[2025-09-26T17:00:01.505737] [INFO ] [MAIN ] Using last completed trading day: 2025-09-26 [2025-09-26T17:00:01.506242] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-26T17:00:01.506357] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-26T17:00:01.506399] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-26T17:00:03.010060] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-09-26T17:00:03.010243] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-26T17:00:03.010448] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-26T17:00:03.011265] [INFO ] [LOCAL ] Symbols cache updated with 2371 symbols. [2025-09-26T17:00:03.011328] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-26T17:00:03.011362] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-26T17:00:03.011424] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-26T17:00:03.011586] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-26T17:00:03.011982] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-09-26T17:00:03.012027] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-26T17:00:03.012187] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-26T17:00:03.012222] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2371 valid symbols. [2025-09-26T17:00:03.012254] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-26T17:00:03.012285] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-26T17:00:03.035960] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/KLG.csv (symbol KLG no longer active). [2025-09-26T17:00:03.040530] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/PHT.csv (symbol PHT no longer active). [2025-09-26T17:00:03.041010] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-26T17:00:03.063044] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/derivative_storage/KLG.csv (symbol KLG no longer active). [2025-09-26T17:00:03.067181] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/derivative_storage/PHT.csv (symbol PHT no longer active). [2025-09-26T17:00:03.067615] [INFO ] [LOCAL ] Deleted 4 obsolete data files. [2025-09-26T17:00:03.067696] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-26T17:00:03.067750] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-26T17:00:03.067782] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-26T17:00:03.068097] [WARN ] [STATE ] State set to: RUNNING [2025-09-26T17:00:03.068264] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-26T17:00:03.068693] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-09-26T17:00:03.068747] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-26T17:00:03.068782] [INFO ] [MAIN ] Starting incremental update for 2371 symbols. [2025-09-26T17:00:03.068813] [INFO ] [MAIN ] Running in parallel mode [2025-09-26T17:00:03.068930] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2371 symbols [2025-09-26T17:00:03.769035] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:00:03.826440] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:00:03.846097] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:00:03.851238] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-09-26T17:00:03.851152] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:00:03.854434] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-09-26T17:00:03.854491] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-09-26T17:00:03.854340] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-09-26T17:00:03.854716] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-09-26T17:00:03.854891] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-26T17:00:03.854950] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-26T17:00:03.855011] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-09-26T17:00:03.855094] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-26T17:00:03.854986] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-09-26T17:00:03.855221] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-26T17:00:03.869058] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-09-26T17:00:04.660142] [DEBUG] [LOCAL ] AA: Loaded 54004 existing records from primary storage. [2025-09-26T17:00:04.693184] [INFO ] [MAIN ] AA: Loaded 54004 existing records. [2025-09-26T17:00:04.724324] [DEBUG] [LOCAL ] A: Loaded 51143 existing records from primary storage. [2025-09-26T17:00:04.728312] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:00:04.728485] [INFO ] [MAIN ] A: Loaded 51143 existing records. [2025-09-26T17:00:04.756584] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-09-26T17:00:05.065023] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:00:05.098306] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-09-26T17:00:05.216776] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:00:05.236010] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-09-26T17:00:05.261711] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:00:05.261501] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-09-26T17:00:05.262124] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-09-26T17:00:05.262252] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-09-26T17:00:05.264147] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-09-26T17:00:05.264184] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-09-26T17:00:05.264341] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-09-26T17:00:05.264409] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-09-26T17:00:05.448983] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-26T17:00:05.439954] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:00:05.505701] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-09-26T17:00:05.510929] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-09-26T17:00:05.524784] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-01. [2025-09-26T17:00:06.022282] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-26T17:00:06.063921] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-09-26T17:00:06.145216] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:00:06.146799] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-12. [2025-09-26T17:00:06.172157] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:00:06.173473] [INFO ] [REMOTE ] A: Fetching primary data for 2024-12. [2025-09-26T17:00:06.511186] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-26T17:00:06.512410] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-09-26T17:00:06.674901] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-26T17:00:06.679196] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-02. [2025-09-26T17:00:06.787932] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-26T17:00:06.788924] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-09-26T17:00:07.584457] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-26T17:00:07.585492] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-09-26T17:00:07.627557] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-26T17:00:07.638735] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-09-26T17:00:07.651359] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-26T17:00:07.656337] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-03. [2025-09-26T17:00:07.817609] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-26T17:00:07.829223] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-09-26T17:00:07.882191] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-26T17:00:07.883084] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-09-26T17:00:08.202962] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-26T17:00:08.204112] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-09-26T17:00:08.477113] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-09-26T17:00:08.478094] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-09-26T17:00:08.833315] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-26T17:00:08.839096] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-04. [2025-09-26T17:00:08.935228] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-26T17:00:08.936462] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-09-26T17:00:09.349184] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-26T17:00:09.350802] [INFO ] [REMOTE ] AAM: Full fetch complete (966 records). [2025-09-26T17:00:09.351395] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-09-26T17:00:09.352565] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-26T17:00:09.353545] [FATAL] [VALIDATOR ] AAM: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:00:09.370639] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:00:09.371510] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:00:09.371680] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-26T17:00:09.372488] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-26T17:00:09.372604] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-09-26T17:00:09.372952] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-09-26T17:00:09.373205] [INFO ] [MAIN ] Update Progress: 1/2371 symbols completed. AAM took 6.3s. Estimated remaining: 4h 9m 1s. Rate: 9.5 symbols/min [2025-09-26T17:00:09.374346] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-09-26T17:00:09.590848] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:00:09.634485] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-26T17:00:09.647180] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-09-26T17:00:09.705454] [DEBUG] [LOCAL ] AAP: Loaded 52464 existing records from primary storage. [2025-09-26T17:00:09.705674] [INFO ] [MAIN ] AAP: Loaded 52464 existing records. [2025-09-26T17:00:09.914463] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:00:09.914888] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-09-26T17:00:09.914955] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-09-26T17:00:09.922203] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-09-26T17:00:09.932266] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-09-26T17:00:09.938794] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-26T17:00:10.024872] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-05. [2025-09-26T17:00:10.332137] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:00:10.332518] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-12. [2025-09-26T17:00:10.906404] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-26T17:00:10.917789] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-09-26T17:00:10.933628] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-26T17:00:10.939911] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-06. [2025-09-26T17:00:11.664205] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-26T17:00:11.676927] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-09-26T17:00:11.851211] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-26T17:00:11.862843] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-09-26T17:00:12.075067] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-26T17:00:12.081767] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-07. [2025-09-26T17:00:12.487463] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-26T17:00:12.500562] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-09-26T17:00:13.310280] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-26T17:00:13.322492] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-09-26T17:00:13.353121] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-26T17:00:13.360940] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-08. [2025-09-26T17:00:13.431991] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T17:00:13.443620] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-09-26T17:00:13.963201] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-26T17:00:13.975664] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-09-26T17:00:14.181794] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-26T17:00:14.187875] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-09. [2025-09-26T17:00:14.794091] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-26T17:00:14.806021] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-09-26T17:00:15.065097] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-26T17:00:15.077724] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-09-26T17:00:15.261723] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-26T17:00:15.274331] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-09-26T17:00:16.133614] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-26T17:00:16.140032] [INFO ] [REMOTE ] AAMI: Full fetch complete (30735 records). [2025-09-26T17:00:16.140152] [DEBUG] [VALIDATOR ] AAMI: Validating primary data. [2025-09-26T17:00:16.395277] [WARN ] [VALIDATOR ] AAMI: Validation failed - insufficient historical data. Have 184 unique days, need 200 days [2025-09-26T17:00:16.395753] [FATAL] [MAIN ] AAMI: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:00:16.395877] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:00:16.396170] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-26T17:00:16.396288] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-26T17:00:16.396340] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-09-26T17:00:16.396529] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-09-26T17:00:16.397112] [INFO ] [MAIN ] Update Progress: 2/2371 symbols completed. AAMI took 13.3s. Estimated remaining: 4h 23m 7s. Rate: 9.0 symbols/min [2025-09-26T17:00:16.614430] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:00:16.666225] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-26T17:00:16.697974] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-26T17:00:16.711120] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-09-26T17:00:16.721406] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-09-26T17:00:16.739118] [DEBUG] [LOCAL ] AAT: Loaded 30881 existing records from primary storage. [2025-09-26T17:00:16.739288] [INFO ] [MAIN ] AAT: Loaded 30881 existing records. [2025-09-26T17:00:16.965345] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:00:16.965838] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-09-26T17:00:16.965914] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-09-26T17:00:16.967340] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-09-26T17:00:16.967415] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-09-26T17:00:17.394240] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-09-26T17:00:17.508128] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-09-26T17:00:17.516318] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:00:17.518824] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-12. [2025-09-26T17:00:18.138832] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-26T17:00:18.157066] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-09-26T17:00:18.206298] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-26T17:00:18.221378] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-09-26T17:00:18.866584] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-26T17:00:18.872766] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-09-26T17:00:19.766855] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-26T17:00:19.779001] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-09-26T17:00:20.408005] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-26T17:00:20.427440] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-09-26T17:00:20.701607] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (3.19 seconds). [2025-09-26T17:00:20.713878] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-09-26T17:00:20.787105] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-26T17:00:20.793518] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-09-26T17:00:22.255066] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-26T17:00:22.267384] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-09-26T17:00:22.334722] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-09-26T17:00:22.348274] [INFO ] [REMOTE ] A: Full fetch complete (73040 records). [2025-09-26T17:00:22.348502] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-09-26T17:00:22.800852] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-09-26T17:00:22.801072] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-09-26T17:00:22.802243] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-09-26T17:00:22.802481] [DEBUG] [LOCAL ] A: Saving primary data. [2025-09-26T17:00:22.819020] [DEBUG] [LOCAL ] A: Trimmed 73040 records to 51487 (keeping 200 days of data) [2025-09-26T17:00:22.820278] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-26T17:00:22.827536] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-09-26T17:00:22.934869] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-26T17:00:22.988376] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-09-26T17:00:23.240386] [DEBUG] [LOCAL ] A: Primary data saved (51487 records). [2025-09-26T17:00:23.240561] [INFO ] [MAIN ] A: Full history saved. [2025-09-26T17:00:23.241300] [INFO ] [MAIN ] Update Progress: 3/2371 symbols completed. A took 20.2s. Estimated remaining: 4h 25m 23s. Rate: 8.9 symbols/min [2025-09-26T17:00:23.445237] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:00:23.445449] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-09-26T17:00:23.445507] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-09-26T17:00:23.445700] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-09-26T17:00:23.445756] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-26T17:00:23.445803] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-26T17:00:23.445839] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-09-26T17:00:23.852409] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:00:23.853526] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-09-26T17:00:23.890394] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-26T17:00:23.898394] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-09-26T17:00:23.930801] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-26T17:00:23.945526] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-09-26T17:00:24.064194] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:00:24.064559] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-09-26T17:00:24.065190] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-01. [2025-09-26T17:00:24.281267] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:00:24.281597] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-01 [2025-09-26T17:00:24.282087] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-02. [2025-09-26T17:00:24.435337] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-26T17:00:24.448301] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-09-26T17:00:24.498060] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:00:24.498487] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-02 [2025-09-26T17:00:24.498988] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-03. [2025-09-26T17:00:24.710778] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:00:24.711137] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-03 [2025-09-26T17:00:24.711778] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-04. [2025-09-26T17:00:24.942125] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:00:24.942457] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-04 [2025-09-26T17:00:24.943083] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-05. [2025-09-26T17:00:24.987801] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-26T17:00:24.997248] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-09-26T17:00:25.081248] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-26T17:00:25.093717] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-09-26T17:00:25.195888] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:00:25.196341] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-05 [2025-09-26T17:00:25.196955] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-06. [2025-09-26T17:00:25.648585] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-26T17:00:25.651050] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-07. [2025-09-26T17:00:25.914423] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-26T17:00:25.922193] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-09-26T17:00:26.190009] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-26T17:00:26.192984] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-08. [2025-09-26T17:00:26.494351] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-26T17:00:26.505420] [INFO ] [REMOTE ] AAP: Full fetch complete (75085 records). [2025-09-26T17:00:26.505721] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-09-26T17:00:26.974194] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-09-26T17:00:27.009451] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-09-26T17:00:27.014498] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-09-26T17:00:27.020103] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-09-26T17:00:27.029126] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-09-26T17:00:27.029514] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-26T17:00:27.062070] [DEBUG] [LOCAL ] AAP: Trimmed 75085 records to 52789 (keeping 200 days of data) [2025-09-26T17:00:27.064613] [INFO ] [REMOTE ] AA: Full fetch complete (77538 records). [2025-09-26T17:00:27.064923] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-09-26T17:00:27.061907] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-09. [2025-09-26T17:00:27.067399] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-26T17:00:27.157182] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-09-26T17:00:27.694275] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-09-26T17:00:27.694944] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-09-26T17:00:27.698124] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-09-26T17:00:27.749541] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-09-26T17:00:27.787817] [DEBUG] [LOCAL ] AA: Trimmed 77538 records to 54394 (keeping 200 days of data) [2025-09-26T17:00:28.178237] [DEBUG] [LOCAL ] AAP: Primary data saved (52789 records). [2025-09-26T17:00:28.179052] [INFO ] [MAIN ] AAP: Full history saved. [2025-09-26T17:00:28.180563] [INFO ] [MAIN ] Update Progress: 4/2371 symbols completed. AAP took 18.8s. Estimated remaining: 4h 7m 40s. Rate: 9.6 symbols/min [2025-09-26T17:00:28.341257] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-26T17:00:28.380467] [INFO ] [REMOTE ] AAUC: Full fetch complete (7698 records). [2025-09-26T17:00:28.399440] [DEBUG] [VALIDATOR ] AAUC: Validating primary data. [2025-09-26T17:00:28.404668] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:00:28.436706] [DEBUG] [LOCAL ] AB: No existing data file found in primary storage. [2025-09-26T17:00:28.447724] [WARN ] [MAIN ] AB: No existing data found, performing full refresh instead. [2025-09-26T17:00:28.472855] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-09-26T17:00:28.506580] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-09-26T17:00:28.536498] [DEBUG] [LOCAL ] AB: No primary data file found to delete. [2025-09-26T17:00:28.537178] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-09-26T17:00:28.691302] [WARN ] [VALIDATOR ] AAUC: Validation failed - insufficient historical data. Have 77 unique days, need 200 days [2025-09-26T17:00:28.697308] [FATAL] [MAIN ] AAUC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:00:28.712023] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:00:28.738696] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-26T17:00:28.739486] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-26T17:00:28.739922] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-09-26T17:00:28.745705] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-09-26T17:00:28.776762] [INFO ] [MAIN ] Update Progress: 5/2371 symbols completed. AAUC took 5.5s. Estimated remaining: 3h 22m 45s. Rate: 11.7 symbols/min [2025-09-26T17:00:28.936012] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-26T17:00:29.058400] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-09-26T17:00:29.312906] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:00:29.423492] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:00:29.424718] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-12. [2025-09-26T17:00:29.456510] [DEBUG] [LOCAL ] AA: Primary data saved (54394 records). [2025-09-26T17:00:29.456740] [INFO ] [MAIN ] AA: Full history saved. [2025-09-26T17:00:29.457390] [INFO ] [MAIN ] Update Progress: 6/2371 symbols completed. AA took 26.4s. Estimated remaining: 2h 53m 21s. Rate: 13.6 symbols/min [2025-09-26T17:00:29.615288] [DEBUG] [LOCAL ] ABBV: Loaded 54076 existing records from primary storage. [2025-09-26T17:00:29.621143] [INFO ] [MAIN ] ABBV: Loaded 54076 existing records. [2025-09-26T17:00:29.792359] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:00:29.807542] [DEBUG] [LOCAL ] ABCB: No existing data file found in primary storage. [2025-09-26T17:00:29.810419] [WARN ] [MAIN ] ABCB: No existing data found, performing full refresh instead. [2025-09-26T17:00:29.810958] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-09-26T17:00:29.816396] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-09-26T17:00:29.826742] [DEBUG] [LOCAL ] ABCB: No primary data file found to delete. [2025-09-26T17:00:29.831932] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-09-26T17:00:30.019946] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:00:30.035674] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-09-26T17:00:30.059793] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-09-26T17:00:30.092206] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-09-26T17:00:30.108354] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-09-26T17:00:30.435486] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:00:30.436781] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-12. [2025-09-26T17:00:30.772833] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:00:30.776149] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-12. [2025-09-26T17:00:30.778741] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-26T17:00:30.804571] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-09-26T17:00:30.809396] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-26T17:00:30.817622] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-09-26T17:00:31.461109] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-26T17:00:31.467400] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-09-26T17:00:31.734377] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-26T17:00:31.740605] [INFO ] [REMOTE ] AAT: Full fetch complete (42487 records). [2025-09-26T17:00:31.740819] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-09-26T17:00:31.741556] [FATAL] [VALIDATOR ] AAT: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:00:31.741682] [FATAL] [MAIN ] AAT: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:00:31.741759] [WARN ] [MAIN ] AAT: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:00:31.741845] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-09-26T17:00:31.741950] [DEBUG] [LOCAL ] AAT: No primary data file found to delete. [2025-09-26T17:00:31.742020] [INFO ] [LOCAL ] AAT: Starting deletion of derivative data. [2025-09-26T17:00:31.743106] [DEBUG] [LOCAL ] AAT: Deleted derivative data file. [2025-09-26T17:00:31.743260] [INFO ] [MAIN ] Update Progress: 7/2371 symbols completed. AAT took 15.3s. Estimated remaining: 2h 41m 24s. Rate: 14.6 symbols/min [2025-09-26T17:00:31.934730] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:00:31.961565] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-26T17:00:31.970954] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-09-26T17:00:32.042287] [DEBUG] [LOCAL ] ABEV: Loaded 53665 existing records from primary storage. [2025-09-26T17:00:32.042543] [INFO ] [MAIN ] ABEV: Loaded 53665 existing records. [2025-09-26T17:00:32.234197] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:00:32.234522] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-09-26T17:00:32.234574] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-09-26T17:00:32.236009] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-09-26T17:00:32.236074] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-09-26T17:00:32.639531] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:00:32.640338] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-12. [2025-09-26T17:00:32.672161] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-26T17:00:32.679613] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-09-26T17:00:32.713117] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-26T17:00:32.725110] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-09-26T17:00:33.100150] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-26T17:00:33.110226] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-09-26T17:00:33.514444] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-26T17:00:33.521254] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-09-26T17:00:34.353972] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-26T17:00:34.364473] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-09-26T17:00:34.578850] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-26T17:00:34.587624] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-09-26T17:00:34.742391] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-26T17:00:34.754110] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-09-26T17:00:35.029261] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-09-26T17:00:35.040520] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-09-26T17:00:35.519913] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-26T17:00:35.529964] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-09-26T17:00:36.101291] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-26T17:00:36.114638] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-09-26T17:00:36.595558] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-26T17:00:36.613302] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-09-26T17:00:36.657506] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-26T17:00:36.665540] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-09-26T17:00:36.774389] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-26T17:00:36.785636] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-09-26T17:00:37.362518] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-26T17:00:37.369941] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-09-26T17:00:37.497194] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-26T17:00:37.503925] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-09-26T17:00:38.115484] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-26T17:00:38.127312] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-09-26T17:00:38.243500] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-26T17:00:38.250233] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-09-26T17:00:38.271947] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-26T17:00:38.278295] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-09-26T17:00:38.493361] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-26T17:00:38.505909] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-09-26T17:00:39.049636] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-26T17:00:39.055107] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-09-26T17:00:39.280577] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-26T17:00:39.288593] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-09-26T17:00:39.901502] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-26T17:00:39.907635] [INFO ] [REMOTE ] AB: Full fetch complete (45903 records). [2025-09-26T17:00:39.907900] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-09-26T17:00:40.361211] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-09-26T17:00:40.361535] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-09-26T17:00:40.362513] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-09-26T17:00:40.362805] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-09-26T17:00:40.403198] [DEBUG] [LOCAL ] AB: Trimmed 45903 records to 28642 (keeping 200 days of data) [2025-09-26T17:00:40.418740] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-09-26T17:00:40.420847] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-26T17:00:40.442416] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-09-26T17:00:40.444837] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-09-26T17:00:40.661980] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-26T17:00:40.676241] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-09-26T17:00:40.688906] [DEBUG] [LOCAL ] AB: Primary data saved (28642 records). [2025-09-26T17:00:40.689072] [INFO ] [MAIN ] AB: Full history saved. [2025-09-26T17:00:40.689166] [INFO ] [MAIN ] Update Progress: 8/2371 symbols completed. AB took 12.5s. Estimated remaining: 3h 5m 12s. Rate: 12.8 symbols/min [2025-09-26T17:00:40.875266] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:00:40.894809] [DEBUG] [LOCAL ] ABG: Loaded 18922 existing records from primary storage. [2025-09-26T17:00:40.894956] [INFO ] [MAIN ] ABG: Loaded 18922 existing records. [2025-09-26T17:00:41.084546] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:00:41.084865] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-09-26T17:00:41.084917] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-09-26T17:00:41.085539] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-09-26T17:00:41.085603] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-09-26T17:00:41.469977] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:00:41.470324] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-12. [2025-09-26T17:00:41.869503] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-26T17:00:41.876585] [INFO ] [REMOTE ] ABCB: Full fetch complete (44442 records). [2025-09-26T17:00:41.876772] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-09-26T17:00:42.359291] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-09-26T17:00:42.359531] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-09-26T17:00:42.360096] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-09-26T17:00:42.360216] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-09-26T17:00:42.396254] [DEBUG] [LOCAL ] ABCB: Trimmed 44442 records to 31144 (keeping 200 days of data) [2025-09-26T17:00:42.398078] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-26T17:00:42.412056] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-09-26T17:00:42.583773] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-26T17:00:42.608758] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-09-26T17:00:42.629680] [DEBUG] [LOCAL ] ABCB: Primary data saved (31144 records). [2025-09-26T17:00:42.630290] [INFO ] [MAIN ] ABCB: Full history saved. [2025-09-26T17:00:42.630559] [INFO ] [MAIN ] Update Progress: 9/2371 symbols completed. ABCB took 13.2s. Estimated remaining: 2h 53m 3s. Rate: 13.6 symbols/min [2025-09-26T17:00:42.868588] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:00:42.901277] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-26T17:00:42.914076] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-09-26T17:00:42.945810] [DEBUG] [LOCAL ] ABM: Loaded 32713 existing records from primary storage. [2025-09-26T17:00:42.945987] [INFO ] [MAIN ] ABM: Loaded 32713 existing records. [2025-09-26T17:00:43.132330] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:00:43.132588] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-09-26T17:00:43.132687] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-09-26T17:00:43.133639] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-09-26T17:00:43.133736] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-09-26T17:00:43.515963] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:00:43.516459] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-12. [2025-09-26T17:00:43.530386] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-26T17:00:43.535430] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-09-26T17:00:43.954456] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-26T17:00:43.967677] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-09-26T17:00:44.302196] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-26T17:00:44.308741] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-09-26T17:00:44.348795] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-26T17:00:44.353277] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-09-26T17:00:44.450406] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-26T17:00:44.462543] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-09-26T17:00:45.101506] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-26T17:00:45.107072] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-09-26T17:00:45.158137] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-26T17:00:45.164768] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-09-26T17:00:45.487126] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-26T17:00:45.499095] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-09-26T17:00:45.993489] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-26T17:00:46.000015] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-09-26T17:00:46.052557] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-26T17:00:46.060808] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-09-26T17:00:46.264814] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-26T17:00:46.277637] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-09-26T17:00:46.755392] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-26T17:00:46.759199] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-09-26T17:00:47.061482] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-26T17:00:47.069204] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-09-26T17:00:47.317899] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-26T17:00:47.330952] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-09-26T17:00:47.433735] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-26T17:00:47.437992] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-09-26T17:00:47.920371] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-26T17:00:47.938924] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-09-26T17:00:48.183830] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-26T17:00:48.193056] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-09-26T17:00:48.273084] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-26T17:00:48.278339] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-09-26T17:00:48.871770] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-26T17:00:48.888436] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-09-26T17:00:49.003393] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-26T17:00:49.009150] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-09-26T17:00:49.124831] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-26T17:00:49.131519] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-09-26T17:00:49.756110] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-26T17:00:49.759888] [INFO ] [REMOTE ] ABG: Full fetch complete (26446 records). [2025-09-26T17:00:49.759990] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-09-26T17:00:50.184279] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-09-26T17:00:50.184999] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-09-26T17:00:50.185555] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-09-26T17:00:50.185686] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-09-26T17:00:50.187239] [DEBUG] [LOCAL ] ABG: Trimmed 26446 records to 19034 (keeping 200 days of data) [2025-09-26T17:00:50.208470] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-26T17:00:50.338011] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-09-26T17:00:50.344487] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-09-26T17:00:50.360911] [INFO ] [REMOTE ] ABBV: Full fetch complete (77719 records). [2025-09-26T17:00:50.361854] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-09-26T17:00:50.787777] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-26T17:00:50.850980] [INFO ] [REMOTE ] ABEV: Full fetch complete (77198 records). [2025-09-26T17:00:50.876473] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-09-26T17:00:50.885414] [DEBUG] [LOCAL ] ABG: Primary data saved (19034 records). [2025-09-26T17:00:50.901735] [INFO ] [MAIN ] ABG: Full history saved. [2025-09-26T17:00:50.905918] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-09-26T17:00:50.906076] [INFO ] [MAIN ] Update Progress: 10/2371 symbols completed. ABG took 10.2s. Estimated remaining: 3h 8m 14s. Rate: 12.5 symbols/min [2025-09-26T17:00:50.906568] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-09-26T17:00:50.913000] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-09-26T17:00:50.921145] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-09-26T17:00:51.085545] [DEBUG] [LOCAL ] ABBV: Trimmed 77719 records to 54465 (keeping 200 days of data) [2025-09-26T17:00:51.375600] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:00:51.822681] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-09-26T17:00:51.824085] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-09-26T17:00:51.825816] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-09-26T17:00:51.826042] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-09-26T17:00:51.851736] [DEBUG] [LOCAL ] ABEV: Trimmed 77198 records to 54055 (keeping 200 days of data) [2025-09-26T17:00:51.858356] [DEBUG] [LOCAL ] ABR: Loaded 52464 existing records from primary storage. [2025-09-26T17:00:51.861067] [INFO ] [MAIN ] ABR: Loaded 52464 existing records. [2025-09-26T17:00:52.241609] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:00:52.245364] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-09-26T17:00:52.250912] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-09-26T17:00:52.255890] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-09-26T17:00:52.256241] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-09-26T17:00:52.835340] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-09-26T17:00:52.875836] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-09-26T17:00:53.018316] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:00:53.026003] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-12. [2025-09-26T17:00:53.082177] [DEBUG] [LOCAL ] ABEV: Primary data saved (54055 records). [2025-09-26T17:00:53.084910] [INFO ] [MAIN ] ABEV: Full history saved. [2025-09-26T17:00:53.088722] [INFO ] [MAIN ] Update Progress: 11/2371 symbols completed. ABEV took 21.3s. Estimated remaining: 2h 58m 52s. Rate: 13.2 symbols/min [2025-09-26T17:00:53.085084] [DEBUG] [LOCAL ] ABBV: Primary data saved (54465 records). [2025-09-26T17:00:53.088930] [INFO ] [MAIN ] ABBV: Full history saved. [2025-09-26T17:00:53.123054] [INFO ] [MAIN ] Update Progress: 12/2371 symbols completed. ABBV took 24.3s. Estimated remaining: 2h 43m 60s. Rate: 14.4 symbols/min [2025-09-26T17:00:53.481566] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:00:53.501764] [DEBUG] [LOCAL ] ABT: No existing data file found in primary storage. [2025-09-26T17:00:53.501589] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:00:53.501885] [WARN ] [MAIN ] ABT: No existing data found, performing full refresh instead. [2025-09-26T17:00:53.502065] [DEBUG] [LOCAL ] ACA: No existing data file found in primary storage. [2025-09-26T17:00:53.502410] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-09-26T17:00:53.502504] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-09-26T17:00:53.502218] [WARN ] [MAIN ] ACA: No existing data found, performing full refresh instead. [2025-09-26T17:00:53.502820] [DEBUG] [LOCAL ] ABT: No primary data file found to delete. [2025-09-26T17:00:53.502907] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-09-26T17:00:53.503015] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-09-26T17:00:53.508255] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-09-26T17:00:53.539047] [DEBUG] [LOCAL ] ACA: No primary data file found to delete. [2025-09-26T17:00:53.574769] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-09-26T17:00:54.286773] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:00:54.303127] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-12. [2025-09-26T17:00:54.364522] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:00:54.365441] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-12. [2025-09-26T17:00:54.388898] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-26T17:00:54.397252] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-09-26T17:00:55.022058] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-26T17:00:55.034909] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-09-26T17:00:55.121519] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-26T17:00:55.126760] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-09-26T17:00:55.700948] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-26T17:00:55.709854] [INFO ] [REMOTE ] ABM: Full fetch complete (44682 records). [2025-09-26T17:00:55.710010] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-09-26T17:00:56.158585] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-09-26T17:00:56.160044] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-09-26T17:00:56.162425] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-09-26T17:00:56.161616] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-26T17:00:56.164625] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-09-26T17:00:56.169710] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-09-26T17:00:56.171932] [DEBUG] [LOCAL ] ABM: Trimmed 44682 records to 32915 (keeping 200 days of data) [2025-09-26T17:00:56.321268] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-26T17:00:56.337431] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-09-26T17:00:56.480796] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-26T17:00:56.494443] [DEBUG] [LOCAL ] ABM: Primary data saved (32915 records). [2025-09-26T17:00:56.494680] [INFO ] [MAIN ] ABM: Full history saved. [2025-09-26T17:00:56.497719] [INFO ] [MAIN ] Update Progress: 13/2371 symbols completed. ABM took 13.9s. Estimated remaining: 2h 41m 31s. Rate: 14.6 symbols/min [2025-09-26T17:00:56.498831] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-09-26T17:00:56.690000] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:00:56.690206] [DEBUG] [LOCAL ] ACCO: No existing data file found in primary storage. [2025-09-26T17:00:56.690245] [WARN ] [MAIN ] ACCO: No existing data found, performing full refresh instead. [2025-09-26T17:00:56.690405] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-09-26T17:00:56.690454] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-09-26T17:00:56.690496] [DEBUG] [LOCAL ] ACCO: No primary data file found to delete. [2025-09-26T17:00:56.690542] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-09-26T17:00:57.081725] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:00:57.082202] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-12. [2025-09-26T17:00:57.099171] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-26T17:00:57.105627] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-09-26T17:00:57.727443] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-26T17:00:57.739216] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-09-26T17:00:57.838581] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-26T17:00:58.262782] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-26T17:00:58.356742] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-09-26T17:00:58.465113] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-26T17:00:59.163917] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-09-26T17:00:59.185514] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-26T17:00:59.715220] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-26T17:00:59.956750] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-09-26T17:01:00.068873] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-26T17:01:00.756742] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-09-26T17:01:01.440742] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-26T17:01:01.556745] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-09-26T17:01:01.799489] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-26T17:01:02.356752] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-09-26T17:01:03.133596] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-26T17:01:03.156681] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-09-26T17:01:03.281457] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-26T17:01:03.956751] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-09-26T17:01:04.659087] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-26T17:01:04.756784] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-09-26T17:01:05.081052] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-26T17:01:05.556750] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-09-26T17:01:06.356735] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-09-26T17:01:06.471377] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-26T17:01:06.939449] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-26T17:01:07.156754] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-09-26T17:01:07.295081] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-26T17:01:07.956755] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-09-26T17:01:08.756765] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-09-26T17:01:08.822090] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-26T17:01:08.945262] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-26T17:01:09.556756] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-09-26T17:01:10.357751] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-09-26T17:01:10.361543] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-26T17:01:10.403521] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-26T17:01:11.156814] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-09-26T17:01:11.598064] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-26T17:01:11.956762] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-09-26T17:01:12.558578] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-26T17:01:12.756791] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-09-26T17:01:13.444667] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-26T17:01:13.556730] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-09-26T17:01:13.827450] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-26T17:01:14.356740] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-09-26T17:01:15.156704] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-09-26T17:01:15.248218] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-26T17:01:15.259341] [INFO ] [REMOTE ] ABT: Full fetch complete (77198 records). [2025-09-26T17:01:15.259706] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-09-26T17:01:15.274921] [FATAL] [VALIDATOR ] ABT: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:01:15.275434] [FATAL] [MAIN ] ABT: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:01:15.276606] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-26T17:01:15.275942] [WARN ] [MAIN ] ABT: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:01:15.282278] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-09-26T17:01:15.282936] [DEBUG] [LOCAL ] ABT: No primary data file found to delete. [2025-09-26T17:01:15.283033] [INFO ] [LOCAL ] ABT: Starting deletion of derivative data. [2025-09-26T17:01:15.283466] [DEBUG] [LOCAL ] ABT: No derivative data file found to delete. [2025-09-26T17:01:15.283573] [INFO ] [MAIN ] Update Progress: 14/2371 symbols completed. ABT took 22.2s. Estimated remaining: 3h 22m 38s. Rate: 11.6 symbols/min [2025-09-26T17:01:15.474161] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:01:15.511406] [DEBUG] [LOCAL ] ACEL: Loaded 27254 existing records from primary storage. [2025-09-26T17:01:15.511574] [INFO ] [MAIN ] ACEL: Loaded 27254 existing records. [2025-09-26T17:01:15.707993] [WARN ] [MAIN ] ACEL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:01:15.708273] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-09-26T17:01:15.708328] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-09-26T17:01:15.709350] [DEBUG] [LOCAL ] ACEL: Deleted primary data file. [2025-09-26T17:01:15.709424] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-09-26T17:01:15.966856] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-09-26T17:01:16.110213] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:01:16.691479] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-26T17:01:16.756743] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-12. [2025-09-26T17:01:16.980173] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-26T17:01:16.984980] [INFO ] [REMOTE ] ACA: Full fetch complete (34298 records). [2025-09-26T17:01:16.985110] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-09-26T17:01:17.388126] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-09-26T17:01:17.388220] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-09-26T17:01:17.388597] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-09-26T17:01:17.388684] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-09-26T17:01:17.389593] [DEBUG] [LOCAL ] ACA: Trimmed 34298 records to 24034 (keeping 200 days of data) [2025-09-26T17:01:17.523745] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-26T17:01:17.563129] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-09-26T17:01:17.581485] [DEBUG] [LOCAL ] ACA: Primary data saved (24034 records). [2025-09-26T17:01:17.581681] [INFO ] [MAIN ] ACA: Full history saved. [2025-09-26T17:01:17.581816] [INFO ] [MAIN ] Update Progress: 15/2371 symbols completed. ACA took 24.4s. Estimated remaining: 3h 15m 3s. Rate: 12.1 symbols/min [2025-09-26T17:01:17.788074] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:01:17.847553] [DEBUG] [LOCAL ] ACHR: Loaded 54208 existing records from primary storage. [2025-09-26T17:01:17.847750] [INFO ] [MAIN ] ACHR: Loaded 54208 existing records. [2025-09-26T17:01:18.046059] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:01:18.046351] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-09-26T17:01:18.046422] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-09-26T17:01:18.048569] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-09-26T17:01:18.048663] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-09-26T17:01:18.361961] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-09-26T17:01:18.427541] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:01:18.875709] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-26T17:01:19.156788] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-12. [2025-09-26T17:01:19.910124] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-26T17:01:19.956751] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-09-26T17:01:20.756764] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-09-26T17:01:21.556759] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-09-26T17:01:21.787126] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-12 (2.63 seconds). [2025-09-26T17:01:21.877183] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-26T17:01:22.025840] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-26T17:01:22.037275] [INFO ] [REMOTE ] ABR: Full fetch complete (74830 records). [2025-09-26T17:01:22.037491] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-09-26T17:01:22.038587] [FATAL] [VALIDATOR ] ABR: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:01:22.038749] [FATAL] [MAIN ] ABR: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:01:22.038835] [WARN ] [MAIN ] ABR: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:01:22.038914] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-09-26T17:01:22.038995] [DEBUG] [LOCAL ] ABR: No primary data file found to delete. [2025-09-26T17:01:22.039035] [INFO ] [LOCAL ] ABR: Starting deletion of derivative data. [2025-09-26T17:01:22.039833] [DEBUG] [LOCAL ] ABR: Deleted derivative data file. [2025-09-26T17:01:22.042703] [INFO ] [MAIN ] Update Progress: 16/2371 symbols completed. ABR took 31.1s. Estimated remaining: 3h 13m 44s. Rate: 12.2 symbols/min [2025-09-26T17:01:22.239241] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:01:22.318383] [DEBUG] [LOCAL ] ACI: Loaded 53659 existing records from primary storage. [2025-09-26T17:01:22.318586] [INFO ] [MAIN ] ACI: Loaded 53659 existing records. [2025-09-26T17:01:22.361961] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-09-26T17:01:22.533015] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:01:22.533538] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-09-26T17:01:22.553589] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-09-26T17:01:22.554968] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-26T17:01:22.560901] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-09-26T17:01:22.561547] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-09-26T17:01:22.964758] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:01:23.156758] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-09-26T17:01:23.882439] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-26T17:01:23.956779] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-09-26T17:01:24.034525] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-26T17:01:24.756733] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-09-26T17:01:25.556762] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-12. [2025-09-26T17:01:26.157495] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-26T17:01:26.356760] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-09-26T17:01:26.544722] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.59 seconds). [2025-09-26T17:01:27.156790] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-09-26T17:01:27.606227] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-26T17:01:27.679457] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-26T17:01:27.956760] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-09-26T17:01:28.650099] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-26T17:01:28.756789] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-09-26T17:01:29.556749] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-09-26T17:01:29.658249] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-26T17:01:30.356773] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-09-26T17:01:31.084625] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-26T17:01:31.091759] [INFO ] [REMOTE ] ACCO: Full fetch complete (53913 records). [2025-09-26T17:01:31.091889] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-09-26T17:01:31.094957] [FATAL] [VALIDATOR ] ACCO: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:01:31.095064] [FATAL] [MAIN ] ACCO: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:01:31.095114] [WARN ] [MAIN ] ACCO: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:01:31.095202] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-09-26T17:01:31.095348] [DEBUG] [LOCAL ] ACCO: No primary data file found to delete. [2025-09-26T17:01:31.095424] [INFO ] [LOCAL ] ACCO: Starting deletion of derivative data. [2025-09-26T17:01:31.095498] [DEBUG] [LOCAL ] ACCO: No derivative data file found to delete. [2025-09-26T17:01:31.095600] [INFO ] [MAIN ] Update Progress: 17/2371 symbols completed. ACCO took 34.6s. Estimated remaining: 3h 23m 9s. Rate: 11.6 symbols/min [2025-09-26T17:01:31.164364] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-09-26T17:01:31.290271] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:01:31.290675] [DEBUG] [LOCAL ] ACM: No existing data file found in primary storage. [2025-09-26T17:01:31.290758] [WARN ] [MAIN ] ACM: No existing data found, performing full refresh instead. [2025-09-26T17:01:31.290973] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-09-26T17:01:31.291120] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-09-26T17:01:31.291263] [DEBUG] [LOCAL ] ACM: No primary data file found to delete. [2025-09-26T17:01:31.291366] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-09-26T17:01:31.709212] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.95 seconds). [2025-09-26T17:01:31.762461] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:01:31.956697] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-09-26T17:01:32.012756] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-26T17:01:32.203729] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-26T17:01:32.756781] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-09-26T17:01:33.556801] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-09-26T17:01:33.942585] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-26T17:01:34.181311] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-26T17:01:34.356787] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-09-26T17:01:34.716808] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-26T17:01:35.156767] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-09-26T17:01:35.254947] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-26T17:01:35.260689] [INFO ] [REMOTE ] ACEL: Full fetch complete (38799 records). [2025-09-26T17:01:35.260851] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-09-26T17:01:35.673056] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-09-26T17:01:35.673141] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-09-26T17:01:35.673582] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-09-26T17:01:35.673671] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-09-26T17:01:35.676331] [DEBUG] [LOCAL ] ACEL: Trimmed 38799 records to 27405 (keeping 200 days of data) [2025-09-26T17:01:35.836872] [DEBUG] [LOCAL ] ACEL: Primary data saved (27405 records). [2025-09-26T17:01:35.837043] [INFO ] [MAIN ] ACEL: Full history saved. [2025-09-26T17:01:35.837154] [INFO ] [MAIN ] Update Progress: 18/2371 symbols completed. ACEL took 20.6s. Estimated remaining: 3h 22m 7s. Rate: 11.6 symbols/min [2025-09-26T17:01:35.961942] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-12. [2025-09-26T17:01:36.020639] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:01:36.020862] [DEBUG] [LOCAL ] ACN: No existing data file found in primary storage. [2025-09-26T17:01:36.020917] [WARN ] [MAIN ] ACN: No existing data found, performing full refresh instead. [2025-09-26T17:01:36.021063] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-09-26T17:01:36.021108] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-09-26T17:01:36.021152] [DEBUG] [LOCAL ] ACN: No primary data file found to delete. [2025-09-26T17:01:36.021185] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-09-26T17:01:36.387761] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:01:36.756797] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-12. [2025-09-26T17:01:37.561264] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-09-26T17:01:37.567424] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-26T17:01:37.829883] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-09-26T17:01:38.356701] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-09-26T17:01:38.892779] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-26T17:01:39.157762] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-09-26T17:01:39.157609] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-26T17:01:39.956805] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-09-26T17:01:40.431957] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-26T17:01:40.621796] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-26T17:01:40.756762] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-09-26T17:01:41.528966] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T17:01:41.556739] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-09-26T17:01:42.356752] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-09-26T17:01:43.166725] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-09-26T17:01:43.175145] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-26T17:01:43.270929] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-09-26T17:01:43.644533] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-26T17:01:43.956789] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-09-26T17:01:44.595218] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-26T17:01:44.756766] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-09-26T17:01:45.195204] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-26T17:01:45.556789] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-09-26T17:01:46.356710] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-09-26T17:01:46.452067] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-26T17:01:46.841815] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-26T17:01:47.156737] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-09-26T17:01:47.956758] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-09-26T17:01:47.999713] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-26T17:01:48.514198] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-26T17:01:48.756764] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-09-26T17:01:49.556758] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-09-26T17:01:50.356773] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-09-26T17:01:50.618496] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-26T17:01:50.917782] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.96 seconds). [2025-09-26T17:01:50.998747] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-26T17:01:51.156745] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-09-26T17:01:51.956756] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-09-26T17:01:52.047595] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-26T17:01:52.741261] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-26T17:01:52.756685] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-09-26T17:01:53.432052] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-26T17:01:53.556735] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-09-26T17:01:54.243606] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T17:01:54.356730] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-09-26T17:01:54.706415] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-26T17:01:55.156796] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-09-26T17:01:55.956834] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-09-26T17:01:56.434672] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-26T17:01:56.701843] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-26T17:01:56.756744] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-09-26T17:01:57.538586] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-26T17:01:57.556791] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-09-26T17:01:58.257521] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-26T17:01:58.269690] [INFO ] [REMOTE ] ACI: Full fetch complete (77048 records). [2025-09-26T17:01:58.269916] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-09-26T17:01:58.362480] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-09-26T17:01:58.786360] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-09-26T17:01:58.786518] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-09-26T17:01:58.787362] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-09-26T17:01:58.787438] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-09-26T17:01:58.789427] [DEBUG] [LOCAL ] ACI: Trimmed 77048 records to 54044 (keeping 200 days of data) [2025-09-26T17:01:59.163391] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-09-26T17:01:59.172497] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-26T17:01:59.201267] [DEBUG] [LOCAL ] ACI: Primary data saved (54044 records). [2025-09-26T17:01:59.201415] [INFO ] [MAIN ] ACI: Full history saved. [2025-09-26T17:01:59.201502] [INFO ] [MAIN ] Update Progress: 19/2371 symbols completed. ACI took 37.2s. Estimated remaining: 3h 59m 36s. Rate: 9.8 symbols/min [2025-09-26T17:01:59.409972] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:01:59.445834] [DEBUG] [LOCAL ] ACP: Loaded 31281 existing records from primary storage. [2025-09-26T17:01:59.445991] [INFO ] [MAIN ] ACP: Loaded 31281 existing records. [2025-09-26T17:01:59.651809] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:01:59.652122] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-09-26T17:01:59.652187] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-09-26T17:01:59.653173] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-09-26T17:01:59.653250] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-09-26T17:01:59.962009] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-09-26T17:02:00.170780] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:02:00.196522] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-26T17:02:00.206402] [INFO ] [REMOTE ] ACM: Full fetch complete (62766 records). [2025-09-26T17:02:00.206555] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-09-26T17:02:00.649178] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-09-26T17:02:00.649326] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-09-26T17:02:00.650144] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-09-26T17:02:00.650270] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-09-26T17:02:00.652063] [DEBUG] [LOCAL ] ACM: Trimmed 62766 records to 43767 (keeping 200 days of data) [2025-09-26T17:02:00.765574] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-12. [2025-09-26T17:02:00.999775] [DEBUG] [LOCAL ] ACM: Primary data saved (43767 records). [2025-09-26T17:02:00.999951] [INFO ] [MAIN ] ACM: Full history saved. [2025-09-26T17:02:01.000043] [INFO ] [MAIN ] Update Progress: 20/2371 symbols completed. ACM took 29.9s. Estimated remaining: 3h 51m 3s. Rate: 10.2 symbols/min [2025-09-26T17:02:01.222595] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:02:01.234801] [DEBUG] [LOCAL ] ACR: Loaded 6320 existing records from primary storage. [2025-09-26T17:02:01.234956] [INFO ] [MAIN ] ACR: Loaded 6320 existing records. [2025-09-26T17:02:01.450407] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:02:01.450712] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-09-26T17:02:01.450772] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-09-26T17:02:01.451095] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-09-26T17:02:01.451157] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-09-26T17:02:01.856255] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:02:01.857146] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-12. [2025-09-26T17:02:02.168054] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-26T17:02:02.290632] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (3.13 seconds). [2025-09-26T17:02:02.302678] [INFO ] [REMOTE ] ACHR: Full fetch complete (77608 records). [2025-09-26T17:02:02.302861] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-09-26T17:02:02.303808] [FATAL] [VALIDATOR ] ACHR: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:02:02.303928] [FATAL] [MAIN ] ACHR: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:02:02.304006] [WARN ] [MAIN ] ACHR: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:02:02.304101] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-09-26T17:02:02.304185] [DEBUG] [LOCAL ] ACHR: No primary data file found to delete. [2025-09-26T17:02:02.304228] [INFO ] [LOCAL ] ACHR: Starting deletion of derivative data. [2025-09-26T17:02:02.304690] [DEBUG] [LOCAL ] ACHR: Deleted derivative data file. [2025-09-26T17:02:02.306135] [INFO ] [MAIN ] Update Progress: 21/2371 symbols completed. ACHR took 44.7s. Estimated remaining: 3h 42m 23s. Rate: 10.6 symbols/min [2025-09-26T17:02:02.366532] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-09-26T17:02:02.507977] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:02:02.508618] [DEBUG] [LOCAL ] ACRE: No existing data file found in primary storage. [2025-09-26T17:02:02.509041] [WARN ] [MAIN ] ACRE: No existing data found, performing full refresh instead. [2025-09-26T17:02:02.509382] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-09-26T17:02:02.509441] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-09-26T17:02:02.509489] [DEBUG] [LOCAL ] ACRE: No primary data file found to delete. [2025-09-26T17:02:02.509566] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-09-26T17:02:02.645864] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-26T17:02:02.790326] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-26T17:02:03.126137] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:02:03.156801] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-12. [2025-09-26T17:02:03.956810] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-09-26T17:02:04.589720] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-26T17:02:04.601176] [INFO ] [REMOTE ] ACN: Full fetch complete (77108 records). [2025-09-26T17:02:04.601343] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-09-26T17:02:04.761333] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-09-26T17:02:05.087939] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-09-26T17:02:05.090073] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-26T17:02:05.090422] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-09-26T17:02:05.100712] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-09-26T17:02:05.100960] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-09-26T17:02:05.103481] [DEBUG] [LOCAL ] ACN: Trimmed 77108 records to 54204 (keeping 200 days of data) [2025-09-26T17:02:05.128574] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-26T17:02:05.370499] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-26T17:02:05.502842] [DEBUG] [LOCAL ] ACN: Primary data saved (54204 records). [2025-09-26T17:02:05.503014] [INFO ] [MAIN ] ACN: Full history saved. [2025-09-26T17:02:05.503114] [INFO ] [MAIN ] Update Progress: 22/2371 symbols completed. ACN took 29.7s. Estimated remaining: 3h 37m 53s. Rate: 10.8 symbols/min [2025-09-26T17:02:05.561875] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-09-26T17:02:05.725509] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:02:05.736163] [DEBUG] [LOCAL ] ACV: Loaded 7016 existing records from primary storage. [2025-09-26T17:02:05.736394] [INFO ] [MAIN ] ACV: Loaded 7016 existing records. [2025-09-26T17:02:05.948686] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:02:05.949110] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-09-26T17:02:05.949175] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-09-26T17:02:05.949618] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-09-26T17:02:05.949758] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-09-26T17:02:06.279098] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-26T17:02:06.361875] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-09-26T17:02:06.367987] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:02:07.053214] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-26T17:02:07.156787] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-09-26T17:02:07.956785] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-09-26T17:02:08.304985] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-26T17:02:08.542840] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-26T17:02:08.756756] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-09-26T17:02:09.556736] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-09-26T17:02:09.931408] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-26T17:02:10.356774] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-12. [2025-09-26T17:02:11.024547] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-26T17:02:11.156781] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-09-26T17:02:11.318783] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-26T17:02:11.823419] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-26T17:02:11.956769] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-09-26T17:02:12.466139] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-26T17:02:12.756769] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-09-26T17:02:13.400215] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-26T17:02:13.556738] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-09-26T17:02:14.356777] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-09-26T17:02:14.380190] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-26T17:02:15.156765] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-09-26T17:02:15.673789] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-26T17:02:15.956773] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-09-26T17:02:16.129246] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-26T17:02:16.756767] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-09-26T17:02:17.221401] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-26T17:02:17.247261] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-26T17:02:17.556735] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-09-26T17:02:18.356810] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-09-26T17:02:18.594441] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-26T17:02:18.721147] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-26T17:02:19.156749] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-09-26T17:02:19.809782] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-26T17:02:19.956781] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-09-26T17:02:20.612632] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-26T17:02:20.756804] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-09-26T17:02:21.556713] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-09-26T17:02:21.639796] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-26T17:02:22.356810] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-09-26T17:02:23.013390] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-26T17:02:23.156788] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-09-26T17:02:23.621395] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-26T17:02:23.956740] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-09-26T17:02:24.131196] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-26T17:02:24.133923] [INFO ] [REMOTE ] ACV: Full fetch complete (9780 records). [2025-09-26T17:02:24.134001] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-09-26T17:02:24.566945] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-09-26T17:02:24.567133] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-09-26T17:02:24.567893] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-09-26T17:02:24.567994] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-09-26T17:02:24.569601] [DEBUG] [LOCAL ] ACV: Trimmed 9780 records to 7095 (keeping 200 days of data) [2025-09-26T17:02:24.632953] [DEBUG] [LOCAL ] ACV: Primary data saved (7095 records). [2025-09-26T17:02:24.633212] [INFO ] [MAIN ] ACV: Full history saved. [2025-09-26T17:02:24.633395] [INFO ] [MAIN ] Update Progress: 23/2371 symbols completed. ACV took 19.1s. Estimated remaining: 4h 0m 52s. Rate: 9.7 symbols/min [2025-09-26T17:02:24.761850] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-09-26T17:02:24.842015] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:02:24.842361] [DEBUG] [LOCAL ] ACVA: No existing data file found in primary storage. [2025-09-26T17:02:24.842448] [WARN ] [MAIN ] ACVA: No existing data found, performing full refresh instead. [2025-09-26T17:02:24.843151] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-09-26T17:02:24.843230] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-09-26T17:02:24.843302] [DEBUG] [LOCAL ] ACVA: No primary data file found to delete. [2025-09-26T17:02:24.843344] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-09-26T17:02:25.052635] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-26T17:02:25.276632] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:02:25.284001] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-26T17:02:25.556756] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-09-26T17:02:26.002032] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-26T17:02:26.356801] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-09-26T17:02:27.156749] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-09-26T17:02:27.761506] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-26T17:02:27.875637] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-26T17:02:27.877124] [INFO ] [REMOTE ] ACR: Full fetch complete (8571 records). [2025-09-26T17:02:27.877203] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-09-26T17:02:27.962078] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-09-26T17:02:28.279522] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-09-26T17:02:28.279637] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-09-26T17:02:28.279978] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-09-26T17:02:28.280046] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-09-26T17:02:28.280542] [DEBUG] [LOCAL ] ACR: Trimmed 8571 records to 6352 (keeping 200 days of data) [2025-09-26T17:02:28.319507] [DEBUG] [LOCAL ] ACR: Primary data saved (6352 records). [2025-09-26T17:02:28.319691] [INFO ] [MAIN ] ACR: Full history saved. [2025-09-26T17:02:28.319874] [INFO ] [MAIN ] Update Progress: 24/2371 symbols completed. ACR took 27.3s. Estimated remaining: 3h 56m 44s. Rate: 9.9 symbols/min [2025-09-26T17:02:28.501294] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:02:28.501535] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-09-26T17:02:28.501582] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-09-26T17:02:28.501795] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-09-26T17:02:28.501853] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-26T17:02:28.501897] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-26T17:02:28.502009] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-09-26T17:02:28.763339] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-09-26T17:02:28.909272] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:02:29.282997] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-26T17:02:29.290203] [INFO ] [REMOTE ] ACP: Full fetch complete (47511 records). [2025-09-26T17:02:29.290383] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-09-26T17:02:29.567225] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-12. [2025-09-26T17:02:29.713265] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-09-26T17:02:29.713360] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-09-26T17:02:29.714080] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-09-26T17:02:29.714152] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-09-26T17:02:29.715726] [DEBUG] [LOCAL ] ACP: Trimmed 47511 records to 31428 (keeping 200 days of data) [2025-09-26T17:02:29.901366] [DEBUG] [LOCAL ] ACP: Primary data saved (31428 records). [2025-09-26T17:02:29.901514] [INFO ] [MAIN ] ACP: Full history saved. [2025-09-26T17:02:29.901605] [INFO ] [MAIN ] Update Progress: 25/2371 symbols completed. ACP took 30.7s. Estimated remaining: 3h 49m 39s. Rate: 10.2 symbols/min [2025-09-26T17:02:30.090778] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:02:30.091028] [DEBUG] [LOCAL ] ADC: No existing data file found in primary storage. [2025-09-26T17:02:30.091073] [WARN ] [MAIN ] ADC: No existing data found, performing full refresh instead. [2025-09-26T17:02:30.091317] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-09-26T17:02:30.091373] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-09-26T17:02:30.091417] [DEBUG] [LOCAL ] ADC: No primary data file found to delete. [2025-09-26T17:02:30.091465] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-09-26T17:02:30.368618] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-09-26T17:02:30.511329] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:02:30.535585] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-26T17:02:30.676065] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:02:30.676402] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-09-26T17:02:31.156789] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-09-26T17:02:31.380916] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-26T17:02:31.956790] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-01. [2025-09-26T17:02:32.111548] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-26T17:02:32.169271] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:02:32.169630] [WARN ] [REMOTE ] AD: No data returned for month 2025-01 [2025-09-26T17:02:32.756783] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-02. [2025-09-26T17:02:32.986448] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:02:32.986826] [WARN ] [REMOTE ] AD: No data returned for month 2025-02 [2025-09-26T17:02:33.556734] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-09-26T17:02:34.356814] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-03. [2025-09-26T17:02:34.584829] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:02:34.585183] [WARN ] [REMOTE ] AD: No data returned for month 2025-03 [2025-09-26T17:02:35.097047] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-26T17:02:35.156708] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-09-26T17:02:35.956737] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-04. [2025-09-26T17:02:36.202789] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:02:36.203157] [WARN ] [REMOTE ] AD: No data returned for month 2025-04 [2025-09-26T17:02:36.679535] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-26T17:02:36.756784] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-09-26T17:02:37.556748] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-05. [2025-09-26T17:02:37.968900] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:02:37.969262] [WARN ] [REMOTE ] AD: No data returned for month 2025-05 [2025-09-26T17:02:37.991972] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-26T17:02:38.356781] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-06. [2025-09-26T17:02:38.597136] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:02:38.597521] [WARN ] [REMOTE ] AD: No data returned for month 2025-06 [2025-09-26T17:02:39.156728] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-07. [2025-09-26T17:02:39.366263] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:02:39.366700] [WARN ] [REMOTE ] AD: No data returned for month 2025-07 [2025-09-26T17:02:39.956762] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-08. [2025-09-26T17:02:40.756771] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-09-26T17:02:41.182859] [INFO ] [REMOTE ] AD: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-26T17:02:41.556736] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-09. [2025-09-26T17:02:42.292370] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T17:02:42.356761] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-09-26T17:02:42.822009] [INFO ] [REMOTE ] AD: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-26T17:02:42.829552] [INFO ] [REMOTE ] AD: Full fetch complete (6577 records). [2025-09-26T17:02:42.829756] [DEBUG] [VALIDATOR ] AD: Validating primary data. [2025-09-26T17:02:43.038923] [WARN ] [VALIDATOR ] AD: Validation failed - insufficient historical data. Have 33 unique days, need 200 days [2025-09-26T17:02:43.039193] [FATAL] [MAIN ] AD: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:02:43.039268] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:02:43.039324] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-26T17:02:43.039424] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-26T17:02:43.039496] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-09-26T17:02:43.039568] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-09-26T17:02:43.039697] [INFO ] [MAIN ] Update Progress: 26/2371 symbols completed. AD took 14.7s. Estimated remaining: 4h 0m 28s. Rate: 9.8 symbols/min [2025-09-26T17:02:43.161923] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-09-26T17:02:43.235230] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:02:43.279783] [DEBUG] [LOCAL ] ADCT: Loaded 34394 existing records from primary storage. [2025-09-26T17:02:43.279972] [INFO ] [MAIN ] ADCT: Loaded 34394 existing records. [2025-09-26T17:02:43.499490] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:02:43.499819] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-09-26T17:02:43.499875] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-09-26T17:02:43.501141] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-09-26T17:02:43.501208] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-09-26T17:02:43.904823] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:02:43.967330] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-12. [2025-09-26T17:02:43.976524] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-26T17:02:44.444318] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-26T17:02:44.756780] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-09-26T17:02:45.248616] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-26T17:02:45.556759] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-12. [2025-09-26T17:02:46.040773] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-26T17:02:46.356771] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-09-26T17:02:47.063760] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-26T17:02:47.156755] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-09-26T17:02:47.450881] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-26T17:02:47.956749] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-09-26T17:02:48.065519] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-26T17:02:48.756756] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-09-26T17:02:49.172393] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-26T17:02:49.556807] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-09-26T17:02:49.868058] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-26T17:02:49.874978] [INFO ] [REMOTE ] ACRE: Full fetch complete (50537 records). [2025-09-26T17:02:49.875186] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-09-26T17:02:50.314931] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-09-26T17:02:50.315029] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-09-26T17:02:50.315559] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-09-26T17:02:50.315607] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-09-26T17:02:50.318733] [DEBUG] [LOCAL ] ACRE: Trimmed 50537 records to 34027 (keeping 200 days of data) [2025-09-26T17:02:50.370573] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-09-26T17:02:50.529475] [DEBUG] [LOCAL ] ACRE: Primary data saved (34027 records). [2025-09-26T17:02:50.529675] [INFO ] [MAIN ] ACRE: Full history saved. [2025-09-26T17:02:50.529789] [INFO ] [MAIN ] Update Progress: 27/2371 symbols completed. ACRE took 48.2s. Estimated remaining: 4h 2m 18s. Rate: 9.7 symbols/min [2025-09-26T17:02:50.716053] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:02:50.716255] [DEBUG] [LOCAL ] ADM: No existing data file found in primary storage. [2025-09-26T17:02:50.716297] [WARN ] [MAIN ] ADM: No existing data found, performing full refresh instead. [2025-09-26T17:02:50.716458] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-09-26T17:02:50.716504] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-09-26T17:02:50.716549] [DEBUG] [LOCAL ] ADM: No primary data file found to delete. [2025-09-26T17:02:50.716587] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-09-26T17:02:51.157057] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-09-26T17:02:51.163894] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:02:51.198432] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-26T17:02:51.524926] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-26T17:02:51.956732] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-12. [2025-09-26T17:02:52.286415] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-26T17:02:52.756733] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-09-26T17:02:53.556739] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-09-26T17:02:53.894048] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-26T17:02:54.356779] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-09-26T17:02:54.476168] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-26T17:02:54.989290] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-26T17:02:55.156796] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-09-26T17:02:55.871130] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-26T17:02:55.956770] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-09-26T17:02:56.512191] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-26T17:02:56.756814] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-09-26T17:02:57.245384] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-26T17:02:57.556773] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-09-26T17:02:58.356747] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-09-26T17:02:58.394467] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-26T17:02:58.926920] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-26T17:02:59.156748] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-09-26T17:02:59.445960] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-26T17:02:59.956758] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-09-26T17:03:00.756726] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-09-26T17:03:00.945753] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-26T17:03:01.204826] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-26T17:03:01.556758] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-09-26T17:03:02.356749] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-09-26T17:03:02.427504] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-26T17:03:02.438072] [INFO ] [REMOTE ] ACVA: Full fetch complete (70254 records). [2025-09-26T17:03:02.438256] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-09-26T17:03:02.904545] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-09-26T17:03:02.904755] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-09-26T17:03:02.905589] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-09-26T17:03:02.905704] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-09-26T17:03:02.907895] [DEBUG] [LOCAL ] ACVA: Trimmed 70254 records to 50072 (keeping 200 days of data) [2025-09-26T17:03:03.031079] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-26T17:03:03.162980] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-09-26T17:03:03.261268] [DEBUG] [LOCAL ] ACVA: Primary data saved (50072 records). [2025-09-26T17:03:03.261449] [INFO ] [MAIN ] ACVA: Full history saved. [2025-09-26T17:03:03.261539] [INFO ] [MAIN ] Update Progress: 28/2371 symbols completed. ACVA took 38.6s. Estimated remaining: 4h 11m 18s. Rate: 9.3 symbols/min [2025-09-26T17:03:03.456250] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:03:03.508233] [DEBUG] [LOCAL ] ADNT: Loaded 47786 existing records from primary storage. [2025-09-26T17:03:03.508394] [INFO ] [MAIN ] ADNT: Loaded 47786 existing records. [2025-09-26T17:03:03.709794] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:03:03.726847] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-09-26T17:03:03.727251] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-09-26T17:03:03.728691] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-26T17:03:03.735330] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-09-26T17:03:03.735565] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-09-26T17:03:03.961887] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-09-26T17:03:04.114160] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:03:04.756703] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-12. [2025-09-26T17:03:04.804216] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-26T17:03:05.249225] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-26T17:03:05.556743] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-09-26T17:03:06.112271] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-26T17:03:06.356791] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-09-26T17:03:07.156755] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-09-26T17:03:07.316922] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-26T17:03:07.956740] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-09-26T17:03:08.223291] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-26T17:03:08.258829] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-26T17:03:08.756737] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-09-26T17:03:09.379276] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-26T17:03:09.556727] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-09-26T17:03:10.356753] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-09-26T17:03:11.156738] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-09-26T17:03:11.243747] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-09-26T17:03:11.383002] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-26T17:03:11.919840] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-09-26T17:03:11.929163] [INFO ] [REMOTE ] ADC: Full fetch complete (66035 records). [2025-09-26T17:03:11.929328] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-09-26T17:03:11.966598] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-09-26T17:03:12.371308] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-09-26T17:03:12.371473] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-09-26T17:03:12.372177] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-09-26T17:03:12.372246] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-09-26T17:03:12.373781] [DEBUG] [LOCAL ] ADC: Trimmed 66035 records to 46934 (keeping 200 days of data) [2025-09-26T17:03:12.678059] [DEBUG] [LOCAL ] ADC: Primary data saved (46934 records). [2025-09-26T17:03:12.678229] [INFO ] [MAIN ] ADC: Full history saved. [2025-09-26T17:03:12.678335] [INFO ] [MAIN ] Update Progress: 29/2371 symbols completed. ADC took 42.8s. Estimated remaining: 4h 15m 13s. Rate: 9.2 symbols/min [2025-09-26T17:03:12.757370] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-09-26T17:03:12.885214] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:03:12.887376] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-26T17:03:12.949215] [DEBUG] [LOCAL ] ADT: Loaded 53866 existing records from primary storage. [2025-09-26T17:03:12.949391] [INFO ] [MAIN ] ADT: Loaded 53866 existing records. [2025-09-26T17:03:13.133775] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:03:13.134067] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-09-26T17:03:13.134133] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-09-26T17:03:13.135918] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-09-26T17:03:13.135986] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-09-26T17:03:13.523047] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-26T17:03:13.565716] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-09-26T17:03:13.572454] [INFO ] [REMOTE ] ADCT: Full fetch complete (51606 records). [2025-09-26T17:03:13.572242] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:03:13.572831] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-09-26T17:03:13.984106] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-09-26T17:03:13.984227] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-09-26T17:03:13.984813] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-09-26T17:03:13.984879] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-09-26T17:03:13.986367] [DEBUG] [LOCAL ] ADCT: Trimmed 51606 records to 34670 (keeping 200 days of data) [2025-09-26T17:03:14.199463] [DEBUG] [LOCAL ] ADCT: Primary data saved (34670 records). [2025-09-26T17:03:14.199773] [INFO ] [MAIN ] ADCT: Full history saved. [2025-09-26T17:03:14.201490] [INFO ] [MAIN ] Update Progress: 30/2371 symbols completed. ADCT took 31.2s. Estimated remaining: 4h 8m 35s. Rate: 9.4 symbols/min [2025-09-26T17:03:14.356966] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-12. [2025-09-26T17:03:14.393046] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:03:14.430466] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-26T17:03:14.467354] [DEBUG] [LOCAL ] ADX: Loaded 28005 existing records from primary storage. [2025-09-26T17:03:14.467507] [INFO ] [MAIN ] ADX: Loaded 28005 existing records. [2025-09-26T17:03:14.657947] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:03:14.658307] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-09-26T17:03:14.658357] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-09-26T17:03:14.659310] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-09-26T17:03:14.659413] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-09-26T17:03:15.048352] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:03:15.080478] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-26T17:03:15.156727] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-09-26T17:03:15.956745] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-09-26T17:03:16.020557] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-26T17:03:16.756767] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-09-26T17:03:16.895535] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-26T17:03:17.556737] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-12. [2025-09-26T17:03:18.031841] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-26T17:03:18.157105] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-26T17:03:18.356733] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-09-26T17:03:18.575320] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-26T17:03:19.156728] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-09-26T17:03:19.956751] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-09-26T17:03:20.316991] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-26T17:03:20.475354] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-26T17:03:20.756790] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-09-26T17:03:21.258266] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-26T17:03:21.556732] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-09-26T17:03:22.356738] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-09-26T17:03:22.792122] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-26T17:03:22.877669] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-26T17:03:22.889227] [INFO ] [REMOTE ] ADM: Full fetch complete (77223 records). [2025-09-26T17:03:22.889415] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-09-26T17:03:23.162898] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-09-26T17:03:23.308796] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-09-26T17:03:23.308909] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-09-26T17:03:23.309702] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-09-26T17:03:23.309775] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-09-26T17:03:23.311516] [DEBUG] [LOCAL ] ADM: Trimmed 77223 records to 54175 (keeping 200 days of data) [2025-09-26T17:03:23.685126] [DEBUG] [LOCAL ] ADM: Primary data saved (54175 records). [2025-09-26T17:03:23.685427] [INFO ] [MAIN ] ADM: Full history saved. [2025-09-26T17:03:23.685880] [INFO ] [MAIN ] Update Progress: 31/2371 symbols completed. ADM took 33.2s. Estimated remaining: 4h 12m 23s. Rate: 9.3 symbols/min [2025-09-26T17:03:23.877974] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:03:23.937318] [DEBUG] [LOCAL ] AEE: Loaded 50500 existing records from primary storage. [2025-09-26T17:03:23.937505] [INFO ] [MAIN ] AEE: Loaded 50500 existing records. [2025-09-26T17:03:23.971327] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-09-26T17:03:24.145465] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:03:24.156611] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-09-26T17:03:24.171668] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-09-26T17:03:24.177507] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-26T17:03:24.187734] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-09-26T17:03:24.188688] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-09-26T17:03:24.304800] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-26T17:03:24.616153] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:03:24.756759] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-12. [2025-09-26T17:03:25.239526] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-26T17:03:25.556757] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-09-26T17:03:25.999468] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-26T17:03:26.356732] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-09-26T17:03:26.944818] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-26T17:03:27.156775] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-09-26T17:03:27.241740] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-26T17:03:27.956752] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-09-26T17:03:28.425904] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-26T17:03:28.756767] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-09-26T17:03:29.114254] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-26T17:03:29.556732] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-09-26T17:03:30.356746] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-09-26T17:03:31.027232] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-09-26T17:03:31.115005] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-26T17:03:31.156772] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-09-26T17:03:31.219459] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-26T17:03:31.956734] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-09-26T17:03:32.756690] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-09-26T17:03:32.802677] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T17:03:32.814078] [INFO ] [REMOTE ] ADNT: Full fetch complete (68058 records). [2025-09-26T17:03:32.814282] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-09-26T17:03:33.140020] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-26T17:03:33.270253] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-09-26T17:03:33.270349] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-09-26T17:03:33.271037] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-09-26T17:03:33.271108] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-09-26T17:03:33.272573] [DEBUG] [LOCAL ] ADNT: Trimmed 68058 records to 48095 (keeping 200 days of data) [2025-09-26T17:03:33.558026] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-09-26T17:03:33.574683] [DEBUG] [LOCAL ] ADNT: Primary data saved (48095 records). [2025-09-26T17:03:33.574952] [INFO ] [MAIN ] ADNT: Full history saved. [2025-09-26T17:03:33.575127] [INFO ] [MAIN ] Update Progress: 32/2371 symbols completed. ADNT took 30.3s. Estimated remaining: 4h 16m 27s. Rate: 9.1 symbols/min [2025-09-26T17:03:33.763381] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:03:33.763577] [DEBUG] [LOCAL ] AEFC: No existing data file found in primary storage. [2025-09-26T17:03:33.763615] [WARN ] [MAIN ] AEFC: No existing data found, performing full refresh instead. [2025-09-26T17:03:33.763785] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-09-26T17:03:33.763828] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-09-26T17:03:33.763870] [DEBUG] [LOCAL ] AEFC: No primary data file found to delete. [2025-09-26T17:03:33.763901] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-09-26T17:03:34.146765] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:03:34.361884] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-12. [2025-09-26T17:03:34.377594] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-26T17:03:35.094043] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-26T17:03:35.156778] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-09-26T17:03:35.366987] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-26T17:03:35.956734] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-09-26T17:03:36.447293] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-26T17:03:36.756745] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-09-26T17:03:37.556745] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-09-26T17:03:37.652522] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-26T17:03:37.681394] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-26T17:03:37.952942] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-26T17:03:38.356737] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-09-26T17:03:38.999159] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-26T17:03:39.156792] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-09-26T17:03:39.932151] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-26T17:03:39.956764] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-09-26T17:03:40.756791] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-09-26T17:03:41.556761] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-09-26T17:03:41.860022] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-26T17:03:42.029570] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-26T17:03:42.055916] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-26T17:03:42.356738] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-09-26T17:03:43.156729] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-09-26T17:03:43.175427] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-26T17:03:43.956787] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-09-26T17:03:44.756811] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-09-26T17:03:44.832704] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-26T17:03:45.004202] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-26T17:03:45.010281] [INFO ] [REMOTE ] ADX: Full fetch complete (42107 records). [2025-09-26T17:03:45.010428] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-09-26T17:03:45.398376] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-09-26T17:03:45.398505] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-09-26T17:03:45.399058] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-09-26T17:03:45.399135] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-09-26T17:03:45.400698] [DEBUG] [LOCAL ] ADX: Trimmed 42107 records to 28180 (keeping 200 days of data) [2025-09-26T17:03:45.486381] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-26T17:03:45.557304] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-09-26T17:03:45.615013] [DEBUG] [LOCAL ] ADX: Primary data saved (28180 records). [2025-09-26T17:03:45.615232] [INFO ] [MAIN ] ADX: Full history saved. [2025-09-26T17:03:45.616691] [INFO ] [MAIN ] Update Progress: 33/2371 symbols completed. ADX took 31.4s. Estimated remaining: 4h 22m 47s. Rate: 8.9 symbols/min [2025-09-26T17:03:45.793215] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:03:45.793446] [DEBUG] [LOCAL ] AEG: No existing data file found in primary storage. [2025-09-26T17:03:45.793483] [WARN ] [MAIN ] AEG: No existing data found, performing full refresh instead. [2025-09-26T17:03:45.793638] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-09-26T17:03:45.793732] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-09-26T17:03:45.793803] [DEBUG] [LOCAL ] AEG: No primary data file found to delete. [2025-09-26T17:03:45.793840] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-09-26T17:03:46.179103] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:03:46.356726] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-09-26T17:03:46.369719] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-26T17:03:47.156809] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-09-26T17:03:47.956816] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-09-26T17:03:48.126033] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-26T17:03:48.164821] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-26T17:03:48.756753] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-09-26T17:03:49.371475] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-26T17:03:49.408728] [INFO ] [REMOTE ] AEFC: Full fetch complete (12319 records). [2025-09-26T17:03:49.409936] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-09-26T17:03:49.412024] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-26T17:03:49.561919] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-12. [2025-09-26T17:03:49.909846] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-09-26T17:03:49.909962] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-09-26T17:03:49.910297] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-09-26T17:03:49.910338] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-09-26T17:03:49.910951] [DEBUG] [LOCAL ] AEFC: Trimmed 12319 records to 8643 (keeping 200 days of data) [2025-09-26T17:03:49.968046] [DEBUG] [LOCAL ] AEFC: Primary data saved (8643 records). [2025-09-26T17:03:49.968258] [INFO ] [MAIN ] AEFC: Full history saved. [2025-09-26T17:03:49.968357] [INFO ] [MAIN ] Update Progress: 34/2371 symbols completed. AEFC took 16.4s. Estimated remaining: 4h 19m 56s. Rate: 9.0 symbols/min [2025-09-26T17:03:50.143973] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:03:50.144164] [DEBUG] [LOCAL ] AEM: No existing data file found in primary storage. [2025-09-26T17:03:50.144224] [WARN ] [MAIN ] AEM: No existing data found, performing full refresh instead. [2025-09-26T17:03:50.144375] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-09-26T17:03:50.144418] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-09-26T17:03:50.144460] [DEBUG] [LOCAL ] AEM: No primary data file found to delete. [2025-09-26T17:03:50.144492] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-09-26T17:03:50.361798] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-09-26T17:03:50.516151] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:03:51.026467] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-26T17:03:51.156758] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-09-26T17:03:51.845383] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-26T17:03:51.956679] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-09-26T17:03:52.756775] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-09-26T17:03:52.798964] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-26T17:03:53.373585] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-26T17:03:53.556770] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-09-26T17:03:54.356737] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-12. [2025-09-26T17:03:54.721538] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-26T17:03:55.156750] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-09-26T17:03:55.280676] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-26T17:03:55.866521] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-26T17:03:55.956777] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-09-26T17:03:56.670168] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-26T17:03:56.681598] [INFO ] [REMOTE ] ADT: Full fetch complete (77204 records). [2025-09-26T17:03:56.681825] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-09-26T17:03:56.762677] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-09-26T17:03:57.127343] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-09-26T17:03:57.127448] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-09-26T17:03:57.128301] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-09-26T17:03:57.128369] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-09-26T17:03:57.130135] [DEBUG] [LOCAL ] ADT: Trimmed 77204 records to 54253 (keeping 200 days of data) [2025-09-26T17:03:57.485794] [DEBUG] [LOCAL ] ADT: Primary data saved (54253 records). [2025-09-26T17:03:57.486203] [INFO ] [MAIN ] ADT: Full history saved. [2025-09-26T17:03:57.486511] [INFO ] [MAIN ] Update Progress: 35/2371 symbols completed. ADT took 44.8s. Estimated remaining: 4h 20m 46s. Rate: 9.0 symbols/min [2025-09-26T17:03:57.560947] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-09-26T17:03:57.716444] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:03:57.720601] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-26T17:03:57.789337] [DEBUG] [LOCAL ] AEO: Loaded 53946 existing records from primary storage. [2025-09-26T17:03:57.789519] [INFO ] [MAIN ] AEO: Loaded 53946 existing records. [2025-09-26T17:03:57.982166] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:03:57.982522] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-09-26T17:03:57.982615] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-09-26T17:03:57.984122] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-09-26T17:03:57.984184] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-09-26T17:03:58.359099] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-09-26T17:03:58.359000] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:03:58.397828] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-26T17:03:58.409323] [INFO ] [REMOTE ] AEE: Full fetch complete (72553 records). [2025-09-26T17:03:58.409563] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-09-26T17:03:58.836130] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-09-26T17:03:58.836228] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-09-26T17:03:58.836957] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-09-26T17:03:58.837058] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-09-26T17:03:58.838805] [DEBUG] [LOCAL ] AEE: Trimmed 72553 records to 50875 (keeping 200 days of data) [2025-09-26T17:03:59.156890] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-12. [2025-09-26T17:03:59.175091] [DEBUG] [LOCAL ] AEE: Primary data saved (50875 records). [2025-09-26T17:03:59.175313] [INFO ] [MAIN ] AEE: Full history saved. [2025-09-26T17:03:59.176756] [INFO ] [MAIN ] Update Progress: 36/2371 symbols completed. AEE took 35.5s. Estimated remaining: 4h 15m 14s. Rate: 9.1 symbols/min [2025-09-26T17:03:59.368465] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:03:59.368746] [DEBUG] [LOCAL ] AER: No existing data file found in primary storage. [2025-09-26T17:03:59.368820] [WARN ] [MAIN ] AER: No existing data found, performing full refresh instead. [2025-09-26T17:03:59.368976] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-09-26T17:03:59.369021] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-09-26T17:03:59.369064] [DEBUG] [LOCAL ] AER: No primary data file found to delete. [2025-09-26T17:03:59.369102] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-09-26T17:03:59.805799] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:03:59.808936] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-09-26T17:03:59.956736] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-12. [2025-09-26T17:04:00.060913] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-26T17:04:00.709961] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-26T17:04:00.756727] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-09-26T17:04:01.417062] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-26T17:04:01.556743] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-09-26T17:04:02.074226] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-26T17:04:02.356752] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-09-26T17:04:03.156698] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-09-26T17:04:03.197294] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-26T17:04:03.956730] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-09-26T17:04:04.026708] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-26T17:04:04.717208] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-26T17:04:04.756696] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-09-26T17:04:05.365982] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-26T17:04:05.556766] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-09-26T17:04:06.356768] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-09-26T17:04:06.464716] [DEBUG] [REMOTE ] AER: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-26T17:04:06.465270] [WARN ] [REMOTE ] AER: No data returned for month 2025-02 [2025-09-26T17:04:06.741304] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-26T17:04:06.828919] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-26T17:04:07.156739] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-09-26T17:04:07.956779] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-09-26T17:04:08.756819] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-09-26T17:04:08.917335] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-26T17:04:09.292746] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-26T17:04:09.556748] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-09-26T17:04:09.951663] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-26T17:04:10.356758] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-09-26T17:04:11.156734] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-09-26T17:04:11.473863] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-26T17:04:11.870491] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-26T17:04:11.956783] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-09-26T17:04:12.715793] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-26T17:04:12.756733] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-09-26T17:04:13.556722] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-09-26T17:04:13.946481] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-26T17:04:14.356739] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-09-26T17:04:14.667334] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-26T17:04:15.156746] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-09-26T17:04:15.716708] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-26T17:04:15.956730] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-09-26T17:04:16.195266] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-26T17:04:16.205460] [INFO ] [REMOTE ] AEG: Full fetch complete (70286 records). [2025-09-26T17:04:16.205619] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-09-26T17:04:16.696134] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-09-26T17:04:16.696253] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-09-26T17:04:16.697098] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-09-26T17:04:16.697212] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-09-26T17:04:16.698888] [DEBUG] [LOCAL ] AEG: Trimmed 70286 records to 50307 (keeping 200 days of data) [2025-09-26T17:04:16.758330] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-09-26T17:04:16.954284] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-26T17:04:17.067566] [DEBUG] [LOCAL ] AEG: Primary data saved (50307 records). [2025-09-26T17:04:17.067758] [INFO ] [MAIN ] AEG: Full history saved. [2025-09-26T17:04:17.067877] [INFO ] [MAIN ] Update Progress: 37/2371 symbols completed. AEG took 31.5s. Estimated remaining: 4h 27m 3s. Rate: 8.7 symbols/min [2025-09-26T17:04:17.556779] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-09-26T17:04:18.212384] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-26T17:04:18.356779] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-09-26T17:04:18.577332] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-26T17:04:18.868857] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-26T17:04:19.156774] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-09-26T17:04:19.904698] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-26T17:04:19.956695] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-09-26T17:04:20.241860] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-26T17:04:20.756788] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-09-26T17:04:21.477192] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-26T17:04:21.487820] [INFO ] [REMOTE ] AEM: Full fetch complete (76755 records). [2025-09-26T17:04:21.488003] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-09-26T17:04:21.490522] [FATAL] [VALIDATOR ] AEM: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:04:21.490636] [FATAL] [MAIN ] AEM: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:04:21.490719] [WARN ] [MAIN ] AEM: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:04:21.490794] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-09-26T17:04:21.490867] [DEBUG] [LOCAL ] AEM: No primary data file found to delete. [2025-09-26T17:04:21.490918] [INFO ] [LOCAL ] AEM: Starting deletion of derivative data. [2025-09-26T17:04:21.491003] [DEBUG] [LOCAL ] AEM: No derivative data file found to delete. [2025-09-26T17:04:21.491099] [INFO ] [MAIN ] Update Progress: 38/2371 symbols completed. AEM took 31.5s. Estimated remaining: 4h 24m 26s. Rate: 8.8 symbols/min [2025-09-26T17:04:21.556775] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-09-26T17:04:22.310584] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T17:04:22.356705] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-09-26T17:04:22.626180] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-26T17:04:23.156791] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-09-26T17:04:24.353033] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-26T17:04:24.366013] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-09-26T17:04:24.791033] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-26T17:04:24.800966] [INFO ] [REMOTE ] AER: Full fetch complete (62826 records). [2025-09-26T17:04:24.801117] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-09-26T17:04:25.015881] [WARN ] [VALIDATOR ] AER: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-26T17:04:25.016606] [FATAL] [MAIN ] AER: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:04:25.016705] [WARN ] [MAIN ] AER: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:04:25.016780] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-09-26T17:04:25.016912] [DEBUG] [LOCAL ] AER: No primary data file found to delete. [2025-09-26T17:04:25.016977] [INFO ] [LOCAL ] AER: Starting deletion of derivative data. [2025-09-26T17:04:25.017087] [DEBUG] [LOCAL ] AER: No derivative data file found to delete. [2025-09-26T17:04:25.017182] [INFO ] [MAIN ] Update Progress: 39/2371 symbols completed. AER took 25.8s. Estimated remaining: 4h 21m 3s. Rate: 8.9 symbols/min [2025-09-26T17:04:26.200105] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-26T17:04:26.212850] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-09-26T17:04:29.195617] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (2.98 seconds). [2025-09-26T17:04:29.206769] [INFO ] [REMOTE ] AEO: Full fetch complete (77444 records). [2025-09-26T17:04:29.206929] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-09-26T17:04:29.636057] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-09-26T17:04:29.636163] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-09-26T17:04:29.636954] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-09-26T17:04:29.637081] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-09-26T17:04:29.638842] [DEBUG] [LOCAL ] AEO: Trimmed 77444 records to 54336 (keeping 200 days of data) [2025-09-26T17:04:29.983352] [DEBUG] [LOCAL ] AEO: Primary data saved (54336 records). [2025-09-26T17:04:29.983532] [INFO ] [MAIN ] AEO: Full history saved. [2025-09-26T17:04:29.983671] [INFO ] [MAIN ] Update Progress: 40/2371 symbols completed. AEO took 32.5s. Estimated remaining: 4h 19m 14s. Rate: 9.0 symbols/min [2025-09-26T17:04:30.720137] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:04:30.741535] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:04:30.742389] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:04:30.740213] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:04:30.743027] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-09-26T17:04:30.743742] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-09-26T17:04:30.743886] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-09-26T17:04:30.743927] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-09-26T17:04:30.743969] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-09-26T17:04:30.744001] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-09-26T17:04:30.884628] [DEBUG] [LOCAL ] AFB: Loaded 11386 existing records from primary storage. [2025-09-26T17:04:30.922358] [INFO ] [MAIN ] AFB: Loaded 11386 existing records. [2025-09-26T17:04:31.216446] [DEBUG] [LOCAL ] AESI: Loaded 49853 existing records from primary storage. [2025-09-26T17:04:31.319844] [DEBUG] [LOCAL ] AES: Loaded 54061 existing records from primary storage. [2025-09-26T17:04:31.320020] [INFO ] [MAIN ] AESI: Loaded 49853 existing records. [2025-09-26T17:04:31.398593] [INFO ] [MAIN ] AES: Loaded 54061 existing records. [2025-09-26T17:04:31.488418] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:04:31.521585] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:04:31.541399] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2024-12. [2025-09-26T17:04:31.619852] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-09-26T17:04:31.665020] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-09-26T17:04:31.725784] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-09-26T17:04:31.761523] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-09-26T17:04:31.855793] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:04:31.890676] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:04:31.926554] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-09-26T17:04:31.926195] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:04:31.938589] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-09-26T17:04:31.948373] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-09-26T17:04:31.948281] [WARN ] [REMOTE ] AEXA: No data returned for month 2024-12 [2025-09-26T17:04:31.964118] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-09-26T17:04:31.969876] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2025-01. [2025-09-26T17:04:31.964059] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-09-26T17:04:31.981325] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-09-26T17:04:31.993902] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-09-26T17:04:31.993726] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-09-26T17:04:32.292811] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:04:32.375537] [WARN ] [REMOTE ] AEXA: No data returned for month 2025-01 [2025-09-26T17:04:32.409762] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2025-02. [2025-09-26T17:04:32.827996] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:04:32.843032] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:04:32.864399] [WARN ] [REMOTE ] AEXA: No data returned for month 2025-02 [2025-09-26T17:04:32.895833] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-12. [2025-09-26T17:04:32.906577] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2025-03. [2025-09-26T17:04:33.097338] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:04:33.098874] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-12. [2025-09-26T17:04:33.125677] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:04:33.126318] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-12. [2025-09-26T17:04:33.196755] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:04:33.197146] [WARN ] [REMOTE ] AEXA: No data returned for month 2025-03 [2025-09-26T17:04:33.197621] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2025-04. [2025-09-26T17:04:33.394455] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:04:33.394808] [WARN ] [REMOTE ] AEXA: No data returned for month 2025-04 [2025-09-26T17:04:33.395299] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2025-05. [2025-09-26T17:04:33.612402] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:04:33.612832] [WARN ] [REMOTE ] AEXA: No data returned for month 2025-05 [2025-09-26T17:04:33.613441] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2025-06. [2025-09-26T17:04:33.851825] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:04:33.852194] [WARN ] [REMOTE ] AEXA: No data returned for month 2025-06 [2025-09-26T17:04:33.852691] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2025-07. [2025-09-26T17:04:33.958739] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-26T17:04:34.047372] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:04:34.047734] [WARN ] [REMOTE ] AEXA: No data returned for month 2025-07 [2025-09-26T17:04:34.356718] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-09-26T17:04:34.763389] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-26T17:04:34.858014] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-26T17:04:34.894870] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T17:04:35.156731] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-09-26T17:04:35.956729] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-09-26T17:04:36.604373] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-26T17:04:36.756703] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-09-26T17:04:36.942670] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-26T17:04:37.556741] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2025-08. [2025-09-26T17:04:37.757614] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:04:37.757979] [WARN ] [REMOTE ] AEXA: No data returned for month 2025-08 [2025-09-26T17:04:38.320563] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-26T17:04:38.356690] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-09-26T17:04:39.156727] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2025-09. [2025-09-26T17:04:39.397457] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:04:39.397827] [WARN ] [REMOTE ] AEXA: No data returned for month 2025-09 [2025-09-26T17:04:39.397944] [INFO ] [REMOTE ] AEXA: Full fetch complete (0 records). [2025-09-26T17:04:39.398023] [DEBUG] [VALIDATOR ] AEXA: Validating primary data. [2025-09-26T17:04:39.398103] [WARN ] [VALIDATOR ] AEXA: No data provided for validation! [2025-09-26T17:04:39.398190] [FATAL] [MAIN ] AEXA: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:04:39.398267] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:04:39.398361] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-09-26T17:04:39.398459] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-09-26T17:04:39.398518] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-09-26T17:04:39.398704] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-09-26T17:04:39.398785] [INFO ] [MAIN ] Update Progress: 41/2371 symbols completed. AEXA took 9.4s. Estimated remaining: 4h 21m 44s. Rate: 8.9 symbols/min [2025-09-26T17:04:39.606527] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:04:39.659346] [DEBUG] [LOCAL ] AFG: Loaded 32808 existing records from primary storage. [2025-09-26T17:04:39.659528] [INFO ] [MAIN ] AFG: Loaded 32808 existing records. [2025-09-26T17:04:39.858199] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:04:39.858635] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-09-26T17:04:39.858778] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-09-26T17:04:39.859896] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-09-26T17:04:39.859963] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-09-26T17:04:39.961840] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-09-26T17:04:40.021726] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-26T17:04:40.287268] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:04:40.756757] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-09-26T17:04:41.556759] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-12. [2025-09-26T17:04:41.907493] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-26T17:04:42.285511] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-26T17:04:42.356705] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-09-26T17:04:42.552401] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-26T17:04:42.915799] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-26T17:04:43.156755] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-09-26T17:04:43.956697] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-09-26T17:04:44.078759] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-26T17:04:44.756739] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-09-26T17:04:45.466514] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-26T17:04:45.556700] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-09-26T17:04:45.665280] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-26T17:04:46.101752] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-26T17:04:46.356726] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-09-26T17:04:47.156715] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-09-26T17:04:47.196826] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-26T17:04:47.956723] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-09-26T17:04:48.756720] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-09-26T17:04:48.956729] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-26T17:04:49.518102] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-26T17:04:49.556723] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-09-26T17:04:49.673909] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-26T17:04:50.334030] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-26T17:04:50.356686] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-09-26T17:04:51.156733] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-09-26T17:04:51.621099] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-26T17:04:51.623988] [INFO ] [REMOTE ] AFB: Full fetch complete (16499 records). [2025-09-26T17:04:51.624085] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-09-26T17:04:51.961806] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-09-26T17:04:52.026626] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-09-26T17:04:52.026810] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-09-26T17:04:52.027194] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-09-26T17:04:52.027269] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-09-26T17:04:52.027931] [DEBUG] [LOCAL ] AFB: Trimmed 16499 records to 11422 (keeping 200 days of data) [2025-09-26T17:04:52.100201] [DEBUG] [LOCAL ] AFB: Primary data saved (11422 records). [2025-09-26T17:04:52.100361] [INFO ] [MAIN ] AFB: Full history saved. [2025-09-26T17:04:52.100455] [INFO ] [MAIN ] Update Progress: 42/2371 symbols completed. AFB took 22.1s. Estimated remaining: 4h 27m 7s. Rate: 8.7 symbols/min [2025-09-26T17:04:52.275762] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:04:52.280984] [DEBUG] [LOCAL ] AFGB: Loaded 2394 existing records from primary storage. [2025-09-26T17:04:52.281075] [INFO ] [MAIN ] AFGB: Loaded 2394 existing records. [2025-09-26T17:04:52.466839] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:04:52.467134] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-09-26T17:04:52.467219] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-09-26T17:04:52.467471] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-09-26T17:04:52.467531] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-09-26T17:04:52.760400] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-09-26T17:04:52.871998] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:04:53.249109] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-26T17:04:53.281300] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-26T17:04:53.556723] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-09-26T17:04:54.126582] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-26T17:04:54.356735] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-09-26T17:04:55.156725] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-09-26T17:04:55.312195] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-26T17:04:55.951530] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-26T17:04:55.959396] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-09-26T17:04:56.730798] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-26T17:04:56.756737] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-09-26T17:04:57.556740] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-09-26T17:04:57.844552] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-26T17:04:58.169106] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-26T17:04:58.356770] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-09-26T17:04:58.834333] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-26T17:04:59.156733] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-12. [2025-09-26T17:04:59.762724] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-26T17:04:59.822188] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-26T17:04:59.956769] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-09-26T17:05:00.756776] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-09-26T17:05:01.556759] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-09-26T17:05:02.132078] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-26T17:05:02.344039] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-26T17:05:02.356706] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-09-26T17:05:02.861419] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-26T17:05:03.156691] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-09-26T17:05:03.275235] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T17:05:03.285571] [INFO ] [REMOTE ] AESI: Full fetch complete (69961 records). [2025-09-26T17:05:03.285765] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-09-26T17:05:03.286806] [FATAL] [VALIDATOR ] AESI: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:05:03.286900] [FATAL] [MAIN ] AESI: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:05:03.286946] [WARN ] [MAIN ] AESI: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:05:03.286986] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-09-26T17:05:03.287111] [DEBUG] [LOCAL ] AESI: No primary data file found to delete. [2025-09-26T17:05:03.287167] [INFO ] [LOCAL ] AESI: Starting deletion of derivative data. [2025-09-26T17:05:03.287811] [DEBUG] [LOCAL ] AESI: Deleted derivative data file. [2025-09-26T17:05:03.287951] [INFO ] [MAIN ] Update Progress: 43/2371 symbols completed. AESI took 33.3s. Estimated remaining: 4h 30m 54s. Rate: 8.6 symbols/min [2025-09-26T17:05:03.477419] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:05:03.482330] [DEBUG] [LOCAL ] AFGC: Loaded 2590 existing records from primary storage. [2025-09-26T17:05:03.482440] [INFO ] [MAIN ] AFGC: Loaded 2590 existing records. [2025-09-26T17:05:03.673830] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:05:03.674148] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-09-26T17:05:03.674198] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-09-26T17:05:03.674512] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-09-26T17:05:03.674574] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-09-26T17:05:03.965249] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-09-26T17:05:04.094189] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:05:04.756785] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-09-26T17:05:04.942845] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-26T17:05:05.202029] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-26T17:05:05.556768] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-12. [2025-09-26T17:05:05.593614] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-26T17:05:06.080714] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-26T17:05:06.356821] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-09-26T17:05:06.927231] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-26T17:05:07.156748] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-09-26T17:05:07.956724] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-09-26T17:05:08.091767] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-26T17:05:08.318450] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-26T17:05:08.756774] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-09-26T17:05:09.327738] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-26T17:05:09.556755] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-09-26T17:05:09.992296] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-26T17:05:10.356771] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-09-26T17:05:11.156704] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-09-26T17:05:11.407062] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-26T17:05:11.418435] [INFO ] [REMOTE ] AES: Full fetch complete (77722 records). [2025-09-26T17:05:11.418612] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-09-26T17:05:11.883796] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-09-26T17:05:11.883953] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-09-26T17:05:11.884754] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-09-26T17:05:11.884827] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-09-26T17:05:11.886480] [DEBUG] [LOCAL ] AES: Trimmed 77722 records to 54450 (keeping 200 days of data) [2025-09-26T17:05:11.957228] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-09-26T17:05:12.243826] [DEBUG] [LOCAL ] AES: Primary data saved (54450 records). [2025-09-26T17:05:12.243990] [INFO ] [MAIN ] AES: Full history saved. [2025-09-26T17:05:12.246890] [INFO ] [MAIN ] Update Progress: 44/2371 symbols completed. AES took 42.3s. Estimated remaining: 4h 32m 31s. Rate: 8.5 symbols/min [2025-09-26T17:05:12.437556] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:05:12.442213] [DEBUG] [LOCAL ] AFGD: Loaded 1852 existing records from primary storage. [2025-09-26T17:05:12.442318] [INFO ] [MAIN ] AFGD: Loaded 1852 existing records. [2025-09-26T17:05:12.664242] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:05:12.667445] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-09-26T17:05:12.667201] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-26T17:05:12.667626] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-09-26T17:05:12.675533] [INFO ] [REMOTE ] AFG: Full fetch complete (45743 records). [2025-09-26T17:05:12.675600] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-09-26T17:05:12.675901] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-09-26T17:05:12.675841] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-09-26T17:05:12.780099] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-09-26T17:05:13.476376] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:05:13.498555] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-26T17:05:13.518729] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-09-26T17:05:13.518802] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-09-26T17:05:13.519299] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-09-26T17:05:13.519341] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-09-26T17:05:13.520373] [DEBUG] [LOCAL ] AFG: Trimmed 45743 records to 33021 (keeping 200 days of data) [2025-09-26T17:05:13.578096] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-09-26T17:05:13.739891] [DEBUG] [LOCAL ] AFG: Primary data saved (33021 records). [2025-09-26T17:05:13.740062] [INFO ] [MAIN ] AFG: Full history saved. [2025-09-26T17:05:13.745761] [INFO ] [MAIN ] Update Progress: 45/2371 symbols completed. AFG took 34.3s. Estimated remaining: 4h 27m 39s. Rate: 8.7 symbols/min [2025-09-26T17:05:13.929770] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:05:13.935376] [DEBUG] [LOCAL ] AFGE: Loaded 2508 existing records from primary storage. [2025-09-26T17:05:13.935492] [INFO ] [MAIN ] AFGE: Loaded 2508 existing records. [2025-09-26T17:05:14.126243] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:05:14.126509] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-09-26T17:05:14.126602] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-09-26T17:05:14.127064] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-09-26T17:05:14.127125] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-09-26T17:05:14.215840] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-26T17:05:14.361916] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-09-26T17:05:14.541392] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:05:14.946044] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-26T17:05:15.156774] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-12. [2025-09-26T17:05:15.406939] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (3.45 seconds). [2025-09-26T17:05:15.794557] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-26T17:05:15.956789] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-09-26T17:05:16.424123] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-26T17:05:16.756771] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-12. [2025-09-26T17:05:17.208670] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-26T17:05:17.556729] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-09-26T17:05:18.160367] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-26T17:05:18.356740] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-09-26T17:05:18.845501] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-26T17:05:19.156782] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-09-26T17:05:19.666553] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-26T17:05:19.956771] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-09-26T17:05:20.530773] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-26T17:05:20.756787] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-09-26T17:05:21.254366] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-26T17:05:21.255554] [INFO ] [REMOTE ] AFGB: Full fetch complete (3649 records). [2025-09-26T17:05:21.255676] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-09-26T17:05:21.599109] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-09-26T17:05:21.686398] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-09-26T17:05:21.686707] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-09-26T17:05:21.686872] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-09-26T17:05:21.686934] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-09-26T17:05:21.687349] [DEBUG] [LOCAL ] AFGB: Trimmed 3649 records to 2404 (keeping 200 days of data) [2025-09-26T17:05:21.702545] [DEBUG] [LOCAL ] AFGB: Primary data saved (2404 records). [2025-09-26T17:05:21.702624] [INFO ] [MAIN ] AFGB: Full history saved. [2025-09-26T17:05:21.702754] [INFO ] [MAIN ] Update Progress: 46/2371 symbols completed. AFGB took 29.6s. Estimated remaining: 4h 28m 25s. Rate: 8.7 symbols/min [2025-09-26T17:05:21.884974] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:05:21.947168] [DEBUG] [LOCAL ] AFL: Loaded 53532 existing records from primary storage. [2025-09-26T17:05:21.947341] [INFO ] [MAIN ] AFL: Loaded 53532 existing records. [2025-09-26T17:05:22.075106] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-26T17:05:22.165413] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:05:22.165752] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-09-26T17:05:22.165812] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-09-26T17:05:22.167784] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-09-26T17:05:22.167851] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-09-26T17:05:22.365609] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-09-26T17:05:22.561893] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:05:22.845379] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-26T17:05:23.156755] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-09-26T17:05:23.610418] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-26T17:05:23.956737] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-09-26T17:05:24.414881] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-26T17:05:24.756806] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-09-26T17:05:25.268506] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-26T17:05:25.556751] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-09-26T17:05:26.254948] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-26T17:05:26.356740] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-09-26T17:05:26.672910] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-26T17:05:27.156795] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-09-26T17:05:27.593018] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-26T17:05:27.956747] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-09-26T17:05:28.548482] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-26T17:05:28.756765] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-09-26T17:05:29.201417] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-26T17:05:29.556726] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-09-26T17:05:29.962226] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-26T17:05:30.356759] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-12. [2025-09-26T17:05:31.156937] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-09-26T17:05:31.719845] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-26T17:05:31.721186] [INFO ] [REMOTE ] AFGD: Full fetch complete (3178 records). [2025-09-26T17:05:31.721261] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-09-26T17:05:31.961840] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-09-26T17:05:32.153274] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-09-26T17:05:32.153410] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-09-26T17:05:32.153688] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-09-26T17:05:32.153809] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-09-26T17:05:32.155092] [DEBUG] [LOCAL ] AFGD: Trimmed 3178 records to 1859 (keeping 200 days of data) [2025-09-26T17:05:32.168681] [DEBUG] [LOCAL ] AFGD: Primary data saved (1859 records). [2025-09-26T17:05:32.168898] [INFO ] [MAIN ] AFGD: Full history saved. [2025-09-26T17:05:32.169104] [INFO ] [MAIN ] Update Progress: 47/2371 symbols completed. AFGD took 19.9s. Estimated remaining: 4h 31m 13s. Rate: 8.6 symbols/min [2025-09-26T17:05:32.399862] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-26T17:05:32.443807] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:05:32.505058] [DEBUG] [LOCAL ] AG: Loaded 54033 existing records from primary storage. [2025-09-26T17:05:32.505260] [INFO ] [MAIN ] AG: Loaded 54033 existing records. [2025-09-26T17:05:32.740349] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-26T17:05:32.740541] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:05:32.743235] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-09-26T17:05:32.743305] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-09-26T17:05:32.745170] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-09-26T17:05:32.745262] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-09-26T17:05:32.761854] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-09-26T17:05:33.183729] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:05:33.469463] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-26T17:05:33.556729] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-12. [2025-09-26T17:05:34.356747] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-09-26T17:05:34.813513] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-26T17:05:35.156758] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-09-26T17:05:35.460099] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-26T17:05:35.956756] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-09-26T17:05:36.719368] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-26T17:05:36.756690] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-09-26T17:05:37.556721] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-09-26T17:05:37.617989] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-26T17:05:38.120746] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-26T17:05:38.356743] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-09-26T17:05:38.431587] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-26T17:05:39.156778] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-09-26T17:05:39.667754] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-26T17:05:39.669476] [INFO ] [REMOTE ] AFGC: Full fetch complete (3727 records). [2025-09-26T17:05:39.669556] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-09-26T17:05:39.961951] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-09-26T17:05:40.064424] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-09-26T17:05:40.064599] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-09-26T17:05:40.064824] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-09-26T17:05:40.065003] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-09-26T17:05:40.065536] [DEBUG] [LOCAL ] AFGC: Trimmed 3727 records to 2602 (keeping 200 days of data) [2025-09-26T17:05:40.082483] [DEBUG] [LOCAL ] AFGC: Primary data saved (2602 records). [2025-09-26T17:05:40.082584] [INFO ] [MAIN ] AFGC: Full history saved. [2025-09-26T17:05:40.082698] [INFO ] [MAIN ] Update Progress: 48/2371 symbols completed. AFGC took 36.8s. Estimated remaining: 4h 31m 50s. Rate: 8.5 symbols/min [2025-09-26T17:05:40.308447] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-26T17:05:40.317913] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:05:40.337615] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-26T17:05:40.387250] [DEBUG] [LOCAL ] AGCO: Loaded 42791 existing records from primary storage. [2025-09-26T17:05:40.387475] [INFO ] [MAIN ] AGCO: Loaded 42791 existing records. [2025-09-26T17:05:40.594994] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:05:40.595284] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-09-26T17:05:40.595335] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-09-26T17:05:40.596913] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-09-26T17:05:40.596979] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-09-26T17:05:40.763832] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-09-26T17:05:41.030691] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:05:41.556769] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-09-26T17:05:42.060929] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-26T17:05:42.356747] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-09-26T17:05:42.640502] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-26T17:05:43.156737] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-09-26T17:05:43.680373] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-26T17:05:43.681378] [INFO ] [REMOTE ] AFGE: Full fetch complete (3486 records). [2025-09-26T17:05:43.681452] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-09-26T17:05:43.681868] [FATAL] [VALIDATOR ] AFGE: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:05:43.682009] [FATAL] [MAIN ] AFGE: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:05:43.682056] [WARN ] [MAIN ] AFGE: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:05:43.682096] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-09-26T17:05:43.682155] [DEBUG] [LOCAL ] AFGE: No primary data file found to delete. [2025-09-26T17:05:43.682192] [INFO ] [LOCAL ] AFGE: Starting deletion of derivative data. [2025-09-26T17:05:43.682826] [DEBUG] [LOCAL ] AFGE: Deleted derivative data file. [2025-09-26T17:05:43.682929] [INFO ] [MAIN ] Update Progress: 49/2371 symbols completed. AFGE took 29.9s. Estimated remaining: 4h 29m 1s. Rate: 8.6 symbols/min [2025-09-26T17:05:43.873941] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:05:43.895717] [DEBUG] [LOCAL ] AGD: Loaded 17874 existing records from primary storage. [2025-09-26T17:05:43.895864] [INFO ] [MAIN ] AGD: Loaded 17874 existing records. [2025-09-26T17:05:43.958343] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-12. [2025-09-26T17:05:44.138590] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:05:44.139284] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-09-26T17:05:44.139507] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-09-26T17:05:44.140772] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-09-26T17:05:44.140858] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-09-26T17:05:44.434979] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-26T17:05:44.641074] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:05:44.756787] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-09-26T17:05:45.556728] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-09-26T17:05:45.629986] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-26T17:05:46.279329] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T17:05:46.356782] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-09-26T17:05:47.156736] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-12. [2025-09-26T17:05:47.396042] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-26T17:05:47.754133] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-26T17:05:47.809009] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-26T17:05:47.956784] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-09-26T17:05:48.756782] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-09-26T17:05:49.531784] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-26T17:05:49.556709] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-09-26T17:05:49.595866] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-26T17:05:50.356777] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-09-26T17:05:50.914337] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-26T17:05:51.156759] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-09-26T17:05:51.956715] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-09-26T17:05:52.440108] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-26T17:05:52.570043] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-26T17:05:52.594184] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-26T17:05:52.756780] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-09-26T17:05:53.556779] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-09-26T17:05:54.368290] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-09-26T17:05:54.376098] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-26T17:05:54.399240] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-26T17:05:55.156765] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-09-26T17:05:55.956729] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-09-26T17:05:56.470771] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-26T17:05:56.756773] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-09-26T17:05:56.818533] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-26T17:05:57.021538] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-26T17:05:57.556737] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-09-26T17:05:58.356807] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-09-26T17:05:58.496930] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-26T17:05:58.694800] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-26T17:05:59.156778] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-09-26T17:05:59.392375] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-26T17:05:59.956734] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-09-26T17:06:00.589779] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-26T17:06:00.756775] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-09-26T17:06:01.181032] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-26T17:06:01.556789] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-09-26T17:06:02.356785] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-09-26T17:06:02.760372] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-26T17:06:02.913430] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-26T17:06:02.925005] [INFO ] [REMOTE ] AFL: Full fetch complete (76535 records). [2025-09-26T17:06:02.925283] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-09-26T17:06:02.931314] [FATAL] [VALIDATOR ] AFL: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:06:02.931496] [FATAL] [MAIN ] AFL: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:06:02.931586] [WARN ] [MAIN ] AFL: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:06:02.931727] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-09-26T17:06:02.931831] [DEBUG] [LOCAL ] AFL: No primary data file found to delete. [2025-09-26T17:06:02.931899] [INFO ] [LOCAL ] AFL: Starting deletion of derivative data. [2025-09-26T17:06:02.932570] [DEBUG] [LOCAL ] AFL: Deleted derivative data file. [2025-09-26T17:06:02.932794] [INFO ] [MAIN ] Update Progress: 50/2371 symbols completed. AFL took 41.2s. Estimated remaining: 4h 38m 25s. Rate: 8.3 symbols/min [2025-09-26T17:06:03.132684] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:06:03.156741] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-09-26T17:06:03.209636] [DEBUG] [LOCAL ] AGI: Loaded 53807 existing records from primary storage. [2025-09-26T17:06:03.209847] [INFO ] [MAIN ] AGI: Loaded 53807 existing records. [2025-09-26T17:06:03.414706] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:06:03.414995] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-09-26T17:06:03.415045] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-09-26T17:06:03.416613] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-09-26T17:06:03.416952] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-09-26T17:06:03.812456] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:06:03.845756] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-26T17:06:03.878334] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-26T17:06:03.956745] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-12. [2025-09-26T17:06:04.756734] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-09-26T17:06:05.556745] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-09-26T17:06:05.789445] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-26T17:06:06.356731] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-09-26T17:06:06.464416] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-26T17:06:06.473312] [INFO ] [REMOTE ] AGCO: Full fetch complete (61985 records). [2025-09-26T17:06:06.473519] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-09-26T17:06:06.930428] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-09-26T17:06:06.926731] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-26T17:06:06.930613] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-09-26T17:06:06.936821] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-09-26T17:06:06.937082] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-09-26T17:06:06.939725] [DEBUG] [LOCAL ] AGCO: Trimmed 61985 records to 43086 (keeping 200 days of data) [2025-09-26T17:06:07.177415] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-09-26T17:06:07.239357] [DEBUG] [LOCAL ] AGCO: Primary data saved (43086 records). [2025-09-26T17:06:07.239522] [INFO ] [MAIN ] AGCO: Full history saved. [2025-09-26T17:06:07.239623] [INFO ] [MAIN ] Update Progress: 51/2371 symbols completed. AGCO took 27.2s. Estimated remaining: 4h 36m 6s. Rate: 8.4 symbols/min [2025-09-26T17:06:07.440795] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:06:07.500143] [DEBUG] [LOCAL ] AGL: Loaded 52810 existing records from primary storage. [2025-09-26T17:06:07.500309] [INFO ] [MAIN ] AGL: Loaded 52810 existing records. [2025-09-26T17:06:07.688436] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:06:07.688745] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-09-26T17:06:07.688818] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-09-26T17:06:07.690274] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-09-26T17:06:07.690340] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-09-26T17:06:07.962999] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-09-26T17:06:08.083509] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:06:08.242589] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-26T17:06:08.756781] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-09-26T17:06:08.855137] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-26T17:06:08.967666] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-26T17:06:09.556744] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-09-26T17:06:10.356741] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-12. [2025-09-26T17:06:10.542169] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-26T17:06:11.126634] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-26T17:06:11.156694] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-09-26T17:06:11.684619] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-26T17:06:11.956762] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-09-26T17:06:12.747697] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-26T17:06:12.758991] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-09-26T17:06:13.556723] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-09-26T17:06:13.718594] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-26T17:06:13.723403] [INFO ] [REMOTE ] AGD: Full fetch complete (25388 records). [2025-09-26T17:06:13.723521] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-09-26T17:06:14.142768] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-09-26T17:06:14.142856] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-09-26T17:06:14.143219] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-09-26T17:06:14.143296] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-09-26T17:06:14.144197] [DEBUG] [LOCAL ] AGD: Trimmed 25388 records to 17937 (keeping 200 days of data) [2025-09-26T17:06:14.270971] [DEBUG] [LOCAL ] AGD: Primary data saved (17937 records). [2025-09-26T17:06:14.271164] [INFO ] [MAIN ] AGD: Full history saved. [2025-09-26T17:06:14.271307] [INFO ] [MAIN ] Update Progress: 52/2371 symbols completed. AGD took 30.6s. Estimated remaining: 4h 35m 54s. Rate: 8.4 symbols/min [2025-09-26T17:06:14.361793] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-09-26T17:06:14.462280] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:06:14.475190] [DEBUG] [LOCAL ] AGM: Loaded 9994 existing records from primary storage. [2025-09-26T17:06:14.475313] [INFO ] [MAIN ] AGM: Loaded 9994 existing records. [2025-09-26T17:06:14.678692] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:06:14.679269] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-09-26T17:06:14.679495] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-09-26T17:06:14.680042] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-09-26T17:06:14.680106] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-09-26T17:06:15.044374] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (3.09 seconds). [2025-09-26T17:06:15.108502] [INFO ] [REMOTE ] AG: Full fetch complete (77586 records). [2025-09-26T17:06:15.119527] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-09-26T17:06:15.148760] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:06:15.191826] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-12. [2025-09-26T17:06:15.588326] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-09-26T17:06:15.588449] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-09-26T17:06:15.589398] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-09-26T17:06:15.589558] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-09-26T17:06:15.623857] [DEBUG] [LOCAL ] AG: Trimmed 77586 records to 54423 (keeping 200 days of data) [2025-09-26T17:06:15.623677] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-26T17:06:15.759163] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-26T17:06:15.910830] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-26T17:06:15.989000] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-09-26T17:06:16.043485] [DEBUG] [LOCAL ] AG: Primary data saved (54423 records). [2025-09-26T17:06:16.043661] [INFO ] [MAIN ] AG: Full history saved. [2025-09-26T17:06:16.045121] [INFO ] [MAIN ] Update Progress: 53/2371 symbols completed. AG took 43.9s. Estimated remaining: 4h 31m 52s. Rate: 8.5 symbols/min [2025-09-26T17:06:16.228742] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:06:16.267807] [DEBUG] [LOCAL ] AGO: Loaded 28247 existing records from primary storage. [2025-09-26T17:06:16.267987] [INFO ] [MAIN ] AGO: Loaded 28247 existing records. [2025-09-26T17:06:16.465176] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:06:16.465543] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-09-26T17:06:16.465627] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-09-26T17:06:16.466779] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-09-26T17:06:16.466855] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-09-26T17:06:16.764781] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-09-26T17:06:16.862450] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:06:17.459540] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-26T17:06:17.556725] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-09-26T17:06:18.356744] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-09-26T17:06:18.428720] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-26T17:06:18.808308] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-26T17:06:18.900107] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-26T17:06:19.156759] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-09-26T17:06:19.956962] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-12. [2025-09-26T17:06:20.740062] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-26T17:06:20.756679] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-09-26T17:06:20.860886] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-26T17:06:21.556736] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-09-26T17:06:22.271755] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-26T17:06:22.356740] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-09-26T17:06:22.815838] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-26T17:06:23.158873] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-09-26T17:06:23.175499] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-26T17:06:23.956714] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-09-26T17:06:24.079551] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-26T17:06:24.756735] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-09-26T17:06:25.556731] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-09-26T17:06:25.633930] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-26T17:06:25.671251] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-26T17:06:26.071637] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-26T17:06:26.356735] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-09-26T17:06:27.156733] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-09-26T17:06:27.614965] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-26T17:06:27.956731] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-09-26T17:06:28.700259] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-26T17:06:28.756778] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-09-26T17:06:28.846500] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-26T17:06:29.556752] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-09-26T17:06:30.356712] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-09-26T17:06:30.394060] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-26T17:06:30.539350] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-26T17:06:31.156712] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-09-26T17:06:31.480348] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-26T17:06:31.956748] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-09-26T17:06:32.756761] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-09-26T17:06:33.181176] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-26T17:06:33.556699] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-09-26T17:06:33.933174] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-26T17:06:33.936294] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-26T17:06:33.955126] [INFO ] [REMOTE ] AGL: Full fetch complete (75474 records). [2025-09-26T17:06:33.955328] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-09-26T17:06:34.360955] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-09-26T17:06:34.385358] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-09-26T17:06:34.385461] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-09-26T17:06:34.386229] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-09-26T17:06:34.386412] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-09-26T17:06:34.388175] [DEBUG] [LOCAL ] AGL: Trimmed 75474 records to 53191 (keeping 200 days of data) [2025-09-26T17:06:34.703238] [DEBUG] [LOCAL ] AGL: Primary data saved (53191 records). [2025-09-26T17:06:34.703476] [INFO ] [MAIN ] AGL: Full history saved. [2025-09-26T17:06:34.703610] [INFO ] [MAIN ] Update Progress: 54/2371 symbols completed. AGL took 27.5s. Estimated remaining: 4h 40m 4s. Rate: 8.3 symbols/min [2025-09-26T17:06:34.884281] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:06:34.918217] [DEBUG] [LOCAL ] AGRO: Loaded 33927 existing records from primary storage. [2025-09-26T17:06:34.918385] [INFO ] [MAIN ] AGRO: Loaded 33927 existing records. [2025-09-26T17:06:35.131730] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:06:35.132190] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-09-26T17:06:35.132271] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-09-26T17:06:35.133431] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-09-26T17:06:35.133513] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-09-26T17:06:35.164867] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-09-26T17:06:35.435915] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-26T17:06:35.579329] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:06:35.762954] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-26T17:06:35.956741] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-12. [2025-09-26T17:06:36.140174] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-26T17:06:36.756733] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-09-26T17:06:37.141558] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-26T17:06:37.346957] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-26T17:06:37.556726] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-09-26T17:06:38.345244] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-26T17:06:38.356674] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-09-26T17:06:39.076494] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-26T17:06:39.079112] [INFO ] [REMOTE ] AGM: Full fetch complete (12620 records). [2025-09-26T17:06:39.079212] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-09-26T17:06:39.161870] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-09-26T17:06:39.469444] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-09-26T17:06:39.469533] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-09-26T17:06:39.469833] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-09-26T17:06:39.469903] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-09-26T17:06:39.470724] [DEBUG] [LOCAL ] AGM: Trimmed 12620 records to 10125 (keeping 200 days of data) [2025-09-26T17:06:39.542550] [DEBUG] [LOCAL ] AGM: Primary data saved (10125 records). [2025-09-26T17:06:39.542744] [INFO ] [MAIN ] AGM: Full history saved. [2025-09-26T17:06:39.542850] [INFO ] [MAIN ] Update Progress: 55/2371 symbols completed. AGM took 25.3s. Estimated remaining: 4h 38m 15s. Rate: 8.3 symbols/min [2025-09-26T17:06:39.724280] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:06:39.778978] [DEBUG] [LOCAL ] AGX: Loaded 33628 existing records from primary storage. [2025-09-26T17:06:39.779201] [INFO ] [MAIN ] AGX: Loaded 33628 existing records. [2025-09-26T17:06:39.965500] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-09-26T17:06:39.972533] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:06:39.974137] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-09-26T17:06:39.974212] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-09-26T17:06:39.975402] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-09-26T17:06:39.975485] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-09-26T17:06:40.369047] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:06:40.399774] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-26T17:06:40.756727] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-09-26T17:06:40.987053] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-26T17:06:41.556742] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-12. [2025-09-26T17:06:41.720836] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-26T17:06:42.356780] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-09-26T17:06:42.627819] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-26T17:06:43.156751] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-09-26T17:06:43.956764] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-09-26T17:06:44.137586] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-26T17:06:44.273383] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-26T17:06:44.278929] [INFO ] [REMOTE ] AGO: Full fetch complete (39304 records). [2025-09-26T17:06:44.279049] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-09-26T17:06:44.705318] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-09-26T17:06:44.705444] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-09-26T17:06:44.705967] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-09-26T17:06:44.706035] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-09-26T17:06:44.707211] [DEBUG] [LOCAL ] AGO: Trimmed 39304 records to 28356 (keeping 200 days of data) [2025-09-26T17:06:44.769623] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-09-26T17:06:44.920789] [DEBUG] [LOCAL ] AGO: Primary data saved (28356 records). [2025-09-26T17:06:44.920950] [INFO ] [MAIN ] AGO: Full history saved. [2025-09-26T17:06:44.922483] [INFO ] [MAIN ] Update Progress: 56/2371 symbols completed. AGO took 28.9s. Estimated remaining: 4h 36m 52s. Rate: 8.4 symbols/min [2025-09-26T17:06:45.123805] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:06:45.177896] [DEBUG] [LOCAL ] AHH: Loaded 41636 existing records from primary storage. [2025-09-26T17:06:45.178127] [INFO ] [MAIN ] AHH: Loaded 41636 existing records. [2025-09-26T17:06:45.469235] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:06:45.469559] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-09-26T17:06:45.469622] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-09-26T17:06:45.470962] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-09-26T17:06:45.471048] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-09-26T17:06:45.562499] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-09-26T17:06:45.960477] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:06:45.985358] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-26T17:06:46.225595] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-26T17:06:46.356759] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-09-26T17:06:47.156749] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-09-26T17:06:47.539930] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-26T17:06:47.553201] [INFO ] [REMOTE ] AGI: Full fetch complete (76769 records). [2025-09-26T17:06:47.553758] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-09-26T17:06:47.785736] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-26T17:06:47.961875] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-09-26T17:06:48.076323] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-09-26T17:06:48.076452] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-09-26T17:06:48.077886] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-09-26T17:06:48.077993] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-09-26T17:06:48.080285] [DEBUG] [LOCAL ] AGI: Trimmed 76769 records to 54195 (keeping 200 days of data) [2025-09-26T17:06:48.566562] [DEBUG] [LOCAL ] AGI: Primary data saved (54195 records). [2025-09-26T17:06:48.566813] [INFO ] [MAIN ] AGI: Full history saved. [2025-09-26T17:06:48.566984] [INFO ] [MAIN ] Update Progress: 57/2371 symbols completed. AGI took 45.6s. Estimated remaining: 4h 34m 22s. Rate: 8.4 symbols/min [2025-09-26T17:06:48.758503] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-12. [2025-09-26T17:06:48.843132] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:06:48.843815] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-09-26T17:06:48.844040] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-09-26T17:06:48.844344] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-09-26T17:06:48.844525] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-26T17:06:48.844620] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-26T17:06:48.844742] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-09-26T17:06:49.202637] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-26T17:06:49.365166] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:06:49.556724] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-09-26T17:06:49.594172] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-26T17:06:49.751500] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:06:49.751987] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-09-26T17:06:50.195912] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-26T17:06:50.356761] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-01. [2025-09-26T17:06:50.747847] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:06:50.748199] [WARN ] [REMOTE ] AHL: No data returned for month 2025-01 [2025-09-26T17:06:51.156772] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-09-26T17:06:51.956757] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-09-26T17:06:52.478734] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-26T17:06:52.756775] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-09-26T17:06:53.297350] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-26T17:06:53.556728] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-02. [2025-09-26T17:06:53.776484] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:06:53.777062] [WARN ] [REMOTE ] AHL: No data returned for month 2025-02 [2025-09-26T17:06:54.015389] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-26T17:06:54.356753] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-03. [2025-09-26T17:06:54.578910] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:06:54.579247] [WARN ] [REMOTE ] AHL: No data returned for month 2025-03 [2025-09-26T17:06:55.156741] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-09-26T17:06:55.956743] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-09-26T17:06:56.598607] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-26T17:06:56.756770] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-09-26T17:06:56.977798] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-26T17:06:57.556747] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-09-26T17:06:58.098124] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-26T17:06:58.356715] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-04. [2025-09-26T17:06:58.394904] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-26T17:06:58.563008] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:06:58.563387] [WARN ] [REMOTE ] AHL: No data returned for month 2025-04 [2025-09-26T17:06:59.156782] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-09-26T17:06:59.956766] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-09-26T17:07:00.692719] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-26T17:07:00.756697] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-09-26T17:07:01.304370] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-26T17:07:01.556757] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-09-26T17:07:02.054399] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-26T17:07:02.356751] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-09-26T17:07:02.601187] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-26T17:07:03.156786] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-09-26T17:07:03.702130] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-26T17:07:03.956738] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-05. [2025-09-26T17:07:04.300547] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-26T17:07:04.642289] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-26T17:07:04.756771] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-09-26T17:07:05.556747] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-09-26T17:07:06.284006] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-26T17:07:06.356742] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-09-26T17:07:06.838722] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-26T17:07:06.846368] [INFO ] [REMOTE ] AGX: Full fetch complete (48815 records). [2025-09-26T17:07:06.846516] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-09-26T17:07:07.161829] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-09-26T17:07:07.299404] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-09-26T17:07:07.299564] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-09-26T17:07:07.300585] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-09-26T17:07:07.300838] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-09-26T17:07:07.310272] [DEBUG] [LOCAL ] AGX: Trimmed 48815 records to 33823 (keeping 200 days of data) [2025-09-26T17:07:07.323835] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-26T17:07:07.595757] [DEBUG] [LOCAL ] AGX: Primary data saved (33823 records). [2025-09-26T17:07:07.595943] [INFO ] [MAIN ] AGX: Full history saved. [2025-09-26T17:07:07.597244] [INFO ] [MAIN ] Update Progress: 58/2371 symbols completed. AGX took 28.1s. Estimated remaining: 4h 42m 10s. Rate: 8.2 symbols/min [2025-09-26T17:07:07.786620] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:07:07.841600] [DEBUG] [LOCAL ] AHR: Loaded 49615 existing records from primary storage. [2025-09-26T17:07:07.841780] [INFO ] [MAIN ] AHR: Loaded 49615 existing records. [2025-09-26T17:07:07.962089] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-09-26T17:07:08.054126] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:07:08.054490] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-09-26T17:07:08.054576] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-09-26T17:07:08.056147] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-09-26T17:07:08.056240] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-09-26T17:07:08.464447] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:07:08.504846] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-26T17:07:08.756735] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-12. [2025-09-26T17:07:09.009573] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-26T17:07:09.016996] [INFO ] [REMOTE ] AGRO: Full fetch complete (49824 records). [2025-09-26T17:07:09.017172] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-09-26T17:07:09.425489] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-09-26T17:07:09.425663] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-09-26T17:07:09.426382] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-09-26T17:07:09.426446] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-09-26T17:07:09.427919] [DEBUG] [LOCAL ] AGRO: Trimmed 49824 records to 34097 (keeping 200 days of data) [2025-09-26T17:07:09.586610] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-09-26T17:07:09.635983] [DEBUG] [LOCAL ] AGRO: Primary data saved (34097 records). [2025-09-26T17:07:09.636138] [INFO ] [MAIN ] AGRO: Full history saved. [2025-09-26T17:07:09.636242] [INFO ] [MAIN ] Update Progress: 59/2371 symbols completed. AGRO took 34.9s. Estimated remaining: 4h 38m 36s. Rate: 8.3 symbols/min [2025-09-26T17:07:09.825275] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:07:09.834047] [DEBUG] [LOCAL ] AHT: Loaded 6122 existing records from primary storage. [2025-09-26T17:07:09.834153] [INFO ] [MAIN ] AHT: Loaded 6122 existing records. [2025-09-26T17:07:10.018324] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:07:10.018634] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-09-26T17:07:10.018721] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-09-26T17:07:10.019134] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-09-26T17:07:10.019219] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-09-26T17:07:10.364798] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-06. [2025-09-26T17:07:10.409074] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:07:10.443317] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-26T17:07:10.921542] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-26T17:07:11.055272] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-26T17:07:11.156751] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-09-26T17:07:11.956778] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-07. [2025-09-26T17:07:12.756777] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-12. [2025-09-26T17:07:12.791757] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-26T17:07:12.799485] [INFO ] [REMOTE ] AHH: Full fetch complete (59981 records). [2025-09-26T17:07:12.799782] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-09-26T17:07:12.810892] [FATAL] [VALIDATOR ] AHH: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:07:12.811994] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-26T17:07:12.815818] [FATAL] [MAIN ] AHH: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:07:12.816729] [WARN ] [MAIN ] AHH: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:07:12.816810] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-09-26T17:07:12.816904] [DEBUG] [LOCAL ] AHH: No primary data file found to delete. [2025-09-26T17:07:12.816963] [INFO ] [LOCAL ] AHH: Starting deletion of derivative data. [2025-09-26T17:07:12.817508] [DEBUG] [LOCAL ] AHH: Deleted derivative data file. [2025-09-26T17:07:12.817624] [INFO ] [MAIN ] Update Progress: 60/2371 symbols completed. AHH took 27.9s. Estimated remaining: 4h 35m 52s. Rate: 8.4 symbols/min [2025-09-26T17:07:13.020408] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:07:13.083580] [DEBUG] [LOCAL ] AI: Loaded 54139 existing records from primary storage. [2025-09-26T17:07:13.083801] [INFO ] [MAIN ] AI: Loaded 54139 existing records. [2025-09-26T17:07:13.305742] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:07:13.306003] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-09-26T17:07:13.306052] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-09-26T17:07:13.307553] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-09-26T17:07:13.307635] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-09-26T17:07:13.561928] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-08. [2025-09-26T17:07:13.721294] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:07:13.730881] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-26T17:07:14.356740] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-12. [2025-09-26T17:07:14.693499] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-26T17:07:15.156774] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-09-26T17:07:15.956744] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-09. [2025-09-26T17:07:16.721306] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-26T17:07:16.756778] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-09-26T17:07:17.189455] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-12 (2.83 seconds). [2025-09-26T17:07:17.222107] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-26T17:07:17.229792] [INFO ] [REMOTE ] AHL: Full fetch complete (18042 records). [2025-09-26T17:07:17.229881] [DEBUG] [VALIDATOR ] AHL: Validating primary data. [2025-09-26T17:07:17.428483] [WARN ] [VALIDATOR ] AHL: Validation failed - insufficient historical data. Have 98 unique days, need 200 days [2025-09-26T17:07:17.428852] [FATAL] [MAIN ] AHL: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:07:17.428924] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:07:17.428993] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-26T17:07:17.429074] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-26T17:07:17.429133] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-09-26T17:07:17.429190] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-09-26T17:07:17.429254] [INFO ] [MAIN ] Update Progress: 61/2371 symbols completed. AHL took 28.9s. Estimated remaining: 4h 34m 9s. Rate: 8.4 symbols/min [2025-09-26T17:07:17.593881] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-09-26T17:07:17.675358] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:07:17.733582] [DEBUG] [LOCAL ] AIG: Loaded 53865 existing records from primary storage. [2025-09-26T17:07:17.733834] [INFO ] [MAIN ] AIG: Loaded 53865 existing records. [2025-09-26T17:07:17.934851] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:07:17.935172] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-09-26T17:07:17.935222] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-09-26T17:07:17.937098] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-09-26T17:07:17.937162] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-09-26T17:07:18.330799] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:07:18.356692] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-12. [2025-09-26T17:07:18.356603] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-26T17:07:19.156731] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-09-26T17:07:19.956763] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-09-26T17:07:20.110221] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-26T17:07:20.194711] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-09-26T17:07:20.406425] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-26T17:07:20.504230] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-26T17:07:20.756738] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-09-26T17:07:21.556737] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-09-26T17:07:22.365232] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-09-26T17:07:22.369032] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-26T17:07:22.791960] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-26T17:07:23.156775] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-09-26T17:07:23.956759] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-09-26T17:07:24.490125] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-26T17:07:24.570553] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-26T17:07:24.756738] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-09-26T17:07:25.331082] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-26T17:07:25.556731] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-09-26T17:07:26.356747] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-09-26T17:07:26.953259] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-26T17:07:27.135369] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-26T17:07:27.156700] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-09-26T17:07:27.930448] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-26T17:07:27.956718] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-09-26T17:07:28.756723] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-09-26T17:07:29.556793] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-09-26T17:07:29.598427] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-26T17:07:29.645553] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-26T17:07:30.109609] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-26T17:07:30.288994] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-26T17:07:30.356709] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-09-26T17:07:30.961536] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-26T17:07:31.156755] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-09-26T17:07:31.702317] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-26T17:07:31.956733] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-09-26T17:07:32.504780] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-26T17:07:32.756738] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-09-26T17:07:33.478875] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-26T17:07:33.556752] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-09-26T17:07:34.356750] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-09-26T17:07:34.990028] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-26T17:07:35.156707] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-09-26T17:07:35.188765] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-26T17:07:35.956735] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-09-26T17:07:36.068709] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-26T17:07:36.756737] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-09-26T17:07:37.556745] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-09-26T17:07:38.187850] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-26T17:07:38.231890] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-26T17:07:38.243314] [INFO ] [REMOTE ] AHR: Full fetch complete (70937 records). [2025-09-26T17:07:38.243483] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-09-26T17:07:38.361154] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-09-26T17:07:38.697670] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-09-26T17:07:38.697777] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-09-26T17:07:38.698548] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-09-26T17:07:38.698598] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-09-26T17:07:38.700280] [DEBUG] [LOCAL ] AHR: Trimmed 70937 records to 49946 (keeping 200 days of data) [2025-09-26T17:07:38.926825] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-26T17:07:38.937356] [INFO ] [REMOTE ] AHT: Full fetch complete (9396 records). [2025-09-26T17:07:38.937578] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-09-26T17:07:39.159372] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-09-26T17:07:39.411697] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-09-26T17:07:39.412279] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-09-26T17:07:39.414217] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-09-26T17:07:39.415168] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-09-26T17:07:39.416249] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-26T17:07:39.433176] [DEBUG] [LOCAL ] AHT: Trimmed 9396 records to 6181 (keeping 200 days of data) [2025-09-26T17:07:39.534229] [DEBUG] [LOCAL ] AHR: Primary data saved (49946 records). [2025-09-26T17:07:39.535245] [INFO ] [MAIN ] AHR: Full history saved. [2025-09-26T17:07:39.538859] [INFO ] [MAIN ] Update Progress: 62/2371 symbols completed. AHR took 31.9s. Estimated remaining: 4h 43m 20s. Rate: 8.1 symbols/min [2025-09-26T17:07:39.538939] [DEBUG] [LOCAL ] AHT: Primary data saved (6181 records). [2025-09-26T17:07:39.539069] [INFO ] [MAIN ] AHT: Full history saved. [2025-09-26T17:07:39.539463] [INFO ] [MAIN ] Update Progress: 63/2371 symbols completed. AHT took 29.9s. Estimated remaining: 4h 38m 43s. Rate: 8.3 symbols/min [2025-09-26T17:07:39.910949] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:07:39.936846] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:07:39.937158] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-09-26T17:07:39.937207] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-09-26T17:07:39.937364] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-09-26T17:07:39.937410] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-26T17:07:39.937454] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-26T17:07:39.937488] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-09-26T17:07:39.962336] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-09-26T17:07:40.229337] [DEBUG] [LOCAL ] AIN: Loaded 24757 existing records from primary storage. [2025-09-26T17:07:40.256207] [INFO ] [MAIN ] AIN: Loaded 24757 existing records. [2025-09-26T17:07:40.485216] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:07:40.568182] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:07:40.568437] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-09-26T17:07:40.568488] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-09-26T17:07:40.569439] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-09-26T17:07:40.569503] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-09-26T17:07:40.759510] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-09-26T17:07:40.954252] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:07:41.080500] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:07:41.080867] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-09-26T17:07:41.522987] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-26T17:07:41.556679] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-09-26T17:07:41.616252] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-26T17:07:42.356743] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-01. [2025-09-26T17:07:42.567479] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:07:42.567835] [WARN ] [REMOTE ] AII: No data returned for month 2025-01 [2025-09-26T17:07:43.156719] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-09-26T17:07:43.956729] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-12. [2025-09-26T17:07:44.070944] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-09-26T17:07:44.578076] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-26T17:07:44.756736] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-09-26T17:07:44.825079] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-26T17:07:45.556735] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-09-26T17:07:46.356702] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-09-26T17:07:46.556041] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-26T17:07:47.156697] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-09-26T17:07:47.338793] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-26T17:07:47.956769] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-02. [2025-09-26T17:07:48.023700] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-09-26T17:07:48.157532] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:07:48.157948] [WARN ] [REMOTE ] AII: No data returned for month 2025-02 [2025-09-26T17:07:48.756758] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-09-26T17:07:48.970263] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-26T17:07:48.981565] [INFO ] [REMOTE ] AIG: Full fetch complete (77379 records). [2025-09-26T17:07:48.981832] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-09-26T17:07:49.412162] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-09-26T17:07:49.412331] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-09-26T17:07:49.413215] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-09-26T17:07:49.413305] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-09-26T17:07:49.415036] [DEBUG] [LOCAL ] AIG: Trimmed 77379 records to 54254 (keeping 200 days of data) [2025-09-26T17:07:49.606514] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-09-26T17:07:49.774889] [DEBUG] [LOCAL ] AIG: Primary data saved (54254 records). [2025-09-26T17:07:49.775105] [INFO ] [MAIN ] AIG: Full history saved. [2025-09-26T17:07:49.775214] [INFO ] [MAIN ] Update Progress: 64/2371 symbols completed. AIG took 32.3s. Estimated remaining: 4h 40m 23s. Rate: 8.2 symbols/min [2025-09-26T17:07:49.919941] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-26T17:07:49.987844] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:07:50.004670] [DEBUG] [LOCAL ] AIO: Loaded 13365 existing records from primary storage. [2025-09-26T17:07:50.004847] [INFO ] [MAIN ] AIO: Loaded 13365 existing records. [2025-09-26T17:07:50.192635] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:07:50.192943] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-09-26T17:07:50.193007] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-09-26T17:07:50.193679] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-09-26T17:07:50.193750] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-09-26T17:07:50.378978] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-09-26T17:07:50.583146] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:07:51.156785] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-12. [2025-09-26T17:07:51.808552] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-26T17:07:51.956742] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-03. [2025-09-26T17:07:52.178188] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-26T17:07:52.319107] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:07:52.319437] [WARN ] [REMOTE ] AII: No data returned for month 2025-03 [2025-09-26T17:07:52.353560] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.75 seconds). [2025-09-26T17:07:52.364857] [INFO ] [REMOTE ] AI: Full fetch complete (77896 records). [2025-09-26T17:07:52.365053] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-09-26T17:07:52.761580] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-04. [2025-09-26T17:07:52.788997] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-09-26T17:07:52.789124] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-09-26T17:07:52.789997] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-09-26T17:07:52.790186] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-09-26T17:07:52.792057] [DEBUG] [LOCAL ] AI: Trimmed 77896 records to 54529 (keeping 200 days of data) [2025-09-26T17:07:53.074418] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:07:53.100213] [WARN ] [REMOTE ] AII: No data returned for month 2025-04 [2025-09-26T17:07:53.126833] [DEBUG] [LOCAL ] AI: Primary data saved (54529 records). [2025-09-26T17:07:53.127055] [INFO ] [MAIN ] AI: Full history saved. [2025-09-26T17:07:53.130417] [INFO ] [MAIN ] Update Progress: 65/2371 symbols completed. AI took 40.3s. Estimated remaining: 4h 37m 56s. Rate: 8.3 symbols/min [2025-09-26T17:07:53.311721] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:07:53.311926] [DEBUG] [LOCAL ] AIR: No existing data file found in primary storage. [2025-09-26T17:07:53.311969] [WARN ] [MAIN ] AIR: No existing data found, performing full refresh instead. [2025-09-26T17:07:53.312120] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-09-26T17:07:53.312171] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-09-26T17:07:53.312217] [DEBUG] [LOCAL ] AIR: No primary data file found to delete. [2025-09-26T17:07:53.312251] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-09-26T17:07:53.561872] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-05. [2025-09-26T17:07:53.721272] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:07:54.356696] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-12. [2025-09-26T17:07:54.655807] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-26T17:07:55.156762] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-09-26T17:07:55.441633] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-26T17:07:55.956753] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-09-26T17:07:56.224724] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-26T17:07:56.756688] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-09-26T17:07:56.852813] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-26T17:07:57.449138] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-26T17:07:57.556724] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-09-26T17:07:58.356757] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-09-26T17:07:58.587559] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-26T17:07:59.047491] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-26T17:07:59.156729] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-06. [2025-09-26T17:07:59.956738] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-09-26T17:08:00.073258] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-26T17:08:00.756798] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-09-26T17:08:01.204435] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-26T17:08:01.556729] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-09-26T17:08:01.636411] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-26T17:08:02.356704] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-09-26T17:08:02.378185] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-26T17:08:03.156782] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-09-26T17:08:03.742703] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-26T17:08:03.956731] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-09-26T17:08:03.998515] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-26T17:08:04.756780] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-09-26T17:08:04.819359] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-26T17:08:05.556753] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-07. [2025-09-26T17:08:05.980978] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-26T17:08:06.356799] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-09-26T17:08:06.486367] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-26T17:08:07.104413] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-26T17:08:07.156740] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-09-26T17:08:07.956744] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-09-26T17:08:08.506853] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-26T17:08:08.512750] [INFO ] [REMOTE ] AIN: Full fetch complete (33250 records). [2025-09-26T17:08:08.512887] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-09-26T17:08:08.767854] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-08. [2025-09-26T17:08:08.949738] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-09-26T17:08:08.949954] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-09-26T17:08:08.950537] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-09-26T17:08:08.950722] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-09-26T17:08:08.952150] [DEBUG] [LOCAL ] AIN: Trimmed 33250 records to 24906 (keeping 200 days of data) [2025-09-26T17:08:09.068403] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-26T17:08:09.140064] [DEBUG] [LOCAL ] AIN: Primary data saved (24906 records). [2025-09-26T17:08:09.140255] [INFO ] [MAIN ] AIN: Full history saved. [2025-09-26T17:08:09.140377] [INFO ] [MAIN ] Update Progress: 66/2371 symbols completed. AIN took 29.6s. Estimated remaining: 4h 42m 56s. Rate: 8.1 symbols/min [2025-09-26T17:08:09.337450] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:08:09.365906] [DEBUG] [LOCAL ] AIT: Loaded 28128 existing records from primary storage. [2025-09-26T17:08:09.366047] [INFO ] [MAIN ] AIT: Loaded 28128 existing records. [2025-09-26T17:08:09.562167] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-09-26T17:08:09.582114] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:08:09.584562] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-09-26T17:08:09.584639] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-09-26T17:08:09.585808] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-09-26T17:08:09.585896] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-09-26T17:08:09.731012] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-26T17:08:10.020148] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:08:10.356735] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-12. [2025-09-26T17:08:10.560811] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-26T17:08:11.156887] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-09. [2025-09-26T17:08:11.760413] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T17:08:11.956776] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-09-26T17:08:12.204237] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-26T17:08:12.208726] [INFO ] [REMOTE ] AII: Full fetch complete (10735 records). [2025-09-26T17:08:12.208847] [DEBUG] [VALIDATOR ] AII: Validating primary data. [2025-09-26T17:08:12.449915] [WARN ] [VALIDATOR ] AII: Validation failed - insufficient historical data. Have 98 unique days, need 200 days [2025-09-26T17:08:12.451384] [FATAL] [MAIN ] AII: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:08:12.451674] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:08:12.451754] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-26T17:08:12.451895] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-26T17:08:12.451972] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-09-26T17:08:12.452044] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-09-26T17:08:12.452149] [INFO ] [MAIN ] Update Progress: 67/2371 symbols completed. AII took 32.9s. Estimated remaining: 4h 40m 29s. Rate: 8.2 symbols/min [2025-09-26T17:08:12.669114] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:08:12.741386] [DEBUG] [LOCAL ] AIV: Loaded 40567 existing records from primary storage. [2025-09-26T17:08:12.741561] [INFO ] [MAIN ] AIV: Loaded 40567 existing records. [2025-09-26T17:08:12.761979] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-09-26T17:08:12.966694] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:08:12.966975] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-09-26T17:08:12.967067] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-09-26T17:08:12.968568] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-09-26T17:08:12.968639] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-09-26T17:08:13.373606] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:08:13.390337] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-26T17:08:13.556729] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-12. [2025-09-26T17:08:13.676313] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-26T17:08:14.356795] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-09-26T17:08:14.867789] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-26T17:08:14.987683] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-26T17:08:15.156783] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-09-26T17:08:15.956753] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-09-26T17:08:16.556943] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-26T17:08:16.756748] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-09-26T17:08:16.885804] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-26T17:08:17.556753] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-09-26T17:08:17.921222] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-26T17:08:18.356728] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-09-26T17:08:18.497317] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-26T17:08:18.877895] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-26T17:08:19.156718] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-09-26T17:08:19.956770] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-09-26T17:08:20.293538] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-26T17:08:20.296950] [INFO ] [REMOTE ] AIO: Full fetch complete (20055 records). [2025-09-26T17:08:20.297140] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-09-26T17:08:20.716358] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-09-26T17:08:20.716455] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-09-26T17:08:20.716823] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-09-26T17:08:20.716890] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-09-26T17:08:20.717677] [DEBUG] [LOCAL ] AIO: Trimmed 20055 records to 13477 (keeping 200 days of data) [2025-09-26T17:08:20.766320] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-09-26T17:08:20.818222] [DEBUG] [LOCAL ] AIO: Primary data saved (13477 records). [2025-09-26T17:08:20.818377] [INFO ] [MAIN ] AIO: Full history saved. [2025-09-26T17:08:20.818492] [INFO ] [MAIN ] Update Progress: 68/2371 symbols completed. AIO took 31.0s. Estimated remaining: 4h 40m 58s. Rate: 8.2 symbols/min [2025-09-26T17:08:21.019152] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:08:21.042254] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-26T17:08:21.092049] [DEBUG] [LOCAL ] AIZ: Loaded 30320 existing records from primary storage. [2025-09-26T17:08:21.092220] [INFO ] [MAIN ] AIZ: Loaded 30320 existing records. [2025-09-26T17:08:21.293402] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:08:21.293934] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-09-26T17:08:21.294078] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-09-26T17:08:21.295241] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-09-26T17:08:21.295307] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-09-26T17:08:21.564120] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-09-26T17:08:21.731177] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:08:22.356750] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-12. [2025-09-26T17:08:22.497234] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-26T17:08:22.503840] [INFO ] [REMOTE ] AIR: Full fetch complete (37964 records). [2025-09-26T17:08:22.504009] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-09-26T17:08:22.505156] [FATAL] [VALIDATOR ] AIR: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:08:22.505246] [FATAL] [MAIN ] AIR: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:08:22.505311] [WARN ] [MAIN ] AIR: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:08:22.505387] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-09-26T17:08:22.505457] [DEBUG] [LOCAL ] AIR: No primary data file found to delete. [2025-09-26T17:08:22.505496] [INFO ] [LOCAL ] AIR: Starting deletion of derivative data. [2025-09-26T17:08:22.505554] [DEBUG] [LOCAL ] AIR: No derivative data file found to delete. [2025-09-26T17:08:22.505669] [INFO ] [MAIN ] Update Progress: 69/2371 symbols completed. AIR took 29.4s. Estimated remaining: 4h 37m 42s. Rate: 8.3 symbols/min [2025-09-26T17:08:22.695991] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:08:22.712696] [DEBUG] [LOCAL ] AIZN: Loaded 3914 existing records from primary storage. [2025-09-26T17:08:22.713130] [INFO ] [MAIN ] AIZN: Loaded 3914 existing records. [2025-09-26T17:08:22.917183] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:08:22.917623] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-09-26T17:08:22.917737] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-09-26T17:08:22.918140] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-09-26T17:08:22.918202] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-09-26T17:08:23.157819] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-09-26T17:08:23.331728] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:08:23.354976] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-26T17:08:23.446993] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-26T17:08:23.956755] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-12. [2025-09-26T17:08:24.287950] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-26T17:08:24.384442] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-26T17:08:24.756763] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-09-26T17:08:25.556747] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-09-26T17:08:25.779726] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-26T17:08:26.356734] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-09-26T17:08:26.684879] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-26T17:08:27.156760] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-09-26T17:08:27.553266] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-26T17:08:27.578975] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-26T17:08:27.956746] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-09-26T17:08:28.515573] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-26T17:08:28.756752] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-09-26T17:08:29.556731] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-09-26T17:08:30.232147] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-26T17:08:30.356732] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-09-26T17:08:30.929425] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-26T17:08:31.156731] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-09-26T17:08:31.799333] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-26T17:08:31.834476] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-26T17:08:31.956734] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-09-26T17:08:32.756735] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-09-26T17:08:33.123274] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-26T17:08:33.137723] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-26T17:08:33.556734] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-09-26T17:08:34.118758] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-26T17:08:34.356730] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-09-26T17:08:34.962520] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-26T17:08:35.156716] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-09-26T17:08:35.738630] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-26T17:08:35.956745] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-09-26T17:08:36.549351] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-26T17:08:36.756772] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-09-26T17:08:37.556725] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-09-26T17:08:38.356736] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-09-26T17:08:38.388777] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-26T17:08:38.661630] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-26T17:08:39.156732] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-09-26T17:08:39.331110] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-26T17:08:39.956767] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-09-26T17:08:40.545449] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-26T17:08:40.546853] [INFO ] [REMOTE ] AIZN: Full fetch complete (5742 records). [2025-09-26T17:08:40.546931] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-09-26T17:08:40.763105] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-09-26T17:08:40.941528] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-26T17:08:41.021129] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-09-26T17:08:41.021214] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-09-26T17:08:41.021395] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-09-26T17:08:41.021440] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-09-26T17:08:41.021917] [DEBUG] [LOCAL ] AIZN: Trimmed 5742 records to 3935 (keeping 200 days of data) [2025-09-26T17:08:41.047002] [DEBUG] [LOCAL ] AIZN: Primary data saved (3935 records). [2025-09-26T17:08:41.047178] [INFO ] [MAIN ] AIZN: Full history saved. [2025-09-26T17:08:41.047271] [INFO ] [MAIN ] Update Progress: 70/2371 symbols completed. AIZN took 18.5s. Estimated remaining: 4h 43m 47s. Rate: 8.1 symbols/min [2025-09-26T17:08:41.234966] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:08:41.296925] [DEBUG] [LOCAL ] AJG: Loaded 47404 existing records from primary storage. [2025-09-26T17:08:41.297135] [INFO ] [MAIN ] AJG: Loaded 47404 existing records. [2025-09-26T17:08:41.497222] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:08:41.497494] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-09-26T17:08:41.497550] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-09-26T17:08:41.499245] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-09-26T17:08:41.499312] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-09-26T17:08:41.569607] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-09-26T17:08:41.936897] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:08:42.213074] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-26T17:08:42.356734] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-12. [2025-09-26T17:08:43.156721] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-09-26T17:08:43.231710] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-26T17:08:43.956707] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-09-26T17:08:44.154556] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T17:08:44.222132] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-26T17:08:44.756796] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-09-26T17:08:45.241539] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-26T17:08:45.251442] [INFO ] [REMOTE ] AIV: Full fetch complete (59432 records). [2025-09-26T17:08:45.251604] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-09-26T17:08:45.561889] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-09-26T17:08:45.712453] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-09-26T17:08:45.712559] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-09-26T17:08:45.713229] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-09-26T17:08:45.713320] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-09-26T17:08:45.715379] [DEBUG] [LOCAL ] AIV: Trimmed 59432 records to 40950 (keeping 200 days of data) [2025-09-26T17:08:45.963044] [DEBUG] [LOCAL ] AIV: Primary data saved (40950 records). [2025-09-26T17:08:45.963183] [INFO ] [MAIN ] AIV: Full history saved. [2025-09-26T17:08:45.964238] [INFO ] [MAIN ] Update Progress: 71/2371 symbols completed. AIV took 33.5s. Estimated remaining: 4h 42m 19s. Rate: 8.1 symbols/min [2025-09-26T17:08:46.157445] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:08:46.157860] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-09-26T17:08:46.157922] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-09-26T17:08:46.158070] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-09-26T17:08:46.158115] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-26T17:08:46.158157] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-26T17:08:46.158190] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-09-26T17:08:46.362432] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-09-26T17:08:46.564733] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:08:46.595285] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-26T17:08:47.156703] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-09-26T17:08:47.223144] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-26T17:08:47.294140] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-26T17:08:47.956750] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-09-26T17:08:48.374776] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-26T17:08:48.419331] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-26T17:08:48.756757] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-09-26T17:08:49.556748] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-09-26T17:08:50.356705] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-09-26T17:08:50.396730] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-26T17:08:50.561247] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-26T17:08:50.565719] [INFO ] [REMOTE ] AIT: Full fetch complete (39468 records). [2025-09-26T17:08:50.565835] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-09-26T17:08:50.885961] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-26T17:08:50.989261] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-09-26T17:08:50.989363] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-09-26T17:08:50.989929] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-09-26T17:08:50.990003] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-09-26T17:08:50.991134] [DEBUG] [LOCAL ] AIT: Trimmed 39468 records to 28208 (keeping 200 days of data) [2025-09-26T17:08:51.158572] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-09-26T17:08:51.192708] [DEBUG] [LOCAL ] AIT: Primary data saved (28208 records). [2025-09-26T17:08:51.192841] [INFO ] [MAIN ] AIT: Full history saved. [2025-09-26T17:08:51.192933] [INFO ] [MAIN ] Update Progress: 72/2371 symbols completed. AIT took 42.1s. Estimated remaining: 4h 41m 3s. Rate: 8.2 symbols/min [2025-09-26T17:08:51.373157] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:08:51.421838] [DEBUG] [LOCAL ] AKR: Loaded 46130 existing records from primary storage. [2025-09-26T17:08:51.422009] [INFO ] [MAIN ] AKR: Loaded 46130 existing records. [2025-09-26T17:08:51.616635] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:08:51.616989] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-09-26T17:08:51.617078] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-09-26T17:08:51.618402] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-09-26T17:08:51.618465] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-09-26T17:08:51.970074] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-09-26T17:08:51.995342] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:08:52.756770] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-12. [2025-09-26T17:08:53.078031] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-26T17:08:53.448798] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-26T17:08:53.556750] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-09-26T17:08:54.356817] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-09-26T17:08:54.566021] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-26T17:08:54.732145] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-26T17:08:55.156748] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-09-26T17:08:55.956774] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-09-26T17:08:56.023153] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-26T17:08:56.593211] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-26T17:08:56.756729] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-09-26T17:08:57.462556] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-26T17:08:57.556733] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-09-26T17:08:58.100744] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-26T17:08:58.106801] [INFO ] [REMOTE ] AIZ: Full fetch complete (43010 records). [2025-09-26T17:08:58.106937] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-09-26T17:08:58.361920] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-09-26T17:08:58.530366] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-09-26T17:08:58.530525] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-09-26T17:08:58.531137] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-09-26T17:08:58.531227] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-09-26T17:08:58.532546] [DEBUG] [LOCAL ] AIZ: Trimmed 43010 records to 30543 (keeping 200 days of data) [2025-09-26T17:08:58.752202] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-26T17:08:58.780994] [DEBUG] [LOCAL ] AIZ: Primary data saved (30543 records). [2025-09-26T17:08:58.781136] [INFO ] [MAIN ] AIZ: Full history saved. [2025-09-26T17:08:58.781241] [INFO ] [MAIN ] Update Progress: 73/2371 symbols completed. AIZ took 38.0s. Estimated remaining: 4h 41m 4s. Rate: 8.2 symbols/min [2025-09-26T17:08:58.903314] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-26T17:08:58.979853] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:08:59.027865] [DEBUG] [LOCAL ] AL: Loaded 44455 existing records from primary storage. [2025-09-26T17:08:59.028071] [INFO ] [MAIN ] AL: Loaded 44455 existing records. [2025-09-26T17:08:59.161873] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-09-26T17:08:59.223125] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:08:59.223422] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-09-26T17:08:59.223472] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-09-26T17:08:59.225369] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-09-26T17:08:59.225487] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-09-26T17:08:59.605020] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:08:59.956750] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-12. [2025-09-26T17:09:00.756743] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-09-26T17:09:00.870156] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-26T17:09:01.449108] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-26T17:09:01.556723] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-09-26T17:09:01.636952] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-26T17:09:02.356735] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-09-26T17:09:02.875444] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-26T17:09:02.901580] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-26T17:09:03.156712] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-09-26T17:09:03.956736] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-09-26T17:09:04.662491] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-26T17:09:04.756752] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-09-26T17:09:05.413243] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-26T17:09:05.556725] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-09-26T17:09:06.210545] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-26T17:09:06.356755] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-09-26T17:09:06.629490] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-26T17:09:07.156716] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-09-26T17:09:07.653773] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-26T17:09:07.956751] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-09-26T17:09:08.459888] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-26T17:09:08.756741] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-09-26T17:09:09.517581] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-26T17:09:09.556738] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-09-26T17:09:10.339698] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-26T17:09:10.356685] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-09-26T17:09:11.156736] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-09-26T17:09:11.291404] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-26T17:09:11.618556] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-26T17:09:11.956769] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-09-26T17:09:12.561295] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-26T17:09:12.572200] [INFO ] [REMOTE ] AJG: Full fetch complete (69776 records). [2025-09-26T17:09:12.572391] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-09-26T17:09:12.767908] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-09-26T17:09:13.013320] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-09-26T17:09:13.013473] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-09-26T17:09:13.014261] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-09-26T17:09:13.014332] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-09-26T17:09:13.016108] [DEBUG] [LOCAL ] AJG: Trimmed 69776 records to 47710 (keeping 200 days of data) [2025-09-26T17:09:13.330592] [DEBUG] [LOCAL ] AJG: Primary data saved (47710 records). [2025-09-26T17:09:13.330771] [INFO ] [MAIN ] AJG: Full history saved. [2025-09-26T17:09:13.331884] [INFO ] [MAIN ] Update Progress: 74/2371 symbols completed. AJG took 32.3s. Estimated remaining: 4h 44m 40s. Rate: 8.1 symbols/min [2025-09-26T17:09:13.519980] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:09:13.553770] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-26T17:09:13.564191] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-09-26T17:09:13.620667] [DEBUG] [LOCAL ] ALB: Loaded 53612 existing records from primary storage. [2025-09-26T17:09:13.620845] [INFO ] [MAIN ] ALB: Loaded 53612 existing records. [2025-09-26T17:09:13.741810] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-26T17:09:13.828106] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:09:13.828420] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-09-26T17:09:13.828478] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-09-26T17:09:13.830057] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-09-26T17:09:13.830120] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-09-26T17:09:14.219283] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:09:14.356748] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-09-26T17:09:14.778560] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-26T17:09:15.120209] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-26T17:09:15.156687] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-09-26T17:09:15.788243] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-26T17:09:15.956745] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-09-26T17:09:16.235451] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-26T17:09:16.756764] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-09-26T17:09:17.556736] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-09-26T17:09:18.356068] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-26T17:09:18.364844] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-12. [2025-09-26T17:09:18.367391] [INFO ] [REMOTE ] AKR: Full fetch complete (65494 records). [2025-09-26T17:09:18.367541] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-09-26T17:09:18.796865] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-09-26T17:09:18.797059] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-09-26T17:09:18.798783] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-09-26T17:09:18.798867] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-09-26T17:09:18.800438] [DEBUG] [LOCAL ] AKR: Trimmed 65494 records to 46481 (keeping 200 days of data) [2025-09-26T17:09:19.059938] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-26T17:09:19.120351] [DEBUG] [LOCAL ] AKR: Primary data saved (46481 records). [2025-09-26T17:09:19.120500] [INFO ] [MAIN ] AKR: Full history saved. [2025-09-26T17:09:19.120610] [INFO ] [MAIN ] Update Progress: 75/2371 symbols completed. AKR took 27.9s. Estimated remaining: 4h 43m 43s. Rate: 8.1 symbols/min [2025-09-26T17:09:19.161830] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-09-26T17:09:19.314682] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:09:19.314887] [DEBUG] [LOCAL ] ALC: No existing data file found in primary storage. [2025-09-26T17:09:19.314932] [WARN ] [MAIN ] ALC: No existing data found, performing full refresh instead. [2025-09-26T17:09:19.315108] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-09-26T17:09:19.315166] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-09-26T17:09:19.315236] [DEBUG] [LOCAL ] ALC: No primary data file found to delete. [2025-09-26T17:09:19.315274] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-09-26T17:09:19.711012] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:09:19.714420] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-26T17:09:19.715737] [INFO ] [REMOTE ] AKA: Full fetch complete (2428 records). [2025-09-26T17:09:19.715810] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-09-26T17:09:19.908703] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-26T17:09:19.908965] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:09:19.909053] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:09:19.909145] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-26T17:09:19.909248] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-26T17:09:19.909315] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-09-26T17:09:19.909363] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-09-26T17:09:19.909428] [INFO ] [MAIN ] Update Progress: 76/2371 symbols completed. AKA took 33.9s. Estimated remaining: 4h 40m 15s. Rate: 8.2 symbols/min [2025-09-26T17:09:19.967788] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-09-26T17:09:20.100498] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:09:20.150388] [DEBUG] [LOCAL ] ALE: Loaded 30493 existing records from primary storage. [2025-09-26T17:09:20.150557] [INFO ] [MAIN ] ALE: Loaded 30493 existing records. [2025-09-26T17:09:20.345343] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:09:20.345769] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-09-26T17:09:20.345905] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-09-26T17:09:20.346954] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-09-26T17:09:20.347050] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-09-26T17:09:20.549535] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-26T17:09:20.761875] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-09-26T17:09:20.796944] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:09:21.196639] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-26T17:09:21.556736] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-12. [2025-09-26T17:09:22.356734] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-12. [2025-09-26T17:09:22.655936] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-26T17:09:22.818979] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-26T17:09:23.156727] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-09-26T17:09:23.767414] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-26T17:09:23.956746] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-09-26T17:09:24.009665] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-26T17:09:24.756726] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-09-26T17:09:25.530179] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T17:09:25.556711] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-09-26T17:09:26.356718] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-09-26T17:09:26.580885] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-26T17:09:26.986799] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-26T17:09:27.156717] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-09-26T17:09:27.202205] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-26T17:09:27.956738] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-09-26T17:09:28.691123] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-26T17:09:28.756715] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-09-26T17:09:29.276253] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-26T17:09:29.556733] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-09-26T17:09:30.133678] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-26T17:09:30.356739] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-09-26T17:09:31.156728] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-09-26T17:09:31.328432] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-26T17:09:31.830811] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-26T17:09:31.843189] [INFO ] [REMOTE ] AL: Full fetch complete (62378 records). [2025-09-26T17:09:31.843454] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-09-26T17:09:31.961993] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-09-26T17:09:32.254610] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-09-26T17:09:32.254746] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-09-26T17:09:32.255457] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-09-26T17:09:32.255503] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-09-26T17:09:32.257408] [DEBUG] [LOCAL ] AL: Trimmed 62378 records to 44831 (keeping 200 days of data) [2025-09-26T17:09:32.546261] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-26T17:09:32.615687] [DEBUG] [LOCAL ] AL: Primary data saved (44831 records). [2025-09-26T17:09:32.615891] [INFO ] [MAIN ] AL: Full history saved. [2025-09-26T17:09:32.616018] [INFO ] [MAIN ] Update Progress: 77/2371 symbols completed. AL took 33.8s. Estimated remaining: 4h 42m 48s. Rate: 8.1 symbols/min [2025-09-26T17:09:32.756734] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-09-26T17:09:33.556733] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-09-26T17:09:33.914343] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-26T17:09:34.356712] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-09-26T17:09:34.492139] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-26T17:09:34.626828] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-26T17:09:35.156757] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-09-26T17:09:35.956719] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-09-26T17:09:36.128281] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-26T17:09:36.165462] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-26T17:09:36.756757] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-09-26T17:09:37.243137] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-26T17:09:37.556753] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-09-26T17:09:37.675167] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-26T17:09:38.356759] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-09-26T17:09:39.156737] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-09-26T17:09:39.459066] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-26T17:09:39.956738] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-09-26T17:09:40.372271] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-26T17:09:40.402750] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-26T17:09:40.756754] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-09-26T17:09:41.495750] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-26T17:09:41.506796] [INFO ] [REMOTE ] ALC: Full fetch complete (72764 records). [2025-09-26T17:09:41.506972] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-09-26T17:09:41.574752] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-09-26T17:09:41.915204] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-09-26T17:09:41.915315] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-09-26T17:09:41.916118] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-09-26T17:09:41.916189] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-09-26T17:09:41.918139] [DEBUG] [LOCAL ] ALC: Trimmed 72764 records to 51537 (keeping 200 days of data) [2025-09-26T17:09:42.246428] [DEBUG] [LOCAL ] ALC: Primary data saved (51537 records). [2025-09-26T17:09:42.246631] [INFO ] [MAIN ] ALC: Full history saved. [2025-09-26T17:09:42.246808] [INFO ] [MAIN ] Update Progress: 78/2371 symbols completed. ALC took 23.1s. Estimated remaining: 4h 43m 46s. Rate: 8.1 symbols/min [2025-09-26T17:09:42.762445] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-26T17:09:42.775623] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-09-26T17:09:42.801001] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-26T17:09:43.156730] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-09-26T17:09:44.566595] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-26T17:09:44.575023] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-09-26T17:09:44.965394] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-26T17:09:44.978318] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-09-26T17:09:46.137293] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-26T17:09:46.149851] [INFO ] [REMOTE ] ALE: Full fetch complete (42465 records). [2025-09-26T17:09:46.150066] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-09-26T17:09:46.698242] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-09-26T17:09:46.698521] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-09-26T17:09:46.699224] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-09-26T17:09:46.699376] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-09-26T17:09:46.700832] [DEBUG] [LOCAL ] ALE: Trimmed 42465 records to 30788 (keeping 200 days of data) [2025-09-26T17:09:46.986760] [DEBUG] [LOCAL ] ALE: Primary data saved (30788 records). [2025-09-26T17:09:46.986970] [INFO ] [MAIN ] ALE: Full history saved. [2025-09-26T17:09:46.991016] [INFO ] [MAIN ] Update Progress: 79/2371 symbols completed. ALE took 27.1s. Estimated remaining: 4h 42m 21s. Rate: 8.1 symbols/min [2025-09-26T17:09:47.246312] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-26T17:09:47.257744] [INFO ] [REMOTE ] ALB: Full fetch complete (76789 records). [2025-09-26T17:09:47.257924] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-09-26T17:09:47.709786] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-09-26T17:09:47.709914] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-09-26T17:09:47.710765] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-09-26T17:09:47.710835] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-09-26T17:09:47.712567] [DEBUG] [LOCAL ] ALB: Trimmed 76789 records to 54000 (keeping 200 days of data) [2025-09-26T17:09:48.070934] [DEBUG] [LOCAL ] ALB: Primary data saved (54000 records). [2025-09-26T17:09:48.071098] [INFO ] [MAIN ] ALB: Full history saved. [2025-09-26T17:09:48.074906] [INFO ] [MAIN ] Update Progress: 80/2371 symbols completed. ALB took 34.7s. Estimated remaining: 4h 39m 13s. Rate: 8.2 symbols/min [2025-09-26T17:09:48.734462] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:09:48.769554] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:09:48.852537] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:09:48.873849] [DEBUG] [LOCAL ] ALG: No existing data file found in primary storage. [2025-09-26T17:09:48.874507] [WARN ] [MAIN ] ALG: No existing data found, performing full refresh instead. [2025-09-26T17:09:48.879895] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:09:48.880541] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-09-26T17:09:48.881014] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-09-26T17:09:48.881243] [DEBUG] [LOCAL ] ALG: No primary data file found to delete. [2025-09-26T17:09:48.881306] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-09-26T17:09:49.206445] [DEBUG] [LOCAL ] ALEX: Loaded 31536 existing records from primary storage. [2025-09-26T17:09:49.268045] [DEBUG] [LOCAL ] ALIT: Loaded 53147 existing records from primary storage. [2025-09-26T17:09:49.274245] [DEBUG] [LOCAL ] ALK: Loaded 53452 existing records from primary storage. [2025-09-26T17:09:49.273336] [INFO ] [MAIN ] ALEX: Loaded 31536 existing records. [2025-09-26T17:09:49.274632] [INFO ] [MAIN ] ALK: Loaded 53452 existing records. [2025-09-26T17:09:49.274506] [INFO ] [MAIN ] ALIT: Loaded 53147 existing records. [2025-09-26T17:09:49.703358] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:09:49.728613] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-12. [2025-09-26T17:09:49.981981] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:09:49.990949] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:09:49.991309] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-09-26T17:09:49.991159] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:09:49.991995] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-09-26T17:09:49.991548] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-09-26T17:09:49.992260] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-09-26T17:09:49.992323] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-09-26T17:09:49.992490] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-09-26T17:09:49.993673] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-09-26T17:09:49.993713] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-09-26T17:09:49.993861] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-09-26T17:09:49.993922] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-09-26T17:09:49.999184] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-09-26T17:09:50.071377] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-09-26T17:09:51.063975] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-26T17:09:51.095401] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:09:51.142558] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-09-26T17:09:51.122411] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-12. [2025-09-26T17:09:51.227223] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:09:51.233861] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:09:51.234367] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-12. [2025-09-26T17:09:51.234930] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-12. [2025-09-26T17:09:52.075921] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-26T17:09:52.079229] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-09-26T17:09:52.414959] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-26T17:09:52.422353] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-09-26T17:09:52.612570] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-26T17:09:52.629628] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-09-26T17:09:52.669060] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-26T17:09:52.680867] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-09-26T17:09:52.690261] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-26T17:09:52.756715] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-09-26T17:09:53.322225] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-26T17:09:53.556736] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-09-26T17:09:53.821467] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-26T17:09:54.281279] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-26T17:09:54.307284] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-26T17:09:54.342917] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-26T17:09:54.356669] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-09-26T17:09:55.156735] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-09-26T17:09:55.956707] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-09-26T17:09:55.989707] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T17:09:56.100569] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-26T17:09:56.756744] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-09-26T17:09:56.962911] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-26T17:09:57.556750] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-09-26T17:09:58.130507] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-26T17:09:58.169065] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-26T17:09:58.356723] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-09-26T17:09:59.156721] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-09-26T17:09:59.370372] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-26T17:09:59.956775] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-09-26T17:10:00.756710] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-09-26T17:10:01.020534] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-26T17:10:01.214054] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-26T17:10:01.556739] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-09-26T17:10:01.912673] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-26T17:10:02.356736] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-09-26T17:10:02.707256] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-26T17:10:03.156712] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-09-26T17:10:03.719881] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-26T17:10:03.956707] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-09-26T17:10:04.025666] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-26T17:10:04.756743] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-09-26T17:10:05.569391] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-09-26T17:10:05.575782] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-26T17:10:05.645420] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-26T17:10:06.241357] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-26T17:10:06.244187] [INFO ] [REMOTE ] ALG: Full fetch complete (15901 records). [2025-09-26T17:10:06.244271] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-09-26T17:10:06.360506] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-09-26T17:10:06.656393] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-09-26T17:10:06.656490] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-09-26T17:10:06.656884] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-09-26T17:10:06.656955] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-09-26T17:10:06.657806] [DEBUG] [LOCAL ] ALG: Trimmed 15901 records to 10562 (keeping 200 days of data) [2025-09-26T17:10:06.726900] [DEBUG] [LOCAL ] ALG: Primary data saved (10562 records). [2025-09-26T17:10:06.727091] [INFO ] [MAIN ] ALG: Full history saved. [2025-09-26T17:10:06.727183] [INFO ] [MAIN ] Update Progress: 81/2371 symbols completed. ALG took 18.6s. Estimated remaining: 4h 44m 26s. Rate: 8.1 symbols/min [2025-09-26T17:10:06.908974] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:10:06.963392] [DEBUG] [LOCAL ] ALL: Loaded 50565 existing records from primary storage. [2025-09-26T17:10:06.963572] [INFO ] [MAIN ] ALL: Loaded 50565 existing records. [2025-09-26T17:10:07.156752] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-09-26T17:10:07.156627] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:10:07.158281] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-09-26T17:10:07.158677] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-09-26T17:10:07.160258] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-09-26T17:10:07.160371] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-09-26T17:10:07.540094] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:10:07.956714] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-09-26T17:10:08.191809] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-26T17:10:08.667163] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-26T17:10:08.756787] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-09-26T17:10:08.984754] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-26T17:10:09.556730] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-12. [2025-09-26T17:10:10.358886] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-09-26T17:10:10.367727] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-26T17:10:11.156721] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-09-26T17:10:11.319348] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-26T17:10:11.623436] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-26T17:10:11.956766] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-09-26T17:10:12.756717] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-09-26T17:10:12.854409] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-26T17:10:13.396214] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-26T17:10:13.556737] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-09-26T17:10:14.356773] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-09-26T17:10:14.641891] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-26T17:10:15.014512] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-26T17:10:15.156715] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-09-26T17:10:15.956702] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-09-26T17:10:16.230863] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-26T17:10:16.541595] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-26T17:10:16.549062] [INFO ] [REMOTE ] ALEX: Full fetch complete (44646 records). [2025-09-26T17:10:16.549213] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-09-26T17:10:16.761851] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-09-26T17:10:16.962665] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-09-26T17:10:16.962774] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-09-26T17:10:16.963366] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-09-26T17:10:16.963519] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-09-26T17:10:16.964983] [DEBUG] [LOCAL ] ALEX: Trimmed 44646 records to 31769 (keeping 200 days of data) [2025-09-26T17:10:17.190961] [DEBUG] [LOCAL ] ALEX: Primary data saved (31769 records). [2025-09-26T17:10:17.191320] [INFO ] [MAIN ] ALEX: Full history saved. [2025-09-26T17:10:17.191808] [INFO ] [MAIN ] Update Progress: 82/2371 symbols completed. ALEX took 29.1s. Estimated remaining: 4h 45m 43s. Rate: 8.0 symbols/min [2025-09-26T17:10:17.385084] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:10:17.447478] [DEBUG] [LOCAL ] ALLE: Loaded 45377 existing records from primary storage. [2025-09-26T17:10:17.447687] [INFO ] [MAIN ] ALLE: Loaded 45377 existing records. [2025-09-26T17:10:17.559276] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-09-26T17:10:17.730318] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:10:17.730799] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-09-26T17:10:17.730906] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-09-26T17:10:17.732957] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-09-26T17:10:17.733038] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-09-26T17:10:17.919015] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-26T17:10:18.187312] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:10:18.279570] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-26T17:10:18.356767] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-09-26T17:10:19.141351] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-26T17:10:19.156722] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-12. [2025-09-26T17:10:19.846150] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-26T17:10:19.857764] [INFO ] [REMOTE ] ALIT: Full fetch complete (76414 records). [2025-09-26T17:10:19.857987] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-09-26T17:10:19.961884] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-09-26T17:10:20.319556] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-09-26T17:10:20.319961] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-09-26T17:10:20.320881] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-09-26T17:10:20.320952] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-09-26T17:10:20.322693] [DEBUG] [LOCAL ] ALIT: Trimmed 76414 records to 53534 (keeping 200 days of data) [2025-09-26T17:10:20.651752] [DEBUG] [LOCAL ] ALIT: Primary data saved (53534 records). [2025-09-26T17:10:20.651908] [INFO ] [MAIN ] ALIT: Full history saved. [2025-09-26T17:10:20.652000] [INFO ] [MAIN ] Update Progress: 83/2371 symbols completed. ALIT took 32.6s. Estimated remaining: 4h 43m 44s. Rate: 8.1 symbols/min [2025-09-26T17:10:20.765413] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-09-26T17:10:20.852585] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:10:20.911370] [DEBUG] [LOCAL ] ALLY: Loaded 53608 existing records from primary storage. [2025-09-26T17:10:20.911597] [INFO ] [MAIN ] ALLY: Loaded 53608 existing records. [2025-09-26T17:10:21.111943] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:10:21.112277] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-09-26T17:10:21.112329] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-09-26T17:10:21.114288] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-09-26T17:10:21.114364] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-09-26T17:10:21.533399] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:10:21.564305] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-12. [2025-09-26T17:10:21.570059] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-26T17:10:21.586783] [INFO ] [REMOTE ] ALK: Full fetch complete (76838 records). [2025-09-26T17:10:21.587535] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-09-26T17:10:22.015228] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-09-26T17:10:22.015337] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-09-26T17:10:22.016257] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-09-26T17:10:22.016339] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-09-26T17:10:22.018440] [DEBUG] [LOCAL ] ALK: Trimmed 76838 records to 53840 (keeping 200 days of data) [2025-09-26T17:10:22.384109] [DEBUG] [LOCAL ] ALK: Primary data saved (53840 records). [2025-09-26T17:10:22.384421] [INFO ] [MAIN ] ALK: Full history saved. [2025-09-26T17:10:22.386360] [INFO ] [MAIN ] Update Progress: 84/2371 symbols completed. ALK took 34.3s. Estimated remaining: 4h 41m 2s. Rate: 8.1 symbols/min [2025-09-26T17:10:22.596452] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:10:22.624793] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-12 (3.47 seconds). [2025-09-26T17:10:22.634802] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-09-26T17:10:22.677905] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-26T17:10:22.727380] [DEBUG] [LOCAL ] ALSN: Loaded 43608 existing records from primary storage. [2025-09-26T17:10:22.727532] [INFO ] [MAIN ] ALSN: Loaded 43608 existing records. [2025-09-26T17:10:22.979339] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:10:22.979801] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-09-26T17:10:22.979881] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-09-26T17:10:22.981135] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-09-26T17:10:22.981210] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-09-26T17:10:23.176572] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-09-26T17:10:23.347815] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-26T17:10:23.446878] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:10:23.921382] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-26T17:10:23.956716] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-09-26T17:10:24.756731] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-12. [2025-09-26T17:10:25.099930] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-26T17:10:25.516130] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-26T17:10:25.556687] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-09-26T17:10:26.126525] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-26T17:10:26.356741] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-09-26T17:10:26.918313] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-26T17:10:27.156714] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-09-26T17:10:27.956720] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-09-26T17:10:28.109594] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-26T17:10:28.636205] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-26T17:10:28.756740] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-09-26T17:10:29.351686] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-26T17:10:29.556729] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-09-26T17:10:30.356730] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-09-26T17:10:30.535467] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-26T17:10:31.003436] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-26T17:10:31.156701] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-09-26T17:10:31.956731] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-09-26T17:10:31.985939] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-26T17:10:32.756693] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-09-26T17:10:32.956511] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-26T17:10:33.539718] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-26T17:10:33.556702] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-09-26T17:10:33.996180] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-26T17:10:34.356772] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-09-26T17:10:34.856002] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-26T17:10:35.156772] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-09-26T17:10:35.642100] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-26T17:10:35.956750] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-09-26T17:10:36.398118] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-26T17:10:36.756788] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-09-26T17:10:37.475704] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T17:10:37.556731] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-09-26T17:10:37.994126] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-26T17:10:38.356749] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-09-26T17:10:39.029072] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T17:10:39.156785] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-09-26T17:10:39.674665] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-26T17:10:39.684529] [INFO ] [REMOTE ] ALLE: Full fetch complete (64880 records). [2025-09-26T17:10:39.684773] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-09-26T17:10:39.965004] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-09-26T17:10:40.218451] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-09-26T17:10:40.218592] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-09-26T17:10:40.219593] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-09-26T17:10:40.219700] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-09-26T17:10:40.222245] [DEBUG] [LOCAL ] ALLE: Trimmed 64880 records to 45637 (keeping 200 days of data) [2025-09-26T17:10:40.529513] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-26T17:10:40.601180] [DEBUG] [LOCAL ] ALLE: Primary data saved (45637 records). [2025-09-26T17:10:40.601363] [INFO ] [MAIN ] ALLE: Full history saved. [2025-09-26T17:10:40.601465] [INFO ] [MAIN ] Update Progress: 85/2371 symbols completed. ALLE took 23.4s. Estimated remaining: 4h 45m 46s. Rate: 8.0 symbols/min [2025-09-26T17:10:40.764788] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-09-26T17:10:40.798378] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:10:40.823800] [DEBUG] [LOCAL ] ALTG: Loaded 24032 existing records from primary storage. [2025-09-26T17:10:40.823942] [INFO ] [MAIN ] ALTG: Loaded 24032 existing records. [2025-09-26T17:10:41.032530] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:10:41.032868] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-09-26T17:10:41.032919] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-09-26T17:10:41.033697] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-09-26T17:10:41.033760] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-09-26T17:10:41.460603] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:10:41.556793] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-12. [2025-09-26T17:10:41.647124] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-26T17:10:42.343086] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-26T17:10:42.356979] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-09-26T17:10:42.743059] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-26T17:10:43.156754] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-09-26T17:10:43.945123] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-26T17:10:43.956817] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-09-26T17:10:44.679761] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-26T17:10:44.756788] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-09-26T17:10:45.170889] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-26T17:10:45.556737] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-09-26T17:10:46.356709] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-09-26T17:10:46.391883] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-26T17:10:46.403035] [INFO ] [REMOTE ] ALL: Full fetch complete (72523 records). [2025-09-26T17:10:46.403200] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-09-26T17:10:46.885740] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-09-26T17:10:46.886022] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-09-26T17:10:46.886943] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-09-26T17:10:46.887361] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-09-26T17:10:46.889612] [DEBUG] [LOCAL ] ALL: Trimmed 72523 records to 50903 (keeping 200 days of data) [2025-09-26T17:10:47.014377] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-26T17:10:47.047342] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-26T17:10:47.158141] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-09-26T17:10:47.311431] [DEBUG] [LOCAL ] ALL: Primary data saved (50903 records). [2025-09-26T17:10:47.311716] [INFO ] [MAIN ] ALL: Full history saved. [2025-09-26T17:10:47.313890] [INFO ] [MAIN ] Update Progress: 86/2371 symbols completed. ALL took 40.6s. Estimated remaining: 4h 45m 17s. Rate: 8.0 symbols/min [2025-09-26T17:10:47.534345] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:10:47.551262] [DEBUG] [LOCAL ] ALUR: Loaded 10913 existing records from primary storage. [2025-09-26T17:10:47.551447] [INFO ] [MAIN ] ALUR: Loaded 10913 existing records. [2025-09-26T17:10:47.754519] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:10:47.754826] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-09-26T17:10:47.754885] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-09-26T17:10:47.755828] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-09-26T17:10:47.755893] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-09-26T17:10:47.966571] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-09-26T17:10:48.145677] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:10:48.756709] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-12. [2025-09-26T17:10:48.912393] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-26T17:10:49.253782] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-26T17:10:49.265497] [INFO ] [REMOTE ] ALLY: Full fetch complete (76895 records). [2025-09-26T17:10:49.265715] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-09-26T17:10:49.561906] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-09-26T17:10:49.710305] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-09-26T17:10:49.710407] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-09-26T17:10:49.711224] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-09-26T17:10:49.711296] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-09-26T17:10:49.714575] [DEBUG] [LOCAL ] ALLY: Trimmed 76895 records to 53997 (keeping 200 days of data) [2025-09-26T17:10:50.087183] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-26T17:10:50.115063] [DEBUG] [LOCAL ] ALLY: Primary data saved (53997 records). [2025-09-26T17:10:50.115219] [INFO ] [MAIN ] ALLY: Full history saved. [2025-09-26T17:10:50.116464] [INFO ] [MAIN ] Update Progress: 87/2371 symbols completed. ALLY took 29.5s. Estimated remaining: 4h 43m 7s. Rate: 8.1 symbols/min [2025-09-26T17:10:50.309987] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:10:50.359288] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-09-26T17:10:50.361569] [DEBUG] [LOCAL ] ALV: Loaded 42904 existing records from primary storage. [2025-09-26T17:10:50.361688] [INFO ] [MAIN ] ALV: Loaded 42904 existing records. [2025-09-26T17:10:50.579539] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:10:50.580115] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-09-26T17:10:50.580282] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-09-26T17:10:50.587718] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-09-26T17:10:50.601253] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-26T17:10:50.600271] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-09-26T17:10:51.066306] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:10:51.156751] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-12. [2025-09-26T17:10:51.874031] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-26T17:10:51.956777] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-09-26T17:10:52.756725] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-09-26T17:10:52.844767] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-26T17:10:53.173385] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-26T17:10:53.556738] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-09-26T17:10:53.583693] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-26T17:10:54.356778] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-09-26T17:10:55.158723] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-09-26T17:10:55.165352] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-26T17:10:55.211896] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-26T17:10:55.956726] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-09-26T17:10:56.152984] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-26T17:10:56.756727] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-09-26T17:10:56.903154] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-26T17:10:57.556761] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-09-26T17:10:57.846346] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-26T17:10:58.048806] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-26T17:10:58.356763] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-09-26T17:10:59.156742] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-09-26T17:10:59.511118] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-26T17:10:59.914626] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-26T17:10:59.956754] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-09-26T17:11:00.756782] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-09-26T17:11:01.410560] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-26T17:11:01.556734] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-09-26T17:11:01.666572] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-26T17:11:02.356749] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-09-26T17:11:03.122585] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-26T17:11:03.151174] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-26T17:11:03.157359] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-09-26T17:11:03.956760] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-09-26T17:11:04.756780] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-09-26T17:11:04.939050] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-26T17:11:05.556731] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-09-26T17:11:05.749686] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-26T17:11:05.760563] [INFO ] [REMOTE ] ALSN: Full fetch complete (62130 records). [2025-09-26T17:11:05.760937] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-09-26T17:11:05.903556] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-26T17:11:06.260400] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-09-26T17:11:06.260832] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-09-26T17:11:06.261592] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-09-26T17:11:06.261717] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-09-26T17:11:06.275908] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-26T17:11:06.285559] [DEBUG] [LOCAL ] ALSN: Trimmed 62130 records to 43953 (keeping 200 days of data) [2025-09-26T17:11:06.359167] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-09-26T17:11:06.578417] [DEBUG] [LOCAL ] ALSN: Primary data saved (43953 records). [2025-09-26T17:11:06.578584] [INFO ] [MAIN ] ALSN: Full history saved. [2025-09-26T17:11:06.578713] [INFO ] [MAIN ] Update Progress: 88/2371 symbols completed. ALSN took 44.2s. Estimated remaining: 4h 46m 54s. Rate: 8.0 symbols/min [2025-09-26T17:11:06.763715] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:11:06.771554] [DEBUG] [LOCAL ] ALX: Loaded 6059 existing records from primary storage. [2025-09-26T17:11:06.771662] [INFO ] [MAIN ] ALX: Loaded 6059 existing records. [2025-09-26T17:11:06.964458] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:11:06.964752] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-09-26T17:11:06.964808] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-09-26T17:11:06.965111] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-09-26T17:11:06.965171] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-09-26T17:11:07.161781] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-09-26T17:11:07.367380] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:11:07.385416] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-26T17:11:07.391467] [INFO ] [REMOTE ] ALTG: Full fetch complete (33723 records). [2025-09-26T17:11:07.391693] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-09-26T17:11:07.805140] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-09-26T17:11:07.805228] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-09-26T17:11:07.805671] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-09-26T17:11:07.805739] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-09-26T17:11:07.806699] [DEBUG] [LOCAL ] ALTG: Trimmed 33723 records to 24161 (keeping 200 days of data) [2025-09-26T17:11:07.956848] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-09-26T17:11:07.962936] [DEBUG] [LOCAL ] ALTG: Primary data saved (24161 records). [2025-09-26T17:11:07.963154] [INFO ] [MAIN ] ALTG: Full history saved. [2025-09-26T17:11:07.963315] [INFO ] [MAIN ] Update Progress: 89/2371 symbols completed. ALTG took 27.4s. Estimated remaining: 4h 44m 8s. Rate: 8.0 symbols/min [2025-09-26T17:11:08.145348] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:11:08.198391] [DEBUG] [LOCAL ] AM: Loaded 52519 existing records from primary storage. [2025-09-26T17:11:08.198569] [INFO ] [MAIN ] AM: Loaded 52519 existing records. [2025-09-26T17:11:08.385034] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:11:08.385331] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-09-26T17:11:08.385381] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-09-26T17:11:08.386941] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-09-26T17:11:08.387004] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-09-26T17:11:08.630628] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-26T17:11:08.760989] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-12. [2025-09-26T17:11:08.807702] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:11:08.840621] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-26T17:11:09.472854] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-26T17:11:09.556734] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-09-26T17:11:10.151477] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-26T17:11:10.356811] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-09-26T17:11:10.881926] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-26T17:11:11.156760] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-09-26T17:11:11.712910] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-26T17:11:11.956785] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-12. [2025-09-26T17:11:12.756783] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-09-26T17:11:13.556911] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-09-26T17:11:13.772669] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-26T17:11:13.844514] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-26T17:11:14.356740] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-09-26T17:11:14.496090] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-26T17:11:14.498232] [INFO ] [REMOTE ] ALUR: Full fetch complete (20607 records). [2025-09-26T17:11:14.498310] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-09-26T17:11:14.901594] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-09-26T17:11:14.901390] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-26T17:11:14.901870] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-09-26T17:11:14.904036] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-09-26T17:11:14.904115] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-09-26T17:11:14.905063] [DEBUG] [LOCAL ] ALUR: Trimmed 20607 records to 10950 (keeping 200 days of data) [2025-09-26T17:11:14.973252] [DEBUG] [LOCAL ] ALUR: Primary data saved (10950 records). [2025-09-26T17:11:14.973475] [INFO ] [MAIN ] ALUR: Full history saved. [2025-09-26T17:11:14.973590] [INFO ] [MAIN ] Update Progress: 90/2371 symbols completed. ALUR took 27.7s. Estimated remaining: 4h 43m 49s. Rate: 8.0 symbols/min [2025-09-26T17:11:15.158472] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:11:15.158611] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-09-26T17:11:15.201692] [DEBUG] [LOCAL ] AMBC: Loaded 37246 existing records from primary storage. [2025-09-26T17:11:15.201920] [INFO ] [MAIN ] AMBC: Loaded 37246 existing records. [2025-09-26T17:11:15.410529] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:11:15.411065] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-09-26T17:11:15.411196] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-09-26T17:11:15.412353] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-09-26T17:11:15.412419] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-09-26T17:11:15.741884] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-26T17:11:15.823814] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:11:15.956785] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-12. [2025-09-26T17:11:16.756774] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-09-26T17:11:17.556716] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-09-26T17:11:17.574882] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-26T17:11:17.615825] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-26T17:11:18.356741] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-09-26T17:11:18.735199] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-26T17:11:18.825627] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-26T17:11:19.156761] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-09-26T17:11:19.956770] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-09-26T17:11:20.756980] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-09-26T17:11:20.812874] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-26T17:11:20.834061] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-26T17:11:21.556767] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-09-26T17:11:22.158330] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-26T17:11:22.356735] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-09-26T17:11:22.665744] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-26T17:11:23.156772] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-09-26T17:11:23.682593] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-26T17:11:23.956755] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-09-26T17:11:24.756756] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-09-26T17:11:24.810429] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T17:11:24.819667] [INFO ] [REMOTE ] ALV: Full fetch complete (61846 records). [2025-09-26T17:11:24.819919] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-09-26T17:11:25.276206] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-09-26T17:11:25.276342] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-09-26T17:11:25.277276] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-09-26T17:11:25.277390] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-09-26T17:11:25.305131] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-26T17:11:25.312882] [DEBUG] [LOCAL ] ALV: Trimmed 61846 records to 43217 (keeping 200 days of data) [2025-09-26T17:11:25.556990] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-09-26T17:11:25.613258] [DEBUG] [LOCAL ] ALV: Primary data saved (43217 records). [2025-09-26T17:11:25.613440] [INFO ] [MAIN ] ALV: Full history saved. [2025-09-26T17:11:25.613633] [INFO ] [MAIN ] Update Progress: 91/2371 symbols completed. ALV took 35.5s. Estimated remaining: 4h 45m 1s. Rate: 8.0 symbols/min [2025-09-26T17:11:25.741576] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-26T17:11:25.770851] [INFO ] [REMOTE ] ALX: Full fetch complete (6972 records). [2025-09-26T17:11:25.799437] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-09-26T17:11:25.830523] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:11:26.249104] [DEBUG] [LOCAL ] AMBP: Loaded 45578 existing records from primary storage. [2025-09-26T17:11:26.272904] [INFO ] [MAIN ] AMBP: Loaded 45578 existing records. [2025-09-26T17:11:26.307933] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-09-26T17:11:26.344267] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-09-26T17:11:26.367324] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-09-26T17:11:26.374450] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-09-26T17:11:26.361462] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-09-26T17:11:26.389442] [DEBUG] [LOCAL ] ALX: Trimmed 6972 records to 6121 (keeping 200 days of data) [2025-09-26T17:11:26.513679] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:11:26.527076] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-09-26T17:11:26.530768] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-09-26T17:11:26.533116] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-09-26T17:11:26.533337] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-09-26T17:11:26.595164] [DEBUG] [LOCAL ] ALX: Primary data saved (6121 records). [2025-09-26T17:11:26.614968] [INFO ] [MAIN ] ALX: Full history saved. [2025-09-26T17:11:26.620409] [INFO ] [MAIN ] Update Progress: 92/2371 symbols completed. ALX took 20.0s. Estimated remaining: 4h 42m 13s. Rate: 8.1 symbols/min [2025-09-26T17:11:26.961491] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-26T17:11:27.134847] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:11:27.161960] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-09-26T17:11:27.162107] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-09-26T17:11:27.168493] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-09-26T17:11:27.256381] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-09-26T17:11:27.274983] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:11:27.275364] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-26T17:11:27.275858] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-26T17:11:27.275921] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-09-26T17:11:27.704323] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:11:27.956735] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-09-26T17:11:28.212942] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:11:28.226187] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-09-26T17:11:28.255513] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-26T17:11:28.495614] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-26T17:11:28.756751] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-09-26T17:11:29.556741] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-09-26T17:11:30.288231] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-26T17:11:30.356774] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-09-26T17:11:31.156732] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-01. [2025-09-26T17:11:31.380439] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:11:31.384431] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-01 [2025-09-26T17:11:31.387942] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-26T17:11:31.861424] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-26T17:11:31.956743] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-02. [2025-09-26T17:11:32.161256] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:11:32.161695] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-02 [2025-09-26T17:11:32.756738] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-09-26T17:11:33.556724] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-03. [2025-09-26T17:11:33.753882] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:11:33.754207] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-03 [2025-09-26T17:11:34.356731] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-04. [2025-09-26T17:11:34.580200] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:11:34.602839] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-04 [2025-09-26T17:11:34.606137] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-26T17:11:35.156795] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-12. [2025-09-26T17:11:35.956786] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-05. [2025-09-26T17:11:36.158720] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:11:36.159083] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-05 [2025-09-26T17:11:36.756764] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-09-26T17:11:36.824227] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-26T17:11:37.556724] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-09-26T17:11:38.356744] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-06. [2025-09-26T17:11:38.583699] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-26T17:11:38.596243] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:11:38.596534] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-06 [2025-09-26T17:11:39.145872] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-26T17:11:39.156816] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-09-26T17:11:39.956739] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-09-26T17:11:40.739903] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-26T17:11:40.756686] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-09-26T17:11:41.014747] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-26T17:11:41.556765] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-09-26T17:11:42.356784] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-09-26T17:11:42.496130] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-26T17:11:42.795971] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-26T17:11:43.156786] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-09-26T17:11:43.432031] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-26T17:11:43.956778] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-09-26T17:11:44.448590] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-26T17:11:44.756777] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-07. [2025-09-26T17:11:45.236405] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-26T17:11:45.556742] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-09-26T17:11:45.763497] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-26T17:11:45.775478] [INFO ] [REMOTE ] AM: Full fetch complete (75601 records). [2025-09-26T17:11:45.775755] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-09-26T17:11:46.206802] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-09-26T17:11:46.206908] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-09-26T17:11:46.207897] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-09-26T17:11:46.207972] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-09-26T17:11:46.209746] [DEBUG] [LOCAL ] AM: Trimmed 75601 records to 52887 (keeping 200 days of data) [2025-09-26T17:11:46.382628] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-08. [2025-09-26T17:11:46.531612] [DEBUG] [LOCAL ] AM: Primary data saved (52887 records). [2025-09-26T17:11:46.531807] [INFO ] [MAIN ] AM: Full history saved. [2025-09-26T17:11:46.531905] [INFO ] [MAIN ] Update Progress: 93/2371 symbols completed. AM took 38.6s. Estimated remaining: 4h 47m 11s. Rate: 7.9 symbols/min [2025-09-26T17:11:46.712086] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:11:46.712318] [DEBUG] [LOCAL ] AMC: No existing data file found in primary storage. [2025-09-26T17:11:46.712371] [WARN ] [MAIN ] AMC: No existing data found, performing full refresh instead. [2025-09-26T17:11:46.712517] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-09-26T17:11:46.712562] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-09-26T17:11:46.712611] [DEBUG] [LOCAL ] AMC: No primary data file found to delete. [2025-09-26T17:11:46.712677] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-09-26T17:11:47.134896] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:11:47.161467] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-12. [2025-09-26T17:11:47.168705] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-26T17:11:47.440345] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-26T17:11:47.956759] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-09. [2025-09-26T17:11:48.756755] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-09-26T17:11:49.221294] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-26T17:11:49.226470] [INFO ] [REMOTE ] AMBQ: Full fetch complete (8187 records). [2025-09-26T17:11:49.226565] [DEBUG] [VALIDATOR ] AMBQ: Validating primary data. [2025-09-26T17:11:49.439271] [WARN ] [VALIDATOR ] AMBQ: Validation failed - insufficient historical data. Have 42 unique days, need 200 days [2025-09-26T17:11:49.439681] [FATAL] [MAIN ] AMBQ: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:11:49.439757] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:11:49.439807] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-26T17:11:49.439882] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-26T17:11:49.439977] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-09-26T17:11:49.440033] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-09-26T17:11:49.440098] [INFO ] [MAIN ] Update Progress: 94/2371 symbols completed. AMBQ took 22.8s. Estimated remaining: 4h 45m 11s. Rate: 8.0 symbols/min [2025-09-26T17:11:49.561811] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-09-26T17:11:49.626240] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:11:49.683410] [DEBUG] [LOCAL ] AMCR: Loaded 54059 existing records from primary storage. [2025-09-26T17:11:49.683567] [INFO ] [MAIN ] AMCR: Loaded 54059 existing records. [2025-09-26T17:11:49.878252] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:11:49.906102] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-09-26T17:11:49.909722] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-09-26T17:11:49.911578] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-12 (2.75 seconds). [2025-09-26T17:11:49.915666] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-09-26T17:11:49.923080] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-09-26T17:11:50.342226] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:11:50.345265] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-26T17:11:50.356681] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-09-26T17:11:51.076233] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-26T17:11:51.156772] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-12. [2025-09-26T17:11:51.282275] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-26T17:11:51.956812] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-09-26T17:11:52.756717] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-09-26T17:11:52.835761] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-26T17:11:52.889757] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-26T17:11:52.896666] [INFO ] [REMOTE ] AMBC: Full fetch complete (51087 records). [2025-09-26T17:11:52.896846] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-09-26T17:11:53.314526] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-09-26T17:11:53.314626] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-09-26T17:11:53.315273] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-09-26T17:11:53.315344] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-09-26T17:11:53.316682] [DEBUG] [LOCAL ] AMBC: Trimmed 51087 records to 37453 (keeping 200 days of data) [2025-09-26T17:11:53.528621] [DEBUG] [LOCAL ] AMBC: Primary data saved (37453 records). [2025-09-26T17:11:53.528794] [INFO ] [MAIN ] AMBC: Full history saved. [2025-09-26T17:11:53.528882] [INFO ] [MAIN ] Update Progress: 95/2371 symbols completed. AMBC took 38.6s. Estimated remaining: 4h 43m 41s. Rate: 8.0 symbols/min [2025-09-26T17:11:53.569472] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-09-26T17:11:53.734255] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:11:53.789246] [DEBUG] [LOCAL ] AME: Loaded 48905 existing records from primary storage. [2025-09-26T17:11:53.789431] [INFO ] [MAIN ] AME: Loaded 48905 existing records. [2025-09-26T17:11:53.991009] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:11:53.991275] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-09-26T17:11:53.991324] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-09-26T17:11:53.992913] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-09-26T17:11:53.992976] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-09-26T17:11:54.364082] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-09-26T17:11:54.389024] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:11:54.807575] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-26T17:11:54.869365] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-26T17:11:55.156755] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-09-26T17:11:55.674435] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-26T17:11:55.956765] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-09-26T17:11:56.756754] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-12. [2025-09-26T17:11:57.412015] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-26T17:11:57.556734] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-09-26T17:11:57.734891] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-26T17:11:58.255148] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-26T17:11:58.356774] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-09-26T17:11:58.742899] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-26T17:11:59.156747] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-09-26T17:11:59.793414] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-26T17:11:59.956774] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-09-26T17:12:00.756788] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-09-26T17:12:01.267099] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-26T17:12:01.350230] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-26T17:12:01.359799] [INFO ] [REMOTE ] AMBP: Full fetch complete (65848 records). [2025-09-26T17:12:01.359985] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-09-26T17:12:01.570821] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-09-26T17:12:01.843851] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-09-26T17:12:01.843956] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-09-26T17:12:01.844733] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-09-26T17:12:01.844835] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-09-26T17:12:01.846362] [DEBUG] [LOCAL ] AMBP: Trimmed 65848 records to 45863 (keeping 200 days of data) [2025-09-26T17:12:02.127827] [DEBUG] [LOCAL ] AMBP: Primary data saved (45863 records). [2025-09-26T17:12:02.128030] [INFO ] [MAIN ] AMBP: Full history saved. [2025-09-26T17:12:02.128177] [INFO ] [MAIN ] Update Progress: 96/2371 symbols completed. AMBP took 36.5s. Estimated remaining: 4h 44m 0s. Rate: 8.0 symbols/min [2025-09-26T17:12:02.330924] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:12:02.364587] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-09-26T17:12:02.371739] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-26T17:12:02.400493] [DEBUG] [LOCAL ] AMG: Loaded 20906 existing records from primary storage. [2025-09-26T17:12:02.400676] [INFO ] [MAIN ] AMG: Loaded 20906 existing records. [2025-09-26T17:12:02.600099] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:12:02.600405] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-09-26T17:12:02.600456] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-09-26T17:12:02.601135] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-09-26T17:12:02.601199] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-09-26T17:12:02.980944] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:12:03.156747] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-12. [2025-09-26T17:12:03.762815] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-26T17:12:03.956757] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-09-26T17:12:04.191084] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-26T17:12:04.212279] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-26T17:12:04.756741] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-09-26T17:12:05.556730] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-09-26T17:12:06.133175] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-26T17:12:06.364067] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-09-26T17:12:06.370222] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-26T17:12:06.776574] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-26T17:12:07.156773] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-09-26T17:12:07.700304] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-26T17:12:07.956736] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-09-26T17:12:08.756710] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-09-26T17:12:08.883603] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-26T17:12:09.556727] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-09-26T17:12:09.942861] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-26T17:12:10.269296] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-26T17:12:10.366770] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-09-26T17:12:10.387548] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-26T17:12:11.156749] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-09-26T17:12:11.956699] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-09-26T17:12:12.352810] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-26T17:12:12.756730] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-09-26T17:12:12.991634] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-09-26T17:12:13.512675] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-26T17:12:13.556722] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-09-26T17:12:14.217479] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-26T17:12:14.356745] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-09-26T17:12:15.156772] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-09-26T17:12:15.645750] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-26T17:12:15.956747] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-09-26T17:12:16.080217] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-26T17:12:16.756728] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-09-26T17:12:16.951813] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-26T17:12:17.148283] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-26T17:12:17.556729] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-09-26T17:12:18.356697] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-09-26T17:12:18.450758] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-26T17:12:19.156725] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-09-26T17:12:19.732007] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-26T17:12:19.743440] [INFO ] [REMOTE ] AMC: Full fetch complete (77923 records). [2025-09-26T17:12:19.743631] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-09-26T17:12:19.964363] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-09-26T17:12:20.180249] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-09-26T17:12:20.180344] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-09-26T17:12:20.181154] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-09-26T17:12:20.181227] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-09-26T17:12:20.182841] [DEBUG] [LOCAL ] AMC: Trimmed 77923 records to 54539 (keeping 200 days of data) [2025-09-26T17:12:20.411404] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-26T17:12:20.432589] [INFO ] [REMOTE ] AMCR: Full fetch complete (77677 records). [2025-09-26T17:12:20.433586] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-09-26T17:12:20.984074] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-09-26T17:12:20.984290] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-09-26T17:12:21.012496] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-09-26T17:12:21.014128] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-09-26T17:12:21.025106] [DEBUG] [LOCAL ] AMCR: Trimmed 77677 records to 54449 (keeping 200 days of data) [2025-09-26T17:12:21.046574] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-26T17:12:21.056532] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-09-26T17:12:21.206694] [DEBUG] [LOCAL ] AMC: Primary data saved (54539 records). [2025-09-26T17:12:21.208231] [INFO ] [MAIN ] AMC: Full history saved. [2025-09-26T17:12:21.211215] [INFO ] [MAIN ] Update Progress: 97/2371 symbols completed. AMC took 34.7s. Estimated remaining: 4h 48m 24s. Rate: 7.9 symbols/min [2025-09-26T17:12:21.210970] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-26T17:12:21.426290] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:12:21.493486] [DEBUG] [LOCAL ] AMH: Loaded 52080 existing records from primary storage. [2025-09-26T17:12:21.575981] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-09-26T17:12:21.580747] [INFO ] [MAIN ] AMH: Loaded 52080 existing records. [2025-09-26T17:12:21.906669] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:12:21.912445] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-09-26T17:12:21.912552] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-09-26T17:12:21.970731] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-09-26T17:12:21.971195] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-09-26T17:12:22.354501] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-26T17:12:22.381001] [DEBUG] [LOCAL ] AMCR: Primary data saved (54449 records). [2025-09-26T17:12:22.387715] [INFO ] [MAIN ] AMCR: Full history saved. [2025-09-26T17:12:22.408792] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-09-26T17:12:22.412264] [INFO ] [MAIN ] Update Progress: 98/2371 symbols completed. AMCR took 33.0s. Estimated remaining: 4h 45m 48s. Rate: 8.0 symbols/min [2025-09-26T17:12:22.475338] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:12:22.659556] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:12:22.704726] [DEBUG] [LOCAL ] AMN: Loaded 42296 existing records from primary storage. [2025-09-26T17:12:22.704893] [INFO ] [MAIN ] AMN: Loaded 42296 existing records. [2025-09-26T17:12:22.902065] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:12:22.902545] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-09-26T17:12:22.902753] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-09-26T17:12:22.904320] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-09-26T17:12:22.904386] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-09-26T17:12:23.138728] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-26T17:12:23.172548] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-12. [2025-09-26T17:12:23.366006] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:12:23.387022] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-26T17:12:23.956751] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-12. [2025-09-26T17:12:24.756713] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-09-26T17:12:24.840091] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-26T17:12:25.094847] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-26T17:12:25.556730] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-09-26T17:12:26.205914] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-26T17:12:26.216517] [INFO ] [REMOTE ] AME: Full fetch complete (69806 records). [2025-09-26T17:12:26.216722] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-09-26T17:12:26.361795] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-09-26T17:12:26.655003] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-09-26T17:12:26.655103] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-09-26T17:12:26.655877] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-09-26T17:12:26.655958] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-09-26T17:12:26.657720] [DEBUG] [LOCAL ] AME: Trimmed 69806 records to 49252 (keeping 200 days of data) [2025-09-26T17:12:26.969661] [DEBUG] [LOCAL ] AME: Primary data saved (49252 records). [2025-09-26T17:12:26.969819] [INFO ] [MAIN ] AME: Full history saved. [2025-09-26T17:12:26.971181] [INFO ] [MAIN ] Update Progress: 99/2371 symbols completed. AME took 33.4s. Estimated remaining: 4h 44m 32s. Rate: 8.0 symbols/min [2025-09-26T17:12:27.163167] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-09-26T17:12:27.167458] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:12:27.206086] [DEBUG] [LOCAL ] AMP: Loaded 32671 existing records from primary storage. [2025-09-26T17:12:27.206235] [INFO ] [MAIN ] AMP: Loaded 32671 existing records. [2025-09-26T17:12:27.407056] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:12:27.417117] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-09-26T17:12:27.431786] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-09-26T17:12:27.437395] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-26T17:12:27.437470] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-09-26T17:12:27.448144] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-09-26T17:12:27.691117] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-26T17:12:27.863042] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:12:27.956747] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-09-26T17:12:28.312740] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-26T17:12:28.756775] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-12. [2025-09-26T17:12:29.556706] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-09-26T17:12:29.589630] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T17:12:30.196004] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-26T17:12:30.356748] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-09-26T17:12:30.424440] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-26T17:12:30.429304] [INFO ] [REMOTE ] AMG: Full fetch complete (29862 records). [2025-09-26T17:12:30.429446] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-09-26T17:12:30.839309] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-09-26T17:12:30.839458] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-09-26T17:12:30.839882] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-09-26T17:12:30.839947] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-09-26T17:12:30.840849] [DEBUG] [LOCAL ] AMG: Trimmed 29862 records to 21046 (keeping 200 days of data) [2025-09-26T17:12:30.979208] [DEBUG] [LOCAL ] AMG: Primary data saved (21046 records). [2025-09-26T17:12:30.979354] [INFO ] [MAIN ] AMG: Full history saved. [2025-09-26T17:12:30.979439] [INFO ] [MAIN ] Update Progress: 100/2371 symbols completed. AMG took 28.9s. Estimated remaining: 4h 43m 5s. Rate: 8.0 symbols/min [2025-09-26T17:12:31.161257] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-09-26T17:12:31.188790] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:12:31.189016] [DEBUG] [LOCAL ] AMPX: No existing data file found in primary storage. [2025-09-26T17:12:31.189082] [WARN ] [MAIN ] AMPX: No existing data found, performing full refresh instead. [2025-09-26T17:12:31.189550] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-09-26T17:12:31.189610] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-09-26T17:12:31.189731] [DEBUG] [LOCAL ] AMPX: No primary data file found to delete. [2025-09-26T17:12:31.189835] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-09-26T17:12:31.590964] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:12:31.622404] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-26T17:12:31.956746] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-09-26T17:12:32.672299] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-26T17:12:32.756733] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-09-26T17:12:33.041500] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-26T17:12:33.556770] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-12. [2025-09-26T17:12:34.262623] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-26T17:12:34.356753] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-09-26T17:12:35.141348] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-26T17:12:35.156698] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-09-26T17:12:35.956766] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-09-26T17:12:36.012355] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-26T17:12:36.756713] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-09-26T17:12:37.101822] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-26T17:12:37.469548] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-26T17:12:37.556728] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-09-26T17:12:37.933197] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-26T17:12:38.356937] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-09-26T17:12:38.927420] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-26T17:12:39.156753] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-09-26T17:12:39.616861] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-26T17:12:39.956763] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-09-26T17:12:40.760917] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-09-26T17:12:40.772439] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-26T17:12:41.556719] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-09-26T17:12:41.763174] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-26T17:12:41.981672] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-26T17:12:42.356755] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-09-26T17:12:43.156735] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-09-26T17:12:43.235216] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-26T17:12:43.741046] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-26T17:12:43.956800] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-09-26T17:12:44.571736] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-26T17:12:44.756847] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-09-26T17:12:45.532036] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-26T17:12:45.556729] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-09-26T17:12:46.145684] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-26T17:12:46.356770] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-09-26T17:12:47.064949] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-26T17:12:47.156769] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-09-26T17:12:47.956741] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-09-26T17:12:48.077114] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T17:12:48.496532] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-26T17:12:48.756787] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-09-26T17:12:49.556750] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-09-26T17:12:49.894069] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-26T17:12:49.906927] [INFO ] [REMOTE ] AMH: Full fetch complete (74785 records). [2025-09-26T17:12:49.907141] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-09-26T17:12:50.361494] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-09-26T17:12:50.426378] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-09-26T17:12:50.426507] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-09-26T17:12:50.427357] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-09-26T17:12:50.427475] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-09-26T17:12:50.446194] [DEBUG] [LOCAL ] AMH: Trimmed 74785 records to 52467 (keeping 200 days of data) [2025-09-26T17:12:50.461706] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-26T17:12:50.806295] [DEBUG] [LOCAL ] AMH: Primary data saved (52467 records). [2025-09-26T17:12:50.806494] [INFO ] [MAIN ] AMH: Full history saved. [2025-09-26T17:12:50.806672] [INFO ] [MAIN ] Update Progress: 101/2371 symbols completed. AMH took 29.6s. Estimated remaining: 4h 47m 35s. Rate: 7.9 symbols/min [2025-09-26T17:12:50.996093] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:12:51.017871] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-26T17:12:51.058610] [DEBUG] [LOCAL ] AMPY: Loaded 37778 existing records from primary storage. [2025-09-26T17:12:51.058825] [INFO ] [MAIN ] AMPY: Loaded 37778 existing records. [2025-09-26T17:12:51.162599] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-09-26T17:12:51.250165] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:12:51.250472] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-09-26T17:12:51.250543] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-09-26T17:12:51.251754] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-09-26T17:12:51.251820] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-09-26T17:12:51.670954] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:12:51.918278] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-26T17:12:51.956700] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-09-26T17:12:52.701420] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-26T17:12:52.708355] [INFO ] [REMOTE ] AMP: Full fetch complete (47634 records). [2025-09-26T17:12:52.708476] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-09-26T17:12:52.761910] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-12. [2025-09-26T17:12:53.145446] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-09-26T17:12:53.145683] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-09-26T17:12:53.146299] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-09-26T17:12:53.146450] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-09-26T17:12:53.147696] [DEBUG] [LOCAL ] AMP: Trimmed 47634 records to 32959 (keeping 200 days of data) [2025-09-26T17:12:53.449806] [DEBUG] [LOCAL ] AMP: Primary data saved (32959 records). [2025-09-26T17:12:53.451262] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-26T17:12:53.451532] [INFO ] [MAIN ] AMP: Full history saved. [2025-09-26T17:12:53.460760] [INFO ] [MAIN ] Update Progress: 102/2371 symbols completed. AMP took 26.5s. Estimated remaining: 4h 45m 37s. Rate: 7.9 symbols/min [2025-09-26T17:12:53.565361] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-09-26T17:12:53.654905] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:12:53.697369] [DEBUG] [LOCAL ] AMR: Loaded 29293 existing records from primary storage. [2025-09-26T17:12:53.697509] [INFO ] [MAIN ] AMR: Loaded 29293 existing records. [2025-09-26T17:12:53.974045] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:12:53.974414] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-09-26T17:12:53.974472] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-09-26T17:12:53.975504] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-09-26T17:12:53.975569] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-09-26T17:12:54.150905] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-26T17:12:54.361899] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-09-26T17:12:54.747746] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:12:55.156790] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-12. [2025-09-26T17:12:55.962004] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-09-26T17:12:55.967854] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-26T17:12:56.136179] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-09-26T17:12:56.205877] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-26T17:12:56.756700] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-09-26T17:12:56.779406] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-26T17:12:57.556753] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-09-26T17:12:58.356692] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-09-26T17:12:58.825498] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-26T17:12:58.952398] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-26T17:12:59.156735] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-09-26T17:12:59.783073] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-26T17:12:59.956736] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-09-26T17:13:00.756747] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-09-26T17:13:01.556723] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-09-26T17:13:01.722928] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-26T17:13:01.732626] [INFO ] [REMOTE ] AMN: Full fetch complete (60384 records). [2025-09-26T17:13:01.732842] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-09-26T17:13:01.988983] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-09-26T17:13:02.074137] [INFO ] [REMOTE ] AMPX: Full fetch complete (74611 records). [2025-09-26T17:13:02.097779] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-09-26T17:13:02.154497] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-26T17:13:02.357219] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-09-26T17:13:02.395961] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-09-26T17:13:02.406568] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-09-26T17:13:02.412432] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-09-26T17:13:02.418171] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-09-26T17:13:02.481020] [DEBUG] [LOCAL ] AMN: Trimmed 60384 records to 42588 (keeping 200 days of data) [2025-09-26T17:13:02.829733] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-09-26T17:13:02.830705] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-09-26T17:13:02.834145] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-09-26T17:13:02.841404] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-09-26T17:13:02.859250] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-26T17:13:02.870716] [DEBUG] [LOCAL ] AMPX: Trimmed 74611 records to 52949 (keeping 200 days of data) [2025-09-26T17:13:03.164726] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-09-26T17:13:03.354675] [DEBUG] [LOCAL ] AMPX: Primary data saved (52949 records). [2025-09-26T17:13:03.355638] [INFO ] [MAIN ] AMPX: Full history saved. [2025-09-26T17:13:03.356176] [INFO ] [MAIN ] Update Progress: 103/2371 symbols completed. AMPX took 32.4s. Estimated remaining: 4h 46m 21s. Rate: 7.9 symbols/min [2025-09-26T17:13:03.383547] [DEBUG] [LOCAL ] AMN: Primary data saved (42588 records). [2025-09-26T17:13:03.400056] [INFO ] [MAIN ] AMN: Full history saved. [2025-09-26T17:13:03.401159] [INFO ] [MAIN ] Update Progress: 104/2371 symbols completed. AMN took 41.0s. Estimated remaining: 4h 43m 30s. Rate: 8.0 symbols/min [2025-09-26T17:13:03.646239] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-26T17:13:03.747968] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:13:03.829177] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:13:03.829450] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-09-26T17:13:03.829508] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-09-26T17:13:03.829690] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-09-26T17:13:03.829746] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-26T17:13:03.829791] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-26T17:13:03.829825] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-09-26T17:13:03.960855] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-09-26T17:13:04.041764] [DEBUG] [LOCAL ] AMRC: Loaded 38678 existing records from primary storage. [2025-09-26T17:13:04.060785] [INFO ] [MAIN ] AMRC: Loaded 38678 existing records. [2025-09-26T17:13:04.484446] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:13:04.484780] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:13:04.485779] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-09-26T17:13:04.485870] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-09-26T17:13:04.486980] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-09-26T17:13:04.487252] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-09-26T17:13:04.633318] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-26T17:13:04.763307] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-09-26T17:13:04.945876] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:13:05.010384] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-26T17:13:05.556745] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-09-26T17:13:05.783597] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:13:05.783998] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-09-26T17:13:05.982202] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-26T17:13:06.356734] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-01. [2025-09-26T17:13:06.573844] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:13:06.574163] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-01 [2025-09-26T17:13:07.156760] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-09-26T17:13:07.956729] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-12. [2025-09-26T17:13:08.486831] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-26T17:13:08.756735] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-09-26T17:13:09.089893] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-26T17:13:09.556744] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-09-26T17:13:09.637416] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-26T17:13:10.356732] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-09-26T17:13:10.509751] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-26T17:13:11.156755] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-09-26T17:13:11.188623] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-26T17:13:11.269318] [DEBUG] [REMOTE ] AMPY: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-09-26T17:13:11.269664] [WARN ] [REMOTE ] AMPY: No data returned for month 2025-06 [2025-09-26T17:13:11.956731] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-09-26T17:13:12.756725] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-09-26T17:13:12.968677] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-26T17:13:13.556724] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-09-26T17:13:14.017020] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-26T17:13:14.356724] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-09-26T17:13:14.837877] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-26T17:13:15.156735] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-09-26T17:13:15.453913] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-26T17:13:15.956726] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-02. [2025-09-26T17:13:16.205816] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:13:16.206129] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-02 [2025-09-26T17:13:16.447301] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-26T17:13:16.756725] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-03. [2025-09-26T17:13:16.969245] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:13:16.969689] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-03 [2025-09-26T17:13:17.556725] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-04. [2025-09-26T17:13:17.771967] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:13:17.772280] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-04 [2025-09-26T17:13:18.356768] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-09-26T17:13:19.156738] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-09-26T17:13:19.881851] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-26T17:13:19.956733] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-09-26T17:13:20.314310] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-26T17:13:20.321789] [INFO ] [REMOTE ] AMPY: Full fetch complete (44329 records). [2025-09-26T17:13:20.321930] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-09-26T17:13:20.531670] [WARN ] [VALIDATOR ] AMPY: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-26T17:13:20.532210] [FATAL] [MAIN ] AMPY: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:13:20.532287] [WARN ] [MAIN ] AMPY: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:13:20.532364] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-09-26T17:13:20.532458] [DEBUG] [LOCAL ] AMPY: No primary data file found to delete. [2025-09-26T17:13:20.532511] [INFO ] [LOCAL ] AMPY: Starting deletion of derivative data. [2025-09-26T17:13:20.533057] [DEBUG] [LOCAL ] AMPY: Deleted derivative data file. [2025-09-26T17:13:20.533163] [INFO ] [MAIN ] Update Progress: 105/2371 symbols completed. AMPY took 29.7s. Estimated remaining: 4h 46m 50s. Rate: 7.9 symbols/min [2025-09-26T17:13:20.715302] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:13:20.758705] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-09-26T17:13:20.784010] [DEBUG] [LOCAL ] AMT: Loaded 52833 existing records from primary storage. [2025-09-26T17:13:20.784165] [INFO ] [MAIN ] AMT: Loaded 52833 existing records. [2025-09-26T17:13:20.978795] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:13:20.979038] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-09-26T17:13:20.979087] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-09-26T17:13:20.980579] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-09-26T17:13:20.980673] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-09-26T17:13:21.375453] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:13:21.556754] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-12. [2025-09-26T17:13:21.657886] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-26T17:13:22.356710] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-05. [2025-09-26T17:13:22.651568] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:13:22.651944] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-05 [2025-09-26T17:13:22.680349] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-26T17:13:23.156746] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-06. [2025-09-26T17:13:23.275220] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-26T17:13:23.956767] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-09-26T17:13:24.358536] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-26T17:13:24.756740] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-09-26T17:13:25.305917] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-26T17:13:25.312088] [INFO ] [REMOTE ] AMR: Full fetch complete (39827 records). [2025-09-26T17:13:25.312213] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-09-26T17:13:25.564300] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-07. [2025-09-26T17:13:25.736197] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-09-26T17:13:25.736442] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-09-26T17:13:25.737182] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-09-26T17:13:25.737264] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-09-26T17:13:25.756345] [DEBUG] [LOCAL ] AMR: Trimmed 39827 records to 29441 (keeping 200 days of data) [2025-09-26T17:13:25.758046] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-26T17:13:25.943320] [DEBUG] [LOCAL ] AMR: Primary data saved (29441 records). [2025-09-26T17:13:25.943468] [INFO ] [MAIN ] AMR: Full history saved. [2025-09-26T17:13:25.943557] [INFO ] [MAIN ] Update Progress: 106/2371 symbols completed. AMR took 32.5s. Estimated remaining: 4h 45m 56s. Rate: 7.9 symbols/min [2025-09-26T17:13:26.131089] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:13:26.152219] [DEBUG] [LOCAL ] AMTB: Loaded 20492 existing records from primary storage. [2025-09-26T17:13:26.152365] [INFO ] [MAIN ] AMTB: Loaded 20492 existing records. [2025-09-26T17:13:26.343952] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:13:26.344212] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-09-26T17:13:26.344262] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-09-26T17:13:26.345034] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-09-26T17:13:26.345097] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-09-26T17:13:26.366916] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-09-26T17:13:26.736234] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:13:27.156776] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-12. [2025-09-26T17:13:27.290170] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-26T17:13:27.831361] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-26T17:13:27.956767] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-08. [2025-09-26T17:13:28.037504] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-26T17:13:28.756774] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-09-26T17:13:29.450894] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-26T17:13:29.511101] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-26T17:13:29.556703] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-09-26T17:13:30.356741] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-09-26T17:13:30.653156] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-26T17:13:31.156742] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-09-26T17:13:31.945198] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-26T17:13:31.956667] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-09-26T17:13:32.335696] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-26T17:13:32.756755] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-09-26T17:13:33.541662] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-26T17:13:33.556679] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-09-26T17:13:33.969850] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-26T17:13:34.356767] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-09. [2025-09-26T17:13:35.112014] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-26T17:13:35.120393] [INFO ] [REMOTE ] AMRC: Full fetch complete (52817 records). [2025-09-26T17:13:35.120501] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-09-26T17:13:35.161835] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-09-26T17:13:35.556697] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-09-26T17:13:35.556813] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-09-26T17:13:35.557421] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-09-26T17:13:35.557489] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-09-26T17:13:35.558867] [DEBUG] [LOCAL ] AMRC: Trimmed 52817 records to 38981 (keeping 200 days of data) [2025-09-26T17:13:35.794687] [DEBUG] [LOCAL ] AMRC: Primary data saved (38981 records). [2025-09-26T17:13:35.794851] [INFO ] [MAIN ] AMRC: Full history saved. [2025-09-26T17:13:35.794943] [INFO ] [MAIN ] Update Progress: 107/2371 symbols completed. AMRC took 32.4s. Estimated remaining: 4h 46m 36s. Rate: 7.9 symbols/min [2025-09-26T17:13:35.994218] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:13:35.961789] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-09-26T17:13:36.002930] [DEBUG] [LOCAL ] AMTD: Loaded 3578 existing records from primary storage. [2025-09-26T17:13:36.003145] [INFO ] [MAIN ] AMTD: Loaded 3578 existing records. [2025-09-26T17:13:36.144993] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-26T17:13:36.174514] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-26T17:13:36.221386] [INFO ] [REMOTE ] AMRZ: Full fetch complete (25745 records). [2025-09-26T17:13:36.242315] [DEBUG] [VALIDATOR ] AMRZ: Validating primary data. [2025-09-26T17:13:36.264857] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:13:36.344740] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-09-26T17:13:36.356527] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-09-26T17:13:36.381468] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-09-26T17:13:36.381628] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-09-26T17:13:36.646298] [WARN ] [VALIDATOR ] AMRZ: Validation failed - insufficient historical data. Have 68 unique days, need 200 days [2025-09-26T17:13:36.662579] [FATAL] [MAIN ] AMRZ: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:13:36.663350] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:13:36.663802] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-26T17:13:36.664251] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-26T17:13:36.680409] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-09-26T17:13:36.735354] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-09-26T17:13:36.753561] [INFO ] [MAIN ] Update Progress: 108/2371 symbols completed. AMRZ took 33.3s. Estimated remaining: 4h 44m 10s. Rate: 8.0 symbols/min [2025-09-26T17:13:36.766099] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-09-26T17:13:37.060318] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:13:37.172534] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:13:37.244973] [DEBUG] [LOCAL ] AMTM: Loaded 51110 existing records from primary storage. [2025-09-26T17:13:37.245188] [INFO ] [MAIN ] AMTM: Loaded 51110 existing records. [2025-09-26T17:13:37.521457] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:13:37.522053] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-09-26T17:13:37.522128] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-09-26T17:13:37.556830] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-12. [2025-09-26T17:13:37.534230] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-09-26T17:13:37.558852] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-09-26T17:13:37.593484] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T17:13:37.891778] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-26T17:13:38.127389] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:13:38.361314] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-12. [2025-09-26T17:13:38.362335] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-26T17:13:39.156744] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-09-26T17:13:39.956751] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-09-26T17:13:40.269119] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-26T17:13:40.692085] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-26T17:13:40.756755] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-09-26T17:13:41.214257] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-26T17:13:41.523095] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-26T17:13:41.556724] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-09-26T17:13:42.356775] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-09-26T17:13:43.156706] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-09-26T17:13:43.441793] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-26T17:13:43.534680] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-26T17:13:43.637754] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-26T17:13:43.956743] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-09-26T17:13:44.756765] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-09-26T17:13:45.556741] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-09-26T17:13:45.962352] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-26T17:13:46.050659] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-26T17:13:46.356733] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-09-26T17:13:46.405367] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-26T17:13:46.897731] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-26T17:13:47.156741] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-09-26T17:13:47.956741] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-09-26T17:13:48.403114] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-26T17:13:48.683925] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-26T17:13:48.756774] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-09-26T17:13:49.556737] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-09-26T17:13:50.356750] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-09-26T17:13:50.595854] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-26T17:13:51.068633] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-26T17:13:51.156740] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-09-26T17:13:51.325122] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-26T17:13:51.564292] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-26T17:13:51.956759] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-09-26T17:13:52.756808] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-09-26T17:13:53.556722] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-09-26T17:13:53.872523] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-26T17:13:53.901509] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-26T17:13:54.356743] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-09-26T17:13:55.156745] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-09-26T17:13:55.458011] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-26T17:13:55.956726] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-09-26T17:13:56.343633] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-26T17:13:56.352552] [INFO ] [REMOTE ] AMTB: Full fetch complete (30119 records). [2025-09-26T17:13:56.352402] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-26T17:13:56.363073] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-09-26T17:13:56.392162] [INFO ] [REMOTE ] AMT: Full fetch complete (76009 records). [2025-09-26T17:13:56.422854] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-09-26T17:13:56.578849] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-26T17:13:56.764350] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-09-26T17:13:57.273364] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-09-26T17:13:57.287227] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-09-26T17:13:57.287526] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-09-26T17:13:57.288448] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-09-26T17:13:57.288575] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-09-26T17:13:57.289077] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-09-26T17:13:57.289265] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-09-26T17:13:57.289184] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-09-26T17:13:57.291452] [DEBUG] [LOCAL ] AMTB: Trimmed 30119 records to 20599 (keeping 200 days of data) [2025-09-26T17:13:57.292380] [DEBUG] [LOCAL ] AMT: Trimmed 76009 records to 53212 (keeping 200 days of data) [2025-09-26T17:13:57.513260] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-26T17:13:57.519207] [INFO ] [REMOTE ] AMTD: Full fetch complete (5602 records). [2025-09-26T17:13:57.519329] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-09-26T17:13:57.573246] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-09-26T17:13:57.854062] [DEBUG] [LOCAL ] AMTB: Primary data saved (20599 records). [2025-09-26T17:13:57.870236] [INFO ] [MAIN ] AMTB: Full history saved. [2025-09-26T17:13:57.921375] [INFO ] [MAIN ] Update Progress: 109/2371 symbols completed. AMTB took 32.0s. Estimated remaining: 4h 48m 45s. Rate: 7.8 symbols/min [2025-09-26T17:13:58.212735] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-09-26T17:13:58.224430] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-09-26T17:13:58.225250] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-09-26T17:13:58.236273] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-09-26T17:13:58.268279] [DEBUG] [LOCAL ] AMTD: Trimmed 5602 records to 3622 (keeping 200 days of data) [2025-09-26T17:13:58.302358] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:13:58.331689] [DEBUG] [LOCAL ] AMTD: Primary data saved (3622 records). [2025-09-26T17:13:58.333150] [INFO ] [MAIN ] AMTD: Full history saved. [2025-09-26T17:13:58.338975] [INFO ] [MAIN ] Update Progress: 110/2371 symbols completed. AMTD took 22.5s. Estimated remaining: 4h 46m 9s. Rate: 7.9 symbols/min [2025-09-26T17:13:58.340409] [DEBUG] [LOCAL ] AMWL: Loaded 8731 existing records from primary storage. [2025-09-26T17:13:58.341563] [INFO ] [MAIN ] AMWL: Loaded 8731 existing records. [2025-09-26T17:13:58.710366] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:13:58.790249] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:13:58.810030] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-09-26T17:13:58.812051] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-09-26T17:13:58.819150] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-09-26T17:13:58.820787] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-09-26T17:13:59.130768] [DEBUG] [LOCAL ] AMX: Loaded 49543 existing records from primary storage. [2025-09-26T17:13:59.097295] [DEBUG] [LOCAL ] AMT: Primary data saved (53212 records). [2025-09-26T17:13:59.153382] [INFO ] [MAIN ] AMT: Full history saved. [2025-09-26T17:13:59.163763] [INFO ] [MAIN ] Update Progress: 111/2371 symbols completed. AMT took 38.6s. Estimated remaining: 4h 43m 43s. Rate: 8.0 symbols/min [2025-09-26T17:13:59.163932] [INFO ] [MAIN ] AMX: Loaded 49543 existing records. [2025-09-26T17:13:59.525882] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:13:59.549710] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-12. [2025-09-26T17:13:59.708759] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:13:59.760458] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:13:59.781205] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-09-26T17:13:59.792737] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-09-26T17:13:59.794831] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-26T17:13:59.805620] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-09-26T17:13:59.806788] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-09-26T17:13:59.848831] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-09-26T17:14:00.016292] [DEBUG] [LOCAL ] AN: Loaded 32630 existing records from primary storage. [2025-09-26T17:14:00.030674] [INFO ] [MAIN ] AN: Loaded 32630 existing records. [2025-09-26T17:14:00.434133] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:14:00.455186] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-09-26T17:14:00.477181] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-09-26T17:14:00.477099] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:14:00.477546] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-12. [2025-09-26T17:14:00.479418] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-09-26T17:14:00.479490] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-09-26T17:14:00.812032] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-26T17:14:00.831022] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-09-26T17:14:00.890822] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:14:01.527622] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-26T17:14:01.556741] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-09-26T17:14:01.869627] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-26T17:14:02.061239] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-26T17:14:02.146773] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-26T17:14:02.356749] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-12. [2025-09-26T17:14:03.156735] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-09-26T17:14:03.956723] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-09-26T17:14:03.997846] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-26T17:14:04.756708] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-09-26T17:14:04.804607] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-26T17:14:05.426874] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-26T17:14:05.466707] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-26T17:14:05.556736] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-09-26T17:14:06.356741] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-09-26T17:14:07.161867] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-09-26T17:14:07.179459] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-26T17:14:07.374092] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-26T17:14:07.662964] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-26T17:14:07.956733] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-09-26T17:14:08.756754] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-09-26T17:14:09.551116] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-26T17:14:09.556668] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-09-26T17:14:09.956254] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-26T17:14:10.321545] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-26T17:14:10.356697] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-09-26T17:14:11.026545] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-26T17:14:11.156733] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-09-26T17:14:11.956727] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-09-26T17:14:12.756740] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-09-26T17:14:13.307869] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-26T17:14:13.318553] [INFO ] [REMOTE ] AMTM: Full fetch complete (73974 records). [2025-09-26T17:14:13.318789] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-09-26T17:14:13.577557] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-09-26T17:14:13.637225] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-26T17:14:13.772020] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-09-26T17:14:13.772153] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-09-26T17:14:13.773009] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-09-26T17:14:13.773100] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-09-26T17:14:13.775125] [DEBUG] [LOCAL ] AMTM: Trimmed 73974 records to 51451 (keeping 200 days of data) [2025-09-26T17:14:13.862449] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-26T17:14:14.121821] [DEBUG] [LOCAL ] AMTM: Primary data saved (51451 records). [2025-09-26T17:14:14.121976] [INFO ] [MAIN ] AMTM: Full history saved. [2025-09-26T17:14:14.124076] [INFO ] [MAIN ] Update Progress: 112/2371 symbols completed. AMTM took 37.4s. Estimated remaining: 4h 46m 5s. Rate: 7.9 symbols/min [2025-09-26T17:14:14.301756] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:14:14.361563] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-09-26T17:14:14.363790] [DEBUG] [LOCAL ] ANET: Loaded 54156 existing records from primary storage. [2025-09-26T17:14:14.364084] [INFO ] [MAIN ] ANET: Loaded 54156 existing records. [2025-09-26T17:14:14.554666] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:14:14.554963] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-09-26T17:14:14.555027] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-09-26T17:14:14.556586] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-09-26T17:14:14.556678] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-09-26T17:14:14.947741] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:14:14.969925] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-26T17:14:15.156727] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-09-26T17:14:15.924597] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-26T17:14:15.956685] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-09-26T17:14:16.216023] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-26T17:14:16.756718] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-09-26T17:14:17.186142] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-26T17:14:17.410598] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-26T17:14:17.413505] [INFO ] [REMOTE ] AMWL: Full fetch complete (14028 records). [2025-09-26T17:14:17.413602] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-09-26T17:14:17.569847] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-09-26T17:14:17.831386] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-09-26T17:14:17.831469] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-09-26T17:14:17.831736] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-09-26T17:14:17.831814] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-09-26T17:14:17.832359] [DEBUG] [LOCAL ] AMWL: Trimmed 14028 records to 8830 (keeping 200 days of data) [2025-09-26T17:14:17.881053] [DEBUG] [LOCAL ] AMWL: Primary data saved (8830 records). [2025-09-26T17:14:17.881190] [INFO ] [MAIN ] AMWL: Full history saved. [2025-09-26T17:14:17.881292] [INFO ] [MAIN ] Update Progress: 113/2371 symbols completed. AMWL took 19.9s. Estimated remaining: 4h 44m 41s. Rate: 7.9 symbols/min [2025-09-26T17:14:18.058782] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:14:18.119975] [DEBUG] [LOCAL ] ANF: Loaded 52603 existing records from primary storage. [2025-09-26T17:14:18.120202] [INFO ] [MAIN ] ANF: Loaded 52603 existing records. [2025-09-26T17:14:18.355899] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:14:18.356235] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-09-26T17:14:18.356293] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-09-26T17:14:18.356723] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-12. [2025-09-26T17:14:18.358001] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-09-26T17:14:18.358083] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-09-26T17:14:18.749206] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:14:19.108942] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-26T17:14:19.156706] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-09-26T17:14:19.956778] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-09-26T17:14:20.401307] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-26T17:14:20.448178] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-26T17:14:20.756751] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-09-26T17:14:21.158933] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-26T17:14:21.556726] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-09-26T17:14:21.774414] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-26T17:14:22.356762] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-09-26T17:14:22.957964] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-26T17:14:23.156737] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-09-26T17:14:23.588512] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-26T17:14:23.956738] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-09-26T17:14:24.756780] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-12. [2025-09-26T17:14:25.556755] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-09-26T17:14:25.613509] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-09-26T17:14:25.693765] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-26T17:14:26.357725] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-09-26T17:14:26.361146] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-26T17:14:26.537066] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-26T17:14:27.156749] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-09-26T17:14:27.956782] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-09-26T17:14:28.616102] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-26T17:14:28.756738] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-09-26T17:14:28.936812] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-26T17:14:28.946975] [INFO ] [REMOTE ] AMX: Full fetch complete (70710 records). [2025-09-26T17:14:28.947150] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-09-26T17:14:29.374510] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-09-26T17:14:29.374622] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-09-26T17:14:29.375456] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-09-26T17:14:29.375534] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-09-26T17:14:29.377161] [DEBUG] [LOCAL ] AMX: Trimmed 70710 records to 49855 (keeping 200 days of data) [2025-09-26T17:14:29.564151] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-09-26T17:14:29.702175] [DEBUG] [LOCAL ] AMX: Primary data saved (49855 records). [2025-09-26T17:14:29.702464] [INFO ] [MAIN ] AMX: Full history saved. [2025-09-26T17:14:29.702686] [INFO ] [MAIN ] Update Progress: 114/2371 symbols completed. AMX took 31.4s. Estimated remaining: 4h 45m 58s. Rate: 7.9 symbols/min [2025-09-26T17:14:29.935873] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:14:29.937307] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-09-26T17:14:29.939314] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-26T17:14:29.939529] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-09-26T17:14:29.952067] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-09-26T17:14:29.952549] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-26T17:14:29.952637] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-26T17:14:29.952780] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-09-26T17:14:30.362012] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-09-26T17:14:30.452967] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:14:30.811094] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-26T17:14:30.822153] [INFO ] [REMOTE ] AN: Full fetch complete (47668 records). [2025-09-26T17:14:30.822364] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-09-26T17:14:31.165141] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-09-26T17:14:31.370776] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-09-26T17:14:31.371133] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-09-26T17:14:31.371748] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-09-26T17:14:31.371815] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-09-26T17:14:31.373164] [DEBUG] [LOCAL ] AN: Trimmed 47668 records to 32842 (keeping 200 days of data) [2025-09-26T17:14:31.412369] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-09-26T17:14:31.477441] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:14:31.515801] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-09-26T17:14:31.636740] [DEBUG] [LOCAL ] AN: Primary data saved (32842 records). [2025-09-26T17:14:31.636904] [INFO ] [MAIN ] AN: Full history saved. [2025-09-26T17:14:31.637014] [INFO ] [MAIN ] Update Progress: 115/2371 symbols completed. AN took 32.4s. Estimated remaining: 4h 43m 59s. Rate: 7.9 symbols/min [2025-09-26T17:14:31.822914] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:14:31.823089] [DEBUG] [LOCAL ] ANRO: No existing data file found in primary storage. [2025-09-26T17:14:31.823129] [WARN ] [MAIN ] ANRO: No existing data found, performing full refresh instead. [2025-09-26T17:14:31.823276] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-09-26T17:14:31.823320] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-09-26T17:14:31.823362] [DEBUG] [LOCAL ] ANRO: No primary data file found to delete. [2025-09-26T17:14:31.823396] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-09-26T17:14:31.961820] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-09-26T17:14:32.226929] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:14:32.429271] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-26T17:14:32.756759] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-09-26T17:14:33.556740] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-12. [2025-09-26T17:14:34.361825] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-01. [2025-09-26T17:14:34.379330] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-26T17:14:34.457864] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-26T17:14:34.490583] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-26T17:14:34.598090] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:14:34.598403] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-01 [2025-09-26T17:14:35.156801] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-09-26T17:14:35.956772] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-02. [2025-09-26T17:14:36.167278] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:14:36.167638] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-02 [2025-09-26T17:14:36.756742] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-09-26T17:14:37.471783] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-26T17:14:37.556711] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-09-26T17:14:38.356794] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-03. [2025-09-26T17:14:38.564128] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-26T17:14:38.577178] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:14:38.577723] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-03 [2025-09-26T17:14:38.709101] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-26T17:14:39.156794] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-09-26T17:14:39.956750] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-09-26T17:14:40.756748] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-09-26T17:14:41.166717] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-26T17:14:41.438033] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-26T17:14:41.556739] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-09-26T17:14:41.846409] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-26T17:14:42.356731] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-04. [2025-09-26T17:14:42.559029] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:14:42.559455] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-04 [2025-09-26T17:14:43.156734] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-05. [2025-09-26T17:14:43.203444] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-26T17:14:43.356455] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:14:43.356872] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-05 [2025-09-26T17:14:43.956744] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-06. [2025-09-26T17:14:44.311817] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:14:44.312179] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-06 [2025-09-26T17:14:44.756777] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-09-26T17:14:45.556748] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-09-26T17:14:46.353278] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-26T17:14:46.359515] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-09-26T17:14:47.042157] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-26T17:14:47.156771] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-07. [2025-09-26T17:14:47.364980] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:14:47.365319] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-07 [2025-09-26T17:14:47.956733] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-08. [2025-09-26T17:14:48.177518] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:14:48.177930] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-08 [2025-09-26T17:14:48.419520] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-26T17:14:48.756784] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-09. [2025-09-26T17:14:49.556730] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-09-26T17:14:50.356712] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-09-26T17:14:50.457986] [INFO ] [REMOTE ] ANGX: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-26T17:14:50.465029] [INFO ] [REMOTE ] ANGX: Full fetch complete (3864 records). [2025-09-26T17:14:50.465199] [DEBUG] [VALIDATOR ] ANGX: Validating primary data. [2025-09-26T17:14:50.465736] [FATAL] [VALIDATOR ] ANGX: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:14:50.465837] [FATAL] [MAIN ] ANGX: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:14:50.465882] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:14:50.465925] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-26T17:14:50.466010] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-26T17:14:50.466070] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-09-26T17:14:50.466132] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-09-26T17:14:50.466218] [INFO ] [MAIN ] Update Progress: 116/2371 symbols completed. ANGX took 20.8s. Estimated remaining: 4h 47m 31s. Rate: 7.8 symbols/min [2025-09-26T17:14:50.659215] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:14:50.684924] [DEBUG] [LOCAL ] ANVS: Loaded 23312 existing records from primary storage. [2025-09-26T17:14:50.685131] [INFO ] [MAIN ] ANVS: Loaded 23312 existing records. [2025-09-26T17:14:50.874990] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:14:50.875260] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-09-26T17:14:50.875312] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-09-26T17:14:50.876160] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-09-26T17:14:50.876249] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-09-26T17:14:51.157558] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-09-26T17:14:51.285272] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:14:51.321187] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-26T17:14:51.903938] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-09-26T17:14:51.956755] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-09-26T17:14:52.714419] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-26T17:14:52.756733] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-09-26T17:14:53.294094] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-26T17:14:53.560807] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-12. [2025-09-26T17:14:53.570400] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-26T17:14:54.356790] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-09-26T17:14:54.923386] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-26T17:14:55.156749] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-09-26T17:14:55.956715] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-09-26T17:14:55.992117] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-26T17:14:56.003410] [INFO ] [REMOTE ] ANF: Full fetch complete (75644 records). [2025-09-26T17:14:56.003622] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-09-26T17:14:56.442848] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-09-26T17:14:56.442969] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-09-26T17:14:56.443753] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-09-26T17:14:56.443854] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-09-26T17:14:56.445494] [DEBUG] [LOCAL ] ANF: Trimmed 75644 records to 52967 (keeping 200 days of data) [2025-09-26T17:14:56.756845] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-09-26T17:14:56.783583] [DEBUG] [LOCAL ] ANF: Primary data saved (52967 records). [2025-09-26T17:14:56.783777] [INFO ] [MAIN ] ANF: Full history saved. [2025-09-26T17:14:56.784007] [INFO ] [MAIN ] Update Progress: 117/2371 symbols completed. ANF took 38.9s. Estimated remaining: 4h 46m 57s. Rate: 7.9 symbols/min [2025-09-26T17:14:57.028559] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-26T17:14:57.321576] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-26T17:14:57.333579] [INFO ] [REMOTE ] ANET: Full fetch complete (77859 records). [2025-09-26T17:14:57.333795] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-09-26T17:14:57.568133] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-09-26T17:14:57.772386] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-09-26T17:14:57.772503] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-09-26T17:14:57.773333] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-09-26T17:14:57.773433] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-09-26T17:14:57.784496] [DEBUG] [LOCAL ] ANET: Trimmed 77859 records to 54546 (keeping 200 days of data) [2025-09-26T17:14:57.797947] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-26T17:14:58.149665] [DEBUG] [LOCAL ] ANET: Primary data saved (54546 records). [2025-09-26T17:14:58.150127] [INFO ] [MAIN ] ANET: Full history saved. [2025-09-26T17:14:58.151382] [INFO ] [MAIN ] Update Progress: 118/2371 symbols completed. ANET took 44.0s. Estimated remaining: 4h 44m 50s. Rate: 7.9 symbols/min [2025-09-26T17:14:58.287288] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-26T17:14:58.356764] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-09-26T17:14:59.156808] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-09-26T17:14:59.574127] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-26T17:14:59.777114] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-26T17:14:59.779896] [INFO ] [REMOTE ] ANRO: Full fetch complete (29998 records). [2025-09-26T17:14:59.779989] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-09-26T17:14:59.967467] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-09-26T17:15:00.206699] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-09-26T17:15:00.206804] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-09-26T17:15:00.207209] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-09-26T17:15:00.207273] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-09-26T17:15:00.208130] [DEBUG] [LOCAL ] ANRO: Trimmed 29998 records to 19387 (keeping 200 days of data) [2025-09-26T17:15:00.333326] [DEBUG] [LOCAL ] ANRO: Primary data saved (19387 records). [2025-09-26T17:15:00.333507] [INFO ] [MAIN ] ANRO: Full history saved. [2025-09-26T17:15:00.333664] [INFO ] [MAIN ] Update Progress: 119/2371 symbols completed. ANRO took 28.7s. Estimated remaining: 4h 43m 0s. Rate: 8.0 symbols/min [2025-09-26T17:15:01.436585] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-26T17:15:01.443582] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-09-26T17:15:02.903511] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-26T17:15:02.911139] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-09-26T17:15:04.454160] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-26T17:15:04.460427] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-09-26T17:15:05.846155] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-26T17:15:05.853440] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-09-26T17:15:06.906738] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-26T17:15:06.912959] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-09-26T17:15:08.025320] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-26T17:15:08.033835] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-09-26T17:15:09.229754] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-26T17:15:09.233823] [INFO ] [REMOTE ] ANVS: Full fetch complete (36553 records). [2025-09-26T17:15:09.233930] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-09-26T17:15:09.643909] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-09-26T17:15:09.644020] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-09-26T17:15:09.644458] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-09-26T17:15:09.644501] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-09-26T17:15:09.645709] [DEBUG] [LOCAL ] ANVS: Trimmed 36553 records to 23508 (keeping 200 days of data) [2025-09-26T17:15:09.793422] [DEBUG] [LOCAL ] ANVS: Primary data saved (23508 records). [2025-09-26T17:15:09.793564] [INFO ] [MAIN ] ANVS: Full history saved. [2025-09-26T17:15:09.793675] [INFO ] [MAIN ] Update Progress: 120/2371 symbols completed. ANVS took 19.3s. Estimated remaining: 4h 43m 29s. Rate: 7.9 symbols/min [2025-09-26T17:15:10.519146] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:15:10.512831] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:15:10.537956] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:15:10.558912] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-09-26T17:15:10.558728] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:15:10.560037] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-09-26T17:15:10.562570] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-09-26T17:15:10.562782] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-26T17:15:10.562884] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-26T17:15:10.562972] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-09-26T17:15:10.680557] [DEBUG] [LOCAL ] AOMR: Loaded 16780 existing records from primary storage. [2025-09-26T17:15:10.693915] [INFO ] [MAIN ] AOMR: Loaded 16780 existing records. [2025-09-26T17:15:10.983668] [DEBUG] [LOCAL ] AOD: Loaded 30246 existing records from primary storage. [2025-09-26T17:15:11.071267] [DEBUG] [LOCAL ] AON: Loaded 45981 existing records from primary storage. [2025-09-26T17:15:11.061017] [INFO ] [MAIN ] AOD: Loaded 30246 existing records. [2025-09-26T17:15:11.111778] [INFO ] [MAIN ] AON: Loaded 45981 existing records. [2025-09-26T17:15:11.111480] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:15:11.154818] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-09-26T17:15:11.203684] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-09-26T17:15:11.317164] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-09-26T17:15:11.379442] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-09-26T17:15:11.565736] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:15:11.661138] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-09-26T17:15:11.750560] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:15:11.793488] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-09-26T17:15:11.793680] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:15:11.804629] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-09-26T17:15:11.815204] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-09-26T17:15:11.815331] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-09-26T17:15:11.821578] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-09-26T17:15:11.821512] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-09-26T17:15:11.843001] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-09-26T17:15:11.842916] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-09-26T17:15:12.075298] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:15:12.197800] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-09-26T17:15:12.224705] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-01. [2025-09-26T17:15:12.534495] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:15:12.647965] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-01 [2025-09-26T17:15:12.710563] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-02. [2025-09-26T17:15:12.670862] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:15:12.756795] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-12. [2025-09-26T17:15:12.853538] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:15:12.869373] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-12. [2025-09-26T17:15:12.945035] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:15:12.945388] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-12. [2025-09-26T17:15:13.034979] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:15:13.035324] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-02 [2025-09-26T17:15:13.035877] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-03. [2025-09-26T17:15:13.396293] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:15:13.396691] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-03 [2025-09-26T17:15:13.397208] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-04. [2025-09-26T17:15:13.742436] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:15:13.742788] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-04 [2025-09-26T17:15:13.743244] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-05. [2025-09-26T17:15:14.122242] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-26T17:15:14.125676] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-09-26T17:15:14.311898] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-26T17:15:14.319058] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-09-26T17:15:14.341660] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-26T17:15:14.356716] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-06. [2025-09-26T17:15:14.642557] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-26T17:15:14.894887] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-26T17:15:14.904204] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-26T17:15:15.156764] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-09-26T17:15:15.481461] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-26T17:15:15.956750] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-07. [2025-09-26T17:15:16.250588] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-26T17:15:16.689050] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-26T17:15:16.756796] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-08. [2025-09-26T17:15:17.262890] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-26T17:15:17.556744] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-09-26T17:15:18.356783] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-09. [2025-09-26T17:15:18.548615] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-26T17:15:18.872391] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-26T17:15:18.873490] [INFO ] [REMOTE ] AOMD: Full fetch complete (1808 records). [2025-09-26T17:15:18.873561] [DEBUG] [VALIDATOR ] AOMD: Validating primary data. [2025-09-26T17:15:19.062145] [WARN ] [VALIDATOR ] AOMD: Validation failed - insufficient historical data. Have 86 unique days, need 200 days [2025-09-26T17:15:19.062398] [FATAL] [MAIN ] AOMD: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:15:19.062504] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:15:19.062583] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-26T17:15:19.062681] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-26T17:15:19.062739] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-09-26T17:15:19.062803] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-09-26T17:15:19.062904] [INFO ] [MAIN ] Update Progress: 121/2371 symbols completed. AOMD took 9.3s. Estimated remaining: 4h 43m 53s. Rate: 7.9 symbols/min [2025-09-26T17:15:19.161903] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-09-26T17:15:19.255715] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:15:19.286274] [DEBUG] [LOCAL ] AORT: Loaded 29879 existing records from primary storage. [2025-09-26T17:15:19.286468] [INFO ] [MAIN ] AORT: Loaded 29879 existing records. [2025-09-26T17:15:19.474805] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:15:19.475109] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-09-26T17:15:19.475171] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-09-26T17:15:19.476015] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-09-26T17:15:19.476077] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-09-26T17:15:19.906924] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:15:19.956743] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-12. [2025-09-26T17:15:20.604756] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-26T17:15:20.756778] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-09-26T17:15:20.842685] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-26T17:15:21.511941] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-26T17:15:21.556783] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-09-26T17:15:22.356699] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-09-26T17:15:22.584286] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-26T17:15:23.156745] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-09-26T17:15:23.956702] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-09-26T17:15:24.043324] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-26T17:15:24.218931] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-26T17:15:24.756774] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-09-26T17:15:24.933380] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-26T17:15:25.556725] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-09-26T17:15:25.920453] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-26T17:15:26.356766] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-09-26T17:15:26.555960] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-26T17:15:27.156770] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-09-26T17:15:27.956783] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-09-26T17:15:28.196842] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-26T17:15:28.340080] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-26T17:15:28.756797] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-09-26T17:15:29.548418] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-26T17:15:29.556676] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-09-26T17:15:30.163080] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-26T17:15:30.356759] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-09-26T17:15:30.830097] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-26T17:15:31.101033] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-26T17:15:31.156773] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-09-26T17:15:31.956741] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-09-26T17:15:32.754586] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-26T17:15:32.757467] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-09-26T17:15:33.353618] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-26T17:15:33.556740] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-09-26T17:15:33.680594] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-26T17:15:34.356758] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-09-26T17:15:34.838198] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-26T17:15:35.156689] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-09-26T17:15:35.559095] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-26T17:15:35.956759] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-09-26T17:15:36.358502] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-26T17:15:36.756767] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-09-26T17:15:37.556709] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-09-26T17:15:37.597183] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-26T17:15:37.744961] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-26T17:15:38.356739] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-09-26T17:15:38.939680] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-26T17:15:39.156760] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-09-26T17:15:39.366382] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-26T17:15:39.956738] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-09-26T17:15:40.288354] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-26T17:15:40.295007] [INFO ] [REMOTE ] AORT: Full fetch complete (41799 records). [2025-09-26T17:15:40.295192] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-09-26T17:15:40.702146] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-09-26T17:15:40.702253] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-09-26T17:15:40.702793] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-09-26T17:15:40.702860] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-09-26T17:15:40.704039] [DEBUG] [LOCAL ] AORT: Trimmed 41799 records to 30087 (keeping 200 days of data) [2025-09-26T17:15:40.765094] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-09-26T17:15:40.890839] [DEBUG] [LOCAL ] AORT: Primary data saved (30087 records). [2025-09-26T17:15:40.891019] [INFO ] [MAIN ] AORT: Full history saved. [2025-09-26T17:15:40.891117] [INFO ] [MAIN ] Update Progress: 122/2371 symbols completed. AORT took 21.8s. Estimated remaining: 4h 48m 8s. Rate: 7.8 symbols/min [2025-09-26T17:15:41.080902] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:15:41.081315] [DEBUG] [LOCAL ] AOS: No existing data file found in primary storage. [2025-09-26T17:15:41.081527] [WARN ] [MAIN ] AOS: No existing data found, performing full refresh instead. [2025-09-26T17:15:41.081759] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-09-26T17:15:41.081823] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-09-26T17:15:41.082148] [DEBUG] [LOCAL ] AOS: No primary data file found to delete. [2025-09-26T17:15:41.082214] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-09-26T17:15:41.180700] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-26T17:15:41.235839] [INFO ] [REMOTE ] AOD: Full fetch complete (44060 records). [2025-09-26T17:15:41.241336] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-09-26T17:15:41.560858] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-09-26T17:15:41.929386] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:15:42.041139] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-09-26T17:15:42.041859] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-09-26T17:15:42.043172] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-09-26T17:15:42.043279] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-09-26T17:15:42.042234] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-26T17:15:42.048080] [DEBUG] [LOCAL ] AOD: Trimmed 44060 records to 30414 (keeping 200 days of data) [2025-09-26T17:15:42.236180] [DEBUG] [LOCAL ] AOD: Primary data saved (30414 records). [2025-09-26T17:15:42.236355] [INFO ] [MAIN ] AOD: Full history saved. [2025-09-26T17:15:42.236472] [INFO ] [MAIN ] Update Progress: 123/2371 symbols completed. AOD took 32.4s. Estimated remaining: 4h 46m 5s. Rate: 7.9 symbols/min [2025-09-26T17:15:42.366329] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-09-26T17:15:42.459278] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:15:42.468662] [DEBUG] [LOCAL ] AP: Loaded 7174 existing records from primary storage. [2025-09-26T17:15:42.468820] [INFO ] [MAIN ] AP: Loaded 7174 existing records. [2025-09-26T17:15:42.672257] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:15:42.672528] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-09-26T17:15:42.672578] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-09-26T17:15:42.673015] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-09-26T17:15:42.673076] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-09-26T17:15:43.093448] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:15:43.156791] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-12. [2025-09-26T17:15:43.369766] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-26T17:15:43.425447] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-26T17:15:43.956809] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-09-26T17:15:44.484913] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-26T17:15:44.704308] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-26T17:15:44.708412] [INFO ] [REMOTE ] AOMR: Full fetch complete (23082 records). [2025-09-26T17:15:44.708576] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-09-26T17:15:44.765546] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-12. [2025-09-26T17:15:45.109092] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-09-26T17:15:45.109183] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-09-26T17:15:45.109493] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-09-26T17:15:45.109535] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-09-26T17:15:45.110332] [DEBUG] [LOCAL ] AOMR: Trimmed 23082 records to 16852 (keeping 200 days of data) [2025-09-26T17:15:45.214292] [DEBUG] [LOCAL ] AOMR: Primary data saved (16852 records). [2025-09-26T17:15:45.214447] [INFO ] [MAIN ] AOMR: Full history saved. [2025-09-26T17:15:45.214538] [INFO ] [MAIN ] Update Progress: 124/2371 symbols completed. AOMR took 35.4s. Estimated remaining: 4h 44m 33s. Rate: 7.9 symbols/min [2025-09-26T17:15:45.433504] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:15:45.486221] [DEBUG] [LOCAL ] APAM: Loaded 36716 existing records from primary storage. [2025-09-26T17:15:45.486453] [INFO ] [MAIN ] APAM: Loaded 36716 existing records. [2025-09-26T17:15:45.559058] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-09-26T17:15:45.572888] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-26T17:15:45.688787] [WARN ] [MAIN ] APAM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:15:45.689099] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-09-26T17:15:45.689157] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-09-26T17:15:45.690221] [DEBUG] [LOCAL ] APAM: Deleted primary data file. [2025-09-26T17:15:45.690284] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-09-26T17:15:46.072310] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:15:46.356733] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-09-26T17:15:47.053354] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-26T17:15:47.156704] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-09-26T17:15:47.237611] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-26T17:15:47.519665] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-26T17:15:47.956815] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-09-26T17:15:48.530458] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-26T17:15:48.756760] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-09-26T17:15:49.219979] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-26T17:15:49.556750] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-09-26T17:15:50.356738] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-09-26T17:15:51.135610] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-26T17:15:51.156745] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-12. [2025-09-26T17:15:51.342734] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-26T17:15:51.956757] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-09-26T17:15:52.232264] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-26T17:15:52.478619] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-26T17:15:52.756765] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-09-26T17:15:53.556740] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-09-26T17:15:54.076443] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-26T17:15:54.356728] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-09-26T17:15:55.109294] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-26T17:15:55.120017] [INFO ] [REMOTE ] AON: Full fetch complete (64932 records). [2025-09-26T17:15:55.120199] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-09-26T17:15:55.161986] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-09-26T17:15:55.565426] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-09-26T17:15:55.565525] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-09-26T17:15:55.566171] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-09-26T17:15:55.566239] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-09-26T17:15:55.569859] [DEBUG] [LOCAL ] AON: Trimmed 64932 records to 46248 (keeping 200 days of data) [2025-09-26T17:15:55.907961] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-26T17:15:55.926023] [DEBUG] [LOCAL ] AON: Primary data saved (46248 records). [2025-09-26T17:15:55.926188] [INFO ] [MAIN ] AON: Full history saved. [2025-09-26T17:15:55.926294] [INFO ] [MAIN ] Update Progress: 125/2371 symbols completed. AON took 46.1s. Estimated remaining: 4h 45m 21s. Rate: 7.9 symbols/min [2025-09-26T17:15:55.961838] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-09-26T17:15:56.113338] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:15:56.113538] [DEBUG] [LOCAL ] APD: No existing data file found in primary storage. [2025-09-26T17:15:56.113577] [WARN ] [MAIN ] APD: No existing data found, performing full refresh instead. [2025-09-26T17:15:56.113749] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-09-26T17:15:56.113801] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-09-26T17:15:56.113846] [DEBUG] [LOCAL ] APD: No primary data file found to delete. [2025-09-26T17:15:56.113881] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-09-26T17:15:56.521443] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:15:56.524141] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-26T17:15:56.621285] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-26T17:15:56.756756] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-12. [2025-09-26T17:15:57.556760] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-09-26T17:15:58.204169] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-26T17:15:58.356743] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-09-26T17:15:58.601412] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-26T17:15:59.156731] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-09-26T17:15:59.914448] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-26T17:15:59.956688] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-09-26T17:16:00.242916] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-26T17:16:00.756739] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-09-26T17:16:01.381871] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-26T17:16:01.556719] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-09-26T17:16:01.977131] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-26T17:16:02.356744] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-09-26T17:16:02.813885] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-26T17:16:02.868563] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-26T17:16:03.156724] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-09-26T17:16:03.935890] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-26T17:16:03.938114] [INFO ] [REMOTE ] AP: Full fetch complete (8864 records). [2025-09-26T17:16:03.938219] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-09-26T17:16:03.938861] [FATAL] [VALIDATOR ] AP: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:16:03.938953] [FATAL] [MAIN ] AP: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:16:03.938999] [WARN ] [MAIN ] AP: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:16:03.939039] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-09-26T17:16:03.939100] [DEBUG] [LOCAL ] AP: No primary data file found to delete. [2025-09-26T17:16:03.939138] [INFO ] [LOCAL ] AP: Starting deletion of derivative data. [2025-09-26T17:16:03.939697] [DEBUG] [LOCAL ] AP: Deleted derivative data file. [2025-09-26T17:16:03.939798] [INFO ] [MAIN ] Update Progress: 126/2371 symbols completed. AP took 21.7s. Estimated remaining: 4h 45m 20s. Rate: 7.9 symbols/min [2025-09-26T17:16:03.962467] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-09-26T17:16:04.140550] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:16:04.140797] [DEBUG] [LOCAL ] APG: No existing data file found in primary storage. [2025-09-26T17:16:04.140854] [WARN ] [MAIN ] APG: No existing data found, performing full refresh instead. [2025-09-26T17:16:04.141005] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-09-26T17:16:04.141051] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-09-26T17:16:04.141093] [DEBUG] [LOCAL ] APG: No primary data file found to delete. [2025-09-26T17:16:04.141126] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-09-26T17:16:04.540156] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:16:04.756746] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-09-26T17:16:05.556744] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-12. [2025-09-26T17:16:05.789060] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-26T17:16:06.356808] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-09-26T17:16:06.362487] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-26T17:16:06.845734] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-26T17:16:07.156722] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-09-26T17:16:07.957687] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-09-26T17:16:07.957573] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T17:16:08.159577] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-26T17:16:08.756731] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-09-26T17:16:09.384060] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-26T17:16:09.556816] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-09-26T17:16:09.950387] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-26T17:16:10.356781] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-09-26T17:16:10.764880] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-26T17:16:11.156725] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-09-26T17:16:11.713808] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-26T17:16:11.956779] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-09-26T17:16:12.756842] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-09-26T17:16:13.009285] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-26T17:16:13.189144] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-26T17:16:13.556747] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-09-26T17:16:13.919254] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-26T17:16:14.356780] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-09-26T17:16:15.047732] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-26T17:16:15.156769] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-09-26T17:16:15.660750] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-26T17:16:15.667733] [INFO ] [REMOTE ] APAM: Full fetch complete (51617 records). [2025-09-26T17:16:15.667932] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-09-26T17:16:15.961837] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-09-26T17:16:16.083783] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present. [2025-09-26T17:16:16.083926] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed. [2025-09-26T17:16:16.084512] [INFO ] [MAIN ] APAM: Fetched primary data is valid. [2025-09-26T17:16:16.084577] [DEBUG] [LOCAL ] APAM: Saving primary data. [2025-09-26T17:16:16.085879] [DEBUG] [LOCAL ] APAM: Trimmed 51617 records to 36969 (keeping 200 days of data) [2025-09-26T17:16:16.316375] [DEBUG] [LOCAL ] APAM: Primary data saved (36969 records). [2025-09-26T17:16:16.316531] [INFO ] [MAIN ] APAM: Full history saved. [2025-09-26T17:16:16.316621] [INFO ] [MAIN ] Update Progress: 127/2371 symbols completed. APAM took 31.1s. Estimated remaining: 4h 46m 37s. Rate: 7.8 symbols/min [2025-09-26T17:16:16.511052] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:16:16.511370] [DEBUG] [LOCAL ] APH: No existing data file found in primary storage. [2025-09-26T17:16:16.511486] [WARN ] [MAIN ] APH: No existing data found, performing full refresh instead. [2025-09-26T17:16:16.511763] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-09-26T17:16:16.511972] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-09-26T17:16:16.512053] [DEBUG] [LOCAL ] APH: No primary data file found to delete. [2025-09-26T17:16:16.512244] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-09-26T17:16:16.715539] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-26T17:16:16.761554] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-09-26T17:16:16.980980] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:16:17.440788] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-26T17:16:17.556744] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-12. [2025-09-26T17:16:18.356753] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-09-26T17:16:19.017283] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-26T17:16:19.156741] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-09-26T17:16:19.624957] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-26T17:16:19.956712] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-09-26T17:16:20.309390] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-26T17:16:20.756762] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-09-26T17:16:21.080113] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-26T17:16:21.090348] [INFO ] [REMOTE ] AOS: Full fetch complete (70669 records). [2025-09-26T17:16:21.090533] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-09-26T17:16:21.532783] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-09-26T17:16:21.532887] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-09-26T17:16:21.534694] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-09-26T17:16:21.534773] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-09-26T17:16:21.536469] [DEBUG] [LOCAL ] AOS: Trimmed 70669 records to 49769 (keeping 200 days of data) [2025-09-26T17:16:21.597153] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-09-26T17:16:21.694336] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-26T17:16:21.913979] [DEBUG] [LOCAL ] AOS: Primary data saved (49769 records). [2025-09-26T17:16:21.914175] [INFO ] [MAIN ] AOS: Full history saved. [2025-09-26T17:16:21.914302] [INFO ] [MAIN ] Update Progress: 128/2371 symbols completed. AOS took 41.0s. Estimated remaining: 4h 45m 53s. Rate: 7.8 symbols/min [2025-09-26T17:16:22.103305] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:16:22.139776] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-26T17:16:22.201994] [DEBUG] [LOCAL ] APLE: Loaded 52397 existing records from primary storage. [2025-09-26T17:16:22.202258] [INFO ] [MAIN ] APLE: Loaded 52397 existing records. [2025-09-26T17:16:22.365399] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-09-26T17:16:22.401523] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:16:22.401888] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-09-26T17:16:22.401959] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-09-26T17:16:22.403582] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-09-26T17:16:22.403673] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-09-26T17:16:22.935913] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:16:23.088472] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T17:16:23.156714] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-09-26T17:16:23.904035] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-26T17:16:23.956787] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-09-26T17:16:24.706895] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T17:16:24.756768] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-09-26T17:16:25.451409] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-26T17:16:25.556738] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-09-26T17:16:26.015723] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-26T17:16:26.356787] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-12. [2025-09-26T17:16:27.156761] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-09-26T17:16:27.591761] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-26T17:16:27.956777] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-09-26T17:16:28.425389] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-26T17:16:28.756749] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-09-26T17:16:28.924407] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-26T17:16:28.933633] [INFO ] [REMOTE ] APD: Full fetch complete (66296 records). [2025-09-26T17:16:28.933898] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-09-26T17:16:28.934907] [FATAL] [VALIDATOR ] APD: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:16:28.935023] [FATAL] [MAIN ] APD: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:16:28.935108] [WARN ] [MAIN ] APD: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:16:28.935193] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-09-26T17:16:28.935272] [DEBUG] [LOCAL ] APD: No primary data file found to delete. [2025-09-26T17:16:28.935312] [INFO ] [LOCAL ] APD: Starting deletion of derivative data. [2025-09-26T17:16:28.935354] [DEBUG] [LOCAL ] APD: No derivative data file found to delete. [2025-09-26T17:16:28.935429] [INFO ] [MAIN ] Update Progress: 129/2371 symbols completed. APD took 33.0s. Estimated remaining: 4h 45m 34s. Rate: 7.9 symbols/min [2025-09-26T17:16:29.125065] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:16:29.125249] [DEBUG] [LOCAL ] APO: No existing data file found in primary storage. [2025-09-26T17:16:29.125309] [WARN ] [MAIN ] APO: No existing data found, performing full refresh instead. [2025-09-26T17:16:29.125514] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-09-26T17:16:29.125570] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-09-26T17:16:29.125616] [DEBUG] [LOCAL ] APO: No primary data file found to delete. [2025-09-26T17:16:29.125679] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-09-26T17:16:29.540825] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:16:29.567100] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-12. [2025-09-26T17:16:29.574254] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-26T17:16:30.258249] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-26T17:16:30.356756] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-09-26T17:16:31.156705] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-09-26T17:16:31.492080] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-26T17:16:31.956720] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-09-26T17:16:31.993611] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-26T17:16:32.003469] [INFO ] [REMOTE ] APG: Full fetch complete (71308 records). [2025-09-26T17:16:32.003633] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-09-26T17:16:32.004461] [FATAL] [VALIDATOR ] APG: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:16:32.004556] [FATAL] [MAIN ] APG: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:16:32.004602] [WARN ] [MAIN ] APG: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:16:32.004664] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-09-26T17:16:32.004754] [DEBUG] [LOCAL ] APG: No primary data file found to delete. [2025-09-26T17:16:32.004791] [INFO ] [LOCAL ] APG: Starting deletion of derivative data. [2025-09-26T17:16:32.004849] [DEBUG] [LOCAL ] APG: No derivative data file found to delete. [2025-09-26T17:16:32.004934] [INFO ] [MAIN ] Update Progress: 130/2371 symbols completed. APG took 28.1s. Estimated remaining: 4h 44m 8s. Rate: 7.9 symbols/min [2025-09-26T17:16:32.243781] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:16:32.253521] [DEBUG] [LOCAL ] APOS: Loaded 7545 existing records from primary storage. [2025-09-26T17:16:32.253636] [INFO ] [MAIN ] APOS: Loaded 7545 existing records. [2025-09-26T17:16:32.458797] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:16:32.459121] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-09-26T17:16:32.459195] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-09-26T17:16:32.459898] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-09-26T17:16:32.459964] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-09-26T17:16:32.766264] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-09-26T17:16:32.867748] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:16:32.906159] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-26T17:16:33.211084] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-26T17:16:33.556728] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-09-26T17:16:34.220158] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-26T17:16:34.356729] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-12. [2025-09-26T17:16:34.857910] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-26T17:16:34.874417] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-26T17:16:35.156762] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-09-26T17:16:35.781793] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-26T17:16:35.956781] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-09-26T17:16:36.756763] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-09-26T17:16:37.352985] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-26T17:16:37.556725] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-09-26T17:16:38.356753] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-09-26T17:16:38.444375] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-26T17:16:38.961769] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-26T17:16:38.961487] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-26T17:16:39.156786] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-09-26T17:16:39.956775] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-09-26T17:16:40.756737] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-09-26T17:16:41.078061] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-26T17:16:41.556737] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-09-26T17:16:41.865410] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-26T17:16:42.311203] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T17:16:42.356719] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-09-26T17:16:43.156734] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-09-26T17:16:43.518387] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-26T17:16:43.764564] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-26T17:16:43.956703] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-09-26T17:16:44.094340] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-26T17:16:44.498169] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-26T17:16:44.756759] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-09-26T17:16:45.384078] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-26T17:16:45.556740] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-09-26T17:16:46.356747] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-09-26T17:16:47.156721] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-09-26T17:16:47.640251] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-26T17:16:47.658794] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-26T17:16:47.759505] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-26T17:16:47.956744] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-09-26T17:16:48.756773] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-09-26T17:16:49.348448] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-26T17:16:49.556725] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-09-26T17:16:49.616479] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-26T17:16:50.356745] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-09-26T17:16:51.156729] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-09-26T17:16:51.607164] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-26T17:16:51.623327] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-26T17:16:51.625375] [INFO ] [REMOTE ] APH: Full fetch complete (77683 records). [2025-09-26T17:16:51.626330] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-09-26T17:16:51.960923] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-09-26T17:16:52.054883] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-09-26T17:16:52.055052] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-09-26T17:16:52.055918] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-09-26T17:16:52.056011] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-09-26T17:16:52.057772] [DEBUG] [LOCAL ] APH: Trimmed 77683 records to 54471 (keeping 200 days of data) [2025-09-26T17:16:52.325108] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-26T17:16:52.459440] [DEBUG] [LOCAL ] APH: Primary data saved (54471 records). [2025-09-26T17:16:52.459607] [INFO ] [MAIN ] APH: Full history saved. [2025-09-26T17:16:52.459717] [INFO ] [MAIN ] Update Progress: 131/2371 symbols completed. APH took 36.1s. Estimated remaining: 4h 47m 40s. Rate: 7.8 symbols/min [2025-09-26T17:16:52.584502] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-26T17:16:52.603431] [INFO ] [REMOTE ] APOS: Full fetch complete (10396 records). [2025-09-26T17:16:52.614082] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-09-26T17:16:52.672332] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:16:52.673051] [FATAL] [VALIDATOR ] APOS: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:16:52.673457] [DEBUG] [LOCAL ] APTV: No existing data file found in primary storage. [2025-09-26T17:16:52.673345] [FATAL] [MAIN ] APOS: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:16:52.673544] [WARN ] [MAIN ] APTV: No existing data found, performing full refresh instead. [2025-09-26T17:16:52.673713] [WARN ] [MAIN ] APOS: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:16:52.673993] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-09-26T17:16:52.674138] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-09-26T17:16:52.674235] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-09-26T17:16:52.674421] [DEBUG] [LOCAL ] APTV: No primary data file found to delete. [2025-09-26T17:16:52.674512] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-09-26T17:16:52.674680] [DEBUG] [LOCAL ] APOS: No primary data file found to delete. [2025-09-26T17:16:52.679969] [INFO ] [LOCAL ] APOS: Starting deletion of derivative data. [2025-09-26T17:16:52.761887] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-09-26T17:16:52.762001] [DEBUG] [LOCAL ] APOS: Deleted derivative data file. [2025-09-26T17:16:52.793530] [INFO ] [MAIN ] Update Progress: 132/2371 symbols completed. APOS took 20.8s. Estimated remaining: 4h 45m 27s. Rate: 7.8 symbols/min [2025-09-26T17:16:53.195728] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:16:53.279465] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:16:53.326212] [DEBUG] [LOCAL ] AQN: Loaded 52302 existing records from primary storage. [2025-09-26T17:16:53.326364] [INFO ] [MAIN ] AQN: Loaded 52302 existing records. [2025-09-26T17:16:53.513265] [WARN ] [MAIN ] AQN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:16:53.513534] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-09-26T17:16:53.513582] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-09-26T17:16:53.515036] [DEBUG] [LOCAL ] AQN: Deleted primary data file. [2025-09-26T17:16:53.515099] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-09-26T17:16:53.561855] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-09-26T17:16:53.900937] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:16:54.356757] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-12. [2025-09-26T17:16:54.645369] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-26T17:16:55.156902] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-09-26T17:16:55.375876] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-26T17:16:55.834489] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-26T17:16:55.956734] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-09-26T17:16:56.606081] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-26T17:16:56.756742] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-09-26T17:16:57.199572] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-26T17:16:57.556734] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-12. [2025-09-26T17:16:58.356763] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-09-26T17:16:58.499172] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-26T17:16:59.156729] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-09-26T17:16:59.409179] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-26T17:16:59.576173] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-26T17:16:59.956739] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-09-26T17:17:00.756730] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-09-26T17:17:01.173432] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-26T17:17:01.184895] [INFO ] [REMOTE ] APO: Full fetch complete (77291 records). [2025-09-26T17:17:01.185097] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-09-26T17:17:01.571855] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-09-26T17:17:01.638005] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-09-26T17:17:01.638120] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-09-26T17:17:01.638994] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-09-26T17:17:01.639168] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-09-26T17:17:01.667449] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-26T17:17:01.667593] [DEBUG] [LOCAL ] APO: Trimmed 77291 records to 54162 (keeping 200 days of data) [2025-09-26T17:17:01.678724] [INFO ] [REMOTE ] APLE: Full fetch complete (73888 records). [2025-09-26T17:17:01.678896] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-09-26T17:17:01.679981] [FATAL] [VALIDATOR ] APLE: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:17:01.680098] [FATAL] [MAIN ] APLE: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:17:01.680165] [WARN ] [MAIN ] APLE: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:17:01.680236] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-09-26T17:17:01.680305] [DEBUG] [LOCAL ] APLE: No primary data file found to delete. [2025-09-26T17:17:01.680343] [INFO ] [LOCAL ] APLE: Starting deletion of derivative data. [2025-09-26T17:17:01.735789] [DEBUG] [LOCAL ] APLE: Deleted derivative data file. [2025-09-26T17:17:01.748897] [INFO ] [MAIN ] Update Progress: 133/2371 symbols completed. APLE took 39.8s. Estimated remaining: 4h 45m 41s. Rate: 7.8 symbols/min [2025-09-26T17:17:01.990253] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:17:01.991329] [DEBUG] [LOCAL ] AQNB: No existing data file found in primary storage. [2025-09-26T17:17:01.991999] [WARN ] [MAIN ] AQNB: No existing data found, performing full refresh instead. [2025-09-26T17:17:01.992796] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-09-26T17:17:01.993165] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-09-26T17:17:01.993607] [DEBUG] [LOCAL ] AQNB: No primary data file found to delete. [2025-09-26T17:17:01.994912] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-09-26T17:17:02.431364] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:17:02.436697] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-12. [2025-09-26T17:17:02.575286] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-26T17:17:02.713787] [DEBUG] [LOCAL ] APO: Primary data saved (54162 records). [2025-09-26T17:17:02.713955] [INFO ] [MAIN ] APO: Full history saved. [2025-09-26T17:17:02.714040] [INFO ] [MAIN ] Update Progress: 134/2371 symbols completed. APO took 33.8s. Estimated remaining: 4h 43m 42s. Rate: 7.9 symbols/min [2025-09-26T17:17:02.901815] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:17:02.957913] [DEBUG] [LOCAL ] AR: Loaded 53974 existing records from primary storage. [2025-09-26T17:17:02.958104] [INFO ] [MAIN ] AR: Loaded 53974 existing records. [2025-09-26T17:17:03.159981] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-09-26T17:17:03.168062] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:17:03.168637] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-09-26T17:17:03.168758] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-09-26T17:17:03.170256] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-09-26T17:17:03.170336] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-09-26T17:17:03.288535] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-26T17:17:03.394751] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-26T17:17:03.636929] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:17:03.956723] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-09-26T17:17:04.489138] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-26T17:17:04.756726] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-09-26T17:17:04.872440] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-26T17:17:05.070720] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-26T17:17:05.556720] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-09-26T17:17:06.356719] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-12. [2025-09-26T17:17:07.156714] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-09-26T17:17:07.350015] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-26T17:17:07.530788] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-26T17:17:07.761449] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T17:17:07.956740] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-09-26T17:17:08.756754] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-09-26T17:17:09.556743] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-09-26T17:17:09.760459] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-26T17:17:10.259381] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-26T17:17:10.358610] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-09-26T17:17:10.364603] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-26T17:17:11.156789] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-09-26T17:17:11.956814] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-09-26T17:17:12.095026] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-26T17:17:12.654308] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-26T17:17:12.756702] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-09-26T17:17:13.280415] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-26T17:17:13.556791] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-09-26T17:17:14.143149] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-26T17:17:14.356836] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-09-26T17:17:14.841989] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-26T17:17:15.031629] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-26T17:17:15.156819] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-09-26T17:17:15.956758] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-09-26T17:17:16.756752] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-09-26T17:17:16.812151] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-26T17:17:17.556774] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-09-26T17:17:17.648058] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-26T17:17:18.356719] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-09-26T17:17:18.688882] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-26T17:17:18.975094] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-26T17:17:19.156707] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-09-26T17:17:19.259819] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-26T17:17:19.956800] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-09-26T17:17:20.288337] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-26T17:17:20.761256] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-09-26T17:17:20.768213] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-26T17:17:21.556770] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-09-26T17:17:22.356819] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-09-26T17:17:22.485484] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T17:17:22.890151] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-26T17:17:23.156742] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-09-26T17:17:23.564151] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-26T17:17:23.765558] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-26T17:17:23.767593] [INFO ] [REMOTE ] AQNB: Full fetch complete (5886 records). [2025-09-26T17:17:23.767708] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-09-26T17:17:23.959963] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-09-26T17:17:24.178728] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-09-26T17:17:24.178821] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-09-26T17:17:24.179000] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-09-26T17:17:24.179042] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-09-26T17:17:24.179458] [DEBUG] [LOCAL ] AQNB: Trimmed 5886 records to 4228 (keeping 200 days of data) [2025-09-26T17:17:24.213553] [DEBUG] [LOCAL ] AQNB: Primary data saved (4228 records). [2025-09-26T17:17:24.213784] [INFO ] [MAIN ] AQNB: Full history saved. [2025-09-26T17:17:24.213903] [INFO ] [MAIN ] Update Progress: 135/2371 symbols completed. AQNB took 22.5s. Estimated remaining: 4h 47m 24s. Rate: 7.8 symbols/min [2025-09-26T17:17:24.407298] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:17:24.459149] [DEBUG] [LOCAL ] ARCO: Loaded 44935 existing records from primary storage. [2025-09-26T17:17:24.459311] [INFO ] [MAIN ] ARCO: Loaded 44935 existing records. [2025-09-26T17:17:24.652435] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:17:24.653132] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-09-26T17:17:24.653195] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-09-26T17:17:24.654873] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-09-26T17:17:24.654938] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-09-26T17:17:24.763881] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-09-26T17:17:25.042835] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:17:25.556789] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-12. [2025-09-26T17:17:25.879912] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-26T17:17:26.356764] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-09-26T17:17:26.397679] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-26T17:17:26.410352] [INFO ] [REMOTE ] AQN: Full fetch complete (75281 records). [2025-09-26T17:17:26.410532] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-09-26T17:17:26.859164] [DEBUG] [VALIDATOR ] AQN: All expected trading days are present. [2025-09-26T17:17:26.859318] [DEBUG] [VALIDATOR ] AQN: Primary data validation passed. [2025-09-26T17:17:26.860233] [INFO ] [MAIN ] AQN: Fetched primary data is valid. [2025-09-26T17:17:26.860329] [DEBUG] [LOCAL ] AQN: Saving primary data. [2025-09-26T17:17:26.862452] [DEBUG] [LOCAL ] AQN: Trimmed 75281 records to 52684 (keeping 200 days of data) [2025-09-26T17:17:27.001522] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-26T17:17:27.157406] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-09-26T17:17:27.252116] [DEBUG] [LOCAL ] AQN: Primary data saved (52684 records). [2025-09-26T17:17:27.252343] [INFO ] [MAIN ] AQN: Full history saved. [2025-09-26T17:17:27.252673] [INFO ] [MAIN ] Update Progress: 136/2371 symbols completed. AQN took 34.5s. Estimated remaining: 4h 45m 60s. Rate: 7.8 symbols/min [2025-09-26T17:17:27.450513] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:17:27.472963] [DEBUG] [LOCAL ] ARDC: Loaded 14647 existing records from primary storage. [2025-09-26T17:17:27.473107] [INFO ] [MAIN ] ARDC: Loaded 14647 existing records. [2025-09-26T17:17:27.668782] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:17:27.669074] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-09-26T17:17:27.669126] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-09-26T17:17:27.669899] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-09-26T17:17:27.669976] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-09-26T17:17:27.961945] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-09-26T17:17:28.090228] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:17:28.189964] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-26T17:17:28.202306] [INFO ] [REMOTE ] APTV: Full fetch complete (76027 records). [2025-09-26T17:17:28.202490] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-09-26T17:17:28.663316] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-09-26T17:17:28.663436] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-09-26T17:17:28.664419] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-09-26T17:17:28.664552] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-09-26T17:17:28.667105] [DEBUG] [LOCAL ] APTV: Trimmed 76027 records to 52964 (keeping 200 days of data) [2025-09-26T17:17:28.768234] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-12. [2025-09-26T17:17:28.803691] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-26T17:17:29.082631] [DEBUG] [LOCAL ] APTV: Primary data saved (52964 records). [2025-09-26T17:17:29.083118] [INFO ] [MAIN ] APTV: Full history saved. [2025-09-26T17:17:29.083264] [INFO ] [MAIN ] Update Progress: 137/2371 symbols completed. APTV took 36.6s. Estimated remaining: 4h 44m 17s. Rate: 7.9 symbols/min [2025-09-26T17:17:29.385394] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:17:29.433208] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-26T17:17:29.485502] [DEBUG] [LOCAL ] ARDT: Loaded 28351 existing records from primary storage. [2025-09-26T17:17:29.485823] [INFO ] [MAIN ] ARDT: Loaded 28351 existing records. [2025-09-26T17:17:29.562002] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-09-26T17:17:29.771620] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:17:29.784418] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-26T17:17:29.783936] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-09-26T17:17:29.788616] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-09-26T17:17:29.789994] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-09-26T17:17:29.790063] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-09-26T17:17:30.216694] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:17:30.356763] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-12. [2025-09-26T17:17:30.841018] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-26T17:17:31.156767] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-09-26T17:17:31.364559] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-26T17:17:31.787858] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-26T17:17:31.956777] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-09-26T17:17:32.756769] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-09-26T17:17:33.511376] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T17:17:33.556704] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-09-26T17:17:33.694924] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-26T17:17:34.356744] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-09-26T17:17:34.839520] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-26T17:17:35.155298] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-26T17:17:35.157366] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-09-26T17:17:35.956727] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-09-26T17:17:35.985977] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-26T17:17:36.756737] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-09-26T17:17:37.556715] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-09-26T17:17:37.732325] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-26T17:17:37.927664] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-26T17:17:38.356775] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-09-26T17:17:39.156732] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-09-26T17:17:39.468559] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-26T17:17:39.531161] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-26T17:17:39.815159] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-26T17:17:39.956766] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-09-26T17:17:40.756712] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-09-26T17:17:40.975836] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-26T17:17:41.556724] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-09-26T17:17:42.124353] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-26T17:17:42.203708] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-26T17:17:42.356752] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-09-26T17:17:43.156790] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-09-26T17:17:43.956772] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-09-26T17:17:44.027680] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-26T17:17:44.063029] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-26T17:17:44.756754] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-09-26T17:17:45.202001] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-26T17:17:45.549116] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-26T17:17:45.556690] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-09-26T17:17:46.356744] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-09-26T17:17:47.016953] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-26T17:17:47.161330] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-09-26T17:17:47.163773] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-26T17:17:47.956750] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-09-26T17:17:48.756713] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-09-26T17:17:49.046568] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-26T17:17:49.058204] [INFO ] [REMOTE ] AR: Full fetch complete (77532 records). [2025-09-26T17:17:49.058396] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-09-26T17:17:49.494692] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-09-26T17:17:49.504490] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-09-26T17:17:49.522000] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-09-26T17:17:49.522152] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-09-26T17:17:49.525588] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-26T17:17:49.549761] [DEBUG] [LOCAL ] AR: Trimmed 77532 records to 54364 (keeping 200 days of data) [2025-09-26T17:17:49.550714] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-26T17:17:49.556974] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-09-26T17:17:49.898468] [DEBUG] [LOCAL ] AR: Primary data saved (54364 records). [2025-09-26T17:17:49.898694] [INFO ] [MAIN ] AR: Full history saved. [2025-09-26T17:17:49.902639] [INFO ] [MAIN ] Update Progress: 138/2371 symbols completed. AR took 47.2s. Estimated remaining: 4h 47m 43s. Rate: 7.8 symbols/min [2025-09-26T17:17:50.088315] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:17:50.147473] [DEBUG] [LOCAL ] ARE: Loaded 50963 existing records from primary storage. [2025-09-26T17:17:50.147635] [INFO ] [MAIN ] ARE: Loaded 50963 existing records. [2025-09-26T17:17:50.357720] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-09-26T17:17:50.357946] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:17:50.359552] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-09-26T17:17:50.359629] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-09-26T17:17:50.361180] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-09-26T17:17:50.361249] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-09-26T17:17:50.760886] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:17:51.110616] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-26T17:17:51.119304] [INFO ] [REMOTE ] ARCO: Full fetch complete (65574 records). [2025-09-26T17:17:51.119477] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-09-26T17:17:51.164751] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-09-26T17:17:51.615107] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-09-26T17:17:51.615806] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-26T17:17:51.619602] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-09-26T17:17:51.620687] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-09-26T17:17:51.621200] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-09-26T17:17:51.625109] [DEBUG] [LOCAL ] ARCO: Trimmed 65574 records to 45249 (keeping 200 days of data) [2025-09-26T17:17:51.909518] [DEBUG] [LOCAL ] ARCO: Primary data saved (45249 records). [2025-09-26T17:17:51.909706] [INFO ] [MAIN ] ARCO: Full history saved. [2025-09-26T17:17:51.911191] [INFO ] [MAIN ] Update Progress: 139/2371 symbols completed. ARCO took 27.7s. Estimated remaining: 4h 46m 3s. Rate: 7.8 symbols/min [2025-09-26T17:17:51.961817] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-12. [2025-09-26T17:17:52.114352] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:17:52.114526] [DEBUG] [LOCAL ] ARES: No existing data file found in primary storage. [2025-09-26T17:17:52.114565] [WARN ] [MAIN ] ARES: No existing data found, performing full refresh instead. [2025-09-26T17:17:52.114743] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-09-26T17:17:52.114796] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-09-26T17:17:52.114839] [DEBUG] [LOCAL ] ARES: No primary data file found to delete. [2025-09-26T17:17:52.114872] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-09-26T17:17:52.525124] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:17:52.633769] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-26T17:17:52.756743] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-09-26T17:17:53.556716] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-09-26T17:17:53.624832] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-26T17:17:53.645713] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-26T17:17:53.649864] [INFO ] [REMOTE ] ARDC: Full fetch complete (20449 records). [2025-09-26T17:17:53.649966] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-09-26T17:17:54.054258] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-09-26T17:17:54.054350] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-09-26T17:17:54.054703] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-09-26T17:17:54.054773] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-09-26T17:17:54.055746] [DEBUG] [LOCAL ] ARDC: Trimmed 20449 records to 14821 (keeping 200 days of data) [2025-09-26T17:17:54.156501] [DEBUG] [LOCAL ] ARDC: Primary data saved (14821 records). [2025-09-26T17:17:54.156759] [INFO ] [MAIN ] ARDC: Full history saved. [2025-09-26T17:17:54.156908] [INFO ] [MAIN ] Update Progress: 140/2371 symbols completed. ARDC took 26.9s. Estimated remaining: 4h 44m 29s. Rate: 7.8 symbols/min [2025-09-26T17:17:54.346083] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:17:54.346304] [DEBUG] [LOCAL ] ARI: No existing data file found in primary storage. [2025-09-26T17:17:54.346364] [WARN ] [MAIN ] ARI: No existing data found, performing full refresh instead. [2025-09-26T17:17:54.346518] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-09-26T17:17:54.346563] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-09-26T17:17:54.346610] [DEBUG] [LOCAL ] ARI: No primary data file found to delete. [2025-09-26T17:17:54.346673] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-09-26T17:17:54.361868] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-09-26T17:17:54.600718] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-26T17:17:54.677289] [INFO ] [REMOTE ] ARDT: Full fetch complete (41190 records). [2025-09-26T17:17:54.680744] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-09-26T17:17:54.693748] [FATAL] [VALIDATOR ] ARDT: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:17:54.704195] [FATAL] [MAIN ] ARDT: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:17:54.709505] [WARN ] [MAIN ] ARDT: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:17:54.728473] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-09-26T17:17:54.745300] [DEBUG] [LOCAL ] ARDT: No primary data file found to delete. [2025-09-26T17:17:54.767980] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:17:54.768347] [INFO ] [LOCAL ] ARDT: Starting deletion of derivative data. [2025-09-26T17:17:54.769208] [DEBUG] [LOCAL ] ARDT: Deleted derivative data file. [2025-09-26T17:17:54.769371] [INFO ] [MAIN ] Update Progress: 141/2371 symbols completed. ARDT took 25.7s. Estimated remaining: 4h 42m 30s. Rate: 7.9 symbols/min [2025-09-26T17:17:54.957466] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:17:55.005857] [DEBUG] [LOCAL ] ARIS: Loaded 42320 existing records from primary storage. [2025-09-26T17:17:55.006017] [INFO ] [MAIN ] ARIS: Loaded 42320 existing records. [2025-09-26T17:17:55.161857] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-12. [2025-09-26T17:17:55.210070] [WARN ] [MAIN ] ARIS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:17:55.210306] [INFO ] [MAIN ] ARIS: Wiping existing primary data before full refresh. [2025-09-26T17:17:55.210356] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-09-26T17:17:55.211697] [DEBUG] [LOCAL ] ARIS: Deleted primary data file. [2025-09-26T17:17:55.211915] [INFO ] [MAIN ] ARIS: Starting full primary refresh. [2025-09-26T17:17:55.599480] [INFO ] [REMOTE ] ARIS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:17:55.956735] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2024-12. [2025-09-26T17:17:56.192351] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-26T17:17:56.756744] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-12. [2025-09-26T17:17:56.950527] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-26T17:17:57.069691] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-26T17:17:57.556735] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-09-26T17:17:58.104352] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-26T17:17:58.356734] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-09-26T17:17:58.817065] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-26T17:17:59.156726] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-09-26T17:17:59.517758] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-26T17:17:59.956724] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-09-26T17:18:00.756738] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-01. [2025-09-26T17:18:01.201185] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-26T17:18:01.324611] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-26T17:18:01.556763] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-09-26T17:18:01.933830] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-26T17:18:02.356722] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-02. [2025-09-26T17:18:03.154262] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T17:18:03.164530] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-09-26T17:18:03.431715] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-26T17:18:03.956763] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-03. [2025-09-26T17:18:04.767804] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-09-26T17:18:04.772948] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-26T17:18:05.130843] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-26T17:18:05.556721] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-09-26T17:18:06.356775] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-04. [2025-09-26T17:18:06.519146] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-26T17:18:06.878216] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-26T17:18:07.156787] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-09-26T17:18:07.647989] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-26T17:18:07.956754] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-05. [2025-09-26T17:18:08.756715] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-09-26T17:18:08.804670] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-26T17:18:09.210711] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-26T17:18:09.556734] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-09-26T17:18:10.356691] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-09-26T17:18:10.447459] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-26T17:18:11.156705] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-09-26T17:18:11.312818] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-26T17:18:11.765580] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-26T17:18:11.956729] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-09-26T17:18:12.595739] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-26T17:18:12.756812] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-06. [2025-09-26T17:18:13.380714] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-26T17:18:13.556748] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-09-26T17:18:13.891519] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-26T17:18:14.356784] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-07. [2025-09-26T17:18:14.936861] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-26T17:18:15.156768] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-09-26T17:18:15.748136] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-26T17:18:15.956747] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-08. [2025-09-26T17:18:16.291978] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-26T17:18:16.756770] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-09-26T17:18:17.447158] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-26T17:18:17.556748] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-09-26T17:18:18.356718] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-09-26T17:18:18.593846] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-26T17:18:19.109761] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T17:18:19.156751] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-09-26T17:18:19.956744] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-09. [2025-09-26T17:18:20.013360] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-26T17:18:20.542666] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-26T17:18:20.756754] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-09-26T17:18:21.556847] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-09-26T17:18:22.143348] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-26T17:18:22.156978] [INFO ] [REMOTE ] ARIS: Full fetch complete (59771 records). [2025-09-26T17:18:22.157220] [DEBUG] [VALIDATOR ] ARIS: Validating primary data. [2025-09-26T17:18:22.159048] [FATAL] [VALIDATOR ] ARIS: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:18:22.159253] [FATAL] [MAIN ] ARIS: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:18:22.159315] [WARN ] [MAIN ] ARIS: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:18:22.159404] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-09-26T17:18:22.159489] [DEBUG] [LOCAL ] ARIS: No primary data file found to delete. [2025-09-26T17:18:22.159554] [INFO ] [LOCAL ] ARIS: Starting deletion of derivative data. [2025-09-26T17:18:22.160287] [DEBUG] [LOCAL ] ARIS: Deleted derivative data file. [2025-09-26T17:18:22.160450] [INFO ] [MAIN ] Update Progress: 142/2371 symbols completed. ARIS took 27.4s. Estimated remaining: 4h 47m 33s. Rate: 7.8 symbols/min [2025-09-26T17:18:22.357780] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-09-26T17:18:22.430285] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:18:22.477907] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T17:18:22.492686] [INFO ] [REMOTE ] ARES: Full fetch complete (70678 records). [2025-09-26T17:18:22.492950] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-09-26T17:18:22.724891] [DEBUG] [LOCAL ] ARLO: Loaded 44209 existing records from primary storage. [2025-09-26T17:18:22.742113] [INFO ] [MAIN ] ARLO: Loaded 44209 existing records. [2025-09-26T17:18:23.205209] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:18:23.222575] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-09-26T17:18:23.223087] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-09-26T17:18:23.222967] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-09-26T17:18:23.223231] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-09-26T17:18:23.224012] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-09-26T17:18:23.224139] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-09-26T17:18:23.225607] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-09-26T17:18:23.225724] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-09-26T17:18:23.231082] [DEBUG] [LOCAL ] ARES: Trimmed 70678 records to 50322 (keeping 200 days of data) [2025-09-26T17:18:23.737975] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:18:23.738823] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-12. [2025-09-26T17:18:23.793386] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-26T17:18:23.957206] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-09-26T17:18:24.065811] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-26T17:18:24.092731] [DEBUG] [LOCAL ] ARES: Primary data saved (50322 records). [2025-09-26T17:18:24.092940] [INFO ] [MAIN ] ARES: Full history saved. [2025-09-26T17:18:24.093083] [INFO ] [MAIN ] Update Progress: 143/2371 symbols completed. ARES took 32.2s. Estimated remaining: 4h 45m 54s. Rate: 7.8 symbols/min [2025-09-26T17:18:24.281038] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:18:24.336626] [DEBUG] [LOCAL ] ARMK: Loaded 50735 existing records from primary storage. [2025-09-26T17:18:24.336808] [INFO ] [MAIN ] ARMK: Loaded 50735 existing records. [2025-09-26T17:18:24.524074] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:18:24.524330] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-09-26T17:18:24.524378] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-09-26T17:18:24.525896] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-09-26T17:18:24.525970] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-09-26T17:18:24.764986] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-09-26T17:18:24.934125] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:18:25.059189] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-26T17:18:25.556727] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-12. [2025-09-26T17:18:25.785376] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-26T17:18:25.796058] [INFO ] [REMOTE ] ARE: Full fetch complete (72589 records). [2025-09-26T17:18:25.796232] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-09-26T17:18:26.276741] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-26T17:18:26.275231] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-09-26T17:18:26.280044] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-09-26T17:18:26.286790] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-09-26T17:18:26.287067] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-09-26T17:18:26.288694] [DEBUG] [LOCAL ] ARE: Trimmed 72589 records to 51319 (keeping 200 days of data) [2025-09-26T17:18:26.358958] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-09-26T17:18:26.621508] [DEBUG] [LOCAL ] ARE: Primary data saved (51319 records). [2025-09-26T17:18:26.621783] [INFO ] [MAIN ] ARE: Full history saved. [2025-09-26T17:18:26.622686] [INFO ] [MAIN ] Update Progress: 144/2371 symbols completed. ARE took 36.7s. Estimated remaining: 4h 44m 27s. Rate: 7.8 symbols/min [2025-09-26T17:18:26.805167] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:18:26.805362] [DEBUG] [LOCAL ] AROC: No existing data file found in primary storage. [2025-09-26T17:18:26.805405] [WARN ] [MAIN ] AROC: No existing data found, performing full refresh instead. [2025-09-26T17:18:26.805632] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-09-26T17:18:26.805763] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-09-26T17:18:26.805844] [DEBUG] [LOCAL ] AROC: No primary data file found to delete. [2025-09-26T17:18:26.805918] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-09-26T17:18:27.162116] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-09-26T17:18:27.222291] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:18:27.263365] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-26T17:18:27.795577] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-26T17:18:27.804024] [INFO ] [REMOTE ] ARI: Full fetch complete (62715 records). [2025-09-26T17:18:27.804163] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-09-26T17:18:27.961864] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-12. [2025-09-26T17:18:28.232912] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-09-26T17:18:28.233065] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-09-26T17:18:28.234578] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-09-26T17:18:28.234697] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-09-26T17:18:28.236382] [DEBUG] [LOCAL ] ARI: Trimmed 62715 records to 44009 (keeping 200 days of data) [2025-09-26T17:18:28.490902] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-26T17:18:28.552720] [DEBUG] [LOCAL ] ARI: Primary data saved (44009 records). [2025-09-26T17:18:28.552878] [INFO ] [MAIN ] ARI: Full history saved. [2025-09-26T17:18:28.552992] [INFO ] [MAIN ] Update Progress: 145/2371 symbols completed. ARI took 34.4s. Estimated remaining: 4h 42m 51s. Rate: 7.9 symbols/min [2025-09-26T17:18:28.731095] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:18:28.731270] [DEBUG] [LOCAL ] ARR: No existing data file found in primary storage. [2025-09-26T17:18:28.731309] [WARN ] [MAIN ] ARR: No existing data found, performing full refresh instead. [2025-09-26T17:18:28.731459] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-09-26T17:18:28.731503] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-09-26T17:18:28.731545] [DEBUG] [LOCAL ] ARR: No primary data file found to delete. [2025-09-26T17:18:28.731577] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-09-26T17:18:28.763132] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-09-26T17:18:29.145223] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:18:29.360430] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T17:18:29.556726] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-12. [2025-09-26T17:18:30.014357] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-26T17:18:30.356756] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-09-26T17:18:31.156771] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-09-26T17:18:31.467404] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-26T17:18:31.956768] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-09-26T17:18:32.117024] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-26T17:18:32.761942] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-09-26T17:18:32.782184] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T17:18:33.488837] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-26T17:18:33.556702] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-09-26T17:18:34.074291] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-26T17:18:34.356744] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-09-26T17:18:35.156711] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-09-26T17:18:35.487841] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-26T17:18:35.957130] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-09-26T17:18:35.962417] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-26T17:18:36.468189] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-26T17:18:36.756733] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-09-26T17:18:37.389570] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-26T17:18:37.556722] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-09-26T17:18:38.266813] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-26T17:18:38.356760] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-09-26T17:18:39.117925] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-26T17:18:39.156678] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-09-26T17:18:39.688634] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-26T17:18:39.956755] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-09-26T17:18:40.756738] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-09-26T17:18:41.355794] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-26T17:18:41.556706] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-09-26T17:18:41.622597] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-26T17:18:41.780117] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-26T17:18:42.356766] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-09-26T17:18:43.094590] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-26T17:18:43.156705] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-09-26T17:18:43.499108] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-26T17:18:43.956733] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-09-26T17:18:44.752448] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-26T17:18:44.762174] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-09-26T17:18:45.556700] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-09-26T17:18:45.795709] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-26T17:18:46.356703] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-09-26T17:18:46.452186] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-26T17:18:47.156731] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-09-26T17:18:47.359129] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-26T17:18:47.760103] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-26T17:18:47.956735] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-09-26T17:18:48.603804] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-26T17:18:48.756755] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-09-26T17:18:49.563441] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-09-26T17:18:49.584183] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-26T17:18:50.013364] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-26T17:18:50.356720] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-09-26T17:18:50.905801] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-26T17:18:51.156748] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-09-26T17:18:51.867437] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-26T17:18:51.956744] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-09-26T17:18:52.759592] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-09-26T17:18:52.765630] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-26T17:18:53.356574] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-26T17:18:53.556746] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-09-26T17:18:54.083283] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-26T17:18:54.093367] [INFO ] [REMOTE ] ARLO: Full fetch complete (62486 records). [2025-09-26T17:18:54.093548] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-09-26T17:18:54.364518] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-09-26T17:18:54.511624] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-09-26T17:18:54.511743] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-09-26T17:18:54.512415] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-09-26T17:18:54.512474] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-09-26T17:18:54.513920] [DEBUG] [LOCAL ] ARLO: Trimmed 62486 records to 44493 (keeping 200 days of data) [2025-09-26T17:18:54.785448] [DEBUG] [LOCAL ] ARLO: Primary data saved (44493 records). [2025-09-26T17:18:54.785577] [INFO ] [MAIN ] ARLO: Full history saved. [2025-09-26T17:18:54.785711] [INFO ] [MAIN ] Update Progress: 146/2371 symbols completed. ARLO took 32.6s. Estimated remaining: 4h 47m 27s. Rate: 7.7 symbols/min [2025-09-26T17:18:54.973372] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:18:55.008525] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-26T17:18:55.049433] [DEBUG] [LOCAL ] ARW: Loaded 33429 existing records from primary storage. [2025-09-26T17:18:55.049583] [INFO ] [MAIN ] ARW: Loaded 33429 existing records. [2025-09-26T17:18:55.159072] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-09-26T17:18:55.244956] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:18:55.245195] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-09-26T17:18:55.245276] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-09-26T17:18:55.246451] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-09-26T17:18:55.246515] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-09-26T17:18:55.632019] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:18:55.956731] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-12. [2025-09-26T17:18:56.077518] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-26T17:18:56.756757] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-09-26T17:18:57.262413] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-26T17:18:57.273528] [INFO ] [REMOTE ] ARR: Full fetch complete (75155 records). [2025-09-26T17:18:57.273753] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-09-26T17:18:57.571607] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-09-26T17:18:57.639498] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-26T17:18:57.790092] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-09-26T17:18:57.790193] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-09-26T17:18:57.791075] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-09-26T17:18:57.791152] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-09-26T17:18:57.792881] [DEBUG] [LOCAL ] ARR: Trimmed 75155 records to 52809 (keeping 200 days of data) [2025-09-26T17:18:58.162737] [DEBUG] [LOCAL ] ARR: Primary data saved (52809 records). [2025-09-26T17:18:58.162891] [INFO ] [MAIN ] ARR: Full history saved. [2025-09-26T17:18:58.162974] [INFO ] [MAIN ] Update Progress: 147/2371 symbols completed. ARR took 29.6s. Estimated remaining: 4h 46m 13s. Rate: 7.8 symbols/min [2025-09-26T17:18:58.346806] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:18:58.347060] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-09-26T17:18:58.347124] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-09-26T17:18:58.347269] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-09-26T17:18:58.347312] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-26T17:18:58.347419] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-26T17:18:58.347468] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-09-26T17:18:58.361853] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-09-26T17:18:58.760988] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:18:58.775840] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-26T17:18:58.786025] [INFO ] [REMOTE ] AROC: Full fetch complete (70711 records). [2025-09-26T17:18:58.786205] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-09-26T17:18:59.157735] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-09-26T17:18:59.199161] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-09-26T17:18:59.199257] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-09-26T17:18:59.200031] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-09-26T17:18:59.200101] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-09-26T17:18:59.202058] [DEBUG] [LOCAL ] AROC: Trimmed 70711 records to 49733 (keeping 200 days of data) [2025-09-26T17:18:59.460082] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:18:59.461795] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-09-26T17:18:59.539525] [DEBUG] [LOCAL ] AROC: Primary data saved (49733 records). [2025-09-26T17:18:59.539711] [INFO ] [MAIN ] AROC: Full history saved. [2025-09-26T17:18:59.539809] [INFO ] [MAIN ] Update Progress: 148/2371 symbols completed. AROC took 32.9s. Estimated remaining: 4h 44m 30s. Rate: 7.8 symbols/min [2025-09-26T17:18:59.725479] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:18:59.726268] [DEBUG] [LOCAL ] AS: No existing data file found in primary storage. [2025-09-26T17:18:59.726383] [WARN ] [MAIN ] AS: No existing data found, performing full refresh instead. [2025-09-26T17:18:59.726592] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-09-26T17:18:59.726668] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-09-26T17:18:59.726743] [DEBUG] [LOCAL ] AS: No primary data file found to delete. [2025-09-26T17:18:59.726781] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-09-26T17:18:59.957491] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-01. [2025-09-26T17:19:00.088785] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-09-26T17:19:00.126895] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-26T17:19:00.165707] [INFO ] [REMOTE ] ARMK: Full fetch complete (72561 records). [2025-09-26T17:19:00.172960] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-09-26T17:19:00.198116] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:19:00.367256] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:19:00.382457] [WARN ] [REMOTE ] ARX: No data returned for month 2025-01 [2025-09-26T17:19:00.630792] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-09-26T17:19:00.630886] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-09-26T17:19:00.631639] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-09-26T17:19:00.631739] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-09-26T17:19:00.633328] [DEBUG] [LOCAL ] ARMK: Trimmed 72561 records to 51112 (keeping 200 days of data) [2025-09-26T17:19:00.757104] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-09-26T17:19:00.995821] [DEBUG] [LOCAL ] ARMK: Primary data saved (51112 records). [2025-09-26T17:19:00.995969] [INFO ] [MAIN ] ARMK: Full history saved. [2025-09-26T17:19:00.998882] [INFO ] [MAIN ] Update Progress: 149/2371 symbols completed. ARMK took 36.9s. Estimated remaining: 4h 42m 50s. Rate: 7.9 symbols/min [2025-09-26T17:19:01.190541] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:19:01.207109] [DEBUG] [LOCAL ] ASA: Loaded 13926 existing records from primary storage. [2025-09-26T17:19:01.207282] [INFO ] [MAIN ] ASA: Loaded 13926 existing records. [2025-09-26T17:19:01.405932] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:19:01.406197] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-09-26T17:19:01.406247] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-09-26T17:19:01.406955] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-09-26T17:19:01.407018] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-09-26T17:19:01.561999] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-02. [2025-09-26T17:19:01.805071] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:19:01.875957] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:19:01.876310] [WARN ] [REMOTE ] ARX: No data returned for month 2025-02 [2025-09-26T17:19:02.214446] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-26T17:19:02.356780] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-12. [2025-09-26T17:19:03.153578] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-26T17:19:03.156899] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-09-26T17:19:03.956769] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-03. [2025-09-26T17:19:04.171130] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:19:04.171487] [WARN ] [REMOTE ] ARX: No data returned for month 2025-03 [2025-09-26T17:19:04.296912] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-26T17:19:04.756775] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-04. [2025-09-26T17:19:04.968532] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:19:04.968944] [WARN ] [REMOTE ] ARX: No data returned for month 2025-04 [2025-09-26T17:19:05.556735] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-05. [2025-09-26T17:19:05.765841] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:19:05.766195] [WARN ] [REMOTE ] ARX: No data returned for month 2025-05 [2025-09-26T17:19:06.356745] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-06. [2025-09-26T17:19:06.566378] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:19:06.566729] [WARN ] [REMOTE ] ARX: No data returned for month 2025-06 [2025-09-26T17:19:07.156750] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-09-26T17:19:07.956735] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-07. [2025-09-26T17:19:07.999557] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-26T17:19:08.756739] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-09-26T17:19:09.051895] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-26T17:19:09.302879] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-26T17:19:09.556755] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-12. [2025-09-26T17:19:10.356731] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-08. [2025-09-26T17:19:10.932628] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-26T17:19:11.156764] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-09-26T17:19:11.462019] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-26T17:19:11.956738] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-09-26T17:19:12.566535] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-26T17:19:12.626401] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-26T17:19:12.756766] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-09. [2025-09-26T17:19:13.556745] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-09-26T17:19:14.356702] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-09-26T17:19:14.473670] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T17:19:14.486245] [INFO ] [REMOTE ] ARX: Full fetch complete (14288 records). [2025-09-26T17:19:14.486456] [DEBUG] [VALIDATOR ] ARX: Validating primary data. [2025-09-26T17:19:14.707768] [WARN ] [VALIDATOR ] ARX: Validation failed - insufficient historical data. Have 46 unique days, need 200 days [2025-09-26T17:19:14.708093] [FATAL] [MAIN ] ARX: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:19:14.708166] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:19:14.708242] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-26T17:19:14.708319] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-26T17:19:14.708360] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-09-26T17:19:14.708402] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-09-26T17:19:14.708471] [INFO ] [MAIN ] Update Progress: 150/2371 symbols completed. ARX took 16.5s. Estimated remaining: 4h 44m 12s. Rate: 7.8 symbols/min [2025-09-26T17:19:14.914721] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:19:14.950993] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-26T17:19:15.008471] [DEBUG] [LOCAL ] ASAN: Loaded 53132 existing records from primary storage. [2025-09-26T17:19:15.008625] [INFO ] [MAIN ] ASAN: Loaded 53132 existing records. [2025-09-26T17:19:15.171270] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-09-26T17:19:15.217501] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:19:15.217798] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-09-26T17:19:15.217852] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-09-26T17:19:15.219432] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-09-26T17:19:15.219506] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-09-26T17:19:15.637989] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:19:15.684825] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-26T17:19:15.956771] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-12. [2025-09-26T17:19:16.756743] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-09-26T17:19:16.874463] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-26T17:19:17.556728] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-09-26T17:19:17.808835] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-26T17:19:17.903822] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-26T17:19:18.356733] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-09-26T17:19:19.069217] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-26T17:19:19.156776] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-09-26T17:19:19.897860] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-26T17:19:19.930417] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T17:19:19.956705] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-09-26T17:19:20.756770] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-09-26T17:19:21.531716] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-26T17:19:21.556672] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-09-26T17:19:21.779846] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-26T17:19:22.356731] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-09-26T17:19:22.943549] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-26T17:19:23.156753] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-09-26T17:19:23.823728] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-26T17:19:23.860372] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-26T17:19:23.956770] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-09-26T17:19:24.756732] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-09-26T17:19:25.556736] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-09-26T17:19:25.689790] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-26T17:19:26.102476] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-26T17:19:26.202252] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-26T17:19:26.356791] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-09-26T17:19:27.156761] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-09-26T17:19:27.611680] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-26T17:19:27.616491] [INFO ] [REMOTE ] ASA: Full fetch complete (18588 records). [2025-09-26T17:19:27.616614] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-09-26T17:19:27.961857] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-09-26T17:19:28.023369] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-09-26T17:19:28.023456] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-09-26T17:19:28.023793] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-09-26T17:19:28.023858] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-09-26T17:19:28.024560] [DEBUG] [LOCAL ] ASA: Trimmed 18588 records to 14109 (keeping 200 days of data) [2025-09-26T17:19:28.110620] [DEBUG] [LOCAL ] ASA: Primary data saved (14109 records). [2025-09-26T17:19:28.110802] [INFO ] [MAIN ] ASA: Full history saved. [2025-09-26T17:19:28.110926] [INFO ] [MAIN ] Update Progress: 151/2371 symbols completed. ASA took 27.1s. Estimated remaining: 4h 45m 28s. Rate: 7.8 symbols/min [2025-09-26T17:19:28.290672] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:19:28.338638] [DEBUG] [LOCAL ] ASB: Loaded 49933 existing records from primary storage. [2025-09-26T17:19:28.338839] [INFO ] [MAIN ] ASB: Loaded 49933 existing records. [2025-09-26T17:19:28.529242] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:19:28.549377] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-09-26T17:19:28.550091] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-09-26T17:19:28.552505] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-26T17:19:28.559291] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-09-26T17:19:28.559979] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-09-26T17:19:28.758311] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-09-26T17:19:28.948716] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:19:29.556719] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-12. [2025-09-26T17:19:29.821980] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-26T17:19:29.855549] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-26T17:19:30.356740] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-09-26T17:19:31.033974] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-26T17:19:31.156728] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-09-26T17:19:31.285691] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-26T17:19:31.956770] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-09-26T17:19:32.548437] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-26T17:19:32.756741] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-09-26T17:19:33.454085] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-26T17:19:33.556734] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-09-26T17:19:34.351601] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-26T17:19:34.363630] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-09-26T17:19:34.838632] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-26T17:19:35.156793] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-09-26T17:19:35.956695] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-09-26T17:19:36.037729] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-26T17:19:36.756699] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-09-26T17:19:37.077073] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-26T17:19:37.088817] [INFO ] [REMOTE ] AS: Full fetch complete (76522 records). [2025-09-26T17:19:37.089046] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-09-26T17:19:37.249924] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-26T17:19:37.297777] [INFO ] [REMOTE ] ARW: Full fetch complete (47891 records). [2025-09-26T17:19:37.321796] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-09-26T17:19:37.558095] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-09-26T17:19:37.787718] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-09-26T17:19:37.790409] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-09-26T17:19:37.792627] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-09-26T17:19:37.792778] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-09-26T17:19:37.910149] [DEBUG] [LOCAL ] AS: Trimmed 76522 records to 53854 (keeping 200 days of data) [2025-09-26T17:19:38.112158] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-09-26T17:19:38.112378] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-09-26T17:19:38.113376] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-09-26T17:19:38.113826] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-09-26T17:19:38.118519] [DEBUG] [LOCAL ] ARW: Trimmed 47891 records to 33660 (keeping 200 days of data) [2025-09-26T17:19:38.252226] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-26T17:19:38.361180] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-09-26T17:19:38.522772] [DEBUG] [LOCAL ] ARW: Primary data saved (33660 records). [2025-09-26T17:19:38.524323] [INFO ] [MAIN ] ARW: Full history saved. [2025-09-26T17:19:38.524474] [INFO ] [MAIN ] Update Progress: 152/2371 symbols completed. ARW took 43.7s. Estimated remaining: 4h 46m 0s. Rate: 7.8 symbols/min [2025-09-26T17:19:38.789137] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:19:38.792680] [DEBUG] [LOCAL ] ASBA: No existing data file found in primary storage. [2025-09-26T17:19:38.793288] [WARN ] [MAIN ] ASBA: No existing data found, performing full refresh instead. [2025-09-26T17:19:38.794943] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-09-26T17:19:38.795572] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-09-26T17:19:38.796277] [DEBUG] [LOCAL ] ASBA: No primary data file found to delete. [2025-09-26T17:19:38.796927] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-09-26T17:19:39.113297] [DEBUG] [LOCAL ] AS: Primary data saved (53854 records). [2025-09-26T17:19:39.144959] [INFO ] [MAIN ] AS: Full history saved. [2025-09-26T17:19:39.176405] [INFO ] [MAIN ] Update Progress: 153/2371 symbols completed. AS took 39.6s. Estimated remaining: 4h 44m 10s. Rate: 7.8 symbols/min [2025-09-26T17:19:39.267538] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:19:39.273243] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-12. [2025-09-26T17:19:39.450798] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:19:39.482152] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-26T17:19:39.535365] [DEBUG] [LOCAL ] ASC: Loaded 37925 existing records from primary storage. [2025-09-26T17:19:39.535518] [INFO ] [MAIN ] ASC: Loaded 37925 existing records. [2025-09-26T17:19:39.728794] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:19:39.729074] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-09-26T17:19:39.729127] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-09-26T17:19:39.730249] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-09-26T17:19:39.730314] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-09-26T17:19:39.957236] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-09-26T17:19:39.972858] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-26T17:19:40.145786] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:19:40.176865] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-26T17:19:40.756758] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-09-26T17:19:41.556731] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-09-26T17:19:42.170725] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-26T17:19:42.174197] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-26T17:19:42.275217] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-26T17:19:42.356719] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-09-26T17:19:42.934914] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-26T17:19:43.156766] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-09-26T17:19:43.501281] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-26T17:19:43.956768] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-09-26T17:19:44.756750] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-12. [2025-09-26T17:19:45.556767] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-09-26T17:19:46.001759] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-26T17:19:46.064477] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-26T17:19:46.356741] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-09-26T17:19:46.733323] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-26T17:19:46.769497] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-26T17:19:47.156746] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-09-26T17:19:47.956815] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-09-26T17:19:48.532005] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-26T17:19:48.660260] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-26T17:19:48.756756] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-09-26T17:19:49.556747] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-09-26T17:19:50.272327] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-26T17:19:50.356732] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-09-26T17:19:51.156728] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-09-26T17:19:51.435932] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-26T17:19:51.864510] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-26T17:19:51.956781] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-09-26T17:19:52.756756] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-09-26T17:19:53.394840] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-26T17:19:53.407919] [INFO ] [REMOTE ] ASAN: Full fetch complete (76542 records). [2025-09-26T17:19:53.408126] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-09-26T17:19:53.560482] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-09-26T17:19:53.671263] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-26T17:19:53.913871] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-09-26T17:19:53.913965] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-09-26T17:19:53.914824] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-09-26T17:19:53.914897] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-09-26T17:19:53.916487] [DEBUG] [LOCAL ] ASAN: Trimmed 76542 records to 53512 (keeping 200 days of data) [2025-09-26T17:19:54.233954] [DEBUG] [LOCAL ] ASAN: Primary data saved (53512 records). [2025-09-26T17:19:54.234115] [INFO ] [MAIN ] ASAN: Full history saved. [2025-09-26T17:19:54.234212] [INFO ] [MAIN ] Update Progress: 154/2371 symbols completed. ASAN took 39.5s. Estimated remaining: 4h 45m 48s. Rate: 7.8 symbols/min [2025-09-26T17:19:54.361842] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-09-26T17:19:54.428166] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:19:54.432578] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-26T17:19:54.454471] [DEBUG] [LOCAL ] ASG: Loaded 20501 existing records from primary storage. [2025-09-26T17:19:54.454618] [INFO ] [MAIN ] ASG: Loaded 20501 existing records. [2025-09-26T17:19:54.688206] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:19:54.688770] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-09-26T17:19:54.704872] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-09-26T17:19:54.718097] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-09-26T17:19:54.719446] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-09-26T17:19:54.719293] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-26T17:19:55.120434] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:19:55.156741] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-09-26T17:19:55.861719] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-26T17:19:55.956731] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-09-26T17:19:56.756746] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-09-26T17:19:57.008551] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-26T17:19:57.018844] [INFO ] [REMOTE ] ASB: Full fetch complete (71577 records). [2025-09-26T17:19:57.019055] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-09-26T17:19:57.474268] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-09-26T17:19:57.475137] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-09-26T17:19:57.476288] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-09-26T17:19:57.475388] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-26T17:19:57.476468] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-09-26T17:19:57.490270] [DEBUG] [LOCAL ] ASB: Trimmed 71577 records to 50299 (keeping 200 days of data) [2025-09-26T17:19:57.506963] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T17:19:57.568406] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-12. [2025-09-26T17:19:57.841825] [DEBUG] [LOCAL ] ASB: Primary data saved (50299 records). [2025-09-26T17:19:57.841982] [INFO ] [MAIN ] ASB: Full history saved. [2025-09-26T17:19:57.842897] [INFO ] [MAIN ] Update Progress: 155/2371 symbols completed. ASB took 29.7s. Estimated remaining: 4h 44m 41s. Rate: 7.8 symbols/min [2025-09-26T17:19:58.033814] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:19:58.059335] [DEBUG] [LOCAL ] ASGI: Loaded 22522 existing records from primary storage. [2025-09-26T17:19:58.059496] [INFO ] [MAIN ] ASGI: Loaded 22522 existing records. [2025-09-26T17:19:58.271757] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:19:58.272088] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-09-26T17:19:58.272139] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-09-26T17:19:58.273058] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-09-26T17:19:58.273124] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-09-26T17:19:58.361787] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-09-26T17:19:58.679925] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:19:58.837092] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-26T17:19:58.867210] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-26T17:19:59.156729] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-09-26T17:19:59.956743] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-09-26T17:20:00.295667] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-26T17:20:00.756777] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-09-26T17:20:01.068055] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-26T17:20:01.556740] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-12. [2025-09-26T17:20:01.883039] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-26T17:20:02.356738] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-09-26T17:20:02.813981] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-26T17:20:03.156766] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-09-26T17:20:03.630594] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-26T17:20:03.861710] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-26T17:20:03.863524] [INFO ] [REMOTE ] ASBA: Full fetch complete (5235 records). [2025-09-26T17:20:03.863674] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-09-26T17:20:03.961960] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-09-26T17:20:04.259523] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-09-26T17:20:04.259605] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-09-26T17:20:04.259865] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-09-26T17:20:04.259961] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-09-26T17:20:04.260404] [DEBUG] [LOCAL ] ASBA: Trimmed 5235 records to 3458 (keeping 200 days of data) [2025-09-26T17:20:04.283261] [DEBUG] [LOCAL ] ASBA: Primary data saved (3458 records). [2025-09-26T17:20:04.283404] [INFO ] [MAIN ] ASBA: Full history saved. [2025-09-26T17:20:04.283561] [INFO ] [MAIN ] Update Progress: 156/2371 symbols completed. ASBA took 25.8s. Estimated remaining: 4h 44m 16s. Rate: 7.8 symbols/min [2025-09-26T17:20:04.466249] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:20:04.466463] [DEBUG] [LOCAL ] ASGN: No existing data file found in primary storage. [2025-09-26T17:20:04.466520] [WARN ] [MAIN ] ASGN: No existing data found, performing full refresh instead. [2025-09-26T17:20:04.466714] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-09-26T17:20:04.466769] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-09-26T17:20:04.466815] [DEBUG] [LOCAL ] ASGN: No primary data file found to delete. [2025-09-26T17:20:04.466863] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-09-26T17:20:04.761992] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-09-26T17:20:04.850851] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:20:05.566243] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-09-26T17:20:05.574083] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-26T17:20:05.581419] [INFO ] [REMOTE ] ASC: Full fetch complete (56677 records). [2025-09-26T17:20:05.581550] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-09-26T17:20:05.584709] [FATAL] [VALIDATOR ] ASC: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:20:05.584834] [FATAL] [MAIN ] ASC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:20:05.584910] [WARN ] [MAIN ] ASC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:20:05.584989] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-09-26T17:20:05.585067] [DEBUG] [LOCAL ] ASC: No primary data file found to delete. [2025-09-26T17:20:05.585125] [INFO ] [LOCAL ] ASC: Starting deletion of derivative data. [2025-09-26T17:20:05.585598] [DEBUG] [LOCAL ] ASC: Deleted derivative data file. [2025-09-26T17:20:05.586865] [INFO ] [MAIN ] Update Progress: 157/2371 symbols completed. ASC took 26.4s. Estimated remaining: 4h 42m 38s. Rate: 7.8 symbols/min [2025-09-26T17:20:06.356773] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-12. [2025-09-26T17:20:06.408970] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-26T17:20:06.810410] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-26T17:20:07.156777] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-09-26T17:20:07.602361] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-26T17:20:07.851482] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-26T17:20:07.956742] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-09-26T17:20:08.756776] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-09-26T17:20:09.250778] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-26T17:20:09.493995] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-26T17:20:09.556739] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-09-26T17:20:10.356708] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-09-26T17:20:10.515280] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-26T17:20:11.156758] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-09-26T17:20:11.448407] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-26T17:20:11.956742] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-09-26T17:20:12.289902] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-26T17:20:12.756748] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-09-26T17:20:13.556739] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-09-26T17:20:14.352028] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-26T17:20:14.361371] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-09-26T17:20:14.393464] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-09-26T17:20:14.468701] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-26T17:20:15.156773] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-09-26T17:20:15.691910] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-26T17:20:15.945010] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-26T17:20:15.949099] [INFO ] [REMOTE ] ASG: Full fetch complete (31171 records). [2025-09-26T17:20:15.949221] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-09-26T17:20:15.949870] [FATAL] [VALIDATOR ] ASG: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:20:15.949995] [FATAL] [MAIN ] ASG: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:20:15.950041] [WARN ] [MAIN ] ASG: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:20:15.950092] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-09-26T17:20:15.950189] [DEBUG] [LOCAL ] ASG: No primary data file found to delete. [2025-09-26T17:20:15.950316] [INFO ] [LOCAL ] ASG: Starting deletion of derivative data. [2025-09-26T17:20:15.951080] [DEBUG] [LOCAL ] ASG: Deleted derivative data file. [2025-09-26T17:20:15.951185] [INFO ] [MAIN ] Update Progress: 158/2371 symbols completed. ASG took 21.7s. Estimated remaining: 4h 43m 8s. Rate: 7.8 symbols/min [2025-09-26T17:20:15.956679] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-09-26T17:20:16.756780] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-09-26T17:20:17.538382] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-26T17:20:17.556692] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-09-26T17:20:17.592483] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-26T17:20:18.356781] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-09-26T17:20:18.686392] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-26T17:20:19.156779] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-09-26T17:20:19.340280] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-26T17:20:19.874710] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-26T17:20:19.956754] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-09-26T17:20:20.756692] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-09-26T17:20:21.216341] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-26T17:20:21.556726] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-09-26T17:20:21.912834] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-26T17:20:22.356730] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-09-26T17:20:22.876639] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-26T17:20:23.156777] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-09-26T17:20:24.175935] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-26T17:20:24.185692] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-09-26T17:20:24.202356] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-26T17:20:24.756740] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-09-26T17:20:25.478908] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-26T17:20:25.486576] [INFO ] [REMOTE ] ASGN: Full fetch complete (51932 records). [2025-09-26T17:20:25.486734] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-09-26T17:20:25.908971] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-09-26T17:20:25.909118] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-09-26T17:20:25.909760] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-09-26T17:20:25.909843] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-09-26T17:20:25.925781] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-26T17:20:25.932877] [INFO ] [REMOTE ] ASGI: Full fetch complete (33468 records). [2025-09-26T17:20:25.933063] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-09-26T17:20:25.933271] [DEBUG] [LOCAL ] ASGN: Trimmed 51932 records to 36554 (keeping 200 days of data) [2025-09-26T17:20:26.469036] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-09-26T17:20:26.469415] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-09-26T17:20:26.470288] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-09-26T17:20:26.470672] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-09-26T17:20:26.474193] [DEBUG] [LOCAL ] ASGI: Trimmed 33468 records to 22711 (keeping 200 days of data) [2025-09-26T17:20:26.731991] [DEBUG] [LOCAL ] ASGI: Primary data saved (22711 records). [2025-09-26T17:20:26.732997] [INFO ] [MAIN ] ASGI: Full history saved. [2025-09-26T17:20:26.733193] [INFO ] [MAIN ] Update Progress: 159/2371 symbols completed. ASGI took 28.9s. Estimated remaining: 4h 43m 44s. Rate: 7.8 symbols/min [2025-09-26T17:20:26.763927] [DEBUG] [LOCAL ] ASGN: Primary data saved (36554 records). [2025-09-26T17:20:26.764116] [INFO ] [MAIN ] ASGN: Full history saved. [2025-09-26T17:20:26.764209] [INFO ] [MAIN ] Update Progress: 160/2371 symbols completed. ASGN took 22.5s. Estimated remaining: 4h 41m 50s. Rate: 7.8 symbols/min [2025-09-26T17:20:27.360857] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:20:27.533993] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:20:27.561528] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:20:27.539897] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:20:27.592503] [DEBUG] [LOCAL ] ASR: Loaded 9322 existing records from primary storage. [2025-09-26T17:20:27.592880] [INFO ] [MAIN ] ASR: Loaded 9322 existing records. [2025-09-26T17:20:27.691479] [DEBUG] [LOCAL ] ASIX: Loaded 22682 existing records from primary storage. [2025-09-26T17:20:27.714517] [INFO ] [MAIN ] ASIX: Loaded 22682 existing records. [2025-09-26T17:20:27.984725] [DEBUG] [LOCAL ] ASH: Loaded 38035 existing records from primary storage. [2025-09-26T17:20:28.076193] [INFO ] [MAIN ] ASH: Loaded 38035 existing records. [2025-09-26T17:20:28.104217] [DEBUG] [LOCAL ] ASPN: Loaded 49938 existing records from primary storage. [2025-09-26T17:20:28.204967] [INFO ] [MAIN ] ASPN: Loaded 49938 existing records. [2025-09-26T17:20:28.250095] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:20:28.313561] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-09-26T17:20:28.342226] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-09-26T17:20:28.440183] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-09-26T17:20:28.506811] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-09-26T17:20:28.523260] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:20:28.671541] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-09-26T17:20:28.778611] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-09-26T17:20:28.876814] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-09-26T17:20:28.876741] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:20:28.920104] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-09-26T17:20:28.920000] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-09-26T17:20:28.938822] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-09-26T17:20:28.955959] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-09-26T17:20:29.005720] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:20:28.970337] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-09-26T17:20:29.163900] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-09-26T17:20:29.223041] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-09-26T17:20:29.387945] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-09-26T17:20:29.414598] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-09-26T17:20:29.626195] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:20:29.651366] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-12. [2025-09-26T17:20:30.218050] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:20:30.313753] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:20:30.298911] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-12. [2025-09-26T17:20:30.327712] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-12. [2025-09-26T17:20:30.476037] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:20:30.476954] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-26T17:20:30.478987] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-12. [2025-09-26T17:20:30.479494] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-09-26T17:20:31.093909] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-26T17:20:31.096013] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-09-26T17:20:31.213311] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-26T17:20:31.217160] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-09-26T17:20:31.568453] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-26T17:20:31.570823] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-09-26T17:20:31.790752] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-26T17:20:31.956704] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-09-26T17:20:32.124899] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-26T17:20:32.143521] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-26T17:20:32.157018] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-26T17:20:32.756754] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-09-26T17:20:33.453859] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-26T17:20:33.556760] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-09-26T17:20:33.594600] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-26T17:20:34.356756] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-09-26T17:20:34.577007] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-26T17:20:35.156742] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-09-26T17:20:35.485700] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-26T17:20:35.956458] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-26T17:20:35.957334] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-09-26T17:20:36.756746] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-09-26T17:20:37.557884] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-09-26T17:20:37.564714] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-26T17:20:37.808597] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-26T17:20:38.303155] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-26T17:20:38.356736] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-09-26T17:20:39.156706] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-09-26T17:20:39.234680] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-26T17:20:39.956753] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-09-26T17:20:40.752944] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T17:20:40.761273] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-09-26T17:20:41.219579] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-26T17:20:41.556741] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-09-26T17:20:42.356695] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-09-26T17:20:42.367701] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-26T17:20:42.510387] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-26T17:20:43.156742] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-09-26T17:20:43.912859] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-26T17:20:43.956702] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-09-26T17:20:44.573046] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-26T17:20:44.756729] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-09-26T17:20:45.202686] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-26T17:20:45.304336] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-26T17:20:45.556767] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-09-26T17:20:46.356705] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-09-26T17:20:46.758569] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-26T17:20:47.156731] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-09-26T17:20:47.945754] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-26T17:20:47.956677] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-09-26T17:20:48.267332] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-26T17:20:48.756684] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-09-26T17:20:48.934801] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-26T17:20:49.556818] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-09-26T17:20:49.567277] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-26T17:20:49.570580] [INFO ] [REMOTE ] ASR: Full fetch complete (12375 records). [2025-09-26T17:20:49.570753] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-09-26T17:20:49.972752] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-09-26T17:20:49.972888] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-09-26T17:20:49.973388] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-09-26T17:20:49.973433] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-09-26T17:20:49.974049] [DEBUG] [LOCAL ] ASR: Trimmed 12375 records to 9381 (keeping 200 days of data) [2025-09-26T17:20:50.043756] [DEBUG] [LOCAL ] ASR: Primary data saved (9381 records). [2025-09-26T17:20:50.043999] [INFO ] [MAIN ] ASR: Full history saved. [2025-09-26T17:20:50.044129] [INFO ] [MAIN ] Update Progress: 161/2371 symbols completed. ASR took 23.3s. Estimated remaining: 4h 45m 17s. Rate: 7.7 symbols/min [2025-09-26T17:20:50.237676] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:20:50.237962] [DEBUG] [LOCAL ] ASX: No existing data file found in primary storage. [2025-09-26T17:20:50.238002] [WARN ] [MAIN ] ASX: No existing data found, performing full refresh instead. [2025-09-26T17:20:50.238162] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-09-26T17:20:50.238235] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-09-26T17:20:50.238279] [DEBUG] [LOCAL ] ASX: No primary data file found to delete. [2025-09-26T17:20:50.238313] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-09-26T17:20:50.361858] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-09-26T17:20:50.662189] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:20:51.105507] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-26T17:20:51.156746] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-09-26T17:20:51.221871] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-26T17:20:51.226954] [INFO ] [REMOTE ] ASIX: Full fetch complete (29913 records). [2025-09-26T17:20:51.227156] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-09-26T17:20:51.639021] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-09-26T17:20:51.639144] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-09-26T17:20:51.639606] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-09-26T17:20:51.639695] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-09-26T17:20:51.640952] [DEBUG] [LOCAL ] ASIX: Trimmed 29913 records to 22834 (keeping 200 days of data) [2025-09-26T17:20:51.801356] [DEBUG] [LOCAL ] ASIX: Primary data saved (22834 records). [2025-09-26T17:20:51.801563] [INFO ] [MAIN ] ASIX: Full history saved. [2025-09-26T17:20:51.801770] [INFO ] [MAIN ] Update Progress: 162/2371 symbols completed. ASIX took 25.0s. Estimated remaining: 4h 43m 47s. Rate: 7.8 symbols/min [2025-09-26T17:20:51.963158] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-09-26T17:20:52.000114] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:20:52.000304] [DEBUG] [LOCAL ] ATEN: No existing data file found in primary storage. [2025-09-26T17:20:52.000359] [WARN ] [MAIN ] ATEN: No existing data found, performing full refresh instead. [2025-09-26T17:20:52.000542] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-09-26T17:20:52.000604] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-09-26T17:20:52.000699] [DEBUG] [LOCAL ] ATEN: No primary data file found to delete. [2025-09-26T17:20:52.000759] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-09-26T17:20:52.411730] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:20:52.439716] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-26T17:20:52.756726] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-12. [2025-09-26T17:20:53.398751] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-26T17:20:53.556719] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-09-26T17:20:53.960706] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-26T17:20:54.356757] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-09-26T17:20:55.010104] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-26T17:20:55.156778] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-09-26T17:20:55.448986] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-26T17:20:55.956751] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-12. [2025-09-26T17:20:56.464238] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-26T17:20:56.756767] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-09-26T17:20:57.546847] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-26T17:20:57.558530] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-09-26T17:20:58.233446] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-26T17:20:58.356774] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-09-26T17:20:59.156713] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-09-26T17:20:59.335747] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-26T17:20:59.689422] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-26T17:20:59.696880] [INFO ] [REMOTE ] ASH: Full fetch complete (54837 records). [2025-09-26T17:20:59.697021] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-09-26T17:20:59.962060] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-09-26T17:21:00.136167] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-09-26T17:21:00.136293] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-09-26T17:21:00.137158] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-09-26T17:21:00.137230] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-09-26T17:21:00.138755] [DEBUG] [LOCAL ] ASH: Trimmed 54837 records to 38339 (keeping 200 days of data) [2025-09-26T17:21:00.391608] [DEBUG] [LOCAL ] ASH: Primary data saved (38339 records). [2025-09-26T17:21:00.391803] [INFO ] [MAIN ] ASH: Full history saved. [2025-09-26T17:21:00.391976] [INFO ] [MAIN ] Update Progress: 163/2371 symbols completed. ASH took 33.6s. Estimated remaining: 4h 43m 52s. Rate: 7.8 symbols/min [2025-09-26T17:21:00.593460] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:21:00.630673] [DEBUG] [LOCAL ] ATGE: Loaded 32073 existing records from primary storage. [2025-09-26T17:21:00.630834] [INFO ] [MAIN ] ATGE: Loaded 32073 existing records. [2025-09-26T17:21:00.761970] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-09-26T17:21:00.844572] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:21:00.844920] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-09-26T17:21:00.844971] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-09-26T17:21:00.846151] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-09-26T17:21:00.846221] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-09-26T17:21:01.267009] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:21:01.302399] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-26T17:21:01.556752] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-09-26T17:21:01.938618] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-26T17:21:02.276717] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-26T17:21:02.356728] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-09-26T17:21:02.912693] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-26T17:21:03.156752] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-12. [2025-09-26T17:21:03.957686] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-09-26T17:21:03.964928] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-26T17:21:04.131750] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-26T17:21:04.756763] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-09-26T17:21:05.137510] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-26T17:21:05.556817] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-09-26T17:21:06.356734] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-09-26T17:21:06.718032] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-26T17:21:07.156721] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-09-26T17:21:07.348016] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-26T17:21:07.836202] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-26T17:21:07.956772] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-09-26T17:21:08.175063] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-26T17:21:08.756873] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-09-26T17:21:09.556739] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-09-26T17:21:09.746075] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-26T17:21:09.756617] [INFO ] [REMOTE ] ASPN: Full fetch complete (72282 records). [2025-09-26T17:21:09.756847] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-09-26T17:21:10.361556] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-09-26T17:21:10.419243] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-26T17:21:10.454032] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-09-26T17:21:10.454310] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-09-26T17:21:10.455104] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-09-26T17:21:10.455222] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-09-26T17:21:10.457005] [DEBUG] [LOCAL ] ASPN: Trimmed 72282 records to 50293 (keeping 200 days of data) [2025-09-26T17:21:10.764352] [DEBUG] [LOCAL ] ASPN: Primary data saved (50293 records). [2025-09-26T17:21:10.764515] [INFO ] [MAIN ] ASPN: Full history saved. [2025-09-26T17:21:10.765787] [INFO ] [MAIN ] Update Progress: 164/2371 symbols completed. ASPN took 44.0s. Estimated remaining: 4h 44m 20s. Rate: 7.8 symbols/min [2025-09-26T17:21:10.964660] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:21:11.002735] [DEBUG] [LOCAL ] ATHM: Loaded 32842 existing records from primary storage. [2025-09-26T17:21:11.002918] [INFO ] [MAIN ] ATHM: Loaded 32842 existing records. [2025-09-26T17:21:11.161855] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-09-26T17:21:11.211342] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:21:11.211633] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-09-26T17:21:11.211744] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-09-26T17:21:11.212625] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-09-26T17:21:11.212732] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-09-26T17:21:11.638640] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:21:11.714480] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-26T17:21:11.730374] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-26T17:21:11.956774] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-12. [2025-09-26T17:21:12.366546] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-26T17:21:12.756748] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-09-26T17:21:13.556739] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-09-26T17:21:13.761038] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T17:21:14.356773] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-09-26T17:21:14.577091] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-26T17:21:14.829319] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-26T17:21:14.837465] [INFO ] [REMOTE ] ATEN: Full fetch complete (57407 records). [2025-09-26T17:21:14.837681] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-09-26T17:21:15.161878] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-09-26T17:21:15.248897] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-09-26T17:21:15.248989] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-09-26T17:21:15.249659] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-09-26T17:21:15.249744] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-09-26T17:21:15.251101] [DEBUG] [LOCAL ] ATEN: Trimmed 57407 records to 40398 (keeping 200 days of data) [2025-09-26T17:21:15.519127] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-26T17:21:15.558574] [DEBUG] [LOCAL ] ATEN: Primary data saved (40398 records). [2025-09-26T17:21:15.558736] [INFO ] [MAIN ] ATEN: Full history saved. [2025-09-26T17:21:15.558825] [INFO ] [MAIN ] Update Progress: 165/2371 symbols completed. ATEN took 23.8s. Estimated remaining: 4h 43m 33s. Rate: 7.8 symbols/min [2025-09-26T17:21:15.761739] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:21:15.762024] [DEBUG] [LOCAL ] ATHS: No existing data file found in primary storage. [2025-09-26T17:21:15.762101] [WARN ] [MAIN ] ATHS: No existing data found, performing full refresh instead. [2025-09-26T17:21:15.762342] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-09-26T17:21:15.762413] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-09-26T17:21:15.762494] [DEBUG] [LOCAL ] ATHS: No primary data file found to delete. [2025-09-26T17:21:15.762559] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-09-26T17:21:15.967843] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-09-26T17:21:16.156691] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:21:16.729207] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-26T17:21:16.756721] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-09-26T17:21:17.227328] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-26T17:21:17.556752] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-09-26T17:21:18.325579] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-26T17:21:18.356727] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-09-26T17:21:18.963036] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-26T17:21:19.156779] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-12. [2025-09-26T17:21:19.956783] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-09-26T17:21:20.009500] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-26T17:21:20.263249] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-26T17:21:20.278845] [INFO ] [REMOTE ] ASX: Full fetch complete (76613 records). [2025-09-26T17:21:20.279023] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-09-26T17:21:20.767881] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-09-26T17:21:20.851970] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-09-26T17:21:20.852089] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-09-26T17:21:20.853081] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-09-26T17:21:20.853240] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-09-26T17:21:20.855388] [DEBUG] [LOCAL ] ASX: Trimmed 76613 records to 53639 (keeping 200 days of data) [2025-09-26T17:21:21.351008] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-26T17:21:21.391799] [DEBUG] [LOCAL ] ASX: Primary data saved (53639 records). [2025-09-26T17:21:21.391976] [INFO ] [MAIN ] ASX: Full history saved. [2025-09-26T17:21:21.392107] [INFO ] [MAIN ] Update Progress: 166/2371 symbols completed. ASX took 31.3s. Estimated remaining: 4h 43m 0s. Rate: 7.8 symbols/min [2025-09-26T17:21:21.561431] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-09-26T17:21:21.645833] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:21:21.701443] [DEBUG] [LOCAL ] ATI: Loaded 51903 existing records from primary storage. [2025-09-26T17:21:21.701636] [INFO ] [MAIN ] ATI: Loaded 51903 existing records. [2025-09-26T17:21:21.916440] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:21:21.917145] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-09-26T17:21:21.917216] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-09-26T17:21:21.918740] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-09-26T17:21:21.918807] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-09-26T17:21:22.163067] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-26T17:21:22.345763] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:21:22.363487] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-09-26T17:21:22.368353] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-26T17:21:23.156741] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-12. [2025-09-26T17:21:23.957298] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-09-26T17:21:23.960851] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-26T17:21:24.396918] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-26T17:21:24.431053] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-26T17:21:24.756764] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-09-26T17:21:25.556736] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-09-26T17:21:26.318433] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-26T17:21:26.356718] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-09-26T17:21:26.867635] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-26T17:21:27.156757] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-09-26T17:21:27.786849] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-26T17:21:27.956798] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-09-26T17:21:28.610966] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-26T17:21:28.756791] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-09-26T17:21:29.535954] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-26T17:21:29.556690] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-09-26T17:21:29.787615] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-26T17:21:30.128909] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-26T17:21:30.356753] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-09-26T17:21:30.850789] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-26T17:21:31.156752] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-09-26T17:21:31.929216] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-26T17:21:31.956706] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-09-26T17:21:32.679153] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-26T17:21:32.756759] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-09-26T17:21:33.556721] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-09-26T17:21:34.008293] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-26T17:21:34.356736] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-09-26T17:21:35.156793] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-09-26T17:21:35.298747] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-26T17:21:35.405326] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-26T17:21:35.565276] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-26T17:21:35.956756] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-09-26T17:21:36.756752] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-09-26T17:21:37.524837] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-26T17:21:37.526586] [INFO ] [REMOTE ] ATHS: Full fetch complete (10052 records). [2025-09-26T17:21:37.526693] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-09-26T17:21:37.559637] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-09-26T17:21:37.935231] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-09-26T17:21:37.935421] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-09-26T17:21:37.935791] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-09-26T17:21:37.935877] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-09-26T17:21:37.965758] [DEBUG] [LOCAL ] ATHS: Trimmed 10052 records to 7145 (keeping 200 days of data) [2025-09-26T17:21:37.988599] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-26T17:21:38.033616] [DEBUG] [LOCAL ] ATHS: Primary data saved (7145 records). [2025-09-26T17:21:38.033793] [INFO ] [MAIN ] ATHS: Full history saved. [2025-09-26T17:21:38.033893] [INFO ] [MAIN ] Update Progress: 167/2371 symbols completed. ATHS took 22.5s. Estimated remaining: 4h 44m 50s. Rate: 7.7 symbols/min [2025-09-26T17:21:38.224107] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:21:38.265636] [DEBUG] [LOCAL ] ATKR: Loaded 35914 existing records from primary storage. [2025-09-26T17:21:38.265840] [INFO ] [MAIN ] ATKR: Loaded 35914 existing records. [2025-09-26T17:21:38.365506] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-09-26T17:21:38.461067] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:21:38.461489] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-09-26T17:21:38.461550] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-09-26T17:21:38.462785] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-09-26T17:21:38.462852] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-09-26T17:21:38.882627] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:21:38.907014] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-26T17:21:39.156750] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-09-26T17:21:39.732009] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-26T17:21:39.956760] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-12. [2025-09-26T17:21:40.154834] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-26T17:21:40.160138] [INFO ] [REMOTE ] ATHM: Full fetch complete (51599 records). [2025-09-26T17:21:40.160269] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-09-26T17:21:40.574462] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-09-26T17:21:40.574561] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-09-26T17:21:40.575155] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-09-26T17:21:40.575220] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-09-26T17:21:40.576464] [DEBUG] [LOCAL ] ATHM: Trimmed 51599 records to 33015 (keeping 200 days of data) [2025-09-26T17:21:40.761412] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-09-26T17:21:40.788836] [DEBUG] [LOCAL ] ATHM: Primary data saved (33015 records). [2025-09-26T17:21:40.789001] [INFO ] [MAIN ] ATHM: Full history saved. [2025-09-26T17:21:40.792001] [INFO ] [MAIN ] Update Progress: 168/2371 symbols completed. ATHM took 30.0s. Estimated remaining: 4h 43m 37s. Rate: 7.8 symbols/min [2025-09-26T17:21:40.972481] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:21:40.972695] [DEBUG] [LOCAL ] ATMU: No existing data file found in primary storage. [2025-09-26T17:21:40.972752] [WARN ] [MAIN ] ATMU: No existing data found, performing full refresh instead. [2025-09-26T17:21:40.972895] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-09-26T17:21:40.972938] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-09-26T17:21:40.972980] [DEBUG] [LOCAL ] ATMU: No primary data file found to delete. [2025-09-26T17:21:40.973013] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-09-26T17:21:41.386983] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:21:41.504263] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-26T17:21:41.556709] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-09-26T17:21:42.356743] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-12. [2025-09-26T17:21:42.618584] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-26T17:21:42.973926] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-26T17:21:43.156738] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-09-26T17:21:43.753994] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T17:21:43.956724] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-09-26T17:21:44.648890] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-26T17:21:44.756740] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-09-26T17:21:45.295707] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-26T17:21:45.556746] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-09-26T17:21:45.856407] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-26T17:21:46.356732] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-09-26T17:21:47.125557] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-26T17:21:47.156724] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-09-26T17:21:47.662007] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-26T17:21:47.956780] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-09-26T17:21:48.167913] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-26T17:21:48.756791] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-09-26T17:21:49.539136] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-26T17:21:49.556673] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-09-26T17:21:49.888297] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-26T17:21:50.356763] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-09-26T17:21:51.156738] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-09-26T17:21:51.409799] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-26T17:21:51.665239] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-26T17:21:51.956785] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-09-26T17:21:52.246746] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-26T17:21:52.756786] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-09-26T17:21:53.563949] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-09-26T17:21:53.581784] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-26T17:21:53.593476] [INFO ] [REMOTE ] ATI: Full fetch complete (73906 records). [2025-09-26T17:21:53.593883] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-09-26T17:21:53.730202] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-26T17:21:54.054050] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-09-26T17:21:54.054146] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-09-26T17:21:54.054964] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-09-26T17:21:54.055045] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-09-26T17:21:54.056958] [DEBUG] [LOCAL ] ATI: Trimmed 73906 records to 52283 (keeping 200 days of data) [2025-09-26T17:21:54.357997] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-09-26T17:21:54.371066] [DEBUG] [LOCAL ] ATI: Primary data saved (52283 records). [2025-09-26T17:21:54.371420] [INFO ] [MAIN ] ATI: Full history saved. [2025-09-26T17:21:54.371542] [INFO ] [MAIN ] Update Progress: 169/2371 symbols completed. ATI took 33.0s. Estimated remaining: 4h 44m 46s. Rate: 7.7 symbols/min [2025-09-26T17:21:54.574071] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:21:54.636397] [DEBUG] [LOCAL ] ATO: Loaded 42204 existing records from primary storage. [2025-09-26T17:21:54.636634] [INFO ] [MAIN ] ATO: Loaded 42204 existing records. [2025-09-26T17:21:54.843040] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:21:54.843296] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-09-26T17:21:54.843353] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-09-26T17:21:54.845030] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-09-26T17:21:54.845107] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-09-26T17:21:55.119547] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-26T17:21:55.162110] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-09-26T17:21:55.187880] [INFO ] [REMOTE ] ATGE: Full fetch complete (46245 records). [2025-09-26T17:21:55.193529] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-09-26T17:21:55.477986] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:21:55.812681] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-09-26T17:21:55.812894] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-09-26T17:21:55.813557] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-09-26T17:21:55.813680] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-09-26T17:21:55.837870] [DEBUG] [LOCAL ] ATGE: Trimmed 46245 records to 32251 (keeping 200 days of data) [2025-09-26T17:21:55.838702] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-26T17:21:55.958946] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-09-26T17:21:56.058204] [DEBUG] [LOCAL ] ATGE: Primary data saved (32251 records). [2025-09-26T17:21:56.058474] [INFO ] [MAIN ] ATGE: Full history saved. [2025-09-26T17:21:56.061881] [INFO ] [MAIN ] Update Progress: 170/2371 symbols completed. ATGE took 55.7s. Estimated remaining: 4h 43m 19s. Rate: 7.8 symbols/min [2025-09-26T17:21:56.270210] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:21:56.315149] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-26T17:21:56.336479] [DEBUG] [LOCAL ] ATR: Loaded 30652 existing records from primary storage. [2025-09-26T17:21:56.336687] [INFO ] [MAIN ] ATR: Loaded 30652 existing records. [2025-09-26T17:21:56.570846] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:21:56.571142] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-09-26T17:21:56.571192] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-09-26T17:21:56.572331] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-09-26T17:21:56.572398] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-09-26T17:21:56.761879] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-12. [2025-09-26T17:21:56.965318] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:21:57.064989] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-26T17:21:57.556729] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-12. [2025-09-26T17:21:58.181144] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-26T17:21:58.356749] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-09-26T17:21:58.529951] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-26T17:21:59.156768] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-09-26T17:21:59.676295] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-26T17:21:59.956750] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-09-26T17:22:00.088308] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-26T17:22:00.756795] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-09-26T17:22:01.399253] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-26T17:22:01.556917] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-09-26T17:22:01.854716] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-26T17:22:02.356758] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-09-26T17:22:03.103824] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-26T17:22:03.156694] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-09-26T17:22:03.956707] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-09-26T17:22:04.057546] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-26T17:22:04.756773] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-09-26T17:22:04.805893] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T17:22:04.815620] [INFO ] [REMOTE ] ATKR: Full fetch complete (53681 records). [2025-09-26T17:22:04.815886] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-09-26T17:22:05.281162] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-09-26T17:22:05.281307] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-09-26T17:22:05.282026] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-09-26T17:22:05.282117] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-09-26T17:22:05.303163] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-26T17:22:05.302265] [DEBUG] [LOCAL ] ATKR: Trimmed 53681 records to 36196 (keeping 200 days of data) [2025-09-26T17:22:05.536837] [DEBUG] [LOCAL ] ATKR: Primary data saved (36196 records). [2025-09-26T17:22:05.537026] [INFO ] [MAIN ] ATKR: Full history saved. [2025-09-26T17:22:05.537177] [INFO ] [MAIN ] Update Progress: 171/2371 symbols completed. ATKR took 27.5s. Estimated remaining: 4h 43m 34s. Rate: 7.8 symbols/min [2025-09-26T17:22:05.561905] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-09-26T17:22:05.730427] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:22:05.748593] [DEBUG] [LOCAL ] ATS: Loaded 18022 existing records from primary storage. [2025-09-26T17:22:05.748776] [INFO ] [MAIN ] ATS: Loaded 18022 existing records. [2025-09-26T17:22:05.940493] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:22:05.940789] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-09-26T17:22:05.940845] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-09-26T17:22:05.941530] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-09-26T17:22:05.941607] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-09-26T17:22:06.330901] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:22:06.356731] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-12. [2025-09-26T17:22:06.547860] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-26T17:22:06.955216] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-26T17:22:07.156699] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-09-26T17:22:07.173582] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-26T17:22:07.956785] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-09-26T17:22:08.544764] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-26T17:22:08.756782] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-09-26T17:22:09.332464] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-26T17:22:09.556732] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-09-26T17:22:10.098436] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-26T17:22:10.107868] [INFO ] [REMOTE ] ATMU: Full fetch complete (56938 records). [2025-09-26T17:22:10.108063] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-09-26T17:22:10.361960] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-09-26T17:22:10.542166] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-09-26T17:22:10.542295] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-09-26T17:22:10.543032] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-09-26T17:22:10.543104] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-09-26T17:22:10.544677] [DEBUG] [LOCAL ] ATMU: Trimmed 56938 records to 40274 (keeping 200 days of data) [2025-09-26T17:22:10.810550] [DEBUG] [LOCAL ] ATMU: Primary data saved (40274 records). [2025-09-26T17:22:10.810857] [INFO ] [MAIN ] ATMU: Full history saved. [2025-09-26T17:22:10.811069] [INFO ] [MAIN ] Update Progress: 172/2371 symbols completed. ATMU took 30.0s. Estimated remaining: 4h 42m 55s. Rate: 7.8 symbols/min [2025-09-26T17:22:10.989625] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:22:10.990114] [DEBUG] [LOCAL ] ATUS: No existing data file found in primary storage. [2025-09-26T17:22:10.990282] [WARN ] [MAIN ] ATUS: No existing data found, performing full refresh instead. [2025-09-26T17:22:10.990531] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-09-26T17:22:10.990757] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-09-26T17:22:10.990965] [DEBUG] [LOCAL ] ATUS: No primary data file found to delete. [2025-09-26T17:22:10.991022] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-09-26T17:22:11.161709] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-09-26T17:22:11.177425] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-26T17:22:11.442342] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:22:11.771223] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-26T17:22:11.904932] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-26T17:22:11.956698] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-09-26T17:22:12.756721] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-09-26T17:22:13.067121] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-26T17:22:13.556756] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-09-26T17:22:14.134085] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-26T17:22:14.356799] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-12. [2025-09-26T17:22:14.684871] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-26T17:22:15.156786] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-09-26T17:22:15.956808] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-09-26T17:22:16.116193] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-26T17:22:16.384533] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-26T17:22:16.625748] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-26T17:22:16.756827] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-09-26T17:22:17.556746] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-09-26T17:22:17.986395] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-26T17:22:18.356737] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-09-26T17:22:18.835034] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-26T17:22:19.156742] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-09-26T17:22:19.786180] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-26T17:22:19.794439] [INFO ] [REMOTE ] ATO: Full fetch complete (60452 records). [2025-09-26T17:22:19.794582] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-09-26T17:22:19.963333] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-09-26T17:22:20.224447] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-09-26T17:22:20.224825] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-09-26T17:22:20.225530] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-09-26T17:22:20.225628] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-09-26T17:22:20.227429] [DEBUG] [LOCAL ] ATO: Trimmed 60452 records to 42489 (keeping 200 days of data) [2025-09-26T17:22:20.383940] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-26T17:22:20.536115] [DEBUG] [LOCAL ] ATO: Primary data saved (42489 records). [2025-09-26T17:22:20.536284] [INFO ] [MAIN ] ATO: Full history saved. [2025-09-26T17:22:20.536387] [INFO ] [MAIN ] Update Progress: 173/2371 symbols completed. ATO took 26.2s. Estimated remaining: 4h 43m 13s. Rate: 7.8 symbols/min [2025-09-26T17:22:20.720338] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:22:20.734723] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-26T17:22:20.756762] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-09-26T17:22:20.798708] [DEBUG] [LOCAL ] AU: Loaded 53326 existing records from primary storage. [2025-09-26T17:22:20.798876] [INFO ] [MAIN ] AU: Loaded 53326 existing records. [2025-09-26T17:22:21.023487] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:22:21.023857] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-09-26T17:22:21.023928] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-09-26T17:22:21.025809] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-09-26T17:22:21.025877] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-09-26T17:22:21.516800] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:22:21.556735] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-09-26T17:22:22.357159] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-12. [2025-09-26T17:22:22.363433] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-26T17:22:22.385377] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-26T17:22:23.156733] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-09-26T17:22:23.956707] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-09-26T17:22:24.366032] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-26T17:22:24.405958] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-26T17:22:24.756768] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-09-26T17:22:25.556747] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-09-26T17:22:25.595100] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-26T17:22:25.674885] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-26T17:22:26.356790] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-09-26T17:22:26.717763] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-26T17:22:27.159762] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-09-26T17:22:27.163751] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-26T17:22:27.167817] [INFO ] [REMOTE ] ATS: Full fetch complete (25623 records). [2025-09-26T17:22:27.167931] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-09-26T17:22:27.643018] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-09-26T17:22:27.643214] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-09-26T17:22:27.643850] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-09-26T17:22:27.643971] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-09-26T17:22:27.650345] [DEBUG] [LOCAL ] ATS: Trimmed 25623 records to 18145 (keeping 200 days of data) [2025-09-26T17:22:27.843598] [DEBUG] [LOCAL ] ATS: Primary data saved (18145 records). [2025-09-26T17:22:27.843883] [INFO ] [MAIN ] ATS: Full history saved. [2025-09-26T17:22:27.844261] [INFO ] [MAIN ] Update Progress: 174/2371 symbols completed. ATS took 22.3s. Estimated remaining: 4h 42m 60s. Rate: 7.8 symbols/min [2025-09-26T17:22:27.961918] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-09-26T17:22:28.089226] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:22:28.142617] [DEBUG] [LOCAL ] AUB: Loaded 46780 existing records from primary storage. [2025-09-26T17:22:28.142818] [INFO ] [MAIN ] AUB: Loaded 46780 existing records. [2025-09-26T17:22:28.349269] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:22:28.358114] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-09-26T17:22:28.369976] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-09-26T17:22:28.371767] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-26T17:22:28.378586] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-09-26T17:22:28.379067] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-09-26T17:22:28.761918] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-09-26T17:22:28.795297] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:22:29.556735] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-09-26T17:22:29.933206] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-26T17:22:30.196630] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-26T17:22:30.356747] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-09-26T17:22:31.156741] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-12. [2025-09-26T17:22:31.323839] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-26T17:22:31.748847] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-26T17:22:31.956759] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-09-26T17:22:32.482083] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-26T17:22:32.756731] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-09-26T17:22:33.509419] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-26T17:22:33.556747] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-09-26T17:22:34.026616] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-26T17:22:34.356752] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-09-26T17:22:34.761517] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-26T17:22:35.156752] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-09-26T17:22:35.589171] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-26T17:22:35.597357] [INFO ] [REMOTE ] ATR: Full fetch complete (43440 records). [2025-09-26T17:22:35.597479] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-09-26T17:22:35.965463] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-09-26T17:22:36.018714] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-09-26T17:22:36.018815] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-09-26T17:22:36.019349] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-09-26T17:22:36.019399] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-09-26T17:22:36.022697] [DEBUG] [LOCAL ] ATR: Trimmed 43440 records to 30839 (keeping 200 days of data) [2025-09-26T17:22:36.251524] [DEBUG] [LOCAL ] ATR: Primary data saved (30839 records). [2025-09-26T17:22:36.251729] [INFO ] [MAIN ] ATR: Full history saved. [2025-09-26T17:22:36.252580] [INFO ] [MAIN ] Update Progress: 175/2371 symbols completed. ATR took 40.2s. Estimated remaining: 4h 43m 1s. Rate: 7.8 symbols/min [2025-09-26T17:22:36.446818] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:22:36.455596] [DEBUG] [LOCAL ] AUNA: Loaded 4907 existing records from primary storage. [2025-09-26T17:22:36.455761] [INFO ] [MAIN ] AUNA: Loaded 4907 existing records. [2025-09-26T17:22:36.654799] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:22:36.655096] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-09-26T17:22:36.655146] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-09-26T17:22:36.655681] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-09-26T17:22:36.655747] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-09-26T17:22:36.761860] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-09-26T17:22:37.079221] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:22:37.110486] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-26T17:22:37.152677] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-26T17:22:37.556732] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-09-26T17:22:38.356795] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-09-26T17:22:38.620970] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-26T17:22:39.069329] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-26T17:22:39.156931] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-09-26T17:22:39.956720] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-09-26T17:22:40.225682] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-26T17:22:40.481214] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-26T17:22:40.756724] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-09-26T17:22:41.354169] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-26T17:22:41.556718] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-09-26T17:22:42.356756] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-12. [2025-09-26T17:22:42.542326] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-26T17:22:42.851360] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-26T17:22:42.945254] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-26T17:22:43.156739] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-09-26T17:22:43.956738] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-09-26T17:22:44.573225] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-26T17:22:44.756730] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-09-26T17:22:45.551554] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-26T17:22:45.561000] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-09-26T17:22:45.562952] [INFO ] [REMOTE ] ATUS: Full fetch complete (70932 records). [2025-09-26T17:22:45.563159] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-09-26T17:22:46.022447] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-09-26T17:22:46.022831] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-09-26T17:22:46.024114] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-09-26T17:22:46.024423] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-09-26T17:22:46.044589] [DEBUG] [LOCAL ] ATUS: Trimmed 70932 records to 49958 (keeping 200 days of data) [2025-09-26T17:22:46.059924] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-26T17:22:46.362329] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-09-26T17:22:46.398983] [DEBUG] [LOCAL ] ATUS: Primary data saved (49958 records). [2025-09-26T17:22:46.399102] [INFO ] [MAIN ] ATUS: Full history saved. [2025-09-26T17:22:46.399188] [INFO ] [MAIN ] Update Progress: 176/2371 symbols completed. ATUS took 35.6s. Estimated remaining: 4h 43m 23s. Rate: 7.7 symbols/min [2025-09-26T17:22:46.578218] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:22:46.620079] [DEBUG] [LOCAL ] AVA: Loaded 39928 existing records from primary storage. [2025-09-26T17:22:46.620266] [INFO ] [MAIN ] AVA: Loaded 39928 existing records. [2025-09-26T17:22:46.815144] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:22:46.815495] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-09-26T17:22:46.815561] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-09-26T17:22:46.816809] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-09-26T17:22:46.816873] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-09-26T17:22:46.940866] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-26T17:22:47.161821] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-09-26T17:22:47.228287] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:22:47.483337] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-26T17:22:47.956735] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-09-26T17:22:48.632441] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-26T17:22:48.756734] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-12. [2025-09-26T17:22:49.556727] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-09-26T17:22:50.071277] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-26T17:22:50.278500] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-26T17:22:50.356748] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-09-26T17:22:50.925125] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-26T17:22:50.934799] [INFO ] [REMOTE ] AUB: Full fetch complete (65529 records). [2025-09-26T17:22:50.935024] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-09-26T17:22:51.157492] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-09-26T17:22:51.402256] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-09-26T17:22:51.402483] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-09-26T17:22:51.403613] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-09-26T17:22:51.403777] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-09-26T17:22:51.425345] [DEBUG] [LOCAL ] AUB: Trimmed 65529 records to 47072 (keeping 200 days of data) [2025-09-26T17:22:51.426159] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-26T17:22:51.737351] [DEBUG] [LOCAL ] AUB: Primary data saved (47072 records). [2025-09-26T17:22:51.737607] [INFO ] [MAIN ] AUB: Full history saved. [2025-09-26T17:22:51.737785] [INFO ] [MAIN ] Update Progress: 177/2371 symbols completed. AUB took 23.9s. Estimated remaining: 4h 42m 45s. Rate: 7.8 symbols/min [2025-09-26T17:22:51.930960] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:22:51.941227] [DEBUG] [LOCAL ] AVAL: Loaded 9011 existing records from primary storage. [2025-09-26T17:22:51.941359] [INFO ] [MAIN ] AVAL: Loaded 9011 existing records. [2025-09-26T17:22:51.962992] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-09-26T17:22:52.134424] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:22:52.134746] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-09-26T17:22:52.134805] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-09-26T17:22:52.135164] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-09-26T17:22:52.135227] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-09-26T17:22:52.522313] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:22:52.756783] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-09-26T17:22:53.322558] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-26T17:22:53.556790] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-12. [2025-09-26T17:22:54.357006] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-09-26T17:23:04.683243] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (11.93 seconds). [2025-09-26T17:23:04.685336] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-09-26T17:23:04.809175] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-12 (11.25 seconds). [2025-09-26T17:23:04.811477] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-09-26T17:23:05.421569] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (13.46 seconds). [2025-09-26T17:23:05.428997] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-09-26T17:23:05.947087] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-26T17:23:05.948956] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-09-26T17:23:06.408378] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (12.05 seconds). [2025-09-26T17:23:06.440174] [INFO ] [REMOTE ] AU: Full fetch complete (75883 records). [2025-09-26T17:23:06.442830] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-26T17:23:06.441993] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-09-26T17:23:06.447893] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-09-26T17:23:06.449724] [FATAL] [VALIDATOR ] AU: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:23:06.449860] [FATAL] [MAIN ] AU: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:23:06.449940] [WARN ] [MAIN ] AU: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:23:06.450112] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-09-26T17:23:06.450249] [DEBUG] [LOCAL ] AU: No primary data file found to delete. [2025-09-26T17:23:06.450507] [INFO ] [LOCAL ] AU: Starting deletion of derivative data. [2025-09-26T17:23:06.451313] [DEBUG] [LOCAL ] AU: Deleted derivative data file. [2025-09-26T17:23:06.451510] [INFO ] [MAIN ] Update Progress: 178/2371 symbols completed. AU took 45.9s. Estimated remaining: 4h 44m 4s. Rate: 7.7 symbols/min [2025-09-26T17:23:06.652744] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:23:06.676305] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-26T17:23:06.679239] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-09-26T17:23:06.723390] [DEBUG] [LOCAL ] AVB: Loaded 42140 existing records from primary storage. [2025-09-26T17:23:06.724191] [INFO ] [MAIN ] AVB: Loaded 42140 existing records. [2025-09-26T17:23:07.025069] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:23:07.025348] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-09-26T17:23:07.025405] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-09-26T17:23:07.026674] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-09-26T17:23:07.026738] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-09-26T17:23:07.145730] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-26T17:23:07.163498] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-09-26T17:23:07.479313] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:23:07.489710] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-12. [2025-09-26T17:23:07.490891] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-26T17:23:07.505416] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-09-26T17:23:07.532924] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-26T17:23:07.545128] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-09-26T17:23:08.007828] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-26T17:23:08.010697] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-09-26T17:23:08.238604] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-26T17:23:08.243043] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-09-26T17:23:08.368475] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-26T17:23:08.370247] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-09-26T17:23:08.716532] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-26T17:23:08.732782] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-09-26T17:23:08.733019] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-26T17:23:08.736045] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-09-26T17:23:08.819739] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-26T17:23:08.827841] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-09-26T17:23:08.839755] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-26T17:23:08.843700] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-09-26T17:23:09.385506] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-26T17:23:09.387563] [INFO ] [REMOTE ] AUNA: Full fetch complete (7633 records). [2025-09-26T17:23:09.387638] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-09-26T17:23:09.727948] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-26T17:23:09.747764] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-09-26T17:23:09.830187] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-09-26T17:23:09.830280] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-09-26T17:23:09.830531] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-09-26T17:23:09.830594] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-09-26T17:23:09.831155] [DEBUG] [LOCAL ] AUNA: Trimmed 7633 records to 4966 (keeping 200 days of data) [2025-09-26T17:23:09.863696] [DEBUG] [LOCAL ] AUNA: Primary data saved (4966 records). [2025-09-26T17:23:09.863852] [INFO ] [MAIN ] AUNA: Full history saved. [2025-09-26T17:23:09.863969] [INFO ] [MAIN ] Update Progress: 179/2371 symbols completed. AUNA took 33.6s. Estimated remaining: 4h 43m 2s. Rate: 7.7 symbols/min [2025-09-26T17:23:10.089810] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:23:10.090576] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-09-26T17:23:10.090715] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-09-26T17:23:10.091371] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-09-26T17:23:10.091618] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-26T17:23:10.091943] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-26T17:23:10.092500] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-09-26T17:23:10.249030] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-26T17:23:10.296999] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-09-26T17:23:10.425109] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-26T17:23:10.509119] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-09-26T17:23:10.661125] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:23:10.662219] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-26T17:23:11.156738] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-09-26T17:23:11.755319] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-26T17:23:11.845758] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-26T17:23:11.956747] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-09-26T17:23:12.011611] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-26T17:23:12.756768] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-09-26T17:23:12.969389] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:23:12.969735] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-09-26T17:23:13.419970] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-26T17:23:13.556727] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-01. [2025-09-26T17:23:13.782269] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:23:13.782598] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-01 [2025-09-26T17:23:14.356786] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-09-26T17:23:15.156760] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-09-26T17:23:15.956760] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-02. [2025-09-26T17:23:16.084874] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-26T17:23:16.129246] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-26T17:23:16.168681] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:23:16.169038] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-02 [2025-09-26T17:23:16.756760] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-09-26T17:23:17.556755] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-09-26T17:23:17.997230] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-26T17:23:18.077367] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-26T17:23:18.080227] [INFO ] [REMOTE ] AVAL: Full fetch complete (14645 records). [2025-09-26T17:23:18.080321] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-09-26T17:23:18.361991] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-03. [2025-09-26T17:23:18.511277] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-09-26T17:23:18.511357] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-09-26T17:23:18.511622] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-09-26T17:23:18.511694] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-09-26T17:23:18.512229] [DEBUG] [LOCAL ] AVAL: Trimmed 14645 records to 9040 (keeping 200 days of data) [2025-09-26T17:23:18.570342] [DEBUG] [LOCAL ] AVAL: Primary data saved (9040 records). [2025-09-26T17:23:18.570705] [INFO ] [MAIN ] AVAL: Full history saved. [2025-09-26T17:23:18.570832] [INFO ] [MAIN ] Update Progress: 180/2371 symbols completed. AVAL took 26.8s. Estimated remaining: 4h 43m 6s. Rate: 7.7 symbols/min [2025-09-26T17:23:18.668067] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:23:18.698524] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-03 [2025-09-26T17:23:18.783494] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:23:18.806795] [DEBUG] [LOCAL ] AVD: Loaded 22939 existing records from primary storage. [2025-09-26T17:23:18.806964] [INFO ] [MAIN ] AVD: Loaded 22939 existing records. [2025-09-26T17:23:19.061582] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:23:19.061866] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-09-26T17:23:19.061917] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-09-26T17:23:19.062928] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-09-26T17:23:19.062993] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-09-26T17:23:19.161881] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-09-26T17:23:19.538829] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:23:19.956747] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-12. [2025-09-26T17:23:20.668949] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-26T17:23:20.756769] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-09-26T17:23:21.425464] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-26T17:23:21.556732] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-04. [2025-09-26T17:23:21.764313] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:23:21.764688] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-04 [2025-09-26T17:23:22.145286] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-26T17:23:22.356753] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-09-26T17:23:23.156763] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-09-26T17:23:23.284356] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-26T17:23:23.956734] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-09-26T17:23:24.479967] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-26T17:23:24.488112] [INFO ] [REMOTE ] AVA: Full fetch complete (55713 records). [2025-09-26T17:23:24.488281] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-09-26T17:23:24.767144] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-09-26T17:23:24.947308] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-09-26T17:23:24.947445] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-09-26T17:23:24.948725] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-09-26T17:23:24.948834] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-09-26T17:23:24.950295] [DEBUG] [LOCAL ] AVA: Trimmed 55713 records to 40183 (keeping 200 days of data) [2025-09-26T17:23:25.202421] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-26T17:23:25.243618] [DEBUG] [LOCAL ] AVA: Primary data saved (40183 records). [2025-09-26T17:23:25.243786] [INFO ] [MAIN ] AVA: Full history saved. [2025-09-26T17:23:25.244838] [INFO ] [MAIN ] Update Progress: 181/2371 symbols completed. AVA took 38.8s. Estimated remaining: 4h 42m 46s. Rate: 7.7 symbols/min [2025-09-26T17:23:25.468017] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:23:25.493683] [DEBUG] [LOCAL ] AVK: Loaded 17966 existing records from primary storage. [2025-09-26T17:23:25.493839] [INFO ] [MAIN ] AVK: Loaded 17966 existing records. [2025-09-26T17:23:25.561922] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-05. [2025-09-26T17:23:25.746623] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:23:25.747026] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-09-26T17:23:25.747113] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-09-26T17:23:25.747858] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-09-26T17:23:25.747927] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-09-26T17:23:25.872100] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:23:25.897597] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-05 [2025-09-26T17:23:26.350530] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:23:26.361859] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-12. [2025-09-26T17:23:26.383091] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-26T17:23:27.156778] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-09-26T17:23:27.334947] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-26T17:23:27.956754] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-06. [2025-09-26T17:23:28.173282] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:23:28.173625] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-06 [2025-09-26T17:23:28.451240] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-26T17:23:28.756759] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-09-26T17:23:29.556731] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-07. [2025-09-26T17:23:29.628208] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-26T17:23:29.757202] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:23:29.757548] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-07 [2025-09-26T17:23:30.356753] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-08. [2025-09-26T17:23:31.156806] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-09-26T17:23:31.737971] [INFO ] [REMOTE ] AVBC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-26T17:23:31.956718] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-09. [2025-09-26T17:23:32.079909] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-26T17:23:32.756712] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-09-26T17:23:32.897384] [INFO ] [REMOTE ] AVBC: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-26T17:23:32.900503] [INFO ] [REMOTE ] AVBC: Full fetch complete (4719 records). [2025-09-26T17:23:32.900606] [DEBUG] [VALIDATOR ] AVBC: Validating primary data. [2025-09-26T17:23:33.107734] [WARN ] [VALIDATOR ] AVBC: Validation failed - insufficient historical data. Have 40 unique days, need 200 days [2025-09-26T17:23:33.107977] [FATAL] [MAIN ] AVBC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:23:33.108049] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:23:33.108125] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-26T17:23:33.108195] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-26T17:23:33.108232] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-09-26T17:23:33.108308] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-09-26T17:23:33.108394] [INFO ] [MAIN ] Update Progress: 182/2371 symbols completed. AVBC took 23.2s. Estimated remaining: 4h 42m 39s. Rate: 7.7 symbols/min [2025-09-26T17:23:33.299931] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:23:33.348555] [DEBUG] [LOCAL ] AVNS: Loaded 33862 existing records from primary storage. [2025-09-26T17:23:33.348757] [INFO ] [MAIN ] AVNS: Loaded 33862 existing records. [2025-09-26T17:23:33.549782] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:23:33.550221] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-09-26T17:23:33.550308] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-09-26T17:23:33.551417] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-09-26T17:23:33.551485] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-09-26T17:23:33.563399] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-09-26T17:23:33.913838] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-26T17:23:33.996745] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:23:34.356731] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-09-26T17:23:35.163060] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-09-26T17:23:35.182098] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-26T17:23:35.235857] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-26T17:23:35.956718] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-09-26T17:23:36.113581] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-26T17:23:36.674798] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-26T17:23:36.756720] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-12. [2025-09-26T17:23:37.556743] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-09-26T17:23:37.706843] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-26T17:23:38.356728] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-09-26T17:23:38.743023] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-26T17:23:39.156780] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-09-26T17:23:39.633152] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-26T17:23:39.956801] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-09-26T17:23:40.541244] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-26T17:23:40.550387] [INFO ] [REMOTE ] AVB: Full fetch complete (58415 records). [2025-09-26T17:23:40.550523] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-09-26T17:23:40.761548] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-09-26T17:23:40.927173] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-26T17:23:41.027966] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-09-26T17:23:41.028079] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-09-26T17:23:41.028759] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-09-26T17:23:41.028840] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-09-26T17:23:41.030350] [DEBUG] [LOCAL ] AVB: Trimmed 58415 records to 42457 (keeping 200 days of data) [2025-09-26T17:23:41.315575] [DEBUG] [LOCAL ] AVB: Primary data saved (42457 records). [2025-09-26T17:23:41.315764] [INFO ] [MAIN ] AVB: Full history saved. [2025-09-26T17:23:41.315896] [INFO ] [MAIN ] Update Progress: 183/2371 symbols completed. AVB took 34.9s. Estimated remaining: 4h 42m 37s. Rate: 7.7 symbols/min [2025-09-26T17:23:41.509864] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:23:41.554780] [DEBUG] [LOCAL ] AVNT: Loaded 39555 existing records from primary storage. [2025-09-26T17:23:41.555001] [INFO ] [MAIN ] AVNT: Loaded 39555 existing records. [2025-09-26T17:23:41.567151] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-09-26T17:23:41.786746] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:23:41.787399] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-09-26T17:23:41.787473] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-09-26T17:23:41.789771] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-09-26T17:23:41.789836] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-09-26T17:23:42.231188] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-26T17:23:42.244207] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:23:42.341244] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-26T17:23:42.356696] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-09-26T17:23:43.156696] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-09-26T17:23:43.474606] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-26T17:23:43.862436] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-26T17:23:43.956770] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-09-26T17:23:44.756766] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-09-26T17:23:45.039504] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-26T17:23:45.556744] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-09-26T17:23:45.832193] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-26T17:23:46.356721] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-09-26T17:23:46.682200] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-26T17:23:46.686537] [INFO ] [REMOTE ] AVK: Full fetch complete (26501 records). [2025-09-26T17:23:46.686717] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-09-26T17:23:47.076015] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-09-26T17:23:47.076104] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-09-26T17:23:47.076487] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-09-26T17:23:47.076584] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-09-26T17:23:47.077580] [DEBUG] [LOCAL ] AVK: Trimmed 26501 records to 18064 (keeping 200 days of data) [2025-09-26T17:23:47.158723] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-12. [2025-09-26T17:23:47.193363] [DEBUG] [LOCAL ] AVK: Primary data saved (18064 records). [2025-09-26T17:23:47.193519] [INFO ] [MAIN ] AVK: Full history saved. [2025-09-26T17:23:47.193615] [INFO ] [MAIN ] Update Progress: 184/2371 symbols completed. AVK took 21.9s. Estimated remaining: 4h 42m 7s. Rate: 7.8 symbols/min [2025-09-26T17:23:47.375015] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:23:47.375158] [DEBUG] [LOCAL ] AVTR: No existing data file found in primary storage. [2025-09-26T17:23:47.375195] [WARN ] [MAIN ] AVTR: No existing data found, performing full refresh instead. [2025-09-26T17:23:47.375343] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-09-26T17:23:47.375388] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-09-26T17:23:47.375430] [DEBUG] [LOCAL ] AVTR: No primary data file found to delete. [2025-09-26T17:23:47.375462] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-09-26T17:23:47.770243] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:23:47.793848] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-26T17:23:47.956758] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-12. [2025-09-26T17:23:48.268954] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-26T17:23:48.756726] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-09-26T17:23:49.556719] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-09-26T17:23:49.704448] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-26T17:23:50.257987] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-26T17:23:50.356794] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-09-26T17:23:51.043145] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T17:23:51.156788] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-09-26T17:23:51.893264] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-26T17:23:51.956757] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-09-26T17:23:52.484076] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-26T17:23:52.756748] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-09-26T17:23:53.222351] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-26T17:23:53.556734] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-09-26T17:23:53.821786] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-26T17:23:54.356740] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-09-26T17:23:54.596857] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-26T17:23:55.156825] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-09-26T17:23:55.465202] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-26T17:23:55.956815] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-09-26T17:23:56.644525] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-26T17:23:56.756771] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-09-26T17:23:57.561870] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-09-26T17:23:57.588298] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-26T17:23:57.698734] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-26T17:23:58.356740] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-09-26T17:23:58.885031] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-26T17:23:58.893166] [INFO ] [REMOTE ] AVNS: Full fetch complete (48077 records). [2025-09-26T17:23:58.893412] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-09-26T17:23:59.161836] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-09-26T17:23:59.345209] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-09-26T17:23:59.345467] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-09-26T17:23:59.346384] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-09-26T17:23:59.346531] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-09-26T17:23:59.365517] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-26T17:23:59.371450] [DEBUG] [LOCAL ] AVNS: Trimmed 48077 records to 34132 (keeping 200 days of data) [2025-09-26T17:23:59.588413] [DEBUG] [LOCAL ] AVNS: Primary data saved (34132 records). [2025-09-26T17:23:59.588799] [INFO ] [MAIN ] AVNS: Full history saved. [2025-09-26T17:23:59.591513] [INFO ] [MAIN ] Update Progress: 185/2371 symbols completed. AVNS took 26.5s. Estimated remaining: 4h 42m 54s. Rate: 7.7 symbols/min [2025-09-26T17:23:59.777129] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:23:59.777321] [DEBUG] [LOCAL ] AVY: No existing data file found in primary storage. [2025-09-26T17:23:59.777360] [WARN ] [MAIN ] AVY: No existing data found, performing full refresh instead. [2025-09-26T17:23:59.777520] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-09-26T17:23:59.777563] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-09-26T17:23:59.777604] [DEBUG] [LOCAL ] AVY: No primary data file found to delete. [2025-09-26T17:23:59.777637] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-09-26T17:23:59.962323] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-09-26T17:24:00.174922] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:24:00.756718] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-09-26T17:24:01.072138] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-26T17:24:01.479483] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T17:24:01.556760] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-12. [2025-09-26T17:24:01.672300] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-26T17:24:01.679027] [INFO ] [REMOTE ] AVD: Full fetch complete (33821 records). [2025-09-26T17:24:01.679222] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-09-26T17:24:02.105133] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-09-26T17:24:02.105233] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-09-26T17:24:02.105761] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-09-26T17:24:02.105829] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-09-26T17:24:02.107131] [DEBUG] [LOCAL ] AVD: Trimmed 33821 records to 23030 (keeping 200 days of data) [2025-09-26T17:24:02.237927] [DEBUG] [LOCAL ] AVD: Primary data saved (23030 records). [2025-09-26T17:24:02.238154] [INFO ] [MAIN ] AVD: Full history saved. [2025-09-26T17:24:02.238266] [INFO ] [MAIN ] Update Progress: 186/2371 symbols completed. AVD took 43.7s. Estimated remaining: 4h 41m 46s. Rate: 7.8 symbols/min [2025-09-26T17:24:02.361883] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-09-26T17:24:02.431986] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:24:02.459511] [DEBUG] [LOCAL ] AWF: Loaded 24455 existing records from primary storage. [2025-09-26T17:24:02.459695] [INFO ] [MAIN ] AWF: Loaded 24455 existing records. [2025-09-26T17:24:02.692000] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:24:02.692430] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-09-26T17:24:02.692584] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-09-26T17:24:02.693465] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-09-26T17:24:02.693530] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-09-26T17:24:03.104841] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:24:03.131701] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-26T17:24:03.156722] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-09-26T17:24:03.648765] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-26T17:24:03.956748] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-09-26T17:24:04.410304] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-26T17:24:04.756772] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-09-26T17:24:05.021355] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-26T17:24:05.556733] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-09-26T17:24:05.840269] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-26T17:24:06.356755] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-09-26T17:24:06.772818] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-26T17:24:07.156780] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-09-26T17:24:07.956738] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-12. [2025-09-26T17:24:08.151986] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-26T17:24:08.625896] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-26T17:24:08.756734] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-09-26T17:24:09.155226] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-26T17:24:09.556916] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-09-26T17:24:09.941866] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-26T17:24:09.949957] [INFO ] [REMOTE ] AVNT: Full fetch complete (56217 records). [2025-09-26T17:24:09.950110] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-09-26T17:24:10.365566] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-09-26T17:24:10.452097] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-09-26T17:24:10.452222] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-09-26T17:24:10.452861] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-09-26T17:24:10.452930] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-09-26T17:24:10.454289] [DEBUG] [LOCAL ] AVNT: Trimmed 56217 records to 39887 (keeping 200 days of data) [2025-09-26T17:24:10.704755] [DEBUG] [LOCAL ] AVNT: Primary data saved (39887 records). [2025-09-26T17:24:10.704940] [INFO ] [MAIN ] AVNT: Full history saved. [2025-09-26T17:24:10.705051] [INFO ] [MAIN ] Update Progress: 187/2371 symbols completed. AVNT took 29.4s. Estimated remaining: 4h 41m 47s. Rate: 7.8 symbols/min [2025-09-26T17:24:10.903542] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:24:10.953623] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-26T17:24:10.977101] [DEBUG] [LOCAL ] AWI: Loaded 26071 existing records from primary storage. [2025-09-26T17:24:10.977264] [INFO ] [MAIN ] AWI: Loaded 26071 existing records. [2025-09-26T17:24:11.162068] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-09-26T17:24:11.187979] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:24:11.189341] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-09-26T17:24:11.189395] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-09-26T17:24:11.190586] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-09-26T17:24:11.190708] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-09-26T17:24:11.613722] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:24:11.706361] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-26T17:24:11.956747] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-09-26T17:24:12.756732] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-09-26T17:24:12.851173] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-26T17:24:13.047830] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-26T17:24:13.556742] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-09-26T17:24:14.264443] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-26T17:24:14.356770] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-09-26T17:24:14.652000] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-26T17:24:15.156772] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-12. [2025-09-26T17:24:15.512466] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-26T17:24:15.956767] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-09-26T17:24:16.008714] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-26T17:24:16.756769] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-09-26T17:24:17.489178] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-26T17:24:17.556723] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-09-26T17:24:18.078873] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-26T17:24:18.356780] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-09-26T17:24:18.621311] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-26T17:24:19.156815] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-09-26T17:24:19.281929] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-26T17:24:19.956790] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-09-26T17:24:20.756721] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-09-26T17:24:20.967613] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-26T17:24:20.979818] [INFO ] [REMOTE ] AVY: Full fetch complete (55939 records). [2025-09-26T17:24:20.980069] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-09-26T17:24:20.982228] [FATAL] [VALIDATOR ] AVY: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:24:20.982386] [FATAL] [MAIN ] AVY: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:24:20.982492] [WARN ] [MAIN ] AVY: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:24:20.982606] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-09-26T17:24:20.982724] [DEBUG] [LOCAL ] AVY: No primary data file found to delete. [2025-09-26T17:24:20.982797] [INFO ] [LOCAL ] AVY: Starting deletion of derivative data. [2025-09-26T17:24:20.982883] [DEBUG] [LOCAL ] AVY: No derivative data file found to delete. [2025-09-26T17:24:20.983025] [INFO ] [MAIN ] Update Progress: 188/2371 symbols completed. AVY took 21.4s. Estimated remaining: 4h 42m 9s. Rate: 7.7 symbols/min [2025-09-26T17:24:21.239921] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:24:21.317104] [DEBUG] [LOCAL ] AWK: Loaded 49161 existing records from primary storage. [2025-09-26T17:24:21.317323] [INFO ] [MAIN ] AWK: Loaded 49161 existing records. [2025-09-26T17:24:21.562942] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-09-26T17:24:21.589708] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:24:21.590517] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-09-26T17:24:21.590636] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-09-26T17:24:21.592478] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-09-26T17:24:21.592546] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-09-26T17:24:21.943612] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-26T17:24:22.101006] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-26T17:24:22.108351] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:24:22.356781] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-09-26T17:24:22.927195] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-26T17:24:23.156772] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-09-26T17:24:23.956774] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-09-26T17:24:24.188432] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-26T17:24:24.302736] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-26T17:24:24.756762] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-12. [2025-09-26T17:24:24.949682] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-26T17:24:25.556733] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-09-26T17:24:26.158983] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T17:24:26.356769] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-09-26T17:24:27.114895] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-26T17:24:27.156759] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-09-26T17:24:27.956746] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-09-26T17:24:28.149421] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-26T17:24:28.160757] [INFO ] [REMOTE ] AVTR: Full fetch complete (77442 records). [2025-09-26T17:24:28.160948] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-09-26T17:24:28.619705] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-09-26T17:24:28.619928] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-09-26T17:24:28.620975] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-09-26T17:24:28.621081] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-09-26T17:24:28.634296] [DEBUG] [LOCAL ] AVTR: Trimmed 77442 records to 54345 (keeping 200 days of data) [2025-09-26T17:24:28.656727] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-26T17:24:28.733466] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-26T17:24:28.776439] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-09-26T17:24:29.038056] [DEBUG] [LOCAL ] AVTR: Primary data saved (54345 records). [2025-09-26T17:24:29.038220] [INFO ] [MAIN ] AVTR: Full history saved. [2025-09-26T17:24:29.038305] [INFO ] [MAIN ] Update Progress: 189/2371 symbols completed. AVTR took 41.8s. Estimated remaining: 4h 42m 5s. Rate: 7.7 symbols/min [2025-09-26T17:24:29.232748] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:24:29.255678] [DEBUG] [LOCAL ] AWP: Loaded 21735 existing records from primary storage. [2025-09-26T17:24:29.255823] [INFO ] [MAIN ] AWP: Loaded 21735 existing records. [2025-09-26T17:24:29.455410] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:24:29.455774] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-09-26T17:24:29.455828] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-09-26T17:24:29.456939] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-09-26T17:24:29.457001] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-09-26T17:24:29.561847] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-09-26T17:24:29.983661] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:24:30.000106] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-26T17:24:30.356739] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-09-26T17:24:30.858862] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-26T17:24:31.083329] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-26T17:24:31.156750] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-12. [2025-09-26T17:24:31.956729] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-09-26T17:24:32.376931] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-26T17:24:32.756756] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-09-26T17:24:33.137279] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-26T17:24:33.556723] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-09-26T17:24:33.646796] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-26T17:24:34.356778] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-09-26T17:24:35.101553] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T17:24:35.132545] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-26T17:24:35.156722] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-09-26T17:24:35.784407] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-26T17:24:35.956805] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-09-26T17:24:36.756794] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-09-26T17:24:36.916950] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-26T17:24:37.556793] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-09-26T17:24:38.318915] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-26T17:24:38.356774] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-09-26T17:24:38.882104] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-26T17:24:38.887482] [INFO ] [REMOTE ] AWI: Full fetch complete (35420 records). [2025-09-26T17:24:38.887675] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-09-26T17:24:39.166385] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-09-26T17:24:39.304025] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-09-26T17:24:39.304117] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-09-26T17:24:39.304638] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-09-26T17:24:39.304824] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-09-26T17:24:39.306049] [DEBUG] [LOCAL ] AWI: Trimmed 35420 records to 26185 (keeping 200 days of data) [2025-09-26T17:24:39.499166] [DEBUG] [LOCAL ] AWI: Primary data saved (26185 records). [2025-09-26T17:24:39.499318] [INFO ] [MAIN ] AWI: Full history saved. [2025-09-26T17:24:39.499414] [INFO ] [MAIN ] Update Progress: 190/2371 symbols completed. AWI took 28.8s. Estimated remaining: 4h 42m 28s. Rate: 7.7 symbols/min [2025-09-26T17:24:39.692579] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:24:39.710586] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-26T17:24:39.737374] [DEBUG] [LOCAL ] AWR: Loaded 22806 existing records from primary storage. [2025-09-26T17:24:39.737527] [INFO ] [MAIN ] AWR: Loaded 22806 existing records. [2025-09-26T17:24:39.943786] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:24:39.944070] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-09-26T17:24:39.944131] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-09-26T17:24:39.944918] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-09-26T17:24:39.944982] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-09-26T17:24:39.959989] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-09-26T17:24:40.398285] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:24:40.423224] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-26T17:24:40.756777] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-09-26T17:24:41.556737] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-12. [2025-09-26T17:24:41.678919] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-26T17:24:41.757142] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-26T17:24:41.765510] [INFO ] [REMOTE ] AWF: Full fetch complete (35960 records). [2025-09-26T17:24:41.765730] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-09-26T17:24:42.215263] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-09-26T17:24:42.215374] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-09-26T17:24:42.215912] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-09-26T17:24:42.215979] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-09-26T17:24:42.217294] [DEBUG] [LOCAL ] AWF: Trimmed 35960 records to 24608 (keeping 200 days of data) [2025-09-26T17:24:42.358513] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-09-26T17:24:42.372119] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-26T17:24:42.422683] [DEBUG] [LOCAL ] AWF: Primary data saved (24608 records). [2025-09-26T17:24:42.422840] [INFO ] [MAIN ] AWF: Full history saved. [2025-09-26T17:24:42.422964] [INFO ] [MAIN ] Update Progress: 191/2371 symbols completed. AWF took 40.2s. Estimated remaining: 4h 41m 25s. Rate: 7.7 symbols/min [2025-09-26T17:24:42.627357] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:24:42.657845] [DEBUG] [LOCAL ] AX: Loaded 28738 existing records from primary storage. [2025-09-26T17:24:42.658004] [INFO ] [MAIN ] AX: Loaded 28738 existing records. [2025-09-26T17:24:42.865771] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:24:42.866040] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-09-26T17:24:42.866087] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-09-26T17:24:42.866945] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-09-26T17:24:42.867010] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-09-26T17:24:43.164585] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-09-26T17:24:43.332212] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:24:43.956719] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-09-26T17:24:44.164562] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-26T17:24:44.211386] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-26T17:24:44.756731] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-09-26T17:24:44.879484] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-26T17:24:45.556947] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-12. [2025-09-26T17:24:46.361839] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-09-26T17:24:46.374824] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-26T17:24:46.583739] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-26T17:24:47.156783] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-09-26T17:24:47.505153] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-26T17:24:47.956765] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-09-26T17:24:48.703567] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-26T17:24:48.756745] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-09-26T17:24:49.053191] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-26T17:24:49.556931] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-09-26T17:24:49.603339] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-26T17:24:50.356734] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-09-26T17:24:51.156716] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-09-26T17:24:51.271837] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-26T17:24:51.689304] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-26T17:24:51.956760] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-09-26T17:24:52.028698] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-26T17:24:52.756726] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-09-26T17:24:53.556695] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-09-26T17:24:53.660937] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-26T17:24:53.671463] [INFO ] [REMOTE ] AWK: Full fetch complete (70499 records). [2025-09-26T17:24:53.671611] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-09-26T17:24:54.151025] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-26T17:24:54.151269] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-09-26T17:24:54.157708] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-09-26T17:24:54.158859] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-09-26T17:24:54.158927] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-09-26T17:24:54.160730] [DEBUG] [LOCAL ] AWK: Trimmed 70499 records to 49489 (keeping 200 days of data) [2025-09-26T17:24:54.371107] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-09-26T17:24:54.453071] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-26T17:24:54.536211] [DEBUG] [LOCAL ] AWK: Primary data saved (49489 records). [2025-09-26T17:24:54.536357] [INFO ] [MAIN ] AWK: Full history saved. [2025-09-26T17:24:54.537311] [INFO ] [MAIN ] Update Progress: 192/2371 symbols completed. AWK took 33.6s. Estimated remaining: 4h 42m 7s. Rate: 7.7 symbols/min [2025-09-26T17:24:54.733176] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:24:54.791046] [DEBUG] [LOCAL ] AXL: Loaded 50863 existing records from primary storage. [2025-09-26T17:24:54.791203] [INFO ] [MAIN ] AXL: Loaded 50863 existing records. [2025-09-26T17:24:55.003102] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:24:55.003366] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-09-26T17:24:55.003415] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-09-26T17:24:55.004561] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-09-26T17:24:55.004635] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-09-26T17:24:55.161886] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-09-26T17:24:55.446978] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:24:55.830950] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-26T17:24:55.956754] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-09-26T17:24:56.070022] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-26T17:24:56.074668] [INFO ] [REMOTE ] AWP: Full fetch complete (32517 records). [2025-09-26T17:24:56.074775] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-09-26T17:24:56.485146] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-09-26T17:24:56.485279] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-09-26T17:24:56.485746] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-09-26T17:24:56.485812] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-09-26T17:24:56.486934] [DEBUG] [LOCAL ] AWP: Trimmed 32517 records to 21835 (keeping 200 days of data) [2025-09-26T17:24:56.630122] [DEBUG] [LOCAL ] AWP: Primary data saved (21835 records). [2025-09-26T17:24:56.630268] [INFO ] [MAIN ] AWP: Full history saved. [2025-09-26T17:24:56.630362] [INFO ] [MAIN ] Update Progress: 193/2371 symbols completed. AWP took 27.6s. Estimated remaining: 4h 40m 55s. Rate: 7.8 symbols/min [2025-09-26T17:24:56.758665] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-09-26T17:24:56.837984] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:24:56.838189] [DEBUG] [LOCAL ] AXP: No existing data file found in primary storage. [2025-09-26T17:24:56.838247] [WARN ] [MAIN ] AXP: No existing data found, performing full refresh instead. [2025-09-26T17:24:56.838401] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-09-26T17:24:56.838446] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-09-26T17:24:56.838489] [DEBUG] [LOCAL ] AXP: No primary data file found to delete. [2025-09-26T17:24:56.838560] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-09-26T17:24:57.261284] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:24:57.502351] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-26T17:24:57.556765] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-12. [2025-09-26T17:24:58.068805] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-26T17:24:58.356726] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-09-26T17:24:58.876697] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-26T17:24:59.156776] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-12. [2025-09-26T17:24:59.609411] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-26T17:24:59.956776] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-09-26T17:25:00.756773] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-09-26T17:25:00.796706] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-26T17:25:01.278803] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-26T17:25:01.556741] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-09-26T17:25:01.904074] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-26T17:25:02.356733] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-09-26T17:25:03.156749] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-09-26T17:25:03.837552] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-09-26T17:25:03.906299] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-26T17:25:03.956710] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-09-26T17:25:03.986184] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-26T17:25:04.756792] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-09-26T17:25:05.360944] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-26T17:25:05.550201] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-26T17:25:05.556732] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-09-26T17:25:06.356715] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-09-26T17:25:07.156732] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-09-26T17:25:07.851083] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-26T17:25:07.956789] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-09-26T17:25:08.202239] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-26T17:25:08.397839] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-26T17:25:08.756772] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-09-26T17:25:09.556740] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-09-26T17:25:10.077544] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-26T17:25:10.086491] [INFO ] [REMOTE ] AX: Full fetch complete (42679 records). [2025-09-26T17:25:10.086639] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-09-26T17:25:10.363232] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-09-26T17:25:10.511470] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-09-26T17:25:10.511728] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-09-26T17:25:10.512297] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-09-26T17:25:10.512384] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-09-26T17:25:10.513826] [DEBUG] [LOCAL ] AX: Trimmed 42679 records to 28929 (keeping 200 days of data) [2025-09-26T17:25:10.643837] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-09-26T17:25:10.743860] [DEBUG] [LOCAL ] AX: Primary data saved (28929 records). [2025-09-26T17:25:10.744033] [INFO ] [MAIN ] AX: Full history saved. [2025-09-26T17:25:10.744191] [INFO ] [MAIN ] Update Progress: 194/2371 symbols completed. AX took 28.3s. Estimated remaining: 4h 41m 59s. Rate: 7.7 symbols/min [2025-09-26T17:25:10.931003] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:25:10.949351] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-26T17:25:10.959185] [DEBUG] [LOCAL ] AXR: Loaded 3174 existing records from primary storage. [2025-09-26T17:25:10.959332] [INFO ] [MAIN ] AXR: Loaded 3174 existing records. [2025-09-26T17:25:11.162208] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-09-26T17:25:11.167440] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:25:11.168025] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-09-26T17:25:11.168705] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-09-26T17:25:11.169033] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-09-26T17:25:11.169095] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-09-26T17:25:11.585461] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:25:11.956778] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-09-26T17:25:12.334151] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-26T17:25:12.756780] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-12. [2025-09-26T17:25:13.045376] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-26T17:25:13.052180] [INFO ] [REMOTE ] AWR: Full fetch complete (31704 records). [2025-09-26T17:25:13.052363] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-09-26T17:25:13.053034] [FATAL] [VALIDATOR ] AWR: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:25:13.053142] [FATAL] [MAIN ] AWR: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:25:13.053215] [WARN ] [MAIN ] AWR: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:25:13.053315] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-09-26T17:25:13.053419] [DEBUG] [LOCAL ] AWR: No primary data file found to delete. [2025-09-26T17:25:13.053481] [INFO ] [LOCAL ] AWR: Starting deletion of derivative data. [2025-09-26T17:25:13.053939] [DEBUG] [LOCAL ] AWR: Deleted derivative data file. [2025-09-26T17:25:13.054057] [INFO ] [MAIN ] Update Progress: 195/2371 symbols completed. AWR took 33.6s. Estimated remaining: 4h 40m 50s. Rate: 7.7 symbols/min [2025-09-26T17:25:13.267156] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:25:13.306760] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-26T17:25:13.326927] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-26T17:25:13.357974] [DEBUG] [LOCAL ] AXS: Loaded 38615 existing records from primary storage. [2025-09-26T17:25:13.358139] [INFO ] [MAIN ] AXS: Loaded 38615 existing records. [2025-09-26T17:25:13.554853] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:25:13.555156] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-09-26T17:25:13.555218] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-09-26T17:25:13.556413] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-09-26T17:25:13.556478] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-09-26T17:25:13.561832] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-09-26T17:25:14.121531] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:25:14.356739] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-09-26T17:25:15.156767] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-09-26T17:25:15.279446] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T17:25:15.567351] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-26T17:25:15.956754] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-09-26T17:25:16.423397] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-26T17:25:16.490483] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-26T17:25:16.756732] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-09-26T17:25:17.556744] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-12. [2025-09-26T17:25:18.356711] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-09-26T17:25:18.939388] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-26T17:25:19.150978] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-26T17:25:19.159061] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-09-26T17:25:19.517319] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-26T17:25:19.940360] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-26T17:25:19.956698] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-09-26T17:25:20.756738] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-09-26T17:25:21.493088] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-26T17:25:21.491491] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-26T17:25:21.556734] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-09-26T17:25:22.050787] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-26T17:25:22.356717] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-09-26T17:25:22.765130] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-26T17:25:23.156743] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-09-26T17:25:23.956725] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-09-26T17:25:24.756739] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-09-26T17:25:24.948002] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-26T17:25:24.982360] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-26T17:25:25.556729] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-09-26T17:25:26.356730] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-09-26T17:25:26.806102] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-26T17:25:26.833924] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-26T17:25:26.999993] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-26T17:25:27.156764] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-09-26T17:25:27.749315] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-26T17:25:27.750797] [INFO ] [REMOTE ] AXR: Full fetch complete (5009 records). [2025-09-26T17:25:27.750963] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-09-26T17:25:27.970754] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-09-26T17:25:28.194868] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-09-26T17:25:28.194980] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-09-26T17:25:28.195213] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-09-26T17:25:28.195287] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-09-26T17:25:28.195876] [DEBUG] [LOCAL ] AXR: Trimmed 5009 records to 3220 (keeping 200 days of data) [2025-09-26T17:25:28.216111] [DEBUG] [LOCAL ] AXR: Primary data saved (3220 records). [2025-09-26T17:25:28.216279] [INFO ] [MAIN ] AXR: Full history saved. [2025-09-26T17:25:28.216410] [INFO ] [MAIN ] Update Progress: 196/2371 symbols completed. AXR took 17.5s. Estimated remaining: 4h 42m 4s. Rate: 7.7 symbols/min [2025-09-26T17:25:28.403824] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:25:28.459425] [DEBUG] [LOCAL ] AXTA: Loaded 52445 existing records from primary storage. [2025-09-26T17:25:28.459570] [INFO ] [MAIN ] AXTA: Loaded 52445 existing records. [2025-09-26T17:25:28.677917] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:25:28.678194] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-09-26T17:25:28.678257] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-09-26T17:25:28.679598] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-09-26T17:25:28.679871] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-09-26T17:25:28.761846] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-09-26T17:25:29.077272] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:25:29.479433] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-26T17:25:29.556917] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-09-26T17:25:30.356712] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-09-26T17:25:30.909967] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-26T17:25:31.023867] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-26T17:25:31.156767] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-12. [2025-09-26T17:25:31.647425] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-26T17:25:31.956766] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-09-26T17:25:32.756720] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-09-26T17:25:33.194438] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-26T17:25:33.249058] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-26T17:25:33.556746] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-09-26T17:25:34.273312] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-26T17:25:34.290713] [INFO ] [REMOTE ] AXL: Full fetch complete (72551 records). [2025-09-26T17:25:34.290937] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-09-26T17:25:34.366274] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-09-26T17:25:34.756009] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-09-26T17:25:34.756596] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-09-26T17:25:34.757609] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-09-26T17:25:34.757782] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-09-26T17:25:34.760885] [DEBUG] [LOCAL ] AXL: Trimmed 72551 records to 51239 (keeping 200 days of data) [2025-09-26T17:25:34.891809] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-26T17:25:35.142358] [DEBUG] [LOCAL ] AXL: Primary data saved (51239 records). [2025-09-26T17:25:35.142537] [INFO ] [MAIN ] AXL: Full history saved. [2025-09-26T17:25:35.143453] [INFO ] [MAIN ] Update Progress: 197/2371 symbols completed. AXL took 40.6s. Estimated remaining: 4h 41m 47s. Rate: 7.7 symbols/min [2025-09-26T17:25:35.156740] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-09-26T17:25:35.956796] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-09-26T17:25:36.252124] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-26T17:25:36.384637] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-26T17:25:36.395939] [INFO ] [REMOTE ] AXP: Full fetch complete (76898 records). [2025-09-26T17:25:36.396193] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-09-26T17:25:36.761885] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-09-26T17:25:36.910862] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-09-26T17:25:36.910995] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-09-26T17:25:36.911901] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-09-26T17:25:36.911977] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-09-26T17:25:36.914039] [DEBUG] [LOCAL ] AXP: Trimmed 76898 records to 53999 (keeping 200 days of data) [2025-09-26T17:25:37.223747] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-26T17:25:37.335238] [DEBUG] [LOCAL ] AXP: Primary data saved (53999 records). [2025-09-26T17:25:37.335406] [INFO ] [MAIN ] AXP: Full history saved. [2025-09-26T17:25:37.335495] [INFO ] [MAIN ] Update Progress: 198/2371 symbols completed. AXP took 40.7s. Estimated remaining: 4h 40m 38s. Rate: 7.7 symbols/min [2025-09-26T17:25:37.556854] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-09-26T17:25:37.991419] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-26T17:25:38.356715] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-09-26T17:25:38.890836] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-26T17:25:39.156772] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-09-26T17:25:39.685410] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-26T17:25:39.956759] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-09-26T17:25:40.593842] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-26T17:25:40.756736] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-09-26T17:25:41.052865] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-26T17:25:41.556737] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-09-26T17:25:42.314283] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-26T17:25:42.356750] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-09-26T17:25:42.768985] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-26T17:25:42.777345] [INFO ] [REMOTE ] AXS: Full fetch complete (55561 records). [2025-09-26T17:25:42.777508] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-09-26T17:25:43.189542] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-09-26T17:25:43.189662] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-09-26T17:25:43.190556] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-09-26T17:25:43.190605] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-09-26T17:25:43.191947] [DEBUG] [LOCAL ] AXS: Trimmed 55561 records to 38920 (keeping 200 days of data) [2025-09-26T17:25:43.434455] [DEBUG] [LOCAL ] AXS: Primary data saved (38920 records). [2025-09-26T17:25:43.434630] [INFO ] [MAIN ] AXS: Full history saved. [2025-09-26T17:25:43.434762] [INFO ] [MAIN ] Update Progress: 199/2371 symbols completed. AXS took 30.4s. Estimated remaining: 4h 40m 12s. Rate: 7.8 symbols/min [2025-09-26T17:25:43.868527] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-26T17:25:43.879873] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-09-26T17:25:45.595625] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-26T17:25:45.608148] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-09-26T17:25:47.248477] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-26T17:25:47.260422] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-09-26T17:25:48.868364] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-26T17:25:48.879742] [INFO ] [REMOTE ] AXTA: Full fetch complete (74910 records). [2025-09-26T17:25:48.879957] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-09-26T17:25:49.321051] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-09-26T17:25:49.321147] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-09-26T17:25:49.321908] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-09-26T17:25:49.321980] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-09-26T17:25:49.323541] [DEBUG] [LOCAL ] AXTA: Trimmed 74910 records to 52835 (keeping 200 days of data) [2025-09-26T17:25:49.646749] [DEBUG] [LOCAL ] AXTA: Primary data saved (52835 records). [2025-09-26T17:25:49.646948] [INFO ] [MAIN ] AXTA: Full history saved. [2025-09-26T17:25:49.647112] [INFO ] [MAIN ] Update Progress: 200/2371 symbols completed. AXTA took 21.4s. Estimated remaining: 4h 39m 48s. Rate: 7.8 symbols/min [2025-09-26T17:25:50.273421] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:25:50.367421] [DEBUG] [LOCAL ] AZZ: No existing data file found in primary storage. [2025-09-26T17:25:50.362219] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:25:50.403030] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:25:50.393775] [WARN ] [MAIN ] AZZ: No existing data found, performing full refresh instead. [2025-09-26T17:25:50.441731] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-09-26T17:25:50.463821] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:25:50.463911] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-09-26T17:25:50.464318] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-09-26T17:25:50.464399] [DEBUG] [LOCAL ] AZZ: No primary data file found to delete. [2025-09-26T17:25:50.464495] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-09-26T17:25:50.464765] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-09-26T17:25:50.464833] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-26T17:25:50.464889] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-26T17:25:50.464949] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-09-26T17:25:50.464563] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-09-26T17:25:50.629160] [DEBUG] [LOCAL ] AZO: Loaded 11599 existing records from primary storage. [2025-09-26T17:25:50.686051] [INFO ] [MAIN ] AZO: Loaded 11599 existing records. [2025-09-26T17:25:50.709114] [DEBUG] [LOCAL ] AYI: Loaded 25307 existing records from primary storage. [2025-09-26T17:25:50.767254] [INFO ] [MAIN ] AYI: Loaded 25307 existing records. [2025-09-26T17:25:51.518018] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:25:51.671888] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:25:51.671710] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-09-26T17:25:51.677833] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-09-26T17:25:51.739247] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:25:51.744430] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-09-26T17:25:51.724899] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-09-26T17:25:51.762425] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-09-26T17:25:51.762028] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-09-26T17:25:51.767805] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-09-26T17:25:51.803749] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-09-26T17:25:51.811679] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:25:51.819575] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-12. [2025-09-26T17:25:51.818953] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-09-26T17:25:52.574616] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:25:52.597812] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-12. [2025-09-26T17:25:52.637908] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:25:52.638278] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-12. [2025-09-26T17:25:53.084552] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-26T17:25:53.089052] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-09-26T17:25:53.244332] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-26T17:25:53.251515] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-09-26T17:25:53.405555] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-26T17:25:53.409493] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-09-26T17:25:53.845871] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-26T17:25:53.850955] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-09-26T17:25:53.935596] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-26T17:25:53.941359] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-09-26T17:25:54.219719] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-26T17:25:54.225926] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-09-26T17:25:54.258419] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-26T17:25:54.261327] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-09-26T17:25:54.617391] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:25:54.617768] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-09-26T17:25:54.618285] [INFO ] [REMOTE ] B: Fetching primary data for 2025-03. [2025-09-26T17:25:54.685465] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-26T17:25:54.789514] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-26T17:25:54.828235] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:25:54.828923] [WARN ] [REMOTE ] B: No data returned for month 2025-03 [2025-09-26T17:25:55.156755] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-09-26T17:25:55.374743] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-26T17:25:55.956727] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-09-26T17:25:56.039495] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-26T17:25:56.756744] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-09-26T17:25:56.889345] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-26T17:25:57.556726] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-09-26T17:25:57.978889] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-26T17:25:58.356719] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-09-26T17:25:58.831726] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-26T17:25:59.108102] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-26T17:25:59.156680] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-09-26T17:25:59.956735] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-09-26T17:26:00.547249] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-26T17:26:00.756747] [INFO ] [REMOTE ] B: Fetching primary data for 2025-04. [2025-09-26T17:26:00.895168] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-26T17:26:00.994834] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:26:00.995172] [WARN ] [REMOTE ] B: No data returned for month 2025-04 [2025-09-26T17:26:01.556750] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-09-26T17:26:02.298083] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-26T17:26:02.356681] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-09-26T17:26:03.156824] [INFO ] [REMOTE ] B: Fetching primary data for 2025-05. [2025-09-26T17:26:03.794220] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-26T17:26:03.956747] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-09-26T17:26:04.771992] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-09-26T17:26:04.776450] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-26T17:26:05.214118] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-26T17:26:05.556740] [INFO ] [REMOTE ] B: Fetching primary data for 2025-06. [2025-09-26T17:26:05.707636] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-26T17:26:06.356716] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-09-26T17:26:07.156722] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-09-26T17:26:07.341195] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-26T17:26:07.956728] [INFO ] [REMOTE ] B: Fetching primary data for 2025-07. [2025-09-26T17:26:08.053999] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-26T17:26:08.116716] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-26T17:26:08.121184] [INFO ] [REMOTE ] AZZ: Full fetch complete (30859 records). [2025-09-26T17:26:08.121331] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-09-26T17:26:08.536436] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-09-26T17:26:08.536547] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-09-26T17:26:08.537014] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-09-26T17:26:08.537125] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-09-26T17:26:08.538088] [DEBUG] [LOCAL ] AZZ: Trimmed 30859 records to 22359 (keeping 200 days of data) [2025-09-26T17:26:08.679713] [DEBUG] [LOCAL ] AZZ: Primary data saved (22359 records). [2025-09-26T17:26:08.679854] [INFO ] [MAIN ] AZZ: Full history saved. [2025-09-26T17:26:08.679935] [INFO ] [MAIN ] Update Progress: 201/2371 symbols completed. AZZ took 19.0s. Estimated remaining: 4h 41m 42s. Rate: 7.7 symbols/min [2025-09-26T17:26:08.763739] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-09-26T17:26:08.878220] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:26:08.934104] [DEBUG] [LOCAL ] BA: Loaded 54181 existing records from primary storage. [2025-09-26T17:26:08.934256] [INFO ] [MAIN ] BA: Loaded 54181 existing records. [2025-09-26T17:26:09.132916] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:26:09.133174] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-09-26T17:26:09.133222] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-09-26T17:26:09.134721] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-09-26T17:26:09.134792] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-09-26T17:26:09.522822] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:26:09.532338] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-26T17:26:09.556737] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-09-26T17:26:10.026812] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-26T17:26:10.356772] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-09-26T17:26:10.659312] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-26T17:26:11.156717] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-12. [2025-09-26T17:26:11.243497] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-26T17:26:11.956753] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-09-26T17:26:12.756730] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-09-26T17:26:13.348798] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-26T17:26:13.497136] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-09-26T17:26:13.518842] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-26T17:26:13.556733] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-09-26T17:26:14.356734] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-09-26T17:26:15.156730] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-09-26T17:26:15.235317] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-26T17:26:15.831741] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-09-26T17:26:15.956725] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-09-26T17:26:16.121475] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-26T17:26:16.124496] [INFO ] [REMOTE ] AZO: Full fetch complete (16385 records). [2025-09-26T17:26:16.124604] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-09-26T17:26:16.589516] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-09-26T17:26:16.589605] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-09-26T17:26:16.590093] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-09-26T17:26:16.590160] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-09-26T17:26:16.590959] [DEBUG] [LOCAL ] AZO: Trimmed 16385 records to 11687 (keeping 200 days of data) [2025-09-26T17:26:16.677496] [DEBUG] [LOCAL ] AZO: Primary data saved (11687 records). [2025-09-26T17:26:16.677711] [INFO ] [MAIN ] AZO: Full history saved. [2025-09-26T17:26:16.677845] [INFO ] [MAIN ] Update Progress: 202/2371 symbols completed. AZO took 27.0s. Estimated remaining: 4h 41m 37s. Rate: 7.7 symbols/min [2025-09-26T17:26:16.765403] [INFO ] [REMOTE ] B: Fetching primary data for 2025-08. [2025-09-26T17:26:16.872097] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:26:16.944427] [DEBUG] [LOCAL ] BABA: Loaded 54210 existing records from primary storage. [2025-09-26T17:26:16.944582] [INFO ] [MAIN ] BABA: Loaded 54210 existing records. [2025-09-26T17:26:17.139804] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:26:17.140104] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-09-26T17:26:17.140162] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-09-26T17:26:17.142293] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-09-26T17:26:17.142359] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-09-26T17:26:17.555191] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:26:17.556666] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-12. [2025-09-26T17:26:18.148106] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-26T17:26:18.356734] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-09-26T17:26:18.752775] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-26T17:26:19.156716] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-09-26T17:26:19.192022] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-26T17:26:19.814349] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-09-26T17:26:19.956725] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-09-26T17:26:20.756728] [INFO ] [REMOTE ] B: Fetching primary data for 2025-09. [2025-09-26T17:26:21.306152] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-26T17:26:21.556725] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-09-26T17:26:22.151805] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-09-26T17:26:22.356720] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-09-26T17:26:22.791736] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-26T17:26:22.802541] [INFO ] [REMOTE ] B: Full fetch complete (45487 records). [2025-09-26T17:26:22.802730] [DEBUG] [VALIDATOR ] B: Validating primary data. [2025-09-26T17:26:23.011028] [WARN ] [VALIDATOR ] B: Validation failed - insufficient historical data. Have 128 unique days, need 200 days [2025-09-26T17:26:23.011707] [FATAL] [MAIN ] B: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:26:23.011787] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:26:23.011845] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-26T17:26:23.011931] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-26T17:26:23.011991] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-09-26T17:26:23.012066] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-09-26T17:26:23.012163] [INFO ] [MAIN ] Update Progress: 203/2371 symbols completed. B took 33.4s. Estimated remaining: 4h 41m 13s. Rate: 7.7 symbols/min [2025-09-26T17:26:23.161927] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-09-26T17:26:23.240680] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:26:23.322469] [DEBUG] [LOCAL ] BAC: Loaded 54198 existing records from primary storage. [2025-09-26T17:26:23.322702] [INFO ] [MAIN ] BAC: Loaded 54198 existing records. [2025-09-26T17:26:23.553110] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:26:23.553496] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-09-26T17:26:23.553557] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-09-26T17:26:23.555310] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-09-26T17:26:23.555382] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-09-26T17:26:23.939754] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:26:23.964260] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-12. [2025-09-26T17:26:23.992912] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-26T17:26:24.057915] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-26T17:26:24.065639] [INFO ] [REMOTE ] AYI: Full fetch complete (36526 records). [2025-09-26T17:26:24.065840] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-09-26T17:26:24.067708] [FATAL] [VALIDATOR ] AYI: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:26:24.067825] [FATAL] [MAIN ] AYI: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:26:24.067895] [WARN ] [MAIN ] AYI: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:26:24.067991] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-09-26T17:26:24.068111] [DEBUG] [LOCAL ] AYI: No primary data file found to delete. [2025-09-26T17:26:24.068192] [INFO ] [LOCAL ] AYI: Starting deletion of derivative data. [2025-09-26T17:26:24.068696] [DEBUG] [LOCAL ] AYI: Deleted derivative data file. [2025-09-26T17:26:24.068868] [INFO ] [MAIN ] Update Progress: 204/2371 symbols completed. AYI took 34.4s. Estimated remaining: 4h 39m 54s. Rate: 7.7 symbols/min [2025-09-26T17:26:24.274816] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:26:24.358734] [DEBUG] [LOCAL ] BAH: Loaded 52108 existing records from primary storage. [2025-09-26T17:26:24.358963] [INFO ] [MAIN ] BAH: Loaded 52108 existing records. [2025-09-26T17:26:24.563757] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:26:24.564196] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-09-26T17:26:24.564268] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-09-26T17:26:24.566129] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-09-26T17:26:24.566239] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-09-26T17:26:24.780909] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-09-26T17:26:24.902539] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.55 seconds). [2025-09-26T17:26:25.046920] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:26:25.556720] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-09-26T17:26:25.972680] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-26T17:26:26.356724] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-09-26T17:26:27.138354] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-26T17:26:27.156674] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-09-26T17:26:27.550253] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-26T17:26:27.956795] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-12. [2025-09-26T17:26:28.476739] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-26T17:26:28.756751] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-09-26T17:26:29.403506] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-26T17:26:29.445935] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-26T17:26:29.556740] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-09-26T17:26:30.356732] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-09-26T17:26:30.809367] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-26T17:26:31.156773] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-09-26T17:26:31.960141] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-09-26T17:26:31.974382] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-09-26T17:26:32.756732] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-09-26T17:26:33.143253] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.79 seconds). [2025-09-26T17:26:33.556705] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-09-26T17:26:33.735807] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-09-26T17:26:33.779558] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-26T17:26:34.356719] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-09-26T17:26:35.049281] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-26T17:26:35.156759] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-09-26T17:26:35.925497] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-26T17:26:35.956770] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-09-26T17:26:36.150895] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-09-26T17:26:36.756723] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-09-26T17:26:37.276543] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-26T17:26:37.290703] [INFO ] [REMOTE ] BA: Full fetch complete (77925 records). [2025-09-26T17:26:37.290886] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-09-26T17:26:37.563770] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-09-26T17:26:37.736446] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-09-26T17:26:37.736544] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-09-26T17:26:37.737460] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-09-26T17:26:37.737542] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-09-26T17:26:37.742947] [DEBUG] [LOCAL ] BA: Trimmed 77925 records to 54571 (keeping 200 days of data) [2025-09-26T17:26:38.106675] [DEBUG] [LOCAL ] BA: Primary data saved (54571 records). [2025-09-26T17:26:38.106837] [INFO ] [MAIN ] BA: Full history saved. [2025-09-26T17:26:38.106945] [INFO ] [MAIN ] Update Progress: 205/2371 symbols completed. BA took 29.4s. Estimated remaining: 4h 40m 53s. Rate: 7.7 symbols/min [2025-09-26T17:26:38.308158] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:26:38.347200] [DEBUG] [LOCAL ] BAK: Loaded 39033 existing records from primary storage. [2025-09-26T17:26:38.347352] [INFO ] [MAIN ] BAK: Loaded 39033 existing records. [2025-09-26T17:26:38.544800] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:26:38.545183] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-09-26T17:26:38.545245] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-09-26T17:26:38.546877] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-09-26T17:26:38.546946] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-09-26T17:26:38.777851] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.82 seconds). [2025-09-26T17:26:38.882208] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-09-26T17:26:39.006845] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:26:39.059170] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-26T17:26:39.156701] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-09-26T17:26:39.269008] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-09-26T17:26:39.956756] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-09-26T17:26:40.756742] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-12. [2025-09-26T17:26:40.947750] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-26T17:26:41.261563] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-26T17:26:41.556736] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-09-26T17:26:42.356735] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-09-26T17:26:42.518868] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-26T17:26:42.570164] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-09-26T17:26:43.156778] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-09-26T17:26:43.628016] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-26T17:26:43.836061] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-26T17:26:43.956737] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-09-26T17:26:44.756783] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-09-26T17:26:45.541402] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-09-26T17:26:45.563536] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-09-26T17:26:45.588498] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-26T17:26:46.356742] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-09-26T17:26:47.084449] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-26T17:26:47.156748] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-09-26T17:26:47.384797] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-09-26T17:26:47.956743] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-09-26T17:26:48.230419] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-26T17:26:48.500562] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-26T17:26:48.756803] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-09-26T17:26:49.556778] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-09-26T17:26:50.356721] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-09-26T17:26:50.537851] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-09-26T17:26:51.106491] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T17:26:51.156699] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-09-26T17:26:51.706190] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.95 seconds). [2025-09-26T17:26:51.717429] [INFO ] [REMOTE ] BABA: Full fetch complete (77983 records). [2025-09-26T17:26:51.717780] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-09-26T17:26:51.962186] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-09-26T17:26:52.143196] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-26T17:26:52.220745] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-09-26T17:26:52.220870] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-09-26T17:26:52.221751] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-09-26T17:26:52.221818] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-09-26T17:26:52.223947] [DEBUG] [LOCAL ] BABA: Trimmed 77983 records to 54600 (keeping 200 days of data) [2025-09-26T17:26:52.498932] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-26T17:26:52.626201] [DEBUG] [LOCAL ] BABA: Primary data saved (54600 records). [2025-09-26T17:26:52.626364] [INFO ] [MAIN ] BABA: Full history saved. [2025-09-26T17:26:52.627930] [INFO ] [MAIN ] Update Progress: 206/2371 symbols completed. BABA took 35.9s. Estimated remaining: 4h 41m 56s. Rate: 7.7 symbols/min [2025-09-26T17:26:52.761916] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-09-26T17:26:52.814007] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:26:52.877212] [DEBUG] [LOCAL ] BALL: Loaded 52197 existing records from primary storage. [2025-09-26T17:26:52.877367] [INFO ] [MAIN ] BALL: Loaded 52197 existing records. [2025-09-26T17:26:53.068707] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:26:53.069008] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-09-26T17:26:53.069073] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-09-26T17:26:53.070524] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-09-26T17:26:53.070586] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-09-26T17:26:53.449215] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:26:53.556724] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-12. [2025-09-26T17:26:54.356960] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-09-26T17:26:54.412012] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-26T17:26:54.511627] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.55 seconds). [2025-09-26T17:26:54.523480] [INFO ] [REMOTE ] BAC: Full fetch complete (77943 records). [2025-09-26T17:26:54.523684] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-09-26T17:26:54.967695] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-09-26T17:26:54.967866] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-09-26T17:26:54.968733] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-09-26T17:26:54.968906] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-09-26T17:26:54.970959] [DEBUG] [LOCAL ] BAC: Trimmed 77943 records to 54588 (keeping 200 days of data) [2025-09-26T17:26:55.095460] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-26T17:26:55.196436] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-09-26T17:26:55.368981] [DEBUG] [LOCAL ] BAC: Primary data saved (54588 records). [2025-09-26T17:26:55.369129] [INFO ] [MAIN ] BAC: Full history saved. [2025-09-26T17:26:55.369218] [INFO ] [MAIN ] Update Progress: 207/2371 symbols completed. BAC took 32.4s. Estimated remaining: 4h 40m 55s. Rate: 7.7 symbols/min [2025-09-26T17:26:55.549496] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:26:55.549714] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-09-26T17:26:55.549764] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-09-26T17:26:55.549908] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-09-26T17:26:55.549952] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-26T17:26:55.549995] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-26T17:26:55.550027] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-09-26T17:26:55.940308] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:26:55.967255] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-09-26T17:26:55.973594] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-26T17:26:55.985146] [INFO ] [REMOTE ] BAH: Full fetch complete (74824 records). [2025-09-26T17:26:55.985324] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-09-26T17:26:56.396665] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-09-26T17:26:56.396766] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-09-26T17:26:56.397537] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-09-26T17:26:56.397606] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-09-26T17:26:56.401328] [DEBUG] [LOCAL ] BAH: Trimmed 74824 records to 52477 (keeping 200 days of data) [2025-09-26T17:26:56.737835] [DEBUG] [LOCAL ] BAH: Primary data saved (52477 records). [2025-09-26T17:26:56.737989] [INFO ] [MAIN ] BAH: Full history saved. [2025-09-26T17:26:56.738935] [INFO ] [MAIN ] Update Progress: 208/2371 symbols completed. BAH took 32.7s. Estimated remaining: 4h 39m 41s. Rate: 7.7 symbols/min [2025-09-26T17:26:56.761957] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-09-26T17:26:56.932844] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:26:56.990388] [DEBUG] [LOCAL ] BAM: Loaded 52391 existing records from primary storage. [2025-09-26T17:26:56.990559] [INFO ] [MAIN ] BAM: Loaded 52391 existing records. [2025-09-26T17:26:57.188631] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:26:57.189096] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-09-26T17:26:57.189178] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-09-26T17:26:57.200137] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-09-26T17:26:57.215577] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-09-26T17:26:57.291342] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-26T17:26:57.557221] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-09-26T17:26:57.651715] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:26:57.663861] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-26T17:26:58.207146] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-26T17:26:58.356742] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-12. [2025-09-26T17:26:58.865006] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-26T17:26:59.156753] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-09-26T17:26:59.933278] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-26T17:26:59.956743] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-09-26T17:27:00.715827] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-26T17:27:00.756773] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-09-26T17:27:01.556711] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-09-26T17:27:01.611355] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-26T17:27:02.356775] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-09-26T17:27:02.681866] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-26T17:27:03.131246] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-26T17:27:03.156683] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-09-26T17:27:03.270847] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-26T17:27:03.956776] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-09-26T17:27:04.611099] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-26T17:27:04.756700] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-09-26T17:27:04.850296] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-26T17:27:04.858007] [INFO ] [REMOTE ] BAK: Full fetch complete (56955 records). [2025-09-26T17:27:04.858159] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-09-26T17:27:05.272200] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-09-26T17:27:05.272330] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-09-26T17:27:05.273017] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-09-26T17:27:05.273085] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-09-26T17:27:05.274508] [DEBUG] [LOCAL ] BAK: Trimmed 56955 records to 39413 (keeping 200 days of data) [2025-09-26T17:27:05.508502] [DEBUG] [LOCAL ] BAK: Primary data saved (39413 records). [2025-09-26T17:27:05.508702] [INFO ] [MAIN ] BAK: Full history saved. [2025-09-26T17:27:05.508842] [INFO ] [MAIN ] Update Progress: 209/2371 symbols completed. BAK took 27.4s. Estimated remaining: 4h 39m 43s. Rate: 7.7 symbols/min [2025-09-26T17:27:05.567131] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-09-26T17:27:05.693002] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:27:05.752289] [DEBUG] [LOCAL ] BANC: Loaded 51644 existing records from primary storage. [2025-09-26T17:27:05.752533] [INFO ] [MAIN ] BANC: Loaded 51644 existing records. [2025-09-26T17:27:05.948242] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:27:05.948776] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-09-26T17:27:05.948962] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-09-26T17:27:05.950563] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-09-26T17:27:05.950631] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-09-26T17:27:06.202419] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-26T17:27:06.306517] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-26T17:27:06.362373] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-09-26T17:27:06.394783] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:27:07.136964] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-26T17:27:07.156733] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-09-26T17:27:07.956757] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-09-26T17:27:08.141334] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-26T17:27:08.756777] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-09-26T17:27:09.556755] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-09-26T17:27:09.598185] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-26T17:27:10.356715] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-09-26T17:27:10.376728] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-26T17:27:10.590990] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-26T17:27:11.156748] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-12. [2025-09-26T17:27:11.956742] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-09-26T17:27:12.413275] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-26T17:27:12.756742] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-09-26T17:27:12.957013] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T17:27:13.229242] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-26T17:27:13.556705] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-09-26T17:27:13.636173] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-26T17:27:14.356729] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-09-26T17:27:15.156697] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-09-26T17:27:15.250500] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-26T17:27:15.572424] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-26T17:27:15.911576] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-26T17:27:15.956727] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-09-26T17:27:16.756754] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-09-26T17:27:17.558482] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-09-26T17:27:17.558384] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-26T17:27:18.080237] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-26T17:27:18.356726] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-09-26T17:27:19.085231] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-26T17:27:19.156720] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-09-26T17:27:19.956696] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-09-26T17:27:20.089006] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-26T17:27:20.756787] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-09-26T17:27:21.018201] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-26T17:27:21.556758] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-09-26T17:27:21.830108] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-26T17:27:22.356758] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-09-26T17:27:22.426669] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-26T17:27:23.166347] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-09-26T17:27:23.188304] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-26T17:27:23.820788] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-26T17:27:23.956783] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-09-26T17:27:24.756767] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-09-26T17:27:24.759080] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-26T17:27:25.556752] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-09-26T17:27:25.623878] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-26T17:27:25.635910] [INFO ] [REMOTE ] BAM: Full fetch complete (74174 records). [2025-09-26T17:27:25.636196] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-09-26T17:27:25.783503] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-26T17:27:25.822504] [INFO ] [REMOTE ] BALY: Full fetch complete (17169 records). [2025-09-26T17:27:25.829131] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-09-26T17:27:26.256300] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-26T17:27:26.295670] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:27:26.303782] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:27:26.303916] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-26T17:27:26.326136] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-26T17:27:26.326413] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-09-26T17:27:26.326339] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-09-26T17:27:26.326528] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-09-26T17:27:26.327453] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-09-26T17:27:26.327563] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-09-26T17:27:26.327628] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-09-26T17:27:26.328000] [INFO ] [MAIN ] Update Progress: 210/2371 symbols completed. BALY took 31.0s. Estimated remaining: 4h 41m 50s. Rate: 7.7 symbols/min [2025-09-26T17:27:26.361909] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-09-26T17:27:26.410725] [DEBUG] [LOCAL ] BAM: Trimmed 74174 records to 52779 (keeping 200 days of data) [2025-09-26T17:27:26.635183] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:27:26.749601] [DEBUG] [LOCAL ] BAP: Loaded 26518 existing records from primary storage. [2025-09-26T17:27:26.758625] [INFO ] [MAIN ] BAP: Loaded 26518 existing records. [2025-09-26T17:27:27.034898] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:27:27.036209] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-09-26T17:27:27.039127] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-09-26T17:27:27.044210] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-09-26T17:27:27.046176] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-09-26T17:27:27.387319] [DEBUG] [LOCAL ] BAM: Primary data saved (52779 records). [2025-09-26T17:27:27.416968] [INFO ] [MAIN ] BAM: Full history saved. [2025-09-26T17:27:27.476850] [INFO ] [MAIN ] Update Progress: 211/2371 symbols completed. BAM took 30.7s. Estimated remaining: 4h 40m 34s. Rate: 7.7 symbols/min [2025-09-26T17:27:27.670154] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:27:27.679792] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-12. [2025-09-26T17:27:27.804354] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:27:27.802330] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-26T17:27:27.817891] [INFO ] [REMOTE ] BALL: Full fetch complete (75382 records). [2025-09-26T17:27:27.818150] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-09-26T17:27:28.190325] [DEBUG] [LOCAL ] BARK: Loaded 38678 existing records from primary storage. [2025-09-26T17:27:28.190767] [INFO ] [MAIN ] BARK: Loaded 38678 existing records. [2025-09-26T17:27:28.429393] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-09-26T17:27:28.470722] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-09-26T17:27:28.489486] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-09-26T17:27:28.489671] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-09-26T17:27:28.488585] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-26T17:27:28.547759] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:27:28.549427] [DEBUG] [LOCAL ] BALL: Trimmed 75382 records to 52583 (keeping 200 days of data) [2025-09-26T17:27:28.549184] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-09-26T17:27:28.549485] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-09-26T17:27:28.550915] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-09-26T17:27:28.552089] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-09-26T17:27:28.552187] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-09-26T17:27:29.136985] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:27:29.138003] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-12. [2025-09-26T17:27:29.139426] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-26T17:27:29.379663] [DEBUG] [LOCAL ] BALL: Primary data saved (52583 records). [2025-09-26T17:27:29.379836] [INFO ] [MAIN ] BALL: Full history saved. [2025-09-26T17:27:29.380595] [INFO ] [MAIN ] Update Progress: 212/2371 symbols completed. BALL took 36.8s. Estimated remaining: 4h 39m 26s. Rate: 7.7 symbols/min [2025-09-26T17:27:29.574023] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:27:29.569025] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-09-26T17:27:29.574701] [DEBUG] [LOCAL ] BAX: No existing data file found in primary storage. [2025-09-26T17:27:29.575520] [WARN ] [MAIN ] BAX: No existing data found, performing full refresh instead. [2025-09-26T17:27:29.575779] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-09-26T17:27:29.575866] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-09-26T17:27:29.575918] [DEBUG] [LOCAL ] BAX: No primary data file found to delete. [2025-09-26T17:27:29.575957] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-09-26T17:27:29.982254] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:27:30.357448] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-12. [2025-09-26T17:27:30.360960] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-26T17:27:30.842222] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-26T17:27:30.866772] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-26T17:27:31.156732] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-09-26T17:27:31.956690] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-09-26T17:27:32.068225] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-26T17:27:32.367964] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-26T17:27:32.761823] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-09-26T17:27:32.771522] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-26T17:27:33.556793] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-09-26T17:27:34.356764] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-09-26T17:27:34.712703] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-26T17:27:34.900386] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-26T17:27:35.156763] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-09-26T17:27:35.956789] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-09-26T17:27:36.170003] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-26T17:27:36.299054] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-26T17:27:36.756782] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-09-26T17:27:37.556710] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-09-26T17:27:37.733273] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-26T17:27:37.743936] [INFO ] [REMOTE ] BANC: Full fetch complete (74184 records). [2025-09-26T17:27:37.744121] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-09-26T17:27:38.175839] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-09-26T17:27:38.175935] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-09-26T17:27:38.176768] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-09-26T17:27:38.176850] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-09-26T17:27:38.178478] [DEBUG] [LOCAL ] BANC: Trimmed 74184 records to 52019 (keeping 200 days of data) [2025-09-26T17:27:38.361748] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-09-26T17:27:38.524313] [DEBUG] [LOCAL ] BANC: Primary data saved (52019 records). [2025-09-26T17:27:38.524507] [INFO ] [MAIN ] BANC: Full history saved. [2025-09-26T17:27:38.524636] [INFO ] [MAIN ] Update Progress: 213/2371 symbols completed. BANC took 33.0s. Estimated remaining: 4h 39m 32s. Rate: 7.7 symbols/min [2025-09-26T17:27:38.750444] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:27:38.754496] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-26T17:27:38.818730] [DEBUG] [LOCAL ] BB: Loaded 53311 existing records from primary storage. [2025-09-26T17:27:38.819086] [INFO ] [MAIN ] BB: Loaded 53311 existing records. [2025-09-26T17:27:38.929745] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-26T17:27:39.046155] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:27:39.046437] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-09-26T17:27:39.046498] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-09-26T17:27:39.047897] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-09-26T17:27:39.047962] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-09-26T17:27:39.157381] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-09-26T17:27:39.445632] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:27:39.710432] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-26T17:27:39.956734] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-09-26T17:27:40.701529] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T17:27:40.756771] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-09-26T17:27:41.556703] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-12. [2025-09-26T17:27:41.642347] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-26T17:27:42.126021] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-26T17:27:42.356745] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-09-26T17:27:43.156768] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-09-26T17:27:43.761400] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-26T17:27:43.888537] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-09-26T17:27:43.956759] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-09-26T17:27:43.988035] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-26T17:27:44.756740] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-09-26T17:27:45.556720] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-09-26T17:27:45.839002] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-26T17:27:46.356742] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-09-26T17:27:46.418716] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-26T17:27:46.447125] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-26T17:27:47.156771] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-09-26T17:27:47.956979] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-09-26T17:27:48.307995] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-26T17:27:48.489439] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-26T17:27:48.756728] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-09-26T17:27:49.363466] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-26T17:27:49.556743] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-09-26T17:27:50.045147] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-26T17:27:50.356736] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-09-26T17:27:51.156778] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-09-26T17:27:51.301010] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-26T17:27:51.704209] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-26T17:27:51.956747] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-09-26T17:27:52.401370] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-26T17:27:52.756771] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-09-26T17:27:53.049978] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-26T17:27:53.556746] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-09-26T17:27:54.363751] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-09-26T17:27:54.390115] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-26T17:27:54.445444] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-26T17:27:54.452515] [INFO ] [REMOTE ] BAP: Full fetch complete (37758 records). [2025-09-26T17:27:54.452713] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-09-26T17:27:54.897999] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-09-26T17:27:54.898127] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-09-26T17:27:54.898828] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-09-26T17:27:54.898911] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-09-26T17:27:54.900366] [DEBUG] [LOCAL ] BAP: Trimmed 37758 records to 26635 (keeping 200 days of data) [2025-09-26T17:27:55.081844] [DEBUG] [LOCAL ] BAP: Primary data saved (26635 records). [2025-09-26T17:27:55.081996] [INFO ] [MAIN ] BAP: Full history saved. [2025-09-26T17:27:55.082110] [INFO ] [MAIN ] Update Progress: 214/2371 symbols completed. BAP took 28.8s. Estimated remaining: 4h 40m 53s. Rate: 7.7 symbols/min [2025-09-26T17:27:55.163296] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-09-26T17:27:55.278048] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:27:55.337599] [DEBUG] [LOCAL ] BBAI: Loaded 54210 existing records from primary storage. [2025-09-26T17:27:55.337798] [INFO ] [MAIN ] BBAI: Loaded 54210 existing records. [2025-09-26T17:27:55.530791] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:27:55.531128] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-09-26T17:27:55.531185] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-09-26T17:27:55.532677] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-09-26T17:27:55.532740] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-09-26T17:27:55.919494] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:27:55.956718] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-09-26T17:27:56.267322] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-26T17:27:56.457681] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-26T17:27:56.465076] [INFO ] [REMOTE ] BARK: Full fetch complete (56850 records). [2025-09-26T17:27:56.465245] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-09-26T17:27:56.762585] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-09-26T17:27:56.930181] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-09-26T17:27:56.930275] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-09-26T17:27:56.931198] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-09-26T17:27:56.931276] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-09-26T17:27:56.932880] [DEBUG] [LOCAL ] BARK: Trimmed 56850 records to 38893 (keeping 200 days of data) [2025-09-26T17:27:57.219986] [DEBUG] [LOCAL ] BARK: Primary data saved (38893 records). [2025-09-26T17:27:57.220148] [INFO ] [MAIN ] BARK: Full history saved. [2025-09-26T17:27:57.220243] [INFO ] [MAIN ] Update Progress: 215/2371 symbols completed. BARK took 29.7s. Estimated remaining: 4h 39m 48s. Rate: 7.7 symbols/min [2025-09-26T17:27:57.400768] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:27:57.447939] [DEBUG] [LOCAL ] BBAR: Loaded 41667 existing records from primary storage. [2025-09-26T17:27:57.448126] [INFO ] [MAIN ] BBAR: Loaded 41667 existing records. [2025-09-26T17:27:57.559115] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-12. [2025-09-26T17:27:57.649201] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:27:57.649696] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-09-26T17:27:57.649855] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-09-26T17:27:57.651378] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-09-26T17:27:57.651448] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-09-26T17:27:57.998300] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-26T17:27:58.110168] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:27:58.356728] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-09-26T17:27:58.442420] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-26T17:27:59.156728] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-09-26T17:27:59.956750] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-12. [2025-09-26T17:28:00.005850] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T17:28:00.017296] [INFO ] [REMOTE ] BAX: Full fetch complete (77441 records). [2025-09-26T17:28:00.017469] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-09-26T17:28:00.465074] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-09-26T17:28:00.465255] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-09-26T17:28:00.466257] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-09-26T17:28:00.466379] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-09-26T17:28:00.503505] [DEBUG] [LOCAL ] BAX: Trimmed 77441 records to 54273 (keeping 200 days of data) [2025-09-26T17:28:00.504771] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-12 (2.95 seconds). [2025-09-26T17:28:00.756869] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-09-26T17:28:00.870415] [DEBUG] [LOCAL ] BAX: Primary data saved (54273 records). [2025-09-26T17:28:00.870573] [INFO ] [MAIN ] BAX: Full history saved. [2025-09-26T17:28:00.870689] [INFO ] [MAIN ] Update Progress: 216/2371 symbols completed. BAX took 31.5s. Estimated remaining: 4h 38m 59s. Rate: 7.7 symbols/min [2025-09-26T17:28:01.053713] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:28:01.108037] [DEBUG] [LOCAL ] BBD: Loaded 53571 existing records from primary storage. [2025-09-26T17:28:01.108187] [INFO ] [MAIN ] BBD: Loaded 53571 existing records. [2025-09-26T17:28:01.353196] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:28:01.356475] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-26T17:28:01.367183] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-09-26T17:28:01.368739] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-09-26T17:28:01.371070] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-09-26T17:28:01.371159] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-09-26T17:28:01.564086] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-09-26T17:28:01.820378] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-26T17:28:01.862866] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:28:02.356739] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-09-26T17:28:03.156764] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-12. [2025-09-26T17:28:03.381183] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.62 seconds). [2025-09-26T17:28:03.629116] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-26T17:28:03.956750] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-09-26T17:28:04.026572] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-26T17:28:04.725988] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-26T17:28:04.756673] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-09-26T17:28:05.561811] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-09-26T17:28:05.579146] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-26T17:28:06.083954] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-26T17:28:06.356734] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-09-26T17:28:07.156733] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-09-26T17:28:07.956769] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-09-26T17:28:08.214784] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.65 seconds). [2025-09-26T17:28:08.650959] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-26T17:28:08.756756] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-09-26T17:28:08.868671] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-09-26T17:28:08.880257] [INFO ] [REMOTE ] BB: Full fetch complete (76984 records). [2025-09-26T17:28:08.880454] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-09-26T17:28:09.425987] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-09-26T17:28:09.426190] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-09-26T17:28:09.427839] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-09-26T17:28:09.428136] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-09-26T17:28:09.431166] [DEBUG] [LOCAL ] BB: Trimmed 76984 records to 53701 (keeping 200 days of data) [2025-09-26T17:28:09.565368] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-09-26T17:28:09.608895] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-26T17:28:09.937237] [DEBUG] [LOCAL ] BB: Primary data saved (53701 records). [2025-09-26T17:28:09.937458] [INFO ] [MAIN ] BB: Full history saved. [2025-09-26T17:28:09.937638] [INFO ] [MAIN ] Update Progress: 217/2371 symbols completed. BB took 31.4s. Estimated remaining: 4h 39m 4s. Rate: 7.7 symbols/min [2025-09-26T17:28:10.202388] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:28:10.246930] [DEBUG] [LOCAL ] BBDC: Loaded 33540 existing records from primary storage. [2025-09-26T17:28:10.247193] [INFO ] [MAIN ] BBDC: Loaded 33540 existing records. [2025-09-26T17:28:10.361878] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-09-26T17:28:10.473321] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:28:10.473629] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-09-26T17:28:10.473715] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-09-26T17:28:10.474752] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-09-26T17:28:10.474816] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-09-26T17:28:10.869706] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:28:11.108596] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T17:28:11.156733] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-09-26T17:28:11.497521] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.74 seconds). [2025-09-26T17:28:11.845482] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-26T17:28:11.956748] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-09-26T17:28:12.378417] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-26T17:28:12.756733] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-09-26T17:28:13.556741] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-09-26T17:28:14.132741] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-26T17:28:14.300448] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-26T17:28:14.356719] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-09-26T17:28:15.158979] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-09-26T17:28:15.162324] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-26T17:28:15.956734] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-12. [2025-09-26T17:28:16.756720] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-09-26T17:28:16.864454] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-09-26T17:28:16.901870] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-26T17:28:17.556727] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-09-26T17:28:17.755996] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T17:28:18.356699] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-09-26T17:28:18.435158] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-26T17:28:19.156708] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-09-26T17:28:19.337301] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-26T17:28:19.843074] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-26T17:28:19.956746] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-09-26T17:28:20.583105] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-26T17:28:20.756748] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-09-26T17:28:21.556715] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-09-26T17:28:22.356706] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-09-26T17:28:22.441568] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-26T17:28:22.494795] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-09-26T17:28:22.528160] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-26T17:28:23.156723] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-09-26T17:28:23.529375] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-26T17:28:23.956734] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-09-26T17:28:24.188713] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-26T17:28:24.756757] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-09-26T17:28:25.547786] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-26T17:28:25.556733] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-09-26T17:28:26.356754] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-09-26T17:28:26.749303] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-26T17:28:27.156777] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-09-26T17:28:27.905063] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-26T17:28:27.915110] [INFO ] [REMOTE ] BBAR: Full fetch complete (60747 records). [2025-09-26T17:28:27.915445] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-09-26T17:28:27.962688] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-09-26T17:28:28.378152] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.82 seconds). [2025-09-26T17:28:28.378485] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-09-26T17:28:28.390116] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-09-26T17:28:28.391351] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-09-26T17:28:28.392059] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-09-26T17:28:28.393886] [DEBUG] [LOCAL ] BBAR: Trimmed 60747 records to 41988 (keeping 200 days of data) [2025-09-26T17:28:28.514635] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-26T17:28:28.689296] [DEBUG] [LOCAL ] BBAR: Primary data saved (41988 records). [2025-09-26T17:28:28.689452] [INFO ] [MAIN ] BBAR: Full history saved. [2025-09-26T17:28:28.690751] [INFO ] [MAIN ] Update Progress: 218/2371 symbols completed. BBAR took 31.5s. Estimated remaining: 4h 40m 45s. Rate: 7.7 symbols/min [2025-09-26T17:28:28.761815] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-09-26T17:28:28.916630] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:28:28.925390] [DEBUG] [LOCAL ] BBDO: Loaded 5030 existing records from primary storage. [2025-09-26T17:28:28.925529] [INFO ] [MAIN ] BBDO: Loaded 5030 existing records. [2025-09-26T17:28:29.112027] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:28:29.112339] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-09-26T17:28:29.112407] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-09-26T17:28:29.112895] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-09-26T17:28:29.112960] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-09-26T17:28:29.506606] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:28:29.556706] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-12. [2025-09-26T17:28:29.683364] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T17:28:29.695849] [INFO ] [REMOTE ] BBD: Full fetch complete (77118 records). [2025-09-26T17:28:29.696029] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-09-26T17:28:30.124260] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-09-26T17:28:30.124354] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-09-26T17:28:30.125194] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-09-26T17:28:30.125267] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-09-26T17:28:30.127460] [DEBUG] [LOCAL ] BBD: Trimmed 77118 records to 53959 (keeping 200 days of data) [2025-09-26T17:28:30.233092] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-26T17:28:30.361105] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-09-26T17:28:30.491362] [DEBUG] [LOCAL ] BBD: Primary data saved (53959 records). [2025-09-26T17:28:30.491527] [INFO ] [MAIN ] BBD: Full history saved. [2025-09-26T17:28:30.492796] [INFO ] [MAIN ] Update Progress: 219/2371 symbols completed. BBD took 29.6s. Estimated remaining: 4h 39m 38s. Rate: 7.7 symbols/min [2025-09-26T17:28:30.725325] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:28:30.750117] [DEBUG] [LOCAL ] BBN: Loaded 18100 existing records from primary storage. [2025-09-26T17:28:30.750260] [INFO ] [MAIN ] BBN: Loaded 18100 existing records. [2025-09-26T17:28:30.890320] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-26T17:28:30.960495] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:28:30.960803] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-09-26T17:28:30.960857] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-09-26T17:28:30.961536] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-09-26T17:28:30.961599] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-09-26T17:28:31.161848] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-09-26T17:28:31.356327] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:28:31.387899] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-09-26T17:28:31.398680] [INFO ] [REMOTE ] BBAI: Full fetch complete (77999 records). [2025-09-26T17:28:31.398844] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-09-26T17:28:31.795779] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-26T17:28:31.823197] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-09-26T17:28:31.823282] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-09-26T17:28:31.824133] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-09-26T17:28:31.824202] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-09-26T17:28:31.825817] [DEBUG] [LOCAL ] BBAI: Trimmed 77999 records to 54600 (keeping 200 days of data) [2025-09-26T17:28:31.989275] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-09-26T17:28:32.144475] [DEBUG] [LOCAL ] BBAI: Primary data saved (54600 records). [2025-09-26T17:28:32.144619] [INFO ] [MAIN ] BBAI: Full history saved. [2025-09-26T17:28:32.144736] [INFO ] [MAIN ] Update Progress: 220/2371 symbols completed. BBAI took 37.1s. Estimated remaining: 4h 38m 30s. Rate: 7.7 symbols/min [2025-09-26T17:28:32.322938] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:28:32.323114] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-09-26T17:28:32.323153] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-09-26T17:28:32.323301] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-09-26T17:28:32.323346] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-26T17:28:32.323390] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-26T17:28:32.323427] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-09-26T17:28:32.699407] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:28:32.756677] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-09-26T17:28:33.149910] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:28:33.150238] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-09-26T17:28:33.330799] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-26T17:28:33.556718] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-01. [2025-09-26T17:28:33.771299] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:28:33.771623] [WARN ] [REMOTE ] BBT: No data returned for month 2025-01 [2025-09-26T17:28:34.356771] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-12. [2025-09-26T17:28:35.156748] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-09-26T17:28:35.632386] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-26T17:28:35.956755] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-09-26T17:28:36.211056] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-26T17:28:36.338630] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-26T17:28:36.756765] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-02. [2025-09-26T17:28:36.956512] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:28:36.956882] [WARN ] [REMOTE ] BBT: No data returned for month 2025-02 [2025-09-26T17:28:37.556731] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-03. [2025-09-26T17:28:37.757743] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:28:37.758127] [WARN ] [REMOTE ] BBT: No data returned for month 2025-03 [2025-09-26T17:28:38.356756] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-09-26T17:28:39.096279] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-26T17:28:39.156770] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-09-26T17:28:39.956705] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-09-26T17:28:40.125267] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-26T17:28:40.461501] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-26T17:28:40.756770] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-04. [2025-09-26T17:28:40.971314] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:28:40.971636] [WARN ] [REMOTE ] BBT: No data returned for month 2025-04 [2025-09-26T17:28:41.556717] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-05. [2025-09-26T17:28:41.763063] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:28:41.763373] [WARN ] [REMOTE ] BBT: No data returned for month 2025-05 [2025-09-26T17:28:42.356731] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-09-26T17:28:43.156738] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-09-26T17:28:43.218523] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-26T17:28:43.568589] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-26T17:28:43.956738] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-09-26T17:28:44.756737] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-06. [2025-09-26T17:28:45.077502] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:28:45.077875] [WARN ] [REMOTE ] BBT: No data returned for month 2025-06 [2025-09-26T17:28:45.099502] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-26T17:28:45.556738] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-07. [2025-09-26T17:28:45.760391] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:28:45.760739] [WARN ] [REMOTE ] BBT: No data returned for month 2025-07 [2025-09-26T17:28:46.356730] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-08. [2025-09-26T17:28:46.559391] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:28:46.559741] [WARN ] [REMOTE ] BBT: No data returned for month 2025-08 [2025-09-26T17:28:47.156751] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-09-26T17:28:47.753095] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-26T17:28:47.956741] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-09-26T17:28:48.304751] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-26T17:28:48.756766] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-09-26T17:28:49.556742] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-09-26T17:28:50.056075] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-26T17:28:50.061432] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-26T17:28:50.072383] [INFO ] [REMOTE ] BBDO: Full fetch complete (7688 records). [2025-09-26T17:28:50.072533] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-09-26T17:28:50.361880] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-09-26T17:28:50.465580] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-09-26T17:28:50.465688] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-09-26T17:28:50.465913] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-09-26T17:28:50.466008] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-09-26T17:28:50.466814] [DEBUG] [LOCAL ] BBDO: Trimmed 7688 records to 5051 (keeping 200 days of data) [2025-09-26T17:28:50.500235] [DEBUG] [LOCAL ] BBDO: Primary data saved (5051 records). [2025-09-26T17:28:50.500345] [INFO ] [MAIN ] BBDO: Full history saved. [2025-09-26T17:28:50.500523] [INFO ] [MAIN ] Update Progress: 221/2371 symbols completed. BBDO took 21.8s. Estimated remaining: 4h 40m 5s. Rate: 7.7 symbols/min [2025-09-26T17:28:50.675187] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:28:50.682719] [DEBUG] [LOCAL ] BBU: Loaded 4332 existing records from primary storage. [2025-09-26T17:28:50.682801] [INFO ] [MAIN ] BBU: Loaded 4332 existing records. [2025-09-26T17:28:50.867471] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:28:50.867729] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-09-26T17:28:50.867786] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-09-26T17:28:50.868117] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-09-26T17:28:50.868187] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-09-26T17:28:51.158461] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-09-26T17:28:51.264316] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:28:51.273390] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-26T17:28:51.956761] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-12. [2025-09-26T17:28:52.419352] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-26T17:28:52.441569] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-26T17:28:52.449742] [INFO ] [REMOTE ] BBDC: Full fetch complete (48839 records). [2025-09-26T17:28:52.449879] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-09-26T17:28:52.761822] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-09. [2025-09-26T17:28:52.882309] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-09-26T17:28:52.882408] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-09-26T17:28:52.882998] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-09-26T17:28:52.883064] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-09-26T17:28:52.885408] [DEBUG] [LOCAL ] BBDC: Trimmed 48839 records to 33756 (keeping 200 days of data) [2025-09-26T17:28:53.111517] [DEBUG] [LOCAL ] BBDC: Primary data saved (33756 records). [2025-09-26T17:28:53.111694] [INFO ] [MAIN ] BBDC: Full history saved. [2025-09-26T17:28:53.111833] [INFO ] [MAIN ] Update Progress: 222/2371 symbols completed. BBDC took 43.2s. Estimated remaining: 4h 39m 7s. Rate: 7.7 symbols/min [2025-09-26T17:28:53.313011] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:28:53.329304] [DEBUG] [LOCAL ] BBUC: Loaded 13336 existing records from primary storage. [2025-09-26T17:28:53.329474] [INFO ] [MAIN ] BBUC: Loaded 13336 existing records. [2025-09-26T17:28:53.525628] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:28:53.526603] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-09-26T17:28:53.526684] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-09-26T17:28:53.527713] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-09-26T17:28:53.527774] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-09-26T17:28:53.561880] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-09-26T17:28:53.953634] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:28:54.356709] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-12. [2025-09-26T17:28:54.547920] [INFO ] [REMOTE ] BBT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-26T17:28:54.560716] [INFO ] [REMOTE ] BBT: Full fetch complete (5611 records). [2025-09-26T17:28:54.561026] [DEBUG] [VALIDATOR ] BBT: Validating primary data. [2025-09-26T17:28:54.698098] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-26T17:28:54.802297] [WARN ] [VALIDATOR ] BBT: Validation failed - insufficient historical data. Have 19 unique days, need 200 days [2025-09-26T17:28:54.802614] [FATAL] [MAIN ] BBT: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:28:54.802741] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:28:54.802834] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-26T17:28:54.803276] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-26T17:28:54.803396] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-09-26T17:28:54.809008] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-09-26T17:28:54.809151] [INFO ] [MAIN ] Update Progress: 223/2371 symbols completed. BBT took 22.7s. Estimated remaining: 4h 38m 1s. Rate: 7.7 symbols/min [2025-09-26T17:28:54.815636] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-26T17:28:55.000014] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:28:55.066965] [DEBUG] [LOCAL ] BBVA: Loaded 49832 existing records from primary storage. [2025-09-26T17:28:55.067201] [INFO ] [MAIN ] BBVA: Loaded 49832 existing records. [2025-09-26T17:28:55.161821] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-09-26T17:28:55.263254] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:28:55.263510] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-09-26T17:28:55.263561] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-09-26T17:28:55.265056] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-09-26T17:28:55.265117] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-09-26T17:28:55.653580] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:28:55.756552] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-26T17:28:55.956727] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-09-26T17:28:56.451204] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-26T17:28:56.756745] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-12. [2025-09-26T17:28:57.556722] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-09-26T17:28:57.963848] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-26T17:28:58.356697] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-09-26T17:28:58.609277] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-26T17:28:58.872627] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-26T17:28:59.156767] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-09-26T17:28:59.956690] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-09-26T17:29:00.315394] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-26T17:29:00.756745] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-09-26T17:29:01.556880] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-09-26T17:29:01.734780] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-26T17:29:01.774791] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-26T17:29:02.087812] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-26T17:29:02.356814] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-09-26T17:29:03.115417] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-26T17:29:03.156712] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-09-26T17:29:03.644483] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-26T17:29:03.956759] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-09-26T17:29:04.681465] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-26T17:29:04.756720] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-09-26T17:29:05.227351] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-26T17:29:05.556721] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-09-26T17:29:06.303365] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-26T17:29:06.356736] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-09-26T17:29:07.156738] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-09-26T17:29:07.963617] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-09-26T17:29:07.982843] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T17:29:08.037838] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-26T17:29:08.760270] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-09-26T17:29:08.762812] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-26T17:29:09.556713] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-09-26T17:29:09.645912] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-26T17:29:10.356723] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-09-26T17:29:10.412309] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-26T17:29:10.417792] [INFO ] [REMOTE ] BBN: Full fetch complete (26742 records). [2025-09-26T17:29:10.417912] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-09-26T17:29:10.830277] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-09-26T17:29:10.830407] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-09-26T17:29:10.830878] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-09-26T17:29:10.830948] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-09-26T17:29:10.831951] [DEBUG] [LOCAL ] BBN: Trimmed 26742 records to 18193 (keeping 200 days of data) [2025-09-26T17:29:10.960672] [DEBUG] [LOCAL ] BBN: Primary data saved (18193 records). [2025-09-26T17:29:10.960865] [INFO ] [MAIN ] BBN: Full history saved. [2025-09-26T17:29:10.961004] [INFO ] [MAIN ] Update Progress: 224/2371 symbols completed. BBN took 40.5s. Estimated remaining: 4h 39m 13s. Rate: 7.7 symbols/min [2025-09-26T17:29:11.143379] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:29:11.160094] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-09-26T17:29:11.173365] [DEBUG] [LOCAL ] BBW: Loaded 26921 existing records from primary storage. [2025-09-26T17:29:11.174056] [INFO ] [MAIN ] BBW: Loaded 26921 existing records. [2025-09-26T17:29:11.369910] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:29:11.370288] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-09-26T17:29:11.370380] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-09-26T17:29:11.371282] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-09-26T17:29:11.371347] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-09-26T17:29:11.779949] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:29:11.819948] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-26T17:29:11.953722] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-26T17:29:11.964284] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-09-26T17:29:12.672344] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-26T17:29:12.756722] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-09-26T17:29:13.552899] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-26T17:29:13.556029] [INFO ] [REMOTE ] BBU: Full fetch complete (6398 records). [2025-09-26T17:29:13.556155] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-09-26T17:29:13.561873] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-12. [2025-09-26T17:29:13.971368] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-09-26T17:29:13.971474] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-09-26T17:29:13.971713] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-09-26T17:29:13.971777] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-09-26T17:29:13.972221] [DEBUG] [LOCAL ] BBU: Trimmed 6398 records to 4478 (keeping 200 days of data) [2025-09-26T17:29:14.003451] [DEBUG] [LOCAL ] BBU: Primary data saved (4478 records). [2025-09-26T17:29:14.003593] [INFO ] [MAIN ] BBU: Full history saved. [2025-09-26T17:29:14.003757] [INFO ] [MAIN ] Update Progress: 225/2371 symbols completed. BBU took 23.5s. Estimated remaining: 4h 38m 20s. Rate: 7.7 symbols/min [2025-09-26T17:29:14.196560] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:29:14.276531] [DEBUG] [LOCAL ] BBWI: Loaded 53970 existing records from primary storage. [2025-09-26T17:29:14.276731] [INFO ] [MAIN ] BBWI: Loaded 53970 existing records. [2025-09-26T17:29:14.361950] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-09-26T17:29:14.496951] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:29:14.497298] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-09-26T17:29:14.497354] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-09-26T17:29:14.498892] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-09-26T17:29:14.498955] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-09-26T17:29:14.892368] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:29:14.944049] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-26T17:29:14.960034] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-26T17:29:15.156752] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-09-26T17:29:15.956772] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-09-26T17:29:16.532292] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-26T17:29:16.756783] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-09-26T17:29:17.556798] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-12. [2025-09-26T17:29:17.773010] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-26T17:29:17.855278] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-26T17:29:18.356757] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-09-26T17:29:19.156752] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-09-26T17:29:19.420454] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-26T17:29:19.673935] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-26T17:29:19.929233] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-26T17:29:19.956690] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-09-26T17:29:20.756774] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-09-26T17:29:21.153737] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-26T17:29:21.556741] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-09-26T17:29:22.108995] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-26T17:29:22.356759] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-09-26T17:29:22.461588] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-26T17:29:23.156771] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-09-26T17:29:23.872899] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-26T17:29:23.956767] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-09-26T17:29:24.548071] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-26T17:29:24.749343] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-26T17:29:24.756671] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-09-26T17:29:25.556706] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-09-26T17:29:25.886981] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-26T17:29:26.231594] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-26T17:29:26.356754] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-09-26T17:29:27.156796] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-09-26T17:29:27.516520] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-26T17:29:27.956754] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-09-26T17:29:28.756791] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-09-26T17:29:28.971613] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-26T17:29:29.203127] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-26T17:29:29.556741] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-09-26T17:29:30.356726] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-09-26T17:29:30.401472] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-26T17:29:30.404951] [INFO ] [REMOTE ] BBUC: Full fetch complete (17692 records). [2025-09-26T17:29:30.405043] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-09-26T17:29:30.808238] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-09-26T17:29:30.824119] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-09-26T17:29:30.838035] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-09-26T17:29:30.838190] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-09-26T17:29:30.840959] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-26T17:29:30.841325] [DEBUG] [LOCAL ] BBUC: Trimmed 17692 records to 13503 (keeping 200 days of data) [2025-09-26T17:29:30.941719] [DEBUG] [LOCAL ] BBUC: Primary data saved (13503 records). [2025-09-26T17:29:30.941881] [INFO ] [MAIN ] BBUC: Full history saved. [2025-09-26T17:29:30.941994] [INFO ] [MAIN ] Update Progress: 226/2371 symbols completed. BBUC took 37.8s. Estimated remaining: 4h 39m 39s. Rate: 7.7 symbols/min [2025-09-26T17:29:31.126043] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:29:31.160305] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-09-26T17:29:31.183877] [DEBUG] [LOCAL ] BBY: Loaded 53868 existing records from primary storage. [2025-09-26T17:29:31.184041] [INFO ] [MAIN ] BBY: Loaded 53868 existing records. [2025-09-26T17:29:31.373861] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:29:31.374115] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-09-26T17:29:31.374163] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-09-26T17:29:31.376266] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-09-26T17:29:31.376330] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-09-26T17:29:31.753279] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:29:31.956753] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-09-26T17:29:32.397414] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-26T17:29:32.542852] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-26T17:29:32.550310] [INFO ] [REMOTE ] BBW: Full fetch complete (39048 records). [2025-09-26T17:29:32.550462] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-09-26T17:29:32.765334] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-09-26T17:29:32.984761] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-09-26T17:29:32.984856] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-09-26T17:29:32.985338] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-09-26T17:29:32.985382] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-09-26T17:29:32.986562] [DEBUG] [LOCAL ] BBW: Trimmed 39048 records to 27177 (keeping 200 days of data) [2025-09-26T17:29:33.184191] [DEBUG] [LOCAL ] BBW: Primary data saved (27177 records). [2025-09-26T17:29:33.184384] [INFO ] [MAIN ] BBW: Full history saved. [2025-09-26T17:29:33.184515] [INFO ] [MAIN ] Update Progress: 227/2371 symbols completed. BBW took 22.2s. Estimated remaining: 4h 38m 39s. Rate: 7.7 symbols/min [2025-09-26T17:29:33.365037] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:29:33.415517] [DEBUG] [LOCAL ] BC: Loaded 44723 existing records from primary storage. [2025-09-26T17:29:33.415730] [INFO ] [MAIN ] BC: Loaded 44723 existing records. [2025-09-26T17:29:33.560536] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-12. [2025-09-26T17:29:33.631408] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:29:33.631961] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-09-26T17:29:33.632099] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-09-26T17:29:33.644072] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-09-26T17:29:33.661736] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-09-26T17:29:33.711450] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-26T17:29:34.052890] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:29:34.297779] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-26T17:29:34.356770] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-12. [2025-09-26T17:29:34.982479] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-26T17:29:35.156791] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-09-26T17:29:35.958530] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-09-26T17:29:35.964599] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-26T17:29:36.756773] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-09-26T17:29:36.971663] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-26T17:29:37.351528] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-26T17:29:37.556743] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-09-26T17:29:38.293122] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-26T17:29:38.303936] [INFO ] [REMOTE ] BBVA: Full fetch complete (71572 records). [2025-09-26T17:29:38.304269] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-09-26T17:29:38.362613] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-09-26T17:29:38.726839] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-09-26T17:29:38.726982] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-09-26T17:29:38.727861] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-09-26T17:29:38.727937] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-09-26T17:29:38.732606] [DEBUG] [LOCAL ] BBVA: Trimmed 71572 records to 50167 (keeping 200 days of data) [2025-09-26T17:29:39.071838] [DEBUG] [LOCAL ] BBVA: Primary data saved (50167 records). [2025-09-26T17:29:39.085717] [INFO ] [MAIN ] BBVA: Full history saved. [2025-09-26T17:29:39.085867] [INFO ] [MAIN ] Update Progress: 228/2371 symbols completed. BBVA took 44.3s. Estimated remaining: 4h 38m 13s. Rate: 7.7 symbols/min [2025-09-26T17:29:39.149303] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-26T17:29:39.158332] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-09-26T17:29:39.279917] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:29:39.280089] [DEBUG] [LOCAL ] BCAT: No existing data file found in primary storage. [2025-09-26T17:29:39.280145] [WARN ] [MAIN ] BCAT: No existing data found, performing full refresh instead. [2025-09-26T17:29:39.280289] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-09-26T17:29:39.280332] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-09-26T17:29:39.280373] [DEBUG] [LOCAL ] BCAT: No primary data file found to delete. [2025-09-26T17:29:39.280406] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-09-26T17:29:39.651032] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:29:39.934596] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T17:29:39.956692] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-09-26T17:29:40.761060] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-09-26T17:29:40.768091] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-26T17:29:41.400369] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-26T17:29:41.556746] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-12. [2025-09-26T17:29:42.356721] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-09-26T17:29:42.496016] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-26T17:29:42.671663] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-26T17:29:43.156729] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-09-26T17:29:43.956760] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-09-26T17:29:44.383398] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-26T17:29:44.756720] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-09-26T17:29:45.027017] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-26T17:29:45.368866] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-26T17:29:45.556738] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-09-26T17:29:46.267829] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-26T17:29:46.356734] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-09-26T17:29:47.108404] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-26T17:29:47.156743] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-09-26T17:29:47.693523] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-26T17:29:47.956760] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-09-26T17:29:48.550440] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-26T17:29:48.756777] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-09-26T17:29:48.965313] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-26T17:29:49.556756] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-09-26T17:29:50.356763] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-09-26T17:29:50.553531] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-26T17:29:50.564614] [INFO ] [REMOTE ] BBWI: Full fetch complete (77415 records). [2025-09-26T17:29:50.564797] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-09-26T17:29:50.986392] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-09-26T17:29:50.986673] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-09-26T17:29:50.988088] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-09-26T17:29:50.988180] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-09-26T17:29:50.990936] [DEBUG] [LOCAL ] BBWI: Trimmed 77415 records to 54360 (keeping 200 days of data) [2025-09-26T17:29:51.137717] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-26T17:29:51.157279] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-09-26T17:29:51.411976] [DEBUG] [LOCAL ] BBWI: Primary data saved (54360 records). [2025-09-26T17:29:51.412158] [INFO ] [MAIN ] BBWI: Full history saved. [2025-09-26T17:29:51.412921] [INFO ] [MAIN ] Update Progress: 229/2371 symbols completed. BBWI took 37.4s. Estimated remaining: 4h 38m 48s. Rate: 7.7 symbols/min [2025-09-26T17:29:51.595478] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:29:51.630390] [DEBUG] [LOCAL ] BCC: Loaded 28556 existing records from primary storage. [2025-09-26T17:29:51.630577] [INFO ] [MAIN ] BCC: Loaded 28556 existing records. [2025-09-26T17:29:51.874896] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-26T17:29:51.918969] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:29:51.919235] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-09-26T17:29:51.919287] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-09-26T17:29:51.920195] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-09-26T17:29:51.920259] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-09-26T17:29:51.961917] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-09-26T17:29:52.331060] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:29:52.760628] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-09-26T17:29:52.767292] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-26T17:29:53.556735] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-09-26T17:29:53.801864] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-26T17:29:53.895583] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-26T17:29:54.356727] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-09-26T17:29:54.747364] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-26T17:29:55.156776] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-12. [2025-09-26T17:29:55.956809] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-09-26T17:29:56.070060] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-26T17:29:56.081186] [INFO ] [REMOTE ] BBY: Full fetch complete (77245 records). [2025-09-26T17:29:56.081392] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-09-26T17:29:56.652680] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-09-26T17:29:56.653880] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-09-26T17:29:56.656073] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-09-26T17:29:56.656232] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-09-26T17:29:56.655032] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-26T17:29:56.666748] [DEBUG] [LOCAL ] BBY: Trimmed 77245 records to 54253 (keeping 200 days of data) [2025-09-26T17:29:56.776443] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-09-26T17:29:57.035480] [DEBUG] [LOCAL ] BBY: Primary data saved (54253 records). [2025-09-26T17:29:57.035681] [INFO ] [MAIN ] BBY: Full history saved. [2025-09-26T17:29:57.035815] [INFO ] [MAIN ] Update Progress: 230/2371 symbols completed. BBY took 26.1s. Estimated remaining: 4h 38m 19s. Rate: 7.7 symbols/min [2025-09-26T17:29:57.253834] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-26T17:29:57.266247] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:29:57.330606] [DEBUG] [LOCAL ] BCE: Loaded 52712 existing records from primary storage. [2025-09-26T17:29:57.330889] [INFO ] [MAIN ] BCE: Loaded 52712 existing records. [2025-09-26T17:29:57.562463] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-09-26T17:29:57.606909] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:29:57.607268] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-09-26T17:29:57.607348] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-09-26T17:29:57.609368] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-09-26T17:29:57.609439] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-09-26T17:29:58.026266] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-26T17:29:58.064316] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:29:58.356765] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-09-26T17:29:59.088882] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-26T17:29:59.156733] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-09-26T17:29:59.789312] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-26T17:29:59.956759] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-12. [2025-09-26T17:30:00.756719] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-09-26T17:30:00.805453] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-26T17:30:01.556764] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-09-26T17:30:02.091394] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-26T17:30:02.356690] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-09-26T17:30:02.457915] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-26T17:30:02.808875] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-26T17:30:03.156742] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-09-26T17:30:03.627886] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-26T17:30:03.956736] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-09-26T17:30:04.756731] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-09-26T17:30:05.055422] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-26T17:30:05.063806] [INFO ] [REMOTE ] BC: Full fetch complete (63840 records). [2025-09-26T17:30:05.063942] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-09-26T17:30:05.483114] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-09-26T17:30:05.483207] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-09-26T17:30:05.484014] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-09-26T17:30:05.484090] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-09-26T17:30:05.485594] [DEBUG] [LOCAL ] BC: Trimmed 63840 records to 45020 (keeping 200 days of data) [2025-09-26T17:30:05.582979] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-09-26T17:30:05.787044] [DEBUG] [LOCAL ] BC: Primary data saved (45020 records). [2025-09-26T17:30:05.787251] [INFO ] [MAIN ] BC: Full history saved. [2025-09-26T17:30:05.789514] [INFO ] [MAIN ] Update Progress: 231/2371 symbols completed. BC took 32.6s. Estimated remaining: 4h 38m 21s. Rate: 7.7 symbols/min [2025-09-26T17:30:05.985034] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:30:05.985270] [DEBUG] [LOCAL ] BCH: No existing data file found in primary storage. [2025-09-26T17:30:05.985528] [WARN ] [MAIN ] BCH: No existing data found, performing full refresh instead. [2025-09-26T17:30:05.985798] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-09-26T17:30:05.985854] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-09-26T17:30:05.985901] [DEBUG] [LOCAL ] BCH: No primary data file found to delete. [2025-09-26T17:30:05.985936] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-09-26T17:30:06.133497] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-26T17:30:06.172210] [INFO ] [REMOTE ] BCAT: Full fetch complete (49992 records). [2025-09-26T17:30:06.192344] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-09-26T17:30:06.609358] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:30:06.626624] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-12. [2025-09-26T17:30:06.899871] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-09-26T17:30:06.900253] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-09-26T17:30:06.911200] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-09-26T17:30:06.927532] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-09-26T17:30:06.934367] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-26T17:30:06.962140] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-26T17:30:06.962486] [DEBUG] [LOCAL ] BCAT: Trimmed 49992 records to 34910 (keeping 200 days of data) [2025-09-26T17:30:07.169727] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-09-26T17:30:07.200446] [DEBUG] [LOCAL ] BCAT: Primary data saved (34910 records). [2025-09-26T17:30:07.200578] [INFO ] [MAIN ] BCAT: Full history saved. [2025-09-26T17:30:07.200687] [INFO ] [MAIN ] Update Progress: 232/2371 symbols completed. BCAT took 28.1s. Estimated remaining: 4h 37m 14s. Rate: 7.7 symbols/min [2025-09-26T17:30:07.383424] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:30:07.383633] [DEBUG] [LOCAL ] BCO: No existing data file found in primary storage. [2025-09-26T17:30:07.383713] [WARN ] [MAIN ] BCO: No existing data found, performing full refresh instead. [2025-09-26T17:30:07.383833] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-09-26T17:30:07.383873] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-09-26T17:30:07.383916] [DEBUG] [LOCAL ] BCO: No primary data file found to delete. [2025-09-26T17:30:07.383949] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-09-26T17:30:07.783178] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:30:07.801314] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-26T17:30:07.956734] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-12. [2025-09-26T17:30:08.756745] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-09-26T17:30:09.060887] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-26T17:30:09.208413] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-26T17:30:09.556734] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-09-26T17:30:10.152331] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-26T17:30:10.356738] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-09-26T17:30:11.156726] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-09-26T17:30:11.487313] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-26T17:30:11.664078] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-26T17:30:11.956753] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-09-26T17:30:12.059766] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-26T17:30:12.756762] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-09-26T17:30:12.812945] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-26T17:30:13.556725] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-09-26T17:30:13.737301] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-26T17:30:14.356754] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-09-26T17:30:14.487247] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-26T17:30:15.156776] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-09-26T17:30:15.297542] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-26T17:30:15.956765] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-09-26T17:30:15.991590] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-26T17:30:16.756766] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-09-26T17:30:17.434096] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-26T17:30:17.556763] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-09-26T17:30:17.656793] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-26T17:30:18.356757] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-09-26T17:30:19.064571] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-26T17:30:19.156768] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-09-26T17:30:19.956768] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-09-26T17:30:20.103374] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-26T17:30:20.756698] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-09-26T17:30:20.759075] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T17:30:20.868389] [DEBUG] [REMOTE ] BCH: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-09-26T17:30:20.868740] [WARN ] [REMOTE ] BCH: No data returned for month 2025-05 [2025-09-26T17:30:20.985368] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-26T17:30:21.556725] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-09-26T17:30:22.356730] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-09-26T17:30:22.861688] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-26T17:30:23.156785] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-09-26T17:30:23.747996] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-26T17:30:23.956703] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-09-26T17:30:24.283738] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-26T17:30:24.756751] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-09-26T17:30:25.282126] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-26T17:30:25.556741] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-09-26T17:30:25.787201] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-26T17:30:25.793497] [INFO ] [REMOTE ] BCC: Full fetch complete (40396 records). [2025-09-26T17:30:25.793663] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-09-26T17:30:26.191587] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-09-26T17:30:26.191713] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-09-26T17:30:26.192279] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-09-26T17:30:26.192345] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-09-26T17:30:26.193339] [DEBUG] [LOCAL ] BCC: Trimmed 40396 records to 28735 (keeping 200 days of data) [2025-09-26T17:30:26.366007] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-09-26T17:30:26.384405] [DEBUG] [LOCAL ] BCC: Primary data saved (28735 records). [2025-09-26T17:30:26.384530] [INFO ] [MAIN ] BCC: Full history saved. [2025-09-26T17:30:26.386259] [INFO ] [MAIN ] Update Progress: 233/2371 symbols completed. BCC took 35.0s. Estimated remaining: 4h 38m 51s. Rate: 7.7 symbols/min [2025-09-26T17:30:26.567356] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:30:26.627392] [DEBUG] [LOCAL ] BCS: Loaded 53855 existing records from primary storage. [2025-09-26T17:30:26.627562] [INFO ] [MAIN ] BCS: Loaded 53855 existing records. [2025-09-26T17:30:26.814726] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:30:26.815389] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-09-26T17:30:26.815483] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-09-26T17:30:26.817255] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-09-26T17:30:26.817325] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-09-26T17:30:27.160859] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-09-26T17:30:27.219780] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:30:27.268549] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-26T17:30:27.270791] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-26T17:30:27.956758] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-09-26T17:30:28.645352] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-26T17:30:28.756759] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-12. [2025-09-26T17:30:29.349857] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-26T17:30:29.556772] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-09-26T17:30:30.356725] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-09-26T17:30:30.394587] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-26T17:30:30.613268] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-26T17:30:30.620542] [INFO ] [REMOTE ] BCO: Full fetch complete (36744 records). [2025-09-26T17:30:30.620797] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-09-26T17:30:31.086726] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-09-26T17:30:31.086844] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-09-26T17:30:31.087573] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-09-26T17:30:31.087668] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-09-26T17:30:31.088753] [DEBUG] [LOCAL ] BCO: Trimmed 36744 records to 26740 (keeping 200 days of data) [2025-09-26T17:30:31.178899] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-09-26T17:30:31.261109] [DEBUG] [LOCAL ] BCO: Primary data saved (26740 records). [2025-09-26T17:30:31.261272] [INFO ] [MAIN ] BCO: Full history saved. [2025-09-26T17:30:31.261371] [INFO ] [MAIN ] Update Progress: 234/2371 symbols completed. BCO took 24.1s. Estimated remaining: 4h 38m 16s. Rate: 7.7 symbols/min [2025-09-26T17:30:31.457221] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:30:31.488114] [DEBUG] [LOCAL ] BCSF: Loaded 28030 existing records from primary storage. [2025-09-26T17:30:31.488261] [INFO ] [MAIN ] BCSF: Loaded 28030 existing records. [2025-09-26T17:30:31.678506] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:30:31.678834] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-09-26T17:30:31.678893] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-09-26T17:30:31.679682] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-09-26T17:30:31.679764] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-09-26T17:30:31.959463] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-09-26T17:30:32.093597] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:30:32.133837] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-26T17:30:32.163422] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-26T17:30:32.756815] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-12. [2025-09-26T17:30:33.556891] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-09-26T17:30:33.841634] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-26T17:30:33.851519] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-26T17:30:34.356749] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-09-26T17:30:34.528049] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-26T17:30:34.534917] [INFO ] [REMOTE ] BCH: Full fetch complete (36526 records). [2025-09-26T17:30:34.535084] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-09-26T17:30:34.747198] [WARN ] [VALIDATOR ] BCH: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-26T17:30:34.747745] [FATAL] [MAIN ] BCH: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:30:34.747823] [WARN ] [MAIN ] BCH: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:30:34.747907] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-09-26T17:30:34.748015] [DEBUG] [LOCAL ] BCH: No primary data file found to delete. [2025-09-26T17:30:34.748088] [INFO ] [LOCAL ] BCH: Starting deletion of derivative data. [2025-09-26T17:30:34.748178] [DEBUG] [LOCAL ] BCH: No derivative data file found to delete. [2025-09-26T17:30:34.748272] [INFO ] [MAIN ] Update Progress: 235/2371 symbols completed. BCH took 29.0s. Estimated remaining: 4h 37m 29s. Rate: 7.7 symbols/min [2025-09-26T17:30:34.945709] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:30:34.946090] [DEBUG] [LOCAL ] BCX: No existing data file found in primary storage. [2025-09-26T17:30:34.946130] [WARN ] [MAIN ] BCX: No existing data found, performing full refresh instead. [2025-09-26T17:30:34.946278] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-09-26T17:30:34.946323] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-09-26T17:30:34.946367] [DEBUG] [LOCAL ] BCX: No primary data file found to delete. [2025-09-26T17:30:34.946401] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-09-26T17:30:35.167372] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-09-26T17:30:35.340369] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:30:35.944972] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-26T17:30:35.956667] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-09-26T17:30:35.972538] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-26T17:30:36.756766] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-09-26T17:30:37.481895] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-26T17:30:37.556725] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-09-26T17:30:37.876422] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-26T17:30:38.356740] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-09-26T17:30:39.156734] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-09-26T17:30:39.520883] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-26T17:30:39.770535] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-26T17:30:39.956787] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-09-26T17:30:40.601375] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-26T17:30:40.756767] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-12. [2025-09-26T17:30:40.910728] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-26T17:30:41.556747] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-09-26T17:30:41.697833] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-26T17:30:42.356759] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-09-26T17:30:42.834267] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-26T17:30:43.156748] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-09-26T17:30:43.181237] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-26T17:30:43.956786] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-09-26T17:30:44.756740] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-09-26T17:30:44.909446] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-26T17:30:44.921844] [INFO ] [REMOTE ] BCE: Full fetch complete (76101 records). [2025-09-26T17:30:44.935879] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-09-26T17:30:44.943685] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-26T17:30:45.390122] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-09-26T17:30:45.390221] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-09-26T17:30:45.391026] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-09-26T17:30:45.391117] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-09-26T17:30:45.392881] [DEBUG] [LOCAL ] BCE: Trimmed 76101 records to 53072 (keeping 200 days of data) [2025-09-26T17:30:45.581790] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-09-26T17:30:45.754777] [DEBUG] [LOCAL ] BCE: Primary data saved (53072 records). [2025-09-26T17:30:45.754985] [INFO ] [MAIN ] BCE: Full history saved. [2025-09-26T17:30:45.762064] [INFO ] [MAIN ] Update Progress: 236/2371 symbols completed. BCE took 48.7s. Estimated remaining: 4h 37m 50s. Rate: 7.7 symbols/min [2025-09-26T17:30:45.822052] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-26T17:30:45.970242] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:30:45.970445] [DEBUG] [LOCAL ] BDC: No existing data file found in primary storage. [2025-09-26T17:30:45.970486] [WARN ] [MAIN ] BDC: No existing data found, performing full refresh instead. [2025-09-26T17:30:45.970700] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-09-26T17:30:45.970759] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-09-26T17:30:45.970840] [DEBUG] [LOCAL ] BDC: No primary data file found to delete. [2025-09-26T17:30:45.970887] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-09-26T17:30:46.381107] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-09-26T17:30:46.387374] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:30:47.156734] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-12. [2025-09-26T17:30:47.466399] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-26T17:30:47.594553] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-26T17:30:47.956743] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-09-26T17:30:48.268172] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-26T17:30:48.756762] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-09-26T17:30:48.894407] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-26T17:30:49.556714] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-09-26T17:30:49.608913] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-26T17:30:50.356760] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-09-26T17:30:50.714164] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-26T17:30:51.156778] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-09-26T17:30:51.528920] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-26T17:30:51.956746] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-09-26T17:30:52.756760] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-09-26T17:30:52.858635] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-26T17:30:52.958342] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-26T17:30:52.967866] [INFO ] [REMOTE ] BCSF: Full fetch complete (38132 records). [2025-09-26T17:30:52.968046] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-09-26T17:30:53.387011] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-09-26T17:30:53.387131] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-09-26T17:30:53.387595] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-09-26T17:30:53.387638] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-09-26T17:30:53.390202] [DEBUG] [LOCAL ] BCSF: Trimmed 38132 records to 28231 (keeping 200 days of data) [2025-09-26T17:30:53.565243] [DEBUG] [LOCAL ] BCSF: Primary data saved (28231 records). [2025-09-26T17:30:53.560855] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-09-26T17:30:53.566320] [INFO ] [MAIN ] BCSF: Full history saved. [2025-09-26T17:30:53.566473] [INFO ] [MAIN ] Update Progress: 237/2371 symbols completed. BCSF took 22.3s. Estimated remaining: 4h 37m 42s. Rate: 7.7 symbols/min [2025-09-26T17:30:53.976737] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-26T17:30:54.356798] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-09-26T17:30:55.159599] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-09-26T17:30:55.162969] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-26T17:30:55.411846] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-26T17:30:55.956758] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-09-26T17:30:56.084049] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-26T17:30:56.756769] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-09-26T17:30:57.136811] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-26T17:30:57.556719] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-09-26T17:30:57.771788] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-26T17:30:58.215663] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-26T17:30:58.356759] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-09-26T17:30:59.156744] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-09-26T17:30:59.202977] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-26T17:30:59.207275] [INFO ] [REMOTE ] BCX: Full fetch complete (33885 records). [2025-09-26T17:30:59.207416] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-09-26T17:30:59.636145] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-09-26T17:30:59.636286] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-09-26T17:30:59.636821] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-09-26T17:30:59.636962] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-09-26T17:30:59.641841] [DEBUG] [LOCAL ] BCX: Trimmed 33885 records to 21920 (keeping 200 days of data) [2025-09-26T17:30:59.788811] [DEBUG] [LOCAL ] BCX: Primary data saved (21920 records). [2025-09-26T17:30:59.788979] [INFO ] [MAIN ] BCX: Full history saved. [2025-09-26T17:30:59.789221] [INFO ] [MAIN ] Update Progress: 238/2371 symbols completed. BCX took 25.0s. Estimated remaining: 4h 37m 20s. Rate: 7.7 symbols/min [2025-09-26T17:30:59.956838] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-09-26T17:31:01.188019] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-26T17:31:01.205564] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-09-26T17:31:01.491304] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-26T17:31:01.556751] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-09-26T17:31:02.644292] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-26T17:31:02.658048] [INFO ] [REMOTE ] BCS: Full fetch complete (76901 records). [2025-09-26T17:31:02.658261] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-09-26T17:31:02.659512] [FATAL] [VALIDATOR ] BCS: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:31:02.659671] [FATAL] [MAIN ] BCS: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:31:02.659747] [WARN ] [MAIN ] BCS: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:31:02.659813] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-09-26T17:31:02.659898] [DEBUG] [LOCAL ] BCS: No primary data file found to delete. [2025-09-26T17:31:02.659970] [INFO ] [LOCAL ] BCS: Starting deletion of derivative data. [2025-09-26T17:31:02.660965] [DEBUG] [LOCAL ] BCS: Deleted derivative data file. [2025-09-26T17:31:02.661674] [INFO ] [MAIN ] Update Progress: 239/2371 symbols completed. BCS took 36.3s. Estimated remaining: 4h 36m 29s. Rate: 7.7 symbols/min [2025-09-26T17:31:02.803944] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-26T17:31:02.809699] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-09-26T17:31:03.898101] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-26T17:31:03.904153] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-09-26T17:31:05.082863] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-26T17:31:05.089377] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-09-26T17:31:06.245329] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-26T17:31:06.251379] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-09-26T17:31:07.510769] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-26T17:31:07.518870] [INFO ] [REMOTE ] BDC: Full fetch complete (35763 records). [2025-09-26T17:31:07.519101] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-09-26T17:31:08.132403] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-09-26T17:31:08.132868] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-09-26T17:31:08.133740] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-09-26T17:31:08.133838] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-09-26T17:31:08.135374] [DEBUG] [LOCAL ] BDC: Trimmed 35763 records to 25073 (keeping 200 days of data) [2025-09-26T17:31:08.358739] [DEBUG] [LOCAL ] BDC: Primary data saved (25073 records). [2025-09-26T17:31:08.358891] [INFO ] [MAIN ] BDC: Full history saved. [2025-09-26T17:31:08.358976] [INFO ] [MAIN ] Update Progress: 240/2371 symbols completed. BDC took 22.6s. Estimated remaining: 4h 36m 2s. Rate: 7.7 symbols/min [2025-09-26T17:31:09.200332] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:31:09.245775] [DEBUG] [LOCAL ] BDN: No existing data file found in primary storage. [2025-09-26T17:31:09.286699] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:31:09.245546] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:31:09.287381] [DEBUG] [LOCAL ] BDJ: No existing data file found in primary storage. [2025-09-26T17:31:09.286882] [WARN ] [MAIN ] BDN: No existing data found, performing full refresh instead. [2025-09-26T17:31:09.278819] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:31:09.289424] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-09-26T17:31:09.289551] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-09-26T17:31:09.289788] [DEBUG] [LOCAL ] BDN: No primary data file found to delete. [2025-09-26T17:31:09.289860] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-09-26T17:31:09.287819] [WARN ] [MAIN ] BDJ: No existing data found, performing full refresh instead. [2025-09-26T17:31:09.313589] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-09-26T17:31:09.328820] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-09-26T17:31:09.372863] [DEBUG] [LOCAL ] BDJ: No primary data file found to delete. [2025-09-26T17:31:09.390212] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-09-26T17:31:09.843020] [DEBUG] [LOCAL ] BE: Loaded 54043 existing records from primary storage. [2025-09-26T17:31:09.923304] [INFO ] [MAIN ] BE: Loaded 54043 existing records. [2025-09-26T17:31:09.980732] [DEBUG] [LOCAL ] BDX: Loaded 52828 existing records from primary storage. [2025-09-26T17:31:10.053114] [INFO ] [MAIN ] BDX: Loaded 52828 existing records. [2025-09-26T17:31:10.427108] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:31:10.522730] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-12. [2025-09-26T17:31:10.626413] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:31:10.669751] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-12. [2025-09-26T17:31:10.733586] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:31:10.785233] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-09-26T17:31:10.810200] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-09-26T17:31:10.817030] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-09-26T17:31:10.817321] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-09-26T17:31:10.817179] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:31:10.903303] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-09-26T17:31:10.915904] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-09-26T17:31:10.947724] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-09-26T17:31:10.968979] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-09-26T17:31:11.574011] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:31:11.592389] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-12. [2025-09-26T17:31:11.735277] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:31:11.735622] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-12. [2025-09-26T17:31:11.765262] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-26T17:31:11.772765] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-09-26T17:31:11.992188] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-26T17:31:12.002442] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-09-26T17:31:12.710544] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-26T17:31:12.719490] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-09-26T17:31:13.385555] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-26T17:31:13.397103] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-09-26T17:31:13.504591] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-26T17:31:13.511564] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-09-26T17:31:13.662355] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-26T17:31:13.674331] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-09-26T17:31:13.760161] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-26T17:31:13.771479] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-09-26T17:31:14.956217] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-26T17:31:14.967028] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-09-26T17:31:15.200015] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-26T17:31:15.213577] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-09-26T17:31:15.266485] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-26T17:31:15.537212] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-26T17:31:15.961907] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-09-26T17:31:15.975130] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-26T17:31:16.576853] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-26T17:31:16.756763] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-09-26T17:31:17.304935] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-26T17:31:17.556746] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-09-26T17:31:18.356715] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-09-26T17:31:18.543882] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-26T17:31:19.156760] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-09-26T17:31:19.244633] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-26T17:31:19.956770] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-09-26T17:31:20.215401] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-26T17:31:20.658896] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-26T17:31:20.756766] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-09-26T17:31:21.556693] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-09-26T17:31:21.594802] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-26T17:31:22.356780] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-09-26T17:31:22.749001] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-26T17:31:22.799851] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-26T17:31:23.156801] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-09-26T17:31:23.956740] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-09-26T17:31:24.569902] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-26T17:31:24.756766] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-09-26T17:31:24.996835] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-26T17:31:25.221282] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-26T17:31:25.556740] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-09-26T17:31:26.047801] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-26T17:31:26.356735] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-09-26T17:31:26.632252] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-26T17:31:27.156788] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-09-26T17:31:27.735462] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-26T17:31:27.956775] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-09-26T17:31:28.553455] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-26T17:31:28.756737] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-09-26T17:31:29.299607] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-26T17:31:29.556729] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-09-26T17:31:30.356744] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-09-26T17:31:30.474252] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-26T17:31:30.923201] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-26T17:31:30.933212] [INFO ] [REMOTE ] BDN: Full fetch complete (69230 records). [2025-09-26T17:31:30.933409] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-09-26T17:31:31.163799] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-09-26T17:31:31.372885] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-09-26T17:31:31.372989] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-09-26T17:31:31.373736] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-09-26T17:31:31.373806] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-09-26T17:31:31.375351] [DEBUG] [LOCAL ] BDN: Trimmed 69230 records to 48230 (keeping 200 days of data) [2025-09-26T17:31:31.673838] [DEBUG] [LOCAL ] BDN: Primary data saved (48230 records). [2025-09-26T17:31:31.674034] [INFO ] [MAIN ] BDN: Full history saved. [2025-09-26T17:31:31.674149] [INFO ] [MAIN ] Update Progress: 241/2371 symbols completed. BDN took 23.3s. Estimated remaining: 4h 38m 12s. Rate: 7.7 symbols/min [2025-09-26T17:31:31.881139] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:31:31.881623] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-09-26T17:31:31.881724] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-09-26T17:31:31.881960] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-09-26T17:31:31.882185] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-26T17:31:31.882273] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-26T17:31:31.882408] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-09-26T17:31:31.961237] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-09-26T17:31:32.284846] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-26T17:31:32.375414] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:31:32.379112] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-26T17:31:32.756788] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-09-26T17:31:33.556731] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-09-26T17:31:33.891335] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-26T17:31:34.356755] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-09-26T17:31:34.756588] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-26T17:31:34.773104] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-26T17:31:34.790222] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-26T17:31:34.796260] [INFO ] [REMOTE ] BDJ: Full fetch complete (42790 records). [2025-09-26T17:31:34.796386] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-09-26T17:31:35.165539] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-09-26T17:31:35.225225] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-09-26T17:31:35.225354] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-09-26T17:31:35.226247] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-09-26T17:31:35.226317] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-09-26T17:31:35.227593] [DEBUG] [LOCAL ] BDJ: Trimmed 42790 records to 29325 (keeping 200 days of data) [2025-09-26T17:31:35.426892] [DEBUG] [LOCAL ] BDJ: Primary data saved (29325 records). [2025-09-26T17:31:35.427059] [INFO ] [MAIN ] BDJ: Full history saved. [2025-09-26T17:31:35.427193] [INFO ] [MAIN ] Update Progress: 242/2371 symbols completed. BDJ took 27.1s. Estimated remaining: 4h 37m 28s. Rate: 7.7 symbols/min [2025-09-26T17:31:35.620991] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:31:35.679936] [DEBUG] [LOCAL ] BEKE: Loaded 53637 existing records from primary storage. [2025-09-26T17:31:35.680091] [INFO ] [MAIN ] BEKE: Loaded 53637 existing records. [2025-09-26T17:31:35.875183] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:31:35.875503] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-09-26T17:31:35.875569] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-09-26T17:31:35.877871] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-09-26T17:31:35.877946] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-09-26T17:31:35.961845] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-09-26T17:31:36.260230] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:31:36.756761] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-09-26T17:31:37.025739] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-09-26T17:31:37.440962] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-26T17:31:37.532120] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-26T17:31:37.542564] [INFO ] [REMOTE ] BDX: Full fetch complete (75837 records). [2025-09-26T17:31:37.542788] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-09-26T17:31:37.565157] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-12. [2025-09-26T17:31:37.969466] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-09-26T17:31:37.969613] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-09-26T17:31:37.970589] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-09-26T17:31:37.970684] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-09-26T17:31:37.973365] [DEBUG] [LOCAL ] BDX: Trimmed 75837 records to 53191 (keeping 200 days of data) [2025-09-26T17:31:38.343704] [DEBUG] [LOCAL ] BDX: Primary data saved (53191 records). [2025-09-26T17:31:38.343859] [INFO ] [MAIN ] BDX: Full history saved. [2025-09-26T17:31:38.344671] [INFO ] [MAIN ] Update Progress: 243/2371 symbols completed. BDX took 30.0s. Estimated remaining: 4h 36m 37s. Rate: 7.7 symbols/min [2025-09-26T17:31:38.361674] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-09-26T17:31:38.537380] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:31:38.601089] [DEBUG] [LOCAL ] BEN: Loaded 53445 existing records from primary storage. [2025-09-26T17:31:38.601281] [INFO ] [MAIN ] BEN: Loaded 53445 existing records. [2025-09-26T17:31:38.735723] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-26T17:31:38.832950] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:31:38.833285] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-09-26T17:31:38.833343] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-09-26T17:31:38.835177] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-09-26T17:31:38.835248] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-09-26T17:31:39.156839] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-09-26T17:31:39.252181] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:31:39.486702] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-26T17:31:39.502574] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-26T17:31:39.956783] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-09-26T17:31:40.756746] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-09-26T17:31:41.556745] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-09-26T17:31:42.000867] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-26T17:31:42.003286] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-26T17:31:42.356775] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-09-26T17:31:42.538555] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-26T17:31:43.156755] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-09-26T17:31:43.559304] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-26T17:31:43.956744] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-09-26T17:31:44.289279] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-26T17:31:44.756735] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-12. [2025-09-26T17:31:45.091063] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.73 seconds). [2025-09-26T17:31:45.102400] [INFO ] [REMOTE ] BE: Full fetch complete (77662 records). [2025-09-26T17:31:45.102582] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-09-26T17:31:45.553231] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-09-26T17:31:45.553351] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-09-26T17:31:45.554353] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-09-26T17:31:45.554442] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-09-26T17:31:45.556549] [DEBUG] [LOCAL ] BE: Trimmed 77662 records to 54433 (keeping 200 days of data) [2025-09-26T17:31:45.556734] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-09-26T17:31:45.900362] [DEBUG] [LOCAL ] BE: Primary data saved (54433 records). [2025-09-26T17:31:45.900515] [INFO ] [MAIN ] BE: Full history saved. [2025-09-26T17:31:45.900604] [INFO ] [MAIN ] Update Progress: 244/2371 symbols completed. BE took 37.5s. Estimated remaining: 4h 36m 27s. Rate: 7.7 symbols/min [2025-09-26T17:31:46.016084] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-26T17:31:46.147239] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:31:46.147513] [DEBUG] [LOCAL ] BEP: No existing data file found in primary storage. [2025-09-26T17:31:46.147565] [WARN ] [MAIN ] BEP: No existing data found, performing full refresh instead. [2025-09-26T17:31:46.147714] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-09-26T17:31:46.147766] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-09-26T17:31:46.147809] [DEBUG] [LOCAL ] BEP: No primary data file found to delete. [2025-09-26T17:31:46.147843] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-09-26T17:31:46.361891] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-09-26T17:31:46.559725] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:31:46.801854] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-26T17:31:47.156734] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-09-26T17:31:47.956783] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-09-26T17:31:48.297687] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-26T17:31:48.345147] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-26T17:31:48.585771] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-26T17:31:48.756737] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-09-26T17:31:49.556733] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-12. [2025-09-26T17:31:50.356734] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-09-26T17:31:50.804211] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-26T17:31:51.162251] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-09-26T17:31:51.167386] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-26T17:31:51.517141] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-26T17:31:51.517988] [INFO ] [REMOTE ] BEDU: Full fetch complete (1429 records). [2025-09-26T17:31:51.518060] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-09-26T17:31:51.731574] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-09-26T17:31:51.732007] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:31:51.732162] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:31:51.732285] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-26T17:31:51.732404] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-26T17:31:51.732512] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-09-26T17:31:51.732721] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-09-26T17:31:51.732830] [INFO ] [MAIN ] Update Progress: 245/2371 symbols completed. BEDU took 20.1s. Estimated remaining: 4h 36m 3s. Rate: 7.7 symbols/min [2025-09-26T17:31:51.959579] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-09-26T17:31:51.945347] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:31:51.961292] [DEBUG] [LOCAL ] BEPC: No existing data file found in primary storage. [2025-09-26T17:31:51.961728] [WARN ] [MAIN ] BEPC: No existing data found, performing full refresh instead. [2025-09-26T17:31:51.964491] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-26T17:31:51.965035] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-09-26T17:31:51.976215] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-09-26T17:31:51.976837] [DEBUG] [LOCAL ] BEPC: No primary data file found to delete. [2025-09-26T17:31:51.977259] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-09-26T17:31:52.358679] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:31:52.756792] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-09-26T17:31:53.556757] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-12. [2025-09-26T17:31:53.623098] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-26T17:31:54.356770] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-09-26T17:31:54.431837] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-26T17:31:55.156783] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-09-26T17:31:55.371880] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-26T17:31:55.858399] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-26T17:31:55.956720] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-09-26T17:31:56.686745] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-26T17:31:56.756734] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-09-26T17:31:57.556741] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-09-26T17:31:57.650103] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-26T17:31:58.356738] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-09-26T17:31:58.701470] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-26T17:31:58.817995] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-26T17:31:59.156756] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-09-26T17:31:59.629624] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-26T17:31:59.956772] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-09-26T17:32:00.309070] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-26T17:32:00.756774] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-09-26T17:32:01.556739] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-09-26T17:32:01.619878] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-26T17:32:02.356698] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-09-26T17:32:02.693050] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-26T17:32:03.156826] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-09-26T17:32:03.323841] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-26T17:32:03.459488] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-26T17:32:03.956766] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-09-26T17:32:04.727109] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-26T17:32:04.756692] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-09-26T17:32:05.561996] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-09-26T17:32:05.582105] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-26T17:32:05.825690] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-26T17:32:06.356746] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-09-26T17:32:07.157625] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-09-26T17:32:07.164761] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-26T17:32:07.957106] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-09-26T17:32:07.960419] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-26T17:32:08.420892] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-26T17:32:08.756745] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-09-26T17:32:09.557670] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T17:32:09.557802] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-09-26T17:32:09.815742] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-26T17:32:10.356739] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-09-26T17:32:11.019006] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-26T17:32:11.156797] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-09-26T17:32:11.633901] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-26T17:32:11.956792] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-09-26T17:32:12.691507] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-26T17:32:12.756790] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-09-26T17:32:13.181672] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-26T17:32:13.556742] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-09-26T17:32:14.356721] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-09-26T17:32:14.388112] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-26T17:32:14.399520] [INFO ] [REMOTE ] BEP: Full fetch complete (58019 records). [2025-09-26T17:32:14.399759] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-09-26T17:32:14.401583] [FATAL] [VALIDATOR ] BEP: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:32:14.401882] [FATAL] [MAIN ] BEP: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:32:14.401958] [WARN ] [MAIN ] BEP: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:32:14.402054] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-09-26T17:32:14.402201] [DEBUG] [LOCAL ] BEP: No primary data file found to delete. [2025-09-26T17:32:14.402265] [INFO ] [LOCAL ] BEP: Starting deletion of derivative data. [2025-09-26T17:32:14.402326] [DEBUG] [LOCAL ] BEP: No derivative data file found to delete. [2025-09-26T17:32:14.402451] [INFO ] [MAIN ] Update Progress: 246/2371 symbols completed. BEP took 28.5s. Estimated remaining: 4h 38m 3s. Rate: 7.6 symbols/min [2025-09-26T17:32:14.607131] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:32:14.616236] [DEBUG] [LOCAL ] BEPH: Loaded 5160 existing records from primary storage. [2025-09-26T17:32:14.616403] [INFO ] [MAIN ] BEPH: Loaded 5160 existing records. [2025-09-26T17:32:14.829959] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:32:14.830245] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-09-26T17:32:14.830296] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-09-26T17:32:14.830707] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-09-26T17:32:14.830770] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-09-26T17:32:15.159979] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-09-26T17:32:15.289266] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:32:15.327719] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-26T17:32:15.339067] [INFO ] [REMOTE ] BEN: Full fetch complete (76887 records). [2025-09-26T17:32:15.339263] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-09-26T17:32:15.793280] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-09-26T17:32:15.793408] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-09-26T17:32:15.794507] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-09-26T17:32:15.794619] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-09-26T17:32:15.796840] [DEBUG] [LOCAL ] BEN: Trimmed 76887 records to 53833 (keeping 200 days of data) [2025-09-26T17:32:15.931399] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-26T17:32:15.956900] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-12. [2025-09-26T17:32:16.194410] [DEBUG] [LOCAL ] BEN: Primary data saved (53833 records). [2025-09-26T17:32:16.194582] [INFO ] [MAIN ] BEN: Full history saved. [2025-09-26T17:32:16.195392] [INFO ] [MAIN ] Update Progress: 247/2371 symbols completed. BEN took 37.9s. Estimated remaining: 4h 37m 3s. Rate: 7.7 symbols/min [2025-09-26T17:32:16.409921] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:32:16.417930] [DEBUG] [LOCAL ] BEPI: Loaded 3452 existing records from primary storage. [2025-09-26T17:32:16.418069] [INFO ] [MAIN ] BEPI: Loaded 3452 existing records. [2025-09-26T17:32:16.630135] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:32:16.630506] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-09-26T17:32:16.630564] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-09-26T17:32:16.630964] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-09-26T17:32:16.631027] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-09-26T17:32:16.764860] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-09-26T17:32:16.974442] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-26T17:32:17.043790] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:32:17.087689] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-26T17:32:17.098785] [INFO ] [REMOTE ] BEKE: Full fetch complete (76807 records). [2025-09-26T17:32:17.099013] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-09-26T17:32:17.100038] [FATAL] [VALIDATOR ] BEKE: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:32:17.100137] [FATAL] [MAIN ] BEKE: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:32:17.100184] [WARN ] [MAIN ] BEKE: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:32:17.100262] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-09-26T17:32:17.100334] [DEBUG] [LOCAL ] BEKE: No primary data file found to delete. [2025-09-26T17:32:17.100405] [INFO ] [LOCAL ] BEKE: Starting deletion of derivative data. [2025-09-26T17:32:17.101295] [DEBUG] [LOCAL ] BEKE: Deleted derivative data file. [2025-09-26T17:32:17.101418] [INFO ] [MAIN ] Update Progress: 248/2371 symbols completed. BEKE took 41.7s. Estimated remaining: 4h 35m 56s. Rate: 7.7 symbols/min [2025-09-26T17:32:17.288942] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:32:17.294251] [DEBUG] [LOCAL ] BEPJ: Loaded 3259 existing records from primary storage. [2025-09-26T17:32:17.294416] [INFO ] [MAIN ] BEPJ: Loaded 3259 existing records. [2025-09-26T17:32:17.486597] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:32:17.487026] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-09-26T17:32:17.487105] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-09-26T17:32:17.487530] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-09-26T17:32:17.487590] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-09-26T17:32:17.565583] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-09-26T17:32:17.890856] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:32:18.039698] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-26T17:32:18.070883] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-26T17:32:18.356753] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-12. [2025-09-26T17:32:19.110063] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-26T17:32:19.156775] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-09-26T17:32:19.956781] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-09-26T17:32:20.393702] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-26T17:32:20.654486] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-26T17:32:20.663934] [INFO ] [REMOTE ] BEPC: Full fetch complete (68471 records). [2025-09-26T17:32:20.664110] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-09-26T17:32:20.762060] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-09-26T17:32:21.074418] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-09-26T17:32:21.074525] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-09-26T17:32:21.075280] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-09-26T17:32:21.075353] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-09-26T17:32:21.076859] [DEBUG] [LOCAL ] BEPC: Trimmed 68471 records to 47209 (keeping 200 days of data) [2025-09-26T17:32:21.299796] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-26T17:32:21.376562] [DEBUG] [LOCAL ] BEPC: Primary data saved (47209 records). [2025-09-26T17:32:21.376773] [INFO ] [MAIN ] BEPC: Full history saved. [2025-09-26T17:32:21.376864] [INFO ] [MAIN ] Update Progress: 249/2371 symbols completed. BEPC took 29.6s. Estimated remaining: 4h 35m 18s. Rate: 7.7 symbols/min [2025-09-26T17:32:21.555504] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:32:21.555720] [DEBUG] [LOCAL ] BFAM: No existing data file found in primary storage. [2025-09-26T17:32:21.555772] [WARN ] [MAIN ] BFAM: No existing data found, performing full refresh instead. [2025-09-26T17:32:21.555923] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-09-26T17:32:21.555968] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-09-26T17:32:21.556010] [DEBUG] [LOCAL ] BFAM: No primary data file found to delete. [2025-09-26T17:32:21.556043] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-09-26T17:32:21.561977] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-09-26T17:32:21.968501] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:32:21.989930] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-26T17:32:22.356739] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-12. [2025-09-26T17:32:23.156783] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-12. [2025-09-26T17:32:23.724808] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-26T17:32:23.750616] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-26T17:32:23.956815] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-09-26T17:32:24.598514] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-26T17:32:24.756765] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-09-26T17:32:25.236667] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-26T17:32:25.556721] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-09-26T17:32:25.845823] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-26T17:32:26.356770] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-09-26T17:32:27.054548] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-26T17:32:27.156771] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-09-26T17:32:27.956739] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-09-26T17:32:28.557341] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-26T17:32:28.756735] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-09-26T17:32:28.820699] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-26T17:32:29.396491] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-26T17:32:29.556730] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-09-26T17:32:30.120288] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-26T17:32:30.356770] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-09-26T17:32:31.156751] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-09-26T17:32:31.726113] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-26T17:32:31.748394] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-26T17:32:31.956783] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-09-26T17:32:32.662193] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-26T17:32:32.756690] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-09-26T17:32:33.287896] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-26T17:32:33.556746] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-09-26T17:32:34.041793] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-26T17:32:34.042915] [INFO ] [REMOTE ] BEPI: Full fetch complete (4992 records). [2025-09-26T17:32:34.042986] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-09-26T17:32:34.361827] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-09-26T17:32:34.433280] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-09-26T17:32:34.433362] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-09-26T17:32:34.433531] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-09-26T17:32:34.433578] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-09-26T17:32:34.434037] [DEBUG] [LOCAL ] BEPI: Trimmed 4992 records to 3487 (keeping 200 days of data) [2025-09-26T17:32:34.457316] [DEBUG] [LOCAL ] BEPI: Primary data saved (3487 records). [2025-09-26T17:32:34.457450] [INFO ] [MAIN ] BEPI: Full history saved. [2025-09-26T17:32:34.457539] [INFO ] [MAIN ] Update Progress: 250/2371 symbols completed. BEPI took 18.3s. Estimated remaining: 4h 35m 56s. Rate: 7.7 symbols/min [2025-09-26T17:32:34.648544] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:32:34.694452] [DEBUG] [LOCAL ] BFH: Loaded 42012 existing records from primary storage. [2025-09-26T17:32:34.694625] [INFO ] [MAIN ] BFH: Loaded 42012 existing records. [2025-09-26T17:32:34.885056] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:32:34.885312] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-09-26T17:32:34.885361] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-09-26T17:32:34.886623] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-09-26T17:32:34.886744] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-09-26T17:32:35.148385] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-26T17:32:35.158635] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-09-26T17:32:35.306293] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:32:35.759031] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-26T17:32:35.956733] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-09-26T17:32:36.546982] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-26T17:32:36.756752] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-09-26T17:32:37.556743] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-09-26T17:32:37.889005] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-26T17:32:37.952754] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-26T17:32:38.356771] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-09-26T17:32:38.698629] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-26T17:32:39.156735] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-09-26T17:32:39.599893] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-26T17:32:39.956732] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-09-26T17:32:40.492810] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-26T17:32:40.756750] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-09-26T17:32:41.358800] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-26T17:32:41.556730] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-12. [2025-09-26T17:32:42.356752] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-09-26T17:32:42.857923] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-26T17:32:43.156723] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-09-26T17:32:43.728127] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-26T17:32:43.956764] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-09-26T17:32:44.347152] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-26T17:32:44.347374] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-26T17:32:44.756795] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-09-26T17:32:45.157144] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-26T17:32:45.556760] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-09-26T17:32:46.356749] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-09-26T17:32:47.000383] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-26T17:32:47.009335] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4487 records). [2025-09-26T17:32:47.021598] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-09-26T17:32:47.023160] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T17:32:47.161815] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-09-26T17:32:47.427628] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-09-26T17:32:47.427750] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-09-26T17:32:47.427906] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-09-26T17:32:47.427973] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-09-26T17:32:47.428578] [DEBUG] [LOCAL ] BEPJ: Trimmed 4487 records to 3268 (keeping 200 days of data) [2025-09-26T17:32:47.450219] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3268 records). [2025-09-26T17:32:47.450374] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-09-26T17:32:47.450513] [INFO ] [MAIN ] Update Progress: 251/2371 symbols completed. BEPJ took 30.3s. Estimated remaining: 4h 36m 32s. Rate: 7.7 symbols/min [2025-09-26T17:32:47.654773] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:32:47.670559] [DEBUG] [LOCAL ] BFK: Loaded 14083 existing records from primary storage. [2025-09-26T17:32:47.670741] [INFO ] [MAIN ] BFK: Loaded 14083 existing records. [2025-09-26T17:32:47.889889] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:32:47.890228] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-09-26T17:32:47.890286] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-09-26T17:32:47.890932] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-09-26T17:32:47.891000] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-09-26T17:32:47.962340] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-09-26T17:32:48.297926] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:32:48.756744] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-12. [2025-09-26T17:32:48.827009] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-26T17:32:48.827919] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-26T17:32:48.837058] [INFO ] [REMOTE ] BEPH: Full fetch complete (7547 records). [2025-09-26T17:32:48.837578] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-09-26T17:32:49.230663] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-09-26T17:32:49.230757] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-09-26T17:32:49.230980] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-09-26T17:32:49.231022] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-09-26T17:32:49.231434] [DEBUG] [LOCAL ] BEPH: Trimmed 7547 records to 5208 (keeping 200 days of data) [2025-09-26T17:32:49.262537] [DEBUG] [LOCAL ] BEPH: Primary data saved (5208 records). [2025-09-26T17:32:49.262628] [INFO ] [MAIN ] BEPH: Full history saved. [2025-09-26T17:32:49.262746] [INFO ] [MAIN ] Update Progress: 252/2371 symbols completed. BEPH took 34.9s. Estimated remaining: 4h 35m 33s. Rate: 7.7 symbols/min [2025-09-26T17:32:49.437815] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:32:49.493178] [DEBUG] [LOCAL ] BFLY: Loaded 52211 existing records from primary storage. [2025-09-26T17:32:49.493351] [INFO ] [MAIN ] BFLY: Loaded 52211 existing records. [2025-09-26T17:32:49.562448] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-09-26T17:32:49.706944] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-26T17:32:49.711431] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:32:49.715730] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-09-26T17:32:49.715796] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-09-26T17:32:49.717135] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-09-26T17:32:49.717212] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-09-26T17:32:50.124344] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:32:50.356729] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-12. [2025-09-26T17:32:50.806749] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-26T17:32:51.156742] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-09-26T17:32:51.900187] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-26T17:32:51.956731] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-09-26T17:32:52.416158] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-26T17:32:52.756767] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-09-26T17:32:53.280594] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-26T17:32:53.471318] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-26T17:32:53.556781] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-09-26T17:32:54.356758] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-09-26T17:32:54.724570] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-26T17:32:55.156736] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-09-26T17:32:55.790851] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-26T17:32:55.956717] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-09-26T17:32:56.050135] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-26T17:32:56.756728] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-09-26T17:32:57.384606] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-26T17:32:57.407223] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-26T17:32:57.556724] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-09-26T17:32:58.269197] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-26T17:32:58.356728] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-09-26T17:32:59.156697] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-09-26T17:32:59.220780] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-26T17:32:59.956737] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-09-26T17:33:00.756733] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-09-26T17:33:00.867234] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-26T17:33:00.920550] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-26T17:33:01.556747] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-09-26T17:33:02.356710] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-09-26T17:33:02.620203] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-26T17:33:02.884184] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-26T17:33:03.151941] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-26T17:33:03.160951] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-09-26T17:33:03.956737] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-09-26T17:33:04.761890] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-09-26T17:33:04.785689] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-26T17:33:05.231019] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-26T17:33:05.238330] [INFO ] [REMOTE ] BFAM: Full fetch complete (46960 records). [2025-09-26T17:33:05.238461] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-09-26T17:33:05.558156] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-09-26T17:33:05.583999] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-26T17:33:05.671498] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-09-26T17:33:05.671586] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-09-26T17:33:05.672133] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-09-26T17:33:05.672200] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-09-26T17:33:05.673415] [DEBUG] [LOCAL ] BFAM: Trimmed 46960 records to 33519 (keeping 200 days of data) [2025-09-26T17:33:05.883262] [DEBUG] [LOCAL ] BFAM: Primary data saved (33519 records). [2025-09-26T17:33:05.883413] [INFO ] [MAIN ] BFAM: Full history saved. [2025-09-26T17:33:05.883495] [INFO ] [MAIN ] Update Progress: 253/2371 symbols completed. BFAM took 44.5s. Estimated remaining: 4h 36m 39s. Rate: 7.7 symbols/min [2025-09-26T17:33:06.056411] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:33:06.066386] [DEBUG] [LOCAL ] BFS: Loaded 9144 existing records from primary storage. [2025-09-26T17:33:06.066500] [INFO ] [MAIN ] BFS: Loaded 9144 existing records. [2025-09-26T17:33:06.270842] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:33:06.271095] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-09-26T17:33:06.271145] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-09-26T17:33:06.271606] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-09-26T17:33:06.271716] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-09-26T17:33:06.361847] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-09-26T17:33:06.665997] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:33:07.156700] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-09-26T17:33:07.417120] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-26T17:33:07.453040] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-26T17:33:07.458572] [INFO ] [REMOTE ] BFK: Full fetch complete (19343 records). [2025-09-26T17:33:07.458815] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-09-26T17:33:07.883889] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-09-26T17:33:07.883975] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-09-26T17:33:07.884309] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-09-26T17:33:07.884352] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-09-26T17:33:07.885036] [DEBUG] [LOCAL ] BFK: Trimmed 19343 records to 14145 (keeping 200 days of data) [2025-09-26T17:33:07.960784] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-12. [2025-09-26T17:33:07.980312] [DEBUG] [LOCAL ] BFK: Primary data saved (14145 records). [2025-09-26T17:33:07.980846] [INFO ] [MAIN ] BFK: Full history saved. [2025-09-26T17:33:07.980953] [INFO ] [MAIN ] Update Progress: 254/2371 symbols completed. BFK took 20.5s. Estimated remaining: 4h 35m 44s. Rate: 7.7 symbols/min [2025-09-26T17:33:08.166307] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:33:08.180304] [DEBUG] [LOCAL ] BFZ: Loaded 12147 existing records from primary storage. [2025-09-26T17:33:08.180437] [INFO ] [MAIN ] BFZ: Loaded 12147 existing records. [2025-09-26T17:33:08.382459] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:33:08.383256] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-09-26T17:33:08.383383] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-09-26T17:33:08.384028] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-09-26T17:33:08.384102] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-09-26T17:33:08.701899] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-26T17:33:08.777595] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:33:08.771571] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-09-26T17:33:08.804898] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-26T17:33:09.556727] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-12. [2025-09-26T17:33:09.654750] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-26T17:33:10.356743] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-09-26T17:33:10.692022] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-26T17:33:11.156772] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-09-26T17:33:11.854084] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-26T17:33:11.956777] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-09-26T17:33:12.157167] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-26T17:33:12.534091] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-26T17:33:12.756759] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-09-26T17:33:13.556715] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-09-26T17:33:13.603906] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-26T17:33:14.356715] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-09-26T17:33:14.377619] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-26T17:33:15.156768] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-09-26T17:33:15.919573] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-26T17:33:15.956803] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-09-26T17:33:16.474323] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-26T17:33:16.761868] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-09-26T17:33:16.784741] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-26T17:33:17.556739] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-09-26T17:33:17.910179] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-26T17:33:18.103198] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-26T17:33:18.356745] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-09-26T17:33:19.156753] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-09-26T17:33:19.956764] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-09-26T17:33:20.267922] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-26T17:33:20.530682] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-26T17:33:20.575859] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-26T17:33:20.583941] [INFO ] [REMOTE ] BFH: Full fetch complete (59688 records). [2025-09-26T17:33:20.584069] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-09-26T17:33:20.770749] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-09-26T17:33:21.036058] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-09-26T17:33:21.036218] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-09-26T17:33:21.037850] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-09-26T17:33:21.037981] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-09-26T17:33:21.045595] [DEBUG] [LOCAL ] BFH: Trimmed 59688 records to 42308 (keeping 200 days of data) [2025-09-26T17:33:21.333132] [DEBUG] [LOCAL ] BFH: Primary data saved (42308 records). [2025-09-26T17:33:21.333306] [INFO ] [MAIN ] BFH: Full history saved. [2025-09-26T17:33:21.334605] [INFO ] [MAIN ] Update Progress: 255/2371 symbols completed. BFH took 46.9s. Estimated remaining: 4h 36m 22s. Rate: 7.7 symbols/min [2025-09-26T17:33:21.542799] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:33:21.556738] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-09-26T17:33:21.604854] [DEBUG] [LOCAL ] BG: Loaded 50757 existing records from primary storage. [2025-09-26T17:33:21.604998] [INFO ] [MAIN ] BG: Loaded 50757 existing records. [2025-09-26T17:33:21.778197] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-26T17:33:21.838698] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:33:21.838983] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-09-26T17:33:21.839046] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-09-26T17:33:21.840703] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-09-26T17:33:21.840785] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-09-26T17:33:22.227169] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:33:22.356738] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-09-26T17:33:23.158045] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-09-26T17:33:23.161536] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-26T17:33:23.808362] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-26T17:33:23.822866] [INFO ] [REMOTE ] BFLY: Full fetch complete (75268 records). [2025-09-26T17:33:23.823034] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-09-26T17:33:23.961259] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-09-26T17:33:23.955928] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-26T17:33:24.269966] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-09-26T17:33:24.270320] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-09-26T17:33:24.271227] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-09-26T17:33:24.271311] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-09-26T17:33:24.276262] [DEBUG] [LOCAL ] BFLY: Trimmed 75268 records to 52590 (keeping 200 days of data) [2025-09-26T17:33:24.589889] [DEBUG] [LOCAL ] BFLY: Primary data saved (52590 records). [2025-09-26T17:33:24.590037] [INFO ] [MAIN ] BFLY: Full history saved. [2025-09-26T17:33:24.590140] [INFO ] [MAIN ] Update Progress: 256/2371 symbols completed. BFLY took 35.3s. Estimated remaining: 4h 35m 36s. Rate: 7.7 symbols/min [2025-09-26T17:33:24.762961] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-12. [2025-09-26T17:33:24.786440] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:33:24.807791] [DEBUG] [LOCAL ] BGB: Loaded 17478 existing records from primary storage. [2025-09-26T17:33:24.808002] [INFO ] [MAIN ] BGB: Loaded 17478 existing records. [2025-09-26T17:33:25.018114] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:33:25.026619] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-26T17:33:25.026830] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-09-26T17:33:25.029926] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-09-26T17:33:25.030156] [INFO ] [REMOTE ] BFS: Full fetch complete (12645 records). [2025-09-26T17:33:25.030256] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-09-26T17:33:25.063350] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-09-26T17:33:25.089516] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-09-26T17:33:25.565771] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-09-26T17:33:25.873223] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-09-26T17:33:25.873427] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-09-26T17:33:25.873773] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-09-26T17:33:25.874668] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-09-26T17:33:25.898423] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:33:25.898961] [DEBUG] [LOCAL ] BFS: Trimmed 12645 records to 9240 (keeping 200 days of data) [2025-09-26T17:33:25.962777] [DEBUG] [LOCAL ] BFS: Primary data saved (9240 records). [2025-09-26T17:33:25.962906] [INFO ] [MAIN ] BFS: Full history saved. [2025-09-26T17:33:25.962994] [INFO ] [MAIN ] Update Progress: 257/2371 symbols completed. BFS took 20.1s. Estimated remaining: 4h 34m 35s. Rate: 7.7 symbols/min [2025-09-26T17:33:26.140358] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:33:26.160933] [DEBUG] [LOCAL ] BGH: Loaded 16544 existing records from primary storage. [2025-09-26T17:33:26.161110] [INFO ] [MAIN ] BGH: Loaded 16544 existing records. [2025-09-26T17:33:26.359065] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-12. [2025-09-26T17:33:26.366231] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:33:26.366720] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-09-26T17:33:26.366792] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-09-26T17:33:26.367689] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-09-26T17:33:26.367819] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-09-26T17:33:26.481957] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-26T17:33:26.814819] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:33:26.844570] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-26T17:33:27.156735] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-09-26T17:33:27.521824] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-26T17:33:27.633019] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-26T17:33:27.956728] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-09-26T17:33:28.756763] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-09-26T17:33:29.556774] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-09-26T17:33:29.813918] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-26T17:33:29.838109] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-26T17:33:30.356748] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-12. [2025-09-26T17:33:30.708578] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-26T17:33:31.101088] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-26T17:33:31.156740] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-09-26T17:33:31.956730] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-09-26T17:33:32.002005] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-26T17:33:32.756754] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-09-26T17:33:33.556720] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-09-26T17:33:33.574127] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-26T17:33:33.653905] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-26T17:33:34.356733] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-09-26T17:33:34.478469] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-26T17:33:35.156738] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-09-26T17:33:35.956707] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-09-26T17:33:36.153514] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-26T17:33:36.203859] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-26T17:33:36.551966] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-26T17:33:36.756756] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-09-26T17:33:37.458120] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-26T17:33:37.556721] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-09-26T17:33:38.356746] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-09-26T17:33:38.752783] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-26T17:33:39.156744] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-09-26T17:33:39.237319] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-26T17:33:39.956757] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-09-26T17:33:40.756751] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-09-26T17:33:40.989189] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-26T17:33:41.286606] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-26T17:33:41.291033] [INFO ] [REMOTE ] BFZ: Full fetch complete (18061 records). [2025-09-26T17:33:41.291133] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-09-26T17:33:41.561863] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-09-26T17:33:41.683506] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-09-26T17:33:41.683594] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-09-26T17:33:41.683952] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-09-26T17:33:41.684017] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-09-26T17:33:41.685366] [DEBUG] [LOCAL ] BFZ: Trimmed 18061 records to 12223 (keeping 200 days of data) [2025-09-26T17:33:41.770190] [DEBUG] [LOCAL ] BFZ: Primary data saved (12223 records). [2025-09-26T17:33:41.770876] [INFO ] [MAIN ] BFZ: Full history saved. [2025-09-26T17:33:41.771008] [INFO ] [MAIN ] Update Progress: 258/2371 symbols completed. BFZ took 33.8s. Estimated remaining: 4h 35m 33s. Rate: 7.7 symbols/min [2025-09-26T17:33:41.875490] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-26T17:33:41.985798] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:33:42.003135] [DEBUG] [LOCAL ] BGR: Loaded 13568 existing records from primary storage. [2025-09-26T17:33:42.003305] [INFO ] [MAIN ] BGR: Loaded 13568 existing records. [2025-09-26T17:33:42.197760] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:33:42.198050] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-09-26T17:33:42.198102] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-09-26T17:33:42.198688] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-09-26T17:33:42.198752] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-09-26T17:33:42.361687] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-09-26T17:33:42.587714] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:33:43.156703] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-09-26T17:33:43.188491] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-26T17:33:43.629634] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-26T17:33:43.955332] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-26T17:33:43.959592] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-09-26T17:33:44.756773] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-09-26T17:33:45.556749] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-12. [2025-09-26T17:33:45.659249] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-26T17:33:45.691289] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-26T17:33:46.356697] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-09-26T17:33:46.444117] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-26T17:33:47.156745] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-09-26T17:33:47.194355] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-26T17:33:47.956738] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-09-26T17:33:48.059434] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-26T17:33:48.627582] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-26T17:33:48.756728] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-09-26T17:33:49.556733] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-09-26T17:33:49.842544] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-26T17:33:50.265632] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-26T17:33:50.356738] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-09-26T17:33:51.156718] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-09-26T17:33:51.346978] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-26T17:33:51.956732] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-09-26T17:33:52.756738] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-09-26T17:33:53.293335] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-26T17:33:53.422596] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-26T17:33:53.426342] [INFO ] [REMOTE ] BGH: Full fetch complete (21927 records). [2025-09-26T17:33:53.426426] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-09-26T17:33:53.561438] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-09-26T17:33:53.676902] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-26T17:33:53.863622] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-09-26T17:33:53.863740] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-09-26T17:33:53.864135] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-09-26T17:33:53.864199] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-09-26T17:33:53.865217] [DEBUG] [LOCAL ] BGH: Trimmed 21927 records to 16728 (keeping 200 days of data) [2025-09-26T17:33:53.973534] [DEBUG] [LOCAL ] BGH: Primary data saved (16728 records). [2025-09-26T17:33:53.973718] [INFO ] [MAIN ] BGH: Full history saved. [2025-09-26T17:33:53.973847] [INFO ] [MAIN ] Update Progress: 259/2371 symbols completed. BGH took 28.0s. Estimated remaining: 4h 36m 1s. Rate: 7.7 symbols/min [2025-09-26T17:33:54.159199] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:33:54.224159] [DEBUG] [LOCAL ] BGS: Loaded 50823 existing records from primary storage. [2025-09-26T17:33:54.224377] [INFO ] [MAIN ] BGS: Loaded 50823 existing records. [2025-09-26T17:33:54.361884] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-09-26T17:33:54.432207] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:33:54.432440] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-09-26T17:33:54.432489] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-09-26T17:33:54.433911] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-09-26T17:33:54.433973] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-09-26T17:33:54.815206] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:33:55.156725] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-09-26T17:33:55.448326] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-26T17:33:55.481716] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-26T17:33:55.485159] [INFO ] [REMOTE ] BGB: Full fetch complete (26924 records). [2025-09-26T17:33:55.485286] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-09-26T17:33:55.849312] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-26T17:33:55.926221] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-09-26T17:33:55.926313] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-09-26T17:33:55.926729] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-09-26T17:33:55.926799] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-09-26T17:33:55.927700] [DEBUG] [LOCAL ] BGB: Trimmed 26924 records to 17621 (keeping 200 days of data) [2025-09-26T17:33:55.978076] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-12. [2025-09-26T17:33:56.044331] [DEBUG] [LOCAL ] BGB: Primary data saved (17621 records). [2025-09-26T17:33:56.044467] [INFO ] [MAIN ] BGB: Full history saved. [2025-09-26T17:33:56.044557] [INFO ] [MAIN ] Update Progress: 260/2371 symbols completed. BGB took 31.5s. Estimated remaining: 4h 35m 6s. Rate: 7.7 symbols/min [2025-09-26T17:33:56.229296] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:33:56.229564] [DEBUG] [LOCAL ] BGSF: No existing data file found in primary storage. [2025-09-26T17:33:56.229614] [WARN ] [MAIN ] BGSF: No existing data found, performing full refresh instead. [2025-09-26T17:33:56.229853] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-09-26T17:33:56.229906] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-09-26T17:33:56.229954] [DEBUG] [LOCAL ] BGSF: No primary data file found to delete. [2025-09-26T17:33:56.230029] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-09-26T17:33:56.610166] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:33:56.756707] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-12. [2025-09-26T17:33:57.430268] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-26T17:33:57.556731] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-09-26T17:33:57.781380] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T17:33:58.356770] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-09-26T17:33:58.612897] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-26T17:33:58.701485] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-26T17:33:59.156735] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-09-26T17:33:59.956728] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-09-26T17:34:00.471338] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-26T17:34:00.756700] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-09-26T17:34:01.090483] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-26T17:34:01.100770] [INFO ] [REMOTE ] BG: Full fetch complete (72765 records). [2025-09-26T17:34:01.100920] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-09-26T17:34:01.548081] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-26T17:34:01.565498] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-09-26T17:34:01.595838] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-09-26T17:34:01.597471] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-09-26T17:34:01.598543] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-09-26T17:34:01.598750] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-09-26T17:34:01.600497] [DEBUG] [LOCAL ] BG: Trimmed 72765 records to 51118 (keeping 200 days of data) [2025-09-26T17:34:01.933519] [DEBUG] [LOCAL ] BG: Primary data saved (51118 records). [2025-09-26T17:34:01.933706] [INFO ] [MAIN ] BG: Full history saved. [2025-09-26T17:34:01.933816] [INFO ] [MAIN ] Update Progress: 261/2371 symbols completed. BG took 40.6s. Estimated remaining: 4h 34m 43s. Rate: 7.7 symbols/min [2025-09-26T17:34:02.130194] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:34:02.130502] [DEBUG] [LOCAL ] BGT: No existing data file found in primary storage. [2025-09-26T17:34:02.130556] [WARN ] [MAIN ] BGT: No existing data found, performing full refresh instead. [2025-09-26T17:34:02.130825] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-09-26T17:34:02.130880] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-09-26T17:34:02.130925] [DEBUG] [LOCAL ] BGT: No primary data file found to delete. [2025-09-26T17:34:02.130958] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-09-26T17:34:02.366003] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-09-26T17:34:02.543721] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:34:03.156750] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-09-26T17:34:03.250488] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-26T17:34:03.293286] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-26T17:34:03.537500] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-26T17:34:03.956749] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-09-26T17:34:04.427471] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-26T17:34:04.756759] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-09-26T17:34:05.168407] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-26T17:34:05.556725] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-09-26T17:34:06.356748] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-09-26T17:34:07.156760] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-09-26T17:34:07.185022] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-26T17:34:07.310156] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-26T17:34:07.953788] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-26T17:34:07.957247] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-09-26T17:34:08.756747] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-09-26T17:34:09.253789] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-26T17:34:09.556725] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-09-26T17:34:09.699966] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-26T17:34:10.356754] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-09-26T17:34:10.802883] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-26T17:34:11.156758] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-12. [2025-09-26T17:34:11.229031] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-26T17:34:11.927110] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-26T17:34:11.956716] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-09-26T17:34:12.756718] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-09-26T17:34:13.014228] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-26T17:34:13.556687] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-09-26T17:34:13.840839] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-26T17:34:13.843973] [INFO ] [REMOTE ] BGR: Full fetch complete (20230 records). [2025-09-26T17:34:13.844064] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-09-26T17:34:14.235284] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-09-26T17:34:14.235378] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-09-26T17:34:14.235757] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-09-26T17:34:14.235825] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-09-26T17:34:14.236557] [DEBUG] [LOCAL ] BGR: Trimmed 20230 records to 13658 (keeping 200 days of data) [2025-09-26T17:34:14.327542] [DEBUG] [LOCAL ] BGR: Primary data saved (13658 records). [2025-09-26T17:34:14.327746] [INFO ] [MAIN ] BGR: Full history saved. [2025-09-26T17:34:14.327858] [INFO ] [MAIN ] Update Progress: 262/2371 symbols completed. BGR took 32.6s. Estimated remaining: 4h 35m 12s. Rate: 7.7 symbols/min [2025-09-26T17:34:14.361822] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-09-26T17:34:14.546520] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:34:14.559486] [DEBUG] [LOCAL ] BGX: Loaded 10782 existing records from primary storage. [2025-09-26T17:34:14.559670] [INFO ] [MAIN ] BGX: Loaded 10782 existing records. [2025-09-26T17:34:14.753311] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:34:14.753965] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-09-26T17:34:14.754083] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-09-26T17:34:14.754711] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-09-26T17:34:14.754773] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-09-26T17:34:15.023562] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-26T17:34:15.059333] [INFO ] [REMOTE ] BGSF: Full fetch complete (8330 records). [2025-09-26T17:34:15.071079] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-09-26T17:34:15.180702] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-09-26T17:34:15.278948] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:34:15.569740] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-09-26T17:34:15.569836] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-09-26T17:34:15.570063] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-09-26T17:34:15.570106] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-09-26T17:34:15.570725] [DEBUG] [LOCAL ] BGSF: Trimmed 8330 records to 7050 (keeping 200 days of data) [2025-09-26T17:34:15.612361] [DEBUG] [LOCAL ] BGSF: Primary data saved (7050 records). [2025-09-26T17:34:15.612506] [INFO ] [MAIN ] BGSF: Full history saved. [2025-09-26T17:34:15.612589] [INFO ] [MAIN ] Update Progress: 263/2371 symbols completed. BGSF took 19.6s. Estimated remaining: 4h 34m 12s. Rate: 7.7 symbols/min [2025-09-26T17:34:15.802253] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:34:15.825155] [DEBUG] [LOCAL ] BGY: Loaded 22657 existing records from primary storage. [2025-09-26T17:34:15.825291] [INFO ] [MAIN ] BGY: Loaded 22657 existing records. [2025-09-26T17:34:15.964305] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-12. [2025-09-26T17:34:16.028804] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:34:16.029208] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-09-26T17:34:16.029285] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-09-26T17:34:16.040156] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-09-26T17:34:16.040496] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-09-26T17:34:16.153101] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-26T17:34:16.393258] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-26T17:34:16.466625] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:34:16.756724] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-09-26T17:34:16.923972] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-26T17:34:17.427518] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-26T17:34:17.556751] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-09-26T17:34:18.199799] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-26T17:34:18.356728] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-09-26T17:34:19.151129] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-26T17:34:19.156673] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-09-26T17:34:19.956740] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-09-26T17:34:20.028637] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-26T17:34:20.756706] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-09-26T17:34:20.989365] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-26T17:34:21.556729] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-09-26T17:34:22.356716] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-12. [2025-09-26T17:34:22.527790] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-26T17:34:22.677329] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-26T17:34:23.156727] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-09-26T17:34:23.373508] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-26T17:34:23.823688] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-26T17:34:23.956762] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-09-26T17:34:24.756748] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-09-26T17:34:25.556702] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-09-26T17:34:25.640365] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-26T17:34:25.781027] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-26T17:34:26.356753] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-09-26T17:34:26.424294] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-26T17:34:27.156732] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-09-26T17:34:27.956703] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-09-26T17:34:28.233307] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-26T17:34:28.260147] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-26T17:34:28.756696] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-09-26T17:34:28.842696] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-26T17:34:29.556739] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-09-26T17:34:30.356735] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-09-26T17:34:30.510249] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-26T17:34:30.631695] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-26T17:34:31.156742] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-09-26T17:34:31.279776] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-26T17:34:31.956739] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-09-26T17:34:32.176331] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-26T17:34:32.756739] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-09-26T17:34:33.316107] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-26T17:34:33.556739] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-09-26T17:34:33.611367] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T17:34:33.622008] [INFO ] [REMOTE ] BGS: Full fetch complete (72492 records). [2025-09-26T17:34:33.622178] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-09-26T17:34:34.036829] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-09-26T17:34:34.036917] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-09-26T17:34:34.037723] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-09-26T17:34:34.037812] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-09-26T17:34:34.039368] [DEBUG] [LOCAL ] BGS: Trimmed 72492 records to 51183 (keeping 200 days of data) [2025-09-26T17:34:34.356135] [DEBUG] [LOCAL ] BGS: Primary data saved (51183 records). [2025-09-26T17:34:34.356375] [INFO ] [MAIN ] BGS: Full history saved. [2025-09-26T17:34:34.359141] [INFO ] [MAIN ] Update Progress: 264/2371 symbols completed. BGS took 40.4s. Estimated remaining: 4h 35m 31s. Rate: 7.6 symbols/min [2025-09-26T17:34:34.359215] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-09-26T17:34:34.581138] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:34:34.605546] [DEBUG] [LOCAL ] BH: Loaded 15800 existing records from primary storage. [2025-09-26T17:34:34.605710] [INFO ] [MAIN ] BH: Loaded 15800 existing records. [2025-09-26T17:34:34.796737] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:34:34.797236] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-09-26T17:34:34.797295] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-09-26T17:34:34.797926] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-09-26T17:34:34.797988] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-09-26T17:34:35.042276] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-26T17:34:35.137931] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-26T17:34:35.156944] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-09-26T17:34:35.220076] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:34:35.956769] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-09-26T17:34:36.288946] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-26T17:34:36.591009] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-26T17:34:36.756742] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-09-26T17:34:37.408499] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-26T17:34:37.411617] [INFO ] [REMOTE ] BGX: Full fetch complete (15855 records). [2025-09-26T17:34:37.411723] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-09-26T17:34:37.561886] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-12. [2025-09-26T17:34:37.817239] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-09-26T17:34:37.817323] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-09-26T17:34:37.817610] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-09-26T17:34:37.817676] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-09-26T17:34:37.818291] [DEBUG] [LOCAL ] BGX: Trimmed 15855 records to 10900 (keeping 200 days of data) [2025-09-26T17:34:37.884932] [DEBUG] [LOCAL ] BGX: Primary data saved (10900 records). [2025-09-26T17:34:37.885065] [INFO ] [MAIN ] BGX: Full history saved. [2025-09-26T17:34:37.885167] [INFO ] [MAIN ] Update Progress: 265/2371 symbols completed. BGX took 23.6s. Estimated remaining: 4h 34m 49s. Rate: 7.7 symbols/min [2025-09-26T17:34:38.077417] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:34:38.132907] [DEBUG] [LOCAL ] BHC: Loaded 47170 existing records from primary storage. [2025-09-26T17:34:38.133081] [INFO ] [MAIN ] BHC: Loaded 47170 existing records. [2025-09-26T17:34:38.330734] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:34:38.331053] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-09-26T17:34:38.331121] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-09-26T17:34:38.332320] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-09-26T17:34:38.332380] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-09-26T17:34:38.364819] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-09-26T17:34:38.720393] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-26T17:34:38.725922] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:34:39.156741] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-12. [2025-09-26T17:34:39.267995] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-26T17:34:39.956727] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-09-26T17:34:40.695000] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-26T17:34:40.756746] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-09-26T17:34:41.015922] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-26T17:34:41.519272] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-26T17:34:41.556727] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-09-26T17:34:42.356717] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-09-26T17:34:42.677471] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-26T17:34:42.681235] [INFO ] [REMOTE ] BGT: Full fetch complete (24333 records). [2025-09-26T17:34:42.681332] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-09-26T17:34:43.071905] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-09-26T17:34:43.071998] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-09-26T17:34:43.072358] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-09-26T17:34:43.072414] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-09-26T17:34:43.073210] [DEBUG] [LOCAL ] BGT: Trimmed 24333 records to 16793 (keeping 200 days of data) [2025-09-26T17:34:43.160003] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-09-26T17:34:43.190136] [DEBUG] [LOCAL ] BGT: Primary data saved (16793 records). [2025-09-26T17:34:43.190576] [INFO ] [MAIN ] BGT: Full history saved. [2025-09-26T17:34:43.190868] [INFO ] [MAIN ] Update Progress: 266/2371 symbols completed. BGT took 41.3s. Estimated remaining: 4h 34m 21s. Rate: 7.7 symbols/min [2025-09-26T17:34:43.380393] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:34:43.407457] [DEBUG] [LOCAL ] BHE: Loaded 25227 existing records from primary storage. [2025-09-26T17:34:43.407636] [INFO ] [MAIN ] BHE: Loaded 25227 existing records. [2025-09-26T17:34:43.603000] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:34:43.603257] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-09-26T17:34:43.603311] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-09-26T17:34:43.604133] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-09-26T17:34:43.604196] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-09-26T17:34:43.959474] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-09-26T17:34:44.015990] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:34:44.044993] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-26T17:34:44.067568] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-26T17:34:44.623847] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-26T17:34:44.756738] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-09-26T17:34:45.556730] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-09-26T17:34:46.067867] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-26T17:34:46.356734] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-09-26T17:34:46.803566] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-26T17:34:46.807395] [INFO ] [REMOTE ] BGY: Full fetch complete (33325 records). [2025-09-26T17:34:46.807490] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-09-26T17:34:47.161877] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-12. [2025-09-26T17:34:47.240350] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-09-26T17:34:47.240441] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-09-26T17:34:47.240887] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-09-26T17:34:47.240955] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-09-26T17:34:47.241773] [DEBUG] [LOCAL ] BGY: Trimmed 33325 records to 22790 (keeping 200 days of data) [2025-09-26T17:34:47.378396] [DEBUG] [LOCAL ] BGY: Primary data saved (22790 records). [2025-09-26T17:34:47.378536] [INFO ] [MAIN ] BGY: Full history saved. [2025-09-26T17:34:47.378624] [INFO ] [MAIN ] Update Progress: 267/2371 symbols completed. BGY took 31.8s. Estimated remaining: 4h 33m 45s. Rate: 7.7 symbols/min [2025-09-26T17:34:47.580380] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:34:47.605791] [DEBUG] [LOCAL ] BHK: Loaded 22729 existing records from primary storage. [2025-09-26T17:34:47.606031] [INFO ] [MAIN ] BHK: Loaded 22729 existing records. [2025-09-26T17:34:47.817138] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:34:47.817572] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-09-26T17:34:47.817782] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-09-26T17:34:47.818708] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-09-26T17:34:47.818770] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-09-26T17:34:47.958793] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-09-26T17:34:48.181601] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-26T17:34:48.264169] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:34:48.490394] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-26T17:34:48.598960] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-26T17:34:48.756748] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-09-26T17:34:49.556760] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-12. [2025-09-26T17:34:49.809890] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-26T17:34:50.356717] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-09-26T17:34:50.382365] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-26T17:34:51.156712] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-09-26T17:34:51.561117] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-26T17:34:51.590735] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-26T17:34:51.956716] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-09-26T17:34:52.673285] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-26T17:34:52.756720] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-09-26T17:34:53.401607] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-26T17:34:53.556712] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-09-26T17:34:54.356728] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-09-26T17:34:54.616223] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-26T17:34:55.156764] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-09-26T17:34:55.759511] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-26T17:34:55.792733] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-26T17:34:55.956787] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-09-26T17:34:56.756728] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-09-26T17:34:57.326593] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-26T17:34:57.556742] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-09-26T17:34:57.911281] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-26T17:34:58.356770] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-09-26T17:34:59.080986] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T17:34:59.156801] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-09-26T17:34:59.631933] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-26T17:34:59.956719] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-09-26T17:35:00.181010] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-26T17:35:00.756758] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-09-26T17:35:01.325924] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-26T17:35:01.495805] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-26T17:35:01.556734] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-09-26T17:35:02.356703] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-09-26T17:35:02.882098] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-26T17:35:03.156720] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-09-26T17:35:03.404973] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-26T17:35:03.956743] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-09-26T17:35:04.038211] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-26T17:35:04.756777] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-09-26T17:35:05.476511] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-26T17:35:05.553563] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-26T17:35:05.559204] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-09-26T17:35:06.356728] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-09-26T17:35:06.887678] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-26T17:35:06.893531] [INFO ] [REMOTE ] BHK: Full fetch complete (29740 records). [2025-09-26T17:35:06.893779] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-09-26T17:35:07.161468] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-09-26T17:35:07.329133] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-26T17:35:07.341043] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-09-26T17:35:07.341799] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-09-26T17:35:07.342470] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-09-26T17:35:07.342562] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-09-26T17:35:07.341939] [INFO ] [REMOTE ] BH: Full fetch complete (19322 records). [2025-09-26T17:35:07.342768] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-09-26T17:35:07.343603] [FATAL] [VALIDATOR ] BH: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:35:07.344108] [FATAL] [MAIN ] BH: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:35:07.344450] [WARN ] [MAIN ] BH: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:35:07.344539] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-09-26T17:35:07.344696] [DEBUG] [LOCAL ] BHK: Trimmed 29740 records to 22922 (keeping 200 days of data) [2025-09-26T17:35:07.344921] [DEBUG] [LOCAL ] BH: No primary data file found to delete. [2025-09-26T17:35:07.345317] [INFO ] [LOCAL ] BH: Starting deletion of derivative data. [2025-09-26T17:35:07.346371] [DEBUG] [LOCAL ] BH: Deleted derivative data file. [2025-09-26T17:35:07.346496] [INFO ] [MAIN ] Update Progress: 268/2371 symbols completed. BH took 33.0s. Estimated remaining: 4h 35m 12s. Rate: 7.6 symbols/min [2025-09-26T17:35:07.652295] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:35:07.705444] [DEBUG] [LOCAL ] BHK: Primary data saved (22922 records). [2025-09-26T17:35:07.705590] [INFO ] [MAIN ] BHK: Full history saved. [2025-09-26T17:35:07.705706] [INFO ] [MAIN ] Update Progress: 269/2371 symbols completed. BHK took 20.3s. Estimated remaining: 4h 34m 6s. Rate: 7.7 symbols/min [2025-09-26T17:35:07.933297] [DEBUG] [LOCAL ] BHP: Loaded 53763 existing records from primary storage. [2025-09-26T17:35:07.935416] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:35:07.935625] [INFO ] [MAIN ] BHP: Loaded 53763 existing records. [2025-09-26T17:35:07.961964] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-09-26T17:35:08.145503] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:35:08.153340] [DEBUG] [LOCAL ] BHR: Loaded 21634 existing records from primary storage. [2025-09-26T17:35:08.153595] [INFO ] [MAIN ] BHR: Loaded 21634 existing records. [2025-09-26T17:35:08.153495] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-09-26T17:35:08.158852] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-09-26T17:35:08.241551] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-09-26T17:35:08.270127] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-09-26T17:35:08.496902] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:35:08.517123] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-09-26T17:35:08.522455] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-09-26T17:35:08.566142] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-09-26T17:35:08.636057] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-09-26T17:35:08.871402] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:35:08.898253] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-12. [2025-09-26T17:35:09.182900] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-26T17:35:09.258960] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:35:09.273544] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-26T17:35:09.556726] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-09-26T17:35:10.356728] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-09-26T17:35:10.762276] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-26T17:35:10.937405] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-26T17:35:11.156758] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-12. [2025-09-26T17:35:11.629384] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-26T17:35:11.946608] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-26T17:35:11.956687] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-09-26T17:35:12.756740] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-09-26T17:35:12.996200] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-26T17:35:13.556730] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-09-26T17:35:14.356729] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-09-26T17:35:14.607874] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-26T17:35:14.629411] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-26T17:35:15.156740] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-09-26T17:35:15.840424] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-26T17:35:15.956754] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-09-26T17:35:16.756780] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-09-26T17:35:17.136124] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-26T17:35:17.343192] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-26T17:35:17.556725] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-09-26T17:35:18.356712] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-09-26T17:35:18.569977] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-26T17:35:18.581164] [INFO ] [REMOTE ] BHC: Full fetch complete (66893 records). [2025-09-26T17:35:18.581368] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-09-26T17:35:18.767327] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-26T17:35:18.884093] [INFO ] [REMOTE ] BHE: Full fetch complete (36380 records). [2025-09-26T17:35:18.932130] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-09-26T17:35:18.947340] [FATAL] [VALIDATOR ] BHE: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:35:18.977203] [FATAL] [MAIN ] BHE: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:35:18.991225] [WARN ] [MAIN ] BHE: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:35:19.022691] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-09-26T17:35:19.040256] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-09-26T17:35:19.040524] [DEBUG] [LOCAL ] BHE: No primary data file found to delete. [2025-09-26T17:35:19.040780] [INFO ] [LOCAL ] BHE: Starting deletion of derivative data. [2025-09-26T17:35:19.040858] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-09-26T17:35:19.041746] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-09-26T17:35:19.041799] [DEBUG] [LOCAL ] BHE: Deleted derivative data file. [2025-09-26T17:35:19.042004] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-09-26T17:35:19.042181] [INFO ] [MAIN ] Update Progress: 270/2371 symbols completed. BHE took 35.9s. Estimated remaining: 4h 34m 25s. Rate: 7.7 symbols/min [2025-09-26T17:35:19.156799] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-09-26T17:35:19.145877] [DEBUG] [LOCAL ] BHC: Trimmed 66893 records to 47495 (keeping 200 days of data) [2025-09-26T17:35:19.336833] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:35:19.363982] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-09-26T17:35:19.364062] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-09-26T17:35:19.364449] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-09-26T17:35:19.364546] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-26T17:35:19.364612] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-26T17:35:19.364693] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-09-26T17:35:19.822038] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-26T17:35:19.969552] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-09-26T17:35:19.975891] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:35:19.969736] [DEBUG] [LOCAL ] BHC: Primary data saved (47495 records). [2025-09-26T17:35:19.977666] [INFO ] [MAIN ] BHC: Full history saved. [2025-09-26T17:35:19.977818] [INFO ] [MAIN ] Update Progress: 271/2371 symbols completed. BHC took 42.1s. Estimated remaining: 4h 33m 24s. Rate: 7.7 symbols/min [2025-09-26T17:35:20.162379] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:35:20.210586] [DEBUG] [LOCAL ] BHVN: Loaded 50018 existing records from primary storage. [2025-09-26T17:35:20.210768] [INFO ] [MAIN ] BHVN: Loaded 50018 existing records. [2025-09-26T17:35:20.400874] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:35:20.401189] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-09-26T17:35:20.401249] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-09-26T17:35:20.402683] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-09-26T17:35:20.402758] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-09-26T17:35:20.761917] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-09-26T17:35:20.801734] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:35:21.418117] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-26T17:35:21.421749] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-26T17:35:21.462924] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-26T17:35:21.556719] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-09-26T17:35:22.356736] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-09-26T17:35:22.881754] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-26T17:35:23.156761] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-12. [2025-09-26T17:35:23.956732] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-09-26T17:35:24.207472] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-26T17:35:24.241273] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-09-26T17:35:24.756747] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-09-26T17:35:24.811407] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-26T17:35:25.056230] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-26T17:35:25.556748] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-09-26T17:35:26.356773] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-09-26T17:35:26.710799] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-26T17:35:27.156753] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-09-26T17:35:27.311283] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-26T17:35:27.532078] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-26T17:35:27.956774] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-09-26T17:35:28.756768] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-09-26T17:35:29.339088] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-26T17:35:29.556728] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-09-26T17:35:30.356826] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-09-26T17:35:30.646300] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-26T17:35:30.649554] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-26T17:35:30.820384] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-26T17:35:31.156775] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-09-26T17:35:31.956763] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-09-26T17:35:32.756775] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-09-26T17:35:32.940417] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-26T17:35:33.116193] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-26T17:35:33.556764] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-09-26T17:35:34.012954] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-26T17:35:34.280669] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T17:35:34.356713] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-09-26T17:35:34.708397] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-26T17:35:35.156793] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-09-26T17:35:35.956747] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-09-26T17:35:36.756760] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-09-26T17:35:37.301096] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-26T17:35:37.341683] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-26T17:35:37.556723] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-09-26T17:35:37.678677] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-26T17:35:38.356730] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-09-26T17:35:38.663080] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-26T17:35:38.857295] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-26T17:35:39.156744] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-09-26T17:35:39.956764] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-09-26T17:35:40.756750] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-09-26T17:35:40.941223] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-26T17:35:41.556764] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-09-26T17:35:41.643760] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-26T17:35:41.681501] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-26T17:35:42.356764] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-09-26T17:35:42.926821] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-26T17:35:43.156729] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-09-26T17:35:43.741153] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-26T17:35:43.767707] [INFO ] [REMOTE ] BHVN: Full fetch complete (69623 records). [2025-09-26T17:35:43.768833] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-26T17:35:43.768947] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-09-26T17:35:43.775099] [INFO ] [REMOTE ] BHR: Full fetch complete (30571 records). [2025-09-26T17:35:43.775223] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-09-26T17:35:43.961800] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-09-26T17:35:44.690686] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-09-26T17:35:44.690540] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-09-26T17:35:44.690838] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-09-26T17:35:44.690883] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-09-26T17:35:44.691232] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-09-26T17:35:44.692018] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-09-26T17:35:44.692104] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-09-26T17:35:44.692354] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-09-26T17:35:44.693354] [DEBUG] [LOCAL ] BHR: Trimmed 30571 records to 21771 (keeping 200 days of data) [2025-09-26T17:35:44.742698] [DEBUG] [LOCAL ] BHVN: Trimmed 69623 records to 50401 (keeping 200 days of data) [2025-09-26T17:35:44.778800] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-09-26T17:35:44.925252] [DEBUG] [LOCAL ] BHR: Primary data saved (21771 records). [2025-09-26T17:35:44.925625] [INFO ] [MAIN ] BHR: Full history saved. [2025-09-26T17:35:44.926045] [INFO ] [MAIN ] Update Progress: 272/2371 symbols completed. BHR took 37.2s. Estimated remaining: 4h 35m 29s. Rate: 7.6 symbols/min [2025-09-26T17:35:45.154503] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:35:45.339823] [DEBUG] [LOCAL ] BILL: Loaded 52715 existing records from primary storage. [2025-09-26T17:35:45.358790] [INFO ] [MAIN ] BILL: Loaded 52715 existing records. [2025-09-26T17:35:45.509088] [DEBUG] [LOCAL ] BHVN: Primary data saved (50401 records). [2025-09-26T17:35:45.539338] [INFO ] [MAIN ] BHVN: Full history saved. [2025-09-26T17:35:45.566397] [INFO ] [MAIN ] Update Progress: 273/2371 symbols completed. BHVN took 25.6s. Estimated remaining: 4h 34m 25s. Rate: 7.6 symbols/min [2025-09-26T17:35:45.572860] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:35:45.588179] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-09-26T17:35:45.621934] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-09-26T17:35:45.628274] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-26T17:35:45.642943] [INFO ] [REMOTE ] BHV: Full fetch complete (1368 records). [2025-09-26T17:35:45.657200] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-09-26T17:35:45.664342] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-09-26T17:35:45.669625] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-09-26T17:35:45.987030] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:35:46.204003] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-26T17:35:46.216873] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:35:46.237178] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:35:46.253728] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-26T17:35:46.292278] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-26T17:35:46.293147] [DEBUG] [LOCAL ] BIO: Loaded 25432 existing records from primary storage. [2025-09-26T17:35:46.293350] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-09-26T17:35:46.293747] [INFO ] [MAIN ] BIO: Loaded 25432 existing records. [2025-09-26T17:35:46.310128] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-09-26T17:35:46.337190] [INFO ] [MAIN ] Update Progress: 274/2371 symbols completed. BHV took 27.3s. Estimated remaining: 4h 33m 23s. Rate: 7.7 symbols/min [2025-09-26T17:35:46.448959] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:35:46.492960] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-12. [2025-09-26T17:35:46.758098] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:35:46.766472] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (2.80 seconds). [2025-09-26T17:35:46.795159] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-09-26T17:35:46.848403] [INFO ] [REMOTE ] BHP: Full fetch complete (77245 records). [2025-09-26T17:35:46.818102] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-09-26T17:35:46.852370] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-09-26T17:35:46.852249] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:35:46.859191] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-09-26T17:35:46.903334] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-09-26T17:35:47.320156] [DEBUG] [LOCAL ] BIP: Loaded 39863 existing records from primary storage. [2025-09-26T17:35:47.406376] [INFO ] [MAIN ] BIP: Loaded 39863 existing records. [2025-09-26T17:35:47.861074] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-09-26T17:35:47.952661] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-09-26T17:35:48.012560] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:35:48.023767] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:35:48.024711] [INFO ] [REMOTE ] BIO: Fetching primary data for 2024-12. [2025-09-26T17:35:48.020250] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-09-26T17:35:48.026892] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-09-26T17:35:48.027024] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-09-26T17:35:48.027312] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-09-26T17:35:48.028921] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-09-26T17:35:48.029114] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-09-26T17:35:48.112973] [DEBUG] [LOCAL ] BHP: Trimmed 77245 records to 54153 (keeping 200 days of data) [2025-09-26T17:35:48.669265] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:35:48.670142] [INFO ] [REMOTE ] BIP: Fetching primary data for 2024-12. [2025-09-26T17:35:48.786353] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-09-26T17:35:48.816107] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-09-26T17:35:48.844570] [DEBUG] [LOCAL ] BHP: Primary data saved (54153 records). [2025-09-26T17:35:48.844765] [INFO ] [MAIN ] BHP: Full history saved. [2025-09-26T17:35:48.846504] [INFO ] [MAIN ] Update Progress: 275/2371 symbols completed. BHP took 41.5s. Estimated remaining: 4h 32m 35s. Rate: 7.7 symbols/min [2025-09-26T17:35:49.038108] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:35:49.053077] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-26T17:35:49.057518] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-09-26T17:35:49.113817] [DEBUG] [LOCAL ] BIPC: Loaded 42014 existing records from primary storage. [2025-09-26T17:35:49.113990] [INFO ] [MAIN ] BIPC: Loaded 42014 existing records. [2025-09-26T17:35:49.323131] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:35:49.323405] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-09-26T17:35:49.323455] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-09-26T17:35:49.324616] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-09-26T17:35:49.324707] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-09-26T17:35:49.747708] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:35:49.748492] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2024-12. [2025-09-26T17:35:49.824257] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-26T17:35:49.915848] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-26T17:35:50.118552] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-26T17:35:50.356717] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-09-26T17:35:50.911057] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-26T17:35:51.156785] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-09-26T17:35:51.389556] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-26T17:35:51.929879] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-26T17:35:51.956728] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-09-26T17:35:52.756765] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-09-26T17:35:53.164883] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-26T17:35:53.556732] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-09-26T17:35:53.805557] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-26T17:35:54.356839] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-09-26T17:35:54.658921] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-26T17:35:55.156785] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-09-26T17:35:55.956769] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-09-26T17:35:56.253034] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-26T17:35:56.601239] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-26T17:35:56.756741] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-09-26T17:35:57.145070] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-26T17:35:57.556739] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-09-26T17:35:58.054724] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-26T17:35:58.356734] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-09-26T17:35:59.156741] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-09-26T17:35:59.234445] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-26T17:35:59.405055] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-26T17:35:59.956771] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-09-26T17:36:00.756761] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-09-26T17:36:01.113911] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-26T17:36:01.336760] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-26T17:36:01.556737] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-09-26T17:36:02.096806] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-26T17:36:02.356773] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-09-26T17:36:02.422031] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-26T17:36:03.156776] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-09-26T17:36:03.920353] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-26T17:36:03.956763] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-09-26T17:36:04.756760] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-09-26T17:36:05.057215] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-26T17:36:05.062964] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-26T17:36:05.556734] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-09-26T17:36:05.843088] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-26T17:36:06.356776] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-09-26T17:36:07.156738] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-09-26T17:36:07.411481] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-26T17:36:07.527185] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-26T17:36:07.956771] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-09-26T17:36:08.562681] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-26T17:36:08.756772] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-09-26T17:36:09.386798] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-26T17:36:09.556730] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-09-26T17:36:09.768210] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-26T17:36:10.356748] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-09-26T17:36:10.476924] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-26T17:36:11.156777] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-09-26T17:36:11.958945] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-09-26T17:36:11.965037] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-26T17:36:12.756760] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-09-26T17:36:13.015612] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-26T17:36:13.211577] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-26T17:36:13.216180] [INFO ] [REMOTE ] BIO: Full fetch complete (34146 records). [2025-09-26T17:36:13.216356] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-09-26T17:36:13.561855] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-09-26T17:36:13.627908] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-09-26T17:36:13.628025] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-09-26T17:36:13.628515] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-09-26T17:36:13.628560] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-09-26T17:36:13.629571] [DEBUG] [LOCAL ] BIO: Trimmed 34146 records to 25533 (keeping 200 days of data) [2025-09-26T17:36:13.814779] [DEBUG] [LOCAL ] BIO: Primary data saved (25533 records). [2025-09-26T17:36:13.814985] [INFO ] [MAIN ] BIO: Full history saved. [2025-09-26T17:36:13.815156] [INFO ] [MAIN ] Update Progress: 276/2371 symbols completed. BIO took 28.2s. Estimated remaining: 4h 34m 37s. Rate: 7.6 symbols/min [2025-09-26T17:36:14.029004] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:36:14.034024] [DEBUG] [LOCAL ] BIPH: Loaded 2608 existing records from primary storage. [2025-09-26T17:36:14.034126] [INFO ] [MAIN ] BIPH: Loaded 2608 existing records. [2025-09-26T17:36:14.246072] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:36:14.246579] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-09-26T17:36:14.246680] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-09-26T17:36:14.246963] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-09-26T17:36:14.247027] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-09-26T17:36:14.362393] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-09-26T17:36:14.654380] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-26T17:36:14.745359] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:36:15.088306] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-26T17:36:15.156767] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2024-12. [2025-09-26T17:36:15.644186] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-26T17:36:15.946167] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-26T17:36:15.957243] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-09-26T17:36:16.756776] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-09-26T17:36:17.556718] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-09-26T17:36:17.590427] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-26T17:36:17.601025] [INFO ] [REMOTE ] BIP: Full fetch complete (56617 records). [2025-09-26T17:36:17.601210] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-09-26T17:36:18.024461] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-09-26T17:36:18.024699] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-09-26T17:36:18.025481] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-09-26T17:36:18.025630] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-09-26T17:36:18.033366] [DEBUG] [LOCAL ] BIP: Trimmed 56617 records to 40240 (keeping 200 days of data) [2025-09-26T17:36:18.120147] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-26T17:36:18.163775] [INFO ] [REMOTE ] BIPC: Full fetch complete (59708 records). [2025-09-26T17:36:18.166908] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-09-26T17:36:18.360960] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-09-26T17:36:18.629717] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-09-26T17:36:18.629840] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-09-26T17:36:18.630733] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-09-26T17:36:18.631905] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-09-26T17:36:18.636134] [DEBUG] [LOCAL ] BIPC: Trimmed 59708 records to 42317 (keeping 200 days of data) [2025-09-26T17:36:19.016688] [DEBUG] [LOCAL ] BIP: Primary data saved (40240 records). [2025-09-26T17:36:19.017600] [INFO ] [MAIN ] BIP: Full history saved. [2025-09-26T17:36:19.017772] [INFO ] [MAIN ] Update Progress: 277/2371 symbols completed. BIP took 32.6s. Estimated remaining: 4h 34m 9s. Rate: 7.6 symbols/min [2025-09-26T17:36:19.058957] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-26T17:36:19.068206] [DEBUG] [LOCAL ] BIPC: Primary data saved (42317 records). [2025-09-26T17:36:19.068381] [INFO ] [MAIN ] BIPC: Full history saved. [2025-09-26T17:36:19.069857] [INFO ] [MAIN ] Update Progress: 278/2371 symbols completed. BIPC took 30.2s. Estimated remaining: 4h 33m 3s. Rate: 7.7 symbols/min [2025-09-26T17:36:19.156778] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-09-26T17:36:19.516169] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-26T17:36:19.528176] [INFO ] [REMOTE ] BILL: Full fetch complete (75595 records). [2025-09-26T17:36:19.528386] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-09-26T17:36:19.629243] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-26T17:36:19.970033] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-09-26T17:36:19.974599] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-09-26T17:36:19.974683] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-09-26T17:36:19.975460] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-09-26T17:36:19.975675] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-09-26T17:36:19.978888] [DEBUG] [LOCAL ] BILL: Trimmed 75595 records to 53105 (keeping 200 days of data) [2025-09-26T17:36:20.313558] [DEBUG] [LOCAL ] BILL: Primary data saved (53105 records). [2025-09-26T17:36:20.313802] [INFO ] [MAIN ] BILL: Full history saved. [2025-09-26T17:36:20.313927] [INFO ] [MAIN ] Update Progress: 279/2371 symbols completed. BILL took 35.4s. Estimated remaining: 4h 32m 5s. Rate: 7.7 symbols/min [2025-09-26T17:36:20.512883] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-26T17:36:20.756746] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-09-26T17:36:21.225413] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-26T17:36:21.556727] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-09-26T17:36:21.991520] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-26T17:36:22.356794] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-09-26T17:36:22.808960] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-26T17:36:23.156756] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-09-26T17:36:23.451015] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-26T17:36:23.956767] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-09-26T17:36:24.325025] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-26T17:36:24.756754] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-09-26T17:36:25.357862] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-26T17:36:25.358943] [INFO ] [REMOTE ] BIPH: Full fetch complete (4318 records). [2025-09-26T17:36:25.359013] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-09-26T17:36:25.754902] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-09-26T17:36:25.754987] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-09-26T17:36:25.755128] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-09-26T17:36:25.755167] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-09-26T17:36:25.755668] [DEBUG] [LOCAL ] BIPH: Trimmed 4318 records to 2632 (keeping 200 days of data) [2025-09-26T17:36:25.774590] [DEBUG] [LOCAL ] BIPH: Primary data saved (2632 records). [2025-09-26T17:36:25.774754] [INFO ] [MAIN ] BIPH: Full history saved. [2025-09-26T17:36:25.774854] [INFO ] [MAIN ] Update Progress: 280/2371 symbols completed. BIPH took 12.0s. Estimated remaining: 4h 31m 40s. Rate: 7.7 symbols/min [2025-09-26T17:36:26.494254] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:36:26.511223] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:36:26.556955] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:36:26.561123] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:36:26.571950] [DEBUG] [LOCAL ] BIPI: Loaded 3269 existing records from primary storage. [2025-09-26T17:36:26.572261] [INFO ] [MAIN ] BIPI: Loaded 3269 existing records. [2025-09-26T17:36:26.652948] [DEBUG] [LOCAL ] BIPJ: Loaded 3002 existing records from primary storage. [2025-09-26T17:36:26.685314] [INFO ] [MAIN ] BIPJ: Loaded 3002 existing records. [2025-09-26T17:36:26.766479] [DEBUG] [LOCAL ] BIT: Loaded 22535 existing records from primary storage. [2025-09-26T17:36:26.853594] [INFO ] [MAIN ] BIT: Loaded 22535 existing records. [2025-09-26T17:36:26.948724] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:36:26.983328] [DEBUG] [LOCAL ] BIRK: Loaded 51295 existing records from primary storage. [2025-09-26T17:36:27.004783] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-09-26T17:36:27.004602] [INFO ] [MAIN ] BIRK: Loaded 51295 existing records. [2025-09-26T17:36:27.004938] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-09-26T17:36:27.144121] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-09-26T17:36:27.246230] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-09-26T17:36:27.246035] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:36:27.307052] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-09-26T17:36:27.389361] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-09-26T17:36:27.497601] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-09-26T17:36:27.533097] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:36:27.533243] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-09-26T17:36:27.654902] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-09-26T17:36:27.649196] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:36:27.677823] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-09-26T17:36:27.740061] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-09-26T17:36:27.793568] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-09-26T17:36:27.804157] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-09-26T17:36:27.872066] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-09-26T17:36:28.030937] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-09-26T17:36:28.119544] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-09-26T17:36:28.236990] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:36:28.381056] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2024-12. [2025-09-26T17:36:28.771845] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:36:28.823985] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2024-12. [2025-09-26T17:36:29.095634] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:36:29.107237] [INFO ] [REMOTE ] BIT: Fetching primary data for 2024-12. [2025-09-26T17:36:29.174322] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:36:29.175065] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2024-12. [2025-09-26T17:36:29.410749] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-26T17:36:29.413573] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-09-26T17:36:29.420239] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-26T17:36:29.556710] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-09-26T17:36:29.744367] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-26T17:36:29.941281] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-26T17:36:30.107257] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-26T17:36:30.356735] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-09-26T17:36:30.608384] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-26T17:36:30.692885] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-26T17:36:31.156753] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-09-26T17:36:31.584628] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-26T17:36:31.956732] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-09-26T17:36:32.381197] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-26T17:36:32.756774] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-09-26T17:36:33.205850] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-26T17:36:33.556739] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-09-26T17:36:34.124880] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-26T17:36:34.356763] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-09-26T17:36:34.942864] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-26T17:36:35.156780] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-09-26T17:36:35.581634] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-26T17:36:35.956757] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-09-26T17:36:36.756762] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-09-26T17:36:36.777040] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-26T17:36:37.324552] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-26T17:36:37.556764] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-09-26T17:36:38.356766] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-09-26T17:36:38.464383] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-26T17:36:39.156744] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-09-26T17:36:39.956710] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-09-26T17:36:40.036166] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-26T17:36:40.143986] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-26T17:36:40.756732] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-09-26T17:36:40.943239] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-26T17:36:40.944678] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4351 records). [2025-09-26T17:36:40.944776] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-09-26T17:36:41.341841] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-09-26T17:36:41.341929] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-09-26T17:36:41.342131] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-09-26T17:36:41.342171] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-09-26T17:36:41.342542] [DEBUG] [LOCAL ] BIPJ: Trimmed 4351 records to 3026 (keeping 200 days of data) [2025-09-26T17:36:41.361940] [DEBUG] [LOCAL ] BIPJ: Primary data saved (3026 records). [2025-09-26T17:36:41.362033] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-09-26T17:36:41.362113] [INFO ] [MAIN ] Update Progress: 281/2371 symbols completed. BIPJ took 15.6s. Estimated remaining: 4h 32m 30s. Rate: 7.7 symbols/min [2025-09-26T17:36:41.548442] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:36:41.556755] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-09-26T17:36:41.607248] [DEBUG] [LOCAL ] BJ: Loaded 51779 existing records from primary storage. [2025-09-26T17:36:41.607406] [INFO ] [MAIN ] BJ: Loaded 51779 existing records. [2025-09-26T17:36:41.804719] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:36:41.805024] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-09-26T17:36:41.805082] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-09-26T17:36:41.806603] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-09-26T17:36:41.806707] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-09-26T17:36:42.198585] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:36:42.218915] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-26T17:36:42.356789] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-09-26T17:36:42.365393] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-26T17:36:43.156761] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-09-26T17:36:43.333473] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-26T17:36:43.956801] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-09-26T17:36:44.595906] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-26T17:36:44.756701] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-09-26T17:36:44.877372] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-26T17:36:45.471432] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-26T17:36:45.556741] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-09-26T17:36:46.356705] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-09-26T17:36:46.753496] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-26T17:36:46.811424] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-26T17:36:47.156751] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-09-26T17:36:47.956767] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-09-26T17:36:48.405387] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-26T17:36:48.758284] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-09-26T17:36:48.764338] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-26T17:36:49.556724] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-09-26T17:36:49.824965] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-26T17:36:50.356740] [INFO ] [REMOTE ] BJ: Fetching primary data for 2024-12. [2025-09-26T17:36:51.037227] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-26T17:36:51.156749] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-09-26T17:36:51.637350] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-26T17:36:51.956739] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-09-26T17:36:52.639257] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-26T17:36:52.756734] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-09-26T17:36:53.120860] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-26T17:36:53.128288] [INFO ] [REMOTE ] BIT: Full fetch complete (31358 records). [2025-09-26T17:36:53.128419] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-09-26T17:36:53.551900] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-09-26T17:36:53.552006] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-09-26T17:36:53.552510] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-09-26T17:36:53.552576] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-09-26T17:36:53.553566] [DEBUG] [LOCAL ] BIT: Trimmed 31358 records to 22765 (keeping 200 days of data) [2025-09-26T17:36:53.607192] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-09-26T17:36:53.700639] [DEBUG] [LOCAL ] BIT: Primary data saved (22765 records). [2025-09-26T17:36:53.700819] [INFO ] [MAIN ] BIT: Full history saved. [2025-09-26T17:36:53.700929] [INFO ] [MAIN ] Update Progress: 282/2371 symbols completed. BIT took 27.9s. Estimated remaining: 4h 32m 56s. Rate: 7.7 symbols/min [2025-09-26T17:36:53.894190] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:36:53.947008] [DEBUG] [LOCAL ] BK: Loaded 53936 existing records from primary storage. [2025-09-26T17:36:53.947195] [INFO ] [MAIN ] BK: Loaded 53936 existing records. [2025-09-26T17:36:54.066162] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-26T17:36:54.153259] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:36:54.153724] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-09-26T17:36:54.153783] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-09-26T17:36:54.155257] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-09-26T17:36:54.155321] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-09-26T17:36:54.358083] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-09-26T17:36:54.360040] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-26T17:36:54.604966] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:36:54.989090] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-26T17:36:55.156761] [INFO ] [REMOTE ] BK: Fetching primary data for 2024-12. [2025-09-26T17:36:55.956728] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-09-26T17:36:56.367214] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-26T17:36:56.368606] [INFO ] [REMOTE ] BIPI: Full fetch complete (5229 records). [2025-09-26T17:36:56.368732] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-09-26T17:36:56.768822] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-09-26T17:36:56.778019] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-09-26T17:36:56.778324] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-09-26T17:36:56.778522] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-09-26T17:36:56.778719] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-09-26T17:36:56.779416] [DEBUG] [LOCAL ] BIPI: Trimmed 5229 records to 3282 (keeping 200 days of data) [2025-09-26T17:36:56.839082] [DEBUG] [LOCAL ] BIPI: Primary data saved (3282 records). [2025-09-26T17:36:56.839522] [INFO ] [MAIN ] BIPI: Full history saved. [2025-09-26T17:36:56.839857] [INFO ] [MAIN ] Update Progress: 283/2371 symbols completed. BIPI took 31.1s. Estimated remaining: 4h 32m 13s. Rate: 7.7 symbols/min [2025-09-26T17:36:56.841591] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-26T17:36:57.049206] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:36:57.116812] [DEBUG] [LOCAL ] BKD: Loaded 50514 existing records from primary storage. [2025-09-26T17:36:57.116966] [INFO ] [MAIN ] BKD: Loaded 50514 existing records. [2025-09-26T17:36:57.311747] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:36:57.312044] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-09-26T17:36:57.312094] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-09-26T17:36:57.313578] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-09-26T17:36:57.313673] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-09-26T17:36:57.569578] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-09-26T17:36:57.698237] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:36:58.356766] [INFO ] [REMOTE ] BKD: Fetching primary data for 2024-12. [2025-09-26T17:36:58.572539] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-26T17:36:59.156727] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-09-26T17:36:59.475719] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-26T17:36:59.637076] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-26T17:36:59.956755] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-09-26T17:37:00.691790] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T17:37:00.756744] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-09-26T17:37:01.439741] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-26T17:37:01.556734] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-09-26T17:37:02.356754] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-09-26T17:37:02.686162] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-26T17:37:03.156744] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-09-26T17:37:03.359961] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-26T17:37:03.956762] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-09-26T17:37:04.247928] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-26T17:37:04.415867] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-26T17:37:04.756772] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-09-26T17:37:05.556711] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-09-26T17:37:05.868511] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-26T17:37:06.356761] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-09-26T17:37:06.607781] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-26T17:37:06.805778] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-26T17:37:07.156738] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-09-26T17:37:07.956700] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-09-26T17:37:08.058291] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-26T17:37:08.421761] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-26T17:37:08.756744] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-09-26T17:37:09.185316] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-26T17:37:09.556738] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-09-26T17:37:10.356746] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-09-26T17:37:10.468872] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-26T17:37:10.947048] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-26T17:37:11.156730] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-09-26T17:37:11.910950] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-26T17:37:11.921452] [INFO ] [REMOTE ] BIRK: Full fetch complete (72918 records). [2025-09-26T17:37:11.921631] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-09-26T17:37:11.961914] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-09-26T17:37:12.348281] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-09-26T17:37:12.348383] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-09-26T17:37:12.349203] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-09-26T17:37:12.349283] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-09-26T17:37:12.350879] [DEBUG] [LOCAL ] BIRK: Trimmed 72918 records to 51674 (keeping 200 days of data) [2025-09-26T17:37:12.655328] [DEBUG] [LOCAL ] BIRK: Primary data saved (51674 records). [2025-09-26T17:37:12.655461] [INFO ] [MAIN ] BIRK: Full history saved. [2025-09-26T17:37:12.655543] [INFO ] [MAIN ] Update Progress: 284/2371 symbols completed. BIRK took 46.9s. Estimated remaining: 4h 33m 4s. Rate: 7.6 symbols/min [2025-09-26T17:37:12.761803] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-09-26T17:37:12.856344] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:37:12.887371] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-26T17:37:12.929593] [DEBUG] [LOCAL ] BKE: Loaded 34985 existing records from primary storage. [2025-09-26T17:37:12.929785] [INFO ] [MAIN ] BKE: Loaded 34985 existing records. [2025-09-26T17:37:13.118379] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:37:13.118758] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-09-26T17:37:13.118830] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-09-26T17:37:13.120013] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-09-26T17:37:13.120077] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-09-26T17:37:13.497623] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:37:13.556723] [INFO ] [REMOTE ] BKE: Fetching primary data for 2024-12. [2025-09-26T17:37:13.742157] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-26T17:37:14.356780] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-09-26T17:37:14.499478] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-26T17:37:14.605787] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-26T17:37:15.156746] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-09-26T17:37:15.935862] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-26T17:37:15.956680] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-09-26T17:37:16.510532] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-26T17:37:16.756750] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-09-26T17:37:17.411839] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-26T17:37:17.556739] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-09-26T17:37:18.068065] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-26T17:37:18.356751] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-09-26T17:37:19.165142] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-09-26T17:37:19.185473] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-26T17:37:19.196528] [INFO ] [REMOTE ] BJ: Full fetch complete (73808 records). [2025-09-26T17:37:19.196701] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-09-26T17:37:19.631390] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-09-26T17:37:19.631546] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-09-26T17:37:19.632450] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-09-26T17:37:19.632520] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-09-26T17:37:19.634062] [DEBUG] [LOCAL ] BJ: Trimmed 73808 records to 52156 (keeping 200 days of data) [2025-09-26T17:37:19.881244] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-26T17:37:19.960722] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-09-26T17:37:20.006470] [DEBUG] [LOCAL ] BJ: Primary data saved (52156 records). [2025-09-26T17:37:20.006638] [INFO ] [MAIN ] BJ: Full history saved. [2025-09-26T17:37:20.009357] [INFO ] [MAIN ] Update Progress: 285/2371 symbols completed. BJ took 38.6s. Estimated remaining: 4h 32m 53s. Rate: 7.6 symbols/min [2025-09-26T17:37:20.182507] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:37:20.225381] [DEBUG] [LOCAL ] BKH: Loaded 36896 existing records from primary storage. [2025-09-26T17:37:20.225533] [INFO ] [MAIN ] BKH: Loaded 36896 existing records. [2025-09-26T17:37:20.450189] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:37:20.450439] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-09-26T17:37:20.450490] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-09-26T17:37:20.451820] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-09-26T17:37:20.451883] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-09-26T17:37:20.759026] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-09-26T17:37:20.853346] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:37:20.884691] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-26T17:37:21.556739] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-09-26T17:37:21.841474] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-26T17:37:21.852629] [INFO ] [REMOTE ] BK: Full fetch complete (77481 records). [2025-09-26T17:37:21.852857] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-09-26T17:37:22.103016] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-26T17:37:22.310074] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-09-26T17:37:22.310158] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-09-26T17:37:22.310925] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-09-26T17:37:22.310991] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-09-26T17:37:22.312445] [DEBUG] [LOCAL ] BK: Trimmed 77481 records to 54319 (keeping 200 days of data) [2025-09-26T17:37:22.368301] [INFO ] [REMOTE ] BKH: Fetching primary data for 2024-12. [2025-09-26T17:37:22.648314] [DEBUG] [LOCAL ] BK: Primary data saved (54319 records). [2025-09-26T17:37:22.648475] [INFO ] [MAIN ] BK: Full history saved. [2025-09-26T17:37:22.649713] [INFO ] [MAIN ] Update Progress: 286/2371 symbols completed. BK took 28.9s. Estimated remaining: 4h 32m 7s. Rate: 7.7 symbols/min [2025-09-26T17:37:22.827674] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:37:22.867488] [DEBUG] [LOCAL ] BKKT: Loaded 34785 existing records from primary storage. [2025-09-26T17:37:22.867709] [INFO ] [MAIN ] BKKT: Loaded 34785 existing records. [2025-09-26T17:37:23.077924] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:37:23.078427] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-09-26T17:37:23.078716] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-09-26T17:37:23.079951] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-09-26T17:37:23.080021] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-09-26T17:37:23.163054] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-09-26T17:37:23.289779] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-26T17:37:23.544010] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:37:23.613357] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-26T17:37:23.956766] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-09-26T17:37:24.354015] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-26T17:37:24.756730] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-09-26T17:37:25.222141] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-26T17:37:25.556738] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-09-26T17:37:25.869175] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-26T17:37:26.356729] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-09-26T17:37:27.082992] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-26T17:37:27.093545] [INFO ] [REMOTE ] BKD: Full fetch complete (71518 records). [2025-09-26T17:37:27.093746] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-09-26T17:37:27.163023] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-09-26T17:37:27.524668] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-09-26T17:37:27.524950] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-09-26T17:37:27.525892] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-09-26T17:37:27.526002] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-09-26T17:37:27.527812] [DEBUG] [LOCAL ] BKD: Trimmed 71518 records to 50889 (keeping 200 days of data) [2025-09-26T17:37:27.635004] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-26T17:37:27.846975] [DEBUG] [LOCAL ] BKD: Primary data saved (50889 records). [2025-09-26T17:37:27.847161] [INFO ] [MAIN ] BKD: Full history saved. [2025-09-26T17:37:27.847262] [INFO ] [MAIN ] Update Progress: 287/2371 symbols completed. BKD took 31.0s. Estimated remaining: 4h 31m 40s. Rate: 7.7 symbols/min [2025-09-26T17:37:27.960907] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2024-12. [2025-09-26T17:37:28.033755] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:37:28.043280] [DEBUG] [LOCAL ] BKN: Loaded 7820 existing records from primary storage. [2025-09-26T17:37:28.043399] [INFO ] [MAIN ] BKN: Loaded 7820 existing records. [2025-09-26T17:37:28.238115] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:37:28.238405] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-09-26T17:37:28.238478] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-09-26T17:37:28.238938] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-09-26T17:37:28.239028] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-09-26T17:37:28.625768] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:37:28.756732] [INFO ] [REMOTE ] BKN: Fetching primary data for 2024-12. [2025-09-26T17:37:28.797445] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-26T17:37:29.556790] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-09-26T17:37:29.692020] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-26T17:37:29.875639] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-26T17:37:30.356733] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-09-26T17:37:30.629192] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-26T17:37:31.156735] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-09-26T17:37:31.735021] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-26T17:37:31.956755] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-09-26T17:37:32.317147] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-26T17:37:32.756725] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-09-26T17:37:32.870695] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-26T17:37:33.556736] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-09-26T17:37:34.246772] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-26T17:37:34.356740] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-09-26T17:37:34.534581] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-26T17:37:34.887372] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-26T17:37:35.156746] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-09-26T17:37:35.956737] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-09-26T17:37:36.756725] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-09-26T17:37:36.817607] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-26T17:37:37.247677] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-26T17:37:37.556719] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-09-26T17:37:38.365259] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-09-26T17:37:38.368567] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-26T17:37:38.878631] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-26T17:37:38.886248] [INFO ] [REMOTE ] BKE: Full fetch complete (50214 records). [2025-09-26T17:37:38.886448] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-09-26T17:37:39.019089] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-26T17:37:39.161805] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-09-26T17:37:39.310627] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-09-26T17:37:39.310792] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-09-26T17:37:39.312265] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-09-26T17:37:39.312346] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-09-26T17:37:39.313781] [DEBUG] [LOCAL ] BKE: Trimmed 50214 records to 35206 (keeping 200 days of data) [2025-09-26T17:37:39.546599] [DEBUG] [LOCAL ] BKE: Primary data saved (35206 records). [2025-09-26T17:37:39.546989] [INFO ] [MAIN ] BKE: Full history saved. [2025-09-26T17:37:39.551791] [INFO ] [MAIN ] Update Progress: 288/2371 symbols completed. BKE took 26.9s. Estimated remaining: 4h 32m 0s. Rate: 7.7 symbols/min [2025-09-26T17:37:39.817309] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:37:39.878558] [DEBUG] [LOCAL ] BKSY: Loaded 48651 existing records from primary storage. [2025-09-26T17:37:39.878769] [INFO ] [MAIN ] BKSY: Loaded 48651 existing records. [2025-09-26T17:37:39.964266] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-09-26T17:37:40.069173] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-26T17:37:40.154972] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:37:40.155381] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-09-26T17:37:40.155456] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-09-26T17:37:40.157222] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-09-26T17:37:40.157395] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-09-26T17:37:40.702069] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:37:40.756931] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2024-12. [2025-09-26T17:37:41.524317] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-26T17:37:41.556710] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-09-26T17:37:42.227426] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-26T17:37:42.356741] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-09-26T17:37:42.488247] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-26T17:37:43.156736] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-09-26T17:37:43.822604] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-26T17:37:43.956720] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-09-26T17:37:44.246836] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-26T17:37:44.756727] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-09-26T17:37:45.201842] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-26T17:37:45.556723] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-09-26T17:37:46.015809] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-26T17:37:46.306823] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-26T17:37:46.356755] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-09-26T17:37:47.073130] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-26T17:37:47.156773] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-09-26T17:37:47.956774] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-09-26T17:37:48.413085] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-26T17:37:48.461189] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-26T17:37:48.756738] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-09-26T17:37:49.556734] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-09-26T17:37:50.361863] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-09-26T17:37:50.375232] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-26T17:37:50.396803] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-26T17:37:51.156732] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-09-26T17:37:51.808489] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-26T17:37:51.956699] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-09-26T17:37:52.134374] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-26T17:37:52.756762] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-09-26T17:37:52.847412] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-26T17:37:52.849746] [INFO ] [REMOTE ] BKN: Full fetch complete (11981 records). [2025-09-26T17:37:52.849832] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-09-26T17:37:53.255708] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-09-26T17:37:53.255799] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-09-26T17:37:53.256083] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-09-26T17:37:53.256144] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-09-26T17:37:53.256680] [DEBUG] [LOCAL ] BKN: Trimmed 11981 records to 7853 (keeping 200 days of data) [2025-09-26T17:37:53.306846] [DEBUG] [LOCAL ] BKN: Primary data saved (7853 records). [2025-09-26T17:37:53.307010] [INFO ] [MAIN ] BKN: Full history saved. [2025-09-26T17:37:53.307137] [INFO ] [MAIN ] Update Progress: 289/2371 symbols completed. BKN took 25.5s. Estimated remaining: 4h 32m 35s. Rate: 7.6 symbols/min [2025-09-26T17:37:53.496152] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:37:53.509144] [DEBUG] [LOCAL ] BKT: Loaded 11032 existing records from primary storage. [2025-09-26T17:37:53.509277] [INFO ] [MAIN ] BKT: Loaded 11032 existing records. [2025-09-26T17:37:53.561788] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-09-26T17:37:53.730225] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:37:53.730512] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-09-26T17:37:53.730571] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-09-26T17:37:53.731222] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-09-26T17:37:53.731303] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-09-26T17:37:54.104546] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:37:54.356740] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-09-26T17:37:54.898869] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-26T17:37:54.992813] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-26T17:37:55.156741] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-09-26T17:37:55.804801] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-26T17:37:55.956780] [INFO ] [REMOTE ] BKT: Fetching primary data for 2024-12. [2025-09-26T17:37:56.756729] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-09-26T17:37:56.777118] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-26T17:37:56.803152] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T17:37:56.814282] [INFO ] [REMOTE ] BKH: Full fetch complete (52231 records). [2025-09-26T17:37:56.814428] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-09-26T17:37:57.389730] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-09-26T17:37:57.389880] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-09-26T17:37:57.390766] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-09-26T17:37:57.390840] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-09-26T17:37:57.392304] [DEBUG] [LOCAL ] BKH: Trimmed 52231 records to 37133 (keeping 200 days of data) [2025-09-26T17:37:57.558825] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-09-26T17:37:57.690234] [DEBUG] [LOCAL ] BKH: Primary data saved (37133 records). [2025-09-26T17:37:57.690407] [INFO ] [MAIN ] BKH: Full history saved. [2025-09-26T17:37:57.691300] [INFO ] [MAIN ] Update Progress: 290/2371 symbols completed. BKH took 37.7s. Estimated remaining: 4h 32m 2s. Rate: 7.6 symbols/min [2025-09-26T17:37:57.862951] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:37:57.910277] [DEBUG] [LOCAL ] BKU: Loaded 42162 existing records from primary storage. [2025-09-26T17:37:57.910422] [INFO ] [MAIN ] BKU: Loaded 42162 existing records. [2025-09-26T17:37:58.093964] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:37:58.094483] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-09-26T17:37:58.094545] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-09-26T17:37:58.095869] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-09-26T17:37:58.095933] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-09-26T17:37:58.357248] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-09-26T17:37:58.486757] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:37:58.515344] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-26T17:37:58.521636] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-26T17:37:59.156742] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-09-26T17:37:59.961844] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-09-26T17:37:59.975854] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-26T17:38:00.756740] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-09-26T17:38:00.776918] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-26T17:38:01.415147] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-26T17:38:01.427911] [INFO ] [REMOTE ] BKKT: Full fetch complete (49906 records). [2025-09-26T17:38:01.428149] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-09-26T17:38:01.561807] [INFO ] [REMOTE ] BKU: Fetching primary data for 2024-12. [2025-09-26T17:38:01.854585] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-09-26T17:38:01.854692] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-09-26T17:38:01.855307] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-09-26T17:38:01.855354] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-09-26T17:38:01.856415] [DEBUG] [LOCAL ] BKKT: Trimmed 49906 records to 35164 (keeping 200 days of data) [2025-09-26T17:38:02.069099] [DEBUG] [LOCAL ] BKKT: Primary data saved (35164 records). [2025-09-26T17:38:02.069263] [INFO ] [MAIN ] BKKT: Full history saved. [2025-09-26T17:38:02.069355] [INFO ] [MAIN ] Update Progress: 291/2371 symbols completed. BKKT took 39.4s. Estimated remaining: 4h 31m 30s. Rate: 7.7 symbols/min [2025-09-26T17:38:02.251373] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:38:02.281683] [DEBUG] [LOCAL ] BKV: Loaded 29986 existing records from primary storage. [2025-09-26T17:38:02.281854] [INFO ] [MAIN ] BKV: Loaded 29986 existing records. [2025-09-26T17:38:02.356814] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-09-26T17:38:02.481429] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:38:02.481872] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-09-26T17:38:02.482047] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-09-26T17:38:02.492160] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-09-26T17:38:02.510242] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-09-26T17:38:02.573731] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-26T17:38:02.963300] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T17:38:02.996816] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:38:03.138846] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-26T17:38:03.156699] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-09-26T17:38:03.956727] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-09-26T17:38:04.174583] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-26T17:38:04.756735] [INFO ] [REMOTE ] BKV: Fetching primary data for 2024-12. [2025-09-26T17:38:05.556743] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-09-26T17:38:06.005900] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-26T17:38:06.141336] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-26T17:38:06.181975] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-26T17:38:06.356777] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-09-26T17:38:07.156690] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-09-26T17:38:07.240613] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-26T17:38:07.956747] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-09-26T17:38:08.571447] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-26T17:38:08.756756] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-09-26T17:38:08.789340] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-26T17:38:09.556764] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-09-26T17:38:10.356742] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-09-26T17:38:10.951497] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-26T17:38:10.987439] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-26T17:38:11.034538] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-26T17:38:11.156759] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-09-26T17:38:11.956745] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-09-26T17:38:12.638687] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-26T17:38:12.756767] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-09-26T17:38:13.269097] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-26T17:38:13.414199] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-26T17:38:13.556734] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-09-26T17:38:14.356691] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-09-26T17:38:14.756426] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-26T17:38:14.763011] [INFO ] [REMOTE ] BKT: Full fetch complete (15052 records). [2025-09-26T17:38:14.763217] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-09-26T17:38:15.166934] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-09-26T17:38:15.166726] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-09-26T17:38:15.168042] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-09-26T17:38:15.168459] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-09-26T17:38:15.168556] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-09-26T17:38:15.169448] [DEBUG] [LOCAL ] BKT: Trimmed 15052 records to 11125 (keeping 200 days of data) [2025-09-26T17:38:15.247962] [DEBUG] [LOCAL ] BKT: Primary data saved (11125 records). [2025-09-26T17:38:15.248108] [INFO ] [MAIN ] BKT: Full history saved. [2025-09-26T17:38:15.248285] [INFO ] [MAIN ] Update Progress: 292/2371 symbols completed. BKT took 21.9s. Estimated remaining: 4h 32m 0s. Rate: 7.6 symbols/min [2025-09-26T17:38:15.424051] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:38:15.465525] [DEBUG] [LOCAL ] BLCO: Loaded 35907 existing records from primary storage. [2025-09-26T17:38:15.465716] [INFO ] [MAIN ] BLCO: Loaded 35907 existing records. [2025-09-26T17:38:15.676400] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:38:15.677876] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-09-26T17:38:15.677974] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-09-26T17:38:15.679550] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-09-26T17:38:15.679625] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-09-26T17:38:15.966271] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-09-26T17:38:16.074050] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:38:16.326637] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-26T17:38:16.339206] [INFO ] [REMOTE ] BKSY: Full fetch complete (69425 records). [2025-09-26T17:38:16.339386] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-09-26T17:38:16.765218] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-09-26T17:38:16.761526] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2024-12. [2025-09-26T17:38:16.766594] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-09-26T17:38:16.767561] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-09-26T17:38:16.768022] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-09-26T17:38:16.769581] [DEBUG] [LOCAL ] BKSY: Trimmed 69425 records to 48993 (keeping 200 days of data) [2025-09-26T17:38:16.903376] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-26T17:38:17.102463] [DEBUG] [LOCAL ] BKSY: Primary data saved (48993 records). [2025-09-26T17:38:17.102617] [INFO ] [MAIN ] BKSY: Full history saved. [2025-09-26T17:38:17.102764] [INFO ] [MAIN ] Update Progress: 293/2371 symbols completed. BKSY took 37.6s. Estimated remaining: 4h 31m 10s. Rate: 7.7 symbols/min [2025-09-26T17:38:17.285744] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:38:17.314847] [DEBUG] [LOCAL ] BLD: Loaded 28248 existing records from primary storage. [2025-09-26T17:38:17.314994] [INFO ] [MAIN ] BLD: Loaded 28248 existing records. [2025-09-26T17:38:17.507763] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:38:17.508287] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-09-26T17:38:17.508418] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-09-26T17:38:17.509342] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-09-26T17:38:17.509403] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-09-26T17:38:17.567265] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-09-26T17:38:17.845441] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-26T17:38:17.940850] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:38:18.324603] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-26T17:38:18.356694] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-09-26T17:38:18.949331] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-26T17:38:19.156753] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-09-26T17:38:19.412422] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-26T17:38:19.956780] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-09-26T17:38:20.157200] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-26T17:38:20.756799] [INFO ] [REMOTE ] BLD: Fetching primary data for 2024-12. [2025-09-26T17:38:21.364120] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-26T17:38:21.556719] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-09-26T17:38:21.848833] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-26T17:38:22.356730] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-09-26T17:38:23.156723] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-09-26T17:38:23.232970] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-26T17:38:23.572213] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-26T17:38:23.956758] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-09-26T17:38:24.331076] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-26T17:38:24.756801] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-09-26T17:38:24.936593] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-26T17:38:25.556717] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-09-26T17:38:25.844450] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-26T17:38:26.356733] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-09-26T17:38:26.801932] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-26T17:38:27.156732] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-09-26T17:38:27.724697] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-26T17:38:27.956751] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-09-26T17:38:28.756716] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-09-26T17:38:28.810235] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-26T17:38:28.893424] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-26T17:38:28.899244] [INFO ] [REMOTE ] BKV: Full fetch complete (44972 records). [2025-09-26T17:38:28.899373] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-09-26T17:38:29.298815] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-09-26T17:38:29.298902] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-09-26T17:38:29.299465] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-09-26T17:38:29.299530] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-09-26T17:38:29.300628] [DEBUG] [LOCAL ] BKV: Trimmed 44972 records to 30278 (keeping 200 days of data) [2025-09-26T17:38:29.495591] [DEBUG] [LOCAL ] BKV: Primary data saved (30278 records). [2025-09-26T17:38:29.495800] [INFO ] [MAIN ] BKV: Full history saved. [2025-09-26T17:38:29.496005] [INFO ] [MAIN ] Update Progress: 294/2371 symbols completed. BKV took 27.4s. Estimated remaining: 4h 31m 34s. Rate: 7.6 symbols/min [2025-09-26T17:38:29.565211] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-09-26T17:38:29.698963] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:38:29.755374] [DEBUG] [LOCAL ] BLDR: Loaded 52046 existing records from primary storage. [2025-09-26T17:38:29.755546] [INFO ] [MAIN ] BLDR: Loaded 52046 existing records. [2025-09-26T17:38:29.960488] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:38:29.960939] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-09-26T17:38:29.961087] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-09-26T17:38:29.962588] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-09-26T17:38:29.962678] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-09-26T17:38:30.106072] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-26T17:38:30.361884] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-09-26T17:38:30.393477] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:38:30.749828] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-26T17:38:31.156747] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-09-26T17:38:31.500360] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-26T17:38:31.956733] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-09-26T17:38:32.518617] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-26T17:38:32.756734] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-09-26T17:38:33.496605] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-26T17:38:33.504701] [INFO ] [REMOTE ] BKU: Full fetch complete (59781 records). [2025-09-26T17:38:33.504835] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-09-26T17:38:33.565725] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2024-12. [2025-09-26T17:38:33.930873] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-09-26T17:38:33.931063] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-09-26T17:38:33.931881] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-09-26T17:38:33.932061] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-09-26T17:38:33.933474] [DEBUG] [LOCAL ] BKU: Trimmed 59781 records to 42412 (keeping 200 days of data) [2025-09-26T17:38:34.056197] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-26T17:38:34.235704] [DEBUG] [LOCAL ] BKU: Primary data saved (42412 records). [2025-09-26T17:38:34.235843] [INFO ] [MAIN ] BKU: Full history saved. [2025-09-26T17:38:34.235932] [INFO ] [MAIN ] Update Progress: 295/2371 symbols completed. BKU took 36.5s. Estimated remaining: 4h 31m 4s. Rate: 7.7 symbols/min [2025-09-26T17:38:34.361797] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-09-26T17:38:34.427732] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:38:34.446171] [DEBUG] [LOCAL ] BLE: Loaded 14657 existing records from primary storage. [2025-09-26T17:38:34.446327] [INFO ] [MAIN ] BLE: Loaded 14657 existing records. [2025-09-26T17:38:34.661767] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:38:34.662136] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-09-26T17:38:34.662192] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-09-26T17:38:34.662737] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-09-26T17:38:34.662802] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-09-26T17:38:35.075049] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:38:35.156687] [INFO ] [REMOTE ] BLE: Fetching primary data for 2024-12. [2025-09-26T17:38:35.517430] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-26T17:38:35.519721] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-26T17:38:35.956786] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-09-26T17:38:36.321070] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-26T17:38:36.756724] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-09-26T17:38:37.292624] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-26T17:38:37.326033] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-26T17:38:37.556732] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-09-26T17:38:38.356738] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-09-26T17:38:39.016693] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-26T17:38:39.156731] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-09-26T17:38:39.249425] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-26T17:38:39.956722] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-09-26T17:38:39.998317] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-26T17:38:40.756727] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-09-26T17:38:41.263988] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-26T17:38:41.556726] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-09-26T17:38:42.356710] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-09-26T17:38:42.475979] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T17:38:43.156712] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-09-26T17:38:43.283966] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-26T17:38:43.305929] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-26T17:38:43.956738] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-09-26T17:38:44.329385] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-26T17:38:44.654620] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-26T17:38:44.756716] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-09-26T17:38:45.556714] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-09-26T17:38:46.356752] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-09-26T17:38:46.455053] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-26T17:38:46.656491] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-26T17:38:47.156736] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-09-26T17:38:47.689851] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-26T17:38:47.695896] [INFO ] [REMOTE ] BLD: Full fetch complete (40423 records). [2025-09-26T17:38:47.696082] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-09-26T17:38:47.962442] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-09-26T17:38:47.962271] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-26T17:38:48.163516] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-09-26T17:38:48.163614] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-09-26T17:38:48.164139] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-09-26T17:38:48.164202] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-09-26T17:38:48.165264] [DEBUG] [LOCAL ] BLD: Trimmed 40423 records to 28408 (keeping 200 days of data) [2025-09-26T17:38:48.341559] [DEBUG] [LOCAL ] BLD: Primary data saved (28408 records). [2025-09-26T17:38:48.341763] [INFO ] [MAIN ] BLD: Full history saved. [2025-09-26T17:38:48.341863] [INFO ] [MAIN ] Update Progress: 296/2371 symbols completed. BLD took 31.2s. Estimated remaining: 4h 31m 40s. Rate: 7.6 symbols/min [2025-09-26T17:38:48.524752] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:38:48.564186] [DEBUG] [LOCAL ] BLK: Loaded 35037 existing records from primary storage. [2025-09-26T17:38:48.564351] [INFO ] [MAIN ] BLK: Loaded 35037 existing records. [2025-09-26T17:38:48.766337] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-09-26T17:38:48.773679] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:38:48.773934] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-09-26T17:38:48.773987] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-09-26T17:38:48.775168] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-09-26T17:38:48.775232] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-09-26T17:38:49.172553] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:38:49.407767] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-26T17:38:49.556731] [INFO ] [REMOTE ] BLK: Fetching primary data for 2024-12. [2025-09-26T17:38:49.647261] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-26T17:38:50.356739] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-09-26T17:38:51.156772] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-09-26T17:38:51.218931] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-26T17:38:51.392142] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-26T17:38:51.956791] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-09-26T17:38:52.730774] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-26T17:38:52.756687] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-09-26T17:38:53.388866] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-26T17:38:53.556718] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-09-26T17:38:53.637838] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-26T17:38:54.356769] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-09-26T17:38:54.635816] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-26T17:38:55.156752] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-09-26T17:38:55.963349] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-09-26T17:38:55.979218] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-26T17:38:56.231620] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-26T17:38:56.239852] [INFO ] [REMOTE ] BLCO: Full fetch complete (52746 records). [2025-09-26T17:38:56.240011] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-09-26T17:38:56.641146] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-09-26T17:38:56.641272] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-09-26T17:38:56.641887] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-09-26T17:38:56.641952] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-09-26T17:38:56.643189] [DEBUG] [LOCAL ] BLCO: Trimmed 52746 records to 36110 (keeping 200 days of data) [2025-09-26T17:38:56.757000] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-09-26T17:38:56.875456] [DEBUG] [LOCAL ] BLCO: Primary data saved (36110 records). [2025-09-26T17:38:56.875669] [INFO ] [MAIN ] BLCO: Full history saved. [2025-09-26T17:38:56.875830] [INFO ] [MAIN ] Update Progress: 297/2371 symbols completed. BLCO took 41.6s. Estimated remaining: 4h 31m 37s. Rate: 7.6 symbols/min [2025-09-26T17:38:57.056290] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:38:57.104141] [DEBUG] [LOCAL ] BLND: Loaded 49802 existing records from primary storage. [2025-09-26T17:38:57.104312] [INFO ] [MAIN ] BLND: Loaded 49802 existing records. [2025-09-26T17:38:57.291822] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:38:57.292314] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-09-26T17:38:57.292521] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-09-26T17:38:57.293893] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-09-26T17:38:57.293970] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-09-26T17:38:57.557669] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-09-26T17:38:57.585238] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-26T17:38:57.616839] [INFO ] [REMOTE ] BLE: Full fetch complete (20485 records). [2025-09-26T17:38:57.627871] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-09-26T17:38:57.812453] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:38:57.854980] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-26T17:38:58.149292] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-09-26T17:38:58.149388] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-09-26T17:38:58.149784] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-09-26T17:38:58.149847] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-09-26T17:38:58.150479] [DEBUG] [LOCAL ] BLE: Trimmed 20485 records to 14718 (keeping 200 days of data) [2025-09-26T17:38:58.250614] [DEBUG] [LOCAL ] BLE: Primary data saved (14718 records). [2025-09-26T17:38:58.250794] [INFO ] [MAIN ] BLE: Full history saved. [2025-09-26T17:38:58.250905] [INFO ] [MAIN ] Update Progress: 298/2371 symbols completed. BLE took 24.0s. Estimated remaining: 4h 30m 44s. Rate: 7.7 symbols/min [2025-09-26T17:38:58.361940] [INFO ] [REMOTE ] BLND: Fetching primary data for 2024-12. [2025-09-26T17:38:58.456320] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:38:58.456511] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-09-26T17:38:58.456552] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-09-26T17:38:58.456746] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-09-26T17:38:58.456832] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-26T17:38:58.456884] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-26T17:38:58.456919] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-09-26T17:38:58.848572] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:38:59.156763] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-09-26T17:38:59.376518] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-26T17:38:59.833627] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-26T17:38:59.956761] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-12. [2025-09-26T17:39:00.173408] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:39:00.173761] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-12 [2025-09-26T17:39:00.764304] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-09-26T17:39:00.770147] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-26T17:39:01.556740] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-09-26T17:39:02.356737] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-01. [2025-09-26T17:39:02.486845] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-26T17:39:02.579289] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:39:02.579609] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-01 [2025-09-26T17:39:03.156741] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-09-26T17:39:03.442908] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-26T17:39:03.956725] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-02. [2025-09-26T17:39:04.171844] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:39:04.172149] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-02 [2025-09-26T17:39:04.676219] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-26T17:39:04.756785] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-09-26T17:39:05.556712] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-09-26T17:39:06.133595] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-26T17:39:06.356746] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-09-26T17:39:06.871936] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-26T17:39:07.156737] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-09-26T17:39:07.956722] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-03. [2025-09-26T17:39:08.110238] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-26T17:39:08.120471] [INFO ] [REMOTE ] BLDR: Full fetch complete (74375 records). [2025-09-26T17:39:08.120696] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-09-26T17:39:08.193152] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:39:08.222124] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-03 [2025-09-26T17:39:08.541213] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-09-26T17:39:08.541426] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-09-26T17:39:08.542282] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-09-26T17:39:08.542371] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-09-26T17:39:08.563910] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-26T17:39:08.571289] [DEBUG] [LOCAL ] BLDR: Trimmed 74375 records to 52403 (keeping 200 days of data) [2025-09-26T17:39:08.764070] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-09-26T17:39:08.921955] [DEBUG] [LOCAL ] BLDR: Primary data saved (52403 records). [2025-09-26T17:39:08.922119] [INFO ] [MAIN ] BLDR: Full history saved. [2025-09-26T17:39:08.922211] [INFO ] [MAIN ] Update Progress: 299/2371 symbols completed. BLDR took 39.4s. Estimated remaining: 4h 30m 56s. Rate: 7.6 symbols/min [2025-09-26T17:39:09.179134] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:39:09.194140] [DEBUG] [LOCAL ] BLW: Loaded 12881 existing records from primary storage. [2025-09-26T17:39:09.194269] [INFO ] [MAIN ] BLW: Loaded 12881 existing records. [2025-09-26T17:39:09.383008] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:39:09.383279] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-09-26T17:39:09.383327] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-09-26T17:39:09.383845] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-09-26T17:39:09.383906] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-09-26T17:39:09.561812] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-04. [2025-09-26T17:39:09.768268] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:39:09.894866] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:39:09.895220] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-04 [2025-09-26T17:39:10.356724] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-05. [2025-09-26T17:39:10.669100] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-26T17:39:10.708277] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:39:10.708722] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-05 [2025-09-26T17:39:11.156756] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-06. [2025-09-26T17:39:11.671325] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:39:11.671731] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-06 [2025-09-26T17:39:11.956750] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-09-26T17:39:12.756726] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-09-26T17:39:13.556735] [INFO ] [REMOTE ] BLW: Fetching primary data for 2024-12. [2025-09-26T17:39:13.727961] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-26T17:39:14.326920] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-26T17:39:14.356679] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-09-26T17:39:14.399063] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-26T17:39:15.156724] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-09-26T17:39:15.287146] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-26T17:39:15.956764] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-09-26T17:39:16.756737] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-09-26T17:39:16.852066] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-26T17:39:16.858990] [INFO ] [REMOTE ] BLK: Full fetch complete (52748 records). [2025-09-26T17:39:16.859108] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-09-26T17:39:17.291962] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-09-26T17:39:17.292502] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-09-26T17:39:17.293315] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-09-26T17:39:17.293891] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-09-26T17:39:17.307678] [DEBUG] [LOCAL ] BLK: Trimmed 52748 records to 35240 (keeping 200 days of data) [2025-09-26T17:39:17.309040] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-26T17:39:17.415305] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-26T17:39:17.565312] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-09-26T17:39:17.598612] [DEBUG] [LOCAL ] BLK: Primary data saved (35240 records). [2025-09-26T17:39:17.598803] [INFO ] [MAIN ] BLK: Full history saved. [2025-09-26T17:39:17.598910] [INFO ] [MAIN ] Update Progress: 300/2371 symbols completed. BLK took 29.3s. Estimated remaining: 4h 30m 54s. Rate: 7.6 symbols/min [2025-09-26T17:39:17.775530] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:39:17.775724] [DEBUG] [LOCAL ] BLX: No existing data file found in primary storage. [2025-09-26T17:39:17.775773] [WARN ] [MAIN ] BLX: No existing data found, performing full refresh instead. [2025-09-26T17:39:17.775936] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-09-26T17:39:17.775979] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-09-26T17:39:17.776021] [DEBUG] [LOCAL ] BLX: No primary data file found to delete. [2025-09-26T17:39:17.776054] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-09-26T17:39:18.152397] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:39:18.356729] [INFO ] [REMOTE ] BLX: Fetching primary data for 2024-12. [2025-09-26T17:39:18.985602] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-26T17:39:19.097622] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-26T17:39:19.156730] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-09-26T17:39:19.956693] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-07. [2025-09-26T17:39:20.028037] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-26T17:39:20.178499] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:39:20.178863] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-07 [2025-09-26T17:39:20.756737] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-08. [2025-09-26T17:39:21.556722] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-09-26T17:39:22.338278] [INFO ] [REMOTE ] BLSH: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-26T17:39:22.356671] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-09. [2025-09-26T17:39:22.845799] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-26T17:39:23.156747] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-09-26T17:39:23.719005] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-26T17:39:23.956753] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-09-26T17:39:24.593304] [INFO ] [REMOTE ] BLSH: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-26T17:39:24.604052] [INFO ] [REMOTE ] BLSH: Full fetch complete (12216 records). [2025-09-26T17:39:24.604165] [DEBUG] [VALIDATOR ] BLSH: Validating primary data. [2025-09-26T17:39:24.765942] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-09-26T17:39:24.819217] [WARN ] [VALIDATOR ] BLSH: Validation failed - insufficient historical data. Have 32 unique days, need 200 days [2025-09-26T17:39:24.819613] [FATAL] [MAIN ] BLSH: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:39:24.819710] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:39:24.819784] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-26T17:39:24.819874] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-26T17:39:24.819965] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-09-26T17:39:24.820033] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-09-26T17:39:24.820155] [INFO ] [MAIN ] Update Progress: 301/2371 symbols completed. BLSH took 26.6s. Estimated remaining: 4h 30m 42s. Rate: 7.6 symbols/min [2025-09-26T17:39:25.037883] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:39:25.085280] [DEBUG] [LOCAL ] BMA: Loaded 35339 existing records from primary storage. [2025-09-26T17:39:25.090819] [INFO ] [MAIN ] BMA: Loaded 35339 existing records. [2025-09-26T17:39:25.101268] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-26T17:39:25.308800] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:39:25.309150] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-09-26T17:39:25.309219] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-09-26T17:39:25.310541] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-09-26T17:39:25.310618] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-09-26T17:39:25.561878] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-09-26T17:39:25.726547] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:39:25.741439] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-26T17:39:26.356749] [INFO ] [REMOTE ] BMA: Fetching primary data for 2024-12. [2025-09-26T17:39:26.907120] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-26T17:39:27.156722] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-09-26T17:39:27.509548] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-26T17:39:27.956760] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-09-26T17:39:28.756784] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-09-26T17:39:29.056967] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-26T17:39:29.097597] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-26T17:39:29.556725] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-09-26T17:39:29.896961] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-26T17:39:30.229910] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-26T17:39:30.356753] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-09-26T17:39:30.934002] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-26T17:39:31.156749] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-09-26T17:39:31.956744] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-09-26T17:39:32.197581] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-26T17:39:32.531813] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-26T17:39:32.756721] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-09-26T17:39:33.556719] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-09-26T17:39:33.989769] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-26T17:39:34.356762] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-09-26T17:39:35.116418] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-26T17:39:35.147560] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-26T17:39:35.157121] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-09-26T17:39:35.159582] [INFO ] [REMOTE ] BLND: Full fetch complete (72227 records). [2025-09-26T17:39:35.159893] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-09-26T17:39:35.579522] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-09-26T17:39:35.579623] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-09-26T17:39:35.580458] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-09-26T17:39:35.580532] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-09-26T17:39:35.582018] [DEBUG] [LOCAL ] BLND: Trimmed 72227 records to 50107 (keeping 200 days of data) [2025-09-26T17:39:35.872251] [DEBUG] [LOCAL ] BLND: Primary data saved (50107 records). [2025-09-26T17:39:35.872423] [INFO ] [MAIN ] BLND: Full history saved. [2025-09-26T17:39:35.872547] [INFO ] [MAIN ] Update Progress: 302/2371 symbols completed. BLND took 39.0s. Estimated remaining: 4h 30m 56s. Rate: 7.6 symbols/min [2025-09-26T17:39:35.961944] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-09-26T17:39:36.058290] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:39:36.071204] [DEBUG] [LOCAL ] BME: Loaded 10912 existing records from primary storage. [2025-09-26T17:39:36.071333] [INFO ] [MAIN ] BME: Loaded 10912 existing records. [2025-09-26T17:39:36.254232] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:39:36.254807] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-09-26T17:39:36.254982] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-09-26T17:39:36.255734] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-09-26T17:39:36.255802] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-09-26T17:39:36.598203] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-26T17:39:36.689596] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:39:36.699497] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-26T17:39:36.756709] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-09-26T17:39:37.556712] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-09-26T17:39:37.723048] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-26T17:39:38.356738] [INFO ] [REMOTE ] BME: Fetching primary data for 2024-12. [2025-09-26T17:39:38.835007] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-26T17:39:38.994571] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-26T17:39:39.156730] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-09-26T17:39:39.956732] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-09-26T17:39:40.465414] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-26T17:39:40.545176] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-26T17:39:40.756728] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-09-26T17:39:41.564009] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-09-26T17:39:41.566498] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-26T17:39:42.356723] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-09-26T17:39:42.935802] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-26T17:39:42.960841] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-26T17:39:43.156722] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-09-26T17:39:43.956711] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-09-26T17:39:44.396860] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-26T17:39:44.401110] [INFO ] [REMOTE ] BLW: Full fetch complete (18976 records). [2025-09-26T17:39:44.401271] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-09-26T17:39:44.762165] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-09-26T17:39:44.901247] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-26T17:39:44.988019] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-09-26T17:39:44.988140] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-09-26T17:39:44.988591] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-09-26T17:39:44.988638] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-09-26T17:39:44.989749] [DEBUG] [LOCAL ] BLW: Trimmed 18976 records to 13044 (keeping 200 days of data) [2025-09-26T17:39:45.102903] [DEBUG] [LOCAL ] BLW: Primary data saved (13044 records). [2025-09-26T17:39:45.103111] [INFO ] [MAIN ] BLW: Full history saved. [2025-09-26T17:39:45.103277] [INFO ] [MAIN ] Update Progress: 303/2371 symbols completed. BLW took 36.2s. Estimated remaining: 4h 30m 58s. Rate: 7.6 symbols/min [2025-09-26T17:39:45.403176] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:39:45.433550] [DEBUG] [LOCAL ] BMEZ: Loaded 26209 existing records from primary storage. [2025-09-26T17:39:45.433748] [INFO ] [MAIN ] BMEZ: Loaded 26209 existing records. [2025-09-26T17:39:45.563408] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-09-26T17:39:45.659417] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:39:45.659751] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-09-26T17:39:45.659809] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-09-26T17:39:45.660805] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-09-26T17:39:45.660870] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-09-26T17:39:46.045539] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:39:46.128468] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-26T17:39:46.356769] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-09-26T17:39:46.550006] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-26T17:39:46.553922] [INFO ] [REMOTE ] BLX: Full fetch complete (22710 records). [2025-09-26T17:39:46.554073] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-09-26T17:39:46.977554] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-09-26T17:39:46.977659] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-09-26T17:39:46.978042] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-09-26T17:39:46.978085] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-09-26T17:39:46.978789] [DEBUG] [LOCAL ] BLX: Trimmed 22710 records to 15880 (keeping 200 days of data) [2025-09-26T17:39:47.075893] [DEBUG] [LOCAL ] BLX: Primary data saved (15880 records). [2025-09-26T17:39:47.076056] [INFO ] [MAIN ] BLX: Full history saved. [2025-09-26T17:39:47.076145] [INFO ] [MAIN ] Update Progress: 304/2371 symbols completed. BLX took 29.5s. Estimated remaining: 4h 30m 10s. Rate: 7.7 symbols/min [2025-09-26T17:39:47.161841] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2024-12. [2025-09-26T17:39:47.261173] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:39:47.261349] [DEBUG] [LOCAL ] BMI: No existing data file found in primary storage. [2025-09-26T17:39:47.261388] [WARN ] [MAIN ] BMI: No existing data found, performing full refresh instead. [2025-09-26T17:39:47.261543] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-09-26T17:39:47.261588] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-09-26T17:39:47.261632] [DEBUG] [LOCAL ] BMI: No primary data file found to delete. [2025-09-26T17:39:47.261707] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-09-26T17:39:47.638769] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:39:47.956727] [INFO ] [REMOTE ] BMI: Fetching primary data for 2024-12. [2025-09-26T17:39:48.074471] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T17:39:48.083738] [INFO ] [REMOTE ] BMA: Full fetch complete (51272 records). [2025-09-26T17:39:48.083911] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-09-26T17:39:48.534394] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-09-26T17:39:48.534803] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-09-26T17:39:48.535479] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-09-26T17:39:48.535565] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-09-26T17:39:48.537959] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-26T17:39:48.546783] [DEBUG] [LOCAL ] BMA: Trimmed 51272 records to 35645 (keeping 200 days of data) [2025-09-26T17:39:48.756928] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-09-26T17:39:48.788615] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-26T17:39:48.800481] [DEBUG] [LOCAL ] BMA: Primary data saved (35645 records). [2025-09-26T17:39:48.800675] [INFO ] [MAIN ] BMA: Full history saved. [2025-09-26T17:39:48.802161] [INFO ] [MAIN ] Update Progress: 305/2371 symbols completed. BMA took 24.0s. Estimated remaining: 4h 29m 20s. Rate: 7.7 symbols/min [2025-09-26T17:39:48.987504] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:39:48.992851] [DEBUG] [LOCAL ] BMN: Loaded 2536 existing records from primary storage. [2025-09-26T17:39:48.992967] [INFO ] [MAIN ] BMN: Loaded 2536 existing records. [2025-09-26T17:39:49.175712] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:39:49.175964] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-09-26T17:39:49.176013] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-09-26T17:39:49.176380] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-09-26T17:39:49.176443] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-09-26T17:39:49.544275] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:39:49.556676] [INFO ] [REMOTE ] BMN: Fetching primary data for 2024-12. [2025-09-26T17:39:49.728331] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-26T17:39:49.969028] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-26T17:39:50.356727] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-09-26T17:39:50.881970] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-26T17:39:51.156773] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-09-26T17:39:51.956781] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-09-26T17:39:51.968945] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-26T17:39:52.756733] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-09-26T17:39:53.087498] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-26T17:39:53.556743] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-09-26T17:39:53.805612] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-26T17:39:54.356740] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-09-26T17:39:54.489285] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-26T17:39:55.006203] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-26T17:39:55.156785] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-09-26T17:39:55.946786] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-26T17:39:55.956680] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-09-26T17:39:56.756742] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-09-26T17:39:56.851213] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-26T17:39:57.085772] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-26T17:39:57.556781] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-09-26T17:39:58.356722] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-09-26T17:39:58.905585] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-26T17:39:59.156767] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-09-26T17:39:59.184942] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-26T17:39:59.956739] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-09-26T17:40:00.180689] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-26T17:40:00.477953] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-26T17:40:00.756764] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-09-26T17:40:01.556726] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-09-26T17:40:02.189686] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-26T17:40:02.356789] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-09-26T17:40:02.655477] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-26T17:40:03.156721] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-09-26T17:40:03.260739] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-26T17:40:03.628366] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-26T17:40:03.956768] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-09-26T17:40:04.756743] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-09-26T17:40:04.936292] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-26T17:40:05.321079] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-26T17:40:05.556723] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-09-26T17:40:06.036397] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-26T17:40:06.356742] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-09-26T17:40:06.826173] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-26T17:40:07.156750] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-09-26T17:40:07.956746] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-09-26T17:40:08.143887] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-26T17:40:08.146780] [INFO ] [REMOTE ] BME: Full fetch complete (16047 records). [2025-09-26T17:40:08.146868] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-09-26T17:40:08.583253] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-26T17:40:08.583477] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-09-26T17:40:08.585164] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-09-26T17:40:08.585679] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-09-26T17:40:08.585760] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-09-26T17:40:08.586487] [DEBUG] [LOCAL ] BME: Trimmed 16047 records to 10968 (keeping 200 days of data) [2025-09-26T17:40:08.661187] [DEBUG] [LOCAL ] BME: Primary data saved (10968 records). [2025-09-26T17:40:08.661371] [INFO ] [MAIN ] BME: Full history saved. [2025-09-26T17:40:08.661473] [INFO ] [MAIN ] Update Progress: 306/2371 symbols completed. BME took 32.8s. Estimated remaining: 4h 30m 34s. Rate: 7.6 symbols/min [2025-09-26T17:40:08.761822] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-09-26T17:40:08.868980] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:40:08.913790] [DEBUG] [LOCAL ] BMO: Loaded 41667 existing records from primary storage. [2025-09-26T17:40:08.913961] [INFO ] [MAIN ] BMO: Loaded 41667 existing records. [2025-09-26T17:40:09.131467] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:40:09.131742] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-09-26T17:40:09.131800] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-09-26T17:40:09.133255] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-09-26T17:40:09.133331] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-09-26T17:40:09.556781] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:40:09.556928] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-09-26T17:40:09.884085] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-26T17:40:09.907637] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-26T17:40:10.356724] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-09-26T17:40:11.156742] [INFO ] [REMOTE ] BMO: Fetching primary data for 2024-12. [2025-09-26T17:40:11.956813] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-09-26T17:40:12.709848] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-26T17:40:12.722729] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-26T17:40:12.723946] [INFO ] [REMOTE ] BMN: Full fetch complete (3724 records). [2025-09-26T17:40:12.724022] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-09-26T17:40:12.761798] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-09-26T17:40:13.098693] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (2.74 seconds). [2025-09-26T17:40:13.143244] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-09-26T17:40:13.143325] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-09-26T17:40:13.143471] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-09-26T17:40:13.143555] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-09-26T17:40:13.144102] [DEBUG] [LOCAL ] BMN: Trimmed 3724 records to 2548 (keeping 200 days of data) [2025-09-26T17:40:13.162549] [DEBUG] [LOCAL ] BMN: Primary data saved (2548 records). [2025-09-26T17:40:13.162638] [INFO ] [MAIN ] BMN: Full history saved. [2025-09-26T17:40:13.162777] [INFO ] [MAIN ] Update Progress: 307/2371 symbols completed. BMN took 24.4s. Estimated remaining: 4h 30m 3s. Rate: 7.6 symbols/min [2025-09-26T17:40:13.343731] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:40:13.343967] [DEBUG] [LOCAL ] BMY: No existing data file found in primary storage. [2025-09-26T17:40:13.344025] [WARN ] [MAIN ] BMY: No existing data found, performing full refresh instead. [2025-09-26T17:40:13.344191] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-09-26T17:40:13.344235] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-09-26T17:40:13.344279] [DEBUG] [LOCAL ] BMY: No primary data file found to delete. [2025-09-26T17:40:13.344312] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-09-26T17:40:13.561878] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-09-26T17:40:13.737067] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:40:14.186764] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-26T17:40:14.356737] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-09-26T17:40:14.454976] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-26T17:40:15.156795] [INFO ] [REMOTE ] BMY: Fetching primary data for 2024-12. [2025-09-26T17:40:15.531591] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-26T17:40:15.956728] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-09-26T17:40:16.756744] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-09-26T17:40:16.914958] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-26T17:40:17.086735] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-26T17:40:17.556722] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-09-26T17:40:18.112703] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-26T17:40:18.356724] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-09-26T17:40:18.748778] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-26T17:40:18.755832] [INFO ] [REMOTE ] BMI: Full fetch complete (32989 records). [2025-09-26T17:40:18.755983] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-09-26T17:40:19.162178] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-09-26T17:40:19.215301] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-09-26T17:40:19.215495] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-09-26T17:40:19.216022] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-09-26T17:40:19.216094] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-09-26T17:40:19.217022] [DEBUG] [LOCAL ] BMI: Trimmed 32989 records to 24611 (keeping 200 days of data) [2025-09-26T17:40:19.376460] [DEBUG] [LOCAL ] BMI: Primary data saved (24611 records). [2025-09-26T17:40:19.376605] [INFO ] [MAIN ] BMI: Full history saved. [2025-09-26T17:40:19.376710] [INFO ] [MAIN ] Update Progress: 308/2371 symbols completed. BMI took 32.3s. Estimated remaining: 4h 29m 45s. Rate: 7.6 symbols/min [2025-09-26T17:40:19.566388] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:40:19.621370] [DEBUG] [LOCAL ] BN: Loaded 53384 existing records from primary storage. [2025-09-26T17:40:19.621511] [INFO ] [MAIN ] BN: Loaded 53384 existing records. [2025-09-26T17:40:19.825590] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:40:19.826048] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-09-26T17:40:19.826101] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-09-26T17:40:19.827596] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-09-26T17:40:19.827695] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-09-26T17:40:19.960630] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-09-26T17:40:20.219582] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-26T17:40:20.297670] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:40:20.291793] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-26T17:40:20.756739] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-09-26T17:40:21.556720] [INFO ] [REMOTE ] BN: Fetching primary data for 2024-12. [2025-09-26T17:40:21.726879] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-26T17:40:21.951131] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-26T17:40:22.356740] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-09-26T17:40:23.156735] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-09-26T17:40:23.496246] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-26T17:40:23.569998] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-26T17:40:23.956779] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-09-26T17:40:24.756731] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-09-26T17:40:24.813485] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-26T17:40:24.884579] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-26T17:40:25.556714] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-09-26T17:40:25.738163] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-26T17:40:26.356737] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-09-26T17:40:27.156726] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-09-26T17:40:27.258144] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-26T17:40:27.844387] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-26T17:40:27.956744] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-09-26T17:40:28.183873] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-26T17:40:28.189449] [INFO ] [REMOTE ] BMEZ: Full fetch complete (40870 records). [2025-09-26T17:40:28.189542] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-09-26T17:40:28.594803] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-09-26T17:40:28.594894] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-09-26T17:40:28.595426] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-09-26T17:40:28.595493] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-09-26T17:40:28.596562] [DEBUG] [LOCAL ] BMEZ: Trimmed 40870 records to 26421 (keeping 200 days of data) [2025-09-26T17:40:28.758341] [DEBUG] [LOCAL ] BMEZ: Primary data saved (26421 records). [2025-09-26T17:40:28.758472] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-09-26T17:40:28.756861] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-09-26T17:40:28.758623] [INFO ] [MAIN ] Update Progress: 309/2371 symbols completed. BMEZ took 43.7s. Estimated remaining: 4h 29m 47s. Rate: 7.6 symbols/min [2025-09-26T17:40:28.943083] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:40:28.943320] [DEBUG] [LOCAL ] BNED: No existing data file found in primary storage. [2025-09-26T17:40:28.943377] [WARN ] [MAIN ] BNED: No existing data found, performing full refresh instead. [2025-09-26T17:40:28.943522] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-09-26T17:40:28.943565] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-09-26T17:40:28.943608] [DEBUG] [LOCAL ] BNED: No primary data file found to delete. [2025-09-26T17:40:28.943661] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-09-26T17:40:29.325865] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:40:29.556696] [INFO ] [REMOTE ] BNED: Fetching primary data for 2024-12. [2025-09-26T17:40:29.686210] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-26T17:40:30.356738] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-09-26T17:40:30.649952] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-26T17:40:31.106736] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-26T17:40:31.156800] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-09-26T17:40:31.561576] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-26T17:40:31.956735] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-09-26T17:40:32.756745] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-09-26T17:40:32.832349] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-26T17:40:33.556713] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-09-26T17:40:33.671844] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-26T17:40:34.078124] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-26T17:40:34.356760] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-09-26T17:40:35.052664] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-26T17:40:35.061762] [INFO ] [REMOTE ] BMO: Full fetch complete (59738 records). [2025-09-26T17:40:35.061954] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-09-26T17:40:35.164527] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-09-26T17:40:35.504533] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-09-26T17:40:35.504624] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-09-26T17:40:35.505394] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-09-26T17:40:35.505496] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-09-26T17:40:35.514629] [DEBUG] [LOCAL ] BMO: Trimmed 59738 records to 41940 (keeping 200 days of data) [2025-09-26T17:40:35.793243] [DEBUG] [LOCAL ] BMO: Primary data saved (41940 records). [2025-09-26T17:40:35.793842] [INFO ] [MAIN ] BMO: Full history saved. [2025-09-26T17:40:35.794186] [INFO ] [MAIN ] Update Progress: 310/2371 symbols completed. BMO took 27.1s. Estimated remaining: 4h 29m 34s. Rate: 7.6 symbols/min [2025-09-26T17:40:35.967124] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-09-26T17:40:35.990974] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:40:36.034596] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-26T17:40:36.037612] [DEBUG] [LOCAL ] BNH: Loaded 4902 existing records from primary storage. [2025-09-26T17:40:36.037823] [INFO ] [MAIN ] BNH: Loaded 4902 existing records. [2025-09-26T17:40:36.250241] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:40:36.250924] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-09-26T17:40:36.250987] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-09-26T17:40:36.251380] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-09-26T17:40:36.251450] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-09-26T17:40:36.460137] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-26T17:40:36.732910] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:40:36.756751] [INFO ] [REMOTE ] BNH: Fetching primary data for 2024-12. [2025-09-26T17:40:37.436244] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-26T17:40:37.556753] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-09-26T17:40:38.138278] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-26T17:40:38.300795] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-26T17:40:38.356748] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-09-26T17:40:39.156723] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-09-26T17:40:39.956732] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-09-26T17:40:40.160493] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-26T17:40:40.212477] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-26T17:40:40.756734] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-09-26T17:40:41.091525] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-26T17:40:41.556722] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-09-26T17:40:41.693018] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-26T17:40:41.915461] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-26T17:40:42.356769] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-09-26T17:40:43.156765] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-09-26T17:40:43.956714] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-09-26T17:40:44.181862] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-26T17:40:44.218527] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-26T17:40:44.686086] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-26T17:40:44.756731] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-09-26T17:40:45.125108] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-26T17:40:45.556724] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-09-26T17:40:46.115551] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-26T17:40:46.356754] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-09-26T17:40:47.156811] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-09-26T17:40:47.956734] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-09-26T17:40:48.731367] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-26T17:40:48.756677] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-09-26T17:40:48.845531] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-09-26T17:40:48.929900] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-26T17:40:48.940720] [INFO ] [REMOTE ] BMY: Full fetch complete (77795 records). [2025-09-26T17:40:48.940894] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-09-26T17:40:49.364837] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-09-26T17:40:49.364987] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-09-26T17:40:49.365890] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-09-26T17:40:49.365960] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-09-26T17:40:49.367691] [DEBUG] [LOCAL ] BMY: Trimmed 77795 records to 54537 (keeping 200 days of data) [2025-09-26T17:40:49.571962] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-09-26T17:40:49.732363] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-26T17:40:49.763610] [DEBUG] [LOCAL ] BMY: Primary data saved (54537 records). [2025-09-26T17:40:49.763787] [INFO ] [MAIN ] BMY: Full history saved. [2025-09-26T17:40:49.763875] [INFO ] [MAIN ] Update Progress: 311/2371 symbols completed. BMY took 36.6s. Estimated remaining: 4h 30m 6s. Rate: 7.6 symbols/min [2025-09-26T17:40:49.941206] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:40:49.945995] [DEBUG] [LOCAL ] BNJ: Loaded 2610 existing records from primary storage. [2025-09-26T17:40:49.946084] [INFO ] [MAIN ] BNJ: Loaded 2610 existing records. [2025-09-26T17:40:50.120097] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-26T17:40:50.146752] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:40:50.147602] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-09-26T17:40:50.147693] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-09-26T17:40:50.148060] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-09-26T17:40:50.148376] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-09-26T17:40:50.366570] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-09-26T17:40:50.547473] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:40:51.019892] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-26T17:40:51.156713] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-09-26T17:40:51.665753] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-26T17:40:51.667305] [INFO ] [REMOTE ] BNH: Full fetch complete (6876 records). [2025-09-26T17:40:51.667382] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-09-26T17:40:51.961980] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2024-12. [2025-09-26T17:40:52.065962] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-09-26T17:40:52.066126] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-09-26T17:40:52.066333] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-09-26T17:40:52.066377] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-09-26T17:40:52.066899] [DEBUG] [LOCAL ] BNH: Trimmed 6876 records to 4926 (keeping 200 days of data) [2025-09-26T17:40:52.098465] [DEBUG] [LOCAL ] BNH: Primary data saved (4926 records). [2025-09-26T17:40:52.098631] [INFO ] [MAIN ] BNH: Full history saved. [2025-09-26T17:40:52.098771] [INFO ] [MAIN ] Update Progress: 312/2371 symbols completed. BNH took 16.3s. Estimated remaining: 4h 29m 22s. Rate: 7.6 symbols/min [2025-09-26T17:40:52.281994] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:40:52.340931] [DEBUG] [LOCAL ] BNL: Loaded 47233 existing records from primary storage. [2025-09-26T17:40:52.341105] [INFO ] [MAIN ] BNL: Loaded 47233 existing records. [2025-09-26T17:40:52.529427] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:40:52.529726] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-09-26T17:40:52.529825] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-09-26T17:40:52.531206] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-09-26T17:40:52.531271] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-09-26T17:40:52.765470] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-26T17:40:52.765557] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-09-26T17:40:52.956599] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:40:53.556741] [INFO ] [REMOTE ] BNL: Fetching primary data for 2024-12. [2025-09-26T17:40:54.288402] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-26T17:40:54.356765] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-09-26T17:40:55.156730] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-09-26T17:40:55.211483] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-26T17:40:55.837461] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-26T17:40:55.956775] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-09-26T17:40:56.436108] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-26T17:40:56.756734] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-09-26T17:40:56.985995] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-26T17:40:57.239817] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-26T17:40:57.556739] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-09-26T17:40:58.356752] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-09-26T17:40:59.011279] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-26T17:40:59.156757] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-09-26T17:40:59.652701] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-26T17:40:59.734406] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-26T17:40:59.740210] [INFO ] [REMOTE ] BNED: Full fetch complete (44121 records). [2025-09-26T17:40:59.740340] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-09-26T17:40:59.963225] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-09-26T17:41:00.140416] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-09-26T17:41:00.140509] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-09-26T17:41:00.141052] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-09-26T17:41:00.141116] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-09-26T17:41:00.142345] [DEBUG] [LOCAL ] BNED: Trimmed 44121 records to 30226 (keeping 200 days of data) [2025-09-26T17:41:00.329495] [DEBUG] [LOCAL ] BNED: Primary data saved (30226 records). [2025-09-26T17:41:00.329669] [INFO ] [MAIN ] BNED: Full history saved. [2025-09-26T17:41:00.329771] [INFO ] [MAIN ] Update Progress: 313/2371 symbols completed. BNED took 31.6s. Estimated remaining: 4h 29m 17s. Rate: 7.6 symbols/min [2025-09-26T17:41:00.512682] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:41:00.570981] [DEBUG] [LOCAL ] BNS: Loaded 51844 existing records from primary storage. [2025-09-26T17:41:00.571134] [INFO ] [MAIN ] BNS: Loaded 51844 existing records. [2025-09-26T17:41:00.684921] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-26T17:41:00.765811] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-09-26T17:41:00.775339] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:41:00.776717] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-09-26T17:41:00.776794] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-09-26T17:41:00.778353] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-09-26T17:41:00.778424] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-09-26T17:41:01.171307] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:41:01.556731] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-09-26T17:41:02.356732] [INFO ] [REMOTE ] BNS: Fetching primary data for 2024-12. [2025-09-26T17:41:02.731232] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-26T17:41:02.801296] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-26T17:41:03.156737] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-09-26T17:41:03.956802] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-09-26T17:41:04.235870] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-26T17:41:04.756783] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-09-26T17:41:05.003896] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-26T17:41:05.290683] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-26T17:41:05.556721] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-09-26T17:41:06.031118] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-26T17:41:06.356771] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-09-26T17:41:07.156752] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-09-26T17:41:07.157783] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T17:41:07.956695] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-09-26T17:41:08.133851] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-26T17:41:08.759421] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-09-26T17:41:08.765912] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-26T17:41:08.777329] [INFO ] [REMOTE ] BN: Full fetch complete (76645 records). [2025-09-26T17:41:08.777561] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-09-26T17:41:09.220108] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-09-26T17:41:09.220227] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-09-26T17:41:09.221200] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-09-26T17:41:09.221291] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-09-26T17:41:09.223287] [DEBUG] [LOCAL ] BN: Trimmed 76645 records to 53774 (keeping 200 days of data) [2025-09-26T17:41:09.318522] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-26T17:41:09.323121] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-26T17:41:09.571129] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-09-26T17:41:09.626429] [DEBUG] [LOCAL ] BN: Primary data saved (53774 records). [2025-09-26T17:41:09.626604] [INFO ] [MAIN ] BN: Full history saved. [2025-09-26T17:41:09.626747] [INFO ] [MAIN ] Update Progress: 314/2371 symbols completed. BN took 50.2s. Estimated remaining: 4h 29m 18s. Rate: 7.6 symbols/min [2025-09-26T17:41:09.819418] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:41:09.824713] [DEBUG] [LOCAL ] BNT: Loaded 3437 existing records from primary storage. [2025-09-26T17:41:09.824802] [INFO ] [MAIN ] BNT: Loaded 3437 existing records. [2025-09-26T17:41:10.020549] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:41:10.020887] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-09-26T17:41:10.020944] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-09-26T17:41:10.021288] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-09-26T17:41:10.021354] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-09-26T17:41:10.098955] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-26T17:41:10.361874] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-09-26T17:41:10.422394] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:41:10.832488] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-26T17:41:11.156724] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-09-26T17:41:11.607005] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-26T17:41:11.956769] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-09-26T17:41:12.756753] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-09-26T17:41:13.298865] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-26T17:41:13.556743] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-09-26T17:41:14.147214] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-26T17:41:14.149464] [INFO ] [REMOTE ] BNJ: Full fetch complete (4421 records). [2025-09-26T17:41:14.149910] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-09-26T17:41:14.361185] [INFO ] [REMOTE ] BNT: Fetching primary data for 2024-12. [2025-09-26T17:41:14.370977] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-26T17:41:14.602786] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-09-26T17:41:14.602899] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-09-26T17:41:14.603067] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-09-26T17:41:14.603127] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-09-26T17:41:14.603532] [DEBUG] [LOCAL ] BNJ: Trimmed 4421 records to 2631 (keeping 200 days of data) [2025-09-26T17:41:14.622376] [DEBUG] [LOCAL ] BNJ: Primary data saved (2631 records). [2025-09-26T17:41:14.622510] [INFO ] [MAIN ] BNJ: Full history saved. [2025-09-26T17:41:14.622601] [INFO ] [MAIN ] Update Progress: 315/2371 symbols completed. BNJ took 24.9s. Estimated remaining: 4h 28m 52s. Rate: 7.6 symbols/min [2025-09-26T17:41:14.799968] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:41:14.809016] [DEBUG] [LOCAL ] BNY: Loaded 7428 existing records from primary storage. [2025-09-26T17:41:14.809137] [INFO ] [MAIN ] BNY: Loaded 7428 existing records. [2025-09-26T17:41:14.991917] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:41:14.992166] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-09-26T17:41:14.992214] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-09-26T17:41:14.992619] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-09-26T17:41:14.992738] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-09-26T17:41:15.107591] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-26T17:41:15.161828] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-09-26T17:41:15.392008] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:41:15.713536] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-26T17:41:15.956743] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-09-26T17:41:16.756761] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-09-26T17:41:17.288464] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-26T17:41:17.556743] [INFO ] [REMOTE ] BNY: Fetching primary data for 2024-12. [2025-09-26T17:41:17.632998] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-26T17:41:18.356747] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-09-26T17:41:18.455617] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-26T17:41:19.156733] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-09-26T17:41:19.801770] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-26T17:41:19.943165] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-26T17:41:19.956675] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-09-26T17:41:20.756748] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-09-26T17:41:21.531781] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-26T17:41:21.541383] [INFO ] [REMOTE ] BNL: Full fetch complete (66707 records). [2025-09-26T17:41:21.541522] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-09-26T17:41:21.564803] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-09-26T17:41:21.955281] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-09-26T17:41:21.955388] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-09-26T17:41:21.956115] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-09-26T17:41:21.956184] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-09-26T17:41:21.958083] [DEBUG] [LOCAL ] BNL: Trimmed 66707 records to 47577 (keeping 200 days of data) [2025-09-26T17:41:22.225697] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-26T17:41:22.226147] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-26T17:41:22.314977] [DEBUG] [LOCAL ] BNL: Primary data saved (47577 records). [2025-09-26T17:41:22.315124] [INFO ] [MAIN ] BNL: Full history saved. [2025-09-26T17:41:22.315227] [INFO ] [MAIN ] Update Progress: 316/2371 symbols completed. BNL took 30.2s. Estimated remaining: 4h 28m 43s. Rate: 7.6 symbols/min [2025-09-26T17:41:22.361801] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-09-26T17:41:22.500815] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:41:22.520412] [DEBUG] [LOCAL ] BOC: Loaded 18500 existing records from primary storage. [2025-09-26T17:41:22.520558] [INFO ] [MAIN ] BOC: Loaded 18500 existing records. [2025-09-26T17:41:22.708843] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:41:22.709166] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-09-26T17:41:22.709245] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-09-26T17:41:22.709968] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-09-26T17:41:22.710033] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-09-26T17:41:23.128993] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:41:23.129395] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-26T17:41:23.156670] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-09-26T17:41:23.639918] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-26T17:41:23.956796] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-09-26T17:41:24.553398] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-26T17:41:24.756764] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-09-26T17:41:25.452764] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-26T17:41:25.556732] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-09-26T17:41:26.238716] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-26T17:41:26.356755] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-09-26T17:41:27.073823] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-26T17:41:27.156730] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-09-26T17:41:27.956774] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-12. [2025-09-26T17:41:28.756718] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-09-26T17:41:28.903671] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-26T17:41:28.932078] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-26T17:41:29.233212] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-26T17:41:29.556770] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-09-26T17:41:30.328032] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-26T17:41:30.356795] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-09-26T17:41:31.156713] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-09-26T17:41:31.393615] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-26T17:41:31.956724] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-09-26T17:41:32.757380] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-09-26T17:41:32.763501] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-26T17:41:32.807061] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-26T17:41:33.161954] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-26T17:41:33.556708] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-09-26T17:41:34.137318] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-26T17:41:34.356739] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-09-26T17:41:35.156732] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-09-26T17:41:35.893837] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-26T17:41:35.898164] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-26T17:41:35.956752] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-09-26T17:41:36.756699] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-09-26T17:41:36.902324] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-26T17:41:37.039533] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-26T17:41:37.556722] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-09-26T17:41:38.356715] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-09-26T17:41:38.585447] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-26T17:41:38.890548] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-26T17:41:38.892294] [INFO ] [REMOTE ] BNT: Full fetch complete (4502 records). [2025-09-26T17:41:38.892368] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-09-26T17:41:39.161906] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-09-26T17:41:39.274384] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-09-26T17:41:39.274495] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-09-26T17:41:39.274673] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-09-26T17:41:39.274734] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-09-26T17:41:39.275104] [DEBUG] [LOCAL ] BNT: Trimmed 4502 records to 3473 (keeping 200 days of data) [2025-09-26T17:41:39.299887] [DEBUG] [LOCAL ] BNT: Primary data saved (3473 records). [2025-09-26T17:41:39.300076] [INFO ] [MAIN ] BNT: Full history saved. [2025-09-26T17:41:39.300206] [INFO ] [MAIN ] Update Progress: 317/2371 symbols completed. BNT took 29.7s. Estimated remaining: 4h 29m 34s. Rate: 7.6 symbols/min [2025-09-26T17:41:39.956696] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-09-26T17:41:40.108094] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-26T17:41:40.110314] [INFO ] [REMOTE ] BNY: Full fetch complete (10466 records). [2025-09-26T17:41:40.110398] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-09-26T17:41:40.541320] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-09-26T17:41:40.541438] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-09-26T17:41:40.541842] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-09-26T17:41:40.541918] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-09-26T17:41:40.542915] [DEBUG] [LOCAL ] BNY: Trimmed 10466 records to 7446 (keeping 200 days of data) [2025-09-26T17:41:40.599413] [DEBUG] [LOCAL ] BNY: Primary data saved (7446 records). [2025-09-26T17:41:40.599565] [INFO ] [MAIN ] BNY: Full history saved. [2025-09-26T17:41:40.599690] [INFO ] [MAIN ] Update Progress: 318/2371 symbols completed. BNY took 26.0s. Estimated remaining: 4h 28m 44s. Rate: 7.6 symbols/min [2025-09-26T17:41:40.756768] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-09-26T17:41:41.591393] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-26T17:41:41.602785] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-09-26T17:41:41.845285] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-26T17:41:42.356745] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-09-26T17:41:43.279170] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-26T17:41:43.289821] [INFO ] [REMOTE ] BNS: Full fetch complete (74184 records). [2025-09-26T17:41:43.290011] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-09-26T17:41:43.410019] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-26T17:41:43.414759] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-09-26T17:41:43.717546] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-09-26T17:41:43.717680] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-09-26T17:41:43.718455] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-09-26T17:41:43.718504] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-09-26T17:41:43.720095] [DEBUG] [LOCAL ] BNS: Trimmed 74184 records to 52212 (keeping 200 days of data) [2025-09-26T17:41:44.050453] [DEBUG] [LOCAL ] BNS: Primary data saved (52212 records). [2025-09-26T17:41:44.050720] [INFO ] [MAIN ] BNS: Full history saved. [2025-09-26T17:41:44.050902] [INFO ] [MAIN ] Update Progress: 319/2371 symbols completed. BNS took 43.7s. Estimated remaining: 4h 28m 8s. Rate: 7.7 symbols/min [2025-09-26T17:41:44.533467] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-26T17:41:44.538577] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-09-26T17:41:46.517001] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-26T17:41:46.522801] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-09-26T17:41:48.351183] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-26T17:41:48.355371] [INFO ] [REMOTE ] BOC: Full fetch complete (25704 records). [2025-09-26T17:41:48.355536] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-09-26T17:41:48.356307] [FATAL] [VALIDATOR ] BOC: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:41:48.356427] [FATAL] [MAIN ] BOC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:41:48.356474] [WARN ] [MAIN ] BOC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:41:48.356540] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-09-26T17:41:48.356697] [DEBUG] [LOCAL ] BOC: No primary data file found to delete. [2025-09-26T17:41:48.356785] [INFO ] [LOCAL ] BOC: Starting deletion of derivative data. [2025-09-26T17:41:48.357393] [DEBUG] [LOCAL ] BOC: Deleted derivative data file. [2025-09-26T17:41:48.357578] [INFO ] [MAIN ] Update Progress: 320/2371 symbols completed. BOC took 26.0s. Estimated remaining: 4h 27m 37s. Rate: 7.7 symbols/min [2025-09-26T17:41:49.108204] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:41:49.173120] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:41:49.225605] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:41:49.280308] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:41:49.280833] [DEBUG] [LOCAL ] BOE: No existing data file found in primary storage. [2025-09-26T17:41:49.280890] [WARN ] [MAIN ] BOE: No existing data found, performing full refresh instead. [2025-09-26T17:41:49.281020] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-09-26T17:41:49.281061] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-09-26T17:41:49.281103] [DEBUG] [LOCAL ] BOE: No primary data file found to delete. [2025-09-26T17:41:49.281137] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-09-26T17:41:49.444452] [DEBUG] [LOCAL ] BOH: Loaded 31510 existing records from primary storage. [2025-09-26T17:41:49.496114] [INFO ] [MAIN ] BOH: Loaded 31510 existing records. [2025-09-26T17:41:49.608874] [DEBUG] [LOCAL ] BOND: Loaded 32348 existing records from primary storage. [2025-09-26T17:41:49.655083] [INFO ] [MAIN ] BOND: Loaded 32348 existing records. [2025-09-26T17:41:49.744482] [DEBUG] [LOCAL ] BOOT: Loaded 41144 existing records from primary storage. [2025-09-26T17:41:49.848478] [INFO ] [MAIN ] BOOT: Loaded 41144 existing records. [2025-09-26T17:41:50.127909] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:41:50.185613] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:41:50.217672] [INFO ] [REMOTE ] BOE: Fetching primary data for 2024-12. [2025-09-26T17:41:50.303850] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-09-26T17:41:50.403565] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:41:50.396335] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:41:50.361754] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-09-26T17:41:50.404082] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-09-26T17:41:50.404261] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-09-26T17:41:50.404364] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-09-26T17:41:50.404565] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-09-26T17:41:50.405325] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-09-26T17:41:50.405399] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-09-26T17:41:50.410596] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-09-26T17:41:50.410679] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-09-26T17:41:50.443856] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-09-26T17:41:50.443947] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-09-26T17:41:51.586325] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:41:51.574216] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:41:51.587452] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2024-12. [2025-09-26T17:41:51.588983] [INFO ] [REMOTE ] BOH: Fetching primary data for 2024-12. [2025-09-26T17:41:51.690764] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:41:51.692220] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-26T17:41:51.698079] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-09-26T17:41:51.692613] [INFO ] [REMOTE ] BOND: Fetching primary data for 2024-12. [2025-09-26T17:41:52.806415] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-26T17:41:52.811901] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-09-26T17:41:52.958247] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-26T17:41:52.965886] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-09-26T17:41:52.985437] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T17:41:52.991692] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-09-26T17:41:53.059395] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-26T17:41:53.068084] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-09-26T17:41:53.438249] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-26T17:41:53.442807] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-09-26T17:41:53.912982] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-26T17:41:53.922521] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-09-26T17:41:54.072978] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-26T17:41:54.280344] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-26T17:41:54.334884] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-26T17:41:54.356751] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-09-26T17:41:54.768473] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-26T17:41:55.156774] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-09-26T17:41:55.563410] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-26T17:41:55.956772] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-09-26T17:41:56.755836] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-26T17:41:56.763475] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-09-26T17:41:57.556725] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-09-26T17:41:57.760973] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-26T17:41:58.356785] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-09-26T17:41:58.783570] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-26T17:41:59.164148] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-09-26T17:41:59.173255] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-09-26T17:41:59.260717] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-26T17:41:59.956748] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-09-26T17:42:00.161750] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-26T17:42:00.756759] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-09-26T17:42:01.024819] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-26T17:42:01.556715] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-09-26T17:42:01.584296] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-26T17:42:02.356798] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-09-26T17:42:02.790392] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-26T17:42:03.156726] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-09-26T17:42:03.788969] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-26T17:42:03.956795] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-09-26T17:42:04.187161] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-26T17:42:04.756767] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-09-26T17:42:05.425226] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T17:42:05.556737] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-09-26T17:42:05.677938] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-26T17:42:06.155671] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-26T17:42:06.356765] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-09-26T17:42:07.156754] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-09-26T17:42:07.712967] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-26T17:42:07.956772] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-09-26T17:42:08.352498] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-26T17:42:08.756772] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-09-26T17:42:09.049415] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-26T17:42:09.556726] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-09-26T17:42:10.251014] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T17:42:10.356737] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-09-26T17:42:10.890783] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-26T17:42:11.156785] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-09-26T17:42:11.794283] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-26T17:42:11.956750] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-09-26T17:42:12.506159] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-26T17:42:12.756774] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-09-26T17:42:13.489324] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-26T17:42:13.496994] [INFO ] [REMOTE ] BOND: Full fetch complete (46324 records). [2025-09-26T17:42:13.497178] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-09-26T17:42:13.564745] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-09-26T17:42:13.917843] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-09-26T17:42:13.926934] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-09-26T17:42:13.928430] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-09-26T17:42:13.928851] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-26T17:42:13.929128] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-09-26T17:42:13.934332] [DEBUG] [LOCAL ] BOND: Trimmed 46324 records to 32554 (keeping 200 days of data) [2025-09-26T17:42:14.146278] [DEBUG] [LOCAL ] BOND: Primary data saved (32554 records). [2025-09-26T17:42:14.146491] [INFO ] [MAIN ] BOND: Full history saved. [2025-09-26T17:42:14.146694] [INFO ] [MAIN ] Update Progress: 321/2371 symbols completed. BOND took 25.8s. Estimated remaining: 4h 29m 24s. Rate: 7.6 symbols/min [2025-09-26T17:42:14.336826] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:42:14.365894] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-09-26T17:42:14.390060] [DEBUG] [LOCAL ] BORR: Loaded 51538 existing records from primary storage. [2025-09-26T17:42:14.390232] [INFO ] [MAIN ] BORR: Loaded 51538 existing records. [2025-09-26T17:42:14.573865] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:42:14.574118] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-09-26T17:42:14.574209] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-09-26T17:42:14.575823] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-09-26T17:42:14.575898] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-09-26T17:42:14.964179] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:42:15.156738] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-09-26T17:42:15.186883] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-26T17:42:15.193526] [INFO ] [REMOTE ] BOH: Full fetch complete (44890 records). [2025-09-26T17:42:15.193754] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-09-26T17:42:15.568759] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-26T17:42:15.606234] [INFO ] [REMOTE ] BOE: Full fetch complete (26680 records). [2025-09-26T17:42:15.652806] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-09-26T17:42:15.719326] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-09-26T17:42:15.756998] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-09-26T17:42:15.786551] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-09-26T17:42:15.791262] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-09-26T17:42:15.855501] [DEBUG] [LOCAL ] BOH: Trimmed 44890 records to 31676 (keeping 200 days of data) [2025-09-26T17:42:16.016666] [INFO ] [REMOTE ] BORR: Fetching primary data for 2024-12. [2025-09-26T17:42:16.208756] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-09-26T17:42:16.209379] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-09-26T17:42:16.211411] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-09-26T17:42:16.212030] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-09-26T17:42:16.219424] [DEBUG] [LOCAL ] BOE: Trimmed 26680 records to 17816 (keeping 200 days of data) [2025-09-26T17:42:16.421037] [DEBUG] [LOCAL ] BOH: Primary data saved (31676 records). [2025-09-26T17:42:16.423253] [INFO ] [MAIN ] BOH: Full history saved. [2025-09-26T17:42:16.423456] [INFO ] [MAIN ] Update Progress: 322/2371 symbols completed. BOH took 28.1s. Estimated remaining: 4h 28m 41s. Rate: 7.6 symbols/min [2025-09-26T17:42:16.572364] [DEBUG] [LOCAL ] BOE: Primary data saved (17816 records). [2025-09-26T17:42:16.633977] [INFO ] [MAIN ] BOE: Full history saved. [2025-09-26T17:42:16.639347] [INFO ] [MAIN ] Update Progress: 323/2371 symbols completed. BOE took 28.3s. Estimated remaining: 4h 27m 44s. Rate: 7.6 symbols/min [2025-09-26T17:42:16.639072] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:42:16.749749] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-26T17:42:16.824390] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-09-26T17:42:16.898634] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:42:16.899693] [DEBUG] [LOCAL ] BOW: Loaded 23795 existing records from primary storage. [2025-09-26T17:42:16.900052] [INFO ] [MAIN ] BOW: Loaded 23795 existing records. [2025-09-26T17:42:17.119536] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:42:17.119948] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-09-26T17:42:17.120032] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-09-26T17:42:17.120938] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-09-26T17:42:17.121016] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-09-26T17:42:17.249108] [DEBUG] [LOCAL ] BOX: Loaded 50653 existing records from primary storage. [2025-09-26T17:42:17.254934] [INFO ] [MAIN ] BOX: Loaded 50653 existing records. [2025-09-26T17:42:17.655855] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:42:17.696578] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-09-26T17:42:17.701997] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-09-26T17:42:17.742204] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:42:17.742789] [INFO ] [REMOTE ] BOW: Fetching primary data for 2024-12. [2025-09-26T17:42:17.743887] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-09-26T17:42:17.743980] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-09-26T17:42:18.100774] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-26T17:42:18.231893] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:42:18.361855] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-09-26T17:42:18.372773] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-26T17:42:18.965962] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-26T17:42:19.156747] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-09-26T17:42:19.916872] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-26T17:42:19.956698] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-09-26T17:42:20.444088] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-26T17:42:20.756761] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-09-26T17:42:20.782934] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-26T17:42:21.556743] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-09-26T17:42:22.128426] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-26T17:42:22.136033] [INFO ] [REMOTE ] BOOT: Full fetch complete (60270 records). [2025-09-26T17:42:22.136198] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-09-26T17:42:22.367327] [INFO ] [REMOTE ] BOX: Fetching primary data for 2024-12. [2025-09-26T17:42:22.576485] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-09-26T17:42:22.576737] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-09-26T17:42:22.577552] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-09-26T17:42:22.577710] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-09-26T17:42:22.597462] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-26T17:42:22.604555] [DEBUG] [LOCAL ] BOOT: Trimmed 60270 records to 41409 (keeping 200 days of data) [2025-09-26T17:42:22.871166] [DEBUG] [LOCAL ] BOOT: Primary data saved (41409 records). [2025-09-26T17:42:22.871302] [INFO ] [MAIN ] BOOT: Full history saved. [2025-09-26T17:42:22.871384] [INFO ] [MAIN ] Update Progress: 324/2371 symbols completed. BOOT took 34.5s. Estimated remaining: 4h 27m 26s. Rate: 7.7 symbols/min [2025-09-26T17:42:23.062307] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:42:23.117357] [DEBUG] [LOCAL ] BP: Loaded 54101 existing records from primary storage. [2025-09-26T17:42:23.117513] [INFO ] [MAIN ] BP: Loaded 54101 existing records. [2025-09-26T17:42:23.161926] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-09-26T17:42:23.307309] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:42:23.307577] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-09-26T17:42:23.307630] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-09-26T17:42:23.309572] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-09-26T17:42:23.309709] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-09-26T17:42:23.714112] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:42:23.957079] [INFO ] [REMOTE ] BP: Fetching primary data for 2024-12. [2025-09-26T17:42:23.961483] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-26T17:42:24.467448] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-26T17:42:24.756751] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-09-26T17:42:25.556746] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-09-26T17:42:26.283041] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-26T17:42:26.362797] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-09-26T17:42:26.403462] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-09-26T17:42:26.437441] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-26T17:42:27.156772] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-09-26T17:42:27.956705] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-09-26T17:42:28.128877] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-26T17:42:28.692581] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-26T17:42:28.762489] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-09-26T17:42:28.774672] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-26T17:42:29.556708] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-09-26T17:42:30.356733] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-09-26T17:42:30.597685] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-26T17:42:30.847034] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-26T17:42:31.156738] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-09-26T17:42:31.956691] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-09-26T17:42:32.456562] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-26T17:42:32.789243] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-09-26T17:42:32.810917] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-26T17:42:33.556691] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-09-26T17:42:33.731446] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-26T17:42:33.766081] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-26T17:42:34.356723] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-09-26T17:42:34.974339] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-26T17:42:35.156728] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-09-26T17:42:35.956718] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-09-26T17:42:36.252199] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-26T17:42:36.322330] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-26T17:42:36.756736] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-09-26T17:42:37.502406] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T17:42:37.556702] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-09-26T17:42:37.704668] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-26T17:42:37.709502] [INFO ] [REMOTE ] BOW: Full fetch complete (31170 records). [2025-09-26T17:42:37.709597] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-09-26T17:42:38.108956] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-09-26T17:42:38.109038] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-09-26T17:42:38.109457] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-09-26T17:42:38.109497] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-09-26T17:42:38.110353] [DEBUG] [LOCAL ] BOW: Trimmed 31170 records to 23974 (keeping 200 days of data) [2025-09-26T17:42:38.250626] [DEBUG] [LOCAL ] BOW: Primary data saved (23974 records). [2025-09-26T17:42:38.250784] [INFO ] [MAIN ] BOW: Full history saved. [2025-09-26T17:42:38.250874] [INFO ] [MAIN ] Update Progress: 325/2371 symbols completed. BOW took 21.8s. Estimated remaining: 4h 28m 6s. Rate: 7.6 symbols/min [2025-09-26T17:42:38.365669] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-09-26T17:42:38.453249] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:42:38.453471] [DEBUG] [LOCAL ] BR: No existing data file found in primary storage. [2025-09-26T17:42:38.453538] [WARN ] [MAIN ] BR: No existing data found, performing full refresh instead. [2025-09-26T17:42:38.453868] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-09-26T17:42:38.453929] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-09-26T17:42:38.453980] [DEBUG] [LOCAL ] BR: No primary data file found to delete. [2025-09-26T17:42:38.454033] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-09-26T17:42:38.854986] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:42:38.933148] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-26T17:42:39.156757] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-09-26T17:42:39.956719] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-09-26T17:42:40.040602] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-26T17:42:40.756693] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-09-26T17:42:40.832533] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-26T17:42:41.556749] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-09-26T17:42:41.669041] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-26T17:42:42.356760] [INFO ] [REMOTE ] BR: Fetching primary data for 2024-12. [2025-09-26T17:42:42.497874] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-26T17:42:43.156739] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-09-26T17:42:43.490495] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-26T17:42:43.612713] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-26T17:42:43.956768] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-09-26T17:42:44.756728] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-09-26T17:42:45.123274] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-26T17:42:45.164386] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-26T17:42:45.556713] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-09-26T17:42:46.361868] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-09-26T17:42:46.378396] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-26T17:42:46.392027] [INFO ] [REMOTE ] BOX: Full fetch complete (72106 records). [2025-09-26T17:42:46.392222] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-09-26T17:42:46.875673] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-09-26T17:42:46.876932] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-26T17:42:46.876308] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-09-26T17:42:46.877947] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-09-26T17:42:46.886142] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-09-26T17:42:46.888338] [DEBUG] [LOCAL ] BOX: Trimmed 72106 records to 51017 (keeping 200 days of data) [2025-09-26T17:42:47.173441] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-09-26T17:42:47.215831] [DEBUG] [LOCAL ] BOX: Primary data saved (51017 records). [2025-09-26T17:42:47.215976] [INFO ] [MAIN ] BOX: Full history saved. [2025-09-26T17:42:47.216105] [INFO ] [MAIN ] Update Progress: 326/2371 symbols completed. BOX took 30.6s. Estimated remaining: 4h 28m 5s. Rate: 7.6 symbols/min [2025-09-26T17:42:47.395485] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:42:47.454073] [DEBUG] [LOCAL ] BRBR: Loaded 51612 existing records from primary storage. [2025-09-26T17:42:47.454219] [INFO ] [MAIN ] BRBR: Loaded 51612 existing records. [2025-09-26T17:42:47.648297] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:42:47.648560] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-09-26T17:42:47.648609] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-09-26T17:42:47.650292] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-09-26T17:42:47.650369] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-09-26T17:42:47.958971] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-09-26T17:42:48.042507] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:42:48.640630] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-26T17:42:48.714448] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-26T17:42:48.756715] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-09-26T17:42:49.211836] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-26T17:42:49.556717] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2024-12. [2025-09-26T17:42:50.356328] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-26T17:42:50.360011] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-09-26T17:42:50.367986] [INFO ] [REMOTE ] BORR: Full fetch complete (74716 records). [2025-09-26T17:42:50.368095] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-09-26T17:42:50.801725] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-09-26T17:42:50.801846] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-09-26T17:42:50.802618] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-09-26T17:42:50.802868] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-09-26T17:42:50.805006] [DEBUG] [LOCAL ] BORR: Trimmed 74716 records to 51902 (keeping 200 days of data) [2025-09-26T17:42:50.942087] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-26T17:42:51.153765] [DEBUG] [LOCAL ] BORR: Primary data saved (51902 records). [2025-09-26T17:42:51.153928] [INFO ] [MAIN ] BORR: Full history saved. [2025-09-26T17:42:51.154036] [INFO ] [MAIN ] Update Progress: 327/2371 symbols completed. BORR took 37.0s. Estimated remaining: 4h 27m 32s. Rate: 7.6 symbols/min [2025-09-26T17:42:51.166032] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-09-26T17:42:51.336423] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:42:51.356935] [DEBUG] [LOCAL ] BRC: Loaded 19466 existing records from primary storage. [2025-09-26T17:42:51.357079] [INFO ] [MAIN ] BRC: Loaded 19466 existing records. [2025-09-26T17:42:51.583500] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:42:51.584348] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-09-26T17:42:51.584600] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-09-26T17:42:51.585569] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-09-26T17:42:51.585706] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-09-26T17:42:51.832320] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-26T17:42:51.961904] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-09-26T17:42:52.036928] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:42:52.756752] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-09-26T17:42:53.249205] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-26T17:42:53.288987] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-26T17:42:53.556735] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-09-26T17:42:53.929306] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-26T17:42:54.356771] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-09-26T17:42:54.470854] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-26T17:42:55.156747] [INFO ] [REMOTE ] BRC: Fetching primary data for 2024-12. [2025-09-26T17:42:55.550895] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-26T17:42:55.956742] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-09-26T17:42:56.288026] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-26T17:42:56.756777] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-09-26T17:42:57.556726] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-09-26T17:42:58.006128] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-26T17:42:58.148794] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-26T17:42:58.356747] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-09-26T17:42:58.751623] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-26T17:42:59.002794] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-26T17:42:59.156769] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-09-26T17:42:59.956735] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-09-26T17:43:00.756782] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-09-26T17:43:01.054142] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-26T17:43:01.091949] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-26T17:43:01.556693] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-09-26T17:43:01.954581] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-26T17:43:02.356752] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-09-26T17:43:03.156748] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-09-26T17:43:03.408903] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-26T17:43:03.525790] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-26T17:43:03.533430] [INFO ] [REMOTE ] BR: Full fetch complete (49074 records). [2025-09-26T17:43:03.533574] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-09-26T17:43:03.952529] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-09-26T17:43:03.952615] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-09-26T17:43:03.953245] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-09-26T17:43:03.953306] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-09-26T17:43:03.955489] [DEBUG] [LOCAL ] BR: Trimmed 49074 records to 35251 (keeping 200 days of data) [2025-09-26T17:43:03.956773] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-09-26T17:43:04.190801] [DEBUG] [LOCAL ] BR: Primary data saved (35251 records). [2025-09-26T17:43:04.190951] [INFO ] [MAIN ] BR: Full history saved. [2025-09-26T17:43:04.191035] [INFO ] [MAIN ] Update Progress: 328/2371 symbols completed. BR took 25.9s. Estimated remaining: 4h 27m 57s. Rate: 7.6 symbols/min [2025-09-26T17:43:04.381125] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:43:04.428161] [DEBUG] [LOCAL ] BRCC: Loaded 40672 existing records from primary storage. [2025-09-26T17:43:04.428378] [INFO ] [MAIN ] BRCC: Loaded 40672 existing records. [2025-09-26T17:43:04.618868] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:43:04.619173] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-09-26T17:43:04.619230] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-09-26T17:43:04.620581] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-09-26T17:43:04.620675] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-09-26T17:43:04.757165] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-09-26T17:43:04.955303] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-26T17:43:05.045548] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:43:05.079087] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-26T17:43:05.556724] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2024-12. [2025-09-26T17:43:06.356699] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-09-26T17:43:06.560541] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-26T17:43:07.164098] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-09-26T17:43:07.169722] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-26T17:43:07.956744] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-09-26T17:43:08.219671] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-26T17:43:08.230746] [INFO ] [REMOTE ] BP: Full fetch complete (77763 records). [2025-09-26T17:43:08.230902] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-09-26T17:43:08.675711] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-09-26T17:43:08.675897] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-09-26T17:43:08.676963] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-09-26T17:43:08.677071] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-09-26T17:43:08.711913] [DEBUG] [LOCAL ] BP: Trimmed 77763 records to 54491 (keeping 200 days of data) [2025-09-26T17:43:08.714091] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-26T17:43:08.793215] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-09-26T17:43:09.095178] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-26T17:43:09.140508] [DEBUG] [LOCAL ] BP: Primary data saved (54491 records). [2025-09-26T17:43:09.140715] [INFO ] [MAIN ] BP: Full history saved. [2025-09-26T17:43:09.140855] [INFO ] [MAIN ] Update Progress: 329/2371 symbols completed. BP took 46.3s. Estimated remaining: 4h 27m 31s. Rate: 7.6 symbols/min [2025-09-26T17:43:09.324223] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:43:09.392464] [DEBUG] [LOCAL ] BRO: Loaded 52300 existing records from primary storage. [2025-09-26T17:43:09.392673] [INFO ] [MAIN ] BRO: Loaded 52300 existing records. [2025-09-26T17:43:09.561863] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-09-26T17:43:09.602824] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:43:09.603160] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-09-26T17:43:09.603218] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-09-26T17:43:09.604948] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-09-26T17:43:09.605012] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-09-26T17:43:09.981008] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:43:10.326438] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-26T17:43:10.356682] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-09-26T17:43:10.964871] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-26T17:43:11.156748] [INFO ] [REMOTE ] BRO: Fetching primary data for 2024-12. [2025-09-26T17:43:11.918153] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-26T17:43:11.928920] [INFO ] [REMOTE ] BRBR: Full fetch complete (71905 records). [2025-09-26T17:43:11.929064] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-09-26T17:43:11.965920] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-09-26T17:43:12.401043] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-09-26T17:43:12.401242] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-09-26T17:43:12.402176] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-09-26T17:43:12.402258] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-09-26T17:43:12.403983] [DEBUG] [LOCAL ] BRBR: Trimmed 71905 records to 51987 (keeping 200 days of data) [2025-09-26T17:43:12.646567] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-26T17:43:12.756933] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-09-26T17:43:12.767411] [DEBUG] [LOCAL ] BRBR: Primary data saved (51987 records). [2025-09-26T17:43:12.767531] [INFO ] [MAIN ] BRBR: Full history saved. [2025-09-26T17:43:12.767623] [INFO ] [MAIN ] Update Progress: 330/2371 symbols completed. BRBR took 25.6s. Estimated remaining: 4h 26m 57s. Rate: 7.6 symbols/min [2025-09-26T17:43:12.971273] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:43:13.028725] [DEBUG] [LOCAL ] BROS: Loaded 53677 existing records from primary storage. [2025-09-26T17:43:13.028883] [INFO ] [MAIN ] BROS: Loaded 53677 existing records. [2025-09-26T17:43:13.251755] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:43:13.253065] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-26T17:43:13.258219] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-09-26T17:43:13.258626] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-09-26T17:43:13.260206] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-09-26T17:43:13.260275] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-09-26T17:43:13.560969] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-09-26T17:43:13.644270] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:43:14.356801] [INFO ] [REMOTE ] BROS: Fetching primary data for 2024-12. [2025-09-26T17:43:14.565419] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-26T17:43:14.622754] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-26T17:43:15.156773] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-09-26T17:43:15.956729] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-09-26T17:43:16.026889] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-26T17:43:16.051238] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-26T17:43:16.756743] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-09-26T17:43:17.432857] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-26T17:43:17.556707] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-09-26T17:43:18.093200] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-26T17:43:18.356731] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-09-26T17:43:19.096475] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-26T17:43:19.136025] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-26T17:43:19.156680] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-09-26T17:43:19.956735] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-09-26T17:43:20.756757] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-09-26T17:43:20.899838] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-26T17:43:21.072479] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-26T17:43:21.556727] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-09-26T17:43:22.351176] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-26T17:43:22.361519] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-09-26T17:43:23.156743] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-09-26T17:43:23.537267] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-26T17:43:23.652006] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-26T17:43:23.956748] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-09-26T17:43:24.613047] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-26T17:43:24.618107] [INFO ] [REMOTE ] BRC: Full fetch complete (29139 records). [2025-09-26T17:43:24.618239] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-09-26T17:43:24.768729] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-09-26T17:43:25.013338] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-09-26T17:43:25.013421] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-09-26T17:43:25.013900] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-09-26T17:43:25.013965] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-09-26T17:43:25.014781] [DEBUG] [LOCAL ] BRC: Trimmed 29139 records to 19567 (keeping 200 days of data) [2025-09-26T17:43:25.136114] [DEBUG] [LOCAL ] BRC: Primary data saved (19567 records). [2025-09-26T17:43:25.136266] [INFO ] [MAIN ] BRC: Full history saved. [2025-09-26T17:43:25.136369] [INFO ] [MAIN ] Update Progress: 331/2371 symbols completed. BRC took 34.0s. Estimated remaining: 4h 27m 17s. Rate: 7.6 symbols/min [2025-09-26T17:43:25.314122] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:43:25.314312] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-09-26T17:43:25.314350] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-09-26T17:43:25.314490] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-09-26T17:43:25.314533] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-26T17:43:25.314574] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-26T17:43:25.314607] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-09-26T17:43:25.584732] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-09-26T17:43:25.707881] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:43:25.999960] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-26T17:43:26.062039] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-26T17:43:26.356737] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-09-26T17:43:27.156730] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-09-26T17:43:27.244767] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-26T17:43:27.905662] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-26T17:43:27.956753] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-12. [2025-09-26T17:43:28.166687] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:43:28.167074] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-12 [2025-09-26T17:43:28.758971] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-09-26T17:43:28.761698] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-26T17:43:29.556721] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-09-26T17:43:30.356708] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-09-26T17:43:30.455428] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-26T17:43:30.719572] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-26T17:43:31.156726] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-09-26T17:43:31.830025] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T17:43:31.956722] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-09-26T17:43:32.756729] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-09-26T17:43:33.154140] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-26T17:43:33.310433] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-26T17:43:33.556730] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-01. [2025-09-26T17:43:33.762015] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:43:33.762469] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-01 [2025-09-26T17:43:33.980625] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-26T17:43:34.356788] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-09-26T17:43:35.156786] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-02. [2025-09-26T17:43:35.360340] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:43:35.360764] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-02 [2025-09-26T17:43:35.956446] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-26T17:43:35.956726] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-03. [2025-09-26T17:43:36.170300] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:43:36.170620] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-03 [2025-09-26T17:43:36.756773] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-09-26T17:43:37.556771] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-04. [2025-09-26T17:43:37.769830] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:43:37.770167] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-04 [2025-09-26T17:43:38.356751] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-05. [2025-09-26T17:43:38.564303] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:43:38.564669] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-05 [2025-09-26T17:43:38.635343] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-26T17:43:39.156735] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-09-26T17:43:39.956726] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-09-26T17:43:40.694039] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-26T17:43:40.702959] [INFO ] [REMOTE ] BRCC: Full fetch complete (57856 records). [2025-09-26T17:43:40.703111] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-09-26T17:43:40.768003] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-09-26T17:43:41.121126] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-09-26T17:43:41.121255] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-09-26T17:43:41.122392] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-09-26T17:43:41.122474] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-09-26T17:43:41.123944] [DEBUG] [LOCAL ] BRCC: Trimmed 57856 records to 40896 (keeping 200 days of data) [2025-09-26T17:43:41.370613] [DEBUG] [LOCAL ] BRCC: Primary data saved (40896 records). [2025-09-26T17:43:41.370782] [INFO ] [MAIN ] BRCC: Full history saved. [2025-09-26T17:43:41.370908] [INFO ] [MAIN ] Update Progress: 332/2371 symbols completed. BRCC took 37.2s. Estimated remaining: 4h 28m 0s. Rate: 7.6 symbols/min [2025-09-26T17:43:41.560915] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-06. [2025-09-26T17:43:41.564761] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:43:41.606152] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-26T17:43:41.648385] [DEBUG] [LOCAL ] BRSP: Loaded 37224 existing records from primary storage. [2025-09-26T17:43:41.648565] [INFO ] [MAIN ] BRSP: Loaded 37224 existing records. [2025-09-26T17:43:41.794363] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:43:41.848962] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-06 [2025-09-26T17:43:41.856517] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:43:41.856837] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-09-26T17:43:41.856908] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-09-26T17:43:41.858115] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-09-26T17:43:41.858200] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-09-26T17:43:42.295120] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:43:42.356765] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2024-12. [2025-09-26T17:43:42.568359] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-26T17:43:42.579002] [INFO ] [REMOTE ] BROS: Full fetch complete (76999 records). [2025-09-26T17:43:42.579158] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-09-26T17:43:43.004482] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-09-26T17:43:43.004570] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-09-26T17:43:43.005423] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-09-26T17:43:43.005491] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-09-26T17:43:43.007058] [DEBUG] [LOCAL ] BROS: Trimmed 76999 records to 54067 (keeping 200 days of data) [2025-09-26T17:43:43.183721] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-09-26T17:43:43.342971] [DEBUG] [LOCAL ] BROS: Primary data saved (54067 records). [2025-09-26T17:43:43.343111] [INFO ] [MAIN ] BROS: Full history saved. [2025-09-26T17:43:43.343233] [INFO ] [MAIN ] Update Progress: 333/2371 symbols completed. BROS took 30.6s. Estimated remaining: 4h 27m 16s. Rate: 7.6 symbols/min [2025-09-26T17:43:43.532719] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:43:43.558885] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-26T17:43:43.570549] [DEBUG] [LOCAL ] BRT: Loaded 4999 existing records from primary storage. [2025-09-26T17:43:43.570718] [INFO ] [MAIN ] BRT: Loaded 4999 existing records. [2025-09-26T17:43:43.759095] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:43:43.759338] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-09-26T17:43:43.759387] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-09-26T17:43:43.759926] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-09-26T17:43:43.759991] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-09-26T17:43:43.958703] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-09-26T17:43:44.157434] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:43:44.756738] [INFO ] [REMOTE ] BRT: Fetching primary data for 2024-12. [2025-09-26T17:43:44.815343] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-26T17:43:44.825808] [INFO ] [REMOTE ] BRO: Full fetch complete (74206 records). [2025-09-26T17:43:44.825956] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-09-26T17:43:45.251184] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-09-26T17:43:45.251585] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-09-26T17:43:45.256554] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-09-26T17:43:45.256756] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-09-26T17:43:45.257708] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-26T17:43:45.279750] [DEBUG] [LOCAL ] BRO: Trimmed 74206 records to 52664 (keeping 200 days of data) [2025-09-26T17:43:45.280797] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-26T17:43:45.557349] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-09-26T17:43:45.641869] [DEBUG] [LOCAL ] BRO: Primary data saved (52664 records). [2025-09-26T17:43:45.642088] [INFO ] [MAIN ] BRO: Full history saved. [2025-09-26T17:43:45.642211] [INFO ] [MAIN ] Update Progress: 334/2371 symbols completed. BRO took 36.5s. Estimated remaining: 4h 26m 35s. Rate: 7.6 symbols/min [2025-09-26T17:43:45.822693] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:43:45.844400] [DEBUG] [LOCAL ] BRW: Loaded 19574 existing records from primary storage. [2025-09-26T17:43:45.844535] [INFO ] [MAIN ] BRW: Loaded 19574 existing records. [2025-09-26T17:43:46.031117] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:43:46.031418] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-09-26T17:43:46.031466] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-09-26T17:43:46.031793] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-09-26T17:43:46.031853] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-09-26T17:43:46.344152] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-26T17:43:46.361820] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-09-26T17:43:46.441369] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:43:47.156732] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-09-26T17:43:47.620147] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-26T17:43:47.651607] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-26T17:43:47.956771] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-07. [2025-09-26T17:43:48.756752] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-09-26T17:43:49.355138] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-26T17:43:49.398931] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-26T17:43:49.556731] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-09-26T17:43:50.356729] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-09-26T17:43:51.048550] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-26T17:43:51.047412] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-26T17:43:51.156746] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-08. [2025-09-26T17:43:51.956731] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-09-26T17:43:52.637428] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-26T17:43:52.670462] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-26T17:43:52.756751] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-09. [2025-09-26T17:43:53.556722] [INFO ] [REMOTE ] BRW: Fetching primary data for 2024-12. [2025-09-26T17:43:54.361890] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-09-26T17:43:54.380904] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-26T17:43:54.391896] [INFO ] [REMOTE ] BRSL: Full fetch complete (22342 records). [2025-09-26T17:43:54.392094] [DEBUG] [VALIDATOR ] BRSL: Validating primary data. [2025-09-26T17:43:54.606826] [WARN ] [VALIDATOR ] BRSL: Validation failed - insufficient historical data. Have 61 unique days, need 200 days [2025-09-26T17:43:54.619705] [FATAL] [MAIN ] BRSL: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:43:54.620305] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:43:54.620935] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-26T17:43:54.621023] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-26T17:43:54.625870] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-26T17:43:54.626508] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-09-26T17:43:54.626607] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-09-26T17:43:54.626734] [INFO ] [MAIN ] Update Progress: 335/2371 symbols completed. BRSL took 29.5s. Estimated remaining: 4h 26m 34s. Rate: 7.6 symbols/min [2025-09-26T17:43:54.809394] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:43:54.863004] [DEBUG] [LOCAL ] BRX: Loaded 52115 existing records from primary storage. [2025-09-26T17:43:54.863154] [INFO ] [MAIN ] BRX: Loaded 52115 existing records. [2025-09-26T17:43:55.049248] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:43:55.049579] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-09-26T17:43:55.049636] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-09-26T17:43:55.049945] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-09-26T17:43:55.050004] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-09-26T17:43:55.161819] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-09-26T17:43:55.421681] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:43:55.956697] [INFO ] [REMOTE ] BRX: Fetching primary data for 2024-12. [2025-09-26T17:43:56.087291] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-26T17:43:56.127925] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-26T17:43:56.756731] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-09-26T17:43:57.430735] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-26T17:43:57.549370] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-26T17:43:57.560136] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-09-26T17:43:58.356751] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-09-26T17:43:58.880075] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-26T17:43:59.080775] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-26T17:43:59.156768] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-09-26T17:43:59.956732] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-09-26T17:44:00.332545] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-26T17:44:00.756759] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-09-26T17:44:01.403116] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-26T17:44:01.444442] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-26T17:44:01.556733] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-09-26T17:44:02.356738] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-09-26T17:44:02.563976] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-26T17:44:03.156798] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-09-26T17:44:03.368754] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-26T17:44:03.956750] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-09-26T17:44:04.669392] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-26T17:44:04.756792] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-09-26T17:44:05.556719] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-09-26T17:44:05.591325] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T17:44:06.238935] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-26T17:44:06.263815] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-26T17:44:06.356750] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-09-26T17:44:07.156768] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-09-26T17:44:07.956734] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-09-26T17:44:08.056487] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-26T17:44:08.064262] [INFO ] [REMOTE ] BRSP: Full fetch complete (54010 records). [2025-09-26T17:44:08.064441] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-09-26T17:44:08.201408] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-26T17:44:08.489361] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-09-26T17:44:08.489452] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-09-26T17:44:08.490091] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-09-26T17:44:08.490192] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-09-26T17:44:08.491468] [DEBUG] [LOCAL ] BRSP: Trimmed 54010 records to 37442 (keeping 200 days of data) [2025-09-26T17:44:08.716253] [DEBUG] [LOCAL ] BRSP: Primary data saved (37442 records). [2025-09-26T17:44:08.716413] [INFO ] [MAIN ] BRSP: Full history saved. [2025-09-26T17:44:08.716502] [INFO ] [MAIN ] Update Progress: 336/2371 symbols completed. BRSP took 27.3s. Estimated remaining: 4h 27m 3s. Rate: 7.6 symbols/min [2025-09-26T17:44:08.761871] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-09-26T17:44:08.830128] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-26T17:44:08.835983] [INFO ] [REMOTE ] BRT: Full fetch complete (6818 records). [2025-09-26T17:44:08.846593] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-09-26T17:44:08.993743] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:44:09.282034] [DEBUG] [LOCAL ] BSAC: Loaded 33282 existing records from primary storage. [2025-09-26T17:44:09.307991] [INFO ] [MAIN ] BSAC: Loaded 33282 existing records. [2025-09-26T17:44:09.351813] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-09-26T17:44:09.364291] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-09-26T17:44:09.389132] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-09-26T17:44:09.408053] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-09-26T17:44:09.435932] [DEBUG] [LOCAL ] BRT: Trimmed 6818 records to 5034 (keeping 200 days of data) [2025-09-26T17:44:09.556827] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:44:09.556955] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-09-26T17:44:09.560354] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-09-26T17:44:09.560779] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-09-26T17:44:09.561349] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-09-26T17:44:09.562032] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-09-26T17:44:09.576141] [DEBUG] [LOCAL ] BRT: Primary data saved (5034 records). [2025-09-26T17:44:09.602054] [INFO ] [MAIN ] BRT: Full history saved. [2025-09-26T17:44:09.639044] [INFO ] [MAIN ] Update Progress: 337/2371 symbols completed. BRT took 26.3s. Estimated remaining: 4h 26m 14s. Rate: 7.6 symbols/min [2025-09-26T17:44:10.029017] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:44:10.165992] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:44:10.193119] [DEBUG] [LOCAL ] BSBR: Loaded 35491 existing records from primary storage. [2025-09-26T17:44:10.193280] [INFO ] [MAIN ] BSBR: Loaded 35491 existing records. [2025-09-26T17:44:10.362118] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2024-12. [2025-09-26T17:44:10.398376] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:44:10.399953] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-09-26T17:44:10.400015] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-09-26T17:44:10.400266] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-09-26T17:44:10.400430] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-09-26T17:44:10.668746] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-26T17:44:10.819023] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:44:10.849525] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-26T17:44:11.156749] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-09-26T17:44:11.629872] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-26T17:44:11.956766] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2024-12. [2025-09-26T17:44:12.593861] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-26T17:44:12.756761] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-09-26T17:44:13.045869] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-26T17:44:13.413476] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-26T17:44:13.556725] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-09-26T17:44:14.356746] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-09-26T17:44:14.955039] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-26T17:44:15.156766] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-09-26T17:44:15.530639] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-26T17:44:15.958421] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-09-26T17:44:15.968170] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-26T17:44:16.756767] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-09-26T17:44:16.801149] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-26T17:44:17.556724] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-09-26T17:44:18.231108] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T17:44:18.356729] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-09-26T17:44:18.493231] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-26T17:44:19.156774] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-09-26T17:44:19.327578] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-26T17:44:19.335926] [INFO ] [REMOTE ] BRW: Full fetch complete (29799 records). [2025-09-26T17:44:19.336152] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-09-26T17:44:19.978575] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-09-26T17:44:19.993189] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-09-26T17:44:19.993277] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-09-26T17:44:19.993810] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-09-26T17:44:19.993899] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-09-26T17:44:19.994668] [DEBUG] [LOCAL ] BRW: Trimmed 29799 records to 19862 (keeping 200 days of data) [2025-09-26T17:44:20.119848] [DEBUG] [LOCAL ] BRW: Primary data saved (19862 records). [2025-09-26T17:44:20.120028] [INFO ] [MAIN ] BRW: Full history saved. [2025-09-26T17:44:20.120127] [INFO ] [MAIN ] Update Progress: 338/2371 symbols completed. BRW took 34.5s. Estimated remaining: 4h 26m 22s. Rate: 7.6 symbols/min [2025-09-26T17:44:20.295355] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-26T17:44:20.350598] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:44:20.362204] [DEBUG] [LOCAL ] BSL: Loaded 8077 existing records from primary storage. [2025-09-26T17:44:20.362317] [INFO ] [MAIN ] BSL: Loaded 8077 existing records. [2025-09-26T17:44:20.554268] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:44:20.554561] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-09-26T17:44:20.554610] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-09-26T17:44:20.554854] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-09-26T17:44:20.554912] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-09-26T17:44:20.766872] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-09-26T17:44:20.920999] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:44:21.556699] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-09-26T17:44:21.638372] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-26T17:44:21.768588] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-26T17:44:22.356731] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-09-26T17:44:22.659683] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-26T17:44:23.156735] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-09-26T17:44:23.795271] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-26T17:44:23.956767] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-09-26T17:44:24.358569] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-26T17:44:24.756735] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-09-26T17:44:25.056047] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-26T17:44:25.556723] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-09-26T17:44:25.679005] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-26T17:44:26.326248] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-26T17:44:26.356680] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-09-26T17:44:27.156743] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-09-26T17:44:27.575229] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-26T17:44:27.956811] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-09-26T17:44:28.756720] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-12. [2025-09-26T17:44:28.843099] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-26T17:44:29.530011] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-26T17:44:29.556680] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-09-26T17:44:29.669574] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-26T17:44:30.356721] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-09-26T17:44:30.989096] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-26T17:44:31.156727] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-09-26T17:44:31.956732] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-09-26T17:44:31.996286] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-26T17:44:32.006797] [INFO ] [REMOTE ] BRX: Full fetch complete (74865 records). [2025-09-26T17:44:32.006976] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-09-26T17:44:32.441160] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-09-26T17:44:32.441323] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-09-26T17:44:32.442318] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-09-26T17:44:32.442548] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-09-26T17:44:32.474868] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-26T17:44:32.475311] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-26T17:44:32.473392] [DEBUG] [LOCAL ] BRX: Trimmed 74865 records to 52462 (keeping 200 days of data) [2025-09-26T17:44:32.488197] [INFO ] [REMOTE ] BSBR: Full fetch complete (50612 records). [2025-09-26T17:44:32.488339] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-09-26T17:44:32.763367] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-09-26T17:44:33.033925] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-09-26T17:44:33.034284] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-09-26T17:44:33.035321] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-09-26T17:44:33.035406] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-09-26T17:44:33.039113] [DEBUG] [LOCAL ] BSBR: Trimmed 50612 records to 35731 (keeping 200 days of data) [2025-09-26T17:44:33.387831] [DEBUG] [LOCAL ] BSBR: Primary data saved (35731 records). [2025-09-26T17:44:33.388542] [INFO ] [MAIN ] BSBR: Full history saved. [2025-09-26T17:44:33.389274] [INFO ] [MAIN ] Update Progress: 339/2371 symbols completed. BSBR took 23.7s. Estimated remaining: 4h 26m 46s. Rate: 7.6 symbols/min [2025-09-26T17:44:33.557617] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-09-26T17:44:33.591769] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:44:33.663390] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-26T17:44:33.697765] [DEBUG] [LOCAL ] BSM: Loaded 32577 existing records from primary storage. [2025-09-26T17:44:33.698495] [INFO ] [MAIN ] BSM: Loaded 32577 existing records. [2025-09-26T17:44:33.901462] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:44:33.903241] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-09-26T17:44:33.905214] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-09-26T17:44:33.905103] [DEBUG] [LOCAL ] BRX: Primary data saved (52462 records). [2025-09-26T17:44:33.905429] [INFO ] [MAIN ] BRX: Full history saved. [2025-09-26T17:44:33.905557] [INFO ] [MAIN ] Update Progress: 340/2371 symbols completed. BRX took 39.3s. Estimated remaining: 4h 25m 54s. Rate: 7.6 symbols/min [2025-09-26T17:44:33.905628] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-09-26T17:44:33.905997] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-09-26T17:44:34.293354] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:44:34.312462] [DEBUG] [LOCAL ] BST: No existing data file found in primary storage. [2025-09-26T17:44:34.362861] [WARN ] [MAIN ] BST: No existing data found, performing full refresh instead. [2025-09-26T17:44:34.362718] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-09-26T17:44:34.399529] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-09-26T17:44:34.429608] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-09-26T17:44:34.429886] [DEBUG] [LOCAL ] BST: No primary data file found to delete. [2025-09-26T17:44:34.429976] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-09-26T17:44:34.638928] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:44:34.925171] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:44:35.023550] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-26T17:44:35.039230] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-26T17:44:35.156768] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-09-26T17:44:35.956746] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-12. [2025-09-26T17:44:36.473478] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-26T17:44:36.756767] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-09-26T17:44:37.171445] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-26T17:44:37.556761] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-09-26T17:44:37.703469] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-26T17:44:37.709997] [INFO ] [REMOTE ] BSAC: Full fetch complete (43547 records). [2025-09-26T17:44:37.710136] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-09-26T17:44:38.116020] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-09-26T17:44:38.116244] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-09-26T17:44:38.116907] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-09-26T17:44:38.117067] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-09-26T17:44:38.125375] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-26T17:44:38.128636] [DEBUG] [LOCAL ] BSAC: Trimmed 43547 records to 33389 (keeping 200 days of data) [2025-09-26T17:44:38.340434] [DEBUG] [LOCAL ] BSAC: Primary data saved (33389 records). [2025-09-26T17:44:38.340586] [INFO ] [MAIN ] BSAC: Full history saved. [2025-09-26T17:44:38.340703] [INFO ] [MAIN ] Update Progress: 341/2371 symbols completed. BSAC took 29.6s. Estimated remaining: 4h 25m 26s. Rate: 7.6 symbols/min [2025-09-26T17:44:38.363960] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-09-26T17:44:38.576186] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:44:38.602483] [DEBUG] [LOCAL ] BSTZ: Loaded 25007 existing records from primary storage. [2025-09-26T17:44:38.602634] [INFO ] [MAIN ] BSTZ: Loaded 25007 existing records. [2025-09-26T17:44:38.803570] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:44:38.803892] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-09-26T17:44:38.803973] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-09-26T17:44:38.804202] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-09-26T17:44:38.804262] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-09-26T17:44:39.161827] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-09-26T17:44:39.242438] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:44:39.408997] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-26T17:44:39.764384] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-26T17:44:39.956735] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-12. [2025-09-26T17:44:40.756729] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-09-26T17:44:41.189224] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-26T17:44:41.556736] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-09-26T17:44:42.232019] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-26T17:44:42.356691] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-09-26T17:44:42.733317] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-26T17:44:43.098784] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-26T17:44:43.156723] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-09-26T17:44:43.956705] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-09-26T17:44:44.109850] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-26T17:44:44.647551] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-26T17:44:44.756747] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-09-26T17:44:45.379612] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-26T17:44:45.556733] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-09-26T17:44:46.356737] [INFO ] [REMOTE ] BST: Fetching primary data for 2024-12. [2025-09-26T17:44:46.843430] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-26T17:44:47.156763] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-09-26T17:44:47.563995] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-26T17:44:47.956787] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-09-26T17:44:48.073777] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-26T17:44:48.756733] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-09-26T17:44:49.087314] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-26T17:44:49.556726] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-09-26T17:44:49.601956] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-26T17:44:50.356765] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-09-26T17:44:50.891816] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-26T17:44:51.156729] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-09-26T17:44:51.524786] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-26T17:44:51.527005] [INFO ] [REMOTE ] BSL: Full fetch complete (12528 records). [2025-09-26T17:44:51.527079] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-09-26T17:44:51.527559] [FATAL] [VALIDATOR ] BSL: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:44:51.527666] [FATAL] [MAIN ] BSL: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:44:51.527726] [WARN ] [MAIN ] BSL: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:44:51.527793] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-09-26T17:44:51.527861] [DEBUG] [LOCAL ] BSL: No primary data file found to delete. [2025-09-26T17:44:51.527898] [INFO ] [LOCAL ] BSL: Starting deletion of derivative data. [2025-09-26T17:44:51.528311] [DEBUG] [LOCAL ] BSL: Deleted derivative data file. [2025-09-26T17:44:51.528412] [INFO ] [MAIN ] Update Progress: 342/2371 symbols completed. BSL took 31.4s. Estimated remaining: 4h 25m 50s. Rate: 7.6 symbols/min [2025-09-26T17:44:51.708430] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:44:51.764609] [DEBUG] [LOCAL ] BSX: Loaded 54078 existing records from primary storage. [2025-09-26T17:44:51.764808] [INFO ] [MAIN ] BSX: Loaded 54078 existing records. [2025-09-26T17:44:51.965287] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-09-26T17:44:51.974069] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:44:51.974371] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-09-26T17:44:51.974441] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-09-26T17:44:51.974769] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-09-26T17:44:51.974848] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-09-26T17:44:52.389286] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:44:52.392132] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-26T17:44:52.756736] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-09-26T17:44:53.524600] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-26T17:44:53.556700] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-09-26T17:44:53.809627] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-26T17:44:54.288751] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-26T17:44:54.356724] [INFO ] [REMOTE ] BSX: Fetching primary data for 2024-12. [2025-09-26T17:44:55.156764] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-09-26T17:44:55.956737] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-09-26T17:44:56.231130] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-26T17:44:56.401248] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-26T17:44:56.629911] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-26T17:44:56.756751] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-09-26T17:44:57.556720] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-09-26T17:44:57.775810] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-26T17:44:58.356735] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-09-26T17:44:59.156763] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-09-26T17:44:59.479777] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-26T17:44:59.956727] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-09-26T17:45:00.055458] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-26T17:45:00.756788] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-09-26T17:45:01.556748] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-09-26T17:45:02.294708] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (3.14 seconds). [2025-09-26T17:45:02.356743] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-09-26T17:45:02.728332] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (2.77 seconds). [2025-09-26T17:45:03.130839] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-26T17:45:03.156727] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-09-26T17:45:03.404110] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-26T17:45:03.607612] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-26T17:45:03.614576] [INFO ] [REMOTE ] BSM: Full fetch complete (47311 records). [2025-09-26T17:45:03.614744] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-09-26T17:45:03.615463] [FATAL] [VALIDATOR ] BSM: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:45:03.615569] [FATAL] [MAIN ] BSM: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:45:03.615670] [WARN ] [MAIN ] BSM: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:45:03.615759] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-09-26T17:45:03.615872] [DEBUG] [LOCAL ] BSM: No primary data file found to delete. [2025-09-26T17:45:03.615955] [INFO ] [LOCAL ] BSM: Starting deletion of derivative data. [2025-09-26T17:45:03.616342] [DEBUG] [LOCAL ] BSM: Deleted derivative data file. [2025-09-26T17:45:03.616520] [INFO ] [MAIN ] Update Progress: 343/2371 symbols completed. BSM took 30.2s. Estimated remaining: 4h 26m 7s. Rate: 7.6 symbols/min [2025-09-26T17:45:03.806429] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:45:03.807685] [DEBUG] [LOCAL ] BTA: No existing data file found in primary storage. [2025-09-26T17:45:03.807745] [WARN ] [MAIN ] BTA: No existing data found, performing full refresh instead. [2025-09-26T17:45:03.807985] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-09-26T17:45:03.808041] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-09-26T17:45:03.808087] [DEBUG] [LOCAL ] BTA: No primary data file found to delete. [2025-09-26T17:45:03.808121] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-09-26T17:45:03.961894] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-09-26T17:45:04.191853] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:45:04.712633] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-26T17:45:04.717584] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36448 records). [2025-09-26T17:45:04.717756] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-09-26T17:45:04.718472] [FATAL] [VALIDATOR ] BSTZ: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:45:04.718767] [FATAL] [MAIN ] BSTZ: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:45:04.718846] [WARN ] [MAIN ] BSTZ: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:45:04.718921] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-09-26T17:45:04.718992] [DEBUG] [LOCAL ] BSTZ: No primary data file found to delete. [2025-09-26T17:45:04.719029] [INFO ] [LOCAL ] BSTZ: Starting deletion of derivative data. [2025-09-26T17:45:04.719432] [DEBUG] [LOCAL ] BSTZ: Deleted derivative data file. [2025-09-26T17:45:04.719534] [INFO ] [MAIN ] Update Progress: 344/2371 symbols completed. BSTZ took 26.4s. Estimated remaining: 4h 25m 19s. Rate: 7.6 symbols/min [2025-09-26T17:45:04.761827] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-09-26T17:45:04.909339] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:45:04.909580] [DEBUG] [LOCAL ] BTCM: No existing data file found in primary storage. [2025-09-26T17:45:04.909638] [WARN ] [MAIN ] BTCM: No existing data found, performing full refresh instead. [2025-09-26T17:45:04.909818] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-09-26T17:45:04.909865] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-09-26T17:45:04.909915] [DEBUG] [LOCAL ] BTCM: No primary data file found to delete. [2025-09-26T17:45:04.909952] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-09-26T17:45:05.232245] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-26T17:45:05.324424] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:45:05.556733] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2024-12. [2025-09-26T17:45:06.356767] [INFO ] [REMOTE ] BTA: Fetching primary data for 2024-12. [2025-09-26T17:45:06.718871] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-26T17:45:06.805029] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-26T17:45:06.961731] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-26T17:45:07.156733] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-01. [2025-09-26T17:45:07.878686] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-26T17:45:07.956764] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-09-26T17:45:08.756705] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-09-26T17:45:09.057765] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-26T17:45:09.556739] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-09-26T17:45:10.325713] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-26T17:45:10.356700] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-09-26T17:45:10.927859] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-26T17:45:11.156779] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-09-26T17:45:11.832994] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-26T17:45:11.956739] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-09-26T17:45:12.406550] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-26T17:45:12.756736] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-09-26T17:45:13.101777] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-26T17:45:13.263394] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-26T17:45:13.556742] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-09-26T17:45:14.270174] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-26T17:45:14.356782] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-09-26T17:45:15.156738] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-09-26T17:45:15.675792] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-26T17:45:15.708791] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-26T17:45:15.712963] [INFO ] [REMOTE ] BST: Full fetch complete (28721 records). [2025-09-26T17:45:15.713046] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-09-26T17:45:15.961869] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-09-26T17:45:16.123630] [DEBUG] [VALIDATOR ] BST: All expected trading days are present. [2025-09-26T17:45:16.123765] [DEBUG] [VALIDATOR ] BST: Primary data validation passed. [2025-09-26T17:45:16.124209] [INFO ] [MAIN ] BST: Fetched primary data is valid. [2025-09-26T17:45:16.124276] [DEBUG] [LOCAL ] BST: Saving primary data. [2025-09-26T17:45:16.125263] [DEBUG] [LOCAL ] BST: Trimmed 28721 records to 19385 (keeping 200 days of data) [2025-09-26T17:45:16.266932] [DEBUG] [LOCAL ] BST: Primary data saved (19385 records). [2025-09-26T17:45:16.267134] [INFO ] [MAIN ] BST: Full history saved. [2025-09-26T17:45:16.267254] [INFO ] [MAIN ] Update Progress: 345/2371 symbols completed. BST took 42.4s. Estimated remaining: 4h 25m 33s. Rate: 7.6 symbols/min [2025-09-26T17:45:16.466807] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:45:16.524991] [DEBUG] [LOCAL ] BTE: Loaded 53117 existing records from primary storage. [2025-09-26T17:45:16.525154] [INFO ] [MAIN ] BTE: Loaded 53117 existing records. [2025-09-26T17:45:16.727355] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:45:16.727664] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-09-26T17:45:16.727740] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-09-26T17:45:16.728011] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-09-26T17:45:16.728070] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-09-26T17:45:16.762417] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-09-26T17:45:17.149558] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:45:17.512685] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-26T17:45:17.556734] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-09-26T17:45:18.070187] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-26T17:45:18.086853] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-26T17:45:18.356735] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-09-26T17:45:18.976322] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-26T17:45:19.156768] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-09-26T17:45:19.956775] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-09-26T17:45:20.756808] [INFO ] [REMOTE ] BTE: Fetching primary data for 2024-12. [2025-09-26T17:45:20.816888] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-26T17:45:20.996595] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-26T17:45:21.556727] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-09-26T17:45:22.350851] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-26T17:45:22.361885] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-09-26T17:45:22.554670] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-26T17:45:22.556601] [INFO ] [REMOTE ] BTA: Full fetch complete (9607 records). [2025-09-26T17:45:22.556717] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-09-26T17:45:22.954224] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-09-26T17:45:22.954318] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-09-26T17:45:22.954675] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-09-26T17:45:22.954744] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-09-26T17:45:22.955319] [DEBUG] [LOCAL ] BTA: Trimmed 9607 records to 5464 (keeping 200 days of data) [2025-09-26T17:45:22.988881] [DEBUG] [LOCAL ] BTA: Primary data saved (5464 records). [2025-09-26T17:45:22.989005] [INFO ] [MAIN ] BTA: Full history saved. [2025-09-26T17:45:22.989087] [INFO ] [MAIN ] Update Progress: 346/2371 symbols completed. BTA took 19.4s. Estimated remaining: 4h 25m 19s. Rate: 7.6 symbols/min [2025-09-26T17:45:23.167534] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-09-26T17:45:23.171099] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:45:23.245355] [DEBUG] [LOCAL ] BTI: Loaded 53946 existing records from primary storage. [2025-09-26T17:45:23.245533] [INFO ] [MAIN ] BTI: Loaded 53946 existing records. [2025-09-26T17:45:23.434475] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:45:23.434760] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-09-26T17:45:23.434817] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-09-26T17:45:23.435088] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-09-26T17:45:23.435147] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-09-26T17:45:23.805632] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:45:23.956687] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-12. [2025-09-26T17:45:24.424123] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-26T17:45:24.490085] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-26T17:45:24.756726] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-09-26T17:45:25.568042] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-09-26T17:45:25.574175] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-26T17:45:25.968229] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-26T17:45:25.983761] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-26T17:45:26.356744] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-09-26T17:45:27.156734] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-09-26T17:45:27.609042] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-26T17:45:27.919361] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-26T17:45:27.956722] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-09-26T17:45:28.756739] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-09-26T17:45:29.556741] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-09-26T17:45:29.890236] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-26T17:45:30.243331] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-26T17:45:30.356774] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-09-26T17:45:30.987729] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-26T17:45:31.156727] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-09-26T17:45:31.956773] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-09-26T17:45:32.255631] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-26T17:45:32.266518] [INFO ] [REMOTE ] BSX: Full fetch complete (77694 records). [2025-09-26T17:45:32.266699] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-09-26T17:45:32.694541] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-09-26T17:45:32.694723] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-09-26T17:45:32.695777] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-09-26T17:45:32.695925] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-09-26T17:45:32.703201] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-26T17:45:32.707344] [DEBUG] [LOCAL ] BSX: Trimmed 77694 records to 54468 (keeping 200 days of data) [2025-09-26T17:45:32.775720] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-09-26T17:45:32.985506] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-26T17:45:33.122024] [DEBUG] [LOCAL ] BSX: Primary data saved (54468 records). [2025-09-26T17:45:33.122182] [INFO ] [MAIN ] BSX: Full history saved. [2025-09-26T17:45:33.122276] [INFO ] [MAIN ] Update Progress: 347/2371 symbols completed. BSX took 41.6s. Estimated remaining: 4h 25m 24s. Rate: 7.6 symbols/min [2025-09-26T17:45:33.313172] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:45:33.328846] [DEBUG] [LOCAL ] BTO: Loaded 8942 existing records from primary storage. [2025-09-26T17:45:33.329009] [INFO ] [MAIN ] BTO: Loaded 8942 existing records. [2025-09-26T17:45:33.526063] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:45:33.526386] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-09-26T17:45:33.526442] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-09-26T17:45:33.526683] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-09-26T17:45:33.526743] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-09-26T17:45:33.561884] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-09-26T17:45:33.953727] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:45:34.312282] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-26T17:45:34.356764] [INFO ] [REMOTE ] BTO: Fetching primary data for 2024-12. [2025-09-26T17:45:34.440221] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-26T17:45:35.156787] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-09-26T17:45:35.280870] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-26T17:45:35.956787] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-09-26T17:45:36.450848] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-26T17:45:36.756788] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-09-26T17:45:36.844583] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-26T17:45:37.257996] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-26T17:45:37.556741] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-09-26T17:45:38.356804] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-09-26T17:45:39.156781] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-09-26T17:45:39.605808] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-26T17:45:39.750863] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-26T17:45:39.956795] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-09-26T17:45:40.626151] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T17:45:40.756798] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-09-26T17:45:41.370557] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-26T17:45:41.507481] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-26T17:45:41.556747] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-09-26T17:45:42.356773] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-09-26T17:45:42.541048] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-26T17:45:43.156768] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-09-26T17:45:43.805801] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-26T17:45:43.811119] [INFO ] [REMOTE ] BTCM: Full fetch complete (19435 records). [2025-09-26T17:45:43.811225] [DEBUG] [VALIDATOR ] BTCM: Validating primary data. [2025-09-26T17:45:43.942152] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-26T17:45:43.963249] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-09-26T17:45:44.236357] [DEBUG] [VALIDATOR ] BTCM: All expected trading days are present. [2025-09-26T17:45:44.236443] [DEBUG] [VALIDATOR ] BTCM: Primary data validation passed. [2025-09-26T17:45:44.236825] [INFO ] [MAIN ] BTCM: Fetched primary data is valid. [2025-09-26T17:45:44.236890] [DEBUG] [LOCAL ] BTCM: Saving primary data. [2025-09-26T17:45:44.237551] [DEBUG] [LOCAL ] BTCM: Trimmed 19435 records to 15122 (keeping 200 days of data) [2025-09-26T17:45:44.340398] [DEBUG] [LOCAL ] BTCM: Primary data saved (15122 records). [2025-09-26T17:45:44.340634] [INFO ] [MAIN ] BTCM: Full history saved. [2025-09-26T17:45:44.340789] [INFO ] [MAIN ] Update Progress: 348/2371 symbols completed. BTCM took 39.6s. Estimated remaining: 4h 25m 36s. Rate: 7.6 symbols/min [2025-09-26T17:45:44.530826] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:45:44.550458] [DEBUG] [LOCAL ] BTT: Loaded 16032 existing records from primary storage. [2025-09-26T17:45:44.550630] [INFO ] [MAIN ] BTT: Loaded 16032 existing records. [2025-09-26T17:45:44.755286] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:45:44.755608] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-09-26T17:45:44.755689] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-09-26T17:45:44.755944] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-09-26T17:45:44.756004] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-09-26T17:45:44.767933] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-09-26T17:45:45.146438] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:45:45.556718] [INFO ] [REMOTE ] BTT: Fetching primary data for 2024-12. [2025-09-26T17:45:46.128781] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-26T17:45:46.242013] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-26T17:45:46.356783] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-09-26T17:45:46.860572] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-26T17:45:47.156817] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-09-26T17:45:47.234920] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-26T17:45:47.956771] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-09-26T17:45:48.756717] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-09-26T17:45:49.025035] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-26T17:45:49.073146] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-26T17:45:49.231580] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-26T17:45:49.556748] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-09-26T17:45:50.356787] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-09-26T17:45:50.398403] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-26T17:45:51.156781] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-09-26T17:45:51.682353] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-26T17:45:51.961829] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-09-26T17:45:51.984180] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-26T17:45:52.756749] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-09-26T17:45:52.813771] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-26T17:45:52.816773] [INFO ] [REMOTE ] BTO: Full fetch complete (13283 records). [2025-09-26T17:45:52.816917] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-09-26T17:45:53.207364] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-09-26T17:45:53.207454] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-09-26T17:45:53.207769] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-09-26T17:45:53.207832] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-09-26T17:45:53.208353] [DEBUG] [LOCAL ] BTO: Trimmed 13283 records to 8982 (keeping 200 days of data) [2025-09-26T17:45:53.266072] [DEBUG] [LOCAL ] BTO: Primary data saved (8982 records). [2025-09-26T17:45:53.266220] [INFO ] [MAIN ] BTO: Full history saved. [2025-09-26T17:45:53.266313] [INFO ] [MAIN ] Update Progress: 349/2371 symbols completed. BTO took 20.1s. Estimated remaining: 4h 25m 34s. Rate: 7.6 symbols/min [2025-09-26T17:45:53.450192] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:45:53.513755] [DEBUG] [LOCAL ] BTU: Loaded 53693 existing records from primary storage. [2025-09-26T17:45:53.513952] [INFO ] [MAIN ] BTU: Loaded 53693 existing records. [2025-09-26T17:45:53.561937] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-09-26T17:45:53.720717] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:45:53.721051] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-09-26T17:45:53.721109] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-09-26T17:45:53.721518] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-09-26T17:45:53.721582] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-09-26T17:45:54.156955] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:45:54.356785] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-09-26T17:45:54.752839] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-26T17:45:54.946859] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-26T17:45:55.156776] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-09-26T17:45:55.319833] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-26T17:45:55.330351] [INFO ] [REMOTE ] BTI: Full fetch complete (77040 records). [2025-09-26T17:45:55.330512] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-09-26T17:45:55.332938] [FATAL] [VALIDATOR ] BTI: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:45:55.333061] [FATAL] [MAIN ] BTI: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:45:55.333106] [WARN ] [MAIN ] BTI: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:45:55.333157] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-09-26T17:45:55.333217] [DEBUG] [LOCAL ] BTI: No primary data file found to delete. [2025-09-26T17:45:55.333299] [INFO ] [LOCAL ] BTI: Starting deletion of derivative data. [2025-09-26T17:45:55.333734] [DEBUG] [LOCAL ] BTI: Deleted derivative data file. [2025-09-26T17:45:55.333836] [INFO ] [MAIN ] Update Progress: 350/2371 symbols completed. BTI took 32.3s. Estimated remaining: 4h 24m 52s. Rate: 7.6 symbols/min [2025-09-26T17:45:55.523761] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:45:55.523956] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-09-26T17:45:55.523996] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-09-26T17:45:55.524138] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-09-26T17:45:55.524182] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-26T17:45:55.524225] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-26T17:45:55.524258] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-09-26T17:45:55.936734] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:45:55.950910] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-26T17:45:55.956668] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-09-26T17:45:56.756771] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-09-26T17:45:57.121512] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-26T17:45:57.556719] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-09-26T17:45:58.356712] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-12. [2025-09-26T17:45:58.492367] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-26T17:45:58.538866] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-26T17:45:58.571185] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:45:58.571518] [WARN ] [REMOTE ] BTX: No data returned for month 2024-12 [2025-09-26T17:45:59.156786] [INFO ] [REMOTE ] BTU: Fetching primary data for 2024-12. [2025-09-26T17:45:59.956745] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-09-26T17:46:00.756700] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-09-26T17:46:01.030056] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-26T17:46:01.032536] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-26T17:46:01.556731] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-09-26T17:46:02.356723] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-01. [2025-09-26T17:46:02.528126] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-26T17:46:02.576201] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:46:02.578872] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-26T17:46:02.578965] [WARN ] [REMOTE ] BTX: No data returned for month 2025-01 [2025-09-26T17:46:02.590295] [INFO ] [REMOTE ] BTE: Full fetch complete (75997 records). [2025-09-26T17:46:02.590403] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-09-26T17:46:03.013215] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-09-26T17:46:03.013319] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-09-26T17:46:03.014162] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-09-26T17:46:03.014231] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-09-26T17:46:03.015855] [DEBUG] [LOCAL ] BTE: Trimmed 75997 records to 53505 (keeping 200 days of data) [2025-09-26T17:46:03.204782] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-09-26T17:46:03.367280] [DEBUG] [LOCAL ] BTE: Primary data saved (53505 records). [2025-09-26T17:46:03.367461] [INFO ] [MAIN ] BTE: Full history saved. [2025-09-26T17:46:03.367576] [INFO ] [MAIN ] Update Progress: 351/2371 symbols completed. BTE took 47.1s. Estimated remaining: 4h 24m 45s. Rate: 7.6 symbols/min [2025-09-26T17:46:03.561014] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:46:03.586419] [DEBUG] [LOCAL ] BTZ: Loaded 22899 existing records from primary storage. [2025-09-26T17:46:03.586572] [INFO ] [MAIN ] BTZ: Loaded 22899 existing records. [2025-09-26T17:46:03.789270] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:46:03.789540] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-09-26T17:46:03.789592] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-09-26T17:46:03.789866] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-09-26T17:46:03.789927] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-09-26T17:46:03.961505] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-09-26T17:46:04.219830] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:46:04.756755] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-02. [2025-09-26T17:46:05.012429] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-26T17:46:05.033847] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-26T17:46:05.037806] [INFO ] [REMOTE ] BTT: Full fetch complete (24303 records). [2025-09-26T17:46:05.037893] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-09-26T17:46:05.457710] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-09-26T17:46:05.457882] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-09-26T17:46:05.459003] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-09-26T17:46:05.459467] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-09-26T17:46:05.459375] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-26T17:46:05.464073] [DEBUG] [LOCAL ] BTT: Trimmed 24303 records to 16126 (keeping 200 days of data) [2025-09-26T17:46:05.556945] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-03. [2025-09-26T17:46:05.574605] [DEBUG] [LOCAL ] BTT: Primary data saved (16126 records). [2025-09-26T17:46:05.574970] [INFO ] [MAIN ] BTT: Full history saved. [2025-09-26T17:46:05.575082] [INFO ] [MAIN ] Update Progress: 352/2371 symbols completed. BTT took 21.2s. Estimated remaining: 4h 24m 5s. Rate: 7.6 symbols/min [2025-09-26T17:46:05.766950] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:46:05.820339] [DEBUG] [LOCAL ] BUD: Loaded 53125 existing records from primary storage. [2025-09-26T17:46:05.820550] [INFO ] [MAIN ] BUD: Loaded 53125 existing records. [2025-09-26T17:46:06.033143] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:46:06.033485] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-09-26T17:46:06.033543] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-09-26T17:46:06.033880] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-09-26T17:46:06.033940] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-09-26T17:46:06.361961] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-12. [2025-09-26T17:46:06.450778] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:46:06.831784] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-26T17:46:07.156755] [INFO ] [REMOTE ] BUD: Fetching primary data for 2024-12. [2025-09-26T17:46:07.279923] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-26T17:46:07.956765] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-04. [2025-09-26T17:46:08.756893] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-09-26T17:46:08.953943] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T17:46:09.000256] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-26T17:46:09.556726] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-05. [2025-09-26T17:46:10.157941] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-26T17:46:10.356760] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-09-26T17:46:10.420881] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-26T17:46:11.156770] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-06. [2025-09-26T17:46:11.956714] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-09-26T17:46:12.069511] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-26T17:46:12.114287] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-26T17:46:12.756721] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-07. [2025-09-26T17:46:12.780084] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-26T17:46:13.556739] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-09-26T17:46:14.230296] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-26T17:46:14.356738] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-08. [2025-09-26T17:46:15.101370] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T17:46:15.156732] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-09-26T17:46:15.273710] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-26T17:46:15.956750] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-09-26T17:46:16.690899] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-26T17:46:16.756736] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-09-26T17:46:17.556735] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-09. [2025-09-26T17:46:17.969901] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-26T17:46:18.356756] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-09-26T17:46:18.737975] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-26T17:46:18.811545] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-26T17:46:18.821870] [INFO ] [REMOTE ] BTX: Full fetch complete (36384 records). [2025-09-26T17:46:18.822129] [DEBUG] [VALIDATOR ] BTX: Validating primary data. [2025-09-26T17:46:19.045118] [WARN ] [VALIDATOR ] BTX: Validation failed - insufficient historical data. Have 152 unique days, need 200 days [2025-09-26T17:46:19.045726] [FATAL] [MAIN ] BTX: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:46:19.045818] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:46:19.045929] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-26T17:46:19.046043] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-26T17:46:19.046140] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-09-26T17:46:19.046229] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-09-26T17:46:19.046336] [INFO ] [MAIN ] Update Progress: 353/2371 symbols completed. BTX took 23.7s. Estimated remaining: 4h 24m 29s. Rate: 7.6 symbols/min [2025-09-26T17:46:19.161841] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-09-26T17:46:19.269670] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:46:19.269852] [DEBUG] [LOCAL ] BUI: No existing data file found in primary storage. [2025-09-26T17:46:19.269891] [WARN ] [MAIN ] BUI: No existing data found, performing full refresh instead. [2025-09-26T17:46:19.270112] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-09-26T17:46:19.270177] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-09-26T17:46:19.270238] [DEBUG] [LOCAL ] BUI: No primary data file found to delete. [2025-09-26T17:46:19.270307] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-09-26T17:46:19.671273] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:46:19.889489] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-26T17:46:19.956731] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-09-26T17:46:20.756755] [INFO ] [REMOTE ] BUI: Fetching primary data for 2024-12. [2025-09-26T17:46:21.241458] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-26T17:46:21.278628] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-26T17:46:21.462026] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-26T17:46:21.556734] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-09-26T17:46:22.356726] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-09-26T17:46:22.716162] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-26T17:46:23.156730] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-09-26T17:46:23.956684] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-09-26T17:46:24.148833] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-26T17:46:24.234326] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-26T17:46:24.756738] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-09-26T17:46:25.319346] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-26T17:46:25.556772] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-09-26T17:46:26.134903] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-26T17:46:26.356777] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-09-26T17:46:26.896108] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-26T17:46:27.156786] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-09-26T17:46:27.684433] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-26T17:46:27.826891] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-26T17:46:27.956747] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-09-26T17:46:28.543886] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-26T17:46:28.756782] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-09-26T17:46:29.556755] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-09-26T17:46:30.356777] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-09-26T17:46:30.568492] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-26T17:46:30.636286] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-26T17:46:31.156777] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-09-26T17:46:31.956739] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-09-26T17:46:32.297459] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-26T17:46:32.315376] [DEBUG] [REMOTE ] BTZ: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-09-26T17:46:32.316397] [WARN ] [REMOTE ] BTZ: No data returned for month 2025-08 [2025-09-26T17:46:32.631116] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-26T17:46:32.756791] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-09-26T17:46:33.556720] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-09-26T17:46:34.356723] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-09-26T17:46:34.745826] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-26T17:46:34.756976] [INFO ] [REMOTE ] BUD: Full fetch complete (76490 records). [2025-09-26T17:46:34.757181] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-09-26T17:46:34.962631] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-26T17:46:35.054480] [INFO ] [REMOTE ] BTZ: Full fetch complete (30369 records). [2025-09-26T17:46:35.104819] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-09-26T17:46:35.161556] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-09-26T17:46:35.465411] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-09-26T17:46:35.498457] [WARN ] [VALIDATOR ] BTZ: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-26T17:46:35.498602] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-09-26T17:46:35.500161] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-09-26T17:46:35.500309] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-09-26T17:46:35.500949] [FATAL] [MAIN ] BTZ: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:46:35.501430] [WARN ] [MAIN ] BTZ: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:46:35.501580] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-09-26T17:46:35.501877] [DEBUG] [LOCAL ] BTZ: No primary data file found to delete. [2025-09-26T17:46:35.502000] [INFO ] [LOCAL ] BTZ: Starting deletion of derivative data. [2025-09-26T17:46:35.502606] [DEBUG] [LOCAL ] BTZ: Deleted derivative data file. [2025-09-26T17:46:35.502764] [INFO ] [MAIN ] Update Progress: 354/2371 symbols completed. BTZ took 32.1s. Estimated remaining: 4h 25m 11s. Rate: 7.6 symbols/min [2025-09-26T17:46:35.508559] [DEBUG] [LOCAL ] BUD: Trimmed 76490 records to 53504 (keeping 200 days of data) [2025-09-26T17:46:35.802938] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:46:35.864066] [DEBUG] [LOCAL ] BUR: Loaded 45395 existing records from primary storage. [2025-09-26T17:46:35.865881] [INFO ] [MAIN ] BUR: Loaded 45395 existing records. [2025-09-26T17:46:35.866525] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-26T17:46:35.962808] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-09-26T17:46:36.189273] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:46:36.191399] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-09-26T17:46:36.192510] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-09-26T17:46:36.194018] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-09-26T17:46:36.194465] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-09-26T17:46:36.646526] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-26T17:46:36.645298] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:46:36.660886] [INFO ] [REMOTE ] BTU: Full fetch complete (76851 records). [2025-09-26T17:46:36.661095] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-09-26T17:46:36.757627] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-12. [2025-09-26T17:46:36.915227] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-26T17:46:37.185562] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-09-26T17:46:37.185973] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-09-26T17:46:37.187002] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-09-26T17:46:37.187762] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-09-26T17:46:37.193166] [DEBUG] [LOCAL ] BTU: Trimmed 76851 records to 54082 (keeping 200 days of data) [2025-09-26T17:46:37.298918] [DEBUG] [LOCAL ] BUD: Primary data saved (53504 records). [2025-09-26T17:46:37.299572] [INFO ] [MAIN ] BUD: Full history saved. [2025-09-26T17:46:37.300011] [INFO ] [MAIN ] Update Progress: 355/2371 symbols completed. BUD took 31.7s. Estimated remaining: 4h 24m 28s. Rate: 7.6 symbols/min [2025-09-26T17:46:37.509094] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:46:37.559725] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-09-26T17:46:37.626804] [DEBUG] [LOCAL ] BURL: Loaded 46617 existing records from primary storage. [2025-09-26T17:46:37.653852] [INFO ] [MAIN ] BURL: Loaded 46617 existing records. [2025-09-26T17:46:37.861909] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:46:37.863271] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-09-26T17:46:37.863580] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-09-26T17:46:37.864209] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-09-26T17:46:37.864285] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-09-26T17:46:38.280046] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:46:38.359436] [INFO ] [REMOTE ] BURL: Fetching primary data for 2024-12. [2025-09-26T17:46:38.432439] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-26T17:46:38.455347] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-26T17:46:38.474952] [DEBUG] [LOCAL ] BTU: Primary data saved (54082 records). [2025-09-26T17:46:38.475122] [INFO ] [MAIN ] BTU: Full history saved. [2025-09-26T17:46:38.475232] [INFO ] [MAIN ] Update Progress: 356/2371 symbols completed. BTU took 45.2s. Estimated remaining: 4h 23m 42s. Rate: 7.6 symbols/min [2025-09-26T17:46:38.657798] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:46:38.658059] [DEBUG] [LOCAL ] BUXX: No existing data file found in primary storage. [2025-09-26T17:46:38.658134] [WARN ] [MAIN ] BUXX: No existing data found, performing full refresh instead. [2025-09-26T17:46:38.658288] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-09-26T17:46:38.658333] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-09-26T17:46:38.658375] [DEBUG] [LOCAL ] BUXX: No primary data file found to delete. [2025-09-26T17:46:38.658407] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-09-26T17:46:39.057221] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:46:39.156747] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-09-26T17:46:39.956752] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2024-12. [2025-09-26T17:46:40.100077] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-26T17:46:40.269821] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-26T17:46:40.756766] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-09-26T17:46:40.922814] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-26T17:46:41.556738] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-09-26T17:46:42.317412] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-26T17:46:42.338471] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-26T17:46:42.356742] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-09-26T17:46:43.156743] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-09-26T17:46:43.911125] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T17:46:43.956058] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-26T17:46:43.959331] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-09-26T17:46:44.756776] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-09-26T17:46:45.556736] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-09-26T17:46:45.596665] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-26T17:46:45.648108] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-26T17:46:46.356740] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-09-26T17:46:46.797781] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-26T17:46:47.156799] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-09-26T17:46:47.562340] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-26T17:46:47.704435] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-26T17:46:47.956763] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-09-26T17:46:48.756753] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-09-26T17:46:49.428191] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-26T17:46:49.556721] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-09-26T17:46:50.125324] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-26T17:46:50.356706] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-09-26T17:46:50.509854] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-26T17:46:51.156764] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-09-26T17:46:51.905861] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T17:46:51.931578] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-26T17:46:51.956736] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-09-26T17:46:52.756741] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-09-26T17:46:53.047002] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-26T17:46:53.556738] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-09-26T17:46:54.169117] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-26T17:46:54.191155] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-26T17:46:54.356743] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-09-26T17:46:55.156734] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-09-26T17:46:55.409403] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-26T17:46:55.412634] [INFO ] [REMOTE ] BUI: Full fetch complete (16208 records). [2025-09-26T17:46:55.412805] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-09-26T17:46:55.801416] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-09-26T17:46:55.801498] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-09-26T17:46:55.801831] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-09-26T17:46:55.801916] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-09-26T17:46:55.802541] [DEBUG] [LOCAL ] BUI: Trimmed 16208 records to 11615 (keeping 200 days of data) [2025-09-26T17:46:55.878169] [DEBUG] [LOCAL ] BUI: Primary data saved (11615 records). [2025-09-26T17:46:55.878324] [INFO ] [MAIN ] BUI: Full history saved. [2025-09-26T17:46:55.878410] [INFO ] [MAIN ] Update Progress: 357/2371 symbols completed. BUI took 36.8s. Estimated remaining: 4h 24m 28s. Rate: 7.6 symbols/min [2025-09-26T17:46:55.956724] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-09-26T17:46:56.731248] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-26T17:46:56.756685] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-09-26T17:46:57.239151] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-26T17:46:57.556748] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-09-26T17:46:57.782276] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-26T17:46:58.150271] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-26T17:46:58.356728] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-09-26T17:46:59.156740] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-09-26T17:46:59.290684] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-26T17:46:59.956775] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-09-26T17:47:00.756758] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-09-26T17:47:00.813280] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-26T17:47:01.178544] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-26T17:47:01.323381] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-26T17:47:01.556721] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-09-26T17:47:02.356753] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-09-26T17:47:03.156767] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-09-26T17:47:03.378166] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-26T17:47:03.650334] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-26T17:47:03.659583] [INFO ] [REMOTE ] BUR: Full fetch complete (63079 records). [2025-09-26T17:47:03.659778] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-09-26T17:47:03.660683] [FATAL] [VALIDATOR ] BUR: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:47:03.660853] [FATAL] [MAIN ] BUR: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:47:03.660929] [WARN ] [MAIN ] BUR: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:47:03.660984] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-09-26T17:47:03.661060] [DEBUG] [LOCAL ] BUR: No primary data file found to delete. [2025-09-26T17:47:03.661131] [INFO ] [LOCAL ] BUR: Starting deletion of derivative data. [2025-09-26T17:47:03.661727] [DEBUG] [LOCAL ] BUR: Deleted derivative data file. [2025-09-26T17:47:03.661833] [INFO ] [MAIN ] Update Progress: 358/2371 symbols completed. BUR took 28.2s. Estimated remaining: 4h 24m 20s. Rate: 7.6 symbols/min [2025-09-26T17:47:03.956769] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-09-26T17:47:04.098799] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-26T17:47:04.756732] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-09-26T17:47:05.678390] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T17:47:05.692819] [INFO ] [REMOTE ] BURL: Full fetch complete (65694 records). [2025-09-26T17:47:05.693064] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-09-26T17:47:05.902105] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-26T17:47:05.977329] [INFO ] [REMOTE ] BUXX: Full fetch complete (20298 records). [2025-09-26T17:47:06.004706] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-09-26T17:47:06.341828] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-09-26T17:47:06.342017] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-09-26T17:47:06.343128] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-09-26T17:47:06.348740] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-09-26T17:47:06.440231] [DEBUG] [LOCAL ] BURL: Trimmed 65694 records to 46896 (keeping 200 days of data) [2025-09-26T17:47:06.758406] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-09-26T17:47:06.759442] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-09-26T17:47:06.760185] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-09-26T17:47:06.760594] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-09-26T17:47:06.764422] [DEBUG] [LOCAL ] BUXX: Trimmed 20298 records to 15364 (keeping 200 days of data) [2025-09-26T17:47:06.984176] [DEBUG] [LOCAL ] BUXX: Primary data saved (15364 records). [2025-09-26T17:47:06.984902] [INFO ] [MAIN ] BUXX: Full history saved. [2025-09-26T17:47:06.985365] [INFO ] [MAIN ] Update Progress: 359/2371 symbols completed. BUXX took 28.5s. Estimated remaining: 4h 23m 47s. Rate: 7.6 symbols/min [2025-09-26T17:47:07.069063] [DEBUG] [LOCAL ] BURL: Primary data saved (46896 records). [2025-09-26T17:47:07.069270] [INFO ] [MAIN ] BURL: Full history saved. [2025-09-26T17:47:07.072166] [INFO ] [MAIN ] Update Progress: 360/2371 symbols completed. BURL took 29.8s. Estimated remaining: 4h 22m 55s. Rate: 7.6 symbols/min [2025-09-26T17:47:07.829116] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:47:07.897824] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:47:07.950496] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:47:07.951464] [DEBUG] [LOCAL ] BVN: No existing data file found in primary storage. [2025-09-26T17:47:07.945372] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:47:07.951630] [WARN ] [MAIN ] BVN: No existing data found, performing full refresh instead. [2025-09-26T17:47:07.952329] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-09-26T17:47:07.952421] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-09-26T17:47:07.952546] [DEBUG] [LOCAL ] BVN: No primary data file found to delete. [2025-09-26T17:47:07.952675] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-09-26T17:47:08.272235] [DEBUG] [LOCAL ] BW: Loaded 39935 existing records from primary storage. [2025-09-26T17:47:08.322826] [DEBUG] [LOCAL ] BV: Loaded 38782 existing records from primary storage. [2025-09-26T17:47:08.322096] [INFO ] [MAIN ] BW: Loaded 39935 existing records. [2025-09-26T17:47:08.339813] [INFO ] [MAIN ] BV: Loaded 38782 existing records. [2025-09-26T17:47:08.323491] [DEBUG] [LOCAL ] BWA: Loaded 52616 existing records from primary storage. [2025-09-26T17:47:08.407086] [INFO ] [MAIN ] BWA: Loaded 52616 existing records. [2025-09-26T17:47:08.786368] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:47:08.846223] [INFO ] [REMOTE ] BVN: Fetching primary data for 2024-12. [2025-09-26T17:47:09.044102] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:47:09.072687] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-09-26T17:47:09.072105] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:47:09.087959] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-09-26T17:47:09.094458] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:47:09.094751] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-09-26T17:47:09.094814] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-09-26T17:47:09.094943] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-09-26T17:47:09.095114] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-09-26T17:47:09.095237] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-09-26T17:47:09.107983] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-09-26T17:47:09.100455] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-09-26T17:47:09.113243] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-09-26T17:47:09.152432] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-09-26T17:47:09.220201] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-09-26T17:47:10.202206] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:47:10.234521] [INFO ] [REMOTE ] BW: Fetching primary data for 2024-12. [2025-09-26T17:47:10.298902] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:47:10.303566] [INFO ] [REMOTE ] BV: Fetching primary data for 2024-12. [2025-09-26T17:47:10.331091] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:47:10.331579] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-12. [2025-09-26T17:47:10.454427] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-26T17:47:10.464190] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-09-26T17:47:11.391962] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-26T17:47:11.399736] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-09-26T17:47:11.500775] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-26T17:47:11.509495] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-09-26T17:47:11.581370] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-26T17:47:11.591227] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-09-26T17:47:12.130466] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T17:47:12.141822] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-09-26T17:47:12.186769] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-26T17:47:12.400857] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-26T17:47:12.756764] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-09-26T17:47:13.263429] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-26T17:47:13.556769] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-09-26T17:47:13.619327] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-26T17:47:13.844933] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-26T17:47:14.356731] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-09-26T17:47:14.741680] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-26T17:47:15.156796] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-09-26T17:47:15.835950] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-26T17:47:15.956779] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-09-26T17:47:16.322136] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-26T17:47:16.756770] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-09-26T17:47:17.471927] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-26T17:47:17.556735] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-09-26T17:47:18.249774] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-26T17:47:18.356776] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-09-26T17:47:19.156755] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-09-26T17:47:19.322429] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-26T17:47:19.833095] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-26T17:47:19.956747] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-09-26T17:47:20.292264] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-26T17:47:20.756765] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-09-26T17:47:20.981729] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-26T17:47:21.556755] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-09-26T17:47:21.913290] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-26T17:47:22.356774] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-09-26T17:47:22.986208] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-26T17:47:23.156727] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-09-26T17:47:23.615186] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-26T17:47:23.956784] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-09-26T17:47:24.302185] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-26T17:47:24.756765] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-09-26T17:47:25.403355] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-26T17:47:25.556748] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-09-26T17:47:25.835488] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-26T17:47:26.356804] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-09-26T17:47:27.156733] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-09-26T17:47:27.204385] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-26T17:47:27.956724] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-09-26T17:47:28.030838] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-26T17:47:28.742307] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-26T17:47:28.750365] [INFO ] [REMOTE ] BV: Full fetch complete (53778 records). [2025-09-26T17:47:28.750481] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-09-26T17:47:28.765119] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-09-26T17:47:29.183915] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-09-26T17:47:29.184147] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-09-26T17:47:29.184876] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-09-26T17:47:29.184988] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-09-26T17:47:29.186715] [DEBUG] [LOCAL ] BV: Trimmed 53778 records to 39048 (keeping 200 days of data) [2025-09-26T17:47:29.309995] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-26T17:47:29.462931] [DEBUG] [LOCAL ] BV: Primary data saved (39048 records). [2025-09-26T17:47:29.463095] [INFO ] [MAIN ] BV: Full history saved. [2025-09-26T17:47:29.463187] [INFO ] [MAIN ] Update Progress: 361/2371 symbols completed. BV took 22.4s. Estimated remaining: 4h 24m 8s. Rate: 7.6 symbols/min [2025-09-26T17:47:29.565177] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-09-26T17:47:29.673672] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:47:29.688471] [DEBUG] [LOCAL ] BWG: Loaded 12430 existing records from primary storage. [2025-09-26T17:47:29.688616] [INFO ] [MAIN ] BWG: Loaded 12430 existing records. [2025-09-26T17:47:29.883596] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:47:29.883930] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-09-26T17:47:29.883982] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-09-26T17:47:29.884210] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-09-26T17:47:29.884271] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-09-26T17:47:30.301157] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:47:30.366316] [INFO ] [REMOTE ] BWG: Fetching primary data for 2024-12. [2025-09-26T17:47:30.388732] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-26T17:47:31.156747] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-09-26T17:47:31.269780] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-26T17:47:31.311932] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-26T17:47:31.956788] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-09-26T17:47:32.756765] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-09-26T17:47:32.817926] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-26T17:47:33.509192] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-26T17:47:33.556706] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-09-26T17:47:34.275804] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-26T17:47:34.356718] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-09-26T17:47:34.830295] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-26T17:47:34.840063] [INFO ] [REMOTE ] BVN: Full fetch complete (62771 records). [2025-09-26T17:47:34.840259] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-09-26T17:47:35.165728] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-09-26T17:47:35.339796] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-09-26T17:47:35.339911] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-09-26T17:47:35.340734] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-09-26T17:47:35.340843] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-09-26T17:47:35.342549] [DEBUG] [LOCAL ] BVN: Trimmed 62771 records to 44520 (keeping 200 days of data) [2025-09-26T17:47:35.645210] [DEBUG] [LOCAL ] BVN: Primary data saved (44520 records). [2025-09-26T17:47:35.645381] [INFO ] [MAIN ] BVN: Full history saved. [2025-09-26T17:47:35.645545] [INFO ] [MAIN ] Update Progress: 362/2371 symbols completed. BVN took 28.6s. Estimated remaining: 4h 23m 51s. Rate: 7.6 symbols/min [2025-09-26T17:47:35.830556] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:47:35.862970] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-26T17:47:35.873694] [INFO ] [REMOTE ] BWA: Full fetch complete (75354 records). [2025-09-26T17:47:35.873879] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-09-26T17:47:35.874885] [FATAL] [VALIDATOR ] BWA: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:47:35.874993] [FATAL] [MAIN ] BWA: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:47:35.875053] [WARN ] [MAIN ] BWA: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:47:35.875132] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-09-26T17:47:35.875204] [DEBUG] [LOCAL ] BWA: No primary data file found to delete. [2025-09-26T17:47:35.875257] [INFO ] [LOCAL ] BWA: Starting deletion of derivative data. [2025-09-26T17:47:35.875831] [DEBUG] [LOCAL ] BWA: Deleted derivative data file. [2025-09-26T17:47:35.876044] [INFO ] [MAIN ] Update Progress: 363/2371 symbols completed. BWA took 28.8s. Estimated remaining: 4h 23m 1s. Rate: 7.6 symbols/min [2025-09-26T17:47:35.961465] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-09-26T17:47:36.060270] [DEBUG] [LOCAL ] BWLP: Loaded 32989 existing records from primary storage. [2025-09-26T17:47:36.067633] [INFO ] [MAIN ] BWLP: Loaded 32989 existing records. [2025-09-26T17:47:36.091441] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:47:36.147709] [DEBUG] [LOCAL ] BWMX: No existing data file found in primary storage. [2025-09-26T17:47:36.164245] [WARN ] [MAIN ] BWMX: No existing data found, performing full refresh instead. [2025-09-26T17:47:36.202242] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-09-26T17:47:36.202540] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-09-26T17:47:36.203091] [DEBUG] [LOCAL ] BWMX: No primary data file found to delete. [2025-09-26T17:47:36.213797] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-09-26T17:47:36.337143] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:47:36.360714] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-09-26T17:47:36.379024] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-09-26T17:47:36.385010] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-09-26T17:47:36.404050] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-09-26T17:47:36.758067] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-26T17:47:36.857488] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-26T17:47:36.960134] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-09-26T17:47:37.146454] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:47:37.225289] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:47:37.556726] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2024-12. [2025-09-26T17:47:38.264085] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-26T17:47:38.356746] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-09-26T17:47:39.156740] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2024-12. [2025-09-26T17:47:39.275153] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-26T17:47:39.956706] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-09-26T17:47:39.996567] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-26T17:47:40.165380] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-26T17:47:40.748740] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-26T17:47:40.756696] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-09-26T17:47:41.556741] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-09-26T17:47:41.580946] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-26T17:47:42.356761] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-09-26T17:47:42.949287] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-26T17:47:43.156744] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-09-26T17:47:43.741439] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-26T17:47:43.905929] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-26T17:47:43.915712] [INFO ] [REMOTE ] BW: Full fetch complete (58753 records). [2025-09-26T17:47:43.915881] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-09-26T17:47:43.961836] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-09-26T17:47:44.326290] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-09-26T17:47:44.326401] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-09-26T17:47:44.327223] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-09-26T17:47:44.327291] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-09-26T17:47:44.328633] [DEBUG] [LOCAL ] BW: Trimmed 58753 records to 40297 (keeping 200 days of data) [2025-09-26T17:47:44.570761] [DEBUG] [LOCAL ] BW: Primary data saved (40297 records). [2025-09-26T17:47:44.570890] [INFO ] [MAIN ] BW: Full history saved. [2025-09-26T17:47:44.570990] [INFO ] [MAIN ] Update Progress: 364/2371 symbols completed. BW took 37.5s. Estimated remaining: 4h 22m 58s. Rate: 7.6 symbols/min [2025-09-26T17:47:44.752187] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:47:44.757324] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-26T17:47:44.757130] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-09-26T17:47:44.770102] [DEBUG] [LOCAL ] BWNB: Loaded 4463 existing records from primary storage. [2025-09-26T17:47:44.770208] [INFO ] [MAIN ] BWNB: Loaded 4463 existing records. [2025-09-26T17:47:44.950212] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:47:44.950464] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-09-26T17:47:44.950549] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-09-26T17:47:44.950763] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-09-26T17:47:44.950822] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-09-26T17:47:45.328880] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:47:45.556695] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-09-26T17:47:45.602041] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-26T17:47:46.356724] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-09-26T17:47:46.789092] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-26T17:47:46.790078] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-26T17:47:47.156748] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-09-26T17:47:47.956734] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2024-12. [2025-09-26T17:47:48.382167] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-26T17:47:48.384334] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-26T17:47:48.756743] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-09-26T17:47:49.104824] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-26T17:47:49.556718] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-09-26T17:47:50.356739] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-09-26T17:47:50.935390] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-26T17:47:50.979786] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-26T17:47:51.156776] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-09-26T17:47:51.925616] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-26T17:47:51.956700] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-09-26T17:47:52.480416] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-26T17:47:52.756737] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-09-26T17:47:53.161526] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-26T17:47:53.556746] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-09-26T17:47:54.356765] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-09-26T17:47:54.985461] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-26T17:47:55.051049] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T17:47:55.156761] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-09-26T17:47:55.517530] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-26T17:47:55.956734] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-09-26T17:47:56.756728] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-09-26T17:47:57.411556] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-26T17:47:57.556727] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-09-26T17:47:57.727158] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-26T17:47:58.356763] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-09-26T17:47:58.965058] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-26T17:47:58.985616] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-26T17:47:59.156746] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-09-26T17:47:59.956779] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-09-26T17:48:00.080194] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-26T17:48:00.474710] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-26T17:48:00.756751] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-09-26T17:48:01.336381] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-26T17:48:01.556773] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-09-26T17:48:02.356742] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-09-26T17:48:02.712752] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-26T17:48:03.156768] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-09-26T17:48:03.325560] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-26T17:48:03.327461] [INFO ] [REMOTE ] BWMX: Full fetch complete (10047 records). [2025-09-26T17:48:03.327536] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-09-26T17:48:03.719881] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-09-26T17:48:03.719964] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-09-26T17:48:03.720214] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-09-26T17:48:03.720254] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-09-26T17:48:03.720756] [DEBUG] [LOCAL ] BWMX: Trimmed 10047 records to 7676 (keeping 200 days of data) [2025-09-26T17:48:03.771590] [DEBUG] [LOCAL ] BWMX: Primary data saved (7676 records). [2025-09-26T17:48:03.771759] [INFO ] [MAIN ] BWMX: Full history saved. [2025-09-26T17:48:03.771859] [INFO ] [MAIN ] Update Progress: 365/2371 symbols completed. BWMX took 27.9s. Estimated remaining: 4h 23m 52s. Rate: 7.6 symbols/min [2025-09-26T17:48:03.957431] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-09-26T17:48:03.957364] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:48:03.958983] [DEBUG] [LOCAL ] BWSN: No existing data file found in primary storage. [2025-09-26T17:48:03.959130] [WARN ] [MAIN ] BWSN: No existing data found, performing full refresh instead. [2025-09-26T17:48:03.959318] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-09-26T17:48:03.959366] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-09-26T17:48:03.959412] [DEBUG] [LOCAL ] BWSN: No primary data file found to delete. [2025-09-26T17:48:03.959448] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-09-26T17:48:04.049410] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-26T17:48:04.404122] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:48:04.756710] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2024-12. [2025-09-26T17:48:04.827693] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-26T17:48:05.209586] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-26T17:48:05.556725] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-09-26T17:48:06.143664] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-26T17:48:06.356747] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-09-26T17:48:06.814309] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-26T17:48:07.156718] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-09-26T17:48:07.956703] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-09-26T17:48:08.225976] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-26T17:48:08.230290] [INFO ] [REMOTE ] BWG: Full fetch complete (17733 records). [2025-09-26T17:48:08.230402] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-09-26T17:48:08.491739] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-26T17:48:08.650881] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-09-26T17:48:08.650971] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-09-26T17:48:08.651387] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-09-26T17:48:08.651449] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-09-26T17:48:08.652307] [DEBUG] [LOCAL ] BWG: Trimmed 17733 records to 12478 (keeping 200 days of data) [2025-09-26T17:48:08.740747] [DEBUG] [LOCAL ] BWG: Primary data saved (12478 records). [2025-09-26T17:48:08.740909] [INFO ] [MAIN ] BWG: Full history saved. [2025-09-26T17:48:08.741002] [INFO ] [MAIN ] Update Progress: 366/2371 symbols completed. BWG took 39.3s. Estimated remaining: 4h 23m 28s. Rate: 7.6 symbols/min [2025-09-26T17:48:08.764090] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-09-26T17:48:08.932792] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:48:08.992759] [DEBUG] [LOCAL ] BWXT: Loaded 47108 existing records from primary storage. [2025-09-26T17:48:08.992919] [INFO ] [MAIN ] BWXT: Loaded 47108 existing records. [2025-09-26T17:48:09.179255] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:48:09.179502] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-09-26T17:48:09.179551] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-09-26T17:48:09.179816] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-09-26T17:48:09.179876] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-09-26T17:48:09.339871] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-26T17:48:09.560959] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:48:09.561067] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-09-26T17:48:10.038507] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-26T17:48:10.356728] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-09-26T17:48:11.156724] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-09-26T17:48:11.600198] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-26T17:48:11.606699] [INFO ] [REMOTE ] BWLP: Full fetch complete (48399 records). [2025-09-26T17:48:11.606835] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-09-26T17:48:11.785574] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-26T17:48:11.806174] [INFO ] [REMOTE ] BWNB: Full fetch complete (5720 records). [2025-09-26T17:48:11.814382] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-09-26T17:48:11.961050] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-09-26T17:48:12.271723] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-09-26T17:48:12.311040] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-09-26T17:48:12.346494] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-09-26T17:48:12.352726] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-09-26T17:48:12.400566] [DEBUG] [LOCAL ] BWLP: Trimmed 48399 records to 33185 (keeping 200 days of data) [2025-09-26T17:48:12.534315] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-09-26T17:48:12.534555] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-09-26T17:48:12.534793] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-09-26T17:48:12.534990] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-09-26T17:48:12.535571] [DEBUG] [LOCAL ] BWNB: Trimmed 5720 records to 4468 (keeping 200 days of data) [2025-09-26T17:48:12.601219] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-26T17:48:12.624122] [DEBUG] [LOCAL ] BWNB: Primary data saved (4468 records). [2025-09-26T17:48:12.625609] [INFO ] [MAIN ] BWNB: Full history saved. [2025-09-26T17:48:12.627072] [INFO ] [MAIN ] Update Progress: 367/2371 symbols completed. BWNB took 28.1s. Estimated remaining: 4h 22m 58s. Rate: 7.6 symbols/min [2025-09-26T17:48:12.761982] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-09-26T17:48:12.829763] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:48:12.964333] [DEBUG] [LOCAL ] BX: Loaded 53887 existing records from primary storage. [2025-09-26T17:48:12.965381] [INFO ] [MAIN ] BX: Loaded 53887 existing records. [2025-09-26T17:48:13.140056] [DEBUG] [LOCAL ] BWLP: Primary data saved (33185 records). [2025-09-26T17:48:13.180182] [INFO ] [MAIN ] BWLP: Full history saved. [2025-09-26T17:48:13.185183] [INFO ] [MAIN ] Update Progress: 368/2371 symbols completed. BWLP took 37.5s. Estimated remaining: 4h 22m 11s. Rate: 7.6 symbols/min [2025-09-26T17:48:13.184506] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:48:13.270330] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-09-26T17:48:13.288955] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-09-26T17:48:13.297159] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-09-26T17:48:13.318060] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-26T17:48:13.314859] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-09-26T17:48:13.495164] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:48:13.570473] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2024-12. [2025-09-26T17:48:13.709500] [DEBUG] [LOCAL ] BXC: Loaded 13822 existing records from primary storage. [2025-09-26T17:48:13.738271] [INFO ] [MAIN ] BXC: Loaded 13822 existing records. [2025-09-26T17:48:13.951726] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:48:14.030994] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:48:14.031337] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-09-26T17:48:14.031397] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-09-26T17:48:14.031630] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-09-26T17:48:14.031726] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-09-26T17:48:14.361891] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-09-26T17:48:14.430102] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:48:15.156725] [INFO ] [REMOTE ] BXC: Fetching primary data for 2024-12. [2025-09-26T17:48:15.193932] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-26T17:48:15.435831] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-26T17:48:15.812469] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-26T17:48:15.956743] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-09-26T17:48:16.756726] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-09-26T17:48:16.845118] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-26T17:48:17.556754] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-09-26T17:48:18.284974] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-26T17:48:18.356743] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-09-26T17:48:18.536139] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-26T17:48:18.740550] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-26T17:48:19.156794] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-09-26T17:48:19.776721] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-26T17:48:19.956745] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-09-26T17:48:20.554466] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-26T17:48:20.555829] [INFO ] [REMOTE ] BWSN: Full fetch complete (6138 records). [2025-09-26T17:48:20.555912] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-09-26T17:48:20.759583] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-09-26T17:48:20.975201] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-09-26T17:48:20.975293] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-09-26T17:48:20.975483] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-09-26T17:48:20.975524] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-09-26T17:48:20.975976] [DEBUG] [LOCAL ] BWSN: Trimmed 6138 records to 5130 (keeping 200 days of data) [2025-09-26T17:48:21.009346] [DEBUG] [LOCAL ] BWSN: Primary data saved (5130 records). [2025-09-26T17:48:21.009468] [INFO ] [MAIN ] BWSN: Full history saved. [2025-09-26T17:48:21.009542] [INFO ] [MAIN ] Update Progress: 369/2371 symbols completed. BWSN took 17.2s. Estimated remaining: 4h 22m 3s. Rate: 7.6 symbols/min [2025-09-26T17:48:21.196537] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:48:21.252069] [DEBUG] [LOCAL ] BXMT: Loaded 47634 existing records from primary storage. [2025-09-26T17:48:21.252219] [INFO ] [MAIN ] BXMT: Loaded 47634 existing records. [2025-09-26T17:48:21.493442] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:48:21.493751] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-09-26T17:48:21.493807] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-09-26T17:48:21.494051] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-09-26T17:48:21.494109] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-09-26T17:48:21.561865] [INFO ] [REMOTE ] BX: Fetching primary data for 2024-12. [2025-09-26T17:48:21.885070] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:48:22.294459] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-26T17:48:22.356688] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-09-26T17:48:23.010973] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-26T17:48:23.156783] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-09-26T17:48:23.634697] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-26T17:48:23.956770] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-09-26T17:48:24.716632] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-26T17:48:24.756776] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2024-12. [2025-09-26T17:48:25.556696] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-09-26T17:48:25.671508] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-26T17:48:26.356697] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-09-26T17:48:26.472569] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-26T17:48:26.941728] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-26T17:48:27.156780] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-09-26T17:48:27.676587] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-26T17:48:27.956729] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-09-26T17:48:28.396760] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-26T17:48:28.547790] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-26T17:48:28.756772] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-09-26T17:48:29.556736] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-09-26T17:48:30.356706] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-09-26T17:48:30.741090] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-26T17:48:31.011706] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-26T17:48:31.156788] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-09-26T17:48:31.520039] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-26T17:48:31.732566] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-26T17:48:31.956730] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-09-26T17:48:32.756729] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-09-26T17:48:33.399926] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-26T17:48:33.477484] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-26T17:48:33.556727] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-09-26T17:48:34.356761] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-09-26T17:48:35.000201] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-26T17:48:35.156770] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-09-26T17:48:35.678179] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-26T17:48:35.802383] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-26T17:48:35.956735] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-09-26T17:48:36.756773] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-09-26T17:48:37.556702] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-09-26T17:48:37.809918] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-26T17:48:38.198153] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-26T17:48:38.207557] [INFO ] [REMOTE ] BWXT: Full fetch complete (67370 records). [2025-09-26T17:48:38.207744] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-09-26T17:48:38.361325] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-09-26T17:48:38.631595] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-09-26T17:48:38.631715] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-09-26T17:48:38.632494] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-09-26T17:48:38.632541] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-09-26T17:48:38.634042] [DEBUG] [LOCAL ] BWXT: Trimmed 67370 records to 47442 (keeping 200 days of data) [2025-09-26T17:48:38.948826] [DEBUG] [LOCAL ] BWXT: Primary data saved (47442 records). [2025-09-26T17:48:38.948966] [INFO ] [MAIN ] BWXT: Full history saved. [2025-09-26T17:48:38.949114] [INFO ] [MAIN ] Update Progress: 370/2371 symbols completed. BWXT took 30.2s. Estimated remaining: 4h 22m 49s. Rate: 7.6 symbols/min [2025-09-26T17:48:39.134472] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:48:39.134763] [DEBUG] [LOCAL ] BXMX: No existing data file found in primary storage. [2025-09-26T17:48:39.134822] [WARN ] [MAIN ] BXMX: No existing data found, performing full refresh instead. [2025-09-26T17:48:39.134970] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-09-26T17:48:39.135017] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-09-26T17:48:39.135061] [DEBUG] [LOCAL ] BXMX: No primary data file found to delete. [2025-09-26T17:48:39.135096] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-09-26T17:48:39.168309] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-09-26T17:48:39.528584] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:48:39.617919] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-26T17:48:39.956738] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2024-12. [2025-09-26T17:48:40.010611] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-26T17:48:40.237898] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-26T17:48:40.756733] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-09-26T17:48:41.175820] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-26T17:48:41.556738] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-09-26T17:48:41.711864] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-26T17:48:42.356732] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-09-26T17:48:43.070727] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-26T17:48:43.121218] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-26T17:48:43.156747] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-09-26T17:48:43.956739] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-09-26T17:48:44.735146] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-26T17:48:44.756676] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-09-26T17:48:45.556719] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-09-26T17:48:45.978005] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-26T17:48:46.020377] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-26T17:48:46.120251] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-26T17:48:46.356725] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-09-26T17:48:47.156709] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-09-26T17:48:47.412195] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-26T17:48:47.877983] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-26T17:48:47.881022] [INFO ] [REMOTE ] BXC: Full fetch complete (17819 records). [2025-09-26T17:48:47.881106] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-09-26T17:48:47.961886] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-09-26T17:48:48.276367] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-09-26T17:48:48.276504] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-09-26T17:48:48.276893] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-09-26T17:48:48.276958] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-09-26T17:48:48.277614] [DEBUG] [LOCAL ] BXC: Trimmed 17819 records to 13880 (keeping 200 days of data) [2025-09-26T17:48:48.363884] [DEBUG] [LOCAL ] BXC: Primary data saved (13880 records). [2025-09-26T17:48:48.364035] [INFO ] [MAIN ] BXC: Full history saved. [2025-09-26T17:48:48.364130] [INFO ] [MAIN ] Update Progress: 371/2371 symbols completed. BXC took 35.2s. Estimated remaining: 4h 22m 50s. Rate: 7.6 symbols/min [2025-09-26T17:48:48.555094] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:48:48.605447] [DEBUG] [LOCAL ] BXP: Loaded 50191 existing records from primary storage. [2025-09-26T17:48:48.605662] [INFO ] [MAIN ] BXP: Loaded 50191 existing records. [2025-09-26T17:48:48.766411] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-09-26T17:48:48.804776] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:48:48.805175] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-09-26T17:48:48.805237] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-09-26T17:48:48.805493] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-09-26T17:48:48.805554] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-09-26T17:48:49.179565] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:48:49.556745] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-09-26T17:48:49.844611] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-26T17:48:49.854976] [INFO ] [REMOTE ] BXMT: Full fetch complete (69555 records). [2025-09-26T17:48:49.855137] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-09-26T17:48:50.288449] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-09-26T17:48:50.288561] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-09-26T17:48:50.289333] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-09-26T17:48:50.289411] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-09-26T17:48:50.291021] [DEBUG] [LOCAL ] BXMT: Trimmed 69555 records to 47994 (keeping 200 days of data) [2025-09-26T17:48:50.357214] [INFO ] [REMOTE ] BXP: Fetching primary data for 2024-12. [2025-09-26T17:48:50.602175] [DEBUG] [LOCAL ] BXMT: Primary data saved (47994 records). [2025-09-26T17:48:50.602324] [INFO ] [MAIN ] BXMT: Full history saved. [2025-09-26T17:48:50.603418] [INFO ] [MAIN ] Update Progress: 372/2371 symbols completed. BXMT took 29.6s. Estimated remaining: 4h 22m 12s. Rate: 7.6 symbols/min [2025-09-26T17:48:50.793486] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:48:50.794146] [DEBUG] [LOCAL ] BXSL: No existing data file found in primary storage. [2025-09-26T17:48:50.794476] [WARN ] [MAIN ] BXSL: No existing data found, performing full refresh instead. [2025-09-26T17:48:50.810084] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-09-26T17:48:50.810238] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-09-26T17:48:50.810008] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-26T17:48:50.810566] [DEBUG] [LOCAL ] BXSL: No primary data file found to delete. [2025-09-26T17:48:50.816514] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-09-26T17:48:51.016749] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-26T17:48:51.159678] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-09-26T17:48:51.281016] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:48:51.776830] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-26T17:48:51.956794] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2024-12. [2025-09-26T17:48:52.756690] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-09-26T17:48:52.889808] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-26T17:48:53.556701] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-09-26T17:48:53.661921] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-26T17:48:53.697034] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-26T17:48:54.356804] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-09-26T17:48:55.156698] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-09-26T17:48:55.240068] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-26T17:48:55.943170] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-26T17:48:55.956687] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-09-26T17:48:56.238223] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-26T17:48:56.756723] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-09-26T17:48:57.279638] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-26T17:48:57.556736] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-09-26T17:48:58.356701] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-09-26T17:48:58.544121] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-26T17:48:58.704726] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-26T17:48:59.156726] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-09-26T17:48:59.492547] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-26T17:48:59.956732] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-09-26T17:49:00.756749] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-09-26T17:49:00.992106] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-26T17:49:01.556758] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-09-26T17:49:01.946061] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-26T17:49:02.158629] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-26T17:49:02.169915] [INFO ] [REMOTE ] BX: Full fetch complete (77402 records). [2025-09-26T17:49:02.170157] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-09-26T17:49:02.356945] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-09-26T17:49:02.609589] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-09-26T17:49:02.609787] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-09-26T17:49:02.610777] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-09-26T17:49:02.610847] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-09-26T17:49:02.612546] [DEBUG] [LOCAL ] BX: Trimmed 77402 records to 54270 (keeping 200 days of data) [2025-09-26T17:49:02.988185] [DEBUG] [LOCAL ] BX: Primary data saved (54270 records). [2025-09-26T17:49:02.988510] [INFO ] [MAIN ] BX: Full history saved. [2025-09-26T17:49:02.988760] [INFO ] [MAIN ] Update Progress: 373/2371 symbols completed. BX took 50.4s. Estimated remaining: 4h 22m 28s. Rate: 7.6 symbols/min [2025-09-26T17:49:03.162434] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-09-26T17:49:03.201276] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:49:03.215105] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-26T17:49:03.247392] [DEBUG] [LOCAL ] BY: Loaded 21748 existing records from primary storage. [2025-09-26T17:49:03.247543] [INFO ] [MAIN ] BY: Loaded 21748 existing records. [2025-09-26T17:49:03.449314] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:49:03.451222] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-26T17:49:03.455875] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-09-26T17:49:03.456157] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-09-26T17:49:03.456328] [INFO ] [REMOTE ] BXMX: Full fetch complete (28801 records). [2025-09-26T17:49:03.456479] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-09-26T17:49:03.483685] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-09-26T17:49:03.538616] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-09-26T17:49:03.977338] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-09-26T17:49:04.274091] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-09-26T17:49:04.279734] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-09-26T17:49:04.280273] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-09-26T17:49:04.280364] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-09-26T17:49:04.311775] [DEBUG] [LOCAL ] BXMX: Trimmed 28801 records to 19855 (keeping 200 days of data) [2025-09-26T17:49:04.315379] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:49:04.447783] [DEBUG] [LOCAL ] BXMX: Primary data saved (19855 records). [2025-09-26T17:49:04.447958] [INFO ] [MAIN ] BXMX: Full history saved. [2025-09-26T17:49:04.448046] [INFO ] [MAIN ] Update Progress: 374/2371 symbols completed. BXMX took 25.5s. Estimated remaining: 4h 21m 46s. Rate: 7.6 symbols/min [2025-09-26T17:49:04.635876] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:49:04.671310] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-26T17:49:04.718422] [DEBUG] [LOCAL ] BYD: Loaded 45502 existing records from primary storage. [2025-09-26T17:49:04.718608] [INFO ] [MAIN ] BYD: Loaded 45502 existing records. [2025-09-26T17:49:04.762590] [INFO ] [REMOTE ] BY: Fetching primary data for 2024-12. [2025-09-26T17:49:04.911662] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:49:04.911919] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-09-26T17:49:04.911968] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-09-26T17:49:04.912314] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-09-26T17:49:04.912374] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-09-26T17:49:05.291094] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:49:05.556728] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-09-26T17:49:05.895952] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-26T17:49:06.243728] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-26T17:49:06.356746] [INFO ] [REMOTE ] BYD: Fetching primary data for 2024-12. [2025-09-26T17:49:07.156735] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-09-26T17:49:07.630375] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-26T17:49:07.702514] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-26T17:49:07.956756] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-09-26T17:49:08.339115] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-26T17:49:08.756743] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-09-26T17:49:09.556753] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-09-26T17:49:09.667066] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-26T17:49:10.128039] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-26T17:49:10.356726] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-09-26T17:49:11.156713] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-09-26T17:49:11.211762] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-26T17:49:11.690089] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-26T17:49:11.956752] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-09-26T17:49:12.354339] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-26T17:49:12.756780] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-09-26T17:49:13.556713] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-09-26T17:49:13.711101] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-26T17:49:14.220949] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-26T17:49:14.356710] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-09-26T17:49:14.576258] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-26T17:49:15.156733] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-09-26T17:49:15.956723] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-09-26T17:49:16.195701] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-26T17:49:16.467456] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-26T17:49:16.756724] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-09-26T17:49:16.856902] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-26T17:49:17.556742] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-09-26T17:49:18.178480] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-26T17:49:18.356785] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-09-26T17:49:19.088625] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-26T17:49:19.156746] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-09-26T17:49:19.557616] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-26T17:49:19.956744] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-09-26T17:49:20.563186] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-26T17:49:20.756748] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-09-26T17:49:21.556729] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-09-26T17:49:21.827847] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-26T17:49:22.303246] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-26T17:49:22.313522] [INFO ] [REMOTE ] BXP: Full fetch complete (71321 records). [2025-09-26T17:49:22.313692] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-09-26T17:49:22.361925] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-09-26T17:49:22.737730] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-09-26T17:49:22.737827] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-09-26T17:49:22.738603] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-09-26T17:49:22.738674] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-09-26T17:49:22.740300] [DEBUG] [LOCAL ] BXP: Trimmed 71321 records to 50577 (keeping 200 days of data) [2025-09-26T17:49:23.069149] [DEBUG] [LOCAL ] BXP: Primary data saved (50577 records). [2025-09-26T17:49:23.069292] [INFO ] [MAIN ] BXP: Full history saved. [2025-09-26T17:49:23.069384] [INFO ] [MAIN ] Update Progress: 375/2371 symbols completed. BXP took 34.7s. Estimated remaining: 4h 22m 35s. Rate: 7.6 symbols/min [2025-09-26T17:49:23.160260] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-09-26T17:49:23.267938] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:49:23.268247] [DEBUG] [LOCAL ] BYM: No existing data file found in primary storage. [2025-09-26T17:49:23.278491] [WARN ] [MAIN ] BYM: No existing data found, performing full refresh instead. [2025-09-26T17:49:23.307071] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-09-26T17:49:23.311352] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-26T17:49:23.311950] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-09-26T17:49:23.314189] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-26T17:49:23.314410] [DEBUG] [LOCAL ] BYM: No primary data file found to delete. [2025-09-26T17:49:23.329856] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-09-26T17:49:23.380052] [INFO ] [REMOTE ] BXSL: Full fetch complete (69328 records). [2025-09-26T17:49:23.403732] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-09-26T17:49:23.957681] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-09-26T17:49:24.099311] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:49:24.197077] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-09-26T17:49:24.197234] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-09-26T17:49:24.198396] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-09-26T17:49:24.198468] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-09-26T17:49:24.200351] [DEBUG] [LOCAL ] BXSL: Trimmed 69328 records to 48276 (keeping 200 days of data) [2025-09-26T17:49:24.469791] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-26T17:49:24.545140] [DEBUG] [LOCAL ] BXSL: Primary data saved (48276 records). [2025-09-26T17:49:24.545282] [INFO ] [MAIN ] BXSL: Full history saved. [2025-09-26T17:49:24.545363] [INFO ] [MAIN ] Update Progress: 376/2371 symbols completed. BXSL took 33.9s. Estimated remaining: 4h 21m 53s. Rate: 7.6 symbols/min [2025-09-26T17:49:24.734267] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:49:24.756741] [INFO ] [REMOTE ] BYM: Fetching primary data for 2024-12. [2025-09-26T17:49:24.770851] [DEBUG] [LOCAL ] BZH: Loaded 32872 existing records from primary storage. [2025-09-26T17:49:24.771042] [INFO ] [MAIN ] BZH: Loaded 32872 existing records. [2025-09-26T17:49:24.970371] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:49:24.970625] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-09-26T17:49:24.970704] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-09-26T17:49:24.970967] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-09-26T17:49:24.971026] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-09-26T17:49:25.364502] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:49:25.380615] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-26T17:49:25.556701] [INFO ] [REMOTE ] BZH: Fetching primary data for 2024-12. [2025-09-26T17:49:25.861541] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-26T17:49:26.356731] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-09-26T17:49:26.900151] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-26T17:49:27.026676] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-26T17:49:27.156740] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-09-26T17:49:27.922433] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-26T17:49:27.956717] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-09-26T17:49:28.756782] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-09-26T17:49:28.787442] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-26T17:49:29.556724] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-09-26T17:49:29.691331] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-26T17:49:30.356686] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-09-26T17:49:30.676539] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-26T17:49:30.820398] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-26T17:49:31.156766] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-09-26T17:49:31.840755] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-26T17:49:31.956757] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-09-26T17:49:32.756746] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-09-26T17:49:33.556763] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-09-26T17:49:33.828245] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-26T17:49:33.838252] [INFO ] [REMOTE ] BYD: Full fetch complete (64906 records). [2025-09-26T17:49:33.838404] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-09-26T17:49:34.251672] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-09-26T17:49:34.252101] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-09-26T17:49:34.252906] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-09-26T17:49:34.253019] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-09-26T17:49:34.277960] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-26T17:49:34.276839] [DEBUG] [LOCAL ] BYD: Trimmed 64906 records to 45804 (keeping 200 days of data) [2025-09-26T17:49:34.381985] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-09-26T17:49:34.401691] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-26T17:49:34.613595] [DEBUG] [LOCAL ] BYD: Primary data saved (45804 records). [2025-09-26T17:49:34.613757] [INFO ] [MAIN ] BYD: Full history saved. [2025-09-26T17:49:34.613853] [INFO ] [MAIN ] Update Progress: 377/2371 symbols completed. BYD took 30.2s. Estimated remaining: 4h 21m 57s. Rate: 7.6 symbols/min [2025-09-26T17:49:34.793473] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:49:34.793699] [DEBUG] [LOCAL ] C: No existing data file found in primary storage. [2025-09-26T17:49:34.793755] [WARN ] [MAIN ] C: No existing data found, performing full refresh instead. [2025-09-26T17:49:34.793961] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-09-26T17:49:34.794018] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-09-26T17:49:34.794065] [DEBUG] [LOCAL ] C: No primary data file found to delete. [2025-09-26T17:49:34.794103] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-09-26T17:49:35.185837] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-09-26T17:49:35.195149] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:49:35.208911] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-26T17:49:35.956755] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-09-26T17:49:36.271523] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-26T17:49:36.756772] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-09-26T17:49:36.836957] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-26T17:49:36.841919] [INFO ] [REMOTE ] BY: Full fetch complete (29295 records). [2025-09-26T17:49:36.842069] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-09-26T17:49:37.283638] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-09-26T17:49:37.283753] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-09-26T17:49:37.284188] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-09-26T17:49:37.284232] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-09-26T17:49:37.285023] [DEBUG] [LOCAL ] BY: Trimmed 29295 records to 21895 (keeping 200 days of data) [2025-09-26T17:49:37.389273] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-26T17:49:37.440446] [DEBUG] [LOCAL ] BY: Primary data saved (21895 records). [2025-09-26T17:49:37.440588] [INFO ] [MAIN ] BY: Full history saved. [2025-09-26T17:49:37.440704] [INFO ] [MAIN ] Update Progress: 378/2371 symbols completed. BY took 34.5s. Estimated remaining: 4h 21m 22s. Rate: 7.6 symbols/min [2025-09-26T17:49:37.561808] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-09-26T17:49:37.622838] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:49:37.622993] [DEBUG] [LOCAL ] CAAP: No existing data file found in primary storage. [2025-09-26T17:49:37.623031] [WARN ] [MAIN ] CAAP: No existing data found, performing full refresh instead. [2025-09-26T17:49:37.623177] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-09-26T17:49:37.623221] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-09-26T17:49:37.623264] [DEBUG] [LOCAL ] CAAP: No primary data file found to delete. [2025-09-26T17:49:37.623297] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-09-26T17:49:38.002408] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:49:38.356732] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2024-12. [2025-09-26T17:49:38.763402] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-26T17:49:39.156185] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-26T17:49:39.158082] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-09-26T17:49:39.956757] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-09-26T17:49:40.239547] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-26T17:49:40.575259] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-26T17:49:40.756732] [INFO ] [REMOTE ] C: Fetching primary data for 2024-12. [2025-09-26T17:49:41.556748] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-09-26T17:49:42.356688] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-09-26T17:49:42.759569] [INFO ] [REMOTE ] C: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-26T17:49:42.808861] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-26T17:49:42.834806] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-26T17:49:43.156734] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-09-26T17:49:43.675575] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-26T17:49:43.956751] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-09-26T17:49:44.756752] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-09-26T17:49:45.496818] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-26T17:49:45.556740] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-09-26T17:49:45.802793] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-26T17:49:46.356746] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-09-26T17:49:46.571811] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-26T17:49:47.156739] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-09-26T17:49:47.956713] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-09-26T17:49:48.007750] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-26T17:49:48.010634] [INFO ] [REMOTE ] BYM: Full fetch complete (18008 records). [2025-09-26T17:49:48.010737] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-09-26T17:49:48.415234] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-09-26T17:49:48.415370] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-09-26T17:49:48.415908] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-09-26T17:49:48.416068] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-09-26T17:49:48.417323] [DEBUG] [LOCAL ] BYM: Trimmed 18008 records to 12225 (keeping 200 days of data) [2025-09-26T17:49:48.508780] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-26T17:49:48.543316] [DEBUG] [LOCAL ] BYM: Primary data saved (12225 records). [2025-09-26T17:49:48.543488] [INFO ] [MAIN ] BYM: Full history saved. [2025-09-26T17:49:48.543575] [INFO ] [MAIN ] Update Progress: 379/2371 symbols completed. BYM took 25.5s. Estimated remaining: 4h 21m 31s. Rate: 7.6 symbols/min [2025-09-26T17:49:48.728145] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:49:48.748333] [DEBUG] [LOCAL ] CABO: Loaded 17466 existing records from primary storage. [2025-09-26T17:49:48.748497] [INFO ] [MAIN ] CABO: Loaded 17466 existing records. [2025-09-26T17:49:48.761886] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-09-26T17:49:48.965497] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:49:48.966336] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-09-26T17:49:48.966425] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-09-26T17:49:48.966895] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-09-26T17:49:48.966964] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-09-26T17:49:49.315290] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-26T17:49:49.446380] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:49:49.559180] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-09-26T17:49:49.564449] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-26T17:49:50.356740] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-09-26T17:49:51.156772] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-09-26T17:49:51.409804] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-26T17:49:51.730893] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-26T17:49:51.956750] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-09-26T17:49:52.306032] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-26T17:49:52.312849] [INFO ] [REMOTE ] BZH: Full fetch complete (46994 records). [2025-09-26T17:49:52.313052] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-09-26T17:49:52.707799] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-09-26T17:49:52.707881] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-09-26T17:49:52.708422] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-09-26T17:49:52.708481] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-09-26T17:49:52.709549] [DEBUG] [LOCAL ] BZH: Trimmed 46994 records to 33088 (keeping 200 days of data) [2025-09-26T17:49:52.771327] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-09-26T17:49:52.932268] [DEBUG] [LOCAL ] BZH: Primary data saved (33088 records). [2025-09-26T17:49:52.932475] [INFO ] [MAIN ] BZH: Full history saved. [2025-09-26T17:49:52.935107] [INFO ] [MAIN ] Update Progress: 380/2371 symbols completed. BZH took 28.4s. Estimated remaining: 4h 21m 5s. Rate: 7.6 symbols/min [2025-09-26T17:49:53.115047] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:49:53.147403] [DEBUG] [LOCAL ] CACI: Loaded 25258 existing records from primary storage. [2025-09-26T17:49:53.147575] [INFO ] [MAIN ] CACI: Loaded 25258 existing records. [2025-09-26T17:49:53.334378] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:49:53.334702] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-09-26T17:49:53.334763] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-09-26T17:49:53.335551] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-09-26T17:49:53.335690] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-09-26T17:49:53.568123] [INFO ] [REMOTE ] CABO: Fetching primary data for 2024-12. [2025-09-26T17:49:53.740100] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:49:53.856938] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-26T17:49:53.922043] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-26T17:49:54.279230] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-26T17:49:54.356745] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-09-26T17:49:55.156694] [INFO ] [REMOTE ] CACI: Fetching primary data for 2024-12. [2025-09-26T17:49:55.246318] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-26T17:49:55.956734] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-09-26T17:49:56.093128] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-26T17:49:56.544806] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-26T17:49:56.756742] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-09-26T17:49:57.556725] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-09-26T17:49:57.759701] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-26T17:49:58.104056] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-26T17:49:58.356773] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-09-26T17:49:59.002833] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-26T17:49:59.156736] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-09-26T17:49:59.956773] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-09-26T17:50:00.231928] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-26T17:50:00.756717] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-09-26T17:50:01.556746] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-09-26T17:50:02.027394] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-26T17:50:02.356728] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-09-26T17:50:02.425784] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-26T17:50:02.523816] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-09-26T17:50:02.950144] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-26T17:50:03.156744] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-09-26T17:50:03.956723] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-09-26T17:50:04.318370] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-26T17:50:04.756750] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-09-26T17:50:05.556741] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-09-26T17:50:06.011295] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-26T17:50:06.067298] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-26T17:50:06.356729] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-09-26T17:50:06.430247] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-26T17:50:07.156733] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-09-26T17:50:07.877061] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-26T17:50:07.956743] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-09-26T17:50:08.756734] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-09-26T17:50:09.132075] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-26T17:50:09.556723] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-09-26T17:50:09.606042] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-26T17:50:10.356706] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-09-26T17:50:10.388783] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-26T17:50:10.597024] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-26T17:50:11.156728] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-09-26T17:50:11.695002] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-26T17:50:11.701118] [INFO ] [REMOTE ] CAAP: Full fetch complete (27852 records). [2025-09-26T17:50:11.701263] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-09-26T17:50:11.961816] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-09-26T17:50:12.146004] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-09-26T17:50:12.146177] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-09-26T17:50:12.146724] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-09-26T17:50:12.146810] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-09-26T17:50:12.148012] [DEBUG] [LOCAL ] CAAP: Trimmed 27852 records to 20021 (keeping 200 days of data) [2025-09-26T17:50:12.165696] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-26T17:50:12.287366] [DEBUG] [LOCAL ] CAAP: Primary data saved (20021 records). [2025-09-26T17:50:12.287494] [INFO ] [MAIN ] CAAP: Full history saved. [2025-09-26T17:50:12.287570] [INFO ] [MAIN ] Update Progress: 381/2371 symbols completed. CAAP took 34.8s. Estimated remaining: 4h 21m 57s. Rate: 7.6 symbols/min [2025-09-26T17:50:12.461903] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:50:12.509369] [DEBUG] [LOCAL ] CADE: Loaded 49165 existing records from primary storage. [2025-09-26T17:50:12.509548] [INFO ] [MAIN ] CADE: Loaded 49165 existing records. [2025-09-26T17:50:12.696290] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:50:12.696838] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-09-26T17:50:12.696946] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-09-26T17:50:12.704493] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-09-26T17:50:12.705397] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-26T17:50:12.705114] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-09-26T17:50:12.776752] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-09-26T17:50:12.776923] [INFO ] [REMOTE ] CABO: Full fetch complete (23043 records). [2025-09-26T17:50:12.782404] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-09-26T17:50:13.487746] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-09-26T17:50:13.493168] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-09-26T17:50:13.493104] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:50:13.493798] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-09-26T17:50:13.493862] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-09-26T17:50:13.494507] [DEBUG] [LOCAL ] CABO: Trimmed 23043 records to 17549 (keeping 200 days of data) [2025-09-26T17:50:13.571840] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-09-26T17:50:13.604892] [DEBUG] [LOCAL ] CABO: Primary data saved (17549 records). [2025-09-26T17:50:13.605027] [INFO ] [MAIN ] CABO: Full history saved. [2025-09-26T17:50:13.605114] [INFO ] [MAIN ] Update Progress: 382/2371 symbols completed. CABO took 25.1s. Estimated remaining: 4h 21m 15s. Rate: 7.6 symbols/min [2025-09-26T17:50:13.787083] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:50:13.823521] [DEBUG] [LOCAL ] CAE: Loaded 39345 existing records from primary storage. [2025-09-26T17:50:13.823691] [INFO ] [MAIN ] CAE: Loaded 39345 existing records. [2025-09-26T17:50:14.021679] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:50:14.021934] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-09-26T17:50:14.021985] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-09-26T17:50:14.022233] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-09-26T17:50:14.022292] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-09-26T17:50:14.369431] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-12. [2025-09-26T17:50:14.419815] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:50:14.652863] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-26T17:50:15.007522] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-26T17:50:15.156720] [INFO ] [REMOTE ] CAE: Fetching primary data for 2024-12. [2025-09-26T17:50:15.956694] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-09-26T17:50:16.130496] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-26T17:50:16.314129] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-26T17:50:16.716760] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-26T17:50:16.756787] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-09-26T17:50:17.556791] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-09-26T17:50:18.093480] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-26T17:50:18.356743] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-09-26T17:50:19.156731] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-09-26T17:50:19.671738] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-26T17:50:19.683058] [INFO ] [REMOTE ] C: Full fetch complete (77785 records). [2025-09-26T17:50:19.683221] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-09-26T17:50:19.972623] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-09-26T17:50:19.979281] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-26T17:50:20.164922] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-09-26T17:50:20.165037] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-09-26T17:50:20.165923] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-09-26T17:50:20.165995] [DEBUG] [LOCAL ] C: Saving primary data. [2025-09-26T17:50:20.167720] [DEBUG] [LOCAL ] C: Trimmed 77785 records to 54521 (keeping 200 days of data) [2025-09-26T17:50:20.432479] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-26T17:50:20.559509] [DEBUG] [LOCAL ] C: Primary data saved (54521 records). [2025-09-26T17:50:20.559691] [INFO ] [MAIN ] C: Full history saved. [2025-09-26T17:50:20.559846] [INFO ] [MAIN ] Update Progress: 383/2371 symbols completed. C took 45.9s. Estimated remaining: 4h 21m 3s. Rate: 7.6 symbols/min [2025-09-26T17:50:20.744928] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:50:20.751475] [DEBUG] [LOCAL ] CAF: Loaded 3458 existing records from primary storage. [2025-09-26T17:50:20.751599] [INFO ] [MAIN ] CAF: Loaded 3458 existing records. [2025-09-26T17:50:20.763229] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-09-26T17:50:20.952783] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:50:20.953111] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-09-26T17:50:20.953162] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-09-26T17:50:20.953416] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-09-26T17:50:20.953476] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-09-26T17:50:21.361925] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:50:21.375409] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-26T17:50:21.556750] [INFO ] [REMOTE ] CAF: Fetching primary data for 2024-12. [2025-09-26T17:50:21.573417] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-26T17:50:21.577778] [INFO ] [REMOTE ] CACI: Full fetch complete (39120 records). [2025-09-26T17:50:21.577895] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-09-26T17:50:21.975437] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-09-26T17:50:21.975536] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-09-26T17:50:21.976066] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-09-26T17:50:21.976133] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-09-26T17:50:21.977330] [DEBUG] [LOCAL ] CACI: Trimmed 39120 records to 25384 (keeping 200 days of data) [2025-09-26T17:50:22.143010] [DEBUG] [LOCAL ] CACI: Primary data saved (25384 records). [2025-09-26T17:50:22.143155] [INFO ] [MAIN ] CACI: Full history saved. [2025-09-26T17:50:22.143247] [INFO ] [MAIN ] Update Progress: 384/2371 symbols completed. CACI took 29.2s. Estimated remaining: 4h 20m 22s. Rate: 7.6 symbols/min [2025-09-26T17:50:22.329419] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:50:22.360338] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-09-26T17:50:22.367741] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-26T17:50:22.391150] [DEBUG] [LOCAL ] CAG: Loaded 54049 existing records from primary storage. [2025-09-26T17:50:22.391309] [INFO ] [MAIN ] CAG: Loaded 54049 existing records. [2025-09-26T17:50:22.584828] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:50:22.585129] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-09-26T17:50:22.585192] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-09-26T17:50:22.585503] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-09-26T17:50:22.585564] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-09-26T17:50:22.994198] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:50:23.156754] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-09-26T17:50:23.788497] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-26T17:50:23.819978] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-26T17:50:23.956778] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-09-26T17:50:24.756800] [INFO ] [REMOTE ] CAG: Fetching primary data for 2024-12. [2025-09-26T17:50:25.462971] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-26T17:50:25.556723] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-09-26T17:50:26.167679] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-26T17:50:26.285540] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-26T17:50:26.356766] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-09-26T17:50:27.156745] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-09-26T17:50:27.754619] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-26T17:50:27.925250] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-26T17:50:27.956778] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-09-26T17:50:28.632451] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-26T17:50:28.756752] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-09-26T17:50:29.556727] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-09-26T17:50:30.356733] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-09-26T17:50:30.513315] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-26T17:50:31.156784] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-09-26T17:50:31.275397] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-26T17:50:31.818801] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-26T17:50:31.818976] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-26T17:50:31.956774] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-09-26T17:50:32.756741] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-09-26T17:50:33.243983] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-26T17:50:33.556700] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-09-26T17:50:33.661196] [DEBUG] [REMOTE ] CADE: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-09-26T17:50:33.661531] [WARN ] [REMOTE ] CADE: No data returned for month 2025-03 [2025-09-26T17:50:33.708899] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-26T17:50:34.356771] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-09-26T17:50:35.156750] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-09-26T17:50:35.886807] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-26T17:50:35.956763] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-09-26T17:50:36.725587] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-26T17:50:36.756764] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-09-26T17:50:37.126515] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-26T17:50:37.556743] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-09-26T17:50:38.356713] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-09-26T17:50:38.408043] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-26T17:50:38.948994] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-26T17:50:39.156694] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-09-26T17:50:39.338364] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-26T17:50:39.491036] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-26T17:50:39.956777] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-09-26T17:50:40.610391] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-26T17:50:40.612128] [INFO ] [REMOTE ] CAF: Full fetch complete (5635 records). [2025-09-26T17:50:40.612233] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-09-26T17:50:40.767686] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-09-26T17:50:41.001938] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-09-26T17:50:41.002034] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-09-26T17:50:41.002207] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-09-26T17:50:41.002307] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-09-26T17:50:41.002997] [DEBUG] [LOCAL ] CAF: Trimmed 5635 records to 3471 (keeping 200 days of data) [2025-09-26T17:50:41.026590] [DEBUG] [LOCAL ] CAF: Primary data saved (3471 records). [2025-09-26T17:50:41.026761] [INFO ] [MAIN ] CAF: Full history saved. [2025-09-26T17:50:41.026945] [INFO ] [MAIN ] Update Progress: 385/2371 symbols completed. CAF took 20.5s. Estimated remaining: 4h 21m 11s. Rate: 7.6 symbols/min [2025-09-26T17:50:41.203269] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:50:41.286710] [DEBUG] [LOCAL ] CAH: Loaded 51826 existing records from primary storage. [2025-09-26T17:50:41.286914] [INFO ] [MAIN ] CAH: Loaded 51826 existing records. [2025-09-26T17:50:41.488398] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:50:41.488710] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-09-26T17:50:41.488780] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-09-26T17:50:41.489174] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-09-26T17:50:41.489247] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-09-26T17:50:41.561981] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-09-26T17:50:41.866353] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:50:42.356744] [INFO ] [REMOTE ] CAH: Fetching primary data for 2024-12. [2025-09-26T17:50:42.682149] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-26T17:50:42.826184] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-26T17:50:42.834183] [INFO ] [REMOTE ] CAE: Full fetch complete (55743 records). [2025-09-26T17:50:42.834351] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-09-26T17:50:43.161879] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-09-26T17:50:43.252844] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-09-26T17:50:43.252982] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-09-26T17:50:43.253697] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-09-26T17:50:43.253773] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-09-26T17:50:43.256108] [DEBUG] [LOCAL ] CAE: Trimmed 55743 records to 39622 (keeping 200 days of data) [2025-09-26T17:50:43.507556] [DEBUG] [LOCAL ] CAE: Primary data saved (39622 records). [2025-09-26T17:50:43.507768] [INFO ] [MAIN ] CAE: Full history saved. [2025-09-26T17:50:43.507896] [INFO ] [MAIN ] Update Progress: 386/2371 symbols completed. CAE took 29.9s. Estimated remaining: 4h 20m 35s. Rate: 7.6 symbols/min [2025-09-26T17:50:43.695502] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:50:43.746827] [DEBUG] [LOCAL ] CAL: Loaded 43552 existing records from primary storage. [2025-09-26T17:50:43.746984] [INFO ] [MAIN ] CAL: Loaded 43552 existing records. [2025-09-26T17:50:43.946351] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:50:43.946994] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-09-26T17:50:43.947183] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-09-26T17:50:43.947588] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-09-26T17:50:43.947700] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-09-26T17:50:43.961980] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-09-26T17:50:44.282469] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-26T17:50:44.420090] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:50:44.756732] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-09-26T17:50:45.133733] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-26T17:50:45.556717] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-09-26T17:50:45.871771] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-26T17:50:46.090637] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-26T17:50:46.356785] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-09-26T17:50:47.156773] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-09-26T17:50:47.726734] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-26T17:50:47.956719] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-09-26T17:50:48.005498] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-26T17:50:48.390900] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-26T17:50:48.756766] [INFO ] [REMOTE ] CAL: Fetching primary data for 2024-12. [2025-09-26T17:50:49.500941] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-26T17:50:49.556729] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-09-26T17:50:50.356738] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-09-26T17:50:50.505560] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-26T17:50:51.156774] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-09-26T17:50:51.455327] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-26T17:50:51.469330] [INFO ] [REMOTE ] CAG: Full fetch complete (77650 records). [2025-09-26T17:50:51.469762] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-09-26T17:50:51.932004] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-09-26T17:50:51.932142] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-09-26T17:50:51.932996] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-09-26T17:50:51.933092] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-09-26T17:50:51.948824] [DEBUG] [LOCAL ] CAG: Trimmed 77650 records to 54439 (keeping 200 days of data) [2025-09-26T17:50:51.966259] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-09-26T17:50:51.972994] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-26T17:50:52.337143] [DEBUG] [LOCAL ] CAG: Primary data saved (54439 records). [2025-09-26T17:50:52.337317] [INFO ] [MAIN ] CAG: Full history saved. [2025-09-26T17:50:52.338446] [INFO ] [MAIN ] Update Progress: 387/2371 symbols completed. CAG took 30.2s. Estimated remaining: 4h 20m 32s. Rate: 7.6 symbols/min [2025-09-26T17:50:52.570395] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:50:52.647350] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-26T17:50:52.645574] [DEBUG] [LOCAL ] CALX: Loaded 38755 existing records from primary storage. [2025-09-26T17:50:52.658670] [INFO ] [MAIN ] CALX: Loaded 38755 existing records. [2025-09-26T17:50:52.761846] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-09-26T17:50:52.870683] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:50:52.870992] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-09-26T17:50:52.871052] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-09-26T17:50:52.871343] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-09-26T17:50:52.871412] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-09-26T17:50:53.292484] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:50:53.316578] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-26T17:50:53.556721] [INFO ] [REMOTE ] CALX: Fetching primary data for 2024-12. [2025-09-26T17:50:54.242697] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-26T17:50:54.356737] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-09-26T17:50:54.607380] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-26T17:50:55.156780] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-09-26T17:50:55.453344] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-26T17:50:55.956771] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-09-26T17:50:56.756769] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-09-26T17:50:56.883183] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-26T17:50:57.119138] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-26T17:50:57.556802] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-09-26T17:50:57.691566] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-26T17:50:58.356807] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-09-26T17:50:58.771612] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-26T17:50:59.156826] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-09-26T17:50:59.401088] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-26T17:50:59.956796] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-09-26T17:51:00.756771] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-09-26T17:51:00.793132] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-26T17:51:01.567622] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-09-26T17:51:01.587574] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-26T17:51:01.601030] [INFO ] [REMOTE ] CADE: Full fetch complete (62799 records). [2025-09-26T17:51:01.601252] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-09-26T17:51:01.835543] [WARN ] [VALIDATOR ] CADE: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-26T17:51:01.836577] [FATAL] [MAIN ] CADE: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:51:01.836691] [WARN ] [MAIN ] CADE: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:51:01.836775] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-09-26T17:51:01.836929] [DEBUG] [LOCAL ] CADE: No primary data file found to delete. [2025-09-26T17:51:01.836994] [INFO ] [LOCAL ] CADE: Starting deletion of derivative data. [2025-09-26T17:51:01.837785] [DEBUG] [LOCAL ] CADE: Deleted derivative data file. [2025-09-26T17:51:01.838310] [INFO ] [MAIN ] Update Progress: 388/2371 symbols completed. CADE took 49.6s. Estimated remaining: 4h 20m 33s. Rate: 7.6 symbols/min [2025-09-26T17:51:02.048334] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:51:02.081472] [DEBUG] [LOCAL ] CANG: Loaded 26949 existing records from primary storage. [2025-09-26T17:51:02.081709] [INFO ] [MAIN ] CANG: Loaded 26949 existing records. [2025-09-26T17:51:02.285299] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:51:02.285757] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-09-26T17:51:02.285992] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-09-26T17:51:02.286344] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-09-26T17:51:02.286481] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-09-26T17:51:02.364901] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-09-26T17:51:02.741210] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-26T17:51:02.775892] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:51:02.809783] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-26T17:51:03.156735] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-09-26T17:51:03.942369] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-26T17:51:03.956919] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-09-26T17:51:04.713472] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-26T17:51:04.756686] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-09-26T17:51:05.160167] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-26T17:51:05.556764] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-09-26T17:51:06.161493] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-26T17:51:06.356742] [INFO ] [REMOTE ] CANG: Fetching primary data for 2024-12. [2025-09-26T17:51:06.678834] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-26T17:51:07.156769] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-09-26T17:51:07.691534] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-26T17:51:07.956750] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-09-26T17:51:08.650331] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-26T17:51:08.756722] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-09-26T17:51:08.911867] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-26T17:51:09.556729] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-09-26T17:51:10.011127] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-26T17:51:10.357189] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-09-26T17:51:10.359741] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-26T17:51:11.156746] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-09-26T17:51:11.823193] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-26T17:51:11.956757] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-09-26T17:51:12.411243] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-26T17:51:12.756830] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-09-26T17:51:13.544201] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-26T17:51:13.556685] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-09-26T17:51:13.609454] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-26T17:51:14.356797] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-09-26T17:51:15.156849] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-09-26T17:51:15.730996] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-26T17:51:15.740419] [INFO ] [REMOTE ] CAL: Full fetch complete (61813 records). [2025-09-26T17:51:15.740570] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-09-26T17:51:15.957214] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-09-26T17:51:16.184562] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-09-26T17:51:16.184878] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-09-26T17:51:16.185801] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-09-26T17:51:16.185920] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-09-26T17:51:16.207545] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-26T17:51:16.215507] [DEBUG] [LOCAL ] CAL: Trimmed 61813 records to 43833 (keeping 200 days of data) [2025-09-26T17:51:16.346035] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-26T17:51:16.360363] [INFO ] [REMOTE ] CAH: Full fetch complete (74596 records). [2025-09-26T17:51:16.362043] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-09-26T17:51:16.762209] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-09-26T17:51:16.851102] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-09-26T17:51:16.851835] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-09-26T17:51:16.852768] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-09-26T17:51:16.852942] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-09-26T17:51:16.858036] [DEBUG] [LOCAL ] CAH: Trimmed 74596 records to 52209 (keeping 200 days of data) [2025-09-26T17:51:17.194204] [DEBUG] [LOCAL ] CAL: Primary data saved (43833 records). [2025-09-26T17:51:17.197759] [INFO ] [MAIN ] CAL: Full history saved. [2025-09-26T17:51:17.198233] [INFO ] [MAIN ] Update Progress: 389/2371 symbols completed. CAL took 33.7s. Estimated remaining: 4h 21m 3s. Rate: 7.6 symbols/min [2025-09-26T17:51:17.530141] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:51:17.551331] [DEBUG] [LOCAL ] CAPL: Loaded 5904 existing records from primary storage. [2025-09-26T17:51:17.552436] [INFO ] [MAIN ] CAPL: Loaded 5904 existing records. [2025-09-26T17:51:17.986349] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:51:17.999686] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-26T17:51:18.000210] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-09-26T17:51:18.012919] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-09-26T17:51:18.013691] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-09-26T17:51:18.013758] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-09-26T17:51:18.034626] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-09-26T17:51:18.424389] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-26T17:51:18.516403] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-09-26T17:51:18.524257] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:51:18.531863] [DEBUG] [LOCAL ] CAH: Primary data saved (52209 records). [2025-09-26T17:51:18.531997] [INFO ] [MAIN ] CAH: Full history saved. [2025-09-26T17:51:18.532160] [INFO ] [MAIN ] Update Progress: 390/2371 symbols completed. CAH took 37.5s. Estimated remaining: 4h 20m 22s. Rate: 7.6 symbols/min [2025-09-26T17:51:18.728848] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:51:18.783452] [DEBUG] [LOCAL ] CARR: Loaded 53984 existing records from primary storage. [2025-09-26T17:51:18.783619] [INFO ] [MAIN ] CARR: Loaded 53984 existing records. [2025-09-26T17:51:18.985568] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:51:18.985867] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-09-26T17:51:18.985917] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-09-26T17:51:18.986150] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-09-26T17:51:18.986210] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-09-26T17:51:19.161090] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2024-12. [2025-09-26T17:51:19.403110] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:51:19.439815] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-26T17:51:19.775581] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-26T17:51:19.956782] [INFO ] [REMOTE ] CARR: Fetching primary data for 2024-12. [2025-09-26T17:51:20.143785] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-26T17:51:20.756769] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-09-26T17:51:21.556724] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-09-26T17:51:21.911102] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-26T17:51:21.972638] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-26T17:51:21.980069] [INFO ] [REMOTE ] CALX: Full fetch complete (54186 records). [2025-09-26T17:51:21.980186] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-09-26T17:51:22.133581] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-26T17:51:22.368408] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-09-26T17:51:22.428630] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-09-26T17:51:22.428864] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-09-26T17:51:22.429558] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-09-26T17:51:22.429609] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-09-26T17:51:22.431161] [DEBUG] [LOCAL ] CALX: Trimmed 54186 records to 38931 (keeping 200 days of data) [2025-09-26T17:51:22.675313] [DEBUG] [LOCAL ] CALX: Primary data saved (38931 records). [2025-09-26T17:51:22.675470] [INFO ] [MAIN ] CALX: Full history saved. [2025-09-26T17:51:22.676199] [INFO ] [MAIN ] Update Progress: 391/2371 symbols completed. CALX took 30.3s. Estimated remaining: 4h 19m 55s. Rate: 7.6 symbols/min [2025-09-26T17:51:22.861727] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:51:22.905974] [DEBUG] [LOCAL ] CARS: Loaded 40380 existing records from primary storage. [2025-09-26T17:51:22.906146] [INFO ] [MAIN ] CARS: Loaded 40380 existing records. [2025-09-26T17:51:23.110938] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:51:23.111243] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-09-26T17:51:23.111295] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-09-26T17:51:23.111583] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-09-26T17:51:23.111678] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-09-26T17:51:23.161870] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-09-26T17:51:23.568922] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:51:23.582786] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-26T17:51:23.632781] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-26T17:51:23.956747] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-09-26T17:51:24.756766] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-09-26T17:51:25.350970] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-26T17:51:25.556752] [INFO ] [REMOTE ] CARS: Fetching primary data for 2024-12. [2025-09-26T17:51:25.682390] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-26T17:51:26.356730] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-09-26T17:51:27.011154] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-26T17:51:27.156763] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-09-26T17:51:27.729947] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-26T17:51:27.956734] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-09-26T17:51:28.317689] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-26T17:51:28.324907] [INFO ] [REMOTE ] CANG: Full fetch complete (40674 records). [2025-09-26T17:51:28.325119] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-09-26T17:51:28.798221] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-09-26T17:51:28.762081] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-09-26T17:51:28.798436] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-09-26T17:51:28.800107] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-09-26T17:51:28.800188] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-09-26T17:51:28.801406] [DEBUG] [LOCAL ] CANG: Trimmed 40674 records to 27132 (keeping 200 days of data) [2025-09-26T17:51:28.936621] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-26T17:51:29.013353] [DEBUG] [LOCAL ] CANG: Primary data saved (27132 records). [2025-09-26T17:51:29.013522] [INFO ] [MAIN ] CANG: Full history saved. [2025-09-26T17:51:29.013637] [INFO ] [MAIN ] Update Progress: 392/2371 symbols completed. CANG took 27.2s. Estimated remaining: 4h 19m 39s. Rate: 7.6 symbols/min [2025-09-26T17:51:29.213429] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:51:29.281303] [DEBUG] [LOCAL ] CAT: Loaded 53313 existing records from primary storage. [2025-09-26T17:51:29.281879] [INFO ] [MAIN ] CAT: Loaded 53313 existing records. [2025-09-26T17:51:29.499939] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:51:29.500441] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-09-26T17:51:29.500554] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-09-26T17:51:29.500976] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-09-26T17:51:29.501048] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-09-26T17:51:29.563087] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-09-26T17:51:29.938718] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:51:30.300173] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T17:51:30.356722] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-09-26T17:51:30.474752] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-26T17:51:31.156745] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-09-26T17:51:31.956701] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-09-26T17:51:32.029409] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-26T17:51:32.339448] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-26T17:51:32.756760] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-09-26T17:51:33.436884] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-26T17:51:33.464628] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-26T17:51:33.556769] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-09-26T17:51:34.153429] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-26T17:51:34.356755] [INFO ] [REMOTE ] CAT: Fetching primary data for 2024-12. [2025-09-26T17:51:35.156774] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-09-26T17:51:35.758048] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-26T17:51:35.956745] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-09-26T17:51:36.230761] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-26T17:51:36.756742] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-09-26T17:51:37.556774] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-09-26T17:51:37.939242] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-26T17:51:38.288731] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-26T17:51:38.317833] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-26T17:51:38.356738] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-09-26T17:51:39.156783] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-09-26T17:51:39.750583] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-26T17:51:39.956749] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-09-26T17:51:40.756734] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-09-26T17:51:41.276374] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-26T17:51:41.556731] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-09-26T17:51:41.778453] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-26T17:51:41.782603] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-26T17:51:41.794676] [INFO ] [REMOTE ] CAPL: Full fetch complete (8944 records). [2025-09-26T17:51:41.795121] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-09-26T17:51:42.212693] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-09-26T17:51:42.212788] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-09-26T17:51:42.213032] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-09-26T17:51:42.213075] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-09-26T17:51:42.213526] [DEBUG] [LOCAL ] CAPL: Trimmed 8944 records to 5930 (keeping 200 days of data) [2025-09-26T17:51:42.253393] [DEBUG] [LOCAL ] CAPL: Primary data saved (5930 records). [2025-09-26T17:51:42.253544] [INFO ] [MAIN ] CAPL: Full history saved. [2025-09-26T17:51:42.253672] [INFO ] [MAIN ] Update Progress: 393/2371 symbols completed. CAPL took 25.1s. Estimated remaining: 4h 19m 58s. Rate: 7.6 symbols/min [2025-09-26T17:51:42.361987] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-09-26T17:51:42.445126] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:51:42.455282] [DEBUG] [LOCAL ] CATO: Loaded 7254 existing records from primary storage. [2025-09-26T17:51:42.455435] [INFO ] [MAIN ] CATO: Loaded 7254 existing records. [2025-09-26T17:51:42.658699] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:51:42.659261] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-09-26T17:51:42.659315] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-09-26T17:51:42.659549] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-09-26T17:51:42.659610] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-09-26T17:51:43.061212] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:51:43.090213] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-26T17:51:43.156784] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-09-26T17:51:43.956778] [INFO ] [REMOTE ] CATO: Fetching primary data for 2024-12. [2025-09-26T17:51:44.549898] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-26T17:51:44.589689] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-26T17:51:44.756767] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-09-26T17:51:44.784678] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-26T17:51:45.556739] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-09-26T17:51:45.988300] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-26T17:51:46.356775] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-09-26T17:51:46.713000] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-26T17:51:47.156732] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-09-26T17:51:47.484976] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-26T17:51:47.588753] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-26T17:51:47.956743] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-09-26T17:51:48.756734] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-09-26T17:51:49.556730] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-09-26T17:51:50.004605] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-26T17:51:50.046459] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-26T17:51:50.054268] [INFO ] [REMOTE ] CARS: Full fetch complete (55332 records). [2025-09-26T17:51:50.054444] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-09-26T17:51:50.364989] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-09-26T17:51:50.491763] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-09-26T17:51:50.491846] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-09-26T17:51:50.492513] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-09-26T17:51:50.492578] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-09-26T17:51:50.493850] [DEBUG] [LOCAL ] CARS: Trimmed 55332 records to 40616 (keeping 200 days of data) [2025-09-26T17:51:50.739025] [DEBUG] [LOCAL ] CARS: Primary data saved (40616 records). [2025-09-26T17:51:50.739160] [INFO ] [MAIN ] CARS: Full history saved. [2025-09-26T17:51:50.741285] [INFO ] [MAIN ] Update Progress: 394/2371 symbols completed. CARS took 28.1s. Estimated remaining: 4h 19m 54s. Rate: 7.6 symbols/min [2025-09-26T17:51:50.917786] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:51:50.973400] [DEBUG] [LOCAL ] CAVA: Loaded 53940 existing records from primary storage. [2025-09-26T17:51:50.973562] [INFO ] [MAIN ] CAVA: Loaded 53940 existing records. [2025-09-26T17:51:51.159254] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-09-26T17:51:51.163501] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:51:51.164838] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-09-26T17:51:51.164920] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-09-26T17:51:51.165261] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-09-26T17:51:51.165343] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-09-26T17:51:51.542907] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:51:51.580011] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-26T17:51:51.704408] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-26T17:51:51.772304] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-26T17:51:51.956725] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-09-26T17:51:52.736386] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-26T17:51:52.756738] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-09-26T17:51:53.556725] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-09-26T17:51:54.356768] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-09-26T17:51:54.712493] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-26T17:51:54.876428] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-26T17:51:55.156748] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2024-12. [2025-09-26T17:51:55.325875] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-26T17:51:55.337046] [INFO ] [REMOTE ] CARR: Full fetch complete (77602 records). [2025-09-26T17:51:55.337268] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-09-26T17:51:55.749332] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-09-26T17:51:55.749505] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-09-26T17:51:55.750387] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-09-26T17:51:55.750471] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-09-26T17:51:55.752278] [DEBUG] [LOCAL ] CARR: Trimmed 77602 records to 54374 (keeping 200 days of data) [2025-09-26T17:51:55.967089] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-09-26T17:51:56.093054] [DEBUG] [LOCAL ] CARR: Primary data saved (54374 records). [2025-09-26T17:51:56.093204] [INFO ] [MAIN ] CARR: Full history saved. [2025-09-26T17:51:56.093315] [INFO ] [MAIN ] Update Progress: 395/2371 symbols completed. CARR took 37.6s. Estimated remaining: 4h 19m 33s. Rate: 7.6 symbols/min [2025-09-26T17:51:56.313597] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:51:56.358616] [DEBUG] [LOCAL ] CB: Loaded 50444 existing records from primary storage. [2025-09-26T17:51:56.358789] [INFO ] [MAIN ] CB: Loaded 50444 existing records. [2025-09-26T17:51:56.503150] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-26T17:51:56.568705] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:51:56.569003] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-09-26T17:51:56.569062] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-09-26T17:51:56.569392] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-09-26T17:51:56.569476] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-09-26T17:51:56.762982] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-09-26T17:51:56.945540] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:51:57.096503] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-26T17:51:57.556740] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-09-26T17:51:58.318916] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-26T17:51:58.356685] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-09-26T17:51:59.123161] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T17:51:59.156674] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-09-26T17:51:59.956725] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-09-26T17:52:00.547944] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-26T17:52:00.711787] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-26T17:52:00.756725] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-09-26T17:52:00.977379] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-26T17:52:01.556736] [INFO ] [REMOTE ] CB: Fetching primary data for 2024-12. [2025-09-26T17:52:02.356745] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-09-26T17:52:02.798993] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-26T17:52:03.156702] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-09-26T17:52:03.189911] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-26T17:52:03.437596] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-26T17:52:03.956731] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-09-26T17:52:04.756725] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-09-26T17:52:04.946733] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-26T17:52:04.949289] [INFO ] [REMOTE ] CATO: Full fetch complete (11764 records). [2025-09-26T17:52:04.949466] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-09-26T17:52:05.350152] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-09-26T17:52:05.350288] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-09-26T17:52:05.350795] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-09-26T17:52:05.350901] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-09-26T17:52:05.351900] [DEBUG] [LOCAL ] CATO: Trimmed 11764 records to 7286 (keeping 200 days of data) [2025-09-26T17:52:05.413202] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-26T17:52:05.426683] [INFO ] [REMOTE ] CAT: Full fetch complete (76657 records). [2025-09-26T17:52:05.427479] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-09-26T17:52:05.558737] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-09-26T17:52:05.644373] [DEBUG] [LOCAL ] CATO: Primary data saved (7286 records). [2025-09-26T17:52:05.693079] [INFO ] [MAIN ] CATO: Full history saved. [2025-09-26T17:52:05.717785] [INFO ] [MAIN ] Update Progress: 396/2371 symbols completed. CATO took 23.5s. Estimated remaining: 4h 19m 34s. Rate: 7.6 symbols/min [2025-09-26T17:52:06.030931] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-09-26T17:52:06.031301] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-09-26T17:52:06.032602] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-09-26T17:52:06.033450] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-09-26T17:52:06.053611] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:52:06.054985] [DEBUG] [LOCAL ] CAT: Trimmed 76657 records to 53693 (keeping 200 days of data) [2025-09-26T17:52:06.168764] [DEBUG] [LOCAL ] CBAN: Loaded 11105 existing records from primary storage. [2025-09-26T17:52:06.174052] [INFO ] [MAIN ] CBAN: Loaded 11105 existing records. [2025-09-26T17:52:06.489778] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:52:06.492859] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-09-26T17:52:06.493301] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-09-26T17:52:06.496005] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-09-26T17:52:06.496154] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-09-26T17:52:06.975849] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:52:06.992325] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2024-12. [2025-09-26T17:52:07.001758] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-26T17:52:07.140202] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-26T17:52:07.156673] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-09-26T17:52:07.160572] [DEBUG] [LOCAL ] CAT: Primary data saved (53693 records). [2025-09-26T17:52:07.160689] [INFO ] [MAIN ] CAT: Full history saved. [2025-09-26T17:52:07.160832] [INFO ] [MAIN ] Update Progress: 397/2371 symbols completed. CAT took 38.1s. Estimated remaining: 4h 18m 54s. Rate: 7.6 symbols/min [2025-09-26T17:52:07.908231] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-26T17:52:07.956705] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-09-26T17:52:08.756727] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-09-26T17:52:08.857614] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-26T17:52:09.325336] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-26T17:52:09.556726] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-09-26T17:52:10.026958] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-26T17:52:10.356815] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-09-26T17:52:11.156793] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-09-26T17:52:11.456215] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-26T17:52:11.726611] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-26T17:52:11.956731] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-09-26T17:52:12.551580] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-26T17:52:12.756786] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-09-26T17:52:12.959052] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-26T17:52:13.556741] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-09-26T17:52:14.356762] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-09-26T17:52:14.526200] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-26T17:52:14.754794] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-26T17:52:15.156768] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-09-26T17:52:15.956734] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-09-26T17:52:16.450767] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-26T17:52:16.756704] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-09-26T17:52:16.790088] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-26T17:52:16.907843] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-26T17:52:17.556725] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-09-26T17:52:18.356717] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-09-26T17:52:18.692188] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-26T17:52:19.015678] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-26T17:52:19.156767] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-09-26T17:52:19.244334] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-26T17:52:19.956760] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-09-26T17:52:20.756710] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-09-26T17:52:21.178723] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-26T17:52:21.370165] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-26T17:52:21.469602] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-26T17:52:21.556728] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-09-26T17:52:22.356753] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-09-26T17:52:23.156710] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-09-26T17:52:23.190939] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-26T17:52:23.736323] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-26T17:52:23.956738] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-09-26T17:52:24.273197] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-26T17:52:24.283859] [INFO ] [REMOTE ] CAVA: Full fetch complete (77287 records). [2025-09-26T17:52:24.284062] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-09-26T17:52:24.694055] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-09-26T17:52:24.694147] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-09-26T17:52:24.694997] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-09-26T17:52:24.695105] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-09-26T17:52:24.696764] [DEBUG] [LOCAL ] CAVA: Trimmed 77287 records to 54330 (keeping 200 days of data) [2025-09-26T17:52:24.769819] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-09-26T17:52:25.053926] [DEBUG] [LOCAL ] CAVA: Primary data saved (54330 records). [2025-09-26T17:52:25.054121] [INFO ] [MAIN ] CAVA: Full history saved. [2025-09-26T17:52:25.055443] [INFO ] [MAIN ] Update Progress: 398/2371 symbols completed. CAVA took 34.3s. Estimated remaining: 4h 19m 36s. Rate: 7.6 symbols/min [2025-09-26T17:52:25.480970] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-26T17:52:25.483932] [INFO ] [REMOTE ] CBAN: Full fetch complete (16064 records). [2025-09-26T17:52:25.484049] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-09-26T17:52:25.904309] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-09-26T17:52:25.918571] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-09-26T17:52:25.928744] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-09-26T17:52:25.929372] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-09-26T17:52:25.930710] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-26T17:52:25.941064] [DEBUG] [LOCAL ] CBAN: Trimmed 16064 records to 11141 (keeping 200 days of data) [2025-09-26T17:52:25.941202] [INFO ] [REMOTE ] CB: Full fetch complete (72717 records). [2025-09-26T17:52:25.941359] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-09-26T17:52:26.442392] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-09-26T17:52:26.442869] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-09-26T17:52:26.444812] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-09-26T17:52:26.445180] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-09-26T17:52:26.451219] [DEBUG] [LOCAL ] CBAN: Primary data saved (11141 records). [2025-09-26T17:52:26.451670] [INFO ] [MAIN ] CBAN: Full history saved. [2025-09-26T17:52:26.451797] [INFO ] [MAIN ] Update Progress: 399/2371 symbols completed. CBAN took 20.7s. Estimated remaining: 4h 18m 56s. Rate: 7.6 symbols/min [2025-09-26T17:52:26.452061] [DEBUG] [LOCAL ] CB: Trimmed 72717 records to 50773 (keeping 200 days of data) [2025-09-26T17:52:26.789549] [DEBUG] [LOCAL ] CB: Primary data saved (50773 records). [2025-09-26T17:52:26.789730] [INFO ] [MAIN ] CB: Full history saved. [2025-09-26T17:52:26.789832] [INFO ] [MAIN ] Update Progress: 400/2371 symbols completed. CB took 30.7s. Estimated remaining: 4h 18m 11s. Rate: 7.6 symbols/min [2025-09-26T17:52:27.543076] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:52:27.494514] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:52:27.548183] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:52:27.548958] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-09-26T17:52:27.549765] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-09-26T17:52:27.549938] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-09-26T17:52:27.549986] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-26T17:52:27.550030] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-26T17:52:27.550075] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-09-26T17:52:27.592798] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:52:27.668148] [DEBUG] [LOCAL ] CBNA: Loaded 2908 existing records from primary storage. [2025-09-26T17:52:27.688518] [INFO ] [MAIN ] CBNA: Loaded 2908 existing records. [2025-09-26T17:52:28.022196] [DEBUG] [LOCAL ] CBL: Loaded 16777 existing records from primary storage. [2025-09-26T17:52:28.090313] [INFO ] [MAIN ] CBL: Loaded 16777 existing records. [2025-09-26T17:52:28.092209] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:52:28.157232] [DEBUG] [LOCAL ] CBRE: Loaded 51010 existing records from primary storage. [2025-09-26T17:52:28.177638] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-09-26T17:52:28.188991] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-09-26T17:52:28.183126] [INFO ] [MAIN ] CBRE: Loaded 51010 existing records. [2025-09-26T17:52:28.213156] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-09-26T17:52:28.228799] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-09-26T17:52:28.438365] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:52:28.472144] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-12. [2025-09-26T17:52:28.690911] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:52:28.738087] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-09-26T17:52:28.795165] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:52:28.794566] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-09-26T17:52:28.882717] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-09-26T17:52:28.865174] [WARN ] [REMOTE ] CBO: No data returned for month 2024-12 [2025-09-26T17:52:28.900450] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-09-26T17:52:28.932548] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-01. [2025-09-26T17:52:28.921988] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:52:29.030149] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-09-26T17:52:29.061821] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-09-26T17:52:29.101541] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-09-26T17:52:29.188344] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-09-26T17:52:29.178002] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:52:29.319905] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2024-12. [2025-09-26T17:52:29.411167] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:52:29.468940] [WARN ] [REMOTE ] CBO: No data returned for month 2025-01 [2025-09-26T17:52:29.483546] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-02. [2025-09-26T17:52:29.627796] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:52:29.638377] [INFO ] [REMOTE ] CBL: Fetching primary data for 2024-12. [2025-09-26T17:52:29.832208] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:52:29.867989] [WARN ] [REMOTE ] CBO: No data returned for month 2025-02 [2025-09-26T17:52:29.882955] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-03. [2025-09-26T17:52:29.882598] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:52:30.211326] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-26T17:52:30.211002] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-26T17:52:30.356736] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-09-26T17:52:30.661098] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-26T17:52:30.793726] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-26T17:52:31.156794] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2024-12. [2025-09-26T17:52:31.956743] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-09-26T17:52:32.305012] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-26T17:52:32.727546] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-26T17:52:32.756699] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-09-26T17:52:33.556722] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-09-26T17:52:33.854851] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-09-26T17:52:34.197798] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-26T17:52:34.356731] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-09-26T17:52:35.156701] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-04. [2025-09-26T17:52:35.363700] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-04 (0.21 seconds). [2025-09-26T17:52:35.408872] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-26T17:52:35.956771] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-05. [2025-09-26T17:52:36.582846] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-26T17:52:36.756767] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-06. [2025-09-26T17:52:37.012003] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-09-26T17:52:37.556720] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-09-26T17:52:38.356769] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-09-26T17:52:38.383183] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-26T17:52:39.004580] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-26T17:52:39.156735] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-09-26T17:52:39.956733] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-07. [2025-09-26T17:52:40.069691] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-26T17:52:40.712716] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-26T17:52:40.756765] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-09-26T17:52:41.556734] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-09-26T17:52:41.884420] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-26T17:52:42.356734] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-09-26T17:52:42.842765] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-26T17:52:43.120539] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-26T17:52:43.156690] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-08. [2025-09-26T17:52:43.408522] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:52:43.408869] [WARN ] [REMOTE ] CBO: No data returned for month 2025-08 [2025-09-26T17:52:43.956769] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-09-26T17:52:44.756875] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-09. [2025-09-26T17:52:45.063404] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:52:45.063762] [WARN ] [REMOTE ] CBO: No data returned for month 2025-09 [2025-09-26T17:52:45.063913] [INFO ] [REMOTE ] CBO: Full fetch complete (1016 records). [2025-09-26T17:52:45.064000] [DEBUG] [VALIDATOR ] CBO: Validating primary data. [2025-09-26T17:52:45.064637] [FATAL] [VALIDATOR ] CBO: Data is stale - most recent date (2025-07-10) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:52:45.064740] [FATAL] [MAIN ] CBO: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:52:45.064804] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:52:45.064872] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-26T17:52:45.064937] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-26T17:52:45.064976] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-09-26T17:52:45.065030] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-09-26T17:52:45.065112] [INFO ] [MAIN ] Update Progress: 401/2371 symbols completed. CBO took 18.3s. Estimated remaining: 4h 18m 54s. Rate: 7.6 symbols/min [2025-09-26T17:52:45.250181] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:52:45.284265] [DEBUG] [LOCAL ] CBT: Loaded 31329 existing records from primary storage. [2025-09-26T17:52:45.284430] [INFO ] [MAIN ] CBT: Loaded 31329 existing records. [2025-09-26T17:52:45.486965] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:52:45.487320] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-09-26T17:52:45.487373] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-09-26T17:52:45.487727] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-09-26T17:52:45.487789] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-09-26T17:52:45.561279] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-09-26T17:52:45.917990] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:52:45.951234] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-26T17:52:45.975049] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-26T17:52:46.356739] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-09-26T17:52:47.156693] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-09-26T17:52:47.307408] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-26T17:52:47.516296] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-26T17:52:47.956724] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-09-26T17:52:48.520025] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-26T17:52:48.756774] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-09-26T17:52:49.556704] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-09-26T17:52:49.865969] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-26T17:52:49.987616] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-26T17:52:49.988742] [INFO ] [REMOTE ] CBNA: Full fetch complete (4644 records). [2025-09-26T17:52:49.988815] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-09-26T17:52:50.362069] [INFO ] [REMOTE ] CBT: Fetching primary data for 2024-12. [2025-09-26T17:52:50.415124] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-09-26T17:52:50.415246] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-09-26T17:52:50.415586] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-09-26T17:52:50.415720] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-09-26T17:52:50.416940] [DEBUG] [LOCAL ] CBNA: Trimmed 4644 records to 2923 (keeping 200 days of data) [2025-09-26T17:52:50.438307] [DEBUG] [LOCAL ] CBNA: Primary data saved (2923 records). [2025-09-26T17:52:50.438396] [INFO ] [MAIN ] CBNA: Full history saved. [2025-09-26T17:52:50.438600] [INFO ] [MAIN ] Update Progress: 402/2371 symbols completed. CBNA took 23.6s. Estimated remaining: 4h 18m 34s. Rate: 7.6 symbols/min [2025-09-26T17:52:50.616065] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:52:50.653317] [DEBUG] [LOCAL ] CBU: Loaded 23004 existing records from primary storage. [2025-09-26T17:52:50.653516] [INFO ] [MAIN ] CBU: Loaded 23004 existing records. [2025-09-26T17:52:50.831933] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:52:50.832260] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-09-26T17:52:50.832313] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-09-26T17:52:50.833320] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-09-26T17:52:50.833394] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-09-26T17:52:51.162929] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-09-26T17:52:51.210792] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:52:51.890804] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-26T17:52:51.956757] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-09-26T17:52:52.316153] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-26T17:52:52.756739] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-09-26T17:52:53.556709] [INFO ] [REMOTE ] CBU: Fetching primary data for 2024-12. [2025-09-26T17:52:53.730502] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-26T17:52:53.778029] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-26T17:52:54.320271] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-26T17:52:54.356730] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-09-26T17:52:55.156752] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-09-26T17:52:55.709105] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-26T17:52:55.839504] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-26T17:52:55.956746] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-09-26T17:52:56.756735] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-09-26T17:52:56.916324] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-26T17:52:56.919799] [INFO ] [REMOTE ] CBL: Full fetch complete (25506 records). [2025-09-26T17:52:56.919887] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-09-26T17:52:57.319686] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-09-26T17:52:57.319797] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-09-26T17:52:57.320188] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-09-26T17:52:57.320230] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-09-26T17:52:57.321547] [DEBUG] [LOCAL ] CBL: Trimmed 25506 records to 16862 (keeping 200 days of data) [2025-09-26T17:52:57.434385] [DEBUG] [LOCAL ] CBL: Primary data saved (16862 records). [2025-09-26T17:52:57.434537] [INFO ] [MAIN ] CBL: Full history saved. [2025-09-26T17:52:57.434673] [INFO ] [MAIN ] Update Progress: 403/2371 symbols completed. CBL took 30.6s. Estimated remaining: 4h 18m 22s. Rate: 7.6 symbols/min [2025-09-26T17:52:57.561833] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-09-26T17:52:57.619769] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:52:57.619932] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-09-26T17:52:57.619988] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-09-26T17:52:57.620147] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-09-26T17:52:57.620193] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-26T17:52:57.620238] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-26T17:52:57.620273] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-09-26T17:52:58.073360] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:52:58.088847] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-26T17:52:58.356740] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-09-26T17:52:59.156691] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-12. [2025-09-26T17:52:59.228793] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-26T17:52:59.368702] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:52:59.370423] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-26T17:52:59.370861] [WARN ] [REMOTE ] CBX: No data returned for month 2024-12 [2025-09-26T17:52:59.956726] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-09-26T17:53:00.756713] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-09-26T17:53:00.960345] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-26T17:53:01.556744] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-09-26T17:53:02.356684] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-01. [2025-09-26T17:53:02.575865] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:53:02.590967] [WARN ] [REMOTE ] CBX: No data returned for month 2025-01 [2025-09-26T17:53:02.597138] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-26T17:53:02.761860] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-26T17:53:03.156788] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-02. [2025-09-26T17:53:03.399847] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:53:03.400335] [WARN ] [REMOTE ] CBX: No data returned for month 2025-02 [2025-09-26T17:53:03.956730] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-09-26T17:53:04.756732] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-09-26T17:53:05.567727] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-03. [2025-09-26T17:53:05.574374] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-26T17:53:05.735360] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-26T17:53:05.794023] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:53:05.794379] [WARN ] [REMOTE ] CBX: No data returned for month 2025-03 [2025-09-26T17:53:06.356769] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-09-26T17:53:07.156762] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-04. [2025-09-26T17:53:07.411417] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:53:07.411769] [WARN ] [REMOTE ] CBX: No data returned for month 2025-04 [2025-09-26T17:53:07.913489] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-26T17:53:07.956757] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-09-26T17:53:08.756803] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-05. [2025-09-26T17:53:08.993718] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-26T17:53:09.445396] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-26T17:53:09.556712] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-09-26T17:53:10.356762] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-09-26T17:53:10.908316] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-26T17:53:11.156756] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-09-26T17:53:11.775017] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-26T17:53:11.956772] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-09-26T17:53:12.028403] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-26T17:53:12.756792] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-09-26T17:53:12.960007] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-26T17:53:13.556733] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-06. [2025-09-26T17:53:13.809428] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-09-26T17:53:14.086698] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-26T17:53:14.356779] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-09-26T17:53:15.156726] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-09-26T17:53:15.721052] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-26T17:53:15.727860] [INFO ] [REMOTE ] CBT: Full fetch complete (45886 records). [2025-09-26T17:53:15.728033] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-09-26T17:53:15.967362] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-07. [2025-09-26T17:53:16.140227] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-09-26T17:53:16.140321] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-09-26T17:53:16.140937] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-09-26T17:53:16.141003] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-09-26T17:53:16.142591] [DEBUG] [LOCAL ] CBT: Trimmed 45886 records to 31567 (keeping 200 days of data) [2025-09-26T17:53:16.250885] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-26T17:53:16.357552] [DEBUG] [LOCAL ] CBT: Primary data saved (31567 records). [2025-09-26T17:53:16.357731] [INFO ] [MAIN ] CBT: Full history saved. [2025-09-26T17:53:16.357835] [INFO ] [MAIN ] Update Progress: 404/2371 symbols completed. CBT took 31.3s. Estimated remaining: 4h 19m 8s. Rate: 7.6 symbols/min [2025-09-26T17:53:16.543804] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:53:16.581216] [DEBUG] [LOCAL ] CBZ: Loaded 33818 existing records from primary storage. [2025-09-26T17:53:16.581410] [INFO ] [MAIN ] CBZ: Loaded 33818 existing records. [2025-09-26T17:53:16.769687] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-09-26T17:53:16.786113] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:53:16.786704] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-09-26T17:53:16.786870] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-09-26T17:53:16.810439] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-09-26T17:53:16.813350] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-09-26T17:53:16.822729] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-26T17:53:16.933364] [INFO ] [REMOTE ] CBRE: Full fetch complete (73955 records). [2025-09-26T17:53:16.936587] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-09-26T17:53:17.593748] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:53:17.586317] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-08. [2025-09-26T17:53:17.700229] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-09-26T17:53:17.700432] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-09-26T17:53:17.701262] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-09-26T17:53:17.701328] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-09-26T17:53:17.702907] [DEBUG] [LOCAL ] CBRE: Trimmed 73955 records to 51366 (keeping 200 days of data) [2025-09-26T17:53:17.892804] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:53:17.902500] [WARN ] [REMOTE ] CBX: No data returned for month 2025-08 [2025-09-26T17:53:17.950582] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-26T17:53:18.050689] [DEBUG] [LOCAL ] CBRE: Primary data saved (51366 records). [2025-09-26T17:53:18.050851] [INFO ] [MAIN ] CBRE: Full history saved. [2025-09-26T17:53:18.050961] [INFO ] [MAIN ] Update Progress: 405/2371 symbols completed. CBRE took 51.3s. Estimated remaining: 4h 18m 29s. Rate: 7.6 symbols/min [2025-09-26T17:53:18.235778] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:53:18.293812] [DEBUG] [LOCAL ] CC: Loaded 53416 existing records from primary storage. [2025-09-26T17:53:18.293983] [INFO ] [MAIN ] CC: Loaded 53416 existing records. [2025-09-26T17:53:18.361836] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-09-26T17:53:18.490957] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:53:18.491211] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-09-26T17:53:18.491261] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-09-26T17:53:18.492598] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-09-26T17:53:18.492685] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-09-26T17:53:18.883268] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:53:19.156754] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2024-12. [2025-09-26T17:53:19.631937] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-26T17:53:19.956758] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-09-26T17:53:20.151870] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-26T17:53:20.756743] [INFO ] [REMOTE ] CC: Fetching primary data for 2024-12. [2025-09-26T17:53:20.888627] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-26T17:53:21.556722] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-09. [2025-09-26T17:53:21.875801] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:53:21.876132] [WARN ] [REMOTE ] CBX: No data returned for month 2025-09 [2025-09-26T17:53:21.876254] [INFO ] [REMOTE ] CBX: Full fetch complete (1040 records). [2025-09-26T17:53:21.876327] [DEBUG] [VALIDATOR ] CBX: Validating primary data. [2025-09-26T17:53:21.876964] [FATAL] [VALIDATOR ] CBX: Data is stale - most recent date (2025-07-02) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:53:21.877044] [FATAL] [MAIN ] CBX: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:53:21.877136] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:53:21.877208] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-26T17:53:21.877274] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-26T17:53:21.877343] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-09-26T17:53:21.877435] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-09-26T17:53:21.877502] [INFO ] [MAIN ] Update Progress: 406/2371 symbols completed. CBX took 24.4s. Estimated remaining: 4h 18m 2s. Rate: 7.6 symbols/min [2025-09-26T17:53:22.062136] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:53:22.132911] [DEBUG] [LOCAL ] CCI: Loaded 53536 existing records from primary storage. [2025-09-26T17:53:22.133159] [INFO ] [MAIN ] CCI: Loaded 53536 existing records. [2025-09-26T17:53:22.334182] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:53:22.334490] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-09-26T17:53:22.334570] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-09-26T17:53:22.345637] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-09-26T17:53:22.358993] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-09-26T17:53:22.361954] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-09-26T17:53:22.402892] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-26T17:53:22.769841] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:53:23.156765] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-09-26T17:53:23.530017] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-26T17:53:23.535546] [INFO ] [REMOTE ] CBU: Full fetch complete (32232 records). [2025-09-26T17:53:23.535691] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-09-26T17:53:23.953888] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-09-26T17:53:23.953981] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-09-26T17:53:23.954633] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-09-26T17:53:23.954720] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-09-26T17:53:23.955691] [DEBUG] [LOCAL ] CBU: Trimmed 32232 records to 23130 (keeping 200 days of data) [2025-09-26T17:53:23.956759] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-09-26T17:53:24.111431] [DEBUG] [LOCAL ] CBU: Primary data saved (23130 records). [2025-09-26T17:53:24.111587] [INFO ] [MAIN ] CBU: Full history saved. [2025-09-26T17:53:24.111710] [INFO ] [MAIN ] Update Progress: 407/2371 symbols completed. CBU took 33.7s. Estimated remaining: 4h 17m 27s. Rate: 7.6 symbols/min [2025-09-26T17:53:24.302713] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:53:24.303149] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-09-26T17:53:24.303292] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-09-26T17:53:24.303607] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-09-26T17:53:24.303712] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-26T17:53:24.303835] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-26T17:53:24.304085] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-09-26T17:53:24.662637] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-26T17:53:24.768691] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-09-26T17:53:24.775457] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:53:24.791117] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-26T17:53:25.556731] [INFO ] [REMOTE ] CCI: Fetching primary data for 2024-12. [2025-09-26T17:53:26.265453] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-26T17:53:26.356733] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-09-26T17:53:27.049920] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-26T17:53:27.156772] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-12. [2025-09-26T17:53:27.521037] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-26T17:53:27.694027] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-26T17:53:27.956758] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-09-26T17:53:28.756733] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-09-26T17:53:29.011737] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-26T17:53:29.253636] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-26T17:53:29.556734] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-09-26T17:53:30.356738] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-09-26T17:53:31.156774] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-09-26T17:53:31.430560] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-26T17:53:31.444295] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-26T17:53:31.956711] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-09-26T17:53:32.220388] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-09-26T17:53:32.316817] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-26T17:53:32.756744] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-09-26T17:53:33.556738] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-09-26T17:53:34.356738] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-09-26T17:53:34.410816] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-26T17:53:34.497540] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-26T17:53:35.156779] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-09-26T17:53:35.869549] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-26T17:53:35.956682] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-09-26T17:53:36.595334] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-26T17:53:36.756742] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-09-26T17:53:37.306010] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-26T17:53:37.556792] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-09-26T17:53:38.321416] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-26T17:53:38.356684] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-09-26T17:53:38.986476] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-26T17:53:39.156739] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-09-26T17:53:39.619128] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-26T17:53:39.649456] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-26T17:53:39.956750] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-09-26T17:53:40.295552] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-26T17:53:40.756754] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-09-26T17:53:41.556767] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-09-26T17:53:42.272158] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T17:53:42.356752] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-09-26T17:53:43.161847] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-09-26T17:53:43.180431] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-26T17:53:43.468750] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-26T17:53:43.579697] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-26T17:53:43.956753] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-09-26T17:53:44.330091] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-26T17:53:44.756730] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-09-26T17:53:45.556732] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-09-26T17:53:45.839357] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-26T17:53:46.356755] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-09-26T17:53:46.540229] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-26T17:53:46.922006] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-26T17:53:46.923007] [INFO ] [REMOTE ] CCIA: Full fetch complete (2044 records). [2025-09-26T17:53:46.923082] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-09-26T17:53:47.133954] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-26T17:53:47.134211] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:53:47.134288] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:53:47.134364] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-26T17:53:47.134432] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-26T17:53:47.134472] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-09-26T17:53:47.134530] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-09-26T17:53:47.134627] [INFO ] [MAIN ] Update Progress: 408/2371 symbols completed. CCIA took 23.0s. Estimated remaining: 4h 18m 32s. Rate: 7.6 symbols/min [2025-09-26T17:53:47.165298] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-09-26T17:53:47.323802] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:53:47.340686] [DEBUG] [LOCAL ] CCIF: Loaded 15490 existing records from primary storage. [2025-09-26T17:53:47.340826] [INFO ] [MAIN ] CCIF: Loaded 15490 existing records. [2025-09-26T17:53:47.527761] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:53:47.528038] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-09-26T17:53:47.528092] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-09-26T17:53:47.528724] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-09-26T17:53:47.528785] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-09-26T17:53:47.927057] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:53:47.956717] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2024-12. [2025-09-26T17:53:48.756793] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-09-26T17:53:48.855396] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-26T17:53:49.055176] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-26T17:53:49.556758] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-09-26T17:53:49.771226] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-26T17:53:50.069000] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-26T17:53:50.356759] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-09-26T17:53:51.156819] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-09-26T17:53:51.771064] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-26T17:53:51.810882] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-26T17:53:51.956730] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-09-26T17:53:52.475468] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-26T17:53:52.756757] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-09-26T17:53:53.556738] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-09-26T17:53:54.356782] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-09-26T17:53:54.532333] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-26T17:53:54.578463] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-26T17:53:54.590751] [INFO ] [REMOTE ] CCI: Full fetch complete (76999 records). [2025-09-26T17:53:54.590981] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-09-26T17:53:55.014725] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-09-26T17:53:55.014843] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-09-26T17:53:55.015889] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-09-26T17:53:55.015958] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-09-26T17:53:55.019357] [DEBUG] [LOCAL ] CCI: Trimmed 76999 records to 53922 (keeping 200 days of data) [2025-09-26T17:53:55.156787] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-09-26T17:53:55.378506] [DEBUG] [LOCAL ] CCI: Primary data saved (53922 records). [2025-09-26T17:53:55.378689] [INFO ] [MAIN ] CCI: Full history saved. [2025-09-26T17:53:55.378792] [INFO ] [MAIN ] Update Progress: 409/2371 symbols completed. CCI took 33.5s. Estimated remaining: 4h 18m 26s. Rate: 7.6 symbols/min [2025-09-26T17:53:55.550732] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:53:55.603836] [DEBUG] [LOCAL ] CCJ: Loaded 54065 existing records from primary storage. [2025-09-26T17:53:55.604001] [INFO ] [MAIN ] CCJ: Loaded 54065 existing records. [2025-09-26T17:53:55.803381] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:53:55.803750] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-09-26T17:53:55.803810] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-09-26T17:53:55.805611] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-09-26T17:53:55.805708] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-09-26T17:53:55.961976] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-09-26T17:53:56.210959] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:53:56.329677] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-26T17:53:56.407213] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-26T17:53:56.418112] [INFO ] [REMOTE ] CC: Full fetch complete (75565 records). [2025-09-26T17:53:56.418287] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-09-26T17:53:56.758683] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-09-26T17:53:56.854638] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-26T17:53:56.855062] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-09-26T17:53:56.859313] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-09-26T17:53:56.861224] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-09-26T17:53:56.861335] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-09-26T17:53:56.864439] [DEBUG] [LOCAL ] CC: Trimmed 75565 records to 53801 (keeping 200 days of data) [2025-09-26T17:53:57.212146] [DEBUG] [LOCAL ] CC: Primary data saved (53801 records). [2025-09-26T17:53:57.212341] [INFO ] [MAIN ] CC: Full history saved. [2025-09-26T17:53:57.212459] [INFO ] [MAIN ] Update Progress: 410/2371 symbols completed. CC took 39.2s. Estimated remaining: 4h 17m 49s. Rate: 7.6 symbols/min [2025-09-26T17:53:57.407730] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:53:57.460745] [DEBUG] [LOCAL ] CCK: Loaded 46723 existing records from primary storage. [2025-09-26T17:53:57.460933] [INFO ] [MAIN ] CCK: Loaded 46723 existing records. [2025-09-26T17:53:57.561798] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-09-26T17:53:57.652321] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:53:57.652582] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-09-26T17:53:57.652630] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-09-26T17:53:57.653990] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-09-26T17:53:57.654050] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-09-26T17:53:58.036683] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:53:58.159066] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-26T17:53:58.356774] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-09-26T17:53:58.531193] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-26T17:53:59.156779] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-09-26T17:53:59.479099] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-26T17:53:59.487596] [INFO ] [REMOTE ] CBZ: Full fetch complete (45094 records). [2025-09-26T17:53:59.487780] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-09-26T17:53:59.896905] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-09-26T17:53:59.897221] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-09-26T17:53:59.898080] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-09-26T17:53:59.903352] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-09-26T17:53:59.910133] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-26T17:53:59.915609] [DEBUG] [LOCAL ] CBZ: Trimmed 45094 records to 34130 (keeping 200 days of data) [2025-09-26T17:53:59.967403] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-09-26T17:54:00.131449] [DEBUG] [LOCAL ] CBZ: Primary data saved (34130 records). [2025-09-26T17:54:00.131737] [INFO ] [MAIN ] CBZ: Full history saved. [2025-09-26T17:54:00.131873] [INFO ] [MAIN ] Update Progress: 411/2371 symbols completed. CBZ took 43.8s. Estimated remaining: 4h 17m 17s. Rate: 7.6 symbols/min [2025-09-26T17:54:00.318420] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:54:00.378443] [DEBUG] [LOCAL ] CCL: Loaded 54190 existing records from primary storage. [2025-09-26T17:54:00.378694] [INFO ] [MAIN ] CCL: Loaded 54190 existing records. [2025-09-26T17:54:00.569078] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:54:00.569470] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-09-26T17:54:00.569536] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-09-26T17:54:00.571065] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-09-26T17:54:00.571131] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-09-26T17:54:00.757053] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2024-12. [2025-09-26T17:54:00.898685] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-26T17:54:00.987044] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:54:01.556755] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-09-26T17:54:02.356713] [INFO ] [REMOTE ] CCL: Fetching primary data for 2024-12. [2025-09-26T17:54:02.802378] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-26T17:54:02.825939] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-26T17:54:02.829995] [INFO ] [REMOTE ] CCIF: Full fetch complete (21675 records). [2025-09-26T17:54:02.830078] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-09-26T17:54:03.161866] [INFO ] [REMOTE ] CCK: Fetching primary data for 2024-12. [2025-09-26T17:54:03.236230] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-09-26T17:54:03.236339] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-09-26T17:54:03.236817] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-09-26T17:54:03.236893] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-09-26T17:54:03.237710] [DEBUG] [LOCAL ] CCIF: Trimmed 21675 records to 15698 (keeping 200 days of data) [2025-09-26T17:54:03.329533] [DEBUG] [LOCAL ] CCIF: Primary data saved (15698 records). [2025-09-26T17:54:03.329731] [INFO ] [MAIN ] CCIF: Full history saved. [2025-09-26T17:54:03.329839] [INFO ] [MAIN ] Update Progress: 412/2371 symbols completed. CCIF took 16.2s. Estimated remaining: 4h 16m 47s. Rate: 7.6 symbols/min [2025-09-26T17:54:03.569185] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:54:03.622205] [DEBUG] [LOCAL ] CCO: Loaded 48012 existing records from primary storage. [2025-09-26T17:54:03.622365] [INFO ] [MAIN ] CCO: Loaded 48012 existing records. [2025-09-26T17:54:03.815684] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:54:03.816022] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-09-26T17:54:03.816114] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-09-26T17:54:03.817232] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-09-26T17:54:03.817294] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-09-26T17:54:03.961835] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-09-26T17:54:04.186665] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:54:04.765765] [INFO ] [REMOTE ] CCO: Fetching primary data for 2024-12. [2025-09-26T17:54:04.776031] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-09-26T17:54:05.027318] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-26T17:54:05.556802] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-09-26T17:54:06.066360] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-26T17:54:06.108110] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-26T17:54:06.356793] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-09-26T17:54:07.156748] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-09-26T17:54:07.679104] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-26T17:54:07.956778] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-09-26T17:54:08.239365] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-26T17:54:08.312577] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-26T17:54:08.756786] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-09-26T17:54:09.556791] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-09-26T17:54:10.050125] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-26T17:54:10.122742] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-26T17:54:10.356780] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-09-26T17:54:11.156751] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-09-26T17:54:11.196885] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-26T17:54:11.956833] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-09-26T17:54:12.374947] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-26T17:54:12.499110] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-26T17:54:12.756755] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-09-26T17:54:13.204398] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-26T17:54:13.556761] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-09-26T17:54:14.346441] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-26T17:54:14.356946] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-09-26T17:54:15.156762] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-09-26T17:54:15.367200] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-26T17:54:15.956719] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-09-26T17:54:16.083844] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-26T17:54:16.536571] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-26T17:54:16.756804] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-09-26T17:54:17.229192] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-26T17:54:17.556743] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-09-26T17:54:18.145460] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-26T17:54:18.356747] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-09-26T17:54:18.937833] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-26T17:54:19.156756] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-09-26T17:54:19.589709] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-26T17:54:19.956762] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-09-26T17:54:20.756762] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-09-26T17:54:21.556744] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-09-26T17:54:21.601033] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-26T17:54:21.670311] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-26T17:54:22.033829] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-26T17:54:22.356760] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-09-26T17:54:23.156771] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-09-26T17:54:23.336110] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-26T17:54:23.566694] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-26T17:54:23.956781] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-09-26T17:54:24.756784] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-09-26T17:54:25.353307] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-26T17:54:25.556795] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-09-26T17:54:25.651673] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-26T17:54:26.025363] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-26T17:54:26.035333] [INFO ] [REMOTE ] CCO: Full fetch complete (66325 records). [2025-09-26T17:54:26.035514] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-09-26T17:54:26.361726] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-09-26T17:54:26.462259] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-09-26T17:54:26.462379] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-09-26T17:54:26.463219] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-09-26T17:54:26.463292] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-09-26T17:54:26.464871] [DEBUG] [LOCAL ] CCO: Trimmed 66325 records to 48387 (keeping 200 days of data) [2025-09-26T17:54:26.763475] [DEBUG] [LOCAL ] CCO: Primary data saved (48387 records). [2025-09-26T17:54:26.763639] [INFO ] [MAIN ] CCO: Full history saved. [2025-09-26T17:54:26.765430] [INFO ] [MAIN ] Update Progress: 413/2371 symbols completed. CCO took 23.4s. Estimated remaining: 4h 17m 53s. Rate: 7.6 symbols/min [2025-09-26T17:54:26.948399] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:54:26.964321] [DEBUG] [LOCAL ] CCRD: Loaded 9067 existing records from primary storage. [2025-09-26T17:54:26.964475] [INFO ] [MAIN ] CCRD: Loaded 9067 existing records. [2025-09-26T17:54:27.158544] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-09-26T17:54:27.162732] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:54:27.164162] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-09-26T17:54:27.164232] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-09-26T17:54:27.164730] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-09-26T17:54:27.164795] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-09-26T17:54:27.570104] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:54:27.913980] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-26T17:54:27.956715] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-09-26T17:54:28.152145] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-26T17:54:28.756736] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-09-26T17:54:29.556697] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-12. [2025-09-26T17:54:29.603262] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-09-26T17:54:30.277910] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-26T17:54:30.346247] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-26T17:54:30.361883] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-09-26T17:54:30.384850] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-09-26T17:54:31.109412] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-26T17:54:31.156754] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-09-26T17:54:31.956791] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-09-26T17:54:32.756768] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-09-26T17:54:32.887197] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-26T17:54:32.896891] [INFO ] [REMOTE ] CCK: Full fetch complete (67739 records). [2025-09-26T17:54:32.897124] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-09-26T17:54:33.300062] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-09-26T17:54:33.300161] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-09-26T17:54:33.300923] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-09-26T17:54:33.300989] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-09-26T17:54:33.302448] [DEBUG] [LOCAL ] CCK: Trimmed 67739 records to 47083 (keeping 200 days of data) [2025-09-26T17:54:33.556986] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-09-26T17:54:33.613355] [DEBUG] [LOCAL ] CCK: Primary data saved (47083 records). [2025-09-26T17:54:33.613541] [INFO ] [MAIN ] CCK: Full history saved. [2025-09-26T17:54:33.613712] [INFO ] [MAIN ] Update Progress: 414/2371 symbols completed. CCK took 36.4s. Estimated remaining: 4h 17m 40s. Rate: 7.6 symbols/min [2025-09-26T17:54:33.797790] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:54:33.830410] [DEBUG] [LOCAL ] CCS: Loaded 30944 existing records from primary storage. [2025-09-26T17:54:33.830577] [INFO ] [MAIN ] CCS: Loaded 30944 existing records. [2025-09-26T17:54:34.032689] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-26T17:54:34.032908] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:54:34.035965] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-09-26T17:54:34.036487] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-09-26T17:54:34.037701] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-09-26T17:54:34.037766] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-09-26T17:54:34.360952] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-09-26T17:54:34.443918] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:54:34.487135] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-09-26T17:54:34.831541] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-26T17:54:34.879880] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-26T17:54:35.156788] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-09-26T17:54:35.956786] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-09-26T17:54:36.756740] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-09-26T17:54:37.329549] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-26T17:54:37.341066] [INFO ] [REMOTE ] CCJ: Full fetch complete (77683 records). [2025-09-26T17:54:37.341248] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-09-26T17:54:37.483819] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-26T17:54:37.562119] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-09-26T17:54:37.817443] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-09-26T17:54:37.817539] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-09-26T17:54:37.818428] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-09-26T17:54:37.818501] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-09-26T17:54:37.820104] [DEBUG] [LOCAL ] CCJ: Trimmed 77683 records to 54453 (keeping 200 days of data) [2025-09-26T17:54:38.145614] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-26T17:54:38.165431] [DEBUG] [LOCAL ] CCJ: Primary data saved (54453 records). [2025-09-26T17:54:38.165592] [INFO ] [MAIN ] CCJ: Full history saved. [2025-09-26T17:54:38.165711] [INFO ] [MAIN ] Update Progress: 415/2371 symbols completed. CCJ took 42.8s. Estimated remaining: 4h 17m 16s. Rate: 7.6 symbols/min [2025-09-26T17:54:38.348209] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:54:38.360974] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-09-26T17:54:38.372749] [DEBUG] [LOCAL ] CCU: Loaded 23712 existing records from primary storage. [2025-09-26T17:54:38.372898] [INFO ] [MAIN ] CCU: Loaded 23712 existing records. [2025-09-26T17:54:38.567582] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:54:38.568347] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-09-26T17:54:38.568461] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-09-26T17:54:38.599422] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-09-26T17:54:38.599608] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-09-26T17:54:38.665593] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.71 seconds). [2025-09-26T17:54:38.729871] [INFO ] [REMOTE ] CCL: Full fetch complete (77920 records). [2025-09-26T17:54:38.730073] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-09-26T17:54:39.162263] [INFO ] [REMOTE ] CCS: Fetching primary data for 2024-12. [2025-09-26T17:54:39.336831] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:54:39.380414] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-26T17:54:39.483793] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-09-26T17:54:39.483875] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-09-26T17:54:39.484747] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-09-26T17:54:39.484814] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-09-26T17:54:39.486346] [DEBUG] [LOCAL ] CCL: Trimmed 77920 records to 54580 (keeping 200 days of data) [2025-09-26T17:54:39.828158] [DEBUG] [LOCAL ] CCL: Primary data saved (54580 records). [2025-09-26T17:54:39.828327] [INFO ] [MAIN ] CCL: Full history saved. [2025-09-26T17:54:39.828452] [INFO ] [MAIN ] Update Progress: 416/2371 symbols completed. CCL took 39.7s. Estimated remaining: 4h 16m 39s. Rate: 7.6 symbols/min [2025-09-26T17:54:39.961873] [INFO ] [REMOTE ] CCU: Fetching primary data for 2024-12. [2025-09-26T17:54:40.009519] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:54:40.009756] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-09-26T17:54:40.009860] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-09-26T17:54:40.009988] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-09-26T17:54:40.010031] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-26T17:54:40.010073] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-26T17:54:40.010110] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-09-26T17:54:40.402368] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:54:40.590748] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-26T17:54:40.756741] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-12. [2025-09-26T17:54:41.176947] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-26T17:54:41.255267] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-26T17:54:41.556752] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-09-26T17:54:42.356765] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-09-26T17:54:42.489686] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-26T17:54:42.623134] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-09-26T17:54:43.156730] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-09-26T17:54:43.956727] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-09-26T17:54:44.226006] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-26T17:54:44.756716] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-09-26T17:54:45.045430] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-26T17:54:45.077706] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-26T17:54:45.556729] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-09-26T17:54:46.268384] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-26T17:54:46.356708] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-09-26T17:54:47.156724] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-09-26T17:54:47.779041] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-26T17:54:47.792613] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-26T17:54:47.794881] [INFO ] [REMOTE ] CCRD: Full fetch complete (11816 records). [2025-09-26T17:54:47.795061] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-09-26T17:54:47.795597] [FATAL] [VALIDATOR ] CCRD: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:54:47.795746] [FATAL] [MAIN ] CCRD: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:54:47.795793] [WARN ] [MAIN ] CCRD: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:54:47.795835] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-09-26T17:54:47.795895] [DEBUG] [LOCAL ] CCRD: No primary data file found to delete. [2025-09-26T17:54:47.795949] [INFO ] [LOCAL ] CCRD: Starting deletion of derivative data. [2025-09-26T17:54:47.796488] [DEBUG] [LOCAL ] CCRD: Deleted derivative data file. [2025-09-26T17:54:47.796621] [INFO ] [MAIN ] Update Progress: 417/2371 symbols completed. CCRD took 21.0s. Estimated remaining: 4h 16m 32s. Rate: 7.6 symbols/min [2025-09-26T17:54:47.965315] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-09-26T17:54:48.013355] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:54:48.102875] [DEBUG] [LOCAL ] CDE: Loaded 54031 existing records from primary storage. [2025-09-26T17:54:48.103078] [INFO ] [MAIN ] CDE: Loaded 54031 existing records. [2025-09-26T17:54:48.302469] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:54:48.302897] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-09-26T17:54:48.302961] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-09-26T17:54:48.304361] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-09-26T17:54:48.304436] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-09-26T17:54:48.444735] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-26T17:54:48.705556] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:54:48.756722] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-09-26T17:54:49.556720] [INFO ] [REMOTE ] CDE: Fetching primary data for 2024-12. [2025-09-26T17:54:50.080499] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-26T17:54:50.356758] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-09-26T17:54:51.156737] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-09-26T17:54:51.376151] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-26T17:54:51.432878] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-26T17:54:51.499994] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-26T17:54:51.956756] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-09-26T17:54:52.756762] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-09-26T17:54:53.556743] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-09-26T17:54:53.747496] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-26T17:54:53.828277] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-09-26T17:54:54.356725] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-09-26T17:54:54.605755] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:54:54.606072] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-09-26T17:54:54.632594] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-26T17:54:55.156722] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-09-26T17:54:55.956725] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-09-26T17:54:56.381195] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-26T17:54:56.756728] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-09-26T17:54:56.917342] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-26T17:54:57.556738] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-09-26T17:54:58.261947] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-26T17:54:58.356699] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-09-26T17:54:58.662196] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-26T17:54:59.156758] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-09-26T17:54:59.956715] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-07. [2025-09-26T17:55:00.323099] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-26T17:55:00.353073] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-26T17:55:00.756698] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-08. [2025-09-26T17:55:01.000837] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-26T17:55:01.039497] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-26T17:55:01.556731] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-09-26T17:55:02.356783] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-09. [2025-09-26T17:55:02.798505] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-26T17:55:02.799378] [INFO ] [REMOTE ] CCZ: Full fetch complete (95 records). [2025-09-26T17:55:02.799460] [DEBUG] [VALIDATOR ] CCZ: Validating primary data. [2025-09-26T17:55:02.799989] [FATAL] [VALIDATOR ] CCZ: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:55:02.800080] [FATAL] [MAIN ] CCZ: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:55:02.800136] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:55:02.800224] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-26T17:55:02.800308] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-26T17:55:02.800348] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-09-26T17:55:02.800406] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-09-26T17:55:02.800544] [INFO ] [MAIN ] Update Progress: 418/2371 symbols completed. CCZ took 23.0s. Estimated remaining: 4h 16m 57s. Rate: 7.6 symbols/min [2025-09-26T17:55:02.998805] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:55:03.016784] [DEBUG] [LOCAL ] CDLR: Loaded 9877 existing records from primary storage. [2025-09-26T17:55:03.016926] [INFO ] [MAIN ] CDLR: Loaded 9877 existing records. [2025-09-26T17:55:03.167525] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-09-26T17:55:03.220244] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:55:03.220552] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-09-26T17:55:03.220622] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-09-26T17:55:03.221358] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-09-26T17:55:03.221438] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-09-26T17:55:03.616458] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:55:03.956727] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-09-26T17:55:04.005760] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-09-26T17:55:04.486875] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-26T17:55:04.756744] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2024-12. [2025-09-26T17:55:05.046556] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-26T17:55:05.556716] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-09-26T17:55:06.054850] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-26T17:55:06.356730] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-09-26T17:55:06.988715] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-26T17:55:07.156784] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-09-26T17:55:07.667267] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-26T17:55:07.956740] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-09-26T17:55:08.368106] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-26T17:55:08.454540] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-26T17:55:08.756789] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-09-26T17:55:09.556769] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-09-26T17:55:09.748577] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-26T17:55:10.356743] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-09-26T17:55:10.642813] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-26T17:55:10.647257] [INFO ] [REMOTE ] CCU: Full fetch complete (33166 records). [2025-09-26T17:55:10.647591] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-09-26T17:55:11.072982] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-09-26T17:55:11.073077] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-09-26T17:55:11.073581] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-09-26T17:55:11.073701] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-09-26T17:55:11.074857] [DEBUG] [LOCAL ] CCU: Trimmed 33166 records to 23800 (keeping 200 days of data) [2025-09-26T17:55:11.172135] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-09-26T17:55:11.237833] [DEBUG] [LOCAL ] CCU: Primary data saved (23800 records). [2025-09-26T17:55:11.237992] [INFO ] [MAIN ] CCU: Full history saved. [2025-09-26T17:55:11.238109] [INFO ] [MAIN ] Update Progress: 419/2371 symbols completed. CCU took 33.1s. Estimated remaining: 4h 16m 52s. Rate: 7.6 symbols/min [2025-09-26T17:55:11.428258] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:55:11.479932] [DEBUG] [LOCAL ] CDP: Loaded 43032 existing records from primary storage. [2025-09-26T17:55:11.480085] [INFO ] [MAIN ] CDP: Loaded 43032 existing records. [2025-09-26T17:55:11.674585] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:55:11.674873] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-09-26T17:55:11.674944] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-09-26T17:55:11.676204] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-09-26T17:55:11.676273] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-09-26T17:55:11.959956] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-09-26T17:55:12.101703] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:55:12.157162] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-26T17:55:12.216315] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-26T17:55:12.546568] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-26T17:55:12.756761] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-09-26T17:55:13.556727] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-09-26T17:55:13.612741] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-26T17:55:14.356735] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-09-26T17:55:14.680428] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-26T17:55:14.896184] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-26T17:55:15.156753] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-09-26T17:55:15.956747] [INFO ] [REMOTE ] CDP: Fetching primary data for 2024-12. [2025-09-26T17:55:16.756778] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-09-26T17:55:17.174690] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-26T17:55:17.257772] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-26T17:55:17.352485] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-26T17:55:17.556721] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-09-26T17:55:18.356758] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-09-26T17:55:19.020881] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-26T17:55:19.034087] [INFO ] [REMOTE ] CCS: Full fetch complete (44951 records). [2025-09-26T17:55:19.034391] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-26T17:55:19.034564] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-09-26T17:55:19.161839] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-09-26T17:55:19.452979] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-09-26T17:55:19.453102] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-09-26T17:55:19.453733] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-09-26T17:55:19.453802] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-09-26T17:55:19.455196] [DEBUG] [LOCAL ] CCS: Trimmed 44951 records to 31155 (keeping 200 days of data) [2025-09-26T17:55:19.667187] [DEBUG] [LOCAL ] CCS: Primary data saved (31155 records). [2025-09-26T17:55:19.667334] [INFO ] [MAIN ] CCS: Full history saved. [2025-09-26T17:55:19.667448] [INFO ] [MAIN ] Update Progress: 420/2371 symbols completed. CCS took 46.1s. Estimated remaining: 4h 16m 46s. Rate: 7.6 symbols/min [2025-09-26T17:55:19.854472] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:55:19.882418] [DEBUG] [LOCAL ] CDRE: Loaded 25608 existing records from primary storage. [2025-09-26T17:55:19.882607] [INFO ] [MAIN ] CDRE: Loaded 25608 existing records. [2025-09-26T17:55:19.966213] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-09-26T17:55:20.087600] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:55:20.087879] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-09-26T17:55:20.087930] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-09-26T17:55:20.088862] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-09-26T17:55:20.088927] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-09-26T17:55:20.497418] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:55:20.756693] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2024-12. [2025-09-26T17:55:20.797435] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-26T17:55:20.802279] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-26T17:55:20.800987] [INFO ] [REMOTE ] CDLR: Full fetch complete (13090 records). [2025-09-26T17:55:20.811092] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-09-26T17:55:21.247371] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-09-26T17:55:21.247476] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-09-26T17:55:21.247824] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-09-26T17:55:21.247888] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-09-26T17:55:21.248494] [DEBUG] [LOCAL ] CDLR: Trimmed 13090 records to 9966 (keeping 200 days of data) [2025-09-26T17:55:21.314020] [DEBUG] [LOCAL ] CDLR: Primary data saved (9966 records). [2025-09-26T17:55:21.314172] [INFO ] [MAIN ] CDLR: Full history saved. [2025-09-26T17:55:21.314265] [INFO ] [MAIN ] Update Progress: 421/2371 symbols completed. CDLR took 18.5s. Estimated remaining: 4h 16m 10s. Rate: 7.6 symbols/min [2025-09-26T17:55:21.492169] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:55:21.555241] [DEBUG] [LOCAL ] CE: Loaded 51931 existing records from primary storage. [2025-09-26T17:55:21.555419] [INFO ] [MAIN ] CE: Loaded 51931 existing records. [2025-09-26T17:55:21.561827] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-09-26T17:55:21.762893] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:55:21.763522] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-09-26T17:55:21.763694] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-09-26T17:55:21.770746] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-09-26T17:55:21.781721] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-09-26T17:55:21.782803] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-26T17:55:22.195572] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:55:22.356782] [INFO ] [REMOTE ] CE: Fetching primary data for 2024-12. [2025-09-26T17:55:23.156746] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-09-26T17:55:23.761920] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-26T17:55:23.956725] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-09-26T17:55:24.177283] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-26T17:55:24.232045] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-26T17:55:24.756828] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-09-26T17:55:25.375592] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-26T17:55:25.556758] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-09-26T17:55:26.356782] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-09-26T17:55:26.494209] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-26T17:55:27.156776] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-09-26T17:55:27.579745] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-26T17:55:27.591603] [INFO ] [REMOTE ] CDE: Full fetch complete (77581 records). [2025-09-26T17:55:27.591866] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-09-26T17:55:27.900695] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T17:55:27.957082] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-09-26T17:55:28.082753] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-09-26T17:55:28.082873] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-09-26T17:55:28.084157] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-09-26T17:55:28.084231] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-09-26T17:55:28.086612] [DEBUG] [LOCAL ] CDE: Trimmed 77581 records to 54421 (keeping 200 days of data) [2025-09-26T17:55:28.440231] [DEBUG] [LOCAL ] CDE: Primary data saved (54421 records). [2025-09-26T17:55:28.440445] [INFO ] [MAIN ] CDE: Full history saved. [2025-09-26T17:55:28.441826] [INFO ] [MAIN ] Update Progress: 422/2371 symbols completed. CDE took 40.6s. Estimated remaining: 4h 15m 58s. Rate: 7.6 symbols/min [2025-09-26T17:55:28.618329] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:55:28.630927] [DEBUG] [LOCAL ] CEE: Loaded 6682 existing records from primary storage. [2025-09-26T17:55:28.631108] [INFO ] [MAIN ] CEE: Loaded 6682 existing records. [2025-09-26T17:55:28.761427] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-09-26T17:55:28.827251] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:55:28.828158] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-09-26T17:55:28.828338] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-09-26T17:55:28.835851] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-09-26T17:55:28.847404] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-09-26T17:55:28.899161] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-26T17:55:29.236218] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:55:29.267414] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-26T17:55:29.556774] [INFO ] [REMOTE ] CEE: Fetching primary data for 2024-12. [2025-09-26T17:55:30.246632] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-26T17:55:30.356710] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-09-26T17:55:30.713272] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-26T17:55:31.156798] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-09-26T17:55:31.556319] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-26T17:55:31.963707] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-09-26T17:55:31.988424] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-26T17:55:32.756705] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-09-26T17:55:33.140318] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-26T17:55:33.556764] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-09-26T17:55:34.361820] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-09-26T17:55:34.378856] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-26T17:55:34.431002] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-26T17:55:35.156765] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-09-26T17:55:35.835917] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T17:55:35.956728] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-09-26T17:55:36.545909] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-26T17:55:36.756771] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-09-26T17:55:37.103161] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-26T17:55:37.556802] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-09-26T17:55:38.057779] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-26T17:55:38.356770] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-09-26T17:55:38.613224] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-26T17:55:39.156788] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-09-26T17:55:39.329960] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-26T17:55:39.956770] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-09-26T17:55:40.756755] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-09-26T17:55:40.824021] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-26T17:55:41.097942] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-26T17:55:41.486777] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-26T17:55:41.556708] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-09-26T17:55:42.356747] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-09-26T17:55:42.871738] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-26T17:55:43.156794] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-09-26T17:55:43.845048] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-26T17:55:43.956753] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-09-26T17:55:44.380324] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-26T17:55:44.756734] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-09-26T17:55:45.199443] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-26T17:55:45.556740] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-09-26T17:55:46.270044] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-26T17:55:46.356703] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-09-26T17:55:46.584149] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-26T17:55:46.596195] [INFO ] [REMOTE ] CE: Full fetch complete (74886 records). [2025-09-26T17:55:46.596506] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-09-26T17:55:47.035675] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-09-26T17:55:47.035802] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-09-26T17:55:47.036755] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-09-26T17:55:47.036841] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-09-26T17:55:47.038528] [DEBUG] [LOCAL ] CE: Trimmed 74886 records to 52316 (keeping 200 days of data) [2025-09-26T17:55:47.156939] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-09-26T17:55:47.384121] [DEBUG] [LOCAL ] CE: Primary data saved (52316 records). [2025-09-26T17:55:47.384271] [INFO ] [MAIN ] CE: Full history saved. [2025-09-26T17:55:47.384414] [INFO ] [MAIN ] Update Progress: 423/2371 symbols completed. CE took 26.1s. Estimated remaining: 4h 16m 41s. Rate: 7.6 symbols/min [2025-09-26T17:55:47.567136] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:55:47.592598] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-26T17:55:47.622269] [DEBUG] [LOCAL ] CEPU: Loaded 26270 existing records from primary storage. [2025-09-26T17:55:47.622410] [INFO ] [MAIN ] CEPU: Loaded 26270 existing records. [2025-09-26T17:55:47.807383] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:55:47.807705] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-09-26T17:55:47.807764] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-09-26T17:55:47.808561] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-09-26T17:55:47.808626] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-09-26T17:55:47.961879] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-09-26T17:55:48.214984] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:55:48.642081] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-26T17:55:48.759735] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-09-26T17:55:48.761012] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-26T17:55:48.767058] [INFO ] [REMOTE ] CDRE: Full fetch complete (35341 records). [2025-09-26T17:55:48.767319] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-09-26T17:55:49.184775] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-09-26T17:55:49.184875] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-09-26T17:55:49.185363] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-09-26T17:55:49.185408] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-09-26T17:55:49.186554] [DEBUG] [LOCAL ] CDRE: Trimmed 35341 records to 25747 (keeping 200 days of data) [2025-09-26T17:55:49.352542] [DEBUG] [LOCAL ] CDRE: Primary data saved (25747 records). [2025-09-26T17:55:49.352779] [INFO ] [MAIN ] CDRE: Full history saved. [2025-09-26T17:55:49.352967] [INFO ] [MAIN ] Update Progress: 424/2371 symbols completed. CDRE took 29.7s. Estimated remaining: 4h 16m 6s. Rate: 7.6 symbols/min [2025-09-26T17:55:49.552524] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:55:49.556762] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-09-26T17:55:49.632610] [DEBUG] [LOCAL ] CF: Loaded 52619 existing records from primary storage. [2025-09-26T17:55:49.632810] [INFO ] [MAIN ] CF: Loaded 52619 existing records. [2025-09-26T17:55:49.901148] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:55:49.901419] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-09-26T17:55:49.901476] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-09-26T17:55:49.903325] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-09-26T17:55:49.903399] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-09-26T17:55:50.301714] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-26T17:55:50.358349] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2024-12. [2025-09-26T17:55:50.431835] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:55:50.459669] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-26T17:55:50.468731] [INFO ] [REMOTE ] CDP: Full fetch complete (61871 records). [2025-09-26T17:55:50.468888] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-09-26T17:55:50.915077] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-09-26T17:55:50.915207] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-09-26T17:55:50.916168] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-09-26T17:55:50.916252] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-09-26T17:55:50.917903] [DEBUG] [LOCAL ] CDP: Trimmed 61871 records to 43357 (keeping 200 days of data) [2025-09-26T17:55:51.159223] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-09-26T17:55:51.197945] [DEBUG] [LOCAL ] CDP: Primary data saved (43357 records). [2025-09-26T17:55:51.198107] [INFO ] [MAIN ] CDP: Full history saved. [2025-09-26T17:55:51.198226] [INFO ] [MAIN ] Update Progress: 425/2371 symbols completed. CDP took 40.0s. Estimated remaining: 4h 15m 30s. Rate: 7.6 symbols/min [2025-09-26T17:55:51.383069] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:55:51.440258] [DEBUG] [LOCAL ] CFG: Loaded 54014 existing records from primary storage. [2025-09-26T17:55:51.440431] [INFO ] [MAIN ] CFG: Loaded 54014 existing records. [2025-09-26T17:55:51.654276] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:55:51.655001] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-09-26T17:55:51.655071] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-09-26T17:55:51.656897] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-09-26T17:55:51.656962] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-09-26T17:55:51.961832] [INFO ] [REMOTE ] CF: Fetching primary data for 2024-12. [2025-09-26T17:55:51.980634] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-26T17:55:52.092462] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:55:52.094379] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-26T17:55:52.756730] [INFO ] [REMOTE ] CFG: Fetching primary data for 2024-12. [2025-09-26T17:55:53.556723] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-09-26T17:55:53.824519] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-26T17:55:54.356779] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-09-26T17:55:54.613981] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-26T17:55:54.676146] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-26T17:55:55.156753] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-09-26T17:55:55.529934] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-26T17:55:55.956774] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-09-26T17:55:56.038959] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-26T17:55:56.676140] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-26T17:55:56.756726] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-09-26T17:55:57.184787] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-26T17:55:57.186216] [INFO ] [REMOTE ] CEE: Full fetch complete (10195 records). [2025-09-26T17:55:57.186287] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-09-26T17:55:57.565773] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-09-26T17:55:57.576473] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-09-26T17:55:57.576556] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-09-26T17:55:57.576988] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-09-26T17:55:57.577055] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-09-26T17:55:57.577847] [DEBUG] [LOCAL ] CEE: Trimmed 10195 records to 6697 (keeping 200 days of data) [2025-09-26T17:55:57.622298] [DEBUG] [LOCAL ] CEE: Primary data saved (6697 records). [2025-09-26T17:55:57.622447] [INFO ] [MAIN ] CEE: Full history saved. [2025-09-26T17:55:57.622551] [INFO ] [MAIN ] Update Progress: 426/2371 symbols completed. CEE took 29.2s. Estimated remaining: 4h 15m 16s. Rate: 7.6 symbols/min [2025-09-26T17:55:57.809363] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:55:57.809605] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-09-26T17:55:57.809681] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-09-26T17:55:57.809836] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-09-26T17:55:57.809911] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-26T17:55:57.810008] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-26T17:55:57.810084] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-09-26T17:55:58.199192] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:55:58.356754] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-12. [2025-09-26T17:55:58.551908] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:55:58.552319] [WARN ] [REMOTE ] CFND: No data returned for month 2024-12 [2025-09-26T17:55:59.156732] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-09-26T17:55:59.208809] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-26T17:55:59.956746] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-01. [2025-09-26T17:56:00.162446] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:56:00.162829] [WARN ] [REMOTE ] CFND: No data returned for month 2025-01 [2025-09-26T17:56:00.756768] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-09-26T17:56:00.963853] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-26T17:56:01.556740] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-09-26T17:56:01.788322] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-26T17:56:02.356793] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-09-26T17:56:02.889618] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-26T17:56:03.117886] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-26T17:56:03.156767] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-02. [2025-09-26T17:56:03.371237] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:56:03.371603] [WARN ] [REMOTE ] CFND: No data returned for month 2025-02 [2025-09-26T17:56:03.956758] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-09-26T17:56:04.756762] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-09-26T17:56:05.556740] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-03. [2025-09-26T17:56:05.836829] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:56:05.837321] [WARN ] [REMOTE ] CFND: No data returned for month 2025-03 [2025-09-26T17:56:05.876401] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-26T17:56:06.356792] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-09-26T17:56:06.794071] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-26T17:56:07.156772] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-09-26T17:56:07.740628] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-26T17:56:07.956726] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-09-26T17:56:08.279797] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-26T17:56:08.756736] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-09-26T17:56:09.556719] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-04. [2025-09-26T17:56:09.740217] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-26T17:56:09.777278] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:56:09.777755] [WARN ] [REMOTE ] CFND: No data returned for month 2025-04 [2025-09-26T17:56:10.131781] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-26T17:56:10.356744] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-09-26T17:56:11.156816] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-09-26T17:56:11.955687] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-26T17:56:11.966071] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-05. [2025-09-26T17:56:12.190991] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:56:12.191376] [WARN ] [REMOTE ] CFND: No data returned for month 2025-05 [2025-09-26T17:56:12.500508] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-26T17:56:12.756779] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-06. [2025-09-26T17:56:12.975940] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:56:12.976367] [WARN ] [REMOTE ] CFND: No data returned for month 2025-06 [2025-09-26T17:56:13.556753] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-07. [2025-09-26T17:56:13.763359] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:56:13.763794] [WARN ] [REMOTE ] CFND: No data returned for month 2025-07 [2025-09-26T17:56:14.356785] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-09-26T17:56:15.156825] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-09-26T17:56:15.800793] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-26T17:56:15.956717] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-08. [2025-09-26T17:56:16.595945] [INFO ] [REMOTE ] CFND: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-26T17:56:16.756832] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-09-26T17:56:16.814054] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-26T17:56:17.556703] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-09-26T17:56:17.738147] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-26T17:56:18.356750] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-09-26T17:56:19.138325] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-26T17:56:19.156676] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-09-26T17:56:19.956742] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-09-26T17:56:20.248162] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-26T17:56:20.671117] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-26T17:56:20.686629] [INFO ] [REMOTE ] CF: Full fetch complete (75167 records). [2025-09-26T17:56:20.686907] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-09-26T17:56:20.764414] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-09-26T17:56:21.076195] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-26T17:56:21.184204] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-09-26T17:56:21.184321] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-09-26T17:56:21.185253] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-09-26T17:56:21.185336] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-09-26T17:56:21.187213] [DEBUG] [LOCAL ] CF: Trimmed 75167 records to 52983 (keeping 200 days of data) [2025-09-26T17:56:21.543465] [DEBUG] [LOCAL ] CF: Primary data saved (52983 records). [2025-09-26T17:56:21.543728] [INFO ] [MAIN ] CF: Full history saved. [2025-09-26T17:56:21.543923] [INFO ] [MAIN ] Update Progress: 427/2371 symbols completed. CF took 32.2s. Estimated remaining: 4h 16m 21s. Rate: 7.6 symbols/min [2025-09-26T17:56:21.561952] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-09-26T17:56:21.750040] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:56:21.790578] [DEBUG] [LOCAL ] CFR: Loaded 33773 existing records from primary storage. [2025-09-26T17:56:21.790857] [INFO ] [MAIN ] CFR: Loaded 33773 existing records. [2025-09-26T17:56:22.000971] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:56:22.001531] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-09-26T17:56:22.001761] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-09-26T17:56:22.003129] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-09-26T17:56:22.003211] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-09-26T17:56:22.358288] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-09. [2025-09-26T17:56:22.408147] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:56:22.442620] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-26T17:56:22.474048] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-26T17:56:23.117049] [INFO ] [REMOTE ] CFND: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-26T17:56:23.119142] [INFO ] [REMOTE ] CFND: Full fetch complete (2576 records). [2025-09-26T17:56:23.119218] [DEBUG] [VALIDATOR ] CFND: Validating primary data. [2025-09-26T17:56:23.161970] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-09-26T17:56:23.323398] [WARN ] [VALIDATOR ] CFND: Validation failed - insufficient historical data. Have 36 unique days, need 200 days [2025-09-26T17:56:23.323636] [FATAL] [MAIN ] CFND: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:56:23.323735] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:56:23.323808] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-26T17:56:23.323880] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-26T17:56:23.324092] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-09-26T17:56:23.324548] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-09-26T17:56:23.324828] [INFO ] [MAIN ] Update Progress: 428/2371 symbols completed. CFND took 25.7s. Estimated remaining: 4h 15m 45s. Rate: 7.6 symbols/min [2025-09-26T17:56:23.540043] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:56:23.595259] [DEBUG] [LOCAL ] CGAU: Loaded 43062 existing records from primary storage. [2025-09-26T17:56:23.595424] [INFO ] [MAIN ] CGAU: Loaded 43062 existing records. [2025-09-26T17:56:23.786111] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:56:23.786397] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-09-26T17:56:23.786461] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-09-26T17:56:23.787808] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-09-26T17:56:23.787879] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-09-26T17:56:23.963890] [INFO ] [REMOTE ] CFR: Fetching primary data for 2024-12. [2025-09-26T17:56:24.204362] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:56:24.756760] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-09-26T17:56:24.851687] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-26T17:56:25.261832] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-26T17:56:25.556725] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-09-26T17:56:25.938626] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-26T17:56:25.945882] [INFO ] [REMOTE ] CEPU: Full fetch complete (39644 records). [2025-09-26T17:56:25.946113] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-09-26T17:56:26.361978] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-09-26T17:56:26.378639] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-09-26T17:56:26.378794] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-09-26T17:56:26.379365] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-09-26T17:56:26.379437] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-09-26T17:56:26.380546] [DEBUG] [LOCAL ] CEPU: Trimmed 39644 records to 26454 (keeping 200 days of data) [2025-09-26T17:56:26.540632] [DEBUG] [LOCAL ] CEPU: Primary data saved (26454 records). [2025-09-26T17:56:26.540974] [INFO ] [MAIN ] CEPU: Full history saved. [2025-09-26T17:56:26.541112] [INFO ] [MAIN ] Update Progress: 429/2371 symbols completed. CEPU took 39.2s. Estimated remaining: 4h 15m 16s. Rate: 7.6 symbols/min [2025-09-26T17:56:26.752866] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:56:26.755722] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-26T17:56:26.768410] [DEBUG] [LOCAL ] CGV: Loaded 1421 existing records from primary storage. [2025-09-26T17:56:26.768529] [INFO ] [MAIN ] CGV: Loaded 1421 existing records. [2025-09-26T17:56:26.958792] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:56:26.959053] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-09-26T17:56:26.959102] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-09-26T17:56:26.959361] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-09-26T17:56:26.959422] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-09-26T17:56:27.168570] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2024-12. [2025-09-26T17:56:27.363879] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:56:27.956826] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-09-26T17:56:28.067565] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-26T17:56:28.078574] [INFO ] [REMOTE ] CFG: Full fetch complete (77575 records). [2025-09-26T17:56:28.078767] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-09-26T17:56:28.563122] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-09-26T17:56:28.563312] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-09-26T17:56:28.565044] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-09-26T17:56:28.565171] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-09-26T17:56:28.593571] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-26T17:56:28.602852] [DEBUG] [LOCAL ] CFG: Trimmed 77575 records to 54404 (keeping 200 days of data) [2025-09-26T17:56:28.800380] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-09-26T17:56:28.886119] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-26T17:56:29.005293] [DEBUG] [LOCAL ] CFG: Primary data saved (54404 records). [2025-09-26T17:56:29.005466] [INFO ] [MAIN ] CFG: Full history saved. [2025-09-26T17:56:29.005585] [INFO ] [MAIN ] Update Progress: 430/2371 symbols completed. CFG took 37.8s. Estimated remaining: 4h 14m 44s. Rate: 7.6 symbols/min [2025-09-26T17:56:29.216484] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:56:29.243368] [DEBUG] [LOCAL ] CHCT: Loaded 24167 existing records from primary storage. [2025-09-26T17:56:29.243523] [INFO ] [MAIN ] CHCT: Loaded 24167 existing records. [2025-09-26T17:56:29.434159] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:56:29.434481] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-09-26T17:56:29.434531] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-09-26T17:56:29.435744] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-09-26T17:56:29.435856] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-09-26T17:56:29.561889] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-09-26T17:56:29.837263] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:56:30.143086] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-26T17:56:30.356801] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-12. [2025-09-26T17:56:30.647573] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-26T17:56:30.945752] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-26T17:56:31.156725] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-09-26T17:56:31.614743] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-26T17:56:31.956730] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-09-26T17:56:32.434742] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-26T17:56:32.756736] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-09-26T17:56:33.556737] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2024-12. [2025-09-26T17:56:33.885809] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-26T17:56:34.356733] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-09-26T17:56:34.783736] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-26T17:56:35.156742] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-09-26T17:56:35.632707] [DEBUG] [REMOTE ] CGV: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-09-26T17:56:35.633036] [WARN ] [REMOTE ] CGV: No data returned for month 2025-03 [2025-09-26T17:56:35.658840] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-26T17:56:35.956727] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-09-26T17:56:36.756720] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-09-26T17:56:37.495103] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T17:56:37.556723] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-09-26T17:56:38.356710] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-09-26T17:56:38.405965] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-26T17:56:39.156719] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-09-26T17:56:39.325614] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-26T17:56:39.375917] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-26T17:56:39.956737] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-09-26T17:56:39.976816] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-26T17:56:40.756735] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-09-26T17:56:41.083677] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-26T17:56:41.556751] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-09-26T17:56:42.089057] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-26T17:56:42.260280] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-26T17:56:42.356728] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-09-26T17:56:43.156727] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-09-26T17:56:43.527015] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-26T17:56:43.538317] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-26T17:56:43.956756] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-09-26T17:56:44.308384] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-26T17:56:44.756726] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-09-26T17:56:45.191029] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-26T17:56:45.556736] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-09-26T17:56:46.356724] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-09-26T17:56:46.830699] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-26T17:56:47.156735] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-09-26T17:56:47.255201] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-26T17:56:47.956730] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-09-26T17:56:48.249003] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-26T17:56:48.620495] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-26T17:56:48.756716] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-09-26T17:56:49.556721] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-09-26T17:56:49.988425] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-26T17:56:50.008110] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-26T17:56:50.356741] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-09-26T17:56:51.156775] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-09-26T17:56:51.824490] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-26T17:56:51.956737] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-09-26T17:56:51.975874] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-26T17:56:52.756752] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-09-26T17:56:53.565870] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-09-26T17:56:53.569238] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-26T17:56:53.577279] [INFO ] [REMOTE ] CFR: Full fetch complete (48534 records). [2025-09-26T17:56:53.577498] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-09-26T17:56:53.984969] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-09-26T17:56:53.985299] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-09-26T17:56:53.986093] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-09-26T17:56:53.986233] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-09-26T17:56:53.997750] [DEBUG] [LOCAL ] CFR: Trimmed 48534 records to 33971 (keeping 200 days of data) [2025-09-26T17:56:54.015864] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-26T17:56:54.256733] [DEBUG] [LOCAL ] CFR: Primary data saved (33971 records). [2025-09-26T17:56:54.257194] [INFO ] [MAIN ] CFR: Full history saved. [2025-09-26T17:56:54.257422] [INFO ] [MAIN ] Update Progress: 431/2371 symbols completed. CFR took 32.7s. Estimated remaining: 4h 15m 54s. Rate: 7.6 symbols/min [2025-09-26T17:56:54.362949] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-09-26T17:56:54.513176] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:56:54.535171] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-26T17:56:54.543073] [INFO ] [REMOTE ] CHCT: Full fetch complete (35008 records). [2025-09-26T17:56:54.543274] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-09-26T17:56:54.901135] [DEBUG] [LOCAL ] CHD: Loaded 52397 existing records from primary storage. [2025-09-26T17:56:54.918942] [INFO ] [MAIN ] CHD: Loaded 52397 existing records. [2025-09-26T17:56:54.918826] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-26T17:56:55.157363] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-09-26T17:56:55.405620] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:56:55.405825] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-09-26T17:56:55.405988] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-09-26T17:56:55.406673] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-09-26T17:56:55.406860] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-09-26T17:56:55.406946] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-09-26T17:56:55.407017] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-09-26T17:56:55.408045] [DEBUG] [LOCAL ] CHCT: Trimmed 35008 records to 24309 (keeping 200 days of data) [2025-09-26T17:56:55.409094] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-09-26T17:56:55.409161] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-09-26T17:56:55.822297] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-26T17:56:55.871240] [INFO ] [REMOTE ] CGV: Full fetch complete (2059 records). [2025-09-26T17:56:55.882174] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-09-26T17:56:55.960132] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-09-26T17:56:56.056422] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:56:56.218326] [DEBUG] [LOCAL ] CHCT: Primary data saved (24309 records). [2025-09-26T17:56:56.218452] [INFO ] [MAIN ] CHCT: Full history saved. [2025-09-26T17:56:56.218579] [INFO ] [MAIN ] Update Progress: 432/2371 symbols completed. CHCT took 27.2s. Estimated remaining: 4h 15m 20s. Rate: 7.6 symbols/min [2025-09-26T17:56:56.213196] [WARN ] [VALIDATOR ] CGV: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-26T17:56:56.219007] [FATAL] [MAIN ] CGV: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:56:56.224225] [WARN ] [MAIN ] CGV: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:56:56.255090] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-09-26T17:56:56.305317] [DEBUG] [LOCAL ] CGV: No primary data file found to delete. [2025-09-26T17:56:56.324342] [INFO ] [LOCAL ] CGV: Starting deletion of derivative data. [2025-09-26T17:56:56.342533] [DEBUG] [LOCAL ] CGV: Deleted derivative data file. [2025-09-26T17:56:56.352913] [INFO ] [MAIN ] Update Progress: 433/2371 symbols completed. CGV took 29.8s. Estimated remaining: 4h 14m 37s. Rate: 7.6 symbols/min [2025-09-26T17:56:56.515784] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:56:56.592306] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:56:56.605673] [DEBUG] [LOCAL ] CHE: Loaded 14915 existing records from primary storage. [2025-09-26T17:56:56.605860] [INFO ] [MAIN ] CHE: Loaded 14915 existing records. [2025-09-26T17:56:56.760760] [INFO ] [REMOTE ] CHD: Fetching primary data for 2024-12. [2025-09-26T17:56:56.823897] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:56:56.824205] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-09-26T17:56:56.824261] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-09-26T17:56:56.824845] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-09-26T17:56:56.824911] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-09-26T17:56:56.987497] [DEBUG] [LOCAL ] CHGG: Loaded 48072 existing records from primary storage. [2025-09-26T17:56:57.011359] [INFO ] [MAIN ] CHGG: Loaded 48072 existing records. [2025-09-26T17:56:57.462606] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:56:57.468628] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:56:57.469429] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-09-26T17:56:57.469601] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-09-26T17:56:57.470854] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-09-26T17:56:57.470917] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-09-26T17:56:57.566337] [INFO ] [REMOTE ] CHE: Fetching primary data for 2024-12. [2025-09-26T17:56:57.905101] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:56:57.907133] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-26T17:56:58.180694] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-26T17:56:58.356710] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-09-26T17:56:58.558318] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T17:56:59.156708] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-09-26T17:56:59.229812] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-26T17:56:59.956725] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-09-26T17:57:00.756726] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2024-12. [2025-09-26T17:57:00.794686] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-26T17:57:00.814147] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-26T17:57:01.556725] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-09-26T17:57:02.356724] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-09-26T17:57:02.761802] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-26T17:57:02.825434] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-26T17:57:03.156748] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-09-26T17:57:03.956697] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-09-26T17:57:04.097991] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-26T17:57:04.169942] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-26T17:57:04.180348] [INFO ] [REMOTE ] CGAU: Full fetch complete (60681 records). [2025-09-26T17:57:04.180534] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-09-26T17:57:04.652449] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-09-26T17:57:04.652553] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-09-26T17:57:04.653274] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-09-26T17:57:04.653341] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-09-26T17:57:04.654813] [DEBUG] [LOCAL ] CGAU: Trimmed 60681 records to 43406 (keeping 200 days of data) [2025-09-26T17:57:04.763474] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-09-26T17:57:04.942224] [DEBUG] [LOCAL ] CGAU: Primary data saved (43406 records). [2025-09-26T17:57:04.942430] [INFO ] [MAIN ] CGAU: Full history saved. [2025-09-26T17:57:04.943936] [INFO ] [MAIN ] Update Progress: 434/2371 symbols completed. CGAU took 41.6s. Estimated remaining: 4h 14m 32s. Rate: 7.6 symbols/min [2025-09-26T17:57:05.125739] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:57:05.173905] [DEBUG] [LOCAL ] CHH: Loaded 32491 existing records from primary storage. [2025-09-26T17:57:05.174076] [INFO ] [MAIN ] CHH: Loaded 32491 existing records. [2025-09-26T17:57:05.369365] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:57:05.369929] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-09-26T17:57:05.370043] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-09-26T17:57:05.371301] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-09-26T17:57:05.371379] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-09-26T17:57:05.562852] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-09-26T17:57:05.794536] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-26T17:57:05.825897] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:57:05.852864] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-26T17:57:06.356777] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-09-26T17:57:07.156755] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-09-26T17:57:07.357742] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-26T17:57:07.453405] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-26T17:57:07.956735] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-09-26T17:57:08.411992] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-26T17:57:08.756693] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-09-26T17:57:09.071941] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-26T17:57:09.556748] [INFO ] [REMOTE ] CHH: Fetching primary data for 2024-12. [2025-09-26T17:57:10.356701] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-09-26T17:57:10.685082] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-26T17:57:10.750533] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-26T17:57:11.156784] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-09-26T17:57:11.956740] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-09-26T17:57:12.359966] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-26T17:57:12.441934] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-26T17:57:12.756717] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-09-26T17:57:13.194441] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-26T17:57:13.563144] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-09-26T17:57:13.566838] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-26T17:57:14.356760] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-09-26T17:57:15.156713] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-09-26T17:57:15.325955] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-26T17:57:15.400066] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-26T17:57:15.956738] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-09-26T17:57:16.756959] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-09-26T17:57:16.759938] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T17:57:17.266983] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-26T17:57:17.556734] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-09-26T17:57:18.296237] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-26T17:57:18.356732] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-09-26T17:57:18.905001] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-26T17:57:19.156734] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-09-26T17:57:19.956766] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-09-26T17:57:20.209961] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-26T17:57:20.756750] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-09-26T17:57:20.983706] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-26T17:57:21.181061] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-26T17:57:21.556741] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-09-26T17:57:21.621260] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-26T17:57:21.625583] [INFO ] [REMOTE ] CHE: Full fetch complete (19747 records). [2025-09-26T17:57:21.625753] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-09-26T17:57:22.034732] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-09-26T17:57:22.034875] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-09-26T17:57:22.035310] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-09-26T17:57:22.035360] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-09-26T17:57:22.036492] [DEBUG] [LOCAL ] CHE: Trimmed 19747 records to 14983 (keeping 200 days of data) [2025-09-26T17:57:22.139165] [DEBUG] [LOCAL ] CHE: Primary data saved (14983 records). [2025-09-26T17:57:22.139344] [INFO ] [MAIN ] CHE: Full history saved. [2025-09-26T17:57:22.139444] [INFO ] [MAIN ] Update Progress: 435/2371 symbols completed. CHE took 25.9s. Estimated remaining: 4h 15m 6s. Rate: 7.6 symbols/min [2025-09-26T17:57:22.321805] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:57:22.344493] [DEBUG] [LOCAL ] CHMI: Loaded 22183 existing records from primary storage. [2025-09-26T17:57:22.344703] [INFO ] [MAIN ] CHMI: Loaded 22183 existing records. [2025-09-26T17:57:22.366070] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-09-26T17:57:22.539206] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:57:22.539494] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-09-26T17:57:22.539544] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-09-26T17:57:22.540274] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-09-26T17:57:22.540338] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-09-26T17:57:22.903874] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:57:23.156743] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2024-12. [2025-09-26T17:57:23.323503] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-26T17:57:23.597686] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-26T17:57:23.956735] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-09-26T17:57:24.110711] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-26T17:57:24.756724] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-09-26T17:57:25.094303] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-26T17:57:25.556732] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-09-26T17:57:26.117878] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-26T17:57:26.356725] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-09-26T17:57:27.159123] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-09-26T17:57:27.164837] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-26T17:57:27.175594] [INFO ] [REMOTE ] CHD: Full fetch complete (74372 records). [2025-09-26T17:57:27.175790] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-09-26T17:57:27.586111] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-09-26T17:57:27.586220] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-09-26T17:57:27.587150] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-09-26T17:57:27.587222] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-09-26T17:57:27.588836] [DEBUG] [LOCAL ] CHD: Trimmed 74372 records to 52767 (keeping 200 days of data) [2025-09-26T17:57:27.929971] [DEBUG] [LOCAL ] CHD: Primary data saved (52767 records). [2025-09-26T17:57:27.930247] [INFO ] [MAIN ] CHD: Full history saved. [2025-09-26T17:57:27.930408] [INFO ] [MAIN ] Update Progress: 436/2371 symbols completed. CHD took 33.7s. Estimated remaining: 4h 14m 49s. Rate: 7.6 symbols/min [2025-09-26T17:57:27.965695] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-09-26T17:57:28.125033] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:57:28.168118] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-26T17:57:28.172561] [DEBUG] [LOCAL ] CHN: Loaded 4885 existing records from primary storage. [2025-09-26T17:57:28.183604] [INFO ] [MAIN ] CHN: Loaded 4885 existing records. [2025-09-26T17:57:28.214119] [INFO ] [REMOTE ] CHGG: Full fetch complete (70626 records). [2025-09-26T17:57:28.258427] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-09-26T17:57:28.545262] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:57:28.572228] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-09-26T17:57:28.585909] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-09-26T17:57:28.603858] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-09-26T17:57:28.608174] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-09-26T17:57:29.039271] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-09-26T17:57:29.040920] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-09-26T17:57:29.068124] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-09-26T17:57:29.068421] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-09-26T17:57:29.183867] [DEBUG] [LOCAL ] CHGG: Trimmed 70626 records to 48434 (keeping 200 days of data) [2025-09-26T17:57:29.331734] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:57:29.366106] [INFO ] [REMOTE ] CHN: Fetching primary data for 2024-12. [2025-09-26T17:57:29.394947] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-26T17:57:29.524451] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-09-26T17:57:29.557670] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-09-26T17:57:29.618347] [DEBUG] [LOCAL ] CHGG: Primary data saved (48434 records). [2025-09-26T17:57:29.618505] [INFO ] [MAIN ] CHGG: Full history saved. [2025-09-26T17:57:29.620444] [INFO ] [MAIN ] Update Progress: 437/2371 symbols completed. CHGG took 33.3s. Estimated remaining: 4h 14m 13s. Rate: 7.6 symbols/min [2025-09-26T17:57:29.917427] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-26T17:57:30.356741] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-09-26T17:57:30.519249] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-26T17:57:31.156732] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-09-26T17:57:31.638475] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-26T17:57:31.956725] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-09-26T17:57:32.596215] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-26T17:57:32.756726] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-09-26T17:57:32.832746] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-26T17:57:33.556723] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-09-26T17:57:33.754102] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-26T17:57:33.760536] [INFO ] [REMOTE ] CHH: Full fetch complete (46449 records). [2025-09-26T17:57:33.760682] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-09-26T17:57:34.163064] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-09-26T17:57:34.163171] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-09-26T17:57:34.163862] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-09-26T17:57:34.163926] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-09-26T17:57:34.165146] [DEBUG] [LOCAL ] CHH: Trimmed 46449 records to 32744 (keeping 200 days of data) [2025-09-26T17:57:34.356937] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-09-26T17:57:34.377812] [DEBUG] [LOCAL ] CHH: Primary data saved (32744 records). [2025-09-26T17:57:34.377972] [INFO ] [MAIN ] CHH: Full history saved. [2025-09-26T17:57:34.379805] [INFO ] [MAIN ] Update Progress: 438/2371 symbols completed. CHH took 29.4s. Estimated remaining: 4h 13m 51s. Rate: 7.6 symbols/min [2025-09-26T17:57:34.659189] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-26T17:57:34.786902] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-26T17:57:35.156754] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-09-26T17:57:35.559437] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-26T17:57:35.956722] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-09-26T17:57:36.756725] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-09-26T17:57:37.159109] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-26T17:57:37.322837] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-26T17:57:37.556729] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-09-26T17:57:38.356748] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-09-26T17:57:38.527267] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-26T17:57:38.768613] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-26T17:57:39.156735] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-09-26T17:57:39.762984] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-26T17:57:39.956727] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-09-26T17:57:40.592607] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-26T17:57:40.756723] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-09-26T17:57:41.321816] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-26T17:57:41.556734] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-09-26T17:57:42.273867] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-26T17:57:42.356717] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-09-26T17:57:43.058089] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-26T17:57:43.059747] [INFO ] [REMOTE ] CHN: Full fetch complete (7628 records). [2025-09-26T17:57:43.059821] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-09-26T17:57:43.163607] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-09-26T17:57:43.463976] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-09-26T17:57:43.464063] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-09-26T17:57:43.464263] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-09-26T17:57:43.464303] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-09-26T17:57:43.464868] [DEBUG] [LOCAL ] CHN: Trimmed 7628 records to 4900 (keeping 200 days of data) [2025-09-26T17:57:43.496477] [DEBUG] [LOCAL ] CHN: Primary data saved (4900 records). [2025-09-26T17:57:43.496639] [INFO ] [MAIN ] CHN: Full history saved. [2025-09-26T17:57:43.496780] [INFO ] [MAIN ] Update Progress: 439/2371 symbols completed. CHN took 15.6s. Estimated remaining: 4h 13m 49s. Rate: 7.6 symbols/min [2025-09-26T17:57:44.236892] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-26T17:57:44.241990] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-09-26T17:57:45.109671] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-26T17:57:45.114623] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-09-26T17:57:46.195619] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-26T17:57:46.200470] [INFO ] [REMOTE ] CHMI: Full fetch complete (31680 records). [2025-09-26T17:57:46.200578] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-09-26T17:57:46.599097] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-09-26T17:57:46.599221] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-09-26T17:57:46.599735] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-09-26T17:57:46.599800] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-09-26T17:57:46.600737] [DEBUG] [LOCAL ] CHMI: Trimmed 31680 records to 22359 (keeping 200 days of data) [2025-09-26T17:57:46.737526] [DEBUG] [LOCAL ] CHMI: Primary data saved (22359 records). [2025-09-26T17:57:46.737716] [INFO ] [MAIN ] CHMI: Full history saved. [2025-09-26T17:57:46.737823] [INFO ] [MAIN ] Update Progress: 440/2371 symbols completed. CHMI took 24.6s. Estimated remaining: 4h 13m 21s. Rate: 7.6 symbols/min [2025-09-26T17:57:47.353282] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:57:47.524825] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:57:47.530134] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:57:47.551814] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:57:47.580866] [DEBUG] [LOCAL ] CHT: Loaded 19677 existing records from primary storage. [2025-09-26T17:57:47.581095] [INFO ] [MAIN ] CHT: Loaded 19677 existing records. [2025-09-26T17:57:47.870385] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:57:47.866479] [DEBUG] [LOCAL ] CHPT: Loaded 49531 existing records from primary storage. [2025-09-26T17:57:47.871225] [INFO ] [MAIN ] CHPT: Loaded 49531 existing records. [2025-09-26T17:57:47.872369] [DEBUG] [LOCAL ] CHWY: Loaded 54044 existing records from primary storage. [2025-09-26T17:57:47.895903] [INFO ] [MAIN ] CHWY: Loaded 54044 existing records. [2025-09-26T17:57:47.871524] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-09-26T17:57:47.897168] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-09-26T17:57:47.958503] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-09-26T17:57:47.974145] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-09-26T17:57:47.974052] [DEBUG] [LOCAL ] CI: Loaded 50220 existing records from primary storage. [2025-09-26T17:57:48.030043] [INFO ] [MAIN ] CI: Loaded 50220 existing records. [2025-09-26T17:57:48.515801] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:57:48.546778] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:57:48.578626] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-09-26T17:57:48.579013] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-09-26T17:57:48.603048] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-09-26T17:57:48.649236] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-09-26T17:57:48.653380] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-09-26T17:57:48.653747] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-09-26T17:57:48.653909] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:57:48.659199] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-09-26T17:57:48.724031] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-09-26T17:57:48.738832] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-09-26T17:57:48.755012] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-09-26T17:57:48.795105] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-09-26T17:57:48.869010] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-09-26T17:57:49.298628] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:57:49.404313] [INFO ] [REMOTE ] CHT: Fetching primary data for 2024-12. [2025-09-26T17:57:49.900237] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:57:49.925078] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2024-12. [2025-09-26T17:57:49.992966] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:57:50.009734] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2024-12. [2025-09-26T17:57:50.039421] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:57:50.040007] [INFO ] [REMOTE ] CI: Fetching primary data for 2024-12. [2025-09-26T17:57:50.307054] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-26T17:57:50.311329] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-09-26T17:57:50.988611] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-26T17:57:50.992578] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-09-26T17:57:51.667402] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-26T17:57:51.672124] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-09-26T17:57:51.704402] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-26T17:57:51.717130] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-09-26T17:57:51.925700] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-26T17:57:51.956695] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-09-26T17:57:52.050425] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-26T17:57:52.398568] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-26T17:57:52.756786] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-09-26T17:57:53.054959] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-26T17:57:53.556742] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-09-26T17:57:54.153732] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-09-26T17:57:54.224886] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-26T17:57:54.356747] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-09-26T17:57:54.828263] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-26T17:57:55.156781] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-09-26T17:57:55.956763] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-09-26T17:57:56.471690] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-26T17:57:56.511113] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-26T17:57:56.756738] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-09-26T17:57:57.255961] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-26T17:57:57.445043] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-26T17:57:57.556691] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-09-26T17:57:58.356705] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-09-26T17:57:58.557538] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-26T17:57:59.156734] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-09-26T17:57:59.961856] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-09-26T17:57:59.988567] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-26T17:58:00.756690] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-09-26T17:58:00.827435] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-26T17:58:00.989846] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-26T17:58:01.556728] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-09-26T17:58:02.356730] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-09-26T17:58:02.477459] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T17:58:02.690504] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-26T17:58:03.156730] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-09-26T17:58:03.956731] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-09-26T17:58:04.119302] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-26T17:58:04.742412] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-26T17:58:04.756678] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-09-26T17:58:05.450455] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T17:58:05.556739] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-09-26T17:58:06.355414] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T17:58:06.363271] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-09-26T17:58:06.382205] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-26T17:58:06.387194] [INFO ] [REMOTE ] CHT: Full fetch complete (27299 records). [2025-09-26T17:58:06.387396] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-09-26T17:58:06.924508] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-09-26T17:58:06.924813] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-09-26T17:58:06.925520] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-09-26T17:58:06.925618] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-09-26T17:58:06.927019] [DEBUG] [LOCAL ] CHT: Trimmed 27299 records to 19816 (keeping 200 days of data) [2025-09-26T17:58:07.081473] [DEBUG] [LOCAL ] CHT: Primary data saved (19816 records). [2025-09-26T17:58:07.081681] [INFO ] [MAIN ] CHT: Full history saved. [2025-09-26T17:58:07.081860] [INFO ] [MAIN ] Update Progress: 441/2371 symbols completed. CHT took 20.3s. Estimated remaining: 4h 14m 7s. Rate: 7.6 symbols/min [2025-09-26T17:58:07.161959] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-09-26T17:58:07.367596] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:58:07.388686] [DEBUG] [LOCAL ] CIA: Loaded 17101 existing records from primary storage. [2025-09-26T17:58:07.388850] [INFO ] [MAIN ] CIA: Loaded 17101 existing records. [2025-09-26T17:58:07.604781] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:58:07.605150] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-09-26T17:58:07.605223] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-09-26T17:58:07.606107] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-09-26T17:58:07.606180] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-09-26T17:58:07.961821] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-09-26T17:58:08.006968] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:58:08.684927] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-09-26T17:58:08.756781] [INFO ] [REMOTE ] CIA: Fetching primary data for 2024-12. [2025-09-26T17:58:09.171118] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-26T17:58:09.379114] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-26T17:58:09.398149] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-26T17:58:09.556718] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-09-26T17:58:10.356752] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-09-26T17:58:10.416463] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-26T17:58:11.156775] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-09-26T17:58:11.956734] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-09-26T17:58:12.309889] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-26T17:58:12.470668] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-26T17:58:12.756734] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-09-26T17:58:12.939830] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-26T17:58:13.556756] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-09-26T17:58:14.252540] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-26T17:58:14.356754] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-09-26T17:58:14.728444] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-26T17:58:14.997213] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-26T17:58:15.156734] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-09-26T17:58:15.805077] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-26T17:58:15.956742] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-09-26T17:58:16.756722] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-09-26T17:58:17.556744] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-09-26T17:58:17.996547] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-26T17:58:18.023820] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-26T17:58:18.356766] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-09-26T17:58:19.081965] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-26T17:58:19.156742] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-09-26T17:58:19.682738] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-26T17:58:19.956735] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-09-26T17:58:20.420876] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-26T17:58:20.756733] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-09-26T17:58:21.477348] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-26T17:58:21.556718] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-09-26T17:58:21.673913] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T17:58:21.684413] [INFO ] [REMOTE ] CI: Full fetch complete (72510 records). [2025-09-26T17:58:21.684570] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-09-26T17:58:22.109209] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-09-26T17:58:22.109323] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-09-26T17:58:22.110552] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-09-26T17:58:22.110671] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-09-26T17:58:22.113079] [DEBUG] [LOCAL ] CI: Trimmed 72510 records to 50561 (keeping 200 days of data) [2025-09-26T17:58:22.219916] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-26T17:58:22.224793] [INFO ] [REMOTE ] CIA: Full fetch complete (23452 records). [2025-09-26T17:58:22.225401] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-09-26T17:58:22.360462] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-09-26T17:58:22.645843] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-09-26T17:58:22.646184] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-09-26T17:58:22.646920] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-09-26T17:58:22.648826] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-09-26T17:58:22.651555] [DEBUG] [LOCAL ] CIA: Trimmed 23452 records to 17213 (keeping 200 days of data) [2025-09-26T17:58:22.851482] [DEBUG] [LOCAL ] CIA: Primary data saved (17213 records). [2025-09-26T17:58:22.852237] [INFO ] [MAIN ] CIA: Full history saved. [2025-09-26T17:58:22.853161] [INFO ] [MAIN ] Update Progress: 442/2371 symbols completed. CIA took 15.8s. Estimated remaining: 4h 14m 34s. Rate: 7.6 symbols/min [2025-09-26T17:58:23.051313] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:58:23.105274] [DEBUG] [LOCAL ] CIB: Loaded 31225 existing records from primary storage. [2025-09-26T17:58:23.133236] [INFO ] [MAIN ] CIB: Loaded 31225 existing records. [2025-09-26T17:58:23.157745] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-09-26T17:58:23.346860] [DEBUG] [LOCAL ] CI: Primary data saved (50561 records). [2025-09-26T17:58:23.359217] [INFO ] [MAIN ] CI: Full history saved. [2025-09-26T17:58:23.380382] [INFO ] [MAIN ] Update Progress: 443/2371 symbols completed. CI took 36.6s. Estimated remaining: 4h 13m 54s. Rate: 7.6 symbols/min [2025-09-26T17:58:23.380518] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:58:23.380819] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-09-26T17:58:23.381224] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-09-26T17:58:23.455493] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-09-26T17:58:23.466978] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-09-26T17:58:23.699833] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:58:23.719118] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-09-26T17:58:23.730233] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-09-26T17:58:23.773962] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-09-26T17:58:23.820544] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-26T17:58:23.842308] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-26T17:58:23.859411] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-09-26T17:58:24.075616] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:58:24.096892] [INFO ] [REMOTE ] CIB: Fetching primary data for 2024-12. [2025-09-26T17:58:24.351366] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:58:24.376406] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-26T17:58:24.756758] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-09-26T17:58:25.289270] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-26T17:58:25.446378] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-26T17:58:25.556724] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-09-26T17:58:26.356730] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-09-26T17:58:26.610600] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-26T17:58:26.619946] [INFO ] [REMOTE ] CHPT: Full fetch complete (73097 records). [2025-09-26T17:58:26.620204] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-09-26T17:58:26.969078] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-26T17:58:27.077326] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-09-26T17:58:27.077428] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-09-26T17:58:27.078235] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-09-26T17:58:27.078314] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-09-26T17:58:27.079898] [DEBUG] [LOCAL ] CHPT: Trimmed 73097 records to 49765 (keeping 200 days of data) [2025-09-26T17:58:27.166461] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-12. [2025-09-26T17:58:27.378713] [DEBUG] [LOCAL ] CHPT: Primary data saved (49765 records). [2025-09-26T17:58:27.378864] [INFO ] [MAIN ] CHPT: Full history saved. [2025-09-26T17:58:27.378987] [INFO ] [MAIN ] Update Progress: 444/2371 symbols completed. CHPT took 40.6s. Estimated remaining: 4h 13m 29s. Rate: 7.6 symbols/min [2025-09-26T17:58:27.557451] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:58:27.592336] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-26T17:58:27.612930] [DEBUG] [LOCAL ] CIEN: Loaded 52465 existing records from primary storage. [2025-09-26T17:58:27.613088] [INFO ] [MAIN ] CIEN: Loaded 52465 existing records. [2025-09-26T17:58:27.799416] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:58:27.799723] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-09-26T17:58:27.799782] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-09-26T17:58:27.801238] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-09-26T17:58:27.801303] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-09-26T17:58:27.966783] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-09-26T17:58:28.195607] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:58:28.324626] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-26T17:58:28.339551] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-26T17:58:28.339736] [INFO ] [REMOTE ] CHWY: Full fetch complete (77635 records). [2025-09-26T17:58:28.341389] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-09-26T17:58:28.751170] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-09-26T17:58:28.751256] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-09-26T17:58:28.752169] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-09-26T17:58:28.752258] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-09-26T17:58:28.753874] [DEBUG] [LOCAL ] CHWY: Trimmed 77635 records to 54434 (keeping 200 days of data) [2025-09-26T17:58:28.803033] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-09-26T17:58:29.076199] [DEBUG] [LOCAL ] CHWY: Primary data saved (54434 records). [2025-09-26T17:58:29.076360] [INFO ] [MAIN ] CHWY: Full history saved. [2025-09-26T17:58:29.076458] [INFO ] [MAIN ] Update Progress: 445/2371 symbols completed. CHWY took 42.3s. Estimated remaining: 4h 12m 54s. Rate: 7.6 symbols/min [2025-09-26T17:58:29.180960] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-26T17:58:29.266401] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:58:29.272591] [DEBUG] [LOCAL ] CIF: Loaded 4369 existing records from primary storage. [2025-09-26T17:58:29.272726] [INFO ] [MAIN ] CIF: Loaded 4369 existing records. [2025-09-26T17:58:29.457848] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:58:29.458129] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-09-26T17:58:29.458178] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-09-26T17:58:29.458553] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-09-26T17:58:29.458614] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-09-26T17:58:29.564255] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-09-26T17:58:29.836816] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:58:29.886320] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-26T17:58:30.356750] [INFO ] [REMOTE ] CIF: Fetching primary data for 2024-12. [2025-09-26T17:58:30.959442] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-26T17:58:31.156786] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-09-26T17:58:31.606502] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-26T17:58:31.956738] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2024-12. [2025-09-26T17:58:32.756733] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-09-26T17:58:33.556733] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-09-26T17:58:33.741779] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-26T17:58:33.798554] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-26T17:58:33.878877] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-26T17:58:34.356725] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-09-26T17:58:34.666272] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-26T17:58:35.156757] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-09-26T17:58:35.596011] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-26T17:58:35.956742] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-09-26T17:58:36.650107] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-26T17:58:36.756728] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-09-26T17:58:37.025295] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-09-26T17:58:37.556730] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-09-26T17:58:38.356756] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-09-26T17:58:38.788725] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-26T17:58:39.156710] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-09-26T17:58:39.187450] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-26T17:58:39.652997] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-26T17:58:39.654213] [INFO ] [REMOTE ] CICB: Full fetch complete (2111 records). [2025-09-26T17:58:39.654314] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-09-26T17:58:39.860524] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-26T17:58:39.860767] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:58:39.860841] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:58:39.860915] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-26T17:58:39.860996] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-26T17:58:39.861067] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-09-26T17:58:39.861152] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-09-26T17:58:39.861288] [INFO ] [MAIN ] Update Progress: 446/2371 symbols completed. CICB took 16.5s. Estimated remaining: 4h 12m 59s. Rate: 7.6 symbols/min [2025-09-26T17:58:39.961887] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-09-26T17:58:40.046416] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:58:40.094988] [DEBUG] [LOCAL ] CIG: Loaded 44114 existing records from primary storage. [2025-09-26T17:58:40.095136] [INFO ] [MAIN ] CIG: Loaded 44114 existing records. [2025-09-26T17:58:40.288055] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:58:40.288393] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-09-26T17:58:40.288471] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-09-26T17:58:40.289908] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-09-26T17:58:40.289972] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-09-26T17:58:40.706221] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:58:40.756729] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-09-26T17:58:41.556716] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-09-26T17:58:41.818661] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-26T17:58:41.893279] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-26T17:58:42.103221] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-26T17:58:42.356729] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-09-26T17:58:43.156746] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-09-26T17:58:43.715502] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-26T17:58:43.717307] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-26T17:58:43.956725] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-09-26T17:58:44.756707] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-09-26T17:58:45.366498] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-26T17:58:45.556725] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-09-26T17:58:45.638106] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-26T17:58:46.356737] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-09-26T17:58:46.541742] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-26T17:58:47.156763] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-09-26T17:58:47.546615] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-26T17:58:47.928110] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-26T17:58:47.956712] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-09-26T17:58:48.756757] [INFO ] [REMOTE ] CIG: Fetching primary data for 2024-12. [2025-09-26T17:58:49.556732] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-09-26T17:58:49.765883] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-26T17:58:50.292860] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-26T17:58:50.356769] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-09-26T17:58:50.848055] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-26T17:58:50.953667] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-26T17:58:51.156747] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-09-26T17:58:51.956758] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-09-26T17:58:52.427861] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-26T17:58:52.756735] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-09-26T17:58:53.359436] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-26T17:58:53.363662] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-26T17:58:53.556722] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-09-26T17:58:54.356726] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-09-26T17:58:54.705756] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-26T17:58:54.712551] [INFO ] [REMOTE ] CIB: Full fetch complete (44421 records). [2025-09-26T17:58:54.712726] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-09-26T17:58:54.832378] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-26T17:58:54.849883] [INFO ] [REMOTE ] CIF: Full fetch complete (6604 records). [2025-09-26T17:58:54.868795] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-09-26T17:58:55.165348] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-09-26T17:58:55.462620] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-09-26T17:58:55.503199] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-09-26T17:58:55.532566] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-09-26T17:58:55.538806] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-09-26T17:58:55.538537] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-09-26T17:58:55.539197] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-09-26T17:58:55.539379] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-09-26T17:58:55.539880] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-09-26T17:58:55.541148] [DEBUG] [LOCAL ] CIF: Trimmed 6604 records to 4396 (keeping 200 days of data) [2025-09-26T17:58:55.552496] [DEBUG] [LOCAL ] CIB: Trimmed 44421 records to 31435 (keeping 200 days of data) [2025-09-26T17:58:55.628002] [DEBUG] [LOCAL ] CIF: Primary data saved (4396 records). [2025-09-26T17:58:55.653916] [INFO ] [MAIN ] CIF: Full history saved. [2025-09-26T17:58:55.657776] [INFO ] [MAIN ] Update Progress: 447/2371 symbols completed. CIF took 26.6s. Estimated remaining: 4h 13m 25s. Rate: 7.6 symbols/min [2025-09-26T17:58:55.936801] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:58:55.946917] [DEBUG] [LOCAL ] CIB: Primary data saved (31435 records). [2025-09-26T17:58:55.947082] [INFO ] [MAIN ] CIB: Full history saved. [2025-09-26T17:58:55.947222] [INFO ] [MAIN ] Update Progress: 448/2371 symbols completed. CIB took 33.1s. Estimated remaining: 4h 12m 45s. Rate: 7.6 symbols/min [2025-09-26T17:58:55.961857] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-09-26T17:58:56.070866] [DEBUG] [LOCAL ] CII: Loaded 15570 existing records from primary storage. [2025-09-26T17:58:56.086713] [INFO ] [MAIN ] CII: Loaded 15570 existing records. [2025-09-26T17:58:56.250184] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:58:56.341150] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:58:56.341731] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-09-26T17:58:56.341800] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-09-26T17:58:56.342782] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-09-26T17:58:56.342849] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-09-26T17:58:56.523965] [DEBUG] [LOCAL ] CIM: Loaded 37567 existing records from primary storage. [2025-09-26T17:58:56.532999] [INFO ] [MAIN ] CIM: Loaded 37567 existing records. [2025-09-26T17:58:56.946848] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:58:56.969951] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:58:56.970459] [INFO ] [REMOTE ] CII: Fetching primary data for 2024-12. [2025-09-26T17:58:56.971570] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-09-26T17:58:56.971794] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-09-26T17:58:56.973407] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-09-26T17:58:56.973498] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-09-26T17:58:57.401324] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:58:57.403882] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-26T17:58:57.437388] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-26T17:58:57.556722] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-09-26T17:58:58.175923] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-26T17:58:58.356760] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-09-26T17:58:58.986757] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-26T17:58:59.156753] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-09-26T17:58:59.367146] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-26T17:58:59.956797] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-09-26T17:59:00.756770] [INFO ] [REMOTE ] CIM: Fetching primary data for 2024-12. [2025-09-26T17:59:01.050512] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-26T17:59:01.261616] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-26T17:59:01.556723] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-09-26T17:59:01.928527] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-26T17:59:02.356762] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-09-26T17:59:02.742939] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-26T17:59:03.156756] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-09-26T17:59:03.879489] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-26T17:59:03.956688] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-09-26T17:59:04.084249] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-26T17:59:04.094882] [INFO ] [REMOTE ] CIEN: Full fetch complete (75579 records). [2025-09-26T17:59:04.095047] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-09-26T17:59:04.551036] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-09-26T17:59:04.551223] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-09-26T17:59:04.552281] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-09-26T17:59:04.552394] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-09-26T17:59:04.559016] [DEBUG] [LOCAL ] CIEN: Trimmed 75579 records to 52854 (keeping 200 days of data) [2025-09-26T17:59:04.770451] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-09-26T17:59:04.770317] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-26T17:59:04.931586] [DEBUG] [LOCAL ] CIEN: Primary data saved (52854 records). [2025-09-26T17:59:04.931798] [INFO ] [MAIN ] CIEN: Full history saved. [2025-09-26T17:59:04.932024] [INFO ] [MAIN ] Update Progress: 449/2371 symbols completed. CIEN took 37.6s. Estimated remaining: 4h 12m 41s. Rate: 7.6 symbols/min [2025-09-26T17:59:05.110620] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:59:05.116954] [DEBUG] [LOCAL ] CIMN: Loaded 2678 existing records from primary storage. [2025-09-26T17:59:05.117069] [INFO ] [MAIN ] CIMN: Loaded 2678 existing records. [2025-09-26T17:59:05.309572] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:59:05.309921] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-09-26T17:59:05.309987] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-09-26T17:59:05.310349] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-09-26T17:59:05.310426] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-09-26T17:59:05.562339] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-09-26T17:59:05.688622] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:59:05.900553] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-26T17:59:06.351516] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-26T17:59:06.356864] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-09-26T17:59:07.156737] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-09-26T17:59:07.883393] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-26T17:59:07.927369] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-26T17:59:07.956723] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-09-26T17:59:08.756744] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2024-12. [2025-09-26T17:59:08.822823] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-26T17:59:09.123061] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-09-26T17:59:09.556736] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-09-26T17:59:10.071809] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-26T17:59:10.356781] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-09-26T17:59:11.156752] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-09-26T17:59:11.902036] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-26T17:59:11.932415] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-26T17:59:11.956675] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-09-26T17:59:12.756716] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-09-26T17:59:13.491166] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-26T17:59:13.542405] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-26T17:59:13.556672] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-09-26T17:59:14.356729] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-09-26T17:59:14.626402] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-26T17:59:14.630334] [INFO ] [REMOTE ] CII: Full fetch complete (23068 records). [2025-09-26T17:59:14.630457] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-09-26T17:59:15.015195] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-09-26T17:59:15.015284] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-09-26T17:59:15.015694] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-09-26T17:59:15.015758] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-09-26T17:59:15.016498] [DEBUG] [LOCAL ] CII: Trimmed 23068 records to 15638 (keeping 200 days of data) [2025-09-26T17:59:15.126311] [DEBUG] [LOCAL ] CII: Primary data saved (15638 records). [2025-09-26T17:59:15.126467] [INFO ] [MAIN ] CII: Full history saved. [2025-09-26T17:59:15.126582] [INFO ] [MAIN ] Update Progress: 450/2371 symbols completed. CII took 19.5s. Estimated remaining: 4h 12m 43s. Rate: 7.6 symbols/min [2025-09-26T17:59:15.163722] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-09-26T17:59:15.312022] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:59:15.312241] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-09-26T17:59:15.312284] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-09-26T17:59:15.312551] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-09-26T17:59:15.312625] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-26T17:59:15.312724] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-09-26T17:59:15.312786] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-09-26T17:59:15.689525] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:59:15.783607] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-26T17:59:15.818449] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-26T17:59:15.956724] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-09-26T17:59:16.405245] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-26T17:59:16.756715] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-09-26T17:59:17.310556] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-26T17:59:17.556729] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-09-26T17:59:18.356736] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-09-26T17:59:18.756622] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-26T17:59:19.121999] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-26T17:59:19.156752] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-12. [2025-09-26T17:59:19.751313] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-26T17:59:19.956736] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-09-26T17:59:20.507851] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-26T17:59:20.756747] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-09-26T17:59:21.193983] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-26T17:59:21.556738] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-09-26T17:59:21.989917] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-26T17:59:22.356739] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-09-26T17:59:23.156728] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-09-26T17:59:23.616500] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-26T17:59:23.618095] [INFO ] [REMOTE ] CIMN: Full fetch complete (3903 records). [2025-09-26T17:59:23.618191] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-09-26T17:59:23.961690] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-09-26T17:59:24.028614] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-09-26T17:59:24.028929] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-09-26T17:59:24.029120] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-09-26T17:59:24.044284] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-09-26T17:59:24.058603] [DEBUG] [LOCAL ] CIMN: Trimmed 3903 records to 2697 (keeping 200 days of data) [2025-09-26T17:59:24.060160] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-26T17:59:24.088771] [DEBUG] [LOCAL ] CIMN: Primary data saved (2697 records). [2025-09-26T17:59:24.088929] [INFO ] [MAIN ] CIMN: Full history saved. [2025-09-26T17:59:24.089028] [INFO ] [MAIN ] Update Progress: 451/2371 symbols completed. CIMN took 19.2s. Estimated remaining: 4h 12m 40s. Rate: 7.6 symbols/min [2025-09-26T17:59:24.263429] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:59:24.263667] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-09-26T17:59:24.263725] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-09-26T17:59:24.263874] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-09-26T17:59:24.263922] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-09-26T17:59:24.263965] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-09-26T17:59:24.263999] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-09-26T17:59:24.649882] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:59:24.756739] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2024-12. [2025-09-26T17:59:24.950393] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:59:24.950781] [WARN ] [REMOTE ] CIMP: No data returned for month 2024-12 [2025-09-26T17:59:25.556732] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-01. [2025-09-26T17:59:25.603981] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-26T17:59:25.751891] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:59:25.752208] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-01 [2025-09-26T17:59:26.356725] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-09-26T17:59:26.822106] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-26T17:59:27.156726] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-09-26T17:59:27.681834] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-26T17:59:27.956728] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-09-26T17:59:28.756714] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-09-26T17:59:29.556681] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-09-26T17:59:29.559497] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-26T17:59:29.570618] [INFO ] [REMOTE ] CIG: Full fetch complete (61041 records). [2025-09-26T17:59:29.570782] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-09-26T17:59:29.984757] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-09-26T17:59:29.984881] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-09-26T17:59:29.985702] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-09-26T17:59:29.985770] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-09-26T17:59:29.987290] [DEBUG] [LOCAL ] CIG: Trimmed 61041 records to 44447 (keeping 200 days of data) [2025-09-26T17:59:30.202209] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-26T17:59:30.253670] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-26T17:59:30.307068] [DEBUG] [LOCAL ] CIG: Primary data saved (44447 records). [2025-09-26T17:59:30.307286] [INFO ] [MAIN ] CIG: Full history saved. [2025-09-26T17:59:30.307447] [INFO ] [MAIN ] Update Progress: 452/2371 symbols completed. CIG took 50.4s. Estimated remaining: 4h 12m 25s. Rate: 7.6 symbols/min [2025-09-26T17:59:30.364286] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-02. [2025-09-26T17:59:30.488394] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:59:30.507889] [DEBUG] [LOCAL ] CINT: Loaded 18698 existing records from primary storage. [2025-09-26T17:59:30.508046] [INFO ] [MAIN ] CINT: Loaded 18698 existing records. [2025-09-26T17:59:30.617675] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:59:30.628964] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-02 [2025-09-26T17:59:30.700564] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:59:30.700884] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-09-26T17:59:30.700949] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-09-26T17:59:30.701585] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-09-26T17:59:30.701682] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-09-26T17:59:31.082580] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:59:31.156752] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-09-26T17:59:31.956738] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-03. [2025-09-26T17:59:32.526613] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:59:32.526990] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-03 [2025-09-26T17:59:32.553761] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-26T17:59:32.756733] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-04. [2025-09-26T17:59:32.951380] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:59:32.951775] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-04 [2025-09-26T17:59:33.556748] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-05. [2025-09-26T17:59:33.754118] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:59:33.754522] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-05 [2025-09-26T17:59:34.356724] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-06. [2025-09-26T17:59:34.550975] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:59:34.551319] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-06 [2025-09-26T17:59:35.156727] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-07. [2025-09-26T17:59:35.360817] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:59:35.361175] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-07 [2025-09-26T17:59:35.956721] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-09-26T17:59:36.756721] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-09-26T17:59:37.463121] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-26T17:59:37.464043] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-26T17:59:37.556735] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-09-26T17:59:38.356748] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-08. [2025-09-26T17:59:38.699696] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:59:38.707987] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-08 [2025-09-26T17:59:38.725739] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-26T17:59:39.156738] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-12. [2025-09-26T17:59:39.956712] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-09-26T17:59:40.080487] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-26T17:59:40.756732] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-09. [2025-09-26T17:59:41.524703] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-26T17:59:41.556679] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-09-26T17:59:41.715109] [INFO ] [REMOTE ] CIMP: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-26T17:59:41.716979] [INFO ] [REMOTE ] CIMP: Full fetch complete (992 records). [2025-09-26T17:59:41.717046] [DEBUG] [VALIDATOR ] CIMP: Validating primary data. [2025-09-26T17:59:41.904439] [WARN ] [VALIDATOR ] CIMP: Validation failed - insufficient historical data. Have 7 unique days, need 200 days [2025-09-26T17:59:41.904735] [FATAL] [MAIN ] CIMP: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:59:41.904847] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:59:41.904925] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-09-26T17:59:41.904994] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-09-26T17:59:41.905031] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-09-26T17:59:41.905089] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-09-26T17:59:41.905185] [INFO ] [MAIN ] Update Progress: 453/2371 symbols completed. CIMP took 17.8s. Estimated remaining: 4h 12m 33s. Rate: 7.6 symbols/min [2025-09-26T17:59:42.084587] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:59:42.110400] [DEBUG] [LOCAL ] CIO: Loaded 20205 existing records from primary storage. [2025-09-26T17:59:42.110562] [INFO ] [MAIN ] CIO: Loaded 20205 existing records. [2025-09-26T17:59:42.308369] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:59:42.308692] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-09-26T17:59:42.308762] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-09-26T17:59:42.309405] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-09-26T17:59:42.309478] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-09-26T17:59:42.360238] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-09-26T17:59:42.529247] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-26T17:59:42.716297] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:59:43.156738] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-12. [2025-09-26T17:59:43.485687] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-26T17:59:43.493404] [INFO ] [REMOTE ] CIM: Full fetch complete (54664 records). [2025-09-26T17:59:43.493600] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-09-26T17:59:43.889452] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-09-26T17:59:43.889539] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-09-26T17:59:43.890246] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-09-26T17:59:43.890315] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-09-26T17:59:43.891565] [DEBUG] [LOCAL ] CIM: Trimmed 54664 records to 37858 (keeping 200 days of data) [2025-09-26T17:59:43.963016] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-09-26T17:59:44.191710] [DEBUG] [LOCAL ] CIM: Primary data saved (37858 records). [2025-09-26T17:59:44.191861] [INFO ] [MAIN ] CIM: Full history saved. [2025-09-26T17:59:44.191963] [INFO ] [MAIN ] Update Progress: 454/2371 symbols completed. CIM took 48.2s. Estimated remaining: 4h 12m 1s. Rate: 7.6 symbols/min [2025-09-26T17:59:44.382264] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-26T17:59:44.409478] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:59:44.448197] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-26T17:59:44.451579] [DEBUG] [LOCAL ] CION: Loaded 29526 existing records from primary storage. [2025-09-26T17:59:44.451759] [INFO ] [MAIN ] CION: Loaded 29526 existing records. [2025-09-26T17:59:44.638868] [WARN ] [MAIN ] CION: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:59:44.639135] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-09-26T17:59:44.639186] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-09-26T17:59:44.640042] [DEBUG] [LOCAL ] CION: Deleted primary data file. [2025-09-26T17:59:44.640104] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-09-26T17:59:44.761853] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-09-26T17:59:45.018552] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:59:45.556707] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-09-26T17:59:45.782681] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-26T17:59:46.277559] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-26T17:59:46.356766] [INFO ] [REMOTE ] CION: Fetching primary data for 2024-12. [2025-09-26T17:59:47.156757] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-09-26T17:59:47.394148] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-26T17:59:47.688533] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-26T17:59:47.956755] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-09-26T17:59:48.756695] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-09-26T17:59:48.866354] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-26T17:59:49.323837] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-26T17:59:49.556739] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-09-26T17:59:50.356697] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-09-26T17:59:50.707354] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-26T17:59:50.723605] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-26T17:59:51.156749] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-09-26T17:59:51.650181] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-26T17:59:51.956759] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-09-26T17:59:52.756744] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-09-26T17:59:53.006540] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-26T17:59:53.109794] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-26T17:59:53.556740] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-09-26T17:59:54.356774] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-09-26T17:59:54.709067] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-26T17:59:55.156762] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-09-26T17:59:55.503947] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-26T17:59:55.956727] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-09-26T17:59:56.531119] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-26T17:59:56.547795] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-26T17:59:56.756719] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-09-26T17:59:57.556726] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-09-26T17:59:57.720911] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-26T17:59:58.347304] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-26T17:59:58.356675] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-09-26T17:59:59.156695] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-09-26T17:59:59.287285] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-26T17:59:59.956746] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-09-26T18:00:00.151093] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-26T18:00:00.152907] [INFO ] [REMOTE ] CIMO: Full fetch complete (5472 records). [2025-09-26T18:00:00.152982] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-09-26T18:00:00.345832] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-26T18:00:00.346058] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:00:00.346141] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:00:00.346217] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-26T18:00:00.346285] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-09-26T18:00:00.346325] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-09-26T18:00:00.346384] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-09-26T18:00:00.346511] [INFO ] [MAIN ] Update Progress: 455/2371 symbols completed. CIMO took 45.2s. Estimated remaining: 4h 12m 28s. Rate: 7.6 symbols/min [2025-09-26T18:00:00.529371] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:00:00.529683] [DEBUG] [LOCAL ] CIVI: No existing data file found in primary storage. [2025-09-26T18:00:00.529742] [WARN ] [MAIN ] CIVI: No existing data found, performing full refresh instead. [2025-09-26T18:00:00.529894] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-09-26T18:00:00.529941] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-09-26T18:00:00.529987] [DEBUG] [LOCAL ] CIVI: No primary data file found to delete. [2025-09-26T18:00:00.530021] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-09-26T18:00:00.674896] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-26T18:00:00.764521] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-09-26T18:00:00.950704] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:00:01.556742] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-09-26T18:00:02.086488] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-26T18:00:02.356753] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-09-26T18:00:03.156780] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-09-26T18:00:03.453368] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-26T18:00:03.514281] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-26T18:00:03.519607] [INFO ] [REMOTE ] CINT: Full fetch complete (26042 records). [2025-09-26T18:00:03.519868] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-09-26T18:00:03.520544] [FATAL] [VALIDATOR ] CINT: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:00:03.520638] [FATAL] [MAIN ] CINT: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:00:03.520769] [WARN ] [MAIN ] CINT: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:00:03.520832] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-09-26T18:00:03.520899] [DEBUG] [LOCAL ] CINT: No primary data file found to delete. [2025-09-26T18:00:03.520937] [INFO ] [LOCAL ] CINT: Starting deletion of derivative data. [2025-09-26T18:00:03.521431] [DEBUG] [LOCAL ] CINT: Deleted derivative data file. [2025-09-26T18:00:03.521573] [INFO ] [MAIN ] Update Progress: 456/2371 symbols completed. CINT took 33.2s. Estimated remaining: 4h 12m 0s. Rate: 7.6 symbols/min [2025-09-26T18:00:03.713496] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:00:03.781716] [DEBUG] [LOCAL ] CL: Loaded 54034 existing records from primary storage. [2025-09-26T18:00:03.781902] [INFO ] [MAIN ] CL: Loaded 54034 existing records. [2025-09-26T18:00:03.976286] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2024-12. [2025-09-26T18:00:03.989514] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:00:03.989986] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-09-26T18:00:03.990058] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-09-26T18:00:04.000371] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-09-26T18:00:04.012442] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-09-26T18:00:04.096772] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-26T18:00:04.420229] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:00:04.756724] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-09-26T18:00:05.556717] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-09-26T18:00:05.653930] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-26T18:00:05.685514] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-26T18:00:06.356750] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-09-26T18:00:06.444886] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-26T18:00:07.156771] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-09-26T18:00:07.213339] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-26T18:00:07.218870] [INFO ] [REMOTE ] CIO: Full fetch complete (28734 records). [2025-09-26T18:00:07.218962] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-09-26T18:00:07.219487] [FATAL] [VALIDATOR ] CIO: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:00:07.219576] [FATAL] [MAIN ] CIO: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:00:07.219620] [WARN ] [MAIN ] CIO: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:00:07.219796] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-09-26T18:00:07.219877] [DEBUG] [LOCAL ] CIO: No primary data file found to delete. [2025-09-26T18:00:07.219915] [INFO ] [LOCAL ] CIO: Starting deletion of derivative data. [2025-09-26T18:00:07.220255] [DEBUG] [LOCAL ] CIO: Deleted derivative data file. [2025-09-26T18:00:07.220371] [INFO ] [MAIN ] Update Progress: 457/2371 symbols completed. CIO took 25.3s. Estimated remaining: 4h 11m 35s. Rate: 7.6 symbols/min [2025-09-26T18:00:07.402817] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:00:07.402999] [DEBUG] [LOCAL ] CLB: No existing data file found in primary storage. [2025-09-26T18:00:07.403038] [WARN ] [MAIN ] CLB: No existing data found, performing full refresh instead. [2025-09-26T18:00:07.403185] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-09-26T18:00:07.403229] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-09-26T18:00:07.403270] [DEBUG] [LOCAL ] CLB: No primary data file found to delete. [2025-09-26T18:00:07.403302] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-09-26T18:00:07.772257] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:00:07.956806] [INFO ] [REMOTE ] CLB: Fetching primary data for 2024-12. [2025-09-26T18:00:08.756749] [INFO ] [REMOTE ] CL: Fetching primary data for 2024-12. [2025-09-26T18:00:08.986892] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-26T18:00:09.333220] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-26T18:00:09.556734] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-09-26T18:00:10.325734] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-26T18:00:10.356742] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-09-26T18:00:10.463302] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-26T18:00:11.156770] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-09-26T18:00:11.274239] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-26T18:00:11.956772] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-09-26T18:00:12.425082] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-26T18:00:12.756765] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-09-26T18:00:13.303592] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-26T18:00:13.556738] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-09-26T18:00:14.016219] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-26T18:00:14.356748] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-09-26T18:00:14.898531] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-26T18:00:15.156761] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-09-26T18:00:15.528539] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-26T18:00:15.956765] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-09-26T18:00:16.756733] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-09-26T18:00:17.038098] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-26T18:00:17.069527] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-26T18:00:17.075397] [INFO ] [REMOTE ] CION: Full fetch complete (41180 records). [2025-09-26T18:00:17.075555] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-09-26T18:00:17.500570] [DEBUG] [VALIDATOR ] CION: All expected trading days are present. [2025-09-26T18:00:17.500695] [DEBUG] [VALIDATOR ] CION: Primary data validation passed. [2025-09-26T18:00:17.501308] [INFO ] [MAIN ] CION: Fetched primary data is valid. [2025-09-26T18:00:17.501366] [DEBUG] [LOCAL ] CION: Saving primary data. [2025-09-26T18:00:17.502597] [DEBUG] [LOCAL ] CION: Trimmed 41180 records to 29661 (keeping 200 days of data) [2025-09-26T18:00:17.558395] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-09-26T18:00:17.697500] [DEBUG] [LOCAL ] CION: Primary data saved (29661 records). [2025-09-26T18:00:17.697685] [INFO ] [MAIN ] CION: Full history saved. [2025-09-26T18:00:17.699611] [INFO ] [MAIN ] Update Progress: 458/2371 symbols completed. CION took 33.5s. Estimated remaining: 4h 11m 38s. Rate: 7.6 symbols/min [2025-09-26T18:00:17.893140] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:00:17.935181] [DEBUG] [LOCAL ] CLCO: Loaded 13067 existing records from primary storage. [2025-09-26T18:00:17.936134] [INFO ] [MAIN ] CLCO: Loaded 13067 existing records. [2025-09-26T18:00:17.937357] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-26T18:00:18.146021] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:00:18.146408] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-09-26T18:00:18.146465] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-09-26T18:00:18.146900] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-09-26T18:00:18.146960] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-09-26T18:00:18.365020] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-09-26T18:00:18.602099] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:00:19.100170] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-26T18:00:19.156715] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-09-26T18:00:19.607048] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-26T18:00:19.956744] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-09-26T18:00:20.756729] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2024-12. [2025-09-26T18:00:20.897079] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-26T18:00:20.926911] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-26T18:00:21.556721] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-09-26T18:00:21.977222] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-26T18:00:22.356750] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-09-26T18:00:23.156754] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-09-26T18:00:23.213692] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-26T18:00:23.401562] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-26T18:00:23.956739] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-09-26T18:00:24.756726] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-09-26T18:00:24.824339] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-26T18:00:25.307850] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-26T18:00:25.556756] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-09-26T18:00:26.356739] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-09-26T18:00:26.474103] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-26T18:00:26.510714] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-26T18:00:27.156736] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-09-26T18:00:27.851456] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-26T18:00:27.859072] [INFO ] [REMOTE ] CLB: Full fetch complete (46502 records). [2025-09-26T18:00:27.859210] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-09-26T18:00:27.963917] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-09-26T18:00:28.279524] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-09-26T18:00:28.279617] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-09-26T18:00:28.280234] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-09-26T18:00:28.280318] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-09-26T18:00:28.281353] [DEBUG] [LOCAL ] CLB: Trimmed 46502 records to 33475 (keeping 200 days of data) [2025-09-26T18:00:28.494046] [DEBUG] [LOCAL ] CLB: Primary data saved (33475 records). [2025-09-26T18:00:28.494289] [INFO ] [MAIN ] CLB: Full history saved. [2025-09-26T18:00:28.494438] [INFO ] [MAIN ] Update Progress: 459/2371 symbols completed. CLB took 21.3s. Estimated remaining: 4h 11m 42s. Rate: 7.6 symbols/min [2025-09-26T18:00:28.687103] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:00:28.741898] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-26T18:00:28.761827] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-09-26T18:00:28.763248] [DEBUG] [LOCAL ] CLDT: Loaded 25900 existing records from primary storage. [2025-09-26T18:00:28.764606] [INFO ] [MAIN ] CLDT: Loaded 25900 existing records. [2025-09-26T18:00:28.951895] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:00:28.952171] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-09-26T18:00:28.952219] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-09-26T18:00:28.953061] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-09-26T18:00:28.953124] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-09-26T18:00:29.339344] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:00:29.556716] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2024-12. [2025-09-26T18:00:29.609563] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-26T18:00:30.177772] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-26T18:00:30.356726] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-09-26T18:00:30.479701] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-26T18:00:31.156743] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-09-26T18:00:31.339447] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-26T18:00:31.956770] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-09-26T18:00:32.250822] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-26T18:00:32.726979] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-26T18:00:32.756695] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-09-26T18:00:33.255059] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-26T18:00:33.556753] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-09-26T18:00:34.356746] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-09-26T18:00:35.156765] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-09-26T18:00:35.463090] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-26T18:00:35.500300] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-26T18:00:35.956744] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-09-26T18:00:36.635512] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-26T18:00:36.756734] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-09-26T18:00:36.900049] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-26T18:00:37.556721] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-09-26T18:00:38.041315] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-26T18:00:38.356744] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-09-26T18:00:38.544640] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-26T18:00:39.156744] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-09-26T18:00:39.857492] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-26T18:00:39.931523] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-26T18:00:39.956723] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-09-26T18:00:40.756731] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-09-26T18:00:41.365134] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-26T18:00:41.387702] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-26T18:00:41.556729] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-09-26T18:00:42.192368] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-26T18:00:42.356762] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-09-26T18:00:43.156714] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-09-26T18:00:43.287488] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-26T18:00:43.956782] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-09-26T18:00:44.756782] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-09-26T18:00:44.807878] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-26T18:00:45.556743] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-09-26T18:00:45.784912] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-26T18:00:45.789158] [INFO ] [REMOTE ] CLCO: Full fetch complete (22890 records). [2025-09-26T18:00:45.789353] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-09-26T18:00:46.375771] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-09-26T18:00:46.390291] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-09-26T18:00:46.390583] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-09-26T18:00:46.391043] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-09-26T18:00:46.391132] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-09-26T18:00:46.422599] [DEBUG] [LOCAL ] CLCO: Trimmed 22890 records to 13189 (keeping 200 days of data) [2025-09-26T18:00:46.426301] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-09-26T18:00:46.492369] [INFO ] [REMOTE ] CIVI: Full fetch complete (75571 records). [2025-09-26T18:00:46.495406] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-09-26T18:00:46.770567] [DEBUG] [LOCAL ] CLCO: Primary data saved (13189 records). [2025-09-26T18:00:46.798300] [INFO ] [MAIN ] CLCO: Full history saved. [2025-09-26T18:00:46.813767] [INFO ] [MAIN ] Update Progress: 460/2371 symbols completed. CLCO took 29.1s. Estimated remaining: 4h 12m 17s. Rate: 7.6 symbols/min [2025-09-26T18:00:47.137288] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-09-26T18:00:47.137630] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-09-26T18:00:47.140358] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-09-26T18:00:47.140465] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-09-26T18:00:47.161525] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:00:47.162338] [DEBUG] [LOCAL ] CLF: No existing data file found in primary storage. [2025-09-26T18:00:47.162552] [WARN ] [MAIN ] CLF: No existing data found, performing full refresh instead. [2025-09-26T18:00:47.163087] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-09-26T18:00:47.163162] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-09-26T18:00:47.163234] [DEBUG] [LOCAL ] CLF: No primary data file found to delete. [2025-09-26T18:00:47.163272] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-09-26T18:00:47.175617] [DEBUG] [LOCAL ] CIVI: Trimmed 75571 records to 53363 (keeping 200 days of data) [2025-09-26T18:00:47.724237] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:00:47.728838] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-26T18:00:47.730115] [INFO ] [REMOTE ] CLF: Fetching primary data for 2024-12. [2025-09-26T18:00:47.770470] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-26T18:00:47.785946] [INFO ] [REMOTE ] CL: Full fetch complete (77616 records). [2025-09-26T18:00:47.786783] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-09-26T18:00:47.974599] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-09-26T18:00:48.338331] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-09-26T18:00:48.338762] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-09-26T18:00:48.339866] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-09-26T18:00:48.340207] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-09-26T18:00:48.348304] [DEBUG] [LOCAL ] CL: Trimmed 77616 records to 54424 (keeping 200 days of data) [2025-09-26T18:00:48.681516] [DEBUG] [LOCAL ] CIVI: Primary data saved (53363 records). [2025-09-26T18:00:48.682137] [INFO ] [MAIN ] CIVI: Full history saved. [2025-09-26T18:00:48.682543] [INFO ] [MAIN ] Update Progress: 461/2371 symbols completed. CIVI took 48.3s. Estimated remaining: 4h 11m 44s. Rate: 7.6 symbols/min [2025-09-26T18:00:48.891447] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:00:48.915151] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-26T18:00:48.922462] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-09-26T18:00:49.029209] [DEBUG] [LOCAL ] CLH: Loaded 28304 existing records from primary storage. [2025-09-26T18:00:49.030257] [INFO ] [MAIN ] CLH: Loaded 28304 existing records. [2025-09-26T18:00:49.165725] [DEBUG] [LOCAL ] CL: Primary data saved (54424 records). [2025-09-26T18:00:49.176211] [INFO ] [MAIN ] CL: Full history saved. [2025-09-26T18:00:49.181512] [INFO ] [MAIN ] Update Progress: 462/2371 symbols completed. CL took 45.7s. Estimated remaining: 4h 11m 6s. Rate: 7.6 symbols/min [2025-09-26T18:00:49.253857] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:00:49.254431] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-09-26T18:00:49.254588] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-09-26T18:00:49.267107] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-09-26T18:00:49.267499] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-09-26T18:00:49.613070] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:00:49.773850] [DEBUG] [LOCAL ] CLPR: Loaded 11575 existing records from primary storage. [2025-09-26T18:00:49.774216] [INFO ] [MAIN ] CLPR: Loaded 11575 existing records. [2025-09-26T18:00:50.003152] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:00:50.026843] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-26T18:00:50.042633] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-12. [2025-09-26T18:00:50.055498] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-26T18:00:50.129506] [WARN ] [MAIN ] CLPR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:00:50.134001] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-09-26T18:00:50.134081] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-09-26T18:00:50.134569] [DEBUG] [LOCAL ] CLPR: Deleted primary data file. [2025-09-26T18:00:50.134639] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-09-26T18:00:50.361800] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-09-26T18:00:50.517101] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:00:51.156737] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2024-12. [2025-09-26T18:00:51.672472] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-26T18:00:51.887448] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-26T18:00:51.940343] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-26T18:00:51.956675] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-09-26T18:00:52.756753] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-09-26T18:00:52.878845] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-26T18:00:53.556726] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-09-26T18:00:54.356750] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-09-26T18:00:54.396538] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-26T18:00:54.930840] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-26T18:00:55.156768] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-09-26T18:00:55.275527] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-26T18:00:55.281421] [INFO ] [REMOTE ] CLDT: Full fetch complete (36971 records). [2025-09-26T18:00:55.281549] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-09-26T18:00:55.692500] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-09-26T18:00:55.692583] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-09-26T18:00:55.693103] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-09-26T18:00:55.693185] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-09-26T18:00:55.694142] [DEBUG] [LOCAL ] CLDT: Trimmed 36971 records to 26082 (keeping 200 days of data) [2025-09-26T18:00:55.840867] [DEBUG] [LOCAL ] CLDT: Primary data saved (26082 records). [2025-09-26T18:00:55.841061] [INFO ] [MAIN ] CLDT: Full history saved. [2025-09-26T18:00:55.841182] [INFO ] [MAIN ] Update Progress: 463/2371 symbols completed. CLDT took 27.3s. Estimated remaining: 4h 10m 53s. Rate: 7.6 symbols/min [2025-09-26T18:00:55.961803] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-09-26T18:00:56.029209] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:00:56.085017] [DEBUG] [LOCAL ] CLS: Loaded 54024 existing records from primary storage. [2025-09-26T18:00:56.085271] [INFO ] [MAIN ] CLS: Loaded 54024 existing records. [2025-09-26T18:00:56.282024] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:00:56.282306] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-09-26T18:00:56.282354] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-09-26T18:00:56.283924] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-09-26T18:00:56.283991] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-09-26T18:00:56.664524] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:00:56.756742] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-09-26T18:00:57.124175] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-26T18:00:57.173419] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-26T18:00:57.416289] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-26T18:00:57.556757] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-09-26T18:00:58.356730] [INFO ] [REMOTE ] CLS: Fetching primary data for 2024-12. [2025-09-26T18:00:59.156730] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-09-26T18:00:59.815024] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-26T18:00:59.956757] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-09-26T18:01:00.165986] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-26T18:01:00.378433] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-26T18:01:00.756732] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-09-26T18:01:01.485312] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-26T18:01:01.556726] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-09-26T18:01:01.877148] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-26T18:01:02.356758] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-09-26T18:01:03.156719] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-09-26T18:01:03.184821] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-26T18:01:03.948463] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-26T18:01:03.962465] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-09-26T18:01:03.967889] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-26T18:01:04.756816] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-09-26T18:01:05.556775] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-09-26T18:01:06.268351] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-09-26T18:01:06.344584] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-26T18:01:06.356673] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-09-26T18:01:07.156767] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-09-26T18:01:07.273245] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-26T18:01:07.522908] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-26T18:01:07.956801] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-09-26T18:01:08.756758] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-09-26T18:01:09.556710] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-09-26T18:01:09.697901] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (2.54 seconds). [2025-09-26T18:01:09.837159] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-26T18:01:09.961637] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-26T18:01:10.356737] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-09-26T18:01:10.416454] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-26T18:01:11.156775] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-09-26T18:01:11.956757] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-09-26T18:01:12.521997] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-26T18:01:12.657704] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-26T18:01:12.756739] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-09-26T18:01:13.556769] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-09-26T18:01:13.575813] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-26T18:01:13.758520] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-26T18:01:13.769815] [INFO ] [REMOTE ] CLF: Full fetch complete (77809 records). [2025-09-26T18:01:13.770006] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-09-26T18:01:14.199205] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-09-26T18:01:14.199319] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-09-26T18:01:14.200207] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-09-26T18:01:14.200280] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-09-26T18:01:14.202048] [DEBUG] [LOCAL ] CLF: Trimmed 77809 records to 54521 (keeping 200 days of data) [2025-09-26T18:01:14.376600] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-09-26T18:01:14.546713] [DEBUG] [LOCAL ] CLF: Primary data saved (54521 records). [2025-09-26T18:01:14.547083] [INFO ] [MAIN ] CLF: Full history saved. [2025-09-26T18:01:14.547228] [INFO ] [MAIN ] Update Progress: 464/2371 symbols completed. CLF took 27.7s. Estimated remaining: 4h 11m 29s. Rate: 7.6 symbols/min [2025-09-26T18:01:14.748302] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:01:14.801294] [DEBUG] [LOCAL ] CLVT: Loaded 52329 existing records from primary storage. [2025-09-26T18:01:14.801457] [INFO ] [MAIN ] CLVT: Loaded 52329 existing records. [2025-09-26T18:01:15.029481] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:01:15.031802] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-26T18:01:15.037910] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-09-26T18:01:15.038611] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-09-26T18:01:15.040392] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-09-26T18:01:15.040471] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-09-26T18:01:15.157563] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-09-26T18:01:15.367253] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-26T18:01:15.455681] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:01:15.956770] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-09-26T18:01:16.756772] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2024-12. [2025-09-26T18:01:17.250255] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-26T18:01:17.255676] [INFO ] [REMOTE ] CLH: Full fetch complete (41686 records). [2025-09-26T18:01:17.255828] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-09-26T18:01:17.256571] [FATAL] [VALIDATOR ] CLH: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:01:17.256702] [FATAL] [MAIN ] CLH: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:01:17.256758] [WARN ] [MAIN ] CLH: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:01:17.256805] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-09-26T18:01:17.256866] [DEBUG] [LOCAL ] CLH: No primary data file found to delete. [2025-09-26T18:01:17.256921] [INFO ] [LOCAL ] CLH: Starting deletion of derivative data. [2025-09-26T18:01:17.257385] [DEBUG] [LOCAL ] CLH: Deleted derivative data file. [2025-09-26T18:01:17.257491] [INFO ] [MAIN ] Update Progress: 465/2371 symbols completed. CLH took 28.6s. Estimated remaining: 4h 11m 0s. Rate: 7.6 symbols/min [2025-09-26T18:01:17.447462] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:01:17.472939] [DEBUG] [LOCAL ] CLW: Loaded 22067 existing records from primary storage. [2025-09-26T18:01:17.473143] [INFO ] [MAIN ] CLW: Loaded 22067 existing records. [2025-09-26T18:01:17.560297] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-09-26T18:01:17.667924] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:01:17.668246] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-09-26T18:01:17.668367] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-09-26T18:01:17.669113] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-09-26T18:01:17.669175] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-09-26T18:01:18.086382] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.93 seconds). [2025-09-26T18:01:18.090591] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:01:18.356750] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-09-26T18:01:18.390163] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-26T18:01:18.392091] [INFO ] [REMOTE ] CLPR: Full fetch complete (17666 records). [2025-09-26T18:01:18.392164] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-09-26T18:01:18.807986] [DEBUG] [VALIDATOR ] CLPR: All expected trading days are present. [2025-09-26T18:01:18.808107] [DEBUG] [VALIDATOR ] CLPR: Primary data validation passed. [2025-09-26T18:01:18.808535] [INFO ] [MAIN ] CLPR: Fetched primary data is valid. [2025-09-26T18:01:18.808935] [DEBUG] [LOCAL ] CLPR: Saving primary data. [2025-09-26T18:01:18.839250] [DEBUG] [LOCAL ] CLPR: Trimmed 17666 records to 11615 (keeping 200 days of data) [2025-09-26T18:01:18.841235] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-26T18:01:18.929998] [DEBUG] [LOCAL ] CLPR: Primary data saved (11615 records). [2025-09-26T18:01:18.930183] [INFO ] [MAIN ] CLPR: Full history saved. [2025-09-26T18:01:18.930292] [INFO ] [MAIN ] Update Progress: 466/2371 symbols completed. CLPR took 29.7s. Estimated remaining: 4h 10m 27s. Rate: 7.6 symbols/min [2025-09-26T18:01:19.133322] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:01:19.133576] [DEBUG] [LOCAL ] CLX: No existing data file found in primary storage. [2025-09-26T18:01:19.133632] [WARN ] [MAIN ] CLX: No existing data found, performing full refresh instead. [2025-09-26T18:01:19.133848] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-09-26T18:01:19.134141] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-09-26T18:01:19.134197] [DEBUG] [LOCAL ] CLX: No primary data file found to delete. [2025-09-26T18:01:19.134251] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-09-26T18:01:19.161989] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-09-26T18:01:19.557219] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:01:19.956841] [INFO ] [REMOTE ] CLX: Fetching primary data for 2024-12. [2025-09-26T18:01:20.768429] [INFO ] [REMOTE ] CLW: Fetching primary data for 2024-12. [2025-09-26T18:01:20.795997] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-26T18:01:20.993992] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-26T18:01:21.251848] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-26T18:01:21.556742] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-09-26T18:01:21.867468] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-26T18:01:22.356737] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-09-26T18:01:22.698857] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-26T18:01:23.156756] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-09-26T18:01:23.956714] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-09-26T18:01:24.325354] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-26T18:01:24.437614] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-26T18:01:24.756794] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-09-26T18:01:24.898918] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-26T18:01:25.556805] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-09-26T18:01:26.356748] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-09-26T18:01:26.720888] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-26T18:01:26.871039] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-26T18:01:27.156756] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-09-26T18:01:27.956782] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-09-26T18:01:28.756708] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-09-26T18:01:28.848191] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-09-26T18:01:29.013020] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-26T18:01:29.075084] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-26T18:01:29.556739] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-09-26T18:01:30.358049] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-09-26T18:01:30.364214] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-26T18:01:31.156727] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-09-26T18:01:31.956760] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-09-26T18:01:32.126190] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-09-26T18:01:32.373779] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-26T18:01:32.542717] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-26T18:01:32.756729] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-09-26T18:01:33.544047] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-26T18:01:33.556680] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-09-26T18:01:33.587101] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-26T18:01:34.356731] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-09-26T18:01:35.156758] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-09-26T18:01:35.845409] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-26T18:01:35.908227] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-26T18:01:35.956787] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-09-26T18:01:36.162149] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-26T18:01:36.756812] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-09-26T18:01:37.556729] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-09-26T18:01:37.671203] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-26T18:01:38.078485] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-26T18:01:38.356768] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-09-26T18:01:39.156754] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-09-26T18:01:39.437735] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-26T18:01:39.956722] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-09-26T18:01:40.316890] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.76 seconds). [2025-09-26T18:01:40.329766] [INFO ] [REMOTE ] CLS: Full fetch complete (77448 records). [2025-09-26T18:01:40.330040] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-09-26T18:01:40.759779] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-09-26T18:01:40.850800] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-09-26T18:01:40.850924] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-09-26T18:01:40.851911] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-09-26T18:01:40.852046] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-09-26T18:01:40.887697] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-26T18:01:40.886594] [DEBUG] [LOCAL ] CLS: Trimmed 77448 records to 54412 (keeping 200 days of data) [2025-09-26T18:01:41.282848] [DEBUG] [LOCAL ] CLS: Primary data saved (54412 records). [2025-09-26T18:01:41.283279] [INFO ] [MAIN ] CLS: Full history saved. [2025-09-26T18:01:41.283491] [INFO ] [MAIN ] Update Progress: 467/2371 symbols completed. CLS took 45.4s. Estimated remaining: 4h 11m 18s. Rate: 7.6 symbols/min [2025-09-26T18:01:41.434457] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-26T18:01:41.502506] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:01:41.502778] [DEBUG] [LOCAL ] CM: No existing data file found in primary storage. [2025-09-26T18:01:41.502836] [WARN ] [MAIN ] CM: No existing data found, performing full refresh instead. [2025-09-26T18:01:41.503076] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-09-26T18:01:41.503121] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-09-26T18:01:41.503171] [DEBUG] [LOCAL ] CM: No primary data file found to delete. [2025-09-26T18:01:41.503307] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-09-26T18:01:41.566296] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-09-26T18:01:41.908167] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:01:42.356741] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-09-26T18:01:43.068121] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-26T18:01:43.083352] [INFO ] [REMOTE ] CLVT: Full fetch complete (75225 records). [2025-09-26T18:01:43.083787] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-09-26T18:01:43.170370] [INFO ] [REMOTE ] CM: Fetching primary data for 2024-12. [2025-09-26T18:01:43.399608] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-26T18:01:43.603832] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-26T18:01:43.658552] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-09-26T18:01:43.658839] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-09-26T18:01:43.659804] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-09-26T18:01:43.660309] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-09-26T18:01:43.662080] [DEBUG] [LOCAL ] CLVT: Trimmed 75225 records to 52713 (keeping 200 days of data) [2025-09-26T18:01:43.960245] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-09-26T18:01:44.011456] [DEBUG] [LOCAL ] CLVT: Primary data saved (52713 records). [2025-09-26T18:01:44.011618] [INFO ] [MAIN ] CLVT: Full history saved. [2025-09-26T18:01:44.013055] [INFO ] [MAIN ] Update Progress: 468/2371 symbols completed. CLVT took 29.5s. Estimated remaining: 4h 10m 49s. Rate: 7.6 symbols/min [2025-09-26T18:01:44.193571] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:01:44.253899] [DEBUG] [LOCAL ] CMA: Loaded 50401 existing records from primary storage. [2025-09-26T18:01:44.254048] [INFO ] [MAIN ] CMA: Loaded 50401 existing records. [2025-09-26T18:01:44.457954] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:01:44.458352] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-09-26T18:01:44.458436] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-09-26T18:01:44.458965] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-09-26T18:01:44.459134] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-09-26T18:01:44.761904] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-09-26T18:01:44.795029] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-26T18:01:44.970788] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:01:45.556733] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-12. [2025-09-26T18:01:45.722616] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-26T18:01:45.758952] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-26T18:01:45.766206] [INFO ] [REMOTE ] CLW: Full fetch complete (35253 records). [2025-09-26T18:01:45.766367] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-09-26T18:01:46.187949] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-09-26T18:01:46.188040] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-09-26T18:01:46.188523] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-09-26T18:01:46.188565] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-09-26T18:01:46.189639] [DEBUG] [LOCAL ] CLW: Trimmed 35253 records to 22226 (keeping 200 days of data) [2025-09-26T18:01:46.346798] [DEBUG] [LOCAL ] CLW: Primary data saved (22226 records). [2025-09-26T18:01:46.346969] [INFO ] [MAIN ] CLW: Full history saved. [2025-09-26T18:01:46.347095] [INFO ] [MAIN ] Update Progress: 469/2371 symbols completed. CLW took 29.1s. Estimated remaining: 4h 10m 18s. Rate: 7.6 symbols/min [2025-09-26T18:01:46.361855] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-09-26T18:01:46.552230] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:01:46.577011] [DEBUG] [LOCAL ] CMBT: Loaded 22580 existing records from primary storage. [2025-09-26T18:01:46.577200] [INFO ] [MAIN ] CMBT: Loaded 22580 existing records. [2025-09-26T18:01:46.778835] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:01:46.779106] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-09-26T18:01:46.779169] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-09-26T18:01:46.779449] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-09-26T18:01:46.779508] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-09-26T18:01:47.165051] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-09-26T18:01:47.212429] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:01:47.290428] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-26T18:01:47.956739] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-09-26T18:01:48.082163] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-26T18:01:48.756741] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2024-12. [2025-09-26T18:01:49.121397] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-26T18:01:49.132085] [INFO ] [REMOTE ] CLX: Full fetch complete (72980 records). [2025-09-26T18:01:49.132248] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-09-26T18:01:49.559741] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-09-26T18:01:49.586955] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-09-26T18:01:49.587573] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-09-26T18:01:49.588702] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-09-26T18:01:49.589096] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-09-26T18:01:49.591232] [DEBUG] [LOCAL ] CLX: Trimmed 72980 records to 52189 (keeping 200 days of data) [2025-09-26T18:01:49.731920] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-26T18:01:49.929451] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-26T18:01:50.022250] [DEBUG] [LOCAL ] CLX: Primary data saved (52189 records). [2025-09-26T18:01:50.022419] [INFO ] [MAIN ] CLX: Full history saved. [2025-09-26T18:01:50.022503] [INFO ] [MAIN ] Update Progress: 470/2371 symbols completed. CLX took 31.1s. Estimated remaining: 4h 9m 53s. Rate: 7.6 symbols/min [2025-09-26T18:01:50.220376] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:01:50.270888] [DEBUG] [LOCAL ] CMC: Loaded 45990 existing records from primary storage. [2025-09-26T18:01:50.271045] [INFO ] [MAIN ] CMC: Loaded 45990 existing records. [2025-09-26T18:01:50.361869] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-09-26T18:01:50.482385] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:01:50.482699] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-09-26T18:01:50.482787] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-09-26T18:01:50.483143] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-09-26T18:01:50.483202] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-09-26T18:01:50.896968] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:01:51.021888] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-26T18:01:51.156770] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-09-26T18:01:51.956733] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-09-26T18:01:52.073081] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-26T18:01:52.756764] [INFO ] [REMOTE ] CMC: Fetching primary data for 2024-12. [2025-09-26T18:01:52.818204] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-26T18:01:52.839810] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-26T18:01:53.556760] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-09-26T18:01:54.356765] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-09-26T18:01:54.530699] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-26T18:01:54.783899] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-26T18:01:55.156741] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-09-26T18:01:55.956698] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-09-26T18:01:56.320134] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-26T18:01:56.756782] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-09-26T18:01:56.999715] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-26T18:01:57.015714] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-26T18:01:57.556750] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-09-26T18:01:58.284116] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-26T18:01:58.356782] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-09-26T18:01:58.798946] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-26T18:01:59.041896] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-26T18:01:59.156785] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-09-26T18:01:59.956774] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-09-26T18:02:00.567822] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-26T18:02:00.756743] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-09-26T18:02:01.302584] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-26T18:02:01.504737] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-26T18:02:01.556761] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-09-26T18:02:02.356753] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-09-26T18:02:03.156794] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-09-26T18:02:03.429158] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-26T18:02:03.582470] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-26T18:02:03.956768] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-09-26T18:02:04.318910] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-26T18:02:04.756805] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-09-26T18:02:05.486150] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-26T18:02:05.531198] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-26T18:02:05.556711] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-09-26T18:02:06.356742] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-09-26T18:02:06.843810] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-26T18:02:07.156761] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-09-26T18:02:07.913361] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-26T18:02:07.956783] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-09-26T18:02:08.137165] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-26T18:02:08.756791] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-09-26T18:02:09.462943] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-26T18:02:09.556747] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-09-26T18:02:10.329503] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-26T18:02:10.340739] [INFO ] [REMOTE ] CMBT: Full fetch complete (29676 records). [2025-09-26T18:02:10.340910] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-09-26T18:02:10.364127] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-09-26T18:02:10.793022] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-09-26T18:02:10.793321] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-09-26T18:02:10.794044] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-09-26T18:02:10.794203] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-09-26T18:02:10.795619] [DEBUG] [LOCAL ] CMBT: Trimmed 29676 records to 22911 (keeping 200 days of data) [2025-09-26T18:02:10.935587] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-26T18:02:10.998982] [DEBUG] [LOCAL ] CMBT: Primary data saved (22911 records). [2025-09-26T18:02:10.999133] [INFO ] [MAIN ] CMBT: Full history saved. [2025-09-26T18:02:10.999414] [INFO ] [MAIN ] Update Progress: 471/2371 symbols completed. CMBT took 24.7s. Estimated remaining: 4h 10m 38s. Rate: 7.6 symbols/min [2025-09-26T18:02:11.161931] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-09-26T18:02:11.189238] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:02:11.198372] [DEBUG] [LOCAL ] CMCM: Loaded 4788 existing records from primary storage. [2025-09-26T18:02:11.198519] [INFO ] [MAIN ] CMCM: Loaded 4788 existing records. [2025-09-26T18:02:11.401445] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:02:11.401742] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-09-26T18:02:11.401801] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-09-26T18:02:11.402033] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-09-26T18:02:11.402092] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-09-26T18:02:11.798832] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:02:11.956712] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-09-26T18:02:12.144368] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-26T18:02:12.673960] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-26T18:02:12.756752] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2024-12. [2025-09-26T18:02:13.518081] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-26T18:02:13.556714] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-09-26T18:02:13.859743] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-26T18:02:14.033927] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-26T18:02:14.356738] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-09-26T18:02:15.156800] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-09-26T18:02:15.956716] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-09-26T18:02:16.141097] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-26T18:02:16.150786] [INFO ] [REMOTE ] CMA: Full fetch complete (72875 records). [2025-09-26T18:02:16.150966] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-09-26T18:02:16.152240] [FATAL] [VALIDATOR ] CMA: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:02:16.152364] [FATAL] [MAIN ] CMA: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:02:16.152408] [WARN ] [MAIN ] CMA: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:02:16.152457] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-09-26T18:02:16.152549] [DEBUG] [LOCAL ] CMA: No primary data file found to delete. [2025-09-26T18:02:16.152623] [INFO ] [LOCAL ] CMA: Starting deletion of derivative data. [2025-09-26T18:02:16.153049] [DEBUG] [LOCAL ] CMA: Deleted derivative data file. [2025-09-26T18:02:16.153845] [INFO ] [MAIN ] Update Progress: 472/2371 symbols completed. CMA took 32.1s. Estimated remaining: 4h 10m 19s. Rate: 7.6 symbols/min [2025-09-26T18:02:16.345816] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:02:16.346106] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-09-26T18:02:16.346317] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-09-26T18:02:16.346575] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-09-26T18:02:16.346745] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-26T18:02:16.346922] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-26T18:02:16.347080] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-09-26T18:02:16.472637] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-26T18:02:16.738312] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-26T18:02:16.759144] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-09-26T18:02:16.827276] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:02:17.556730] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-09-26T18:02:17.955627] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-26T18:02:18.122345] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-26T18:02:18.356742] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-09-26T18:02:19.156756] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-09-26T18:02:19.502690] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-26T18:02:19.956779] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-12. [2025-09-26T18:02:20.251060] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:02:20.251607] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-12 [2025-09-26T18:02:20.310573] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-26T18:02:20.321206] [INFO ] [REMOTE ] CM: Full fetch complete (69358 records). [2025-09-26T18:02:20.321399] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-09-26T18:02:20.762977] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-01. [2025-09-26T18:02:20.789412] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-09-26T18:02:20.789546] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-09-26T18:02:20.790431] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-09-26T18:02:20.790518] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-09-26T18:02:20.792433] [DEBUG] [LOCAL ] CM: Trimmed 69358 records to 49317 (keeping 200 days of data) [2025-09-26T18:02:21.044080] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:02:21.045795] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-01 [2025-09-26T18:02:21.131185] [DEBUG] [LOCAL ] CM: Primary data saved (49317 records). [2025-09-26T18:02:21.131343] [INFO ] [MAIN ] CM: Full history saved. [2025-09-26T18:02:21.131622] [INFO ] [MAIN ] Update Progress: 473/2371 symbols completed. CM took 39.8s. Estimated remaining: 4h 9m 60s. Rate: 7.6 symbols/min [2025-09-26T18:02:21.348474] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:02:21.348682] [DEBUG] [LOCAL ] CMG: No existing data file found in primary storage. [2025-09-26T18:02:21.348741] [WARN ] [MAIN ] CMG: No existing data found, performing full refresh instead. [2025-09-26T18:02:21.348894] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-09-26T18:02:21.348940] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-09-26T18:02:21.348987] [DEBUG] [LOCAL ] CMG: No primary data file found to delete. [2025-09-26T18:02:21.349022] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-09-26T18:02:21.561986] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-09-26T18:02:21.772038] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:02:22.127778] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-26T18:02:22.356725] [INFO ] [REMOTE ] CMG: Fetching primary data for 2024-12. [2025-09-26T18:02:23.156729] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-02. [2025-09-26T18:02:23.515541] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:02:23.515991] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-02 [2025-09-26T18:02:23.956749] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-09-26T18:02:24.587401] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-26T18:02:24.756734] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-09-26T18:02:25.120076] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-26T18:02:25.434122] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-26T18:02:25.556733] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-09-26T18:02:26.212223] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-26T18:02:26.356725] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-09-26T18:02:27.156738] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-03. [2025-09-26T18:02:27.364711] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:02:27.365148] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-03 [2025-09-26T18:02:27.956784] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-04. [2025-09-26T18:02:28.185585] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:02:28.186153] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-04 [2025-09-26T18:02:28.395695] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-26T18:02:28.756720] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-09-26T18:02:29.367413] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-26T18:02:29.556736] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-05. [2025-09-26T18:02:30.356773] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-09-26T18:02:30.652091] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-26T18:02:31.156761] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-06. [2025-09-26T18:02:31.780354] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-26T18:02:31.956747] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-09-26T18:02:32.089730] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-26T18:02:32.756734] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-09-26T18:02:33.443437] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-26T18:02:33.446263] [INFO ] [REMOTE ] CMCM: Full fetch complete (7039 records). [2025-09-26T18:02:33.446377] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-09-26T18:02:33.561921] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-07. [2025-09-26T18:02:33.910084] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-09-26T18:02:33.911159] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-09-26T18:02:33.914080] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-09-26T18:02:33.913430] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-26T18:02:33.914328] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-09-26T18:02:33.926210] [DEBUG] [LOCAL ] CMCM: Trimmed 7039 records to 4834 (keeping 200 days of data) [2025-09-26T18:02:33.926848] [INFO ] [REMOTE ] CMC: Full fetch complete (66959 records). [2025-09-26T18:02:33.927327] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-09-26T18:02:34.170953] [DEBUG] [LOCAL ] CMCM: Primary data saved (4834 records). [2025-09-26T18:02:34.188975] [INFO ] [MAIN ] CMCM: Full history saved. [2025-09-26T18:02:34.193473] [INFO ] [MAIN ] Update Progress: 474/2371 symbols completed. CMCM took 23.2s. Estimated remaining: 4h 10m 12s. Rate: 7.6 symbols/min [2025-09-26T18:02:34.370832] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-09-26T18:02:34.572487] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:02:34.665005] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-09-26T18:02:34.670505] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-09-26T18:02:34.678152] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-09-26T18:02:34.680784] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-09-26T18:02:34.683090] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-26T18:02:34.690593] [DEBUG] [LOCAL ] CMC: Trimmed 66959 records to 46311 (keeping 200 days of data) [2025-09-26T18:02:34.782273] [DEBUG] [LOCAL ] CMI: Loaded 42204 existing records from primary storage. [2025-09-26T18:02:34.809165] [INFO ] [MAIN ] CMI: Loaded 42204 existing records. [2025-09-26T18:02:35.009996] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:02:35.012684] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-09-26T18:02:35.013084] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-09-26T18:02:35.015352] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-09-26T18:02:35.015449] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-09-26T18:02:35.158563] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-08. [2025-09-26T18:02:35.550722] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:02:35.630688] [DEBUG] [LOCAL ] CMC: Primary data saved (46311 records). [2025-09-26T18:02:35.631066] [INFO ] [MAIN ] CMC: Full history saved. [2025-09-26T18:02:35.631202] [INFO ] [MAIN ] Update Progress: 475/2371 symbols completed. CMC took 45.6s. Estimated remaining: 4h 9m 39s. Rate: 7.6 symbols/min [2025-09-26T18:02:35.832529] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:02:35.872096] [DEBUG] [LOCAL ] CMP: Loaded 36661 existing records from primary storage. [2025-09-26T18:02:35.872279] [INFO ] [MAIN ] CMP: Loaded 36661 existing records. [2025-09-26T18:02:35.970892] [INFO ] [REMOTE ] CMI: Fetching primary data for 2024-12. [2025-09-26T18:02:36.075762] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:02:36.076387] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-09-26T18:02:36.085453] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-09-26T18:02:36.086463] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-26T18:02:36.089601] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-09-26T18:02:36.090494] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-09-26T18:02:36.497218] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:02:36.545040] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-26T18:02:36.756742] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-12. [2025-09-26T18:02:37.486041] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-26T18:02:37.556731] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-09-26T18:02:37.991637] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-26T18:02:38.356748] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-09. [2025-09-26T18:02:39.010638] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-26T18:02:39.013989] [INFO ] [REMOTE ] CMDB: Full fetch complete (10923 records). [2025-09-26T18:02:39.014117] [DEBUG] [VALIDATOR ] CMDB: Validating primary data. [2025-09-26T18:02:39.161950] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-09-26T18:02:39.243460] [WARN ] [VALIDATOR ] CMDB: Validation failed - insufficient historical data. Have 99 unique days, need 200 days [2025-09-26T18:02:39.243760] [FATAL] [MAIN ] CMDB: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:02:39.243833] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:02:39.243917] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-26T18:02:39.244000] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-26T18:02:39.244039] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-09-26T18:02:39.244104] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-09-26T18:02:39.244209] [INFO ] [MAIN ] Update Progress: 476/2371 symbols completed. CMDB took 23.1s. Estimated remaining: 4h 9m 14s. Rate: 7.6 symbols/min [2025-09-26T18:02:39.444745] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:02:39.485797] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-26T18:02:39.542707] [DEBUG] [LOCAL ] CMPO: Loaded 39856 existing records from primary storage. [2025-09-26T18:02:39.542889] [INFO ] [MAIN ] CMPO: Loaded 39856 existing records. [2025-09-26T18:02:39.746092] [WARN ] [MAIN ] CMPO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:02:39.746364] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-09-26T18:02:39.746414] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-09-26T18:02:39.746804] [DEBUG] [LOCAL ] CMPO: Deleted primary data file. [2025-09-26T18:02:39.746866] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-09-26T18:02:39.961848] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-09-26T18:02:40.158339] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:02:40.190793] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-26T18:02:40.756774] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2024-12. [2025-09-26T18:02:41.556744] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-09-26T18:02:41.953241] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-26T18:02:42.047050] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-26T18:02:42.356743] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-09-26T18:02:43.156781] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-09-26T18:02:43.267254] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-26T18:02:43.956746] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-09-26T18:02:44.219250] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-26T18:02:44.294959] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-26T18:02:44.756748] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-09-26T18:02:45.071285] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-26T18:02:45.556751] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-09-26T18:02:46.356802] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-09-26T18:02:46.584326] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-26T18:02:47.156767] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-09-26T18:02:47.898541] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-26T18:02:47.956700] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-09-26T18:02:48.179989] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-09-26T18:02:48.527860] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-26T18:02:48.756763] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-09-26T18:02:49.182809] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-26T18:02:49.556759] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-09-26T18:02:50.046283] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-26T18:02:50.356792] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-09-26T18:02:51.156784] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-09-26T18:02:51.572059] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-26T18:02:51.690520] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-26T18:02:51.956733] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-09-26T18:02:52.756704] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-09-26T18:02:52.836111] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-26T18:02:53.532724] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-26T18:02:53.556680] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-09-26T18:02:54.356764] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-09-26T18:02:54.619952] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-26T18:02:54.894984] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-26T18:02:54.906840] [INFO ] [REMOTE ] CMG: Full fetch complete (77795 records). [2025-09-26T18:02:54.907013] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-09-26T18:02:55.163743] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-09-26T18:02:55.366962] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-09-26T18:02:55.367079] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-09-26T18:02:55.367972] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-09-26T18:02:55.368053] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-09-26T18:02:55.369723] [DEBUG] [LOCAL ] CMG: Trimmed 77795 records to 54501 (keeping 200 days of data) [2025-09-26T18:02:55.521730] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-26T18:02:55.756542] [DEBUG] [LOCAL ] CMG: Primary data saved (54501 records). [2025-09-26T18:02:55.756726] [INFO ] [MAIN ] CMG: Full history saved. [2025-09-26T18:02:55.756833] [INFO ] [MAIN ] Update Progress: 477/2371 symbols completed. CMG took 34.6s. Estimated remaining: 4h 9m 40s. Rate: 7.6 symbols/min [2025-09-26T18:02:55.956753] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-09-26T18:02:56.761185] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-09-26T18:02:56.766949] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-26T18:02:56.834709] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-26T18:02:57.556752] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-09-26T18:02:58.316769] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-26T18:02:58.356771] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-09-26T18:02:59.156793] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-09-26T18:03:00.027455] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-26T18:03:00.036891] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-09-26T18:03:00.252531] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-26T18:03:00.756777] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-09-26T18:03:01.348339] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-26T18:03:01.556751] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-09-26T18:03:02.239036] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (4.68 seconds). [2025-09-26T18:03:02.245010] [INFO ] [REMOTE ] CMP: Full fetch complete (52692 records). [2025-09-26T18:03:02.245221] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-09-26T18:03:02.246101] [FATAL] [VALIDATOR ] CMP: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:03:02.246195] [FATAL] [MAIN ] CMP: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:03:02.246243] [WARN ] [MAIN ] CMP: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:03:02.246285] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-09-26T18:03:02.246349] [DEBUG] [LOCAL ] CMP: No primary data file found to delete. [2025-09-26T18:03:02.246453] [INFO ] [LOCAL ] CMP: Starting deletion of derivative data. [2025-09-26T18:03:02.246954] [DEBUG] [LOCAL ] CMP: Deleted derivative data file. [2025-09-26T18:03:02.247076] [INFO ] [MAIN ] Update Progress: 478/2371 symbols completed. CMP took 26.6s. Estimated remaining: 4h 9m 26s. Rate: 7.6 symbols/min [2025-09-26T18:03:02.453092] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-26T18:03:02.462795] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-09-26T18:03:03.515510] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-26T18:03:03.525835] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-09-26T18:03:04.439278] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-26T18:03:04.450317] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-09-26T18:03:04.793175] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-26T18:03:04.803728] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-09-26T18:03:05.701692] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-26T18:03:05.713512] [INFO ] [REMOTE ] CMPO: Full fetch complete (58943 records). [2025-09-26T18:03:05.713777] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-09-26T18:03:06.143272] [DEBUG] [VALIDATOR ] CMPO: All expected trading days are present. [2025-09-26T18:03:06.143376] [DEBUG] [VALIDATOR ] CMPO: Primary data validation passed. [2025-09-26T18:03:06.144132] [INFO ] [MAIN ] CMPO: Fetched primary data is valid. [2025-09-26T18:03:06.144201] [DEBUG] [LOCAL ] CMPO: Saving primary data. [2025-09-26T18:03:06.145618] [DEBUG] [LOCAL ] CMPO: Trimmed 58943 records to 40071 (keeping 200 days of data) [2025-09-26T18:03:06.397672] [DEBUG] [LOCAL ] CMPO: Primary data saved (40071 records). [2025-09-26T18:03:06.397818] [INFO ] [MAIN ] CMPO: Full history saved. [2025-09-26T18:03:06.400812] [INFO ] [MAIN ] Update Progress: 479/2371 symbols completed. CMPO took 27.2s. Estimated remaining: 4h 9m 4s. Rate: 7.6 symbols/min [2025-09-26T18:03:06.521087] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T18:03:06.529841] [INFO ] [REMOTE ] CMI: Full fetch complete (59962 records). [2025-09-26T18:03:06.530015] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-09-26T18:03:06.955351] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-09-26T18:03:06.955451] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-09-26T18:03:06.956163] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-09-26T18:03:06.956236] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-09-26T18:03:06.958563] [DEBUG] [LOCAL ] CMI: Trimmed 59962 records to 42484 (keeping 200 days of data) [2025-09-26T18:03:07.239550] [DEBUG] [LOCAL ] CMI: Primary data saved (42484 records). [2025-09-26T18:03:07.239724] [INFO ] [MAIN ] CMI: Full history saved. [2025-09-26T18:03:07.239837] [INFO ] [MAIN ] Update Progress: 480/2371 symbols completed. CMI took 33.0s. Estimated remaining: 4h 8m 28s. Rate: 7.6 symbols/min [2025-09-26T18:03:07.944379] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:03:08.008634] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:03:08.006789] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:03:08.042566] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:03:08.047873] [DEBUG] [LOCAL ] CMSA: Loaded 3406 existing records from primary storage. [2025-09-26T18:03:08.049636] [INFO ] [MAIN ] CMSA: Loaded 3406 existing records. [2025-09-26T18:03:08.124515] [DEBUG] [LOCAL ] CMSC: Loaded 5103 existing records from primary storage. [2025-09-26T18:03:08.159379] [INFO ] [MAIN ] CMSC: Loaded 5103 existing records. [2025-09-26T18:03:08.385312] [DEBUG] [LOCAL ] CMRE: Loaded 35796 existing records from primary storage. [2025-09-26T18:03:08.402036] [INFO ] [MAIN ] CMRE: Loaded 35796 existing records. [2025-09-26T18:03:08.567264] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:03:08.580167] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-09-26T18:03:08.585507] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-09-26T18:03:08.636812] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-09-26T18:03:08.655503] [DEBUG] [LOCAL ] CMS: Loaded 52986 existing records from primary storage. [2025-09-26T18:03:08.670868] [INFO ] [MAIN ] CMS: Loaded 52986 existing records. [2025-09-26T18:03:08.722168] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:03:08.676197] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-09-26T18:03:08.791230] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-09-26T18:03:08.791381] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-09-26T18:03:08.841087] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-09-26T18:03:08.926783] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-09-26T18:03:09.135291] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:03:09.181311] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-09-26T18:03:09.211582] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-09-26T18:03:09.258990] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-09-26T18:03:09.374000] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-09-26T18:03:09.447107] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:03:09.512854] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-09-26T18:03:09.613679] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-09-26T18:03:09.823172] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-09-26T18:03:09.862363] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-09-26T18:03:10.186212] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:03:10.306741] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2024-12. [2025-09-26T18:03:10.359519] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:03:10.383414] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2024-12. [2025-09-26T18:03:10.650105] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:03:10.661881] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-12. [2025-09-26T18:03:10.746252] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:03:10.746576] [INFO ] [REMOTE ] CMS: Fetching primary data for 2024-12. [2025-09-26T18:03:10.946292] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-26T18:03:10.948034] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-09-26T18:03:11.047184] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-26T18:03:11.049183] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-09-26T18:03:11.288816] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-26T18:03:11.290440] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-09-26T18:03:11.457729] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-26T18:03:11.460924] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-09-26T18:03:11.615019] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-26T18:03:11.635799] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-26T18:03:11.806708] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-26T18:03:11.956907] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-09-26T18:03:12.284675] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-26T18:03:12.756760] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-09-26T18:03:13.097370] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-26T18:03:13.211098] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-26T18:03:13.556738] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-09-26T18:03:14.356798] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-09-26T18:03:14.909096] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-26T18:03:15.156755] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-09-26T18:03:15.226512] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-26T18:03:15.578551] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-26T18:03:15.956734] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-09-26T18:03:16.756743] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-09-26T18:03:17.381390] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-26T18:03:17.556723] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-09-26T18:03:18.356741] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-09-26T18:03:18.467946] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-26T18:03:18.621490] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-26T18:03:18.733937] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-26T18:03:19.156754] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-09-26T18:03:19.897614] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-26T18:03:19.956780] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-09-26T18:03:20.436352] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-26T18:03:20.756769] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-09-26T18:03:21.556741] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-09-26T18:03:22.184199] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-26T18:03:22.211247] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-26T18:03:22.356750] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-09-26T18:03:23.156730] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-09-26T18:03:23.488300] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-26T18:03:23.617998] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-26T18:03:23.956730] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-09-26T18:03:24.756803] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-09-26T18:03:25.353414] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-26T18:03:25.556733] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-09-26T18:03:26.263742] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-26T18:03:26.356753] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-09-26T18:03:27.087225] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-26T18:03:27.156733] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-09-26T18:03:27.963189] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-09-26T18:03:27.970369] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-26T18:03:28.335770] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-26T18:03:28.344068] [INFO ] [REMOTE ] CMRE: Full fetch complete (49476 records). [2025-09-26T18:03:28.344249] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-09-26T18:03:28.344993] [FATAL] [VALIDATOR ] CMRE: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:03:28.345100] [FATAL] [MAIN ] CMRE: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:03:28.345144] [WARN ] [MAIN ] CMRE: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:03:28.345184] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-09-26T18:03:28.345296] [DEBUG] [LOCAL ] CMRE: No primary data file found to delete. [2025-09-26T18:03:28.345364] [INFO ] [LOCAL ] CMRE: Starting deletion of derivative data. [2025-09-26T18:03:28.345880] [DEBUG] [LOCAL ] CMRE: Deleted derivative data file. [2025-09-26T18:03:28.346005] [INFO ] [MAIN ] Update Progress: 481/2371 symbols completed. CMRE took 21.1s. Estimated remaining: 4h 9m 12s. Rate: 7.6 symbols/min [2025-09-26T18:03:28.463547] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-26T18:03:28.535757] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:03:28.546669] [DEBUG] [LOCAL ] CMSD: Loaded 8149 existing records from primary storage. [2025-09-26T18:03:28.546812] [INFO ] [MAIN ] CMSD: Loaded 8149 existing records. [2025-09-26T18:03:28.735884] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:03:28.736151] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-09-26T18:03:28.736200] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-09-26T18:03:28.736465] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-09-26T18:03:28.736536] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-09-26T18:03:28.761915] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-09-26T18:03:29.124664] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:03:29.386963] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-26T18:03:29.388417] [INFO ] [REMOTE ] CMSA: Full fetch complete (5043 records). [2025-09-26T18:03:29.388503] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-09-26T18:03:29.561808] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2024-12. [2025-09-26T18:03:29.827321] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-09-26T18:03:29.827415] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-09-26T18:03:29.827590] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-09-26T18:03:29.827702] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-09-26T18:03:29.828228] [DEBUG] [LOCAL ] CMSA: Trimmed 5043 records to 3421 (keeping 200 days of data) [2025-09-26T18:03:29.853839] [DEBUG] [LOCAL ] CMSA: Primary data saved (3421 records). [2025-09-26T18:03:29.854066] [INFO ] [MAIN ] CMSA: Full history saved. [2025-09-26T18:03:29.854281] [INFO ] [MAIN ] Update Progress: 482/2371 symbols completed. CMSA took 22.6s. Estimated remaining: 4h 8m 39s. Rate: 7.6 symbols/min [2025-09-26T18:03:30.042391] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:03:30.093256] [DEBUG] [LOCAL ] CMTG: Loaded 37770 existing records from primary storage. [2025-09-26T18:03:30.093486] [INFO ] [MAIN ] CMTG: Loaded 37770 existing records. [2025-09-26T18:03:30.282767] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:03:30.283041] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-09-26T18:03:30.283089] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-09-26T18:03:30.283322] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-09-26T18:03:30.283393] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-09-26T18:03:30.361837] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-09-26T18:03:30.623851] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-26T18:03:30.683881] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:03:30.968373] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-26T18:03:31.156731] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-09-26T18:03:31.709739] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-26T18:03:31.956752] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-09-26T18:03:32.615575] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-26T18:03:32.756750] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-09-26T18:03:33.461409] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-26T18:03:33.463001] [INFO ] [REMOTE ] CMSC: Full fetch complete (7167 records). [2025-09-26T18:03:33.463086] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-09-26T18:03:33.561890] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-09-26T18:03:33.859324] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-09-26T18:03:33.859414] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-09-26T18:03:33.859629] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-09-26T18:03:33.859709] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-09-26T18:03:33.860161] [DEBUG] [LOCAL ] CMSC: Trimmed 7167 records to 5131 (keeping 200 days of data) [2025-09-26T18:03:33.892930] [DEBUG] [LOCAL ] CMSC: Primary data saved (5131 records). [2025-09-26T18:03:33.893052] [INFO ] [MAIN ] CMSC: Full history saved. [2025-09-26T18:03:33.893141] [INFO ] [MAIN ] Update Progress: 483/2371 symbols completed. CMSC took 26.7s. Estimated remaining: 4h 8m 16s. Rate: 7.6 symbols/min [2025-09-26T18:03:34.073414] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:03:34.082467] [DEBUG] [LOCAL ] CMU: Loaded 7283 existing records from primary storage. [2025-09-26T18:03:34.082568] [INFO ] [MAIN ] CMU: Loaded 7283 existing records. [2025-09-26T18:03:34.270806] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:03:34.271048] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-09-26T18:03:34.271098] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-09-26T18:03:34.271299] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-09-26T18:03:34.271403] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-09-26T18:03:34.362555] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-09-26T18:03:34.616791] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-26T18:03:34.709982] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:03:35.156751] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-09-26T18:03:35.635002] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-26T18:03:35.906042] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-26T18:03:35.956771] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2024-12. [2025-09-26T18:03:36.756781] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-09-26T18:03:37.223107] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-26T18:03:37.556779] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-09-26T18:03:38.077279] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-26T18:03:38.356768] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-09-26T18:03:38.877198] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-26T18:03:39.156785] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-09-26T18:03:39.450007] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-26T18:03:39.653949] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-26T18:03:39.956739] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-09-26T18:03:40.756701] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-09-26T18:03:40.831788] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-26T18:03:41.556735] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-09-26T18:03:42.191281] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-26T18:03:42.356780] [INFO ] [REMOTE ] CMU: Fetching primary data for 2024-12. [2025-09-26T18:03:42.499627] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-26T18:03:43.034978] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-26T18:03:43.156799] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-09-26T18:03:43.818752] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-26T18:03:43.956809] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-09-26T18:03:44.756728] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-09-26T18:03:45.555170] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-26T18:03:45.562663] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-09-26T18:03:46.131718] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-26T18:03:46.356722] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-09-26T18:03:46.491175] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-26T18:03:47.156730] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-09-26T18:03:47.707622] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-26T18:03:47.735081] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-26T18:03:47.956724] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-09-26T18:03:48.756784] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-09-26T18:03:49.556711] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-09-26T18:03:49.592230] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-26T18:03:49.594228] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-26T18:03:50.356778] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-09-26T18:03:51.156777] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-09-26T18:03:51.457062] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-26T18:03:51.494775] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-26T18:03:51.763031] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-26T18:03:51.765137] [INFO ] [REMOTE ] CMSD: Full fetch complete (12466 records). [2025-09-26T18:03:51.765229] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-09-26T18:03:51.960065] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-09-26T18:03:52.195852] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-09-26T18:03:52.195936] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-09-26T18:03:52.196258] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-09-26T18:03:52.196298] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-09-26T18:03:52.196862] [DEBUG] [LOCAL ] CMSD: Trimmed 12466 records to 8184 (keeping 200 days of data) [2025-09-26T18:03:52.253356] [DEBUG] [LOCAL ] CMSD: Primary data saved (8184 records). [2025-09-26T18:03:52.253506] [INFO ] [MAIN ] CMSD: Full history saved. [2025-09-26T18:03:52.253614] [INFO ] [MAIN ] Update Progress: 484/2371 symbols completed. CMSD took 23.9s. Estimated remaining: 4h 8m 49s. Rate: 7.6 symbols/min [2025-09-26T18:03:52.451876] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:03:52.503425] [DEBUG] [LOCAL ] CNA: Loaded 32996 existing records from primary storage. [2025-09-26T18:03:52.503630] [INFO ] [MAIN ] CNA: Loaded 32996 existing records. [2025-09-26T18:03:52.703329] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:03:52.703968] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-09-26T18:03:52.704030] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-09-26T18:03:52.704330] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-09-26T18:03:52.704419] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-09-26T18:03:52.762611] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-09-26T18:03:53.095989] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:03:53.556757] [INFO ] [REMOTE ] CNA: Fetching primary data for 2024-12. [2025-09-26T18:03:53.880058] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-26T18:03:53.897557] [INFO ] [REMOTE ] CMS: Full fetch complete (76018 records). [2025-09-26T18:03:53.897791] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-09-26T18:03:54.246711] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-26T18:03:54.365210] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-09-26T18:03:54.394025] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-09-26T18:03:54.394146] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-09-26T18:03:54.395381] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-09-26T18:03:54.395669] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-09-26T18:03:54.403410] [DEBUG] [LOCAL ] CMS: Trimmed 76018 records to 53371 (keeping 200 days of data) [2025-09-26T18:03:54.416132] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-26T18:03:54.764508] [DEBUG] [LOCAL ] CMS: Primary data saved (53371 records). [2025-09-26T18:03:54.764675] [INFO ] [MAIN ] CMS: Full history saved. [2025-09-26T18:03:54.764837] [INFO ] [MAIN ] Update Progress: 485/2371 symbols completed. CMS took 47.5s. Estimated remaining: 4h 8m 20s. Rate: 7.6 symbols/min [2025-09-26T18:03:54.952473] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:03:55.011244] [DEBUG] [LOCAL ] CNC: Loaded 54128 existing records from primary storage. [2025-09-26T18:03:55.011403] [INFO ] [MAIN ] CNC: Loaded 54128 existing records. [2025-09-26T18:03:55.152860] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-26T18:03:55.163563] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-09-26T18:03:55.242497] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:03:55.242880] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-09-26T18:03:55.242940] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-09-26T18:03:55.243680] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-09-26T18:03:55.243743] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-09-26T18:03:55.618770] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:03:55.956725] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-09-26T18:03:56.756746] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-12. [2025-09-26T18:03:56.894687] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-26T18:03:56.920612] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-26T18:03:57.556727] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-09-26T18:03:58.115683] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-26T18:03:58.316691] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-26T18:03:58.356730] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-09-26T18:03:59.156742] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-09-26T18:03:59.412976] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-26T18:03:59.956737] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-09-26T18:04:00.756735] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-09-26T18:04:00.818122] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-26T18:04:01.477259] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-26T18:04:01.484942] [INFO ] [REMOTE ] CMTG: Full fetch complete (53359 records). [2025-09-26T18:04:01.485090] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-09-26T18:04:01.561715] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-09-26T18:04:01.921730] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-09-26T18:04:01.921859] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-09-26T18:04:01.922753] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-09-26T18:04:01.922962] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-09-26T18:04:01.943667] [DEBUG] [LOCAL ] CMTG: Trimmed 53359 records to 37931 (keeping 200 days of data) [2025-09-26T18:04:01.944935] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-26T18:04:02.203023] [DEBUG] [LOCAL ] CMTG: Primary data saved (37931 records). [2025-09-26T18:04:02.203216] [INFO ] [MAIN ] CMTG: Full history saved. [2025-09-26T18:04:02.204127] [INFO ] [MAIN ] Update Progress: 486/2371 symbols completed. CMTG took 32.3s. Estimated remaining: 4h 8m 10s. Rate: 7.6 symbols/min [2025-09-26T18:04:02.361826] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-09-26T18:04:02.388948] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:04:02.389148] [DEBUG] [LOCAL ] CNF: No existing data file found in primary storage. [2025-09-26T18:04:02.389194] [WARN ] [MAIN ] CNF: No existing data found, performing full refresh instead. [2025-09-26T18:04:02.389338] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-09-26T18:04:02.389396] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-09-26T18:04:02.389485] [DEBUG] [LOCAL ] CNF: No primary data file found to delete. [2025-09-26T18:04:02.389523] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-09-26T18:04:02.777056] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:04:02.821281] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-26T18:04:03.156697] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-09-26T18:04:03.188361] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T18:04:03.766684] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-26T18:04:03.956735] [INFO ] [REMOTE ] CNF: Fetching primary data for 2024-12. [2025-09-26T18:04:04.756760] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-09-26T18:04:04.922204] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-26T18:04:05.556728] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-09-26T18:04:06.027859] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-26T18:04:06.358805] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-09-26T18:04:06.362725] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-26T18:04:07.156770] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-09-26T18:04:07.329532] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-26T18:04:07.956731] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-09-26T18:04:08.319876] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-26T18:04:08.416680] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-26T18:04:08.756738] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-09-26T18:04:09.192874] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-26T18:04:09.556732] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-09-26T18:04:10.331124] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-26T18:04:10.332746] [INFO ] [REMOTE ] CMU: Full fetch complete (9632 records). [2025-09-26T18:04:10.332833] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-09-26T18:04:10.365347] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-09-26T18:04:10.747036] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-09-26T18:04:10.747144] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-09-26T18:04:10.747400] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-09-26T18:04:10.747442] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-09-26T18:04:10.748403] [DEBUG] [LOCAL ] CMU: Trimmed 9632 records to 7303 (keeping 200 days of data) [2025-09-26T18:04:10.797276] [DEBUG] [LOCAL ] CMU: Primary data saved (7303 records). [2025-09-26T18:04:10.797420] [INFO ] [MAIN ] CMU: Full history saved. [2025-09-26T18:04:10.797543] [INFO ] [MAIN ] Update Progress: 487/2371 symbols completed. CMU took 36.9s. Estimated remaining: 4h 8m 5s. Rate: 7.6 symbols/min [2025-09-26T18:04:10.976405] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:04:11.049768] [DEBUG] [LOCAL ] CNH: Loaded 53949 existing records from primary storage. [2025-09-26T18:04:11.049930] [INFO ] [MAIN ] CNH: Loaded 53949 existing records. [2025-09-26T18:04:11.161155] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-09-26T18:04:11.249064] [WARN ] [MAIN ] CNH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:04:11.256592] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-09-26T18:04:11.257533] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-26T18:04:11.257225] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-09-26T18:04:11.261099] [DEBUG] [LOCAL ] CNH: Deleted primary data file. [2025-09-26T18:04:11.261162] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-09-26T18:04:11.642035] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:04:11.956725] [INFO ] [REMOTE ] CNH: Fetching primary data for 2024-12. [2025-09-26T18:04:12.657752] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-26T18:04:12.756745] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-09-26T18:04:13.556738] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-09-26T18:04:14.356728] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-09-26T18:04:14.472416] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-09-26T18:04:14.642611] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-26T18:04:15.156748] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-09-26T18:04:15.956795] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-09-26T18:04:16.312978] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-26T18:04:16.756695] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-09-26T18:04:16.965441] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (3.41 seconds). [2025-09-26T18:04:17.010870] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-26T18:04:17.038662] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-26T18:04:17.553824] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-26T18:04:17.556681] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-09-26T18:04:18.352113] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-26T18:04:18.356666] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-09-26T18:04:19.122863] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-26T18:04:19.156680] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-09-26T18:04:19.956707] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-09-26T18:04:20.097867] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-26T18:04:20.756728] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-09-26T18:04:21.556729] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-09-26T18:04:21.831096] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-26T18:04:21.835319] [INFO ] [REMOTE ] CNF: Full fetch complete (12885 records). [2025-09-26T18:04:21.835442] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-09-26T18:04:22.244851] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-26T18:04:22.280968] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-09-26T18:04:22.281379] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-09-26T18:04:22.281764] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-09-26T18:04:22.281842] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-09-26T18:04:22.282732] [DEBUG] [LOCAL ] CNF: Trimmed 12885 records to 11166 (keeping 200 days of data) [2025-09-26T18:04:22.354592] [DEBUG] [LOCAL ] CNF: Primary data saved (11166 records). [2025-09-26T18:04:22.354784] [INFO ] [MAIN ] CNF: Full history saved. [2025-09-26T18:04:22.354909] [INFO ] [MAIN ] Update Progress: 488/2371 symbols completed. CNF took 20.2s. Estimated remaining: 4h 8m 11s. Rate: 7.6 symbols/min [2025-09-26T18:04:22.367333] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-09-26T18:04:22.552020] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:04:22.617779] [DEBUG] [LOCAL ] CNI: Loaded 52046 existing records from primary storage. [2025-09-26T18:04:22.617968] [INFO ] [MAIN ] CNI: Loaded 52046 existing records. [2025-09-26T18:04:22.868186] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:04:22.868545] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-09-26T18:04:22.868603] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-09-26T18:04:22.868906] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-09-26T18:04:22.868966] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-09-26T18:04:23.183340] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-09-26T18:04:23.198445] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-26T18:04:23.290572] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:04:23.956737] [INFO ] [REMOTE ] CNI: Fetching primary data for 2024-12. [2025-09-26T18:04:24.762408] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-09-26T18:04:24.769154] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-26T18:04:25.253291] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-26T18:04:25.512394] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-26T18:04:25.556686] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-09-26T18:04:25.939123] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-26T18:04:26.356760] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-09-26T18:04:26.976437] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-26T18:04:27.156749] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-09-26T18:04:27.837939] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-26T18:04:27.956782] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-09-26T18:04:28.690978] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-26T18:04:28.756736] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-09-26T18:04:29.556738] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-09-26T18:04:30.121839] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-26T18:04:30.128344] [INFO ] [REMOTE ] CNA: Full fetch complete (45554 records). [2025-09-26T18:04:30.128477] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-09-26T18:04:30.361845] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-09-26T18:04:30.537617] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-09-26T18:04:30.537773] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-09-26T18:04:30.538406] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-09-26T18:04:30.538469] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-09-26T18:04:30.539547] [DEBUG] [LOCAL ] CNA: Trimmed 45554 records to 33235 (keeping 200 days of data) [2025-09-26T18:04:30.754317] [DEBUG] [LOCAL ] CNA: Primary data saved (33235 records). [2025-09-26T18:04:30.754470] [INFO ] [MAIN ] CNA: Full history saved. [2025-09-26T18:04:30.754560] [INFO ] [MAIN ] Update Progress: 489/2371 symbols completed. CNA took 38.5s. Estimated remaining: 4h 8m 5s. Rate: 7.6 symbols/min [2025-09-26T18:04:30.949704] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:04:31.008015] [DEBUG] [LOCAL ] CNK: Loaded 53281 existing records from primary storage. [2025-09-26T18:04:31.008259] [INFO ] [MAIN ] CNK: Loaded 53281 existing records. [2025-09-26T18:04:31.240779] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:04:31.258268] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-09-26T18:04:31.258472] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-09-26T18:04:31.258888] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-09-26T18:04:31.258979] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-09-26T18:04:31.358047] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (3.40 seconds). [2025-09-26T18:04:31.408214] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-09-26T18:04:31.686047] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:04:31.723895] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-26T18:04:31.956736] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-09-26T18:04:32.383340] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-26T18:04:32.756769] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-09-26T18:04:33.556792] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-12. [2025-09-26T18:04:33.843560] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-26T18:04:33.942047] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-09-26T18:04:33.952244] [INFO ] [REMOTE ] CNC: Full fetch complete (77283 records). [2025-09-26T18:04:33.952411] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-09-26T18:04:33.953226] [FATAL] [VALIDATOR ] CNC: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:04:33.953320] [FATAL] [MAIN ] CNC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:04:33.953366] [WARN ] [MAIN ] CNC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:04:33.953442] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-09-26T18:04:33.953511] [DEBUG] [LOCAL ] CNC: No primary data file found to delete. [2025-09-26T18:04:33.953549] [INFO ] [LOCAL ] CNC: Starting deletion of derivative data. [2025-09-26T18:04:33.954078] [DEBUG] [LOCAL ] CNC: Deleted derivative data file. [2025-09-26T18:04:33.954182] [INFO ] [MAIN ] Update Progress: 490/2371 symbols completed. CNC took 39.2s. Estimated remaining: 4h 7m 39s. Rate: 7.6 symbols/min [2025-09-26T18:04:34.144616] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:04:34.182759] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-26T18:04:34.237335] [DEBUG] [LOCAL ] CNM: Loaded 51358 existing records from primary storage. [2025-09-26T18:04:34.237550] [INFO ] [MAIN ] CNM: Loaded 51358 existing records. [2025-09-26T18:04:34.361000] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-09-26T18:04:34.468062] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:04:34.468376] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-09-26T18:04:34.468435] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-09-26T18:04:34.468728] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-09-26T18:04:34.468791] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-09-26T18:04:34.847035] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:04:35.005536] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-26T18:04:35.156882] [INFO ] [REMOTE ] CNM: Fetching primary data for 2024-12. [2025-09-26T18:04:35.956717] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-09-26T18:04:36.087016] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-26T18:04:36.695843] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-26T18:04:36.756715] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-09-26T18:04:37.268407] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-26T18:04:37.556721] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-09-26T18:04:38.356736] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-09-26T18:04:38.690600] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-26T18:04:39.037527] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-26T18:04:39.156782] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-09-26T18:04:39.752175] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-26T18:04:39.956726] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-09-26T18:04:40.684377] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-26T18:04:40.756758] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-09-26T18:04:41.556698] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-09-26T18:04:41.590074] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T18:04:42.086693] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-26T18:04:42.356738] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-09-26T18:04:43.023097] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-26T18:04:43.156727] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-09-26T18:04:43.696014] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-26T18:04:43.956774] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-09-26T18:04:44.558387] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-26T18:04:44.756742] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-09-26T18:04:45.414630] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-26T18:04:45.556728] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-09-26T18:04:46.235971] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-26T18:04:46.356724] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-09-26T18:04:47.156696] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-09-26T18:04:47.603786] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-26T18:04:47.956777] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-09-26T18:04:48.112818] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-26T18:04:48.634541] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-26T18:04:48.756767] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-09-26T18:04:49.556706] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-09-26T18:04:49.789545] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-26T18:04:50.342221] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-26T18:04:50.356674] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-09-26T18:04:51.088710] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-26T18:04:51.156750] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-09-26T18:04:51.769900] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-26T18:04:51.956754] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-09-26T18:04:52.674943] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-26T18:04:52.756747] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-09-26T18:04:53.265600] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-26T18:04:53.556734] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-09-26T18:04:54.298382] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-26T18:04:54.310873] [INFO ] [REMOTE ] CNI: Full fetch complete (74666 records). [2025-09-26T18:04:54.311101] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-09-26T18:04:54.361947] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-09-26T18:04:54.769628] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-09-26T18:04:54.769744] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-09-26T18:04:54.770543] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-09-26T18:04:54.770608] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-09-26T18:04:54.772121] [DEBUG] [LOCAL ] CNI: Trimmed 74666 records to 52419 (keeping 200 days of data) [2025-09-26T18:04:55.110900] [DEBUG] [LOCAL ] CNI: Primary data saved (52419 records). [2025-09-26T18:04:55.111047] [INFO ] [MAIN ] CNI: Full history saved. [2025-09-26T18:04:55.111135] [INFO ] [MAIN ] Update Progress: 491/2371 symbols completed. CNI took 32.8s. Estimated remaining: 4h 8m 22s. Rate: 7.6 symbols/min [2025-09-26T18:04:55.158913] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-09-26T18:04:55.298476] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:04:55.332842] [DEBUG] [LOCAL ] CNMD: Loaded 32633 existing records from primary storage. [2025-09-26T18:04:55.332988] [INFO ] [MAIN ] CNMD: Loaded 32633 existing records. [2025-09-26T18:04:55.528744] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:04:55.546307] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-09-26T18:04:55.561666] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-09-26T18:04:55.563908] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-09-26T18:04:55.563835] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-26T18:04:55.564120] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-09-26T18:04:55.948112] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:04:55.956665] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2024-12. [2025-09-26T18:04:56.291563] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-26T18:04:56.302611] [INFO ] [REMOTE ] CNM: Full fetch complete (73623 records). [2025-09-26T18:04:56.302814] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-09-26T18:04:56.737759] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-09-26T18:04:56.738020] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-09-26T18:04:56.738910] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-09-26T18:04:56.739083] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-09-26T18:04:56.741106] [DEBUG] [LOCAL ] CNM: Trimmed 73623 records to 51747 (keeping 200 days of data) [2025-09-26T18:04:56.800032] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-09-26T18:04:56.866113] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-26T18:04:56.881363] [INFO ] [REMOTE ] CNH: Full fetch complete (77531 records). [2025-09-26T18:04:56.882144] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-09-26T18:04:57.364487] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-09-26T18:04:57.365151] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-09-26T18:04:57.366615] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-09-26T18:04:57.367904] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-26T18:04:57.368285] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-09-26T18:04:57.378770] [DEBUG] [LOCAL ] CNH: Trimmed 77531 records to 54337 (keeping 200 days of data) [2025-09-26T18:04:57.557012] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-09-26T18:04:57.810357] [DEBUG] [LOCAL ] CNM: Primary data saved (51747 records). [2025-09-26T18:04:57.810921] [INFO ] [MAIN ] CNM: Full history saved. [2025-09-26T18:04:57.811342] [INFO ] [MAIN ] Update Progress: 492/2371 symbols completed. CNM took 23.9s. Estimated remaining: 4h 7m 54s. Rate: 7.6 symbols/min [2025-09-26T18:04:58.022189] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:04:58.132476] [DEBUG] [LOCAL ] CNNE: Loaded 37006 existing records from primary storage. [2025-09-26T18:04:58.133773] [INFO ] [MAIN ] CNNE: Loaded 37006 existing records. [2025-09-26T18:04:58.345266] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:04:58.347698] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-09-26T18:04:58.350671] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-09-26T18:04:58.350580] [DEBUG] [LOCAL ] CNH: Primary data saved (54337 records). [2025-09-26T18:04:58.350829] [INFO ] [MAIN ] CNH: Full history saved. [2025-09-26T18:04:58.351019] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-09-26T18:04:58.351091] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-09-26T18:04:58.350997] [INFO ] [MAIN ] Update Progress: 493/2371 symbols completed. CNH took 47.6s. Estimated remaining: 4h 7m 18s. Rate: 7.6 symbols/min [2025-09-26T18:04:58.862122] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:04:58.999264] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:04:59.000325] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2024-12. [2025-09-26T18:04:59.052401] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-26T18:04:59.076802] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-26T18:04:59.098003] [DEBUG] [LOCAL ] CNO: Loaded 41654 existing records from primary storage. [2025-09-26T18:04:59.098166] [INFO ] [MAIN ] CNO: Loaded 41654 existing records. [2025-09-26T18:04:59.165489] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-09-26T18:04:59.290995] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:04:59.291260] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-09-26T18:04:59.291321] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-09-26T18:04:59.291591] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-09-26T18:04:59.291687] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-09-26T18:04:59.680791] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:04:59.956745] [INFO ] [REMOTE ] CNO: Fetching primary data for 2024-12. [2025-09-26T18:05:00.024143] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-26T18:05:00.210011] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-26T18:05:00.756754] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-09-26T18:05:01.425207] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-26T18:05:01.556764] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-09-26T18:05:02.356760] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-09-26T18:05:02.777285] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-26T18:05:02.788533] [INFO ] [REMOTE ] CNK: Full fetch complete (75321 records). [2025-09-26T18:05:02.788770] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-09-26T18:05:02.789725] [FATAL] [VALIDATOR ] CNK: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:05:02.789832] [FATAL] [MAIN ] CNK: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:05:02.789877] [WARN ] [MAIN ] CNK: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:05:02.789943] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-09-26T18:05:02.790014] [DEBUG] [LOCAL ] CNK: No primary data file found to delete. [2025-09-26T18:05:02.790058] [INFO ] [LOCAL ] CNK: Starting deletion of derivative data. [2025-09-26T18:05:02.790518] [DEBUG] [LOCAL ] CNK: Deleted derivative data file. [2025-09-26T18:05:02.791760] [INFO ] [MAIN ] Update Progress: 494/2371 symbols completed. CNK took 32.0s. Estimated remaining: 4h 6m 57s. Rate: 7.6 symbols/min [2025-09-26T18:05:02.999130] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:05:03.058810] [DEBUG] [LOCAL ] CNP: Loaded 53859 existing records from primary storage. [2025-09-26T18:05:03.058989] [INFO ] [MAIN ] CNP: Loaded 53859 existing records. [2025-09-26T18:05:03.159663] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-09-26T18:05:03.288980] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-26T18:05:03.311486] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:05:03.312082] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-09-26T18:05:03.312295] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-09-26T18:05:03.312564] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-09-26T18:05:03.312625] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-09-26T18:05:03.692529] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:05:03.709777] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-26T18:05:03.956726] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-09-26T18:05:04.756746] [INFO ] [REMOTE ] CNP: Fetching primary data for 2024-12. [2025-09-26T18:05:04.932339] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-26T18:05:05.248191] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-26T18:05:05.556771] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-09-26T18:05:06.356741] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-09-26T18:05:06.480614] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-26T18:05:07.149839] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-26T18:05:07.158890] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-09-26T18:05:07.257116] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-26T18:05:07.956771] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-09-26T18:05:08.595748] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-26T18:05:08.756732] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-09-26T18:05:09.144920] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-26T18:05:09.556752] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-09-26T18:05:10.121060] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-26T18:05:10.356731] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-09-26T18:05:10.733211] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-26T18:05:11.156738] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-09-26T18:05:11.781792] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-26T18:05:11.956723] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-09-26T18:05:12.288389] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-26T18:05:12.756733] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-09-26T18:05:13.010618] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-26T18:05:13.556749] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-09-26T18:05:13.699269] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-26T18:05:14.356745] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-09-26T18:05:14.855003] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-26T18:05:15.156751] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-09-26T18:05:15.401132] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-26T18:05:15.956759] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-09-26T18:05:16.125968] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-26T18:05:16.756743] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-09-26T18:05:16.935689] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-26T18:05:17.556748] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-09-26T18:05:18.356726] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-09-26T18:05:18.444453] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-26T18:05:19.156696] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-09-26T18:05:19.221161] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-26T18:05:19.229361] [INFO ] [REMOTE ] CNMD: Full fetch complete (47167 records). [2025-09-26T18:05:19.229563] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-09-26T18:05:19.730144] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-09-26T18:05:19.730677] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-09-26T18:05:19.732453] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-26T18:05:19.731312] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-09-26T18:05:19.741392] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-09-26T18:05:19.743407] [DEBUG] [LOCAL ] CNMD: Trimmed 47167 records to 32884 (keeping 200 days of data) [2025-09-26T18:05:19.954536] [DEBUG] [LOCAL ] CNMD: Primary data saved (32884 records). [2025-09-26T18:05:19.954725] [INFO ] [MAIN ] CNMD: Full history saved. [2025-09-26T18:05:19.954845] [INFO ] [MAIN ] Update Progress: 495/2371 symbols completed. CNMD took 24.8s. Estimated remaining: 4h 7m 25s. Rate: 7.6 symbols/min [2025-09-26T18:05:19.960402] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-09-26T18:05:20.152289] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:05:20.206216] [DEBUG] [LOCAL ] CNQ: Loaded 53971 existing records from primary storage. [2025-09-26T18:05:20.206413] [INFO ] [MAIN ] CNQ: Loaded 53971 existing records. [2025-09-26T18:05:20.429071] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-26T18:05:20.434843] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:05:20.443040] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-09-26T18:05:20.443378] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-09-26T18:05:20.444029] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-09-26T18:05:20.444094] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-09-26T18:05:20.761868] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-09-26T18:05:20.836551] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:05:21.556750] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2024-12. [2025-09-26T18:05:21.772532] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-26T18:05:21.951321] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-26T18:05:22.356768] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-09-26T18:05:23.156747] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-09-26T18:05:23.597368] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-26T18:05:23.956722] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-09-26T18:05:24.110409] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-26T18:05:24.501860] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-26T18:05:24.756771] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-09-26T18:05:25.419005] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-26T18:05:25.556734] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-09-26T18:05:25.976255] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-26T18:05:25.983913] [INFO ] [REMOTE ] CNNE: Full fetch complete (49490 records). [2025-09-26T18:05:25.984056] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-09-26T18:05:26.366829] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-09-26T18:05:26.414711] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-09-26T18:05:26.414804] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-09-26T18:05:26.415403] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-09-26T18:05:26.415463] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-09-26T18:05:26.416750] [DEBUG] [LOCAL ] CNNE: Trimmed 49490 records to 37257 (keeping 200 days of data) [2025-09-26T18:05:26.649482] [DEBUG] [LOCAL ] CNNE: Primary data saved (37257 records). [2025-09-26T18:05:26.649682] [INFO ] [MAIN ] CNNE: Full history saved. [2025-09-26T18:05:26.650008] [INFO ] [MAIN ] Update Progress: 496/2371 symbols completed. CNNE took 28.8s. Estimated remaining: 4h 7m 12s. Rate: 7.6 symbols/min [2025-09-26T18:05:26.834893] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:05:26.835161] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-09-26T18:05:26.835263] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-09-26T18:05:26.835749] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-09-26T18:05:26.850902] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-26T18:05:26.860792] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-09-26T18:05:26.860893] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-09-26T18:05:26.927051] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-26T18:05:27.161944] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-09-26T18:05:27.276066] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:05:27.775596] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-26T18:05:27.956768] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-09-26T18:05:28.345846] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-26T18:05:28.756774] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-12. [2025-09-26T18:05:28.977234] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:05:28.977572] [WARN ] [REMOTE ] CNR: No data returned for month 2024-12 [2025-09-26T18:05:29.352921] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-26T18:05:29.556732] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-09-26T18:05:30.356748] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-09-26T18:05:31.157930] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-01. [2025-09-26T18:05:31.166044] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-26T18:05:31.760534] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-26T18:05:31.956739] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-09-26T18:05:32.095269] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-26T18:05:32.756782] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-09-26T18:05:33.535375] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-26T18:05:33.556678] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-09-26T18:05:34.123904] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-26T18:05:34.356747] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-02. [2025-09-26T18:05:34.922458] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-26T18:05:34.930749] [INFO ] [REMOTE ] CNO: Full fetch complete (60620 records). [2025-09-26T18:05:34.930883] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-09-26T18:05:35.162118] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-09-26T18:05:35.348599] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-09-26T18:05:35.348724] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-09-26T18:05:35.349511] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-09-26T18:05:35.349600] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-09-26T18:05:35.351069] [DEBUG] [LOCAL ] CNO: Trimmed 60620 records to 41901 (keeping 200 days of data) [2025-09-26T18:05:35.510957] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-26T18:05:35.668790] [DEBUG] [LOCAL ] CNO: Primary data saved (41901 records). [2025-09-26T18:05:35.668940] [INFO ] [MAIN ] CNO: Full history saved. [2025-09-26T18:05:35.669034] [INFO ] [MAIN ] Update Progress: 497/2371 symbols completed. CNO took 37.3s. Estimated remaining: 4h 7m 8s. Rate: 7.6 symbols/min [2025-09-26T18:05:35.857486] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:05:35.879838] [DEBUG] [LOCAL ] CNS: Loaded 21094 existing records from primary storage. [2025-09-26T18:05:35.879994] [INFO ] [MAIN ] CNS: Loaded 21094 existing records. [2025-09-26T18:05:35.961968] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-09-26T18:05:36.085288] [WARN ] [MAIN ] CNS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:05:36.085620] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-09-26T18:05:36.085720] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-09-26T18:05:36.085989] [DEBUG] [LOCAL ] CNS: Deleted primary data file. [2025-09-26T18:05:36.086051] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-09-26T18:05:36.475134] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:05:36.708539] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-26T18:05:36.719382] [INFO ] [REMOTE ] CNP: Full fetch complete (77366 records). [2025-09-26T18:05:36.719559] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-09-26T18:05:36.764858] [INFO ] [REMOTE ] CNS: Fetching primary data for 2024-12. [2025-09-26T18:05:37.192982] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-09-26T18:05:37.193083] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-09-26T18:05:37.193955] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-09-26T18:05:37.194033] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-09-26T18:05:37.195735] [DEBUG] [LOCAL ] CNP: Trimmed 77366 records to 54249 (keeping 200 days of data) [2025-09-26T18:05:37.478972] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-26T18:05:37.574804] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-09-26T18:05:37.612611] [DEBUG] [LOCAL ] CNP: Primary data saved (54249 records). [2025-09-26T18:05:37.612841] [INFO ] [MAIN ] CNP: Full history saved. [2025-09-26T18:05:37.613014] [INFO ] [MAIN ] Update Progress: 498/2371 symbols completed. CNP took 34.8s. Estimated remaining: 4h 6m 38s. Rate: 7.6 symbols/min [2025-09-26T18:05:37.807694] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:05:37.859016] [DEBUG] [LOCAL ] CNX: Loaded 51770 existing records from primary storage. [2025-09-26T18:05:37.859274] [INFO ] [MAIN ] CNX: Loaded 51770 existing records. [2025-09-26T18:05:38.003070] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-26T18:05:38.068590] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:05:38.068866] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-09-26T18:05:38.069022] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-09-26T18:05:38.069352] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-09-26T18:05:38.069412] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-09-26T18:05:38.365145] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-03. [2025-09-26T18:05:38.453938] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:05:39.076890] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-26T18:05:39.156734] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-09-26T18:05:39.752121] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-26T18:05:39.956770] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-04. [2025-09-26T18:05:40.251030] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-26T18:05:40.756755] [INFO ] [REMOTE ] CNX: Fetching primary data for 2024-12. [2025-09-26T18:05:41.556736] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-09-26T18:05:41.638067] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-26T18:05:42.356730] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-09-26T18:05:42.636606] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-26T18:05:43.156729] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-09-26T18:05:43.390667] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-26T18:05:43.508355] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-26T18:05:43.956772] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-09-26T18:05:44.756736] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-09-26T18:05:44.974376] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-26T18:05:45.554661] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-26T18:05:45.565364] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-05. [2025-09-26T18:05:46.000632] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-26T18:05:46.356718] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-09-26T18:05:47.156749] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-09-26T18:05:47.319604] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-26T18:05:47.956805] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-06. [2025-09-26T18:05:48.130002] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-26T18:05:48.143514] [INFO ] [REMOTE ] CNQ: Full fetch complete (77549 records). [2025-09-26T18:05:48.143790] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-09-26T18:05:48.653018] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-09-26T18:05:48.653257] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-09-26T18:05:48.654282] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-09-26T18:05:48.654459] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-09-26T18:05:48.671820] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T18:05:48.678446] [DEBUG] [LOCAL ] CNQ: Trimmed 77549 records to 54361 (keeping 200 days of data) [2025-09-26T18:05:48.766335] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-09-26T18:05:49.076582] [DEBUG] [LOCAL ] CNQ: Primary data saved (54361 records). [2025-09-26T18:05:49.076781] [INFO ] [MAIN ] CNQ: Full history saved. [2025-09-26T18:05:49.076882] [INFO ] [MAIN ] Update Progress: 499/2371 symbols completed. CNQ took 29.1s. Estimated remaining: 4h 6m 43s. Rate: 7.6 symbols/min [2025-09-26T18:05:49.268136] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:05:49.298946] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-26T18:05:49.340236] [DEBUG] [LOCAL ] CODI: Loaded 40015 existing records from primary storage. [2025-09-26T18:05:49.340394] [INFO ] [MAIN ] CODI: Loaded 40015 existing records. [2025-09-26T18:05:49.541689] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:05:49.542020] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-09-26T18:05:49.542080] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-09-26T18:05:49.542332] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-09-26T18:05:49.542397] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-09-26T18:05:49.566502] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-09-26T18:05:49.988345] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:05:50.356717] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-07. [2025-09-26T18:05:50.513536] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-26T18:05:50.659372] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-26T18:05:51.156749] [INFO ] [REMOTE ] CODI: Fetching primary data for 2024-12. [2025-09-26T18:05:51.956760] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-09-26T18:05:52.026128] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-26T18:05:52.074488] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-26T18:05:52.613811] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-26T18:05:52.756769] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-08. [2025-09-26T18:05:53.556744] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-09-26T18:05:54.356733] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-09-26T18:05:54.441542] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-26T18:05:54.489362] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-26T18:05:55.156743] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-09-26T18:05:55.956735] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-09-26T18:05:56.036477] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-26T18:05:56.072418] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-26T18:05:56.712896] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-26T18:05:56.756750] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-09-26T18:05:57.556723] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-09-26T18:05:57.864705] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-26T18:05:58.356752] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-09. [2025-09-26T18:05:58.551736] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-26T18:05:58.556744] [INFO ] [REMOTE ] CNS: Full fetch complete (30045 records). [2025-09-26T18:05:58.556842] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-09-26T18:05:58.975793] [DEBUG] [VALIDATOR ] CNS: All expected trading days are present. [2025-09-26T18:05:58.975882] [DEBUG] [VALIDATOR ] CNS: Primary data validation passed. [2025-09-26T18:05:58.976342] [INFO ] [MAIN ] CNS: Fetched primary data is valid. [2025-09-26T18:05:58.976383] [DEBUG] [LOCAL ] CNS: Saving primary data. [2025-09-26T18:05:58.977244] [DEBUG] [LOCAL ] CNS: Trimmed 30045 records to 21245 (keeping 200 days of data) [2025-09-26T18:05:59.115048] [DEBUG] [LOCAL ] CNS: Primary data saved (21245 records). [2025-09-26T18:05:59.115195] [INFO ] [MAIN ] CNS: Full history saved. [2025-09-26T18:05:59.115285] [INFO ] [MAIN ] Update Progress: 500/2371 symbols completed. CNS took 23.4s. Estimated remaining: 4h 6m 44s. Rate: 7.6 symbols/min [2025-09-26T18:05:59.162752] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-09-26T18:05:59.332849] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:05:59.414218] [DEBUG] [LOCAL ] COF: Loaded 54000 existing records from primary storage. [2025-09-26T18:05:59.414442] [INFO ] [MAIN ] COF: Loaded 54000 existing records. [2025-09-26T18:05:59.609315] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:05:59.609831] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-09-26T18:05:59.609893] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-09-26T18:05:59.610218] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-09-26T18:05:59.610292] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-09-26T18:05:59.993219] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-09-26T18:06:00.001276] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:06:00.035228] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-26T18:06:00.050021] [INFO ] [REMOTE ] CNR: Full fetch complete (56816 records). [2025-09-26T18:06:00.050224] [DEBUG] [VALIDATOR ] CNR: Validating primary data. [2025-09-26T18:06:00.263699] [WARN ] [VALIDATOR ] CNR: Validation failed - insufficient historical data. Have 176 unique days, need 200 days [2025-09-26T18:06:00.264364] [FATAL] [MAIN ] CNR: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:06:00.264454] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:06:00.264535] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-26T18:06:00.264612] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-09-26T18:06:00.264683] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-09-26T18:06:00.264750] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-09-26T18:06:00.264869] [INFO ] [MAIN ] Update Progress: 501/2371 symbols completed. CNR took 33.6s. Estimated remaining: 4h 6m 10s. Rate: 7.6 symbols/min [2025-09-26T18:06:00.453790] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:06:00.518789] [DEBUG] [LOCAL ] COHR: Loaded 53754 existing records from primary storage. [2025-09-26T18:06:00.518962] [INFO ] [MAIN ] COHR: Loaded 53754 existing records. [2025-09-26T18:06:00.725862] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:06:00.726202] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-09-26T18:06:00.726286] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-09-26T18:06:00.726667] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-09-26T18:06:00.726736] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-09-26T18:06:00.760777] [INFO ] [REMOTE ] COF: Fetching primary data for 2024-12. [2025-09-26T18:06:01.134259] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:06:01.163258] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-26T18:06:01.421367] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-26T18:06:01.556751] [INFO ] [REMOTE ] COHR: Fetching primary data for 2024-12. [2025-09-26T18:06:02.356728] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-09-26T18:06:02.425712] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-26T18:06:03.134792] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-26T18:06:03.156684] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-09-26T18:06:03.935178] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-26T18:06:03.956719] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-09-26T18:06:04.756751] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-09-26T18:06:05.170875] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-26T18:06:05.556768] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-09-26T18:06:05.631233] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-26T18:06:06.119960] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-26T18:06:06.356740] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-09-26T18:06:07.156697] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-09-26T18:06:07.217452] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-26T18:06:07.956737] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-09-26T18:06:08.028928] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-26T18:06:08.525833] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-26T18:06:08.756771] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-09-26T18:06:09.556738] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-09-26T18:06:09.696786] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-26T18:06:10.339798] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-26T18:06:10.356689] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-09-26T18:06:11.156729] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-09-26T18:06:11.670453] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-26T18:06:11.884934] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-26T18:06:11.956717] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-09-26T18:06:12.645926] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T18:06:12.756733] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-09-26T18:06:13.033444] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-26T18:06:13.042346] [INFO ] [REMOTE ] CODI: Full fetch complete (50669 records). [2025-09-26T18:06:13.042564] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-09-26T18:06:13.479736] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-09-26T18:06:13.479844] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-09-26T18:06:13.480560] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-09-26T18:06:13.480628] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-09-26T18:06:13.481988] [DEBUG] [LOCAL ] CODI: Trimmed 50669 records to 40312 (keeping 200 days of data) [2025-09-26T18:06:13.573939] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-09-26T18:06:13.735934] [DEBUG] [LOCAL ] CODI: Primary data saved (40312 records). [2025-09-26T18:06:13.736137] [INFO ] [MAIN ] CODI: Full history saved. [2025-09-26T18:06:13.736286] [INFO ] [MAIN ] Update Progress: 502/2371 symbols completed. CODI took 24.7s. Estimated remaining: 4h 6m 23s. Rate: 7.6 symbols/min [2025-09-26T18:06:13.919442] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:06:13.983417] [DEBUG] [LOCAL ] COLD: Loaded 52395 existing records from primary storage. [2025-09-26T18:06:13.983574] [INFO ] [MAIN ] COLD: Loaded 52395 existing records. [2025-09-26T18:06:14.182563] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:06:14.183083] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-09-26T18:06:14.183177] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-09-26T18:06:14.193598] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-09-26T18:06:14.213538] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-09-26T18:06:14.280813] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-26T18:06:14.361830] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-09-26T18:06:14.642988] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:06:15.156734] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-09-26T18:06:15.576480] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-26T18:06:15.781910] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-26T18:06:15.956715] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-09-26T18:06:16.756704] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-09-26T18:06:16.833886] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-26T18:06:17.568502] [INFO ] [REMOTE ] COLD: Fetching primary data for 2024-12. [2025-09-26T18:06:17.575143] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-26T18:06:18.053605] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-26T18:06:18.356768] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-09-26T18:06:19.068166] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-26T18:06:19.156809] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-09-26T18:06:19.956781] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-09-26T18:06:20.002632] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T18:06:20.013169] [INFO ] [REMOTE ] CNX: Full fetch complete (74771 records). [2025-09-26T18:06:20.013357] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-09-26T18:06:20.441681] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-09-26T18:06:20.441802] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-09-26T18:06:20.442762] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-09-26T18:06:20.442966] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-09-26T18:06:20.445111] [DEBUG] [LOCAL ] CNX: Trimmed 74771 records to 52150 (keeping 200 days of data) [2025-09-26T18:06:20.558911] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-26T18:06:20.761951] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-09-26T18:06:20.802963] [DEBUG] [LOCAL ] CNX: Primary data saved (52150 records). [2025-09-26T18:06:20.803126] [INFO ] [MAIN ] CNX: Full history saved. [2025-09-26T18:06:20.803265] [INFO ] [MAIN ] Update Progress: 503/2371 symbols completed. CNX took 43.2s. Estimated remaining: 4h 6m 12s. Rate: 7.6 symbols/min [2025-09-26T18:06:20.989158] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:06:21.043889] [DEBUG] [LOCAL ] COMP: Loaded 53776 existing records from primary storage. [2025-09-26T18:06:21.044073] [INFO ] [MAIN ] COMP: Loaded 53776 existing records. [2025-09-26T18:06:21.242500] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:06:21.242798] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-09-26T18:06:21.242870] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-09-26T18:06:21.243144] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-09-26T18:06:21.243217] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-09-26T18:06:21.559310] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-09-26T18:06:21.637082] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:06:21.676157] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-26T18:06:21.954625] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-26T18:06:22.356769] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-09-26T18:06:23.156761] [INFO ] [REMOTE ] COMP: Fetching primary data for 2024-12. [2025-09-26T18:06:23.962083] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-09-26T18:06:23.980124] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-09-26T18:06:24.058264] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-26T18:06:24.560326] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T18:06:24.756737] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-09-26T18:06:25.556732] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-09-26T18:06:26.130436] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-26T18:06:26.356724] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-09-26T18:06:26.485115] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-26T18:06:26.993175] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-26T18:06:27.156764] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-09-26T18:06:27.956769] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-09-26T18:06:28.254405] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-26T18:06:28.406059] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-26T18:06:28.756746] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-09-26T18:06:29.556733] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-09-26T18:06:29.855975] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-26T18:06:30.356753] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-09-26T18:06:31.156703] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-09-26T18:06:31.226232] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-09-26T18:06:31.237156] [INFO ] [REMOTE ] COHR: Full fetch complete (77111 records). [2025-09-26T18:06:31.237329] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-09-26T18:06:31.701340] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-09-26T18:06:31.704823] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-09-26T18:06:31.705914] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-09-26T18:06:31.706294] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-09-26T18:06:31.709060] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-26T18:06:31.722958] [DEBUG] [LOCAL ] COHR: Trimmed 77111 records to 54144 (keeping 200 days of data) [2025-09-26T18:06:31.847817] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-26T18:06:31.980611] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-09-26T18:06:32.108046] [DEBUG] [LOCAL ] COHR: Primary data saved (54144 records). [2025-09-26T18:06:32.108202] [INFO ] [MAIN ] COHR: Full history saved. [2025-09-26T18:06:32.108319] [INFO ] [MAIN ] Update Progress: 504/2371 symbols completed. COHR took 31.8s. Estimated remaining: 4h 6m 17s. Rate: 7.6 symbols/min [2025-09-26T18:06:32.291668] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:06:32.331111] [DEBUG] [LOCAL ] CON: Loaded 39000 existing records from primary storage. [2025-09-26T18:06:32.331260] [INFO ] [MAIN ] CON: Loaded 39000 existing records. [2025-09-26T18:06:32.529414] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:06:32.529759] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-09-26T18:06:32.529818] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-09-26T18:06:32.530044] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-09-26T18:06:32.530104] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-09-26T18:06:32.764010] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-09-26T18:06:32.978125] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:06:33.015336] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-26T18:06:33.556744] [INFO ] [REMOTE ] CON: Fetching primary data for 2024-12. [2025-09-26T18:06:33.714238] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-26T18:06:34.356707] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-09-26T18:06:34.534733] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-26T18:06:35.130714] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-26T18:06:35.156746] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-09-26T18:06:35.947159] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-26T18:06:35.958331] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-09-26T18:06:36.596947] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-26T18:06:36.756766] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-09-26T18:06:37.085331] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-26T18:06:37.556732] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-09-26T18:06:38.182789] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-26T18:06:38.356765] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-09-26T18:06:38.622086] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-26T18:06:39.156750] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-09-26T18:06:39.793742] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-26T18:06:39.956763] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-09-26T18:06:40.689970] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-26T18:06:40.756782] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-09-26T18:06:41.188743] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-26T18:06:41.556736] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-09-26T18:06:42.356750] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-09-26T18:06:42.591069] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-26T18:06:42.642896] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-26T18:06:43.156782] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-09-26T18:06:43.829336] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-26T18:06:43.956756] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-09-26T18:06:44.756752] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-09-26T18:06:45.279554] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-26T18:06:45.290437] [INFO ] [REMOTE ] COF: Full fetch complete (77401 records). [2025-09-26T18:06:45.290601] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-09-26T18:06:45.564439] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-09-26T18:06:45.705432] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-09-26T18:06:45.705626] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-09-26T18:06:45.706507] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-09-26T18:06:45.706560] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-09-26T18:06:45.708434] [DEBUG] [LOCAL ] COF: Trimmed 77401 records to 54389 (keeping 200 days of data) [2025-09-26T18:06:46.071393] [DEBUG] [LOCAL ] COF: Primary data saved (54389 records). [2025-09-26T18:06:46.071552] [INFO ] [MAIN ] COF: Full history saved. [2025-09-26T18:06:46.071676] [INFO ] [MAIN ] Update Progress: 505/2371 symbols completed. COF took 47.0s. Estimated remaining: 4h 6m 31s. Rate: 7.6 symbols/min [2025-09-26T18:06:46.290540] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-09-26T18:06:46.301593] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:06:46.304524] [INFO ] [REMOTE ] COLD: Full fetch complete (74186 records). [2025-09-26T18:06:46.304769] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-09-26T18:06:46.396013] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-26T18:06:46.447835] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-09-26T18:06:46.565253] [DEBUG] [LOCAL ] COOK: Loaded 24686 existing records from primary storage. [2025-09-26T18:06:46.620327] [INFO ] [MAIN ] COOK: Loaded 24686 existing records. [2025-09-26T18:06:46.992297] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:06:46.992089] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-09-26T18:06:46.992753] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-09-26T18:06:46.992844] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-09-26T18:06:46.992962] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-09-26T18:06:46.994217] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-09-26T18:06:46.994370] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-09-26T18:06:46.994720] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-09-26T18:06:46.994811] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-09-26T18:06:47.111185] [DEBUG] [LOCAL ] COLD: Trimmed 74186 records to 52785 (keeping 200 days of data) [2025-09-26T18:06:47.483336] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:06:47.486887] [INFO ] [REMOTE ] COOK: Fetching primary data for 2024-12. [2025-09-26T18:06:47.552929] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-26T18:06:47.574312] [INFO ] [REMOTE ] COMP: Full fetch complete (77095 records). [2025-09-26T18:06:47.579058] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-09-26T18:06:48.054300] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-26T18:06:48.112513] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-09-26T18:06:48.167491] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-09-26T18:06:48.167911] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-09-26T18:06:48.169787] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-09-26T18:06:48.170865] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-09-26T18:06:48.178938] [DEBUG] [LOCAL ] COMP: Trimmed 77095 records to 54166 (keeping 200 days of data) [2025-09-26T18:06:48.388152] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-26T18:06:48.494750] [DEBUG] [LOCAL ] COLD: Primary data saved (52785 records). [2025-09-26T18:06:48.495448] [INFO ] [MAIN ] COLD: Full history saved. [2025-09-26T18:06:48.495904] [INFO ] [MAIN ] Update Progress: 506/2371 symbols completed. COLD took 34.8s. Estimated remaining: 4h 6m 3s. Rate: 7.6 symbols/min [2025-09-26T18:06:48.692994] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:06:48.762740] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-09-26T18:06:48.829001] [DEBUG] [LOCAL ] COP: Loaded 54117 existing records from primary storage. [2025-09-26T18:06:48.830999] [INFO ] [MAIN ] COP: Loaded 54117 existing records. [2025-09-26T18:06:49.044092] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:06:49.045456] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-09-26T18:06:49.045954] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-09-26T18:06:49.047250] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-09-26T18:06:49.047695] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-09-26T18:06:49.085986] [DEBUG] [LOCAL ] COMP: Primary data saved (54166 records). [2025-09-26T18:06:49.133851] [INFO ] [MAIN ] COMP: Full history saved. [2025-09-26T18:06:49.162180] [INFO ] [MAIN ] Update Progress: 507/2371 symbols completed. COMP took 28.4s. Estimated remaining: 4h 5m 29s. Rate: 7.6 symbols/min [2025-09-26T18:06:49.588283] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:06:49.687788] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:06:49.688428] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-12. [2025-09-26T18:06:49.715192] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-26T18:06:49.757526] [DEBUG] [LOCAL ] COR: Loaded 47618 existing records from primary storage. [2025-09-26T18:06:49.757826] [INFO ] [MAIN ] COR: Loaded 47618 existing records. [2025-09-26T18:06:49.968497] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-26T18:06:49.980017] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:06:49.980305] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-09-26T18:06:49.980364] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-09-26T18:06:49.980581] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-09-26T18:06:49.980639] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-09-26T18:06:50.359353] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-09-26T18:06:50.359223] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:06:51.156728] [INFO ] [REMOTE ] COR: Fetching primary data for 2024-12. [2025-09-26T18:06:51.856267] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-26T18:06:51.929968] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-26T18:06:51.956713] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-09-26T18:06:52.547804] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-26T18:06:52.756743] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-09-26T18:06:53.387693] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-26T18:06:53.396521] [INFO ] [REMOTE ] CON: Full fetch complete (56981 records). [2025-09-26T18:06:53.396672] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-09-26T18:06:53.568628] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-09-26T18:06:53.815980] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-09-26T18:06:53.816068] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-09-26T18:06:53.816988] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-09-26T18:06:53.817058] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-09-26T18:06:53.818849] [DEBUG] [LOCAL ] CON: Trimmed 56981 records to 39289 (keeping 200 days of data) [2025-09-26T18:06:54.089770] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-26T18:06:54.110119] [DEBUG] [LOCAL ] CON: Primary data saved (39289 records). [2025-09-26T18:06:54.110314] [INFO ] [MAIN ] CON: Full history saved. [2025-09-26T18:06:54.110430] [INFO ] [MAIN ] Update Progress: 508/2371 symbols completed. CON took 22.0s. Estimated remaining: 4h 5m 10s. Rate: 7.6 symbols/min [2025-09-26T18:06:54.277176] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-26T18:06:54.303827] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:06:54.361702] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-09-26T18:06:54.364157] [DEBUG] [LOCAL ] COTY: Loaded 53636 existing records from primary storage. [2025-09-26T18:06:54.364414] [INFO ] [MAIN ] COTY: Loaded 53636 existing records. [2025-09-26T18:06:54.580086] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:06:54.580384] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-09-26T18:06:54.580434] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-09-26T18:06:54.581303] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-09-26T18:06:54.581392] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-09-26T18:06:54.986012] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:06:55.156724] [INFO ] [REMOTE ] COTY: Fetching primary data for 2024-12. [2025-09-26T18:06:55.726550] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-26T18:06:55.956759] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-09-26T18:06:56.714031] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-26T18:06:56.756683] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-09-26T18:06:57.547481] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-26T18:06:57.558464] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-09-26T18:06:57.978892] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-26T18:06:58.356728] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-09-26T18:06:59.082135] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-26T18:06:59.156760] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-09-26T18:06:59.858184] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-26T18:06:59.956719] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-09-26T18:07:00.756727] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-09-26T18:07:01.241270] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-26T18:07:01.556736] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-09-26T18:07:01.633977] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-26T18:07:02.356750] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-09-26T18:07:02.682557] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-26T18:07:03.061375] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-26T18:07:03.156725] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-09-26T18:07:03.649873] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-26T18:07:03.956751] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-09-26T18:07:04.756765] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-09-26T18:07:04.866543] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-26T18:07:05.060524] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-26T18:07:05.556724] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-09-26T18:07:06.125739] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-26T18:07:06.356738] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-09-26T18:07:07.156688] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-09-26T18:07:07.296870] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-26T18:07:07.329373] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-26T18:07:07.956731] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-09-26T18:07:08.756711] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-09-26T18:07:09.238094] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-26T18:07:09.556732] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-09-26T18:07:09.680714] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-26T18:07:10.356744] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-09-26T18:07:10.677833] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-26T18:07:10.829483] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-26T18:07:11.156748] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-09-26T18:07:11.662076] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-26T18:07:11.956747] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-09-26T18:07:12.050726] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-26T18:07:12.756734] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-09-26T18:07:13.556719] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-09-26T18:07:13.849167] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-26T18:07:14.356692] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-09-26T18:07:14.526574] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-26T18:07:15.156724] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-09-26T18:07:15.345695] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-26T18:07:15.956739] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-09-26T18:07:16.050234] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-26T18:07:16.059621] [INFO ] [REMOTE ] COR: Full fetch complete (68921 records). [2025-09-26T18:07:16.059830] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-09-26T18:07:16.482169] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-09-26T18:07:16.482362] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-09-26T18:07:16.483134] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-09-26T18:07:16.483212] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-09-26T18:07:16.484678] [DEBUG] [LOCAL ] COR: Trimmed 68921 records to 47937 (keeping 200 days of data) [2025-09-26T18:07:16.760154] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-09-26T18:07:16.783444] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-26T18:07:16.867912] [DEBUG] [LOCAL ] COR: Primary data saved (47937 records). [2025-09-26T18:07:16.868110] [INFO ] [MAIN ] COR: Full history saved. [2025-09-26T18:07:16.868229] [INFO ] [MAIN ] Update Progress: 509/2371 symbols completed. COR took 27.7s. Estimated remaining: 4h 5m 56s. Rate: 7.6 symbols/min [2025-09-26T18:07:17.051294] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:07:17.068054] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-26T18:07:17.116636] [DEBUG] [LOCAL ] COUR: Loaded 49322 existing records from primary storage. [2025-09-26T18:07:17.116818] [INFO ] [MAIN ] COUR: Loaded 49322 existing records. [2025-09-26T18:07:17.298169] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:07:17.298498] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-09-26T18:07:17.298560] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-09-26T18:07:17.298925] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-09-26T18:07:17.298984] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-09-26T18:07:17.562353] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-09-26T18:07:17.673695] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:07:18.356752] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-09-26T18:07:18.537620] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-26T18:07:18.904476] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-26T18:07:19.156762] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-09-26T18:07:19.956726] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-09-26T18:07:20.531814] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-26T18:07:20.756750] [INFO ] [REMOTE ] COUR: Fetching primary data for 2024-12. [2025-09-26T18:07:21.039273] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-26T18:07:21.049953] [INFO ] [REMOTE ] COP: Full fetch complete (77379 records). [2025-09-26T18:07:21.055444] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-09-26T18:07:21.066804] [FATAL] [VALIDATOR ] COP: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:07:21.068672] [FATAL] [MAIN ] COP: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:07:21.068754] [WARN ] [MAIN ] COP: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:07:21.068459] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-26T18:07:21.068952] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-09-26T18:07:21.069061] [DEBUG] [LOCAL ] COP: No primary data file found to delete. [2025-09-26T18:07:21.074775] [INFO ] [LOCAL ] COP: Starting deletion of derivative data. [2025-09-26T18:07:21.075570] [INFO ] [REMOTE ] COOK: Full fetch complete (32694 records). [2025-09-26T18:07:21.075744] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-09-26T18:07:21.075924] [DEBUG] [LOCAL ] COP: Deleted derivative data file. [2025-09-26T18:07:21.076134] [INFO ] [MAIN ] Update Progress: 510/2371 symbols completed. COP took 32.6s. Estimated remaining: 4h 5m 35s. Rate: 7.6 symbols/min [2025-09-26T18:07:21.442475] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:07:21.560567] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-09-26T18:07:21.713777] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-09-26T18:07:21.713911] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-09-26T18:07:21.714516] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-09-26T18:07:21.714621] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-09-26T18:07:21.715840] [DEBUG] [LOCAL ] COOK: Trimmed 32694 records to 24850 (keeping 200 days of data) [2025-09-26T18:07:21.796146] [DEBUG] [LOCAL ] CP: Loaded 53664 existing records from primary storage. [2025-09-26T18:07:21.825409] [INFO ] [MAIN ] CP: Loaded 53664 existing records. [2025-09-26T18:07:22.067616] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:07:22.074918] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-09-26T18:07:22.075779] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-09-26T18:07:22.076590] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-09-26T18:07:22.076952] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-09-26T18:07:22.237230] [DEBUG] [LOCAL ] COOK: Primary data saved (24850 records). [2025-09-26T18:07:22.303295] [INFO ] [MAIN ] COOK: Full history saved. [2025-09-26T18:07:22.355716] [INFO ] [MAIN ] Update Progress: 511/2371 symbols completed. COOK took 36.3s. Estimated remaining: 4h 5m 3s. Rate: 7.6 symbols/min [2025-09-26T18:07:22.670223] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-26T18:07:22.655963] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:07:22.670825] [INFO ] [REMOTE ] CP: Fetching primary data for 2024-12. [2025-09-26T18:07:22.756363] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:07:22.792996] [DEBUG] [LOCAL ] CPA: Loaded 29076 existing records from primary storage. [2025-09-26T18:07:22.793144] [INFO ] [MAIN ] CPA: Loaded 29076 existing records. [2025-09-26T18:07:22.980753] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:07:22.980997] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-09-26T18:07:22.981046] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-09-26T18:07:22.981310] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-09-26T18:07:22.981369] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-09-26T18:07:23.171798] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-09-26T18:07:23.381933] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:07:23.411137] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-26T18:07:23.422279] [INFO ] [REMOTE ] COTY: Full fetch complete (77085 records). [2025-09-26T18:07:23.422450] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-09-26T18:07:23.842927] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-09-26T18:07:23.843029] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-09-26T18:07:23.843923] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-09-26T18:07:23.844008] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-09-26T18:07:23.845844] [DEBUG] [LOCAL ] COTY: Trimmed 77085 records to 54014 (keeping 200 days of data) [2025-09-26T18:07:23.956834] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-12. [2025-09-26T18:07:24.159456] [DEBUG] [LOCAL ] COTY: Primary data saved (54014 records). [2025-09-26T18:07:24.159611] [INFO ] [MAIN ] COTY: Full history saved. [2025-09-26T18:07:24.159734] [INFO ] [MAIN ] Update Progress: 512/2371 symbols completed. COTY took 30.0s. Estimated remaining: 4h 4m 33s. Rate: 7.6 symbols/min [2025-09-26T18:07:24.346582] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:07:24.346984] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-09-26T18:07:24.347063] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-09-26T18:07:24.347283] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-09-26T18:07:24.347339] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-26T18:07:24.347388] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-26T18:07:24.347423] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-09-26T18:07:24.748226] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:07:24.759408] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-12. [2025-09-26T18:07:24.807258] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-26T18:07:24.820454] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-26T18:07:25.168247] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-26T18:07:25.379301] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-26T18:07:25.556730] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-09-26T18:07:26.356752] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-09-26T18:07:27.156718] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-09-26T18:07:27.232594] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-26T18:07:27.789610] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-26T18:07:27.956748] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-09-26T18:07:28.151395] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-26T18:07:28.344441] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-26T18:07:28.756738] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-09-26T18:07:29.134759] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-26T18:07:29.556725] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-09-26T18:07:30.356764] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-09-26T18:07:30.717288] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-26T18:07:31.143568] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-26T18:07:31.156678] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-09-26T18:07:31.956772] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-09-26T18:07:32.756705] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-09-26T18:07:33.019758] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-26T18:07:33.085088] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-26T18:07:33.556729] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-09-26T18:07:34.156989] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-26T18:07:34.356806] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-09-26T18:07:34.444789] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-26T18:07:35.156776] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-09-26T18:07:35.764182] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-26T18:07:35.956778] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-09-26T18:07:36.156238] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-26T18:07:36.370242] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-26T18:07:36.756749] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-09-26T18:07:37.056490] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-26T18:07:37.556727] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-09-26T18:07:37.893930] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-26T18:07:38.356745] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-09-26T18:07:38.729159] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-26T18:07:39.156735] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-09-26T18:07:39.956775] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-09-26T18:07:40.419854] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-26T18:07:40.420899] [INFO ] [REMOTE ] CPAC: Full fetch complete (1887 records). [2025-09-26T18:07:40.420972] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-09-26T18:07:40.607578] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-26T18:07:40.607815] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:07:40.607888] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:07:40.607961] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-26T18:07:40.608032] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-26T18:07:40.608075] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-09-26T18:07:40.608122] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-09-26T18:07:40.608200] [INFO ] [MAIN ] Update Progress: 513/2371 symbols completed. CPAC took 16.4s. Estimated remaining: 4h 4m 56s. Rate: 7.6 symbols/min [2025-09-26T18:07:40.764105] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-09-26T18:07:40.802213] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:07:40.834013] [DEBUG] [LOCAL ] CPAY: Loaded 31115 existing records from primary storage. [2025-09-26T18:07:40.834159] [INFO ] [MAIN ] CPAY: Loaded 31115 existing records. [2025-09-26T18:07:41.035109] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:07:41.035521] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-09-26T18:07:41.035676] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-09-26T18:07:41.036127] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-09-26T18:07:41.036219] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-09-26T18:07:41.155471] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-26T18:07:41.464952] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:07:41.556731] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-09-26T18:07:42.069111] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-26T18:07:42.356747] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-09-26T18:07:43.156754] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-09-26T18:07:43.671768] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-26T18:07:43.901795] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-26T18:07:43.956779] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2024-12. [2025-09-26T18:07:44.762702] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-09-26T18:07:44.777238] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-26T18:07:45.006983] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-26T18:07:45.556746] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-09-26T18:07:46.247966] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T18:07:46.356753] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-09-26T18:07:47.077704] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-26T18:07:47.156723] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-09-26T18:07:47.383065] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-26T18:07:47.956753] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-09-26T18:07:48.756751] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-09-26T18:07:49.003114] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-26T18:07:49.039178] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-26T18:07:49.049460] [INFO ] [REMOTE ] COUR: Full fetch complete (70910 records). [2025-09-26T18:07:49.049662] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-09-26T18:07:49.463426] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-09-26T18:07:49.463592] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-09-26T18:07:49.464413] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-09-26T18:07:49.464503] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-09-26T18:07:49.466128] [DEBUG] [LOCAL ] COUR: Trimmed 70910 records to 49636 (keeping 200 days of data) [2025-09-26T18:07:49.557008] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-09-26T18:07:49.769480] [DEBUG] [LOCAL ] COUR: Primary data saved (49636 records). [2025-09-26T18:07:49.769665] [INFO ] [MAIN ] COUR: Full history saved. [2025-09-26T18:07:49.769781] [INFO ] [MAIN ] Update Progress: 514/2371 symbols completed. COUR took 32.9s. Estimated remaining: 4h 4m 52s. Rate: 7.6 symbols/min [2025-09-26T18:07:50.015863] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:07:50.034682] [DEBUG] [LOCAL ] CPF: Loaded 15549 existing records from primary storage. [2025-09-26T18:07:50.034829] [INFO ] [MAIN ] CPF: Loaded 15549 existing records. [2025-09-26T18:07:50.222942] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:07:50.223211] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-09-26T18:07:50.223259] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-09-26T18:07:50.223530] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-09-26T18:07:50.223589] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-09-26T18:07:50.357863] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-09-26T18:07:50.563994] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-26T18:07:50.634801] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:07:50.929982] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-26T18:07:51.156730] [INFO ] [REMOTE ] CPF: Fetching primary data for 2024-12. [2025-09-26T18:07:51.956720] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-09-26T18:07:52.079527] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-26T18:07:52.126360] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-26T18:07:52.756776] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-09-26T18:07:52.835047] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-26T18:07:53.556738] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-09-26T18:07:54.229294] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-26T18:07:54.316357] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-26T18:07:54.356756] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-09-26T18:07:55.156693] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-09-26T18:07:55.372535] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-26T18:07:55.956724] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-09-26T18:07:56.484977] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-26T18:07:56.609996] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-26T18:07:56.756733] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-09-26T18:07:57.556723] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-09-26T18:07:58.349414] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-26T18:07:58.356688] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-09-26T18:07:58.732977] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-26T18:07:58.738391] [INFO ] [REMOTE ] CPA: Full fetch complete (41950 records). [2025-09-26T18:07:58.738494] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-09-26T18:07:58.739105] [FATAL] [VALIDATOR ] CPA: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:07:58.739194] [FATAL] [MAIN ] CPA: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:07:58.739238] [WARN ] [MAIN ] CPA: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:07:58.739306] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-09-26T18:07:58.739372] [DEBUG] [LOCAL ] CPA: No primary data file found to delete. [2025-09-26T18:07:58.739409] [INFO ] [LOCAL ] CPA: Starting deletion of derivative data. [2025-09-26T18:07:58.739989] [DEBUG] [LOCAL ] CPA: Deleted derivative data file. [2025-09-26T18:07:58.740093] [INFO ] [MAIN ] Update Progress: 515/2371 symbols completed. CPA took 36.3s. Estimated remaining: 4h 4m 48s. Rate: 7.6 symbols/min [2025-09-26T18:07:58.916763] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:07:58.936475] [DEBUG] [LOCAL ] CPK: Loaded 13470 existing records from primary storage. [2025-09-26T18:07:58.936621] [INFO ] [MAIN ] CPK: Loaded 13470 existing records. [2025-09-26T18:07:59.125722] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:07:59.126039] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-09-26T18:07:59.126117] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-09-26T18:07:59.126428] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-09-26T18:07:59.126491] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-09-26T18:07:59.161791] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-09-26T18:07:59.505230] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:07:59.926676] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-26T18:07:59.956681] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-09-26T18:08:00.294965] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-26T18:08:00.756752] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-12. [2025-09-26T18:08:01.556719] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-09-26T18:08:01.707777] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-26T18:08:01.969554] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-26T18:08:01.980754] [INFO ] [REMOTE ] CP: Full fetch complete (77128 records). [2025-09-26T18:08:01.980946] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-09-26T18:08:02.370175] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-09-26T18:08:02.444558] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-09-26T18:08:02.444681] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-09-26T18:08:02.445586] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-09-26T18:08:02.445681] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-09-26T18:08:02.447756] [DEBUG] [LOCAL ] CP: Trimmed 77128 records to 54051 (keeping 200 days of data) [2025-09-26T18:08:02.650511] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-26T18:08:02.812043] [DEBUG] [LOCAL ] CP: Primary data saved (54051 records). [2025-09-26T18:08:02.812215] [INFO ] [MAIN ] CP: Full history saved. [2025-09-26T18:08:02.812310] [INFO ] [MAIN ] Update Progress: 516/2371 symbols completed. CP took 41.7s. Estimated remaining: 4h 4m 27s. Rate: 7.6 symbols/min [2025-09-26T18:08:02.994773] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:08:03.047678] [DEBUG] [LOCAL ] CPNG: Loaded 54060 existing records from primary storage. [2025-09-26T18:08:03.047844] [INFO ] [MAIN ] CPNG: Loaded 54060 existing records. [2025-09-26T18:08:03.161192] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-09-26T18:08:03.249261] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:08:03.249519] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-09-26T18:08:03.249569] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-09-26T18:08:03.249857] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-09-26T18:08:03.249919] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-09-26T18:08:03.634465] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:08:03.753494] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-26T18:08:03.768206] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-26T18:08:03.956735] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2024-12. [2025-09-26T18:08:04.756723] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-09-26T18:08:05.556703] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-09-26T18:08:05.686499] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-26T18:08:06.009623] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-26T18:08:06.356736] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-09-26T18:08:06.523100] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-26T18:08:07.023007] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-26T18:08:07.156737] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-09-26T18:08:07.956726] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-09-26T18:08:08.515348] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-26T18:08:08.756726] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-09-26T18:08:09.013534] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-26T18:08:09.556737] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-09-26T18:08:09.576972] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-26T18:08:10.356729] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-09-26T18:08:10.821212] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-26T18:08:10.950636] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-26T18:08:11.156729] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-09-26T18:08:11.956724] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-09-26T18:08:12.153484] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-26T18:08:12.756720] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-09-26T18:08:12.923203] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-26T18:08:12.927052] [INFO ] [REMOTE ] CPF: Full fetch complete (24192 records). [2025-09-26T18:08:12.927200] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-09-26T18:08:13.329994] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-09-26T18:08:13.330161] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-09-26T18:08:13.330777] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-09-26T18:08:13.330861] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-09-26T18:08:13.332010] [DEBUG] [LOCAL ] CPF: Trimmed 24192 records to 15618 (keeping 200 days of data) [2025-09-26T18:08:13.341329] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-26T18:08:13.446968] [DEBUG] [LOCAL ] CPF: Primary data saved (15618 records). [2025-09-26T18:08:13.447176] [INFO ] [MAIN ] CPF: Full history saved. [2025-09-26T18:08:13.447401] [INFO ] [MAIN ] Update Progress: 517/2371 symbols completed. CPF took 23.7s. Estimated remaining: 4h 4m 28s. Rate: 7.6 symbols/min [2025-09-26T18:08:13.556721] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-09-26T18:08:14.356830] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-09-26T18:08:15.156785] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-09-26T18:08:15.297968] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-26T18:08:15.674526] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-26T18:08:15.956740] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-09-26T18:08:16.117737] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-26T18:08:16.756813] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-09-26T18:08:17.433818] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-26T18:08:17.556749] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-09-26T18:08:17.760046] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-26T18:08:18.066396] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-26T18:08:18.356760] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-09-26T18:08:19.156795] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-09-26T18:08:19.365907] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-26T18:08:19.370253] [INFO ] [REMOTE ] CPK: Full fetch complete (17651 records). [2025-09-26T18:08:19.370344] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-09-26T18:08:19.370938] [FATAL] [VALIDATOR ] CPK: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:08:19.371043] [FATAL] [MAIN ] CPK: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:08:19.371128] [WARN ] [MAIN ] CPK: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:08:19.371192] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-09-26T18:08:19.371279] [DEBUG] [LOCAL ] CPK: No primary data file found to delete. [2025-09-26T18:08:19.371343] [INFO ] [LOCAL ] CPK: Starting deletion of derivative data. [2025-09-26T18:08:19.371983] [DEBUG] [LOCAL ] CPK: Deleted derivative data file. [2025-09-26T18:08:19.372105] [INFO ] [MAIN ] Update Progress: 518/2371 symbols completed. CPK took 20.6s. Estimated remaining: 4h 4m 13s. Rate: 7.6 symbols/min [2025-09-26T18:08:19.956831] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-09-26T18:08:21.192227] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-26T18:08:21.205695] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-09-26T18:08:21.242338] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-26T18:08:21.248594] [INFO ] [REMOTE ] CPAY: Full fetch complete (45096 records). [2025-09-26T18:08:21.248760] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-09-26T18:08:21.640813] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-09-26T18:08:21.640909] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-09-26T18:08:21.641555] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-09-26T18:08:21.641603] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-09-26T18:08:21.642973] [DEBUG] [LOCAL ] CPAY: Trimmed 45096 records to 31286 (keeping 200 days of data) [2025-09-26T18:08:21.842585] [DEBUG] [LOCAL ] CPAY: Primary data saved (31286 records). [2025-09-26T18:08:21.842776] [INFO ] [MAIN ] CPAY: Full history saved. [2025-09-26T18:08:21.842878] [INFO ] [MAIN ] Update Progress: 519/2371 symbols completed. CPAY took 41.2s. Estimated remaining: 4h 3m 46s. Rate: 7.6 symbols/min [2025-09-26T18:08:23.465493] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-26T18:08:23.477994] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-09-26T18:08:27.265166] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (3.79 seconds). [2025-09-26T18:08:27.281374] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-09-26T18:08:29.468009] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-26T18:08:29.480016] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-09-26T18:08:31.505704] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-26T18:08:31.518391] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-09-26T18:08:34.019271] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-09-26T18:08:34.031912] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-09-26T18:08:36.481388] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-09-26T18:08:36.492053] [INFO ] [REMOTE ] CPNG: Full fetch complete (77669 records). [2025-09-26T18:08:36.492220] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-09-26T18:08:36.935980] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-09-26T18:08:36.936104] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-09-26T18:08:36.938471] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-09-26T18:08:36.938576] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-09-26T18:08:36.950479] [DEBUG] [LOCAL ] CPNG: Trimmed 77669 records to 54450 (keeping 200 days of data) [2025-09-26T18:08:37.308438] [DEBUG] [LOCAL ] CPNG: Primary data saved (54450 records). [2025-09-26T18:08:37.308612] [INFO ] [MAIN ] CPNG: Full history saved. [2025-09-26T18:08:37.308871] [INFO ] [MAIN ] Update Progress: 520/2371 symbols completed. CPNG took 34.5s. Estimated remaining: 4h 4m 5s. Rate: 7.6 symbols/min [2025-09-26T18:08:37.933623] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:08:38.061171] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:08:38.098703] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:08:38.102235] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:08:38.129374] [DEBUG] [LOCAL ] CQP: Loaded 19937 existing records from primary storage. [2025-09-26T18:08:38.129588] [INFO ] [MAIN ] CQP: Loaded 19937 existing records. [2025-09-26T18:08:38.306864] [DEBUG] [LOCAL ] CPS: Loaded 26362 existing records from primary storage. [2025-09-26T18:08:38.348408] [INFO ] [MAIN ] CPS: Loaded 26362 existing records. [2025-09-26T18:08:38.517839] [DEBUG] [LOCAL ] CPT: Loaded 44711 existing records from primary storage. [2025-09-26T18:08:38.506156] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:08:38.530231] [DEBUG] [LOCAL ] CPRI: Loaded 52950 existing records from primary storage. [2025-09-26T18:08:38.565484] [INFO ] [MAIN ] CPRI: Loaded 52950 existing records. [2025-09-26T18:08:38.565959] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-09-26T18:08:38.565817] [INFO ] [MAIN ] CPT: Loaded 44711 existing records. [2025-09-26T18:08:38.566146] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-09-26T18:08:38.589381] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-09-26T18:08:38.681909] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-09-26T18:08:38.900865] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:08:39.053853] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-09-26T18:08:39.138167] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-09-26T18:08:39.132903] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:08:39.169534] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-09-26T18:08:39.174754] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-09-26T18:08:39.197240] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-09-26T18:08:39.233422] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-09-26T18:08:39.250491] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:08:39.254052] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-09-26T18:08:39.332266] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-09-26T18:08:39.295024] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-09-26T18:08:39.347488] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-09-26T18:08:39.401152] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-09-26T18:08:39.491347] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-09-26T18:08:39.927320] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:08:40.089003] [INFO ] [REMOTE ] CQP: Fetching primary data for 2024-12. [2025-09-26T18:08:40.427540] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:08:40.464620] [INFO ] [REMOTE ] CPS: Fetching primary data for 2024-12. [2025-09-26T18:08:40.683071] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:08:40.696600] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2024-12. [2025-09-26T18:08:40.696343] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:08:40.697781] [INFO ] [REMOTE ] CPT: Fetching primary data for 2024-12. [2025-09-26T18:08:41.795970] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-26T18:08:41.801187] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-09-26T18:08:41.868144] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T18:08:41.872864] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-09-26T18:08:42.106514] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-26T18:08:42.115038] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-09-26T18:08:42.322888] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-26T18:08:42.334323] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-09-26T18:08:42.559128] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-26T18:08:42.564326] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-09-26T18:08:42.694582] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-26T18:08:42.701870] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-09-26T18:08:43.299626] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-26T18:08:43.309763] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-09-26T18:08:43.361793] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-26T18:08:43.367803] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-09-26T18:08:43.671579] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-26T18:08:43.682467] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-09-26T18:08:43.843752] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-26T18:08:43.849627] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-09-26T18:08:44.356177] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-26T18:08:44.362627] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-09-26T18:08:44.989512] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-26T18:08:44.994847] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-09-26T18:08:45.060634] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-26T18:08:45.070342] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-09-26T18:08:45.149833] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-26T18:08:45.160905] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-09-26T18:08:45.329633] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-26T18:08:45.337198] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-09-26T18:08:45.668437] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-26T18:08:45.673193] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-09-26T18:08:46.458909] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-26T18:08:46.464791] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-09-26T18:08:46.541483] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-26T18:08:46.551371] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-09-26T18:08:46.823249] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T18:08:46.830503] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-09-26T18:08:47.075036] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-26T18:08:47.086749] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-09-26T18:08:47.750904] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-26T18:08:47.757382] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-09-26T18:08:48.044919] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-26T18:08:48.050745] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-09-26T18:08:48.225836] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-26T18:08:48.240567] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-09-26T18:08:48.454220] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-26T18:08:48.465885] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-09-26T18:08:48.595777] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-26T18:08:48.601589] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-09-26T18:08:48.824423] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-26T18:08:48.830035] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-09-26T18:08:49.525028] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-26T18:08:49.556699] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-09-26T18:08:49.726578] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T18:08:49.751448] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-26T18:08:49.847670] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-26T18:08:50.356740] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-09-26T18:08:50.737062] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-26T18:08:50.740313] [INFO ] [REMOTE ] CQP: Full fetch complete (30807 records). [2025-09-26T18:08:50.740459] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-09-26T18:08:51.133332] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-09-26T18:08:51.133440] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-09-26T18:08:51.133969] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-09-26T18:08:51.134036] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-09-26T18:08:51.135037] [DEBUG] [LOCAL ] CQP: Trimmed 30807 records to 20033 (keeping 200 days of data) [2025-09-26T18:08:51.194236] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-09-26T18:08:51.278178] [DEBUG] [LOCAL ] CQP: Primary data saved (20033 records). [2025-09-26T18:08:51.278398] [INFO ] [MAIN ] CQP: Full history saved. [2025-09-26T18:08:51.278566] [INFO ] [MAIN ] Update Progress: 521/2371 symbols completed. CQP took 14.0s. Estimated remaining: 4h 4m 19s. Rate: 7.6 symbols/min [2025-09-26T18:08:51.471720] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:08:51.490211] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-26T18:08:51.496376] [INFO ] [REMOTE ] CPS: Full fetch complete (36292 records). [2025-09-26T18:08:51.496597] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-09-26T18:08:51.637262] [DEBUG] [LOCAL ] CR: Loaded 24857 existing records from primary storage. [2025-09-26T18:08:51.648072] [INFO ] [MAIN ] CR: Loaded 24857 existing records. [2025-09-26T18:08:51.976058] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-09-26T18:08:52.068709] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:08:52.084694] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-09-26T18:08:52.084858] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-09-26T18:08:52.110631] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-09-26T18:08:52.132188] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-09-26T18:08:52.212351] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-09-26T18:08:52.250216] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-09-26T18:08:52.264361] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-09-26T18:08:52.282634] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-09-26T18:08:52.335773] [DEBUG] [LOCAL ] CPS: Trimmed 36292 records to 26476 (keeping 200 days of data) [2025-09-26T18:08:52.656710] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:08:52.729192] [DEBUG] [LOCAL ] CPS: Primary data saved (26476 records). [2025-09-26T18:08:52.729339] [INFO ] [MAIN ] CPS: Full history saved. [2025-09-26T18:08:52.729481] [INFO ] [MAIN ] Update Progress: 522/2371 symbols completed. CPS took 15.4s. Estimated remaining: 4h 3m 48s. Rate: 7.6 symbols/min [2025-09-26T18:08:52.761983] [INFO ] [REMOTE ] CR: Fetching primary data for 2024-12. [2025-09-26T18:08:52.915349] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:08:52.944472] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-26T18:08:52.957276] [DEBUG] [LOCAL ] CRBD: Loaded 9077 existing records from primary storage. [2025-09-26T18:08:52.957741] [INFO ] [MAIN ] CRBD: Loaded 9077 existing records. [2025-09-26T18:08:53.145040] [WARN ] [MAIN ] CRBD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:08:53.145291] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-09-26T18:08:53.145340] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-09-26T18:08:53.145761] [DEBUG] [LOCAL ] CRBD: Deleted primary data file. [2025-09-26T18:08:53.145821] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-09-26T18:08:53.523756] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:08:53.556728] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2024-12. [2025-09-26T18:08:54.066006] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-26T18:08:54.135523] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-26T18:08:54.356691] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-09-26T18:08:54.383477] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-26T18:08:55.156746] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-09-26T18:08:55.672200] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-26T18:08:55.956740] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-09-26T18:08:56.509524] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-26T18:08:56.756738] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-09-26T18:08:57.098229] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-26T18:08:57.556745] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-09-26T18:08:58.356705] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-09-26T18:08:58.415853] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-26T18:08:58.759361] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-26T18:08:58.835564] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-26T18:08:59.156796] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-09-26T18:08:59.895391] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-26T18:08:59.956737] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-09-26T18:09:00.566325] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-26T18:09:00.756748] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-09-26T18:09:01.558085] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-09-26T18:09:01.560945] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-26T18:09:02.356742] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-09-26T18:09:03.150450] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-26T18:09:03.156668] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-09-26T18:09:03.426146] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-26T18:09:03.707550] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-26T18:09:03.956743] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-09-26T18:09:04.756732] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-09-26T18:09:05.556730] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-09-26T18:09:05.972537] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-26T18:09:05.982194] [INFO ] [REMOTE ] CPT: Full fetch complete (63718 records). [2025-09-26T18:09:05.982364] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-09-26T18:09:06.211785] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-26T18:09:06.361835] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-09-26T18:09:06.436558] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-09-26T18:09:06.436679] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-09-26T18:09:06.437538] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-09-26T18:09:06.437605] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-09-26T18:09:06.439238] [DEBUG] [LOCAL ] CPT: Trimmed 63718 records to 45034 (keeping 200 days of data) [2025-09-26T18:09:06.738081] [DEBUG] [LOCAL ] CPT: Primary data saved (45034 records). [2025-09-26T18:09:06.738232] [INFO ] [MAIN ] CPT: Full history saved. [2025-09-26T18:09:06.738346] [INFO ] [MAIN ] Update Progress: 523/2371 symbols completed. CPT took 29.4s. Estimated remaining: 4h 4m 1s. Rate: 7.6 symbols/min [2025-09-26T18:09:06.927970] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:09:06.987028] [DEBUG] [LOCAL ] CRBG: Loaded 52728 existing records from primary storage. [2025-09-26T18:09:06.987245] [INFO ] [MAIN ] CRBG: Loaded 52728 existing records. [2025-09-26T18:09:07.105458] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-26T18:09:07.163288] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-09-26T18:09:07.257679] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:09:07.258039] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-09-26T18:09:07.258301] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-09-26T18:09:07.269876] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-09-26T18:09:07.275676] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-09-26T18:09:07.363449] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-26T18:09:07.426612] [INFO ] [REMOTE ] CPRI: Full fetch complete (76150 records). [2025-09-26T18:09:07.437094] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-09-26T18:09:07.964674] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-09-26T18:09:07.952822] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:09:08.132905] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-09-26T18:09:08.133094] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-09-26T18:09:08.133901] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-09-26T18:09:08.133967] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-09-26T18:09:08.135542] [DEBUG] [LOCAL ] CPRI: Trimmed 76150 records to 53326 (keeping 200 days of data) [2025-09-26T18:09:08.238362] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-26T18:09:08.476133] [DEBUG] [LOCAL ] CPRI: Primary data saved (53326 records). [2025-09-26T18:09:08.476420] [INFO ] [MAIN ] CPRI: Full history saved. [2025-09-26T18:09:08.476636] [INFO ] [MAIN ] Update Progress: 524/2371 symbols completed. CPRI took 31.2s. Estimated remaining: 4h 3m 32s. Rate: 7.6 symbols/min [2025-09-26T18:09:08.658191] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:09:08.700556] [DEBUG] [LOCAL ] CRC: Loaded 44654 existing records from primary storage. [2025-09-26T18:09:08.700749] [INFO ] [MAIN ] CRC: Loaded 44654 existing records. [2025-09-26T18:09:08.767616] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-09-26T18:09:08.923734] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:09:08.924028] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-09-26T18:09:08.924081] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-09-26T18:09:08.925368] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-09-26T18:09:08.925435] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-09-26T18:09:09.305865] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:09:09.356126] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-26T18:09:09.372152] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-26T18:09:09.374920] [INFO ] [REMOTE ] CRBD: Full fetch complete (15378 records). [2025-09-26T18:09:09.375002] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-09-26T18:09:09.561858] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-09-26T18:09:09.801975] [DEBUG] [VALIDATOR ] CRBD: All expected trading days are present. [2025-09-26T18:09:09.802104] [DEBUG] [VALIDATOR ] CRBD: Primary data validation passed. [2025-09-26T18:09:09.802894] [INFO ] [MAIN ] CRBD: Fetched primary data is valid. [2025-09-26T18:09:09.802963] [DEBUG] [LOCAL ] CRBD: Saving primary data. [2025-09-26T18:09:09.803835] [DEBUG] [LOCAL ] CRBD: Trimmed 15378 records to 9131 (keeping 200 days of data) [2025-09-26T18:09:09.872964] [DEBUG] [LOCAL ] CRBD: Primary data saved (9131 records). [2025-09-26T18:09:09.873256] [INFO ] [MAIN ] CRBD: Full history saved. [2025-09-26T18:09:09.873445] [INFO ] [MAIN ] Update Progress: 525/2371 symbols completed. CRBD took 17.1s. Estimated remaining: 4h 3m 1s. Rate: 7.6 symbols/min [2025-09-26T18:09:10.067464] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:09:10.067716] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-09-26T18:09:10.067768] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-09-26T18:09:10.067994] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-09-26T18:09:10.068046] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-26T18:09:10.068090] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-26T18:09:10.068122] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-09-26T18:09:10.356814] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-12. [2025-09-26T18:09:10.449915] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:09:10.583410] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-26T18:09:11.156724] [INFO ] [REMOTE ] CRC: Fetching primary data for 2024-12. [2025-09-26T18:09:11.847311] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-26T18:09:11.956705] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-09-26T18:09:12.381020] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-26T18:09:12.756721] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-09-26T18:09:13.259870] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-26T18:09:13.556721] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-09-26T18:09:14.356719] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-12. [2025-09-26T18:09:14.411697] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-26T18:09:14.689092] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:09:14.689433] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-12 [2025-09-26T18:09:14.724202] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-26T18:09:15.156736] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-09-26T18:09:15.956728] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-09-26T18:09:16.661666] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-26T18:09:16.756765] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-09-26T18:09:17.527717] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-26T18:09:17.556672] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-09-26T18:09:17.948517] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-26T18:09:18.356742] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-09-26T18:09:19.106606] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T18:09:19.156683] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-09-26T18:09:19.921931] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-26T18:09:19.956701] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-01. [2025-09-26T18:09:20.155274] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:09:20.155830] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-01 [2025-09-26T18:09:20.756743] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-02. [2025-09-26T18:09:20.930867] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-26T18:09:20.985939] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:09:20.986309] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-02 [2025-09-26T18:09:21.556768] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-09-26T18:09:22.356780] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-09-26T18:09:23.156726] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-03. [2025-09-26T18:09:23.375278] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:09:23.375825] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-03 [2025-09-26T18:09:23.456573] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-26T18:09:23.703247] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-26T18:09:23.956746] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-09-26T18:09:24.756774] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-09-26T18:09:25.556752] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-09-26T18:09:25.599040] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-26T18:09:26.356780] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-04. [2025-09-26T18:09:26.412708] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-26T18:09:26.565368] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:09:26.565832] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-04 [2025-09-26T18:09:26.587985] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-26T18:09:26.593904] [INFO ] [REMOTE ] CR: Full fetch complete (35029 records). [2025-09-26T18:09:26.594019] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-09-26T18:09:27.001198] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-09-26T18:09:27.001282] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-09-26T18:09:27.001784] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-09-26T18:09:27.001849] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-09-26T18:09:27.002768] [DEBUG] [LOCAL ] CR: Trimmed 35029 records to 25019 (keeping 200 days of data) [2025-09-26T18:09:27.156791] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-09-26T18:09:27.162683] [DEBUG] [LOCAL ] CR: Primary data saved (25019 records). [2025-09-26T18:09:27.163804] [INFO ] [MAIN ] CR: Full history saved. [2025-09-26T18:09:27.163921] [INFO ] [MAIN ] Update Progress: 526/2371 symbols completed. CR took 35.9s. Estimated remaining: 4h 3m 26s. Rate: 7.6 symbols/min [2025-09-26T18:09:27.346616] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:09:27.400183] [DEBUG] [LOCAL ] CRGY: Loaded 52903 existing records from primary storage. [2025-09-26T18:09:27.400343] [INFO ] [MAIN ] CRGY: Loaded 52903 existing records. [2025-09-26T18:09:27.588408] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:09:27.588741] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-09-26T18:09:27.588800] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-09-26T18:09:27.590223] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-09-26T18:09:27.590288] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-09-26T18:09:27.963843] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-09-26T18:09:27.980422] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:09:28.756832] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2024-12. [2025-09-26T18:09:28.996565] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-26T18:09:29.131727] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-26T18:09:29.556833] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-09-26T18:09:30.356788] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-05. [2025-09-26T18:09:30.563687] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:09:30.564400] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-05 [2025-09-26T18:09:30.618582] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-26T18:09:31.107312] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T18:09:31.156734] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-09-26T18:09:31.956747] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-09-26T18:09:32.756702] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-09-26T18:09:32.863638] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-26T18:09:33.556723] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-09-26T18:09:33.699154] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-26T18:09:34.302781] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-26T18:09:34.356706] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-09-26T18:09:34.955630] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-26T18:09:35.156782] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-06. [2025-09-26T18:09:35.911106] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-26T18:09:35.920923] [INFO ] [REMOTE ] CRBG: Full fetch complete (75313 records). [2025-09-26T18:09:35.921067] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-09-26T18:09:35.921864] [FATAL] [VALIDATOR ] CRBG: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:09:35.921957] [FATAL] [MAIN ] CRBG: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:09:35.922001] [WARN ] [MAIN ] CRBG: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:09:35.922064] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-09-26T18:09:35.922155] [DEBUG] [LOCAL ] CRBG: No primary data file found to delete. [2025-09-26T18:09:35.922211] [INFO ] [LOCAL ] CRBG: Starting deletion of derivative data. [2025-09-26T18:09:35.922723] [DEBUG] [LOCAL ] CRBG: Deleted derivative data file. [2025-09-26T18:09:35.922853] [INFO ] [MAIN ] Update Progress: 527/2371 symbols completed. CRBG took 29.2s. Estimated remaining: 4h 3m 21s. Rate: 7.6 symbols/min [2025-09-26T18:09:35.961951] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-09-26T18:09:36.101908] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:09:36.154738] [DEBUG] [LOCAL ] CRH: Loaded 53856 existing records from primary storage. [2025-09-26T18:09:36.154918] [INFO ] [MAIN ] CRH: Loaded 53856 existing records. [2025-09-26T18:09:36.354295] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:09:36.354631] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-09-26T18:09:36.354728] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-09-26T18:09:36.356263] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-09-26T18:09:36.356326] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-09-26T18:09:36.736849] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:09:36.756702] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-12. [2025-09-26T18:09:37.245200] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-26T18:09:37.410286] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-26T18:09:37.556716] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-09-26T18:09:38.341069] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-26T18:09:38.356872] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-09-26T18:09:38.965786] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-26T18:09:38.975944] [INFO ] [REMOTE ] CRC: Full fetch complete (62288 records). [2025-09-26T18:09:38.976137] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-09-26T18:09:39.159993] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-07. [2025-09-26T18:09:39.510627] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-09-26T18:09:39.510840] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-09-26T18:09:39.512316] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-09-26T18:09:39.512506] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-09-26T18:09:39.514537] [DEBUG] [LOCAL ] CRC: Trimmed 62288 records to 44946 (keeping 200 days of data) [2025-09-26T18:09:39.927487] [DEBUG] [LOCAL ] CRC: Primary data saved (44946 records). [2025-09-26T18:09:39.927719] [INFO ] [MAIN ] CRC: Full history saved. [2025-09-26T18:09:39.927866] [INFO ] [MAIN ] Update Progress: 528/2371 symbols completed. CRC took 31.5s. Estimated remaining: 4h 2m 59s. Rate: 7.6 symbols/min [2025-09-26T18:09:39.967774] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-09-26T18:09:40.158527] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:09:40.244630] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-26T18:09:40.260071] [DEBUG] [LOCAL ] CRI: Loaded 50361 existing records from primary storage. [2025-09-26T18:09:40.260244] [INFO ] [MAIN ] CRI: Loaded 50361 existing records. [2025-09-26T18:09:40.485966] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:09:40.486248] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-09-26T18:09:40.486304] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-09-26T18:09:40.487739] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-09-26T18:09:40.487802] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-09-26T18:09:40.761885] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-09-26T18:09:40.873251] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:09:41.556759] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-12. [2025-09-26T18:09:41.931423] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-26T18:09:42.043258] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-07 (2.88 seconds). [2025-09-26T18:09:42.319026] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-26T18:09:42.356728] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-09-26T18:09:43.156756] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-09-26T18:09:43.325623] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-26T18:09:43.956759] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-09-26T18:09:44.367994] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-26T18:09:44.756739] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-09-26T18:09:44.876547] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T18:09:45.173848] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-26T18:09:45.556741] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-09-26T18:09:46.281688] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T18:09:46.356728] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-09-26T18:09:46.990428] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-26T18:09:47.156739] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-09-26T18:09:47.956752] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-09-26T18:09:48.019681] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-26T18:09:48.756740] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-08. [2025-09-26T18:09:48.888700] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-26T18:09:49.219076] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-26T18:09:49.556726] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-09-26T18:09:50.356760] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-09-26T18:09:50.872375] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-26T18:09:51.156742] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-09-26T18:09:51.359549] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-09-26T18:09:51.956734] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-09-26T18:09:52.269173] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-26T18:09:52.756747] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-09-26T18:09:52.878102] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-26T18:09:53.556733] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-09-26T18:09:53.660844] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-26T18:09:54.356713] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-09-26T18:09:54.735915] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-26T18:09:55.052695] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-26T18:09:55.156775] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-09-26T18:09:55.775476] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-26T18:09:55.956724] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-09-26T18:09:56.756688] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-09. [2025-09-26T18:09:56.802988] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T18:09:56.814048] [INFO ] [REMOTE ] CRGY: Full fetch complete (75952 records). [2025-09-26T18:09:56.814220] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-09-26T18:09:57.225792] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-09-26T18:09:57.225923] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-09-26T18:09:57.226813] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-09-26T18:09:57.226897] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-09-26T18:09:57.229034] [DEBUG] [LOCAL ] CRGY: Trimmed 75952 records to 53290 (keeping 200 days of data) [2025-09-26T18:09:57.348904] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-26T18:09:57.569493] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-09-26T18:09:57.597176] [DEBUG] [LOCAL ] CRGY: Primary data saved (53290 records). [2025-09-26T18:09:57.597317] [INFO ] [MAIN ] CRGY: Full history saved. [2025-09-26T18:09:57.597421] [INFO ] [MAIN ] Update Progress: 529/2371 symbols completed. CRGY took 30.4s. Estimated remaining: 4h 3m 26s. Rate: 7.6 symbols/min [2025-09-26T18:09:57.779492] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:09:57.831827] [DEBUG] [LOCAL ] CRK: Loaded 52506 existing records from primary storage. [2025-09-26T18:09:57.831986] [INFO ] [MAIN ] CRK: Loaded 52506 existing records. [2025-09-26T18:09:58.016965] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:09:58.017268] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-09-26T18:09:58.017322] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-09-26T18:09:58.018708] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-09-26T18:09:58.018810] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-09-26T18:09:58.361832] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-09-26T18:09:58.404394] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:09:59.156733] [INFO ] [REMOTE ] CRK: Fetching primary data for 2024-12. [2025-09-26T18:09:59.331092] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-09-26T18:09:59.342182] [INFO ] [REMOTE ] CRCL: Full fetch complete (30609 records). [2025-09-26T18:09:59.342316] [DEBUG] [VALIDATOR ] CRCL: Validating primary data. [2025-09-26T18:09:59.543404] [WARN ] [VALIDATOR ] CRCL: Validation failed - insufficient historical data. Have 79 unique days, need 200 days [2025-09-26T18:09:59.543925] [FATAL] [MAIN ] CRCL: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:09:59.544057] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:09:59.544136] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-26T18:09:59.544376] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-26T18:09:59.544478] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-09-26T18:09:59.544605] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-09-26T18:09:59.544823] [INFO ] [MAIN ] Update Progress: 530/2371 symbols completed. CRCL took 49.7s. Estimated remaining: 4h 2m 57s. Rate: 7.6 symbols/min [2025-09-26T18:09:59.764065] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:09:59.769924] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-26T18:09:59.847121] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-26T18:09:59.879265] [DEBUG] [LOCAL ] CRL: Loaded 43547 existing records from primary storage. [2025-09-26T18:09:59.879424] [INFO ] [MAIN ] CRL: Loaded 43547 existing records. [2025-09-26T18:09:59.961828] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-09-26T18:10:00.117183] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:10:00.117480] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-09-26T18:10:00.117535] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-09-26T18:10:00.118813] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-09-26T18:10:00.118876] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-09-26T18:10:00.492761] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:10:00.762117] [INFO ] [REMOTE ] CRL: Fetching primary data for 2024-12. [2025-09-26T18:10:00.778575] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-26T18:10:01.556760] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-09-26T18:10:02.083784] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-26T18:10:02.093985] [INFO ] [REMOTE ] CRH: Full fetch complete (76907 records). [2025-09-26T18:10:02.094709] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-09-26T18:10:02.095553] [FATAL] [VALIDATOR ] CRH: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:10:02.095669] [FATAL] [MAIN ] CRH: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:10:02.095731] [WARN ] [MAIN ] CRH: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:10:02.095802] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-09-26T18:10:02.095874] [DEBUG] [LOCAL ] CRH: No primary data file found to delete. [2025-09-26T18:10:02.095913] [INFO ] [LOCAL ] CRH: Starting deletion of derivative data. [2025-09-26T18:10:02.096342] [DEBUG] [LOCAL ] CRH: Deleted derivative data file. [2025-09-26T18:10:02.096457] [INFO ] [MAIN ] Update Progress: 531/2371 symbols completed. CRH took 26.2s. Estimated remaining: 4h 2m 30s. Rate: 7.6 symbols/min [2025-09-26T18:10:02.285551] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:10:02.310992] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-26T18:10:02.356726] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-09-26T18:10:02.378814] [DEBUG] [LOCAL ] CRM: Loaded 54160 existing records from primary storage. [2025-09-26T18:10:02.379029] [INFO ] [MAIN ] CRM: Loaded 54160 existing records. [2025-09-26T18:10:02.612554] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:10:02.612875] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-09-26T18:10:02.612942] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-09-26T18:10:02.614779] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-09-26T18:10:02.614861] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-09-26T18:10:03.003020] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:10:03.156731] [INFO ] [REMOTE ] CRM: Fetching primary data for 2024-12. [2025-09-26T18:10:03.300950] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-26T18:10:03.956741] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-09-26T18:10:04.080766] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-26T18:10:04.756736] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-09-26T18:10:05.378933] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-26T18:10:05.556741] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-09-26T18:10:06.102309] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-26T18:10:06.112261] [INFO ] [REMOTE ] CRI: Full fetch complete (70635 records). [2025-09-26T18:10:06.112446] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-09-26T18:10:06.113730] [FATAL] [VALIDATOR ] CRI: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:10:06.113856] [FATAL] [MAIN ] CRI: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:10:06.114015] [WARN ] [MAIN ] CRI: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:10:06.114328] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-09-26T18:10:06.114473] [DEBUG] [LOCAL ] CRI: No primary data file found to delete. [2025-09-26T18:10:06.114544] [INFO ] [LOCAL ] CRI: Starting deletion of derivative data. [2025-09-26T18:10:06.115128] [DEBUG] [LOCAL ] CRI: Deleted derivative data file. [2025-09-26T18:10:06.115402] [INFO ] [MAIN ] Update Progress: 532/2371 symbols completed. CRI took 26.2s. Estimated remaining: 4h 2m 9s. Rate: 7.6 symbols/min [2025-09-26T18:10:06.313174] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:10:06.313553] [DEBUG] [LOCAL ] CRS: No existing data file found in primary storage. [2025-09-26T18:10:06.313738] [WARN ] [MAIN ] CRS: No existing data found, performing full refresh instead. [2025-09-26T18:10:06.314146] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-09-26T18:10:06.314206] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-09-26T18:10:06.323424] [DEBUG] [LOCAL ] CRS: No primary data file found to delete. [2025-09-26T18:10:06.338951] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-09-26T18:10:06.364093] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-26T18:10:06.361813] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-09-26T18:10:06.736334] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:10:07.156700] [INFO ] [REMOTE ] CRS: Fetching primary data for 2024-12. [2025-09-26T18:10:07.234461] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-26T18:10:07.956731] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-09-26T18:10:08.610510] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-26T18:10:08.723385] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-09-26T18:10:08.756709] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-09-26T18:10:09.414494] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-26T18:10:09.556726] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-09-26T18:10:10.356755] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-09-26T18:10:10.773111] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-26T18:10:10.888530] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-26T18:10:11.156743] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-09-26T18:10:11.922897] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-26T18:10:11.956695] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-09-26T18:10:12.756704] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-09-26T18:10:13.052957] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-26T18:10:13.556695] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-09-26T18:10:13.797583] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-26T18:10:14.356776] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-09-26T18:10:14.744758] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-26T18:10:15.021023] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-26T18:10:15.156728] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-09-26T18:10:15.866192] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-26T18:10:15.956766] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-09-26T18:10:16.631968] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-26T18:10:16.756807] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-09-26T18:10:17.065992] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-26T18:10:17.556770] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-09-26T18:10:18.198768] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-26T18:10:18.356764] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-09-26T18:10:19.156738] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-09-26T18:10:19.956758] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-09-26T18:10:20.055716] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-09-26T18:10:20.484379] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-26T18:10:20.756771] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-09-26T18:10:20.899416] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-26T18:10:21.425961] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-26T18:10:21.556743] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-09-26T18:10:22.237571] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-26T18:10:22.356761] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-09-26T18:10:23.156743] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-09-26T18:10:23.902087] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-26T18:10:23.956744] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-09-26T18:10:24.025216] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-26T18:10:24.580312] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-26T18:10:24.756773] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-09-26T18:10:25.556731] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-09-26T18:10:26.356765] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-09-26T18:10:26.561552] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-09-26T18:10:26.601868] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-26T18:10:27.140947] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-26T18:10:27.151428] [INFO ] [REMOTE ] CRK: Full fetch complete (75555 records). [2025-09-26T18:10:27.151631] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-09-26T18:10:27.164527] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-09-26T18:10:27.601380] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-09-26T18:10:27.601551] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-09-26T18:10:27.602468] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-09-26T18:10:27.602573] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-09-26T18:10:27.604509] [DEBUG] [LOCAL ] CRK: Trimmed 75555 records to 52891 (keeping 200 days of data) [2025-09-26T18:10:27.724449] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-26T18:10:27.741965] [INFO ] [REMOTE ] CRL: Full fetch complete (62762 records). [2025-09-26T18:10:27.744553] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-09-26T18:10:27.962791] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-09-26T18:10:28.300244] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-09-26T18:10:28.300713] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-09-26T18:10:28.302733] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-09-26T18:10:28.303161] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-09-26T18:10:28.308066] [DEBUG] [LOCAL ] CRL: Trimmed 62762 records to 43853 (keeping 200 days of data) [2025-09-26T18:10:28.669692] [DEBUG] [LOCAL ] CRL: Primary data saved (43853 records). [2025-09-26T18:10:28.670528] [INFO ] [MAIN ] CRL: Full history saved. [2025-09-26T18:10:28.671009] [INFO ] [MAIN ] Update Progress: 533/2371 symbols completed. CRL took 29.1s. Estimated remaining: 4h 2m 52s. Rate: 7.6 symbols/min [2025-09-26T18:10:28.882107] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:10:28.887440] [DEBUG] [LOCAL ] CRK: Primary data saved (52891 records). [2025-09-26T18:10:28.889554] [INFO ] [MAIN ] CRK: Full history saved. [2025-09-26T18:10:28.889727] [INFO ] [MAIN ] Update Progress: 534/2371 symbols completed. CRK took 31.3s. Estimated remaining: 4h 2m 17s. Rate: 7.6 symbols/min [2025-09-26T18:10:28.961281] [DEBUG] [LOCAL ] CRT: Loaded 4974 existing records from primary storage. [2025-09-26T18:10:28.974089] [INFO ] [MAIN ] CRT: Loaded 4974 existing records. [2025-09-26T18:10:29.221844] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:10:29.317637] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:10:29.318517] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-09-26T18:10:29.318592] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-09-26T18:10:29.319265] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-09-26T18:10:29.320158] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-09-26T18:10:29.506632] [DEBUG] [LOCAL ] CSAN: Loaded 42640 existing records from primary storage. [2025-09-26T18:10:29.527867] [INFO ] [MAIN ] CSAN: Loaded 42640 existing records. [2025-09-26T18:10:30.051153] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:10:30.037076] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:10:30.051787] [INFO ] [REMOTE ] CRT: Fetching primary data for 2024-12. [2025-09-26T18:10:30.053101] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-09-26T18:10:30.053231] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-09-26T18:10:30.054823] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-09-26T18:10:30.055149] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-09-26T18:10:30.350727] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-09-26T18:10:30.455771] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-09-26T18:10:30.483032] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (3.32 seconds). [2025-09-26T18:10:30.571047] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:10:30.572049] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2024-12. [2025-09-26T18:10:30.737221] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-26T18:10:31.156744] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-09-26T18:10:31.897680] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-26T18:10:31.956749] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-09-26T18:10:32.021214] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-26T18:10:32.756782] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-09-26T18:10:32.978369] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-26T18:10:33.307948] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-26T18:10:33.556730] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-09-26T18:10:34.079593] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-26T18:10:34.356777] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-09-26T18:10:35.156821] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-09-26T18:10:35.798628] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-26T18:10:35.891550] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-09-26T18:10:35.903029] [INFO ] [REMOTE ] CRM: Full fetch complete (77844 records). [2025-09-26T18:10:35.903195] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-09-26T18:10:35.963514] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-09-26T18:10:36.330890] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-09-26T18:10:36.331138] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-09-26T18:10:36.332101] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-09-26T18:10:36.332232] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-09-26T18:10:36.334240] [DEBUG] [LOCAL ] CRM: Trimmed 77844 records to 54550 (keeping 200 days of data) [2025-09-26T18:10:36.360016] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-26T18:10:36.744553] [DEBUG] [LOCAL ] CRM: Primary data saved (54550 records). [2025-09-26T18:10:36.744919] [INFO ] [MAIN ] CRM: Full history saved. [2025-09-26T18:10:36.745375] [INFO ] [MAIN ] Update Progress: 535/2371 symbols completed. CRM took 34.6s. Estimated remaining: 4h 2m 9s. Rate: 7.6 symbols/min [2025-09-26T18:10:36.761889] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-09-26T18:10:36.948789] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:10:36.949011] [DEBUG] [LOCAL ] CSL: No existing data file found in primary storage. [2025-09-26T18:10:36.949062] [WARN ] [MAIN ] CSL: No existing data found, performing full refresh instead. [2025-09-26T18:10:36.949205] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-09-26T18:10:36.949250] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-09-26T18:10:36.949291] [DEBUG] [LOCAL ] CSL: No primary data file found to delete. [2025-09-26T18:10:36.949335] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-09-26T18:10:37.365505] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:10:37.396195] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-26T18:10:37.409797] [INFO ] [REMOTE ] CRS: Full fetch complete (62648 records). [2025-09-26T18:10:37.410021] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-09-26T18:10:37.561807] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-09-26T18:10:37.815546] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-09-26T18:10:37.815629] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-09-26T18:10:37.816365] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-09-26T18:10:37.816416] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-09-26T18:10:37.817755] [DEBUG] [LOCAL ] CRS: Trimmed 62648 records to 43928 (keeping 200 days of data) [2025-09-26T18:10:38.105123] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-26T18:10:38.177445] [DEBUG] [LOCAL ] CRS: Primary data saved (43928 records). [2025-09-26T18:10:38.177608] [INFO ] [MAIN ] CRS: Full history saved. [2025-09-26T18:10:38.177804] [INFO ] [MAIN ] Update Progress: 536/2371 symbols completed. CRS took 32.1s. Estimated remaining: 4h 1m 39s. Rate: 7.6 symbols/min [2025-09-26T18:10:38.325083] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-26T18:10:38.361193] [INFO ] [REMOTE ] CSL: Fetching primary data for 2024-12. [2025-09-26T18:10:38.382103] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:10:38.400864] [DEBUG] [LOCAL ] CSR: Loaded 12686 existing records from primary storage. [2025-09-26T18:10:38.400992] [INFO ] [MAIN ] CSR: Loaded 12686 existing records. [2025-09-26T18:10:38.594115] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:10:38.595697] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-09-26T18:10:38.595789] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-09-26T18:10:38.597000] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-09-26T18:10:38.597068] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-09-26T18:10:38.976004] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:10:39.156734] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-09-26T18:10:39.922005] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-26T18:10:39.956764] [INFO ] [REMOTE ] CSR: Fetching primary data for 2024-12. [2025-09-26T18:10:40.450386] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-26T18:10:40.745497] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-26T18:10:40.756684] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-09-26T18:10:41.446594] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-26T18:10:41.556722] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-09-26T18:10:42.356789] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-09-26T18:10:42.965702] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-26T18:10:42.973338] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-26T18:10:43.156747] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-09-26T18:10:43.956732] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-09-26T18:10:44.682555] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-26T18:10:44.711107] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-26T18:10:44.756765] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-09-26T18:10:45.556734] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-09-26T18:10:46.184536] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-26T18:10:46.356747] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-09-26T18:10:46.616520] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-26T18:10:47.156787] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-09-26T18:10:47.799762] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-26T18:10:47.956714] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-09-26T18:10:48.042250] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-26T18:10:48.482991] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-26T18:10:48.756731] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-09-26T18:10:49.412689] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-26T18:10:49.556733] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-09-26T18:10:50.356757] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-09-26T18:10:51.089333] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-26T18:10:51.156725] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-09-26T18:10:51.871574] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-26T18:10:51.956735] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-09-26T18:10:52.080952] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-26T18:10:52.581528] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-26T18:10:52.756727] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-09-26T18:10:53.497271] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-26T18:10:53.556744] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-09-26T18:10:54.356755] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-09-26T18:10:55.013524] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-26T18:10:55.039678] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-26T18:10:55.156762] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-09-26T18:10:55.956729] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-09-26T18:10:56.756744] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-09-26T18:10:57.050025] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-26T18:10:57.062128] [INFO ] [REMOTE ] CSAN: Full fetch complete (60844 records). [2025-09-26T18:10:57.062298] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-09-26T18:10:57.356249] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-26T18:10:57.447182] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-26T18:10:57.481465] [INFO ] [REMOTE ] CRT: Full fetch complete (7632 records). [2025-09-26T18:10:57.494748] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-09-26T18:10:57.580726] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-09-26T18:10:57.561772] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-09-26T18:10:57.603876] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-09-26T18:10:57.619970] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-09-26T18:10:57.620086] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-09-26T18:10:57.673705] [DEBUG] [LOCAL ] CSAN: Trimmed 60844 records to 42951 (keeping 200 days of data) [2025-09-26T18:10:58.069885] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-09-26T18:10:58.072025] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-09-26T18:10:58.072299] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-09-26T18:10:58.072402] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-09-26T18:10:58.082221] [DEBUG] [LOCAL ] CRT: Trimmed 7632 records to 5018 (keeping 200 days of data) [2025-09-26T18:10:58.203993] [DEBUG] [LOCAL ] CRT: Primary data saved (5018 records). [2025-09-26T18:10:58.211712] [INFO ] [MAIN ] CRT: Full history saved. [2025-09-26T18:10:58.218027] [INFO ] [MAIN ] Update Progress: 537/2371 symbols completed. CRT took 29.5s. Estimated remaining: 4h 2m 12s. Rate: 7.6 symbols/min [2025-09-26T18:10:58.359042] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-09-26T18:10:58.417818] [DEBUG] [LOCAL ] CSAN: Primary data saved (42951 records). [2025-09-26T18:10:58.446495] [INFO ] [MAIN ] CSAN: Full history saved. [2025-09-26T18:10:58.446121] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:10:58.447075] [INFO ] [MAIN ] Update Progress: 538/2371 symbols completed. CSAN took 29.6s. Estimated remaining: 4h 1m 38s. Rate: 7.6 symbols/min [2025-09-26T18:10:58.654311] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:10:58.655203] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-26T18:10:58.685778] [DEBUG] [LOCAL ] CSV: Loaded 13101 existing records from primary storage. [2025-09-26T18:10:58.685923] [INFO ] [MAIN ] CSV: Loaded 13101 existing records. [2025-09-26T18:10:58.810090] [DEBUG] [LOCAL ] CSTM: Loaded 48051 existing records from primary storage. [2025-09-26T18:10:58.816011] [INFO ] [MAIN ] CSTM: Loaded 48051 existing records. [2025-09-26T18:10:59.009521] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:10:59.026066] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-09-26T18:10:59.036517] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-09-26T18:10:59.063798] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-09-26T18:10:59.094217] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:10:59.094040] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-09-26T18:10:59.128830] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-09-26T18:10:59.163707] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-09-26T18:10:59.163579] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-09-26T18:10:59.182397] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-09-26T18:10:59.196068] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-09-26T18:10:59.860050] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:10:59.976982] [INFO ] [REMOTE ] CSV: Fetching primary data for 2024-12. [2025-09-26T18:11:00.006079] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:11:00.010742] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-26T18:11:00.026852] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-26T18:11:00.756738] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-09-26T18:11:01.081986] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-26T18:11:01.556735] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-09-26T18:11:02.329723] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-26T18:11:02.356734] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2024-12. [2025-09-26T18:11:02.383930] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-26T18:11:03.156728] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-09-26T18:11:03.956690] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-09-26T18:11:04.145661] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-26T18:11:04.146230] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-26T18:11:04.756730] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-09-26T18:11:05.556780] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-09-26T18:11:05.609808] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-26T18:11:06.356783] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-09-26T18:11:06.397889] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-26T18:11:07.019444] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-26T18:11:07.156777] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-09-26T18:11:07.956767] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-09-26T18:11:08.010178] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T18:11:08.018499] [INFO ] [REMOTE ] CSL: Full fetch complete (45334 records). [2025-09-26T18:11:08.018726] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-09-26T18:11:08.458286] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-09-26T18:11:08.458440] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-09-26T18:11:08.459604] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-09-26T18:11:08.459858] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-09-26T18:11:08.493025] [DEBUG] [LOCAL ] CSL: Trimmed 45334 records to 32100 (keeping 200 days of data) [2025-09-26T18:11:08.496354] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-26T18:11:08.628818] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-26T18:11:08.757621] [DEBUG] [LOCAL ] CSL: Primary data saved (32100 records). [2025-09-26T18:11:08.758337] [INFO ] [MAIN ] CSL: Full history saved. [2025-09-26T18:11:08.757846] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-09-26T18:11:08.758589] [INFO ] [MAIN ] Update Progress: 539/2371 symbols completed. CSL took 32.0s. Estimated remaining: 4h 1m 39s. Rate: 7.6 symbols/min [2025-09-26T18:11:08.944177] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:11:08.944458] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-09-26T18:11:08.944496] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-09-26T18:11:08.944724] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-09-26T18:11:08.944778] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-26T18:11:08.944823] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-26T18:11:08.944858] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-09-26T18:11:09.318983] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:11:09.556706] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-09-26T18:11:09.631935] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-26T18:11:10.186361] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-26T18:11:10.356758] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-09-26T18:11:11.156826] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-12. [2025-09-26T18:11:11.375083] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:11:11.375456] [WARN ] [REMOTE ] CSW: No data returned for month 2024-12 [2025-09-26T18:11:11.956758] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-01. [2025-09-26T18:11:12.033231] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-26T18:11:12.188817] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:11:12.189317] [WARN ] [REMOTE ] CSW: No data returned for month 2025-01 [2025-09-26T18:11:12.756748] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-09-26T18:11:13.556741] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-09-26T18:11:14.356719] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-02. [2025-09-26T18:11:14.565002] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-26T18:11:14.576742] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:11:14.577849] [WARN ] [REMOTE ] CSW: No data returned for month 2025-02 [2025-09-26T18:11:14.587508] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-26T18:11:15.156781] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-09-26T18:11:15.956760] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-03. [2025-09-26T18:11:16.224166] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:11:16.224501] [WARN ] [REMOTE ] CSW: No data returned for month 2025-03 [2025-09-26T18:11:16.718899] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-26T18:11:16.756716] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-09-26T18:11:17.556726] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-09-26T18:11:18.250505] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-26T18:11:18.356713] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-09-26T18:11:18.578122] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-26T18:11:19.156785] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-09-26T18:11:19.956710] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-09-26T18:11:20.069910] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-26T18:11:20.103169] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-26T18:11:20.756775] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-09-26T18:11:20.801711] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-26T18:11:20.805140] [INFO ] [REMOTE ] CSR: Full fetch complete (17570 records). [2025-09-26T18:11:20.805228] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-09-26T18:11:21.225673] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-09-26T18:11:21.225794] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-09-26T18:11:21.226259] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-09-26T18:11:21.226324] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-09-26T18:11:21.226995] [DEBUG] [LOCAL ] CSR: Trimmed 17570 records to 12808 (keeping 200 days of data) [2025-09-26T18:11:21.308095] [DEBUG] [LOCAL ] CSR: Primary data saved (12808 records). [2025-09-26T18:11:21.308262] [INFO ] [MAIN ] CSR: Full history saved. [2025-09-26T18:11:21.308358] [INFO ] [MAIN ] Update Progress: 540/2371 symbols completed. CSR took 43.1s. Estimated remaining: 4h 1m 46s. Rate: 7.6 symbols/min [2025-09-26T18:11:21.506955] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:11:21.517197] [DEBUG] [LOCAL ] CTBB: Loaded 7094 existing records from primary storage. [2025-09-26T18:11:21.517348] [INFO ] [MAIN ] CTBB: Loaded 7094 existing records. [2025-09-26T18:11:21.564089] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-04. [2025-09-26T18:11:21.650715] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-26T18:11:21.741373] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:11:21.741635] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-09-26T18:11:21.741716] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-09-26T18:11:21.742130] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-09-26T18:11:21.742218] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-09-26T18:11:21.860764] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:11:21.895818] [WARN ] [REMOTE ] CSW: No data returned for month 2025-04 [2025-09-26T18:11:22.149527] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:11:22.356735] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-09-26T18:11:23.156716] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-09-26T18:11:23.316912] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-26T18:11:23.956764] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-09-26T18:11:24.756809] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-05. [2025-09-26T18:11:24.831879] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-26T18:11:24.869884] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-26T18:11:24.873146] [INFO ] [REMOTE ] CSV: Full fetch complete (19478 records). [2025-09-26T18:11:24.873243] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-09-26T18:11:24.984050] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:11:25.006867] [WARN ] [REMOTE ] CSW: No data returned for month 2025-05 [2025-09-26T18:11:25.412375] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-09-26T18:11:25.412495] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-09-26T18:11:25.413248] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-09-26T18:11:25.413328] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-09-26T18:11:25.414414] [DEBUG] [LOCAL ] CSV: Trimmed 19478 records to 13198 (keeping 200 days of data) [2025-09-26T18:11:25.544252] [DEBUG] [LOCAL ] CSV: Primary data saved (13198 records). [2025-09-26T18:11:25.544515] [INFO ] [MAIN ] CSV: Full history saved. [2025-09-26T18:11:25.544750] [INFO ] [MAIN ] Update Progress: 541/2371 symbols completed. CSV took 27.1s. Estimated remaining: 4h 1m 26s. Rate: 7.6 symbols/min [2025-09-26T18:11:25.562316] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-06. [2025-09-26T18:11:25.844667] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:11:25.853795] [DEBUG] [LOCAL ] CTDD: Loaded 5891 existing records from primary storage. [2025-09-26T18:11:25.853948] [INFO ] [MAIN ] CTDD: Loaded 5891 existing records. [2025-09-26T18:11:26.079962] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:11:26.080283] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-09-26T18:11:26.080334] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-09-26T18:11:26.080718] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-09-26T18:11:26.080793] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-09-26T18:11:26.363406] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-09-26T18:11:26.502742] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:11:26.510532] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-26T18:11:27.156770] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2024-12. [2025-09-26T18:11:27.876107] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-26T18:11:27.895132] [INFO ] [REMOTE ] CSTM: Full fetch complete (69191 records). [2025-09-26T18:11:27.896273] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-09-26T18:11:27.896156] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-26T18:11:27.961890] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-07. [2025-09-26T18:11:28.322961] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-09-26T18:11:28.323101] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-09-26T18:11:28.324133] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-09-26T18:11:28.324222] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-09-26T18:11:28.326427] [DEBUG] [LOCAL ] CSTM: Trimmed 69191 records to 48360 (keeping 200 days of data) [2025-09-26T18:11:28.637673] [DEBUG] [LOCAL ] CSTM: Primary data saved (48360 records). [2025-09-26T18:11:28.637843] [INFO ] [MAIN ] CSTM: Full history saved. [2025-09-26T18:11:28.637973] [INFO ] [MAIN ] Update Progress: 542/2371 symbols completed. CSTM took 30.4s. Estimated remaining: 4h 1m 2s. Rate: 7.6 symbols/min [2025-09-26T18:11:28.761839] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2024-12. [2025-09-26T18:11:28.829315] [INFO ] [MAIN ] CTEST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:11:28.829672] [DEBUG] [LOCAL ] CTEST: No existing data file found in primary storage. [2025-09-26T18:11:28.829797] [WARN ] [MAIN ] CTEST: No existing data found, performing full refresh instead. [2025-09-26T18:11:28.830069] [INFO ] [MAIN ] CTEST: Wiping existing primary data before full refresh. [2025-09-26T18:11:28.830180] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-26T18:11:28.830251] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-26T18:11:28.830289] [INFO ] [MAIN ] CTEST: Starting full primary refresh. [2025-09-26T18:11:29.141823] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-26T18:11:29.273313] [INFO ] [REMOTE ] CTEST: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:11:29.427102] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-26T18:11:29.556743] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-09-26T18:11:30.175202] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-26T18:11:30.356754] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-09-26T18:11:30.947852] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-26T18:11:31.156737] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-09-26T18:11:31.956744] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2024-12. [2025-09-26T18:11:32.037970] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-26T18:11:32.391216] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:11:32.391576] [WARN ] [REMOTE ] CTEST: No data returned for month 2024-12 [2025-09-26T18:11:32.756786] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-01. [2025-09-26T18:11:32.987600] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:11:32.988011] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-01 [2025-09-26T18:11:33.556740] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-09-26T18:11:34.275829] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-26T18:11:34.356768] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-09-26T18:11:35.073760] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-26T18:11:35.156786] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-08. [2025-09-26T18:11:35.956760] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-09-26T18:11:36.045324] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-26T18:11:36.380427] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-26T18:11:36.756739] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-09. [2025-09-26T18:11:37.556716] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-09-26T18:11:37.734916] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-26T18:11:37.739056] [INFO ] [REMOTE ] CSW: Full fetch complete (8247 records). [2025-09-26T18:11:37.739193] [DEBUG] [VALIDATOR ] CSW: Validating primary data. [2025-09-26T18:11:37.944954] [WARN ] [VALIDATOR ] CSW: Validation failed - insufficient historical data. Have 77 unique days, need 200 days [2025-09-26T18:11:37.945208] [FATAL] [MAIN ] CSW: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:11:37.945281] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:11:37.945356] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-26T18:11:37.945431] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-26T18:11:37.945478] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-09-26T18:11:37.945546] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-09-26T18:11:37.945634] [INFO ] [MAIN ] Update Progress: 543/2371 symbols completed. CSW took 29.2s. Estimated remaining: 4h 0m 59s. Rate: 7.6 symbols/min [2025-09-26T18:11:38.072969] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-26T18:11:38.145856] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:11:38.146120] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-09-26T18:11:38.146174] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-09-26T18:11:38.146324] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-09-26T18:11:38.146396] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-26T18:11:38.146449] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-26T18:11:38.146485] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-09-26T18:11:38.361867] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-09-26T18:11:38.538683] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:11:39.053145] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-26T18:11:39.156775] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-09-26T18:11:39.956729] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-09-26T18:11:40.056061] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-26T18:11:40.509694] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-26T18:11:40.756747] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-09-26T18:11:41.416260] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-26T18:11:41.556727] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-09-26T18:11:42.077362] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-26T18:11:42.356732] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-09-26T18:11:43.099958] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-26T18:11:43.156732] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-02. [2025-09-26T18:11:43.529585] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:11:43.529989] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-02 [2025-09-26T18:11:43.956738] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-12. [2025-09-26T18:11:44.158026] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:11:44.158438] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-12 [2025-09-26T18:11:44.756744] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-01. [2025-09-26T18:11:45.055031] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:11:45.055387] [WARN ] [REMOTE ] CTEV: No data returned for month 2025-01 [2025-09-26T18:11:45.556721] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-09-26T18:11:46.322465] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-26T18:11:46.324351] [INFO ] [REMOTE ] CTDD: Full fetch complete (8507 records). [2025-09-26T18:11:46.324440] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-09-26T18:11:46.361852] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-02. [2025-09-26T18:11:46.718397] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-09-26T18:11:46.718534] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-09-26T18:11:46.718809] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-09-26T18:11:46.718873] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-09-26T18:11:46.719389] [DEBUG] [LOCAL ] CTDD: Trimmed 8507 records to 5947 (keeping 200 days of data) [2025-09-26T18:11:46.758499] [DEBUG] [LOCAL ] CTDD: Primary data saved (5947 records). [2025-09-26T18:11:46.758672] [INFO ] [MAIN ] CTDD: Full history saved. [2025-09-26T18:11:46.758787] [INFO ] [MAIN ] Update Progress: 544/2371 symbols completed. CTDD took 21.2s. Estimated remaining: 4h 0m 54s. Rate: 7.6 symbols/min [2025-09-26T18:11:46.845024] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-26T18:11:46.947224] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:11:46.980929] [DEBUG] [LOCAL ] CTO: Loaded 28465 existing records from primary storage. [2025-09-26T18:11:46.981077] [INFO ] [MAIN ] CTO: Loaded 28465 existing records. [2025-09-26T18:11:47.158424] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-03. [2025-09-26T18:11:47.172932] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:11:47.173162] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-09-26T18:11:47.173231] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-09-26T18:11:47.174221] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-09-26T18:11:47.174290] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-09-26T18:11:47.454783] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:11:47.480250] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-03 [2025-09-26T18:11:47.562950] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:11:47.956730] [INFO ] [REMOTE ] CTO: Fetching primary data for 2024-12. [2025-09-26T18:11:48.756745] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-03. [2025-09-26T18:11:49.505631] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-26T18:11:49.556709] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-09-26T18:11:49.768285] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-26T18:11:50.356715] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-04. [2025-09-26T18:11:50.505066] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-26T18:11:50.859873] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-26T18:11:51.156777] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-05. [2025-09-26T18:11:51.956715] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-09-26T18:11:52.005702] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-26T18:11:52.547713] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-26T18:11:52.756758] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-06. [2025-09-26T18:11:53.556723] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-09-26T18:11:53.646938] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-26T18:11:54.016741] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-26T18:11:54.356773] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-09-26T18:11:55.061147] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-26T18:11:55.156719] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-09-26T18:11:55.912634] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-26T18:11:55.914598] [INFO ] [REMOTE ] CTBB: Full fetch complete (10893 records). [2025-09-26T18:11:55.914694] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-09-26T18:11:55.961910] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-04. [2025-09-26T18:11:56.308858] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-09-26T18:11:56.308999] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-09-26T18:11:56.309632] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-09-26T18:11:56.309732] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-09-26T18:11:56.310476] [DEBUG] [LOCAL ] CTBB: Trimmed 10893 records to 7168 (keeping 200 days of data) [2025-09-26T18:11:56.349170] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:11:56.350718] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-04 [2025-09-26T18:11:56.363977] [DEBUG] [LOCAL ] CTBB: Primary data saved (7168 records). [2025-09-26T18:11:56.364180] [INFO ] [MAIN ] CTBB: Full history saved. [2025-09-26T18:11:56.364338] [INFO ] [MAIN ] Update Progress: 545/2371 symbols completed. CTBB took 35.1s. Estimated remaining: 4h 0m 52s. Rate: 7.6 symbols/min [2025-09-26T18:11:56.551999] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:11:56.595620] [DEBUG] [LOCAL ] CTOS: Loaded 36991 existing records from primary storage. [2025-09-26T18:11:56.595910] [INFO ] [MAIN ] CTOS: Loaded 36991 existing records. [2025-09-26T18:11:56.761856] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-09-26T18:11:56.807605] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:11:56.807977] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-09-26T18:11:56.808048] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-09-26T18:11:56.809263] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-09-26T18:11:56.809331] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-09-26T18:11:57.202450] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:11:57.556730] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2024-12. [2025-09-26T18:11:58.035103] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-26T18:11:58.356719] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-09-26T18:11:58.780254] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-26T18:11:59.156722] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-09-26T18:11:59.472212] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-26T18:11:59.956719] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-07. [2025-09-26T18:12:00.756700] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-05. [2025-09-26T18:12:01.131352] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-26T18:12:01.556727] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-09-26T18:12:02.356773] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-09-26T18:12:02.487333] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-09-26T18:12:03.156787] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-08. [2025-09-26T18:12:03.947811] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-05 (3.19 seconds). [2025-09-26T18:12:03.956746] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-06. [2025-09-26T18:12:04.199373] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-26T18:12:04.231261] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-26T18:12:04.373940] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (2.82 seconds). [2025-09-26T18:12:04.761808] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-09. [2025-09-26T18:12:04.772732] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-09-26T18:12:05.556752] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-07. [2025-09-26T18:12:05.857196] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-26T18:12:05.876014] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-26T18:12:05.879054] [INFO ] [REMOTE ] CTEV: Full fetch complete (13801 records). [2025-09-26T18:12:05.879136] [DEBUG] [VALIDATOR ] CTEV: Validating primary data. [2025-09-26T18:12:06.073454] [WARN ] [VALIDATOR ] CTEV: Validation failed - insufficient historical data. Have 146 unique days, need 200 days [2025-09-26T18:12:06.073812] [FATAL] [MAIN ] CTEV: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:12:06.073896] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:12:06.073981] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-26T18:12:06.074082] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-26T18:12:06.074140] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-09-26T18:12:06.074202] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-09-26T18:12:06.074304] [INFO ] [MAIN ] Update Progress: 546/2371 symbols completed. CTEV took 28.1s. Estimated remaining: 4h 0m 50s. Rate: 7.6 symbols/min [2025-09-26T18:12:06.270905] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:12:06.342449] [DEBUG] [LOCAL ] CTRA: Loaded 54038 existing records from primary storage. [2025-09-26T18:12:06.342671] [INFO ] [MAIN ] CTRA: Loaded 54038 existing records. [2025-09-26T18:12:06.365336] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-08. [2025-09-26T18:12:06.539950] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:12:06.540281] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-09-26T18:12:06.540340] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-09-26T18:12:06.541832] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-09-26T18:12:06.541895] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-09-26T18:12:06.691144] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:12:06.705804] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-08 [2025-09-26T18:12:06.930784] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:12:07.156768] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-09-26T18:12:07.956744] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-09. [2025-09-26T18:12:08.353718] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:12:08.354055] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-09 [2025-09-26T18:12:08.354162] [INFO ] [REMOTE ] CTEST: Full fetch complete (1020 records). [2025-09-26T18:12:08.354238] [DEBUG] [VALIDATOR ] CTEST: Validating primary data. [2025-09-26T18:12:08.354930] [FATAL] [VALIDATOR ] CTEST: Data is stale - most recent date (2025-07-02) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:12:08.355011] [FATAL] [MAIN ] CTEST: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:12:08.355079] [WARN ] [MAIN ] CTEST: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:12:08.355153] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-26T18:12:08.355237] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-26T18:12:08.355296] [INFO ] [LOCAL ] CTEST: Starting deletion of derivative data. [2025-09-26T18:12:08.355356] [DEBUG] [LOCAL ] CTEST: No derivative data file found to delete. [2025-09-26T18:12:08.355469] [INFO ] [MAIN ] Update Progress: 547/2371 symbols completed. CTEST took 39.7s. Estimated remaining: 4h 0m 23s. Rate: 7.6 symbols/min [2025-09-26T18:12:08.561153] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:12:08.599809] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-26T18:12:08.639803] [DEBUG] [LOCAL ] CTRE: Loaded 49589 existing records from primary storage. [2025-09-26T18:12:08.640050] [INFO ] [MAIN ] CTRE: Loaded 49589 existing records. [2025-09-26T18:12:08.761886] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-09-26T18:12:08.831881] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:12:08.832122] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-09-26T18:12:08.832172] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-09-26T18:12:08.834086] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-09-26T18:12:08.834174] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-09-26T18:12:09.242040] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:12:09.556730] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2024-12. [2025-09-26T18:12:10.154853] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-26T18:12:10.356754] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2024-12. [2025-09-26T18:12:11.156738] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-09-26T18:12:11.327263] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-26T18:12:11.767615] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-26T18:12:11.956738] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-09-26T18:12:12.357879] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-26T18:12:12.756773] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-09-26T18:12:13.556728] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-09-26T18:12:13.733994] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-26T18:12:14.356780] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-09-26T18:12:15.156809] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-09-26T18:12:16.065177] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-09-26T18:12:16.075135] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-09-26T18:12:16.108380] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (3.35 seconds). [2025-09-26T18:12:16.173683] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-26T18:12:16.214417] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-26T18:12:16.756759] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-09-26T18:12:17.040828] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-26T18:12:17.556737] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-09-26T18:12:17.663267] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-26T18:12:18.356808] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-09-26T18:12:18.938728] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-26T18:12:19.156779] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-09-26T18:12:19.599712] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-26T18:12:19.956732] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-09-26T18:12:20.756710] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-09-26T18:12:21.115313] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-26T18:12:21.477864] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-26T18:12:21.483944] [INFO ] [REMOTE ] CTO: Full fetch complete (41766 records). [2025-09-26T18:12:21.484076] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-09-26T18:12:21.561861] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-09-26T18:12:21.925094] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-09-26T18:12:21.925204] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-09-26T18:12:21.925784] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-09-26T18:12:21.925853] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-09-26T18:12:21.927025] [DEBUG] [LOCAL ] CTO: Trimmed 41766 records to 28661 (keeping 200 days of data) [2025-09-26T18:12:22.110504] [DEBUG] [LOCAL ] CTO: Primary data saved (28661 records). [2025-09-26T18:12:22.110684] [INFO ] [MAIN ] CTO: Full history saved. [2025-09-26T18:12:22.110798] [INFO ] [MAIN ] Update Progress: 548/2371 symbols completed. CTO took 35.4s. Estimated remaining: 4h 0m 34s. Rate: 7.6 symbols/min [2025-09-26T18:12:22.299806] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:12:22.339194] [DEBUG] [LOCAL ] CTRI: Loaded 38243 existing records from primary storage. [2025-09-26T18:12:22.339340] [INFO ] [MAIN ] CTRI: Loaded 38243 existing records. [2025-09-26T18:12:22.362903] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-09-26T18:12:22.569992] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:12:22.573567] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-09-26T18:12:22.573298] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-26T18:12:22.573786] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-09-26T18:12:22.587700] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-09-26T18:12:22.587796] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-09-26T18:12:22.972191] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:12:23.156735] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2024-12. [2025-09-26T18:12:23.500443] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-26T18:12:23.956746] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-09-26T18:12:24.676241] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-26T18:12:24.756736] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-09-26T18:12:25.130926] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (2.77 seconds). [2025-09-26T18:12:25.556746] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-09-26T18:12:26.356762] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-09-26T18:12:26.744486] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (2.79 seconds). [2025-09-26T18:12:26.972317] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-09-26T18:12:27.008587] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-26T18:12:27.156732] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-09-26T18:12:27.280915] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-26T18:12:27.956771] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-09-26T18:12:28.566614] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-26T18:12:28.756762] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-09-26T18:12:29.162855] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-26T18:12:29.169727] [INFO ] [REMOTE ] CTOS: Full fetch complete (53495 records). [2025-09-26T18:12:29.169833] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-09-26T18:12:29.561963] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-09-26T18:12:29.565824] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-09-26T18:12:29.565886] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-09-26T18:12:29.566713] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-09-26T18:12:29.566895] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-09-26T18:12:29.568206] [DEBUG] [LOCAL ] CTOS: Trimmed 53495 records to 37246 (keeping 200 days of data) [2025-09-26T18:12:29.778830] [DEBUG] [LOCAL ] CTOS: Primary data saved (37246 records). [2025-09-26T18:12:29.779042] [INFO ] [MAIN ] CTOS: Full history saved. [2025-09-26T18:12:29.779170] [INFO ] [MAIN ] Update Progress: 549/2371 symbols completed. CTOS took 33.4s. Estimated remaining: 4h 0m 26s. Rate: 7.6 symbols/min [2025-09-26T18:12:29.957501] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:12:29.977807] [DEBUG] [LOCAL ] CTS: Loaded 19488 existing records from primary storage. [2025-09-26T18:12:29.977966] [INFO ] [MAIN ] CTS: Loaded 19488 existing records. [2025-09-26T18:12:30.182549] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:12:30.183197] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-09-26T18:12:30.183292] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-09-26T18:12:30.184066] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-09-26T18:12:30.184143] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-09-26T18:12:30.357395] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-09-26T18:12:30.594071] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:12:30.625195] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-26T18:12:30.653465] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-26T18:12:31.156730] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-09-26T18:12:31.956730] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-09-26T18:12:32.119895] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-26T18:12:32.190399] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-26T18:12:32.756735] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-09-26T18:12:33.556763] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-09-26T18:12:33.691800] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-26T18:12:33.746784] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-26T18:12:34.356752] [INFO ] [REMOTE ] CTS: Fetching primary data for 2024-12. [2025-09-26T18:12:34.941427] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-26T18:12:35.156687] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-09-26T18:12:35.168889] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-26T18:12:35.956772] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-09-26T18:12:36.756796] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-09-26T18:12:37.207247] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-26T18:12:37.561106] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-09-26T18:12:37.567340] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-26T18:12:37.875030] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-26T18:12:38.356787] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-09-26T18:12:39.066460] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-26T18:12:39.156763] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-09-26T18:12:39.956773] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-09-26T18:12:40.506301] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-26T18:12:40.517715] [INFO ] [REMOTE ] CTRA: Full fetch complete (77663 records). [2025-09-26T18:12:40.517914] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-09-26T18:12:40.766853] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-09-26T18:12:40.879270] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-26T18:12:40.960673] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-26T18:12:41.011938] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-09-26T18:12:41.012138] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-09-26T18:12:41.013236] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-09-26T18:12:41.013330] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-09-26T18:12:41.015263] [DEBUG] [LOCAL ] CTRA: Trimmed 77663 records to 54428 (keeping 200 days of data) [2025-09-26T18:12:41.355525] [DEBUG] [LOCAL ] CTRA: Primary data saved (54428 records). [2025-09-26T18:12:41.355736] [INFO ] [MAIN ] CTRA: Full history saved. [2025-09-26T18:12:41.355863] [INFO ] [MAIN ] Update Progress: 550/2371 symbols completed. CTRA took 35.3s. Estimated remaining: 4h 0m 30s. Rate: 7.6 symbols/min [2025-09-26T18:12:41.539952] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:12:41.556771] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-09-26T18:12:41.612922] [DEBUG] [LOCAL ] CTVA: Loaded 53612 existing records from primary storage. [2025-09-26T18:12:41.613082] [INFO ] [MAIN ] CTVA: Loaded 53612 existing records. [2025-09-26T18:12:41.826380] [WARN ] [MAIN ] CTVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:12:41.826661] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-09-26T18:12:41.826723] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-09-26T18:12:41.828149] [DEBUG] [LOCAL ] CTVA: Deleted primary data file. [2025-09-26T18:12:41.828212] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-09-26T18:12:42.212250] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:12:42.356700] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-09-26T18:12:42.482245] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T18:12:42.493022] [INFO ] [REMOTE ] CTRE: Full fetch complete (71115 records). [2025-09-26T18:12:42.493201] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-09-26T18:12:42.972130] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-26T18:12:42.972230] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-09-26T18:12:42.972367] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-09-26T18:12:42.981360] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-09-26T18:12:42.981752] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-09-26T18:12:42.983493] [DEBUG] [LOCAL ] CTRE: Trimmed 71115 records to 49964 (keeping 200 days of data) [2025-09-26T18:12:43.161639] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2024-12. [2025-09-26T18:12:43.294342] [DEBUG] [LOCAL ] CTRE: Primary data saved (49964 records). [2025-09-26T18:12:43.294493] [INFO ] [MAIN ] CTRE: Full history saved. [2025-09-26T18:12:43.294582] [INFO ] [MAIN ] Update Progress: 551/2371 symbols completed. CTRE took 34.9s. Estimated remaining: 4h 0m 2s. Rate: 7.6 symbols/min [2025-09-26T18:12:43.474981] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-26T18:12:43.496333] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:12:43.501900] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-09-26T18:12:43.501969] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-09-26T18:12:43.502136] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-09-26T18:12:43.502182] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-26T18:12:43.502230] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-26T18:12:43.502264] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-09-26T18:12:43.894274] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:12:43.956753] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-09-26T18:12:44.756750] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-12. [2025-09-26T18:12:44.958169] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T18:12:45.145492] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-26T18:12:45.556741] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-09-26T18:12:45.712007] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-26T18:12:46.356720] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-09-26T18:12:46.980967] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-26T18:12:47.156778] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-09-26T18:12:47.956779] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-09-26T18:12:48.165629] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-26T18:12:48.175369] [INFO ] [REMOTE ] CTRI: Full fetch complete (51314 records). [2025-09-26T18:12:48.175487] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-09-26T18:12:48.253412] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-09-26T18:12:48.591030] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-09-26T18:12:48.591214] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-09-26T18:12:48.591987] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-09-26T18:12:48.592160] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-09-26T18:12:48.593801] [DEBUG] [LOCAL ] CTRI: Trimmed 51314 records to 38571 (keeping 200 days of data) [2025-09-26T18:12:48.692105] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-26T18:12:48.757806] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-09-26T18:12:48.898861] [DEBUG] [LOCAL ] CTRI: Primary data saved (38571 records). [2025-09-26T18:12:48.899035] [INFO ] [MAIN ] CTRI: Full history saved. [2025-09-26T18:12:48.899143] [INFO ] [MAIN ] Update Progress: 552/2371 symbols completed. CTRI took 26.8s. Estimated remaining: 3h 59m 47s. Rate: 7.6 symbols/min [2025-09-26T18:12:49.093243] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:12:49.093421] [DEBUG] [LOCAL ] CUBE: No existing data file found in primary storage. [2025-09-26T18:12:49.093460] [WARN ] [MAIN ] CUBE: No existing data found, performing full refresh instead. [2025-09-26T18:12:49.093606] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-09-26T18:12:49.093679] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-09-26T18:12:49.093743] [DEBUG] [LOCAL ] CUBE: No primary data file found to delete. [2025-09-26T18:12:49.093791] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-09-26T18:12:49.480624] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:12:49.556733] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-09-26T18:12:49.896868] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-26T18:12:50.356724] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-09-26T18:12:50.552604] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-26T18:12:50.698731] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-26T18:12:51.156745] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-09-26T18:12:51.453793] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-26T18:12:51.956743] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-09-26T18:12:52.756795] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2024-12. [2025-09-26T18:12:53.075485] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-26T18:12:53.556736] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-09-26T18:12:54.324507] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-26T18:12:54.356691] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-09-26T18:12:54.381813] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-26T18:12:55.156769] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-09-26T18:12:55.956715] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-09-26T18:12:56.079985] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-26T18:12:56.394824] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-26T18:12:56.706230] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T18:12:56.756692] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-09-26T18:12:57.556759] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-09-26T18:12:57.892482] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-26T18:12:58.356786] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-09-26T18:12:58.586423] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-09-26T18:12:59.156768] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-09-26T18:12:59.627880] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-26T18:12:59.956837] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-09-26T18:13:00.756752] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-09-26T18:13:00.954759] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-26T18:13:01.363528] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-26T18:13:01.556703] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-09-26T18:13:01.961747] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-26T18:13:02.356849] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-09-26T18:13:03.156779] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-09-26T18:13:03.383959] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-26T18:13:03.458763] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-26T18:13:03.464950] [INFO ] [REMOTE ] CTS: Full fetch complete (26655 records). [2025-09-26T18:13:03.465113] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-09-26T18:13:03.855939] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-09-26T18:13:03.856052] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-09-26T18:13:03.856827] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-09-26T18:13:03.856892] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-09-26T18:13:03.857998] [DEBUG] [LOCAL ] CTS: Trimmed 26655 records to 19637 (keeping 200 days of data) [2025-09-26T18:13:03.956812] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-09-26T18:13:03.997937] [DEBUG] [LOCAL ] CTS: Primary data saved (19637 records). [2025-09-26T18:13:03.998173] [INFO ] [MAIN ] CTS: Full history saved. [2025-09-26T18:13:03.998322] [INFO ] [MAIN ] Update Progress: 553/2371 symbols completed. CTS took 34.2s. Estimated remaining: 4h 0m 2s. Rate: 7.6 symbols/min [2025-09-26T18:13:04.180283] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:13:04.180524] [DEBUG] [LOCAL ] CUBI: No existing data file found in primary storage. [2025-09-26T18:13:04.180635] [WARN ] [MAIN ] CUBI: No existing data found, performing full refresh instead. [2025-09-26T18:13:04.180861] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-09-26T18:13:04.180915] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-09-26T18:13:04.180960] [DEBUG] [LOCAL ] CUBI: No primary data file found to delete. [2025-09-26T18:13:04.181012] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-09-26T18:13:04.266842] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-26T18:13:04.571922] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:13:04.719518] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-26T18:13:04.756760] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-09-26T18:13:05.556796] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2024-12. [2025-09-26T18:13:06.356784] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-09-26T18:13:06.566755] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-26T18:13:06.612163] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-26T18:13:07.156767] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-09-26T18:13:07.956811] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-09-26T18:13:08.006142] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-26T18:13:08.708677] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-26T18:13:08.756744] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-09-26T18:13:08.953242] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-26T18:13:09.556781] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-09-26T18:13:10.098226] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-26T18:13:10.356779] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-09-26T18:13:10.481024] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-26T18:13:11.156812] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-09-26T18:13:11.583632] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-26T18:13:11.890786] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-26T18:13:11.956741] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-09-26T18:13:12.756732] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-09-26T18:13:13.556811] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-09-26T18:13:13.756336] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-26T18:13:13.820121] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-26T18:13:14.356761] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-09-26T18:13:15.156771] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-09-26T18:13:15.478417] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-26T18:13:15.496877] [INFO ] [REMOTE ] CTVA: Full fetch complete (76965 records). [2025-09-26T18:13:15.497223] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-09-26T18:13:15.758869] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-26T18:13:15.779236] [INFO ] [REMOTE ] CUBB: Full fetch complete (928 records). [2025-09-26T18:13:15.787541] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-09-26T18:13:15.970945] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-09-26T18:13:16.075437] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T18:13:16.156220] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-09-26T18:13:16.183143] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-09-26T18:13:16.195784] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-09-26T18:13:16.211619] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-09-26T18:13:16.218877] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-26T18:13:16.219444] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:13:16.219531] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:13:16.219609] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-26T18:13:16.219730] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-26T18:13:16.220233] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-09-26T18:13:16.220439] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-09-26T18:13:16.220617] [INFO ] [MAIN ] Update Progress: 554/2371 symbols completed. CUBB took 32.9s. Estimated remaining: 4h 0m 9s. Rate: 7.6 symbols/min [2025-09-26T18:13:16.309332] [DEBUG] [LOCAL ] CTVA: Trimmed 76965 records to 54002 (keeping 200 days of data) [2025-09-26T18:13:16.508534] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:13:16.705949] [DEBUG] [LOCAL ] CUK: Loaded 51382 existing records from primary storage. [2025-09-26T18:13:16.707013] [INFO ] [MAIN ] CUK: Loaded 51382 existing records. [2025-09-26T18:13:16.766821] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-09-26T18:13:16.927593] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:13:16.937006] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-09-26T18:13:16.941583] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-09-26T18:13:16.979157] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-09-26T18:13:16.986350] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-09-26T18:13:17.357950] [DEBUG] [LOCAL ] CTVA: Primary data saved (54002 records). [2025-09-26T18:13:17.383122] [INFO ] [MAIN ] CTVA: Full history saved. [2025-09-26T18:13:17.397901] [INFO ] [MAIN ] Update Progress: 555/2371 symbols completed. CTVA took 36.0s. Estimated remaining: 3h 59m 39s. Rate: 7.6 symbols/min [2025-09-26T18:13:17.467843] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:13:17.558781] [INFO ] [REMOTE ] CUK: Fetching primary data for 2024-12. [2025-09-26T18:13:17.638483] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:13:17.643319] [DEBUG] [LOCAL ] CULP: Loaded 3087 existing records from primary storage. [2025-09-26T18:13:17.643420] [INFO ] [MAIN ] CULP: Loaded 3087 existing records. [2025-09-26T18:13:17.848111] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:13:17.848789] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-09-26T18:13:17.848865] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-09-26T18:13:17.849145] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-09-26T18:13:17.849207] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-09-26T18:13:18.171389] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-26T18:13:18.264471] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:13:18.340479] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-26T18:13:18.356683] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-09-26T18:13:19.128167] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-26T18:13:19.156712] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-09-26T18:13:19.821868] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-26T18:13:19.835146] [INFO ] [REMOTE ] CUBE: Full fetch complete (72973 records). [2025-09-26T18:13:19.835392] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-09-26T18:13:19.961848] [INFO ] [REMOTE ] CULP: Fetching primary data for 2024-12. [2025-09-26T18:13:20.264073] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-09-26T18:13:20.264233] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-09-26T18:13:20.265117] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-09-26T18:13:20.265190] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-09-26T18:13:20.266805] [DEBUG] [LOCAL ] CUBE: Trimmed 72973 records to 51391 (keeping 200 days of data) [2025-09-26T18:13:20.602773] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-26T18:13:20.646972] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-26T18:13:20.647101] [DEBUG] [LOCAL ] CUBE: Primary data saved (51391 records). [2025-09-26T18:13:20.647435] [INFO ] [MAIN ] CUBE: Full history saved. [2025-09-26T18:13:20.663411] [INFO ] [MAIN ] Update Progress: 556/2371 symbols completed. CUBE took 31.8s. Estimated remaining: 3h 59m 15s. Rate: 7.6 symbols/min [2025-09-26T18:13:20.761997] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-09-26T18:13:20.851593] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:13:20.888613] [DEBUG] [LOCAL ] CURB: Loaded 33144 existing records from primary storage. [2025-09-26T18:13:20.888790] [INFO ] [MAIN ] CURB: Loaded 33144 existing records. [2025-09-26T18:13:21.074603] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:13:21.074896] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-09-26T18:13:21.074948] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-09-26T18:13:21.075826] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-09-26T18:13:21.075889] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-09-26T18:13:21.446050] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:13:21.556724] [INFO ] [REMOTE ] CURB: Fetching primary data for 2024-12. [2025-09-26T18:13:21.905974] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-26T18:13:22.356728] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-09-26T18:13:22.752393] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-26T18:13:22.782372] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-26T18:13:23.156728] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-09-26T18:13:23.583698] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-26T18:13:23.956766] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-09-26T18:13:24.756737] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-09-26T18:13:25.355744] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-26T18:13:25.556737] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-09-26T18:13:25.715207] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-26T18:13:26.356732] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-09-26T18:13:26.872472] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-26T18:13:27.156740] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-09-26T18:13:27.769061] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-26T18:13:27.956726] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-09-26T18:13:28.099992] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-26T18:13:28.750753] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-26T18:13:28.757072] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-09-26T18:13:29.556719] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-09-26T18:13:30.356758] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-09-26T18:13:30.610073] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-26T18:13:31.099204] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T18:13:31.156757] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-09-26T18:13:31.420863] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-26T18:13:31.703688] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-26T18:13:31.956794] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-09-26T18:13:32.756755] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-09-26T18:13:33.556739] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-09-26T18:13:33.771581] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-26T18:13:33.841516] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-26T18:13:34.356769] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-09-26T18:13:35.156732] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-09-26T18:13:35.501816] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-26T18:13:35.956705] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-09-26T18:13:36.148280] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-26T18:13:36.176401] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-26T18:13:36.182830] [INFO ] [REMOTE ] CUBI: Full fetch complete (39300 records). [2025-09-26T18:13:36.182979] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-09-26T18:13:36.576960] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-09-26T18:13:36.577047] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-09-26T18:13:36.577626] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-09-26T18:13:36.577717] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-09-26T18:13:36.578666] [DEBUG] [LOCAL ] CUBI: Trimmed 39300 records to 27667 (keeping 200 days of data) [2025-09-26T18:13:36.757198] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-09-26T18:13:36.780123] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-26T18:13:36.790292] [DEBUG] [LOCAL ] CUBI: Primary data saved (27667 records). [2025-09-26T18:13:36.790803] [INFO ] [MAIN ] CUBI: Full history saved. [2025-09-26T18:13:36.790922] [INFO ] [MAIN ] Update Progress: 557/2371 symbols completed. CUBI took 32.8s. Estimated remaining: 3h 59m 34s. Rate: 7.6 symbols/min [2025-09-26T18:13:37.354852] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-26T18:13:37.556737] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-09-26T18:13:38.356689] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-09-26T18:13:38.671559] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-26T18:13:39.156729] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-09-26T18:13:39.782204] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-26T18:13:39.956784] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-09-26T18:13:40.250545] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-26T18:13:40.756728] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-09-26T18:13:41.556778] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-09-26T18:13:41.615137] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-26T18:13:42.101815] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-26T18:13:42.231781] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-26T18:13:42.356730] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-09-26T18:13:43.156721] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-09-26T18:13:43.807424] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-26T18:13:43.814181] [INFO ] [REMOTE ] CURB: Full fetch complete (47232 records). [2025-09-26T18:13:43.814300] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-09-26T18:13:43.966215] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-09-26T18:13:44.231232] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-09-26T18:13:44.231334] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-09-26T18:13:44.232077] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-09-26T18:13:44.232145] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-09-26T18:13:44.233476] [DEBUG] [LOCAL ] CURB: Trimmed 47232 records to 33350 (keeping 200 days of data) [2025-09-26T18:13:44.446080] [DEBUG] [LOCAL ] CURB: Primary data saved (33350 records). [2025-09-26T18:13:44.446233] [INFO ] [MAIN ] CURB: Full history saved. [2025-09-26T18:13:44.446339] [INFO ] [MAIN ] Update Progress: 558/2371 symbols completed. CURB took 23.8s. Estimated remaining: 3h 59m 26s. Rate: 7.6 symbols/min [2025-09-26T18:13:44.456072] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-26T18:13:44.756733] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-09-26T18:13:44.903337] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-26T18:13:44.913531] [INFO ] [REMOTE ] CUK: Full fetch complete (73802 records). [2025-09-26T18:13:44.913717] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-09-26T18:13:45.288057] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-26T18:13:45.310782] [INFO ] [REMOTE ] CULP: Full fetch complete (4778 records). [2025-09-26T18:13:45.332806] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-09-26T18:13:45.351787] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-09-26T18:13:45.357447] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-09-26T18:13:45.392446] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-09-26T18:13:45.406842] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-09-26T18:13:45.491380] [DEBUG] [LOCAL ] CUK: Trimmed 73802 records to 51762 (keeping 200 days of data) [2025-09-26T18:13:45.922928] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-09-26T18:13:45.923320] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-09-26T18:13:45.923500] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-09-26T18:13:45.924183] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-09-26T18:13:45.928473] [DEBUG] [LOCAL ] CULP: Trimmed 4778 records to 3111 (keeping 200 days of data) [2025-09-26T18:13:46.005769] [DEBUG] [LOCAL ] CULP: Primary data saved (3111 records). [2025-09-26T18:13:46.014734] [INFO ] [MAIN ] CULP: Full history saved. [2025-09-26T18:13:46.015202] [INFO ] [MAIN ] Update Progress: 559/2371 symbols completed. CULP took 28.6s. Estimated remaining: 3h 58m 57s. Rate: 7.6 symbols/min [2025-09-26T18:13:46.149272] [DEBUG] [LOCAL ] CUK: Primary data saved (51762 records). [2025-09-26T18:13:46.149443] [INFO ] [MAIN ] CUK: Full history saved. [2025-09-26T18:13:46.149545] [INFO ] [MAIN ] Update Progress: 560/2371 symbols completed. CUK took 29.9s. Estimated remaining: 3h 58m 24s. Rate: 7.6 symbols/min [2025-09-26T18:13:46.819144] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:13:46.882749] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:13:46.881135] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:13:46.923931] [DEBUG] [LOCAL ] CURV: No existing data file found in primary storage. [2025-09-26T18:13:46.931378] [WARN ] [MAIN ] CURV: No existing data found, performing full refresh instead. [2025-09-26T18:13:46.961344] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-09-26T18:13:46.961013] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:13:46.961600] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-09-26T18:13:46.961707] [DEBUG] [LOCAL ] CVEO: No existing data file found in primary storage. [2025-09-26T18:13:46.962845] [WARN ] [MAIN ] CVEO: No existing data found, performing full refresh instead. [2025-09-26T18:13:46.963058] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-09-26T18:13:46.963113] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-09-26T18:13:46.961806] [DEBUG] [LOCAL ] CURV: No primary data file found to delete. [2025-09-26T18:13:46.963185] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-09-26T18:13:46.975888] [DEBUG] [LOCAL ] CVEO: No primary data file found to delete. [2025-09-26T18:13:47.012679] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-09-26T18:13:47.524417] [DEBUG] [LOCAL ] CVE: Loaded 53946 existing records from primary storage. [2025-09-26T18:13:47.539973] [INFO ] [MAIN ] CVE: Loaded 53946 existing records. [2025-09-26T18:13:47.523440] [DEBUG] [LOCAL ] CUZ: Loaded 49778 existing records from primary storage. [2025-09-26T18:13:47.545300] [INFO ] [MAIN ] CUZ: Loaded 49778 existing records. [2025-09-26T18:13:48.070538] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:13:48.108084] [INFO ] [REMOTE ] CURV: Fetching primary data for 2024-12. [2025-09-26T18:13:48.235503] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:13:48.287447] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-09-26T18:13:48.280854] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:13:48.287801] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:13:48.289308] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-09-26T18:13:48.289226] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2024-12. [2025-09-26T18:13:48.290484] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-09-26T18:13:48.290628] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-09-26T18:13:48.292236] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-09-26T18:13:48.292322] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-09-26T18:13:48.297874] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-09-26T18:13:48.358605] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-09-26T18:13:49.044711] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:13:49.051337] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2024-12. [2025-09-26T18:13:49.086077] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:13:49.086692] [INFO ] [REMOTE ] CVE: Fetching primary data for 2024-12. [2025-09-26T18:13:49.244085] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-26T18:13:49.246973] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-09-26T18:13:49.518100] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-26T18:13:49.556744] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-09-26T18:13:49.712623] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-26T18:13:50.337747] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-26T18:13:50.356677] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-09-26T18:13:50.422559] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-26T18:13:50.666060] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-26T18:13:50.955036] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-26T18:13:51.156724] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-09-26T18:13:51.956720] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-09-26T18:13:52.723659] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T18:13:52.756683] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-09-26T18:13:52.780972] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-26T18:13:53.556742] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-09-26T18:13:54.356710] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-09-26T18:13:54.579199] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-26T18:13:54.619879] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-26T18:13:55.156718] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-09-26T18:13:55.463699] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-26T18:13:55.799790] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-26T18:13:55.956705] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-09-26T18:13:56.756789] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-09-26T18:13:56.977509] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-26T18:13:57.556719] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-09-26T18:13:58.180159] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-26T18:13:58.201486] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-26T18:13:58.356737] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-09-26T18:13:59.156778] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-09-26T18:13:59.636691] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-26T18:13:59.956767] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-09-26T18:14:00.473889] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-26T18:14:00.756772] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-09-26T18:14:01.121780] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-26T18:14:01.556750] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-09-26T18:14:02.356736] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-09-26T18:14:02.954300] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-26T18:14:03.108556] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-26T18:14:03.156694] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-09-26T18:14:03.498730] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-26T18:14:03.956714] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-09-26T18:14:04.317065] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-26T18:14:04.756792] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-09-26T18:14:05.556743] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-09-26T18:14:05.681081] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-26T18:14:06.141103] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-26T18:14:06.278751] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-26T18:14:06.356696] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-09-26T18:14:07.156734] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-09-26T18:14:07.956755] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-09-26T18:14:08.089892] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-26T18:14:08.093361] [INFO ] [REMOTE ] CVEO: Full fetch complete (20241 records). [2025-09-26T18:14:08.093529] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-09-26T18:14:08.448815] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-26T18:14:08.548722] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-09-26T18:14:08.548820] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-09-26T18:14:08.549197] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-09-26T18:14:08.549239] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-09-26T18:14:08.549969] [DEBUG] [LOCAL ] CVEO: Trimmed 20241 records to 15402 (keeping 200 days of data) [2025-09-26T18:14:08.647260] [DEBUG] [LOCAL ] CVEO: Primary data saved (15402 records). [2025-09-26T18:14:08.647438] [INFO ] [MAIN ] CVEO: Full history saved. [2025-09-26T18:14:08.647529] [INFO ] [MAIN ] Update Progress: 561/2371 symbols completed. CVEO took 22.5s. Estimated remaining: 3h 59m 3s. Rate: 7.6 symbols/min [2025-09-26T18:14:08.761844] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-09-26T18:14:08.866726] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:14:08.916938] [DEBUG] [LOCAL ] CVI: Loaded 46801 existing records from primary storage. [2025-09-26T18:14:08.917279] [INFO ] [MAIN ] CVI: Loaded 46801 existing records. [2025-09-26T18:14:09.025687] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-26T18:14:09.145074] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:14:09.145360] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-09-26T18:14:09.145410] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-09-26T18:14:09.146486] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-09-26T18:14:09.146547] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-09-26T18:14:09.521105] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:14:09.556677] [INFO ] [REMOTE ] CVI: Fetching primary data for 2024-12. [2025-09-26T18:14:10.032957] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-26T18:14:10.356748] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-09-26T18:14:10.853708] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-26T18:14:11.156738] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-09-26T18:14:11.879126] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T18:14:11.956697] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-09-26T18:14:12.252124] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-26T18:14:12.756728] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-09-26T18:14:13.042019] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-26T18:14:13.556725] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-09-26T18:14:14.356703] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-09-26T18:14:14.442143] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-26T18:14:14.449745] [INFO ] [REMOTE ] CURV: Full fetch complete (39328 records). [2025-09-26T18:14:14.449867] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-09-26T18:14:14.847766] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-09-26T18:14:14.847934] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-09-26T18:14:14.848587] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-09-26T18:14:14.848686] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-09-26T18:14:14.849729] [DEBUG] [LOCAL ] CURV: Trimmed 39328 records to 26933 (keeping 200 days of data) [2025-09-26T18:14:15.008344] [DEBUG] [LOCAL ] CURV: Primary data saved (26933 records). [2025-09-26T18:14:15.008501] [INFO ] [MAIN ] CURV: Full history saved. [2025-09-26T18:14:15.008586] [INFO ] [MAIN ] Update Progress: 562/2371 symbols completed. CURV took 28.9s. Estimated remaining: 3h 58m 50s. Rate: 7.6 symbols/min [2025-09-26T18:14:15.165472] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-09-26T18:14:15.221222] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:14:15.227339] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-26T18:14:15.250437] [DEBUG] [LOCAL ] CVLG: Loaded 15677 existing records from primary storage. [2025-09-26T18:14:15.250567] [INFO ] [MAIN ] CVLG: Loaded 15677 existing records. [2025-09-26T18:14:15.438418] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:14:15.438751] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-09-26T18:14:15.438811] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-09-26T18:14:15.439467] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-09-26T18:14:15.439527] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-09-26T18:14:15.815613] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:14:15.956753] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-09-26T18:14:16.247684] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-26T18:14:16.581295] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-26T18:14:16.756732] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-09-26T18:14:17.091791] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-26T18:14:17.556743] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2024-12. [2025-09-26T18:14:18.356720] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-09-26T18:14:18.572293] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-26T18:14:18.603433] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-26T18:14:18.613757] [INFO ] [REMOTE ] CUZ: Full fetch complete (70846 records). [2025-09-26T18:14:18.613931] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-09-26T18:14:19.028459] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-09-26T18:14:19.028558] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-09-26T18:14:19.029378] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-09-26T18:14:19.029453] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-09-26T18:14:19.031138] [DEBUG] [LOCAL ] CUZ: Trimmed 70846 records to 50140 (keeping 200 days of data) [2025-09-26T18:14:19.158117] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-09-26T18:14:19.354369] [DEBUG] [LOCAL ] CUZ: Primary data saved (50140 records). [2025-09-26T18:14:19.354528] [INFO ] [MAIN ] CUZ: Full history saved. [2025-09-26T18:14:19.354745] [INFO ] [MAIN ] Update Progress: 563/2371 symbols completed. CUZ took 33.2s. Estimated remaining: 3h 58m 31s. Rate: 7.6 symbols/min [2025-09-26T18:14:19.542006] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:14:19.604572] [DEBUG] [LOCAL ] CVNA: Loaded 53395 existing records from primary storage. [2025-09-26T18:14:19.604770] [INFO ] [MAIN ] CVNA: Loaded 53395 existing records. [2025-09-26T18:14:19.834282] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:14:19.835092] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-09-26T18:14:19.837098] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-26T18:14:19.835506] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-09-26T18:14:19.849728] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-09-26T18:14:19.849832] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-09-26T18:14:19.962813] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-09-26T18:14:20.254019] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:14:20.283256] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-26T18:14:20.756753] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-09-26T18:14:21.556718] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-09-26T18:14:21.753912] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-26T18:14:21.993019] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-26T18:14:22.356751] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2024-12. [2025-09-26T18:14:23.156756] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-09-26T18:14:23.370136] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-26T18:14:23.956773] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-09-26T18:14:24.524929] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-26T18:14:24.597268] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-26T18:14:24.711877] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-26T18:14:24.756717] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-09-26T18:14:25.556768] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-09-26T18:14:25.691162] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-26T18:14:26.356790] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-09-26T18:14:26.999230] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-26T18:14:27.156734] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-09-26T18:14:27.965497] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-09-26T18:14:27.986219] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-26T18:14:27.997707] [INFO ] [REMOTE ] CVE: Full fetch complete (77548 records). [2025-09-26T18:14:27.997861] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-09-26T18:14:28.437779] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-09-26T18:14:28.437993] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-09-26T18:14:28.438917] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-09-26T18:14:28.438995] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-09-26T18:14:28.440764] [DEBUG] [LOCAL ] CVE: Trimmed 77548 records to 54336 (keeping 200 days of data) [2025-09-26T18:14:28.766621] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-09-26T18:14:28.798426] [DEBUG] [LOCAL ] CVE: Primary data saved (54336 records). [2025-09-26T18:14:28.798585] [INFO ] [MAIN ] CVE: Full history saved. [2025-09-26T18:14:28.798767] [INFO ] [MAIN ] Update Progress: 564/2371 symbols completed. CVE took 42.6s. Estimated remaining: 3h 58m 28s. Rate: 7.6 symbols/min [2025-09-26T18:14:28.986488] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:14:29.047353] [DEBUG] [LOCAL ] CVS: Loaded 54086 existing records from primary storage. [2025-09-26T18:14:29.047591] [INFO ] [MAIN ] CVS: Loaded 54086 existing records. [2025-09-26T18:14:29.244844] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:14:29.245517] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-09-26T18:14:29.245766] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-09-26T18:14:29.247675] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-09-26T18:14:29.247742] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-09-26T18:14:29.602783] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-09-26T18:14:29.644627] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-09-26T18:14:29.689977] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:14:29.720629] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-26T18:14:29.757351] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-26T18:14:30.356749] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-09-26T18:14:31.156756] [INFO ] [REMOTE ] CVS: Fetching primary data for 2024-12. [2025-09-26T18:14:31.330121] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-26T18:14:31.500595] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-26T18:14:31.956763] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-09-26T18:14:32.705090] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-26T18:14:32.756757] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-09-26T18:14:33.023836] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-26T18:14:33.366082] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-26T18:14:33.556722] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-09-26T18:14:34.356745] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-09-26T18:14:35.156738] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-09-26T18:14:35.308373] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-26T18:14:35.956768] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-09-26T18:14:35.983770] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-26T18:14:36.254057] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-26T18:14:36.756734] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-09-26T18:14:37.556748] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-09-26T18:14:37.747852] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-26T18:14:38.356787] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-09-26T18:14:38.872229] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-26T18:14:38.881936] [INFO ] [REMOTE ] CVI: Full fetch complete (67280 records). [2025-09-26T18:14:38.882084] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-09-26T18:14:39.159534] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-09-26T18:14:39.336485] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-09-26T18:14:39.336704] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-09-26T18:14:39.337672] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-09-26T18:14:39.337795] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-09-26T18:14:39.339624] [DEBUG] [LOCAL ] CVI: Trimmed 67280 records to 47160 (keeping 200 days of data) [2025-09-26T18:14:39.456891] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-26T18:14:39.667350] [DEBUG] [LOCAL ] CVI: Primary data saved (47160 records). [2025-09-26T18:14:39.667510] [INFO ] [MAIN ] CVI: Full history saved. [2025-09-26T18:14:39.667626] [INFO ] [MAIN ] Update Progress: 565/2371 symbols completed. CVI took 31.0s. Estimated remaining: 3h 58m 29s. Rate: 7.6 symbols/min [2025-09-26T18:14:39.853019] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:14:39.912060] [DEBUG] [LOCAL ] CVX: Loaded 54150 existing records from primary storage. [2025-09-26T18:14:39.912225] [INFO ] [MAIN ] CVX: Loaded 54150 existing records. [2025-09-26T18:14:39.966194] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-09-26T18:14:40.120834] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-26T18:14:40.125362] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:14:40.128626] [INFO ] [REMOTE ] CVLG: Full fetch complete (20783 records). [2025-09-26T18:14:40.128759] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-09-26T18:14:40.128916] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-09-26T18:14:40.128998] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-09-26T18:14:40.163295] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-09-26T18:14:40.190412] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-09-26T18:14:40.856262] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-09-26T18:14:40.870006] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-09-26T18:14:40.870483] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-09-26T18:14:40.871038] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-09-26T18:14:40.939570] [DEBUG] [LOCAL ] CVLG: Trimmed 20783 records to 15730 (keeping 200 days of data) [2025-09-26T18:14:40.962003] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:14:40.962532] [INFO ] [REMOTE ] CVX: Fetching primary data for 2024-12. [2025-09-26T18:14:41.082610] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (2.73 seconds). [2025-09-26T18:14:41.120680] [DEBUG] [LOCAL ] CVLG: Primary data saved (15730 records). [2025-09-26T18:14:41.120892] [INFO ] [MAIN ] CVLG: Full history saved. [2025-09-26T18:14:41.121059] [INFO ] [MAIN ] Update Progress: 566/2371 symbols completed. CVLG took 26.1s. Estimated remaining: 3h 58m 1s. Rate: 7.6 symbols/min [2025-09-26T18:14:41.361825] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:14:41.389284] [DEBUG] [LOCAL ] CW: Loaded 22557 existing records from primary storage. [2025-09-26T18:14:41.389428] [INFO ] [MAIN ] CW: Loaded 22557 existing records. [2025-09-26T18:14:41.567453] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-09-26T18:14:41.613054] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:14:41.614138] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-09-26T18:14:41.614382] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-09-26T18:14:41.615342] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-09-26T18:14:41.615430] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-09-26T18:14:41.784857] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-26T18:14:42.076888] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:14:42.356781] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-09-26T18:14:43.167749] [INFO ] [REMOTE ] CW: Fetching primary data for 2024-12. [2025-09-26T18:14:43.200962] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-26T18:14:43.659340] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-26T18:14:43.956716] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-09-26T18:14:44.592383] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-26T18:14:44.632763] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-26T18:14:44.756738] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-09-26T18:14:45.556788] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-09-26T18:14:45.991628] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-26T18:14:46.052257] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-26T18:14:46.356785] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-09-26T18:14:47.156835] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-09-26T18:14:47.452049] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-26T18:14:47.956800] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-09-26T18:14:48.100696] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-26T18:14:48.132040] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-26T18:14:48.756761] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-09-26T18:14:49.556777] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-09-26T18:14:49.832707] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-26T18:14:50.356732] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-09-26T18:14:50.427679] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-26T18:14:51.129707] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-09-26T18:14:51.156707] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-09-26T18:14:51.956749] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-09-26T18:14:52.654966] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-26T18:14:52.756756] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-09-26T18:14:52.789361] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-26T18:14:53.306724] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-26T18:14:53.556800] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-09-26T18:14:54.356852] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-09-26T18:14:55.167448] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-09-26T18:14:55.191746] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-09-26T18:14:55.273269] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-26T18:14:55.346092] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-26T18:14:55.956763] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-09-26T18:14:56.756776] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-09-26T18:14:57.106913] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-26T18:14:57.118184] [INFO ] [REMOTE ] CVNA: Full fetch complete (76673 records). [2025-09-26T18:14:57.118428] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-09-26T18:14:57.543456] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-09-26T18:14:57.543743] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-09-26T18:14:57.545036] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-09-26T18:14:57.545128] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-09-26T18:14:57.547286] [DEBUG] [LOCAL ] CVNA: Trimmed 76673 records to 53766 (keeping 200 days of data) [2025-09-26T18:14:57.563746] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-09-26T18:14:57.565440] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-26T18:14:57.941914] [DEBUG] [LOCAL ] CVNA: Primary data saved (53766 records). [2025-09-26T18:14:57.942272] [INFO ] [MAIN ] CVNA: Full history saved. [2025-09-26T18:14:57.942520] [INFO ] [MAIN ] Update Progress: 567/2371 symbols completed. CVNA took 38.6s. Estimated remaining: 3h 58m 21s. Rate: 7.6 symbols/min [2025-09-26T18:14:58.125909] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:14:58.162022] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-26T18:14:58.226346] [DEBUG] [LOCAL ] CWAN: Loaded 52772 existing records from primary storage. [2025-09-26T18:14:58.226568] [INFO ] [MAIN ] CWAN: Loaded 52772 existing records. [2025-09-26T18:14:58.362022] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-09-26T18:14:58.422982] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:14:58.423276] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-09-26T18:14:58.423328] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-09-26T18:14:58.424850] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-09-26T18:14:58.424924] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-09-26T18:14:58.819712] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:14:59.156788] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-12. [2025-09-26T18:14:59.277088] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-26T18:14:59.412254] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-26T18:14:59.956735] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-09-26T18:15:00.756746] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-09-26T18:15:00.922962] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-26T18:15:01.556733] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-09-26T18:15:01.886535] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-26T18:15:02.156686] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-26T18:15:02.356734] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-09-26T18:15:03.040551] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-26T18:15:03.156787] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-09-26T18:15:03.956715] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-09-26T18:15:04.106520] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-26T18:15:04.112163] [INFO ] [REMOTE ] CW: Full fetch complete (33459 records). [2025-09-26T18:15:04.112269] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-09-26T18:15:04.534200] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-09-26T18:15:04.534382] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-09-26T18:15:04.534951] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-09-26T18:15:04.535059] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-09-26T18:15:04.538673] [DEBUG] [LOCAL ] CW: Trimmed 33459 records to 22705 (keeping 200 days of data) [2025-09-26T18:15:04.668484] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-09-26T18:15:04.731075] [DEBUG] [LOCAL ] CW: Primary data saved (22705 records). [2025-09-26T18:15:04.731202] [INFO ] [MAIN ] CW: Full history saved. [2025-09-26T18:15:04.731382] [INFO ] [MAIN ] Update Progress: 568/2371 symbols completed. CW took 23.6s. Estimated remaining: 3h 58m 10s. Rate: 7.6 symbols/min [2025-09-26T18:15:04.763576] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-09-26T18:15:04.913587] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:15:04.913823] [DEBUG] [LOCAL ] CWEN: No existing data file found in primary storage. [2025-09-26T18:15:04.913881] [WARN ] [MAIN ] CWEN: No existing data found, performing full refresh instead. [2025-09-26T18:15:04.914082] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-09-26T18:15:04.914127] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-09-26T18:15:04.914170] [DEBUG] [LOCAL ] CWEN: No primary data file found to delete. [2025-09-26T18:15:04.914214] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-09-26T18:15:05.306178] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:15:05.556719] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2024-12. [2025-09-26T18:15:06.003156] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-26T18:15:06.021638] [INFO ] [REMOTE ] CVS: Full fetch complete (77813 records). [2025-09-26T18:15:06.021855] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-09-26T18:15:06.360766] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-09-26T18:15:06.472828] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-09-26T18:15:06.473082] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-09-26T18:15:06.474096] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-09-26T18:15:06.474534] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-09-26T18:15:06.486126] [DEBUG] [LOCAL ] CVS: Trimmed 77813 records to 54476 (keeping 200 days of data) [2025-09-26T18:15:06.504397] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-26T18:15:06.868797] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-26T18:15:06.886773] [DEBUG] [LOCAL ] CVS: Primary data saved (54476 records). [2025-09-26T18:15:06.886923] [INFO ] [MAIN ] CVS: Full history saved. [2025-09-26T18:15:06.887064] [INFO ] [MAIN ] Update Progress: 569/2371 symbols completed. CVS took 38.1s. Estimated remaining: 3h 57m 43s. Rate: 7.6 symbols/min [2025-09-26T18:15:07.066163] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:15:07.122470] [DEBUG] [LOCAL ] CWH: Loaded 51776 existing records from primary storage. [2025-09-26T18:15:07.122671] [INFO ] [MAIN ] CWH: Loaded 51776 existing records. [2025-09-26T18:15:07.161907] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-09-26T18:15:07.316098] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:15:07.316388] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-09-26T18:15:07.316436] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-09-26T18:15:07.317798] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-09-26T18:15:07.317873] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-09-26T18:15:07.703935] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:15:07.956733] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-09-26T18:15:08.450876] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-26T18:15:08.729998] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-09-26T18:15:08.756724] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-09-26T18:15:09.420436] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-26T18:15:09.556739] [INFO ] [REMOTE ] CWH: Fetching primary data for 2024-12. [2025-09-26T18:15:10.356768] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-09-26T18:15:10.803585] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-26T18:15:11.156763] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-09-26T18:15:11.362106] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-26T18:15:11.489917] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-26T18:15:11.956744] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-09-26T18:15:12.544925] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-26T18:15:12.756768] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-09-26T18:15:13.258686] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-26T18:15:13.556769] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-09-26T18:15:14.356747] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-09-26T18:15:15.104497] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T18:15:15.156695] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-09-26T18:15:15.392114] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.64 seconds). [2025-09-26T18:15:15.403517] [INFO ] [REMOTE ] CVX: Full fetch complete (77845 records). [2025-09-26T18:15:15.403753] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-09-26T18:15:15.918435] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-09-26T18:15:15.918792] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-09-26T18:15:15.922338] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-26T18:15:15.920845] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-09-26T18:15:15.931619] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-09-26T18:15:15.934296] [DEBUG] [LOCAL ] CVX: Trimmed 77845 records to 54540 (keeping 200 days of data) [2025-09-26T18:15:16.005571] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-09-26T18:15:16.317525] [DEBUG] [LOCAL ] CVX: Primary data saved (54540 records). [2025-09-26T18:15:16.317716] [INFO ] [MAIN ] CVX: Full history saved. [2025-09-26T18:15:16.317856] [INFO ] [MAIN ] Update Progress: 570/2371 symbols completed. CVX took 36.7s. Estimated remaining: 3h 57m 40s. Rate: 7.6 symbols/min [2025-09-26T18:15:16.535325] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:15:16.602093] [DEBUG] [LOCAL ] CWK: Loaded 49795 existing records from primary storage. [2025-09-26T18:15:16.602256] [INFO ] [MAIN ] CWK: Loaded 49795 existing records. [2025-09-26T18:15:16.776932] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-09-26T18:15:16.827429] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:15:16.827898] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-09-26T18:15:16.828040] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-09-26T18:15:16.829570] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-09-26T18:15:16.829682] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-09-26T18:15:17.038938] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-26T18:15:17.280769] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:15:17.556742] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-09-26T18:15:17.781353] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-26T18:15:18.356818] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-09-26T18:15:18.838419] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-26T18:15:19.068591] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-26T18:15:19.156785] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-09-26T18:15:19.653346] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-26T18:15:19.956794] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-09-26T18:15:20.524346] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-26T18:15:20.756781] [INFO ] [REMOTE ] CWK: Fetching primary data for 2024-12. [2025-09-26T18:15:21.556933] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-09-26T18:15:22.051857] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-26T18:15:22.273062] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-26T18:15:22.356777] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-09-26T18:15:22.735132] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-26T18:15:23.156787] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-09-26T18:15:23.804872] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-26T18:15:23.956789] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-09-26T18:15:24.657180] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-26T18:15:24.756764] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-09-26T18:15:25.166495] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-26T18:15:25.556725] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-09-26T18:15:26.005726] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-26T18:15:26.356729] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-09-26T18:15:27.156742] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-09-26T18:15:27.211222] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-26T18:15:27.956719] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-09-26T18:15:28.126844] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-26T18:15:28.535598] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-26T18:15:28.756763] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-09-26T18:15:29.502258] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-26T18:15:29.511964] [INFO ] [REMOTE ] CWEN: Full fetch complete (64451 records). [2025-09-26T18:15:29.512123] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-09-26T18:15:29.561905] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-09-26T18:15:29.940775] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-09-26T18:15:29.940882] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-09-26T18:15:29.941776] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-09-26T18:15:29.941878] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-09-26T18:15:29.943455] [DEBUG] [LOCAL ] CWEN: Trimmed 64451 records to 45717 (keeping 200 days of data) [2025-09-26T18:15:30.210739] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-26T18:15:30.295114] [DEBUG] [LOCAL ] CWEN: Primary data saved (45717 records). [2025-09-26T18:15:30.295258] [INFO ] [MAIN ] CWEN: Full history saved. [2025-09-26T18:15:30.295342] [INFO ] [MAIN ] Update Progress: 571/2371 symbols completed. CWEN took 25.6s. Estimated remaining: 3h 57m 51s. Rate: 7.6 symbols/min [2025-09-26T18:15:30.361827] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-09-26T18:15:30.488106] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:15:30.523229] [DEBUG] [LOCAL ] CWT: Loaded 28104 existing records from primary storage. [2025-09-26T18:15:30.523373] [INFO ] [MAIN ] CWT: Loaded 28104 existing records. [2025-09-26T18:15:30.711327] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:15:30.711687] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-09-26T18:15:30.711769] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-09-26T18:15:30.712680] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-09-26T18:15:30.712750] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-09-26T18:15:31.117492] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:15:31.156726] [INFO ] [REMOTE ] CWT: Fetching primary data for 2024-12. [2025-09-26T18:15:31.559277] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-26T18:15:31.956720] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-09-26T18:15:32.175107] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-26T18:15:32.231471] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-26T18:15:32.756778] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-09-26T18:15:33.556733] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-09-26T18:15:34.085609] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-26T18:15:34.356764] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-09-26T18:15:34.661466] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-26T18:15:35.050120] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (3.09 seconds). [2025-09-26T18:15:35.061556] [INFO ] [REMOTE ] CWAN: Full fetch complete (74721 records). [2025-09-26T18:15:35.061859] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-09-26T18:15:35.062931] [FATAL] [VALIDATOR ] CWAN: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:15:35.063035] [FATAL] [MAIN ] CWAN: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:15:35.063111] [WARN ] [MAIN ] CWAN: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:15:35.063193] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-09-26T18:15:35.063263] [DEBUG] [LOCAL ] CWAN: No primary data file found to delete. [2025-09-26T18:15:35.063302] [INFO ] [LOCAL ] CWAN: Starting deletion of derivative data. [2025-09-26T18:15:35.063890] [DEBUG] [LOCAL ] CWAN: Deleted derivative data file. [2025-09-26T18:15:35.064002] [INFO ] [MAIN ] Update Progress: 572/2371 symbols completed. CWAN took 37.1s. Estimated remaining: 3h 57m 34s. Rate: 7.6 symbols/min [2025-09-26T18:15:35.161836] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-09-26T18:15:35.268559] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:15:35.326970] [DEBUG] [LOCAL ] CX: Loaded 53229 existing records from primary storage. [2025-09-26T18:15:35.327197] [INFO ] [MAIN ] CX: Loaded 53229 existing records. [2025-09-26T18:15:35.520849] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:15:35.521100] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-09-26T18:15:35.521148] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-09-26T18:15:35.522437] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-09-26T18:15:35.522502] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-09-26T18:15:35.911101] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:15:35.945459] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-26T18:15:35.956885] [INFO ] [REMOTE ] CX: Fetching primary data for 2024-12. [2025-09-26T18:15:36.158247] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-26T18:15:36.756775] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-09-26T18:15:37.357846] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T18:15:37.556734] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-09-26T18:15:38.246959] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-26T18:15:38.356734] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-09-26T18:15:38.951568] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-26T18:15:39.156729] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-09-26T18:15:39.956706] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-09-26T18:15:40.139256] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-26T18:15:40.403337] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-26T18:15:40.756731] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-09-26T18:15:41.540681] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-26T18:15:41.556677] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-09-26T18:15:42.027872] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-26T18:15:42.356730] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-09-26T18:15:42.566407] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-26T18:15:43.156743] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-09-26T18:15:43.835264] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-26T18:15:43.845688] [INFO ] [REMOTE ] CWK: Full fetch complete (70917 records). [2025-09-26T18:15:43.845868] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-09-26T18:15:43.961793] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-09-26T18:15:44.319315] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-09-26T18:15:44.319421] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-09-26T18:15:44.320226] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-09-26T18:15:44.320295] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-09-26T18:15:44.321972] [DEBUG] [LOCAL ] CWK: Trimmed 70917 records to 50158 (keeping 200 days of data) [2025-09-26T18:15:44.645847] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-26T18:15:44.674364] [DEBUG] [LOCAL ] CWK: Primary data saved (50158 records). [2025-09-26T18:15:44.675362] [INFO ] [MAIN ] CWK: Full history saved. [2025-09-26T18:15:44.675526] [INFO ] [MAIN ] Update Progress: 573/2371 symbols completed. CWK took 28.4s. Estimated remaining: 3h 57m 31s. Rate: 7.6 symbols/min [2025-09-26T18:15:44.761813] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-09-26T18:15:44.868283] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:15:44.891044] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-26T18:15:44.894627] [DEBUG] [LOCAL ] CXE: Loaded 7230 existing records from primary storage. [2025-09-26T18:15:44.894834] [INFO ] [MAIN ] CXE: Loaded 7230 existing records. [2025-09-26T18:15:45.099186] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:15:45.099438] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-09-26T18:15:45.099489] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-09-26T18:15:45.099920] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-09-26T18:15:45.099985] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-09-26T18:15:45.517845] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:15:45.556743] [INFO ] [REMOTE ] CXE: Fetching primary data for 2024-12. [2025-09-26T18:15:46.356697] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-09-26T18:15:46.474013] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-26T18:15:46.607680] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-26T18:15:47.156723] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-09-26T18:15:47.225241] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-26T18:15:47.956721] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-09-26T18:15:48.756756] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-09-26T18:15:48.963137] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-26T18:15:49.205792] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-26T18:15:49.556716] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-09-26T18:15:50.356726] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-09-26T18:15:50.574860] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-26T18:15:50.586326] [INFO ] [REMOTE ] CWH: Full fetch complete (72851 records). [2025-09-26T18:15:50.586518] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-09-26T18:15:51.061524] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-09-26T18:15:51.061717] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-09-26T18:15:51.062638] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-09-26T18:15:51.062765] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-09-26T18:15:51.064831] [DEBUG] [LOCAL ] CWH: Trimmed 72851 records to 52151 (keeping 200 days of data) [2025-09-26T18:15:51.097778] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-26T18:15:51.161780] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-09-26T18:15:51.250095] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-26T18:15:51.491725] [DEBUG] [LOCAL ] CWH: Primary data saved (52151 records). [2025-09-26T18:15:51.491944] [INFO ] [MAIN ] CWH: Full history saved. [2025-09-26T18:15:51.492082] [INFO ] [MAIN ] Update Progress: 574/2371 symbols completed. CWH took 44.6s. Estimated remaining: 3h 57m 20s. Rate: 7.6 symbols/min [2025-09-26T18:15:51.690710] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:15:51.690912] [DEBUG] [LOCAL ] CXH: No existing data file found in primary storage. [2025-09-26T18:15:51.690954] [WARN ] [MAIN ] CXH: No existing data found, performing full refresh instead. [2025-09-26T18:15:51.691114] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-09-26T18:15:51.691160] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-09-26T18:15:51.691205] [DEBUG] [LOCAL ] CXH: No primary data file found to delete. [2025-09-26T18:15:51.691240] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-09-26T18:15:51.961846] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-09-26T18:15:52.107046] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:15:52.112770] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-26T18:15:52.756732] [INFO ] [REMOTE ] CXH: Fetching primary data for 2024-12. [2025-09-26T18:15:53.212689] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-26T18:15:53.556721] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-09-26T18:15:53.732342] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-26T18:15:54.356767] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-09-26T18:15:54.583144] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-26T18:15:54.589051] [INFO ] [REMOTE ] CWT: Full fetch complete (40268 records). [2025-09-26T18:15:54.589228] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-09-26T18:15:55.010429] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-09-26T18:15:55.010557] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-09-26T18:15:55.011189] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-09-26T18:15:55.011311] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-09-26T18:15:55.020151] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-26T18:15:55.023099] [DEBUG] [LOCAL ] CWT: Trimmed 40268 records to 28294 (keeping 200 days of data) [2025-09-26T18:15:55.167866] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-09-26T18:15:55.203412] [DEBUG] [LOCAL ] CWT: Primary data saved (28294 records). [2025-09-26T18:15:55.203574] [INFO ] [MAIN ] CWT: Full history saved. [2025-09-26T18:15:55.203711] [INFO ] [MAIN ] Update Progress: 575/2371 symbols completed. CWT took 24.9s. Estimated remaining: 3h 56m 58s. Rate: 7.6 symbols/min [2025-09-26T18:15:55.391790] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:15:55.392000] [DEBUG] [LOCAL ] CXM: No existing data file found in primary storage. [2025-09-26T18:15:55.392062] [WARN ] [MAIN ] CXM: No existing data found, performing full refresh instead. [2025-09-26T18:15:55.392282] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-09-26T18:15:55.392339] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-09-26T18:15:55.392385] [DEBUG] [LOCAL ] CXM: No primary data file found to delete. [2025-09-26T18:15:55.392419] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-09-26T18:15:55.717831] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-26T18:15:55.796275] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:15:55.956777] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-09-26T18:15:56.756734] [INFO ] [REMOTE ] CXM: Fetching primary data for 2024-12. [2025-09-26T18:15:56.862821] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-26T18:15:57.556746] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-09-26T18:15:58.041058] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-26T18:15:58.356733] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-09-26T18:15:58.670257] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-26T18:15:59.156734] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-09-26T18:15:59.392635] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-26T18:15:59.533239] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-26T18:15:59.956731] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-09-26T18:16:00.686855] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-26T18:16:00.756742] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-09-26T18:16:01.241782] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-26T18:16:01.556750] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-09-26T18:16:02.356768] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-09-26T18:16:03.156718] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-09-26T18:16:03.508946] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-26T18:16:03.521035] [INFO ] [REMOTE ] CX: Full fetch complete (76381 records). [2025-09-26T18:16:03.521270] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-09-26T18:16:03.972537] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-09-26T18:16:03.972342] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-09-26T18:16:03.974263] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-09-26T18:16:03.975312] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-09-26T18:16:03.980048] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-09-26T18:16:03.983537] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-26T18:16:03.987827] [DEBUG] [LOCAL ] CX: Trimmed 76381 records to 53603 (keeping 200 days of data) [2025-09-26T18:16:04.017031] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-26T18:16:04.361371] [DEBUG] [LOCAL ] CX: Primary data saved (53603 records). [2025-09-26T18:16:04.361571] [INFO ] [MAIN ] CX: Full history saved. [2025-09-26T18:16:04.361712] [INFO ] [MAIN ] Update Progress: 576/2371 symbols completed. CX took 29.3s. Estimated remaining: 3h 56m 54s. Rate: 7.6 symbols/min [2025-09-26T18:16:04.571836] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:16:04.579311] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-26T18:16:04.615738] [DEBUG] [LOCAL ] CXT: Loaded 31343 existing records from primary storage. [2025-09-26T18:16:04.615893] [INFO ] [MAIN ] CXT: Loaded 31343 existing records. [2025-09-26T18:16:04.761899] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-09-26T18:16:04.825065] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:16:04.825355] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-09-26T18:16:04.825414] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-09-26T18:16:04.826427] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-09-26T18:16:04.826492] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-09-26T18:16:05.215681] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:16:05.422677] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-26T18:16:05.556728] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-12. [2025-09-26T18:16:06.356783] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-09-26T18:16:07.056942] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-26T18:16:07.156779] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-09-26T18:16:07.330069] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-26T18:16:07.956719] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-09-26T18:16:08.602494] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-26T18:16:08.756727] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-09-26T18:16:09.558430] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-09-26T18:16:09.562861] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-26T18:16:09.851403] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-26T18:16:10.191709] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-26T18:16:10.356771] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-09-26T18:16:10.839883] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-26T18:16:11.156772] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-09-26T18:16:11.956738] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-09-26T18:16:12.079283] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-26T18:16:12.082031] [INFO ] [REMOTE ] CXE: Full fetch complete (11871 records). [2025-09-26T18:16:12.082161] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-09-26T18:16:12.652381] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-09-26T18:16:12.652496] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-09-26T18:16:12.652905] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-09-26T18:16:12.653004] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-09-26T18:16:12.654020] [DEBUG] [LOCAL ] CXE: Trimmed 11871 records to 7247 (keeping 200 days of data) [2025-09-26T18:16:12.717035] [DEBUG] [LOCAL ] CXE: Primary data saved (7247 records). [2025-09-26T18:16:12.717271] [INFO ] [MAIN ] CXE: Full history saved. [2025-09-26T18:16:12.717468] [INFO ] [MAIN ] Update Progress: 577/2371 symbols completed. CXE took 28.0s. Estimated remaining: 3h 56m 48s. Rate: 7.6 symbols/min [2025-09-26T18:16:12.761937] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-09-26T18:16:12.922979] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:16:12.982396] [DEBUG] [LOCAL ] CXW: Loaded 44634 existing records from primary storage. [2025-09-26T18:16:12.982563] [INFO ] [MAIN ] CXW: Loaded 44634 existing records. [2025-09-26T18:16:13.177804] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:16:13.178205] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-09-26T18:16:13.178324] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-09-26T18:16:13.179437] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-09-26T18:16:13.179506] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-09-26T18:16:13.314612] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-26T18:16:13.561140] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-09-26T18:16:13.640514] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-26T18:16:13.648704] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:16:14.219088] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-26T18:16:14.220819] [INFO ] [REMOTE ] CXH: Full fetch complete (5478 records). [2025-09-26T18:16:14.220917] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-09-26T18:16:14.403436] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-09-26T18:16:14.711793] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-09-26T18:16:14.711932] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-09-26T18:16:14.712152] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-09-26T18:16:14.712213] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-09-26T18:16:14.712936] [DEBUG] [LOCAL ] CXH: Trimmed 5478 records to 4436 (keeping 200 days of data) [2025-09-26T18:16:14.744082] [DEBUG] [LOCAL ] CXH: Primary data saved (4436 records). [2025-09-26T18:16:14.744248] [INFO ] [MAIN ] CXH: Full history saved. [2025-09-26T18:16:14.744350] [INFO ] [MAIN ] Update Progress: 578/2371 symbols completed. CXH took 23.3s. Estimated remaining: 3h 56m 22s. Rate: 7.6 symbols/min [2025-09-26T18:16:14.923375] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:16:14.952933] [DEBUG] [LOCAL ] CYD: Loaded 26935 existing records from primary storage. [2025-09-26T18:16:14.953109] [INFO ] [MAIN ] CYD: Loaded 26935 existing records. [2025-09-26T18:16:15.139821] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:16:15.140133] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-09-26T18:16:15.140183] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-09-26T18:16:15.141074] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-09-26T18:16:15.141137] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-09-26T18:16:15.162613] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-09-26T18:16:15.539209] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:16:15.956738] [INFO ] [REMOTE ] CYD: Fetching primary data for 2024-12. [2025-09-26T18:16:16.155865] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-26T18:16:16.371690] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-26T18:16:16.582360] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-26T18:16:16.756785] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-09-26T18:16:17.429314] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-26T18:16:17.556778] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-09-26T18:16:18.356764] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-09-26T18:16:19.039195] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-26T18:16:19.156710] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-09-26T18:16:19.174105] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-26T18:16:19.956688] [INFO ] [REMOTE ] CXW: Fetching primary data for 2024-12. [2025-09-26T18:16:20.438382] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-26T18:16:20.756773] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-09-26T18:16:21.464779] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-26T18:16:21.556736] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-09-26T18:16:22.084548] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-26T18:16:22.356745] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-09-26T18:16:22.958529] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-26T18:16:23.156794] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-09-26T18:16:23.775831] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-26T18:16:23.956731] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-09-26T18:16:24.725160] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-26T18:16:24.756760] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-09-26T18:16:24.897801] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-26T18:16:25.556747] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-09-26T18:16:26.132517] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-26T18:16:26.318211] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-26T18:16:26.356698] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-09-26T18:16:27.156738] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-09-26T18:16:27.720962] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-26T18:16:27.956766] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-09-26T18:16:28.367440] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-26T18:16:28.756782] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-09-26T18:16:29.255007] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-26T18:16:29.556728] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-09-26T18:16:30.165766] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-26T18:16:30.356742] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-09-26T18:16:31.156714] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-09-26T18:16:31.283186] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-26T18:16:31.337035] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-26T18:16:31.956713] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-09-26T18:16:32.524168] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-26T18:16:32.756741] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-09-26T18:16:33.556719] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-09-26T18:16:33.664442] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-26T18:16:33.969844] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-26T18:16:34.356714] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-09-26T18:16:34.447946] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-26T18:16:35.156774] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-09-26T18:16:35.751926] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-26T18:16:35.763565] [INFO ] [REMOTE ] CXM: Full fetch complete (68943 records). [2025-09-26T18:16:35.763917] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-09-26T18:16:35.966357] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-09-26T18:16:36.238837] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-09-26T18:16:36.238985] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-09-26T18:16:36.240342] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-09-26T18:16:36.240586] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-09-26T18:16:36.262204] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-26T18:16:36.269124] [DEBUG] [LOCAL ] CXM: Trimmed 68943 records to 48607 (keeping 200 days of data) [2025-09-26T18:16:36.270957] [INFO ] [REMOTE ] CXT: Full fetch complete (44916 records). [2025-09-26T18:16:36.271540] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-09-26T18:16:36.272475] [FATAL] [VALIDATOR ] CXT: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:16:36.272597] [FATAL] [MAIN ] CXT: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:16:36.272674] [WARN ] [MAIN ] CXT: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:16:36.272754] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-09-26T18:16:36.272834] [DEBUG] [LOCAL ] CXT: No primary data file found to delete. [2025-09-26T18:16:36.272885] [INFO ] [LOCAL ] CXT: Starting deletion of derivative data. [2025-09-26T18:16:36.328300] [DEBUG] [LOCAL ] CXT: Deleted derivative data file. [2025-09-26T18:16:36.339120] [INFO ] [MAIN ] Update Progress: 579/2371 symbols completed. CXT took 32.0s. Estimated remaining: 3h 56m 56s. Rate: 7.6 symbols/min [2025-09-26T18:16:36.699805] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:16:36.706829] [DEBUG] [LOCAL ] CYH: No existing data file found in primary storage. [2025-09-26T18:16:36.709440] [WARN ] [MAIN ] CYH: No existing data found, performing full refresh instead. [2025-09-26T18:16:36.715771] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-09-26T18:16:36.720238] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-09-26T18:16:36.722525] [DEBUG] [LOCAL ] CYH: No primary data file found to delete. [2025-09-26T18:16:36.724542] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-09-26T18:16:36.761580] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-09-26T18:16:37.175053] [DEBUG] [LOCAL ] CXM: Primary data saved (48607 records). [2025-09-26T18:16:37.201991] [INFO ] [MAIN ] CXM: Full history saved. [2025-09-26T18:16:37.208184] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:16:37.208475] [INFO ] [MAIN ] Update Progress: 580/2371 symbols completed. CXM took 42.0s. Estimated remaining: 3h 56m 26s. Rate: 7.6 symbols/min [2025-09-26T18:16:37.400996] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:16:37.401200] [DEBUG] [LOCAL ] D: No existing data file found in primary storage. [2025-09-26T18:16:37.401254] [WARN ] [MAIN ] D: No existing data found, performing full refresh instead. [2025-09-26T18:16:37.401410] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-09-26T18:16:37.401457] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-09-26T18:16:37.401501] [DEBUG] [LOCAL ] D: No primary data file found to delete. [2025-09-26T18:16:37.401535] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-09-26T18:16:37.561870] [INFO ] [REMOTE ] CYH: Fetching primary data for 2024-12. [2025-09-26T18:16:37.805183] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:16:37.942071] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-26T18:16:38.315056] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-26T18:16:38.321504] [INFO ] [REMOTE ] CYD: Full fetch complete (32733 records). [2025-09-26T18:16:38.321687] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-09-26T18:16:38.361814] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-09-26T18:16:38.774117] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-09-26T18:16:38.774205] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-09-26T18:16:38.774756] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-09-26T18:16:38.774820] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-09-26T18:16:38.775916] [DEBUG] [LOCAL ] CYD: Trimmed 32733 records to 27145 (keeping 200 days of data) [2025-09-26T18:16:38.949812] [DEBUG] [LOCAL ] CYD: Primary data saved (27145 records). [2025-09-26T18:16:38.950168] [INFO ] [MAIN ] CYD: Full history saved. [2025-09-26T18:16:38.950275] [INFO ] [MAIN ] Update Progress: 581/2371 symbols completed. CYD took 24.2s. Estimated remaining: 3h 55m 59s. Rate: 7.6 symbols/min [2025-09-26T18:16:39.054422] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-26T18:16:39.157966] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-09-26T18:16:39.186051] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:16:39.201720] [DEBUG] [LOCAL ] DAC: Loaded 12696 existing records from primary storage. [2025-09-26T18:16:39.201875] [INFO ] [MAIN ] DAC: Loaded 12696 existing records. [2025-09-26T18:16:39.405947] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:16:39.406202] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-09-26T18:16:39.406252] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-09-26T18:16:39.406783] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-09-26T18:16:39.406847] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-09-26T18:16:39.799503] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:16:39.826616] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-26T18:16:39.956711] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-12. [2025-09-26T18:16:40.431460] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-26T18:16:40.646841] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-26T18:16:40.756725] [INFO ] [REMOTE ] D: Fetching primary data for 2024-12. [2025-09-26T18:16:41.556726] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-09-26T18:16:42.356730] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-09-26T18:16:42.545001] [INFO ] [REMOTE ] D: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-26T18:16:42.589822] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-26T18:16:43.156720] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-09-26T18:16:43.692305] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-26T18:16:43.768042] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-26T18:16:43.956735] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-09-26T18:16:44.756763] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-09-26T18:16:44.980903] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-26T18:16:45.556725] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-09-26T18:16:46.356947] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-09-26T18:16:46.714379] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-26T18:16:46.738221] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-26T18:16:47.156767] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-09-26T18:16:47.638477] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-26T18:16:47.956761] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-09-26T18:16:48.756733] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-09-26T18:16:48.913731] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-26T18:16:49.527133] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-26T18:16:49.556676] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-09-26T18:16:49.569194] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-26T18:16:50.356735] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-09-26T18:16:51.156767] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-09-26T18:16:51.281096] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T18:16:51.595227] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-26T18:16:51.956732] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-09-26T18:16:52.111831] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-26T18:16:52.756778] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-09-26T18:16:53.556712] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-09-26T18:16:53.628499] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-26T18:16:53.695671] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-26T18:16:54.356773] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-09-26T18:16:55.166705] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-09-26T18:16:55.192152] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-26T18:16:55.202067] [INFO ] [REMOTE ] CXW: Full fetch complete (65037 records). [2025-09-26T18:16:55.202271] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-09-26T18:16:55.654381] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-09-26T18:16:55.654503] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-09-26T18:16:55.655518] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-09-26T18:16:55.655607] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-09-26T18:16:55.666760] [DEBUG] [LOCAL ] CXW: Trimmed 65037 records to 44899 (keeping 200 days of data) [2025-09-26T18:16:55.687803] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-26T18:16:55.802931] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-26T18:16:55.965238] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-09-26T18:16:55.986854] [DEBUG] [LOCAL ] CXW: Primary data saved (44899 records). [2025-09-26T18:16:55.987005] [INFO ] [MAIN ] CXW: Full history saved. [2025-09-26T18:16:55.987124] [INFO ] [MAIN ] Update Progress: 582/2371 symbols completed. CXW took 43.3s. Estimated remaining: 3h 56m 20s. Rate: 7.6 symbols/min [2025-09-26T18:16:56.173429] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:16:56.230972] [DEBUG] [LOCAL ] DAL: Loaded 54143 existing records from primary storage. [2025-09-26T18:16:56.231145] [INFO ] [MAIN ] DAL: Loaded 54143 existing records. [2025-09-26T18:16:56.432046] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:16:56.432347] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-09-26T18:16:56.432415] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-09-26T18:16:56.433860] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-09-26T18:16:56.433929] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-09-26T18:16:56.761844] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-09-26T18:16:56.837874] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:16:57.556733] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-09-26T18:16:57.693470] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-26T18:16:57.726472] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-26T18:16:57.729234] [INFO ] [REMOTE ] DAC: Full fetch complete (19544 records). [2025-09-26T18:16:57.729336] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-09-26T18:16:57.729887] [FATAL] [VALIDATOR ] DAC: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:16:57.729994] [FATAL] [MAIN ] DAC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:16:57.730073] [WARN ] [MAIN ] DAC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:16:57.730164] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-09-26T18:16:57.730251] [DEBUG] [LOCAL ] DAC: No primary data file found to delete. [2025-09-26T18:16:57.730293] [INFO ] [LOCAL ] DAC: Starting deletion of derivative data. [2025-09-26T18:16:57.730595] [DEBUG] [LOCAL ] DAC: Deleted derivative data file. [2025-09-26T18:16:57.730767] [INFO ] [MAIN ] Update Progress: 583/2371 symbols completed. DAC took 18.8s. Estimated remaining: 3h 55m 53s. Rate: 7.6 symbols/min [2025-09-26T18:16:57.916021] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:16:57.966862] [DEBUG] [LOCAL ] DAN: Loaded 49394 existing records from primary storage. [2025-09-26T18:16:57.967103] [INFO ] [MAIN ] DAN: Loaded 49394 existing records. [2025-09-26T18:16:58.156823] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:16:58.157243] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-09-26T18:16:58.157301] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-09-26T18:16:58.158635] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-09-26T18:16:58.158728] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-09-26T18:16:58.362810] [INFO ] [REMOTE ] DAL: Fetching primary data for 2024-12. [2025-09-26T18:16:58.537785] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:16:59.090916] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-26T18:16:59.156771] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-09-26T18:16:59.956738] [INFO ] [REMOTE ] DAN: Fetching primary data for 2024-12. [2025-09-26T18:17:00.135998] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-26T18:17:00.757239] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-09-26T18:17:00.760555] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-26T18:17:01.346030] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-26T18:17:01.556741] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-09-26T18:17:02.356916] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-09-26T18:17:02.501121] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-26T18:17:02.834562] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-26T18:17:03.156735] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-09-26T18:17:03.956739] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-09-26T18:17:04.020205] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-26T18:17:04.756747] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-09-26T18:17:04.830946] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-26T18:17:05.273109] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-26T18:17:05.556739] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-09-26T18:17:05.980591] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-26T18:17:06.356777] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-09-26T18:17:07.156746] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-09-26T18:17:07.407995] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-26T18:17:07.420046] [INFO ] [REMOTE ] CYH: Full fetch complete (70185 records). [2025-09-26T18:17:07.420255] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-09-26T18:17:07.869213] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-09-26T18:17:07.869309] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-09-26T18:17:07.870142] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-09-26T18:17:07.870253] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-09-26T18:17:07.872940] [DEBUG] [LOCAL ] CYH: Trimmed 70185 records to 48352 (keeping 200 days of data) [2025-09-26T18:17:07.966712] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-09-26T18:17:08.177526] [DEBUG] [LOCAL ] CYH: Primary data saved (48352 records). [2025-09-26T18:17:08.178043] [INFO ] [MAIN ] CYH: Full history saved. [2025-09-26T18:17:08.178256] [INFO ] [MAIN ] Update Progress: 584/2371 symbols completed. CYH took 31.8s. Estimated remaining: 3h 55m 53s. Rate: 7.6 symbols/min [2025-09-26T18:17:08.362085] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:17:08.384510] [DEBUG] [LOCAL ] DAO: Loaded 21360 existing records from primary storage. [2025-09-26T18:17:08.384788] [INFO ] [MAIN ] DAO: Loaded 21360 existing records. [2025-09-26T18:17:08.588332] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:17:08.589942] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-09-26T18:17:08.590108] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-09-26T18:17:08.591154] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-09-26T18:17:08.591243] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-09-26T18:17:08.894481] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-09-26T18:17:08.938999] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-09-26T18:17:09.093111] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-26T18:17:09.100163] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:17:09.556695] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-09-26T18:17:09.728874] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-26T18:17:10.356770] [INFO ] [REMOTE ] DAO: Fetching primary data for 2024-12. [2025-09-26T18:17:11.062383] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-26T18:17:11.156723] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-09-26T18:17:11.251144] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-26T18:17:11.414959] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-26T18:17:11.956758] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-09-26T18:17:12.723689] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-26T18:17:12.756722] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-09-26T18:17:13.556721] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-09-26T18:17:14.279701] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-09-26T18:17:14.356791] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-09-26T18:17:14.570082] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-26T18:17:15.156747] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-09-26T18:17:15.456950] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-26T18:17:15.956719] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-09-26T18:17:16.511256] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-26T18:17:16.756700] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-09-26T18:17:16.903203] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-26T18:17:17.423734] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-26T18:17:17.522848] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-26T18:17:17.556698] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-09-26T18:17:18.356770] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-09-26T18:17:19.156787] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-09-26T18:17:19.510083] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-26T18:17:19.956769] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-09-26T18:17:20.371684] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-26T18:17:20.433247] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-26T18:17:20.756773] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-09-26T18:17:21.328314] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-26T18:17:21.556737] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-09-26T18:17:22.356756] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-09-26T18:17:22.851670] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-26T18:17:22.862871] [INFO ] [REMOTE ] D: Full fetch complete (77656 records). [2025-09-26T18:17:22.863071] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-09-26T18:17:23.167050] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-09-26T18:17:23.249884] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-26T18:17:23.359307] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-09-26T18:17:23.359421] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-09-26T18:17:23.360474] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-09-26T18:17:23.360715] [DEBUG] [LOCAL ] D: Saving primary data. [2025-09-26T18:17:23.364938] [DEBUG] [LOCAL ] D: Trimmed 77656 records to 54426 (keeping 200 days of data) [2025-09-26T18:17:23.761487] [DEBUG] [LOCAL ] D: Primary data saved (54426 records). [2025-09-26T18:17:23.761709] [INFO ] [MAIN ] D: Full history saved. [2025-09-26T18:17:23.761859] [INFO ] [MAIN ] Update Progress: 585/2371 symbols completed. D took 46.6s. Estimated remaining: 3h 56m 8s. Rate: 7.6 symbols/min [2025-09-26T18:17:23.965028] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-09-26T18:17:24.003322] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:17:24.047236] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-26T18:17:24.058966] [INFO ] [REMOTE ] DAN: Full fetch complete (70847 records). [2025-09-26T18:17:24.059182] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-09-26T18:17:24.376300] [DEBUG] [LOCAL ] DAR: Loaded 52219 existing records from primary storage. [2025-09-26T18:17:24.410192] [INFO ] [MAIN ] DAR: Loaded 52219 existing records. [2025-09-26T18:17:24.968034] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-09-26T18:17:24.991682] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-09-26T18:17:24.994664] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-09-26T18:17:25.011881] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-09-26T18:17:25.012045] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:17:25.013182] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-09-26T18:17:25.013313] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-09-26T18:17:25.021859] [DEBUG] [LOCAL ] DAN: Trimmed 70847 records to 49753 (keeping 200 days of data) [2025-09-26T18:17:25.021962] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-09-26T18:17:25.036087] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-09-26T18:17:25.148937] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-26T18:17:25.232558] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-09-26T18:17:25.590082] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-26T18:17:25.664049] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-09-26T18:17:25.690713] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:17:25.904379] [DEBUG] [LOCAL ] DAN: Primary data saved (49753 records). [2025-09-26T18:17:25.904555] [INFO ] [MAIN ] DAN: Full history saved. [2025-09-26T18:17:25.904700] [INFO ] [MAIN ] Update Progress: 586/2371 symbols completed. DAN took 28.2s. Estimated remaining: 3h 55m 42s. Rate: 7.6 symbols/min [2025-09-26T18:17:26.097989] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:17:26.142091] [DEBUG] [LOCAL ] DAVA: Loaded 40977 existing records from primary storage. [2025-09-26T18:17:26.142246] [INFO ] [MAIN ] DAVA: Loaded 40977 existing records. [2025-09-26T18:17:26.350751] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-26T18:17:26.361879] [INFO ] [REMOTE ] DAR: Fetching primary data for 2024-12. [2025-09-26T18:17:26.355065] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:17:26.364023] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-09-26T18:17:26.364094] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-09-26T18:17:26.365434] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-09-26T18:17:26.365520] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-09-26T18:17:26.752174] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:17:27.156772] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2024-12. [2025-09-26T18:17:27.584968] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-26T18:17:27.597752] [INFO ] [REMOTE ] DAL: Full fetch complete (77823 records). [2025-09-26T18:17:27.597953] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-09-26T18:17:27.958071] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-09-26T18:17:28.092877] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-09-26T18:17:28.093113] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-09-26T18:17:28.094303] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-09-26T18:17:28.094434] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-09-26T18:17:28.135429] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-26T18:17:28.133556] [DEBUG] [LOCAL ] DAL: Trimmed 77823 records to 54533 (keeping 200 days of data) [2025-09-26T18:17:28.306335] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-26T18:17:28.537860] [DEBUG] [LOCAL ] DAL: Primary data saved (54533 records). [2025-09-26T18:17:28.538010] [INFO ] [MAIN ] DAL: Full history saved. [2025-09-26T18:17:28.538110] [INFO ] [MAIN ] Update Progress: 587/2371 symbols completed. DAL took 32.6s. Estimated remaining: 3h 55m 18s. Rate: 7.6 symbols/min [2025-09-26T18:17:28.706947] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-26T18:17:28.739706] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:17:28.766701] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-09-26T18:17:28.790316] [DEBUG] [LOCAL ] DAY: Loaded 50193 existing records from primary storage. [2025-09-26T18:17:28.790459] [INFO ] [MAIN ] DAY: Loaded 50193 existing records. [2025-09-26T18:17:28.979899] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:17:28.980230] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-09-26T18:17:28.980289] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-09-26T18:17:28.981409] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-09-26T18:17:28.981475] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-09-26T18:17:29.440595] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:17:29.556692] [INFO ] [REMOTE ] DAY: Fetching primary data for 2024-12. [2025-09-26T18:17:29.580938] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-26T18:17:30.356750] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-09-26T18:17:30.872385] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-26T18:17:31.156738] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-09-26T18:17:31.339701] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-26T18:17:31.956728] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-09-26T18:17:32.449941] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-26T18:17:32.756751] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-09-26T18:17:33.559049] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-09-26T18:17:33.565468] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-26T18:17:34.068290] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-26T18:17:34.356699] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-09-26T18:17:34.433222] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-26T18:17:35.156743] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-09-26T18:17:35.940779] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-26T18:17:35.956677] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-09-26T18:17:36.300155] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-26T18:17:36.304945] [INFO ] [REMOTE ] DAO: Full fetch complete (32843 records). [2025-09-26T18:17:36.305057] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-09-26T18:17:36.728061] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-09-26T18:17:36.728231] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-09-26T18:17:36.728952] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-09-26T18:17:36.729032] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-09-26T18:17:36.730183] [DEBUG] [LOCAL ] DAO: Trimmed 32843 records to 21546 (keeping 200 days of data) [2025-09-26T18:17:36.780328] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-09-26T18:17:36.860271] [DEBUG] [LOCAL ] DAO: Primary data saved (21546 records). [2025-09-26T18:17:36.860413] [INFO ] [MAIN ] DAO: Full history saved. [2025-09-26T18:17:36.860499] [INFO ] [MAIN ] Update Progress: 588/2371 symbols completed. DAO took 28.7s. Estimated remaining: 3h 55m 12s. Rate: 7.6 symbols/min [2025-09-26T18:17:37.059099] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:17:37.059442] [DEBUG] [LOCAL ] DB: No existing data file found in primary storage. [2025-09-26T18:17:37.059631] [WARN ] [MAIN ] DB: No existing data found, performing full refresh instead. [2025-09-26T18:17:37.060074] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-09-26T18:17:37.060154] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-09-26T18:17:37.060319] [DEBUG] [LOCAL ] DB: No primary data file found to delete. [2025-09-26T18:17:37.060398] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-09-26T18:17:37.295126] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-26T18:17:37.509772] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:17:37.556724] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-09-26T18:17:38.317451] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-26T18:17:38.356714] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-09-26T18:17:39.156763] [INFO ] [REMOTE ] DB: Fetching primary data for 2024-12. [2025-09-26T18:17:39.493092] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-26T18:17:39.956755] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-09-26T18:17:40.039812] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-26T18:17:40.494067] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-26T18:17:40.756761] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-09-26T18:17:41.327881] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-26T18:17:41.556750] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-09-26T18:17:42.356728] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-09-26T18:17:42.573693] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-26T18:17:43.156782] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-09-26T18:17:43.479589] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-26T18:17:43.860387] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-26T18:17:43.956722] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-09-26T18:17:44.632975] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-26T18:17:44.756765] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-09-26T18:17:44.998527] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-26T18:17:45.556736] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-09-26T18:17:46.356728] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-09-26T18:17:46.363012] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-26T18:17:47.116776] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-26T18:17:47.156733] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-09-26T18:17:47.647677] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-26T18:17:47.956774] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-09-26T18:17:48.756691] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-09-26T18:17:48.959889] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-26T18:17:49.556731] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-09-26T18:17:49.602507] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-26T18:17:50.154097] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-26T18:17:50.356753] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-09-26T18:17:50.929494] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-26T18:17:51.156775] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-09-26T18:17:51.790888] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-26T18:17:51.956766] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-09-26T18:17:52.756727] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-09-26T18:17:52.879101] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T18:17:53.556745] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-09-26T18:17:54.078727] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-26T18:17:54.088800] [INFO ] [REMOTE ] DAVA: Full fetch complete (55610 records). [2025-09-26T18:17:54.088960] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-09-26T18:17:54.357439] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-09-26T18:17:54.552596] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-09-26T18:17:54.552758] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-09-26T18:17:54.553808] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-09-26T18:17:54.554125] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-09-26T18:17:54.587749] [DEBUG] [LOCAL ] DAVA: Trimmed 55610 records to 41308 (keeping 200 days of data) [2025-09-26T18:17:54.589315] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-26T18:17:54.853760] [DEBUG] [LOCAL ] DAVA: Primary data saved (41308 records). [2025-09-26T18:17:54.853940] [INFO ] [MAIN ] DAVA: Full history saved. [2025-09-26T18:17:54.854053] [INFO ] [MAIN ] Update Progress: 589/2371 symbols completed. DAVA took 28.9s. Estimated remaining: 3h 55m 34s. Rate: 7.6 symbols/min [2025-09-26T18:17:55.034076] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:17:55.034309] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-09-26T18:17:55.034366] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-09-26T18:17:55.034528] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-09-26T18:17:55.034573] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-09-26T18:17:55.034617] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-09-26T18:17:55.034689] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-09-26T18:17:55.157911] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-09-26T18:17:55.426735] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:17:55.462414] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-26T18:17:55.694768] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-26T18:17:55.956749] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-12. [2025-09-26T18:17:56.571941] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-26T18:17:56.622529] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-26T18:17:56.756735] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-09-26T18:17:57.556722] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-09-26T18:17:58.356752] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-09-26T18:17:58.446275] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-26T18:17:58.647698] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-26T18:17:58.658572] [INFO ] [REMOTE ] DAR: Full fetch complete (74542 records). [2025-09-26T18:17:58.658783] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-09-26T18:17:59.086613] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-09-26T18:17:59.086736] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-09-26T18:17:59.087577] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-09-26T18:17:59.087666] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-09-26T18:17:59.089285] [DEBUG] [LOCAL ] DAR: Trimmed 74542 records to 52603 (keeping 200 days of data) [2025-09-26T18:17:59.175663] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-09-26T18:17:59.428672] [DEBUG] [LOCAL ] DAR: Primary data saved (52603 records). [2025-09-26T18:17:59.428919] [INFO ] [MAIN ] DAR: Full history saved. [2025-09-26T18:17:59.429046] [INFO ] [MAIN ] Update Progress: 590/2371 symbols completed. DAR took 35.7s. Estimated remaining: 3h 55m 16s. Rate: 7.6 symbols/min [2025-09-26T18:17:59.621482] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:17:59.671590] [DEBUG] [LOCAL ] DBI: Loaded 45297 existing records from primary storage. [2025-09-26T18:17:59.671861] [INFO ] [MAIN ] DBI: Loaded 45297 existing records. [2025-09-26T18:17:59.862723] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:17:59.863057] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-09-26T18:17:59.863109] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-09-26T18:17:59.864313] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-09-26T18:17:59.864379] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-09-26T18:17:59.961031] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-09-26T18:18:00.110834] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-26T18:18:00.301051] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:18:00.336301] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-26T18:18:00.756800] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-09-26T18:18:01.556750] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-09-26T18:18:01.903044] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-26T18:18:02.146340] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-26T18:18:02.356778] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-09-26T18:18:03.153931] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-26T18:18:03.159384] [INFO ] [REMOTE ] DBI: Fetching primary data for 2024-12. [2025-09-26T18:18:03.431155] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-26T18:18:03.443166] [INFO ] [REMOTE ] DAY: Full fetch complete (71674 records). [2025-09-26T18:18:03.443449] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-09-26T18:18:03.887314] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-09-26T18:18:03.887470] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-09-26T18:18:03.888974] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-09-26T18:18:03.889061] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-09-26T18:18:03.891436] [DEBUG] [LOCAL ] DAY: Trimmed 71674 records to 50491 (keeping 200 days of data) [2025-09-26T18:18:03.983940] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-09-26T18:18:04.225608] [DEBUG] [LOCAL ] DAY: Primary data saved (50491 records). [2025-09-26T18:18:04.225908] [INFO ] [MAIN ] DAY: Full history saved. [2025-09-26T18:18:04.226086] [INFO ] [MAIN ] Update Progress: 591/2371 symbols completed. DAY took 35.7s. Estimated remaining: 3h 54m 59s. Rate: 7.6 symbols/min [2025-09-26T18:18:04.411496] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:18:04.423544] [DEBUG] [LOCAL ] DBL: Loaded 9203 existing records from primary storage. [2025-09-26T18:18:04.423699] [INFO ] [MAIN ] DBL: Loaded 9203 existing records. [2025-09-26T18:18:04.616349] [WARN ] [MAIN ] DBL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:18:04.617262] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-09-26T18:18:04.617334] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-09-26T18:18:04.617936] [DEBUG] [LOCAL ] DBL: Deleted primary data file. [2025-09-26T18:18:04.618008] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-09-26T18:18:04.761697] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-09-26T18:18:05.023351] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:18:05.041966] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-26T18:18:05.556694] [INFO ] [REMOTE ] DBL: Fetching primary data for 2024-12. [2025-09-26T18:18:05.736726] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-26T18:18:05.955471] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-26T18:18:06.266956] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-26T18:18:06.356809] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-09-26T18:18:07.070414] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-26T18:18:07.156722] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-09-26T18:18:07.956773] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-09-26T18:18:07.971909] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-26T18:18:08.756783] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-09-26T18:18:09.556717] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-09-26T18:18:09.627105] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-26T18:18:09.865226] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-26T18:18:09.979075] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-26T18:18:10.356743] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-09-26T18:18:11.156722] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-09-26T18:18:11.276153] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-26T18:18:11.956749] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-09-26T18:18:12.549449] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-26T18:18:12.756736] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-09-26T18:18:12.806841] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-26T18:18:13.552004] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-26T18:18:13.556784] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-09-26T18:18:14.356753] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-09-26T18:18:14.713809] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-26T18:18:14.718940] [INFO ] [REMOTE ] DBD: Full fetch complete (30620 records). [2025-09-26T18:18:14.719047] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-09-26T18:18:14.719561] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:18:14.719696] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:18:14.719785] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:18:14.720039] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-09-26T18:18:14.720334] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-09-26T18:18:14.720400] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-09-26T18:18:14.720474] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-09-26T18:18:14.720602] [INFO ] [MAIN ] Update Progress: 592/2371 symbols completed. DBD took 19.9s. Estimated remaining: 3h 54m 59s. Rate: 7.6 symbols/min [2025-09-26T18:18:14.903472] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:18:14.956043] [DEBUG] [LOCAL ] DBRG: Loaded 50157 existing records from primary storage. [2025-09-26T18:18:14.956290] [INFO ] [MAIN ] DBRG: Loaded 50157 existing records. [2025-09-26T18:18:15.142816] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:18:15.143182] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-09-26T18:18:15.143232] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-09-26T18:18:15.144485] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-09-26T18:18:15.144551] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-09-26T18:18:15.165875] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-09-26T18:18:15.561751] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:18:15.956813] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2024-12. [2025-09-26T18:18:16.349101] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-26T18:18:16.756800] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-09-26T18:18:17.030382] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-26T18:18:17.315163] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-26T18:18:17.556795] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-09-26T18:18:18.147303] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-26T18:18:18.356804] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-09-26T18:18:18.943165] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-26T18:18:19.156758] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-09-26T18:18:19.339723] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-26T18:18:19.350125] [INFO ] [REMOTE ] DB: Full fetch complete (74332 records). [2025-09-26T18:18:19.350277] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-09-26T18:18:19.785873] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-09-26T18:18:19.786076] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-09-26T18:18:19.786960] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-09-26T18:18:19.787038] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-09-26T18:18:19.788732] [DEBUG] [LOCAL ] DB: Trimmed 74332 records to 53377 (keeping 200 days of data) [2025-09-26T18:18:19.965346] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-09-26T18:18:20.131171] [DEBUG] [LOCAL ] DB: Primary data saved (53377 records). [2025-09-26T18:18:20.131335] [INFO ] [MAIN ] DB: Full history saved. [2025-09-26T18:18:20.131528] [INFO ] [MAIN ] Update Progress: 593/2371 symbols completed. DB took 43.3s. Estimated remaining: 3h 54m 43s. Rate: 7.6 symbols/min [2025-09-26T18:18:20.318507] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:18:20.359774] [DEBUG] [LOCAL ] DCI: Loaded 37809 existing records from primary storage. [2025-09-26T18:18:20.359952] [INFO ] [MAIN ] DCI: Loaded 37809 existing records. [2025-09-26T18:18:20.553354] [WARN ] [MAIN ] DCI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:18:20.553757] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-09-26T18:18:20.553910] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-09-26T18:18:20.564373] [DEBUG] [LOCAL ] DCI: Deleted primary data file. [2025-09-26T18:18:20.582395] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-09-26T18:18:20.633361] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-26T18:18:20.762143] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-09-26T18:18:20.991038] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:18:21.311467] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-26T18:18:21.556723] [INFO ] [REMOTE ] DCI: Fetching primary data for 2024-12. [2025-09-26T18:18:22.235464] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-26T18:18:22.356746] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-09-26T18:18:22.872042] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-26T18:18:23.156743] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-09-26T18:18:23.516177] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-26T18:18:23.956743] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-09-26T18:18:24.664098] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-26T18:18:24.756746] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-09-26T18:18:25.556707] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-09-26T18:18:25.648343] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-26T18:18:26.356727] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-09-26T18:18:26.744670] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-26T18:18:26.808102] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-26T18:18:27.156742] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-09-26T18:18:27.926869] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-26T18:18:27.956682] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-09-26T18:18:28.247217] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-26T18:18:28.756752] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-09-26T18:18:29.556725] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-09-26T18:18:29.760009] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-26T18:18:30.151074] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-26T18:18:30.356778] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-09-26T18:18:30.457097] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-26T18:18:31.156725] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-09-26T18:18:31.956718] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-09-26T18:18:32.057733] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-26T18:18:32.095008] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-26T18:18:32.756743] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-09-26T18:18:33.547350] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-26T18:18:33.556677] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-09-26T18:18:33.861471] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-26T18:18:33.870636] [INFO ] [REMOTE ] DBI: Full fetch complete (66174 records). [2025-09-26T18:18:33.870833] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-09-26T18:18:34.298541] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-09-26T18:18:34.298725] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-09-26T18:18:34.305938] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-09-26T18:18:34.306360] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-09-26T18:18:34.306193] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-26T18:18:34.309430] [INFO ] [REMOTE ] DBL: Full fetch complete (12506 records). [2025-09-26T18:18:34.309780] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-09-26T18:18:34.357620] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-09-26T18:18:34.363509] [DEBUG] [LOCAL ] DBI: Trimmed 66174 records to 45524 (keeping 200 days of data) [2025-09-26T18:18:34.831785] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-09-26T18:18:34.832348] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-09-26T18:18:34.834051] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-09-26T18:18:34.835904] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-09-26T18:18:34.842993] [DEBUG] [LOCAL ] DBL: Trimmed 12506 records to 9259 (keeping 200 days of data) [2025-09-26T18:18:34.999321] [DEBUG] [LOCAL ] DBL: Primary data saved (9259 records). [2025-09-26T18:18:35.000324] [INFO ] [MAIN ] DBL: Full history saved. [2025-09-26T18:18:35.001084] [INFO ] [MAIN ] Update Progress: 594/2371 symbols completed. DBL took 30.8s. Estimated remaining: 3h 54m 56s. Rate: 7.6 symbols/min [2025-09-26T18:18:35.157333] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-09-26T18:18:35.213239] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:18:35.232758] [DEBUG] [LOCAL ] DCO: Loaded 13929 existing records from primary storage. [2025-09-26T18:18:35.234237] [INFO ] [MAIN ] DCO: Loaded 13929 existing records. [2025-09-26T18:18:35.451439] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:18:35.453561] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-09-26T18:18:35.453675] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-09-26T18:18:35.469518] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-09-26T18:18:35.473006] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-09-26T18:18:35.737589] [DEBUG] [LOCAL ] DBI: Primary data saved (45524 records). [2025-09-26T18:18:35.785982] [INFO ] [MAIN ] DBI: Full history saved. [2025-09-26T18:18:35.804788] [INFO ] [MAIN ] Update Progress: 595/2371 symbols completed. DBI took 36.4s. Estimated remaining: 3h 54m 27s. Rate: 7.6 symbols/min [2025-09-26T18:18:36.011588] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:18:36.021518] [INFO ] [REMOTE ] DCO: Fetching primary data for 2024-12. [2025-09-26T18:18:36.110680] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:18:36.144893] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-26T18:18:36.206351] [DEBUG] [LOCAL ] DD: Loaded 53213 existing records from primary storage. [2025-09-26T18:18:36.206526] [INFO ] [MAIN ] DD: Loaded 53213 existing records. [2025-09-26T18:18:36.404025] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:18:36.404514] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-09-26T18:18:36.404576] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-09-26T18:18:36.406034] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-09-26T18:18:36.406111] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-09-26T18:18:36.780935] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-09-26T18:18:36.795114] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:18:36.836977] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-26T18:18:36.864850] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-26T18:18:37.556791] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-09-26T18:18:38.276459] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-26T18:18:38.356754] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-09-26T18:18:39.156730] [INFO ] [REMOTE ] DD: Fetching primary data for 2024-12. [2025-09-26T18:18:39.453776] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-26T18:18:39.468493] [INFO ] [REMOTE ] DBRG: Full fetch complete (72246 records). [2025-09-26T18:18:39.468811] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-09-26T18:18:39.622270] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-26T18:18:39.978080] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-09-26T18:18:40.002853] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-09-26T18:18:40.002945] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-09-26T18:18:40.003777] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-09-26T18:18:40.003845] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-09-26T18:18:40.005502] [DEBUG] [LOCAL ] DBRG: Trimmed 72246 records to 50526 (keeping 200 days of data) [2025-09-26T18:18:40.320825] [DEBUG] [LOCAL ] DBRG: Primary data saved (50526 records). [2025-09-26T18:18:40.320977] [INFO ] [MAIN ] DBRG: Full history saved. [2025-09-26T18:18:40.321068] [INFO ] [MAIN ] Update Progress: 596/2371 symbols completed. DBRG took 25.6s. Estimated remaining: 3h 54m 9s. Rate: 7.6 symbols/min [2025-09-26T18:18:40.513024] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:18:40.513244] [DEBUG] [LOCAL ] DDD: No existing data file found in primary storage. [2025-09-26T18:18:40.513300] [WARN ] [MAIN ] DDD: No existing data found, performing full refresh instead. [2025-09-26T18:18:40.513450] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-09-26T18:18:40.513494] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-09-26T18:18:40.513546] [DEBUG] [LOCAL ] DDD: No primary data file found to delete. [2025-09-26T18:18:40.513581] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-09-26T18:18:40.706170] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-26T18:18:40.763445] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-09-26T18:18:40.951383] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:18:41.075444] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-26T18:18:41.556728] [INFO ] [REMOTE ] DDD: Fetching primary data for 2024-12. [2025-09-26T18:18:41.589794] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-26T18:18:42.356762] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-09-26T18:18:43.156700] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-09-26T18:18:43.191635] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-26T18:18:43.423083] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-26T18:18:43.956774] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-09-26T18:18:44.265459] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-26T18:18:44.478939] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-26T18:18:44.756738] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-09-26T18:18:45.556722] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-09-26T18:18:46.359683] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-09-26T18:18:46.363299] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-26T18:18:47.156695] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-09-26T18:18:47.332212] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-26T18:18:47.408962] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-26T18:18:47.956730] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-09-26T18:18:48.756721] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-09-26T18:18:48.852120] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-26T18:18:49.556730] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-09-26T18:18:49.695421] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-26T18:18:50.068689] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-26T18:18:50.249773] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-26T18:18:50.356769] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-09-26T18:18:51.156739] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-09-26T18:18:51.956804] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-09-26T18:18:52.120631] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-26T18:18:52.399444] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-26T18:18:52.756761] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-09-26T18:18:53.044746] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-26T18:18:53.556730] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-09-26T18:18:54.361934] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-09-26T18:18:54.383507] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-26T18:18:55.032965] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-26T18:18:55.156740] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-09-26T18:18:55.647621] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-26T18:18:55.656206] [INFO ] [REMOTE ] DCI: Full fetch complete (54165 records). [2025-09-26T18:18:55.656445] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-09-26T18:18:55.963088] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-09-26T18:18:56.123586] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-26T18:18:56.149896] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-09-26T18:18:56.150033] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-09-26T18:18:56.151043] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-09-26T18:18:56.151138] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-09-26T18:18:56.152539] [DEBUG] [LOCAL ] DCI: Trimmed 54165 records to 38065 (keeping 200 days of data) [2025-09-26T18:18:56.416921] [DEBUG] [LOCAL ] DCI: Primary data saved (38065 records). [2025-09-26T18:18:56.417175] [INFO ] [MAIN ] DCI: Full history saved. [2025-09-26T18:18:56.417354] [INFO ] [MAIN ] Update Progress: 597/2371 symbols completed. DCI took 36.3s. Estimated remaining: 3h 54m 25s. Rate: 7.6 symbols/min [2025-09-26T18:18:56.756785] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-09-26T18:18:57.530710] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-26T18:18:57.556755] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-09-26T18:18:58.356839] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-09-26T18:18:58.523275] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-26T18:18:59.156866] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-09-26T18:18:59.377380] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-26T18:18:59.413072] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-26T18:18:59.417027] [INFO ] [REMOTE ] DCO: Full fetch complete (19308 records). [2025-09-26T18:18:59.417182] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-09-26T18:18:59.814932] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-09-26T18:18:59.815032] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-09-26T18:18:59.815623] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-09-26T18:18:59.815739] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-09-26T18:18:59.816537] [DEBUG] [LOCAL ] DCO: Trimmed 19308 records to 14003 (keeping 200 days of data) [2025-09-26T18:18:59.918585] [DEBUG] [LOCAL ] DCO: Primary data saved (14003 records). [2025-09-26T18:18:59.918811] [INFO ] [MAIN ] DCO: Full history saved. [2025-09-26T18:18:59.918944] [INFO ] [MAIN ] Update Progress: 598/2371 symbols completed. DCO took 24.9s. Estimated remaining: 3h 54m 4s. Rate: 7.6 symbols/min [2025-09-26T18:18:59.956833] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-09-26T18:19:00.858539] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-26T18:19:00.870550] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-09-26T18:19:01.650522] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-26T18:19:01.663263] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-09-26T18:19:02.281921] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-26T18:19:02.356804] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-09-26T18:19:03.244598] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-26T18:19:03.256888] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-09-26T18:19:03.765610] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-26T18:19:03.956742] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-09-26T18:19:05.248920] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-26T18:19:05.260676] [INFO ] [REMOTE ] DD: Full fetch complete (76293 records). [2025-09-26T18:19:05.260946] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-09-26T18:19:05.696748] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-09-26T18:19:05.696990] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-09-26T18:19:05.698248] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-09-26T18:19:05.698344] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-09-26T18:19:05.733969] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-26T18:19:05.732677] [DEBUG] [LOCAL ] DD: Trimmed 76293 records to 53595 (keeping 200 days of data) [2025-09-26T18:19:05.746630] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-09-26T18:19:06.104494] [DEBUG] [LOCAL ] DD: Primary data saved (53595 records). [2025-09-26T18:19:06.104689] [INFO ] [MAIN ] DD: Full history saved. [2025-09-26T18:19:06.106448] [INFO ] [MAIN ] Update Progress: 599/2371 symbols completed. DD took 30.3s. Estimated remaining: 3h 53m 51s. Rate: 7.6 symbols/min [2025-09-26T18:19:07.655420] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-26T18:19:07.666262] [INFO ] [REMOTE ] DDD: Full fetch complete (73697 records). [2025-09-26T18:19:07.666460] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-09-26T18:19:08.102284] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-09-26T18:19:08.102440] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-09-26T18:19:08.103407] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-09-26T18:19:08.103476] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-09-26T18:19:08.105140] [DEBUG] [LOCAL ] DDD: Trimmed 73697 records to 51647 (keeping 200 days of data) [2025-09-26T18:19:08.409238] [DEBUG] [LOCAL ] DDD: Primary data saved (51647 records). [2025-09-26T18:19:08.409409] [INFO ] [MAIN ] DDD: Full history saved. [2025-09-26T18:19:08.409497] [INFO ] [MAIN ] Update Progress: 600/2371 symbols completed. DDD took 28.1s. Estimated remaining: 3h 53m 27s. Rate: 7.6 symbols/min [2025-09-26T18:19:09.131016] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:19:09.153831] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:19:09.231094] [DEBUG] [LOCAL ] DDS: No existing data file found in primary storage. [2025-09-26T18:19:09.235107] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:19:09.260151] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:19:09.260331] [WARN ] [MAIN ] DDS: No existing data found, performing full refresh instead. [2025-09-26T18:19:09.265937] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-09-26T18:19:09.266134] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-09-26T18:19:09.267105] [DEBUG] [LOCAL ] DDS: No primary data file found to delete. [2025-09-26T18:19:09.267334] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-09-26T18:19:09.358280] [DEBUG] [LOCAL ] DDT: Loaded 2107 existing records from primary storage. [2025-09-26T18:19:09.370330] [INFO ] [MAIN ] DDT: Loaded 2107 existing records. [2025-09-26T18:19:09.841740] [DEBUG] [LOCAL ] DE: Loaded 48062 existing records from primary storage. [2025-09-26T18:19:09.847199] [INFO ] [MAIN ] DE: Loaded 48062 existing records. [2025-09-26T18:19:09.821844] [DEBUG] [LOCAL ] DDL: Loaded 36655 existing records from primary storage. [2025-09-26T18:19:09.899558] [INFO ] [MAIN ] DDL: Loaded 36655 existing records. [2025-09-26T18:19:10.116353] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:19:10.219911] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-09-26T18:19:10.252493] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-09-26T18:19:10.252388] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:19:10.281021] [INFO ] [REMOTE ] DDS: Fetching primary data for 2024-12. [2025-09-26T18:19:10.309757] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-09-26T18:19:10.323218] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-09-26T18:19:10.608978] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:19:10.635496] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:19:10.672758] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-09-26T18:19:10.678199] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-09-26T18:19:10.687414] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-09-26T18:19:10.701823] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-09-26T18:19:10.718989] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-09-26T18:19:10.719181] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-09-26T18:19:10.718911] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-09-26T18:19:10.729711] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-09-26T18:19:11.654349] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:19:11.711248] [INFO ] [REMOTE ] DDT: Fetching primary data for 2024-12. [2025-09-26T18:19:11.939947] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-26T18:19:12.002418] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-09-26T18:19:12.064108] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:19:12.095147] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:19:12.095566] [INFO ] [REMOTE ] DDL: Fetching primary data for 2024-12. [2025-09-26T18:19:12.096582] [INFO ] [REMOTE ] DE: Fetching primary data for 2024-12. [2025-09-26T18:19:12.504112] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-26T18:19:12.505692] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-09-26T18:19:12.833287] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-26T18:19:12.836699] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-09-26T18:19:12.996339] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-26T18:19:12.997893] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-09-26T18:19:13.319227] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-26T18:19:13.320841] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-09-26T18:19:13.619034] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-26T18:19:13.629432] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-09-26T18:19:13.698135] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-26T18:19:13.709199] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-09-26T18:19:13.719745] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-26T18:19:13.773674] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-26T18:19:14.356765] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-09-26T18:19:14.976717] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-26T18:19:15.156762] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-09-26T18:19:15.426767] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-26T18:19:15.469053] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-26T18:19:15.956756] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-09-26T18:19:16.159104] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-26T18:19:16.316571] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-26T18:19:16.756771] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-09-26T18:19:17.556721] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-09-26T18:19:17.891482] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-26T18:19:18.356731] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-09-26T18:19:19.118335] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-26T18:19:19.156687] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-09-26T18:19:19.425015] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-26T18:19:19.956741] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-09-26T18:19:20.669906] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-26T18:19:20.756711] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-09-26T18:19:20.875000] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-26T18:19:21.556838] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-09-26T18:19:22.013703] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-26T18:19:22.359158] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-09-26T18:19:22.362678] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-26T18:19:22.936616] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-26T18:19:23.156730] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-09-26T18:19:23.956751] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-09-26T18:19:24.485937] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-26T18:19:24.756733] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-09-26T18:19:25.556732] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-09-26T18:19:25.894350] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-26T18:19:25.929636] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-26T18:19:25.948366] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-26T18:19:26.356740] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-09-26T18:19:27.156733] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-09-26T18:19:27.663992] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-26T18:19:27.702297] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-26T18:19:27.956719] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-09-26T18:19:28.756724] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-09-26T18:19:29.556747] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-09-26T18:19:29.666663] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-26T18:19:29.676016] [INFO ] [REMOTE ] DDL: Full fetch complete (53388 records). [2025-09-26T18:19:29.676500] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-09-26T18:19:29.721836] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-26T18:19:30.096547] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-09-26T18:19:30.096692] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-09-26T18:19:30.097456] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-09-26T18:19:30.097523] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-09-26T18:19:30.101338] [DEBUG] [LOCAL ] DDL: Trimmed 53388 records to 37016 (keeping 200 days of data) [2025-09-26T18:19:30.311204] [DEBUG] [LOCAL ] DDL: Primary data saved (37016 records). [2025-09-26T18:19:30.311360] [INFO ] [MAIN ] DDL: Full history saved. [2025-09-26T18:19:30.311483] [INFO ] [MAIN ] Update Progress: 601/2371 symbols completed. DDL took 21.9s. Estimated remaining: 3h 53m 60s. Rate: 7.6 symbols/min [2025-09-26T18:19:30.361804] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-09-26T18:19:30.497988] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:19:30.546634] [DEBUG] [LOCAL ] DEA: Loaded 41610 existing records from primary storage. [2025-09-26T18:19:30.546812] [INFO ] [MAIN ] DEA: Loaded 41610 existing records. [2025-09-26T18:19:30.742890] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:19:30.743229] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-09-26T18:19:30.743297] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-09-26T18:19:30.744523] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-09-26T18:19:30.744588] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-09-26T18:19:31.140141] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-26T18:19:31.139977] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:19:31.141632] [INFO ] [REMOTE ] DDT: Full fetch complete (2901 records). [2025-09-26T18:19:31.141735] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-09-26T18:19:31.163515] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-09-26T18:19:31.522823] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-09-26T18:19:31.522903] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-09-26T18:19:31.523015] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-09-26T18:19:31.523080] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-09-26T18:19:31.523451] [DEBUG] [LOCAL ] DDT: Trimmed 2901 records to 2117 (keeping 200 days of data) [2025-09-26T18:19:31.538047] [DEBUG] [LOCAL ] DDT: Primary data saved (2117 records). [2025-09-26T18:19:31.538119] [INFO ] [MAIN ] DDT: Full history saved. [2025-09-26T18:19:31.538225] [INFO ] [MAIN ] Update Progress: 602/2371 symbols completed. DDT took 23.1s. Estimated remaining: 3h 53m 32s. Rate: 7.6 symbols/min [2025-09-26T18:19:31.720137] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:19:31.772810] [DEBUG] [LOCAL ] DEC: Loaded 30878 existing records from primary storage. [2025-09-26T18:19:31.773063] [INFO ] [MAIN ] DEC: Loaded 30878 existing records. [2025-09-26T18:19:31.987609] [INFO ] [REMOTE ] DEA: Fetching primary data for 2024-12. [2025-09-26T18:19:31.997031] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:19:31.998498] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-09-26T18:19:31.998577] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-09-26T18:19:32.000007] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-09-26T18:19:32.002281] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-09-26T18:19:32.002080] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-09-26T18:19:32.328907] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-26T18:19:32.407464] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:19:32.756726] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-09-26T18:19:33.312626] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-26T18:19:33.464410] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-26T18:19:33.467364] [INFO ] [REMOTE ] DDS: Full fetch complete (19231 records). [2025-09-26T18:19:33.467477] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-09-26T18:19:33.561932] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-09-26T18:19:33.888563] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-09-26T18:19:33.888677] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-09-26T18:19:33.889082] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-09-26T18:19:33.889125] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-09-26T18:19:33.889882] [DEBUG] [LOCAL ] DDS: Trimmed 19231 records to 13374 (keeping 200 days of data) [2025-09-26T18:19:33.987215] [DEBUG] [LOCAL ] DDS: Primary data saved (13374 records). [2025-09-26T18:19:33.987411] [INFO ] [MAIN ] DDS: Full history saved. [2025-09-26T18:19:33.987529] [INFO ] [MAIN ] Update Progress: 603/2371 symbols completed. DDS took 25.6s. Estimated remaining: 3h 53m 8s. Rate: 7.6 symbols/min [2025-09-26T18:19:34.173862] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:19:34.243795] [DEBUG] [LOCAL ] DECK: Loaded 53690 existing records from primary storage. [2025-09-26T18:19:34.243946] [INFO ] [MAIN ] DECK: Loaded 53690 existing records. [2025-09-26T18:19:34.361901] [INFO ] [REMOTE ] DEC: Fetching primary data for 2024-12. [2025-09-26T18:19:34.440523] [WARN ] [MAIN ] DECK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:19:34.440832] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-09-26T18:19:34.440887] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-09-26T18:19:34.442296] [DEBUG] [LOCAL ] DECK: Deleted primary data file. [2025-09-26T18:19:34.442360] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-09-26T18:19:34.893755] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:19:35.056667] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-26T18:19:35.156784] [INFO ] [REMOTE ] DECK: Fetching primary data for 2024-12. [2025-09-26T18:19:35.350788] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-26T18:19:35.956740] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-09-26T18:19:36.739786] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-26T18:19:36.760452] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-09-26T18:19:36.768154] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-26T18:19:37.556724] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-09-26T18:19:38.248152] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-26T18:19:38.356728] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-09-26T18:19:38.933273] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-26T18:19:39.156738] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-09-26T18:19:39.956744] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-09-26T18:19:39.998779] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-26T18:19:40.756793] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-09-26T18:19:40.792048] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-26T18:19:41.556715] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-09-26T18:19:41.777364] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-26T18:19:42.140349] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-26T18:19:42.356776] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-09-26T18:19:42.515628] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-26T18:19:43.156747] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-09-26T18:19:43.956718] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-09-26T18:19:44.021066] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-26T18:19:44.756741] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-09-26T18:19:45.206684] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-26T18:19:45.261567] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-26T18:19:45.556747] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-09-26T18:19:45.791608] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-26T18:19:46.356777] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-09-26T18:19:47.156755] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-09-26T18:19:47.587729] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-26T18:19:47.785033] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-26T18:19:47.956775] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-09-26T18:19:48.530732] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-26T18:19:48.756738] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-09-26T18:19:48.810894] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-26T18:19:49.556722] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-09-26T18:19:50.253983] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-26T18:19:50.356775] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-09-26T18:19:51.156718] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-09-26T18:19:51.413447] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-26T18:19:51.956692] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-09-26T18:19:51.997859] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-26T18:19:52.032563] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-26T18:19:52.756750] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-09-26T18:19:53.556725] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-09-26T18:19:53.990547] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-26T18:19:54.034367] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-26T18:19:54.040689] [INFO ] [REMOTE ] DEC: Full fetch complete (42936 records). [2025-09-26T18:19:54.041001] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-09-26T18:19:54.361830] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-09-26T18:19:54.486704] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-09-26T18:19:54.486805] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-09-26T18:19:54.487405] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-09-26T18:19:54.487472] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-09-26T18:19:54.488684] [DEBUG] [LOCAL ] DEC: Trimmed 42936 records to 31121 (keeping 200 days of data) [2025-09-26T18:19:54.681183] [DEBUG] [LOCAL ] DEC: Primary data saved (31121 records). [2025-09-26T18:19:54.681348] [INFO ] [MAIN ] DEC: Full history saved. [2025-09-26T18:19:54.681756] [INFO ] [MAIN ] Update Progress: 604/2371 symbols completed. DEC took 23.1s. Estimated remaining: 3h 53m 38s. Rate: 7.6 symbols/min [2025-09-26T18:19:54.895389] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:19:54.891111] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-26T18:19:54.895611] [DEBUG] [LOCAL ] DEI: No existing data file found in primary storage. [2025-09-26T18:19:54.903858] [WARN ] [MAIN ] DEI: No existing data found, performing full refresh instead. [2025-09-26T18:19:54.904088] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-09-26T18:19:54.904562] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-09-26T18:19:54.904632] [DEBUG] [LOCAL ] DEI: No primary data file found to delete. [2025-09-26T18:19:54.904713] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-09-26T18:19:55.161822] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-09-26T18:19:55.313927] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:19:55.956778] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-09-26T18:19:56.099993] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-26T18:19:56.351023] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-26T18:19:56.359406] [INFO ] [REMOTE ] DEA: Full fetch complete (62786 records). [2025-09-26T18:19:56.359560] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-09-26T18:19:56.760025] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-12. [2025-09-26T18:19:56.777549] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-09-26T18:19:56.777673] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-09-26T18:19:56.778460] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-09-26T18:19:56.778675] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-09-26T18:19:56.780323] [DEBUG] [LOCAL ] DEA: Trimmed 62786 records to 41860 (keeping 200 days of data) [2025-09-26T18:19:57.051067] [DEBUG] [LOCAL ] DEA: Primary data saved (41860 records). [2025-09-26T18:19:57.051229] [INFO ] [MAIN ] DEA: Full history saved. [2025-09-26T18:19:57.051328] [INFO ] [MAIN ] Update Progress: 605/2371 symbols completed. DEA took 26.7s. Estimated remaining: 3h 53m 14s. Rate: 7.6 symbols/min [2025-09-26T18:19:57.241357] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:19:57.241589] [DEBUG] [LOCAL ] DELL: No existing data file found in primary storage. [2025-09-26T18:19:57.241639] [WARN ] [MAIN ] DELL: No existing data found, performing full refresh instead. [2025-09-26T18:19:57.241834] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-09-26T18:19:57.241887] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-09-26T18:19:57.241933] [DEBUG] [LOCAL ] DELL: No primary data file found to delete. [2025-09-26T18:19:57.241966] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-09-26T18:19:57.562955] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-09-26T18:19:57.630862] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:19:57.665589] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-26T18:19:58.155500] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T18:19:58.356781] [INFO ] [REMOTE ] DELL: Fetching primary data for 2024-12. [2025-09-26T18:19:59.156779] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-09-26T18:19:59.523234] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-26T18:19:59.956742] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-09-26T18:20:00.632278] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-26T18:20:00.707685] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-09-26T18:20:00.756755] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-09-26T18:20:01.525562] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-26T18:20:01.535945] [INFO ] [REMOTE ] DE: Full fetch complete (69580 records). [2025-09-26T18:20:01.536114] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-09-26T18:20:01.565761] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-09-26T18:20:02.059151] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-09-26T18:20:02.059281] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-09-26T18:20:02.060084] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-09-26T18:20:02.060151] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-09-26T18:20:02.063567] [DEBUG] [LOCAL ] DE: Trimmed 69580 records to 48397 (keeping 200 days of data) [2025-09-26T18:20:02.359291] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-09-26T18:20:02.416210] [DEBUG] [LOCAL ] DE: Primary data saved (48397 records). [2025-09-26T18:20:02.416375] [INFO ] [MAIN ] DE: Full history saved. [2025-09-26T18:20:02.416472] [INFO ] [MAIN ] Update Progress: 606/2371 symbols completed. DE took 54.0s. Estimated remaining: 3h 52m 58s. Rate: 7.6 symbols/min [2025-09-26T18:20:02.610049] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:20:02.661337] [DEBUG] [LOCAL ] DEO: Loaded 49405 existing records from primary storage. [2025-09-26T18:20:02.661567] [INFO ] [MAIN ] DEO: Loaded 49405 existing records. [2025-09-26T18:20:02.879837] [WARN ] [MAIN ] DEO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:20:02.880452] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-09-26T18:20:02.880573] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-09-26T18:20:02.890715] [DEBUG] [LOCAL ] DEO: Deleted primary data file. [2025-09-26T18:20:02.909110] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-09-26T18:20:02.916398] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-26T18:20:03.167811] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-09-26T18:20:03.396079] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:20:03.426315] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.67 seconds). [2025-09-26T18:20:03.956809] [INFO ] [REMOTE ] DEO: Fetching primary data for 2024-12. [2025-09-26T18:20:04.010406] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-26T18:20:04.712318] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T18:20:04.756792] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-09-26T18:20:05.556742] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-09-26T18:20:06.065958] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-26T18:20:06.356764] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-09-26T18:20:06.990913] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-26T18:20:07.156704] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-09-26T18:20:07.412060] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-26T18:20:07.902755] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-26T18:20:07.956730] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-09-26T18:20:08.756773] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-09-26T18:20:09.140400] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-26T18:20:09.301448] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-26T18:20:09.556744] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-09-26T18:20:10.356758] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-09-26T18:20:11.056176] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-26T18:20:11.156726] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-09-26T18:20:11.491985] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-26T18:20:11.949409] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-26T18:20:11.962999] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-09-26T18:20:12.756743] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-09-26T18:20:13.197210] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-26T18:20:13.420768] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-26T18:20:13.556725] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-09-26T18:20:13.915927] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-26T18:20:14.356766] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-09-26T18:20:15.156736] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-09-26T18:20:15.915421] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-26T18:20:15.956748] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-09-26T18:20:16.616496] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-26T18:20:16.756801] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-09-26T18:20:17.086357] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-26T18:20:17.556776] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-09-26T18:20:17.871393] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-26T18:20:18.356728] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-09-26T18:20:18.744189] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-26T18:20:19.156776] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-09-26T18:20:19.956772] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-09-26T18:20:20.136624] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-26T18:20:20.355634] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-26T18:20:20.364858] [INFO ] [REMOTE ] DEI: Full fetch complete (69289 records). [2025-09-26T18:20:20.365027] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-09-26T18:20:20.366100] [FATAL] [VALIDATOR ] DEI: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:20:20.366200] [FATAL] [MAIN ] DEI: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:20:20.366248] [WARN ] [MAIN ] DEI: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:20:20.366300] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-09-26T18:20:20.366364] [DEBUG] [LOCAL ] DEI: No primary data file found to delete. [2025-09-26T18:20:20.366408] [INFO ] [LOCAL ] DEI: Starting deletion of derivative data. [2025-09-26T18:20:20.366477] [DEBUG] [LOCAL ] DEI: No derivative data file found to delete. [2025-09-26T18:20:20.366566] [INFO ] [MAIN ] Update Progress: 607/2371 symbols completed. DEI took 25.7s. Estimated remaining: 3h 53m 20s. Rate: 7.6 symbols/min [2025-09-26T18:20:20.572985] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:20:20.610411] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (3.85 seconds). [2025-09-26T18:20:20.645930] [DEBUG] [LOCAL ] DFH: Loaded 32932 existing records from primary storage. [2025-09-26T18:20:20.646108] [INFO ] [MAIN ] DFH: Loaded 32932 existing records. [2025-09-26T18:20:20.761854] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-09-26T18:20:20.859493] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:20:20.859773] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-09-26T18:20:20.859829] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-09-26T18:20:20.860576] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-09-26T18:20:20.860637] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-09-26T18:20:21.264088] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:20:21.556752] [INFO ] [REMOTE ] DFH: Fetching primary data for 2024-12. [2025-09-26T18:20:21.641794] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-26T18:20:22.356807] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-09-26T18:20:22.868321] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-26T18:20:22.988741] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-26T18:20:23.156763] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-09-26T18:20:23.956726] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-09-26T18:20:24.001373] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-26T18:20:24.756813] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-09-26T18:20:25.459066] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-09-26T18:20:25.470324] [INFO ] [REMOTE ] DELL: Full fetch complete (77820 records). [2025-09-26T18:20:25.470588] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-09-26T18:20:25.560737] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-09-26T18:20:25.862970] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-26T18:20:25.928543] [INFO ] [REMOTE ] DECK: Full fetch complete (76626 records). [2025-09-26T18:20:25.944627] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-09-26T18:20:25.990344] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present. [2025-09-26T18:20:25.990600] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed. [2025-09-26T18:20:26.014872] [INFO ] [MAIN ] DELL: Fetched primary data is valid. [2025-09-26T18:20:26.046255] [DEBUG] [LOCAL ] DELL: Saving primary data. [2025-09-26T18:20:26.116999] [DEBUG] [LOCAL ] DELL: Trimmed 77820 records to 54515 (keeping 200 days of data) [2025-09-26T18:20:26.266114] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-26T18:20:26.402600] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-09-26T18:20:26.607216] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-09-26T18:20:26.607633] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-09-26T18:20:26.609659] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-09-26T18:20:26.610028] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-09-26T18:20:26.619787] [DEBUG] [LOCAL ] DECK: Trimmed 76626 records to 54078 (keeping 200 days of data) [2025-09-26T18:20:27.193177] [DEBUG] [LOCAL ] DECK: Primary data saved (54078 records). [2025-09-26T18:20:27.193991] [INFO ] [MAIN ] DECK: Full history saved. [2025-09-26T18:20:27.194200] [INFO ] [MAIN ] Update Progress: 608/2371 symbols completed. DECK took 53.2s. Estimated remaining: 3h 53m 8s. Rate: 7.6 symbols/min [2025-09-26T18:20:27.395023] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:20:27.412529] [DEBUG] [LOCAL ] DELL: Primary data saved (54515 records). [2025-09-26T18:20:27.412875] [INFO ] [MAIN ] DELL: Full history saved. [2025-09-26T18:20:27.413154] [INFO ] [MAIN ] Update Progress: 609/2371 symbols completed. DELL took 30.4s. Estimated remaining: 3h 52m 38s. Rate: 7.6 symbols/min [2025-09-26T18:20:27.468600] [DEBUG] [LOCAL ] DFIN: Loaded 23491 existing records from primary storage. [2025-09-26T18:20:27.468948] [INFO ] [MAIN ] DFIN: Loaded 23491 existing records. [2025-09-26T18:20:27.838721] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:20:27.880273] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:20:27.926936] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-09-26T18:20:27.927468] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-09-26T18:20:27.931248] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-26T18:20:27.931694] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-09-26T18:20:27.931924] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-09-26T18:20:27.992829] [DEBUG] [LOCAL ] DFP: Loaded 11734 existing records from primary storage. [2025-09-26T18:20:28.019544] [INFO ] [MAIN ] DFP: Loaded 11734 existing records. [2025-09-26T18:20:28.019361] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-09-26T18:20:28.392687] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-26T18:20:28.452822] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-09-26T18:20:28.553297] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:20:28.579905] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-09-26T18:20:28.611920] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-09-26T18:20:28.617067] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-09-26T18:20:28.639484] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:20:28.639707] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-09-26T18:20:28.761905] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-12. [2025-09-26T18:20:29.037400] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:20:29.556727] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-12. [2025-09-26T18:20:29.930342] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-26T18:20:30.037102] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-26T18:20:30.047900] [INFO ] [REMOTE ] DEO: Full fetch complete (71519 records). [2025-09-26T18:20:30.048091] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-09-26T18:20:30.223947] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-26T18:20:30.251909] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-26T18:20:30.361847] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-09-26T18:20:30.543416] [DEBUG] [VALIDATOR ] DEO: All expected trading days are present. [2025-09-26T18:20:30.543586] [DEBUG] [VALIDATOR ] DEO: Primary data validation passed. [2025-09-26T18:20:30.544493] [INFO ] [MAIN ] DEO: Fetched primary data is valid. [2025-09-26T18:20:30.544561] [DEBUG] [LOCAL ] DEO: Saving primary data. [2025-09-26T18:20:30.546116] [DEBUG] [LOCAL ] DEO: Trimmed 71519 records to 49777 (keeping 200 days of data) [2025-09-26T18:20:30.861298] [DEBUG] [LOCAL ] DEO: Primary data saved (49777 records). [2025-09-26T18:20:30.861469] [INFO ] [MAIN ] DEO: Full history saved. [2025-09-26T18:20:30.861612] [INFO ] [MAIN ] Update Progress: 610/2371 symbols completed. DEO took 28.4s. Estimated remaining: 3h 52m 17s. Rate: 7.6 symbols/min [2025-09-26T18:20:31.044989] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:20:31.103589] [DEBUG] [LOCAL ] DG: Loaded 53678 existing records from primary storage. [2025-09-26T18:20:31.103848] [INFO ] [MAIN ] DG: Loaded 53678 existing records. [2025-09-26T18:20:31.157098] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-09-26T18:20:31.244128] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-26T18:20:31.316535] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:20:31.316919] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-09-26T18:20:31.316979] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-09-26T18:20:31.318921] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-09-26T18:20:31.318984] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-09-26T18:20:31.686171] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:20:31.956794] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-09-26T18:20:32.703381] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-26T18:20:32.750631] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-26T18:20:32.756675] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-09-26T18:20:33.556730] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-09-26T18:20:33.841090] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-26T18:20:34.021163] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-26T18:20:34.356773] [INFO ] [REMOTE ] DG: Fetching primary data for 2024-12. [2025-09-26T18:20:35.156809] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-09-26T18:20:35.918931] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-26T18:20:35.956729] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-09-26T18:20:36.166174] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-26T18:20:36.545992] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-26T18:20:36.756773] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-09-26T18:20:37.556742] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-09-26T18:20:37.906800] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-26T18:20:38.356739] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-09-26T18:20:39.163779] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-09-26T18:20:39.187281] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-26T18:20:39.256555] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-26T18:20:39.956727] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-09-26T18:20:40.078285] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-26T18:20:40.756763] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-09-26T18:20:41.556706] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-09-26T18:20:41.654003] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-26T18:20:42.150603] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-26T18:20:42.356761] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-09-26T18:20:42.435299] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-26T18:20:43.156691] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-09-26T18:20:43.168714] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-26T18:20:43.956767] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-09-26T18:20:44.600621] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-26T18:20:44.740825] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-26T18:20:44.756714] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-09-26T18:20:45.556743] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-09-26T18:20:45.750827] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-26T18:20:45.754456] [INFO ] [REMOTE ] DFP: Full fetch complete (16110 records). [2025-09-26T18:20:45.754559] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-09-26T18:20:45.755087] [FATAL] [VALIDATOR ] DFP: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:20:45.755177] [FATAL] [MAIN ] DFP: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:20:45.755293] [WARN ] [MAIN ] DFP: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:20:45.755380] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-09-26T18:20:45.755487] [DEBUG] [LOCAL ] DFP: No primary data file found to delete. [2025-09-26T18:20:45.755562] [INFO ] [LOCAL ] DFP: Starting deletion of derivative data. [2025-09-26T18:20:45.756275] [DEBUG] [LOCAL ] DFP: Deleted derivative data file. [2025-09-26T18:20:45.756405] [INFO ] [MAIN ] Update Progress: 611/2371 symbols completed. DFP took 18.3s. Estimated remaining: 3h 52m 29s. Rate: 7.6 symbols/min [2025-09-26T18:20:45.940761] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:20:45.993037] [DEBUG] [LOCAL ] DGX: Loaded 45481 existing records from primary storage. [2025-09-26T18:20:45.993190] [INFO ] [MAIN ] DGX: Loaded 45481 existing records. [2025-09-26T18:20:46.185795] [WARN ] [MAIN ] DGX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:20:46.186078] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-09-26T18:20:46.186127] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-09-26T18:20:46.187015] [DEBUG] [LOCAL ] DGX: Deleted primary data file. [2025-09-26T18:20:46.187085] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-09-26T18:20:46.360389] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-09-26T18:20:46.573242] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:20:47.156773] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-09-26T18:20:47.590509] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-26T18:20:47.812689] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-26T18:20:47.956757] [INFO ] [REMOTE ] DGX: Fetching primary data for 2024-12. [2025-09-26T18:20:48.348271] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-26T18:20:48.354815] [INFO ] [REMOTE ] DFH: Full fetch complete (48992 records). [2025-09-26T18:20:48.354992] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-09-26T18:20:48.751162] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-09-26T18:20:48.751260] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-09-26T18:20:48.751981] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-09-26T18:20:48.752062] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-09-26T18:20:48.753362] [DEBUG] [LOCAL ] DFH: Trimmed 48992 records to 33106 (keeping 200 days of data) [2025-09-26T18:20:48.801749] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-09-26T18:20:48.958181] [DEBUG] [LOCAL ] DFH: Primary data saved (33106 records). [2025-09-26T18:20:48.958353] [INFO ] [MAIN ] DFH: Full history saved. [2025-09-26T18:20:48.958465] [INFO ] [MAIN ] Update Progress: 612/2371 symbols completed. DFH took 28.6s. Estimated remaining: 3h 52m 8s. Rate: 7.6 symbols/min [2025-09-26T18:20:49.152006] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:20:49.181071] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-26T18:20:49.206799] [DEBUG] [LOCAL ] DHF: Loaded 20665 existing records from primary storage. [2025-09-26T18:20:49.206952] [INFO ] [MAIN ] DHF: Loaded 20665 existing records. [2025-09-26T18:20:49.402059] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:20:49.402332] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-09-26T18:20:49.402386] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-09-26T18:20:49.402759] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-09-26T18:20:49.402821] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-09-26T18:20:49.566044] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-09-26T18:20:49.814210] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:20:50.356698] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-12. [2025-09-26T18:20:50.610580] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-26T18:20:50.811123] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-26T18:20:51.156725] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-09-26T18:20:51.537255] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-26T18:20:51.956726] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-09-26T18:20:52.756754] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-09-26T18:20:52.981179] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-26T18:20:53.229331] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-26T18:20:53.556731] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-09-26T18:20:54.217004] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-26T18:20:54.356757] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-09-26T18:20:55.163188] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-09-26T18:20:55.185745] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-26T18:20:55.231369] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-26T18:20:55.956746] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-09-26T18:20:56.726953] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-26T18:20:56.756688] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-09-26T18:20:57.072138] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-26T18:20:57.556723] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-09-26T18:20:58.356703] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-09-26T18:20:58.476598] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-26T18:20:59.131673] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-26T18:20:59.157191] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-09-26T18:20:59.159961] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-26T18:20:59.956737] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-09-26T18:21:00.054397] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-26T18:21:00.756801] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-09-26T18:21:01.556728] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-09-26T18:21:01.681604] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T18:21:02.356751] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-09-26T18:21:02.395667] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-26T18:21:02.435957] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-26T18:21:03.156751] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-09-26T18:21:03.964132] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-09-26T18:21:03.984238] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-26T18:21:04.756785] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-09-26T18:21:05.065015] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-26T18:21:05.244944] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-26T18:21:05.256587] [INFO ] [REMOTE ] DG: Full fetch complete (77216 records). [2025-09-26T18:21:05.256840] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-09-26T18:21:05.560938] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-09-26T18:21:05.690631] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-26T18:21:05.804307] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-09-26T18:21:05.804409] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-09-26T18:21:05.805440] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-09-26T18:21:05.805541] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-09-26T18:21:05.807391] [DEBUG] [LOCAL ] DG: Trimmed 77216 records to 54068 (keeping 200 days of data) [2025-09-26T18:21:06.165790] [DEBUG] [LOCAL ] DG: Primary data saved (54068 records). [2025-09-26T18:21:06.165949] [INFO ] [MAIN ] DG: Full history saved. [2025-09-26T18:21:06.166042] [INFO ] [MAIN ] Update Progress: 613/2371 symbols completed. DG took 35.3s. Estimated remaining: 3h 52m 27s. Rate: 7.6 symbols/min [2025-09-26T18:21:06.356975] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:21:06.357062] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-09-26T18:21:06.357364] [DEBUG] [LOCAL ] DHI: No existing data file found in primary storage. [2025-09-26T18:21:06.357461] [WARN ] [MAIN ] DHI: No existing data found, performing full refresh instead. [2025-09-26T18:21:06.358597] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-09-26T18:21:06.358680] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-09-26T18:21:06.358807] [DEBUG] [LOCAL ] DHI: No primary data file found to delete. [2025-09-26T18:21:06.358863] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-09-26T18:21:06.821445] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:21:07.156716] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-12. [2025-09-26T18:21:07.247695] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-26T18:21:07.583074] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-26T18:21:07.956784] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-09-26T18:21:08.677420] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-26T18:21:08.756769] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-09-26T18:21:08.839320] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-26T18:21:09.561822] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-09-26T18:21:09.570166] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-26T18:21:10.356734] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-09-26T18:21:10.784127] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-26T18:21:11.156768] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-09-26T18:21:11.879966] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-26T18:21:11.956757] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-09-26T18:21:12.562085] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-26T18:21:12.756724] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-09-26T18:21:13.556704] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-09-26T18:21:13.821958] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-26T18:21:14.361946] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-09-26T18:21:14.377698] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-26T18:21:14.443811] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-26T18:21:14.448151] [INFO ] [REMOTE ] DHF: Full fetch complete (29349 records). [2025-09-26T18:21:14.448270] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-09-26T18:21:14.448959] [FATAL] [VALIDATOR ] DHF: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:21:14.449050] [FATAL] [MAIN ] DHF: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:21:14.449095] [WARN ] [MAIN ] DHF: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:21:14.449136] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-09-26T18:21:14.449196] [DEBUG] [LOCAL ] DHF: No primary data file found to delete. [2025-09-26T18:21:14.449248] [INFO ] [LOCAL ] DHF: Starting deletion of derivative data. [2025-09-26T18:21:14.449846] [DEBUG] [LOCAL ] DHF: Deleted derivative data file. [2025-09-26T18:21:14.449965] [INFO ] [MAIN ] Update Progress: 614/2371 symbols completed. DHF took 25.5s. Estimated remaining: 3h 52m 20s. Rate: 7.6 symbols/min [2025-09-26T18:21:14.662326] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:21:14.662554] [DEBUG] [LOCAL ] DHR: No existing data file found in primary storage. [2025-09-26T18:21:14.662593] [WARN ] [MAIN ] DHR: No existing data found, performing full refresh instead. [2025-09-26T18:21:14.662816] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-09-26T18:21:14.662869] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-09-26T18:21:14.662913] [DEBUG] [LOCAL ] DHR: No primary data file found to delete. [2025-09-26T18:21:14.662946] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-09-26T18:21:15.128200] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:21:15.156699] [INFO ] [REMOTE ] DHR: Fetching primary data for 2024-12. [2025-09-26T18:21:15.956750] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-09-26T18:21:16.107724] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-26T18:21:16.756715] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-09-26T18:21:16.821061] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-26T18:21:16.828437] [INFO ] [REMOTE ] DFIN: Full fetch complete (33465 records). [2025-09-26T18:21:16.828735] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-09-26T18:21:16.829535] [FATAL] [VALIDATOR ] DFIN: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:21:16.829685] [FATAL] [MAIN ] DFIN: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:21:16.829766] [WARN ] [MAIN ] DFIN: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:21:16.829850] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-09-26T18:21:16.829966] [DEBUG] [LOCAL ] DFIN: No primary data file found to delete. [2025-09-26T18:21:16.830025] [INFO ] [LOCAL ] DFIN: Starting deletion of derivative data. [2025-09-26T18:21:16.830413] [DEBUG] [LOCAL ] DFIN: Deleted derivative data file. [2025-09-26T18:21:16.830555] [INFO ] [MAIN ] Update Progress: 615/2371 symbols completed. DFIN took 49.6s. Estimated remaining: 3h 51m 56s. Rate: 7.6 symbols/min [2025-09-26T18:21:17.101151] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:21:17.101479] [DEBUG] [LOCAL ] DHT: No existing data file found in primary storage. [2025-09-26T18:21:17.101582] [WARN ] [MAIN ] DHT: No existing data found, performing full refresh instead. [2025-09-26T18:21:17.102087] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-09-26T18:21:17.102289] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-09-26T18:21:17.102396] [DEBUG] [LOCAL ] DHT: No primary data file found to delete. [2025-09-26T18:21:17.102583] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-09-26T18:21:17.567333] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-09-26T18:21:17.570774] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-09-26T18:21:17.770114] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:21:18.351427] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-26T18:21:18.362233] [INFO ] [REMOTE ] DHT: Fetching primary data for 2024-12. [2025-09-26T18:21:19.156726] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-09-26T18:21:19.421217] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-26T18:21:19.430525] [INFO ] [REMOTE ] DGX: Full fetch complete (65133 records). [2025-09-26T18:21:19.430755] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-09-26T18:21:19.885811] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present. [2025-09-26T18:21:19.886142] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed. [2025-09-26T18:21:19.887018] [INFO ] [MAIN ] DGX: Fetched primary data is valid. [2025-09-26T18:21:19.887107] [DEBUG] [LOCAL ] DGX: Saving primary data. [2025-09-26T18:21:19.918507] [DEBUG] [LOCAL ] DGX: Trimmed 65133 records to 45736 (keeping 200 days of data) [2025-09-26T18:21:19.920583] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-26T18:21:19.998484] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-09-26T18:21:20.236400] [DEBUG] [LOCAL ] DGX: Primary data saved (45736 records). [2025-09-26T18:21:20.236549] [INFO ] [MAIN ] DGX: Full history saved. [2025-09-26T18:21:20.236661] [INFO ] [MAIN ] Update Progress: 616/2371 symbols completed. DGX took 34.5s. Estimated remaining: 3h 51m 35s. Rate: 7.6 symbols/min [2025-09-26T18:21:20.452115] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:21:20.471062] [DEBUG] [LOCAL ] DHX: Loaded 13311 existing records from primary storage. [2025-09-26T18:21:20.471228] [INFO ] [MAIN ] DHX: Loaded 13311 existing records. [2025-09-26T18:21:20.682625] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:21:20.682957] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-09-26T18:21:20.683009] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-09-26T18:21:20.683513] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-09-26T18:21:20.683575] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-09-26T18:21:20.757282] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-09-26T18:21:21.103733] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:21:21.134752] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-26T18:21:21.468263] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T18:21:21.556736] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-09-26T18:21:22.170578] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-26T18:21:22.356755] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-09-26T18:21:22.942128] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-26T18:21:23.156723] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-09-26T18:21:23.835546] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-26T18:21:23.956721] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-09-26T18:21:24.758927] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-09-26T18:21:24.762829] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-26T18:21:25.353085] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-26T18:21:25.556753] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-09-26T18:21:26.356725] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-09-26T18:21:26.492227] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-26T18:21:27.156724] [INFO ] [REMOTE ] DHX: Fetching primary data for 2024-12. [2025-09-26T18:21:27.484694] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-26T18:21:27.939966] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-26T18:21:27.956684] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-09-26T18:21:28.186319] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-26T18:21:28.756703] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-09-26T18:21:29.060708] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-26T18:21:29.556793] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-09-26T18:21:30.356708] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-09-26T18:21:30.685033] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-26T18:21:30.739206] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-26T18:21:31.156797] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-09-26T18:21:31.840938] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-26T18:21:31.956778] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-09-26T18:21:32.093090] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-26T18:21:32.756766] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-09-26T18:21:32.983170] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-26T18:21:33.556736] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-09-26T18:21:34.356711] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-09-26T18:21:34.398829] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-26T18:21:35.050491] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T18:21:35.071189] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-26T18:21:35.156763] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-09-26T18:21:35.956729] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-09-26T18:21:36.756751] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-09-26T18:21:37.182474] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-26T18:21:37.485710] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-26T18:21:37.556716] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-09-26T18:21:37.911551] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-26T18:21:38.357951] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-09-26T18:21:38.360741] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-26T18:21:39.156777] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-09-26T18:21:39.719403] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-26T18:21:39.956817] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-09-26T18:21:40.424775] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-26T18:21:40.689635] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-26T18:21:40.693132] [INFO ] [REMOTE ] DHX: Full fetch complete (20819 records). [2025-09-26T18:21:40.693261] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-09-26T18:21:40.762455] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-09-26T18:21:41.091114] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present. [2025-09-26T18:21:41.091199] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed. [2025-09-26T18:21:41.091608] [INFO ] [MAIN ] DHX: Fetched primary data is valid. [2025-09-26T18:21:41.091728] [DEBUG] [LOCAL ] DHX: Saving primary data. [2025-09-26T18:21:41.093473] [DEBUG] [LOCAL ] DHX: Trimmed 20819 records to 13404 (keeping 200 days of data) [2025-09-26T18:21:41.173590] [DEBUG] [LOCAL ] DHX: Primary data saved (13404 records). [2025-09-26T18:21:41.173792] [INFO ] [MAIN ] DHX: Full history saved. [2025-09-26T18:21:41.174003] [INFO ] [MAIN ] Update Progress: 617/2371 symbols completed. DHX took 20.9s. Estimated remaining: 3h 52m 4s. Rate: 7.6 symbols/min [2025-09-26T18:21:41.361368] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:21:41.380783] [DEBUG] [LOCAL ] DIAX: Loaded 12627 existing records from primary storage. [2025-09-26T18:21:41.380934] [INFO ] [MAIN ] DIAX: Loaded 12627 existing records. [2025-09-26T18:21:41.577477] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-09-26T18:21:41.585111] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:21:41.585485] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-09-26T18:21:41.585552] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-09-26T18:21:41.586259] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-09-26T18:21:41.586333] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-09-26T18:21:41.964998] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:21:42.356740] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2024-12. [2025-09-26T18:21:42.712861] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-26T18:21:43.120074] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-26T18:21:43.156731] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-09-26T18:21:43.407533] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-26T18:21:43.423892] [INFO ] [REMOTE ] DHI: Full fetch complete (76839 records). [2025-09-26T18:21:43.424098] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-09-26T18:21:43.430128] [FATAL] [VALIDATOR ] DHI: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:21:43.430295] [FATAL] [MAIN ] DHI: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:21:43.430390] [WARN ] [MAIN ] DHI: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:21:43.430481] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-09-26T18:21:43.430566] [DEBUG] [LOCAL ] DHI: No primary data file found to delete. [2025-09-26T18:21:43.430678] [INFO ] [LOCAL ] DHI: Starting deletion of derivative data. [2025-09-26T18:21:43.430769] [DEBUG] [LOCAL ] DHI: No derivative data file found to delete. [2025-09-26T18:21:43.430884] [INFO ] [MAIN ] Update Progress: 618/2371 symbols completed. DHI took 37.3s. Estimated remaining: 3h 51m 40s. Rate: 7.6 symbols/min [2025-09-26T18:21:43.622241] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:21:43.656878] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-26T18:21:43.672724] [DEBUG] [LOCAL ] DIN: Loaded 37533 existing records from primary storage. [2025-09-26T18:21:43.672867] [INFO ] [MAIN ] DIN: Loaded 37533 existing records. [2025-09-26T18:21:43.863334] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:21:43.863617] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-09-26T18:21:43.863698] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-09-26T18:21:43.865243] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-09-26T18:21:43.865305] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-09-26T18:21:43.961831] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-09-26T18:21:44.240249] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:21:44.756762] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-09-26T18:21:45.527566] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-26T18:21:45.556771] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-09-26T18:21:46.362320] [INFO ] [REMOTE ] DIN: Fetching primary data for 2024-12. [2025-09-26T18:21:46.369974] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-26T18:21:46.951611] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-26T18:21:47.156774] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-09-26T18:21:47.494476] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-26T18:21:47.956756] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-09-26T18:21:48.516668] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-26T18:21:48.533697] [INFO ] [REMOTE ] DHT: Full fetch complete (69994 records). [2025-09-26T18:21:48.534467] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-26T18:21:48.534600] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-09-26T18:21:48.765965] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-09-26T18:21:48.951512] [DEBUG] [VALIDATOR ] DHT: All expected trading days are present. [2025-09-26T18:21:48.951677] [DEBUG] [VALIDATOR ] DHT: Primary data validation passed. [2025-09-26T18:21:48.952685] [INFO ] [MAIN ] DHT: Fetched primary data is valid. [2025-09-26T18:21:48.952763] [DEBUG] [LOCAL ] DHT: Saving primary data. [2025-09-26T18:21:48.954701] [DEBUG] [LOCAL ] DHT: Trimmed 69994 records to 48583 (keeping 200 days of data) [2025-09-26T18:21:49.274521] [DEBUG] [LOCAL ] DHT: Primary data saved (48583 records). [2025-09-26T18:21:49.274693] [INFO ] [MAIN ] DHT: Full history saved. [2025-09-26T18:21:49.274805] [INFO ] [MAIN ] Update Progress: 619/2371 symbols completed. DHT took 32.4s. Estimated remaining: 3h 51m 26s. Rate: 7.6 symbols/min [2025-09-26T18:21:49.454085] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:21:49.509726] [DEBUG] [LOCAL ] DINO: Loaded 53341 existing records from primary storage. [2025-09-26T18:21:49.509880] [INFO ] [MAIN ] DINO: Loaded 53341 existing records. [2025-09-26T18:21:49.567011] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-09-26T18:21:49.702079] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:21:49.702376] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-09-26T18:21:49.702452] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-09-26T18:21:49.703782] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-09-26T18:21:49.703845] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-09-26T18:21:50.086380] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:21:50.116807] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-26T18:21:50.303900] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-26T18:21:50.356756] [INFO ] [REMOTE ] DINO: Fetching primary data for 2024-12. [2025-09-26T18:21:51.156745] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-09-26T18:21:51.956730] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-09-26T18:21:52.026885] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-26T18:21:52.756733] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-09-26T18:21:52.838949] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-26T18:21:52.851716] [INFO ] [REMOTE ] DHR: Full fetch complete (77267 records). [2025-09-26T18:21:52.851905] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-09-26T18:21:53.274948] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present. [2025-09-26T18:21:53.282590] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed. [2025-09-26T18:21:53.295724] [INFO ] [MAIN ] DHR: Fetched primary data is valid. [2025-09-26T18:21:53.295828] [DEBUG] [LOCAL ] DHR: Saving primary data. [2025-09-26T18:21:53.298061] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-26T18:21:53.307517] [DEBUG] [LOCAL ] DHR: Trimmed 77267 records to 54139 (keeping 200 days of data) [2025-09-26T18:21:53.556925] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-09-26T18:21:53.675079] [DEBUG] [LOCAL ] DHR: Primary data saved (54139 records). [2025-09-26T18:21:53.675237] [INFO ] [MAIN ] DHR: Full history saved. [2025-09-26T18:21:53.675356] [INFO ] [MAIN ] Update Progress: 620/2371 symbols completed. DHR took 39.2s. Estimated remaining: 3h 51m 9s. Rate: 7.6 symbols/min [2025-09-26T18:21:53.859748] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:21:53.924112] [DEBUG] [LOCAL ] DIS: Loaded 54178 existing records from primary storage. [2025-09-26T18:21:53.924274] [INFO ] [MAIN ] DIS: Loaded 54178 existing records. [2025-09-26T18:21:54.111388] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:21:54.111725] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-09-26T18:21:54.111788] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-09-26T18:21:54.113206] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-09-26T18:21:54.113270] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-09-26T18:21:54.360729] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-09-26T18:21:54.526902] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:21:54.560392] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-26T18:21:55.114841] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-26T18:21:55.156688] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-09-26T18:21:55.251076] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-26T18:21:55.956740] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-09-26T18:21:56.678919] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T18:21:56.756756] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-09-26T18:21:57.319890] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-26T18:21:57.423227] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-26T18:21:57.556726] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-09-26T18:21:58.356755] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-09-26T18:21:59.156702] [INFO ] [REMOTE ] DIS: Fetching primary data for 2024-12. [2025-09-26T18:21:59.284142] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-26T18:21:59.309298] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-26T18:21:59.956764] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-09-26T18:22:00.756792] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-09-26T18:22:01.556688] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-09-26T18:22:01.591418] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-09-26T18:22:01.802294] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-26T18:22:02.038312] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-26T18:22:02.160820] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-26T18:22:02.356731] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-09-26T18:22:03.156753] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-09-26T18:22:03.292473] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-26T18:22:03.296000] [INFO ] [REMOTE ] DIAX: Full fetch complete (17384 records). [2025-09-26T18:22:03.296080] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-09-26T18:22:03.707670] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-09-26T18:22:03.707767] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-09-26T18:22:03.708166] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-09-26T18:22:03.708229] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-09-26T18:22:03.708966] [DEBUG] [LOCAL ] DIAX: Trimmed 17384 records to 12780 (keeping 200 days of data) [2025-09-26T18:22:03.800661] [DEBUG] [LOCAL ] DIAX: Primary data saved (12780 records). [2025-09-26T18:22:03.800901] [INFO ] [MAIN ] DIAX: Full history saved. [2025-09-26T18:22:03.801037] [INFO ] [MAIN ] Update Progress: 621/2371 symbols completed. DIAX took 22.6s. Estimated remaining: 3h 51m 7s. Rate: 7.6 symbols/min [2025-09-26T18:22:03.961888] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-09-26T18:22:03.989233] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:22:03.989478] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-09-26T18:22:03.989549] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-09-26T18:22:03.989737] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-09-26T18:22:03.989792] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-26T18:22:03.989837] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-26T18:22:03.989870] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-09-26T18:22:04.374336] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:22:04.756729] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-12. [2025-09-26T18:22:05.216817] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-26T18:22:05.556752] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-09-26T18:22:05.663833] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-09-26T18:22:05.846017] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-26T18:22:05.882614] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-26T18:22:06.356742] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-09-26T18:22:06.711176] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-26T18:22:07.156720] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-09-26T18:22:07.660432] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-26T18:22:07.956753] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-09-26T18:22:08.379832] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-26T18:22:08.756772] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-09-26T18:22:09.556740] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-09-26T18:22:10.201609] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-26T18:22:10.356796] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-09-26T18:22:10.943916] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-26T18:22:11.156775] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-09-26T18:22:11.315119] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-26T18:22:11.956764] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-09-26T18:22:12.241287] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-26T18:22:12.756713] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-09-26T18:22:12.942186] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-26T18:22:13.070734] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-26T18:22:13.556722] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-09-26T18:22:14.356773] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-09-26T18:22:15.156720] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-09-26T18:22:15.356308] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-26T18:22:15.798014] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-26T18:22:15.956730] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-09-26T18:22:16.317634] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-26T18:22:16.756730] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-09-26T18:22:17.141211] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-26T18:22:17.556746] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-09-26T18:22:17.976184] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-26T18:22:17.984399] [INFO ] [REMOTE ] DIN: Full fetch complete (55216 records). [2025-09-26T18:22:17.984572] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-09-26T18:22:18.361915] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-09-26T18:22:18.458039] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-09-26T18:22:18.458196] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-09-26T18:22:18.458990] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-09-26T18:22:18.459073] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-09-26T18:22:18.460608] [DEBUG] [LOCAL ] DIN: Trimmed 55216 records to 37823 (keeping 200 days of data) [2025-09-26T18:22:18.690694] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-26T18:22:18.720019] [DEBUG] [LOCAL ] DIN: Primary data saved (37823 records). [2025-09-26T18:22:18.720190] [INFO ] [MAIN ] DIN: Full history saved. [2025-09-26T18:22:18.720283] [INFO ] [MAIN ] Update Progress: 622/2371 symbols completed. DIN took 35.3s. Estimated remaining: 3h 51m 19s. Rate: 7.6 symbols/min [2025-09-26T18:22:18.915778] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:22:18.916074] [DEBUG] [LOCAL ] DK: No existing data file found in primary storage. [2025-09-26T18:22:18.916132] [WARN ] [MAIN ] DK: No existing data found, performing full refresh instead. [2025-09-26T18:22:18.916311] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-09-26T18:22:18.916365] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-09-26T18:22:18.916410] [DEBUG] [LOCAL ] DK: No primary data file found to delete. [2025-09-26T18:22:18.916444] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-09-26T18:22:19.158788] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-09-26T18:22:19.317029] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:22:19.350473] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-26T18:22:19.361549] [INFO ] [REMOTE ] DINO: Full fetch complete (76675 records). [2025-09-26T18:22:19.361751] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-09-26T18:22:19.790985] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-26T18:22:19.807925] [INFO ] [REMOTE ] DIVY: Full fetch complete (1720 records). [2025-09-26T18:22:19.811886] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-09-26T18:22:19.961877] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-09-26T18:22:20.089878] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-09-26T18:22:20.102429] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-09-26T18:22:20.118871] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-09-26T18:22:20.125825] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-09-26T18:22:20.125615] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-26T18:22:20.126040] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:22:20.126114] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:22:20.126185] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-26T18:22:20.126257] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-26T18:22:20.126296] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-09-26T18:22:20.126628] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-09-26T18:22:20.126837] [INFO ] [MAIN ] Update Progress: 623/2371 symbols completed. DIVY took 16.3s. Estimated remaining: 3h 50m 52s. Rate: 7.6 symbols/min [2025-09-26T18:22:20.197930] [DEBUG] [LOCAL ] DINO: Trimmed 76675 records to 53729 (keeping 200 days of data) [2025-09-26T18:22:20.414832] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:22:20.441528] [DEBUG] [LOCAL ] DKL: Loaded 19153 existing records from primary storage. [2025-09-26T18:22:20.442530] [INFO ] [MAIN ] DKL: Loaded 19153 existing records. [2025-09-26T18:22:20.659680] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:22:20.662326] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-09-26T18:22:20.662677] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-09-26T18:22:20.663495] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-09-26T18:22:20.664159] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-09-26T18:22:20.759355] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-12. [2025-09-26T18:22:21.200082] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:22:21.332070] [DEBUG] [LOCAL ] DINO: Primary data saved (53729 records). [2025-09-26T18:22:21.332246] [INFO ] [MAIN ] DINO: Full history saved. [2025-09-26T18:22:21.332626] [INFO ] [MAIN ] Update Progress: 624/2371 symbols completed. DINO took 32.1s. Estimated remaining: 3h 50m 26s. Rate: 7.6 symbols/min [2025-09-26T18:22:21.535425] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:22:21.535623] [DEBUG] [LOCAL ] DKS: No existing data file found in primary storage. [2025-09-26T18:22:21.535704] [WARN ] [MAIN ] DKS: No existing data found, performing full refresh instead. [2025-09-26T18:22:21.535858] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-09-26T18:22:21.535901] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-09-26T18:22:21.535943] [DEBUG] [LOCAL ] DKS: No primary data file found to delete. [2025-09-26T18:22:21.535976] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-09-26T18:22:21.569100] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-12. [2025-09-26T18:22:21.935994] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:22:22.370724] [INFO ] [REMOTE ] DKS: Fetching primary data for 2024-12. [2025-09-26T18:22:22.374022] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-09-26T18:22:22.469923] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-26T18:22:22.858313] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-26T18:22:23.156725] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-09-26T18:22:23.727319] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-26T18:22:23.873183] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-26T18:22:23.956740] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-09-26T18:22:24.756765] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-09-26T18:22:25.556695] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-09-26T18:22:25.721510] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-26T18:22:25.884147] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-26T18:22:26.356783] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-09-26T18:22:27.156785] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-09-26T18:22:27.501539] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-26T18:22:27.956762] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-09-26T18:22:28.224736] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-09-26T18:22:28.378095] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-26T18:22:28.756755] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-09-26T18:22:29.556732] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-09-26T18:22:29.854051] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-26T18:22:30.356792] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-09-26T18:22:31.163024] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-09-26T18:22:31.183159] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T18:22:31.291700] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-09-26T18:22:31.772532] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-26T18:22:31.956769] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-09-26T18:22:32.237596] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-26T18:22:32.756776] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-09-26T18:22:33.556727] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-09-26T18:22:34.315684] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-26T18:22:34.356716] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-09-26T18:22:34.484264] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-26T18:22:35.156730] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-09-26T18:22:35.504577] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-26T18:22:35.956721] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-09-26T18:22:36.082023] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-26T18:22:36.457468] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-26T18:22:36.756749] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-09-26T18:22:37.454547] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-26T18:22:37.556740] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-09-26T18:22:38.178697] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-26T18:22:38.356741] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-09-26T18:22:38.732756] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-26T18:22:39.156774] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-09-26T18:22:39.729530] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-26T18:22:39.956767] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-09-26T18:22:40.756752] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-09-26T18:22:40.973296] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-26T18:22:41.556705] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-09-26T18:22:41.810294] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-26T18:22:41.834867] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-26T18:22:42.356727] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-09-26T18:22:43.156751] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-09-26T18:22:43.372158] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-26T18:22:43.956713] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-09-26T18:22:44.022669] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-09-26T18:22:44.033919] [INFO ] [REMOTE ] DIS: Full fetch complete (77944 records). [2025-09-26T18:22:44.034098] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-09-26T18:22:44.504972] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-09-26T18:22:44.505235] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-09-26T18:22:44.507119] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-09-26T18:22:44.507494] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-09-26T18:22:44.509382] [DEBUG] [LOCAL ] DIS: Trimmed 77944 records to 54568 (keeping 200 days of data) [2025-09-26T18:22:44.756758] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-09-26T18:22:44.886084] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-26T18:22:44.909503] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-26T18:22:44.914849] [INFO ] [REMOTE ] DKL: Full fetch complete (28985 records). [2025-09-26T18:22:44.915840] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-09-26T18:22:44.917395] [FATAL] [VALIDATOR ] DKL: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:22:44.918130] [FATAL] [MAIN ] DKL: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:22:44.918470] [WARN ] [MAIN ] DKL: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:22:44.918900] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-09-26T18:22:44.919513] [DEBUG] [LOCAL ] DKL: No primary data file found to delete. [2025-09-26T18:22:44.920336] [INFO ] [LOCAL ] DKL: Starting deletion of derivative data. [2025-09-26T18:22:44.921779] [DEBUG] [LOCAL ] DKL: Deleted derivative data file. [2025-09-26T18:22:44.922036] [INFO ] [MAIN ] Update Progress: 625/2371 symbols completed. DKL took 24.8s. Estimated remaining: 3h 51m 1s. Rate: 7.6 symbols/min [2025-09-26T18:22:45.129405] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:22:45.142410] [DEBUG] [LOCAL ] DIS: Primary data saved (54568 records). [2025-09-26T18:22:45.142621] [INFO ] [MAIN ] DIS: Full history saved. [2025-09-26T18:22:45.144241] [INFO ] [MAIN ] Update Progress: 626/2371 symbols completed. DIS took 51.5s. Estimated remaining: 3h 50m 32s. Rate: 7.6 symbols/min [2025-09-26T18:22:45.331247] [DEBUG] [LOCAL ] DLB: Loaded 32368 existing records from primary storage. [2025-09-26T18:22:45.349031] [INFO ] [MAIN ] DLB: Loaded 32368 existing records. [2025-09-26T18:22:45.375637] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:22:45.398194] [DEBUG] [LOCAL ] DLNG: No existing data file found in primary storage. [2025-09-26T18:22:45.413062] [WARN ] [MAIN ] DLNG: No existing data found, performing full refresh instead. [2025-09-26T18:22:45.460047] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-09-26T18:22:45.477710] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-09-26T18:22:45.491545] [DEBUG] [LOCAL ] DLNG: No primary data file found to delete. [2025-09-26T18:22:45.491765] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-09-26T18:22:45.561902] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-09-26T18:22:45.707305] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:22:45.712532] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-09-26T18:22:45.739287] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-09-26T18:22:45.765332] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-09-26T18:22:45.791079] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-09-26T18:22:46.164233] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:22:46.369987] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-12. [2025-09-26T18:22:46.394844] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:22:46.895143] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-26T18:22:46.977029] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-26T18:22:47.156779] [INFO ] [REMOTE ] DLB: Fetching primary data for 2024-12. [2025-09-26T18:22:47.794920] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-26T18:22:47.805468] [INFO ] [REMOTE ] DKS: Full fetch complete (71559 records). [2025-09-26T18:22:47.805736] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-09-26T18:22:47.961974] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-09-26T18:22:48.258262] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-09-26T18:22:48.258722] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-09-26T18:22:48.259900] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-09-26T18:22:48.260100] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-09-26T18:22:48.262510] [DEBUG] [LOCAL ] DKS: Trimmed 71559 records to 50579 (keeping 200 days of data) [2025-09-26T18:22:48.390502] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-26T18:22:48.628445] [DEBUG] [LOCAL ] DKS: Primary data saved (50579 records). [2025-09-26T18:22:48.628612] [INFO ] [MAIN ] DKS: Full history saved. [2025-09-26T18:22:48.628745] [INFO ] [MAIN ] Update Progress: 627/2371 symbols completed. DKS took 27.3s. Estimated remaining: 3h 50m 12s. Rate: 7.6 symbols/min [2025-09-26T18:22:48.761906] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-09-26T18:22:48.825240] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:22:48.893736] [DEBUG] [LOCAL ] DLR: Loaded 51508 existing records from primary storage. [2025-09-26T18:22:48.893892] [INFO ] [MAIN ] DLR: Loaded 51508 existing records. [2025-09-26T18:22:49.096463] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:22:49.097859] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-26T18:22:49.098133] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-09-26T18:22:49.102884] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-09-26T18:22:49.105867] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-09-26T18:22:49.105951] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-09-26T18:22:49.478533] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:22:49.556731] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-09-26T18:22:50.228770] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-26T18:22:50.361872] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-09-26T18:22:50.377757] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-26T18:22:51.156747] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-09-26T18:22:51.786729] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-26T18:22:51.956747] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-09-26T18:22:52.756733] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-09-26T18:22:53.556730] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-12. [2025-09-26T18:23:06.316667] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (15.16 seconds). [2025-09-26T18:23:06.319359] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-09-26T18:23:06.355756] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-12 (12.80 seconds). [2025-09-26T18:23:06.366572] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-09-26T18:23:06.462228] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (13.71 seconds). [2025-09-26T18:23:06.474738] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-09-26T18:23:06.585274] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (14.63 seconds). [2025-09-26T18:23:06.592741] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-09-26T18:23:07.788087] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-26T18:23:07.800637] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-09-26T18:23:07.837023] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-26T18:23:07.844572] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-09-26T18:23:07.915246] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-26T18:23:07.926218] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-09-26T18:23:08.626419] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-26T18:23:08.629450] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-09-26T18:23:09.129160] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-26T18:23:09.132052] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-09-26T18:23:09.224219] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-26T18:23:09.234857] [INFO ] [REMOTE ] DK: Full fetch complete (70361 records). [2025-09-26T18:23:09.235023] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-09-26T18:23:09.235871] [FATAL] [VALIDATOR ] DK: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:23:09.235978] [FATAL] [MAIN ] DK: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:23:09.236046] [WARN ] [MAIN ] DK: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:23:09.236120] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-09-26T18:23:09.236223] [DEBUG] [LOCAL ] DK: No primary data file found to delete. [2025-09-26T18:23:09.236281] [INFO ] [LOCAL ] DK: Starting deletion of derivative data. [2025-09-26T18:23:09.236328] [DEBUG] [LOCAL ] DK: No derivative data file found to delete. [2025-09-26T18:23:09.236425] [INFO ] [MAIN ] Update Progress: 628/2371 symbols completed. DK took 50.5s. Estimated remaining: 3h 50m 39s. Rate: 7.6 symbols/min [2025-09-26T18:23:09.435267] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:23:09.468442] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-26T18:23:09.497456] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-09-26T18:23:09.499960] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-26T18:23:09.512459] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-09-26T18:23:09.536923] [DEBUG] [LOCAL ] DLX: Loaded 29145 existing records from primary storage. [2025-09-26T18:23:09.537109] [INFO ] [MAIN ] DLX: Loaded 29145 existing records. [2025-09-26T18:23:09.740508] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:23:09.740806] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-09-26T18:23:09.740876] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-09-26T18:23:09.741832] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-09-26T18:23:09.741904] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-09-26T18:23:09.978009] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-26T18:23:10.032363] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-09-26T18:23:10.141053] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:23:10.141418] [INFO ] [REMOTE ] DLX: Fetching primary data for 2024-12. [2025-09-26T18:23:10.676887] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-26T18:23:10.679316] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-09-26T18:23:10.865982] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-26T18:23:10.877368] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-09-26T18:23:11.047894] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T18:23:11.059727] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-09-26T18:23:11.071384] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-26T18:23:11.073491] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-09-26T18:23:11.554865] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-26T18:23:11.560059] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-09-26T18:23:11.597910] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-26T18:23:11.599486] [INFO ] [REMOTE ] DLNG: Full fetch complete (11928 records). [2025-09-26T18:23:11.599580] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-09-26T18:23:11.600185] [FATAL] [VALIDATOR ] DLNG: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:23:11.600273] [FATAL] [MAIN ] DLNG: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:23:11.600317] [WARN ] [MAIN ] DLNG: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:23:11.600380] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-09-26T18:23:11.600445] [DEBUG] [LOCAL ] DLNG: No primary data file found to delete. [2025-09-26T18:23:11.600494] [INFO ] [LOCAL ] DLNG: Starting deletion of derivative data. [2025-09-26T18:23:11.600563] [DEBUG] [LOCAL ] DLNG: No derivative data file found to delete. [2025-09-26T18:23:11.600632] [INFO ] [MAIN ] Update Progress: 629/2371 symbols completed. DLNG took 26.5s. Estimated remaining: 3h 50m 16s. Rate: 7.6 symbols/min [2025-09-26T18:23:11.781355] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:23:11.833703] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-26T18:23:11.832466] [DEBUG] [LOCAL ] DLY: Loaded 19619 existing records from primary storage. [2025-09-26T18:23:11.840267] [INFO ] [MAIN ] DLY: Loaded 19619 existing records. [2025-09-26T18:23:11.889247] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-09-26T18:23:12.046612] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:23:12.046912] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-09-26T18:23:12.046971] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-09-26T18:23:12.047673] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-09-26T18:23:12.047751] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-09-26T18:23:12.448851] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:23:12.449343] [INFO ] [REMOTE ] DLY: Fetching primary data for 2024-12. [2025-09-26T18:23:12.465888] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-26T18:23:12.472258] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-09-26T18:23:12.506426] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-26T18:23:12.518230] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-09-26T18:23:12.867131] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-26T18:23:12.874485] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-09-26T18:23:13.375072] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-26T18:23:13.382250] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-09-26T18:23:13.711690] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-26T18:23:13.717747] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-09-26T18:23:13.775927] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-26T18:23:14.004688] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T18:23:14.356752] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-09-26T18:23:14.768419] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-26T18:23:14.769455] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-26T18:23:15.156723] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-09-26T18:23:15.956725] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-09-26T18:23:16.248436] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-26T18:23:16.249226] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-26T18:23:16.260302] [INFO ] [REMOTE ] DLB: Full fetch complete (46887 records). [2025-09-26T18:23:16.260760] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-09-26T18:23:16.657688] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-09-26T18:23:16.657786] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-09-26T18:23:16.658389] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-09-26T18:23:16.658433] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-09-26T18:23:16.659587] [DEBUG] [LOCAL ] DLB: Trimmed 46887 records to 32601 (keeping 200 days of data) [2025-09-26T18:23:16.756702] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-09-26T18:23:16.870507] [DEBUG] [LOCAL ] DLB: Primary data saved (32601 records). [2025-09-26T18:23:16.870701] [INFO ] [MAIN ] DLB: Full history saved. [2025-09-26T18:23:16.870810] [INFO ] [MAIN ] Update Progress: 630/2371 symbols completed. DLB took 31.9s. Estimated remaining: 3h 50m 0s. Rate: 7.6 symbols/min [2025-09-26T18:23:17.056238] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:23:17.062532] [DEBUG] [LOCAL ] DMA: Loaded 4570 existing records from primary storage. [2025-09-26T18:23:17.062639] [INFO ] [MAIN ] DMA: Loaded 4570 existing records. [2025-09-26T18:23:17.249564] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:23:17.249898] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-09-26T18:23:17.249967] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-09-26T18:23:17.250305] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-09-26T18:23:17.250365] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-09-26T18:23:17.561792] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-09-26T18:23:17.620660] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:23:17.785324] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-26T18:23:17.967405] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-26T18:23:18.356722] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-12. [2025-09-26T18:23:18.696221] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-26T18:23:18.838446] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-26T18:23:19.156735] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-09-26T18:23:19.956722] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-09-26T18:23:20.272084] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-26T18:23:20.756726] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-09-26T18:23:21.512091] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-26T18:23:21.556724] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-09-26T18:23:22.356795] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-09-26T18:23:22.557957] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-26T18:23:22.797972] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-26T18:23:23.137705] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-26T18:23:23.156698] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-09-26T18:23:23.956778] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-09-26T18:23:24.524770] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-26T18:23:24.756698] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-09-26T18:23:24.857206] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-26T18:23:24.867803] [INFO ] [REMOTE ] DLR: Full fetch complete (73841 records). [2025-09-26T18:23:24.867972] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-09-26T18:23:24.868877] [FATAL] [VALIDATOR ] DLR: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:23:24.869019] [FATAL] [MAIN ] DLR: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:23:24.869094] [WARN ] [MAIN ] DLR: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:23:24.869188] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-09-26T18:23:24.869334] [DEBUG] [LOCAL ] DLR: No primary data file found to delete. [2025-09-26T18:23:24.869465] [INFO ] [LOCAL ] DLR: Starting deletion of derivative data. [2025-09-26T18:23:24.870004] [DEBUG] [LOCAL ] DLR: Deleted derivative data file. [2025-09-26T18:23:24.870113] [INFO ] [MAIN ] Update Progress: 631/2371 symbols completed. DLR took 36.2s. Estimated remaining: 3h 49m 53s. Rate: 7.6 symbols/min [2025-09-26T18:23:25.109322] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:23:25.123871] [DEBUG] [LOCAL ] DMB: Loaded 10216 existing records from primary storage. [2025-09-26T18:23:25.124009] [INFO ] [MAIN ] DMB: Loaded 10216 existing records. [2025-09-26T18:23:25.282243] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-26T18:23:25.378546] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:23:25.378916] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-09-26T18:23:25.378980] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-09-26T18:23:25.379423] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-09-26T18:23:25.379496] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-09-26T18:23:25.574089] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-09-26T18:23:25.776235] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:23:26.266945] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-26T18:23:26.356744] [INFO ] [REMOTE ] DMB: Fetching primary data for 2024-12. [2025-09-26T18:23:27.156694] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-09-26T18:23:27.194080] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-26T18:23:27.956710] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-09-26T18:23:28.188884] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-26T18:23:28.756784] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-09-26T18:23:29.023330] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-26T18:23:29.431355] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-26T18:23:29.556760] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-09-26T18:23:30.357072] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-09-26T18:23:30.360844] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-26T18:23:31.156743] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-09-26T18:23:31.653607] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-26T18:23:31.682531] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-26T18:23:31.956732] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-09-26T18:23:32.443607] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-26T18:23:32.756743] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-09-26T18:23:33.262554] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-26T18:23:33.556722] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-09-26T18:23:34.356755] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-09-26T18:23:35.076323] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-26T18:23:35.076734] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-26T18:23:35.156757] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-09-26T18:23:35.956709] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-09-26T18:23:36.194256] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-26T18:23:36.344777] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-26T18:23:36.756774] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-09-26T18:23:37.556740] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-09-26T18:23:37.641681] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-26T18:23:37.644346] [INFO ] [REMOTE ] DMA: Full fetch complete (6578 records). [2025-09-26T18:23:37.644446] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-09-26T18:23:37.645115] [FATAL] [VALIDATOR ] DMA: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:23:37.645219] [FATAL] [MAIN ] DMA: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:23:37.645292] [WARN ] [MAIN ] DMA: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:23:37.645385] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-09-26T18:23:37.645479] [DEBUG] [LOCAL ] DMA: No primary data file found to delete. [2025-09-26T18:23:37.645554] [INFO ] [LOCAL ] DMA: Starting deletion of derivative data. [2025-09-26T18:23:37.646079] [DEBUG] [LOCAL ] DMA: Deleted derivative data file. [2025-09-26T18:23:37.646235] [INFO ] [MAIN ] Update Progress: 632/2371 symbols completed. DMA took 20.8s. Estimated remaining: 3h 49m 58s. Rate: 7.6 symbols/min [2025-09-26T18:23:37.870723] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:23:37.882533] [DEBUG] [LOCAL ] DMO: Loaded 9919 existing records from primary storage. [2025-09-26T18:23:37.882700] [INFO ] [MAIN ] DMO: Loaded 9919 existing records. [2025-09-26T18:23:38.081480] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:23:38.081765] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-09-26T18:23:38.081822] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-09-26T18:23:38.082290] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-09-26T18:23:38.082351] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-09-26T18:23:38.363810] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-09-26T18:23:38.499667] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:23:38.648275] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-26T18:23:39.047426] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-26T18:23:39.156752] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-09-26T18:23:39.956747] [INFO ] [REMOTE ] DMO: Fetching primary data for 2024-12. [2025-09-26T18:23:40.426557] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-26T18:23:40.432352] [INFO ] [REMOTE ] DLX: Full fetch complete (41297 records). [2025-09-26T18:23:40.432516] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-09-26T18:23:40.615992] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-26T18:23:40.761872] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-09-26T18:23:40.933484] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-09-26T18:23:40.933590] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-09-26T18:23:40.934269] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-09-26T18:23:40.934342] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-09-26T18:23:40.935724] [DEBUG] [LOCAL ] DLX: Trimmed 41297 records to 29284 (keeping 200 days of data) [2025-09-26T18:23:41.126324] [DEBUG] [LOCAL ] DLX: Primary data saved (29284 records). [2025-09-26T18:23:41.126486] [INFO ] [MAIN ] DLX: Full history saved. [2025-09-26T18:23:41.126585] [INFO ] [MAIN ] Update Progress: 633/2371 symbols completed. DLX took 31.9s. Estimated remaining: 3h 49m 38s. Rate: 7.6 symbols/min [2025-09-26T18:23:41.326249] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:23:41.379134] [DEBUG] [LOCAL ] DNA: Loaded 48681 existing records from primary storage. [2025-09-26T18:23:41.379292] [INFO ] [MAIN ] DNA: Loaded 48681 existing records. [2025-09-26T18:23:41.569558] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-09-26T18:23:41.577598] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:23:41.578417] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-09-26T18:23:41.578774] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-09-26T18:23:41.591051] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-09-26T18:23:41.590971] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-26T18:23:41.591281] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-09-26T18:23:41.986339] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:23:42.356703] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-09-26T18:23:42.659797] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-26T18:23:43.046889] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-26T18:23:43.156755] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-12. [2025-09-26T18:23:43.956778] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-09-26T18:23:44.756754] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-09-26T18:23:45.197407] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-26T18:23:45.203225] [INFO ] [REMOTE ] DLY: Full fetch complete (28178 records). [2025-09-26T18:23:45.203417] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-09-26T18:23:45.406244] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-09-26T18:23:45.486853] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-26T18:23:45.561861] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-09-26T18:23:45.670782] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-09-26T18:23:45.670863] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-09-26T18:23:45.671308] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-09-26T18:23:45.671349] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-09-26T18:23:45.672093] [DEBUG] [LOCAL ] DLY: Trimmed 28178 records to 19800 (keeping 200 days of data) [2025-09-26T18:23:45.798898] [DEBUG] [LOCAL ] DLY: Primary data saved (19800 records). [2025-09-26T18:23:45.799053] [INFO ] [MAIN ] DLY: Full history saved. [2025-09-26T18:23:45.799146] [INFO ] [MAIN ] Update Progress: 634/2371 symbols completed. DLY took 34.2s. Estimated remaining: 3h 49m 21s. Rate: 7.6 symbols/min [2025-09-26T18:23:45.974169] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:23:46.025815] [DEBUG] [LOCAL ] DNOW: Loaded 43851 existing records from primary storage. [2025-09-26T18:23:46.025968] [INFO ] [MAIN ] DNOW: Loaded 43851 existing records. [2025-09-26T18:23:46.212829] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:23:46.213121] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-09-26T18:23:46.213175] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-09-26T18:23:46.214295] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-09-26T18:23:46.214358] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-09-26T18:23:46.362780] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-09-26T18:23:46.624129] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:23:47.156738] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-09-26T18:23:47.234144] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-26T18:23:47.383711] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-26T18:23:47.636931] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-26T18:23:47.956768] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-09-26T18:23:48.756770] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-09-26T18:23:49.556713] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2024-12. [2025-09-26T18:23:49.588054] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-26T18:23:49.795614] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-26T18:23:50.356736] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-09-26T18:23:50.969554] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-26T18:23:51.005296] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-26T18:23:51.156741] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-09-26T18:23:51.960176] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-09-26T18:23:51.961404] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-26T18:23:52.756749] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-09-26T18:23:52.894576] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-26T18:23:53.500974] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-26T18:23:53.556722] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-09-26T18:23:54.356775] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-09-26T18:23:55.131460] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T18:23:55.156937] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-09-26T18:23:55.168849] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-26T18:23:55.956820] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-09-26T18:23:56.756756] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-09-26T18:23:57.049573] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-26T18:23:57.123349] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-26T18:23:57.457192] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-26T18:23:57.460776] [INFO ] [REMOTE ] DMB: Full fetch complete (15052 records). [2025-09-26T18:23:57.460913] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-09-26T18:23:57.561882] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-09-26T18:23:57.882853] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present. [2025-09-26T18:23:57.882938] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed. [2025-09-26T18:23:57.883314] [INFO ] [MAIN ] DMB: Fetched primary data is valid. [2025-09-26T18:23:57.883356] [DEBUG] [LOCAL ] DMB: Saving primary data. [2025-09-26T18:23:57.884126] [DEBUG] [LOCAL ] DMB: Trimmed 15052 records to 10254 (keeping 200 days of data) [2025-09-26T18:23:57.959961] [DEBUG] [LOCAL ] DMB: Primary data saved (10254 records). [2025-09-26T18:23:57.960302] [INFO ] [MAIN ] DMB: Full history saved. [2025-09-26T18:23:57.960914] [INFO ] [MAIN ] Update Progress: 635/2371 symbols completed. DMB took 33.1s. Estimated remaining: 3h 49m 25s. Rate: 7.6 symbols/min [2025-09-26T18:23:58.157203] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:23:58.212344] [DEBUG] [LOCAL ] DNP: Loaded 33558 existing records from primary storage. [2025-09-26T18:23:58.212531] [INFO ] [MAIN ] DNP: Loaded 33558 existing records. [2025-09-26T18:23:58.361904] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-09-26T18:23:58.427776] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:23:58.428144] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-09-26T18:23:58.428235] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-09-26T18:23:58.429107] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-09-26T18:23:58.429183] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-09-26T18:23:58.825831] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:23:59.156746] [INFO ] [REMOTE ] DNP: Fetching primary data for 2024-12. [2025-09-26T18:23:59.472301] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-26T18:23:59.564463] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-26T18:23:59.956721] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-09-26T18:24:00.756771] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-09-26T18:24:01.227336] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-26T18:24:01.556750] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-09-26T18:24:01.765665] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-26T18:24:02.035237] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-26T18:24:02.215482] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-26T18:24:02.356793] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-09-26T18:24:03.156768] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-09-26T18:24:03.771858] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-26T18:24:03.956773] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-09-26T18:24:04.279962] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-26T18:24:04.282691] [INFO ] [REMOTE ] DMO: Full fetch complete (14594 records). [2025-09-26T18:24:04.282787] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-09-26T18:24:04.693688] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-09-26T18:24:04.693794] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-09-26T18:24:04.694185] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-09-26T18:24:04.694272] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-09-26T18:24:04.695295] [DEBUG] [LOCAL ] DMO: Trimmed 14594 records to 9981 (keeping 200 days of data) [2025-09-26T18:24:04.760917] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-09-26T18:24:04.775219] [DEBUG] [LOCAL ] DMO: Primary data saved (9981 records). [2025-09-26T18:24:04.775406] [INFO ] [MAIN ] DMO: Full history saved. [2025-09-26T18:24:04.775548] [INFO ] [MAIN ] Update Progress: 636/2371 symbols completed. DMO took 27.1s. Estimated remaining: 3h 49m 14s. Rate: 7.6 symbols/min [2025-09-26T18:24:04.966585] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:24:05.038677] [DEBUG] [LOCAL ] DOC: Loaded 53927 existing records from primary storage. [2025-09-26T18:24:05.038838] [INFO ] [MAIN ] DOC: Loaded 53927 existing records. [2025-09-26T18:24:05.240759] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:24:05.241179] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-09-26T18:24:05.241240] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-09-26T18:24:05.242942] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-09-26T18:24:05.243009] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-09-26T18:24:05.378940] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-26T18:24:05.562418] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-09-26T18:24:05.703268] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:24:06.146305] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-26T18:24:06.356765] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-09-26T18:24:06.628294] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-26T18:24:07.156731] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-09-26T18:24:07.956784] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-09-26T18:24:08.106164] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-26T18:24:08.218175] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-26T18:24:08.756769] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-09-26T18:24:09.023754] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-26T18:24:09.556729] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-09-26T18:24:10.356728] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-09-26T18:24:10.623866] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-26T18:24:10.719135] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-26T18:24:11.156743] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-09-26T18:24:11.782226] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-26T18:24:11.956725] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-09-26T18:24:12.756728] [INFO ] [REMOTE ] DOC: Fetching primary data for 2024-12. [2025-09-26T18:24:12.913557] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-26T18:24:13.254578] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-26T18:24:13.556719] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-09-26T18:24:14.356739] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-09-26T18:24:14.563135] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-26T18:24:15.156726] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-09-26T18:24:15.546847] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-26T18:24:15.774337] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-26T18:24:15.788282] [INFO ] [REMOTE ] DNA: Full fetch complete (70539 records). [2025-09-26T18:24:15.788501] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-09-26T18:24:15.789589] [FATAL] [VALIDATOR ] DNA: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:24:15.789728] [FATAL] [MAIN ] DNA: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:24:15.789797] [WARN ] [MAIN ] DNA: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:24:15.789905] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-09-26T18:24:15.790005] [DEBUG] [LOCAL ] DNA: No primary data file found to delete. [2025-09-26T18:24:15.790053] [INFO ] [LOCAL ] DNA: Starting deletion of derivative data. [2025-09-26T18:24:15.790405] [DEBUG] [LOCAL ] DNA: Deleted derivative data file. [2025-09-26T18:24:15.790549] [INFO ] [MAIN ] Update Progress: 637/2371 symbols completed. DNA took 34.7s. Estimated remaining: 3h 49m 14s. Rate: 7.6 symbols/min [2025-09-26T18:24:15.956730] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-09-26T18:24:16.733509] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-26T18:24:16.756679] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-09-26T18:24:17.484934] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-26T18:24:17.556703] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-09-26T18:24:18.356719] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-09-26T18:24:18.799585] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-26T18:24:18.883469] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-26T18:24:19.156768] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-09-26T18:24:19.699799] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-26T18:24:19.709769] [INFO ] [REMOTE ] DNP: Full fetch complete (49395 records). [2025-09-26T18:24:19.709933] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-09-26T18:24:19.969578] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-09-26T18:24:20.138728] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-09-26T18:24:20.138834] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-09-26T18:24:20.139678] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-09-26T18:24:20.139747] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-09-26T18:24:20.141043] [DEBUG] [LOCAL ] DNP: Trimmed 49395 records to 33786 (keeping 200 days of data) [2025-09-26T18:24:20.354811] [DEBUG] [LOCAL ] DNP: Primary data saved (33786 records). [2025-09-26T18:24:20.354960] [INFO ] [MAIN ] DNP: Full history saved. [2025-09-26T18:24:20.355051] [INFO ] [MAIN ] Update Progress: 638/2371 symbols completed. DNP took 22.4s. Estimated remaining: 3h 48m 57s. Rate: 7.6 symbols/min [2025-09-26T18:24:20.443812] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-26T18:24:20.453514] [INFO ] [REMOTE ] DNOW: Full fetch complete (62627 records). [2025-09-26T18:24:20.453744] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-09-26T18:24:20.882115] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-09-26T18:24:20.882214] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-09-26T18:24:20.883113] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-09-26T18:24:20.883184] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-09-26T18:24:20.884630] [DEBUG] [LOCAL ] DNOW: Trimmed 62627 records to 44205 (keeping 200 days of data) [2025-09-26T18:24:21.163594] [DEBUG] [LOCAL ] DNOW: Primary data saved (44205 records). [2025-09-26T18:24:21.163797] [INFO ] [MAIN ] DNOW: Full history saved. [2025-09-26T18:24:21.163925] [INFO ] [MAIN ] Update Progress: 639/2371 symbols completed. DNOW took 35.4s. Estimated remaining: 3h 48m 30s. Rate: 7.6 symbols/min [2025-09-26T18:24:21.473348] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-26T18:24:21.485523] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-09-26T18:24:23.576861] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-26T18:24:23.589170] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-09-26T18:24:25.698387] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-26T18:24:25.713462] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-09-26T18:24:27.517531] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-26T18:24:27.529737] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-09-26T18:24:29.636800] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-26T18:24:29.655525] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-09-26T18:24:31.742499] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-26T18:24:31.755015] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-09-26T18:24:33.896141] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-26T18:24:33.908559] [INFO ] [REMOTE ] DOC: Full fetch complete (77386 records). [2025-09-26T18:24:33.908790] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-09-26T18:24:34.338066] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-09-26T18:24:34.338179] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-09-26T18:24:34.340263] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-09-26T18:24:34.340336] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-09-26T18:24:34.342304] [DEBUG] [LOCAL ] DOC: Trimmed 77386 records to 54317 (keeping 200 days of data) [2025-09-26T18:24:34.699507] [DEBUG] [LOCAL ] DOC: Primary data saved (54317 records). [2025-09-26T18:24:34.699735] [INFO ] [MAIN ] DOC: Full history saved. [2025-09-26T18:24:34.699855] [INFO ] [MAIN ] Update Progress: 640/2371 symbols completed. DOC took 29.9s. Estimated remaining: 3h 48m 37s. Rate: 7.6 symbols/min [2025-09-26T18:24:35.415828] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:24:35.453476] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:24:35.526845] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:24:35.552496] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:24:35.618431] [DEBUG] [LOCAL ] DOUG: Loaded 35046 existing records from primary storage. [2025-09-26T18:24:35.618742] [INFO ] [MAIN ] DOUG: Loaded 35046 existing records. [2025-09-26T18:24:35.721371] [DEBUG] [LOCAL ] DOCS: Loaded 51598 existing records from primary storage. [2025-09-26T18:24:35.750479] [INFO ] [MAIN ] DOCS: Loaded 51598 existing records. [2025-09-26T18:24:35.797750] [DEBUG] [LOCAL ] DOLE: Loaded 38240 existing records from primary storage. [2025-09-26T18:24:35.810152] [INFO ] [MAIN ] DOLE: Loaded 38240 existing records. [2025-09-26T18:24:36.069899] [DEBUG] [LOCAL ] DOCN: Loaded 50889 existing records from primary storage. [2025-09-26T18:24:36.151165] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:24:36.145748] [INFO ] [MAIN ] DOCN: Loaded 50889 existing records. [2025-09-26T18:24:36.213267] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-09-26T18:24:36.213521] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-09-26T18:24:36.266770] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:24:36.282663] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-09-26T18:24:36.332563] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-09-26T18:24:36.361980] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-09-26T18:24:36.337884] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-09-26T18:24:36.410489] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-09-26T18:24:36.403834] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:24:36.410695] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-09-26T18:24:36.450998] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-09-26T18:24:36.518029] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-09-26T18:24:36.560397] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-09-26T18:24:36.602201] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-09-26T18:24:36.905474] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:24:36.964229] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-09-26T18:24:37.071865] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-09-26T18:24:37.190361] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-09-26T18:24:37.303439] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-09-26T18:24:37.781841] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:24:37.846302] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2024-12. [2025-09-26T18:24:37.952484] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:24:38.125903] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2024-12. [2025-09-26T18:24:38.154686] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:24:38.162498] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2024-12. [2025-09-26T18:24:38.293033] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:24:38.293438] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2024-12. [2025-09-26T18:24:39.495103] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-26T18:24:39.504615] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-09-26T18:24:39.574813] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-26T18:24:39.583701] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-09-26T18:24:39.687479] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-26T18:24:39.696754] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-09-26T18:24:39.766317] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-26T18:24:39.777821] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-09-26T18:24:40.432314] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-26T18:24:40.440926] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-09-26T18:24:40.585019] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-26T18:24:40.593076] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-09-26T18:24:41.049021] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-26T18:24:41.059513] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-09-26T18:24:41.385264] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-26T18:24:41.395106] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-09-26T18:24:41.503860] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-26T18:24:41.511151] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-09-26T18:24:41.569963] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-26T18:24:41.577824] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-09-26T18:24:42.570256] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-26T18:24:42.578136] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-09-26T18:24:42.658178] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-26T18:24:42.666918] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-09-26T18:24:42.748795] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-26T18:24:42.758678] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-09-26T18:24:43.004404] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-26T18:24:43.016579] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-09-26T18:24:43.742180] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-26T18:24:43.751354] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-09-26T18:24:43.774708] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-26T18:24:43.783516] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-09-26T18:24:44.049039] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-26T18:24:44.059881] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-09-26T18:24:44.442544] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-26T18:24:44.454400] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-09-26T18:24:44.827262] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-26T18:24:44.837119] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-09-26T18:24:44.891188] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-26T18:24:44.900518] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-09-26T18:24:45.323028] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-26T18:24:45.333975] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-09-26T18:24:45.813929] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-26T18:24:45.822704] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-09-26T18:24:45.871275] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-26T18:24:45.974855] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T18:24:46.356731] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-09-26T18:24:46.823252] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T18:24:46.917356] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-26T18:24:47.156843] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-09-26T18:24:47.956726] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-09-26T18:24:48.028822] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-26T18:24:48.071155] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-26T18:24:48.756735] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-09-26T18:24:49.536170] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-26T18:24:49.556735] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-09-26T18:24:50.321709] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-26T18:24:50.356682] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-09-26T18:24:50.848765] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-26T18:24:51.156733] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-09-26T18:24:51.487889] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-26T18:24:51.956788] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-09-26T18:24:52.653825] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-26T18:24:52.756751] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-09-26T18:24:53.556733] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-09-26T18:24:54.238181] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-26T18:24:54.313001] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-26T18:24:54.320350] [INFO ] [REMOTE ] DOUG: Full fetch complete (51446 records). [2025-09-26T18:24:54.320514] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-09-26T18:24:54.361843] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-09-26T18:24:54.791032] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-09-26T18:24:54.791152] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-09-26T18:24:54.791963] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-09-26T18:24:54.792028] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-09-26T18:24:54.793487] [DEBUG] [LOCAL ] DOUG: Trimmed 51446 records to 35254 (keeping 200 days of data) [2025-09-26T18:24:54.994376] [DEBUG] [LOCAL ] DOUG: Primary data saved (35254 records). [2025-09-26T18:24:54.994610] [INFO ] [MAIN ] DOUG: Full history saved. [2025-09-26T18:24:54.994781] [INFO ] [MAIN ] Update Progress: 641/2371 symbols completed. DOUG took 20.3s. Estimated remaining: 3h 49m 3s. Rate: 7.6 symbols/min [2025-09-26T18:24:55.171903] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-09-26T18:24:55.175519] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:24:55.210620] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-26T18:24:55.266626] [DEBUG] [LOCAL ] DOV: Loaded 46044 existing records from primary storage. [2025-09-26T18:24:55.266810] [INFO ] [MAIN ] DOV: Loaded 46044 existing records. [2025-09-26T18:24:55.457023] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:24:55.457322] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-09-26T18:24:55.457377] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-09-26T18:24:55.458723] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-09-26T18:24:55.458805] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-09-26T18:24:55.831459] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:24:55.956713] [INFO ] [REMOTE ] DOV: Fetching primary data for 2024-12. [2025-09-26T18:24:56.163308] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-26T18:24:56.591066] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-26T18:24:56.600258] [INFO ] [REMOTE ] DOLE: Full fetch complete (53460 records). [2025-09-26T18:24:56.600427] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-09-26T18:24:56.766214] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-09-26T18:24:57.021826] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-09-26T18:24:57.021923] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-09-26T18:24:57.022697] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-09-26T18:24:57.022766] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-09-26T18:24:57.024225] [DEBUG] [LOCAL ] DOLE: Trimmed 53460 records to 38568 (keeping 200 days of data) [2025-09-26T18:24:57.273437] [DEBUG] [LOCAL ] DOLE: Primary data saved (38568 records). [2025-09-26T18:24:57.273591] [INFO ] [MAIN ] DOLE: Full history saved. [2025-09-26T18:24:57.275009] [INFO ] [MAIN ] Update Progress: 642/2371 symbols completed. DOLE took 22.6s. Estimated remaining: 3h 48m 39s. Rate: 7.6 symbols/min [2025-09-26T18:24:57.455529] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:24:57.511337] [DEBUG] [LOCAL ] DOW: Loaded 54123 existing records from primary storage. [2025-09-26T18:24:57.511492] [INFO ] [MAIN ] DOW: Loaded 54123 existing records. [2025-09-26T18:24:57.561928] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-09-26T18:24:57.715493] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:24:57.715827] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-09-26T18:24:57.715884] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-09-26T18:24:57.717345] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-09-26T18:24:57.717409] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-09-26T18:24:58.060871] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-26T18:24:58.153336] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:24:58.356720] [INFO ] [REMOTE ] DOW: Fetching primary data for 2024-12. [2025-09-26T18:24:59.011498] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-26T18:24:59.022048] [INFO ] [REMOTE ] DOCN: Full fetch complete (71450 records). [2025-09-26T18:24:59.022177] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-09-26T18:24:59.161438] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-09-26T18:24:59.450095] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-09-26T18:24:59.450214] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-09-26T18:24:59.451258] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-09-26T18:24:59.451345] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-09-26T18:24:59.478999] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-26T18:24:59.483246] [DEBUG] [LOCAL ] DOCN: Trimmed 71450 records to 51245 (keeping 200 days of data) [2025-09-26T18:24:59.492786] [INFO ] [REMOTE ] DOCS: Full fetch complete (74179 records). [2025-09-26T18:24:59.493036] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-09-26T18:25:00.048414] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-09-26T18:25:00.048566] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-09-26T18:25:00.049597] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-09-26T18:25:00.050470] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-09-26T18:25:00.060295] [DEBUG] [LOCAL ] DOCS: Trimmed 74179 records to 51956 (keeping 200 days of data) [2025-09-26T18:25:00.368038] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-26T18:25:00.392270] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-09-26T18:25:00.538303] [DEBUG] [LOCAL ] DOCN: Primary data saved (51245 records). [2025-09-26T18:25:00.540099] [INFO ] [MAIN ] DOCN: Full history saved. [2025-09-26T18:25:00.540950] [INFO ] [MAIN ] Update Progress: 643/2371 symbols completed. DOCN took 25.8s. Estimated remaining: 3h 48m 19s. Rate: 7.6 symbols/min [2025-09-26T18:25:00.741216] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:25:00.778545] [DEBUG] [LOCAL ] DPG: No existing data file found in primary storage. [2025-09-26T18:25:00.795941] [WARN ] [MAIN ] DPG: No existing data found, performing full refresh instead. [2025-09-26T18:25:00.799350] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-09-26T18:25:00.799820] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-09-26T18:25:00.801306] [DEBUG] [LOCAL ] DPG: No primary data file found to delete. [2025-09-26T18:25:00.801635] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-09-26T18:25:00.878530] [DEBUG] [LOCAL ] DOCS: Primary data saved (51956 records). [2025-09-26T18:25:00.928581] [INFO ] [MAIN ] DOCS: Full history saved. [2025-09-26T18:25:00.953977] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-26T18:25:00.962806] [INFO ] [MAIN ] Update Progress: 644/2371 symbols completed. DOCS took 26.3s. Estimated remaining: 3h 47m 51s. Rate: 7.6 symbols/min [2025-09-26T18:25:00.990883] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-09-26T18:25:01.428687] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:25:01.455135] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:25:01.499754] [DEBUG] [LOCAL ] DQ: Loaded 43526 existing records from primary storage. [2025-09-26T18:25:01.499935] [INFO ] [MAIN ] DQ: Loaded 43526 existing records. [2025-09-26T18:25:01.569461] [INFO ] [REMOTE ] DPG: Fetching primary data for 2024-12. [2025-09-26T18:25:01.708157] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:25:01.708421] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-09-26T18:25:01.708470] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-09-26T18:25:01.709517] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-09-26T18:25:01.709579] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-09-26T18:25:02.117109] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:25:02.356704] [INFO ] [REMOTE ] DQ: Fetching primary data for 2024-12. [2025-09-26T18:25:02.407096] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-26T18:25:02.604476] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-09-26T18:25:02.685196] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-26T18:25:03.156761] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-09-26T18:25:03.956722] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-09-26T18:25:04.412346] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-26T18:25:04.756744] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-09-26T18:25:04.812237] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-26T18:25:05.179612] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-26T18:25:05.556725] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-09-26T18:25:06.331599] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T18:25:06.356682] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-09-26T18:25:07.156751] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-09-26T18:25:07.194835] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-26T18:25:07.449330] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-26T18:25:07.956728] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-09-26T18:25:08.756792] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-09-26T18:25:08.815119] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-26T18:25:08.843339] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-26T18:25:09.556749] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-09-26T18:25:10.356699] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-09-26T18:25:10.425683] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-26T18:25:10.473318] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-26T18:25:11.156726] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-09-26T18:25:11.956759] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-09-26T18:25:12.112049] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-26T18:25:12.756730] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-09-26T18:25:12.867400] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-26T18:25:13.472001] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-26T18:25:13.556714] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-09-26T18:25:13.773819] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-26T18:25:14.111443] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-26T18:25:14.356729] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-09-26T18:25:15.156769] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-09-26T18:25:15.956761] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-09-26T18:25:16.721485] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-26T18:25:16.756771] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-09-26T18:25:16.796823] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-26T18:25:17.381223] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-26T18:25:17.556736] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-09-26T18:25:18.356759] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-09-26T18:25:18.445819] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-26T18:25:18.671619] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-26T18:25:19.156742] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-09-26T18:25:19.484956] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-26T18:25:19.956732] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-09-26T18:25:20.756722] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-09-26T18:25:20.956041] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-26T18:25:21.000467] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-26T18:25:21.556742] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-09-26T18:25:21.865832] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-26T18:25:22.356742] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-09-26T18:25:23.156694] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-09-26T18:25:23.304146] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-26T18:25:23.308023] [INFO ] [REMOTE ] DPG: Full fetch complete (19105 records). [2025-09-26T18:25:23.308187] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-09-26T18:25:23.748006] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-09-26T18:25:23.748206] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-09-26T18:25:23.748840] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-09-26T18:25:23.748936] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-09-26T18:25:23.750186] [DEBUG] [LOCAL ] DPG: Trimmed 19105 records to 13683 (keeping 200 days of data) [2025-09-26T18:25:23.783410] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-26T18:25:23.886019] [DEBUG] [LOCAL ] DPG: Primary data saved (13683 records). [2025-09-26T18:25:23.886192] [INFO ] [MAIN ] DPG: Full history saved. [2025-09-26T18:25:23.886343] [INFO ] [MAIN ] Update Progress: 645/2371 symbols completed. DPG took 23.3s. Estimated remaining: 3h 48m 23s. Rate: 7.6 symbols/min [2025-09-26T18:25:23.961865] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-09-26T18:25:24.085920] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:25:24.086129] [DEBUG] [LOCAL ] DRD: No existing data file found in primary storage. [2025-09-26T18:25:24.086177] [WARN ] [MAIN ] DRD: No existing data found, performing full refresh instead. [2025-09-26T18:25:24.086335] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-09-26T18:25:24.086389] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-09-26T18:25:24.086457] [DEBUG] [LOCAL ] DRD: No primary data file found to delete. [2025-09-26T18:25:24.086492] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-09-26T18:25:24.476815] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:25:24.756743] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-09-26T18:25:25.207968] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-26T18:25:25.449805] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-26T18:25:25.556741] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-09-26T18:25:26.009546] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-26T18:25:26.356728] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-09-26T18:25:27.156760] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-09-26T18:25:27.548863] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-26T18:25:27.829957] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-26T18:25:27.840525] [INFO ] [REMOTE ] DQ: Full fetch complete (62970 records). [2025-09-26T18:25:27.840718] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-09-26T18:25:27.961889] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-09-26T18:25:28.280371] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-09-26T18:25:28.280474] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-09-26T18:25:28.281358] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-09-26T18:25:28.281428] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-09-26T18:25:28.282813] [DEBUG] [LOCAL ] DQ: Trimmed 62970 records to 43880 (keeping 200 days of data) [2025-09-26T18:25:28.563227] [DEBUG] [LOCAL ] DQ: Primary data saved (43880 records). [2025-09-26T18:25:28.563418] [INFO ] [MAIN ] DQ: Full history saved. [2025-09-26T18:25:28.563542] [INFO ] [MAIN ] Update Progress: 646/2371 symbols completed. DQ took 27.6s. Estimated remaining: 3h 48m 6s. Rate: 7.6 symbols/min [2025-09-26T18:25:28.763865] [INFO ] [REMOTE ] DRD: Fetching primary data for 2024-12. [2025-09-26T18:25:28.799479] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:25:28.833821] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-26T18:25:28.888380] [DEBUG] [LOCAL ] DRH: Loaded 50835 existing records from primary storage. [2025-09-26T18:25:28.888540] [INFO ] [MAIN ] DRH: Loaded 50835 existing records. [2025-09-26T18:25:29.086367] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:25:29.086735] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-09-26T18:25:29.086793] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-09-26T18:25:29.088164] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-09-26T18:25:29.088228] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-09-26T18:25:29.477518] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:25:29.556741] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-09-26T18:25:30.004708] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-26T18:25:30.356709] [INFO ] [REMOTE ] DRH: Fetching primary data for 2024-12. [2025-09-26T18:25:30.404890] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-09-26T18:25:30.416844] [INFO ] [REMOTE ] DOW: Full fetch complete (77791 records). [2025-09-26T18:25:30.417046] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-09-26T18:25:30.870867] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-09-26T18:25:30.870963] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-09-26T18:25:30.871942] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-09-26T18:25:30.872026] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-09-26T18:25:30.873795] [DEBUG] [LOCAL ] DOW: Trimmed 77791 records to 54513 (keeping 200 days of data) [2025-09-26T18:25:31.174613] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-09-26T18:25:31.231323] [DEBUG] [LOCAL ] DOW: Primary data saved (54513 records). [2025-09-26T18:25:31.231478] [INFO ] [MAIN ] DOW: Full history saved. [2025-09-26T18:25:31.233044] [INFO ] [MAIN ] Update Progress: 647/2371 symbols completed. DOW took 34.0s. Estimated remaining: 3h 47m 45s. Rate: 7.6 symbols/min [2025-09-26T18:25:31.418969] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:25:31.470116] [DEBUG] [LOCAL ] DRI: Loaded 48216 existing records from primary storage. [2025-09-26T18:25:31.470279] [INFO ] [MAIN ] DRI: Loaded 48216 existing records. [2025-09-26T18:25:31.680462] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:25:31.680972] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-09-26T18:25:31.681051] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-09-26T18:25:31.695104] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-09-26T18:25:31.716447] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-09-26T18:25:31.769355] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-26T18:25:31.855009] [INFO ] [REMOTE ] DOV: Full fetch complete (65145 records). [2025-09-26T18:25:31.866201] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-09-26T18:25:32.442912] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:25:32.480463] [INFO ] [REMOTE ] DRI: Fetching primary data for 2024-12. [2025-09-26T18:25:32.598595] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-26T18:25:32.684913] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-09-26T18:25:32.683207] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-09-26T18:25:32.695131] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-09-26T18:25:32.696632] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-09-26T18:25:32.696736] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-09-26T18:25:32.698323] [DEBUG] [LOCAL ] DOV: Trimmed 65145 records to 46376 (keeping 200 days of data) [2025-09-26T18:25:32.757552] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-09-26T18:25:33.003737] [DEBUG] [LOCAL ] DOV: Primary data saved (46376 records). [2025-09-26T18:25:33.003917] [INFO ] [MAIN ] DOV: Full history saved. [2025-09-26T18:25:33.004008] [INFO ] [MAIN ] Update Progress: 648/2371 symbols completed. DOV took 38.0s. Estimated remaining: 3h 47m 20s. Rate: 7.6 symbols/min [2025-09-26T18:25:33.195581] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:25:33.207070] [DEBUG] [LOCAL ] DRLL: Loaded 9694 existing records from primary storage. [2025-09-26T18:25:33.207236] [INFO ] [MAIN ] DRLL: Loaded 9694 existing records. [2025-09-26T18:25:33.403333] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:25:33.403630] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-09-26T18:25:33.403733] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-09-26T18:25:33.404191] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-09-26T18:25:33.404266] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-09-26T18:25:33.565578] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-09-26T18:25:33.812387] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:25:34.075460] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-26T18:25:34.205419] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-26T18:25:34.356753] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-09-26T18:25:34.949810] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-26T18:25:35.156748] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2024-12. [2025-09-26T18:25:35.956754] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-09-26T18:25:36.277265] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-26T18:25:36.389362] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-26T18:25:36.756726] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-09-26T18:25:37.215796] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-26T18:25:37.556701] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-09-26T18:25:37.608726] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-26T18:25:38.356779] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-09-26T18:25:39.145216] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-26T18:25:39.156695] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-09-26T18:25:39.759174] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-26T18:25:39.777342] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-26T18:25:39.956760] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-09-26T18:25:40.756732] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-09-26T18:25:41.556718] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-09-26T18:25:41.710698] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-26T18:25:42.198054] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-26T18:25:42.356709] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-09-26T18:25:42.518257] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-26T18:25:43.156747] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-09-26T18:25:43.956706] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-09-26T18:25:44.386609] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-26T18:25:44.479912] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-26T18:25:44.513560] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-26T18:25:44.756734] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-09-26T18:25:45.556703] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-09-26T18:25:45.653410] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-26T18:25:46.356762] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-09-26T18:25:47.156701] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-09-26T18:25:47.198183] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-26T18:25:47.965961] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-09-26T18:25:47.985552] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-26T18:25:48.547861] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-26T18:25:48.756775] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-09-26T18:25:49.046210] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-26T18:25:49.556748] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-09-26T18:25:50.356706] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-09-26T18:25:50.466194] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-26T18:25:50.698002] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-26T18:25:50.868293] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-26T18:25:51.156761] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-09-26T18:25:51.956786] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-09-26T18:25:52.711999] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-26T18:25:52.756704] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-09-26T18:25:52.955573] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-26T18:25:53.556753] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-09-26T18:25:54.356731] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-09-26T18:25:54.512426] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-26T18:25:54.515099] [INFO ] [REMOTE ] DRLL: Full fetch complete (15734 records). [2025-09-26T18:25:54.515278] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-09-26T18:25:54.926487] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-09-26T18:25:54.926716] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-09-26T18:25:54.927144] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-09-26T18:25:54.927628] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-09-26T18:25:54.928766] [DEBUG] [LOCAL ] DRLL: Trimmed 15734 records to 9737 (keeping 200 days of data) [2025-09-26T18:25:54.991593] [DEBUG] [LOCAL ] DRLL: Primary data saved (9737 records). [2025-09-26T18:25:55.006897] [INFO ] [MAIN ] DRLL: Full history saved. [2025-09-26T18:25:55.019226] [INFO ] [MAIN ] Update Progress: 649/2371 symbols completed. DRLL took 22.0s. Estimated remaining: 3h 47m 50s. Rate: 7.6 symbols/min [2025-09-26T18:25:55.089943] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-26T18:25:55.161919] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-09-26T18:25:55.215579] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:25:55.246575] [DEBUG] [LOCAL ] DSL: Loaded 28428 existing records from primary storage. [2025-09-26T18:25:55.246750] [INFO ] [MAIN ] DSL: Loaded 28428 existing records. [2025-09-26T18:25:55.441870] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:25:55.442200] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-09-26T18:25:55.442273] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-09-26T18:25:55.443252] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-09-26T18:25:55.443318] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-09-26T18:25:55.850174] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:25:55.870887] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-26T18:25:55.956698] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-09-26T18:25:56.727602] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-26T18:25:56.756735] [INFO ] [REMOTE ] DSL: Fetching primary data for 2024-12. [2025-09-26T18:25:57.286951] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-26T18:25:57.556721] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-09-26T18:25:57.711546] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-26T18:25:58.356733] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-09-26T18:25:59.053505] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-26T18:25:59.063837] [INFO ] [REMOTE ] DRH: Full fetch complete (71865 records). [2025-09-26T18:25:59.064045] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-09-26T18:25:59.161884] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-09-26T18:25:59.500863] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-09-26T18:25:59.501025] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-09-26T18:25:59.501984] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-09-26T18:25:59.502095] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-09-26T18:25:59.504223] [DEBUG] [LOCAL ] DRH: Trimmed 71865 records to 51205 (keeping 200 days of data) [2025-09-26T18:25:59.539384] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-26T18:25:59.887198] [DEBUG] [LOCAL ] DRH: Primary data saved (51205 records). [2025-09-26T18:25:59.887396] [INFO ] [MAIN ] DRH: Full history saved. [2025-09-26T18:25:59.887500] [INFO ] [MAIN ] Update Progress: 650/2371 symbols completed. DRH took 31.3s. Estimated remaining: 3h 47m 34s. Rate: 7.6 symbols/min [2025-09-26T18:25:59.961813] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-09-26T18:26:00.083097] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:26:00.083442] [DEBUG] [LOCAL ] DSM: No existing data file found in primary storage. [2025-09-26T18:26:00.083735] [WARN ] [MAIN ] DSM: No existing data found, performing full refresh instead. [2025-09-26T18:26:00.084059] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-09-26T18:26:00.084231] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-09-26T18:26:00.089827] [DEBUG] [LOCAL ] DSM: No primary data file found to delete. [2025-09-26T18:26:00.099522] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-09-26T18:26:00.106097] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-26T18:26:00.489278] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:26:00.756771] [INFO ] [REMOTE ] DSM: Fetching primary data for 2024-12. [2025-09-26T18:26:01.526487] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-26T18:26:01.566429] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-09-26T18:26:01.575693] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-26T18:26:02.356764] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-09-26T18:26:02.536198] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-26T18:26:03.156748] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-09-26T18:26:03.335410] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-26T18:26:03.956727] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-09-26T18:26:04.756734] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-09-26T18:26:05.273049] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-26T18:26:05.284281] [INFO ] [REMOTE ] DRD: Full fetch complete (49385 records). [2025-09-26T18:26:05.284464] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-09-26T18:26:05.569705] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-09-26T18:26:05.740706] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-26T18:26:05.773104] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-09-26T18:26:05.773725] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-09-26T18:26:05.774811] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-09-26T18:26:05.774938] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-09-26T18:26:05.777016] [DEBUG] [LOCAL ] DRD: Trimmed 49385 records to 37397 (keeping 200 days of data) [2025-09-26T18:26:06.021826] [DEBUG] [LOCAL ] DRD: Primary data saved (37397 records). [2025-09-26T18:26:06.021992] [INFO ] [MAIN ] DRD: Full history saved. [2025-09-26T18:26:06.022084] [INFO ] [MAIN ] Update Progress: 651/2371 symbols completed. DRD took 42.1s. Estimated remaining: 3h 47m 21s. Rate: 7.6 symbols/min [2025-09-26T18:26:06.210450] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:26:06.229024] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-26T18:26:06.231033] [DEBUG] [LOCAL ] DSMC: Loaded 1956 existing records from primary storage. [2025-09-26T18:26:06.231242] [INFO ] [MAIN ] DSMC: Loaded 1956 existing records. [2025-09-26T18:26:06.361778] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-09-26T18:26:06.439777] [WARN ] [MAIN ] DSMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:26:06.440119] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-09-26T18:26:06.440177] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-09-26T18:26:06.440458] [DEBUG] [LOCAL ] DSMC: Deleted primary data file. [2025-09-26T18:26:06.440521] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-09-26T18:26:06.847562] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-26T18:26:06.889257] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:26:07.156726] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-09-26T18:26:07.956734] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-09-26T18:26:08.323372] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-26T18:26:08.333537] [INFO ] [REMOTE ] DRI: Full fetch complete (69620 records). [2025-09-26T18:26:08.333745] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-09-26T18:26:08.466096] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-26T18:26:08.770128] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-09-26T18:26:08.795011] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-09-26T18:26:08.795135] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-09-26T18:26:08.796267] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-09-26T18:26:08.796342] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-09-26T18:26:08.798122] [DEBUG] [LOCAL ] DRI: Trimmed 69620 records to 48554 (keeping 200 days of data) [2025-09-26T18:26:09.111841] [DEBUG] [LOCAL ] DRI: Primary data saved (48554 records). [2025-09-26T18:26:09.112021] [INFO ] [MAIN ] DRI: Full history saved. [2025-09-26T18:26:09.112809] [INFO ] [MAIN ] Update Progress: 652/2371 symbols completed. DRI took 37.9s. Estimated remaining: 3h 47m 0s. Rate: 7.6 symbols/min [2025-09-26T18:26:09.301691] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:26:09.326227] [DEBUG] [LOCAL ] DSU: Loaded 22429 existing records from primary storage. [2025-09-26T18:26:09.326375] [INFO ] [MAIN ] DSU: Loaded 22429 existing records. [2025-09-26T18:26:09.532413] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:26:09.551972] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-09-26T18:26:09.554600] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-09-26T18:26:09.556720] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-09-26T18:26:09.556774] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-12. [2025-09-26T18:26:09.556668] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T18:26:09.557881] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-09-26T18:26:09.977009] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:26:09.985781] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-26T18:26:10.230428] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-26T18:26:10.356768] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-09-26T18:26:10.797629] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-26T18:26:11.156777] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-09-26T18:26:11.603088] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-26T18:26:11.956728] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-09-26T18:26:12.756794] [INFO ] [REMOTE ] DSU: Fetching primary data for 2024-12. [2025-09-26T18:26:12.950589] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-26T18:26:13.556772] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-09-26T18:26:14.025171] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-26T18:26:14.200371] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-26T18:26:14.356746] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-09-26T18:26:15.156724] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-09-26T18:26:15.536302] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-26T18:26:15.592064] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-26T18:26:15.956787] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-09-26T18:26:16.756745] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-09-26T18:26:17.001503] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-26T18:26:17.556723] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-09-26T18:26:17.991913] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-26T18:26:18.186484] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-26T18:26:18.356746] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-09-26T18:26:19.156708] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-09-26T18:26:19.418260] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-26T18:26:19.421705] [INFO ] [REMOTE ] DSM: Full fetch complete (24807 records). [2025-09-26T18:26:19.421811] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-09-26T18:26:19.547897] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-26T18:26:19.833017] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-09-26T18:26:19.833119] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-09-26T18:26:19.833567] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-09-26T18:26:19.833616] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-09-26T18:26:19.834552] [DEBUG] [LOCAL ] DSM: Trimmed 24807 records to 15895 (keeping 200 days of data) [2025-09-26T18:26:19.934122] [DEBUG] [LOCAL ] DSM: Primary data saved (15895 records). [2025-09-26T18:26:19.934301] [INFO ] [MAIN ] DSM: Full history saved. [2025-09-26T18:26:19.934418] [INFO ] [MAIN ] Update Progress: 653/2371 symbols completed. DSM took 20.0s. Estimated remaining: 3h 46m 60s. Rate: 7.6 symbols/min [2025-09-26T18:26:19.965270] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-09-26T18:26:20.126749] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:26:20.150444] [DEBUG] [LOCAL ] DSX: Loaded 24488 existing records from primary storage. [2025-09-26T18:26:20.150578] [INFO ] [MAIN ] DSX: Loaded 24488 existing records. [2025-09-26T18:26:20.336046] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:26:20.336294] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-09-26T18:26:20.336343] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-09-26T18:26:20.337117] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-09-26T18:26:20.337205] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-09-26T18:26:20.717978] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:26:20.756762] [INFO ] [REMOTE ] DSX: Fetching primary data for 2024-12. [2025-09-26T18:26:21.231980] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-26T18:26:21.556737] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-09-26T18:26:22.275972] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-26T18:26:22.356709] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-09-26T18:26:22.706457] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-26T18:26:23.156721] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-09-26T18:26:23.210585] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-26T18:26:23.956755] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-09-26T18:26:24.112017] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-26T18:26:24.756732] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-09-26T18:26:24.765089] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-26T18:26:25.556723] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-09-26T18:26:25.920910] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-26T18:26:26.356758] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-09-26T18:26:26.701403] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-26T18:26:27.011779] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-26T18:26:27.156725] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-09-26T18:26:27.956757] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-09-26T18:26:28.395807] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-26T18:26:28.756814] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-09-26T18:26:28.865930] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-26T18:26:29.556779] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-09-26T18:26:29.604854] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-26T18:26:30.356759] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-09-26T18:26:30.904621] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-26T18:26:30.911009] [INFO ] [REMOTE ] DSL: Full fetch complete (41320 records). [2025-09-26T18:26:30.911267] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-09-26T18:26:31.165934] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-09-26T18:26:31.351185] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-09-26T18:26:31.351436] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-09-26T18:26:31.352114] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-09-26T18:26:31.352382] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-09-26T18:26:31.372505] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-26T18:26:31.378970] [DEBUG] [LOCAL ] DSL: Trimmed 41320 records to 28651 (keeping 200 days of data) [2025-09-26T18:26:31.578361] [DEBUG] [LOCAL ] DSL: Primary data saved (28651 records). [2025-09-26T18:26:31.578517] [INFO ] [MAIN ] DSL: Full history saved. [2025-09-26T18:26:31.578773] [INFO ] [MAIN ] Update Progress: 654/2371 symbols completed. DSL took 36.6s. Estimated remaining: 3h 47m 2s. Rate: 7.6 symbols/min [2025-09-26T18:26:31.765133] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:26:31.827601] [DEBUG] [LOCAL ] DT: Loaded 53323 existing records from primary storage. [2025-09-26T18:26:31.827846] [INFO ] [MAIN ] DT: Loaded 53323 existing records. [2025-09-26T18:26:31.961811] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-09-26T18:26:32.031313] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:26:32.031623] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-09-26T18:26:32.031727] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-09-26T18:26:32.033115] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-09-26T18:26:32.033193] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-09-26T18:26:32.371855] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-26T18:26:32.461564] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:26:32.756728] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-09-26T18:26:33.233017] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-26T18:26:33.556706] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-12. [2025-09-26T18:26:33.871999] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-26T18:26:34.356770] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-09-26T18:26:34.733241] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-26T18:26:35.137505] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-26T18:26:35.156674] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-09-26T18:26:35.956735] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-09-26T18:26:36.756736] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-09-26T18:26:37.124704] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-26T18:26:37.455788] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-26T18:26:37.556748] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-09-26T18:26:37.615070] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-26T18:26:38.356748] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-09-26T18:26:39.037582] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-26T18:26:39.156713] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-09-26T18:26:39.456541] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-26T18:26:39.956818] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-09-26T18:26:40.392303] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-26T18:26:40.756724] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-09-26T18:26:40.802452] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-26T18:26:41.322236] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-26T18:26:41.323322] [INFO ] [REMOTE ] DSMC: Full fetch complete (2870 records). [2025-09-26T18:26:41.323401] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-09-26T18:26:41.323998] [FATAL] [VALIDATOR ] DSMC: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:26:41.324124] [FATAL] [MAIN ] DSMC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:26:41.324183] [WARN ] [MAIN ] DSMC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:26:41.324269] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-09-26T18:26:41.324365] [DEBUG] [LOCAL ] DSMC: No primary data file found to delete. [2025-09-26T18:26:41.324438] [INFO ] [LOCAL ] DSMC: Starting deletion of derivative data. [2025-09-26T18:26:41.325438] [DEBUG] [LOCAL ] DSMC: Deleted derivative data file. [2025-09-26T18:26:41.325591] [INFO ] [MAIN ] Update Progress: 655/2371 symbols completed. DSMC took 35.3s. Estimated remaining: 3h 46m 59s. Rate: 7.6 symbols/min [2025-09-26T18:26:41.513874] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:26:41.528093] [DEBUG] [LOCAL ] DTB: Loaded 4784 existing records from primary storage. [2025-09-26T18:26:41.528227] [INFO ] [MAIN ] DTB: Loaded 4784 existing records. [2025-09-26T18:26:41.561821] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-09-26T18:26:41.730759] [WARN ] [MAIN ] DTB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:26:41.731008] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-09-26T18:26:41.731057] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-09-26T18:26:41.731349] [DEBUG] [LOCAL ] DTB: Deleted primary data file. [2025-09-26T18:26:41.731410] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-09-26T18:26:42.120307] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:26:42.356750] [INFO ] [REMOTE ] DTB: Fetching primary data for 2024-12. [2025-09-26T18:26:42.981390] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-26T18:26:42.987488] [INFO ] [REMOTE ] DSU: Full fetch complete (32594 records). [2025-09-26T18:26:42.987623] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-09-26T18:26:43.161340] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-26T18:26:43.161422] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-09-26T18:26:43.453193] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-09-26T18:26:43.453287] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-09-26T18:26:43.453873] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-09-26T18:26:43.453942] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-09-26T18:26:43.455701] [DEBUG] [LOCAL ] DSU: Trimmed 32594 records to 22684 (keeping 200 days of data) [2025-09-26T18:26:43.608786] [DEBUG] [LOCAL ] DSU: Primary data saved (22684 records). [2025-09-26T18:26:43.608927] [INFO ] [MAIN ] DSU: Full history saved. [2025-09-26T18:26:43.609037] [INFO ] [MAIN ] Update Progress: 656/2371 symbols completed. DSU took 34.5s. Estimated remaining: 3h 46m 36s. Rate: 7.6 symbols/min [2025-09-26T18:26:43.798968] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:26:43.799172] [DEBUG] [LOCAL ] DTE: No existing data file found in primary storage. [2025-09-26T18:26:43.799231] [WARN ] [MAIN ] DTE: No existing data found, performing full refresh instead. [2025-09-26T18:26:43.799385] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-09-26T18:26:43.799431] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-09-26T18:26:43.799475] [DEBUG] [LOCAL ] DTE: No primary data file found to delete. [2025-09-26T18:26:43.799513] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-09-26T18:26:43.986798] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-09-26T18:26:44.195803] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:26:44.756751] [INFO ] [REMOTE ] DTE: Fetching primary data for 2024-12. [2025-09-26T18:26:45.255614] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-26T18:26:45.421821] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-26T18:26:45.556727] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-09-26T18:26:46.337206] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-26T18:26:46.356700] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-09-26T18:26:46.936964] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-26T18:26:47.092417] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-26T18:26:47.156759] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-09-26T18:26:47.956732] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-09-26T18:26:48.544403] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-26T18:26:48.756737] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-09-26T18:26:48.815495] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-26T18:26:49.321670] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-26T18:26:49.556736] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-09-26T18:26:50.356721] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-09-26T18:26:51.123143] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-26T18:26:51.156728] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-09-26T18:26:51.501226] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-26T18:26:51.700693] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-26T18:26:51.956722] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-09-26T18:26:52.756769] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-09-26T18:26:53.118243] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-26T18:26:53.237285] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-26T18:26:53.556739] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-09-26T18:26:54.356795] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-09-26T18:26:54.949622] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-26T18:26:55.156769] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-09-26T18:26:55.282313] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-26T18:26:55.778483] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-26T18:26:55.956724] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-09-26T18:26:56.756727] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-09-26T18:26:57.396485] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-26T18:26:57.407716] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-26T18:26:57.411265] [INFO ] [REMOTE ] DSX: Full fetch complete (36939 records). [2025-09-26T18:26:57.411486] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-09-26T18:26:57.568563] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-09-26T18:26:57.833940] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-09-26T18:26:57.834039] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-09-26T18:26:57.834665] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-09-26T18:26:57.834736] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-09-26T18:26:57.835834] [DEBUG] [LOCAL ] DSX: Trimmed 36939 records to 24642 (keeping 200 days of data) [2025-09-26T18:26:58.002699] [DEBUG] [LOCAL ] DSX: Primary data saved (24642 records). [2025-09-26T18:26:58.002869] [INFO ] [MAIN ] DSX: Full history saved. [2025-09-26T18:26:58.002984] [INFO ] [MAIN ] Update Progress: 657/2371 symbols completed. DSX took 38.1s. Estimated remaining: 3h 46m 45s. Rate: 7.6 symbols/min [2025-09-26T18:26:58.202191] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:26:58.202434] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-09-26T18:26:58.202492] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-09-26T18:26:58.202700] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-09-26T18:26:58.202756] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-26T18:26:58.202803] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-26T18:26:58.202837] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-09-26T18:26:58.361809] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-09-26T18:26:58.603102] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:26:59.156703] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-09-26T18:26:59.207702] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-26T18:26:59.209612] [INFO ] [REMOTE ] DTB: Full fetch complete (6866 records). [2025-09-26T18:26:59.209736] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-09-26T18:26:59.591821] [DEBUG] [VALIDATOR ] DTB: All expected trading days are present. [2025-09-26T18:26:59.591906] [DEBUG] [VALIDATOR ] DTB: Primary data validation passed. [2025-09-26T18:26:59.592115] [INFO ] [MAIN ] DTB: Fetched primary data is valid. [2025-09-26T18:26:59.592157] [DEBUG] [LOCAL ] DTB: Saving primary data. [2025-09-26T18:26:59.592595] [DEBUG] [LOCAL ] DTB: Trimmed 6866 records to 4817 (keeping 200 days of data) [2025-09-26T18:26:59.625540] [DEBUG] [LOCAL ] DTB: Primary data saved (4817 records). [2025-09-26T18:26:59.625704] [INFO ] [MAIN ] DTB: Full history saved. [2025-09-26T18:26:59.625827] [INFO ] [MAIN ] Update Progress: 658/2371 symbols completed. DTB took 18.3s. Estimated remaining: 3h 46m 20s. Rate: 7.6 symbols/min [2025-09-26T18:26:59.827016] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:26:59.835623] [DEBUG] [LOCAL ] DTG: Loaded 5918 existing records from primary storage. [2025-09-26T18:26:59.835768] [INFO ] [MAIN ] DTG: Loaded 5918 existing records. [2025-09-26T18:26:59.956788] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-12. [2025-09-26T18:27:00.033172] [WARN ] [MAIN ] DTG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:27:00.033806] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-09-26T18:27:00.034325] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-09-26T18:27:00.034791] [DEBUG] [LOCAL ] DTG: Deleted primary data file. [2025-09-26T18:27:00.034857] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-09-26T18:27:00.189850] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-09-26T18:27:00.477691] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:27:00.756731] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-09-26T18:27:00.771584] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-26T18:27:01.362044] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-26T18:27:01.556739] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-09-26T18:27:02.057312] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-26T18:27:02.356731] [INFO ] [REMOTE ] DTG: Fetching primary data for 2024-12. [2025-09-26T18:27:02.607534] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-26T18:27:02.970187] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-26T18:27:03.156730] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-09-26T18:27:03.780275] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-26T18:27:03.956734] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-09-26T18:27:04.756722] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-09-26T18:27:05.400601] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-26T18:27:05.556695] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-09-26T18:27:05.717727] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-26T18:27:05.976592] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-26T18:27:06.356723] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-09-26T18:27:07.083015] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-26T18:27:07.156801] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-09-26T18:27:07.956745] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-09-26T18:27:08.570010] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-26T18:27:08.756732] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-09-26T18:27:08.841083] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-26T18:27:08.851946] [INFO ] [REMOTE ] DT: Full fetch complete (76246 records). [2025-09-26T18:27:08.852124] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-09-26T18:27:08.854541] [FATAL] [VALIDATOR ] DT: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:27:08.854680] [FATAL] [MAIN ] DT: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:27:08.854762] [WARN ] [MAIN ] DT: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:27:08.854842] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-09-26T18:27:08.854916] [DEBUG] [LOCAL ] DT: No primary data file found to delete. [2025-09-26T18:27:08.854958] [INFO ] [LOCAL ] DT: Starting deletion of derivative data. [2025-09-26T18:27:08.855386] [DEBUG] [LOCAL ] DT: Deleted derivative data file. [2025-09-26T18:27:08.855495] [INFO ] [MAIN ] Update Progress: 659/2371 symbols completed. DT took 37.3s. Estimated remaining: 3h 46m 16s. Rate: 7.6 symbols/min [2025-09-26T18:27:09.041358] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:27:09.041584] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-09-26T18:27:09.041635] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-09-26T18:27:09.041808] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-09-26T18:27:09.041851] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-09-26T18:27:09.041894] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-09-26T18:27:09.041926] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-09-26T18:27:09.205261] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-26T18:27:09.445213] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:27:09.556740] [INFO ] [REMOTE ] DTK: Fetching primary data for 2024-12. [2025-09-26T18:27:09.763624] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:27:09.764006] [WARN ] [REMOTE ] DTK: No data returned for month 2024-12 [2025-09-26T18:27:10.356734] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-01. [2025-09-26T18:27:10.556469] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:27:10.556835] [WARN ] [REMOTE ] DTK: No data returned for month 2025-01 [2025-09-26T18:27:11.156723] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-09-26T18:27:11.956738] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-02. [2025-09-26T18:27:12.165568] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:27:12.165952] [WARN ] [REMOTE ] DTK: No data returned for month 2025-02 [2025-09-26T18:27:12.756702] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-03. [2025-09-26T18:27:12.951844] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-26T18:27:12.978992] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:27:12.979353] [WARN ] [REMOTE ] DTK: No data returned for month 2025-03 [2025-09-26T18:27:13.556720] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-09-26T18:27:14.252445] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-26T18:27:14.356774] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-04. [2025-09-26T18:27:14.591576] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:27:14.592099] [WARN ] [REMOTE ] DTK: No data returned for month 2025-04 [2025-09-26T18:27:15.156757] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-09-26T18:27:15.632017] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-26T18:27:15.956792] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-09-26T18:27:16.612281] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-26T18:27:16.756771] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-09-26T18:27:17.515005] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-26T18:27:17.516807] [INFO ] [REMOTE ] DTG: Full fetch complete (8996 records). [2025-09-26T18:27:17.516888] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-09-26T18:27:17.561902] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-05. [2025-09-26T18:27:17.866009] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:27:17.907974] [WARN ] [REMOTE ] DTK: No data returned for month 2025-05 [2025-09-26T18:27:17.917818] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present. [2025-09-26T18:27:17.917925] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed. [2025-09-26T18:27:17.918252] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-09-26T18:27:17.918313] [DEBUG] [LOCAL ] DTG: Saving primary data. [2025-09-26T18:27:17.918856] [DEBUG] [LOCAL ] DTG: Trimmed 8996 records to 5952 (keeping 200 days of data) [2025-09-26T18:27:17.956782] [DEBUG] [LOCAL ] DTG: Primary data saved (5952 records). [2025-09-26T18:27:17.956911] [INFO ] [MAIN ] DTG: Full history saved. [2025-09-26T18:27:17.957011] [INFO ] [MAIN ] Update Progress: 660/2371 symbols completed. DTG took 18.3s. Estimated remaining: 3h 46m 11s. Rate: 7.6 symbols/min [2025-09-26T18:27:18.137452] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:27:18.199061] [DEBUG] [LOCAL ] DTM: Loaded 44667 existing records from primary storage. [2025-09-26T18:27:18.199215] [INFO ] [MAIN ] DTM: Loaded 44667 existing records. [2025-09-26T18:27:18.368477] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-06. [2025-09-26T18:27:18.390576] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:27:18.390878] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-09-26T18:27:18.390928] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-09-26T18:27:18.392130] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-09-26T18:27:18.392193] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-09-26T18:27:18.669949] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:27:18.697811] [WARN ] [REMOTE ] DTK: No data returned for month 2025-06 [2025-09-26T18:27:18.789751] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:27:19.156731] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-09-26T18:27:19.583202] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-26T18:27:19.956733] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-07. [2025-09-26T18:27:20.349441] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:27:20.349798] [WARN ] [REMOTE ] DTK: No data returned for month 2025-07 [2025-09-26T18:27:20.756731] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-09-26T18:27:21.556719] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-09-26T18:27:22.004882] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-26T18:27:22.356730] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-08. [2025-09-26T18:27:22.410235] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-26T18:27:22.557810] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:27:22.558195] [WARN ] [REMOTE ] DTK: No data returned for month 2025-08 [2025-09-26T18:27:23.156770] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-09. [2025-09-26T18:27:23.956770] [INFO ] [REMOTE ] DTM: Fetching primary data for 2024-12. [2025-09-26T18:27:24.007237] [INFO ] [REMOTE ] DTK: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-26T18:27:24.008991] [INFO ] [REMOTE ] DTK: Full fetch complete (758 records). [2025-09-26T18:27:24.009076] [DEBUG] [VALIDATOR ] DTK: Validating primary data. [2025-09-26T18:27:24.009484] [FATAL] [VALIDATOR ] DTK: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:27:24.009571] [FATAL] [MAIN ] DTK: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:27:24.009616] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:27:24.009692] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-09-26T18:27:24.009818] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-09-26T18:27:24.009902] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-09-26T18:27:24.010015] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-09-26T18:27:24.010122] [INFO ] [MAIN ] Update Progress: 661/2371 symbols completed. DTK took 15.2s. Estimated remaining: 3h 45m 58s. Rate: 7.6 symbols/min [2025-09-26T18:27:24.207000] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:27:24.216021] [DEBUG] [LOCAL ] DTW: Loaded 4905 existing records from primary storage. [2025-09-26T18:27:24.216144] [INFO ] [MAIN ] DTW: Loaded 4905 existing records. [2025-09-26T18:27:24.412442] [WARN ] [MAIN ] DTW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:27:24.412742] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-09-26T18:27:24.412802] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-09-26T18:27:24.413121] [DEBUG] [LOCAL ] DTW: Deleted primary data file. [2025-09-26T18:27:24.413181] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-09-26T18:27:24.761890] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-09-26T18:27:24.890294] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:27:25.554444] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-26T18:27:25.563499] [INFO ] [REMOTE ] DTW: Fetching primary data for 2024-12. [2025-09-26T18:27:26.177214] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-26T18:27:26.226759] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-26T18:27:26.356704] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-09-26T18:27:27.057224] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-26T18:27:27.156778] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-09-26T18:27:27.729946] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-26T18:27:27.956740] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-09-26T18:27:28.462779] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-26T18:27:28.756719] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-09-26T18:27:29.556722] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-09-26T18:27:29.902428] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-26T18:27:30.312224] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-26T18:27:30.356694] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-09-26T18:27:31.156726] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-09-26T18:27:31.956721] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-09-26T18:27:31.976629] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-26T18:27:32.006606] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-26T18:27:32.756774] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-09-26T18:27:33.556697] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-09-26T18:27:33.814707] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-26T18:27:33.824258] [INFO ] [REMOTE ] DTE: Full fetch complete (69104 records). [2025-09-26T18:27:33.824397] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-09-26T18:27:33.941145] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-26T18:27:34.256355] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-09-26T18:27:34.256508] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-09-26T18:27:34.257446] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-09-26T18:27:34.257516] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-09-26T18:27:34.258984] [DEBUG] [LOCAL ] DTE: Trimmed 69104 records to 48557 (keeping 200 days of data) [2025-09-26T18:27:34.363994] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-09-26T18:27:34.603125] [DEBUG] [LOCAL ] DTE: Primary data saved (48557 records). [2025-09-26T18:27:34.603423] [INFO ] [MAIN ] DTE: Full history saved. [2025-09-26T18:27:34.603526] [INFO ] [MAIN ] Update Progress: 662/2371 symbols completed. DTE took 51.0s. Estimated remaining: 3h 45m 57s. Rate: 7.6 symbols/min [2025-09-26T18:27:34.729094] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-26T18:27:34.737793] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-26T18:27:34.882689] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:27:34.943891] [DEBUG] [LOCAL ] DUK: Loaded 53849 existing records from primary storage. [2025-09-26T18:27:34.944047] [INFO ] [MAIN ] DUK: Loaded 53849 existing records. [2025-09-26T18:27:35.156912] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-09-26T18:27:35.156768] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:27:35.158407] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-09-26T18:27:35.158521] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-09-26T18:27:35.160024] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-09-26T18:27:35.160122] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-09-26T18:27:35.560161] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:27:35.661977] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-26T18:27:35.956771] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-09-26T18:27:36.756769] [INFO ] [REMOTE ] DUK: Fetching primary data for 2024-12. [2025-09-26T18:27:37.553663] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T18:27:37.563742] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-09-26T18:27:38.070257] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-26T18:27:38.071191] [INFO ] [REMOTE ] DTF: Full fetch complete (2111 records). [2025-09-26T18:27:38.071261] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-09-26T18:27:38.265557] [WARN ] [VALIDATOR ] DTF: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-26T18:27:38.265878] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:27:38.266130] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:27:38.266288] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-26T18:27:38.266461] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-26T18:27:38.266535] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-09-26T18:27:38.266735] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-09-26T18:27:38.266823] [INFO ] [MAIN ] Update Progress: 663/2371 symbols completed. DTF took 40.3s. Estimated remaining: 3h 45m 38s. Rate: 7.6 symbols/min [2025-09-26T18:27:38.361921] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-09-26T18:27:38.459336] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:27:38.498758] [DEBUG] [LOCAL ] DUKB: Loaded 6389 existing records from primary storage. [2025-09-26T18:27:38.500766] [INFO ] [MAIN ] DUKB: Loaded 6389 existing records. [2025-09-26T18:27:38.500628] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-26T18:27:38.711447] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:27:38.711782] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-09-26T18:27:38.711840] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-09-26T18:27:38.712320] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-09-26T18:27:38.712385] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-09-26T18:27:39.109427] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:27:39.156739] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2024-12. [2025-09-26T18:27:39.956697] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-09-26T18:27:40.043227] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-26T18:27:40.077857] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-26T18:27:40.756755] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-09-26T18:27:41.253784] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-26T18:27:41.523439] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T18:27:41.556742] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-09-26T18:27:42.179437] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-26T18:27:42.356729] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-09-26T18:27:43.156754] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-09-26T18:27:43.944145] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-26T18:27:43.956672] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-09-26T18:27:44.515125] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-26T18:27:44.756803] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-09-26T18:27:45.256840] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-26T18:27:45.257130] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-26T18:27:45.556743] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-09-26T18:27:46.356723] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-09-26T18:27:47.129905] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-26T18:27:47.156707] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-09-26T18:27:47.204372] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-26T18:27:47.753190] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-26T18:27:47.956764] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-09-26T18:27:48.756753] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-09-26T18:27:49.488349] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-26T18:27:49.556717] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-09-26T18:27:49.747925] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-26T18:27:49.756864] [INFO ] [REMOTE ] DTM: Full fetch complete (64852 records). [2025-09-26T18:27:49.757017] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-09-26T18:27:50.207235] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-26T18:27:50.234468] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-09-26T18:27:50.234951] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-09-26T18:27:50.235781] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-09-26T18:27:50.235848] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-09-26T18:27:50.237394] [DEBUG] [LOCAL ] DTM: Trimmed 64852 records to 45043 (keeping 200 days of data) [2025-09-26T18:27:50.356808] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-09-26T18:27:50.543545] [DEBUG] [LOCAL ] DTM: Primary data saved (45043 records). [2025-09-26T18:27:50.543773] [INFO ] [MAIN ] DTM: Full history saved. [2025-09-26T18:27:50.543898] [INFO ] [MAIN ] Update Progress: 664/2371 symbols completed. DTM took 32.6s. Estimated remaining: 3h 45m 42s. Rate: 7.6 symbols/min [2025-09-26T18:27:50.734973] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:27:50.787684] [DEBUG] [LOCAL ] DV: Loaded 51659 existing records from primary storage. [2025-09-26T18:27:50.787835] [INFO ] [MAIN ] DV: Loaded 51659 existing records. [2025-09-26T18:27:50.914597] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-26T18:27:50.993458] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:27:50.993766] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-09-26T18:27:50.993834] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-09-26T18:27:50.995116] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-09-26T18:27:50.995187] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-09-26T18:27:51.161922] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-09-26T18:27:51.378970] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:27:51.797144] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-26T18:27:51.956732] [INFO ] [REMOTE ] DV: Fetching primary data for 2024-12. [2025-09-26T18:27:52.756733] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-09-26T18:27:53.363611] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-26T18:27:53.556732] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-09-26T18:27:53.736182] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-26T18:27:54.199171] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-26T18:27:54.356738] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-09-26T18:27:55.130849] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-26T18:27:55.133289] [INFO ] [REMOTE ] DTW: Full fetch complete (7683 records). [2025-09-26T18:27:55.133364] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-09-26T18:27:55.164616] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-09-26T18:27:55.513625] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present. [2025-09-26T18:27:55.513739] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed. [2025-09-26T18:27:55.513942] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-09-26T18:27:55.513981] [DEBUG] [LOCAL ] DTW: Saving primary data. [2025-09-26T18:27:55.514570] [DEBUG] [LOCAL ] DTW: Trimmed 7683 records to 4923 (keeping 200 days of data) [2025-09-26T18:27:55.546424] [DEBUG] [LOCAL ] DTW: Primary data saved (4923 records). [2025-09-26T18:27:55.546581] [INFO ] [MAIN ] DTW: Full history saved. [2025-09-26T18:27:55.546706] [INFO ] [MAIN ] Update Progress: 665/2371 symbols completed. DTW took 31.5s. Estimated remaining: 3h 45m 26s. Rate: 7.6 symbols/min [2025-09-26T18:27:55.727892] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:27:55.773220] [DEBUG] [LOCAL ] DVA: Loaded 41631 existing records from primary storage. [2025-09-26T18:27:55.773372] [INFO ] [MAIN ] DVA: Loaded 41631 existing records. [2025-09-26T18:27:55.957705] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-09-26T18:27:55.988080] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:27:55.989769] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-09-26T18:27:55.989844] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-09-26T18:27:55.991189] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-09-26T18:27:55.991263] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-09-26T18:27:56.434495] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:27:56.584381] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-26T18:27:56.756729] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-09-26T18:27:56.849601] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-26T18:27:57.556733] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-09-26T18:27:58.341451] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-26T18:27:58.358481] [INFO ] [REMOTE ] DVA: Fetching primary data for 2024-12. [2025-09-26T18:27:58.360818] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-26T18:27:58.364314] [INFO ] [REMOTE ] DUKB: Full fetch complete (9519 records). [2025-09-26T18:27:58.364468] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-09-26T18:27:58.749064] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-09-26T18:27:58.749151] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-09-26T18:27:58.749430] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-09-26T18:27:58.749472] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-09-26T18:27:58.750058] [DEBUG] [LOCAL ] DUKB: Trimmed 9519 records to 6414 (keeping 200 days of data) [2025-09-26T18:27:58.792052] [DEBUG] [LOCAL ] DUKB: Primary data saved (6414 records). [2025-09-26T18:27:58.792205] [INFO ] [MAIN ] DUKB: Full history saved. [2025-09-26T18:27:58.792301] [INFO ] [MAIN ] Update Progress: 666/2371 symbols completed. DUKB took 20.5s. Estimated remaining: 3h 45m 6s. Rate: 7.6 symbols/min [2025-09-26T18:27:58.970095] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:27:58.970266] [DEBUG] [LOCAL ] DVN: No existing data file found in primary storage. [2025-09-26T18:27:58.970304] [WARN ] [MAIN ] DVN: No existing data found, performing full refresh instead. [2025-09-26T18:27:58.970454] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-09-26T18:27:58.970535] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-09-26T18:27:58.970600] [DEBUG] [LOCAL ] DVN: No primary data file found to delete. [2025-09-26T18:27:58.970635] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-09-26T18:27:59.168010] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-09-26T18:27:59.348989] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:27:59.956708] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-09-26T18:28:00.064967] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-26T18:28:00.756817] [INFO ] [REMOTE ] DVN: Fetching primary data for 2024-12. [2025-09-26T18:28:01.334394] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-26T18:28:01.403862] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-26T18:28:01.556697] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-09-26T18:28:02.356724] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-09-26T18:28:02.925971] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-26T18:28:03.156725] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-09-26T18:28:03.266150] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-26T18:28:03.956728] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-09-26T18:28:04.255736] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-26T18:28:04.417123] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-26T18:28:04.756764] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-09-26T18:28:05.556736] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-09-26T18:28:05.739777] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-26T18:28:05.907153] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-26T18:28:06.356725] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-09-26T18:28:07.156778] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-09-26T18:28:07.326231] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-26T18:28:07.956769] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-09-26T18:28:08.007370] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-26T18:28:08.756720] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-09-26T18:28:09.106689] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-26T18:28:09.556722] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-09-26T18:28:09.794259] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-26T18:28:10.356755] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-09-26T18:28:10.506975] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-26T18:28:11.156715] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-09-26T18:28:11.565723] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-26T18:28:11.956773] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-09-26T18:28:12.463966] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-26T18:28:12.506351] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-26T18:28:12.756777] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-09-26T18:28:13.556777] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-09-26T18:28:13.869534] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-26T18:28:14.356711] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-09-26T18:28:14.655365] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-26T18:28:14.833898] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-26T18:28:15.156780] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-09-26T18:28:15.711699] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-26T18:28:15.956728] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-09-26T18:28:16.756780] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-09-26T18:28:17.060008] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-26T18:28:17.071251] [INFO ] [REMOTE ] DUK: Full fetch complete (77405 records). [2025-09-26T18:28:17.071431] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-09-26T18:28:17.514232] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-09-26T18:28:17.514383] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-09-26T18:28:17.515457] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-09-26T18:28:17.515549] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-09-26T18:28:17.541570] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-26T18:28:17.540303] [DEBUG] [LOCAL ] DUK: Trimmed 77405 records to 54238 (keeping 200 days of data) [2025-09-26T18:28:17.609934] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-09-26T18:28:17.908267] [DEBUG] [LOCAL ] DUK: Primary data saved (54238 records). [2025-09-26T18:28:17.908427] [INFO ] [MAIN ] DUK: Full history saved. [2025-09-26T18:28:17.908519] [INFO ] [MAIN ] Update Progress: 667/2371 symbols completed. DUK took 43.3s. Estimated remaining: 3h 45m 27s. Rate: 7.6 symbols/min [2025-09-26T18:28:18.104591] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:28:18.104904] [DEBUG] [LOCAL ] DX: No existing data file found in primary storage. [2025-09-26T18:28:18.105042] [WARN ] [MAIN ] DX: No existing data found, performing full refresh instead. [2025-09-26T18:28:18.105303] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-09-26T18:28:18.105373] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-09-26T18:28:18.105454] [DEBUG] [LOCAL ] DX: No primary data file found to delete. [2025-09-26T18:28:18.105667] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-09-26T18:28:18.308865] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T18:28:18.357276] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-09-26T18:28:18.556341] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:28:18.902509] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-26T18:28:19.156727] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-09-26T18:28:19.956778] [INFO ] [REMOTE ] DX: Fetching primary data for 2024-12. [2025-09-26T18:28:20.449625] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-26T18:28:20.756760] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-09-26T18:28:20.996749] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-26T18:28:21.556729] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-09-26T18:28:21.870403] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-26T18:28:22.356713] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-09-26T18:28:22.561370] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-26T18:28:22.570025] [INFO ] [REMOTE ] DVA: Full fetch complete (59731 records). [2025-09-26T18:28:22.570223] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-09-26T18:28:23.012087] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-09-26T18:28:23.012242] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-09-26T18:28:23.013107] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-09-26T18:28:23.013328] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-09-26T18:28:23.015082] [DEBUG] [LOCAL ] DVA: Trimmed 59731 records to 41877 (keeping 200 days of data) [2025-09-26T18:28:23.139140] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-26T18:28:23.157673] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-09-26T18:28:23.320005] [DEBUG] [LOCAL ] DVA: Primary data saved (41877 records). [2025-09-26T18:28:23.320166] [INFO ] [MAIN ] DVA: Full history saved. [2025-09-26T18:28:23.320289] [INFO ] [MAIN ] Update Progress: 668/2371 symbols completed. DVA took 27.8s. Estimated remaining: 3h 45m 12s. Rate: 7.6 symbols/min [2025-09-26T18:28:23.539790] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:28:23.601494] [DEBUG] [LOCAL ] DXC: Loaded 50066 existing records from primary storage. [2025-09-26T18:28:23.601679] [INFO ] [MAIN ] DXC: Loaded 50066 existing records. [2025-09-26T18:28:23.792729] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:28:23.793067] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-09-26T18:28:23.793131] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-09-26T18:28:23.794488] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-09-26T18:28:23.794570] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-09-26T18:28:23.961863] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-09-26T18:28:24.205701] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:28:24.314072] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-26T18:28:24.679875] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-26T18:28:24.756740] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-09-26T18:28:25.556726] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-09-26T18:28:25.749266] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-26T18:28:25.760410] [INFO ] [REMOTE ] DV: Full fetch complete (73326 records). [2025-09-26T18:28:25.760628] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-09-26T18:28:26.210833] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-09-26T18:28:26.211001] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-09-26T18:28:26.212077] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-09-26T18:28:26.212179] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-09-26T18:28:26.214363] [DEBUG] [LOCAL ] DV: Trimmed 73326 records to 52038 (keeping 200 days of data) [2025-09-26T18:28:26.244847] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-26T18:28:26.357722] [INFO ] [REMOTE ] DXC: Fetching primary data for 2024-12. [2025-09-26T18:28:26.570829] [DEBUG] [LOCAL ] DV: Primary data saved (52038 records). [2025-09-26T18:28:26.570980] [INFO ] [MAIN ] DV: Full history saved. [2025-09-26T18:28:26.571073] [INFO ] [MAIN ] Update Progress: 669/2371 symbols completed. DV took 36.0s. Estimated remaining: 3h 44m 53s. Rate: 7.6 symbols/min [2025-09-26T18:28:26.762340] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:28:26.802041] [DEBUG] [LOCAL ] DXYZ: Loaded 36924 existing records from primary storage. [2025-09-26T18:28:26.802208] [INFO ] [MAIN ] DXYZ: Loaded 36924 existing records. [2025-09-26T18:28:27.004115] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:28:27.004367] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-09-26T18:28:27.004417] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-09-26T18:28:27.005375] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-09-26T18:28:27.005441] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-09-26T18:28:27.167186] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-09-26T18:28:27.410764] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:28:27.751787] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-26T18:28:27.956745] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2024-12. [2025-09-26T18:28:28.076686] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-26T18:28:28.756764] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-09-26T18:28:29.105102] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-26T18:28:29.556741] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-09-26T18:28:29.863235] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-26T18:28:30.356779] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-09-26T18:28:30.667621] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2024-12 (2.71 seconds). [2025-09-26T18:28:31.156717] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-09-26T18:28:31.229701] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-26T18:28:31.454265] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-26T18:28:31.956727] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-09-26T18:28:32.756776] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-09-26T18:28:33.074852] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-26T18:28:33.167458] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-26T18:28:33.556732] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-09-26T18:28:34.356772] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-09-26T18:28:34.821229] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-26T18:28:34.832375] [INFO ] [REMOTE ] DVN: Full fetch complete (77766 records). [2025-09-26T18:28:34.832538] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-09-26T18:28:35.164321] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-09-26T18:28:35.271250] [DEBUG] [VALIDATOR ] DVN: All expected trading days are present. [2025-09-26T18:28:35.271393] [DEBUG] [VALIDATOR ] DVN: Primary data validation passed. [2025-09-26T18:28:35.272386] [INFO ] [MAIN ] DVN: Fetched primary data is valid. [2025-09-26T18:28:35.272571] [DEBUG] [LOCAL ] DVN: Saving primary data. [2025-09-26T18:28:35.312762] [DEBUG] [LOCAL ] DVN: Trimmed 77766 records to 54479 (keeping 200 days of data) [2025-09-26T18:28:35.312583] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-26T18:28:35.700379] [DEBUG] [LOCAL ] DVN: Primary data saved (54479 records). [2025-09-26T18:28:35.700683] [INFO ] [MAIN ] DVN: Full history saved. [2025-09-26T18:28:35.701071] [INFO ] [MAIN ] Update Progress: 670/2371 symbols completed. DVN took 36.9s. Estimated remaining: 3h 44m 48s. Rate: 7.6 symbols/min [2025-09-26T18:28:35.891791] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:28:35.932688] [DEBUG] [LOCAL ] DY: Loaded 29924 existing records from primary storage. [2025-09-26T18:28:35.932830] [INFO ] [MAIN ] DY: Loaded 29924 existing records. [2025-09-26T18:28:35.968167] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-09-26T18:28:36.134087] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:28:36.134386] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-09-26T18:28:36.134444] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-09-26T18:28:36.135347] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-09-26T18:28:36.135426] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-09-26T18:28:36.528299] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:28:36.663952] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-26T18:28:36.760352] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-09-26T18:28:36.766923] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-09-26T18:28:37.375030] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-26T18:28:37.556734] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-09-26T18:28:38.182696] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-26T18:28:38.356722] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-09-26T18:28:39.156733] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-09-26T18:28:39.257727] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-26T18:28:39.673504] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-26T18:28:39.956732] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-09-26T18:28:40.761836] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-09-26T18:28:40.784844] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-26T18:28:41.270774] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-26T18:28:41.556731] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-09-26T18:28:42.356727] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-09-26T18:28:42.873524] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-26T18:28:43.161877] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-09-26T18:28:43.185624] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-26T18:28:43.956707] [INFO ] [REMOTE ] DY: Fetching primary data for 2024-12. [2025-09-26T18:28:44.389025] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-26T18:28:44.756739] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-09-26T18:28:44.787227] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-26T18:28:45.182454] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-26T18:28:45.556742] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-09-26T18:28:46.356733] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-09-26T18:28:46.554576] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-26T18:28:46.657050] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-26T18:28:46.668026] [INFO ] [REMOTE ] DX: Full fetch complete (75365 records). [2025-09-26T18:28:46.668190] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-09-26T18:28:47.107226] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-09-26T18:28:47.107411] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-09-26T18:28:47.108472] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-09-26T18:28:47.108542] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-09-26T18:28:47.110407] [DEBUG] [LOCAL ] DX: Trimmed 75365 records to 53228 (keeping 200 days of data) [2025-09-26T18:28:47.174693] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-09-26T18:28:47.462494] [DEBUG] [LOCAL ] DX: Primary data saved (53228 records). [2025-09-26T18:28:47.462675] [INFO ] [MAIN ] DX: Full history saved. [2025-09-26T18:28:47.462792] [INFO ] [MAIN ] Update Progress: 671/2371 symbols completed. DX took 29.6s. Estimated remaining: 3h 44m 50s. Rate: 7.6 symbols/min [2025-09-26T18:28:47.646436] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:28:47.682586] [DEBUG] [LOCAL ] E: Loaded 33635 existing records from primary storage. [2025-09-26T18:28:47.682795] [INFO ] [MAIN ] E: Loaded 33635 existing records. [2025-09-26T18:28:47.878725] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:28:47.879072] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-09-26T18:28:47.879139] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-09-26T18:28:47.880200] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-09-26T18:28:47.880267] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-09-26T18:28:47.961072] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-09-26T18:28:48.384444] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:28:48.410728] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-26T18:28:48.441162] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-26T18:28:48.756728] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-09-26T18:28:49.556735] [INFO ] [REMOTE ] E: Fetching primary data for 2024-12. [2025-09-26T18:28:49.967916] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-26T18:28:49.981227] [INFO ] [REMOTE ] DXC: Full fetch complete (68912 records). [2025-09-26T18:28:49.981412] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-09-26T18:28:50.332883] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-26T18:28:50.360032] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-09-26T18:28:50.454124] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-09-26T18:28:50.454211] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-09-26T18:28:50.455018] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-09-26T18:28:50.455085] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-09-26T18:28:50.456876] [DEBUG] [LOCAL ] DXC: Trimmed 68912 records to 50456 (keeping 200 days of data) [2025-09-26T18:28:50.771053] [DEBUG] [LOCAL ] DXC: Primary data saved (50456 records). [2025-09-26T18:28:50.771472] [INFO ] [MAIN ] DXC: Full history saved. [2025-09-26T18:28:50.771596] [INFO ] [MAIN ] Update Progress: 672/2371 symbols completed. DXC took 27.5s. Estimated remaining: 3h 44m 30s. Rate: 7.6 symbols/min [2025-09-26T18:28:50.885338] [INFO ] [REMOTE ] E: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-26T18:28:51.007425] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:28:51.052906] [DEBUG] [LOCAL ] EAF: Loaded 43973 existing records from primary storage. [2025-09-26T18:28:51.053059] [INFO ] [MAIN ] EAF: Loaded 43973 existing records. [2025-09-26T18:28:51.162534] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-09-26T18:28:51.245747] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:28:51.246031] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-09-26T18:28:51.246095] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-09-26T18:28:51.247204] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-09-26T18:28:51.247283] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-09-26T18:28:51.633777] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:28:51.956711] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-09-26T18:28:52.337717] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-26T18:28:52.406497] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-26T18:28:52.756741] [INFO ] [REMOTE ] EAF: Fetching primary data for 2024-12. [2025-09-26T18:28:53.009406] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-26T18:28:53.556725] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-09-26T18:28:54.234297] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-26T18:28:54.356729] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-09-26T18:28:55.156714] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-09-26T18:28:55.258081] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-26T18:28:55.461849] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-26T18:28:55.956723] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-09-26T18:28:56.528308] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-26T18:28:56.756722] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-09-26T18:28:57.556702] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-09-26T18:28:58.014734] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-26T18:28:58.072615] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-26T18:28:58.356738] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-09-26T18:28:58.584201] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-26T18:28:59.156744] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-09-26T18:28:59.956782] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-09-26T18:29:00.081213] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T18:29:00.093634] [INFO ] [REMOTE ] DXYZ: Full fetch complete (57854 records). [2025-09-26T18:29:00.093885] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-09-26T18:29:00.270803] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-26T18:29:00.692915] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-09-26T18:29:00.693034] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-09-26T18:29:00.693915] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-09-26T18:29:00.693985] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-09-26T18:29:00.697624] [DEBUG] [LOCAL ] DXYZ: Trimmed 57854 records to 37246 (keeping 200 days of data) [2025-09-26T18:29:00.761730] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-09-26T18:29:00.942414] [DEBUG] [LOCAL ] DXYZ: Primary data saved (37246 records). [2025-09-26T18:29:00.942572] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-09-26T18:29:00.942687] [INFO ] [MAIN ] Update Progress: 673/2371 symbols completed. DXYZ took 34.4s. Estimated remaining: 3h 44m 28s. Rate: 7.6 symbols/min [2025-09-26T18:29:01.129904] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:29:01.130279] [DEBUG] [LOCAL ] EAI: No existing data file found in primary storage. [2025-09-26T18:29:01.130378] [WARN ] [MAIN ] EAI: No existing data found, performing full refresh instead. [2025-09-26T18:29:01.130824] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-09-26T18:29:01.131014] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-09-26T18:29:01.131194] [DEBUG] [LOCAL ] EAI: No primary data file found to delete. [2025-09-26T18:29:01.131313] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-09-26T18:29:01.397625] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-26T18:29:01.561886] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-09-26T18:29:01.621060] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:29:02.099590] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-26T18:29:02.356757] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-09-26T18:29:02.442863] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-26T18:29:03.156725] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-09-26T18:29:03.764790] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-26T18:29:03.956751] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-09-26T18:29:04.206793] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-26T18:29:04.756770] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-09-26T18:29:05.530752] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-26T18:29:05.556677] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-09-26T18:29:06.361852] [INFO ] [REMOTE ] EAI: Fetching primary data for 2024-12. [2025-09-26T18:29:06.378854] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-26T18:29:06.386192] [INFO ] [REMOTE ] DY: Full fetch complete (44906 records). [2025-09-26T18:29:06.386354] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-09-26T18:29:06.796579] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-09-26T18:29:06.796720] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-09-26T18:29:06.797428] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-09-26T18:29:06.797544] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-09-26T18:29:06.798689] [DEBUG] [LOCAL ] DY: Trimmed 44906 records to 30160 (keeping 200 days of data) [2025-09-26T18:29:06.995682] [DEBUG] [LOCAL ] DY: Primary data saved (30160 records). [2025-09-26T18:29:06.995861] [INFO ] [MAIN ] DY: Full history saved. [2025-09-26T18:29:06.995987] [INFO ] [MAIN ] Update Progress: 674/2371 symbols completed. DY took 31.3s. Estimated remaining: 3h 44m 15s. Rate: 7.6 symbols/min [2025-09-26T18:29:07.170672] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-09-26T18:29:07.192780] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:29:07.224072] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-26T18:29:07.261489] [DEBUG] [LOCAL ] EARN: Loaded 30444 existing records from primary storage. [2025-09-26T18:29:07.261668] [INFO ] [MAIN ] EARN: Loaded 30444 existing records. [2025-09-26T18:29:07.379830] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-26T18:29:07.470098] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:29:07.470390] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-09-26T18:29:07.470494] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-09-26T18:29:07.471396] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-09-26T18:29:07.471466] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-09-26T18:29:07.873624] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:29:07.956740] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-09-26T18:29:08.756780] [INFO ] [REMOTE ] EARN: Fetching primary data for 2024-12. [2025-09-26T18:29:08.914878] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-26T18:29:09.556717] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-09-26T18:29:09.772587] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-26T18:29:10.067450] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-26T18:29:10.356728] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-09-26T18:29:11.161831] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-09-26T18:29:11.177324] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-26T18:29:11.665224] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-26T18:29:11.769198] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-26T18:29:11.956738] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-09-26T18:29:12.756755] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-09-26T18:29:13.502459] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-26T18:29:13.502279] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-26T18:29:13.556722] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-09-26T18:29:14.356726] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-09-26T18:29:15.145689] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-26T18:29:15.156670] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-09-26T18:29:15.561905] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-26T18:29:15.956744] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-09-26T18:29:16.301755] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-26T18:29:16.344904] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-26T18:29:16.756770] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-09-26T18:29:17.556731] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-09-26T18:29:18.356709] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-09-26T18:29:18.396194] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-26T18:29:19.036268] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-26T18:29:19.095894] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-26T18:29:19.156759] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-09-26T18:29:19.956724] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-09-26T18:29:20.548561] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-26T18:29:20.554415] [INFO ] [REMOTE ] EAF: Full fetch complete (64391 records). [2025-09-26T18:29:20.554533] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-09-26T18:29:20.762180] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-09-26T18:29:20.950736] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-09-26T18:29:20.950826] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-09-26T18:29:20.951609] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-09-26T18:29:20.951698] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-09-26T18:29:20.953090] [DEBUG] [LOCAL ] EAF: Trimmed 64391 records to 44158 (keeping 200 days of data) [2025-09-26T18:29:21.209865] [DEBUG] [LOCAL ] EAF: Primary data saved (44158 records). [2025-09-26T18:29:21.210013] [INFO ] [MAIN ] EAF: Full history saved. [2025-09-26T18:29:21.210108] [INFO ] [MAIN ] Update Progress: 675/2371 symbols completed. EAF took 30.4s. Estimated remaining: 3h 44m 23s. Rate: 7.6 symbols/min [2025-09-26T18:29:21.374380] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-26T18:29:21.414700] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:29:21.442785] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-26T18:29:21.498038] [DEBUG] [LOCAL ] EAT: Loaded 50179 existing records from primary storage. [2025-09-26T18:29:21.498197] [INFO ] [MAIN ] EAT: Loaded 50179 existing records. [2025-09-26T18:29:21.565783] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-09-26T18:29:21.699156] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:29:21.699506] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-09-26T18:29:21.699570] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-09-26T18:29:21.700968] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-09-26T18:29:21.701031] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-09-26T18:29:22.079346] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:29:22.176907] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-26T18:29:22.356731] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-09-26T18:29:23.156773] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-09-26T18:29:23.701501] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-26T18:29:23.709150] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-26T18:29:23.956736] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-09-26T18:29:24.581545] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-26T18:29:24.756773] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-09-26T18:29:25.420085] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-26T18:29:25.421689] [INFO ] [REMOTE ] EAI: Full fetch complete (6148 records). [2025-09-26T18:29:25.421776] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-09-26T18:29:25.561838] [INFO ] [REMOTE ] EAT: Fetching primary data for 2024-12. [2025-09-26T18:29:25.822076] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-09-26T18:29:25.822168] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-09-26T18:29:25.822389] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-09-26T18:29:25.822451] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-09-26T18:29:25.822926] [DEBUG] [LOCAL ] EAI: Trimmed 6148 records to 4008 (keeping 200 days of data) [2025-09-26T18:29:25.849125] [DEBUG] [LOCAL ] EAI: Primary data saved (4008 records). [2025-09-26T18:29:25.849287] [INFO ] [MAIN ] EAI: Full history saved. [2025-09-26T18:29:25.849372] [INFO ] [MAIN ] Update Progress: 676/2371 symbols completed. EAI took 24.9s. Estimated remaining: 3h 44m 7s. Rate: 7.6 symbols/min [2025-09-26T18:29:26.029154] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:29:26.072077] [DEBUG] [LOCAL ] EB: Loaded 37828 existing records from primary storage. [2025-09-26T18:29:26.072239] [INFO ] [MAIN ] EB: Loaded 37828 existing records. [2025-09-26T18:29:26.262192] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:29:26.262464] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-09-26T18:29:26.262514] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-09-26T18:29:26.263431] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-09-26T18:29:26.263495] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-09-26T18:29:26.361900] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-09-26T18:29:26.669093] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:29:27.156703] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-12. [2025-09-26T18:29:27.440437] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-26T18:29:27.493767] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-26T18:29:27.956767] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-09-26T18:29:28.526473] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-26T18:29:28.756747] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-09-26T18:29:29.499006] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-26T18:29:29.556688] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-09-26T18:29:29.605153] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-26T18:29:30.356727] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-09-26T18:29:31.156695] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-09-26T18:29:31.274850] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-26T18:29:31.522234] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-26T18:29:31.528416] [INFO ] [REMOTE ] E: Full fetch complete (48384 records). [2025-09-26T18:29:31.528556] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-09-26T18:29:31.951062] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-09-26T18:29:31.951152] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-09-26T18:29:31.951845] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-09-26T18:29:31.951912] [DEBUG] [LOCAL ] E: Saving primary data. [2025-09-26T18:29:31.953011] [DEBUG] [LOCAL ] E: Trimmed 48384 records to 33848 (keeping 200 days of data) [2025-09-26T18:29:31.956720] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-09-26T18:29:32.178969] [DEBUG] [LOCAL ] E: Primary data saved (33848 records). [2025-09-26T18:29:32.179156] [INFO ] [MAIN ] E: Full history saved. [2025-09-26T18:29:32.179279] [INFO ] [MAIN ] Update Progress: 677/2371 symbols completed. E took 44.7s. Estimated remaining: 3h 43m 55s. Rate: 7.6 symbols/min [2025-09-26T18:29:32.728639] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T18:29:32.756695] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-09-26T18:29:33.556713] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-09-26T18:29:33.991591] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-26T18:29:34.026826] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-26T18:29:34.356758] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-09-26T18:29:35.124740] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-26T18:29:35.156724] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-09-26T18:29:35.956756] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-09-26T18:29:36.418658] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-26T18:29:36.693991] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T18:29:36.756751] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-09-26T18:29:36.958407] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-26T18:29:36.963165] [INFO ] [REMOTE ] EARN: Full fetch complete (46087 records). [2025-09-26T18:29:36.963270] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-09-26T18:29:37.362431] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-09-26T18:29:37.362570] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-09-26T18:29:37.363472] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-09-26T18:29:37.363556] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-09-26T18:29:37.365202] [DEBUG] [LOCAL ] EARN: Trimmed 46087 records to 30576 (keeping 200 days of data) [2025-09-26T18:29:37.548111] [DEBUG] [LOCAL ] EARN: Primary data saved (30576 records). [2025-09-26T18:29:37.548277] [INFO ] [MAIN ] EARN: Full history saved. [2025-09-26T18:29:37.548455] [INFO ] [MAIN ] Update Progress: 678/2371 symbols completed. EARN took 30.6s. Estimated remaining: 3h 43m 40s. Rate: 7.6 symbols/min [2025-09-26T18:29:37.556754] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-09-26T18:29:38.323034] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-26T18:29:38.356679] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-09-26T18:29:38.770963] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-26T18:29:39.156721] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-09-26T18:29:39.861234] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-26T18:29:39.956729] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-09-26T18:29:40.127525] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-26T18:29:40.756744] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-09-26T18:29:41.446255] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-26T18:29:41.556755] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-09-26T18:29:41.677897] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-26T18:29:42.356774] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-09-26T18:29:43.111833] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-26T18:29:43.156692] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-09-26T18:29:44.131199] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-26T18:29:44.140545] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-09-26T18:29:45.158335] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-26T18:29:45.168715] [INFO ] [REMOTE ] EAT: Full fetch complete (71813 records). [2025-09-26T18:29:45.168848] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-09-26T18:29:45.520099] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-26T18:29:45.565999] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-09-26T18:29:45.651573] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-09-26T18:29:45.651841] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-09-26T18:29:45.653254] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-09-26T18:29:45.653335] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-09-26T18:29:45.655290] [DEBUG] [LOCAL ] EAT: Trimmed 71813 records to 50542 (keeping 200 days of data) [2025-09-26T18:29:45.977267] [DEBUG] [LOCAL ] EAT: Primary data saved (50542 records). [2025-09-26T18:29:45.977451] [INFO ] [MAIN ] EAT: Full history saved. [2025-09-26T18:29:45.977583] [INFO ] [MAIN ] Update Progress: 679/2371 symbols completed. EAT took 24.8s. Estimated remaining: 3h 43m 34s. Rate: 7.6 symbols/min [2025-09-26T18:29:47.151271] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-26T18:29:47.157961] [INFO ] [REMOTE ] EB: Full fetch complete (56310 records). [2025-09-26T18:29:47.158132] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-09-26T18:29:47.159039] [FATAL] [VALIDATOR ] EB: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:29:47.159183] [FATAL] [MAIN ] EB: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:29:47.159263] [WARN ] [MAIN ] EB: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:29:47.159353] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-09-26T18:29:47.159463] [DEBUG] [LOCAL ] EB: No primary data file found to delete. [2025-09-26T18:29:47.159521] [INFO ] [LOCAL ] EB: Starting deletion of derivative data. [2025-09-26T18:29:47.160013] [DEBUG] [LOCAL ] EB: Deleted derivative data file. [2025-09-26T18:29:47.160115] [INFO ] [MAIN ] Update Progress: 680/2371 symbols completed. EB took 21.3s. Estimated remaining: 3h 43m 9s. Rate: 7.6 symbols/min [2025-09-26T18:29:47.792297] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:29:47.887323] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:29:47.957127] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:29:47.970694] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:29:47.993807] [DEBUG] [LOCAL ] EBF: Loaded 19533 existing records from primary storage. [2025-09-26T18:29:47.994034] [INFO ] [MAIN ] EBF: Loaded 19533 existing records. [2025-09-26T18:29:48.175697] [DEBUG] [LOCAL ] EBR: Loaded 43438 existing records from primary storage. [2025-09-26T18:29:48.176716] [INFO ] [MAIN ] EBR: Loaded 43438 existing records. [2025-09-26T18:29:48.258220] [DEBUG] [LOCAL ] EBS: Loaded 47102 existing records from primary storage. [2025-09-26T18:29:48.315402] [INFO ] [MAIN ] EBS: Loaded 47102 existing records. [2025-09-26T18:29:48.347615] [DEBUG] [LOCAL ] EC: Loaded 49689 existing records from primary storage. [2025-09-26T18:29:48.367582] [INFO ] [MAIN ] EC: Loaded 49689 existing records. [2025-09-26T18:29:48.411377] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:29:48.534189] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-09-26T18:29:48.557337] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-09-26T18:29:48.704276] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-09-26T18:29:48.734259] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-09-26T18:29:48.819517] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:29:48.998441] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:29:48.984275] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-09-26T18:29:49.014693] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-09-26T18:29:49.031116] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-09-26T18:29:49.111376] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-09-26T18:29:49.136191] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-09-26T18:29:49.158419] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-09-26T18:29:49.180388] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-09-26T18:29:49.180570] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-09-26T18:29:49.228523] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:29:49.365155] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-09-26T18:29:49.422560] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-09-26T18:29:49.523730] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-09-26T18:29:49.534548] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-09-26T18:29:50.194415] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:29:50.227497] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-12. [2025-09-26T18:29:50.526978] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:29:50.536341] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-12. [2025-09-26T18:29:50.541056] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:29:50.556189] [INFO ] [REMOTE ] EBR: Fetching primary data for 2024-12. [2025-09-26T18:29:50.676924] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:29:50.677301] [INFO ] [REMOTE ] EBS: Fetching primary data for 2024-12. [2025-09-26T18:29:51.224257] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-26T18:29:51.228270] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-09-26T18:29:51.955638] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-26T18:29:51.960056] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-09-26T18:29:52.121916] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-26T18:29:52.133456] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-09-26T18:29:52.199376] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-26T18:29:52.211043] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-09-26T18:29:52.263704] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-26T18:29:52.274794] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-09-26T18:29:52.752073] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-26T18:29:52.759619] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-09-26T18:29:53.459605] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-26T18:29:53.560427] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-09-26T18:29:53.565920] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-26T18:29:53.599499] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-26T18:29:53.952321] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-26T18:29:54.356742] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-09-26T18:29:54.964451] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-26T18:29:55.141313] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-26T18:29:55.156676] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-09-26T18:29:55.956694] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-09-26T18:29:56.317827] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-26T18:29:56.756726] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-09-26T18:29:57.324791] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-26T18:29:57.467287] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-26T18:29:57.556728] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-09-26T18:29:58.356739] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-09-26T18:29:58.906831] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-26T18:29:59.156719] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-09-26T18:29:59.815434] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-26T18:29:59.956723] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-09-26T18:30:00.557422] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-26T18:30:00.756746] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-09-26T18:30:01.556745] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-09-26T18:30:01.875587] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-26T18:30:02.356796] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-09-26T18:30:02.591575] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-26T18:30:02.899968] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-26T18:30:03.156764] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-09-26T18:30:03.956718] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-09-26T18:30:04.425710] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-26T18:30:04.756781] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-09-26T18:30:05.111372] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-26T18:30:05.476709] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-26T18:30:05.556720] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-09-26T18:30:06.304729] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-26T18:30:06.356683] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-09-26T18:30:06.372511] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-26T18:30:06.376281] [INFO ] [REMOTE ] EBF: Full fetch complete (27269 records). [2025-09-26T18:30:06.376366] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-09-26T18:30:06.376969] [FATAL] [VALIDATOR ] EBF: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:30:06.377057] [FATAL] [MAIN ] EBF: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:30:06.377104] [WARN ] [MAIN ] EBF: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:30:06.377207] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-09-26T18:30:06.377322] [DEBUG] [LOCAL ] EBF: No primary data file found to delete. [2025-09-26T18:30:06.377394] [INFO ] [LOCAL ] EBF: Starting deletion of derivative data. [2025-09-26T18:30:06.377893] [DEBUG] [LOCAL ] EBF: Deleted derivative data file. [2025-09-26T18:30:06.378027] [INFO ] [MAIN ] Update Progress: 681/2371 symbols completed. EBF took 19.2s. Estimated remaining: 3h 43m 29s. Rate: 7.6 symbols/min [2025-09-26T18:30:06.567736] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:30:06.567942] [DEBUG] [LOCAL ] ECAT: No existing data file found in primary storage. [2025-09-26T18:30:06.568015] [WARN ] [MAIN ] ECAT: No existing data found, performing full refresh instead. [2025-09-26T18:30:06.568264] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-09-26T18:30:06.568315] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-09-26T18:30:06.568387] [DEBUG] [LOCAL ] ECAT: No primary data file found to delete. [2025-09-26T18:30:06.568432] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-09-26T18:30:06.958541] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:30:07.156773] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2024-12. [2025-09-26T18:30:07.956727] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-09-26T18:30:08.111460] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-26T18:30:08.494324] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-26T18:30:08.756784] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-09-26T18:30:09.392111] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-26T18:30:09.556733] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-09-26T18:30:10.356760] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-09-26T18:30:10.685807] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-26T18:30:10.755189] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-26T18:30:11.156755] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-09-26T18:30:11.913369] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-26T18:30:11.956776] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-09-26T18:30:12.657124] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-26T18:30:12.756862] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-09-26T18:30:12.861238] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-26T18:30:13.556742] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-09-26T18:30:14.005073] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-26T18:30:14.356784] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-09-26T18:30:14.563926] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-26T18:30:15.156785] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-09-26T18:30:15.956762] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-09-26T18:30:16.096890] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-26T18:30:16.106732] [INFO ] [REMOTE ] EC: Full fetch complete (71622 records). [2025-09-26T18:30:16.106955] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-09-26T18:30:16.107967] [FATAL] [VALIDATOR ] EC: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:30:16.108111] [FATAL] [MAIN ] EC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:30:16.108201] [WARN ] [MAIN ] EC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:30:16.108290] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-09-26T18:30:16.108435] [DEBUG] [LOCAL ] EC: No primary data file found to delete. [2025-09-26T18:30:16.108498] [INFO ] [LOCAL ] EC: Starting deletion of derivative data. [2025-09-26T18:30:16.108952] [DEBUG] [LOCAL ] EC: Deleted derivative data file. [2025-09-26T18:30:16.109074] [INFO ] [MAIN ] Update Progress: 682/2371 symbols completed. EC took 28.9s. Estimated remaining: 3h 43m 26s. Rate: 7.6 symbols/min [2025-09-26T18:30:16.303877] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:30:16.323296] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-26T18:30:16.370499] [DEBUG] [LOCAL ] ECC: Loaded 43726 existing records from primary storage. [2025-09-26T18:30:16.370674] [INFO ] [MAIN ] ECC: Loaded 43726 existing records. [2025-09-26T18:30:16.583835] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:30:16.584123] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-09-26T18:30:16.584182] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-09-26T18:30:16.585510] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-09-26T18:30:16.585579] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-09-26T18:30:16.761952] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-09-26T18:30:17.085022] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:30:17.496704] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-26T18:30:17.556737] [INFO ] [REMOTE ] ECC: Fetching primary data for 2024-12. [2025-09-26T18:30:18.356760] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-09-26T18:30:19.156774] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-09-26T18:30:19.625907] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-26T18:30:19.737224] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (2.98 seconds). [2025-09-26T18:30:19.956752] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-09-26T18:30:20.243958] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2024-12 (2.69 seconds). [2025-09-26T18:30:20.718632] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-26T18:30:20.756713] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-09-26T18:30:20.839327] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-26T18:30:21.556739] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-09-26T18:30:21.920281] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-26T18:30:22.356759] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-09-26T18:30:22.917762] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-26T18:30:23.156784] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-09-26T18:30:23.500762] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-26T18:30:23.956736] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-09-26T18:30:24.756765] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-09-26T18:30:24.840532] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-26T18:30:25.499487] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-26T18:30:25.556742] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-09-26T18:30:26.153051] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-26T18:30:26.356739] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-09-26T18:30:26.640534] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-26T18:30:27.156773] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-09-26T18:30:27.946325] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-26T18:30:27.955724] [INFO ] [REMOTE ] EBR: Full fetch complete (62757 records). [2025-09-26T18:30:27.955899] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-09-26T18:30:27.956730] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-09-26T18:30:28.442331] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-09-26T18:30:28.442526] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-09-26T18:30:28.443439] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-09-26T18:30:28.443576] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-09-26T18:30:28.445695] [DEBUG] [LOCAL ] EBR: Trimmed 62757 records to 43731 (keeping 200 days of data) [2025-09-26T18:30:28.594141] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-26T18:30:28.756870] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-09-26T18:30:28.762453] [DEBUG] [LOCAL ] EBR: Primary data saved (43731 records). [2025-09-26T18:30:28.762614] [INFO ] [MAIN ] EBR: Full history saved. [2025-09-26T18:30:28.762762] [INFO ] [MAIN ] Update Progress: 683/2371 symbols completed. EBR took 41.6s. Estimated remaining: 3h 43m 29s. Rate: 7.6 symbols/min [2025-09-26T18:30:28.954404] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:30:28.954601] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-09-26T18:30:28.954662] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-09-26T18:30:28.954833] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-09-26T18:30:28.954878] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-26T18:30:28.954922] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-26T18:30:28.954958] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-09-26T18:30:29.362310] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:30:29.380276] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-26T18:30:29.388384] [INFO ] [REMOTE ] ECAT: Full fetch complete (42746 records). [2025-09-26T18:30:29.388545] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-09-26T18:30:29.568253] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-09-26T18:30:29.821426] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-09-26T18:30:29.821524] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-09-26T18:30:29.822308] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-09-26T18:30:29.822377] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-09-26T18:30:29.823695] [DEBUG] [LOCAL ] ECAT: Trimmed 42746 records to 30092 (keeping 200 days of data) [2025-09-26T18:30:30.016985] [DEBUG] [LOCAL ] ECAT: Primary data saved (30092 records). [2025-09-26T18:30:30.017194] [INFO ] [MAIN ] ECAT: Full history saved. [2025-09-26T18:30:30.017299] [INFO ] [MAIN ] Update Progress: 684/2371 symbols completed. ECAT took 23.6s. Estimated remaining: 3h 43m 5s. Rate: 7.6 symbols/min [2025-09-26T18:30:30.202931] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:30:30.203147] [DEBUG] [LOCAL ] ECCU: No existing data file found in primary storage. [2025-09-26T18:30:30.203203] [WARN ] [MAIN ] ECCU: No existing data found, performing full refresh instead. [2025-09-26T18:30:30.203346] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-09-26T18:30:30.203389] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-26T18:30:30.203431] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-09-26T18:30:30.203463] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-09-26T18:30:30.361446] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-12. [2025-09-26T18:30:30.615493] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:30:30.718272] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-26T18:30:30.731165] [INFO ] [REMOTE ] EBS: Full fetch complete (67358 records). [2025-09-26T18:30:30.731303] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-09-26T18:30:30.979746] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-26T18:30:31.159606] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-09-26T18:30:31.205577] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-09-26T18:30:31.205797] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-09-26T18:30:31.206836] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-09-26T18:30:31.206909] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-09-26T18:30:31.209003] [DEBUG] [LOCAL ] EBS: Trimmed 67358 records to 47455 (keeping 200 days of data) [2025-09-26T18:30:31.441863] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-26T18:30:31.529407] [DEBUG] [LOCAL ] EBS: Primary data saved (47455 records). [2025-09-26T18:30:31.529575] [INFO ] [MAIN ] EBS: Full history saved. [2025-09-26T18:30:31.529701] [INFO ] [MAIN ] Update Progress: 685/2371 symbols completed. EBS took 44.4s. Estimated remaining: 3h 42m 41s. Rate: 7.6 symbols/min [2025-09-26T18:30:31.623862] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-26T18:30:31.724530] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:30:31.724755] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-09-26T18:30:31.724805] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-09-26T18:30:31.724981] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-09-26T18:30:31.725025] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-26T18:30:31.725069] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-26T18:30:31.725108] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-09-26T18:30:31.961967] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-09-26T18:30:32.122871] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:30:32.756768] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-12. [2025-09-26T18:30:33.207640] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-26T18:30:33.557562] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-26T18:30:33.557700] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-09-26T18:30:33.965883] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-26T18:30:34.356735] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-09-26T18:30:35.156740] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-12. [2025-09-26T18:30:35.666130] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-26T18:30:35.697627] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-26T18:30:35.956740] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-09-26T18:30:36.756732] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-09-26T18:30:37.212787] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-26T18:30:37.556733] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-09-26T18:30:37.841974] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-26T18:30:37.898265] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-26T18:30:38.356791] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-09-26T18:30:38.633633] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-09-26T18:30:39.156773] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-09-26T18:30:39.602348] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-26T18:30:39.956788] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-09-26T18:30:40.213541] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-09-26T18:30:40.756780] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-09-26T18:30:41.556753] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-09-26T18:30:42.029078] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-26T18:30:42.356806] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-09-26T18:30:42.588546] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-26T18:30:42.597839] [INFO ] [REMOTE ] ECC: Full fetch complete (60950 records). [2025-09-26T18:30:42.598033] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-09-26T18:30:42.689830] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-26T18:30:43.028712] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-09-26T18:30:43.028822] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-09-26T18:30:43.029704] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-09-26T18:30:43.029774] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-09-26T18:30:43.031235] [DEBUG] [LOCAL ] ECC: Trimmed 60950 records to 44025 (keeping 200 days of data) [2025-09-26T18:30:43.203134] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-09-26T18:30:43.304038] [DEBUG] [LOCAL ] ECC: Primary data saved (44025 records). [2025-09-26T18:30:43.304205] [INFO ] [MAIN ] ECC: Full history saved. [2025-09-26T18:30:43.304306] [INFO ] [MAIN ] Update Progress: 686/2371 symbols completed. ECC took 27.2s. Estimated remaining: 3h 42m 43s. Rate: 7.6 symbols/min [2025-09-26T18:30:43.498847] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:30:43.499045] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-09-26T18:30:43.499083] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-09-26T18:30:43.499237] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-09-26T18:30:43.499283] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-26T18:30:43.499329] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-26T18:30:43.499364] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-09-26T18:30:43.668406] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-26T18:30:43.892897] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:30:43.956773] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-09-26T18:30:44.233682] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-26T18:30:44.756757] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-09-26T18:30:45.194987] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-26T18:30:45.556750] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-09-26T18:30:46.302892] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-26T18:30:46.356799] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-09-26T18:30:46.711122] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-26T18:30:47.156744] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-09-26T18:30:47.758500] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-26T18:30:47.956750] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-09-26T18:30:48.506704] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-26T18:30:48.756759] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-12. [2025-09-26T18:30:49.188346] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-26T18:30:49.556787] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-09-26T18:30:49.990958] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-26T18:30:49.991800] [INFO ] [REMOTE ] ECCC: Full fetch complete (1284 records). [2025-09-26T18:30:49.991870] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-09-26T18:30:50.232296] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-26T18:30:50.232540] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:30:50.232670] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:30:50.232773] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-26T18:30:50.232850] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-26T18:30:50.232888] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-09-26T18:30:50.232929] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-09-26T18:30:50.233012] [INFO ] [MAIN ] Update Progress: 687/2371 symbols completed. ECCC took 21.5s. Estimated remaining: 3h 42m 32s. Rate: 7.6 symbols/min [2025-09-26T18:30:50.359253] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-09-26T18:30:50.446091] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:30:50.446672] [DEBUG] [LOCAL ] ECG: No existing data file found in primary storage. [2025-09-26T18:30:50.446920] [WARN ] [MAIN ] ECG: No existing data found, performing full refresh instead. [2025-09-26T18:30:50.447180] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-09-26T18:30:50.447247] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-09-26T18:30:50.447298] [DEBUG] [LOCAL ] ECG: No primary data file found to delete. [2025-09-26T18:30:50.447334] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-09-26T18:30:50.761546] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-26T18:30:50.841689] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:30:51.156738] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-09-26T18:30:51.610818] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-26T18:30:51.956739] [INFO ] [REMOTE ] ECG: Fetching primary data for 2024-12. [2025-09-26T18:30:52.756729] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-09-26T18:30:53.476145] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-26T18:30:53.526878] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-26T18:30:53.556756] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-09-26T18:30:54.180459] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-26T18:30:54.356736] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-09-26T18:30:54.801579] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-26T18:30:55.156720] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-09-26T18:30:55.956773] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-09-26T18:30:56.603850] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-26T18:30:56.644103] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-26T18:30:56.756746] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-09-26T18:30:57.556736] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-09-26T18:30:58.156814] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-26T18:30:58.191443] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-26T18:30:58.356733] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-09-26T18:30:58.880632] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-26T18:30:59.156719] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-09-26T18:30:59.956752] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-09-26T18:31:00.642537] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-26T18:31:00.682937] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-26T18:31:00.756742] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-09-26T18:31:01.209608] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-26T18:31:01.556760] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-09-26T18:31:01.932314] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-26T18:31:02.356740] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-09-26T18:31:02.837319] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-26T18:31:03.156798] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-09-26T18:31:03.613524] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-26T18:31:03.956753] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-09-26T18:31:04.429251] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-26T18:31:04.756768] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-09-26T18:31:05.105819] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-26T18:31:05.556734] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-09-26T18:31:05.921558] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-26T18:31:06.356755] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-09-26T18:31:07.028989] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-26T18:31:07.029957] [INFO ] [REMOTE ] ECCW: Full fetch complete (1420 records). [2025-09-26T18:31:07.030074] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-09-26T18:31:07.161869] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-09-26T18:31:07.240006] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-09-26T18:31:07.240277] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:31:07.240371] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:31:07.240474] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-26T18:31:07.240562] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-26T18:31:07.240614] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-09-26T18:31:07.240723] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-09-26T18:31:07.240871] [INFO ] [MAIN ] Update Progress: 688/2371 symbols completed. ECCW took 35.7s. Estimated remaining: 3h 42m 47s. Rate: 7.6 symbols/min [2025-09-26T18:31:07.431918] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:31:07.432254] [DEBUG] [LOCAL ] ECL: No existing data file found in primary storage. [2025-09-26T18:31:07.432308] [WARN ] [MAIN ] ECL: No existing data found, performing full refresh instead. [2025-09-26T18:31:07.432553] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-09-26T18:31:07.432620] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-09-26T18:31:07.432715] [DEBUG] [LOCAL ] ECL: No primary data file found to delete. [2025-09-26T18:31:07.432759] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-09-26T18:31:07.890127] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:31:07.956741] [INFO ] [REMOTE ] ECL: Fetching primary data for 2024-12. [2025-09-26T18:31:08.756719] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-09-26T18:31:08.943777] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-26T18:31:09.400578] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-26T18:31:09.402181] [INFO ] [REMOTE ] ECCU: Full fetch complete (4460 records). [2025-09-26T18:31:09.402278] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-09-26T18:31:09.561843] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-09-26T18:31:09.617849] [WARN ] [VALIDATOR ] ECCU: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-26T18:31:09.618673] [FATAL] [MAIN ] ECCU: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:31:09.618799] [WARN ] [MAIN ] ECCU: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:31:09.618870] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-26T18:31:09.619477] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-09-26T18:31:09.619637] [INFO ] [LOCAL ] ECCU: Starting deletion of derivative data. [2025-09-26T18:31:09.619737] [DEBUG] [LOCAL ] ECCU: No derivative data file found to delete. [2025-09-26T18:31:09.619806] [INFO ] [MAIN ] Update Progress: 689/2371 symbols completed. ECCU took 39.6s. Estimated remaining: 3h 42m 25s. Rate: 7.6 symbols/min [2025-09-26T18:31:09.817904] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:31:09.853578] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-26T18:31:09.880673] [DEBUG] [LOCAL ] ECO: Loaded 18686 existing records from primary storage. [2025-09-26T18:31:09.880834] [INFO ] [MAIN ] ECO: Loaded 18686 existing records. [2025-09-26T18:31:10.079212] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:31:10.079523] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-09-26T18:31:10.079595] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-09-26T18:31:10.080795] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-09-26T18:31:10.080864] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-09-26T18:31:10.169344] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-26T18:31:10.198074] [INFO ] [REMOTE ] ECCX: Full fetch complete (1503 records). [2025-09-26T18:31:10.201927] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-09-26T18:31:10.361879] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-09-26T18:31:10.643454] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-26T18:31:10.644152] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:31:10.665097] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:31:10.690089] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-26T18:31:10.690721] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-26T18:31:10.705509] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-09-26T18:31:10.706877] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-09-26T18:31:10.707014] [INFO ] [MAIN ] Update Progress: 690/2371 symbols completed. ECCX took 27.4s. Estimated remaining: 3h 42m 0s. Rate: 7.6 symbols/min [2025-09-26T18:31:10.735519] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:31:10.912364] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:31:10.970781] [DEBUG] [LOCAL ] ECVT: Loaded 43297 existing records from primary storage. [2025-09-26T18:31:10.970947] [INFO ] [MAIN ] ECVT: Loaded 43297 existing records. [2025-09-26T18:31:11.164431] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-09-26T18:31:11.164682] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:31:11.165932] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-09-26T18:31:11.165990] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-09-26T18:31:11.167352] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-09-26T18:31:11.167417] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-09-26T18:31:11.555412] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:31:11.956755] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2024-12. [2025-09-26T18:31:12.112344] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-26T18:31:12.279668] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-26T18:31:12.756763] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-09-26T18:31:13.191666] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-26T18:31:13.556728] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-09-26T18:31:14.134039] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-26T18:31:14.356800] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-09-26T18:31:14.363225] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-26T18:31:15.156769] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-09-26T18:31:15.956765] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-12. [2025-09-26T18:31:16.335319] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-26T18:31:16.367912] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-26T18:31:16.756779] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-09-26T18:31:17.382016] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-26T18:31:17.556772] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-09-26T18:31:18.356745] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-09-26T18:31:18.919327] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-26T18:31:18.979324] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-26T18:31:19.156781] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-09-26T18:31:19.393500] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-26T18:31:19.956738] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-09-26T18:31:20.304481] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-26T18:31:20.728016] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-26T18:31:20.756764] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-09-26T18:31:21.556724] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-09-26T18:31:22.131590] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-26T18:31:22.356778] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-09-26T18:31:23.079021] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-26T18:31:23.156713] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-09-26T18:31:23.748677] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-26T18:31:23.755140] [INFO ] [REMOTE ] ECG: Full fetch complete (51394 records). [2025-09-26T18:31:23.755282] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-09-26T18:31:23.964191] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-09-26T18:31:24.161903] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-09-26T18:31:24.161995] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-09-26T18:31:24.162725] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-09-26T18:31:24.162794] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-09-26T18:31:24.164054] [DEBUG] [LOCAL ] ECG: Trimmed 51394 records to 34619 (keeping 200 days of data) [2025-09-26T18:31:24.397731] [DEBUG] [LOCAL ] ECG: Primary data saved (34619 records). [2025-09-26T18:31:24.397915] [INFO ] [MAIN ] ECG: Full history saved. [2025-09-26T18:31:24.398070] [INFO ] [MAIN ] Update Progress: 691/2371 symbols completed. ECG took 34.2s. Estimated remaining: 3h 42m 7s. Rate: 7.6 symbols/min [2025-09-26T18:31:24.584206] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:31:24.643782] [DEBUG] [LOCAL ] ED: Loaded 53169 existing records from primary storage. [2025-09-26T18:31:24.643926] [INFO ] [MAIN ] ED: Loaded 53169 existing records. [2025-09-26T18:31:24.767132] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-09-26T18:31:24.842361] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:31:24.842694] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-09-26T18:31:24.842921] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-09-26T18:31:24.853532] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-09-26T18:31:24.873468] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-09-26T18:31:24.875920] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-26T18:31:25.084567] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-26T18:31:25.324692] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:31:25.556722] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-09-26T18:31:26.356743] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-09-26T18:31:26.504367] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-26T18:31:26.901589] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-26T18:31:27.156731] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-09-26T18:31:27.171285] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-26T18:31:27.956762] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-09-26T18:31:28.766974] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-09-26T18:31:28.772845] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-26T18:31:28.814756] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-26T18:31:29.556726] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-09-26T18:31:30.160347] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-26T18:31:30.356775] [INFO ] [REMOTE ] ED: Fetching primary data for 2024-12. [2025-09-26T18:31:31.156753] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-09-26T18:31:31.201120] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-26T18:31:31.211684] [INFO ] [REMOTE ] ECL: Full fetch complete (67826 records). [2025-09-26T18:31:31.211894] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-09-26T18:31:31.621105] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-09-26T18:31:31.621231] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-09-26T18:31:31.622755] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-09-26T18:31:31.622838] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-09-26T18:31:31.627231] [DEBUG] [LOCAL ] ECL: Trimmed 67826 records to 47489 (keeping 200 days of data) [2025-09-26T18:31:31.968860] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-09-26T18:31:32.002609] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-26T18:31:32.114825] [DEBUG] [LOCAL ] ECL: Primary data saved (47489 records). [2025-09-26T18:31:32.115035] [INFO ] [MAIN ] ECL: Full history saved. [2025-09-26T18:31:32.115132] [INFO ] [MAIN ] Update Progress: 692/2371 symbols completed. ECL took 24.9s. Estimated remaining: 3h 41m 58s. Rate: 7.6 symbols/min [2025-09-26T18:31:32.296140] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:31:32.325630] [DEBUG] [LOCAL ] EDD: Loaded 27227 existing records from primary storage. [2025-09-26T18:31:32.325866] [INFO ] [MAIN ] EDD: Loaded 27227 existing records. [2025-09-26T18:31:32.528413] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-26T18:31:32.570534] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:31:32.570892] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-09-26T18:31:32.570947] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-09-26T18:31:32.571892] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-09-26T18:31:32.571955] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-09-26T18:31:32.757875] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-09-26T18:31:32.945417] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:31:32.962177] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-26T18:31:33.556750] [INFO ] [REMOTE ] EDD: Fetching primary data for 2024-12. [2025-09-26T18:31:34.325071] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-26T18:31:34.356741] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-09-26T18:31:34.525049] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-26T18:31:35.043185] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-26T18:31:35.156769] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-09-26T18:31:35.956780] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-09-26T18:31:36.756775] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-09-26T18:31:36.853033] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-26T18:31:37.209453] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-26T18:31:37.556748] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-09-26T18:31:37.684903] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-26T18:31:38.356788] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-09-26T18:31:38.927199] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-26T18:31:39.156816] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-09-26T18:31:39.664560] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-26T18:31:39.956773] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-09-26T18:31:40.374015] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-26T18:31:40.756772] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-09-26T18:31:41.099685] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-26T18:31:41.103863] [INFO ] [REMOTE ] ECO: Full fetch complete (29119 records). [2025-09-26T18:31:41.103976] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-09-26T18:31:41.104527] [FATAL] [VALIDATOR ] ECO: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:31:41.104618] [FATAL] [MAIN ] ECO: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:31:41.104706] [WARN ] [MAIN ] ECO: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:31:41.104759] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-09-26T18:31:41.104822] [DEBUG] [LOCAL ] ECO: No primary data file found to delete. [2025-09-26T18:31:41.104860] [INFO ] [LOCAL ] ECO: Starting deletion of derivative data. [2025-09-26T18:31:41.105330] [DEBUG] [LOCAL ] ECO: Deleted derivative data file. [2025-09-26T18:31:41.105443] [INFO ] [MAIN ] Update Progress: 693/2371 symbols completed. ECO took 31.5s. Estimated remaining: 3h 41m 53s. Rate: 7.6 symbols/min [2025-09-26T18:31:41.298176] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:31:41.312827] [DEBUG] [LOCAL ] EDF: Loaded 13569 existing records from primary storage. [2025-09-26T18:31:41.312980] [INFO ] [MAIN ] EDF: Loaded 13569 existing records. [2025-09-26T18:31:41.521958] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:31:41.522331] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-09-26T18:31:41.522405] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-09-26T18:31:41.523050] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-09-26T18:31:41.523143] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-09-26T18:31:41.560368] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-09-26T18:31:41.754044] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-26T18:31:41.960234] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:31:42.356726] [INFO ] [REMOTE ] EDF: Fetching primary data for 2024-12. [2025-09-26T18:31:43.156715] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-09-26T18:31:43.390511] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-26T18:31:43.520059] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-26T18:31:43.956727] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-09-26T18:31:44.351737] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-26T18:31:44.756740] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-09-26T18:31:44.947974] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-26T18:31:45.556744] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-09-26T18:31:46.191805] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-26T18:31:46.204226] [INFO ] [REMOTE ] ECVT: Full fetch complete (59971 records). [2025-09-26T18:31:46.204435] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-09-26T18:31:46.370543] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-09-26T18:31:46.643349] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-09-26T18:31:46.643452] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-09-26T18:31:46.644251] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-09-26T18:31:46.644320] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-09-26T18:31:46.645841] [DEBUG] [LOCAL ] ECVT: Trimmed 59971 records to 43587 (keeping 200 days of data) [2025-09-26T18:31:46.873798] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-26T18:31:46.935099] [DEBUG] [LOCAL ] ECVT: Primary data saved (43587 records). [2025-09-26T18:31:46.935250] [INFO ] [MAIN ] ECVT: Full history saved. [2025-09-26T18:31:46.935344] [INFO ] [MAIN ] Update Progress: 694/2371 symbols completed. ECVT took 36.2s. Estimated remaining: 3h 41m 40s. Rate: 7.6 symbols/min [2025-09-26T18:31:47.148051] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:31:47.148365] [DEBUG] [LOCAL ] EDN: No existing data file found in primary storage. [2025-09-26T18:31:47.148424] [WARN ] [MAIN ] EDN: No existing data found, performing full refresh instead. [2025-09-26T18:31:47.148589] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-09-26T18:31:47.148665] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-09-26T18:31:47.148736] [DEBUG] [LOCAL ] EDN: No primary data file found to delete. [2025-09-26T18:31:47.148771] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-09-26T18:31:47.161852] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-09-26T18:31:47.468490] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-26T18:31:47.581667] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:31:47.956738] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-09-26T18:31:48.756707] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-09-26T18:31:48.816511] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-26T18:31:49.156125] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-26T18:31:49.556724] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-09-26T18:31:49.660720] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-26T18:31:50.356730] [INFO ] [REMOTE ] EDN: Fetching primary data for 2024-12. [2025-09-26T18:31:51.156730] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-09-26T18:31:51.631451] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-26T18:31:51.818311] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-26T18:31:51.911705] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-26T18:31:51.956744] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-09-26T18:31:52.756798] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-09-26T18:31:52.942240] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-26T18:31:53.556743] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-09-26T18:31:54.315477] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-26T18:31:54.356680] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-09-26T18:31:54.574939] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-26T18:31:55.008914] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-26T18:31:55.156768] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-09-26T18:31:55.956710] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-09-26T18:31:56.340977] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-26T18:31:56.477519] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-26T18:31:56.756735] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-09-26T18:31:57.556732] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-09-26T18:31:57.963439] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-26T18:31:58.356761] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-09-26T18:31:58.998722] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-26T18:31:59.156711] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-09-26T18:31:59.216844] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-26T18:31:59.223951] [INFO ] [REMOTE ] EDF: Full fetch complete (21004 records). [2025-09-26T18:31:59.224072] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-09-26T18:31:59.646304] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-09-26T18:31:59.646397] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-09-26T18:31:59.646893] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-09-26T18:31:59.646958] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-09-26T18:31:59.647743] [DEBUG] [LOCAL ] EDF: Trimmed 21004 records to 13627 (keeping 200 days of data) [2025-09-26T18:31:59.743074] [DEBUG] [LOCAL ] EDF: Primary data saved (13627 records). [2025-09-26T18:31:59.743232] [INFO ] [MAIN ] EDF: Full history saved. [2025-09-26T18:31:59.743360] [INFO ] [MAIN ] Update Progress: 695/2371 symbols completed. EDF took 18.6s. Estimated remaining: 3h 41m 44s. Rate: 7.6 symbols/min [2025-09-26T18:31:59.963203] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:31:59.961296] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-09-26T18:32:00.025718] [DEBUG] [LOCAL ] EDU: Loaded 45333 existing records from primary storage. [2025-09-26T18:32:00.025889] [INFO ] [MAIN ] EDU: Loaded 45333 existing records. [2025-09-26T18:32:00.225991] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:32:00.226291] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-09-26T18:32:00.226355] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-09-26T18:32:00.226614] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-09-26T18:32:00.226717] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-09-26T18:32:00.658806] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:32:00.737135] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-26T18:32:00.764040] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-09-26T18:32:00.769203] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-26T18:32:01.556743] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-09-26T18:32:02.356771] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-09-26T18:32:02.474332] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-26T18:32:03.156761] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-09-26T18:32:03.412209] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-26T18:32:03.418432] [INFO ] [REMOTE ] EDD: Full fetch complete (39019 records). [2025-09-26T18:32:03.418573] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-09-26T18:32:03.932076] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-09-26T18:32:03.958216] [INFO ] [REMOTE ] EDU: Fetching primary data for 2024-12. [2025-09-26T18:32:03.980568] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-09-26T18:32:03.981954] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-09-26T18:32:03.982861] [INFO ] [REMOTE ] ED: Full fetch complete (76346 records). [2025-09-26T18:32:03.982707] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-09-26T18:32:03.983220] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-09-26T18:32:03.983341] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-09-26T18:32:04.026986] [DEBUG] [LOCAL ] EDD: Trimmed 39019 records to 27470 (keeping 200 days of data) [2025-09-26T18:32:04.299253] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-26T18:32:04.581920] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-09-26T18:32:04.582326] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-09-26T18:32:04.584070] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-09-26T18:32:04.584479] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-09-26T18:32:04.589893] [DEBUG] [LOCAL ] ED: Trimmed 76346 records to 53539 (keeping 200 days of data) [2025-09-26T18:32:04.757203] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-09-26T18:32:04.777293] [DEBUG] [LOCAL ] EDD: Primary data saved (27470 records). [2025-09-26T18:32:04.778175] [INFO ] [MAIN ] EDD: Full history saved. [2025-09-26T18:32:04.778308] [INFO ] [MAIN ] Update Progress: 696/2371 symbols completed. EDD took 32.7s. Estimated remaining: 3h 41m 29s. Rate: 7.6 symbols/min [2025-09-26T18:32:04.979955] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:32:04.980685] [DEBUG] [LOCAL ] EE: No existing data file found in primary storage. [2025-09-26T18:32:04.980981] [WARN ] [MAIN ] EE: No existing data found, performing full refresh instead. [2025-09-26T18:32:04.981797] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-09-26T18:32:04.982102] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-09-26T18:32:04.982685] [DEBUG] [LOCAL ] EE: No primary data file found to delete. [2025-09-26T18:32:04.982969] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-09-26T18:32:05.532287] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:32:05.556900] [INFO ] [REMOTE ] EE: Fetching primary data for 2024-12. [2025-09-26T18:32:05.662394] [DEBUG] [LOCAL ] ED: Primary data saved (53539 records). [2025-09-26T18:32:05.662574] [INFO ] [MAIN ] ED: Full history saved. [2025-09-26T18:32:05.662696] [INFO ] [MAIN ] Update Progress: 697/2371 symbols completed. ED took 41.3s. Estimated remaining: 3h 41m 4s. Rate: 7.6 symbols/min [2025-09-26T18:32:05.821803] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-26T18:32:05.921729] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:32:05.919690] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-26T18:32:05.926537] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-09-26T18:32:05.926991] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-09-26T18:32:05.927225] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-09-26T18:32:05.927328] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-09-26T18:32:05.927395] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-09-26T18:32:05.927431] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-09-26T18:32:06.338435] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:32:06.356771] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-09-26T18:32:06.583258] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-26T18:32:07.156760] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-09-26T18:32:07.743449] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-26T18:32:07.949164] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-26T18:32:07.956682] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-09-26T18:32:08.756771] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-09-26T18:32:09.556722] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-09-26T18:32:09.604944] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-26T18:32:10.039179] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-26T18:32:10.356694] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-09-26T18:32:10.601824] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-26T18:32:11.156716] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-09-26T18:32:11.804920] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-26T18:32:11.956796] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-09-26T18:32:11.972554] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-26T18:32:12.756749] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-12. [2025-09-26T18:32:13.453961] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-26T18:32:13.456122] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-26T18:32:13.556746] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-09-26T18:32:14.356727] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-09-26T18:32:14.633391] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-26T18:32:14.758828] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-26T18:32:15.156748] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-09-26T18:32:15.819022] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-26T18:32:15.956765] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-09-26T18:32:16.756769] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-09-26T18:32:16.940578] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-26T18:32:17.556775] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-09-26T18:32:18.231294] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-26T18:32:18.278594] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-26T18:32:18.356791] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-09-26T18:32:18.948318] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-26T18:32:19.156748] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-09-26T18:32:19.647820] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-26T18:32:19.956777] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-09-26T18:32:20.756727] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-09-26T18:32:21.556723] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-09-26T18:32:21.841295] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-26T18:32:22.092281] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-26T18:32:22.287685] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-26T18:32:22.356767] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-09-26T18:32:23.156770] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-09-26T18:32:23.730774] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-26T18:32:23.736279] [INFO ] [REMOTE ] EDN: Full fetch complete (30450 records). [2025-09-26T18:32:23.736375] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-09-26T18:32:23.970838] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-09-26T18:32:24.142732] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-09-26T18:32:24.142836] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-09-26T18:32:24.143451] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-09-26T18:32:24.143523] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-09-26T18:32:24.144455] [DEBUG] [LOCAL ] EDN: Trimmed 30450 records to 18501 (keeping 200 days of data) [2025-09-26T18:32:24.259814] [DEBUG] [LOCAL ] EDN: Primary data saved (18501 records). [2025-09-26T18:32:24.259976] [INFO ] [MAIN ] EDN: Full history saved. [2025-09-26T18:32:24.260081] [INFO ] [MAIN ] Update Progress: 698/2371 symbols completed. EDN took 37.3s. Estimated remaining: 3h 41m 21s. Rate: 7.6 symbols/min [2025-09-26T18:32:24.456570] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:32:24.456907] [DEBUG] [LOCAL ] EEX: No existing data file found in primary storage. [2025-09-26T18:32:24.457216] [WARN ] [MAIN ] EEX: No existing data found, performing full refresh instead. [2025-09-26T18:32:24.457400] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-09-26T18:32:24.457550] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-09-26T18:32:24.457835] [DEBUG] [LOCAL ] EEX: No primary data file found to delete. [2025-09-26T18:32:24.457892] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-09-26T18:32:24.602014] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-26T18:32:24.687398] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-26T18:32:24.761970] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-09-26T18:32:24.920144] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:32:25.556740] [INFO ] [REMOTE ] EEX: Fetching primary data for 2024-12. [2025-09-26T18:32:25.919497] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-26T18:32:26.356692] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-09-26T18:32:26.747137] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-26T18:32:27.156718] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-09-26T18:32:27.813386] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-26T18:32:27.874885] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-26T18:32:27.956743] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-09-26T18:32:28.756734] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-09-26T18:32:29.424104] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-26T18:32:29.447987] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-26T18:32:29.556728] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-09-26T18:32:30.356763] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-09-26T18:32:31.156686] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-09-26T18:32:31.191915] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-26T18:32:31.402244] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-26T18:32:31.956733] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-09-26T18:32:32.756729] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-09-26T18:32:32.972107] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-26T18:32:33.318589] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-26T18:32:33.341767] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-26T18:32:33.556734] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-09-26T18:32:34.356744] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-09-26T18:32:35.053393] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-26T18:32:35.059757] [INFO ] [REMOTE ] EE: Full fetch complete (43573 records). [2025-09-26T18:32:35.059872] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-09-26T18:32:35.163365] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-09-26T18:32:35.491123] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-09-26T18:32:35.491290] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-09-26T18:32:35.491988] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-09-26T18:32:35.492070] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-09-26T18:32:35.493283] [DEBUG] [LOCAL ] EE: Trimmed 43573 records to 32973 (keeping 200 days of data) [2025-09-26T18:32:35.699033] [DEBUG] [LOCAL ] EE: Primary data saved (32973 records). [2025-09-26T18:32:35.699195] [INFO ] [MAIN ] EE: Full history saved. [2025-09-26T18:32:35.699289] [INFO ] [MAIN ] Update Progress: 699/2371 symbols completed. EE took 30.9s. Estimated remaining: 3h 41m 22s. Rate: 7.6 symbols/min [2025-09-26T18:32:35.881478] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:32:35.881675] [DEBUG] [LOCAL ] EFC: No existing data file found in primary storage. [2025-09-26T18:32:35.881731] [WARN ] [MAIN ] EFC: No existing data found, performing full refresh instead. [2025-09-26T18:32:35.881879] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-09-26T18:32:35.881941] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-09-26T18:32:35.882011] [DEBUG] [LOCAL ] EFC: No primary data file found to delete. [2025-09-26T18:32:35.882048] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-09-26T18:32:35.964969] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-09-26T18:32:36.296936] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:32:36.309821] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-26T18:32:36.497562] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-26T18:32:36.571031] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-26T18:32:36.580116] [INFO ] [REMOTE ] EDU: Full fetch complete (66476 records). [2025-09-26T18:32:36.580245] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-09-26T18:32:36.772637] [INFO ] [REMOTE ] EFC: Fetching primary data for 2024-12. [2025-09-26T18:32:37.055915] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-09-26T18:32:37.056061] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-09-26T18:32:37.057312] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-09-26T18:32:37.057474] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-09-26T18:32:37.059508] [DEBUG] [LOCAL ] EDU: Trimmed 66476 records to 45666 (keeping 200 days of data) [2025-09-26T18:32:37.346673] [DEBUG] [LOCAL ] EDU: Primary data saved (45666 records). [2025-09-26T18:32:37.346822] [INFO ] [MAIN ] EDU: Full history saved. [2025-09-26T18:32:37.346991] [INFO ] [MAIN ] Update Progress: 700/2371 symbols completed. EDU took 37.6s. Estimated remaining: 3h 40m 59s. Rate: 7.6 symbols/min [2025-09-26T18:32:37.529895] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:32:37.530121] [DEBUG] [LOCAL ] EFR: No existing data file found in primary storage. [2025-09-26T18:32:37.530165] [WARN ] [MAIN ] EFR: No existing data found, performing full refresh instead. [2025-09-26T18:32:37.530314] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-09-26T18:32:37.530357] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-09-26T18:32:37.530399] [DEBUG] [LOCAL ] EFR: No primary data file found to delete. [2025-09-26T18:32:37.530432] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-09-26T18:32:37.563219] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-09-26T18:32:37.927600] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:32:38.073766] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-26T18:32:38.074952] [INFO ] [REMOTE ] EEA: Full fetch complete (3967 records). [2025-09-26T18:32:38.075027] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-09-26T18:32:38.272300] [WARN ] [VALIDATOR ] EEA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-26T18:32:38.272519] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:32:38.272597] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:32:38.272713] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-09-26T18:32:38.272848] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-09-26T18:32:38.272908] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-09-26T18:32:38.273007] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-09-26T18:32:38.273096] [INFO ] [MAIN ] Update Progress: 701/2371 symbols completed. EEA took 32.6s. Estimated remaining: 3h 40m 34s. Rate: 7.6 symbols/min [2025-09-26T18:32:38.361850] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-12. [2025-09-26T18:32:38.470230] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:32:38.487293] [DEBUG] [LOCAL ] EFT: Loaded 12767 existing records from primary storage. [2025-09-26T18:32:38.487449] [INFO ] [MAIN ] EFT: Loaded 12767 existing records. [2025-09-26T18:32:38.678261] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:32:38.678503] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-09-26T18:32:38.678554] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-09-26T18:32:38.678838] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-09-26T18:32:38.678900] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-09-26T18:32:39.083752] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:32:39.156713] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-12. [2025-09-26T18:32:39.339405] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-26T18:32:39.460051] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2024-12 (2.69 seconds). [2025-09-26T18:32:39.956741] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-09-26T18:32:40.066775] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-26T18:32:40.756751] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-09-26T18:32:40.783505] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-26T18:32:41.556752] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-09-26T18:32:41.728847] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-26T18:32:42.123967] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-26T18:32:42.356752] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-09-26T18:32:43.156709] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-09-26T18:32:43.379307] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-26T18:32:43.956739] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-09-26T18:32:44.632013] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-26T18:32:44.756751] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-09-26T18:32:45.018827] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-26T18:32:45.556725] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-09-26T18:32:46.207327] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-26T18:32:46.244865] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-26T18:32:46.356729] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-09-26T18:32:47.156730] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-09-26T18:32:47.251206] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-26T18:32:47.890562] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-26T18:32:47.956764] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-09-26T18:32:48.756723] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-09-26T18:32:48.899632] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-26T18:32:49.540609] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-26T18:32:49.556730] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-09-26T18:32:50.327831] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-26T18:32:50.356758] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-09-26T18:32:51.156717] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-09-26T18:32:51.205735] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-26T18:32:51.749705] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-26T18:32:51.751907] [INFO ] [REMOTE ] EEX: Full fetch complete (19626 records). [2025-09-26T18:32:51.751982] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-09-26T18:32:51.963509] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-09-26T18:32:52.147542] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-09-26T18:32:52.147627] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-09-26T18:32:52.148202] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-09-26T18:32:52.148267] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-09-26T18:32:52.148915] [DEBUG] [LOCAL ] EEX: Trimmed 19626 records to 12042 (keeping 200 days of data) [2025-09-26T18:32:52.222215] [DEBUG] [LOCAL ] EEX: Primary data saved (12042 records). [2025-09-26T18:32:52.222367] [INFO ] [MAIN ] EEX: Full history saved. [2025-09-26T18:32:52.222482] [INFO ] [MAIN ] Update Progress: 702/2371 symbols completed. EEX took 28.0s. Estimated remaining: 3h 40m 41s. Rate: 7.6 symbols/min [2025-09-26T18:32:52.409317] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:32:52.461547] [DEBUG] [LOCAL ] EFX: Loaded 45166 existing records from primary storage. [2025-09-26T18:32:52.461732] [INFO ] [MAIN ] EFX: Loaded 45166 existing records. [2025-09-26T18:32:52.707432] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:32:52.707895] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-09-26T18:32:52.707957] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-09-26T18:32:52.708252] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-09-26T18:32:52.708314] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-09-26T18:32:52.761872] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-09-26T18:32:53.172507] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:32:53.556731] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-09-26T18:32:53.615401] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-26T18:32:53.875723] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-26T18:32:54.265886] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-26T18:32:54.356750] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-09-26T18:32:55.156726] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-09-26T18:32:55.956804] [INFO ] [REMOTE ] EFX: Fetching primary data for 2024-12. [2025-09-26T18:32:56.234889] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-26T18:32:56.259047] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-26T18:32:56.756775] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-09-26T18:32:57.478168] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-26T18:32:57.556746] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-09-26T18:32:57.999790] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-26T18:32:58.004501] [INFO ] [REMOTE ] EFR: Full fetch complete (18507 records). [2025-09-26T18:32:58.004702] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-09-26T18:32:58.005263] [FATAL] [VALIDATOR ] EFR: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:32:58.005358] [FATAL] [MAIN ] EFR: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:32:58.005411] [WARN ] [MAIN ] EFR: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:32:58.005490] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-09-26T18:32:58.005578] [DEBUG] [LOCAL ] EFR: No primary data file found to delete. [2025-09-26T18:32:58.005630] [INFO ] [LOCAL ] EFR: Starting deletion of derivative data. [2025-09-26T18:32:58.005735] [DEBUG] [LOCAL ] EFR: No derivative data file found to delete. [2025-09-26T18:32:58.005816] [INFO ] [MAIN ] Update Progress: 703/2371 symbols completed. EFR took 20.7s. Estimated remaining: 3h 40m 28s. Rate: 7.6 symbols/min [2025-09-26T18:32:58.200453] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:32:58.229083] [DEBUG] [LOCAL ] EFXT: Loaded 29578 existing records from primary storage. [2025-09-26T18:32:58.229225] [INFO ] [MAIN ] EFXT: Loaded 29578 existing records. [2025-09-26T18:32:58.361818] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-09-26T18:32:58.434018] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:32:58.434344] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-09-26T18:32:58.434425] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-09-26T18:32:58.434748] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-09-26T18:32:58.434812] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-09-26T18:32:58.828930] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:32:59.147800] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-26T18:32:59.156675] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-09-26T18:32:59.788330] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-26T18:32:59.822793] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-26T18:32:59.956724] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-09-26T18:33:00.756771] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-09-26T18:33:01.556791] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-09-26T18:33:01.634529] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-26T18:33:01.668410] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-26T18:33:02.356747] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-09-26T18:33:03.011628] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-26T18:33:03.082722] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-26T18:33:03.156715] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2024-12. [2025-09-26T18:33:03.956751] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-09-26T18:33:04.662019] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-26T18:33:04.756735] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-09-26T18:33:05.556743] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-09-26T18:33:05.750591] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-26T18:33:05.816206] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-26T18:33:06.356758] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-09-26T18:33:06.990989] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-26T18:33:07.156710] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-09-26T18:33:07.956715] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-09-26T18:33:07.976915] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-26T18:33:08.272287] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-26T18:33:08.756768] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-09-26T18:33:09.196484] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-26T18:33:09.556730] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-09-26T18:33:10.356736] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-09-26T18:33:10.751898] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-26T18:33:10.947884] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-26T18:33:11.156714] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-09-26T18:33:11.186506] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-26T18:33:11.956773] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-09-26T18:33:12.756711] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-09-26T18:33:12.868110] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-26T18:33:12.907861] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-26T18:33:12.910861] [INFO ] [REMOTE ] EFT: Full fetch complete (17376 records). [2025-09-26T18:33:12.910963] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-09-26T18:33:12.911598] [FATAL] [VALIDATOR ] EFT: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:33:12.911761] [FATAL] [MAIN ] EFT: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:33:12.911827] [WARN ] [MAIN ] EFT: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:33:12.911897] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-09-26T18:33:12.912054] [DEBUG] [LOCAL ] EFT: No primary data file found to delete. [2025-09-26T18:33:12.912112] [INFO ] [LOCAL ] EFT: Starting deletion of derivative data. [2025-09-26T18:33:12.912703] [DEBUG] [LOCAL ] EFT: Deleted derivative data file. [2025-09-26T18:33:12.912821] [INFO ] [MAIN ] Update Progress: 704/2371 symbols completed. EFT took 34.6s. Estimated remaining: 3h 40m 36s. Rate: 7.6 symbols/min [2025-09-26T18:33:13.093482] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:33:13.123369] [DEBUG] [LOCAL ] EG: Loaded 28829 existing records from primary storage. [2025-09-26T18:33:13.123509] [INFO ] [MAIN ] EG: Loaded 28829 existing records. [2025-09-26T18:33:13.308843] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:33:13.309209] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-09-26T18:33:13.309268] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-09-26T18:33:13.309558] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-09-26T18:33:13.309628] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-09-26T18:33:13.562727] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-09-26T18:33:13.721724] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:33:13.840573] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-26T18:33:14.356766] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-09-26T18:33:15.156735] [INFO ] [REMOTE ] EG: Fetching primary data for 2024-12. [2025-09-26T18:33:15.386518] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-26T18:33:15.396880] [INFO ] [REMOTE ] EFC: Full fetch complete (66283 records). [2025-09-26T18:33:15.397105] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-09-26T18:33:15.853843] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-09-26T18:33:15.853959] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-09-26T18:33:15.854878] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-09-26T18:33:15.855048] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-09-26T18:33:15.856560] [DEBUG] [LOCAL ] EFC: Trimmed 66283 records to 46944 (keeping 200 days of data) [2025-09-26T18:33:15.970804] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-26T18:33:15.968961] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-09-26T18:33:16.192945] [DEBUG] [LOCAL ] EFC: Primary data saved (46944 records). [2025-09-26T18:33:16.193103] [INFO ] [MAIN ] EFC: Full history saved. [2025-09-26T18:33:16.193186] [INFO ] [MAIN ] Update Progress: 705/2371 symbols completed. EFC took 40.5s. Estimated remaining: 3h 40m 17s. Rate: 7.6 symbols/min [2025-09-26T18:33:16.420038] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:33:16.443435] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-26T18:33:16.497524] [DEBUG] [LOCAL ] EGO: Loaded 51905 existing records from primary storage. [2025-09-26T18:33:16.497708] [INFO ] [MAIN ] EGO: Loaded 51905 existing records. [2025-09-26T18:33:16.680544] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:33:16.680850] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-09-26T18:33:16.680901] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-09-26T18:33:16.681181] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-09-26T18:33:16.681242] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-09-26T18:33:16.762018] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-09-26T18:33:17.078420] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:33:17.097122] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-26T18:33:17.556726] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-09-26T18:33:18.050619] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-26T18:33:18.345699] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-26T18:33:18.356670] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-09-26T18:33:19.156764] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-09-26T18:33:19.671149] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-26T18:33:19.956779] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-09-26T18:33:20.241171] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-26T18:33:20.756748] [INFO ] [REMOTE ] EGO: Fetching primary data for 2024-12. [2025-09-26T18:33:20.831525] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-26T18:33:21.556727] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-09-26T18:33:22.264115] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-26T18:33:22.356707] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-09-26T18:33:22.543962] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-26T18:33:22.550959] [INFO ] [REMOTE ] EFXT: Full fetch complete (44258 records). [2025-09-26T18:33:22.551136] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-09-26T18:33:22.964739] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-09-26T18:33:22.964834] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-09-26T18:33:22.966250] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-09-26T18:33:22.966318] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-09-26T18:33:22.967500] [DEBUG] [LOCAL ] EFXT: Trimmed 44258 records to 29755 (keeping 200 days of data) [2025-09-26T18:33:23.146712] [DEBUG] [LOCAL ] EFXT: Primary data saved (29755 records). [2025-09-26T18:33:23.146881] [INFO ] [MAIN ] EFXT: Full history saved. [2025-09-26T18:33:23.146975] [INFO ] [MAIN ] Update Progress: 706/2371 symbols completed. EFXT took 25.1s. Estimated remaining: 3h 40m 7s. Rate: 7.6 symbols/min [2025-09-26T18:33:23.161965] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-09-26T18:33:23.336102] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:33:23.336361] [DEBUG] [LOCAL ] EGP: No existing data file found in primary storage. [2025-09-26T18:33:23.336429] [WARN ] [MAIN ] EGP: No existing data found, performing full refresh instead. [2025-09-26T18:33:23.336857] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-09-26T18:33:23.336914] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-09-26T18:33:23.336959] [DEBUG] [LOCAL ] EGP: No primary data file found to delete. [2025-09-26T18:33:23.336995] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-09-26T18:33:23.738398] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:33:23.766773] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-26T18:33:23.956760] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-09-26T18:33:24.688451] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-26T18:33:24.756835] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-09-26T18:33:25.313715] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-26T18:33:25.556764] [INFO ] [REMOTE ] EGP: Fetching primary data for 2024-12. [2025-09-26T18:33:25.791920] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-26T18:33:26.356864] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-09-26T18:33:26.663337] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-26T18:33:27.156782] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-09-26T18:33:27.956708] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-09-26T18:33:28.014535] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-26T18:33:28.715675] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-26T18:33:28.756690] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-09-26T18:33:28.933022] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-26T18:33:29.556737] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-09-26T18:33:30.356778] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-09-26T18:33:30.471175] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-26T18:33:30.552194] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-26T18:33:31.156782] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-09-26T18:33:31.774370] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-26T18:33:31.956760] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-09-26T18:33:32.488123] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-26T18:33:32.756788] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-09-26T18:33:33.556747] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-09-26T18:33:33.733565] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-26T18:33:34.206142] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-26T18:33:34.356726] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-09-26T18:33:34.508562] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-26T18:33:35.156717] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-09-26T18:33:35.626748] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-26T18:33:35.956743] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-09-26T18:33:36.307457] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-26T18:33:36.756738] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-09-26T18:33:37.360575] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-26T18:33:37.370482] [INFO ] [REMOTE ] EFX: Full fetch complete (64420 records). [2025-09-26T18:33:37.370712] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-09-26T18:33:37.561805] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-09-26T18:33:37.854060] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-09-26T18:33:37.855043] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-09-26T18:33:37.856046] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-09-26T18:33:37.856167] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-09-26T18:33:37.860714] [DEBUG] [LOCAL ] EFX: Trimmed 64420 records to 45419 (keeping 200 days of data) [2025-09-26T18:33:38.033244] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-26T18:33:38.216406] [DEBUG] [LOCAL ] EFX: Primary data saved (45419 records). [2025-09-26T18:33:38.216571] [INFO ] [MAIN ] EFX: Full history saved. [2025-09-26T18:33:38.216783] [INFO ] [MAIN ] Update Progress: 707/2371 symbols completed. EFX took 46.0s. Estimated remaining: 3h 40m 16s. Rate: 7.6 symbols/min [2025-09-26T18:33:38.361858] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-09-26T18:33:38.415841] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:33:38.416068] [DEBUG] [LOCAL ] EGY: No existing data file found in primary storage. [2025-09-26T18:33:38.416128] [WARN ] [MAIN ] EGY: No existing data found, performing full refresh instead. [2025-09-26T18:33:38.416378] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-09-26T18:33:38.416478] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-09-26T18:33:38.416535] [DEBUG] [LOCAL ] EGY: No primary data file found to delete. [2025-09-26T18:33:38.416587] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-09-26T18:33:38.822508] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:33:38.837604] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-26T18:33:39.156743] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-09-26T18:33:39.314284] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-26T18:33:39.956733] [INFO ] [REMOTE ] EGY: Fetching primary data for 2024-12. [2025-09-26T18:33:40.638883] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-26T18:33:40.756744] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-09-26T18:33:41.331792] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-26T18:33:41.556732] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-09-26T18:33:42.092306] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-26T18:33:42.356728] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-09-26T18:33:43.156729] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-09-26T18:33:43.188361] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-26T18:33:43.956731] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-09-26T18:33:44.349230] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-26T18:33:44.362611] [INFO ] [REMOTE ] EGO: Full fetch complete (73538 records). [2025-09-26T18:33:44.362980] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-09-26T18:33:44.558360] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-26T18:33:44.627914] [INFO ] [REMOTE ] EG: Full fetch complete (43830 records). [2025-09-26T18:33:44.687127] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-09-26T18:33:44.763486] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-09-26T18:33:45.040440] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-09-26T18:33:45.040686] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-09-26T18:33:45.041965] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-09-26T18:33:45.042059] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-09-26T18:33:45.112360] [DEBUG] [LOCAL ] EGO: Trimmed 73538 records to 52295 (keeping 200 days of data) [2025-09-26T18:33:45.472951] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-09-26T18:33:45.474752] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-09-26T18:33:45.476223] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-09-26T18:33:45.478065] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-09-26T18:33:45.500301] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-26T18:33:45.513146] [DEBUG] [LOCAL ] EG: Trimmed 43830 records to 29024 (keeping 200 days of data) [2025-09-26T18:33:45.607127] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-09-26T18:33:46.068311] [DEBUG] [LOCAL ] EGO: Primary data saved (52295 records). [2025-09-26T18:33:46.069456] [INFO ] [MAIN ] EGO: Full history saved. [2025-09-26T18:33:46.070167] [INFO ] [MAIN ] Update Progress: 708/2371 symbols completed. EGO took 29.9s. Estimated remaining: 3h 40m 8s. Rate: 7.6 symbols/min [2025-09-26T18:33:46.322101] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:33:46.325108] [DEBUG] [LOCAL ] EG: Primary data saved (29024 records). [2025-09-26T18:33:46.326021] [INFO ] [MAIN ] EG: Full history saved. [2025-09-26T18:33:46.326196] [INFO ] [MAIN ] Update Progress: 709/2371 symbols completed. EG took 33.4s. Estimated remaining: 3h 39m 42s. Rate: 7.6 symbols/min [2025-09-26T18:33:46.588623] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:33:46.593017] [DEBUG] [LOCAL ] EHAB: Loaded 30109 existing records from primary storage. [2025-09-26T18:33:46.593298] [INFO ] [MAIN ] EHAB: Loaded 30109 existing records. [2025-09-26T18:33:46.829621] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:33:46.830227] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-09-26T18:33:46.830326] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-09-26T18:33:46.830729] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-09-26T18:33:46.831085] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-09-26T18:33:46.975884] [DEBUG] [LOCAL ] EHC: Loaded 41649 existing records from primary storage. [2025-09-26T18:33:46.944546] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-26T18:33:47.026162] [INFO ] [MAIN ] EHC: Loaded 41649 existing records. [2025-09-26T18:33:47.026081] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-09-26T18:33:47.439741] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:33:47.479564] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-09-26T18:33:47.498758] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-09-26T18:33:47.539568] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-09-26T18:33:47.539508] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:33:47.559043] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2024-12. [2025-09-26T18:33:47.559135] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-09-26T18:33:47.579027] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-26T18:33:47.964271] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-09-26T18:33:47.964203] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:33:48.752987] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-26T18:33:48.762987] [INFO ] [REMOTE ] EHC: Fetching primary data for 2024-12. [2025-09-26T18:33:48.782505] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-26T18:33:48.891839] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-26T18:33:49.556723] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-09-26T18:33:50.108672] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-26T18:33:50.356749] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-09-26T18:33:51.156693] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-09-26T18:33:51.188883] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-26T18:33:51.197184] [INFO ] [REMOTE ] EGP: Full fetch complete (45355 records). [2025-09-26T18:33:51.197369] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-09-26T18:33:51.630809] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-09-26T18:33:51.632307] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-26T18:33:51.631609] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-09-26T18:33:51.638620] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-09-26T18:33:51.639048] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-09-26T18:33:51.640236] [DEBUG] [LOCAL ] EGP: Trimmed 45355 records to 31536 (keeping 200 days of data) [2025-09-26T18:33:51.859862] [DEBUG] [LOCAL ] EGP: Primary data saved (31536 records). [2025-09-26T18:33:51.860022] [INFO ] [MAIN ] EGP: Full history saved. [2025-09-26T18:33:51.860107] [INFO ] [MAIN ] Update Progress: 710/2371 symbols completed. EGP took 28.7s. Estimated remaining: 3h 39m 28s. Rate: 7.6 symbols/min [2025-09-26T18:33:51.961875] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-09-26T18:33:52.055033] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:33:52.067509] [DEBUG] [LOCAL ] EHI: Loaded 10411 existing records from primary storage. [2025-09-26T18:33:52.067620] [INFO ] [MAIN ] EHI: Loaded 10411 existing records. [2025-09-26T18:33:52.258142] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:33:52.258424] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-09-26T18:33:52.258483] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-09-26T18:33:52.258694] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-09-26T18:33:52.258753] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-09-26T18:33:52.657974] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:33:52.754747] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T18:33:52.764079] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-09-26T18:33:53.057921] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-26T18:33:53.564675] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-09-26T18:33:53.566991] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-26T18:33:54.356747] [INFO ] [REMOTE ] EHI: Fetching primary data for 2024-12. [2025-09-26T18:33:55.156717] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-09-26T18:33:55.214803] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-26T18:33:55.480010] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-26T18:33:55.956798] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-09-26T18:33:56.530573] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-26T18:33:56.756733] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-09-26T18:33:57.208257] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-26T18:33:57.556795] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-09-26T18:33:57.979378] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-26T18:33:58.356728] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-09-26T18:33:58.666831] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-26T18:33:58.878316] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-26T18:33:59.156759] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-09-26T18:33:59.956792] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-09-26T18:34:00.613985] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-26T18:34:00.756771] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-09-26T18:34:01.182354] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-26T18:34:01.556765] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-09-26T18:34:02.134326] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-26T18:34:02.356735] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-09-26T18:34:02.530375] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-26T18:34:02.949239] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-26T18:34:03.156759] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-09-26T18:34:03.956778] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-09-26T18:34:04.554558] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-26T18:34:04.756736] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-09-26T18:34:05.556721] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-09-26T18:34:05.906992] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-26T18:34:06.007100] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-26T18:34:06.356770] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-09-26T18:34:06.892989] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-26T18:34:06.901269] [INFO ] [REMOTE ] EGY: Full fetch complete (61571 records). [2025-09-26T18:34:06.901402] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-09-26T18:34:07.023094] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-26T18:34:07.161885] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-09-26T18:34:07.338298] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-09-26T18:34:07.338422] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-09-26T18:34:07.339312] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-09-26T18:34:07.339382] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-09-26T18:34:07.340909] [DEBUG] [LOCAL ] EGY: Trimmed 61571 records to 42824 (keeping 200 days of data) [2025-09-26T18:34:07.613985] [DEBUG] [LOCAL ] EGY: Primary data saved (42824 records). [2025-09-26T18:34:07.614127] [INFO ] [MAIN ] EGY: Full history saved. [2025-09-26T18:34:07.614209] [INFO ] [MAIN ] Update Progress: 711/2371 symbols completed. EGY took 29.4s. Estimated remaining: 3h 39m 39s. Rate: 7.6 symbols/min [2025-09-26T18:34:07.790142] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:34:07.818130] [DEBUG] [LOCAL ] EIC: Loaded 24164 existing records from primary storage. [2025-09-26T18:34:07.818270] [INFO ] [MAIN ] EIC: Loaded 24164 existing records. [2025-09-26T18:34:07.965882] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-09-26T18:34:08.011070] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:34:08.011396] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-09-26T18:34:08.011446] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-09-26T18:34:08.011671] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-09-26T18:34:08.011732] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-09-26T18:34:08.402042] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:34:08.575315] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-26T18:34:08.589294] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-26T18:34:08.756728] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-09-26T18:34:09.556733] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-09-26T18:34:10.065809] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-26T18:34:10.071304] [INFO ] [REMOTE ] EHAB: Full fetch complete (41387 records). [2025-09-26T18:34:10.071409] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-09-26T18:34:10.361951] [INFO ] [REMOTE ] EIC: Fetching primary data for 2024-12. [2025-09-26T18:34:10.480184] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-09-26T18:34:10.480274] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-09-26T18:34:10.481011] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-09-26T18:34:10.481077] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-09-26T18:34:10.482074] [DEBUG] [LOCAL ] EHAB: Trimmed 41387 records to 30257 (keeping 200 days of data) [2025-09-26T18:34:10.658716] [DEBUG] [LOCAL ] EHAB: Primary data saved (30257 records). [2025-09-26T18:34:10.658864] [INFO ] [MAIN ] EHAB: Full history saved. [2025-09-26T18:34:10.658955] [INFO ] [MAIN ] Update Progress: 712/2371 symbols completed. EHAB took 24.6s. Estimated remaining: 3h 39m 19s. Rate: 7.6 symbols/min [2025-09-26T18:34:10.841907] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:34:10.842058] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-09-26T18:34:10.842096] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-09-26T18:34:10.842239] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-09-26T18:34:10.842284] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-26T18:34:10.842327] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-26T18:34:10.842360] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-09-26T18:34:11.163857] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-09-26T18:34:11.282763] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:34:11.326584] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-26T18:34:11.861047] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-26T18:34:11.956730] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-09-26T18:34:12.047034] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-26T18:34:12.756783] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-12. [2025-09-26T18:34:13.127816] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-26T18:34:13.488585] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-26T18:34:13.556720] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-09-26T18:34:14.185883] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-26T18:34:14.356772] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-09-26T18:34:15.156784] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-09-26T18:34:15.495218] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-26T18:34:15.747855] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-26T18:34:15.956767] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-09-26T18:34:16.756736] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-09-26T18:34:16.889880] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-26T18:34:17.218991] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-26T18:34:17.556728] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-09-26T18:34:17.847609] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-26T18:34:18.356741] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-09-26T18:34:19.156724] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-09-26T18:34:19.864010] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-26T18:34:19.956751] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-09-26T18:34:20.682136] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-26T18:34:20.695542] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-26T18:34:20.756702] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-09-26T18:34:21.556719] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-09-26T18:34:22.356709] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-09-26T18:34:22.393821] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-26T18:34:22.596978] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-26T18:34:22.599732] [INFO ] [REMOTE ] EHI: Full fetch complete (16291 records). [2025-09-26T18:34:22.599815] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-09-26T18:34:22.990341] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-09-26T18:34:22.990432] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-09-26T18:34:22.990850] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-09-26T18:34:22.990913] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-09-26T18:34:22.991506] [DEBUG] [LOCAL ] EHI: Trimmed 16291 records to 10472 (keeping 200 days of data) [2025-09-26T18:34:23.055310] [DEBUG] [LOCAL ] EHI: Primary data saved (10472 records). [2025-09-26T18:34:23.055454] [INFO ] [MAIN ] EHI: Full history saved. [2025-09-26T18:34:23.055564] [INFO ] [MAIN ] Update Progress: 713/2371 symbols completed. EHI took 31.2s. Estimated remaining: 3h 39m 22s. Rate: 7.6 symbols/min [2025-09-26T18:34:23.162883] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-09-26T18:34:23.241975] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:34:23.242221] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-09-26T18:34:23.242275] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-09-26T18:34:23.242438] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-09-26T18:34:23.242524] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-26T18:34:23.242674] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-26T18:34:23.242731] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-09-26T18:34:23.634630] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-26T18:34:23.676161] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:34:23.689710] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-26T18:34:23.956728] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-09-26T18:34:24.756747] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-12. [2025-09-26T18:34:25.169129] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-26T18:34:25.415974] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-26T18:34:25.556736] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-09-26T18:34:26.030383] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-26T18:34:26.356751] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-09-26T18:34:27.156753] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-09-26T18:34:27.558637] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-26T18:34:27.562164] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-26T18:34:27.956738] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-09-26T18:34:28.756722] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-09-26T18:34:29.195372] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-26T18:34:29.556750] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-09-26T18:34:29.846524] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-26T18:34:30.087920] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-26T18:34:30.096266] [INFO ] [REMOTE ] EHC: Full fetch complete (58852 records). [2025-09-26T18:34:30.096439] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-09-26T18:34:30.362695] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-09-26T18:34:30.504298] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-09-26T18:34:30.504393] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-09-26T18:34:30.505245] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-09-26T18:34:30.505313] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-09-26T18:34:30.506595] [DEBUG] [LOCAL ] EHC: Trimmed 58852 records to 41849 (keeping 200 days of data) [2025-09-26T18:34:30.791488] [DEBUG] [LOCAL ] EHC: Primary data saved (41849 records). [2025-09-26T18:34:30.791632] [INFO ] [MAIN ] EHC: Full history saved. [2025-09-26T18:34:30.791781] [INFO ] [MAIN ] Update Progress: 714/2371 symbols completed. EHC took 44.5s. Estimated remaining: 3h 39m 13s. Rate: 7.6 symbols/min [2025-09-26T18:34:30.976369] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:34:30.976572] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-09-26T18:34:30.976628] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-09-26T18:34:30.976802] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-09-26T18:34:30.976871] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-09-26T18:34:30.976958] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-09-26T18:34:30.977026] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-09-26T18:34:31.163178] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-09-26T18:34:31.372610] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:34:31.678030] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-26T18:34:31.689061] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-26T18:34:31.956730] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-09-26T18:34:32.756748] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-09-26T18:34:33.063769] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-26T18:34:33.072870] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-26T18:34:33.556719] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-09-26T18:34:33.970111] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-26T18:34:34.356739] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-09-26T18:34:35.156732] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-09-26T18:34:35.561147] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-26T18:34:35.632571] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-26T18:34:35.637294] [INFO ] [REMOTE ] EIC: Full fetch complete (35075 records). [2025-09-26T18:34:35.637422] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-09-26T18:34:35.961852] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-09-26T18:34:36.041321] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-09-26T18:34:36.041411] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-09-26T18:34:36.041978] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-09-26T18:34:36.042041] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-09-26T18:34:36.042935] [DEBUG] [LOCAL ] EIC: Trimmed 35075 records to 24238 (keeping 200 days of data) [2025-09-26T18:34:36.200076] [DEBUG] [LOCAL ] EIC: Primary data saved (24238 records). [2025-09-26T18:34:36.200226] [INFO ] [MAIN ] EIC: Full history saved. [2025-09-26T18:34:36.200319] [INFO ] [MAIN ] Update Progress: 715/2371 symbols completed. EIC took 28.6s. Estimated remaining: 3h 38m 59s. Rate: 7.6 symbols/min [2025-09-26T18:34:36.398963] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:34:36.421910] [DEBUG] [LOCAL ] EIG: Loaded 20438 existing records from primary storage. [2025-09-26T18:34:36.422064] [INFO ] [MAIN ] EIG: Loaded 20438 existing records. [2025-09-26T18:34:36.502093] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-26T18:34:36.629895] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:34:36.630173] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-09-26T18:34:36.630231] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-09-26T18:34:36.630470] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-09-26T18:34:36.630531] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-09-26T18:34:36.789174] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-09-26T18:34:37.058890] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:34:37.289859] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-26T18:34:37.556722] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-09-26T18:34:38.196363] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-26T18:34:38.356762] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-12. [2025-09-26T18:34:39.053700] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-26T18:34:39.156743] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-09-26T18:34:39.520426] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-26T18:34:39.956721] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-09-26T18:34:40.546325] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-26T18:34:40.547573] [INFO ] [REMOTE ] EICB: Full fetch complete (2692 records). [2025-09-26T18:34:40.547678] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-09-26T18:34:40.739868] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-26T18:34:40.740087] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:34:40.740158] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:34:40.740258] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-26T18:34:40.740340] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-26T18:34:40.740381] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-09-26T18:34:40.740438] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-09-26T18:34:40.740536] [INFO ] [MAIN ] Update Progress: 716/2371 symbols completed. EICB took 17.7s. Estimated remaining: 3h 38m 44s. Rate: 7.6 symbols/min [2025-09-26T18:34:40.762434] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-09-26T18:34:40.929570] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:34:40.989109] [DEBUG] [LOCAL ] EIX: Loaded 53725 existing records from primary storage. [2025-09-26T18:34:40.989262] [INFO ] [MAIN ] EIX: Loaded 53725 existing records. [2025-09-26T18:34:41.190239] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:34:41.190543] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-09-26T18:34:41.190603] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-09-26T18:34:41.190941] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-09-26T18:34:41.191002] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-09-26T18:34:41.269908] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-26T18:34:41.557315] [INFO ] [REMOTE ] EIG: Fetching primary data for 2024-12. [2025-09-26T18:34:41.580255] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:34:42.356767] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-09-26T18:34:42.825880] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-26T18:34:42.968689] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-26T18:34:43.156757] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-09-26T18:34:43.956745] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-09-26T18:34:44.215984] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-26T18:34:44.501605] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-26T18:34:44.502532] [INFO ] [REMOTE ] EICA: Full fetch complete (1269 records). [2025-09-26T18:34:44.502615] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-09-26T18:34:44.703857] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-26T18:34:44.704047] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:34:44.704159] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:34:44.704233] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-26T18:34:44.704301] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-26T18:34:44.704338] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-09-26T18:34:44.704377] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-09-26T18:34:44.704444] [INFO ] [MAIN ] Update Progress: 717/2371 symbols completed. EICA took 34.0s. Estimated remaining: 3h 38m 27s. Rate: 7.6 symbols/min [2025-09-26T18:34:44.756764] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-12. [2025-09-26T18:34:45.556738] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-09-26T18:34:46.356709] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-09-26T18:34:46.428800] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-26T18:34:46.715748] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-26T18:34:46.747671] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-26T18:34:47.156794] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-09-26T18:34:47.917619] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-26T18:34:47.956730] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-09-26T18:34:48.640882] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-26T18:34:48.756765] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-09-26T18:34:49.390249] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-26T18:34:49.556721] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-09-26T18:34:50.356717] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-09-26T18:34:50.679487] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-26T18:34:50.995950] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-26T18:34:51.156745] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-09-26T18:34:51.864625] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-26T18:34:51.956760] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-09-26T18:34:52.756780] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-09-26T18:34:53.200012] [DEBUG] [REMOTE ] EIX: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-26T18:34:53.200332] [WARN ] [REMOTE ] EIX: No data returned for month 2025-01 [2025-09-26T18:34:53.231478] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-26T18:34:53.556718] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-09-26T18:34:54.356724] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-09-26T18:34:54.611280] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-26T18:34:55.156802] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-09-26T18:34:55.956722] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-09-26T18:34:56.175484] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-26T18:34:56.350831] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-26T18:34:56.478344] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-26T18:34:56.756729] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-09-26T18:34:57.479341] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-26T18:34:57.481346] [INFO ] [REMOTE ] EICC: Full fetch complete (8033 records). [2025-09-26T18:34:57.481467] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-09-26T18:34:57.481907] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:34:57.482031] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:34:57.482117] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:34:57.482202] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-09-26T18:34:57.482300] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-09-26T18:34:57.482366] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-09-26T18:34:57.482471] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-09-26T18:34:57.482716] [INFO ] [MAIN ] Update Progress: 718/2371 symbols completed. EICC took 26.7s. Estimated remaining: 3h 38m 30s. Rate: 7.6 symbols/min [2025-09-26T18:34:57.556756] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-09-26T18:34:58.356748] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-09-26T18:34:58.629947] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-26T18:34:59.156757] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-09-26T18:35:00.043052] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-26T18:35:00.054598] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-09-26T18:35:00.084368] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-26T18:35:00.756733] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-09-26T18:35:02.015019] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-26T18:35:02.029130] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-09-26T18:35:02.053801] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-26T18:35:02.058281] [INFO ] [REMOTE ] EIG: Full fetch complete (27011 records). [2025-09-26T18:35:02.058360] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-09-26T18:35:02.529733] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-09-26T18:35:02.529821] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-09-26T18:35:02.530346] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-09-26T18:35:02.530400] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-09-26T18:35:02.531198] [DEBUG] [LOCAL ] EIG: Trimmed 27011 records to 20519 (keeping 200 days of data) [2025-09-26T18:35:02.660631] [DEBUG] [LOCAL ] EIG: Primary data saved (20519 records). [2025-09-26T18:35:02.660788] [INFO ] [MAIN ] EIG: Full history saved. [2025-09-26T18:35:02.660885] [INFO ] [MAIN ] Update Progress: 719/2371 symbols completed. EIG took 26.5s. Estimated remaining: 3h 38m 16s. Rate: 7.6 symbols/min [2025-09-26T18:35:03.920822] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-26T18:35:03.932537] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-09-26T18:35:06.136203] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-26T18:35:06.147768] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-09-26T18:35:08.170665] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-26T18:35:08.183555] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-09-26T18:35:10.184509] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-26T18:35:10.196421] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-09-26T18:35:12.373917] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-26T18:35:12.388069] [INFO ] [REMOTE ] EIX: Full fetch complete (69185 records). [2025-09-26T18:35:12.388270] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-09-26T18:35:12.604000] [WARN ] [VALIDATOR ] EIX: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-26T18:35:12.604849] [FATAL] [MAIN ] EIX: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:35:12.604930] [WARN ] [MAIN ] EIX: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:35:12.605008] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-09-26T18:35:12.605103] [DEBUG] [LOCAL ] EIX: No primary data file found to delete. [2025-09-26T18:35:12.605163] [INFO ] [LOCAL ] EIX: Starting deletion of derivative data. [2025-09-26T18:35:12.605719] [DEBUG] [LOCAL ] EIX: Deleted derivative data file. [2025-09-26T18:35:12.605856] [INFO ] [MAIN ] Update Progress: 720/2371 symbols completed. EIX took 31.9s. Estimated remaining: 3h 38m 12s. Rate: 7.6 symbols/min [2025-09-26T18:35:13.348566] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:35:13.341263] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:35:13.337695] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:35:13.413176] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:35:13.417716] [DEBUG] [LOCAL ] ELC: Loaded 3504 existing records from primary storage. [2025-09-26T18:35:13.417875] [INFO ] [MAIN ] ELC: Loaded 3504 existing records. [2025-09-26T18:35:13.669933] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:35:13.671674] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-09-26T18:35:13.672098] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-09-26T18:35:13.702813] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-09-26T18:35:13.703297] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-09-26T18:35:13.704505] [DEBUG] [LOCAL ] ELF: Loaded 52663 existing records from primary storage. [2025-09-26T18:35:13.710018] [INFO ] [MAIN ] ELF: Loaded 52663 existing records. [2025-09-26T18:35:13.726582] [DEBUG] [LOCAL ] EL: Loaded 53791 existing records from primary storage. [2025-09-26T18:35:13.756614] [DEBUG] [LOCAL ] ELAN: Loaded 53595 existing records from primary storage. [2025-09-26T18:35:13.762084] [INFO ] [MAIN ] ELAN: Loaded 53595 existing records. [2025-09-26T18:35:13.755747] [INFO ] [MAIN ] EL: Loaded 53791 existing records. [2025-09-26T18:35:14.589509] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:35:14.699987] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-09-26T18:35:14.705546] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:35:14.705363] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:35:14.721465] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-09-26T18:35:14.740319] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-09-26T18:35:14.740789] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-09-26T18:35:14.741364] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-09-26T18:35:14.751986] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-09-26T18:35:14.757334] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-09-26T18:35:14.789568] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-09-26T18:35:14.767856] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-09-26T18:35:14.789471] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-09-26T18:35:14.866967] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-09-26T18:35:14.928449] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-09-26T18:35:14.942740] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:35:14.980637] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-12. [2025-09-26T18:35:15.964176] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:35:15.975020] [INFO ] [REMOTE ] EL: Fetching primary data for 2024-12. [2025-09-26T18:35:16.019857] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:35:16.078222] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-26T18:35:16.078613] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2024-12. [2025-09-26T18:35:16.085188] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-09-26T18:35:16.088443] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:35:16.089629] [INFO ] [REMOTE ] ELF: Fetching primary data for 2024-12. [2025-09-26T18:35:16.682217] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-26T18:35:16.683980] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-09-26T18:35:17.120872] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-26T18:35:17.122363] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-09-26T18:35:17.543594] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-26T18:35:17.545623] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-09-26T18:35:17.824698] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-26T18:35:17.836425] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-09-26T18:35:17.913322] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-26T18:35:17.925740] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-09-26T18:35:17.931558] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-26T18:35:17.933191] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-09-26T18:35:17.977614] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-26T18:35:17.988627] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-09-26T18:35:18.288678] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-26T18:35:18.290175] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-09-26T18:35:18.632076] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-26T18:35:18.633636] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-09-26T18:35:19.215299] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-26T18:35:19.226151] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-09-26T18:35:19.392433] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-26T18:35:19.394173] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-09-26T18:35:19.774979] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-26T18:35:19.777189] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-09-26T18:35:20.020379] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-26T18:35:20.032293] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-09-26T18:35:20.075982] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-26T18:35:20.087346] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-09-26T18:35:20.208709] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-26T18:35:20.209961] [INFO ] [REMOTE ] ELC: Full fetch complete (5079 records). [2025-09-26T18:35:20.210032] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-09-26T18:35:20.210394] [FATAL] [VALIDATOR ] ELC: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:35:20.210478] [FATAL] [MAIN ] ELC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:35:20.210523] [WARN ] [MAIN ] ELC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:35:20.210587] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-09-26T18:35:20.210686] [DEBUG] [LOCAL ] ELC: No primary data file found to delete. [2025-09-26T18:35:20.210743] [INFO ] [LOCAL ] ELC: Starting deletion of derivative data. [2025-09-26T18:35:20.211242] [DEBUG] [LOCAL ] ELC: Deleted derivative data file. [2025-09-26T18:35:20.211337] [INFO ] [MAIN ] Update Progress: 721/2371 symbols completed. ELC took 7.6s. Estimated remaining: 3h 38m 4s. Rate: 7.6 symbols/min [2025-09-26T18:35:20.401805] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:35:20.435098] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-26T18:35:20.477839] [DEBUG] [LOCAL ] ELME: Loaded 39528 existing records from primary storage. [2025-09-26T18:35:20.477984] [INFO ] [MAIN ] ELME: Loaded 39528 existing records. [2025-09-26T18:35:20.684366] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:35:20.684687] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-09-26T18:35:20.684759] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-09-26T18:35:20.685067] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-09-26T18:35:20.685136] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-09-26T18:35:20.762077] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-09-26T18:35:21.102237] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:35:21.556748] [INFO ] [REMOTE ] ELME: Fetching primary data for 2024-12. [2025-09-26T18:35:21.759680] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-26T18:35:22.164556] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-26T18:35:22.356716] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-09-26T18:35:22.523976] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-09-26T18:35:23.136796] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-26T18:35:23.156674] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-09-26T18:35:23.751072] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-26T18:35:23.956745] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-09-26T18:35:24.092108] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-26T18:35:24.756731] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-09-26T18:35:25.556731] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-09-26T18:35:25.865526] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-26T18:35:25.914511] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-26T18:35:26.356740] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-09-26T18:35:27.156704] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-09-26T18:35:27.283205] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-26T18:35:27.844170] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-26T18:35:27.956730] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-09-26T18:35:28.756732] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-09-26T18:35:29.012740] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-26T18:35:29.556782] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-09-26T18:35:30.128940] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-26T18:35:30.356731] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-09-26T18:35:30.765506] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-26T18:35:31.156768] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-09-26T18:35:31.357846] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-26T18:35:31.522357] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-26T18:35:31.956784] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-09-26T18:35:32.756731] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-09-26T18:35:33.115099] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-26T18:35:33.171761] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-26T18:35:33.556735] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-09-26T18:35:34.356746] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-09-26T18:35:34.910364] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-26T18:35:35.101315] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-26T18:35:35.156721] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-09-26T18:35:35.956708] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-09-26T18:35:36.435084] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-26T18:35:36.756737] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-09-26T18:35:37.177819] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-26T18:35:37.442277] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-26T18:35:37.556740] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-09-26T18:35:38.254210] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-26T18:35:38.356787] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-09-26T18:35:38.765950] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-26T18:35:39.156741] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-09-26T18:35:39.956769] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-09-26T18:35:40.573697] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-26T18:35:40.756743] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-09-26T18:35:41.187935] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-26T18:35:41.225981] [INFO ] [REMOTE ] ELME: Full fetch complete (55816 records). [2025-09-26T18:35:41.229437] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-09-26T18:35:41.232122] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-26T18:35:41.561825] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-09-26T18:35:41.698183] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-09-26T18:35:41.698285] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-09-26T18:35:41.699102] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-09-26T18:35:41.699208] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-09-26T18:35:41.701189] [DEBUG] [LOCAL ] ELME: Trimmed 55816 records to 39817 (keeping 200 days of data) [2025-09-26T18:35:41.970044] [DEBUG] [LOCAL ] ELME: Primary data saved (39817 records). [2025-09-26T18:35:41.970279] [INFO ] [MAIN ] ELME: Full history saved. [2025-09-26T18:35:41.970407] [INFO ] [MAIN ] Update Progress: 722/2371 symbols completed. ELME took 21.8s. Estimated remaining: 3h 38m 27s. Rate: 7.5 symbols/min [2025-09-26T18:35:42.169040] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:35:42.195578] [DEBUG] [LOCAL ] ELP: Loaded 25971 existing records from primary storage. [2025-09-26T18:35:42.195750] [INFO ] [MAIN ] ELP: Loaded 25971 existing records. [2025-09-26T18:35:42.361969] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-09-26T18:35:42.413317] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:35:42.414093] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-09-26T18:35:42.414173] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-09-26T18:35:42.414405] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-09-26T18:35:42.414518] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-09-26T18:35:42.818760] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:35:42.852875] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-26T18:35:43.156770] [INFO ] [REMOTE ] ELP: Fetching primary data for 2024-12. [2025-09-26T18:35:43.360800] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-26T18:35:43.956775] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-09-26T18:35:44.109976] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-26T18:35:44.121200] [INFO ] [REMOTE ] ELAN: Full fetch complete (76856 records). [2025-09-26T18:35:44.121398] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-09-26T18:35:44.590602] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-09-26T18:35:44.600311] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-09-26T18:35:44.601321] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-09-26T18:35:44.601589] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-09-26T18:35:44.603391] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-26T18:35:44.610556] [DEBUG] [LOCAL ] ELAN: Trimmed 76856 records to 53985 (keeping 200 days of data) [2025-09-26T18:35:44.784265] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-09-26T18:35:44.942732] [DEBUG] [LOCAL ] ELAN: Primary data saved (53985 records). [2025-09-26T18:35:44.942887] [INFO ] [MAIN ] ELAN: Full history saved. [2025-09-26T18:35:44.942984] [INFO ] [MAIN ] Update Progress: 723/2371 symbols completed. ELAN took 32.3s. Estimated remaining: 3h 38m 8s. Rate: 7.6 symbols/min [2025-09-26T18:35:45.138748] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:35:45.138977] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-09-26T18:35:45.139037] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-09-26T18:35:45.139226] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-09-26T18:35:45.139321] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-26T18:35:45.139389] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-26T18:35:45.139435] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-09-26T18:35:45.536812] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:35:45.556717] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-12. [2025-09-26T18:35:45.882224] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-26T18:35:46.099555] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-26T18:35:46.356691] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-09-26T18:35:46.469674] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-26T18:35:46.480893] [INFO ] [REMOTE ] EL: Full fetch complete (77327 records). [2025-09-26T18:35:46.481081] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-09-26T18:35:46.734501] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-26T18:35:46.925430] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-09-26T18:35:46.925529] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-09-26T18:35:46.926515] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-09-26T18:35:46.926594] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-09-26T18:35:46.928519] [DEBUG] [LOCAL ] EL: Trimmed 77327 records to 54177 (keeping 200 days of data) [2025-09-26T18:35:47.174138] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-09-26T18:35:47.302327] [DEBUG] [LOCAL ] EL: Primary data saved (54177 records). [2025-09-26T18:35:47.302483] [INFO ] [MAIN ] EL: Full history saved. [2025-09-26T18:35:47.302574] [INFO ] [MAIN ] Update Progress: 724/2371 symbols completed. EL took 34.7s. Estimated remaining: 3h 37m 47s. Rate: 7.6 symbols/min [2025-09-26T18:35:47.484982] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:35:47.541663] [DEBUG] [LOCAL ] ELS: Loaded 49758 existing records from primary storage. [2025-09-26T18:35:47.541835] [INFO ] [MAIN ] ELS: Loaded 49758 existing records. [2025-09-26T18:35:47.787688] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:35:47.787959] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-09-26T18:35:47.788008] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-09-26T18:35:47.788317] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-09-26T18:35:47.788377] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-09-26T18:35:47.961941] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-09-26T18:35:48.190911] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:35:48.756737] [INFO ] [REMOTE ] ELS: Fetching primary data for 2024-12. [2025-09-26T18:35:49.247074] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-26T18:35:49.318330] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-26T18:35:49.329699] [INFO ] [REMOTE ] ELF: Full fetch complete (75374 records). [2025-09-26T18:35:49.329880] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-09-26T18:35:49.561879] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-09-26T18:35:49.783037] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-09-26T18:35:49.783134] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-09-26T18:35:49.784002] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-09-26T18:35:49.784114] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-09-26T18:35:49.785848] [DEBUG] [LOCAL ] ELF: Trimmed 75374 records to 53037 (keeping 200 days of data) [2025-09-26T18:35:50.130892] [DEBUG] [LOCAL ] ELF: Primary data saved (53037 records). [2025-09-26T18:35:50.131055] [INFO ] [MAIN ] ELF: Full history saved. [2025-09-26T18:35:50.132805] [INFO ] [MAIN ] Update Progress: 725/2371 symbols completed. ELF took 37.5s. Estimated remaining: 3h 37m 28s. Rate: 7.6 symbols/min [2025-09-26T18:35:50.376977] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:35:50.371907] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-09-26T18:35:50.410098] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-26T18:35:50.445186] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-26T18:35:50.496417] [DEBUG] [LOCAL ] ELV: Loaded 50969 existing records from primary storage. [2025-09-26T18:35:50.496580] [INFO ] [MAIN ] ELV: Loaded 50969 existing records. [2025-09-26T18:35:50.694401] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-26T18:35:50.694238] [WARN ] [MAIN ] ELV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:35:50.696503] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-09-26T18:35:50.696594] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-09-26T18:35:50.696895] [DEBUG] [LOCAL ] ELV: Deleted primary data file. [2025-09-26T18:35:50.696971] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-09-26T18:35:51.115245] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:35:51.156782] [INFO ] [REMOTE ] ELV: Fetching primary data for 2024-12. [2025-09-26T18:35:51.956750] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-09-26T18:35:52.756709] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-09-26T18:35:52.953988] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T18:35:53.035977] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-26T18:35:53.186054] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-26T18:35:53.556742] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-09-26T18:35:54.051293] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-26T18:35:54.356795] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-09-26T18:35:55.156756] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-09-26T18:35:55.740175] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-26T18:35:55.905341] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-26T18:35:55.956842] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-09-26T18:35:56.756790] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-09-26T18:35:57.556732] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-09-26T18:35:57.738413] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-26T18:35:57.894460] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-26T18:35:58.036700] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-26T18:35:58.356785] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-09-26T18:35:59.156763] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-09-26T18:35:59.693938] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-26T18:35:59.956800] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-09-26T18:36:00.620692] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-26T18:36:00.756772] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-09-26T18:36:01.156570] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-26T18:36:01.556763] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-09-26T18:36:01.727214] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-26T18:36:01.850050] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-26T18:36:02.356768] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-09-26T18:36:03.156743] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-09-26T18:36:03.913779] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-26T18:36:03.956676] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-09-26T18:36:04.081844] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-26T18:36:04.756767] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-09-26T18:36:05.173261] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-26T18:36:05.174124] [INFO ] [REMOTE ] ELPC: Full fetch complete (1481 records). [2025-09-26T18:36:05.174200] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-09-26T18:36:05.377970] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-26T18:36:05.378503] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:36:05.378580] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:36:05.378678] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-26T18:36:05.378767] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-26T18:36:05.378809] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-09-26T18:36:05.378899] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-09-26T18:36:05.379043] [INFO ] [MAIN ] Update Progress: 726/2371 symbols completed. ELPC took 20.4s. Estimated remaining: 3h 37m 36s. Rate: 7.6 symbols/min [2025-09-26T18:36:05.562609] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-09-26T18:36:05.566577] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:36:05.566850] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-09-26T18:36:05.568356] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-09-26T18:36:05.569108] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-09-26T18:36:05.569203] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-26T18:36:05.569312] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-26T18:36:05.569400] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-09-26T18:36:05.966274] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:36:06.003816] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-26T18:36:06.356771] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-12. [2025-09-26T18:36:06.834513] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-26T18:36:06.868288] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:36:06.868899] [WARN ] [REMOTE ] EMA: No data returned for month 2024-12 [2025-09-26T18:36:07.156780] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-09-26T18:36:07.956796] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-09-26T18:36:08.756799] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-09-26T18:36:08.854798] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-26T18:36:09.370158] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-26T18:36:09.556728] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-09-26T18:36:09.653354] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-26T18:36:10.356730] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-09-26T18:36:11.156785] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-09-26T18:36:11.465903] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-26T18:36:11.510447] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-26T18:36:11.956766] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-09-26T18:36:12.756811] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-09-26T18:36:12.976966] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-26T18:36:13.123014] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-26T18:36:13.134691] [INFO ] [REMOTE ] ELS: Full fetch complete (70586 records). [2025-09-26T18:36:13.134974] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-09-26T18:36:13.562205] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-01. [2025-09-26T18:36:13.597189] [DEBUG] [VALIDATOR ] ELS: All expected trading days are present. [2025-09-26T18:36:13.597529] [DEBUG] [VALIDATOR ] ELS: Primary data validation passed. [2025-09-26T18:36:13.601341] [INFO ] [MAIN ] ELS: Fetched primary data is valid. [2025-09-26T18:36:13.601783] [DEBUG] [LOCAL ] ELS: Saving primary data. [2025-09-26T18:36:13.608209] [DEBUG] [LOCAL ] ELS: Trimmed 70586 records to 50110 (keeping 200 days of data) [2025-09-26T18:36:13.841449] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:36:13.846832] [WARN ] [REMOTE ] EMA: No data returned for month 2025-01 [2025-09-26T18:36:13.958005] [DEBUG] [LOCAL ] ELS: Primary data saved (50110 records). [2025-09-26T18:36:13.958249] [INFO ] [MAIN ] ELS: Full history saved. [2025-09-26T18:36:13.958566] [INFO ] [MAIN ] Update Progress: 727/2371 symbols completed. ELS took 26.7s. Estimated remaining: 3h 37m 30s. Rate: 7.6 symbols/min [2025-09-26T18:36:14.142175] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:36:14.175540] [DEBUG] [LOCAL ] EMD: Loaded 21179 existing records from primary storage. [2025-09-26T18:36:14.175813] [INFO ] [MAIN ] EMD: Loaded 21179 existing records. [2025-09-26T18:36:14.364292] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-09-26T18:36:14.371303] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:36:14.373714] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-09-26T18:36:14.373791] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-09-26T18:36:14.374224] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-09-26T18:36:14.374332] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-09-26T18:36:14.582106] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-26T18:36:14.807049] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:36:15.156853] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-02. [2025-09-26T18:36:15.739962] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:36:15.741172] [WARN ] [REMOTE ] EMA: No data returned for month 2025-02 [2025-09-26T18:36:15.768227] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-26T18:36:15.956822] [INFO ] [REMOTE ] EMD: Fetching primary data for 2024-12. [2025-09-26T18:36:16.756784] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-03. [2025-09-26T18:36:16.976467] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:36:16.976841] [WARN ] [REMOTE ] EMA: No data returned for month 2025-03 [2025-09-26T18:36:17.236676] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-26T18:36:17.556739] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-09-26T18:36:18.356874] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-04. [2025-09-26T18:36:18.580864] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:36:18.581220] [WARN ] [REMOTE ] EMA: No data returned for month 2025-04 [2025-09-26T18:36:18.851446] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-26T18:36:18.857087] [INFO ] [REMOTE ] ELP: Full fetch complete (37517 records). [2025-09-26T18:36:18.857252] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-09-26T18:36:19.161973] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-05. [2025-09-26T18:36:19.339840] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-09-26T18:36:19.339965] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-09-26T18:36:19.340751] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-09-26T18:36:19.340820] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-09-26T18:36:19.342065] [DEBUG] [LOCAL ] ELP: Trimmed 37517 records to 26107 (keeping 200 days of data) [2025-09-26T18:36:19.513952] [DEBUG] [LOCAL ] ELP: Primary data saved (26107 records). [2025-09-26T18:36:19.514456] [INFO ] [MAIN ] ELP: Full history saved. [2025-09-26T18:36:19.514692] [INFO ] [MAIN ] Update Progress: 728/2371 symbols completed. ELP took 37.5s. Estimated remaining: 3h 37m 17s. Rate: 7.6 symbols/min [2025-09-26T18:36:19.685423] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-26T18:36:19.708393] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:36:19.708589] [DEBUG] [LOCAL ] EME: No existing data file found in primary storage. [2025-09-26T18:36:19.708666] [WARN ] [MAIN ] EME: No existing data found, performing full refresh instead. [2025-09-26T18:36:19.708869] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-09-26T18:36:19.708914] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-09-26T18:36:19.708957] [DEBUG] [LOCAL ] EME: No primary data file found to delete. [2025-09-26T18:36:19.708990] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-09-26T18:36:19.965863] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-09-26T18:36:20.091355] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:36:20.756762] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-09-26T18:36:20.975691] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-26T18:36:21.556741] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-06. [2025-09-26T18:36:22.356702] [INFO ] [REMOTE ] EME: Fetching primary data for 2024-12. [2025-09-26T18:36:22.380783] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-26T18:36:22.469089] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-26T18:36:23.156734] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-07. [2025-09-26T18:36:23.956721] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-09-26T18:36:24.095266] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-26T18:36:24.111442] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-26T18:36:24.756741] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-09-26T18:36:25.556766] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-09-26T18:36:25.994541] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-26T18:36:26.203031] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-26T18:36:26.356728] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-09-26T18:36:26.915079] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-26T18:36:27.156754] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-09-26T18:36:27.956743] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-08. [2025-09-26T18:36:28.156039] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-26T18:36:28.401729] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-26T18:36:28.600683] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-26T18:36:28.756771] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-09. [2025-09-26T18:36:29.556770] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-09-26T18:36:29.951922] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-26T18:36:29.955935] [INFO ] [REMOTE ] EMA: Full fetch complete (8290 records). [2025-09-26T18:36:29.956037] [DEBUG] [VALIDATOR ] EMA: Validating primary data. [2025-09-26T18:36:30.160526] [WARN ] [VALIDATOR ] EMA: Validation failed - insufficient historical data. Have 85 unique days, need 200 days [2025-09-26T18:36:30.160807] [FATAL] [MAIN ] EMA: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:36:30.160890] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:36:30.160974] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-26T18:36:30.161063] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-26T18:36:30.161101] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-09-26T18:36:30.161171] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-09-26T18:36:30.161241] [INFO ] [MAIN ] Update Progress: 729/2371 symbols completed. EMA took 24.8s. Estimated remaining: 3h 37m 15s. Rate: 7.6 symbols/min [2025-09-26T18:36:30.338815] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:36:30.348629] [DEBUG] [LOCAL ] EMF: Loaded 3558 existing records from primary storage. [2025-09-26T18:36:30.348791] [INFO ] [MAIN ] EMF: Loaded 3558 existing records. [2025-09-26T18:36:30.361808] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-09-26T18:36:30.559703] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:36:30.559986] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-09-26T18:36:30.560041] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-09-26T18:36:30.560351] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-09-26T18:36:30.560439] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-09-26T18:36:30.983237] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:36:31.156739] [INFO ] [REMOTE ] EMF: Fetching primary data for 2024-12. [2025-09-26T18:36:31.521920] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-26T18:36:31.538390] [INFO ] [REMOTE ] ELV: Full fetch complete (73210 records). [2025-09-26T18:36:31.538638] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-09-26T18:36:31.960723] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-09-26T18:36:32.027026] [DEBUG] [VALIDATOR ] ELV: All expected trading days are present. [2025-09-26T18:36:32.029554] [DEBUG] [VALIDATOR ] ELV: Primary data validation passed. [2025-09-26T18:36:32.029425] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-26T18:36:32.031103] [INFO ] [MAIN ] ELV: Fetched primary data is valid. [2025-09-26T18:36:32.041178] [DEBUG] [LOCAL ] ELV: Saving primary data. [2025-09-26T18:36:32.044549] [DEBUG] [LOCAL ] ELV: Trimmed 73210 records to 51334 (keeping 200 days of data) [2025-09-26T18:36:32.161166] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-26T18:36:32.428432] [DEBUG] [LOCAL ] ELV: Primary data saved (51334 records). [2025-09-26T18:36:32.428615] [INFO ] [MAIN ] ELV: Full history saved. [2025-09-26T18:36:32.430041] [INFO ] [MAIN ] Update Progress: 730/2371 symbols completed. ELV took 42.3s. Estimated remaining: 3h 36m 54s. Rate: 7.6 symbols/min [2025-09-26T18:36:32.612637] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:36:32.675157] [DEBUG] [LOCAL ] EMN: Loaded 50743 existing records from primary storage. [2025-09-26T18:36:32.675379] [INFO ] [MAIN ] EMN: Loaded 50743 existing records. [2025-09-26T18:36:32.761830] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-09-26T18:36:32.877146] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:36:32.877567] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-09-26T18:36:32.877624] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-09-26T18:36:32.877901] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-09-26T18:36:32.877959] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-09-26T18:36:33.057853] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-26T18:36:33.293363] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:36:33.299298] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-26T18:36:33.556734] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-09-26T18:36:34.356726] [INFO ] [REMOTE ] EMN: Fetching primary data for 2024-12. [2025-09-26T18:36:35.156704] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-09-26T18:36:35.324588] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-26T18:36:35.575328] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-26T18:36:35.794946] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-26T18:36:35.956797] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-09-26T18:36:36.756776] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-09-26T18:36:37.569725] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-09-26T18:36:37.576440] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-26T18:36:37.930849] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-26T18:36:38.356689] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-09-26T18:36:38.669536] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-26T18:36:39.156772] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-09-26T18:36:39.825314] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-26T18:36:39.904759] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-26T18:36:39.956761] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-09-26T18:36:40.557216] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-26T18:36:40.756733] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-09-26T18:36:41.556752] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-09-26T18:36:41.841569] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-26T18:36:42.356738] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-09-26T18:36:42.920387] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-26T18:36:43.156969] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-09-26T18:36:43.235506] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-26T18:36:43.956800] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-09-26T18:36:44.242114] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-26T18:36:44.756785] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-09-26T18:36:45.556745] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-09-26T18:36:45.563251] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-26T18:36:46.179286] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-26T18:36:46.334959] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-26T18:36:46.356683] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-09-26T18:36:47.156707] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-09-26T18:36:47.402479] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-26T18:36:47.956722] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-09-26T18:36:48.756718] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-09-26T18:36:49.218116] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-26T18:36:49.203214] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-26T18:36:49.232409] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-26T18:36:49.243324] [INFO ] [REMOTE ] EMD: Full fetch complete (32182 records). [2025-09-26T18:36:49.243813] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-09-26T18:36:49.561805] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-09-26T18:36:49.638259] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-09-26T18:36:49.638348] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-09-26T18:36:49.638907] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-09-26T18:36:49.638972] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-09-26T18:36:49.639809] [DEBUG] [LOCAL ] EMD: Trimmed 32182 records to 21338 (keeping 200 days of data) [2025-09-26T18:36:49.769288] [DEBUG] [LOCAL ] EMD: Primary data saved (21338 records). [2025-09-26T18:36:49.769420] [INFO ] [MAIN ] EMD: Full history saved. [2025-09-26T18:36:49.769507] [INFO ] [MAIN ] Update Progress: 731/2371 symbols completed. EMD took 35.8s. Estimated remaining: 3h 37m 7s. Rate: 7.6 symbols/min [2025-09-26T18:36:49.947416] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:36:49.965271] [DEBUG] [LOCAL ] EMO: Loaded 12593 existing records from primary storage. [2025-09-26T18:36:49.965428] [INFO ] [MAIN ] EMO: Loaded 12593 existing records. [2025-09-26T18:36:50.157892] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:36:50.158175] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-09-26T18:36:50.158227] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-09-26T18:36:50.158428] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-09-26T18:36:50.158488] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-09-26T18:36:50.282225] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-26T18:36:50.361846] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-09-26T18:36:50.569620] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:36:51.113328] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-26T18:36:51.156707] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-09-26T18:36:51.759879] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-26T18:36:51.761063] [INFO ] [REMOTE ] EMF: Full fetch complete (7148 records). [2025-09-26T18:36:51.761135] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-09-26T18:36:51.966695] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-09-26T18:36:52.138759] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-09-26T18:36:52.138896] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-09-26T18:36:52.139096] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-09-26T18:36:52.139138] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-09-26T18:36:52.139573] [DEBUG] [LOCAL ] EMF: Trimmed 7148 records to 3575 (keeping 200 days of data) [2025-09-26T18:36:52.164248] [DEBUG] [LOCAL ] EMF: Primary data saved (3575 records). [2025-09-26T18:36:52.164345] [INFO ] [MAIN ] EMF: Full history saved. [2025-09-26T18:36:52.164455] [INFO ] [MAIN ] Update Progress: 732/2371 symbols completed. EMF took 22.0s. Estimated remaining: 3h 36m 47s. Rate: 7.6 symbols/min [2025-09-26T18:36:52.349798] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:36:52.356923] [DEBUG] [LOCAL ] EMP: Loaded 3055 existing records from primary storage. [2025-09-26T18:36:52.357022] [INFO ] [MAIN ] EMP: Loaded 3055 existing records. [2025-09-26T18:36:52.546813] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:36:52.547086] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-09-26T18:36:52.547135] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-09-26T18:36:52.547371] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-09-26T18:36:52.547432] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-09-26T18:36:52.768945] [INFO ] [REMOTE ] EMO: Fetching primary data for 2024-12. [2025-09-26T18:36:52.935595] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:36:53.490132] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-26T18:36:53.556732] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-09-26T18:36:53.725858] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-26T18:36:54.356802] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-09-26T18:36:54.469136] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-26T18:36:55.156762] [INFO ] [REMOTE ] EMP: Fetching primary data for 2024-12. [2025-09-26T18:36:55.648305] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-26T18:36:55.700751] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-26T18:36:55.956750] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-09-26T18:36:56.756798] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-09-26T18:36:57.556753] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-09-26T18:36:57.598151] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-26T18:36:57.605332] [INFO ] [REMOTE ] EME: Full fetch complete (46976 records). [2025-09-26T18:36:57.605489] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-09-26T18:36:58.033661] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-09-26T18:36:58.033789] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-09-26T18:36:58.034631] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-09-26T18:36:58.034733] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-09-26T18:36:58.036009] [DEBUG] [LOCAL ] EME: Trimmed 46976 records to 32035 (keeping 200 days of data) [2025-09-26T18:36:58.191792] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-26T18:36:58.320915] [DEBUG] [LOCAL ] EME: Primary data saved (32035 records). [2025-09-26T18:36:58.321151] [INFO ] [MAIN ] EME: Full history saved. [2025-09-26T18:36:58.321297] [INFO ] [MAIN ] Update Progress: 733/2371 symbols completed. EME took 38.8s. Estimated remaining: 3h 36m 35s. Rate: 7.6 symbols/min [2025-09-26T18:36:58.361813] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-09-26T18:36:58.475123] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-26T18:36:58.537931] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:36:58.593798] [DEBUG] [LOCAL ] EMR: Loaded 53639 existing records from primary storage. [2025-09-26T18:36:58.593981] [INFO ] [MAIN ] EMR: Loaded 53639 existing records. [2025-09-26T18:36:58.782055] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:36:58.782304] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-09-26T18:36:58.782354] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-09-26T18:36:58.782749] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-09-26T18:36:58.782809] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-09-26T18:36:58.988130] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-26T18:36:59.165547] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-09-26T18:36:59.201254] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:36:59.674840] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-26T18:36:59.956750] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-09-26T18:37:00.756735] [INFO ] [REMOTE ] EMR: Fetching primary data for 2024-12. [2025-09-26T18:37:00.828049] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-26T18:37:01.556734] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-09-26T18:37:02.091633] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-26T18:37:02.356706] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-09-26T18:37:02.486808] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-26T18:37:02.753564] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-26T18:37:03.156741] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-09-26T18:37:03.956726] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-09-26T18:37:04.756700] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-09-26T18:37:04.989890] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-26T18:37:05.106278] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-26T18:37:05.383799] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-26T18:37:05.556736] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-09-26T18:37:06.356772] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-09-26T18:37:07.090319] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-26T18:37:07.156789] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-09-26T18:37:07.939664] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-26T18:37:07.950481] [INFO ] [REMOTE ] EMN: Full fetch complete (71990 records). [2025-09-26T18:37:07.950704] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-09-26T18:37:07.963828] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-09-26T18:37:08.369336] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-09-26T18:37:08.369440] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-09-26T18:37:08.370457] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-09-26T18:37:08.370528] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-09-26T18:37:08.373049] [DEBUG] [LOCAL ] EMN: Trimmed 71990 records to 51117 (keeping 200 days of data) [2025-09-26T18:37:08.611879] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-26T18:37:08.744370] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-26T18:37:08.756707] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-09-26T18:37:08.845277] [DEBUG] [LOCAL ] EMN: Primary data saved (51117 records). [2025-09-26T18:37:08.845444] [INFO ] [MAIN ] EMN: Full history saved. [2025-09-26T18:37:08.845562] [INFO ] [MAIN ] Update Progress: 734/2371 symbols completed. EMN took 36.4s. Estimated remaining: 3h 36m 33s. Rate: 7.6 symbols/min [2025-09-26T18:37:09.045357] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:37:09.101423] [DEBUG] [LOCAL ] ENB: Loaded 53906 existing records from primary storage. [2025-09-26T18:37:09.101582] [INFO ] [MAIN ] ENB: Loaded 53906 existing records. [2025-09-26T18:37:09.305637] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:37:09.305969] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-09-26T18:37:09.306038] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-09-26T18:37:09.306438] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-09-26T18:37:09.306502] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-09-26T18:37:09.561894] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-09-26T18:37:09.730617] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:37:09.738893] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-26T18:37:10.356744] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-09-26T18:37:11.050518] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-26T18:37:11.156751] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-09-26T18:37:11.729844] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-26T18:37:11.734709] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-26T18:37:11.956752] [INFO ] [REMOTE ] ENB: Fetching primary data for 2024-12. [2025-09-26T18:37:12.756738] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-09-26T18:37:13.556763] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-09-26T18:37:13.570594] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-26T18:37:13.831064] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-26T18:37:14.099960] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-26T18:37:14.356727] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-09-26T18:37:15.156731] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-09-26T18:37:15.956732] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-09-26T18:37:16.425009] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-26T18:37:16.489217] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-26T18:37:16.760241] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-09-26T18:37:16.766726] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-26T18:37:17.385542] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-26T18:37:17.386933] [INFO ] [REMOTE ] EMP: Full fetch complete (4271 records). [2025-09-26T18:37:17.387015] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-09-26T18:37:17.558688] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-09-26T18:37:17.782610] [DEBUG] [VALIDATOR ] EMP: All expected trading days are present. [2025-09-26T18:37:17.782727] [DEBUG] [VALIDATOR ] EMP: Primary data validation passed. [2025-09-26T18:37:17.782889] [INFO ] [MAIN ] EMP: Fetched primary data is valid. [2025-09-26T18:37:17.782930] [DEBUG] [LOCAL ] EMP: Saving primary data. [2025-09-26T18:37:17.783307] [DEBUG] [LOCAL ] EMP: Trimmed 4271 records to 3062 (keeping 200 days of data) [2025-09-26T18:37:17.803690] [DEBUG] [LOCAL ] EMP: Primary data saved (3062 records). [2025-09-26T18:37:17.803803] [INFO ] [MAIN ] EMP: Full history saved. [2025-09-26T18:37:17.803909] [INFO ] [MAIN ] Update Progress: 735/2371 symbols completed. EMP took 25.6s. Estimated remaining: 3h 36m 27s. Rate: 7.6 symbols/min [2025-09-26T18:37:17.989992] [INFO ] [MAIN ] ENFY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:37:17.995939] [DEBUG] [LOCAL ] ENFY: Loaded 3060 existing records from primary storage. [2025-09-26T18:37:17.996055] [INFO ] [MAIN ] ENFY: Loaded 3060 existing records. [2025-09-26T18:37:18.184157] [WARN ] [MAIN ] ENFY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:37:18.184483] [INFO ] [MAIN ] ENFY: Wiping existing primary data before full refresh. [2025-09-26T18:37:18.184543] [INFO ] [LOCAL ] ENFY: Starting deletion of primary data. [2025-09-26T18:37:18.184875] [DEBUG] [LOCAL ] ENFY: Deleted primary data file. [2025-09-26T18:37:18.184939] [INFO ] [MAIN ] ENFY: Starting full primary refresh. [2025-09-26T18:37:18.361898] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-09-26T18:37:18.604264] [INFO ] [REMOTE ] ENFY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:37:19.156703] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2024-12. [2025-09-26T18:37:19.612982] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-26T18:37:19.863944] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-26T18:37:19.956776] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-09-26T18:37:20.274142] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-26T18:37:20.756771] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-01. [2025-09-26T18:37:21.234445] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-26T18:37:21.556726] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-09-26T18:37:21.892209] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-26T18:37:22.356726] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-09-26T18:37:23.156987] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-02. [2025-09-26T18:37:23.730758] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-26T18:37:23.731143] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-26T18:37:23.956691] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-09-26T18:37:23.994868] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-26T18:37:24.756732] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-09-26T18:37:25.556723] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-09-26T18:37:26.146537] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-26T18:37:26.356728] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-03. [2025-09-26T18:37:26.393849] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-26T18:37:26.542761] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-26T18:37:26.553272] [INFO ] [REMOTE ] EMR: Full fetch complete (77110 records). [2025-09-26T18:37:26.553406] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-09-26T18:37:26.863419] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-26T18:37:26.969361] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-09-26T18:37:26.969461] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-09-26T18:37:26.970390] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-09-26T18:37:26.970461] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-09-26T18:37:26.972248] [DEBUG] [LOCAL ] EMR: Trimmed 77110 records to 54027 (keeping 200 days of data) [2025-09-26T18:37:27.164709] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-04. [2025-09-26T18:37:27.338908] [DEBUG] [LOCAL ] EMR: Primary data saved (54027 records). [2025-09-26T18:37:27.339108] [INFO ] [MAIN ] EMR: Full history saved. [2025-09-26T18:37:27.339269] [INFO ] [MAIN ] Update Progress: 736/2371 symbols completed. EMR took 29.0s. Estimated remaining: 3h 36m 23s. Rate: 7.6 symbols/min [2025-09-26T18:37:27.520281] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:37:27.558460] [DEBUG] [LOCAL ] ENIC: Loaded 36725 existing records from primary storage. [2025-09-26T18:37:27.558634] [INFO ] [MAIN ] ENIC: Loaded 36725 existing records. [2025-09-26T18:37:27.751856] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:37:27.752144] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-09-26T18:37:27.752207] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-09-26T18:37:27.752519] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-09-26T18:37:27.752579] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-09-26T18:37:27.961879] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-09-26T18:37:28.139494] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:37:28.756705] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2024-12. [2025-09-26T18:37:28.958098] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-26T18:37:29.556764] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-09-26T18:37:29.973551] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-26T18:37:30.356751] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-09-26T18:37:30.412991] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-26T18:37:30.417257] [INFO ] [REMOTE ] EMO: Full fetch complete (17092 records). [2025-09-26T18:37:30.417338] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-09-26T18:37:30.826835] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-09-26T18:37:30.827041] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-09-26T18:37:30.827510] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-09-26T18:37:30.827577] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-09-26T18:37:30.828240] [DEBUG] [LOCAL ] EMO: Trimmed 17092 records to 12656 (keeping 200 days of data) [2025-09-26T18:37:30.910337] [DEBUG] [LOCAL ] EMO: Primary data saved (12656 records). [2025-09-26T18:37:30.910498] [INFO ] [MAIN ] EMO: Full history saved. [2025-09-26T18:37:30.910636] [INFO ] [MAIN ] Update Progress: 737/2371 symbols completed. EMO took 41.1s. Estimated remaining: 3h 36m 5s. Rate: 7.6 symbols/min [2025-09-26T18:37:31.114268] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:37:31.119838] [DEBUG] [LOCAL ] ENO: Loaded 1948 existing records from primary storage. [2025-09-26T18:37:31.119931] [INFO ] [MAIN ] ENO: Loaded 1948 existing records. [2025-09-26T18:37:31.167104] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-09-26T18:37:31.322050] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:37:31.322676] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-09-26T18:37:31.322884] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-09-26T18:37:31.323143] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-09-26T18:37:31.323257] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-09-26T18:37:31.524783] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-26T18:37:31.758707] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:37:31.762686] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-04 (4.60 seconds). [2025-09-26T18:37:31.956747] [INFO ] [REMOTE ] ENO: Fetching primary data for 2024-12. [2025-09-26T18:37:32.596276] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-26T18:37:32.756723] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-09-26T18:37:33.218745] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-26T18:37:33.265298] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-26T18:37:33.556741] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-09-26T18:37:34.150967] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-26T18:37:34.356713] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-09-26T18:37:34.808622] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-26T18:37:35.156731] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-09-26T18:37:35.956756] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-05. [2025-09-26T18:37:36.459079] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-26T18:37:36.474125] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-26T18:37:36.756808] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-09-26T18:37:37.556755] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-09-26T18:37:38.356766] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-09-26T18:37:38.751691] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-26T18:37:39.020872] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-26T18:37:39.021023] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-26T18:37:39.156781] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-09-26T18:37:39.956745] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-06. [2025-09-26T18:37:40.553150] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-26T18:37:40.756725] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-09-26T18:37:40.916466] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-26T18:37:41.193490] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-26T18:37:41.556719] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-09-26T18:37:42.356771] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-09-26T18:37:42.982481] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-26T18:37:43.156719] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-09-26T18:37:43.968898] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-07. [2025-09-26T18:37:43.975692] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-26T18:37:44.321923] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-26T18:37:44.702683] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-26T18:37:44.756768] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-09-26T18:37:45.556744] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-08. [2025-09-26T18:37:46.132559] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-26T18:37:46.284281] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-26T18:37:46.356718] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-09-26T18:37:47.156728] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-09. [2025-09-26T18:37:47.705670] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-26T18:37:47.719700] [INFO ] [REMOTE ] ENFY: Full fetch complete (5617 records). [2025-09-26T18:37:47.721233] [DEBUG] [VALIDATOR ] ENFY: Validating primary data. [2025-09-26T18:37:47.721159] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-26T18:37:47.962471] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-09-26T18:37:48.130095] [DEBUG] [VALIDATOR ] ENFY: All expected trading days are present. [2025-09-26T18:37:48.130181] [DEBUG] [VALIDATOR ] ENFY: Primary data validation passed. [2025-09-26T18:37:48.130358] [INFO ] [MAIN ] ENFY: Fetched primary data is valid. [2025-09-26T18:37:48.130402] [DEBUG] [LOCAL ] ENFY: Saving primary data. [2025-09-26T18:37:48.130844] [DEBUG] [LOCAL ] ENFY: Trimmed 5617 records to 3106 (keeping 200 days of data) [2025-09-26T18:37:48.149082] [DEBUG] [LOCAL ] ENFY: Primary data saved (3106 records). [2025-09-26T18:37:48.149174] [INFO ] [MAIN ] ENFY: Full history saved. [2025-09-26T18:37:48.149262] [INFO ] [MAIN ] Update Progress: 738/2371 symbols completed. ENFY took 30.3s. Estimated remaining: 3h 36m 18s. Rate: 7.5 symbols/min [2025-09-26T18:37:48.334952] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:37:48.393013] [DEBUG] [LOCAL ] ENOV: Loaded 45531 existing records from primary storage. [2025-09-26T18:37:48.393184] [INFO ] [MAIN ] ENOV: Loaded 45531 existing records. [2025-09-26T18:37:48.608490] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:37:48.608820] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-09-26T18:37:48.608875] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-09-26T18:37:48.609203] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-09-26T18:37:48.609263] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-09-26T18:37:48.765672] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-09-26T18:37:49.005118] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:37:49.468701] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-26T18:37:49.475583] [INFO ] [REMOTE ] ENIC: Full fetch complete (51277 records). [2025-09-26T18:37:49.475758] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-09-26T18:37:49.561875] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2024-12. [2025-09-26T18:37:49.869776] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-09-26T18:37:49.869861] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-09-26T18:37:49.870527] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-09-26T18:37:49.870568] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-09-26T18:37:49.871700] [DEBUG] [LOCAL ] ENIC: Trimmed 51277 records to 36910 (keeping 200 days of data) [2025-09-26T18:37:50.080300] [DEBUG] [LOCAL ] ENIC: Primary data saved (36910 records). [2025-09-26T18:37:50.080466] [INFO ] [MAIN ] ENIC: Full history saved. [2025-09-26T18:37:50.080560] [INFO ] [MAIN ] Update Progress: 739/2371 symbols completed. ENIC took 22.7s. Estimated remaining: 3h 35m 57s. Rate: 7.6 symbols/min [2025-09-26T18:37:50.259111] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:37:50.259308] [DEBUG] [LOCAL ] ENR: No existing data file found in primary storage. [2025-09-26T18:37:50.259347] [WARN ] [MAIN ] ENR: No existing data found, performing full refresh instead. [2025-09-26T18:37:50.259492] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-09-26T18:37:50.259535] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-09-26T18:37:50.259589] [DEBUG] [LOCAL ] ENR: No primary data file found to delete. [2025-09-26T18:37:50.259622] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-09-26T18:37:50.361966] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-09-26T18:37:50.655287] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:37:50.690036] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-26T18:37:50.886944] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-26T18:37:50.977845] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-26T18:37:51.156743] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-09-26T18:37:51.608058] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-26T18:37:51.956773] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-12. [2025-09-26T18:37:52.756763] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-09-26T18:37:53.354280] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-26T18:37:53.487087] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-26T18:37:53.556729] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-09-26T18:37:54.356772] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-09-26T18:37:55.162842] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-09-26T18:37:55.166198] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-26T18:37:55.720934] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-26T18:37:55.721915] [INFO ] [REMOTE ] ENO: Full fetch complete (3112 records). [2025-09-26T18:37:55.722006] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-09-26T18:37:55.961880] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-09-26T18:37:56.126536] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-09-26T18:37:56.126773] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-09-26T18:37:56.126927] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-09-26T18:37:56.127016] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-09-26T18:37:56.127943] [DEBUG] [LOCAL ] ENO: Trimmed 3112 records to 1952 (keeping 200 days of data) [2025-09-26T18:37:56.141329] [DEBUG] [LOCAL ] ENO: Primary data saved (1952 records). [2025-09-26T18:37:56.141437] [INFO ] [MAIN ] ENO: Full history saved. [2025-09-26T18:37:56.141543] [INFO ] [MAIN ] Update Progress: 740/2371 symbols completed. ENO took 25.2s. Estimated remaining: 3h 35m 45s. Rate: 7.6 symbols/min [2025-09-26T18:37:56.350671] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:37:56.358217] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-26T18:37:56.369255] [INFO ] [REMOTE ] ENB: Full fetch complete (77491 records). [2025-09-26T18:37:56.369458] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-09-26T18:37:56.656001] [DEBUG] [LOCAL ] ENS: Loaded 29684 existing records from primary storage. [2025-09-26T18:37:56.683952] [INFO ] [MAIN ] ENS: Loaded 29684 existing records. [2025-09-26T18:37:56.770852] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-09-26T18:37:57.007082] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-09-26T18:37:57.013330] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:37:57.013633] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-09-26T18:37:57.015422] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-09-26T18:37:57.015827] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-09-26T18:37:57.015625] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-09-26T18:37:57.016025] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-09-26T18:37:57.016847] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-09-26T18:37:57.016994] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-09-26T18:37:57.120708] [DEBUG] [LOCAL ] ENB: Trimmed 77491 records to 54295 (keeping 200 days of data) [2025-09-26T18:37:57.370513] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-26T18:37:57.522711] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:37:57.556673] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-09-26T18:37:57.776764] [DEBUG] [LOCAL ] ENB: Primary data saved (54295 records). [2025-09-26T18:37:57.776929] [INFO ] [MAIN ] ENB: Full history saved. [2025-09-26T18:37:57.777027] [INFO ] [MAIN ] Update Progress: 741/2371 symbols completed. ENB took 48.9s. Estimated remaining: 3h 35m 23s. Rate: 7.6 symbols/min [2025-09-26T18:37:57.962306] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:37:57.989890] [DEBUG] [LOCAL ] ENVA: Loaded 25782 existing records from primary storage. [2025-09-26T18:37:57.990081] [INFO ] [MAIN ] ENVA: Loaded 25782 existing records. [2025-09-26T18:37:58.183758] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:37:58.184031] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-09-26T18:37:58.184080] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-09-26T18:37:58.184331] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-09-26T18:37:58.184389] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-09-26T18:37:58.370593] [INFO ] [REMOTE ] ENS: Fetching primary data for 2024-12. [2025-09-26T18:37:58.608621] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:37:58.612903] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-26T18:37:59.047914] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-26T18:37:59.156793] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2024-12. [2025-09-26T18:37:59.906527] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-26T18:37:59.956705] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-09-26T18:38:00.099056] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-26T18:38:00.756777] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-09-26T18:38:01.078695] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-26T18:38:01.556742] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-09-26T18:38:02.332431] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-26T18:38:02.356684] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-09-26T18:38:02.851918] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-26T18:38:03.156747] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-09-26T18:38:03.747702] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-26T18:38:03.956729] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-09-26T18:38:04.674582] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-26T18:38:04.756769] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-09-26T18:38:04.852386] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-26T18:38:05.556738] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-09-26T18:38:05.994246] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-26T18:38:06.356758] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-09-26T18:38:06.440090] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-26T18:38:07.156745] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-09-26T18:38:07.742579] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-26T18:38:07.915874] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-26T18:38:07.956714] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-09-26T18:38:08.756777] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-09-26T18:38:09.357410] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-26T18:38:09.556732] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-09-26T18:38:10.312345] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-26T18:38:10.356744] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-09-26T18:38:11.156716] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-09-26T18:38:11.313808] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-26T18:38:11.392114] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-26T18:38:11.956747] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-09-26T18:38:12.740920] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-26T18:38:12.756733] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-09-26T18:38:12.816870] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-26T18:38:13.556760] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-09-26T18:38:14.182575] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-26T18:38:14.356753] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-09-26T18:38:15.166020] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-09-26T18:38:15.187787] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-26T18:38:15.885518] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-26T18:38:15.956722] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-09-26T18:38:16.733548] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-26T18:38:16.741831] [INFO ] [REMOTE ] ENR: Full fetch complete (58076 records). [2025-09-26T18:38:16.741966] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-09-26T18:38:16.743008] [FATAL] [VALIDATOR ] ENR: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:38:16.743116] [FATAL] [MAIN ] ENR: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:38:16.743178] [WARN ] [MAIN ] ENR: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:38:16.743227] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-09-26T18:38:16.743335] [DEBUG] [LOCAL ] ENR: No primary data file found to delete. [2025-09-26T18:38:16.743408] [INFO ] [LOCAL ] ENR: Starting deletion of derivative data. [2025-09-26T18:38:16.743509] [DEBUG] [LOCAL ] ENR: No derivative data file found to delete. [2025-09-26T18:38:16.743602] [INFO ] [MAIN ] Update Progress: 742/2371 symbols completed. ENR took 26.7s. Estimated remaining: 3h 35m 39s. Rate: 7.6 symbols/min [2025-09-26T18:38:16.765309] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-09-26T18:38:16.982439] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:38:17.006031] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-26T18:38:17.025120] [DEBUG] [LOCAL ] EOD: Loaded 14137 existing records from primary storage. [2025-09-26T18:38:17.025279] [INFO ] [MAIN ] EOD: Loaded 14137 existing records. [2025-09-26T18:38:17.222588] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:38:17.223412] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-09-26T18:38:17.223498] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-09-26T18:38:17.224070] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-09-26T18:38:17.224147] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-09-26T18:38:17.561909] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-09-26T18:38:17.625113] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:38:17.694721] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-26T18:38:18.356736] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-09-26T18:38:19.156733] [INFO ] [REMOTE ] EOD: Fetching primary data for 2024-12. [2025-09-26T18:38:19.654365] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-26T18:38:19.956746] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-09-26T18:38:20.115306] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-26T18:38:20.756736] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-09-26T18:38:20.945261] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-26T18:38:21.556741] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-09-26T18:38:21.823734] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-26T18:38:22.154686] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-26T18:38:22.213913] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (4.65 seconds). [2025-09-26T18:38:22.223295] [INFO ] [REMOTE ] ENOV: Full fetch complete (63153 records). [2025-09-26T18:38:22.223427] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-09-26T18:38:22.361832] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-09-26T18:38:22.720137] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-09-26T18:38:22.720282] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-09-26T18:38:22.722553] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-09-26T18:38:22.722675] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-09-26T18:38:22.733326] [DEBUG] [LOCAL ] ENOV: Trimmed 63153 records to 45799 (keeping 200 days of data) [2025-09-26T18:38:23.034043] [DEBUG] [LOCAL ] ENOV: Primary data saved (45799 records). [2025-09-26T18:38:23.034186] [INFO ] [MAIN ] ENOV: Full history saved. [2025-09-26T18:38:23.034455] [INFO ] [MAIN ] Update Progress: 743/2371 symbols completed. ENOV took 34.9s. Estimated remaining: 3h 35m 28s. Rate: 7.6 symbols/min [2025-09-26T18:38:23.165073] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-09-26T18:38:23.246696] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:38:23.315232] [DEBUG] [LOCAL ] EOG: Loaded 53731 existing records from primary storage. [2025-09-26T18:38:23.315406] [INFO ] [MAIN ] EOG: Loaded 53731 existing records. [2025-09-26T18:38:23.514061] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:38:23.514359] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-09-26T18:38:23.514451] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-09-26T18:38:23.514846] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-09-26T18:38:23.514918] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-09-26T18:38:23.962184] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-09-26T18:38:24.007421] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:38:24.038558] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-26T18:38:24.085083] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-26T18:38:24.756732] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-09-26T18:38:25.306763] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-26T18:38:25.556741] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-09-26T18:38:25.790834] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-26T18:38:26.356745] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-09-26T18:38:26.946443] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-26T18:38:26.953505] [INFO ] [REMOTE ] ENVA: Full fetch complete (36598 records). [2025-09-26T18:38:26.953745] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-09-26T18:38:27.161875] [INFO ] [REMOTE ] EOG: Fetching primary data for 2024-12. [2025-09-26T18:38:27.365415] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-09-26T18:38:27.365534] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-09-26T18:38:27.366217] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-09-26T18:38:27.366389] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-09-26T18:38:27.391241] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-26T18:38:27.397954] [DEBUG] [LOCAL ] ENVA: Trimmed 36598 records to 25914 (keeping 200 days of data) [2025-09-26T18:38:27.572631] [DEBUG] [LOCAL ] ENVA: Primary data saved (25914 records). [2025-09-26T18:38:27.572810] [INFO ] [MAIN ] ENVA: Full history saved. [2025-09-26T18:38:27.572922] [INFO ] [MAIN ] Update Progress: 744/2371 symbols completed. ENVA took 29.8s. Estimated remaining: 3h 35m 12s. Rate: 7.6 symbols/min [2025-09-26T18:38:27.780791] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:38:27.796240] [DEBUG] [LOCAL ] EOI: Loaded 10652 existing records from primary storage. [2025-09-26T18:38:27.796352] [INFO ] [MAIN ] EOI: Loaded 10652 existing records. [2025-09-26T18:38:27.957939] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-09-26T18:38:27.983300] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:38:27.983746] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-09-26T18:38:27.983816] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-09-26T18:38:27.984153] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-09-26T18:38:27.984214] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-09-26T18:38:28.374529] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:38:28.665821] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-26T18:38:28.756778] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-09-26T18:38:29.093129] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-26T18:38:29.556743] [INFO ] [REMOTE ] EOI: Fetching primary data for 2024-12. [2025-09-26T18:38:30.277321] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-26T18:38:30.284551] [INFO ] [REMOTE ] ENS: Full fetch complete (42031 records). [2025-09-26T18:38:30.284771] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-09-26T18:38:30.364585] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-09-26T18:38:30.761947] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-26T18:38:30.787252] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-09-26T18:38:30.787361] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-09-26T18:38:30.788073] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-09-26T18:38:30.788140] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-09-26T18:38:30.789360] [DEBUG] [LOCAL ] ENS: Trimmed 42031 records to 29869 (keeping 200 days of data) [2025-09-26T18:38:31.014993] [DEBUG] [LOCAL ] ENS: Primary data saved (29869 records). [2025-09-26T18:38:31.015201] [INFO ] [MAIN ] ENS: Full history saved. [2025-09-26T18:38:31.015337] [INFO ] [MAIN ] Update Progress: 745/2371 symbols completed. ENS took 34.9s. Estimated remaining: 3h 34m 54s. Rate: 7.6 symbols/min [2025-09-26T18:38:31.167721] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-09-26T18:38:31.204457] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:38:31.224913] [DEBUG] [LOCAL ] EOS: Loaded 15445 existing records from primary storage. [2025-09-26T18:38:31.225071] [INFO ] [MAIN ] EOS: Loaded 15445 existing records. [2025-09-26T18:38:31.430334] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:38:31.430603] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-09-26T18:38:31.430683] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-09-26T18:38:31.430915] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-09-26T18:38:31.430974] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-09-26T18:38:31.859035] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:38:31.956769] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-09-26T18:38:32.020991] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-26T18:38:32.104009] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-26T18:38:32.756754] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-09-26T18:38:32.977950] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-26T18:38:33.556735] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-09-26T18:38:34.356697] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-09-26T18:38:34.513581] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-26T18:38:34.705187] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-26T18:38:34.912122] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-26T18:38:35.156737] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-09-26T18:38:35.956736] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-12. [2025-09-26T18:38:36.132778] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-26T18:38:36.756754] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-09-26T18:38:37.140377] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-26T18:38:37.316205] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-26T18:38:37.556748] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-09-26T18:38:38.356745] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-09-26T18:38:39.156699] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-09-26T18:38:39.355134] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-26T18:38:39.536537] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-26T18:38:39.941399] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-26T18:38:39.956681] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-09-26T18:38:40.756701] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-09-26T18:38:40.823497] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-26T18:38:41.556737] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-09-26T18:38:41.736199] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-26T18:38:42.182334] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-26T18:38:42.356775] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-09-26T18:38:43.156784] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-09-26T18:38:43.956709] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-09-26T18:38:44.167534] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-26T18:38:44.188984] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-26T18:38:44.621682] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-26T18:38:44.756766] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-09-26T18:38:45.556718] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-09-26T18:38:45.616935] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-26T18:38:46.356713] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-09-26T18:38:46.422162] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-26T18:38:47.082892] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-26T18:38:47.087570] [INFO ] [REMOTE ] EOD: Full fetch complete (20013 records). [2025-09-26T18:38:47.087751] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-09-26T18:38:47.161857] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-09-26T18:38:47.480068] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-09-26T18:38:47.480160] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-09-26T18:38:47.480660] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-09-26T18:38:47.480726] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-09-26T18:38:47.481479] [DEBUG] [LOCAL ] EOD: Trimmed 20013 records to 14232 (keeping 200 days of data) [2025-09-26T18:38:47.578122] [DEBUG] [LOCAL ] EOD: Primary data saved (14232 records). [2025-09-26T18:38:47.578304] [INFO ] [MAIN ] EOD: Full history saved. [2025-09-26T18:38:47.578445] [INFO ] [MAIN ] Update Progress: 746/2371 symbols completed. EOD took 30.8s. Estimated remaining: 3h 35m 5s. Rate: 7.6 symbols/min [2025-09-26T18:38:47.773256] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:38:47.788793] [DEBUG] [LOCAL ] EOT: Loaded 6891 existing records from primary storage. [2025-09-26T18:38:47.788993] [INFO ] [MAIN ] EOT: Loaded 6891 existing records. [2025-09-26T18:38:47.957803] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-09-26T18:38:47.980350] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:38:47.982040] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-09-26T18:38:47.982112] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-09-26T18:38:47.982283] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-09-26T18:38:47.982371] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-09-26T18:38:48.352831] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-26T18:38:48.375059] [INFO ] [REMOTE ] EOI: Full fetch complete (16040 records). [2025-09-26T18:38:48.395011] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-09-26T18:38:48.399173] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:38:48.762433] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-09-26T18:38:48.790700] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-09-26T18:38:48.790833] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-09-26T18:38:48.791245] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-09-26T18:38:48.791289] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-09-26T18:38:48.791889] [DEBUG] [LOCAL ] EOI: Trimmed 16040 records to 10783 (keeping 200 days of data) [2025-09-26T18:38:48.860361] [DEBUG] [LOCAL ] EOI: Primary data saved (10783 records). [2025-09-26T18:38:48.860512] [INFO ] [MAIN ] EOI: Full history saved. [2025-09-26T18:38:48.860680] [INFO ] [MAIN ] Update Progress: 747/2371 symbols completed. EOI took 21.3s. Estimated remaining: 3h 34m 43s. Rate: 7.6 symbols/min [2025-09-26T18:38:49.034703] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:38:49.063002] [DEBUG] [LOCAL ] EPAC: Loaded 27252 existing records from primary storage. [2025-09-26T18:38:49.063145] [INFO ] [MAIN ] EPAC: Loaded 27252 existing records. [2025-09-26T18:38:49.255598] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:38:49.255998] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-09-26T18:38:49.256057] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-09-26T18:38:49.256351] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-09-26T18:38:49.256411] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-09-26T18:38:49.561915] [INFO ] [REMOTE ] EOT: Fetching primary data for 2024-12. [2025-09-26T18:38:49.640141] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:38:49.833416] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-26T18:38:49.872054] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-26T18:38:50.356740] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-09-26T18:38:50.491429] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-26T18:38:50.898383] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-26T18:38:51.156775] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-09-26T18:38:51.956768] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-09-26T18:38:52.756748] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2024-12. [2025-09-26T18:38:52.888607] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-26T18:38:53.112910] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-26T18:38:53.556752] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-09-26T18:38:53.979697] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-26T18:38:54.220359] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-26T18:38:54.356790] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-09-26T18:38:55.156741] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-09-26T18:38:55.956710] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-09-26T18:38:56.155784] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-26T18:38:56.210002] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-26T18:38:56.406983] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-26T18:38:56.756723] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-09-26T18:38:57.556724] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-09-26T18:38:57.890707] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-26T18:38:58.093310] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-26T18:38:58.356738] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-09-26T18:38:59.156706] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-09-26T18:38:59.598392] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-26T18:38:59.956759] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-09-26T18:39:00.756715] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-09-26T18:39:00.912817] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-26T18:39:00.910632] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-26T18:39:01.556723] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-09-26T18:39:01.870408] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-26T18:39:01.873603] [INFO ] [REMOTE ] EOS: Full fetch complete (22966 records). [2025-09-26T18:39:01.873708] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-09-26T18:39:01.874287] [FATAL] [VALIDATOR ] EOS: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:39:01.874387] [FATAL] [MAIN ] EOS: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:39:01.874454] [WARN ] [MAIN ] EOS: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:39:01.874529] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-09-26T18:39:01.874611] [DEBUG] [LOCAL ] EOS: No primary data file found to delete. [2025-09-26T18:39:01.874698] [INFO ] [LOCAL ] EOS: Starting deletion of derivative data. [2025-09-26T18:39:01.875220] [DEBUG] [LOCAL ] EOS: Deleted derivative data file. [2025-09-26T18:39:01.875376] [INFO ] [MAIN ] Update Progress: 748/2371 symbols completed. EOS took 30.9s. Estimated remaining: 3h 34m 46s. Rate: 7.6 symbols/min [2025-09-26T18:39:02.067018] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-26T18:39:02.105527] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:39:02.154409] [DEBUG] [LOCAL ] EPAM: Loaded 40102 existing records from primary storage. [2025-09-26T18:39:02.154561] [INFO ] [MAIN ] EPAM: Loaded 40102 existing records. [2025-09-26T18:39:02.350060] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:39:02.350396] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-09-26T18:39:02.350456] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-09-26T18:39:02.350756] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-09-26T18:39:02.350819] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-09-26T18:39:02.362813] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-09-26T18:39:02.762190] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:39:03.156736] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-12. [2025-09-26T18:39:03.956718] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-09-26T18:39:04.446542] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-26T18:39:04.486351] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-26T18:39:04.756706] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-09-26T18:39:04.969278] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-26T18:39:05.556723] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-09-26T18:39:06.055283] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-26T18:39:06.315849] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-26T18:39:06.356719] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-09-26T18:39:07.156765] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-09-26T18:39:07.805618] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-26T18:39:07.956759] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-09-26T18:39:08.120998] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-26T18:39:08.131830] [INFO ] [REMOTE ] EOG: Full fetch complete (77272 records). [2025-09-26T18:39:08.131999] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-09-26T18:39:08.483559] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-26T18:39:08.564340] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-09-26T18:39:08.564443] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-09-26T18:39:08.565554] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-09-26T18:39:08.565633] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-09-26T18:39:08.567521] [DEBUG] [LOCAL ] EOG: Trimmed 77272 records to 54121 (keeping 200 days of data) [2025-09-26T18:39:08.771546] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-09-26T18:39:08.943520] [DEBUG] [LOCAL ] EOG: Primary data saved (54121 records). [2025-09-26T18:39:08.943717] [INFO ] [MAIN ] EOG: Full history saved. [2025-09-26T18:39:08.943839] [INFO ] [MAIN ] Update Progress: 749/2371 symbols completed. EOG took 45.9s. Estimated remaining: 3h 34m 36s. Rate: 7.6 symbols/min [2025-09-26T18:39:09.126515] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:39:09.126752] [DEBUG] [LOCAL ] EPC: No existing data file found in primary storage. [2025-09-26T18:39:09.126800] [WARN ] [MAIN ] EPC: No existing data found, performing full refresh instead. [2025-09-26T18:39:09.126962] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-09-26T18:39:09.127005] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-09-26T18:39:09.127048] [DEBUG] [LOCAL ] EPC: No primary data file found to delete. [2025-09-26T18:39:09.127081] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-09-26T18:39:09.515022] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:39:09.556758] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-09-26T18:39:10.360552] [INFO ] [REMOTE ] EPC: Fetching primary data for 2024-12. [2025-09-26T18:39:10.364101] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-26T18:39:10.377753] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-26T18:39:11.156724] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-09-26T18:39:11.956726] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-09-26T18:39:12.094260] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-26T18:39:12.162595] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-26T18:39:12.756721] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-09-26T18:39:12.919582] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-26T18:39:12.921633] [INFO ] [REMOTE ] EOT: Full fetch complete (10762 records). [2025-09-26T18:39:12.921736] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-09-26T18:39:13.314702] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-09-26T18:39:13.314794] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-09-26T18:39:13.315065] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-09-26T18:39:13.315104] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-09-26T18:39:13.315625] [DEBUG] [LOCAL ] EOT: Trimmed 10762 records to 6916 (keeping 200 days of data) [2025-09-26T18:39:13.365963] [DEBUG] [LOCAL ] EOT: Primary data saved (6916 records). [2025-09-26T18:39:13.366126] [INFO ] [MAIN ] EOT: Full history saved. [2025-09-26T18:39:13.366225] [INFO ] [MAIN ] Update Progress: 750/2371 symbols completed. EOT took 25.8s. Estimated remaining: 3h 34m 21s. Rate: 7.6 symbols/min [2025-09-26T18:39:13.551791] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:39:13.556747] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-09-26T18:39:13.618403] [DEBUG] [LOCAL ] EPD: Loaded 54001 existing records from primary storage. [2025-09-26T18:39:13.618569] [INFO ] [MAIN ] EPD: Loaded 54001 existing records. [2025-09-26T18:39:13.807504] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:39:13.807812] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-09-26T18:39:13.807872] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-09-26T18:39:13.808180] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-09-26T18:39:13.808239] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-09-26T18:39:14.195714] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:39:14.217936] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-26T18:39:14.356748] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-12. [2025-09-26T18:39:15.099004] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-26T18:39:15.156732] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-09-26T18:39:15.956686] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-09-26T18:39:16.448928] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-26T18:39:16.492999] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-26T18:39:16.756729] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-09-26T18:39:17.467275] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-26T18:39:17.556749] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-09-26T18:39:18.146123] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-26T18:39:18.356765] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-09-26T18:39:19.156773] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-09-26T18:39:19.236626] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-26T18:39:19.658342] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-26T18:39:19.956780] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-09-26T18:39:20.756739] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-09-26T18:39:21.267874] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-26T18:39:21.362680] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-26T18:39:21.556757] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-09-26T18:39:22.356734] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-09-26T18:39:22.466050] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-26T18:39:23.156752] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-09-26T18:39:23.228369] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-26T18:39:23.817236] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-26T18:39:23.956738] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-09-26T18:39:24.704724] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-26T18:39:24.756719] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-09-26T18:39:25.537269] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-26T18:39:25.556702] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-09-26T18:39:26.311478] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T18:39:26.356705] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-09-26T18:39:27.036456] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-26T18:39:27.042259] [INFO ] [REMOTE ] EPAC: Full fetch complete (39098 records). [2025-09-26T18:39:27.042366] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-09-26T18:39:27.161795] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-09-26T18:39:27.456140] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-09-26T18:39:27.456246] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-09-26T18:39:27.457248] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-09-26T18:39:27.457325] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-09-26T18:39:27.458533] [DEBUG] [LOCAL ] EPAC: Trimmed 39098 records to 27416 (keeping 200 days of data) [2025-09-26T18:39:27.630332] [DEBUG] [LOCAL ] EPAC: Primary data saved (27416 records). [2025-09-26T18:39:27.630483] [INFO ] [MAIN ] EPAC: Full history saved. [2025-09-26T18:39:27.630629] [INFO ] [MAIN ] Update Progress: 751/2371 symbols completed. EPAC took 38.8s. Estimated remaining: 3h 34m 26s. Rate: 7.6 symbols/min [2025-09-26T18:39:27.813752] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:39:27.868990] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-26T18:39:27.893291] [DEBUG] [LOCAL ] EPR: Loaded 44449 existing records from primary storage. [2025-09-26T18:39:27.893470] [INFO ] [MAIN ] EPR: Loaded 44449 existing records. [2025-09-26T18:39:27.961916] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-09-26T18:39:28.084700] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:39:28.084964] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-09-26T18:39:28.085011] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-09-26T18:39:28.085259] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-09-26T18:39:28.085318] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-09-26T18:39:28.481380] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:39:28.756756] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-09-26T18:39:28.807380] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-26T18:39:29.509595] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T18:39:29.556724] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-09-26T18:39:30.356728] [INFO ] [REMOTE ] EPR: Fetching primary data for 2024-12. [2025-09-26T18:39:30.461957] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-26T18:39:30.644383] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-26T18:39:31.156756] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-09-26T18:39:31.704894] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-26T18:39:31.956732] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-09-26T18:39:32.540854] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-26T18:39:32.756736] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-09-26T18:39:33.556712] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-09-26T18:39:33.741373] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-26T18:39:33.959209] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-26T18:39:33.967459] [INFO ] [REMOTE ] EPC: Full fetch complete (56701 records). [2025-09-26T18:39:33.967590] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-09-26T18:39:34.362044] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-09-26T18:39:34.449973] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-09-26T18:39:34.450081] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-09-26T18:39:34.451008] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-09-26T18:39:34.451074] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-09-26T18:39:34.452494] [DEBUG] [LOCAL ] EPC: Trimmed 56701 records to 40383 (keeping 200 days of data) [2025-09-26T18:39:34.710203] [DEBUG] [LOCAL ] EPC: Primary data saved (40383 records). [2025-09-26T18:39:34.710332] [INFO ] [MAIN ] EPC: Full history saved. [2025-09-26T18:39:34.710450] [INFO ] [MAIN ] Update Progress: 752/2371 symbols completed. EPC took 25.8s. Estimated remaining: 3h 34m 16s. Rate: 7.6 symbols/min [2025-09-26T18:39:34.894467] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:39:34.920506] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-26T18:39:34.969870] [DEBUG] [LOCAL ] EPRT: Loaded 48991 existing records from primary storage. [2025-09-26T18:39:34.970056] [INFO ] [MAIN ] EPRT: Loaded 48991 existing records. [2025-09-26T18:39:35.160752] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-09-26T18:39:35.164204] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:39:35.165659] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-09-26T18:39:35.165721] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-09-26T18:39:35.166353] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-09-26T18:39:35.166439] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-09-26T18:39:35.562130] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:39:35.942407] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-26T18:39:35.956668] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-09-26T18:39:36.628446] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-26T18:39:36.637212] [INFO ] [REMOTE ] EPAM: Full fetch complete (55935 records). [2025-09-26T18:39:36.637377] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-09-26T18:39:36.638190] [FATAL] [VALIDATOR ] EPAM: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:39:36.638287] [FATAL] [MAIN ] EPAM: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:39:36.638333] [WARN ] [MAIN ] EPAM: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:39:36.638375] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-09-26T18:39:36.638443] [DEBUG] [LOCAL ] EPAM: No primary data file found to delete. [2025-09-26T18:39:36.638481] [INFO ] [LOCAL ] EPAM: Starting deletion of derivative data. [2025-09-26T18:39:36.639089] [DEBUG] [LOCAL ] EPAM: Deleted derivative data file. [2025-09-26T18:39:36.639198] [INFO ] [MAIN ] Update Progress: 753/2371 symbols completed. EPAM took 34.8s. Estimated remaining: 3h 33m 56s. Rate: 7.6 symbols/min [2025-09-26T18:39:36.761817] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-09-26T18:39:36.825142] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:39:36.838552] [DEBUG] [LOCAL ] EQBK: Loaded 10987 existing records from primary storage. [2025-09-26T18:39:36.838758] [INFO ] [MAIN ] EQBK: Loaded 10987 existing records. [2025-09-26T18:39:37.034861] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:39:37.035145] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-09-26T18:39:37.035196] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-09-26T18:39:37.035403] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-09-26T18:39:37.035460] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-09-26T18:39:37.418145] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:39:37.556739] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2024-12. [2025-09-26T18:39:37.880718] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-26T18:39:37.960371] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-26T18:39:38.166238] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-26T18:39:38.356790] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-09-26T18:39:39.156764] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-09-26T18:39:39.919134] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-26T18:39:39.956674] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-09-26T18:39:40.177801] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-26T18:39:40.424596] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-26T18:39:40.756751] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-09-26T18:39:41.556723] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-09-26T18:39:42.356763] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-09-26T18:39:42.746862] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-26T18:39:42.757453] [INFO ] [REMOTE ] EPD: Full fetch complete (77253 records). [2025-09-26T18:39:42.757684] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-09-26T18:39:42.758558] [FATAL] [VALIDATOR ] EPD: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:39:42.758693] [FATAL] [MAIN ] EPD: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:39:42.758773] [WARN ] [MAIN ] EPD: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:39:42.758872] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-09-26T18:39:42.758973] [DEBUG] [LOCAL ] EPD: No primary data file found to delete. [2025-09-26T18:39:42.759034] [INFO ] [LOCAL ] EPD: Starting deletion of derivative data. [2025-09-26T18:39:42.759520] [DEBUG] [LOCAL ] EPD: Deleted derivative data file. [2025-09-26T18:39:42.759627] [INFO ] [MAIN ] Update Progress: 754/2371 symbols completed. EPD took 29.4s. Estimated remaining: 3h 33m 44s. Rate: 7.6 symbols/min [2025-09-26T18:39:42.926514] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-26T18:39:42.957557] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:39:42.957907] [DEBUG] [LOCAL ] EQH: No existing data file found in primary storage. [2025-09-26T18:39:42.958110] [WARN ] [MAIN ] EQH: No existing data found, performing full refresh instead. [2025-09-26T18:39:42.958339] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-09-26T18:39:42.958410] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-09-26T18:39:42.958665] [DEBUG] [LOCAL ] EQH: No primary data file found to delete. [2025-09-26T18:39:42.958769] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-09-26T18:39:43.156739] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2024-12. [2025-09-26T18:39:43.161153] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-26T18:39:43.387093] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:39:43.956770] [INFO ] [REMOTE ] EQH: Fetching primary data for 2024-12. [2025-09-26T18:39:44.679045] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-26T18:39:44.756739] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-09-26T18:39:45.541729] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-26T18:39:45.556683] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-09-26T18:39:46.138312] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-26T18:39:46.356737] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-09-26T18:39:46.513068] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-26T18:39:47.156762] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-09-26T18:39:47.741093] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-26T18:39:47.956737] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-09-26T18:39:48.559832] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-26T18:39:48.756773] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-09-26T18:39:49.556735] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-09-26T18:39:49.616360] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-26T18:39:49.639827] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-26T18:39:50.356743] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-09-26T18:39:50.954290] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-26T18:39:51.156782] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-09-26T18:39:51.569136] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-26T18:39:51.655990] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-26T18:39:51.956762] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-09-26T18:39:52.756711] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-09-26T18:39:52.897338] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-26T18:39:53.556727] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-09-26T18:39:54.219054] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-26T18:39:54.356768] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-09-26T18:39:55.156702] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-09-26T18:39:55.229860] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-26T18:39:55.956818] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-09-26T18:39:56.169520] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-26T18:39:56.539792] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-26T18:39:56.756756] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-09-26T18:39:57.506967] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T18:39:57.534146] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-26T18:39:57.556716] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-09-26T18:39:58.356723] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-09-26T18:39:58.907756] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-26T18:39:59.156757] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-09-26T18:39:59.770207] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-26T18:39:59.956831] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-09-26T18:40:00.756822] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-09-26T18:40:01.032348] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-26T18:40:01.556772] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-09-26T18:40:01.658479] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-26T18:40:02.356849] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-09-26T18:40:02.446996] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-26T18:40:02.450708] [INFO ] [REMOTE ] EQBK: Full fetch complete (15360 records). [2025-09-26T18:40:02.450932] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-09-26T18:40:02.841794] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-09-26T18:40:02.841935] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-09-26T18:40:02.842320] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-09-26T18:40:02.842392] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-09-26T18:40:02.843048] [DEBUG] [LOCAL ] EQBK: Trimmed 15360 records to 11050 (keeping 200 days of data) [2025-09-26T18:40:02.913756] [DEBUG] [LOCAL ] EQBK: Primary data saved (11050 records). [2025-09-26T18:40:02.913920] [INFO ] [MAIN ] EQBK: Full history saved. [2025-09-26T18:40:02.914038] [INFO ] [MAIN ] Update Progress: 755/2371 symbols completed. EQBK took 26.3s. Estimated remaining: 3h 34m 2s. Rate: 7.6 symbols/min [2025-09-26T18:40:03.113662] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:40:03.114095] [DEBUG] [LOCAL ] EQNR: No existing data file found in primary storage. [2025-09-26T18:40:03.114164] [WARN ] [MAIN ] EQNR: No existing data found, performing full refresh instead. [2025-09-26T18:40:03.114567] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-09-26T18:40:03.114781] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-09-26T18:40:03.114966] [DEBUG] [LOCAL ] EQNR: No primary data file found to delete. [2025-09-26T18:40:03.115185] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-09-26T18:40:03.163996] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-09-26T18:40:03.478900] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-26T18:40:03.577143] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:40:03.956743] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2024-12. [2025-09-26T18:40:04.104679] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-26T18:40:04.756794] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-09-26T18:40:05.199870] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-26T18:40:05.209342] [INFO ] [REMOTE ] EPR: Full fetch complete (62832 records). [2025-09-26T18:40:05.209597] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-09-26T18:40:05.557816] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-09-26T18:40:05.635394] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-09-26T18:40:05.635557] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-09-26T18:40:05.636618] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-09-26T18:40:05.636799] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-09-26T18:40:05.638839] [DEBUG] [LOCAL ] EPR: Trimmed 62832 records to 44722 (keeping 200 days of data) [2025-09-26T18:40:05.778319] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-26T18:40:05.974969] [DEBUG] [LOCAL ] EPR: Primary data saved (44722 records). [2025-09-26T18:40:05.975127] [INFO ] [MAIN ] EPR: Full history saved. [2025-09-26T18:40:05.975241] [INFO ] [MAIN ] Update Progress: 756/2371 symbols completed. EPR took 38.3s. Estimated remaining: 3h 33m 44s. Rate: 7.6 symbols/min [2025-09-26T18:40:06.164546] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:40:06.214890] [DEBUG] [LOCAL ] EQR: Loaded 51810 existing records from primary storage. [2025-09-26T18:40:06.215053] [INFO ] [MAIN ] EQR: Loaded 51810 existing records. [2025-09-26T18:40:06.361939] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-09-26T18:40:06.431320] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:40:06.431777] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-09-26T18:40:06.431863] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-09-26T18:40:06.432210] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-09-26T18:40:06.432333] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-09-26T18:40:06.769331] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-26T18:40:06.957963] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:40:07.156719] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-09-26T18:40:07.352190] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-26T18:40:07.871266] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-26T18:40:07.956769] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-09-26T18:40:08.756698] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-09-26T18:40:08.919958] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-26T18:40:09.556775] [INFO ] [REMOTE ] EQR: Fetching primary data for 2024-12. [2025-09-26T18:40:09.774635] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-26T18:40:10.356715] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-09-26T18:40:10.483360] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-26T18:40:10.956615] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T18:40:11.156750] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-09-26T18:40:11.956781] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-09-26T18:40:12.220909] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-26T18:40:12.756726] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-09-26T18:40:12.885832] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-26T18:40:12.896161] [INFO ] [REMOTE ] EPRT: Full fetch complete (68749 records). [2025-09-26T18:40:12.896363] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-09-26T18:40:13.313044] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-09-26T18:40:13.313184] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-09-26T18:40:13.314329] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-09-26T18:40:13.314484] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-09-26T18:40:13.317017] [DEBUG] [LOCAL ] EPRT: Trimmed 68749 records to 49306 (keeping 200 days of data) [2025-09-26T18:40:13.446376] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-26T18:40:13.557427] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-09-26T18:40:13.684395] [DEBUG] [LOCAL ] EPRT: Primary data saved (49306 records). [2025-09-26T18:40:13.684610] [INFO ] [MAIN ] EPRT: Full history saved. [2025-09-26T18:40:13.684756] [INFO ] [MAIN ] Update Progress: 757/2371 symbols completed. EPRT took 39.0s. Estimated remaining: 3h 33m 35s. Rate: 7.6 symbols/min [2025-09-26T18:40:14.356765] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-09-26T18:40:14.426229] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-26T18:40:14.892675] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-26T18:40:15.156770] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-09-26T18:40:15.799411] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-26T18:40:15.956744] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-09-26T18:40:16.756822] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-09-26T18:40:17.151123] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-26T18:40:17.340856] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-26T18:40:17.556733] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-09-26T18:40:18.356722] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-09-26T18:40:18.472131] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T18:40:18.483443] [INFO ] [REMOTE ] EQH: Full fetch complete (76341 records). [2025-09-26T18:40:18.483720] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-09-26T18:40:18.905541] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-09-26T18:40:18.905767] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-09-26T18:40:18.907006] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-09-26T18:40:18.907117] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-09-26T18:40:18.909404] [DEBUG] [LOCAL ] EQH: Trimmed 76341 records to 53435 (keeping 200 days of data) [2025-09-26T18:40:19.046339] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-26T18:40:19.182248] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-09-26T18:40:19.306637] [DEBUG] [LOCAL ] EQH: Primary data saved (53435 records). [2025-09-26T18:40:19.306915] [INFO ] [MAIN ] EQH: Full history saved. [2025-09-26T18:40:19.307053] [INFO ] [MAIN ] Update Progress: 758/2371 symbols completed. EQH took 36.5s. Estimated remaining: 3h 33m 22s. Rate: 7.6 symbols/min [2025-09-26T18:40:20.018793] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-26T18:40:20.030596] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-09-26T18:40:20.506335] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-26T18:40:20.756727] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-09-26T18:40:21.519791] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-26T18:40:21.556716] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-09-26T18:40:22.168175] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-26T18:40:22.356729] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-09-26T18:40:23.089304] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-26T18:40:23.156738] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-09-26T18:40:23.858660] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-26T18:40:23.956775] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-09-26T18:40:24.855459] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-26T18:40:24.866066] [INFO ] [REMOTE ] EQNR: Full fetch complete (76773 records). [2025-09-26T18:40:24.866224] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-09-26T18:40:25.309331] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-09-26T18:40:25.309496] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-09-26T18:40:25.310509] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-09-26T18:40:25.311081] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-09-26T18:40:25.349385] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-26T18:40:25.361157] [DEBUG] [LOCAL ] EQNR: Trimmed 76773 records to 53809 (keeping 200 days of data) [2025-09-26T18:40:25.365040] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-09-26T18:40:25.724146] [DEBUG] [LOCAL ] EQNR: Primary data saved (53809 records). [2025-09-26T18:40:25.724308] [INFO ] [MAIN ] EQNR: Full history saved. [2025-09-26T18:40:25.724523] [INFO ] [MAIN ] Update Progress: 759/2371 symbols completed. EQNR took 22.8s. Estimated remaining: 3h 33m 11s. Rate: 7.6 symbols/min [2025-09-26T18:40:27.311551] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-26T18:40:27.321837] [INFO ] [REMOTE ] EQR: Full fetch complete (73866 records). [2025-09-26T18:40:27.321984] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-09-26T18:40:27.746249] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-09-26T18:40:27.746367] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-09-26T18:40:27.747375] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-09-26T18:40:27.747448] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-09-26T18:40:27.749189] [DEBUG] [LOCAL ] EQR: Trimmed 73866 records to 52190 (keeping 200 days of data) [2025-09-26T18:40:28.106592] [DEBUG] [LOCAL ] EQR: Primary data saved (52190 records). [2025-09-26T18:40:28.106775] [INFO ] [MAIN ] EQR: Full history saved. [2025-09-26T18:40:28.106887] [INFO ] [MAIN ] Update Progress: 760/2371 symbols completed. EQR took 22.1s. Estimated remaining: 3h 32m 51s. Rate: 7.6 symbols/min [2025-09-26T18:40:28.857013] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:40:28.907802] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:40:28.908838] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:40:28.912732] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-09-26T18:40:28.913731] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:40:28.914412] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-09-26T18:40:28.915825] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-09-26T18:40:28.915882] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-26T18:40:28.915930] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-26T18:40:28.915972] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-09-26T18:40:28.993547] [DEBUG] [LOCAL ] EQV: Loaded 2830 existing records from primary storage. [2025-09-26T18:40:29.022726] [INFO ] [MAIN ] EQV: Loaded 2830 existing records. [2025-09-26T18:40:29.443147] [DEBUG] [LOCAL ] ERJ: Loaded 51109 existing records from primary storage. [2025-09-26T18:40:29.467493] [INFO ] [MAIN ] ERJ: Loaded 51109 existing records. [2025-09-26T18:40:29.553837] [DEBUG] [LOCAL ] EQT: Loaded 54072 existing records from primary storage. [2025-09-26T18:40:29.654617] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:40:29.680715] [INFO ] [MAIN ] EQT: Loaded 54072 existing records. [2025-09-26T18:40:29.722936] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:40:29.737754] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-09-26T18:40:29.749538] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-12. [2025-09-26T18:40:29.765714] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-09-26T18:40:29.854689] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-09-26T18:40:29.854857] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-09-26T18:40:29.954580] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:40:30.113585] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-09-26T18:40:30.142192] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-09-26T18:40:30.226936] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:40:30.253504] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-09-26T18:40:30.271057] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-09-26T18:40:30.297921] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-09-26T18:40:30.338684] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-09-26T18:40:30.458039] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-09-26T18:40:30.493285] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-09-26T18:40:30.478383] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-26T18:40:30.553368] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-09-26T18:40:30.705971] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:40:30.766676] [INFO ] [REMOTE ] EQV: Fetching primary data for 2024-12. [2025-09-26T18:40:31.153845] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:40:31.170181] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2024-12. [2025-09-26T18:40:31.264437] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:40:31.266997] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-26T18:40:31.268415] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-09-26T18:40:31.267265] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-12. [2025-09-26T18:40:31.591763] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-26T18:40:31.594123] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-09-26T18:40:31.766312] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-26T18:40:31.767575] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-09-26T18:40:32.075260] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-26T18:40:32.076943] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-09-26T18:40:32.160939] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-26T18:40:32.545009] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-26T18:40:32.590700] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-26T18:40:32.761800] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-09-26T18:40:32.780922] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-26T18:40:33.144928] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-26T18:40:33.556739] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-09-26T18:40:34.356790] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-09-26T18:40:34.724387] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-26T18:40:35.142695] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-26T18:40:35.156687] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-09-26T18:40:35.956774] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-09-26T18:40:36.264414] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-26T18:40:36.586998] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-26T18:40:36.756772] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-09-26T18:40:37.556740] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-09-26T18:40:38.356689] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-09-26T18:40:38.847088] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-26T18:40:38.965480] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-26T18:40:39.156767] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-09-26T18:40:39.307300] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-26T18:40:39.544907] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-26T18:40:39.956737] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-09-26T18:40:40.756722] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-09-26T18:40:40.827707] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-26T18:40:40.829148] [INFO ] [REMOTE ] EQS: Full fetch complete (2522 records). [2025-09-26T18:40:40.829219] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-09-26T18:40:41.032750] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-09-26T18:40:41.032990] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:40:41.033063] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:40:41.033128] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-26T18:40:41.033223] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-26T18:40:41.033283] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-09-26T18:40:41.033332] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-09-26T18:40:41.033397] [INFO ] [MAIN ] Update Progress: 761/2371 symbols completed. EQS took 12.9s. Estimated remaining: 3h 32m 54s. Rate: 7.6 symbols/min [2025-09-26T18:40:41.229857] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:40:41.291808] [DEBUG] [LOCAL ] ERO: Loaded 41546 existing records from primary storage. [2025-09-26T18:40:41.291956] [INFO ] [MAIN ] ERO: Loaded 41546 existing records. [2025-09-26T18:40:41.505869] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:40:41.506225] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-09-26T18:40:41.506280] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-09-26T18:40:41.506559] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-09-26T18:40:41.506617] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-09-26T18:40:41.563916] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-09-26T18:40:41.906336] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:40:42.356807] [INFO ] [REMOTE ] ERO: Fetching primary data for 2024-12. [2025-09-26T18:40:42.745440] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-26T18:40:43.156737] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-09-26T18:40:43.196727] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-26T18:40:43.859257] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-26T18:40:43.956768] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-09-26T18:40:44.000739] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-26T18:40:44.756775] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-09-26T18:40:45.556705] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-09-26T18:40:45.675444] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-26T18:40:46.215325] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-26T18:40:46.356717] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-09-26T18:40:46.445553] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-26T18:40:46.852482] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-26T18:40:47.156737] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-09-26T18:40:47.741999] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-26T18:40:47.956752] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-09-26T18:40:48.756763] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-09-26T18:40:49.390147] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-26T18:40:49.556737] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-09-26T18:40:50.356728] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-09-26T18:40:50.471563] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-26T18:40:50.674176] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-26T18:40:50.686742] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-26T18:40:51.156767] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-09-26T18:40:51.956754] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-09-26T18:40:52.566075] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-26T18:40:52.756745] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-09-26T18:40:52.994100] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-26T18:40:53.305605] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-26T18:40:53.307138] [INFO ] [REMOTE ] EQV: Full fetch complete (5754 records). [2025-09-26T18:40:53.307285] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-09-26T18:40:53.562132] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-09-26T18:40:53.724814] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-09-26T18:40:53.724900] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-09-26T18:40:53.725137] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-09-26T18:40:53.725202] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-09-26T18:40:53.725805] [DEBUG] [LOCAL ] EQV: Trimmed 5754 records to 2840 (keeping 200 days of data) [2025-09-26T18:40:53.750136] [DEBUG] [LOCAL ] EQV: Primary data saved (2840 records). [2025-09-26T18:40:53.750293] [INFO ] [MAIN ] EQV: Full history saved. [2025-09-26T18:40:53.750406] [INFO ] [MAIN ] Update Progress: 762/2371 symbols completed. EQV took 25.6s. Estimated remaining: 3h 32m 56s. Rate: 7.6 symbols/min [2025-09-26T18:40:53.951037] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:40:54.018463] [DEBUG] [LOCAL ] ES: Loaded 52919 existing records from primary storage. [2025-09-26T18:40:54.018716] [INFO ] [MAIN ] ES: Loaded 52919 existing records. [2025-09-26T18:40:54.225116] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:40:54.225428] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-09-26T18:40:54.225510] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-09-26T18:40:54.225826] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-09-26T18:40:54.225890] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-09-26T18:40:54.361848] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-09-26T18:40:54.651046] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:40:55.156787] [INFO ] [REMOTE ] ES: Fetching primary data for 2024-12. [2025-09-26T18:40:55.616385] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-26T18:40:55.693105] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-26T18:40:55.956782] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-09-26T18:40:56.756752] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-09-26T18:40:57.058307] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-26T18:40:57.556731] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-09-26T18:40:57.973739] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-26T18:40:58.033700] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-26T18:40:58.356737] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-09-26T18:40:59.112256] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-26T18:40:59.156710] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-09-26T18:40:59.385815] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-26T18:40:59.956772] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-09-26T18:41:00.756763] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-09-26T18:41:00.845076] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-26T18:41:01.040688] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-26T18:41:01.556733] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-09-26T18:41:02.331058] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-26T18:41:02.356683] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-09-26T18:41:03.156701] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-09-26T18:41:03.426320] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-26T18:41:03.956694] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-09-26T18:41:04.522075] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-26T18:41:04.756740] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-09-26T18:41:05.122890] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-26T18:41:05.486940] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-26T18:41:05.556748] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-09-26T18:41:06.309895] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T18:41:06.356727] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-09-26T18:41:07.156781] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-09-26T18:41:07.855847] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-26T18:41:07.956767] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-09-26T18:41:08.756705] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-09-26T18:41:08.898962] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-26T18:41:08.909250] [INFO ] [REMOTE ] EQT: Full fetch complete (77302 records). [2025-09-26T18:41:08.909417] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-09-26T18:41:08.910255] [FATAL] [VALIDATOR ] EQT: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:41:08.910351] [FATAL] [MAIN ] EQT: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:41:08.910397] [WARN ] [MAIN ] EQT: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:41:08.910475] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-09-26T18:41:08.910550] [DEBUG] [LOCAL ] EQT: No primary data file found to delete. [2025-09-26T18:41:08.910590] [INFO ] [LOCAL ] EQT: Starting deletion of derivative data. [2025-09-26T18:41:08.911030] [DEBUG] [LOCAL ] EQT: Deleted derivative data file. [2025-09-26T18:41:08.911203] [INFO ] [MAIN ] Update Progress: 763/2371 symbols completed. EQT took 40.8s. Estimated remaining: 3h 33m 4s. Rate: 7.5 symbols/min [2025-09-26T18:41:09.093554] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:41:09.125824] [DEBUG] [LOCAL ] ESAB: Loaded 26482 existing records from primary storage. [2025-09-26T18:41:09.125972] [INFO ] [MAIN ] ESAB: Loaded 26482 existing records. [2025-09-26T18:41:09.324979] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:41:09.325387] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-09-26T18:41:09.325458] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-09-26T18:41:09.325748] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-09-26T18:41:09.325812] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-09-26T18:41:09.778474] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:41:09.779097] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2024-12. [2025-09-26T18:41:09.810225] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-26T18:41:09.822593] [INFO ] [REMOTE ] ERJ: Full fetch complete (72228 records). [2025-09-26T18:41:09.822884] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-09-26T18:41:10.037990] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (4.48 seconds). [2025-09-26T18:41:10.111819] [INFO ] [REMOTE ] ERO: Full fetch complete (59341 records). [2025-09-26T18:41:10.140777] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-09-26T18:41:10.471963] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-09-26T18:41:10.508019] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-09-26T18:41:10.571911] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-09-26T18:41:10.598914] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-09-26T18:41:10.678672] [DEBUG] [LOCAL ] ERJ: Trimmed 72228 records to 51477 (keeping 200 days of data) [2025-09-26T18:41:10.899190] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-09-26T18:41:10.899726] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-09-26T18:41:10.900840] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-09-26T18:41:10.901300] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-09-26T18:41:10.908547] [DEBUG] [LOCAL ] ERO: Trimmed 59341 records to 41901 (keeping 200 days of data) [2025-09-26T18:41:11.045324] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-26T18:41:11.085633] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-09-26T18:41:11.092942] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-26T18:41:11.219921] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-09-26T18:41:11.428875] [DEBUG] [LOCAL ] ERO: Primary data saved (41901 records). [2025-09-26T18:41:11.429566] [INFO ] [MAIN ] ERO: Full history saved. [2025-09-26T18:41:11.429781] [INFO ] [MAIN ] Update Progress: 764/2371 symbols completed. ERO took 30.4s. Estimated remaining: 3h 32m 44s. Rate: 7.6 symbols/min [2025-09-26T18:41:11.659233] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:41:11.704248] [DEBUG] [LOCAL ] ESE: Loaded 16748 existing records from primary storage. [2025-09-26T18:41:11.704973] [INFO ] [MAIN ] ESE: Loaded 16748 existing records. [2025-09-26T18:41:11.920538] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:41:11.924979] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-09-26T18:41:11.924627] [DEBUG] [LOCAL ] ERJ: Primary data saved (51477 records). [2025-09-26T18:41:11.925208] [INFO ] [MAIN ] ERJ: Full history saved. [2025-09-26T18:41:11.925301] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-09-26T18:41:11.925526] [INFO ] [MAIN ] Update Progress: 765/2371 symbols completed. ERJ took 43.8s. Estimated remaining: 3h 32m 21s. Rate: 7.6 symbols/min [2025-09-26T18:41:11.926046] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-09-26T18:41:11.931301] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-09-26T18:41:12.292771] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:41:12.539069] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:41:12.540326] [INFO ] [REMOTE ] ESE: Fetching primary data for 2024-12. [2025-09-26T18:41:12.568974] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-26T18:41:12.593027] [DEBUG] [LOCAL ] ESI: Loaded 51196 existing records from primary storage. [2025-09-26T18:41:12.593189] [INFO ] [MAIN ] ESI: Loaded 51196 existing records. [2025-09-26T18:41:12.791454] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:41:12.761191] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-09-26T18:41:12.792920] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-09-26T18:41:12.793036] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-09-26T18:41:12.793265] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-09-26T18:41:12.793324] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-09-26T18:41:13.189945] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:41:13.223128] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-26T18:41:13.556713] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-09-26T18:41:13.716949] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-26T18:41:13.908680] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-26T18:41:14.356723] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-09-26T18:41:15.156717] [INFO ] [REMOTE ] ESI: Fetching primary data for 2024-12. [2025-09-26T18:41:15.359489] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-26T18:41:15.387550] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-26T18:41:15.956738] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-09-26T18:41:16.756743] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-09-26T18:41:17.076205] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-26T18:41:17.345185] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-26T18:41:17.556731] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-09-26T18:41:17.670484] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-26T18:41:18.337084] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-26T18:41:18.356673] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-09-26T18:41:19.156729] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-09-26T18:41:19.243905] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-26T18:41:19.956789] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-09-26T18:41:20.139596] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-26T18:41:20.756786] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-09-26T18:41:21.561848] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-09-26T18:41:21.580471] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-26T18:41:22.356744] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-09-26T18:41:22.613107] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-26T18:41:22.681773] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-26T18:41:23.156782] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-09-26T18:41:23.586226] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-26T18:41:23.956739] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-09-26T18:41:24.549449] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-26T18:41:24.756737] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-09-26T18:41:25.547119] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-26T18:41:25.558513] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-09-26T18:41:25.592857] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-26T18:41:26.356776] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-09-26T18:41:27.156492] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-26T18:41:27.162282] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-09-26T18:41:27.218159] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-26T18:41:27.956798] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-09-26T18:41:28.756735] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-09-26T18:41:28.844602] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-26T18:41:28.868184] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-26T18:41:29.556738] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-09-26T18:41:30.356702] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-09-26T18:41:30.484623] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-26T18:41:30.495753] [INFO ] [REMOTE ] ES: Full fetch complete (76173 records). [2025-09-26T18:41:30.495934] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-09-26T18:41:30.972952] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-09-26T18:41:30.974447] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-26T18:41:30.974694] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-09-26T18:41:30.983814] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-09-26T18:41:30.984333] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-09-26T18:41:30.985986] [DEBUG] [LOCAL ] ES: Trimmed 76173 records to 53309 (keeping 200 days of data) [2025-09-26T18:41:31.103780] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-26T18:41:31.192957] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-09-26T18:41:31.357354] [DEBUG] [LOCAL ] ES: Primary data saved (53309 records). [2025-09-26T18:41:31.357523] [INFO ] [MAIN ] ES: Full history saved. [2025-09-26T18:41:31.357622] [INFO ] [MAIN ] Update Progress: 766/2371 symbols completed. ES took 37.6s. Estimated remaining: 3h 32m 37s. Rate: 7.5 symbols/min [2025-09-26T18:41:31.594553] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:41:31.633498] [DEBUG] [LOCAL ] ESNT: Loaded 38813 existing records from primary storage. [2025-09-26T18:41:31.633731] [INFO ] [MAIN ] ESNT: Loaded 38813 existing records. [2025-09-26T18:41:31.840084] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:41:31.840368] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-09-26T18:41:31.840417] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-09-26T18:41:31.840705] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-09-26T18:41:31.840765] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-09-26T18:41:31.961851] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-09-26T18:41:32.228383] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:41:32.733263] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-26T18:41:32.739630] [INFO ] [REMOTE ] ESAB: Full fetch complete (35636 records). [2025-09-26T18:41:32.739772] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-09-26T18:41:32.761952] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-09-26T18:41:33.138885] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-09-26T18:41:33.138971] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-09-26T18:41:33.139586] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-09-26T18:41:33.139629] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-09-26T18:41:33.140663] [DEBUG] [LOCAL ] ESAB: Trimmed 35636 records to 26683 (keeping 200 days of data) [2025-09-26T18:41:33.365526] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-26T18:41:33.382502] [DEBUG] [LOCAL ] ESAB: Primary data saved (26683 records). [2025-09-26T18:41:33.382637] [INFO ] [MAIN ] ESAB: Full history saved. [2025-09-26T18:41:33.382765] [INFO ] [MAIN ] Update Progress: 767/2371 symbols completed. ESAB took 24.5s. Estimated remaining: 3h 32m 16s. Rate: 7.6 symbols/min [2025-09-26T18:41:33.557275] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-09-26T18:41:33.578716] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:41:33.594506] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-26T18:41:33.640590] [DEBUG] [LOCAL ] ESRT: Loaded 46733 existing records from primary storage. [2025-09-26T18:41:33.640851] [INFO ] [MAIN ] ESRT: Loaded 46733 existing records. [2025-09-26T18:41:33.842239] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:41:33.842529] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-09-26T18:41:33.842591] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-09-26T18:41:33.842869] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-09-26T18:41:33.842930] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-09-26T18:41:34.262226] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:41:34.356756] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-12. [2025-09-26T18:41:35.156709] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2024-12. [2025-09-26T18:41:35.330570] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-26T18:41:35.582404] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-26T18:41:35.956744] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-09-26T18:41:36.415594] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-26T18:41:36.756737] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-09-26T18:41:37.293614] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-26T18:41:37.556725] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-09-26T18:41:37.816387] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-26T18:41:38.356777] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-09-26T18:41:39.055715] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-26T18:41:39.156798] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-09-26T18:41:39.477608] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-26T18:41:39.956756] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-09-26T18:41:40.428427] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-26T18:41:40.432662] [INFO ] [REMOTE ] ESE: Full fetch complete (22169 records). [2025-09-26T18:41:40.432753] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-09-26T18:41:40.761832] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-09-26T18:41:40.833386] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-09-26T18:41:40.833499] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-09-26T18:41:40.834070] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-09-26T18:41:40.834136] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-09-26T18:41:40.835455] [DEBUG] [LOCAL ] ESE: Trimmed 22169 records to 16878 (keeping 200 days of data) [2025-09-26T18:41:40.948944] [DEBUG] [LOCAL ] ESE: Primary data saved (16878 records). [2025-09-26T18:41:40.949119] [INFO ] [MAIN ] ESE: Full history saved. [2025-09-26T18:41:40.949241] [INFO ] [MAIN ] Update Progress: 768/2371 symbols completed. ESE took 29.5s. Estimated remaining: 3h 32m 8s. Rate: 7.6 symbols/min [2025-09-26T18:41:41.135446] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:41:41.167356] [DEBUG] [LOCAL ] ESS: Loaded 30254 existing records from primary storage. [2025-09-26T18:41:41.167543] [INFO ] [MAIN ] ESS: Loaded 30254 existing records. [2025-09-26T18:41:41.363166] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:41:41.363675] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-09-26T18:41:41.363857] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-09-26T18:41:41.364727] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-09-26T18:41:41.364789] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-09-26T18:41:41.567131] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-09-26T18:41:41.683072] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-26T18:41:41.809864] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:41:42.300257] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-26T18:41:42.310933] [INFO ] [REMOTE ] ESI: Full fetch complete (72462 records). [2025-09-26T18:41:42.311091] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-09-26T18:41:42.361801] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-09-26T18:41:42.754224] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-09-26T18:41:42.754326] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-09-26T18:41:42.755299] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-09-26T18:41:42.755371] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-09-26T18:41:42.757442] [DEBUG] [LOCAL ] ESI: Trimmed 72462 records to 51566 (keeping 200 days of data) [2025-09-26T18:41:43.012132] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-26T18:41:43.129059] [DEBUG] [LOCAL ] ESI: Primary data saved (51566 records). [2025-09-26T18:41:43.129205] [INFO ] [MAIN ] ESI: Full history saved. [2025-09-26T18:41:43.129293] [INFO ] [MAIN ] Update Progress: 769/2371 symbols completed. ESI took 31.2s. Estimated remaining: 3h 31m 48s. Rate: 7.6 symbols/min [2025-09-26T18:41:43.161830] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-09-26T18:41:43.308054] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:41:43.356994] [DEBUG] [LOCAL ] ESTC: Loaded 50398 existing records from primary storage. [2025-09-26T18:41:43.357187] [INFO ] [MAIN ] ESTC: Loaded 50398 existing records. [2025-09-26T18:41:43.559246] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:41:43.559631] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-09-26T18:41:43.559736] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-09-26T18:41:43.561351] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-09-26T18:41:43.561418] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-09-26T18:41:43.753400] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-26T18:41:43.962823] [INFO ] [REMOTE ] ESS: Fetching primary data for 2024-12. [2025-09-26T18:41:43.986759] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:41:44.568680] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-26T18:41:44.756747] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-09-26T18:41:44.872090] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-26T18:41:45.556759] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2024-12. [2025-09-26T18:41:46.356713] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-09-26T18:41:46.529996] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-26T18:41:47.156734] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-09-26T18:41:47.961804] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-09-26T18:41:47.977738] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-26T18:41:48.129149] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2024-12 (2.57 seconds). [2025-09-26T18:41:48.163254] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-26T18:41:48.756757] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-09-26T18:41:49.554045] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-26T18:41:49.562510] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-09-26T18:41:50.356709] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-09-26T18:41:50.390147] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-26T18:41:50.753109] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-26T18:41:51.156745] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-09-26T18:41:51.453755] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-26T18:41:51.956753] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-09-26T18:41:52.756705] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-09-26T18:41:53.045313] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-26T18:41:53.391239] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-26T18:41:53.556730] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-09-26T18:41:54.356772] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-09-26T18:41:54.613679] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-26T18:41:54.992170] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-26T18:41:55.156765] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-09-26T18:41:55.597055] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-26T18:41:55.956750] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-09-26T18:41:56.155856] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-26T18:41:56.756799] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-09-26T18:41:57.132703] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-26T18:41:57.556740] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-09-26T18:41:58.228431] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-26T18:41:58.356760] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-09-26T18:41:59.017063] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-26T18:41:59.156745] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-09-26T18:41:59.956751] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-09-26T18:42:00.463431] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-26T18:42:00.493414] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-26T18:42:00.492411] [INFO ] [REMOTE ] ESRT: Full fetch complete (66561 records). [2025-09-26T18:42:00.496519] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-09-26T18:42:00.761819] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-09-26T18:42:00.949476] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-09-26T18:42:00.949580] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-09-26T18:42:00.950523] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-09-26T18:42:00.950602] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-09-26T18:42:00.952263] [DEBUG] [LOCAL ] ESRT: Trimmed 66561 records to 47104 (keeping 200 days of data) [2025-09-26T18:42:01.243897] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-26T18:42:01.272740] [INFO ] [REMOTE ] ESNT: Full fetch complete (56905 records). [2025-09-26T18:42:01.275586] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-09-26T18:42:01.278393] [DEBUG] [LOCAL ] ESRT: Primary data saved (47104 records). [2025-09-26T18:42:01.278721] [INFO ] [MAIN ] ESRT: Full history saved. [2025-09-26T18:42:01.278959] [INFO ] [MAIN ] Update Progress: 770/2371 symbols completed. ESRT took 27.9s. Estimated remaining: 3h 32m 1s. Rate: 7.6 symbols/min [2025-09-26T18:42:01.285235] [FATAL] [VALIDATOR ] ESNT: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:42:01.340809] [FATAL] [MAIN ] ESNT: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:42:01.350614] [WARN ] [MAIN ] ESNT: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:42:01.356634] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-09-26T18:42:01.362772] [DEBUG] [LOCAL ] ESNT: No primary data file found to delete. [2025-09-26T18:42:01.379705] [INFO ] [LOCAL ] ESNT: Starting deletion of derivative data. [2025-09-26T18:42:01.397815] [DEBUG] [LOCAL ] ESNT: Deleted derivative data file. [2025-09-26T18:42:01.408227] [INFO ] [MAIN ] Update Progress: 771/2371 symbols completed. ESNT took 30.1s. Estimated remaining: 3h 31m 37s. Rate: 7.6 symbols/min [2025-09-26T18:42:01.580698] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:42:01.576157] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-09-26T18:42:01.672151] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:42:01.673296] [DEBUG] [LOCAL ] ETB: No existing data file found in primary storage. [2025-09-26T18:42:01.673427] [WARN ] [MAIN ] ETB: No existing data found, performing full refresh instead. [2025-09-26T18:42:01.673706] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-09-26T18:42:01.673780] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-09-26T18:42:01.673869] [DEBUG] [LOCAL ] ETB: No primary data file found to delete. [2025-09-26T18:42:01.673940] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-09-26T18:42:02.018251] [DEBUG] [LOCAL ] ET: Loaded 54179 existing records from primary storage. [2025-09-26T18:42:02.045664] [INFO ] [MAIN ] ET: Loaded 54179 existing records. [2025-09-26T18:42:02.169908] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:42:02.330897] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:42:02.331406] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-09-26T18:42:02.331604] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-09-26T18:42:02.338770] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-09-26T18:42:02.349804] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-09-26T18:42:02.374455] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-26T18:42:02.373028] [INFO ] [REMOTE ] ETB: Fetching primary data for 2024-12. [2025-09-26T18:42:02.748012] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:42:03.156701] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-09-26T18:42:03.231332] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-26T18:42:03.364955] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-26T18:42:03.956726] [INFO ] [REMOTE ] ET: Fetching primary data for 2024-12. [2025-09-26T18:42:04.465901] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-26T18:42:04.756797] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-09-26T18:42:05.556748] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-09-26T18:42:05.770147] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-26T18:42:06.356842] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-09-26T18:42:06.510172] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-09-26T18:42:06.994622] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-26T18:42:07.156738] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-09-26T18:42:07.737776] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-26T18:42:07.743754] [INFO ] [REMOTE ] ESS: Full fetch complete (43389 records). [2025-09-26T18:42:07.743880] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-09-26T18:42:07.961937] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-09-26T18:42:08.071081] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-26T18:42:08.164758] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-09-26T18:42:08.164852] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-09-26T18:42:08.165565] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-09-26T18:42:08.165658] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-09-26T18:42:08.166857] [DEBUG] [LOCAL ] ESS: Trimmed 43389 records to 30441 (keeping 200 days of data) [2025-09-26T18:42:08.357083] [DEBUG] [LOCAL ] ESS: Primary data saved (30441 records). [2025-09-26T18:42:08.357259] [INFO ] [MAIN ] ESS: Full history saved. [2025-09-26T18:42:08.357364] [INFO ] [MAIN ] Update Progress: 772/2371 symbols completed. ESS took 27.4s. Estimated remaining: 3h 31m 27s. Rate: 7.6 symbols/min [2025-09-26T18:42:08.542029] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:42:08.569629] [DEBUG] [LOCAL ] ETD: Loaded 27502 existing records from primary storage. [2025-09-26T18:42:08.569834] [INFO ] [MAIN ] ETD: Loaded 27502 existing records. [2025-09-26T18:42:08.757300] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-09-26T18:42:08.761699] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:42:08.762819] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-09-26T18:42:08.762883] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-09-26T18:42:08.763854] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-09-26T18:42:08.763918] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-09-26T18:42:09.175471] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:42:09.556725] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-09-26T18:42:10.246442] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-09-26T18:42:10.356707] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-09-26T18:42:10.600870] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-26T18:42:10.601696] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-26T18:42:11.156743] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-09-26T18:42:11.956749] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-09-26T18:42:12.182060] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-26T18:42:12.488105] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-26T18:42:12.756722] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-09-26T18:42:13.353753] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-26T18:42:13.556730] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-09-26T18:42:13.657484] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-26T18:42:14.356725] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-09-26T18:42:15.156724] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-09-26T18:42:15.715356] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-26T18:42:15.808704] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-26T18:42:15.838077] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-26T18:42:15.956727] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-09-26T18:42:16.756756] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-09-26T18:42:17.556722] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-09-26T18:42:18.356719] [INFO ] [REMOTE ] ETD: Fetching primary data for 2024-12. [2025-09-26T18:42:18.579235] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-26T18:42:18.622543] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-09-26T18:42:18.671712] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-26T18:42:19.156751] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-09-26T18:42:19.339019] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-26T18:42:19.956779] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-09-26T18:42:20.756800] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-09-26T18:42:20.802517] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-26T18:42:20.963378] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-26T18:42:20.979288] [INFO ] [REMOTE ] ESTC: Full fetch complete (72019 records). [2025-09-26T18:42:20.979528] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-09-26T18:42:21.545920] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-09-26T18:42:21.546040] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-09-26T18:42:21.547381] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-09-26T18:42:21.547490] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-09-26T18:42:21.549768] [DEBUG] [LOCAL ] ESTC: Trimmed 72019 records to 50744 (keeping 200 days of data) [2025-09-26T18:42:21.605130] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-09-26T18:42:21.879816] [DEBUG] [LOCAL ] ESTC: Primary data saved (50744 records). [2025-09-26T18:42:21.880015] [INFO ] [MAIN ] ESTC: Full history saved. [2025-09-26T18:42:21.880164] [INFO ] [MAIN ] Update Progress: 773/2371 symbols completed. ESTC took 38.8s. Estimated remaining: 3h 31m 31s. Rate: 7.6 symbols/min [2025-09-26T18:42:22.069690] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:42:22.088335] [DEBUG] [LOCAL ] ETG: Loaded 16639 existing records from primary storage. [2025-09-26T18:42:22.088506] [INFO ] [MAIN ] ETG: Loaded 16639 existing records. [2025-09-26T18:42:22.257004] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-26T18:42:22.291709] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:42:22.292561] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-09-26T18:42:22.292620] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-09-26T18:42:22.293292] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-09-26T18:42:22.293383] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-09-26T18:42:22.361681] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-09-26T18:42:22.700359] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:42:22.738228] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-26T18:42:23.003628] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-26T18:42:23.156786] [INFO ] [REMOTE ] ETG: Fetching primary data for 2024-12. [2025-09-26T18:42:23.956753] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-09-26T18:42:24.578059] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-26T18:42:24.756738] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-09-26T18:42:25.556723] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-09-26T18:42:25.709713] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-26T18:42:26.356732] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-09-26T18:42:26.379886] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-26T18:42:26.505916] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-26T18:42:27.156774] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-09-26T18:42:27.907940] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-26T18:42:27.910455] [INFO ] [REMOTE ] ETB: Full fetch complete (17862 records). [2025-09-26T18:42:27.910564] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-09-26T18:42:27.961864] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-09-26T18:42:28.301737] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-09-26T18:42:28.301830] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-09-26T18:42:28.302278] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-09-26T18:42:28.302319] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-09-26T18:42:28.302928] [DEBUG] [LOCAL ] ETB: Trimmed 17862 records to 12181 (keeping 200 days of data) [2025-09-26T18:42:28.382273] [DEBUG] [LOCAL ] ETB: Primary data saved (12181 records). [2025-09-26T18:42:28.382446] [INFO ] [MAIN ] ETB: Full history saved. [2025-09-26T18:42:28.382539] [INFO ] [MAIN ] Update Progress: 774/2371 symbols completed. ETB took 27.0s. Estimated remaining: 3h 31m 20s. Rate: 7.6 symbols/min [2025-09-26T18:42:28.567091] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:42:28.584487] [DEBUG] [LOCAL ] ETJ: Loaded 16755 existing records from primary storage. [2025-09-26T18:42:28.584637] [INFO ] [MAIN ] ETJ: Loaded 16755 existing records. [2025-09-26T18:42:28.756810] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-09-26T18:42:28.783469] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:42:28.784442] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-09-26T18:42:28.784577] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-09-26T18:42:28.785560] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-09-26T18:42:28.785814] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-09-26T18:42:28.987784] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-09-26T18:42:29.179659] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-26T18:42:29.291428] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:42:29.556726] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2024-12. [2025-09-26T18:42:29.758871] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-26T18:42:30.356707] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-09-26T18:42:30.594589] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-26T18:42:31.156750] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-09-26T18:42:31.781964] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-26T18:42:31.929434] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-26T18:42:31.956716] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-09-26T18:42:32.756719] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-09-26T18:42:32.883690] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-26T18:42:33.471102] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-26T18:42:33.556716] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-09-26T18:42:34.356751] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-09-26T18:42:34.773268] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-26T18:42:35.156769] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-09-26T18:42:35.956773] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-09-26T18:42:36.461683] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-26T18:42:36.530065] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-26T18:42:36.756742] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-09-26T18:42:37.014715] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-26T18:42:37.556744] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-09-26T18:42:38.275851] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-26T18:42:38.356727] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-09-26T18:42:38.852315] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-26T18:42:38.863727] [INFO ] [REMOTE ] ET: Full fetch complete (77955 records). [2025-09-26T18:42:38.863924] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-09-26T18:42:39.161905] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-09-26T18:42:39.288348] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-09-26T18:42:39.288435] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-09-26T18:42:39.289339] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-09-26T18:42:39.289405] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-09-26T18:42:39.291054] [DEBUG] [LOCAL ] ET: Trimmed 77955 records to 54569 (keeping 200 days of data) [2025-09-26T18:42:39.654901] [DEBUG] [LOCAL ] ET: Primary data saved (54569 records). [2025-09-26T18:42:39.655322] [INFO ] [MAIN ] ET: Full history saved. [2025-09-26T18:42:39.655439] [INFO ] [MAIN ] Update Progress: 775/2371 symbols completed. ET took 38.4s. Estimated remaining: 3h 31m 19s. Rate: 7.6 symbols/min [2025-09-26T18:42:39.866292] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-26T18:42:39.865139] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:42:39.927485] [DEBUG] [LOCAL ] ETN: Loaded 53221 existing records from primary storage. [2025-09-26T18:42:39.927637] [INFO ] [MAIN ] ETN: Loaded 53221 existing records. [2025-09-26T18:42:39.961822] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-09-26T18:42:40.131185] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:42:40.132386] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-09-26T18:42:40.132149] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-26T18:42:40.132567] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-09-26T18:42:40.137603] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-09-26T18:42:40.137715] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-09-26T18:42:40.513842] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:42:40.756734] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-09-26T18:42:41.244921] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-26T18:42:41.556701] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-09-26T18:42:41.797342] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-26T18:42:42.356746] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-09-26T18:42:42.678694] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-26T18:42:43.156724] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-09-26T18:42:43.390815] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-26T18:42:43.956796] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-09-26T18:42:44.242602] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-26T18:42:44.756826] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-09-26T18:42:44.981795] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-26T18:42:45.405341] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-26T18:42:45.556724] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-09-26T18:42:46.356761] [INFO ] [REMOTE ] ETN: Fetching primary data for 2024-12. [2025-09-26T18:42:46.591969] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-26T18:42:47.156764] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-09-26T18:42:47.956726] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-09-26T18:42:48.535452] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-26T18:42:48.537904] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-26T18:42:48.554842] [INFO ] [REMOTE ] ETD: Full fetch complete (38077 records). [2025-09-26T18:42:48.555814] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-09-26T18:42:48.757802] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-09-26T18:42:48.803841] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-26T18:42:48.885433] [INFO ] [REMOTE ] ETJ: Full fetch complete (25036 records). [2025-09-26T18:42:48.898190] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-09-26T18:42:49.179692] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-09-26T18:42:49.185305] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-09-26T18:42:49.197346] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-09-26T18:42:49.197882] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-09-26T18:42:49.299921] [DEBUG] [LOCAL ] ETD: Trimmed 38077 records to 27661 (keeping 200 days of data) [2025-09-26T18:42:49.536418] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-09-26T18:42:49.536804] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-09-26T18:42:49.540987] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-09-26T18:42:49.543446] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-09-26T18:42:49.558963] [DEBUG] [LOCAL ] ETJ: Trimmed 25036 records to 16938 (keeping 200 days of data) [2025-09-26T18:42:49.559058] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-09-26T18:42:49.713255] [DEBUG] [LOCAL ] ETJ: Primary data saved (16938 records). [2025-09-26T18:42:49.714080] [INFO ] [MAIN ] ETJ: Full history saved. [2025-09-26T18:42:49.714310] [INFO ] [MAIN ] Update Progress: 776/2371 symbols completed. ETJ took 21.3s. Estimated remaining: 3h 31m 15s. Rate: 7.6 symbols/min [2025-09-26T18:42:49.905330] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:42:49.905486] [DEBUG] [LOCAL ] ETD: Primary data saved (27661 records). [2025-09-26T18:42:49.906409] [INFO ] [MAIN ] ETD: Full history saved. [2025-09-26T18:42:49.906597] [INFO ] [MAIN ] Update Progress: 777/2371 symbols completed. ETD took 41.5s. Estimated remaining: 3h 30m 51s. Rate: 7.6 symbols/min [2025-09-26T18:42:50.012637] [DEBUG] [LOCAL ] ETO: Loaded 6531 existing records from primary storage. [2025-09-26T18:42:50.024297] [INFO ] [MAIN ] ETO: Loaded 6531 existing records. [2025-09-26T18:42:50.234167] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:42:50.250887] [DEBUG] [LOCAL ] ETR: No existing data file found in primary storage. [2025-09-26T18:42:50.256189] [WARN ] [MAIN ] ETR: No existing data found, performing full refresh instead. [2025-09-26T18:42:50.297139] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-09-26T18:42:50.297590] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-09-26T18:42:50.315945] [DEBUG] [LOCAL ] ETR: No primary data file found to delete. [2025-09-26T18:42:50.319793] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-09-26T18:42:50.319605] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:42:50.413369] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-09-26T18:42:50.444681] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-09-26T18:42:50.450873] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-09-26T18:42:50.466423] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-09-26T18:42:50.913483] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-26T18:42:51.001736] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-09-26T18:42:51.085084] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:42:51.157196] [INFO ] [REMOTE ] ETR: Fetching primary data for 2024-12. [2025-09-26T18:42:51.201686] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:42:51.234725] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-09-26T18:42:51.956742] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-09-26T18:42:52.003701] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-26T18:42:52.007213] [INFO ] [REMOTE ] ETG: Full fetch complete (24772 records). [2025-09-26T18:42:52.007330] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-09-26T18:42:52.424122] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-09-26T18:42:52.424232] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-09-26T18:42:52.424754] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-09-26T18:42:52.424819] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-09-26T18:42:52.426577] [DEBUG] [LOCAL ] ETG: Trimmed 24772 records to 16710 (keeping 200 days of data) [2025-09-26T18:42:52.539541] [DEBUG] [LOCAL ] ETG: Primary data saved (16710 records). [2025-09-26T18:42:52.539793] [INFO ] [MAIN ] ETG: Full history saved. [2025-09-26T18:42:52.539916] [INFO ] [MAIN ] Update Progress: 778/2371 symbols completed. ETG took 30.7s. Estimated remaining: 3h 30m 32s. Rate: 7.6 symbols/min [2025-09-26T18:42:52.751048] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:42:52.751350] [DEBUG] [LOCAL ] ETV: No existing data file found in primary storage. [2025-09-26T18:42:52.751429] [WARN ] [MAIN ] ETV: No existing data found, performing full refresh instead. [2025-09-26T18:42:52.751705] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-09-26T18:42:52.751779] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-09-26T18:42:52.751952] [DEBUG] [LOCAL ] ETV: No primary data file found to delete. [2025-09-26T18:42:52.752045] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-09-26T18:42:52.774865] [INFO ] [REMOTE ] ETO: Fetching primary data for 2024-12. [2025-09-26T18:42:53.192996] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-26T18:42:53.198004] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:42:53.378442] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-26T18:42:53.426751] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-26T18:42:53.556738] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-09-26T18:42:54.357973] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-09-26T18:42:54.359872] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-26T18:42:55.156731] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-09-26T18:42:55.813886] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-26T18:42:55.956744] [INFO ] [REMOTE ] ETV: Fetching primary data for 2024-12. [2025-09-26T18:42:56.173236] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-26T18:42:56.756780] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-09-26T18:42:57.053249] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-26T18:42:57.556784] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-09-26T18:42:58.000401] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-26T18:42:58.356709] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-09-26T18:42:58.432219] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-26T18:42:59.156739] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-09-26T18:42:59.956751] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-09-26T18:43:00.006678] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-26T18:43:00.288312] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-26T18:43:00.756756] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-09-26T18:43:01.556741] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-09-26T18:43:01.589925] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-26T18:43:01.775736] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-26T18:43:02.356714] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-09-26T18:43:02.824778] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-26T18:43:03.156768] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-09-26T18:43:03.702872] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-26T18:43:03.956695] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-09-26T18:43:04.063193] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-26T18:43:04.672567] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-26T18:43:04.756729] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-09-26T18:43:05.556749] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-09-26T18:43:05.772258] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-26T18:43:06.356728] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-09-26T18:43:07.095970] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-26T18:43:07.156723] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-09-26T18:43:07.443106] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-26T18:43:07.678709] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-26T18:43:07.956747] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-09-26T18:43:08.739773] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-26T18:43:08.756690] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-09-26T18:43:09.346364] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-26T18:43:09.556720] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-09-26T18:43:10.356701] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-09-26T18:43:10.479778] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-26T18:43:10.481601] [INFO ] [REMOTE ] ETO: Full fetch complete (9326 records). [2025-09-26T18:43:10.481740] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-09-26T18:43:10.872919] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-09-26T18:43:10.873020] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-09-26T18:43:10.873286] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-09-26T18:43:10.873347] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-09-26T18:43:10.873934] [DEBUG] [LOCAL ] ETO: Trimmed 9326 records to 6600 (keeping 200 days of data) [2025-09-26T18:43:10.919473] [DEBUG] [LOCAL ] ETO: Primary data saved (6600 records). [2025-09-26T18:43:10.919608] [INFO ] [MAIN ] ETO: Full history saved. [2025-09-26T18:43:10.919724] [INFO ] [MAIN ] Update Progress: 779/2371 symbols completed. ETO took 21.2s. Estimated remaining: 3h 30m 46s. Rate: 7.6 symbols/min [2025-09-26T18:43:11.098719] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:43:11.129878] [DEBUG] [LOCAL ] ETW: Loaded 25236 existing records from primary storage. [2025-09-26T18:43:11.130038] [INFO ] [MAIN ] ETW: Loaded 25236 existing records. [2025-09-26T18:43:11.162072] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-09-26T18:43:11.321090] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:43:11.321405] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-09-26T18:43:11.321489] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-09-26T18:43:11.322404] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-09-26T18:43:11.322471] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-09-26T18:43:11.729946] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:43:11.724344] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-26T18:43:11.956724] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-09-26T18:43:12.680280] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-26T18:43:12.756712] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-09-26T18:43:13.556784] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-09-26T18:43:13.770026] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-26T18:43:14.313006] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-26T18:43:14.358343] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T18:43:14.358509] [INFO ] [REMOTE ] ETW: Fetching primary data for 2024-12. [2025-09-26T18:43:15.156775] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-09-26T18:43:15.533977] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-26T18:43:15.956739] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-09-26T18:43:16.756719] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-09-26T18:43:17.056489] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-26T18:43:17.556701] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-09-26T18:43:17.749262] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-09-26T18:43:17.759790] [INFO ] [REMOTE ] ETN: Full fetch complete (76599 records). [2025-09-26T18:43:17.759951] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-09-26T18:43:18.174856] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-09-26T18:43:18.174968] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-09-26T18:43:18.176105] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-09-26T18:43:18.176194] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-09-26T18:43:18.180921] [DEBUG] [LOCAL ] ETN: Trimmed 76599 records to 53593 (keeping 200 days of data) [2025-09-26T18:43:18.335123] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-26T18:43:18.356981] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-09-26T18:43:18.375962] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-26T18:43:18.613453] [DEBUG] [LOCAL ] ETN: Primary data saved (53593 records). [2025-09-26T18:43:18.613614] [INFO ] [MAIN ] ETN: Full history saved. [2025-09-26T18:43:18.613762] [INFO ] [MAIN ] Update Progress: 780/2371 symbols completed. ETN took 39.0s. Estimated remaining: 3h 30m 37s. Rate: 7.6 symbols/min [2025-09-26T18:43:18.794067] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:43:18.800892] [DEBUG] [LOCAL ] ETX: Loaded 5002 existing records from primary storage. [2025-09-26T18:43:18.800999] [INFO ] [MAIN ] ETX: Loaded 5002 existing records. [2025-09-26T18:43:19.029660] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:43:19.029943] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-09-26T18:43:19.029994] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-09-26T18:43:19.030333] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-09-26T18:43:19.030393] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-09-26T18:43:19.165614] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-09-26T18:43:19.497048] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:43:19.572380] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-26T18:43:19.956736] [INFO ] [REMOTE ] ETX: Fetching primary data for 2024-12. [2025-09-26T18:43:20.010281] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-26T18:43:20.015311] [INFO ] [REMOTE ] ETV: Full fetch complete (31727 records). [2025-09-26T18:43:20.015420] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-09-26T18:43:20.424840] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-09-26T18:43:20.424958] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-09-26T18:43:20.425565] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-09-26T18:43:20.425613] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-09-26T18:43:20.426719] [DEBUG] [LOCAL ] ETV: Trimmed 31727 records to 21729 (keeping 200 days of data) [2025-09-26T18:43:20.572135] [DEBUG] [LOCAL ] ETV: Primary data saved (21729 records). [2025-09-26T18:43:20.572271] [INFO ] [MAIN ] ETV: Full history saved. [2025-09-26T18:43:20.572351] [INFO ] [MAIN ] Update Progress: 781/2371 symbols completed. ETV took 28.0s. Estimated remaining: 3h 30m 17s. Rate: 7.6 symbols/min [2025-09-26T18:43:20.766805] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:43:20.765773] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-09-26T18:43:20.774095] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-26T18:43:20.797564] [DEBUG] [LOCAL ] ETY: Loaded 22913 existing records from primary storage. [2025-09-26T18:43:20.797722] [INFO ] [MAIN ] ETY: Loaded 22913 existing records. [2025-09-26T18:43:20.997504] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:43:20.997810] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-09-26T18:43:20.997862] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-09-26T18:43:20.998581] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-09-26T18:43:20.998681] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-09-26T18:43:21.395154] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:43:21.556745] [INFO ] [REMOTE ] ETY: Fetching primary data for 2024-12. [2025-09-26T18:43:22.356705] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-09-26T18:43:22.551245] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-26T18:43:22.730879] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-26T18:43:22.748930] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-26T18:43:23.156811] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-09-26T18:43:23.956749] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-09-26T18:43:24.756783] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-09-26T18:43:25.080890] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-26T18:43:25.133693] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-26T18:43:25.217210] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-26T18:43:25.556717] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-09-26T18:43:26.182846] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-26T18:43:26.356732] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-09-26T18:43:27.027724] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-26T18:43:27.156766] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-09-26T18:43:27.956738] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-09-26T18:43:28.498288] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-26T18:43:28.756733] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-09-26T18:43:28.832010] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-26T18:43:29.475685] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-26T18:43:29.556721] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-09-26T18:43:30.126341] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-26T18:43:30.356750] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-09-26T18:43:31.156732] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-09-26T18:43:31.473139] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-26T18:43:31.956772] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-09-26T18:43:32.500779] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-26T18:43:32.756753] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-09-26T18:43:32.892544] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-26T18:43:33.339159] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-26T18:43:33.341112] [INFO ] [REMOTE ] ETX: Full fetch complete (7020 records). [2025-09-26T18:43:33.341200] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-09-26T18:43:33.566539] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-09-26T18:43:33.744520] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-09-26T18:43:33.744614] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-09-26T18:43:33.744872] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-09-26T18:43:33.744932] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-09-26T18:43:33.745608] [DEBUG] [LOCAL ] ETX: Trimmed 7020 records to 5028 (keeping 200 days of data) [2025-09-26T18:43:33.777940] [DEBUG] [LOCAL ] ETX: Primary data saved (5028 records). [2025-09-26T18:43:33.778087] [INFO ] [MAIN ] ETX: Full history saved. [2025-09-26T18:43:33.778179] [INFO ] [MAIN ] Update Progress: 782/2371 symbols completed. ETX took 15.2s. Estimated remaining: 3h 30m 20s. Rate: 7.6 symbols/min [2025-09-26T18:43:33.962110] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:43:33.985483] [DEBUG] [LOCAL ] EVC: Loaded 19345 existing records from primary storage. [2025-09-26T18:43:33.985620] [INFO ] [MAIN ] EVC: Loaded 19345 existing records. [2025-09-26T18:43:34.181670] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:43:34.181983] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-09-26T18:43:34.182041] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-09-26T18:43:34.182717] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-09-26T18:43:34.182779] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-09-26T18:43:34.356913] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-09-26T18:43:34.605904] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:43:34.830579] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-26T18:43:35.156753] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-09-26T18:43:35.956728] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-09-26T18:43:36.004235] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-26T18:43:36.109119] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-26T18:43:36.756735] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-09-26T18:43:37.556737] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-09-26T18:43:37.660089] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-26T18:43:37.670770] [INFO ] [REMOTE ] ETR: Full fetch complete (77012 records). [2025-09-26T18:43:37.671015] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-09-26T18:43:38.187383] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-09-26T18:43:38.187747] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-09-26T18:43:38.188816] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-09-26T18:43:38.188903] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-09-26T18:43:38.191082] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-26T18:43:38.199991] [DEBUG] [LOCAL ] ETR: Trimmed 77012 records to 54001 (keeping 200 days of data) [2025-09-26T18:43:38.407736] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-09-26T18:43:38.453677] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-26T18:43:38.586058] [DEBUG] [LOCAL ] ETR: Primary data saved (54001 records). [2025-09-26T18:43:38.586258] [INFO ] [MAIN ] ETR: Full history saved. [2025-09-26T18:43:38.586422] [INFO ] [MAIN ] Update Progress: 783/2371 symbols completed. ETR took 48.7s. Estimated remaining: 3h 30m 6s. Rate: 7.6 symbols/min [2025-09-26T18:43:38.841993] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:43:38.889717] [DEBUG] [LOCAL ] EVEX: Loaded 30253 existing records from primary storage. [2025-09-26T18:43:38.889879] [INFO ] [MAIN ] EVEX: Loaded 30253 existing records. [2025-09-26T18:43:39.144882] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:43:39.145289] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-09-26T18:43:39.145366] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-09-26T18:43:39.146338] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-09-26T18:43:39.146414] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-09-26T18:43:39.165022] [INFO ] [REMOTE ] EVC: Fetching primary data for 2024-12. [2025-09-26T18:43:39.557979] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:43:39.645808] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-26T18:43:39.956725] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-09-26T18:43:40.703602] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-26T18:43:40.756733] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-09-26T18:43:40.772865] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-26T18:43:41.556727] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-09-26T18:43:41.888782] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-26T18:43:42.356787] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-09-26T18:43:42.506079] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-26T18:43:43.156793] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-09-26T18:43:43.461695] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-26T18:43:43.897802] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-26T18:43:43.956789] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2024-12. [2025-09-26T18:43:44.756753] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-09-26T18:43:45.105822] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-26T18:43:45.556779] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-09-26T18:43:45.673159] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-26T18:43:46.356689] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-09-26T18:43:46.379013] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-26T18:43:47.156736] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-09-26T18:43:47.313749] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-26T18:43:47.956767] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-09-26T18:43:48.516754] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-26T18:43:48.522005] [INFO ] [REMOTE ] ETW: Full fetch complete (36361 records). [2025-09-26T18:43:48.522138] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-09-26T18:43:48.763453] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-09-26T18:43:48.941398] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-09-26T18:43:48.941479] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-09-26T18:43:48.942141] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-09-26T18:43:48.942208] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-09-26T18:43:48.943259] [DEBUG] [LOCAL ] ETW: Trimmed 36361 records to 25463 (keeping 200 days of data) [2025-09-26T18:43:49.103798] [DEBUG] [LOCAL ] ETW: Primary data saved (25463 records). [2025-09-26T18:43:49.103935] [INFO ] [MAIN ] ETW: Full history saved. [2025-09-26T18:43:49.104031] [INFO ] [MAIN ] Update Progress: 784/2371 symbols completed. ETW took 38.2s. Estimated remaining: 3h 30m 3s. Rate: 7.6 symbols/min [2025-09-26T18:43:49.293460] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:43:49.311047] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-26T18:43:49.325462] [DEBUG] [LOCAL ] EVF: Loaded 9349 existing records from primary storage. [2025-09-26T18:43:49.325698] [INFO ] [MAIN ] EVF: Loaded 9349 existing records. [2025-09-26T18:43:49.519998] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:43:49.520248] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-09-26T18:43:49.520304] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-09-26T18:43:49.520788] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-09-26T18:43:49.520852] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-09-26T18:43:49.561933] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-09-26T18:43:49.924243] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:43:49.997381] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-26T18:43:50.356773] [INFO ] [REMOTE ] EVF: Fetching primary data for 2024-12. [2025-09-26T18:43:50.763288] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-26T18:43:51.156774] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-09-26T18:43:51.204979] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-26T18:43:51.956735] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-09-26T18:43:51.978269] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-26T18:43:52.756776] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-09-26T18:43:53.048886] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-26T18:43:53.183965] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-26T18:43:53.556724] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-09-26T18:43:54.356788] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-09-26T18:43:54.751162] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-26T18:43:55.156771] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-09-26T18:43:55.281992] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-26T18:43:55.931427] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-26T18:43:55.956705] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-09-26T18:43:56.756708] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-09-26T18:43:57.102058] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-26T18:43:57.106308] [INFO ] [REMOTE ] ETY: Full fetch complete (34074 records). [2025-09-26T18:43:57.106410] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-09-26T18:43:57.505026] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-09-26T18:43:57.505179] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-09-26T18:43:57.505808] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-09-26T18:43:57.505906] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-09-26T18:43:57.507301] [DEBUG] [LOCAL ] ETY: Trimmed 34074 records to 23078 (keeping 200 days of data) [2025-09-26T18:43:57.567547] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-09-26T18:43:57.619564] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-26T18:43:57.688770] [DEBUG] [LOCAL ] ETY: Primary data saved (23078 records). [2025-09-26T18:43:57.689229] [INFO ] [MAIN ] ETY: Full history saved. [2025-09-26T18:43:57.689344] [INFO ] [MAIN ] Update Progress: 785/2371 symbols completed. ETY took 37.1s. Estimated remaining: 3h 29m 56s. Rate: 7.6 symbols/min [2025-09-26T18:43:57.883975] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:43:57.892417] [DEBUG] [LOCAL ] EVG: Loaded 5833 existing records from primary storage. [2025-09-26T18:43:57.892512] [INFO ] [MAIN ] EVG: Loaded 5833 existing records. [2025-09-26T18:43:58.082609] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:43:58.082885] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-09-26T18:43:58.082934] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-09-26T18:43:58.083253] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-09-26T18:43:58.083313] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-09-26T18:43:58.365068] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-09-26T18:43:58.469468] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:43:58.775687] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-26T18:43:59.156728] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-09-26T18:43:59.563348] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-26T18:43:59.643524] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-26T18:43:59.956731] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-09-26T18:44:00.516766] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-26T18:44:00.756737] [INFO ] [REMOTE ] EVG: Fetching primary data for 2024-12. [2025-09-26T18:44:01.556732] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-09-26T18:44:01.574841] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-26T18:44:02.356753] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-09-26T18:44:02.877523] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-26T18:44:03.156729] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-09-26T18:44:03.913979] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-26T18:44:03.956751] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-09-26T18:44:04.283404] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-26T18:44:04.288503] [INFO ] [REMOTE ] EVC: Full fetch complete (30799 records). [2025-09-26T18:44:04.288764] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-09-26T18:44:04.711877] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-09-26T18:44:04.712040] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-09-26T18:44:04.712759] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-09-26T18:44:04.712841] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-09-26T18:44:04.713925] [DEBUG] [LOCAL ] EVC: Trimmed 30799 records to 19415 (keeping 200 days of data) [2025-09-26T18:44:04.768335] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-09-26T18:44:04.846486] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-26T18:44:04.865045] [DEBUG] [LOCAL ] EVC: Primary data saved (19415 records). [2025-09-26T18:44:04.865225] [INFO ] [MAIN ] EVC: Full history saved. [2025-09-26T18:44:04.865362] [INFO ] [MAIN ] Update Progress: 786/2371 symbols completed. EVC took 31.1s. Estimated remaining: 3h 29m 47s. Rate: 7.6 symbols/min [2025-09-26T18:44:05.044297] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:44:05.092763] [DEBUG] [LOCAL ] EVH: Loaded 49734 existing records from primary storage. [2025-09-26T18:44:05.092963] [INFO ] [MAIN ] EVH: Loaded 49734 existing records. [2025-09-26T18:44:05.293392] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:44:05.293742] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-09-26T18:44:05.293812] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-09-26T18:44:05.295082] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-09-26T18:44:05.295145] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-09-26T18:44:05.553700] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-26T18:44:05.566281] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-09-26T18:44:05.718882] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:44:06.356735] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-09-26T18:44:07.072003] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-26T18:44:07.156685] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-09-26T18:44:07.266375] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-26T18:44:07.890176] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-26T18:44:07.956736] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-09-26T18:44:08.756739] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-09-26T18:44:09.205922] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-26T18:44:09.534488] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-26T18:44:09.544218] [INFO ] [REMOTE ] EVEX: Full fetch complete (41693 records). [2025-09-26T18:44:09.544381] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-09-26T18:44:09.561857] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-09-26T18:44:09.981207] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-09-26T18:44:09.981308] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-09-26T18:44:09.982047] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-09-26T18:44:09.982139] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-09-26T18:44:09.983531] [DEBUG] [LOCAL ] EVEX: Trimmed 41693 records to 30549 (keeping 200 days of data) [2025-09-26T18:44:10.176365] [DEBUG] [LOCAL ] EVEX: Primary data saved (30549 records). [2025-09-26T18:44:10.176980] [INFO ] [MAIN ] EVEX: Full history saved. [2025-09-26T18:44:10.177215] [INFO ] [MAIN ] Update Progress: 787/2371 symbols completed. EVEX took 31.6s. Estimated remaining: 3h 29m 34s. Rate: 7.6 symbols/min [2025-09-26T18:44:10.314744] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-26T18:44:10.361498] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-09-26T18:44:10.387834] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:44:10.389165] [DEBUG] [LOCAL ] EVN: No existing data file found in primary storage. [2025-09-26T18:44:10.389213] [WARN ] [MAIN ] EVN: No existing data found, performing full refresh instead. [2025-09-26T18:44:10.389372] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-09-26T18:44:10.389417] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-09-26T18:44:10.389463] [DEBUG] [LOCAL ] EVN: No primary data file found to delete. [2025-09-26T18:44:10.389495] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-09-26T18:44:10.824808] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:44:11.156722] [INFO ] [REMOTE ] EVN: Fetching primary data for 2024-12. [2025-09-26T18:44:11.388841] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-26T18:44:11.956769] [INFO ] [REMOTE ] EVH: Fetching primary data for 2024-12. [2025-09-26T18:44:12.557781] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T18:44:12.756781] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-09-26T18:44:13.556717] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-09-26T18:44:13.612913] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-26T18:44:13.875806] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-26T18:44:14.339399] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-26T18:44:14.356724] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-09-26T18:44:15.156778] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-09-26T18:44:15.956786] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-09-26T18:44:16.237143] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-26T18:44:16.277532] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-26T18:44:16.280317] [INFO ] [REMOTE ] EVF: Full fetch complete (12101 records). [2025-09-26T18:44:16.280408] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-09-26T18:44:16.711086] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-09-26T18:44:16.711259] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-09-26T18:44:16.711750] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-09-26T18:44:16.711949] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-09-26T18:44:16.713065] [DEBUG] [LOCAL ] EVF: Trimmed 12101 records to 9501 (keeping 200 days of data) [2025-09-26T18:44:16.725000] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-26T18:44:16.769404] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-09-26T18:44:16.790775] [DEBUG] [LOCAL ] EVF: Primary data saved (9501 records). [2025-09-26T18:44:16.790933] [INFO ] [MAIN ] EVF: Full history saved. [2025-09-26T18:44:16.791108] [INFO ] [MAIN ] Update Progress: 788/2371 symbols completed. EVF took 27.7s. Estimated remaining: 3h 29m 23s. Rate: 7.6 symbols/min [2025-09-26T18:44:16.985953] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:44:17.028338] [DEBUG] [LOCAL ] EVR: Loaded 35727 existing records from primary storage. [2025-09-26T18:44:17.028533] [INFO ] [MAIN ] EVR: Loaded 35727 existing records. [2025-09-26T18:44:17.224208] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:44:17.224517] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-09-26T18:44:17.224567] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-09-26T18:44:17.225739] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-09-26T18:44:17.225803] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-09-26T18:44:17.566201] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-09-26T18:44:17.657586] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:44:17.714172] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-26T18:44:18.356742] [INFO ] [REMOTE ] EVR: Fetching primary data for 2024-12. [2025-09-26T18:44:19.071825] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-26T18:44:19.156710] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-09-26T18:44:19.906870] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-26T18:44:19.956690] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-09-26T18:44:20.756737] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-09-26T18:44:20.977180] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-26T18:44:21.188114] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-26T18:44:21.529837] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T18:44:21.556678] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-09-26T18:44:22.356779] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-09-26T18:44:23.095496] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-26T18:44:23.156720] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-09-26T18:44:23.901332] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-26T18:44:23.956753] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-09-26T18:44:24.303605] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-26T18:44:24.756771] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-09-26T18:44:25.140387] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-26T18:44:25.556759] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-09-26T18:44:26.356731] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-09-26T18:44:26.477416] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-26T18:44:26.714799] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-26T18:44:27.156735] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-09-26T18:44:27.188945] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-26T18:44:27.956772] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-09-26T18:44:28.696886] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-26T18:44:28.756730] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-09-26T18:44:29.357959] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-26T18:44:29.556721] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-09-26T18:44:30.158028] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-26T18:44:30.191334] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-26T18:44:30.356748] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-09-26T18:44:31.156744] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-09-26T18:44:31.809319] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-26T18:44:31.836982] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-26T18:44:31.956735] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-09-26T18:44:32.756752] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-09-26T18:44:32.802126] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-26T18:44:33.251453] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-26T18:44:33.253225] [INFO ] [REMOTE ] EVG: Full fetch complete (8055 records). [2025-09-26T18:44:33.253308] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-09-26T18:44:33.563322] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-09-26T18:44:33.671339] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-09-26T18:44:33.671425] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-09-26T18:44:33.671682] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-09-26T18:44:33.671745] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-09-26T18:44:33.672266] [DEBUG] [LOCAL ] EVG: Trimmed 8055 records to 5862 (keeping 200 days of data) [2025-09-26T18:44:33.711048] [DEBUG] [LOCAL ] EVG: Primary data saved (5862 records). [2025-09-26T18:44:33.711198] [INFO ] [MAIN ] EVG: Full history saved. [2025-09-26T18:44:33.711293] [INFO ] [MAIN ] Update Progress: 789/2371 symbols completed. EVG took 36.0s. Estimated remaining: 3h 29m 33s. Rate: 7.5 symbols/min [2025-09-26T18:44:33.896435] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:44:33.896629] [DEBUG] [LOCAL ] EVT: No existing data file found in primary storage. [2025-09-26T18:44:33.896703] [WARN ] [MAIN ] EVT: No existing data found, performing full refresh instead. [2025-09-26T18:44:33.896864] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-09-26T18:44:33.896909] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-09-26T18:44:33.896952] [DEBUG] [LOCAL ] EVT: No primary data file found to delete. [2025-09-26T18:44:33.896986] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-09-26T18:44:34.283978] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:44:34.356773] [INFO ] [REMOTE ] EVT: Fetching primary data for 2024-12. [2025-09-26T18:44:35.156775] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-09-26T18:44:35.542952] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-26T18:44:35.565489] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-26T18:44:35.923154] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-26T18:44:35.956772] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-09-26T18:44:36.756743] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-09-26T18:44:37.242154] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-26T18:44:37.556742] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-09-26T18:44:37.999071] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-26T18:44:38.356782] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-09-26T18:44:38.697743] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-26T18:44:38.704082] [INFO ] [REMOTE ] EVR: Full fetch complete (50703 records). [2025-09-26T18:44:38.704237] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-09-26T18:44:39.108037] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-09-26T18:44:39.108117] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-09-26T18:44:39.108820] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-09-26T18:44:39.108883] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-09-26T18:44:39.110195] [DEBUG] [LOCAL ] EVR: Trimmed 50703 records to 35882 (keeping 200 days of data) [2025-09-26T18:44:39.168481] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-09-26T18:44:39.343579] [DEBUG] [LOCAL ] EVR: Primary data saved (35882 records). [2025-09-26T18:44:39.343795] [INFO ] [MAIN ] EVR: Full history saved. [2025-09-26T18:44:39.343891] [INFO ] [MAIN ] Update Progress: 790/2371 symbols completed. EVR took 22.6s. Estimated remaining: 3h 29m 20s. Rate: 7.6 symbols/min [2025-09-26T18:44:39.532362] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:44:39.559715] [DEBUG] [LOCAL ] EVTC: Loaded 26605 existing records from primary storage. [2025-09-26T18:44:39.559856] [INFO ] [MAIN ] EVTC: Loaded 26605 existing records. [2025-09-26T18:44:39.765715] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:44:39.766300] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-09-26T18:44:39.766504] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-09-26T18:44:39.777018] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-09-26T18:44:39.792069] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-09-26T18:44:39.836200] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-26T18:44:39.975479] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-09-26T18:44:39.996067] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-26T18:44:40.219794] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:44:40.756747] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-09-26T18:44:41.017334] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-26T18:44:41.556764] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-12. [2025-09-26T18:44:42.313009] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-26T18:44:42.323626] [INFO ] [REMOTE ] EVH: Full fetch complete (71768 records). [2025-09-26T18:44:42.323858] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-09-26T18:44:42.361956] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-09-26T18:44:42.754254] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-09-26T18:44:42.754352] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-09-26T18:44:42.755237] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-09-26T18:44:42.755305] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-09-26T18:44:42.756934] [DEBUG] [LOCAL ] EVH: Trimmed 71768 records to 50111 (keeping 200 days of data) [2025-09-26T18:44:43.061837] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-26T18:44:43.084253] [DEBUG] [LOCAL ] EVH: Primary data saved (50111 records). [2025-09-26T18:44:43.084426] [INFO ] [MAIN ] EVH: Full history saved. [2025-09-26T18:44:43.084528] [INFO ] [MAIN ] Update Progress: 791/2371 symbols completed. EVH took 38.2s. Estimated remaining: 3h 29m 4s. Rate: 7.6 symbols/min [2025-09-26T18:44:43.161841] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-09-26T18:44:43.283041] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:44:43.325750] [DEBUG] [LOCAL ] EVTL: Loaded 37759 existing records from primary storage. [2025-09-26T18:44:43.325962] [INFO ] [MAIN ] EVTL: Loaded 37759 existing records. [2025-09-26T18:44:43.474499] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-26T18:44:43.549292] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:44:43.549616] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-09-26T18:44:43.549710] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-09-26T18:44:43.550686] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-09-26T18:44:43.550768] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-09-26T18:44:43.883438] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-26T18:44:43.961952] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-09-26T18:44:43.967982] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:44:44.756716] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-09-26T18:44:45.069356] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-26T18:44:45.305332] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-26T18:44:45.556743] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-12. [2025-09-26T18:44:46.356784] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-09-26T18:44:47.041927] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-26T18:44:47.099538] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-26T18:44:47.102292] [INFO ] [REMOTE ] EVN: Full fetch complete (17540 records). [2025-09-26T18:44:47.102405] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-09-26T18:44:47.161811] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-09-26T18:44:47.550225] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-09-26T18:44:47.550323] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-09-26T18:44:47.550863] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-09-26T18:44:47.550941] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-09-26T18:44:47.551922] [DEBUG] [LOCAL ] EVN: Trimmed 17540 records to 11217 (keeping 200 days of data) [2025-09-26T18:44:47.627263] [DEBUG] [LOCAL ] EVN: Primary data saved (11217 records). [2025-09-26T18:44:47.627427] [INFO ] [MAIN ] EVN: Full history saved. [2025-09-26T18:44:47.627521] [INFO ] [MAIN ] Update Progress: 792/2371 symbols completed. EVN took 37.5s. Estimated remaining: 3h 28m 49s. Rate: 7.6 symbols/min [2025-09-26T18:44:47.826230] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:44:47.850633] [DEBUG] [LOCAL ] EVTR: Loaded 23468 existing records from primary storage. [2025-09-26T18:44:47.850810] [INFO ] [MAIN ] EVTR: Loaded 23468 existing records. [2025-09-26T18:44:47.966319] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-09-26T18:44:48.056189] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:44:48.056490] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-09-26T18:44:48.056549] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-09-26T18:44:48.057368] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-09-26T18:44:48.057460] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-09-26T18:44:48.466838] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:44:48.477522] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-26T18:44:48.740317] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-26T18:44:48.756680] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-09-26T18:44:49.556720] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-09-26T18:44:49.820533] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-26T18:44:50.356769] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-09-26T18:44:50.934230] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-26T18:44:51.035169] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-26T18:44:51.156775] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-09-26T18:44:51.956729] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-09-26T18:44:52.155528] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-26T18:44:52.756772] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-09-26T18:44:53.409790] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-26T18:44:53.556746] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2024-12. [2025-09-26T18:44:53.725854] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-26T18:44:53.732026] [INFO ] [REMOTE ] EVT: Full fetch complete (25214 records). [2025-09-26T18:44:53.732229] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-09-26T18:44:54.165695] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-09-26T18:44:54.165800] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-09-26T18:44:54.166381] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-09-26T18:44:54.166464] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-09-26T18:44:54.167423] [DEBUG] [LOCAL ] EVT: Trimmed 25214 records to 17270 (keeping 200 days of data) [2025-09-26T18:44:54.273844] [DEBUG] [LOCAL ] EVT: Primary data saved (17270 records). [2025-09-26T18:44:54.274007] [INFO ] [MAIN ] EVT: Full history saved. [2025-09-26T18:44:54.274144] [INFO ] [MAIN ] Update Progress: 793/2371 symbols completed. EVT took 20.6s. Estimated remaining: 3h 28m 39s. Rate: 7.6 symbols/min [2025-09-26T18:44:54.361900] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-09-26T18:44:54.458974] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:44:54.459297] [DEBUG] [LOCAL ] EW: No existing data file found in primary storage. [2025-09-26T18:44:54.459484] [WARN ] [MAIN ] EW: No existing data found, performing full refresh instead. [2025-09-26T18:44:54.459688] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-09-26T18:44:54.459744] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-09-26T18:44:54.459789] [DEBUG] [LOCAL ] EW: No primary data file found to delete. [2025-09-26T18:44:54.459830] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-09-26T18:44:54.757194] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-26T18:44:54.873068] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:44:55.156734] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-09-26T18:44:55.575558] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-26T18:44:55.836694] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-26T18:44:55.956734] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-09-26T18:44:56.756711] [INFO ] [REMOTE ] EW: Fetching primary data for 2024-12. [2025-09-26T18:44:57.198973] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-26T18:44:57.556719] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-09-26T18:44:58.356717] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-09-26T18:44:58.555429] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T18:44:58.890221] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-26T18:44:58.973575] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-26T18:44:59.156721] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-09-26T18:44:59.956702] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-09-26T18:45:00.344183] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-26T18:45:00.756728] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-09-26T18:45:01.556735] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-09-26T18:45:01.879824] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-26T18:45:01.923501] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-26T18:45:02.356722] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-09-26T18:45:02.444890] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-26T18:45:03.156724] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-09-26T18:45:03.956690] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-09-26T18:45:04.033883] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-26T18:45:04.330024] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-26T18:45:04.756723] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-09-26T18:45:05.424066] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-26T18:45:05.556968] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-09-26T18:45:05.556883] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-26T18:45:06.356732] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-09-26T18:45:06.728979] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-26T18:45:07.156835] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-09-26T18:45:07.878728] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-26T18:45:07.884098] [INFO ] [REMOTE ] EVTC: Full fetch complete (37742 records). [2025-09-26T18:45:07.884214] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-09-26T18:45:07.884866] [FATAL] [VALIDATOR ] EVTC: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:45:07.884972] [FATAL] [MAIN ] EVTC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:45:07.885050] [WARN ] [MAIN ] EVTC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:45:07.885149] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-09-26T18:45:07.885232] [DEBUG] [LOCAL ] EVTC: No primary data file found to delete. [2025-09-26T18:45:07.885271] [INFO ] [LOCAL ] EVTC: Starting deletion of derivative data. [2025-09-26T18:45:07.885775] [DEBUG] [LOCAL ] EVTC: Deleted derivative data file. [2025-09-26T18:45:07.885876] [INFO ] [MAIN ] Update Progress: 794/2371 symbols completed. EVTC took 28.5s. Estimated remaining: 3h 28m 42s. Rate: 7.6 symbols/min [2025-09-26T18:45:07.965560] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-09-26T18:45:08.068115] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:45:08.111389] [DEBUG] [LOCAL ] EXG: Loaded 34473 existing records from primary storage. [2025-09-26T18:45:08.111561] [INFO ] [MAIN ] EXG: Loaded 34473 existing records. [2025-09-26T18:45:08.304895] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:45:08.305189] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-09-26T18:45:08.305299] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-09-26T18:45:08.306796] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-09-26T18:45:08.306862] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-09-26T18:45:08.626009] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T18:45:08.740618] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:45:08.756712] [INFO ] [REMOTE ] EXG: Fetching primary data for 2024-12. [2025-09-26T18:45:08.898233] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-26T18:45:09.556737] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-09-26T18:45:09.885180] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-26T18:45:10.356726] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-09-26T18:45:10.829351] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-26T18:45:11.156774] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-09-26T18:45:11.956773] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-09-26T18:45:12.235326] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-26T18:45:12.553407] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-26T18:45:12.756757] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-09-26T18:45:13.396890] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-26T18:45:13.556728] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-09-26T18:45:14.356721] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-09-26T18:45:14.400229] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-26T18:45:14.440871] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-26T18:45:15.156767] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-09-26T18:45:15.956691] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-09-26T18:45:16.089054] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-26T18:45:16.347282] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-26T18:45:16.756768] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-09-26T18:45:17.556697] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-09-26T18:45:17.831770] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-26T18:45:17.970084] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-26T18:45:18.356823] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-09-26T18:45:19.161918] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-09-26T18:45:19.191175] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-26T18:45:19.837941] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-26T18:45:19.956780] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-09-26T18:45:20.313258] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-26T18:45:20.756761] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-09-26T18:45:21.556740] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-09-26T18:45:21.753854] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-26T18:45:21.763927] [INFO ] [REMOTE ] EVTL: Full fetch complete (50676 records). [2025-09-26T18:45:21.764112] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-09-26T18:45:21.764922] [FATAL] [VALIDATOR ] EVTL: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:45:21.765019] [FATAL] [MAIN ] EVTL: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:45:21.765066] [WARN ] [MAIN ] EVTL: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:45:21.765108] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-09-26T18:45:21.765174] [DEBUG] [LOCAL ] EVTL: No primary data file found to delete. [2025-09-26T18:45:21.765212] [INFO ] [LOCAL ] EVTL: Starting deletion of derivative data. [2025-09-26T18:45:21.765671] [DEBUG] [LOCAL ] EVTL: Deleted derivative data file. [2025-09-26T18:45:21.765778] [INFO ] [MAIN ] Update Progress: 795/2371 symbols completed. EVTL took 38.7s. Estimated remaining: 3h 28m 46s. Rate: 7.5 symbols/min [2025-09-26T18:45:21.977361] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:45:22.009258] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-26T18:45:22.067492] [DEBUG] [LOCAL ] EXK: Loaded 53514 existing records from primary storage. [2025-09-26T18:45:22.067699] [INFO ] [MAIN ] EXK: Loaded 53514 existing records. [2025-09-26T18:45:22.282274] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:45:22.282554] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-09-26T18:45:22.282605] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-09-26T18:45:22.284019] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-09-26T18:45:22.284084] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-09-26T18:45:22.363749] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-09-26T18:45:22.678009] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:45:22.847304] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-26T18:45:22.854356] [INFO ] [REMOTE ] EVTR: Full fetch complete (32102 records). [2025-09-26T18:45:22.854473] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-09-26T18:45:23.162509] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-09-26T18:45:23.254858] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-09-26T18:45:23.254953] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-09-26T18:45:23.255530] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-09-26T18:45:23.255591] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-09-26T18:45:23.256546] [DEBUG] [LOCAL ] EVTR: Trimmed 32102 records to 23675 (keeping 200 days of data) [2025-09-26T18:45:23.404523] [DEBUG] [LOCAL ] EVTR: Primary data saved (23675 records). [2025-09-26T18:45:23.404685] [INFO ] [MAIN ] EVTR: Full history saved. [2025-09-26T18:45:23.404797] [INFO ] [MAIN ] Update Progress: 796/2371 symbols completed. EVTR took 35.8s. Estimated remaining: 3h 28m 26s. Rate: 7.6 symbols/min [2025-09-26T18:45:23.578885] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:45:23.579095] [DEBUG] [LOCAL ] EXP: No existing data file found in primary storage. [2025-09-26T18:45:23.579134] [WARN ] [MAIN ] EXP: No existing data found, performing full refresh instead. [2025-09-26T18:45:23.579276] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-09-26T18:45:23.579319] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-09-26T18:45:23.579402] [DEBUG] [LOCAL ] EXP: No primary data file found to delete. [2025-09-26T18:45:23.579448] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-09-26T18:45:23.971592] [INFO ] [REMOTE ] EXK: Fetching primary data for 2024-12. [2025-09-26T18:45:24.019499] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:45:24.065722] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-26T18:45:24.693346] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-26T18:45:24.756792] [INFO ] [REMOTE ] EXP: Fetching primary data for 2024-12. [2025-09-26T18:45:25.454600] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-26T18:45:25.556753] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-09-26T18:45:25.770290] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-26T18:45:26.356801] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-09-26T18:45:27.068739] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-26T18:45:27.156774] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-09-26T18:45:27.808767] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-26T18:45:27.956797] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-09-26T18:45:28.690681] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-26T18:45:28.756768] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-09-26T18:45:29.465029] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-26T18:45:29.556746] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-09-26T18:45:30.359669] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-09-26T18:45:30.363461] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-26T18:45:30.635372] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-26T18:45:31.156747] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-09-26T18:45:31.320576] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-26T18:45:31.956784] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-09-26T18:45:32.756777] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-09-26T18:45:33.236727] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-26T18:45:33.415376] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-26T18:45:33.426492] [INFO ] [REMOTE ] EW: Full fetch complete (77348 records). [2025-09-26T18:45:33.426718] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-09-26T18:45:33.561885] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-09-26T18:45:33.909160] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-09-26T18:45:33.909354] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-09-26T18:45:33.913883] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-09-26T18:45:33.915133] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-09-26T18:45:33.914949] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-26T18:45:33.923860] [INFO ] [REMOTE ] EXG: Full fetch complete (49890 records). [2025-09-26T18:45:33.923994] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-09-26T18:45:33.930382] [DEBUG] [LOCAL ] EW: Trimmed 77348 records to 54176 (keeping 200 days of data) [2025-09-26T18:45:34.359254] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-09-26T18:45:34.461727] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-09-26T18:45:34.462957] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-09-26T18:45:34.463932] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-09-26T18:45:34.464276] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-09-26T18:45:34.468563] [DEBUG] [LOCAL ] EXG: Trimmed 49890 records to 34725 (keeping 200 days of data) [2025-09-26T18:45:34.938568] [DEBUG] [LOCAL ] EXG: Primary data saved (34725 records). [2025-09-26T18:45:34.939783] [INFO ] [MAIN ] EXG: Full history saved. [2025-09-26T18:45:34.940047] [INFO ] [MAIN ] Update Progress: 797/2371 symbols completed. EXG took 27.1s. Estimated remaining: 3h 28m 25s. Rate: 7.6 symbols/min [2025-09-26T18:45:34.955590] [DEBUG] [LOCAL ] EW: Primary data saved (54176 records). [2025-09-26T18:45:34.955774] [INFO ] [MAIN ] EW: Full history saved. [2025-09-26T18:45:34.955941] [INFO ] [MAIN ] Update Progress: 798/2371 symbols completed. EW took 40.7s. Estimated remaining: 3h 28m 1s. Rate: 7.6 symbols/min [2025-09-26T18:45:35.249240] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-26T18:45:35.261374] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-09-26T18:45:35.643074] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-26T18:45:35.956787] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-09-26T18:45:36.667408] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-26T18:45:36.756760] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-09-26T18:45:37.459740] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-26T18:45:37.556734] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-09-26T18:45:38.681199] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-26T18:45:38.693185] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-09-26T18:45:38.743765] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-26T18:45:39.156769] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-09-26T18:45:40.737434] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-26T18:45:40.749812] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-09-26T18:45:40.803751] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-26T18:45:40.814189] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-09-26T18:45:41.789156] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-26T18:45:41.800100] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-09-26T18:45:42.264765] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-26T18:45:42.356765] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-09-26T18:45:43.181925] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-26T18:45:43.190696] [INFO ] [REMOTE ] EXP: Full fetch complete (43052 records). [2025-09-26T18:45:43.190905] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-09-26T18:45:43.597826] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-09-26T18:45:43.597941] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-09-26T18:45:43.598623] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-09-26T18:45:43.598702] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-09-26T18:45:43.600157] [DEBUG] [LOCAL ] EXP: Trimmed 43052 records to 30275 (keeping 200 days of data) [2025-09-26T18:45:43.806596] [DEBUG] [LOCAL ] EXP: Primary data saved (30275 records). [2025-09-26T18:45:43.806768] [INFO ] [MAIN ] EXP: Full history saved. [2025-09-26T18:45:43.806854] [INFO ] [MAIN ] Update Progress: 799/2371 symbols completed. EXP took 20.4s. Estimated remaining: 3h 27m 55s. Rate: 7.6 symbols/min [2025-09-26T18:45:44.268108] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-26T18:45:44.279606] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-09-26T18:45:46.459842] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-26T18:45:46.479183] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-09-26T18:45:48.359301] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-26T18:45:48.371880] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-09-26T18:45:50.507288] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-26T18:45:50.521888] [INFO ] [REMOTE ] EXK: Full fetch complete (76493 records). [2025-09-26T18:45:50.522046] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-09-26T18:45:50.945409] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-09-26T18:45:50.945507] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-09-26T18:45:50.946523] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-09-26T18:45:50.946596] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-09-26T18:45:50.948487] [DEBUG] [LOCAL ] EXK: Trimmed 76493 records to 53904 (keeping 200 days of data) [2025-09-26T18:45:51.289301] [DEBUG] [LOCAL ] EXK: Primary data saved (53904 records). [2025-09-26T18:45:51.289481] [INFO ] [MAIN ] EXK: Full history saved. [2025-09-26T18:45:51.289612] [INFO ] [MAIN ] Update Progress: 800/2371 symbols completed. EXK took 29.5s. Estimated remaining: 3h 27m 46s. Rate: 7.6 symbols/min [2025-09-26T18:45:51.883588] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:45:51.931083] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:45:51.921612] [DEBUG] [LOCAL ] EXPD: No existing data file found in primary storage. [2025-09-26T18:45:51.977895] [WARN ] [MAIN ] EXPD: No existing data found, performing full refresh instead. [2025-09-26T18:45:52.030939] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:45:52.041447] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-09-26T18:45:52.056895] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-09-26T18:45:52.057634] [DEBUG] [LOCAL ] EXPD: No primary data file found to delete. [2025-09-26T18:45:52.057743] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-09-26T18:45:52.067391] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:45:52.414578] [DEBUG] [LOCAL ] FAF: Loaded 42198 existing records from primary storage. [2025-09-26T18:45:52.433305] [INFO ] [MAIN ] FAF: Loaded 42198 existing records. [2025-09-26T18:45:52.559882] [DEBUG] [LOCAL ] EXR: Loaded 45800 existing records from primary storage. [2025-09-26T18:45:52.606240] [INFO ] [MAIN ] EXR: Loaded 45800 existing records. [2025-09-26T18:45:52.647322] [DEBUG] [LOCAL ] F: Loaded 54210 existing records from primary storage. [2025-09-26T18:45:52.665382] [INFO ] [MAIN ] F: Loaded 54210 existing records. [2025-09-26T18:45:52.726254] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:45:52.835532] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2024-12. [2025-09-26T18:45:53.087781] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:45:53.136368] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-09-26T18:45:53.223974] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-09-26T18:45:53.267443] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:45:53.282269] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-09-26T18:45:53.281949] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:45:53.282479] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-09-26T18:45:53.282609] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-09-26T18:45:53.282795] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-09-26T18:45:53.283591] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-09-26T18:45:53.283827] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-09-26T18:45:53.289393] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-09-26T18:45:53.289301] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-09-26T18:45:53.301927] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-09-26T18:45:53.312778] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-09-26T18:45:54.494265] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:45:54.533589] [INFO ] [REMOTE ] EXR: Fetching primary data for 2024-12. [2025-09-26T18:45:54.533203] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:45:54.580008] [INFO ] [REMOTE ] F: Fetching primary data for 2024-12. [2025-09-26T18:45:54.602455] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:45:54.604290] [INFO ] [REMOTE ] FAF: Fetching primary data for 2024-12. [2025-09-26T18:45:54.703558] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-26T18:45:54.713572] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-09-26T18:45:55.848145] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-26T18:45:55.855456] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-09-26T18:45:56.021083] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-26T18:45:56.032090] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-09-26T18:45:56.150258] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-26T18:45:56.159387] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-09-26T18:45:56.974627] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-26T18:45:56.985254] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-09-26T18:45:57.184971] [INFO ] [REMOTE ] F: Incremental fetch complete for 2024-12 (2.60 seconds). [2025-09-26T18:45:57.197048] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-09-26T18:45:57.749755] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-26T18:45:57.761796] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-09-26T18:45:57.950842] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-26T18:45:57.961352] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-09-26T18:45:58.357327] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-26T18:45:58.366287] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-09-26T18:45:59.475161] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-26T18:45:59.485261] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-09-26T18:45:59.588358] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-26T18:45:59.602127] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-09-26T18:45:59.651968] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-09-26T18:45:59.665155] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-09-26T18:45:59.886848] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-26T18:45:59.895601] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-09-26T18:46:01.120378] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-26T18:46:01.130690] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-09-26T18:46:01.428493] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-26T18:46:01.439939] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-09-26T18:46:01.680671] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-26T18:46:01.691811] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-09-26T18:46:02.120041] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-09-26T18:46:02.134906] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-09-26T18:46:02.586965] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-26T18:46:02.597374] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-09-26T18:46:02.794150] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-26T18:46:02.851257] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-26T18:46:03.156824] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-09-26T18:46:03.867172] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-26T18:46:03.956789] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-09-26T18:46:04.258265] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-26T18:46:04.300820] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-26T18:46:04.756742] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-09-26T18:46:05.278289] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-26T18:46:05.556742] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-09-26T18:46:06.356793] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-09-26T18:46:06.903201] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-26T18:46:07.017455] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-26T18:46:07.156736] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-09-26T18:46:07.651270] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-26T18:46:07.956732] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-09-26T18:46:08.756766] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-09-26T18:46:09.298457] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-26T18:46:09.437926] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-26T18:46:09.556723] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-09-26T18:46:10.356745] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-09-26T18:46:10.412942] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-26T18:46:11.156799] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-09-26T18:46:11.238843] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-26T18:46:11.633755] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-26T18:46:11.956800] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-09-26T18:46:12.601664] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-26T18:46:12.611549] [INFO ] [REMOTE ] EXPD: Full fetch complete (69217 records). [2025-09-26T18:46:12.611764] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-09-26T18:46:12.764040] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-09-26T18:46:13.047367] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-09-26T18:46:13.047586] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-09-26T18:46:13.048484] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-09-26T18:46:13.048580] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-09-26T18:46:13.073467] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-26T18:46:13.081598] [DEBUG] [LOCAL ] EXPD: Trimmed 69217 records to 48786 (keeping 200 days of data) [2025-09-26T18:46:13.408912] [DEBUG] [LOCAL ] EXPD: Primary data saved (48786 records). [2025-09-26T18:46:13.409068] [INFO ] [MAIN ] EXPD: Full history saved. [2025-09-26T18:46:13.409161] [INFO ] [MAIN ] Update Progress: 801/2371 symbols completed. EXPD took 22.1s. Estimated remaining: 3h 28m 6s. Rate: 7.5 symbols/min [2025-09-26T18:46:13.565904] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-09-26T18:46:13.594055] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:46:13.646110] [DEBUG] [LOCAL ] FBIN: Loaded 50757 existing records from primary storage. [2025-09-26T18:46:13.646271] [INFO ] [MAIN ] FBIN: Loaded 50757 existing records. [2025-09-26T18:46:13.849732] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:46:13.850040] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-09-26T18:46:13.850097] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-09-26T18:46:13.851528] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-09-26T18:46:13.851592] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-09-26T18:46:14.240516] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:46:14.356779] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2024-12. [2025-09-26T18:46:15.156724] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-09-26T18:46:15.282263] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-09-26T18:46:15.353111] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-26T18:46:15.362551] [INFO ] [REMOTE ] EXR: Full fetch complete (65908 records). [2025-09-26T18:46:15.362766] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-09-26T18:46:15.819800] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-09-26T18:46:15.819943] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-09-26T18:46:15.820915] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-09-26T18:46:15.821067] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-09-26T18:46:15.832521] [DEBUG] [LOCAL ] EXR: Trimmed 65908 records to 46080 (keeping 200 days of data) [2025-09-26T18:46:15.851363] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-26T18:46:15.957701] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-09-26T18:46:16.164832] [DEBUG] [LOCAL ] EXR: Primary data saved (46080 records). [2025-09-26T18:46:16.164984] [INFO ] [MAIN ] EXR: Full history saved. [2025-09-26T18:46:16.167206] [INFO ] [MAIN ] Update Progress: 802/2371 symbols completed. EXR took 24.9s. Estimated remaining: 3h 27m 48s. Rate: 7.6 symbols/min [2025-09-26T18:46:16.348265] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:46:16.378849] [DEBUG] [LOCAL ] FBK: Loaded 25859 existing records from primary storage. [2025-09-26T18:46:16.378990] [INFO ] [MAIN ] FBK: Loaded 25859 existing records. [2025-09-26T18:46:16.581869] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:46:16.582326] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-09-26T18:46:16.582495] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-09-26T18:46:16.583530] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-09-26T18:46:16.583598] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-09-26T18:46:16.739569] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-26T18:46:16.757343] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-09-26T18:46:16.835258] [INFO ] [REMOTE ] FAF: Full fetch complete (57542 records). [2025-09-26T18:46:16.869111] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-09-26T18:46:17.175721] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:46:17.450308] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-09-26T18:46:17.450402] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-09-26T18:46:17.451165] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-09-26T18:46:17.451239] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-09-26T18:46:17.452617] [DEBUG] [LOCAL ] FAF: Trimmed 57542 records to 42474 (keeping 200 days of data) [2025-09-26T18:46:17.556892] [INFO ] [REMOTE ] FBK: Fetching primary data for 2024-12. [2025-09-26T18:46:17.745310] [DEBUG] [LOCAL ] FAF: Primary data saved (42474 records). [2025-09-26T18:46:17.745471] [INFO ] [MAIN ] FAF: Full history saved. [2025-09-26T18:46:17.748593] [INFO ] [MAIN ] Update Progress: 803/2371 symbols completed. FAF took 26.5s. Estimated remaining: 3h 27m 28s. Rate: 7.6 symbols/min [2025-09-26T18:46:17.967362] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:46:18.027179] [DEBUG] [LOCAL ] FBP: Loaded 46592 existing records from primary storage. [2025-09-26T18:46:18.027340] [INFO ] [MAIN ] FBP: Loaded 46592 existing records. [2025-09-26T18:46:18.234185] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:46:18.234486] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-09-26T18:46:18.234549] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-09-26T18:46:18.235853] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-09-26T18:46:18.235919] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-09-26T18:46:18.754212] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.80 seconds). [2025-09-26T18:46:18.771458] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-26T18:46:18.761791] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:46:18.780568] [INFO ] [REMOTE ] FBP: Fetching primary data for 2024-12. [2025-09-26T18:46:18.817932] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-26T18:46:19.156776] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-09-26T18:46:19.956812] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-09-26T18:46:20.321195] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-26T18:46:20.423098] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-26T18:46:20.756792] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-09-26T18:46:21.556730] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-09-26T18:46:21.959915] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-26T18:46:22.052210] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-26T18:46:22.356760] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-09-26T18:46:22.787122] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-26T18:46:23.156731] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-09-26T18:46:23.956783] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-09-26T18:46:24.556037] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-26T18:46:24.599198] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-26T18:46:24.610123] [INFO ] [REMOTE ] F: Full fetch complete (77999 records). [2025-09-26T18:46:24.610285] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-09-26T18:46:24.766240] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-09-26T18:46:24.908699] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-26T18:46:25.066983] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-09-26T18:46:25.067070] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-09-26T18:46:25.068043] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-09-26T18:46:25.068110] [DEBUG] [LOCAL ] F: Saving primary data. [2025-09-26T18:46:25.069685] [DEBUG] [LOCAL ] F: Trimmed 77999 records to 54600 (keeping 200 days of data) [2025-09-26T18:46:25.433799] [DEBUG] [LOCAL ] F: Primary data saved (54600 records). [2025-09-26T18:46:25.433955] [INFO ] [MAIN ] F: Full history saved. [2025-09-26T18:46:25.434073] [INFO ] [MAIN ] Update Progress: 804/2371 symbols completed. F took 34.1s. Estimated remaining: 3h 27m 19s. Rate: 7.6 symbols/min [2025-09-26T18:46:25.561803] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-09-26T18:46:25.621223] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:46:25.656836] [DEBUG] [LOCAL ] FBRT: Loaded 34745 existing records from primary storage. [2025-09-26T18:46:25.657006] [INFO ] [MAIN ] FBRT: Loaded 34745 existing records. [2025-09-26T18:46:25.855457] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:46:25.855763] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-09-26T18:46:25.855820] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-09-26T18:46:25.856788] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-09-26T18:46:25.856855] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-09-26T18:46:26.253830] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:46:26.356740] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-09-26T18:46:26.676029] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-26T18:46:26.699931] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-26T18:46:27.156775] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-09-26T18:46:27.610268] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-26T18:46:27.956759] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-09-26T18:46:28.601141] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-26T18:46:28.756761] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-09-26T18:46:29.274921] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-26T18:46:29.556740] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-09-26T18:46:29.927889] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-26T18:46:30.356773] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-09-26T18:46:31.156781] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2024-12. [2025-09-26T18:46:31.241329] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-26T18:46:31.912187] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-26T18:46:31.956775] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-09-26T18:46:32.026549] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-26T18:46:32.756791] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-09-26T18:46:32.977031] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-26T18:46:33.556742] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-09-26T18:46:34.299511] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-26T18:46:34.356681] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-09-26T18:46:34.749010] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-26T18:46:35.156806] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-09-26T18:46:35.616418] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-26T18:46:35.873962] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-26T18:46:35.956732] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-09-26T18:46:36.756785] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-09-26T18:46:37.561735] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-09-26T18:46:37.585356] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-26T18:46:37.641375] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-26T18:46:38.356800] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-09-26T18:46:38.518089] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-26T18:46:39.156800] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-09-26T18:46:39.457323] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-26T18:46:39.956798] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-09-26T18:46:40.563252] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-26T18:46:40.756766] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-09-26T18:46:41.556724] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-09-26T18:46:41.630119] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-26T18:46:42.356743] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-09-26T18:46:42.398426] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-26T18:46:42.670868] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-26T18:46:43.156754] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-09-26T18:46:43.779581] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-26T18:46:43.788369] [INFO ] [REMOTE ] FBP: Full fetch complete (66339 records). [2025-09-26T18:46:43.788495] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-09-26T18:46:43.961807] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-09-26T18:46:44.224178] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-09-26T18:46:44.224286] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-09-26T18:46:44.225304] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-09-26T18:46:44.225378] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-09-26T18:46:44.227007] [DEBUG] [LOCAL ] FBP: Trimmed 66339 records to 46874 (keeping 200 days of data) [2025-09-26T18:46:44.541075] [DEBUG] [LOCAL ] FBP: Primary data saved (46874 records). [2025-09-26T18:46:44.541277] [INFO ] [MAIN ] FBP: Full history saved. [2025-09-26T18:46:44.541406] [INFO ] [MAIN ] Update Progress: 805/2371 symbols completed. FBP took 26.8s. Estimated remaining: 3h 27m 33s. Rate: 7.5 symbols/min [2025-09-26T18:46:44.752728] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-26T18:46:44.761912] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-09-26T18:46:44.786713] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:46:44.809869] [DEBUG] [LOCAL ] FC: Loaded 15445 existing records from primary storage. [2025-09-26T18:46:44.810042] [INFO ] [MAIN ] FC: Loaded 15445 existing records. [2025-09-26T18:46:45.036299] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:46:45.036566] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-09-26T18:46:45.036616] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-09-26T18:46:45.037217] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-09-26T18:46:45.037281] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-09-26T18:46:45.455068] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:46:45.556722] [INFO ] [REMOTE ] FC: Fetching primary data for 2024-12. [2025-09-26T18:46:45.816614] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-26T18:46:45.827911] [INFO ] [REMOTE ] FBIN: Full fetch complete (72599 records). [2025-09-26T18:46:45.828211] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-09-26T18:46:46.091259] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-26T18:46:46.247665] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-26T18:46:46.324848] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-09-26T18:46:46.325005] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-09-26T18:46:46.325995] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-09-26T18:46:46.326063] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-09-26T18:46:46.327838] [DEBUG] [LOCAL ] FBIN: Trimmed 72599 records to 51061 (keeping 200 days of data) [2025-09-26T18:46:46.386832] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-09-26T18:46:46.665994] [DEBUG] [LOCAL ] FBIN: Primary data saved (51061 records). [2025-09-26T18:46:46.666142] [INFO ] [MAIN ] FBIN: Full history saved. [2025-09-26T18:46:46.666235] [INFO ] [MAIN ] Update Progress: 806/2371 symbols completed. FBIN took 33.3s. Estimated remaining: 3h 27m 14s. Rate: 7.6 symbols/min [2025-09-26T18:46:46.851174] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:46:46.892152] [DEBUG] [LOCAL ] FCF: Loaded 39973 existing records from primary storage. [2025-09-26T18:46:46.892332] [INFO ] [MAIN ] FCF: Loaded 39973 existing records. [2025-09-26T18:46:47.088012] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:46:47.088355] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-09-26T18:46:47.088455] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-09-26T18:46:47.089585] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-09-26T18:46:47.089691] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-09-26T18:46:47.161969] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-09-26T18:46:47.493513] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:46:47.849335] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-26T18:46:47.956800] [INFO ] [REMOTE ] FCF: Fetching primary data for 2024-12. [2025-09-26T18:46:48.043927] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-26T18:46:48.049301] [INFO ] [REMOTE ] FBK: Full fetch complete (33214 records). [2025-09-26T18:46:48.049454] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-09-26T18:46:48.476425] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-09-26T18:46:48.476539] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-09-26T18:46:48.477400] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-09-26T18:46:48.477478] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-09-26T18:46:48.478663] [DEBUG] [LOCAL ] FBK: Trimmed 33214 records to 26066 (keeping 200 days of data) [2025-09-26T18:46:48.647940] [DEBUG] [LOCAL ] FBK: Primary data saved (26066 records). [2025-09-26T18:46:48.648088] [INFO ] [MAIN ] FBK: Full history saved. [2025-09-26T18:46:48.648208] [INFO ] [MAIN ] Update Progress: 807/2371 symbols completed. FBK took 32.5s. Estimated remaining: 3h 26m 54s. Rate: 7.6 symbols/min [2025-09-26T18:46:48.761009] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-09-26T18:46:48.841551] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:46:48.871821] [DEBUG] [LOCAL ] FCN: Loaded 26414 existing records from primary storage. [2025-09-26T18:46:48.872003] [INFO ] [MAIN ] FCN: Loaded 26414 existing records. [2025-09-26T18:46:49.081857] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:46:49.082506] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-09-26T18:46:49.082730] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-09-26T18:46:49.083529] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-09-26T18:46:49.083610] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-09-26T18:46:49.390421] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-26T18:46:49.532830] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:46:49.556740] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-09-26T18:46:50.052531] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-26T18:46:50.356744] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-09-26T18:46:51.156728] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-09-26T18:46:51.529718] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-26T18:46:51.629880] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-26T18:46:51.816604] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-26T18:46:51.956775] [INFO ] [REMOTE ] FCN: Fetching primary data for 2024-12. [2025-09-26T18:46:52.756763] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-09-26T18:46:53.195816] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-26T18:46:53.556767] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-09-26T18:46:53.949764] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-26T18:46:53.956906] [INFO ] [REMOTE ] FBRT: Full fetch complete (48543 records). [2025-09-26T18:46:53.957069] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-09-26T18:46:54.357934] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-09-26T18:46:54.365147] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-26T18:46:54.421834] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-09-26T18:46:54.421949] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-09-26T18:46:54.422848] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-09-26T18:46:54.422914] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-09-26T18:46:54.424752] [DEBUG] [LOCAL ] FBRT: Trimmed 48543 records to 34985 (keeping 200 days of data) [2025-09-26T18:46:54.655231] [DEBUG] [LOCAL ] FBRT: Primary data saved (34985 records). [2025-09-26T18:46:54.655455] [INFO ] [MAIN ] FBRT: Full history saved. [2025-09-26T18:46:54.655605] [INFO ] [MAIN ] Update Progress: 808/2371 symbols completed. FBRT took 29.2s. Estimated remaining: 3h 26m 43s. Rate: 7.6 symbols/min [2025-09-26T18:46:54.830511] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:46:54.870252] [DEBUG] [LOCAL ] FCPT: Loaded 37647 existing records from primary storage. [2025-09-26T18:46:54.870488] [INFO ] [MAIN ] FCPT: Loaded 37647 existing records. [2025-09-26T18:46:55.058299] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:46:55.058662] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-09-26T18:46:55.058730] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-09-26T18:46:55.059915] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-09-26T18:46:55.059981] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-09-26T18:46:55.161935] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-09-26T18:46:55.448969] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:46:55.864860] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-26T18:46:55.887013] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-26T18:46:55.956761] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-09-26T18:46:56.756754] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-09-26T18:46:57.288232] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-26T18:46:57.556783] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-09-26T18:46:58.196395] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-26T18:46:58.356737] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-09-26T18:46:58.379286] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-26T18:46:59.156793] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-09-26T18:46:59.956778] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-09-26T18:47:00.011568] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-26T18:47:00.059544] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-26T18:47:00.756839] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-09-26T18:47:00.811697] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-26T18:47:01.556764] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-09-26T18:47:01.841704] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-26T18:47:02.332473] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-26T18:47:02.356737] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-09-26T18:47:03.156748] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2024-12. [2025-09-26T18:47:03.440162] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-26T18:47:03.956783] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-09-26T18:47:04.353265] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-26T18:47:04.589435] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-26T18:47:04.756768] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-09-26T18:47:05.556792] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-09-26T18:47:05.771427] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-26T18:47:05.775285] [INFO ] [REMOTE ] FC: Full fetch complete (21645 records). [2025-09-26T18:47:05.775458] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-09-26T18:47:06.182577] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-09-26T18:47:06.182684] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-09-26T18:47:06.183162] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-09-26T18:47:06.183204] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-09-26T18:47:06.183891] [DEBUG] [LOCAL ] FC: Trimmed 21645 records to 15634 (keeping 200 days of data) [2025-09-26T18:47:06.279488] [DEBUG] [LOCAL ] FC: Primary data saved (15634 records). [2025-09-26T18:47:06.279668] [INFO ] [MAIN ] FC: Full history saved. [2025-09-26T18:47:06.279832] [INFO ] [MAIN ] Update Progress: 809/2371 symbols completed. FC took 21.7s. Estimated remaining: 3h 26m 42s. Rate: 7.6 symbols/min [2025-09-26T18:47:06.366066] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-09-26T18:47:06.473103] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:47:06.473325] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-09-26T18:47:06.473382] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-09-26T18:47:06.473575] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-09-26T18:47:06.473663] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-26T18:47:06.473750] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-26T18:47:06.473800] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-09-26T18:47:06.929342] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-26T18:47:06.927932] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:47:07.156715] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-09-26T18:47:07.568242] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-26T18:47:07.956749] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-09-26T18:47:08.135966] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-26T18:47:08.756784] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-09-26T18:47:08.975431] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-26T18:47:09.556741] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-09-26T18:47:09.789693] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-26T18:47:10.356701] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-12. [2025-09-26T18:47:10.447313] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-26T18:47:10.609920] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-12 (0.25 seconds). [2025-09-26T18:47:11.156775] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-09-26T18:47:11.597681] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-26T18:47:11.956768] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-09-26T18:47:12.756740] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-09-26T18:47:13.407635] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-26T18:47:13.556757] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-09-26T18:47:14.359988] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-09-26T18:47:14.365975] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-26T18:47:15.041039] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-26T18:47:15.074533] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T18:47:15.156728] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-09-26T18:47:15.956775] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-09-26T18:47:16.678098] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-26T18:47:16.756764] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-09-26T18:47:16.872722] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-26T18:47:17.556743] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-09-26T18:47:17.829753] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-09-26T18:47:17.859935] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-26T18:47:18.356787] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-09-26T18:47:19.156765] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-09-26T18:47:19.510744] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-26T18:47:19.956754] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-09-26T18:47:20.009842] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-26T18:47:20.756771] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-09-26T18:47:21.422432] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-26T18:47:21.521366] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-26T18:47:21.529209] [INFO ] [REMOTE ] FCF: Full fetch complete (58117 records). [2025-09-26T18:47:21.529388] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-09-26T18:47:21.561979] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-09-26T18:47:21.955474] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-09-26T18:47:21.955592] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-09-26T18:47:21.956414] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-09-26T18:47:21.956491] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-09-26T18:47:21.957926] [DEBUG] [LOCAL ] FCF: Trimmed 58117 records to 40237 (keeping 200 days of data) [2025-09-26T18:47:22.049936] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-26T18:47:22.219852] [DEBUG] [LOCAL ] FCF: Primary data saved (40237 records). [2025-09-26T18:47:22.219990] [INFO ] [MAIN ] FCF: Full history saved. [2025-09-26T18:47:22.220100] [INFO ] [MAIN ] Update Progress: 810/2371 symbols completed. FCF took 35.6s. Estimated remaining: 3h 26m 49s. Rate: 7.5 symbols/min [2025-09-26T18:47:22.361825] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-09-26T18:47:22.427557] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:47:22.444420] [DEBUG] [LOCAL ] FCT: Loaded 14502 existing records from primary storage. [2025-09-26T18:47:22.444620] [INFO ] [MAIN ] FCT: Loaded 14502 existing records. [2025-09-26T18:47:22.660067] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:47:22.660535] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-09-26T18:47:22.660604] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-09-26T18:47:22.661235] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-09-26T18:47:22.661303] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-09-26T18:47:23.038808] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:47:23.156767] [INFO ] [REMOTE ] FCT: Fetching primary data for 2024-12. [2025-09-26T18:47:23.500446] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-26T18:47:23.817599] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-26T18:47:23.956802] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-09-26T18:47:24.756765] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-09-26T18:47:25.165376] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-26T18:47:25.187852] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-26T18:47:25.556724] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-09-26T18:47:25.910743] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-26T18:47:26.356731] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-09-26T18:47:27.156772] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-09-26T18:47:27.603979] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-26T18:47:27.609390] [INFO ] [REMOTE ] FCN: Full fetch complete (35699 records). [2025-09-26T18:47:27.609568] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-09-26T18:47:27.972675] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-09-26T18:47:28.025765] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-09-26T18:47:28.025855] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-09-26T18:47:28.026477] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-09-26T18:47:28.026541] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-09-26T18:47:28.027689] [DEBUG] [LOCAL ] FCN: Trimmed 35699 records to 26559 (keeping 200 days of data) [2025-09-26T18:47:28.196407] [DEBUG] [LOCAL ] FCN: Primary data saved (26559 records). [2025-09-26T18:47:28.196562] [INFO ] [MAIN ] FCN: Full history saved. [2025-09-26T18:47:28.196687] [INFO ] [MAIN ] Update Progress: 811/2371 symbols completed. FCN took 39.5s. Estimated remaining: 3h 26m 38s. Rate: 7.5 symbols/min [2025-09-26T18:47:28.385268] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:47:28.420535] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-26T18:47:28.465344] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-26T18:47:28.466915] [INFO ] [REMOTE ] FCRX: Full fetch complete (1674 records). [2025-09-26T18:47:28.467138] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-09-26T18:47:28.615098] [DEBUG] [LOCAL ] FCX: Loaded 54090 existing records from primary storage. [2025-09-26T18:47:28.638604] [INFO ] [MAIN ] FCX: Loaded 54090 existing records. [2025-09-26T18:47:28.759781] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-09-26T18:47:28.862160] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-26T18:47:28.879198] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:47:28.889806] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:47:28.926691] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-26T18:47:28.928083] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-26T18:47:28.928207] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-09-26T18:47:28.929015] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-09-26T18:47:28.929928] [INFO ] [MAIN ] Update Progress: 812/2371 symbols completed. FCRX took 22.6s. Estimated remaining: 3h 26m 16s. Rate: 7.6 symbols/min [2025-09-26T18:47:28.953139] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:47:28.995682] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-09-26T18:47:29.034754] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-09-26T18:47:29.068683] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-09-26T18:47:29.083536] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-09-26T18:47:29.282090] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:47:29.569416] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-09-26T18:47:29.576738] [DEBUG] [LOCAL ] FDP: Loaded 30588 existing records from primary storage. [2025-09-26T18:47:29.614241] [INFO ] [MAIN ] FDP: Loaded 30588 existing records. [2025-09-26T18:47:29.628076] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:47:29.826579] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-26T18:47:29.860809] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:47:29.861078] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-09-26T18:47:29.861131] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-09-26T18:47:29.862066] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-09-26T18:47:29.862131] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-09-26T18:47:30.277134] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:47:30.356737] [INFO ] [REMOTE ] FDP: Fetching primary data for 2024-12. [2025-09-26T18:47:30.744896] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-26T18:47:31.156710] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-09-26T18:47:31.237385] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-26T18:47:31.956775] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-09-26T18:47:32.438072] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-26T18:47:32.447715] [INFO ] [REMOTE ] FCPT: Full fetch complete (53409 records). [2025-09-26T18:47:32.447891] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-09-26T18:47:32.758540] [INFO ] [REMOTE ] FCX: Fetching primary data for 2024-12. [2025-09-26T18:47:32.850866] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-26T18:47:32.960935] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-09-26T18:47:32.961042] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-09-26T18:47:32.961837] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-09-26T18:47:32.961911] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-09-26T18:47:32.963366] [DEBUG] [LOCAL ] FCPT: Trimmed 53409 records to 37955 (keeping 200 days of data) [2025-09-26T18:47:33.203993] [DEBUG] [LOCAL ] FCPT: Primary data saved (37955 records). [2025-09-26T18:47:33.204159] [INFO ] [MAIN ] FCPT: Full history saved. [2025-09-26T18:47:33.204257] [INFO ] [MAIN ] Update Progress: 813/2371 symbols completed. FCPT took 38.5s. Estimated remaining: 3h 26m 1s. Rate: 7.6 symbols/min [2025-09-26T18:47:33.397163] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:47:33.427846] [DEBUG] [LOCAL ] FDS: Loaded 26520 existing records from primary storage. [2025-09-26T18:47:33.428039] [INFO ] [MAIN ] FDS: Loaded 26520 existing records. [2025-09-26T18:47:33.561891] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-09-26T18:47:33.663597] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:47:33.664094] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-09-26T18:47:33.664176] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-09-26T18:47:33.665599] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-09-26T18:47:33.665719] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-09-26T18:47:34.039538] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:47:34.356785] [INFO ] [REMOTE ] FDS: Fetching primary data for 2024-12. [2025-09-26T18:47:34.741121] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-26T18:47:34.784463] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-26T18:47:35.156735] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-09-26T18:47:35.271395] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-26T18:47:35.956748] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-09-26T18:47:36.127779] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-26T18:47:36.756780] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-09-26T18:47:36.978987] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-26T18:47:37.425852] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-26T18:47:37.556746] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-09-26T18:47:38.356728] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-09-26T18:47:38.635795] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-26T18:47:39.156720] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-09-26T18:47:39.263786] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-26T18:47:39.956756] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-09-26T18:47:40.617016] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-26T18:47:40.756748] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-09-26T18:47:40.835353] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-26T18:47:41.465023] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-26T18:47:41.556718] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-09-26T18:47:42.356726] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-09-26T18:47:42.501716] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-26T18:47:43.156725] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-09-26T18:47:43.931401] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-26T18:47:43.956702] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-09-26T18:47:44.168286] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-26T18:47:44.756734] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-09-26T18:47:45.005808] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-26T18:47:45.009767] [INFO ] [REMOTE ] FCT: Full fetch complete (21141 records). [2025-09-26T18:47:45.009855] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-09-26T18:47:45.458810] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-09-26T18:47:45.459052] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-09-26T18:47:45.459630] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-09-26T18:47:45.459722] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-09-26T18:47:45.460546] [DEBUG] [LOCAL ] FCT: Trimmed 21141 records to 14613 (keeping 200 days of data) [2025-09-26T18:47:45.557073] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-09-26T18:47:45.561462] [DEBUG] [LOCAL ] FCT: Primary data saved (14613 records). [2025-09-26T18:47:45.562296] [INFO ] [MAIN ] FCT: Full history saved. [2025-09-26T18:47:45.562394] [INFO ] [MAIN ] Update Progress: 814/2371 symbols completed. FCT took 23.3s. Estimated remaining: 3h 26m 1s. Rate: 7.6 symbols/min [2025-09-26T18:47:45.755815] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:47:45.816096] [DEBUG] [LOCAL ] FDX: Loaded 51985 existing records from primary storage. [2025-09-26T18:47:45.816249] [INFO ] [MAIN ] FDX: Loaded 51985 existing records. [2025-09-26T18:47:46.009399] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:47:46.009850] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-09-26T18:47:46.009922] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-09-26T18:47:46.011453] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-09-26T18:47:46.011517] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-09-26T18:47:46.309139] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T18:47:46.361766] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-09-26T18:47:46.431276] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:47:47.156730] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-09-26T18:47:47.824415] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-26T18:47:47.855264] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-26T18:47:47.956738] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-09-26T18:47:48.091575] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-26T18:47:48.756723] [INFO ] [REMOTE ] FDX: Fetching primary data for 2024-12. [2025-09-26T18:47:49.556724] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-09-26T18:47:50.010162] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-26T18:47:50.359981] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-09-26T18:47:50.365844] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-26T18:47:50.520027] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-26T18:47:51.156728] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-09-26T18:47:51.249690] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-26T18:47:51.956724] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-09-26T18:47:52.657412] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-26T18:47:52.751392] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-26T18:47:52.756830] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-09-26T18:47:53.556727] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-09-26T18:47:53.910342] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-26T18:47:54.356887] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-09-26T18:47:55.164447] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-09-26T18:47:55.172866] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-26T18:47:55.531329] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-26T18:47:55.956747] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-09-26T18:47:56.492158] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-26T18:47:56.756733] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-09-26T18:47:57.297111] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-26T18:47:57.556722] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-09-26T18:47:58.072264] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-26T18:47:58.356714] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-09-26T18:47:59.022003] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-26T18:47:59.029929] [INFO ] [REMOTE ] FDS: Full fetch complete (37229 records). [2025-09-26T18:47:59.030076] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-09-26T18:47:59.161786] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-09-26T18:47:59.455375] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-09-26T18:47:59.455573] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-09-26T18:47:59.456350] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-09-26T18:47:59.456472] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-09-26T18:47:59.479185] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-26T18:47:59.479414] [DEBUG] [LOCAL ] FDS: Trimmed 37229 records to 26759 (keeping 200 days of data) [2025-09-26T18:47:59.679214] [DEBUG] [LOCAL ] FDS: Primary data saved (26759 records). [2025-09-26T18:47:59.679391] [INFO ] [MAIN ] FDS: Full history saved. [2025-09-26T18:47:59.679688] [INFO ] [MAIN ] Update Progress: 815/2371 symbols completed. FDS took 26.5s. Estimated remaining: 3h 26m 5s. Rate: 7.6 symbols/min [2025-09-26T18:47:59.864113] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:47:59.920912] [DEBUG] [LOCAL ] FE: Loaded 53818 existing records from primary storage. [2025-09-26T18:47:59.921113] [INFO ] [MAIN ] FE: Loaded 53818 existing records. [2025-09-26T18:47:59.965494] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-09-26T18:48:00.117928] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:48:00.118216] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-09-26T18:48:00.118268] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-09-26T18:48:00.119797] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-09-26T18:48:00.119871] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-09-26T18:48:00.502552] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:48:00.756719] [INFO ] [REMOTE ] FE: Fetching primary data for 2024-12. [2025-09-26T18:48:01.235567] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-26T18:48:01.556735] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-09-26T18:48:01.696401] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-26T18:48:01.702800] [INFO ] [REMOTE ] FDP: Full fetch complete (42751 records). [2025-09-26T18:48:01.702968] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-09-26T18:48:02.107060] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-09-26T18:48:02.107187] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-09-26T18:48:02.108157] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-09-26T18:48:02.108246] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-09-26T18:48:02.109492] [DEBUG] [LOCAL ] FDP: Trimmed 42751 records to 30760 (keeping 200 days of data) [2025-09-26T18:48:02.304812] [DEBUG] [LOCAL ] FDP: Primary data saved (30760 records). [2025-09-26T18:48:02.304967] [INFO ] [MAIN ] FDP: Full history saved. [2025-09-26T18:48:02.305099] [INFO ] [MAIN ] Update Progress: 816/2371 symbols completed. FDP took 33.4s. Estimated remaining: 3h 25m 47s. Rate: 7.6 symbols/min [2025-09-26T18:48:02.361852] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-09-26T18:48:02.492464] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:48:02.492747] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-09-26T18:48:02.492810] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-09-26T18:48:02.492989] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-09-26T18:48:02.493032] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-26T18:48:02.493074] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-26T18:48:02.493106] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-09-26T18:48:02.843778] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-26T18:48:02.930207] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:48:03.156689] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-09-26T18:48:03.291622] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-26T18:48:03.956742] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-09-26T18:48:04.090629] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-26T18:48:04.575835] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-26T18:48:04.756796] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-09-26T18:48:05.556773] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-09-26T18:48:05.632701] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-26T18:48:06.356720] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-09-26T18:48:06.725748] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-26T18:48:07.156708] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-12. [2025-09-26T18:48:07.508066] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-26T18:48:07.570283] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-26T18:48:07.867299] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-26T18:48:07.956786] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-09-26T18:48:08.756783] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-09-26T18:48:09.191551] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-26T18:48:09.556721] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-09-26T18:48:09.718379] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-26T18:48:10.356737] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-09-26T18:48:11.156711] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-09-26T18:48:11.572536] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-26T18:48:11.769495] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-26T18:48:11.956727] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-09-26T18:48:12.617195] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-26T18:48:12.756773] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-09-26T18:48:13.055557] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-09-26T18:48:13.476574] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T18:48:13.556741] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-09-26T18:48:14.356743] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-09-26T18:48:14.844298] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-26T18:48:15.156761] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-09-26T18:48:15.248383] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-26T18:48:15.464434] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-26T18:48:15.956747] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-09-26T18:48:16.490300] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-26T18:48:16.756786] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-09-26T18:48:17.556772] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-09-26T18:48:18.356702] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-09-26T18:48:18.558078] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-26T18:48:19.156727] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-09-26T18:48:19.474575] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-26T18:48:19.478474] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-26T18:48:19.956735] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-09-26T18:48:20.330849] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-26T18:48:20.379946] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-26T18:48:20.756745] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-09-26T18:48:21.556725] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-09-26T18:48:22.356750] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-09-26T18:48:22.952306] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-26T18:48:22.965162] [INFO ] [REMOTE ] FCX: Full fetch complete (77740 records). [2025-09-26T18:48:22.965343] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-09-26T18:48:23.161857] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-09-26T18:48:23.473376] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-09-26T18:48:23.473508] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-09-26T18:48:23.474668] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-09-26T18:48:23.474828] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-09-26T18:48:23.493308] [DEBUG] [LOCAL ] FCX: Trimmed 77740 records to 54480 (keeping 200 days of data) [2025-09-26T18:48:23.512240] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-26T18:48:23.758261] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-26T18:48:23.760158] [INFO ] [REMOTE ] FENG: Full fetch complete (2245 records). [2025-09-26T18:48:23.760814] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-09-26T18:48:23.966343] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-09-26T18:48:23.973927] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-26T18:48:23.976077] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:48:23.977030] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:48:23.977498] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-26T18:48:23.977868] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-26T18:48:23.978501] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-09-26T18:48:23.979690] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-09-26T18:48:23.981010] [INFO ] [MAIN ] Update Progress: 817/2371 symbols completed. FENG took 21.7s. Estimated remaining: 3h 26m 5s. Rate: 7.5 symbols/min [2025-09-26T18:48:24.183272] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:48:24.311695] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-26T18:48:24.337820] [INFO ] [REMOTE ] FDX: Full fetch complete (74426 records). [2025-09-26T18:48:24.338723] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-09-26T18:48:24.400028] [DEBUG] [LOCAL ] FCX: Primary data saved (54480 records). [2025-09-26T18:48:24.445550] [INFO ] [MAIN ] FCX: Full history saved. [2025-09-26T18:48:24.465807] [DEBUG] [LOCAL ] FERG: Loaded 49361 existing records from primary storage. [2025-09-26T18:48:24.466068] [INFO ] [MAIN ] Update Progress: 818/2371 symbols completed. FCX took 56.3s. Estimated remaining: 3h 25m 43s. Rate: 7.5 symbols/min [2025-09-26T18:48:24.483237] [INFO ] [MAIN ] FERG: Loaded 49361 existing records. [2025-09-26T18:48:25.117060] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:48:25.134994] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-09-26T18:48:25.151287] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-09-26T18:48:25.202754] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:48:25.232981] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-09-26T18:48:25.259193] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-09-26T18:48:25.259665] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-09-26T18:48:25.265172] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-09-26T18:48:25.279132] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-09-26T18:48:25.282845] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-09-26T18:48:25.358737] [DEBUG] [LOCAL ] FET: Loaded 12838 existing records from primary storage. [2025-09-26T18:48:25.389793] [INFO ] [MAIN ] FET: Loaded 12838 existing records. [2025-09-26T18:48:25.400736] [DEBUG] [LOCAL ] FDX: Trimmed 74426 records to 52362 (keeping 200 days of data) [2025-09-26T18:48:25.946323] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:48:26.019454] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-09-26T18:48:26.022877] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-09-26T18:48:26.045955] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:48:26.046258] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-09-26T18:48:26.047549] [INFO ] [REMOTE ] FERG: Fetching primary data for 2024-12. [2025-09-26T18:48:26.048324] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-09-26T18:48:26.069787] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-26T18:48:26.165695] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-09-26T18:48:26.616385] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:48:26.617621] [INFO ] [REMOTE ] FET: Fetching primary data for 2024-12. [2025-09-26T18:48:26.730991] [DEBUG] [LOCAL ] FDX: Primary data saved (52362 records). [2025-09-26T18:48:26.731162] [INFO ] [MAIN ] FDX: Full history saved. [2025-09-26T18:48:26.731255] [INFO ] [MAIN ] Update Progress: 819/2371 symbols completed. FDX took 41.2s. Estimated remaining: 3h 25m 24s. Rate: 7.6 symbols/min [2025-09-26T18:48:26.924420] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:48:26.953468] [DEBUG] [LOCAL ] FF: Loaded 25640 existing records from primary storage. [2025-09-26T18:48:26.953675] [INFO ] [MAIN ] FF: Loaded 25640 existing records. [2025-09-26T18:48:27.152146] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:48:27.152420] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-09-26T18:48:27.152468] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-09-26T18:48:27.153318] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-09-26T18:48:27.153379] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-09-26T18:48:27.596053] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-26T18:48:27.595389] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:48:27.600017] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-09-26T18:48:27.715792] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-26T18:48:27.956700] [INFO ] [REMOTE ] FF: Fetching primary data for 2024-12. [2025-09-26T18:48:28.071566] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-26T18:48:28.082419] [INFO ] [REMOTE ] FE: Full fetch complete (77227 records). [2025-09-26T18:48:28.082616] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-09-26T18:48:28.545709] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-09-26T18:48:28.545582] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-26T18:48:28.545848] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-09-26T18:48:28.549961] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-09-26T18:48:28.550384] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-09-26T18:48:28.551871] [DEBUG] [LOCAL ] FE: Trimmed 77227 records to 54208 (keeping 200 days of data) [2025-09-26T18:48:28.775423] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-09-26T18:48:28.902344] [DEBUG] [LOCAL ] FE: Primary data saved (54208 records). [2025-09-26T18:48:28.902510] [INFO ] [MAIN ] FE: Full history saved. [2025-09-26T18:48:28.902603] [INFO ] [MAIN ] Update Progress: 820/2371 symbols completed. FE took 29.2s. Estimated remaining: 3h 25m 6s. Rate: 7.6 symbols/min [2025-09-26T18:48:29.104544] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:48:29.122289] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-26T18:48:29.134536] [DEBUG] [LOCAL ] FFA: Loaded 5730 existing records from primary storage. [2025-09-26T18:48:29.134630] [INFO ] [MAIN ] FFA: Loaded 5730 existing records. [2025-09-26T18:48:29.335554] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:48:29.335968] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-09-26T18:48:29.336044] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-09-26T18:48:29.336589] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-09-26T18:48:29.336704] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-09-26T18:48:29.561876] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-09-26T18:48:29.771807] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:48:30.279526] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-26T18:48:30.356724] [INFO ] [REMOTE ] FFA: Fetching primary data for 2024-12. [2025-09-26T18:48:30.952530] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-26T18:48:31.156757] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-09-26T18:48:31.273347] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-26T18:48:31.956744] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-09-26T18:48:32.756761] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-09-26T18:48:32.795877] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-26T18:48:32.796200] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-26T18:48:33.556714] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-09-26T18:48:33.947969] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-26T18:48:34.356732] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-09-26T18:48:35.077290] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-26T18:48:35.156741] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-09-26T18:48:35.330612] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-26T18:48:35.956750] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-09-26T18:48:36.100757] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-26T18:48:36.516756] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-26T18:48:36.756740] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-09-26T18:48:37.410773] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-26T18:48:37.556751] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-09-26T18:48:38.353694] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-26T18:48:38.356668] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-09-26T18:48:39.156765] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-09-26T18:48:39.186384] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-26T18:48:39.956730] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-09-26T18:48:40.476174] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-26T18:48:40.756729] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-09-26T18:48:41.502336] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-26T18:48:41.507711] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-26T18:48:41.556736] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-09-26T18:48:42.356695] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-09-26T18:48:42.586317] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-26T18:48:42.742347] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-26T18:48:43.156734] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-09-26T18:48:43.818907] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-26T18:48:43.956732] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-09-26T18:48:44.756759] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-09-26T18:48:45.015620] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-26T18:48:45.019502] [INFO ] [REMOTE ] FET: Full fetch complete (18305 records). [2025-09-26T18:48:45.019606] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-09-26T18:48:45.488376] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-09-26T18:48:45.488506] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-09-26T18:48:45.489103] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-09-26T18:48:45.489170] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-09-26T18:48:45.489960] [DEBUG] [LOCAL ] FET: Trimmed 18305 records to 12984 (keeping 200 days of data) [2025-09-26T18:48:45.557131] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-09-26T18:48:45.560288] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-26T18:48:45.589906] [DEBUG] [LOCAL ] FET: Primary data saved (12984 records). [2025-09-26T18:48:45.590078] [INFO ] [MAIN ] FET: Full history saved. [2025-09-26T18:48:45.590180] [INFO ] [MAIN ] Update Progress: 821/2371 symbols completed. FET took 21.1s. Estimated remaining: 3h 25m 14s. Rate: 7.6 symbols/min [2025-09-26T18:48:45.789428] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:48:45.814059] [DEBUG] [LOCAL ] FFC: Loaded 16760 existing records from primary storage. [2025-09-26T18:48:45.814230] [INFO ] [MAIN ] FFC: Loaded 16760 existing records. [2025-09-26T18:48:46.019806] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:48:46.020075] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-09-26T18:48:46.020125] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-09-26T18:48:46.020839] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-09-26T18:48:46.020915] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-09-26T18:48:46.364672] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-09-26T18:48:46.411837] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:48:47.156706] [INFO ] [REMOTE ] FFC: Fetching primary data for 2024-12. [2025-09-26T18:48:47.294179] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-26T18:48:47.333293] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-26T18:48:47.826077] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-26T18:48:47.956910] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-09-26T18:48:48.756731] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-09-26T18:48:49.394593] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-26T18:48:49.556738] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-09-26T18:48:50.238186] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-26T18:48:50.321514] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-26T18:48:50.356690] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-09-26T18:48:51.156727] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-09-26T18:48:51.509395] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-26T18:48:51.565595] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-26T18:48:51.956736] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-09-26T18:48:52.506041] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-26T18:48:52.756720] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-09-26T18:48:53.556712] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-09-26T18:48:53.887794] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-26T18:48:53.892319] [INFO ] [REMOTE ] FF: Full fetch complete (37010 records). [2025-09-26T18:48:53.892430] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-09-26T18:48:54.281747] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-09-26T18:48:54.281841] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-09-26T18:48:54.282469] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-09-26T18:48:54.282515] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-09-26T18:48:54.283539] [DEBUG] [LOCAL ] FF: Trimmed 37010 records to 25768 (keeping 200 days of data) [2025-09-26T18:48:54.371833] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-09-26T18:48:54.443936] [DEBUG] [LOCAL ] FF: Primary data saved (25768 records). [2025-09-26T18:48:54.444092] [INFO ] [MAIN ] FF: Full history saved. [2025-09-26T18:48:54.444212] [INFO ] [MAIN ] Update Progress: 822/2371 symbols completed. FF took 27.7s. Estimated remaining: 3h 25m 8s. Rate: 7.6 symbols/min [2025-09-26T18:48:54.621567] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:48:54.655987] [DEBUG] [LOCAL ] FFWM: Loaded 36348 existing records from primary storage. [2025-09-26T18:48:54.656133] [INFO ] [MAIN ] FFWM: Loaded 36348 existing records. [2025-09-26T18:48:54.845786] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:48:54.846062] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-09-26T18:48:54.846111] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-09-26T18:48:54.847362] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-09-26T18:48:54.847426] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-09-26T18:48:55.180909] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-09-26T18:48:55.238064] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:48:55.251227] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-26T18:48:55.301259] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-26T18:48:55.851023] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-26T18:48:55.956745] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-09-26T18:48:56.756758] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-09-26T18:48:57.360253] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-26T18:48:57.551737] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-26T18:48:57.561050] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-12. [2025-09-26T18:48:57.669055] [DEBUG] [REMOTE ] FFWM: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-09-26T18:48:57.669475] [WARN ] [REMOTE ] FFWM: No data returned for month 2024-12 [2025-09-26T18:48:58.356719] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-09-26T18:48:59.156727] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-09-26T18:48:59.198283] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-26T18:48:59.200053] [INFO ] [REMOTE ] FFA: Full fetch complete (8305 records). [2025-09-26T18:48:59.200124] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-09-26T18:48:59.587230] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-09-26T18:48:59.587319] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-09-26T18:48:59.587552] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-09-26T18:48:59.587596] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-09-26T18:48:59.588064] [DEBUG] [LOCAL ] FFA: Trimmed 8305 records to 5800 (keeping 200 days of data) [2025-09-26T18:48:59.624758] [DEBUG] [LOCAL ] FFA: Primary data saved (5800 records). [2025-09-26T18:48:59.624901] [INFO ] [MAIN ] FFA: Full history saved. [2025-09-26T18:48:59.625000] [INFO ] [MAIN ] Update Progress: 823/2371 symbols completed. FFA took 30.7s. Estimated remaining: 3h 24m 55s. Rate: 7.6 symbols/min [2025-09-26T18:48:59.818447] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:48:59.841301] [DEBUG] [LOCAL ] FG: Loaded 22680 existing records from primary storage. [2025-09-26T18:48:59.841451] [INFO ] [MAIN ] FG: Loaded 22680 existing records. [2025-09-26T18:48:59.960335] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-09-26T18:49:00.053789] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:49:00.055315] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-09-26T18:49:00.055118] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-26T18:49:00.055559] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-09-26T18:49:00.060976] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-09-26T18:49:00.061048] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-09-26T18:49:00.436164] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:49:00.756746] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-09-26T18:49:01.556729] [INFO ] [REMOTE ] FG: Fetching primary data for 2024-12. [2025-09-26T18:49:01.721848] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-26T18:49:01.895126] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-26T18:49:01.905615] [INFO ] [REMOTE ] FERG: Full fetch complete (71013 records). [2025-09-26T18:49:01.905844] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-09-26T18:49:02.239362] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-26T18:49:02.356208] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-09-26T18:49:02.356312] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-09-26T18:49:02.357277] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-09-26T18:49:02.357391] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-09-26T18:49:02.359085] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-09-26T18:49:02.360927] [DEBUG] [LOCAL ] FERG: Trimmed 71013 records to 49691 (keeping 200 days of data) [2025-09-26T18:49:02.723939] [DEBUG] [LOCAL ] FERG: Primary data saved (49691 records). [2025-09-26T18:49:02.724084] [INFO ] [MAIN ] FERG: Full history saved. [2025-09-26T18:49:02.724197] [INFO ] [MAIN ] Update Progress: 824/2371 symbols completed. FERG took 38.7s. Estimated remaining: 3h 24m 38s. Rate: 7.6 symbols/min [2025-09-26T18:49:02.926506] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:49:02.935709] [DEBUG] [LOCAL ] FGN: Loaded 3905 existing records from primary storage. [2025-09-26T18:49:02.935920] [INFO ] [MAIN ] FGN: Loaded 3905 existing records. [2025-09-26T18:49:03.129460] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:49:03.129802] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-09-26T18:49:03.129874] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-09-26T18:49:03.130279] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-09-26T18:49:03.130339] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-09-26T18:49:03.161861] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-09-26T18:49:03.268090] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-26T18:49:03.539350] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:49:03.956723] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-09-26T18:49:04.315556] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-26T18:49:04.756789] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-09-26T18:49:04.973631] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-26T18:49:05.389481] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-26T18:49:05.556730] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-09-26T18:49:06.356700] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-09-26T18:49:06.658911] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-26T18:49:07.034137] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-26T18:49:07.156748] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-09-26T18:49:07.956708] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-09-26T18:49:08.230686] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-26T18:49:08.756743] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-09-26T18:49:09.261676] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-26T18:49:09.556751] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-09-26T18:49:10.124297] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-26T18:49:10.356771] [INFO ] [REMOTE ] FGN: Fetching primary data for 2024-12. [2025-09-26T18:49:10.956827] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-26T18:49:11.110515] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-26T18:49:11.156722] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-09-26T18:49:11.956779] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-09-26T18:49:12.738314] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-26T18:49:12.756682] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-09-26T18:49:12.789027] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-26T18:49:13.345506] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-26T18:49:13.556734] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-09-26T18:49:14.356728] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-09-26T18:49:14.932746] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-26T18:49:15.156709] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-09-26T18:49:15.249370] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-26T18:49:15.479045] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-26T18:49:15.956729] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-09-26T18:49:16.756738] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-09-26T18:49:17.353350] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-26T18:49:17.407472] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-26T18:49:17.556727] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-09-26T18:49:18.356690] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-09-26T18:49:18.730288] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-26T18:49:19.156780] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-09-26T18:49:19.956710] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-09-26T18:49:20.045960] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-26T18:49:20.162740] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-26T18:49:20.166715] [INFO ] [REMOTE ] FFC: Full fetch complete (24715 records). [2025-09-26T18:49:20.166800] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-09-26T18:49:20.380110] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-26T18:49:20.574620] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-09-26T18:49:20.574750] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-09-26T18:49:20.575318] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-09-26T18:49:20.575381] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-09-26T18:49:20.576360] [DEBUG] [LOCAL ] FFC: Trimmed 24715 records to 16899 (keeping 200 days of data) [2025-09-26T18:49:20.682178] [DEBUG] [LOCAL ] FFC: Primary data saved (16899 records). [2025-09-26T18:49:20.682336] [INFO ] [MAIN ] FFC: Full history saved. [2025-09-26T18:49:20.682452] [INFO ] [MAIN ] Update Progress: 825/2371 symbols completed. FFC took 35.1s. Estimated remaining: 3h 24m 49s. Rate: 7.5 symbols/min [2025-09-26T18:49:20.761941] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-09-26T18:49:20.868436] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:49:20.868611] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-09-26T18:49:20.868680] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-09-26T18:49:20.868838] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-09-26T18:49:20.868885] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-26T18:49:20.868930] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-09-26T18:49:20.868966] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-09-26T18:49:21.252416] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:49:21.286752] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-26T18:49:21.556724] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-09-26T18:49:22.356751] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-09-26T18:49:22.586301] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-26T18:49:23.156758] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-12. [2025-09-26T18:49:23.481979] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:49:23.492313] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-12 [2025-09-26T18:49:23.494705] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-26T18:49:23.956780] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-09-26T18:49:24.576222] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-26T18:49:24.756797] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-09-26T18:49:25.556807] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-01. [2025-09-26T18:49:26.162155] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-26T18:49:26.180416] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-26T18:49:26.180775] [INFO ] [REMOTE ] FFWM: Full fetch complete (47955 records). [2025-09-26T18:49:26.184906] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-09-26T18:49:26.380498] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-09-26T18:49:26.401825] [WARN ] [VALIDATOR ] FFWM: Validation failed - insufficient historical data. Have 184 unique days, need 200 days [2025-09-26T18:49:26.402722] [FATAL] [MAIN ] FFWM: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:49:26.402804] [WARN ] [MAIN ] FFWM: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:49:26.402886] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-09-26T18:49:26.403007] [DEBUG] [LOCAL ] FFWM: No primary data file found to delete. [2025-09-26T18:49:26.403070] [INFO ] [LOCAL ] FFWM: Starting deletion of derivative data. [2025-09-26T18:49:26.403741] [DEBUG] [LOCAL ] FFWM: Deleted derivative data file. [2025-09-26T18:49:26.403899] [INFO ] [MAIN ] Update Progress: 826/2371 symbols completed. FFWM took 32.0s. Estimated remaining: 3h 24m 36s. Rate: 7.6 symbols/min [2025-09-26T18:49:26.592274] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:49:26.638995] [DEBUG] [LOCAL ] FHI: Loaded 40977 existing records from primary storage. [2025-09-26T18:49:26.639258] [INFO ] [MAIN ] FHI: Loaded 40977 existing records. [2025-09-26T18:49:26.835385] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:49:26.835781] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-09-26T18:49:26.835844] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-09-26T18:49:26.837445] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-09-26T18:49:26.837518] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-09-26T18:49:27.025130] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-26T18:49:27.161994] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-09-26T18:49:27.259831] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:49:27.808020] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-26T18:49:27.956784] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-02. [2025-09-26T18:49:28.648235] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-26T18:49:28.756759] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-03. [2025-09-26T18:49:29.396822] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-26T18:49:29.556722] [INFO ] [REMOTE ] FHI: Fetching primary data for 2024-12. [2025-09-26T18:49:30.356717] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-04. [2025-09-26T18:49:31.045284] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-26T18:49:31.064804] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-26T18:49:31.156785] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-09-26T18:49:31.956769] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-09-26T18:49:32.644532] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-26T18:49:32.756740] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-05. [2025-09-26T18:49:33.031265] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-26T18:49:33.073211] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-26T18:49:33.556724] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-09-26T18:49:34.356747] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-09-26T18:49:34.631224] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-26T18:49:34.830636] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-26T18:49:34.831801] [INFO ] [REMOTE ] FGN: Full fetch complete (5744 records). [2025-09-26T18:49:34.831900] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-09-26T18:49:35.165418] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-09-26T18:49:35.215968] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-09-26T18:49:35.216233] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-09-26T18:49:35.216432] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-09-26T18:49:35.216493] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-09-26T18:49:35.217037] [DEBUG] [LOCAL ] FGN: Trimmed 5744 records to 3915 (keeping 200 days of data) [2025-09-26T18:49:35.241909] [DEBUG] [LOCAL ] FGN: Primary data saved (3915 records). [2025-09-26T18:49:35.242032] [INFO ] [MAIN ] FGN: Full history saved. [2025-09-26T18:49:35.242138] [INFO ] [MAIN ] Update Progress: 827/2371 symbols completed. FGN took 32.5s. Estimated remaining: 3h 24m 30s. Rate: 7.6 symbols/min [2025-09-26T18:49:35.423184] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:49:35.477416] [DEBUG] [LOCAL ] FHN: Loaded 53759 existing records from primary storage. [2025-09-26T18:49:35.477592] [INFO ] [MAIN ] FHN: Loaded 53759 existing records. [2025-09-26T18:49:35.661149] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:49:35.661443] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-09-26T18:49:35.661499] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-09-26T18:49:35.662996] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-09-26T18:49:35.663058] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-09-26T18:49:35.961852] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-06. [2025-09-26T18:49:36.036867] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:49:36.632757] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-26T18:49:36.637219] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-26T18:49:36.756742] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-09-26T18:49:37.556731] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-07. [2025-09-26T18:49:38.351604] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-26T18:49:38.365690] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-08. [2025-09-26T18:49:38.383709] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-26T18:49:38.964793] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-26T18:49:39.156756] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-09-26T18:49:39.956732] [INFO ] [REMOTE ] FHN: Fetching primary data for 2024-12. [2025-09-26T18:49:40.659232] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-26T18:49:40.756784] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-09-26T18:49:41.556715] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-09. [2025-09-26T18:49:41.616090] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-26T18:49:41.837702] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-26T18:49:41.842064] [INFO ] [REMOTE ] FG: Full fetch complete (27332 records). [2025-09-26T18:49:41.842172] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-09-26T18:49:42.163723] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-26T18:49:42.171341] [INFO ] [REMOTE ] FGSN: Full fetch complete (7583 records). [2025-09-26T18:49:42.187014] [DEBUG] [VALIDATOR ] FGSN: Validating primary data. [2025-09-26T18:49:42.359281] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-09-26T18:49:42.359437] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-09-26T18:49:42.367274] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-09-26T18:49:42.372748] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-09-26T18:49:42.412984] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-09-26T18:49:42.459413] [WARN ] [VALIDATOR ] FGSN: Validation failed - insufficient historical data. Have 173 unique days, need 200 days [2025-09-26T18:49:42.459859] [FATAL] [MAIN ] FGSN: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:49:42.460035] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:49:42.460123] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-26T18:49:42.460216] [DEBUG] [LOCAL ] FG: Trimmed 27332 records to 22819 (keeping 200 days of data) [2025-09-26T18:49:42.460749] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-09-26T18:49:42.460854] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-09-26T18:49:42.461133] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-09-26T18:49:42.461239] [INFO ] [MAIN ] Update Progress: 828/2371 symbols completed. FGSN took 21.8s. Estimated remaining: 3h 24m 21s. Rate: 7.6 symbols/min [2025-09-26T18:49:42.752395] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:49:42.817529] [DEBUG] [LOCAL ] FG: Primary data saved (22819 records). [2025-09-26T18:49:42.817721] [INFO ] [MAIN ] FG: Full history saved. [2025-09-26T18:49:42.817832] [INFO ] [MAIN ] Update Progress: 829/2371 symbols completed. FG took 43.2s. Estimated remaining: 3h 23m 59s. Rate: 7.6 symbols/min [2025-09-26T18:49:42.962142] [DEBUG] [LOCAL ] FI: Loaded 53894 existing records from primary storage. [2025-09-26T18:49:42.972685] [INFO ] [MAIN ] FI: Loaded 53894 existing records. [2025-09-26T18:49:43.139035] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:49:43.159932] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-09-26T18:49:43.228938] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:49:43.229254] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-09-26T18:49:43.229313] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-09-26T18:49:43.234743] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-09-26T18:49:43.234890] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-09-26T18:49:43.357446] [DEBUG] [LOCAL ] FICO: Loaded 20525 existing records from primary storage. [2025-09-26T18:49:43.401230] [INFO ] [MAIN ] FICO: Loaded 20525 existing records. [2025-09-26T18:49:43.786026] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:49:43.811363] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-09-26T18:49:43.811487] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-09-26T18:49:43.823044] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-09-26T18:49:43.833366] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-09-26T18:49:43.935877] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:49:43.985204] [INFO ] [REMOTE ] FI: Fetching primary data for 2024-12. [2025-09-26T18:49:44.319445] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-26T18:49:44.365413] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:49:44.734509] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T18:49:44.756693] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-09-26T18:49:45.556701] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-09-26T18:49:45.626758] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-26T18:49:45.914971] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-26T18:49:46.356718] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-09-26T18:49:47.156728] [INFO ] [REMOTE ] FICO: Fetching primary data for 2024-12. [2025-09-26T18:49:47.287087] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-26T18:49:47.863498] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-26T18:49:47.956723] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-09-26T18:49:48.074390] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-26T18:49:48.756757] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-09-26T18:49:49.556693] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-09-26T18:49:49.838706] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-26T18:49:49.862723] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-26T18:49:50.356724] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-09-26T18:49:50.892684] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-26T18:49:51.156728] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-09-26T18:49:51.620504] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-26T18:49:51.956764] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-09-26T18:49:52.618153] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-26T18:49:52.642356] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-26T18:49:52.756742] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-09-26T18:49:53.556747] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-09-26T18:49:54.356753] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-09-26T18:49:54.638078] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-26T18:49:54.689129] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-26T18:49:55.156773] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-09-26T18:49:55.956746] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-09-26T18:49:56.231153] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-26T18:49:56.295135] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-26T18:49:56.756752] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-09-26T18:49:57.083525] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-26T18:49:57.556728] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-09-26T18:49:58.356722] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-09-26T18:49:58.768688] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-26T18:49:58.992589] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-26T18:49:59.000224] [INFO ] [REMOTE ] FHI: Full fetch complete (57862 records). [2025-09-26T18:49:59.000359] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-09-26T18:49:59.161825] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-09-26T18:49:59.424490] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-09-26T18:49:59.424575] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-09-26T18:49:59.425345] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-09-26T18:49:59.425415] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-09-26T18:49:59.426940] [DEBUG] [LOCAL ] FHI: Trimmed 57862 records to 41203 (keeping 200 days of data) [2025-09-26T18:49:59.692360] [DEBUG] [LOCAL ] FHI: Primary data saved (41203 records). [2025-09-26T18:49:59.692491] [INFO ] [MAIN ] FHI: Full history saved. [2025-09-26T18:49:59.692592] [INFO ] [MAIN ] Update Progress: 830/2371 symbols completed. FHI took 33.3s. Estimated remaining: 3h 24m 7s. Rate: 7.5 symbols/min [2025-09-26T18:49:59.893084] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:49:59.893371] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-09-26T18:49:59.893475] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-09-26T18:49:59.894339] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-09-26T18:49:59.894427] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-26T18:49:59.895088] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-26T18:49:59.895178] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-09-26T18:49:59.969993] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-09-26T18:50:00.064881] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-26T18:50:00.329156] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:50:00.756739] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-09-26T18:50:00.982264] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-26T18:50:01.039907] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-26T18:50:01.556739] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-09-26T18:50:02.356736] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-09-26T18:50:02.516140] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-26T18:50:03.156780] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-09-26T18:50:03.206109] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-26T18:50:03.956743] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-12. [2025-09-26T18:50:04.271241] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-09-26T18:50:04.307534] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-26T18:50:04.587443] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-26T18:50:04.756726] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-09-26T18:50:05.005167] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.25 seconds). [2025-09-26T18:50:05.556715] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-09-26T18:50:06.356710] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-09-26T18:50:06.754817] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-26T18:50:07.156802] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-09-26T18:50:07.538593] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-26T18:50:07.956711] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-09-26T18:50:08.283220] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-26T18:50:08.316938] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-26T18:50:08.756786] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-09-26T18:50:09.130858] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-26T18:50:09.556726] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-09-26T18:50:10.356715] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-09-26T18:50:10.728332] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-26T18:50:11.156737] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-09-26T18:50:11.560693] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:50:11.561050] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-09-26T18:50:11.613338] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-26T18:50:11.956728] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-09-26T18:50:12.756773] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-09-26T18:50:13.556779] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-09-26T18:50:14.356697] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-07. [2025-09-26T18:50:14.743549] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-26T18:50:14.758181] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-26T18:50:14.774490] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-26T18:50:14.779160] [INFO ] [REMOTE ] FICO: Full fetch complete (28467 records). [2025-09-26T18:50:14.779283] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-09-26T18:50:15.165875] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-09-26T18:50:15.200608] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-09-26T18:50:15.200845] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-09-26T18:50:15.201449] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-09-26T18:50:15.201594] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-09-26T18:50:15.202741] [DEBUG] [LOCAL ] FICO: Trimmed 28467 records to 20674 (keeping 200 days of data) [2025-09-26T18:50:15.300756] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (3.34 seconds). [2025-09-26T18:50:15.347342] [INFO ] [REMOTE ] FHN: Full fetch complete (77282 records). [2025-09-26T18:50:15.352411] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-09-26T18:50:15.781076] [DEBUG] [LOCAL ] FICO: Primary data saved (20674 records). [2025-09-26T18:50:15.808191] [INFO ] [MAIN ] FICO: Full history saved. [2025-09-26T18:50:15.811814] [INFO ] [MAIN ] Update Progress: 831/2371 symbols completed. FICO took 33.0s. Estimated remaining: 3h 24m 15s. Rate: 7.5 symbols/min [2025-09-26T18:50:15.831496] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-09-26T18:50:15.836993] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-09-26T18:50:15.854571] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-09-26T18:50:15.861163] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-09-26T18:50:15.961867] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-08. [2025-09-26T18:50:15.976264] [DEBUG] [LOCAL ] FHN: Trimmed 77282 records to 54148 (keeping 200 days of data) [2025-09-26T18:50:16.170473] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:50:16.360835] [DEBUG] [LOCAL ] FIGS: Loaded 49285 existing records from primary storage. [2025-09-26T18:50:16.365405] [INFO ] [MAIN ] FIGS: Loaded 49285 existing records. [2025-09-26T18:50:16.648271] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:50:16.651180] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-09-26T18:50:16.651861] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-09-26T18:50:16.654060] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-09-26T18:50:16.654568] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-09-26T18:50:16.858085] [DEBUG] [LOCAL ] FHN: Primary data saved (54148 records). [2025-09-26T18:50:16.859296] [INFO ] [MAIN ] FHN: Full history saved. [2025-09-26T18:50:16.874838] [INFO ] [MAIN ] Update Progress: 832/2371 symbols completed. FHN took 41.6s. Estimated remaining: 3h 23m 54s. Rate: 7.5 symbols/min [2025-09-26T18:50:17.228690] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:50:17.263907] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:50:17.264674] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2024-12. [2025-09-26T18:50:17.310414] [DEBUG] [LOCAL ] FIHL: Loaded 40582 existing records from primary storage. [2025-09-26T18:50:17.310630] [INFO ] [MAIN ] FIHL: Loaded 40582 existing records. [2025-09-26T18:50:17.520421] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:50:17.520910] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-09-26T18:50:17.520984] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-09-26T18:50:17.522259] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-09-26T18:50:17.522323] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-09-26T18:50:17.828420] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-09-26T18:50:17.881177] [INFO ] [REMOTE ] FI: Full fetch complete (77170 records). [2025-09-26T18:50:17.896806] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-09-26T18:50:17.954858] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:50:17.955385] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2024-12. [2025-09-26T18:50:18.421686] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-09-26T18:50:18.421837] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-09-26T18:50:18.423233] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-09-26T18:50:18.423339] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-09-26T18:50:18.425782] [DEBUG] [LOCAL ] FI: Trimmed 77170 records to 54281 (keeping 200 days of data) [2025-09-26T18:50:18.581962] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-09-26T18:50:18.606036] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-09. [2025-09-26T18:50:18.754284] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-26T18:50:18.873666] [DEBUG] [LOCAL ] FI: Primary data saved (54281 records). [2025-09-26T18:50:18.873898] [INFO ] [MAIN ] FI: Full history saved. [2025-09-26T18:50:18.874062] [INFO ] [MAIN ] Update Progress: 833/2371 symbols completed. FI took 36.4s. Estimated remaining: 3h 23m 35s. Rate: 7.6 symbols/min [2025-09-26T18:50:19.070115] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:50:19.096170] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-26T18:50:19.109074] [DEBUG] [LOCAL ] FINS: Loaded 8280 existing records from primary storage. [2025-09-26T18:50:19.109226] [INFO ] [MAIN ] FINS: Loaded 8280 existing records. [2025-09-26T18:50:19.167051] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-09-26T18:50:19.307209] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:50:19.307480] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-09-26T18:50:19.307549] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-09-26T18:50:19.308006] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-09-26T18:50:19.308068] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-09-26T18:50:19.708752] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:50:19.956737] [INFO ] [REMOTE ] FINS: Fetching primary data for 2024-12. [2025-09-26T18:50:20.756763] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-09-26T18:50:20.884383] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-26T18:50:21.054345] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-26T18:50:21.096636] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-09-26T18:50:21.107484] [INFO ] [REMOTE ] FIG: Full fetch complete (16186 records). [2025-09-26T18:50:21.107633] [DEBUG] [VALIDATOR ] FIG: Validating primary data. [2025-09-26T18:50:21.300293] [WARN ] [VALIDATOR ] FIG: Validation failed - insufficient historical data. Have 145 unique days, need 200 days [2025-09-26T18:50:21.300622] [FATAL] [MAIN ] FIG: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:50:21.300729] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:50:21.300806] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-26T18:50:21.300876] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-26T18:50:21.300913] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-09-26T18:50:21.300971] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-09-26T18:50:21.301058] [INFO ] [MAIN ] Update Progress: 834/2371 symbols completed. FIG took 21.6s. Estimated remaining: 3h 23m 17s. Rate: 7.6 symbols/min [2025-09-26T18:50:21.483913] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:50:21.539526] [DEBUG] [LOCAL ] FINV: Loaded 45475 existing records from primary storage. [2025-09-26T18:50:21.539738] [INFO ] [MAIN ] FINV: Loaded 45475 existing records. [2025-09-26T18:50:21.561861] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-09-26T18:50:21.739950] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:50:21.740279] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-09-26T18:50:21.740332] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-09-26T18:50:21.741562] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-09-26T18:50:21.741626] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-09-26T18:50:22.145305] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:50:22.159757] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-26T18:50:22.356713] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-09-26T18:50:22.865018] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-26T18:50:23.156755] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-09-26T18:50:23.262133] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-26T18:50:23.614534] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-26T18:50:23.956779] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-09-26T18:50:24.756779] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-09-26T18:50:25.556712] [INFO ] [REMOTE ] FINV: Fetching primary data for 2024-12. [2025-09-26T18:50:25.620271] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-26T18:50:25.666094] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-26T18:50:26.356731] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-09-26T18:50:26.768503] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-26T18:50:27.156750] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-09-26T18:50:27.954087] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-26T18:50:27.963220] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-09-26T18:50:28.635775] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-26T18:50:28.756761] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-09-26T18:50:29.556921] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-09-26T18:50:29.592547] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-26T18:50:30.234516] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-26T18:50:30.234781] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-26T18:50:30.356716] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-09-26T18:50:31.156748] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-09-26T18:50:31.845475] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T18:50:31.956732] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-09-26T18:50:32.468017] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-26T18:50:32.756730] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-09-26T18:50:33.008975] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-26T18:50:33.556729] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-09-26T18:50:33.913597] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-26T18:50:34.356758] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-09-26T18:50:34.884232] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-26T18:50:35.156757] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-09-26T18:50:35.958049] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T18:50:35.958188] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-09-26T18:50:36.644338] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-26T18:50:36.756785] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-09-26T18:50:36.943907] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-26T18:50:37.556719] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-09-26T18:50:38.278485] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-26T18:50:38.288314] [INFO ] [REMOTE ] FIGS: Full fetch complete (71094 records). [2025-09-26T18:50:38.288486] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-09-26T18:50:38.365756] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-09-26T18:50:38.743918] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-09-26T18:50:38.744174] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-09-26T18:50:38.745464] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-09-26T18:50:38.745586] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-09-26T18:50:38.762078] [DEBUG] [LOCAL ] FIGS: Trimmed 71094 records to 49651 (keeping 200 days of data) [2025-09-26T18:50:38.774097] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-26T18:50:38.890457] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-26T18:50:39.095378] [DEBUG] [LOCAL ] FIGS: Primary data saved (49651 records). [2025-09-26T18:50:39.095547] [INFO ] [MAIN ] FIGS: Full history saved. [2025-09-26T18:50:39.095681] [INFO ] [MAIN ] Update Progress: 835/2371 symbols completed. FIGS took 23.3s. Estimated remaining: 3h 23m 27s. Rate: 7.5 symbols/min [2025-09-26T18:50:39.156776] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-09-26T18:50:39.290154] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:50:39.343765] [DEBUG] [LOCAL ] FIS: Loaded 53754 existing records from primary storage. [2025-09-26T18:50:39.344003] [INFO ] [MAIN ] FIS: Loaded 53754 existing records. [2025-09-26T18:50:39.534545] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:50:39.534840] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-09-26T18:50:39.534891] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-09-26T18:50:39.536486] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-09-26T18:50:39.536548] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-09-26T18:50:39.945094] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:50:39.956495] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-26T18:50:39.956862] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-09-26T18:50:40.756731] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-09-26T18:50:41.438516] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-26T18:50:41.556727] [INFO ] [REMOTE ] FIS: Fetching primary data for 2024-12. [2025-09-26T18:50:42.183431] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-26T18:50:42.356764] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-09-26T18:50:43.156747] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-09-26T18:50:43.313377] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-26T18:50:43.956702] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-09-26T18:50:44.150761] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-26T18:50:44.454863] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-26T18:50:44.756745] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-09-26T18:50:45.556737] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-09-26T18:50:45.698155] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-26T18:50:46.346119] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-26T18:50:46.356691] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-09-26T18:50:46.895197] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-26T18:50:47.092067] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-26T18:50:47.156697] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-09-26T18:50:47.902580] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-26T18:50:47.956735] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-09-26T18:50:48.756789] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-09-26T18:50:49.556716] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-09-26T18:50:49.844471] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-26T18:50:49.854109] [INFO ] [REMOTE ] FINV: Full fetch complete (63558 records). [2025-09-26T18:50:49.854271] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-09-26T18:50:50.012854] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-26T18:50:50.324380] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-26T18:50:50.356699] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-09-26T18:50:50.357671] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-09-26T18:50:50.358810] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-09-26T18:50:50.359915] [INFO ] [REMOTE ] FIHL: Full fetch complete (55868 records). [2025-09-26T18:50:50.360145] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-09-26T18:50:50.359748] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-09-26T18:50:50.360825] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-09-26T18:50:50.479010] [DEBUG] [LOCAL ] FINV: Trimmed 63558 records to 45772 (keeping 200 days of data) [2025-09-26T18:50:50.910742] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-09-26T18:50:50.912254] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-09-26T18:50:50.917184] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-09-26T18:50:50.917292] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-09-26T18:50:50.999912] [DEBUG] [LOCAL ] FIHL: Trimmed 55868 records to 40851 (keeping 200 days of data) [2025-09-26T18:50:51.145454] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-26T18:50:51.161628] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-09-26T18:50:51.176244] [INFO ] [REMOTE ] FINS: Full fetch complete (12488 records). [2025-09-26T18:50:51.179493] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-09-26T18:50:51.327252] [DEBUG] [LOCAL ] FINV: Primary data saved (45772 records). [2025-09-26T18:50:51.338507] [INFO ] [MAIN ] FINV: Full history saved. [2025-09-26T18:50:51.339241] [INFO ] [MAIN ] Update Progress: 836/2371 symbols completed. FINV took 30.0s. Estimated remaining: 3h 23m 27s. Rate: 7.5 symbols/min [2025-09-26T18:50:51.821562] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:50:51.926412] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-09-26T18:50:51.927180] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-09-26T18:50:51.927683] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-09-26T18:50:51.927958] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-09-26T18:50:52.018211] [DEBUG] [LOCAL ] FINS: Trimmed 12488 records to 8309 (keeping 200 days of data) [2025-09-26T18:50:52.109077] [DEBUG] [LOCAL ] FIX: Loaded 30594 existing records from primary storage. [2025-09-26T18:50:52.116013] [INFO ] [MAIN ] FIX: Loaded 30594 existing records. [2025-09-26T18:50:52.183882] [DEBUG] [LOCAL ] FIHL: Primary data saved (40851 records). [2025-09-26T18:50:52.189903] [INFO ] [MAIN ] FIHL: Full history saved. [2025-09-26T18:50:52.208773] [INFO ] [MAIN ] Update Progress: 837/2371 symbols completed. FIHL took 35.3s. Estimated remaining: 3h 23m 6s. Rate: 7.6 symbols/min [2025-09-26T18:50:52.254745] [DEBUG] [LOCAL ] FINS: Primary data saved (8309 records). [2025-09-26T18:50:52.254956] [INFO ] [MAIN ] FINS: Full history saved. [2025-09-26T18:50:52.255109] [INFO ] [MAIN ] Update Progress: 838/2371 symbols completed. FINS took 33.4s. Estimated remaining: 3h 22m 44s. Rate: 7.6 symbols/min [2025-09-26T18:50:52.355055] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:50:52.355339] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-09-26T18:50:52.355390] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-09-26T18:50:52.356393] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-09-26T18:50:52.356457] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-09-26T18:50:52.792714] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:50:52.793074] [INFO ] [REMOTE ] FIX: Fetching primary data for 2024-12. [2025-09-26T18:50:53.098983] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-26T18:50:53.109723] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-09-26T18:50:54.206411] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-26T18:50:54.212287] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-09-26T18:50:54.872041] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-26T18:50:54.884804] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-09-26T18:50:55.424250] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-26T18:50:55.433096] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-09-26T18:50:56.496122] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-26T18:50:56.508975] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-09-26T18:50:56.594423] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-26T18:50:56.756867] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-09-26T18:50:58.276294] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-26T18:50:58.288731] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-09-26T18:50:58.424187] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-26T18:50:58.433270] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-09-26T18:50:59.718827] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-26T18:50:59.730575] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-09-26T18:50:59.864233] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-26T18:50:59.956775] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-09-26T18:51:01.652814] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-26T18:51:01.654735] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-26T18:51:01.673965] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-09-26T18:51:01.675335] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-09-26T18:51:02.964937] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-26T18:51:02.971440] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-09-26T18:51:03.521280] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-26T18:51:03.536703] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-09-26T18:51:04.074530] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-26T18:51:04.081543] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-09-26T18:51:05.145519] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-26T18:51:05.154787] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-09-26T18:51:05.247061] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-26T18:51:05.258012] [INFO ] [REMOTE ] FIS: Full fetch complete (77176 records). [2025-09-26T18:51:05.258174] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-09-26T18:51:05.695224] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-09-26T18:51:05.695310] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-09-26T18:51:05.696299] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-09-26T18:51:05.696368] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-09-26T18:51:05.698033] [DEBUG] [LOCAL ] FIS: Trimmed 77176 records to 54144 (keeping 200 days of data) [2025-09-26T18:51:06.049594] [DEBUG] [LOCAL ] FIS: Primary data saved (54144 records). [2025-09-26T18:51:06.049783] [INFO ] [MAIN ] FIS: Full history saved. [2025-09-26T18:51:06.049964] [INFO ] [MAIN ] Update Progress: 839/2371 symbols completed. FIS took 27.0s. Estimated remaining: 3h 22m 46s. Rate: 7.6 symbols/min [2025-09-26T18:51:06.284824] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-26T18:51:06.291532] [INFO ] [REMOTE ] FIX: Full fetch complete (45688 records). [2025-09-26T18:51:06.291668] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-09-26T18:51:06.939054] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-09-26T18:51:06.939183] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-09-26T18:51:06.940027] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-09-26T18:51:06.940096] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-09-26T18:51:06.941216] [DEBUG] [LOCAL ] FIX: Trimmed 45688 records to 30763 (keeping 200 days of data) [2025-09-26T18:51:07.162254] [DEBUG] [LOCAL ] FIX: Primary data saved (30763 records). [2025-09-26T18:51:07.162394] [INFO ] [MAIN ] FIX: Full history saved. [2025-09-26T18:51:07.162482] [INFO ] [MAIN ] Update Progress: 840/2371 symbols completed. FIX took 15.8s. Estimated remaining: 3h 22m 26s. Rate: 7.6 symbols/min [2025-09-26T18:51:07.944677] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:51:07.994158] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:51:08.062158] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:51:08.059940] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:51:08.062555] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-09-26T18:51:08.063172] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-09-26T18:51:08.063948] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-09-26T18:51:08.064056] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-26T18:51:08.064354] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-26T18:51:08.064573] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-09-26T18:51:08.151475] [DEBUG] [LOCAL ] FLC: Loaded 5533 existing records from primary storage. [2025-09-26T18:51:08.168194] [INFO ] [MAIN ] FLC: Loaded 5533 existing records. [2025-09-26T18:51:08.533209] [DEBUG] [LOCAL ] FLNG: Loaded 34205 existing records from primary storage. [2025-09-26T18:51:08.610030] [INFO ] [MAIN ] FLNG: Loaded 34205 existing records. [2025-09-26T18:51:08.682875] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:51:08.694180] [DEBUG] [LOCAL ] FLG: Loaded 53717 existing records from primary storage. [2025-09-26T18:51:08.720626] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-09-26T18:51:08.772350] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-09-26T18:51:08.791371] [INFO ] [MAIN ] FLG: Loaded 53717 existing records. [2025-09-26T18:51:08.852588] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:51:08.858231] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-12. [2025-09-26T18:51:08.840708] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-09-26T18:51:08.874162] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-09-26T18:51:09.185962] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:51:09.236682] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-12 [2025-09-26T18:51:09.273170] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-01. [2025-09-26T18:51:09.300134] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:51:09.418469] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-09-26T18:51:09.482783] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:51:09.461252] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-09-26T18:51:09.527473] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-09-26T18:51:09.541240] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-09-26T18:51:09.521270] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-09-26T18:51:09.554294] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-09-26T18:51:09.561063] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:51:09.587268] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-01 [2025-09-26T18:51:09.635392] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-09-26T18:51:09.635842] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-02. [2025-09-26T18:51:09.690180] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-09-26T18:51:09.796621] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:51:09.827814] [INFO ] [REMOTE ] FLC: Fetching primary data for 2024-12. [2025-09-26T18:51:09.970936] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:51:10.047533] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-02 [2025-09-26T18:51:10.160522] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-03. [2025-09-26T18:51:10.459727] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:51:10.483808] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2024-12. [2025-09-26T18:51:10.506831] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:51:10.508488] [INFO ] [REMOTE ] FLG: Fetching primary data for 2024-12. [2025-09-26T18:51:10.561268] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-26T18:51:10.561019] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:51:10.563840] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-03 [2025-09-26T18:51:11.156775] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-04. [2025-09-26T18:51:11.363273] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:51:11.363631] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-04 [2025-09-26T18:51:11.956771] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-05. [2025-09-26T18:51:12.100297] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-26T18:51:12.547702] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:51:12.548050] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-05 [2025-09-26T18:51:12.585013] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-26T18:51:12.756751] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-09-26T18:51:13.556738] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-09-26T18:51:14.000877] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-26T18:51:14.356742] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-09-26T18:51:14.740234] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-26T18:51:15.033285] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-26T18:51:15.156783] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-06. [2025-09-26T18:51:15.824188] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-26T18:51:15.956790] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-09-26T18:51:16.756737] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-09-26T18:51:17.377556] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-26T18:51:17.528151] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-26T18:51:17.556760] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-09-26T18:51:18.171610] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-26T18:51:18.356777] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-07. [2025-09-26T18:51:18.917261] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-26T18:51:19.156735] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-08. [2025-09-26T18:51:19.598387] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-26T18:51:19.956757] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-09-26T18:51:20.659886] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-26T18:51:20.756786] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-09. [2025-09-26T18:51:21.300769] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-26T18:51:21.301942] [INFO ] [REMOTE ] FIXT: Full fetch complete (1753 records). [2025-09-26T18:51:21.302015] [DEBUG] [VALIDATOR ] FIXT: Validating primary data. [2025-09-26T18:51:21.496669] [WARN ] [VALIDATOR ] FIXT: Validation failed - insufficient historical data. Have 72 unique days, need 200 days [2025-09-26T18:51:21.496907] [FATAL] [MAIN ] FIXT: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:51:21.497003] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:51:21.497126] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-26T18:51:21.497242] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-26T18:51:21.497299] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-09-26T18:51:21.497366] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-09-26T18:51:21.497469] [INFO ] [MAIN ] Update Progress: 841/2371 symbols completed. FIXT took 14.3s. Estimated remaining: 3h 22m 30s. Rate: 7.6 symbols/min [2025-09-26T18:51:21.563441] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-09-26T18:51:21.717095] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:51:21.778286] [DEBUG] [LOCAL ] FLO: Loaded 52270 existing records from primary storage. [2025-09-26T18:51:21.778488] [INFO ] [MAIN ] FLO: Loaded 52270 existing records. [2025-09-26T18:51:21.973336] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:51:21.973683] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-09-26T18:51:21.973744] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-09-26T18:51:21.975248] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-09-26T18:51:21.975321] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-09-26T18:51:22.374863] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-09-26T18:51:22.382015] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:51:22.970617] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-26T18:51:23.156779] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-09-26T18:51:23.279461] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-26T18:51:23.956738] [INFO ] [REMOTE ] FLO: Fetching primary data for 2024-12. [2025-09-26T18:51:24.200476] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-26T18:51:24.756736] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-09-26T18:51:25.186046] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-26T18:51:25.556731] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-09-26T18:51:25.846303] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-26T18:51:26.356781] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-09-26T18:51:27.049275] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-26T18:51:27.156743] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-09-26T18:51:27.651702] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-26T18:51:27.956764] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-09-26T18:51:28.527808] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-26T18:51:28.756699] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-09-26T18:51:28.852667] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-26T18:51:29.187300] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-26T18:51:29.556728] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-09-26T18:51:30.356727] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-09-26T18:51:31.156731] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-09-26T18:51:31.396307] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-26T18:51:31.793986] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-26T18:51:31.794268] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-26T18:51:31.956755] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-09-26T18:51:32.756786] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-09-26T18:51:33.486123] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-26T18:51:33.488500] [INFO ] [REMOTE ] FLC: Full fetch complete (8019 records). [2025-09-26T18:51:33.488608] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-09-26T18:51:33.561874] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-09-26T18:51:33.900932] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-09-26T18:51:33.901045] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-09-26T18:51:33.901332] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-09-26T18:51:33.901486] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-09-26T18:51:33.902293] [DEBUG] [LOCAL ] FLC: Trimmed 8019 records to 5559 (keeping 200 days of data) [2025-09-26T18:51:33.973015] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-26T18:51:33.993844] [DEBUG] [LOCAL ] FLC: Primary data saved (5559 records). [2025-09-26T18:51:33.994418] [INFO ] [MAIN ] FLC: Full history saved. [2025-09-26T18:51:33.994539] [INFO ] [MAIN ] Update Progress: 842/2371 symbols completed. FLC took 26.8s. Estimated remaining: 3h 22m 30s. Rate: 7.6 symbols/min [2025-09-26T18:51:34.182297] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:51:34.182579] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-09-26T18:51:34.182638] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-09-26T18:51:34.182824] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-09-26T18:51:34.182914] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-26T18:51:34.182969] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-09-26T18:51:34.183005] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-09-26T18:51:34.358461] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-09-26T18:51:34.582580] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:51:35.149548] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-26T18:51:35.157449] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-09-26T18:51:35.955329] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-26T18:51:35.966172] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-09-26T18:51:36.317769] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-26T18:51:36.756724] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-09-26T18:51:37.030795] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-26T18:51:37.556719] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-09-26T18:51:38.356713] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-09-26T18:51:38.815070] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-26T18:51:39.080128] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-26T18:51:39.088491] [INFO ] [REMOTE ] FLNG: Full fetch complete (50779 records). [2025-09-26T18:51:39.088680] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-09-26T18:51:39.161837] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-12. [2025-09-26T18:51:39.425613] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:51:39.462246] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-12 [2025-09-26T18:51:39.511216] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-09-26T18:51:39.511301] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-09-26T18:51:39.512082] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-09-26T18:51:39.512150] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-09-26T18:51:39.513473] [DEBUG] [LOCAL ] FLNG: Trimmed 50779 records to 34431 (keeping 200 days of data) [2025-09-26T18:51:39.732083] [DEBUG] [LOCAL ] FLNG: Primary data saved (34431 records). [2025-09-26T18:51:39.732243] [INFO ] [MAIN ] FLNG: Full history saved. [2025-09-26T18:51:39.732352] [INFO ] [MAIN ] Update Progress: 843/2371 symbols completed. FLNG took 32.6s. Estimated remaining: 3h 22m 18s. Rate: 7.6 symbols/min [2025-09-26T18:51:39.924032] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:51:39.963234] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-09-26T18:51:39.970107] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-26T18:51:40.020211] [DEBUG] [LOCAL ] FLR: Loaded 53507 existing records from primary storage. [2025-09-26T18:51:40.020373] [INFO ] [MAIN ] FLR: Loaded 53507 existing records. [2025-09-26T18:51:40.204514] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:51:40.204845] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-09-26T18:51:40.204902] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-09-26T18:51:40.207243] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-09-26T18:51:40.207316] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-09-26T18:51:40.576964] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:51:40.756776] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-09-26T18:51:41.556707] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-01. [2025-09-26T18:51:41.696827] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-26T18:51:42.261268] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-26T18:51:42.356703] [INFO ] [REMOTE ] FLR: Fetching primary data for 2024-12. [2025-09-26T18:51:42.628276] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-26T18:51:43.156726] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-02. [2025-09-26T18:51:43.964613] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-09-26T18:51:43.971430] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-26T18:51:44.427996] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-26T18:51:44.756731] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-03. [2025-09-26T18:51:45.556741] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-09-26T18:51:46.100211] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-26T18:51:46.111148] [INFO ] [REMOTE ] FLG: Full fetch complete (77295 records). [2025-09-26T18:51:46.111340] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-09-26T18:51:46.381736] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-09-26T18:51:46.491800] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-26T18:51:46.597703] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-09-26T18:51:46.597818] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-09-26T18:51:46.598809] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-09-26T18:51:46.598949] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-09-26T18:51:46.600890] [DEBUG] [LOCAL ] FLG: Trimmed 77295 records to 54105 (keeping 200 days of data) [2025-09-26T18:51:46.883994] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-26T18:51:46.988267] [DEBUG] [LOCAL ] FLG: Primary data saved (54105 records). [2025-09-26T18:51:46.988419] [INFO ] [MAIN ] FLG: Full history saved. [2025-09-26T18:51:46.988515] [INFO ] [MAIN ] Update Progress: 844/2371 symbols completed. FLG took 39.8s. Estimated remaining: 3h 22m 9s. Rate: 7.6 symbols/min [2025-09-26T18:51:47.169879] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:51:47.166058] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-04. [2025-09-26T18:51:47.220430] [DEBUG] [LOCAL ] FLS: Loaded 50555 existing records from primary storage. [2025-09-26T18:51:47.220605] [INFO ] [MAIN ] FLS: Loaded 50555 existing records. [2025-09-26T18:51:47.409985] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:51:47.410254] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-09-26T18:51:47.410303] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-09-26T18:51:47.411856] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-09-26T18:51:47.411933] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-09-26T18:51:47.856392] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:51:47.956692] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-09-26T18:51:48.115427] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-26T18:51:48.430873] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-26T18:51:48.756768] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-09-26T18:51:49.556709] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-05. [2025-09-26T18:51:49.643092] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-26T18:51:50.356694] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-09-26T18:51:50.387986] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-26T18:51:51.048503] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T18:51:51.156785] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-06. [2025-09-26T18:51:51.956728] [INFO ] [REMOTE ] FLS: Fetching primary data for 2024-12. [2025-09-26T18:51:52.077022] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-26T18:51:52.134125] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-26T18:51:52.756747] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-09-26T18:51:53.193666] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-26T18:51:53.556733] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-07. [2025-09-26T18:51:54.152525] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-26T18:51:54.356726] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-09-26T18:51:54.693764] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-26T18:51:55.156747] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-09-26T18:51:55.956708] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-08. [2025-09-26T18:51:56.098007] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-26T18:51:56.757732] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-09-26T18:51:56.761078] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-26T18:51:57.284326] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-26T18:51:57.556739] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-09. [2025-09-26T18:51:58.356733] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-09-26T18:51:58.587851] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-26T18:51:58.641724] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-26T18:51:58.648892] [INFO ] [REMOTE ] FLOC: Full fetch complete (37544 records). [2025-09-26T18:51:58.648990] [DEBUG] [VALIDATOR ] FLOC: Validating primary data. [2025-09-26T18:51:58.847747] [WARN ] [VALIDATOR ] FLOC: Validation failed - insufficient historical data. Have 175 unique days, need 200 days [2025-09-26T18:51:58.848230] [FATAL] [MAIN ] FLOC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:51:58.848303] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:51:58.848376] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-26T18:51:58.848469] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-09-26T18:51:58.848528] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-09-26T18:51:58.848574] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-09-26T18:51:58.848662] [INFO ] [MAIN ] Update Progress: 845/2371 symbols completed. FLOC took 24.9s. Estimated remaining: 3h 22m 8s. Rate: 7.5 symbols/min [2025-09-26T18:51:59.029760] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:51:59.082622] [DEBUG] [LOCAL ] FLUT: Loaded 51237 existing records from primary storage. [2025-09-26T18:51:59.082812] [INFO ] [MAIN ] FLUT: Loaded 51237 existing records. [2025-09-26T18:51:59.161783] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-09-26T18:51:59.267802] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:51:59.268044] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-09-26T18:51:59.268092] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-09-26T18:51:59.270224] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-09-26T18:51:59.270286] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-09-26T18:51:59.639913] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:51:59.672264] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-26T18:51:59.956722] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2024-12. [2025-09-26T18:52:00.676567] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-26T18:52:00.756725] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-09-26T18:52:01.286940] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-26T18:52:01.556743] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-09-26T18:52:02.322370] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-26T18:52:02.356682] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-09-26T18:52:03.165701] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-09-26T18:52:03.184808] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-26T18:52:03.956709] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-09-26T18:52:04.277492] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-26T18:52:04.722484] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-26T18:52:04.733339] [INFO ] [REMOTE ] FLO: Full fetch complete (74931 records). [2025-09-26T18:52:04.733515] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-09-26T18:52:04.768822] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-09-26T18:52:05.173081] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-09-26T18:52:05.173250] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-09-26T18:52:05.176540] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-09-26T18:52:05.176687] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-09-26T18:52:05.189776] [DEBUG] [LOCAL ] FLO: Trimmed 74931 records to 52656 (keeping 200 days of data) [2025-09-26T18:52:05.561335] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-09-26T18:52:05.588638] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T18:52:05.617714] [DEBUG] [LOCAL ] FLO: Primary data saved (52656 records). [2025-09-26T18:52:05.617924] [INFO ] [MAIN ] FLO: Full history saved. [2025-09-26T18:52:05.618167] [INFO ] [MAIN ] Update Progress: 846/2371 symbols completed. FLO took 44.1s. Estimated remaining: 3h 21m 58s. Rate: 7.6 symbols/min [2025-09-26T18:52:05.828127] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:52:05.851662] [DEBUG] [LOCAL ] FLXR: Loaded 20150 existing records from primary storage. [2025-09-26T18:52:05.851829] [INFO ] [MAIN ] FLXR: Loaded 20150 existing records. [2025-09-26T18:52:06.038445] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:52:06.038799] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-09-26T18:52:06.038856] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-09-26T18:52:06.040033] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-09-26T18:52:06.040112] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-09-26T18:52:06.357229] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-09-26T18:52:06.427440] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:52:06.545807] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-26T18:52:07.156741] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-09-26T18:52:07.274895] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-26T18:52:07.287832] [INFO ] [REMOTE ] FLR: Full fetch complete (76348 records). [2025-09-26T18:52:07.288029] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-09-26T18:52:07.718048] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-09-26T18:52:07.718571] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-09-26T18:52:07.719782] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-09-26T18:52:07.719906] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-09-26T18:52:07.722436] [DEBUG] [LOCAL ] FLR: Trimmed 76348 records to 53892 (keeping 200 days of data) [2025-09-26T18:52:07.850854] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-26T18:52:07.979239] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2024-12. [2025-09-26T18:52:08.104235] [DEBUG] [LOCAL ] FLR: Primary data saved (53892 records). [2025-09-26T18:52:08.104393] [INFO ] [MAIN ] FLR: Full history saved. [2025-09-26T18:52:08.104485] [INFO ] [MAIN ] Update Progress: 847/2371 symbols completed. FLR took 28.4s. Estimated remaining: 3h 21m 40s. Rate: 7.6 symbols/min [2025-09-26T18:52:08.294669] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:52:08.355108] [DEBUG] [LOCAL ] FMC: Loaded 52176 existing records from primary storage. [2025-09-26T18:52:08.355379] [INFO ] [MAIN ] FMC: Loaded 52176 existing records. [2025-09-26T18:52:08.573339] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-26T18:52:08.578082] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:52:08.583146] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-09-26T18:52:08.583295] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-09-26T18:52:08.585200] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-09-26T18:52:08.585280] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-09-26T18:52:08.757303] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-09-26T18:52:09.032871] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:52:09.066317] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-26T18:52:09.556794] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-09-26T18:52:09.592789] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-26T18:52:10.356760] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-09-26T18:52:11.128898] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-26T18:52:11.149818] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-26T18:52:11.156671] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-09-26T18:52:11.956725] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-09-26T18:52:12.163563] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-26T18:52:12.756758] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-09-26T18:52:13.556716] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-09-26T18:52:13.753064] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-26T18:52:14.357208] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-09-26T18:52:14.357093] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-26T18:52:14.394188] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-26T18:52:15.156737] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-09-26T18:52:15.956729] [INFO ] [REMOTE ] FMC: Fetching primary data for 2024-12. [2025-09-26T18:52:16.174841] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-26T18:52:16.221712] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-26T18:52:16.756727] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-09-26T18:52:17.403855] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-26T18:52:17.556738] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-09-26T18:52:17.942188] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-26T18:52:18.356779] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-09-26T18:52:19.156749] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-09-26T18:52:19.334078] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-26T18:52:19.669395] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-26T18:52:19.956748] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-09-26T18:52:20.432944] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-26T18:52:20.756725] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-09-26T18:52:21.374965] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-26T18:52:21.431426] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-26T18:52:21.556727] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-09-26T18:52:22.356749] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-09-26T18:52:22.642906] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-26T18:52:23.156776] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-09-26T18:52:23.957172] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-09-26T18:52:23.957030] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-26T18:52:24.229336] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-26T18:52:24.235447] [INFO ] [REMOTE ] FLXR: Full fetch complete (25149 records). [2025-09-26T18:52:24.235604] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-09-26T18:52:24.642196] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-09-26T18:52:24.642302] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-09-26T18:52:24.642856] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-09-26T18:52:24.642920] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-09-26T18:52:24.643852] [DEBUG] [LOCAL ] FLXR: Trimmed 25149 records to 20315 (keeping 200 days of data) [2025-09-26T18:52:24.756836] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-09-26T18:52:24.787982] [DEBUG] [LOCAL ] FLXR: Primary data saved (20315 records). [2025-09-26T18:52:24.788114] [INFO ] [MAIN ] FLXR: Full history saved. [2025-09-26T18:52:24.788237] [INFO ] [MAIN ] Update Progress: 848/2371 symbols completed. FLXR took 19.2s. Estimated remaining: 3h 21m 48s. Rate: 7.5 symbols/min [2025-09-26T18:52:24.973697] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:52:24.981926] [DEBUG] [LOCAL ] FMN: Loaded 6073 existing records from primary storage. [2025-09-26T18:52:24.982057] [INFO ] [MAIN ] FMN: Loaded 6073 existing records. [2025-09-26T18:52:25.181608] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:52:25.181936] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-09-26T18:52:25.182011] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-09-26T18:52:25.182446] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-09-26T18:52:25.182506] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-09-26T18:52:25.566986] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-09-26T18:52:25.570192] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:52:25.610145] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-26T18:52:26.204919] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-26T18:52:26.356735] [INFO ] [REMOTE ] FMN: Fetching primary data for 2024-12. [2025-09-26T18:52:26.761502] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-26T18:52:27.156721] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-09-26T18:52:27.243133] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-26T18:52:27.956760] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-09-26T18:52:28.756745] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-09-26T18:52:28.999765] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-26T18:52:29.288918] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-26T18:52:29.556698] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-09-26T18:52:29.835004] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-26T18:52:29.845118] [INFO ] [REMOTE ] FLUT: Full fetch complete (72803 records). [2025-09-26T18:52:29.845265] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-09-26T18:52:30.277341] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-09-26T18:52:30.277458] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-09-26T18:52:30.278382] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-09-26T18:52:30.278451] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-09-26T18:52:30.280727] [DEBUG] [LOCAL ] FLUT: Trimmed 72803 records to 51580 (keeping 200 days of data) [2025-09-26T18:52:30.383591] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-09-26T18:52:30.616752] [DEBUG] [LOCAL ] FLUT: Primary data saved (51580 records). [2025-09-26T18:52:30.616899] [INFO ] [MAIN ] FLUT: Full history saved. [2025-09-26T18:52:30.617002] [INFO ] [MAIN ] Update Progress: 849/2371 symbols completed. FLUT took 31.8s. Estimated remaining: 3h 21m 36s. Rate: 7.5 symbols/min [2025-09-26T18:52:30.805669] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:52:30.842239] [DEBUG] [LOCAL ] FMS: Loaded 30619 existing records from primary storage. [2025-09-26T18:52:30.842384] [INFO ] [MAIN ] FMS: Loaded 30619 existing records. [2025-09-26T18:52:31.034379] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:52:31.034637] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-09-26T18:52:31.034720] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-09-26T18:52:31.035797] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-09-26T18:52:31.035859] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-09-26T18:52:31.158363] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-09-26T18:52:31.423493] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:52:31.456030] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-26T18:52:31.956769] [INFO ] [REMOTE ] FMS: Fetching primary data for 2024-12. [2025-09-26T18:52:32.216225] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-26T18:52:32.238630] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-26T18:52:32.756740] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-09-26T18:52:32.812407] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-26T18:52:33.556731] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-09-26T18:52:34.356701] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-09-26T18:52:34.407953] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-26T18:52:34.469469] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-26T18:52:35.156768] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-09-26T18:52:35.968186] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-09-26T18:52:35.975106] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-26T18:52:35.986194] [INFO ] [REMOTE ] FLS: Full fetch complete (71442 records). [2025-09-26T18:52:35.986420] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-09-26T18:52:36.421766] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-09-26T18:52:36.421901] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-09-26T18:52:36.422880] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-09-26T18:52:36.422992] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-09-26T18:52:36.424613] [DEBUG] [LOCAL ] FLS: Trimmed 71442 records to 50934 (keeping 200 days of data) [2025-09-26T18:52:36.677546] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-26T18:52:36.729043] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-26T18:52:36.756837] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-09-26T18:52:36.857398] [DEBUG] [LOCAL ] FLS: Primary data saved (50934 records). [2025-09-26T18:52:36.857614] [INFO ] [MAIN ] FLS: Full history saved. [2025-09-26T18:52:36.857804] [INFO ] [MAIN ] Update Progress: 850/2371 symbols completed. FLS took 49.9s. Estimated remaining: 3h 21m 25s. Rate: 7.6 symbols/min [2025-09-26T18:52:37.054674] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:52:37.106250] [DEBUG] [LOCAL ] FMX: Loaded 41039 existing records from primary storage. [2025-09-26T18:52:37.106459] [INFO ] [MAIN ] FMX: Loaded 41039 existing records. [2025-09-26T18:52:37.290362] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:52:37.290699] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-09-26T18:52:37.290790] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-09-26T18:52:37.292359] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-09-26T18:52:37.292423] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-09-26T18:52:37.561928] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-09-26T18:52:37.682154] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:52:37.948240] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-26T18:52:38.108867] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-26T18:52:38.356727] [INFO ] [REMOTE ] FMX: Fetching primary data for 2024-12. [2025-09-26T18:52:39.156724] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-09-26T18:52:39.600837] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-26T18:52:39.890457] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-26T18:52:39.956706] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-09-26T18:52:40.756723] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-09-26T18:52:41.422180] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-26T18:52:41.556723] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-09-26T18:52:41.827877] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-26T18:52:41.922579] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-26T18:52:42.356730] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-09-26T18:52:42.985178] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-26T18:52:43.156712] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-09-26T18:52:43.956747] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-09-26T18:52:44.542097] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-26T18:52:44.756738] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-09-26T18:52:44.868366] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-26T18:52:45.283541] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-26T18:52:45.285265] [INFO ] [REMOTE ] FMN: Full fetch complete (10082 records). [2025-09-26T18:52:45.285381] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-09-26T18:52:45.561894] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-09-26T18:52:45.683337] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-09-26T18:52:45.683417] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-09-26T18:52:45.683688] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-09-26T18:52:45.683748] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-09-26T18:52:45.684201] [DEBUG] [LOCAL ] FMN: Trimmed 10082 records to 6097 (keeping 200 days of data) [2025-09-26T18:52:45.723887] [DEBUG] [LOCAL ] FMN: Primary data saved (6097 records). [2025-09-26T18:52:45.724026] [INFO ] [MAIN ] FMN: Full history saved. [2025-09-26T18:52:45.724120] [INFO ] [MAIN ] Update Progress: 851/2371 symbols completed. FMN took 20.9s. Estimated remaining: 3h 21m 19s. Rate: 7.6 symbols/min [2025-09-26T18:52:45.904681] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:52:45.908037] [DEBUG] [LOCAL ] FMY: Loaded 1394 existing records from primary storage. [2025-09-26T18:52:45.908117] [INFO ] [MAIN ] FMY: Loaded 1394 existing records. [2025-09-26T18:52:46.102986] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:52:46.103359] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-09-26T18:52:46.103427] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-09-26T18:52:46.103713] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-09-26T18:52:46.103785] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-09-26T18:52:46.361881] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-09-26T18:52:46.478292] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:52:47.104252] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-26T18:52:47.156690] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-09-26T18:52:47.863315] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-26T18:52:47.956732] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-09-26T18:52:48.663077] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-26T18:52:48.756712] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-09-26T18:52:49.063694] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-26T18:52:49.556702] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-12. [2025-09-26T18:52:49.641939] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-26T18:52:49.838005] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-12 (0.28 seconds). [2025-09-26T18:52:50.356739] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-09-26T18:52:51.156722] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-09-26T18:52:51.549069] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-26T18:52:51.575483] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-26T18:52:51.956786] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-09-26T18:52:52.756725] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-09-26T18:52:53.556784] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-09-26T18:52:53.659375] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-26T18:52:53.670436] [INFO ] [REMOTE ] FMC: Full fetch complete (75002 records). [2025-09-26T18:52:53.670618] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-09-26T18:52:54.147868] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-09-26T18:52:54.148040] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-09-26T18:52:54.149142] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-09-26T18:52:54.149259] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-09-26T18:52:54.151276] [DEBUG] [LOCAL ] FMC: Trimmed 75002 records to 52560 (keeping 200 days of data) [2025-09-26T18:52:54.266533] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-26T18:52:54.365589] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-09-26T18:52:54.443841] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-26T18:52:54.549417] [DEBUG] [LOCAL ] FMC: Primary data saved (52560 records). [2025-09-26T18:52:54.549630] [INFO ] [MAIN ] FMC: Full history saved. [2025-09-26T18:52:54.549871] [INFO ] [MAIN ] Update Progress: 852/2371 symbols completed. FMC took 46.4s. Estimated remaining: 3h 21m 13s. Rate: 7.5 symbols/min [2025-09-26T18:52:54.739663] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:52:54.781411] [DEBUG] [LOCAL ] FN: Loaded 39626 existing records from primary storage. [2025-09-26T18:52:54.781561] [INFO ] [MAIN ] FN: Loaded 39626 existing records. [2025-09-26T18:52:54.871091] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-26T18:52:54.993204] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:52:54.993477] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-09-26T18:52:54.993528] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-09-26T18:52:54.995028] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-09-26T18:52:54.995092] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-09-26T18:52:55.156789] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-09-26T18:52:55.366529] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:52:55.956744] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-09-26T18:52:56.472785] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-26T18:52:56.479589] [INFO ] [REMOTE ] FMS: Full fetch complete (42330 records). [2025-09-26T18:52:56.479721] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-09-26T18:52:56.760693] [INFO ] [REMOTE ] FN: Fetching primary data for 2024-12. [2025-09-26T18:52:56.992607] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-09-26T18:52:56.992850] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-09-26T18:52:56.994004] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-09-26T18:52:56.994106] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-09-26T18:52:56.995701] [DEBUG] [LOCAL ] FMS: Trimmed 42330 records to 30771 (keeping 200 days of data) [2025-09-26T18:52:57.119623] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-26T18:52:57.226472] [DEBUG] [LOCAL ] FMS: Primary data saved (30771 records). [2025-09-26T18:52:57.226669] [INFO ] [MAIN ] FMS: Full history saved. [2025-09-26T18:52:57.226809] [INFO ] [MAIN ] Update Progress: 853/2371 symbols completed. FMS took 26.6s. Estimated remaining: 3h 20m 55s. Rate: 7.6 symbols/min [2025-09-26T18:52:57.411376] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:52:57.411573] [DEBUG] [LOCAL ] FNB: No existing data file found in primary storage. [2025-09-26T18:52:57.411612] [WARN ] [MAIN ] FNB: No existing data found, performing full refresh instead. [2025-09-26T18:52:57.411826] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-09-26T18:52:57.411870] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-09-26T18:52:57.411961] [DEBUG] [LOCAL ] FNB: No primary data file found to delete. [2025-09-26T18:52:57.412011] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-09-26T18:52:57.561839] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-09-26T18:52:57.805997] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:52:57.829056] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-26T18:52:57.919574] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-26T18:52:58.356760] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-09-26T18:52:58.810947] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-26T18:52:59.156732] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-09-26T18:52:59.455678] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-26T18:52:59.956800] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-09-26T18:53:00.756744] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-09-26T18:53:01.438194] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-26T18:53:01.465743] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-26T18:53:01.556788] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-09-26T18:53:02.356771] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-09-26T18:53:03.055516] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-26T18:53:03.093357] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-26T18:53:03.156769] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-09-26T18:53:03.956759] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-09-26T18:53:04.709006] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-26T18:53:04.756722] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-09-26T18:53:05.270477] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-26T18:53:05.556720] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-09-26T18:53:06.135521] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-26T18:53:06.356762] [INFO ] [REMOTE ] FNB: Fetching primary data for 2024-12. [2025-09-26T18:53:07.156757] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-09-26T18:53:07.396569] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-26T18:53:07.406071] [INFO ] [REMOTE ] FMX: Full fetch complete (57624 records). [2025-09-26T18:53:07.406235] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-09-26T18:53:07.700034] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-26T18:53:07.839767] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-09-26T18:53:07.839927] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-09-26T18:53:07.840886] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-09-26T18:53:07.840994] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-09-26T18:53:07.842479] [DEBUG] [LOCAL ] FMX: Trimmed 57624 records to 41276 (keeping 200 days of data) [2025-09-26T18:53:07.956706] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-09-26T18:53:08.000783] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-26T18:53:08.158367] [DEBUG] [LOCAL ] FMX: Primary data saved (41276 records). [2025-09-26T18:53:08.158506] [INFO ] [MAIN ] FMX: Full history saved. [2025-09-26T18:53:08.158615] [INFO ] [MAIN ] Update Progress: 854/2371 symbols completed. FMX took 31.3s. Estimated remaining: 3h 20m 53s. Rate: 7.6 symbols/min [2025-09-26T18:53:08.348178] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:53:08.400626] [DEBUG] [LOCAL ] FND: Loaded 52511 existing records from primary storage. [2025-09-26T18:53:08.400885] [INFO ] [MAIN ] FND: Loaded 52511 existing records. [2025-09-26T18:53:08.598526] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-26T18:53:08.619795] [INFO ] [REMOTE ] FMY: Full fetch complete (1962 records). [2025-09-26T18:53:08.620444] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-09-26T18:53:08.620155] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:53:08.621103] [FATAL] [VALIDATOR ] FMY: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:53:08.621458] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-09-26T18:53:08.621727] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-09-26T18:53:08.621576] [FATAL] [MAIN ] FMY: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:53:08.621872] [WARN ] [MAIN ] FMY: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:53:08.622004] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-09-26T18:53:08.622078] [DEBUG] [LOCAL ] FMY: No primary data file found to delete. [2025-09-26T18:53:08.622137] [INFO ] [LOCAL ] FMY: Starting deletion of derivative data. [2025-09-26T18:53:08.622586] [DEBUG] [LOCAL ] FMY: Deleted derivative data file. [2025-09-26T18:53:08.622840] [INFO ] [MAIN ] Update Progress: 855/2371 symbols completed. FMY took 22.9s. Estimated remaining: 3h 20m 31s. Rate: 7.6 symbols/min [2025-09-26T18:53:08.628761] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-09-26T18:53:08.658966] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-09-26T18:53:08.771992] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-09-26T18:53:08.979242] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:53:09.282291] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:53:09.303624] [DEBUG] [LOCAL ] FNF: Loaded 49513 existing records from primary storage. [2025-09-26T18:53:09.303801] [INFO ] [MAIN ] FNF: Loaded 49513 existing records. [2025-09-26T18:53:09.489822] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:53:09.490315] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-09-26T18:53:09.490402] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-09-26T18:53:09.492135] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-09-26T18:53:09.492202] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-09-26T18:53:09.561832] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-09-26T18:53:09.892006] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:53:10.356700] [INFO ] [REMOTE ] FNF: Fetching primary data for 2024-12. [2025-09-26T18:53:10.552841] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-26T18:53:10.749901] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-26T18:53:11.156766] [INFO ] [REMOTE ] FND: Fetching primary data for 2024-12. [2025-09-26T18:53:11.956783] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-09-26T18:53:12.405527] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-26T18:53:12.756757] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-09-26T18:53:12.894506] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-26T18:53:13.556731] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-09-26T18:53:13.716685] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-26T18:53:14.288791] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-26T18:53:14.356772] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-09-26T18:53:14.839920] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-26T18:53:15.156784] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-09-26T18:53:15.956695] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-09-26T18:53:16.065072] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-26T18:53:16.760158] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-09-26T18:53:16.765904] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-26T18:53:17.556734] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-09-26T18:53:17.858270] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-26T18:53:18.363580] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-09-26T18:53:18.383040] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-26T18:53:18.522926] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-26T18:53:19.156723] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-09-26T18:53:19.956707] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-09-26T18:53:20.235184] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-26T18:53:20.756744] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-09-26T18:53:20.850243] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-26T18:53:21.419097] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-26T18:53:21.556725] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-09-26T18:53:22.113379] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-26T18:53:22.356726] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-09-26T18:53:22.638828] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-26T18:53:23.156776] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-09-26T18:53:23.634047] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-26T18:53:23.956759] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-09-26T18:53:24.538438] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-26T18:53:24.756786] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-09-26T18:53:25.556735] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-09-26T18:53:25.891685] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-26T18:53:26.261908] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-26T18:53:26.356762] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-09-26T18:53:26.854674] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-26T18:53:27.156727] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-09-26T18:53:27.671048] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-26T18:53:27.956738] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-09-26T18:53:28.534684] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-26T18:53:28.542352] [INFO ] [REMOTE ] FN: Full fetch complete (56488 records). [2025-09-26T18:53:28.542492] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-09-26T18:53:28.766028] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-09-26T18:53:28.951240] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-09-26T18:53:28.951348] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-09-26T18:53:28.952221] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-09-26T18:53:28.952288] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-09-26T18:53:28.953568] [DEBUG] [LOCAL ] FN: Trimmed 56488 records to 39795 (keeping 200 days of data) [2025-09-26T18:53:29.203420] [DEBUG] [LOCAL ] FN: Primary data saved (39795 records). [2025-09-26T18:53:29.203682] [INFO ] [MAIN ] FN: Full history saved. [2025-09-26T18:53:29.203982] [INFO ] [MAIN ] Update Progress: 856/2371 symbols completed. FN took 34.7s. Estimated remaining: 3h 20m 46s. Rate: 7.5 symbols/min [2025-09-26T18:53:29.396045] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:53:29.427396] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-26T18:53:29.483168] [DEBUG] [LOCAL ] FNV: Loaded 46719 existing records from primary storage. [2025-09-26T18:53:29.483351] [INFO ] [MAIN ] FNV: Loaded 46719 existing records. [2025-09-26T18:53:29.561936] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-09-26T18:53:29.688988] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:53:29.689264] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-09-26T18:53:29.689313] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-09-26T18:53:29.690832] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-09-26T18:53:29.690895] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-09-26T18:53:30.080441] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:53:30.142885] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-26T18:53:30.356727] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-09-26T18:53:31.036846] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-26T18:53:31.156740] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-09-26T18:53:31.731835] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-26T18:53:31.956733] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-09-26T18:53:32.460602] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-26T18:53:32.756728] [INFO ] [REMOTE ] FNV: Fetching primary data for 2024-12. [2025-09-26T18:53:33.389993] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-26T18:53:33.556724] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-09-26T18:53:33.877296] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-26T18:53:34.356730] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-09-26T18:53:35.100990] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-26T18:53:35.112762] [INFO ] [REMOTE ] FNB: Full fetch complete (75763 records). [2025-09-26T18:53:35.112951] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-09-26T18:53:35.163860] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-09-26T18:53:35.547485] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-09-26T18:53:35.547679] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-09-26T18:53:35.548856] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-09-26T18:53:35.549048] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-09-26T18:53:35.550975] [DEBUG] [LOCAL ] FNB: Trimmed 75763 records to 53226 (keeping 200 days of data) [2025-09-26T18:53:35.676057] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-26T18:53:35.924695] [DEBUG] [LOCAL ] FNB: Primary data saved (53226 records). [2025-09-26T18:53:35.924858] [INFO ] [MAIN ] FNB: Full history saved. [2025-09-26T18:53:35.924942] [INFO ] [MAIN ] Update Progress: 857/2371 symbols completed. FNB took 38.7s. Estimated remaining: 3h 20m 36s. Rate: 7.5 symbols/min [2025-09-26T18:53:35.961919] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-09-26T18:53:36.106566] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:53:36.121137] [DEBUG] [LOCAL ] FOA: Loaded 13368 existing records from primary storage. [2025-09-26T18:53:36.121255] [INFO ] [MAIN ] FOA: Loaded 13368 existing records. [2025-09-26T18:53:36.307794] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:53:36.308117] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-09-26T18:53:36.308176] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-09-26T18:53:36.308769] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-09-26T18:53:36.308831] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-09-26T18:53:36.685803] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:53:36.720874] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-26T18:53:36.756721] [INFO ] [REMOTE ] FOA: Fetching primary data for 2024-12. [2025-09-26T18:53:37.362978] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-26T18:53:37.487378] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-26T18:53:37.556690] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-09-26T18:53:38.356722] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-09-26T18:53:38.648193] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-26T18:53:39.156735] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-09-26T18:53:39.956697] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-09-26T18:53:40.149571] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-26T18:53:40.159964] [INFO ] [REMOTE ] FND: Full fetch complete (74441 records). [2025-09-26T18:53:40.160100] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-09-26T18:53:40.579428] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-09-26T18:53:40.579667] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-09-26T18:53:40.580795] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-09-26T18:53:40.580899] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-09-26T18:53:40.582740] [DEBUG] [LOCAL ] FND: Trimmed 74441 records to 52871 (keeping 200 days of data) [2025-09-26T18:53:40.761397] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-09-26T18:53:40.836389] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-26T18:53:40.951349] [DEBUG] [LOCAL ] FND: Primary data saved (52871 records). [2025-09-26T18:53:40.951502] [INFO ] [MAIN ] FND: Full history saved. [2025-09-26T18:53:40.951608] [INFO ] [MAIN ] Update Progress: 858/2371 symbols completed. FND took 32.8s. Estimated remaining: 3h 20m 23s. Rate: 7.6 symbols/min [2025-09-26T18:53:41.137129] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:53:41.147898] [DEBUG] [LOCAL ] FOF: Loaded 8438 existing records from primary storage. [2025-09-26T18:53:41.148027] [INFO ] [MAIN ] FOF: Loaded 8438 existing records. [2025-09-26T18:53:41.340500] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:53:41.341100] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-09-26T18:53:41.341232] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-09-26T18:53:41.341806] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-09-26T18:53:41.341869] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-09-26T18:53:41.567082] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-26T18:53:41.565097] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-09-26T18:53:41.788986] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:53:42.016786] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-26T18:53:42.356731] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-09-26T18:53:43.156675] [INFO ] [REMOTE ] FOF: Fetching primary data for 2024-12. [2025-09-26T18:53:43.423763] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-26T18:53:43.956704] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-09-26T18:53:44.038486] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-26T18:53:44.068696] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-26T18:53:44.078340] [INFO ] [REMOTE ] FNF: Full fetch complete (69570 records). [2025-09-26T18:53:44.078485] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-09-26T18:53:44.498486] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-09-26T18:53:44.498586] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-09-26T18:53:44.499472] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-09-26T18:53:44.499548] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-09-26T18:53:44.501169] [DEBUG] [LOCAL ] FNF: Trimmed 69570 records to 49871 (keeping 200 days of data) [2025-09-26T18:53:44.756769] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-09-26T18:53:44.831252] [DEBUG] [LOCAL ] FNF: Primary data saved (49871 records). [2025-09-26T18:53:44.831413] [INFO ] [MAIN ] FNF: Full history saved. [2025-09-26T18:53:44.831527] [INFO ] [MAIN ] Update Progress: 859/2371 symbols completed. FNF took 36.2s. Estimated remaining: 3h 20m 8s. Rate: 7.6 symbols/min [2025-09-26T18:53:45.012872] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:53:45.033142] [DEBUG] [LOCAL ] FOR: Loaded 20256 existing records from primary storage. [2025-09-26T18:53:45.033295] [INFO ] [MAIN ] FOR: Loaded 20256 existing records. [2025-09-26T18:53:45.223850] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:53:45.224351] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-09-26T18:53:45.224605] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-09-26T18:53:45.225402] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-09-26T18:53:45.225483] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-09-26T18:53:45.580485] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-09-26T18:53:45.620736] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:53:45.629682] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-26T18:53:45.662904] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-26T18:53:46.356686] [INFO ] [REMOTE ] FOR: Fetching primary data for 2024-12. [2025-09-26T18:53:46.749635] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-26T18:53:47.056962] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-26T18:53:47.156755] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-09-26T18:53:47.956766] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-09-26T18:53:48.245134] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-26T18:53:48.756745] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-09-26T18:53:49.495270] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-26T18:53:49.556714] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-09-26T18:53:49.873987] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-26T18:53:50.356712] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-09-26T18:53:50.432034] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-26T18:53:51.144661] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-26T18:53:51.156673] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-09-26T18:53:51.956754] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-09-26T18:53:52.756721] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-09-26T18:53:52.810309] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-26T18:53:52.843239] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-26T18:53:53.430197] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-26T18:53:53.556733] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-09-26T18:53:54.356805] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-09-26T18:53:54.373617] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-26T18:53:55.156811] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-09-26T18:53:55.614423] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-26T18:53:55.956766] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-09-26T18:53:55.959897] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-26T18:53:56.756749] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-09-26T18:53:56.950602] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-26T18:53:57.556724] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-09-26T18:53:57.994257] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-26T18:53:58.070313] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-26T18:53:58.356742] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-09-26T18:53:59.156742] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-09-26T18:53:59.389122] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-26T18:53:59.641314] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-26T18:53:59.956714] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-09-26T18:54:00.756705] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-09-26T18:54:00.914500] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-26T18:54:01.556719] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-09-26T18:54:01.997960] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-26T18:54:02.016157] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-26T18:54:02.356751] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-09-26T18:54:03.152612] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-26T18:54:03.156672] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-09-26T18:54:03.836146] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-26T18:54:03.956717] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-09-26T18:54:04.756741] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-09-26T18:54:04.936566] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-26T18:54:04.939351] [INFO ] [REMOTE ] FOF: Full fetch complete (11899 records). [2025-09-26T18:54:04.939432] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-09-26T18:54:05.368428] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-09-26T18:54:05.368510] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-09-26T18:54:05.368817] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-09-26T18:54:05.368878] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-09-26T18:54:05.369376] [DEBUG] [LOCAL ] FOF: Trimmed 11899 records to 8510 (keeping 200 days of data) [2025-09-26T18:54:05.422877] [DEBUG] [LOCAL ] FOF: Primary data saved (8510 records). [2025-09-26T18:54:05.423037] [INFO ] [MAIN ] FOF: Full history saved. [2025-09-26T18:54:05.423135] [INFO ] [MAIN ] Update Progress: 860/2371 symbols completed. FOF took 24.5s. Estimated remaining: 3h 20m 22s. Rate: 7.5 symbols/min [2025-09-26T18:54:05.572039] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-09-26T18:54:05.608266] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:54:05.659375] [DEBUG] [LOCAL ] FOUR: Loaded 49917 existing records from primary storage. [2025-09-26T18:54:05.659550] [INFO ] [MAIN ] FOUR: Loaded 49917 existing records. [2025-09-26T18:54:05.844834] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:54:05.845134] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-09-26T18:54:05.845191] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-09-26T18:54:05.846408] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-09-26T18:54:05.846471] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-09-26T18:54:06.225231] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:54:06.356749] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-09-26T18:54:06.513349] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-26T18:54:06.524705] [INFO ] [REMOTE ] FNV: Full fetch complete (66099 records). [2025-09-26T18:54:06.524954] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-09-26T18:54:06.539247] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-26T18:54:06.978782] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-26T18:54:06.979082] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-09-26T18:54:06.979343] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-09-26T18:54:06.984375] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-09-26T18:54:06.984608] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-09-26T18:54:06.988701] [DEBUG] [LOCAL ] FNV: Trimmed 66099 records to 47028 (keeping 200 days of data) [2025-09-26T18:54:07.185855] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-09-26T18:54:07.307554] [DEBUG] [LOCAL ] FNV: Primary data saved (47028 records). [2025-09-26T18:54:07.307758] [INFO ] [MAIN ] FNV: Full history saved. [2025-09-26T18:54:07.307865] [INFO ] [MAIN ] Update Progress: 861/2371 symbols completed. FNV took 38.1s. Estimated remaining: 3h 20m 3s. Rate: 7.5 symbols/min [2025-09-26T18:54:07.500239] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:54:07.523452] [DEBUG] [LOCAL ] FPF: Loaded 17789 existing records from primary storage. [2025-09-26T18:54:07.523628] [INFO ] [MAIN ] FPF: Loaded 17789 existing records. [2025-09-26T18:54:07.755031] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:54:07.755790] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-09-26T18:54:07.755847] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-09-26T18:54:07.756753] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-09-26T18:54:07.756818] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-09-26T18:54:07.966469] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-09-26T18:54:08.156789] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:54:08.257622] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-26T18:54:08.756768] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-09-26T18:54:09.148862] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-26T18:54:09.152722] [INFO ] [REMOTE ] FOA: Full fetch complete (22485 records). [2025-09-26T18:54:09.152809] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-09-26T18:54:09.558637] [INFO ] [REMOTE ] FPF: Fetching primary data for 2024-12. [2025-09-26T18:54:09.590541] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-09-26T18:54:09.593777] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-09-26T18:54:09.595795] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-09-26T18:54:09.596082] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-09-26T18:54:09.600060] [DEBUG] [LOCAL ] FOA: Trimmed 22485 records to 13484 (keeping 200 days of data) [2025-09-26T18:54:09.691398] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-26T18:54:09.721393] [DEBUG] [LOCAL ] FOA: Primary data saved (13484 records). [2025-09-26T18:54:09.721576] [INFO ] [REMOTE ] FOR: Full fetch complete (29904 records). [2025-09-26T18:54:09.721795] [INFO ] [MAIN ] FOA: Full history saved. [2025-09-26T18:54:09.722148] [INFO ] [MAIN ] Update Progress: 862/2371 symbols completed. FOA took 33.8s. Estimated remaining: 3h 19m 46s. Rate: 7.6 symbols/min [2025-09-26T18:54:09.722263] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-09-26T18:54:10.125495] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:54:10.337754] [DEBUG] [LOCAL ] FPH: Loaded 19773 existing records from primary storage. [2025-09-26T18:54:10.348830] [INFO ] [MAIN ] FPH: Loaded 19773 existing records. [2025-09-26T18:54:10.361262] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2024-12. [2025-09-26T18:54:10.368032] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-09-26T18:54:10.390185] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-09-26T18:54:10.437595] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-09-26T18:54:10.455424] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-09-26T18:54:10.486761] [DEBUG] [LOCAL ] FOR: Trimmed 29904 records to 20362 (keeping 200 days of data) [2025-09-26T18:54:10.617916] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:54:10.640127] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-26T18:54:10.668073] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-09-26T18:54:10.682448] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-09-26T18:54:10.687777] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-09-26T18:54:10.687885] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-09-26T18:54:11.092362] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:54:11.100927] [DEBUG] [LOCAL ] FOR: Primary data saved (20362 records). [2025-09-26T18:54:11.101101] [INFO ] [MAIN ] FOR: Full history saved. [2025-09-26T18:54:11.101275] [INFO ] [MAIN ] Update Progress: 863/2371 symbols completed. FOR took 26.3s. Estimated remaining: 3h 19m 26s. Rate: 7.6 symbols/min [2025-09-26T18:54:11.164762] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-09-26T18:54:11.297117] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:54:11.341212] [DEBUG] [LOCAL ] FPI: Loaded 31331 existing records from primary storage. [2025-09-26T18:54:11.341361] [INFO ] [MAIN ] FPI: Loaded 31331 existing records. [2025-09-26T18:54:11.531490] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:54:11.531885] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-09-26T18:54:11.531942] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-09-26T18:54:11.533532] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-09-26T18:54:11.533599] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-09-26T18:54:11.911104] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:54:11.956700] [INFO ] [REMOTE ] FPH: Fetching primary data for 2024-12. [2025-09-26T18:54:12.252953] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-26T18:54:12.280071] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-26T18:54:12.756759] [INFO ] [REMOTE ] FPI: Fetching primary data for 2024-12. [2025-09-26T18:54:13.195887] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-26T18:54:13.556748] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-09-26T18:54:13.907093] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-26T18:54:14.356776] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-09-26T18:54:14.516573] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-26T18:54:15.156768] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-09-26T18:54:15.704257] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-26T18:54:15.831231] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-26T18:54:15.956748] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-09-26T18:54:16.756689] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-09-26T18:54:17.153782] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-26T18:54:17.429145] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-26T18:54:17.556724] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-09-26T18:54:18.356730] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-09-26T18:54:18.698467] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-26T18:54:19.156732] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-09-26T18:54:19.958360] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-09-26T18:54:19.961330] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-26T18:54:20.010084] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-26T18:54:20.756759] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-09-26T18:54:21.331385] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-26T18:54:21.556723] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-09-26T18:54:22.160291] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-26T18:54:22.356745] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-09-26T18:54:22.513346] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-26T18:54:23.156739] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-09-26T18:54:23.770037] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-26T18:54:23.956742] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-09-26T18:54:24.128160] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-26T18:54:24.756759] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-09-26T18:54:25.218698] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-26T18:54:25.556685] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-09-26T18:54:25.598633] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-26T18:54:26.356754] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-09-26T18:54:27.156757] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-09-26T18:54:27.233291] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-26T18:54:27.268500] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-26T18:54:27.783261] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-26T18:54:27.956748] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-09-26T18:54:28.756723] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-09-26T18:54:29.556726] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-09-26T18:54:29.674063] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-26T18:54:29.732359] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-26T18:54:30.251429] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-26T18:54:30.356733] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-09-26T18:54:31.156726] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-09-26T18:54:31.776973] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-26T18:54:31.798426] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-26T18:54:31.956723] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-09-26T18:54:32.756685] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-09-26T18:54:33.196387] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-26T18:54:33.480579] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-26T18:54:33.556752] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-09-26T18:54:34.356747] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-09-26T18:54:34.912395] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-26T18:54:34.918588] [INFO ] [REMOTE ] FPI: Full fetch complete (44127 records). [2025-09-26T18:54:34.918730] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-09-26T18:54:35.164053] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-09-26T18:54:35.338202] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-09-26T18:54:35.338310] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-09-26T18:54:35.339078] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-09-26T18:54:35.339147] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-09-26T18:54:35.340446] [DEBUG] [LOCAL ] FPI: Trimmed 44127 records to 31525 (keeping 200 days of data) [2025-09-26T18:54:35.550467] [DEBUG] [LOCAL ] FPI: Primary data saved (31525 records). [2025-09-26T18:54:35.550720] [INFO ] [MAIN ] FPI: Full history saved. [2025-09-26T18:54:35.550858] [INFO ] [MAIN ] Update Progress: 864/2371 symbols completed. FPI took 24.4s. Estimated remaining: 3h 19m 47s. Rate: 7.5 symbols/min [2025-09-26T18:54:35.731678] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:54:35.778852] [DEBUG] [LOCAL ] FR: Loaded 46867 existing records from primary storage. [2025-09-26T18:54:35.779008] [INFO ] [MAIN ] FR: Loaded 46867 existing records. [2025-09-26T18:54:35.979857] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-09-26T18:54:35.979620] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:54:35.981870] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-09-26T18:54:35.982159] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-09-26T18:54:35.993705] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-09-26T18:54:35.995171] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-26T18:54:35.995275] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-09-26T18:54:36.210583] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-26T18:54:36.439495] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:54:36.756704] [INFO ] [REMOTE ] FR: Fetching primary data for 2024-12. [2025-09-26T18:54:37.063251] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-26T18:54:37.556724] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-09-26T18:54:38.352461] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-26T18:54:38.361837] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-09-26T18:54:39.156703] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-09-26T18:54:39.286931] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-26T18:54:39.477087] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-26T18:54:39.487311] [INFO ] [REMOTE ] FOUR: Full fetch complete (71961 records). [2025-09-26T18:54:39.487519] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-09-26T18:54:39.932789] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-09-26T18:54:39.932926] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-09-26T18:54:39.934030] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-09-26T18:54:39.934123] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-09-26T18:54:39.947369] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-26T18:54:39.951773] [DEBUG] [LOCAL ] FOUR: Trimmed 71961 records to 50306 (keeping 200 days of data) [2025-09-26T18:54:39.954240] [INFO ] [REMOTE ] FPF: Full fetch complete (26346 records). [2025-09-26T18:54:39.954396] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-09-26T18:54:40.016201] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-09-26T18:54:40.558887] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-09-26T18:54:40.585536] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-09-26T18:54:40.587113] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-09-26T18:54:40.587238] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-09-26T18:54:40.594515] [DEBUG] [LOCAL ] FPF: Trimmed 26346 records to 17998 (keeping 200 days of data) [2025-09-26T18:54:40.740625] [DEBUG] [LOCAL ] FPF: Primary data saved (17998 records). [2025-09-26T18:54:40.765950] [INFO ] [MAIN ] FPF: Full history saved. [2025-09-26T18:54:40.771225] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-09-26T18:54:40.785504] [INFO ] [MAIN ] Update Progress: 865/2371 symbols completed. FPF took 33.5s. Estimated remaining: 3h 19m 34s. Rate: 7.5 symbols/min [2025-09-26T18:54:41.000884] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:54:41.016560] [DEBUG] [LOCAL ] FOUR: Primary data saved (50306 records). [2025-09-26T18:54:41.016820] [INFO ] [MAIN ] FOUR: Full history saved. [2025-09-26T18:54:41.016982] [INFO ] [MAIN ] Update Progress: 866/2371 symbols completed. FOUR took 35.6s. Estimated remaining: 3h 19m 13s. Rate: 7.6 symbols/min [2025-09-26T18:54:41.116394] [DEBUG] [LOCAL ] FRA: Loaded 14610 existing records from primary storage. [2025-09-26T18:54:41.139583] [INFO ] [MAIN ] FRA: Loaded 14610 existing records. [2025-09-26T18:54:41.333955] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:54:41.421916] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:54:41.422773] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-09-26T18:54:41.422882] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-09-26T18:54:41.427786] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-09-26T18:54:41.427896] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-09-26T18:54:41.544571] [DEBUG] [LOCAL ] FRGE: Loaded 18502 existing records from primary storage. [2025-09-26T18:54:41.548491] [INFO ] [MAIN ] FRGE: Loaded 18502 existing records. [2025-09-26T18:54:41.993219] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:54:42.078628] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-09-26T18:54:42.084123] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-09-26T18:54:42.085955] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-26T18:54:42.127078] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-09-26T18:54:42.096827] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-26T18:54:42.136184] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:54:42.143322] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-09-26T18:54:42.144682] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-09-26T18:54:42.357693] [INFO ] [REMOTE ] FRA: Fetching primary data for 2024-12. [2025-09-26T18:54:42.573358] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:54:43.156753] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2024-12. [2025-09-26T18:54:43.532588] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-26T18:54:43.699980] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-26T18:54:43.956734] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-09-26T18:54:44.218602] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-26T18:54:44.566947] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-26T18:54:44.756734] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-09-26T18:54:45.556737] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-09-26T18:54:46.024016] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-26T18:54:46.356736] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-09-26T18:54:46.885063] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-26T18:54:46.979784] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-26T18:54:47.156733] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-09-26T18:54:47.956788] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-09-26T18:54:48.756776] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-09-26T18:54:49.106605] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-26T18:54:49.174441] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-26T18:54:49.556733] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-09-26T18:54:49.742118] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-26T18:54:50.356768] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-09-26T18:54:51.156695] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-09-26T18:54:51.195143] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-26T18:54:51.233512] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-26T18:54:51.910789] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-26T18:54:51.915953] [INFO ] [REMOTE ] FPH: Full fetch complete (31463 records). [2025-09-26T18:54:51.916094] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-09-26T18:54:51.961866] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-09-26T18:54:52.330058] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-09-26T18:54:52.330140] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-09-26T18:54:52.330752] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-09-26T18:54:52.330815] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-09-26T18:54:52.331572] [DEBUG] [LOCAL ] FPH: Trimmed 31463 records to 19890 (keeping 200 days of data) [2025-09-26T18:54:52.450514] [DEBUG] [LOCAL ] FPH: Primary data saved (19890 records). [2025-09-26T18:54:52.450699] [INFO ] [MAIN ] FPH: Full history saved. [2025-09-26T18:54:52.450805] [INFO ] [MAIN ] Update Progress: 867/2371 symbols completed. FPH took 42.7s. Estimated remaining: 3h 19m 11s. Rate: 7.6 symbols/min [2025-09-26T18:54:52.636531] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:54:52.646750] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-26T18:54:52.708090] [DEBUG] [LOCAL ] FRO: Loaded 52243 existing records from primary storage. [2025-09-26T18:54:52.708284] [INFO ] [MAIN ] FRO: Loaded 52243 existing records. [2025-09-26T18:54:52.756824] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-09-26T18:54:52.897855] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:54:52.898180] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-09-26T18:54:52.898240] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-09-26T18:54:52.899735] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-09-26T18:54:52.899801] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-09-26T18:54:53.288115] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:54:53.556733] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-09-26T18:54:54.356691] [INFO ] [REMOTE ] FRO: Fetching primary data for 2024-12. [2025-09-26T18:54:54.538117] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-26T18:54:54.656090] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-26T18:54:55.156730] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-09-26T18:54:55.956700] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-09-26T18:54:56.298816] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-26T18:54:56.377829] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-26T18:54:56.756778] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-09-26T18:54:57.231380] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-26T18:54:57.556732] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-09-26T18:54:57.797553] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-26T18:54:58.169872] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-26T18:54:58.356750] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-09-26T18:54:59.156771] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-09-26T18:54:59.956730] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-09-26T18:54:59.989274] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-26T18:55:00.239394] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-26T18:55:00.756763] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-09-26T18:55:00.882623] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-26T18:55:01.556727] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-09-26T18:55:02.361093] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-09-26T18:55:02.383235] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T18:55:02.401511] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-26T18:55:02.405098] [INFO ] [REMOTE ] FRA: Full fetch complete (24096 records). [2025-09-26T18:55:02.405196] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-09-26T18:55:02.811161] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-09-26T18:55:02.811259] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-09-26T18:55:02.811836] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-09-26T18:55:02.811900] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-09-26T18:55:02.813174] [DEBUG] [LOCAL ] FRA: Trimmed 24096 records to 14717 (keeping 200 days of data) [2025-09-26T18:55:02.914281] [DEBUG] [LOCAL ] FRA: Primary data saved (14717 records). [2025-09-26T18:55:02.914437] [INFO ] [MAIN ] FRA: Full history saved. [2025-09-26T18:55:02.914589] [INFO ] [MAIN ] Update Progress: 868/2371 symbols completed. FRA took 22.1s. Estimated remaining: 3h 19m 8s. Rate: 7.5 symbols/min [2025-09-26T18:55:03.105487] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:55:03.153765] [DEBUG] [LOCAL ] FRT: Loaded 42561 existing records from primary storage. [2025-09-26T18:55:03.153917] [INFO ] [MAIN ] FRT: Loaded 42561 existing records. [2025-09-26T18:55:03.166739] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-09-26T18:55:03.353992] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:55:03.354303] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-09-26T18:55:03.354420] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-09-26T18:55:03.355530] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-09-26T18:55:03.355594] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-09-26T18:55:03.542804] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-26T18:55:03.767594] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:55:03.956784] [INFO ] [REMOTE ] FRT: Fetching primary data for 2024-12. [2025-09-26T18:55:04.756750] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-09-26T18:55:05.299099] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-26T18:55:05.479517] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-26T18:55:05.556743] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-09-26T18:55:05.613933] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-26T18:55:06.356769] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-09-26T18:55:06.921626] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-26T18:55:07.156745] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-09-26T18:55:07.956737] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-09-26T18:55:08.535688] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-26T18:55:08.714528] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-26T18:55:08.756735] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-09-26T18:55:09.425184] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-26T18:55:09.434312] [INFO ] [REMOTE ] FR: Full fetch complete (66550 records). [2025-09-26T18:55:09.434491] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-09-26T18:55:09.561815] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-09-26T18:55:09.870965] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-09-26T18:55:09.871111] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-09-26T18:55:09.872093] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-09-26T18:55:09.872161] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-09-26T18:55:09.873634] [DEBUG] [LOCAL ] FR: Trimmed 66550 records to 47174 (keeping 200 days of data) [2025-09-26T18:55:10.178931] [DEBUG] [LOCAL ] FR: Primary data saved (47174 records). [2025-09-26T18:55:10.179086] [INFO ] [MAIN ] FR: Full history saved. [2025-09-26T18:55:10.179192] [INFO ] [MAIN ] Update Progress: 869/2371 symbols completed. FR took 34.6s. Estimated remaining: 3h 18m 58s. Rate: 7.5 symbols/min [2025-09-26T18:55:10.375290] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:55:10.370561] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-09-26T18:55:10.413441] [DEBUG] [LOCAL ] FSCO: Loaded 37342 existing records from primary storage. [2025-09-26T18:55:10.413662] [INFO ] [MAIN ] FSCO: Loaded 37342 existing records. [2025-09-26T18:55:10.619543] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:55:10.635856] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-09-26T18:55:10.656250] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-26T18:55:10.655067] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-09-26T18:55:10.665674] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-09-26T18:55:10.657956] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-26T18:55:10.666396] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-09-26T18:55:11.061735] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:55:11.156755] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-09-26T18:55:11.956769] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2024-12. [2025-09-26T18:55:12.272791] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-26T18:55:12.365593] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-26T18:55:12.756772] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-09-26T18:55:13.107720] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-26T18:55:13.556735] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-09-26T18:55:14.361811] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-09-26T18:55:14.381742] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-26T18:55:14.956406] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-26T18:55:15.031390] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-26T18:55:15.156747] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-09-26T18:55:15.956731] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-09-26T18:55:16.673273] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-26T18:55:16.756778] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-09-26T18:55:17.340338] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-26T18:55:17.556734] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-09-26T18:55:18.216393] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-26T18:55:18.356751] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-09-26T18:55:19.156794] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-09-26T18:55:19.536108] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-26T18:55:19.599576] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-26T18:55:19.769958] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-26T18:55:19.774260] [INFO ] [REMOTE ] FRGE: Full fetch complete (33478 records). [2025-09-26T18:55:19.774477] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-09-26T18:55:19.956735] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-09-26T18:55:20.199478] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-09-26T18:55:20.199568] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-09-26T18:55:20.200241] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-09-26T18:55:20.200310] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-09-26T18:55:20.201376] [DEBUG] [LOCAL ] FRGE: Trimmed 33478 records to 18571 (keeping 200 days of data) [2025-09-26T18:55:20.320943] [DEBUG] [LOCAL ] FRGE: Primary data saved (18571 records). [2025-09-26T18:55:20.321099] [INFO ] [MAIN ] FRGE: Full history saved. [2025-09-26T18:55:20.321226] [INFO ] [MAIN ] Update Progress: 870/2371 symbols completed. FRGE took 39.3s. Estimated remaining: 3h 18m 54s. Rate: 7.5 symbols/min [2025-09-26T18:55:20.538751] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:55:20.594303] [DEBUG] [LOCAL ] FSK: Loaded 49795 existing records from primary storage. [2025-09-26T18:55:20.594460] [INFO ] [MAIN ] FSK: Loaded 49795 existing records. [2025-09-26T18:55:20.786197] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-09-26T18:55:20.793574] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:55:20.794872] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-09-26T18:55:20.794941] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-09-26T18:55:20.796704] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-09-26T18:55:20.796781] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-09-26T18:55:21.216135] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:55:21.556719] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-09-26T18:55:21.967929] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-26T18:55:22.045958] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-26T18:55:22.356737] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-09-26T18:55:22.662807] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-26T18:55:23.156738] [INFO ] [REMOTE ] FSK: Fetching primary data for 2024-12. [2025-09-26T18:55:23.956699] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-09-26T18:55:24.053763] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-26T18:55:24.064496] [INFO ] [REMOTE ] FRO: Full fetch complete (75362 records). [2025-09-26T18:55:24.064692] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-09-26T18:55:24.568223] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-09-26T18:55:24.568429] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-09-26T18:55:24.569635] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-09-26T18:55:24.569796] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-09-26T18:55:24.572018] [DEBUG] [LOCAL ] FRO: Trimmed 75362 records to 52603 (keeping 200 days of data) [2025-09-26T18:55:24.710938] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-26T18:55:24.808227] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-09-26T18:55:24.963048] [DEBUG] [LOCAL ] FRO: Primary data saved (52603 records). [2025-09-26T18:55:24.963201] [INFO ] [MAIN ] FRO: Full history saved. [2025-09-26T18:55:24.964382] [INFO ] [MAIN ] Update Progress: 871/2371 symbols completed. FRO took 32.5s. Estimated remaining: 3h 18m 41s. Rate: 7.5 symbols/min [2025-09-26T18:55:25.151609] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:55:25.206335] [DEBUG] [LOCAL ] FSLY: Loaded 51629 existing records from primary storage. [2025-09-26T18:55:25.206494] [INFO ] [MAIN ] FSLY: Loaded 51629 existing records. [2025-09-26T18:55:25.369526] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-26T18:55:25.451901] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:55:25.452206] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-09-26T18:55:25.452256] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-09-26T18:55:25.453819] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-09-26T18:55:25.453883] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-09-26T18:55:25.561872] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-09-26T18:55:25.859819] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:55:26.229603] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-26T18:55:26.356775] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2024-12. [2025-09-26T18:55:26.800062] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-26T18:55:27.156751] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-09-26T18:55:27.956734] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-09-26T18:55:28.113957] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-26T18:55:28.171175] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-26T18:55:28.756744] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-09-26T18:55:29.255027] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-26T18:55:29.556725] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-09-26T18:55:30.080403] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-26T18:55:30.088601] [INFO ] [REMOTE ] FRT: Full fetch complete (60264 records). [2025-09-26T18:55:30.088814] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-09-26T18:55:30.365083] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-09-26T18:55:30.516706] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-09-26T18:55:30.516826] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-09-26T18:55:30.517834] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-09-26T18:55:30.517958] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-09-26T18:55:30.526764] [DEBUG] [LOCAL ] FRT: Trimmed 60264 records to 42808 (keeping 200 days of data) [2025-09-26T18:55:30.541241] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-26T18:55:30.816859] [DEBUG] [LOCAL ] FRT: Primary data saved (42808 records). [2025-09-26T18:55:30.816998] [INFO ] [MAIN ] FRT: Full history saved. [2025-09-26T18:55:30.817086] [INFO ] [MAIN ] Update Progress: 872/2371 symbols completed. FRT took 27.9s. Estimated remaining: 3h 18m 29s. Rate: 7.6 symbols/min [2025-09-26T18:55:31.003544] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:55:31.060230] [DEBUG] [LOCAL ] FSM: Loaded 53675 existing records from primary storage. [2025-09-26T18:55:31.060415] [INFO ] [MAIN ] FSM: Loaded 53675 existing records. [2025-09-26T18:55:31.161962] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-09-26T18:55:31.262720] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:55:31.262990] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-09-26T18:55:31.263039] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-09-26T18:55:31.264992] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-09-26T18:55:31.265091] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-09-26T18:55:31.646925] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:55:31.956754] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-09-26T18:55:32.218632] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-26T18:55:32.753142] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-26T18:55:32.761865] [INFO ] [REMOTE ] FSM: Fetching primary data for 2024-12. [2025-09-26T18:55:33.319059] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-26T18:55:33.556742] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-09-26T18:55:34.145452] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-26T18:55:34.356757] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-09-26T18:55:35.057548] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-26T18:55:35.156784] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-09-26T18:55:35.781422] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-26T18:55:35.956726] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-09-26T18:55:36.667166] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-26T18:55:36.756685] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-09-26T18:55:37.556727] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-09-26T18:55:37.612349] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-26T18:55:38.070053] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-26T18:55:38.078524] [INFO ] [REMOTE ] FSCO: Full fetch complete (54152 records). [2025-09-26T18:55:38.078684] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-09-26T18:55:38.365592] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-09-26T18:55:38.494065] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-09-26T18:55:38.494205] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-09-26T18:55:38.495299] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-09-26T18:55:38.495377] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-09-26T18:55:38.497223] [DEBUG] [LOCAL ] FSCO: Trimmed 54152 records to 37725 (keeping 200 days of data) [2025-09-26T18:55:38.753378] [DEBUG] [LOCAL ] FSCO: Primary data saved (37725 records). [2025-09-26T18:55:38.753577] [INFO ] [MAIN ] FSCO: Full history saved. [2025-09-26T18:55:38.753725] [INFO ] [MAIN ] Update Progress: 873/2371 symbols completed. FSCO took 28.6s. Estimated remaining: 3h 18m 21s. Rate: 7.6 symbols/min [2025-09-26T18:55:38.936473] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:55:38.981254] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-26T18:55:39.026245] [DEBUG] [LOCAL ] FSS: Loaded 34689 existing records from primary storage. [2025-09-26T18:55:39.026457] [INFO ] [MAIN ] FSS: Loaded 34689 existing records. [2025-09-26T18:55:39.173908] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-09-26T18:55:39.222150] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:55:39.222552] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-09-26T18:55:39.222616] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-09-26T18:55:39.224264] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-09-26T18:55:39.224332] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-09-26T18:55:39.598542] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:55:39.743007] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-26T18:55:39.956769] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-09-26T18:55:40.756782] [INFO ] [REMOTE ] FSS: Fetching primary data for 2024-12. [2025-09-26T18:55:40.997175] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-26T18:55:41.565895] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-09-26T18:55:41.572426] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-26T18:55:41.639146] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-26T18:55:42.356789] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-09-26T18:55:43.040234] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T18:55:43.156827] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-09-26T18:55:43.640962] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-26T18:55:43.956799] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-09-26T18:55:44.756742] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-09-26T18:55:45.159184] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-26T18:55:45.556808] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-09-26T18:55:45.655486] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-26T18:55:46.275776] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-26T18:55:46.356768] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-09-26T18:55:46.508354] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-26T18:55:47.156767] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-09-26T18:55:47.956814] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-09-26T18:55:48.330997] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-26T18:55:48.429700] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-26T18:55:48.440446] [INFO ] [REMOTE ] FSK: Full fetch complete (71431 records). [2025-09-26T18:55:48.440681] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-09-26T18:55:48.756988] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-09-26T18:55:48.861350] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-09-26T18:55:48.861477] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-09-26T18:55:48.862462] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-09-26T18:55:48.862555] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-09-26T18:55:48.864148] [DEBUG] [LOCAL ] FSK: Trimmed 71431 records to 50173 (keeping 200 days of data) [2025-09-26T18:55:49.192101] [DEBUG] [LOCAL ] FSK: Primary data saved (50173 records). [2025-09-26T18:55:49.192294] [INFO ] [MAIN ] FSK: Full history saved. [2025-09-26T18:55:49.192413] [INFO ] [MAIN ] Update Progress: 874/2371 symbols completed. FSK took 28.9s. Estimated remaining: 3h 18m 17s. Rate: 7.5 symbols/min [2025-09-26T18:55:49.381138] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:55:49.390236] [DEBUG] [LOCAL ] FT: Loaded 6371 existing records from primary storage. [2025-09-26T18:55:49.390373] [INFO ] [MAIN ] FT: Loaded 6371 existing records. [2025-09-26T18:55:49.599188] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:55:49.578051] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-09-26T18:55:49.626574] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-09-26T18:55:49.626779] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-09-26T18:55:49.627765] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-09-26T18:55:49.630350] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-26T18:55:49.630517] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-09-26T18:55:50.029417] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:55:50.205432] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-26T18:55:50.356728] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-09-26T18:55:50.934463] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-26T18:55:51.156781] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-09-26T18:55:51.834949] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-26T18:55:51.956760] [INFO ] [REMOTE ] FT: Fetching primary data for 2024-12. [2025-09-26T18:55:52.370497] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-26T18:55:52.393474] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-26T18:55:52.756787] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-09-26T18:55:53.556728] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-09-26T18:55:54.356800] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-09-26T18:55:54.587226] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-26T18:55:54.635961] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-26T18:55:55.007235] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-26T18:55:55.156809] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-09-26T18:55:55.756408] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-26T18:55:55.956775] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-09-26T18:55:56.756760] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-09-26T18:55:57.556712] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-09-26T18:55:57.681018] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-26T18:55:58.145427] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-26T18:55:58.356766] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-09-26T18:55:58.409683] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-26T18:55:59.157423] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-09-26T18:55:59.157320] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-26T18:55:59.956853] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-09-26T18:56:00.756784] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-09-26T18:56:00.771436] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-26T18:56:01.020600] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-26T18:56:01.031114] [INFO ] [REMOTE ] FSLY: Full fetch complete (74919 records). [2025-09-26T18:56:01.031264] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-09-26T18:56:01.443318] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-09-26T18:56:01.443419] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-09-26T18:56:01.444340] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-09-26T18:56:01.444406] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-09-26T18:56:01.446013] [DEBUG] [LOCAL ] FSLY: Trimmed 74919 records to 51989 (keeping 200 days of data) [2025-09-26T18:56:01.560884] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-09-26T18:56:01.773280] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-26T18:56:01.794423] [DEBUG] [LOCAL ] FSLY: Primary data saved (51989 records). [2025-09-26T18:56:01.794557] [INFO ] [MAIN ] FSLY: Full history saved. [2025-09-26T18:56:01.795016] [INFO ] [MAIN ] Update Progress: 875/2371 symbols completed. FSLY took 36.8s. Estimated remaining: 3h 18m 17s. Rate: 7.5 symbols/min [2025-09-26T18:56:01.977397] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:56:01.992267] [DEBUG] [LOCAL ] FTHY: Loaded 11807 existing records from primary storage. [2025-09-26T18:56:01.992400] [INFO ] [MAIN ] FTHY: Loaded 11807 existing records. [2025-09-26T18:56:02.107476] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-26T18:56:02.188039] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:56:02.188333] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-09-26T18:56:02.188383] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-09-26T18:56:02.188963] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-09-26T18:56:02.189024] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-09-26T18:56:02.358780] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-09-26T18:56:02.616470] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:56:03.156745] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-09-26T18:56:03.837342] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-26T18:56:03.956741] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-09-26T18:56:04.122081] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-26T18:56:04.438596] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-26T18:56:04.756753] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-09-26T18:56:05.556737] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-09-26T18:56:05.631534] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-26T18:56:05.633534] [INFO ] [REMOTE ] FT: Full fetch complete (9046 records). [2025-09-26T18:56:05.633607] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-09-26T18:56:06.014510] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-09-26T18:56:06.014590] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-09-26T18:56:06.014838] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-09-26T18:56:06.014898] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-09-26T18:56:06.015340] [DEBUG] [LOCAL ] FT: Trimmed 9046 records to 6432 (keeping 200 days of data) [2025-09-26T18:56:06.067754] [DEBUG] [LOCAL ] FT: Primary data saved (6432 records). [2025-09-26T18:56:06.068195] [INFO ] [MAIN ] FT: Full history saved. [2025-09-26T18:56:06.068865] [INFO ] [MAIN ] Update Progress: 876/2371 symbols completed. FT took 16.9s. Estimated remaining: 3h 18m 3s. Rate: 7.5 symbols/min [2025-09-26T18:56:06.263305] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:56:06.263541] [DEBUG] [LOCAL ] FTI: No existing data file found in primary storage. [2025-09-26T18:56:06.263594] [WARN ] [MAIN ] FTI: No existing data found, performing full refresh instead. [2025-09-26T18:56:06.263774] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-09-26T18:56:06.263822] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-09-26T18:56:06.263892] [DEBUG] [LOCAL ] FTI: No primary data file found to delete. [2025-09-26T18:56:06.263960] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-09-26T18:56:06.362684] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2024-12. [2025-09-26T18:56:06.646376] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:56:06.919753] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-26T18:56:07.015496] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-26T18:56:07.156754] [INFO ] [REMOTE ] FTI: Fetching primary data for 2024-12. [2025-09-26T18:56:07.956736] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-09-26T18:56:08.756738] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-09-26T18:56:09.072760] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-26T18:56:09.260269] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-26T18:56:09.556721] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-09-26T18:56:10.356752] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-09-26T18:56:10.691164] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-26T18:56:10.864422] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-26T18:56:10.886166] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-26T18:56:11.156749] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-09-26T18:56:11.956734] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-09-26T18:56:12.756745] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-09-26T18:56:13.335267] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-26T18:56:13.346183] [INFO ] [REMOTE ] FSM: Full fetch complete (76729 records). [2025-09-26T18:56:13.346351] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-09-26T18:56:13.484252] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-26T18:56:13.559306] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-09-26T18:56:13.742261] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-26T18:56:13.781240] [INFO ] [REMOTE ] FSS: Full fetch complete (48248 records). [2025-09-26T18:56:13.791782] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-09-26T18:56:13.953669] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-09-26T18:56:13.965364] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-09-26T18:56:13.993304] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-09-26T18:56:13.999218] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-09-26T18:56:14.085480] [DEBUG] [LOCAL ] FSM: Trimmed 76729 records to 54065 (keeping 200 days of data) [2025-09-26T18:56:14.361042] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-09-26T18:56:14.433387] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-09-26T18:56:14.434099] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-09-26T18:56:14.435297] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-09-26T18:56:14.435617] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-09-26T18:56:14.445070] [DEBUG] [LOCAL ] FSS: Trimmed 48248 records to 34888 (keeping 200 days of data) [2025-09-26T18:56:14.906107] [DEBUG] [LOCAL ] FSM: Primary data saved (54065 records). [2025-09-26T18:56:14.906900] [INFO ] [MAIN ] FSM: Full history saved. [2025-09-26T18:56:14.907084] [INFO ] [MAIN ] Update Progress: 877/2371 symbols completed. FSM took 44.1s. Estimated remaining: 3h 17m 57s. Rate: 7.5 symbols/min [2025-09-26T18:56:14.919457] [DEBUG] [LOCAL ] FSS: Primary data saved (34888 records). [2025-09-26T18:56:14.919595] [INFO ] [MAIN ] FSS: Full history saved. [2025-09-26T18:56:14.919736] [INFO ] [MAIN ] Update Progress: 878/2371 symbols completed. FSS took 36.2s. Estimated remaining: 3h 17m 35s. Rate: 7.6 symbols/min [2025-09-26T18:56:15.177547] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-26T18:56:15.180604] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-09-26T18:56:15.290588] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-26T18:56:15.956696] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-09-26T18:56:16.096199] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-26T18:56:16.756735] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-09-26T18:56:17.471444] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-26T18:56:17.527369] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-26T18:56:17.556734] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-09-26T18:56:18.356787] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-09-26T18:56:18.389876] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-26T18:56:19.156753] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-09-26T18:56:20.090756] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-26T18:56:20.094072] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-09-26T18:56:20.188843] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-26T18:56:20.756748] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-09-26T18:56:21.031712] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-26T18:56:21.556735] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-09-26T18:56:22.319930] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-26T18:56:22.340936] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-26T18:56:22.345294] [INFO ] [REMOTE ] FTHY: Full fetch complete (17597 records). [2025-09-26T18:56:22.345449] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-09-26T18:56:22.383971] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-09-26T18:56:22.804901] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-09-26T18:56:22.805019] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-09-26T18:56:22.805421] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-09-26T18:56:22.805561] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-09-26T18:56:22.806526] [DEBUG] [LOCAL ] FTHY: Trimmed 17597 records to 11947 (keeping 200 days of data) [2025-09-26T18:56:22.891423] [DEBUG] [LOCAL ] FTHY: Primary data saved (11947 records). [2025-09-26T18:56:22.891575] [INFO ] [MAIN ] FTHY: Full history saved. [2025-09-26T18:56:22.891691] [INFO ] [MAIN ] Update Progress: 879/2371 symbols completed. FTHY took 21.1s. Estimated remaining: 3h 17m 27s. Rate: 7.6 symbols/min [2025-09-26T18:56:24.206784] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-26T18:56:24.218470] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-09-26T18:56:25.959797] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-26T18:56:25.973416] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-09-26T18:56:27.823689] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-26T18:56:27.835411] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-09-26T18:56:29.796593] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-26T18:56:29.807474] [INFO ] [REMOTE ] FTI: Full fetch complete (77124 records). [2025-09-26T18:56:29.807706] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-09-26T18:56:30.239891] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-09-26T18:56:30.240021] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-09-26T18:56:30.241053] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-09-26T18:56:30.241123] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-09-26T18:56:30.242708] [DEBUG] [LOCAL ] FTI: Trimmed 77124 records to 54078 (keeping 200 days of data) [2025-09-26T18:56:30.602696] [DEBUG] [LOCAL ] FTI: Primary data saved (54078 records). [2025-09-26T18:56:30.602927] [INFO ] [MAIN ] FTI: Full history saved. [2025-09-26T18:56:30.603039] [INFO ] [MAIN ] Update Progress: 880/2371 symbols completed. FTI took 24.5s. Estimated remaining: 3h 17m 19s. Rate: 7.6 symbols/min [2025-09-26T18:56:31.259798] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:56:31.327234] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:56:31.333334] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:56:31.385435] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:56:31.394351] [DEBUG] [LOCAL ] FTWO: Loaded 1806 existing records from primary storage. [2025-09-26T18:56:31.394724] [INFO ] [MAIN ] FTWO: Loaded 1806 existing records. [2025-09-26T18:56:31.549458] [DEBUG] [LOCAL ] FTK: Loaded 32527 existing records from primary storage. [2025-09-26T18:56:31.582210] [INFO ] [MAIN ] FTK: Loaded 32527 existing records. [2025-09-26T18:56:31.747197] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:56:31.758875] [DEBUG] [LOCAL ] FTS: Loaded 42414 existing records from primary storage. [2025-09-26T18:56:31.826882] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-09-26T18:56:31.821521] [INFO ] [MAIN ] FTS: Loaded 42414 existing records. [2025-09-26T18:56:31.862761] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-09-26T18:56:31.874799] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-09-26T18:56:31.869071] [DEBUG] [LOCAL ] FTV: Loaded 53303 existing records from primary storage. [2025-09-26T18:56:31.974467] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-09-26T18:56:31.970921] [INFO ] [MAIN ] FTV: Loaded 53303 existing records. [2025-09-26T18:56:31.984469] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:56:32.099288] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-09-26T18:56:32.142608] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-09-26T18:56:32.234709] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-09-26T18:56:32.274287] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-09-26T18:56:32.504247] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:56:32.671180] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-09-26T18:56:32.690066] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-09-26T18:56:32.652001] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:56:32.716817] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-09-26T18:56:32.711601] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-09-26T18:56:32.733449] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-09-26T18:56:32.766247] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-09-26T18:56:32.849006] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-09-26T18:56:32.925000] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-09-26T18:56:33.355325] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:56:33.418625] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2024-12. [2025-09-26T18:56:33.570780] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:56:33.616877] [INFO ] [REMOTE ] FTK: Fetching primary data for 2024-12. [2025-09-26T18:56:33.964169] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:56:33.961345] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:56:33.964528] [INFO ] [REMOTE ] FTV: Fetching primary data for 2024-12. [2025-09-26T18:56:33.964826] [INFO ] [REMOTE ] FTS: Fetching primary data for 2024-12. [2025-09-26T18:56:34.186555] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-26T18:56:34.188279] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-09-26T18:56:34.883018] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-26T18:56:34.884732] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-09-26T18:56:35.002803] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-26T18:56:35.008150] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-09-26T18:56:35.441100] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-26T18:56:35.442616] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-09-26T18:56:35.551330] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-26T18:56:35.559735] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-09-26T18:56:35.702516] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-26T18:56:35.713731] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-09-26T18:56:35.764552] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-26T18:56:35.765834] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-09-26T18:56:36.001503] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-26T18:56:36.007280] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-09-26T18:56:36.107937] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-26T18:56:36.109234] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-09-26T18:56:36.403234] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-26T18:56:36.404318] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-09-26T18:56:36.703323] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-26T18:56:36.723719] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-26T18:56:36.739303] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-26T18:56:36.756727] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-09-26T18:56:36.974619] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-26T18:56:37.556753] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-09-26T18:56:38.356723] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-09-26T18:56:38.402943] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-26T18:56:38.795043] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-26T18:56:39.156744] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-09-26T18:56:39.851896] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-26T18:56:39.956762] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-09-26T18:56:40.317109] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-26T18:56:40.344478] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-26T18:56:40.756773] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-09-26T18:56:41.556714] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-09-26T18:56:41.907280] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-26T18:56:42.356760] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-09-26T18:56:43.150718] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-26T18:56:43.161536] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-09-26T18:56:43.577066] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-26T18:56:43.956745] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-09-26T18:56:44.292503] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-26T18:56:44.756760] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-09-26T18:56:45.173560] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-26T18:56:45.556749] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-09-26T18:56:45.878848] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-26T18:56:45.917748] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-26T18:56:46.356748] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-09-26T18:56:47.156730] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-09-26T18:56:47.709460] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-26T18:56:47.710542] [INFO ] [REMOTE ] FTWO: Full fetch complete (3466 records). [2025-09-26T18:56:47.710618] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-09-26T18:56:47.958113] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-09-26T18:56:48.106226] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-09-26T18:56:48.106432] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-09-26T18:56:48.106615] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-09-26T18:56:48.106706] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-09-26T18:56:48.107073] [DEBUG] [LOCAL ] FTWO: Trimmed 3466 records to 1837 (keeping 200 days of data) [2025-09-26T18:56:48.118678] [DEBUG] [LOCAL ] FTWO: Primary data saved (1837 records). [2025-09-26T18:56:48.118755] [INFO ] [MAIN ] FTWO: Full history saved. [2025-09-26T18:56:48.118835] [INFO ] [MAIN ] Update Progress: 881/2371 symbols completed. FTWO took 17.5s. Estimated remaining: 3h 17m 27s. Rate: 7.5 symbols/min [2025-09-26T18:56:48.297607] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:56:48.330610] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-26T18:56:48.390551] [DEBUG] [LOCAL ] FUBO: Loaded 54088 existing records from primary storage. [2025-09-26T18:56:48.390779] [INFO ] [MAIN ] FUBO: Loaded 54088 existing records. [2025-09-26T18:56:48.575374] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:56:48.575667] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-09-26T18:56:48.575728] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-09-26T18:56:48.577119] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-09-26T18:56:48.577213] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-09-26T18:56:48.766019] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-09-26T18:56:48.949613] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:56:49.508508] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T18:56:49.556679] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-09-26T18:56:50.356703] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-09-26T18:56:50.428499] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-26T18:56:51.123521] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-26T18:56:51.156684] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-09-26T18:56:51.956723] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2024-12. [2025-09-26T18:56:52.300114] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-26T18:56:52.661848] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-26T18:56:52.756798] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-09-26T18:56:53.556735] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-09-26T18:56:53.721397] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-26T18:56:54.005637] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-26T18:56:54.015962] [INFO ] [REMOTE ] FTS: Full fetch complete (60082 records). [2025-09-26T18:56:54.016169] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-09-26T18:56:54.361877] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-09-26T18:56:54.523235] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-09-26T18:56:54.523335] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-09-26T18:56:54.524325] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-09-26T18:56:54.524414] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-09-26T18:56:54.526185] [DEBUG] [LOCAL ] FTS: Trimmed 60082 records to 42695 (keeping 200 days of data) [2025-09-26T18:56:54.809614] [DEBUG] [LOCAL ] FTS: Primary data saved (42695 records). [2025-09-26T18:56:54.809830] [INFO ] [MAIN ] FTS: Full history saved. [2025-09-26T18:56:54.809971] [INFO ] [MAIN ] Update Progress: 882/2371 symbols completed. FTS took 24.2s. Estimated remaining: 3h 17m 17s. Rate: 7.5 symbols/min [2025-09-26T18:56:55.014695] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:56:55.037577] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-26T18:56:55.077716] [DEBUG] [LOCAL ] FUL: Loaded 33285 existing records from primary storage. [2025-09-26T18:56:55.077889] [INFO ] [MAIN ] FUL: Loaded 33285 existing records. [2025-09-26T18:56:55.161849] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-09-26T18:56:55.275211] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:56:55.275482] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-09-26T18:56:55.275532] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-09-26T18:56:55.276578] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-09-26T18:56:55.276678] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-09-26T18:56:55.674300] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:56:55.956761] [INFO ] [REMOTE ] FUL: Fetching primary data for 2024-12. [2025-09-26T18:56:56.271066] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-26T18:56:56.756797] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-09-26T18:56:56.820382] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-26T18:56:57.225214] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-26T18:56:57.556738] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-09-26T18:56:58.167212] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-26T18:56:58.356753] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-09-26T18:56:58.557045] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-26T18:56:59.156742] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-09-26T18:56:59.956731] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-09-26T18:57:00.300119] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-26T18:57:00.756742] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-09-26T18:57:00.857504] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-26T18:57:01.163780] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-26T18:57:01.171407] [INFO ] [REMOTE ] FTK: Full fetch complete (42697 records). [2025-09-26T18:57:01.171542] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-09-26T18:57:01.561840] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-09-26T18:57:01.685796] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-09-26T18:57:01.685895] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-09-26T18:57:01.686634] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-09-26T18:57:01.686739] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-09-26T18:57:01.688198] [DEBUG] [LOCAL ] FTK: Trimmed 42697 records to 32755 (keeping 200 days of data) [2025-09-26T18:57:01.910063] [DEBUG] [LOCAL ] FTK: Primary data saved (32755 records). [2025-09-26T18:57:01.910215] [INFO ] [MAIN ] FTK: Full history saved. [2025-09-26T18:57:01.910308] [INFO ] [MAIN ] Update Progress: 883/2371 symbols completed. FTK took 31.3s. Estimated remaining: 3h 17m 8s. Rate: 7.5 symbols/min [2025-09-26T18:57:02.097599] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:57:02.149693] [DEBUG] [LOCAL ] FUN: Loaded 51960 existing records from primary storage. [2025-09-26T18:57:02.149866] [INFO ] [MAIN ] FUN: Loaded 51960 existing records. [2025-09-26T18:57:02.342970] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:57:02.343245] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-09-26T18:57:02.343301] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-09-26T18:57:02.344831] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-09-26T18:57:02.344900] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-09-26T18:57:02.379018] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-09-26T18:57:02.819934] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:57:02.854719] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-26T18:57:02.960181] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-26T18:57:03.156733] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-09-26T18:57:03.956721] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-09-26T18:57:04.182717] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-26T18:57:04.194029] [INFO ] [REMOTE ] FTV: Full fetch complete (76285 records). [2025-09-26T18:57:04.194200] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-09-26T18:57:04.617602] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-09-26T18:57:04.617751] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-09-26T18:57:04.618816] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-09-26T18:57:04.618886] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-09-26T18:57:04.620913] [DEBUG] [LOCAL ] FTV: Trimmed 76285 records to 53686 (keeping 200 days of data) [2025-09-26T18:57:04.757679] [INFO ] [REMOTE ] FUN: Fetching primary data for 2024-12. [2025-09-26T18:57:04.977704] [DEBUG] [LOCAL ] FTV: Primary data saved (53686 records). [2025-09-26T18:57:04.977861] [INFO ] [MAIN ] FTV: Full history saved. [2025-09-26T18:57:04.978617] [INFO ] [MAIN ] Update Progress: 884/2371 symbols completed. FTV took 34.4s. Estimated remaining: 3h 16m 52s. Rate: 7.6 symbols/min [2025-09-26T18:57:05.211016] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:57:05.214878] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-26T18:57:05.250438] [DEBUG] [LOCAL ] FVR: Loaded 22268 existing records from primary storage. [2025-09-26T18:57:05.250583] [INFO ] [MAIN ] FVR: Loaded 22268 existing records. [2025-09-26T18:57:05.460390] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:57:05.460867] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-09-26T18:57:05.461024] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-09-26T18:57:05.461860] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-09-26T18:57:05.461982] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-09-26T18:57:05.542076] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-26T18:57:05.567983] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-09-26T18:57:05.920223] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:57:06.146501] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-26T18:57:06.356732] [INFO ] [REMOTE ] FVR: Fetching primary data for 2024-12. [2025-09-26T18:57:07.159490] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-09-26T18:57:07.163990] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-26T18:57:07.584968] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-26T18:57:07.956760] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-09-26T18:57:08.421818] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-26T18:57:08.756781] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-09-26T18:57:09.556737] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-09-26T18:57:09.766517] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-26T18:57:09.874963] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-26T18:57:10.356728] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-09-26T18:57:10.686307] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-26T18:57:11.156760] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-09-26T18:57:11.804804] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-26T18:57:11.956738] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-09-26T18:57:12.756744] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-09-26T18:57:12.988925] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-26T18:57:13.556697] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-09-26T18:57:13.624144] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-09-26T18:57:14.189435] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-26T18:57:14.365460] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-09-26T18:57:14.369625] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-26T18:57:15.156760] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-09-26T18:57:15.956695] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-09-26T18:57:16.060968] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-26T18:57:16.596313] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-26T18:57:16.756710] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-09-26T18:57:17.556731] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-09-26T18:57:18.161511] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-26T18:57:18.360821] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-09-26T18:57:18.366982] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-26T18:57:19.027554] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-26T18:57:19.156715] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-09-26T18:57:19.190941] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-26T18:57:19.956733] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-09-26T18:57:20.568244] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-26T18:57:20.756702] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-09-26T18:57:21.062403] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-26T18:57:21.556757] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-09-26T18:57:22.356788] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-09-26T18:57:23.090357] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-09-26T18:57:23.101117] [INFO ] [REMOTE ] FUBO: Full fetch complete (77759 records). [2025-09-26T18:57:23.101267] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-09-26T18:57:23.170023] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-09-26T18:57:23.620831] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-09-26T18:57:23.623109] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-26T18:57:23.630028] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-09-26T18:57:23.654763] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-09-26T18:57:23.656874] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-09-26T18:57:23.656736] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-26T18:57:23.666090] [INFO ] [REMOTE ] FUL: Full fetch complete (47194 records). [2025-09-26T18:57:23.666516] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-09-26T18:57:23.666841] [DEBUG] [LOCAL ] FUBO: Trimmed 77759 records to 54476 (keeping 200 days of data) [2025-09-26T18:57:23.962630] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-09-26T18:57:24.215385] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-26T18:57:24.218471] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-09-26T18:57:24.224388] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-09-26T18:57:24.229456] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-09-26T18:57:24.229543] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-09-26T18:57:24.239302] [DEBUG] [LOCAL ] FUL: Trimmed 47194 records to 33570 (keeping 200 days of data) [2025-09-26T18:57:24.559960] [DEBUG] [LOCAL ] FUL: Primary data saved (33570 records). [2025-09-26T18:57:24.561020] [INFO ] [MAIN ] FUL: Full history saved. [2025-09-26T18:57:24.561423] [INFO ] [MAIN ] Update Progress: 885/2371 symbols completed. FUL took 29.8s. Estimated remaining: 3h 17m 3s. Rate: 7.5 symbols/min [2025-09-26T18:57:24.775855] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:57:24.767765] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-09-26T18:57:24.885315] [DEBUG] [LOCAL ] FUBO: Primary data saved (54476 records). [2025-09-26T18:57:24.885526] [INFO ] [MAIN ] FUBO: Full history saved. [2025-09-26T18:57:24.885704] [INFO ] [MAIN ] Update Progress: 886/2371 symbols completed. FUBO took 36.8s. Estimated remaining: 3h 16m 43s. Rate: 7.5 symbols/min [2025-09-26T18:57:25.011447] [DEBUG] [LOCAL ] FVRR: Loaded 40472 existing records from primary storage. [2025-09-26T18:57:25.017441] [INFO ] [MAIN ] FVRR: Loaded 40472 existing records. [2025-09-26T18:57:25.186455] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:57:25.198988] [DEBUG] [LOCAL ] FXED: No existing data file found in primary storage. [2025-09-26T18:57:25.199397] [WARN ] [MAIN ] FXED: No existing data found, performing full refresh instead. [2025-09-26T18:57:25.210373] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-09-26T18:57:25.220774] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-09-26T18:57:25.240071] [DEBUG] [LOCAL ] FXED: No primary data file found to delete. [2025-09-26T18:57:25.240137] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-09-26T18:57:25.346089] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:57:25.385363] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-09-26T18:57:25.393364] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-09-26T18:57:25.403629] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-09-26T18:57:25.414037] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-09-26T18:57:26.019996] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:57:26.051841] [INFO ] [REMOTE ] FXED: Fetching primary data for 2024-12. [2025-09-26T18:57:26.127628] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-26T18:57:26.254503] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:57:26.257400] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-26T18:57:26.356735] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2024-12. [2025-09-26T18:57:26.719131] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-26T18:57:27.156721] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-09-26T18:57:27.947062] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-26T18:57:27.956689] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-09-26T18:57:28.756688] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-09-26T18:57:29.145309] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-26T18:57:29.262022] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-26T18:57:29.273047] [INFO ] [REMOTE ] FUN: Full fetch complete (72662 records). [2025-09-26T18:57:29.273200] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-09-26T18:57:29.562572] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-09-26T18:57:29.710014] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-09-26T18:57:29.710109] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-09-26T18:57:29.711013] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-09-26T18:57:29.711079] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-09-26T18:57:29.712565] [DEBUG] [LOCAL ] FUN: Trimmed 72662 records to 52349 (keeping 200 days of data) [2025-09-26T18:57:29.973609] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-26T18:57:30.069970] [DEBUG] [LOCAL ] FUN: Primary data saved (52349 records). [2025-09-26T18:57:30.070135] [INFO ] [MAIN ] FUN: Full history saved. [2025-09-26T18:57:30.070279] [INFO ] [MAIN ] Update Progress: 887/2371 symbols completed. FUN took 28.2s. Estimated remaining: 3h 16m 30s. Rate: 7.6 symbols/min [2025-09-26T18:57:30.256989] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:57:30.307487] [DEBUG] [LOCAL ] G: Loaded 50170 existing records from primary storage. [2025-09-26T18:57:30.307757] [INFO ] [MAIN ] G: Loaded 50170 existing records. [2025-09-26T18:57:30.361804] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-09-26T18:57:30.451598] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-26T18:57:30.540928] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:57:30.541280] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-09-26T18:57:30.541333] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-09-26T18:57:30.543070] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-09-26T18:57:30.543142] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-09-26T18:57:30.853823] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-26T18:57:30.939044] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:57:31.156723] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-09-26T18:57:31.496223] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-26T18:57:31.956716] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-09-26T18:57:32.756730] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-09-26T18:57:33.512519] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-26T18:57:33.559974] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-09-26T18:57:33.562157] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-26T18:57:34.356759] [INFO ] [REMOTE ] G: Fetching primary data for 2024-12. [2025-09-26T18:57:35.159123] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-09-26T18:57:35.165208] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-26T18:57:35.686109] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-26T18:57:35.956750] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-09-26T18:57:36.311678] [INFO ] [REMOTE ] G: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-26T18:57:36.756758] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-09-26T18:57:37.134797] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-26T18:57:37.467611] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-26T18:57:37.471809] [INFO ] [REMOTE ] FVR: Full fetch complete (30421 records). [2025-09-26T18:57:37.471944] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-09-26T18:57:37.561809] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-09-26T18:57:37.891789] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-09-26T18:57:37.891875] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-09-26T18:57:37.892457] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-09-26T18:57:37.892529] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-09-26T18:57:37.893398] [DEBUG] [LOCAL ] FVR: Trimmed 30421 records to 22328 (keeping 200 days of data) [2025-09-26T18:57:38.031961] [DEBUG] [LOCAL ] FVR: Primary data saved (22328 records). [2025-09-26T18:57:38.032098] [INFO ] [MAIN ] FVR: Full history saved. [2025-09-26T18:57:38.032199] [INFO ] [MAIN ] Update Progress: 888/2371 symbols completed. FVR took 33.1s. Estimated remaining: 3h 16m 22s. Rate: 7.6 symbols/min [2025-09-26T18:57:38.224365] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:57:38.252179] [DEBUG] [LOCAL ] GAB: Loaded 28167 existing records from primary storage. [2025-09-26T18:57:38.252323] [INFO ] [MAIN ] GAB: Loaded 28167 existing records. [2025-09-26T18:57:38.361802] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-09-26T18:57:38.458732] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:57:38.459033] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-09-26T18:57:38.459135] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-09-26T18:57:38.460063] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-09-26T18:57:38.460126] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-09-26T18:57:38.861466] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-26T18:57:38.867721] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:57:39.160040] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-09-26T18:57:39.162821] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-26T18:57:39.519304] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-26T18:57:39.956749] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-09-26T18:57:40.756724] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-09-26T18:57:41.424957] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-26T18:57:41.556710] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-09-26T18:57:41.921431] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-26T18:57:42.356736] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-09-26T18:57:42.692906] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-26T18:57:43.156699] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-09-26T18:57:43.258487] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-26T18:57:43.956728] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-09-26T18:57:44.757186] [INFO ] [REMOTE ] GAB: Fetching primary data for 2024-12. [2025-09-26T18:57:44.757019] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-26T18:57:45.186431] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-26T18:57:45.556739] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-09-26T18:57:45.695845] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-26T18:57:46.356803] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-09-26T18:57:47.156708] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-09-26T18:57:47.198185] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-26T18:57:47.206431] [INFO ] [REMOTE ] FVRR: Full fetch complete (58753 records). [2025-09-26T18:57:47.206596] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-09-26T18:57:47.626046] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-09-26T18:57:47.626124] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-09-26T18:57:47.626916] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-09-26T18:57:47.626985] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-09-26T18:57:47.628596] [DEBUG] [LOCAL ] FVRR: Trimmed 58753 records to 40749 (keeping 200 days of data) [2025-09-26T18:57:47.870785] [DEBUG] [LOCAL ] FVRR: Primary data saved (40749 records). [2025-09-26T18:57:47.870921] [INFO ] [MAIN ] FVRR: Full history saved. [2025-09-26T18:57:47.871017] [INFO ] [MAIN ] Update Progress: 889/2371 symbols completed. FVRR took 23.3s. Estimated remaining: 3h 16m 17s. Rate: 7.6 symbols/min [2025-09-26T18:57:47.962747] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-09-26T18:57:48.068247] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:57:48.101669] [DEBUG] [LOCAL ] GAM: Loaded 4142 existing records from primary storage. [2025-09-26T18:57:48.105674] [INFO ] [MAIN ] GAM: Loaded 4142 existing records. [2025-09-26T18:57:48.162233] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-26T18:57:48.280764] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-26T18:57:48.327512] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-26T18:57:48.386851] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:57:48.387121] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-09-26T18:57:48.387217] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-09-26T18:57:48.387545] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-09-26T18:57:48.387606] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-09-26T18:57:48.761883] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-09-26T18:57:48.793963] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:57:49.231959] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-26T18:57:49.556724] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-09-26T18:57:50.356727] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-09-26T18:57:50.626631] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-26T18:57:50.774863] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-26T18:57:50.775801] [INFO ] [REMOTE ] FXED: Full fetch complete (1798 records). [2025-09-26T18:57:50.775876] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-09-26T18:57:51.161881] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-09-26T18:57:51.204465] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-09-26T18:57:51.204564] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-09-26T18:57:51.204708] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-09-26T18:57:51.204772] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-09-26T18:57:51.205152] [DEBUG] [LOCAL ] FXED: Trimmed 1798 records to 1259 (keeping 200 days of data) [2025-09-26T18:57:51.214218] [DEBUG] [LOCAL ] FXED: Primary data saved (1259 records). [2025-09-26T18:57:51.214291] [INFO ] [MAIN ] FXED: Full history saved. [2025-09-26T18:57:51.214417] [INFO ] [MAIN ] Update Progress: 890/2371 symbols completed. FXED took 26.3s. Estimated remaining: 3h 16m 2s. Rate: 7.6 symbols/min [2025-09-26T18:57:51.402513] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:57:51.457789] [DEBUG] [LOCAL ] GAP: Loaded 54045 existing records from primary storage. [2025-09-26T18:57:51.457972] [INFO ] [MAIN ] GAP: Loaded 54045 existing records. [2025-09-26T18:57:51.653692] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:57:51.653965] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-09-26T18:57:51.654015] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-09-26T18:57:51.655517] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-09-26T18:57:51.655595] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-09-26T18:57:51.963545] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-09-26T18:57:52.100155] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:57:52.520346] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-26T18:57:52.756782] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-12. [2025-09-26T18:57:53.437725] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-26T18:57:53.556731] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-09-26T18:57:54.356771] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-09-26T18:57:54.815732] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-26T18:57:54.965837] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-26T18:57:55.156722] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-09-26T18:57:55.956733] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-09-26T18:57:56.086284] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-26T18:57:56.467624] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-26T18:57:56.756760] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-09-26T18:57:57.415744] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-26T18:57:57.556741] [INFO ] [REMOTE ] GAM: Fetching primary data for 2024-12. [2025-09-26T18:57:57.979325] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-26T18:57:57.996964] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-26T18:57:58.356753] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-09-26T18:57:59.156777] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-09-26T18:57:59.597721] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-26T18:57:59.956729] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-09-26T18:58:00.756702] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-09-26T18:58:00.936541] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-26T18:58:00.991549] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-26T18:58:01.556722] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-09-26T18:58:02.356704] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-09-26T18:58:02.451177] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-26T18:58:02.742000] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-26T18:58:03.156750] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-09-26T18:58:03.688891] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-26T18:58:03.956737] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-09-26T18:58:04.091950] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-26T18:58:04.448290] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-26T18:58:04.756728] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-09-26T18:58:05.503416] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-26T18:58:05.556701] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-09-26T18:58:06.103792] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-26T18:58:06.356793] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-09-26T18:58:07.156749] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-09-26T18:58:07.956838] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-09-26T18:58:08.328239] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-26T18:58:08.578054] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-26T18:58:08.756768] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-09-26T18:58:08.904089] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-26T18:58:09.556736] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-09-26T18:58:09.730567] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-26T18:58:09.737018] [INFO ] [REMOTE ] GAB: Full fetch complete (39665 records). [2025-09-26T18:58:09.737213] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-09-26T18:58:10.165364] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-09-26T18:58:10.165468] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-09-26T18:58:10.166143] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-09-26T18:58:10.166226] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-09-26T18:58:10.167364] [DEBUG] [LOCAL ] GAB: Trimmed 39665 records to 28493 (keeping 200 days of data) [2025-09-26T18:58:10.258921] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-26T18:58:10.350488] [DEBUG] [LOCAL ] GAB: Primary data saved (28493 records). [2025-09-26T18:58:10.350667] [INFO ] [MAIN ] GAB: Full history saved. [2025-09-26T18:58:10.350782] [INFO ] [MAIN ] Update Progress: 891/2371 symbols completed. GAB took 32.3s. Estimated remaining: 3h 16m 12s. Rate: 7.5 symbols/min [2025-09-26T18:58:10.361901] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-09-26T18:58:10.539492] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:58:10.562297] [DEBUG] [LOCAL ] GATX: Loaded 18290 existing records from primary storage. [2025-09-26T18:58:10.562441] [INFO ] [MAIN ] GATX: Loaded 18290 existing records. [2025-09-26T18:58:10.753071] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:58:10.753389] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-09-26T18:58:10.753473] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-09-26T18:58:10.754313] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-09-26T18:58:10.754390] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-09-26T18:58:11.067452] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-26T18:58:11.150714] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:58:11.156679] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-12. [2025-09-26T18:58:11.956800] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-09-26T18:58:12.216593] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-26T18:58:12.540750] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-26T18:58:12.756741] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-09-26T18:58:13.556741] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-09-26T18:58:13.806146] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-26T18:58:14.035939] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-26T18:58:14.037540] [INFO ] [REMOTE ] GAM: Full fetch complete (6855 records). [2025-09-26T18:58:14.037627] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-09-26T18:58:14.365028] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-09-26T18:58:14.470243] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-09-26T18:58:14.470328] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-09-26T18:58:14.470516] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-09-26T18:58:14.470556] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-09-26T18:58:14.471188] [DEBUG] [LOCAL ] GAM: Trimmed 6855 records to 4174 (keeping 200 days of data) [2025-09-26T18:58:14.497045] [DEBUG] [LOCAL ] GAM: Primary data saved (4174 records). [2025-09-26T18:58:14.497240] [INFO ] [MAIN ] GAM: Full history saved. [2025-09-26T18:58:14.497366] [INFO ] [MAIN ] Update Progress: 892/2371 symbols completed. GAM took 26.6s. Estimated remaining: 3h 15m 58s. Rate: 7.5 symbols/min [2025-09-26T18:58:14.692302] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:58:14.709333] [DEBUG] [LOCAL ] GBAB: Loaded 13056 existing records from primary storage. [2025-09-26T18:58:14.709474] [INFO ] [MAIN ] GBAB: Loaded 13056 existing records. [2025-09-26T18:58:14.900115] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:58:14.900376] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-09-26T18:58:14.900425] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-09-26T18:58:14.900967] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-09-26T18:58:14.901029] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-09-26T18:58:15.162466] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-09-26T18:58:15.288228] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:58:15.956694] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2024-12. [2025-09-26T18:58:16.494007] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-26T18:58:16.707761] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-26T18:58:16.719989] [INFO ] [REMOTE ] G: Full fetch complete (71596 records). [2025-09-26T18:58:16.720190] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-09-26T18:58:16.761248] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-09-26T18:58:17.158326] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-09-26T18:58:17.158453] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-09-26T18:58:17.159513] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-09-26T18:58:17.159609] [DEBUG] [LOCAL ] G: Saving primary data. [2025-09-26T18:58:17.174617] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-26T18:58:17.181083] [DEBUG] [LOCAL ] G: Trimmed 71596 records to 50547 (keeping 200 days of data) [2025-09-26T18:58:17.509062] [DEBUG] [LOCAL ] G: Primary data saved (50547 records). [2025-09-26T18:58:17.509274] [INFO ] [MAIN ] G: Full history saved. [2025-09-26T18:58:17.509385] [INFO ] [MAIN ] Update Progress: 893/2371 symbols completed. G took 47.4s. Estimated remaining: 3h 15m 42s. Rate: 7.6 symbols/min [2025-09-26T18:58:17.558788] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-09-26T18:58:17.715939] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:58:17.729191] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-26T18:58:17.772970] [DEBUG] [LOCAL ] GBCI: Loaded 40385 existing records from primary storage. [2025-09-26T18:58:17.773170] [INFO ] [MAIN ] GBCI: Loaded 40385 existing records. [2025-09-26T18:58:17.974978] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:58:17.975316] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-09-26T18:58:17.975373] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-09-26T18:58:17.976629] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-09-26T18:58:17.976735] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-09-26T18:58:18.366112] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-09-26T18:58:18.372160] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:58:19.156794] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-09-26T18:58:19.274428] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-26T18:58:19.463471] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-26T18:58:19.835478] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-26T18:58:19.956765] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-09-26T18:58:20.756741] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-09-26T18:58:21.556706] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-09-26T18:58:21.700040] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-26T18:58:21.904797] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-26T18:58:22.356739] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-12. [2025-09-26T18:58:22.952495] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-26T18:58:23.156728] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-09-26T18:58:23.956703] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-09-26T18:58:23.986505] [DEBUG] [REMOTE ] GATX: Error fetching primary data for 2025-05: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-09-26T18:58:23.994283] [WARN ] [REMOTE ] GATX: No data returned for month 2025-05 [2025-09-26T18:58:24.009111] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-26T18:58:24.756736] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-09-26T18:58:25.466860] [DEBUG] [REMOTE ] GAP: Error fetching primary data for 2025-08: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-09-26T18:58:25.467075] [WARN ] [REMOTE ] GAP: No data returned for month 2025-08 [2025-09-26T18:58:25.556726] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-09-26T18:58:26.267610] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-26T18:58:26.356714] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-09-26T18:58:27.156718] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-09-26T18:58:27.432633] [DEBUG] [REMOTE ] GBCI: Error fetching primary data for 2025-02: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-09-26T18:58:27.432968] [WARN ] [REMOTE ] GBCI: No data returned for month 2025-02 [2025-09-26T18:58:27.467630] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-26T18:58:27.482141] [INFO ] [REMOTE ] GAP: Full fetch complete (69448 records). [2025-09-26T18:58:27.482353] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-09-26T18:58:27.706891] [WARN ] [VALIDATOR ] GAP: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-26T18:58:27.707818] [FATAL] [MAIN ] GAP: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:58:27.707942] [WARN ] [MAIN ] GAP: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:58:27.708115] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-09-26T18:58:27.708212] [DEBUG] [LOCAL ] GAP: No primary data file found to delete. [2025-09-26T18:58:27.708273] [INFO ] [LOCAL ] GAP: Starting deletion of derivative data. [2025-09-26T18:58:27.708923] [DEBUG] [LOCAL ] GAP: Deleted derivative data file. [2025-09-26T18:58:27.709147] [INFO ] [MAIN ] Update Progress: 894/2371 symbols completed. GAP took 36.5s. Estimated remaining: 3h 15m 38s. Rate: 7.5 symbols/min [2025-09-26T18:58:27.904105] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:58:27.904330] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-09-26T18:58:27.904387] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-09-26T18:58:27.904591] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-09-26T18:58:27.904672] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-26T18:58:27.904745] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-26T18:58:27.904782] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-09-26T18:58:27.963308] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-09-26T18:58:28.072342] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-26T18:58:28.312623] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:58:28.756696] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-09-26T18:58:29.061936] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-26T18:58:29.556727] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-12. [2025-09-26T18:58:29.740940] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-26T18:58:30.034075] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-26T18:58:30.356721] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-09-26T18:58:31.156738] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-09-26T18:58:31.177464] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-26T18:58:31.686671] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-26T18:58:31.956776] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-09-26T18:58:32.756730] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-09-26T18:58:32.993864] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-26T18:58:33.556726] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-09-26T18:58:34.237779] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-26T18:58:34.356749] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-09-26T18:58:34.601365] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-09-26T18:58:34.687600] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-26T18:58:35.156740] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-09-26T18:58:35.956732] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-09-26T18:58:36.115925] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-26T18:58:36.297464] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-26T18:58:36.756772] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-09-26T18:58:37.556722] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-09-26T18:58:37.777750] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-26T18:58:38.356749] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-09-26T18:58:39.096364] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-26T18:58:39.156800] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-09-26T18:58:39.594815] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-26T18:58:39.602201] [INFO ] [REMOTE ] GATX: Full fetch complete (22643 records). [2025-09-26T18:58:39.602384] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-09-26T18:58:39.708782] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-26T18:58:39.919976] [WARN ] [VALIDATOR ] GATX: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-26T18:58:39.920675] [FATAL] [MAIN ] GATX: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:58:39.920755] [WARN ] [MAIN ] GATX: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:58:39.920869] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-09-26T18:58:39.920974] [DEBUG] [LOCAL ] GATX: No primary data file found to delete. [2025-09-26T18:58:39.921079] [INFO ] [LOCAL ] GATX: Starting deletion of derivative data. [2025-09-26T18:58:39.921856] [DEBUG] [LOCAL ] GATX: Deleted derivative data file. [2025-09-26T18:58:39.922033] [INFO ] [MAIN ] Update Progress: 895/2371 symbols completed. GATX took 29.6s. Estimated remaining: 3h 15m 37s. Rate: 7.5 symbols/min [2025-09-26T18:58:39.961931] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-09-26T18:58:40.121863] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:58:40.179404] [DEBUG] [LOCAL ] GBTG: Loaded 40531 existing records from primary storage. [2025-09-26T18:58:40.179557] [INFO ] [MAIN ] GBTG: Loaded 40531 existing records. [2025-09-26T18:58:40.370355] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:58:40.370608] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-09-26T18:58:40.370686] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-09-26T18:58:40.371839] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-09-26T18:58:40.371903] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-09-26T18:58:40.752930] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:58:40.756678] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2024-12. [2025-09-26T18:58:41.485307] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-26T18:58:41.556730] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-09-26T18:58:42.136538] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-26T18:58:42.356747] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-09-26T18:58:42.879531] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-26T18:58:43.156768] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-09-26T18:58:43.794308] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-26T18:58:43.956726] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-09-26T18:58:44.756734] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-09-26T18:58:44.807734] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-26T18:58:45.237614] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-26T18:58:45.352391] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-26T18:58:45.556722] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-09-26T18:58:45.988235] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-26T18:58:46.356731] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-09-26T18:58:46.628000] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-09-26T18:58:47.156752] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-09-26T18:58:47.956771] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-09-26T18:58:48.653456] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-26T18:58:48.752376] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-26T18:58:48.756675] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-09-26T18:58:49.556740] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-09-26T18:58:49.693739] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-26T18:58:49.697833] [INFO ] [REMOTE ] GBAB: Full fetch complete (20050 records). [2025-09-26T18:58:49.697942] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-09-26T18:58:50.086280] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-09-26T18:58:50.086410] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-09-26T18:58:50.086981] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-09-26T18:58:50.087051] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-09-26T18:58:50.087992] [DEBUG] [LOCAL ] GBAB: Trimmed 20050 records to 13142 (keeping 200 days of data) [2025-09-26T18:58:50.181307] [DEBUG] [LOCAL ] GBAB: Primary data saved (13142 records). [2025-09-26T18:58:50.181468] [INFO ] [MAIN ] GBAB: Full history saved. [2025-09-26T18:58:50.181581] [INFO ] [MAIN ] Update Progress: 896/2371 symbols completed. GBAB took 35.7s. Estimated remaining: 3h 15m 33s. Rate: 7.5 symbols/min [2025-09-26T18:58:50.363518] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-09-26T18:58:50.367437] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:58:50.416550] [DEBUG] [LOCAL ] GBX: Loaded 29340 existing records from primary storage. [2025-09-26T18:58:50.416745] [INFO ] [MAIN ] GBX: Loaded 29340 existing records. [2025-09-26T18:58:50.611078] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:58:50.611415] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-09-26T18:58:50.611488] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-09-26T18:58:50.612414] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-09-26T18:58:50.612480] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-09-26T18:58:51.006420] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:58:51.032435] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-26T18:58:51.156744] [INFO ] [REMOTE ] GBX: Fetching primary data for 2024-12. [2025-09-26T18:58:51.956742] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-09-26T18:58:52.001312] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-26T18:58:52.009828] [INFO ] [REMOTE ] GBCI: Full fetch complete (52469 records). [2025-09-26T18:58:52.009993] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-09-26T18:58:52.224685] [WARN ] [VALIDATOR ] GBCI: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-26T18:58:52.225355] [FATAL] [MAIN ] GBCI: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:58:52.225435] [WARN ] [MAIN ] GBCI: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:58:52.225544] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-09-26T18:58:52.225638] [DEBUG] [LOCAL ] GBCI: No primary data file found to delete. [2025-09-26T18:58:52.225723] [INFO ] [LOCAL ] GBCI: Starting deletion of derivative data. [2025-09-26T18:58:52.226077] [DEBUG] [LOCAL ] GBCI: Deleted derivative data file. [2025-09-26T18:58:52.226207] [INFO ] [MAIN ] Update Progress: 897/2371 symbols completed. GBCI took 34.7s. Estimated remaining: 3h 15m 15s. Rate: 7.5 symbols/min [2025-09-26T18:58:52.445045] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:58:52.447946] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-26T18:58:52.500589] [DEBUG] [LOCAL ] GCI: Loaded 44530 existing records from primary storage. [2025-09-26T18:58:52.500795] [INFO ] [MAIN ] GCI: Loaded 44530 existing records. [2025-09-26T18:58:52.688044] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:58:52.688300] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-09-26T18:58:52.688349] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-09-26T18:58:52.689588] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-09-26T18:58:52.689683] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-09-26T18:58:52.761821] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-09-26T18:58:53.078890] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:58:53.107707] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-26T18:58:53.146049] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-26T18:58:53.556720] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-09-26T18:58:54.356742] [INFO ] [REMOTE ] GCI: Fetching primary data for 2024-12. [2025-09-26T18:58:54.901905] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-26T18:58:55.156779] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-09-26T18:58:55.775401] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-26T18:58:55.956698] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-09-26T18:58:56.373604] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-26T18:58:56.756738] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-09-26T18:58:57.314129] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-26T18:58:57.556751] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-09-26T18:58:57.823162] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-26T18:58:58.356760] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-09-26T18:58:58.793212] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-26T18:58:58.794029] [INFO ] [REMOTE ] GBLI: Full fetch complete (1330 records). [2025-09-26T18:58:58.794099] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-09-26T18:58:58.986201] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 173 unique days, need 200 days [2025-09-26T18:58:58.986542] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:58:58.986621] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:58:58.986715] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-26T18:58:58.986961] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-26T18:58:58.987022] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-09-26T18:58:59.010629] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-09-26T18:58:59.010875] [INFO ] [MAIN ] Update Progress: 898/2371 symbols completed. GBLI took 31.3s. Estimated remaining: 3h 15m 5s. Rate: 7.6 symbols/min [2025-09-26T18:58:59.012802] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-26T18:58:59.165917] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-09-26T18:58:59.199353] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:58:59.228507] [DEBUG] [LOCAL ] GCO: Loaded 25567 existing records from primary storage. [2025-09-26T18:58:59.228670] [INFO ] [MAIN ] GCO: Loaded 25567 existing records. [2025-09-26T18:58:59.410418] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:58:59.410704] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-09-26T18:58:59.410762] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-09-26T18:58:59.411476] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-09-26T18:58:59.411538] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-09-26T18:58:59.784583] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:58:59.956776] [INFO ] [REMOTE ] GCO: Fetching primary data for 2024-12. [2025-09-26T18:59:00.657523] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T18:59:00.756737] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-09-26T18:59:01.103994] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-26T18:59:01.556737] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-09-26T18:59:02.356711] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-09-26T18:59:02.469540] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-26T18:59:03.031932] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-26T18:59:03.156704] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-09-26T18:59:03.510141] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-26T18:59:03.956760] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-09-26T18:59:04.529198] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-26T18:59:04.644024] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-26T18:59:04.756735] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-09-26T18:59:05.556755] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-09-26T18:59:06.365986] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-09-26T18:59:06.387059] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-26T18:59:06.606274] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-26T18:59:07.156738] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-09-26T18:59:07.813486] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-26T18:59:07.956743] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-09-26T18:59:08.611822] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-26T18:59:08.678982] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-26T18:59:08.756780] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-09-26T18:59:09.545920] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-26T18:59:09.556673] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-09-26T18:59:10.356761] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-09-26T18:59:10.787484] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-26T18:59:10.792893] [INFO ] [REMOTE ] GBX: Full fetch complete (42746 records). [2025-09-26T18:59:10.793059] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-09-26T18:59:11.164408] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-09-26T18:59:11.209864] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-09-26T18:59:11.209973] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-09-26T18:59:11.210690] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-09-26T18:59:11.210755] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-09-26T18:59:11.211925] [DEBUG] [LOCAL ] GBX: Trimmed 42746 records to 29497 (keeping 200 days of data) [2025-09-26T18:59:11.406858] [DEBUG] [LOCAL ] GBX: Primary data saved (29497 records). [2025-09-26T18:59:11.407014] [INFO ] [MAIN ] GBX: Full history saved. [2025-09-26T18:59:11.407105] [INFO ] [MAIN ] Update Progress: 899/2371 symbols completed. GBX took 21.2s. Estimated remaining: 3h 15m 5s. Rate: 7.5 symbols/min [2025-09-26T18:59:11.596298] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:59:11.617402] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-26T18:59:11.646508] [DEBUG] [LOCAL ] GCTS: Loaded 19961 existing records from primary storage. [2025-09-26T18:59:11.646757] [INFO ] [MAIN ] GCTS: Loaded 19961 existing records. [2025-09-26T18:59:11.855020] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:59:11.855350] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-09-26T18:59:11.855404] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-09-26T18:59:11.856195] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-09-26T18:59:11.856259] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-09-26T18:59:11.963081] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-09-26T18:59:12.234805] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:59:12.621186] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-26T18:59:12.756793] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2024-12. [2025-09-26T18:59:13.477241] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-26T18:59:13.531780] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-26T18:59:13.556683] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-09-26T18:59:14.356717] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-09-26T18:59:14.614923] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-26T18:59:15.156748] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-09-26T18:59:15.870503] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-26T18:59:15.878592] [INFO ] [REMOTE ] GBTG: Full fetch complete (56631 records). [2025-09-26T18:59:15.878746] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-09-26T18:59:15.963208] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-09-26T18:59:16.311537] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-09-26T18:59:16.311828] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-09-26T18:59:16.312750] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-09-26T18:59:16.312818] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-09-26T18:59:16.315194] [DEBUG] [LOCAL ] GBTG: Trimmed 56631 records to 40807 (keeping 200 days of data) [2025-09-26T18:59:16.596517] [DEBUG] [LOCAL ] GBTG: Primary data saved (40807 records). [2025-09-26T18:59:16.596682] [INFO ] [MAIN ] GBTG: Full history saved. [2025-09-26T18:59:16.597748] [INFO ] [MAIN ] Update Progress: 900/2371 symbols completed. GBTG took 36.7s. Estimated remaining: 3h 14m 52s. Rate: 7.5 symbols/min [2025-09-26T18:59:16.764302] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-09-26T18:59:16.809507] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-26T18:59:16.841820] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-26T18:59:16.840189] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:59:16.860465] [DEBUG] [LOCAL ] GCV: Loaded 7245 existing records from primary storage. [2025-09-26T18:59:16.860699] [INFO ] [MAIN ] GCV: Loaded 7245 existing records. [2025-09-26T18:59:17.056479] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:59:17.056824] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-09-26T18:59:17.056879] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-09-26T18:59:17.057310] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-09-26T18:59:17.057372] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-09-26T18:59:17.470080] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:59:17.556681] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-12. [2025-09-26T18:59:18.083630] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-26T18:59:18.257500] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-26T18:59:18.356724] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-09-26T18:59:19.156732] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-09-26T18:59:19.880973] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-26T18:59:19.956700] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-09-26T18:59:20.074142] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-26T18:59:20.756721] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-09-26T18:59:21.358135] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-26T18:59:21.423624] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-26T18:59:21.556743] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-09-26T18:59:22.356722] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-09-26T18:59:22.965277] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-26T18:59:22.980349] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-26T18:59:22.983113] [INFO ] [REMOTE ] GCI: Full fetch complete (63120 records). [2025-09-26T18:59:22.983370] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-09-26T18:59:23.163995] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-09-26T18:59:23.401676] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-09-26T18:59:23.401799] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-09-26T18:59:23.403042] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-09-26T18:59:23.403113] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-09-26T18:59:23.405232] [DEBUG] [LOCAL ] GCI: Trimmed 63120 records to 44828 (keeping 200 days of data) [2025-09-26T18:59:23.670620] [DEBUG] [LOCAL ] GCI: Primary data saved (44828 records). [2025-09-26T18:59:23.670834] [INFO ] [MAIN ] GCI: Full history saved. [2025-09-26T18:59:23.670971] [INFO ] [MAIN ] Update Progress: 901/2371 symbols completed. GCI took 31.4s. Estimated remaining: 3h 14m 43s. Rate: 7.5 symbols/min [2025-09-26T18:59:23.849383] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:59:23.900093] [DEBUG] [LOCAL ] GD: Loaded 47620 existing records from primary storage. [2025-09-26T18:59:23.900332] [INFO ] [MAIN ] GD: Loaded 47620 existing records. [2025-09-26T18:59:23.964007] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-09-26T18:59:24.085668] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:59:24.085968] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-09-26T18:59:24.086019] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-09-26T18:59:24.087683] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-09-26T18:59:24.087747] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-09-26T18:59:24.434777] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-26T18:59:24.482542] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:59:24.489143] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-26T18:59:24.756780] [INFO ] [REMOTE ] GD: Fetching primary data for 2024-12. [2025-09-26T18:59:25.556736] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-09-26T18:59:26.356741] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-09-26T18:59:26.471677] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-26T18:59:26.524282] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-26T18:59:27.085463] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-26T18:59:27.156715] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-09-26T18:59:27.888474] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-26T18:59:27.956738] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-09-26T18:59:28.756702] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-09-26T18:59:29.065706] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-26T18:59:29.480363] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-26T18:59:29.556724] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-09-26T18:59:30.059617] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-26T18:59:30.356724] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-09-26T18:59:31.156717] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-09-26T18:59:31.541693] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-26T18:59:31.956764] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-09-26T18:59:32.701409] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-26T18:59:32.756676] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-09-26T18:59:33.009070] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-26T18:59:33.556705] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-09-26T18:59:33.694904] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-26T18:59:33.697430] [INFO ] [REMOTE ] GCV: Full fetch complete (9256 records). [2025-09-26T18:59:33.697515] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-09-26T18:59:33.698083] [FATAL] [VALIDATOR ] GCV: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:59:33.698224] [FATAL] [MAIN ] GCV: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:59:33.698295] [WARN ] [MAIN ] GCV: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:59:33.698406] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-09-26T18:59:33.698496] [DEBUG] [LOCAL ] GCV: No primary data file found to delete. [2025-09-26T18:59:33.698554] [INFO ] [LOCAL ] GCV: Starting deletion of derivative data. [2025-09-26T18:59:33.699073] [DEBUG] [LOCAL ] GCV: Deleted derivative data file. [2025-09-26T18:59:33.699202] [INFO ] [MAIN ] Update Progress: 902/2371 symbols completed. GCV took 17.1s. Estimated remaining: 3h 14m 38s. Rate: 7.5 symbols/min [2025-09-26T18:59:33.889301] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:59:33.942564] [DEBUG] [LOCAL ] GDDY: Loaded 50073 existing records from primary storage. [2025-09-26T18:59:33.942780] [INFO ] [MAIN ] GDDY: Loaded 50073 existing records. [2025-09-26T18:59:34.144538] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:59:34.144814] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-09-26T18:59:34.144867] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-09-26T18:59:34.146363] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-09-26T18:59:34.146429] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-09-26T18:59:34.361931] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-09-26T18:59:34.579016] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:59:34.939956] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-26T18:59:35.156794] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-09-26T18:59:35.511178] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-26T18:59:35.956730] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2024-12. [2025-09-26T18:59:36.756742] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-09-26T18:59:36.939162] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-26T18:59:37.556747] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-09-26T18:59:37.605101] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-26T18:59:37.813974] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-26T18:59:38.356723] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-09-26T18:59:39.156701] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-09-26T18:59:39.340543] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-26T18:59:39.462967] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-26T18:59:39.956793] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-09-26T18:59:40.756711] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-09-26T18:59:40.797867] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-26T18:59:41.556704] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-09-26T18:59:41.902977] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-26T18:59:41.961981] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-26T18:59:42.356746] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-09-26T18:59:43.156743] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-09-26T18:59:43.260389] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-26T18:59:43.956733] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-09-26T18:59:44.150368] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-26T18:59:44.193349] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-26T18:59:44.198453] [INFO ] [REMOTE ] GCO: Full fetch complete (35752 records). [2025-09-26T18:59:44.198564] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-09-26T18:59:44.597427] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-09-26T18:59:44.597514] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-09-26T18:59:44.598205] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-09-26T18:59:44.598270] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-09-26T18:59:44.599256] [DEBUG] [LOCAL ] GCO: Trimmed 35752 records to 25686 (keeping 200 days of data) [2025-09-26T18:59:44.763774] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-09-26T18:59:44.775895] [DEBUG] [LOCAL ] GCO: Primary data saved (25686 records). [2025-09-26T18:59:44.776051] [INFO ] [MAIN ] GCO: Full history saved. [2025-09-26T18:59:44.776165] [INFO ] [MAIN ] Update Progress: 903/2371 symbols completed. GCO took 45.8s. Estimated remaining: 3h 14m 35s. Rate: 7.5 symbols/min [2025-09-26T18:59:44.971464] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:59:44.977942] [DEBUG] [LOCAL ] GDIV: Loaded 3707 existing records from primary storage. [2025-09-26T18:59:44.978044] [INFO ] [MAIN ] GDIV: Loaded 3707 existing records. [2025-09-26T18:59:45.196117] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:59:45.201916] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-09-26T18:59:45.208849] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-09-26T18:59:45.209599] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-09-26T18:59:45.209721] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-09-26T18:59:45.210143] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-26T18:59:45.277849] [INFO ] [REMOTE ] GCTS: Full fetch complete (27043 records). [2025-09-26T18:59:45.292688] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-09-26T18:59:45.581898] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-09-26T18:59:46.044599] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:59:46.057976] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-09-26T18:59:46.058040] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-09-26T18:59:46.058616] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-09-26T18:59:46.058728] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-09-26T18:59:46.059453] [DEBUG] [LOCAL ] GCTS: Trimmed 27043 records to 20060 (keeping 200 days of data) [2025-09-26T18:59:46.177011] [DEBUG] [LOCAL ] GCTS: Primary data saved (20060 records). [2025-09-26T18:59:46.177171] [INFO ] [MAIN ] GCTS: Full history saved. [2025-09-26T18:59:46.177301] [INFO ] [MAIN ] Update Progress: 904/2371 symbols completed. GCTS took 34.8s. Estimated remaining: 3h 14m 17s. Rate: 7.6 symbols/min [2025-09-26T18:59:46.359436] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:59:46.357964] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2024-12. [2025-09-26T18:59:46.364811] [DEBUG] [LOCAL ] GDL: Loaded 2556 existing records from primary storage. [2025-09-26T18:59:46.364949] [INFO ] [MAIN ] GDL: Loaded 2556 existing records. [2025-09-26T18:59:46.578497] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:59:46.579031] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-09-26T18:59:46.579102] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-09-26T18:59:46.579513] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-09-26T18:59:46.579576] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-09-26T18:59:46.809759] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-26T18:59:47.012679] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:59:47.006941] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-26T18:59:47.156692] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-09-26T18:59:47.596661] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-26T18:59:47.956736] [INFO ] [REMOTE ] GDL: Fetching primary data for 2024-12. [2025-09-26T18:59:48.528972] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-26T18:59:48.756711] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-09-26T18:59:49.008956] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-26T18:59:49.167263] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-26T18:59:49.556723] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-09-26T18:59:50.356734] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-09-26T18:59:51.156788] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-09-26T18:59:51.290930] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-26T18:59:51.927458] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-26T18:59:51.956770] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-09-26T18:59:52.117777] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-26T18:59:52.330130] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-26T18:59:52.756743] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-09-26T18:59:53.194760] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-26T18:59:53.556740] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-09-26T18:59:54.010709] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-26T18:59:54.356752] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-09-26T18:59:55.156764] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-09-26T18:59:55.728043] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-26T18:59:55.956723] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-09-26T18:59:56.089015] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-26T18:59:56.756735] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-09-26T18:59:57.119285] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-26T18:59:57.556742] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-09-26T18:59:57.787888] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-26T18:59:57.799545] [INFO ] [REMOTE ] GD: Full fetch complete (70452 records). [2025-09-26T18:59:57.799773] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-09-26T18:59:57.958111] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-26T18:59:58.224349] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-09-26T18:59:58.224467] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-09-26T18:59:58.225508] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-09-26T18:59:58.225578] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-09-26T18:59:58.227155] [DEBUG] [LOCAL ] GD: Trimmed 70452 records to 47940 (keeping 200 days of data) [2025-09-26T18:59:58.356736] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-09-26T18:59:58.531716] [DEBUG] [LOCAL ] GD: Primary data saved (47940 records). [2025-09-26T18:59:58.531870] [INFO ] [MAIN ] GD: Full history saved. [2025-09-26T18:59:58.531998] [INFO ] [MAIN ] Update Progress: 905/2371 symbols completed. GD took 34.9s. Estimated remaining: 3h 14m 16s. Rate: 7.5 symbols/min [2025-09-26T18:59:58.710980] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:59:58.720034] [DEBUG] [LOCAL ] GDO: Loaded 6055 existing records from primary storage. [2025-09-26T18:59:58.720168] [INFO ] [MAIN ] GDO: Loaded 6055 existing records. [2025-09-26T18:59:58.908902] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:59:58.909317] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-09-26T18:59:58.913199] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-09-26T18:59:58.913367] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-26T18:59:58.915016] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-09-26T18:59:58.915095] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-09-26T18:59:59.161864] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-09-26T18:59:59.303779] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:59:59.715260] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-26T18:59:59.956743] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-09-26T19:00:00.460747] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-26T19:00:00.756756] [INFO ] [REMOTE ] GDO: Fetching primary data for 2024-12. [2025-09-26T19:00:01.556733] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-09-26T19:00:01.749006] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-26T19:00:02.356769] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-09-26T19:00:03.118795] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-26T19:00:03.156726] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-09-26T19:00:03.369194] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-26T19:00:03.956761] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-09-26T19:00:03.990741] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-26T19:00:03.992155] [INFO ] [REMOTE ] GDL: Full fetch complete (3688 records). [2025-09-26T19:00:03.992231] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-09-26T19:00:04.384586] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-09-26T19:00:04.384699] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-09-26T19:00:04.384854] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-09-26T19:00:04.384897] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-09-26T19:00:04.385321] [DEBUG] [LOCAL ] GDL: Trimmed 3688 records to 2572 (keeping 200 days of data) [2025-09-26T19:00:04.402008] [DEBUG] [LOCAL ] GDL: Primary data saved (2572 records). [2025-09-26T19:00:04.402167] [INFO ] [MAIN ] GDL: Full history saved. [2025-09-26T19:00:04.402264] [INFO ] [MAIN ] Update Progress: 906/2371 symbols completed. GDL took 18.2s. Estimated remaining: 3h 14m 5s. Rate: 7.5 symbols/min [2025-09-26T19:00:04.600547] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:00:04.648865] [DEBUG] [LOCAL ] GDOT: Loaded 38946 existing records from primary storage. [2025-09-26T19:00:04.649631] [INFO ] [MAIN ] GDOT: Loaded 38946 existing records. [2025-09-26T19:00:04.649937] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-26T19:00:04.764775] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-09-26T19:00:04.852388] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:00:04.852664] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-09-26T19:00:04.852727] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-09-26T19:00:04.853877] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-09-26T19:00:04.853939] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-09-26T19:00:05.255155] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:00:05.455200] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-26T19:00:05.556741] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2024-12. [2025-09-26T19:00:06.356745] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-09-26T19:00:07.002687] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-26T19:00:07.061591] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-26T19:00:07.156733] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-09-26T19:00:07.956811] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-09-26T19:00:08.429766] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-26T19:00:08.599983] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-26T19:00:08.756763] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-09-26T19:00:09.556723] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-09-26T19:00:10.055984] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-26T19:00:10.356729] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-09-26T19:00:10.619172] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-26T19:00:10.931974] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-26T19:00:11.156769] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-09-26T19:00:11.913392] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-26T19:00:11.956786] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-09-26T19:00:12.756757] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-09-26T19:00:13.331209] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-26T19:00:13.556729] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-09-26T19:00:13.681289] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-26T19:00:14.181666] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-26T19:00:14.356739] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-09-26T19:00:15.156703] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-09-26T19:00:15.482789] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-26T19:00:15.956739] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-09-26T19:00:16.443324] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-26T19:00:16.756746] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-09-26T19:00:17.029333] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-26T19:00:17.039515] [INFO ] [REMOTE ] GDDY: Full fetch complete (71267 records). [2025-09-26T19:00:17.039752] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-09-26T19:00:17.433659] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-26T19:00:17.456724] [INFO ] [REMOTE ] GDIV: Full fetch complete (5448 records). [2025-09-26T19:00:17.460897] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-09-26T19:00:17.538911] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-09-26T19:00:17.560314] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-09-26T19:00:17.560196] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-09-26T19:00:17.573728] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-09-26T19:00:17.591261] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-09-26T19:00:17.654882] [DEBUG] [LOCAL ] GDDY: Trimmed 71267 records to 50449 (keeping 200 days of data) [2025-09-26T19:00:17.982214] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-09-26T19:00:17.983950] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-09-26T19:00:17.984710] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-09-26T19:00:17.986206] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-09-26T19:00:17.988259] [DEBUG] [LOCAL ] GDIV: Trimmed 5448 records to 3724 (keeping 200 days of data) [2025-09-26T19:00:18.015013] [DEBUG] [LOCAL ] GDIV: Primary data saved (3724 records). [2025-09-26T19:00:18.016519] [INFO ] [MAIN ] GDIV: Full history saved. [2025-09-26T19:00:18.016993] [INFO ] [MAIN ] Update Progress: 907/2371 symbols completed. GDIV took 33.2s. Estimated remaining: 3h 14m 6s. Rate: 7.5 symbols/min [2025-09-26T19:00:18.097789] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-26T19:00:18.246965] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:00:18.335294] [DEBUG] [LOCAL ] GDV: Loaded 19887 existing records from primary storage. [2025-09-26T19:00:18.362424] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-09-26T19:00:18.363381] [INFO ] [MAIN ] GDV: Loaded 19887 existing records. [2025-09-26T19:00:18.574890] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:00:18.576493] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-09-26T19:00:18.576839] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-09-26T19:00:18.578380] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-09-26T19:00:18.578709] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-09-26T19:00:18.983707] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:00:19.076390] [DEBUG] [LOCAL ] GDDY: Primary data saved (50449 records). [2025-09-26T19:00:19.076549] [INFO ] [MAIN ] GDDY: Full history saved. [2025-09-26T19:00:19.077794] [INFO ] [MAIN ] Update Progress: 908/2371 symbols completed. GDDY took 45.4s. Estimated remaining: 3h 13m 47s. Rate: 7.5 symbols/min [2025-09-26T19:00:19.169897] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-09-26T19:00:19.170260] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-26T19:00:19.278563] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:00:19.342430] [DEBUG] [LOCAL ] GE: Loaded 54103 existing records from primary storage. [2025-09-26T19:00:19.342603] [INFO ] [MAIN ] GE: Loaded 54103 existing records. [2025-09-26T19:00:19.538178] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:00:19.538592] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-09-26T19:00:19.538679] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-09-26T19:00:19.540809] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-09-26T19:00:19.540942] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-09-26T19:00:19.925774] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:00:19.956691] [INFO ] [REMOTE ] GE: Fetching primary data for 2024-12. [2025-09-26T19:00:20.756709] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-09-26T19:00:20.843692] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-26T19:00:21.477542] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-26T19:00:21.479478] [INFO ] [REMOTE ] GDO: Full fetch complete (9333 records). [2025-09-26T19:00:21.479556] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-09-26T19:00:21.561854] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-09-26T19:00:21.919865] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-09-26T19:00:21.919985] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-09-26T19:00:21.920319] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-09-26T19:00:21.920402] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-09-26T19:00:21.921447] [DEBUG] [LOCAL ] GDO: Trimmed 9333 records to 6076 (keeping 200 days of data) [2025-09-26T19:00:21.962743] [DEBUG] [LOCAL ] GDO: Primary data saved (6076 records). [2025-09-26T19:00:21.962903] [INFO ] [MAIN ] GDO: Full history saved. [2025-09-26T19:00:21.963022] [INFO ] [MAIN ] Update Progress: 909/2371 symbols completed. GDO took 23.4s. Estimated remaining: 3h 13m 31s. Rate: 7.6 symbols/min [2025-09-26T19:00:22.191149] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:00:22.278678] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-09-26T19:00:22.308195] [DEBUG] [LOCAL ] GEF: Loaded 20843 existing records from primary storage. [2025-09-26T19:00:22.308346] [INFO ] [MAIN ] GEF: Loaded 20843 existing records. [2025-09-26T19:00:22.368823] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-09-26T19:00:22.510613] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:00:22.510941] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-09-26T19:00:22.510992] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-09-26T19:00:22.511804] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-09-26T19:00:22.511869] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-09-26T19:00:22.922616] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:00:23.063930] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-26T19:00:23.156747] [INFO ] [REMOTE ] GEF: Fetching primary data for 2024-12. [2025-09-26T19:00:23.956748] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-09-26T19:00:24.301086] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-26T19:00:24.424555] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-26T19:00:24.756723] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-09-26T19:00:25.415051] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-26T19:00:25.474140] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-26T19:00:25.556736] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-09-26T19:00:26.356732] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-09-26T19:00:27.156738] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-09-26T19:00:27.664186] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-26T19:00:27.740550] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-26T19:00:27.956707] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-09-26T19:00:28.303969] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-26T19:00:28.756764] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-09-26T19:00:29.486681] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-26T19:00:29.556724] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-09-26T19:00:29.889127] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-26T19:00:30.356731] [INFO ] [REMOTE ] GDV: Fetching primary data for 2024-12. [2025-09-26T19:00:31.156699] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-09-26T19:00:31.381966] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-26T19:00:31.456940] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-26T19:00:31.956770] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-09-26T19:00:32.588276] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-26T19:00:32.756761] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-09-26T19:00:33.556706] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-09-26T19:00:33.876780] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-26T19:00:34.210851] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-26T19:00:34.356740] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-09-26T19:00:34.637826] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-26T19:00:35.156763] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-09-26T19:00:35.956748] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-09-26T19:00:36.138823] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-26T19:00:36.525726] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-26T19:00:36.756763] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-09-26T19:00:37.564296] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-09-26T19:00:37.567529] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-26T19:00:37.576401] [INFO ] [REMOTE ] GDOT: Full fetch complete (52897 records). [2025-09-26T19:00:37.576537] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-09-26T19:00:37.997065] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-09-26T19:00:37.997234] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-09-26T19:00:37.998200] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-09-26T19:00:37.998290] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-09-26T19:00:37.999913] [DEBUG] [LOCAL ] GDOT: Trimmed 52897 records to 39279 (keeping 200 days of data) [2025-09-26T19:00:38.102062] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-26T19:00:38.253078] [DEBUG] [LOCAL ] GDOT: Primary data saved (39279 records). [2025-09-26T19:00:38.253249] [INFO ] [MAIN ] GDOT: Full history saved. [2025-09-26T19:00:38.253339] [INFO ] [MAIN ] Update Progress: 910/2371 symbols completed. GDOT took 33.9s. Estimated remaining: 3h 13m 36s. Rate: 7.5 symbols/min [2025-09-26T19:00:38.362855] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-09-26T19:00:38.443104] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:00:38.481456] [DEBUG] [LOCAL ] GEL: Loaded 34035 existing records from primary storage. [2025-09-26T19:00:38.481630] [INFO ] [MAIN ] GEL: Loaded 34035 existing records. [2025-09-26T19:00:38.629049] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-26T19:00:38.709270] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:00:38.709547] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-09-26T19:00:38.709600] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-09-26T19:00:38.710736] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-09-26T19:00:38.710837] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-09-26T19:00:39.114746] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:00:39.156800] [INFO ] [REMOTE ] GEL: Fetching primary data for 2024-12. [2025-09-26T19:00:39.527813] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-26T19:00:39.956753] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-09-26T19:00:40.377615] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-26T19:00:40.756763] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-09-26T19:00:41.556711] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-09-26T19:00:41.920293] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-26T19:00:42.138912] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-26T19:00:42.330421] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-26T19:00:42.356683] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-09-26T19:00:43.156752] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-09-26T19:00:43.777405] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-26T19:00:43.784412] [INFO ] [REMOTE ] GEF: Full fetch complete (29416 records). [2025-09-26T19:00:43.784601] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-09-26T19:00:43.979056] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-09-26T19:00:44.458621] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-09-26T19:00:44.459946] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-26T19:00:44.465893] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-09-26T19:00:44.468333] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-09-26T19:00:44.468896] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-09-26T19:00:44.473480] [DEBUG] [LOCAL ] GEF: Trimmed 29416 records to 20965 (keeping 200 days of data) [2025-09-26T19:00:44.703906] [DEBUG] [LOCAL ] GEF: Primary data saved (20965 records). [2025-09-26T19:00:44.704111] [INFO ] [MAIN ] GEF: Full history saved. [2025-09-26T19:00:44.704388] [INFO ] [MAIN ] Update Progress: 911/2371 symbols completed. GEF took 22.7s. Estimated remaining: 3h 13m 26s. Rate: 7.5 symbols/min [2025-09-26T19:00:44.762829] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-09-26T19:00:45.018289] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:00:45.111385] [DEBUG] [LOCAL ] GENI: Loaded 53298 existing records from primary storage. [2025-09-26T19:00:45.111560] [INFO ] [MAIN ] GENI: Loaded 53298 existing records. [2025-09-26T19:00:45.363370] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:00:45.363854] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-09-26T19:00:45.363912] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-09-26T19:00:45.365525] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-09-26T19:00:45.365637] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-09-26T19:00:45.561200] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-09-26T19:00:45.803352] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:00:46.052208] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-26T19:00:46.155626] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-26T19:00:46.356763] [INFO ] [REMOTE ] GENI: Fetching primary data for 2024-12. [2025-09-26T19:00:46.992012] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-26T19:00:47.156773] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-09-26T19:00:47.956701] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-09-26T19:00:48.086678] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-26T19:00:48.179935] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-26T19:00:48.756746] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-09-26T19:00:49.556746] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-09-26T19:00:50.082885] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-26T19:00:50.294592] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T19:00:50.356699] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-09-26T19:00:50.582974] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-26T19:00:51.156756] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-09-26T19:00:51.460229] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-26T19:00:51.956771] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-09-26T19:00:52.621605] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-26T19:00:52.756765] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-09-26T19:00:53.463493] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-26T19:00:53.556891] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-09-26T19:00:54.073893] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-26T19:00:54.356779] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-09-26T19:00:55.156736] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-09-26T19:00:55.463969] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-26T19:00:55.928857] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-26T19:00:55.941835] [INFO ] [REMOTE ] GE: Full fetch complete (77780 records). [2025-09-26T19:00:55.942017] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-09-26T19:00:55.966946] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-09-26T19:00:56.438727] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-09-26T19:00:56.438857] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-09-26T19:00:56.440068] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-09-26T19:00:56.440326] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-09-26T19:00:56.442224] [DEBUG] [LOCAL ] GE: Trimmed 77780 records to 54493 (keeping 200 days of data) [2025-09-26T19:00:56.712924] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-26T19:00:56.757981] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-09-26T19:00:56.861441] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-26T19:00:56.871764] [DEBUG] [LOCAL ] GE: Primary data saved (54493 records). [2025-09-26T19:00:56.871937] [INFO ] [MAIN ] GE: Full history saved. [2025-09-26T19:00:56.873056] [INFO ] [MAIN ] Update Progress: 912/2371 symbols completed. GE took 37.8s. Estimated remaining: 3h 13m 24s. Rate: 7.5 symbols/min [2025-09-26T19:00:57.062330] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:00:57.125138] [DEBUG] [LOCAL ] GEO: Loaded 52453 existing records from primary storage. [2025-09-26T19:00:57.125315] [INFO ] [MAIN ] GEO: Loaded 52453 existing records. [2025-09-26T19:00:57.320254] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:00:57.320633] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-09-26T19:00:57.320719] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-09-26T19:00:57.322805] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-09-26T19:00:57.322875] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-09-26T19:00:57.561963] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-09-26T19:00:57.718314] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:00:58.205683] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-26T19:00:58.356710] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-09-26T19:00:58.691931] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-26T19:00:58.695928] [INFO ] [REMOTE ] GDV: Full fetch complete (28788 records). [2025-09-26T19:00:58.696022] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-09-26T19:00:59.091030] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-09-26T19:00:59.091129] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-09-26T19:00:59.091767] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-09-26T19:00:59.091829] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-09-26T19:00:59.092925] [DEBUG] [LOCAL ] GDV: Trimmed 28788 records to 19971 (keeping 200 days of data) [2025-09-26T19:00:59.160739] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-09-26T19:00:59.235568] [DEBUG] [LOCAL ] GDV: Primary data saved (19971 records). [2025-09-26T19:00:59.235750] [INFO ] [MAIN ] GDV: Full history saved. [2025-09-26T19:00:59.235848] [INFO ] [MAIN ] Update Progress: 913/2371 symbols completed. GDV took 41.2s. Estimated remaining: 3h 13m 8s. Rate: 7.5 symbols/min [2025-09-26T19:00:59.414206] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:00:59.464252] [DEBUG] [LOCAL ] GES: Loaded 40204 existing records from primary storage. [2025-09-26T19:00:59.464402] [INFO ] [MAIN ] GES: Loaded 40204 existing records. [2025-09-26T19:00:59.657921] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:00:59.658164] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-09-26T19:00:59.658213] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-09-26T19:00:59.659425] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-09-26T19:00:59.659493] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-09-26T19:00:59.961229] [INFO ] [REMOTE ] GEO: Fetching primary data for 2024-12. [2025-09-26T19:01:00.048907] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:01:00.281981] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-26T19:01:00.560844] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-26T19:01:00.756740] [INFO ] [REMOTE ] GES: Fetching primary data for 2024-12. [2025-09-26T19:01:01.556732] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-09-26T19:01:01.939467] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-26T19:01:02.356696] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-09-26T19:01:02.454717] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-26T19:01:02.898526] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-26T19:01:02.907060] [INFO ] [REMOTE ] GEL: Full fetch complete (48664 records). [2025-09-26T19:01:02.907271] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-09-26T19:01:03.161840] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-09-26T19:01:03.354158] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-09-26T19:01:03.354255] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-09-26T19:01:03.355129] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-09-26T19:01:03.355231] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-09-26T19:01:03.358498] [DEBUG] [LOCAL ] GEL: Trimmed 48664 records to 34252 (keeping 200 days of data) [2025-09-26T19:01:03.587841] [DEBUG] [LOCAL ] GEL: Primary data saved (34252 records). [2025-09-26T19:01:03.588014] [INFO ] [MAIN ] GEL: Full history saved. [2025-09-26T19:01:03.588155] [INFO ] [MAIN ] Update Progress: 914/2371 symbols completed. GEL took 25.3s. Estimated remaining: 3h 12m 54s. Rate: 7.6 symbols/min [2025-09-26T19:01:03.782597] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:01:03.828578] [DEBUG] [LOCAL ] GETY: Loaded 36145 existing records from primary storage. [2025-09-26T19:01:03.828747] [INFO ] [MAIN ] GETY: Loaded 36145 existing records. [2025-09-26T19:01:03.961824] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-09-26T19:01:04.033893] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:01:04.034123] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-09-26T19:01:04.034191] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-09-26T19:01:04.035413] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-09-26T19:01:04.035490] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-09-26T19:01:04.450022] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:01:04.485254] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-26T19:01:04.756782] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-09-26T19:01:05.004192] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-26T19:01:05.556739] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-09-26T19:01:05.997560] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-26T19:01:06.356732] [INFO ] [REMOTE ] GETY: Fetching primary data for 2024-12. [2025-09-26T19:01:06.473333] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-26T19:01:07.156706] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-09-26T19:01:07.260285] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-26T19:01:07.841806] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-26T19:01:07.956786] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-09-26T19:01:08.756795] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-09-26T19:01:09.012091] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-26T19:01:09.556727] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-09-26T19:01:09.731219] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-26T19:01:10.166480] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-26T19:01:10.356758] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-09-26T19:01:11.156753] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-09-26T19:01:11.702875] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-26T19:01:11.956757] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-09-26T19:01:12.239809] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-26T19:01:12.407264] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-26T19:01:12.756754] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-09-26T19:01:13.556754] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-09-26T19:01:13.772277] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-26T19:01:14.226249] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-26T19:01:14.356738] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-09-26T19:01:15.156725] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-09-26T19:01:15.314201] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-26T19:01:15.956692] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-09-26T19:01:16.144765] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-26T19:01:16.155884] [INFO ] [REMOTE ] GENI: Full fetch complete (75443 records). [2025-09-26T19:01:16.156077] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-09-26T19:01:16.657790] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-09-26T19:01:16.658013] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-09-26T19:01:16.659214] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-09-26T19:01:16.659357] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-09-26T19:01:16.661391] [DEBUG] [LOCAL ] GENI: Trimmed 75443 records to 53679 (keeping 200 days of data) [2025-09-26T19:01:16.763740] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-09-26T19:01:16.789803] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-26T19:01:17.033783] [DEBUG] [LOCAL ] GENI: Primary data saved (53679 records). [2025-09-26T19:01:17.033955] [INFO ] [MAIN ] GENI: Full history saved. [2025-09-26T19:01:17.034045] [INFO ] [MAIN ] Update Progress: 915/2371 symbols completed. GENI took 32.3s. Estimated remaining: 3h 12m 55s. Rate: 7.5 symbols/min [2025-09-26T19:01:17.224030] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:01:17.288152] [DEBUG] [LOCAL ] GEV: Loaded 53499 existing records from primary storage. [2025-09-26T19:01:17.288318] [INFO ] [MAIN ] GEV: Loaded 53499 existing records. [2025-09-26T19:01:17.487162] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:01:17.487467] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-09-26T19:01:17.487523] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-09-26T19:01:17.489227] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-09-26T19:01:17.489315] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-09-26T19:01:17.574830] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-09-26T19:01:17.876737] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:01:17.912245] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-26T19:01:18.315472] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-26T19:01:18.356746] [INFO ] [REMOTE ] GEV: Fetching primary data for 2024-12. [2025-09-26T19:01:19.156744] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-09-26T19:01:19.301759] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-26T19:01:19.956723] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-09-26T19:01:20.582987] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-26T19:01:20.756731] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-09-26T19:01:21.057836] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-26T19:01:21.556718] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-09-26T19:01:21.743391] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-26T19:01:22.356732] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-09-26T19:01:22.875757] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-26T19:01:23.092944] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-26T19:01:23.156700] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-09-26T19:01:23.842264] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-26T19:01:23.956735] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-09-26T19:01:24.735014] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-26T19:01:24.756728] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-09-26T19:01:25.556725] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-09-26T19:01:25.757836] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-26T19:01:26.356733] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-09-26T19:01:27.122382] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-09-26T19:01:27.161956] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-09-26T19:01:27.177565] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-26T19:01:27.956708] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-09-26T19:01:27.981870] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-26T19:01:28.756814] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-09-26T19:01:29.093192] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-26T19:01:29.104393] [INFO ] [REMOTE ] GEO: Full fetch complete (75513 records). [2025-09-26T19:01:29.104733] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-09-26T19:01:29.566250] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-09-26T19:01:29.572339] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-09-26T19:01:29.572491] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-09-26T19:01:29.573878] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-09-26T19:01:29.574204] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-09-26T19:01:29.599637] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-26T19:01:29.608547] [DEBUG] [LOCAL ] GEO: Trimmed 75513 records to 52812 (keeping 200 days of data) [2025-09-26T19:01:29.940471] [DEBUG] [LOCAL ] GEO: Primary data saved (52812 records). [2025-09-26T19:01:29.940636] [INFO ] [MAIN ] GEO: Full history saved. [2025-09-26T19:01:29.941320] [INFO ] [MAIN ] Update Progress: 916/2371 symbols completed. GEO took 33.1s. Estimated remaining: 3h 12m 55s. Rate: 7.5 symbols/min [2025-09-26T19:01:30.119894] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:01:30.125564] [DEBUG] [LOCAL ] GF: Loaded 3206 existing records from primary storage. [2025-09-26T19:01:30.125693] [INFO ] [MAIN ] GF: Loaded 3206 existing records. [2025-09-26T19:01:30.310514] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:01:30.310846] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-09-26T19:01:30.310919] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-09-26T19:01:30.311203] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-09-26T19:01:30.311286] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-09-26T19:01:30.370284] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-09-26T19:01:30.733193] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:01:31.131679] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-26T19:01:31.156672] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-09-26T19:01:31.213198] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T19:01:31.220827] [INFO ] [REMOTE ] GES: Full fetch complete (59820 records). [2025-09-26T19:01:31.221013] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-09-26T19:01:31.646517] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-09-26T19:01:31.646621] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-09-26T19:01:31.647735] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-09-26T19:01:31.647808] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-09-26T19:01:31.649266] [DEBUG] [LOCAL ] GES: Trimmed 59820 records to 40424 (keeping 200 days of data) [2025-09-26T19:01:31.964957] [INFO ] [REMOTE ] GF: Fetching primary data for 2024-12. [2025-09-26T19:01:31.988392] [DEBUG] [LOCAL ] GES: Primary data saved (40424 records). [2025-09-26T19:01:31.988986] [INFO ] [MAIN ] GES: Full history saved. [2025-09-26T19:01:31.989865] [INFO ] [MAIN ] Update Progress: 917/2371 symbols completed. GES took 32.8s. Estimated remaining: 3h 12m 37s. Rate: 7.5 symbols/min [2025-09-26T19:01:31.991964] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-26T19:01:32.653097] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-26T19:01:32.756738] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-09-26T19:01:33.557002] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-26T19:01:33.557152] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-09-26T19:01:34.050915] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-26T19:01:34.098715] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-26T19:01:34.356763] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-09-26T19:01:34.954285] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-26T19:01:35.156773] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-09-26T19:01:35.956745] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-09-26T19:01:36.756755] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-09-26T19:01:36.962220] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-26T19:01:36.969603] [INFO ] [REMOTE ] GETY: Full fetch complete (55714 records). [2025-09-26T19:01:36.969786] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-09-26T19:01:37.417261] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-09-26T19:01:37.417377] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-09-26T19:01:37.418327] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-09-26T19:01:37.418398] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-09-26T19:01:37.419963] [DEBUG] [LOCAL ] GETY: Trimmed 55714 records to 36378 (keeping 200 days of data) [2025-09-26T19:01:37.611415] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-26T19:01:37.643791] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-09-26T19:01:37.672954] [DEBUG] [LOCAL ] GETY: Primary data saved (36378 records). [2025-09-26T19:01:37.673159] [INFO ] [MAIN ] GETY: Full history saved. [2025-09-26T19:01:37.673310] [INFO ] [MAIN ] Update Progress: 918/2371 symbols completed. GETY took 34.1s. Estimated remaining: 3h 12m 26s. Rate: 7.6 symbols/min [2025-09-26T19:01:38.158618] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-26T19:01:38.230842] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-26T19:01:38.356784] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-09-26T19:01:38.739918] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-26T19:01:39.156902] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-09-26T19:01:39.956775] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-09-26T19:01:40.465078] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-26T19:01:40.756743] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-09-26T19:01:41.228821] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-26T19:01:41.389336] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-26T19:01:41.556717] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-09-26T19:01:42.042572] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-26T19:01:42.356766] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-09-26T19:01:42.842430] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-26T19:01:42.843408] [INFO ] [REMOTE ] GF: Full fetch complete (5292 records). [2025-09-26T19:01:42.843484] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-09-26T19:01:43.163446] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-09-26T19:01:43.254262] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-09-26T19:01:43.254419] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-09-26T19:01:43.254605] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-09-26T19:01:43.254695] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-09-26T19:01:43.255169] [DEBUG] [LOCAL ] GF: Trimmed 5292 records to 3220 (keeping 200 days of data) [2025-09-26T19:01:43.277330] [DEBUG] [LOCAL ] GF: Primary data saved (3220 records). [2025-09-26T19:01:43.277466] [INFO ] [MAIN ] GF: Full history saved. [2025-09-26T19:01:43.277553] [INFO ] [MAIN ] Update Progress: 919/2371 symbols completed. GF took 13.3s. Estimated remaining: 3h 12m 14s. Rate: 7.6 symbols/min [2025-09-26T19:01:45.675150] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-09-26T19:01:45.688055] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-09-26T19:01:48.191344] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-09-26T19:01:48.203338] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-09-26T19:01:50.826943] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-09-26T19:01:50.838106] [INFO ] [REMOTE ] GEV: Full fetch complete (76964 records). [2025-09-26T19:01:50.838303] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-09-26T19:01:51.283625] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-09-26T19:01:51.283761] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-09-26T19:01:51.284872] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-09-26T19:01:51.284943] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-09-26T19:01:51.286739] [DEBUG] [LOCAL ] GEV: Trimmed 76964 records to 53878 (keeping 200 days of data) [2025-09-26T19:01:51.649438] [DEBUG] [LOCAL ] GEV: Primary data saved (53878 records). [2025-09-26T19:01:51.649593] [INFO ] [MAIN ] GEV: Full history saved. [2025-09-26T19:01:51.649719] [INFO ] [MAIN ] Update Progress: 920/2371 symbols completed. GEV took 34.6s. Estimated remaining: 3h 12m 7s. Rate: 7.6 symbols/min [2025-09-26T19:01:52.358073] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:01:52.409518] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:01:52.431227] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:01:52.426852] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:01:52.443264] [DEBUG] [LOCAL ] GFR: Loaded 8522 existing records from primary storage. [2025-09-26T19:01:52.443624] [INFO ] [MAIN ] GFR: Loaded 8522 existing records. [2025-09-26T19:01:52.633305] [DEBUG] [LOCAL ] GFF: Loaded 30968 existing records from primary storage. [2025-09-26T19:01:52.638947] [INFO ] [MAIN ] GFF: Loaded 30968 existing records. [2025-09-26T19:01:52.843639] [DEBUG] [LOCAL ] GFL: Loaded 48414 existing records from primary storage. [2025-09-26T19:01:52.847786] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:01:52.842762] [DEBUG] [LOCAL ] GFI: Loaded 53499 existing records from primary storage. [2025-09-26T19:01:52.864181] [INFO ] [MAIN ] GFI: Loaded 53499 existing records. [2025-09-26T19:01:52.869505] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-09-26T19:01:52.891314] [INFO ] [MAIN ] GFL: Loaded 48414 existing records. [2025-09-26T19:01:52.981398] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-09-26T19:01:53.123008] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-09-26T19:01:53.184107] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-09-26T19:01:53.234510] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:01:53.246826] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-09-26T19:01:53.303510] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-09-26T19:01:53.391904] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-09-26T19:01:53.438115] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:01:53.483597] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-09-26T19:01:53.489017] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-09-26T19:01:53.494285] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-09-26T19:01:53.529295] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-09-26T19:01:53.624896] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-09-26T19:01:53.789081] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:01:53.946843] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-09-26T19:01:53.972862] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-09-26T19:01:54.075512] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-09-26T19:01:54.172712] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-09-26T19:01:54.547213] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:01:54.590584] [INFO ] [REMOTE ] GFR: Fetching primary data for 2024-12. [2025-09-26T19:01:54.903889] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:01:54.954540] [INFO ] [REMOTE ] GFF: Fetching primary data for 2024-12. [2025-09-26T19:01:55.020604] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:01:55.035461] [INFO ] [REMOTE ] GFL: Fetching primary data for 2024-12. [2025-09-26T19:01:55.204631] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:01:55.205005] [INFO ] [REMOTE ] GFI: Fetching primary data for 2024-12. [2025-09-26T19:01:55.541249] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-26T19:01:55.544749] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-09-26T19:01:56.315242] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-26T19:01:56.318105] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-09-26T19:01:56.384583] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-26T19:01:56.390922] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-09-26T19:01:56.672862] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-26T19:01:56.682428] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-09-26T19:01:56.767013] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-26T19:01:56.777593] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-09-26T19:01:57.145045] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-26T19:01:57.147586] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-09-26T19:01:57.555814] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-26T19:01:57.563279] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-09-26T19:01:57.988913] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-26T19:01:57.999813] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-09-26T19:01:58.009285] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-26T19:01:58.012993] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-09-26T19:01:58.414550] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-26T19:01:58.421770] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-09-26T19:01:58.609533] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-26T19:01:58.613533] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-09-26T19:01:58.694083] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-26T19:01:58.705878] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-09-26T19:01:59.245886] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-26T19:01:59.255535] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-09-26T19:01:59.398848] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-26T19:01:59.402058] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-09-26T19:01:59.841384] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-26T19:01:59.956763] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-09-26T19:02:00.171680] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-26T19:02:00.619620] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-26T19:02:00.756727] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-09-26T19:02:01.084358] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-26T19:02:01.526276] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-26T19:02:01.556775] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-09-26T19:02:02.356777] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-09-26T19:02:02.627768] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-26T19:02:02.950213] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-26T19:02:03.157828] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T19:02:03.157921] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-09-26T19:02:03.956725] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-09-26T19:02:04.493638] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-26T19:02:04.756769] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-09-26T19:02:05.376219] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-26T19:02:05.556729] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-09-26T19:02:06.174800] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-26T19:02:06.175599] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-26T19:02:06.189126] [INFO ] [REMOTE ] GFR: Full fetch complete (12786 records). [2025-09-26T19:02:06.189684] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-09-26T19:02:06.359695] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-09-26T19:02:06.587605] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-09-26T19:02:06.587725] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-09-26T19:02:06.588122] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-09-26T19:02:06.588167] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-09-26T19:02:06.588682] [DEBUG] [LOCAL ] GFR: Trimmed 12786 records to 8572 (keeping 200 days of data) [2025-09-26T19:02:06.640087] [DEBUG] [LOCAL ] GFR: Primary data saved (8572 records). [2025-09-26T19:02:06.640257] [INFO ] [MAIN ] GFR: Full history saved. [2025-09-26T19:02:06.640467] [INFO ] [MAIN ] Update Progress: 921/2371 symbols completed. GFR took 15.0s. Estimated remaining: 3h 12m 10s. Rate: 7.5 symbols/min [2025-09-26T19:02:06.834542] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:02:06.886633] [DEBUG] [LOCAL ] GGB: Loaded 51429 existing records from primary storage. [2025-09-26T19:02:06.886851] [INFO ] [MAIN ] GGB: Loaded 51429 existing records. [2025-09-26T19:02:07.080032] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:02:07.080388] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-09-26T19:02:07.080462] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-09-26T19:02:07.081909] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-09-26T19:02:07.081974] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-09-26T19:02:07.161910] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-09-26T19:02:07.476931] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:02:07.956727] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-09-26T19:02:08.161279] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-26T19:02:08.756765] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-09-26T19:02:09.270142] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-26T19:02:09.310354] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-26T19:02:09.556731] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-09-26T19:02:10.229545] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-26T19:02:10.356800] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-09-26T19:02:10.375783] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-26T19:02:11.156751] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-09-26T19:02:11.956734] [INFO ] [REMOTE ] GGB: Fetching primary data for 2024-12. [2025-09-26T19:02:12.472124] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-26T19:02:12.585169] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-26T19:02:12.756758] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-09-26T19:02:13.188856] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-26T19:02:13.556746] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-09-26T19:02:14.356830] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-09-26T19:02:14.465061] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-26T19:02:14.470876] [INFO ] [REMOTE ] GFF: Full fetch complete (44164 records). [2025-09-26T19:02:14.471022] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-09-26T19:02:14.930308] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-09-26T19:02:14.930703] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-09-26T19:02:14.931617] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-09-26T19:02:14.931751] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-09-26T19:02:14.933290] [DEBUG] [LOCAL ] GFF: Trimmed 44164 records to 31088 (keeping 200 days of data) [2025-09-26T19:02:15.062088] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-26T19:02:15.156839] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-09-26T19:02:15.179991] [DEBUG] [LOCAL ] GFF: Primary data saved (31088 records). [2025-09-26T19:02:15.180252] [INFO ] [MAIN ] GFF: Full history saved. [2025-09-26T19:02:15.180363] [INFO ] [MAIN ] Update Progress: 922/2371 symbols completed. GFF took 23.5s. Estimated remaining: 3h 12m 3s. Rate: 7.5 symbols/min [2025-09-26T19:02:15.361412] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:02:15.407586] [DEBUG] [LOCAL ] GGG: Loaded 41294 existing records from primary storage. [2025-09-26T19:02:15.407805] [INFO ] [MAIN ] GGG: Loaded 41294 existing records. [2025-09-26T19:02:15.603690] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:02:15.604086] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-09-26T19:02:15.604147] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-09-26T19:02:15.605755] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-09-26T19:02:15.605824] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-09-26T19:02:15.961133] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-09-26T19:02:16.027969] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:02:16.072743] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-26T19:02:16.756715] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-09-26T19:02:17.193856] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-26T19:02:17.556742] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-12. [2025-09-26T19:02:17.619887] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-26T19:02:18.361817] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-09-26T19:02:18.379280] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-26T19:02:19.057470] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-26T19:02:19.156728] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-09-26T19:02:19.956721] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-09-26T19:02:20.326874] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-26T19:02:20.337326] [INFO ] [REMOTE ] GFL: Full fetch complete (68877 records). [2025-09-26T19:02:20.337535] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-09-26T19:02:20.756767] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-09-26T19:02:20.757145] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-09-26T19:02:20.757235] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-09-26T19:02:20.759018] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-09-26T19:02:20.759155] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-09-26T19:02:20.760734] [DEBUG] [LOCAL ] GFL: Trimmed 68877 records to 48755 (keeping 200 days of data) [2025-09-26T19:02:21.121948] [DEBUG] [LOCAL ] GFL: Primary data saved (48755 records). [2025-09-26T19:02:21.122810] [INFO ] [MAIN ] GFL: Full history saved. [2025-09-26T19:02:21.123923] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-26T19:02:21.124190] [INFO ] [MAIN ] Update Progress: 923/2371 symbols completed. GFL took 29.5s. Estimated remaining: 3h 11m 52s. Rate: 7.5 symbols/min [2025-09-26T19:02:21.324400] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:02:21.363214] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-26T19:02:21.381540] [DEBUG] [LOCAL ] GGT: Loaded 14231 existing records from primary storage. [2025-09-26T19:02:21.381714] [INFO ] [MAIN ] GGT: Loaded 14231 existing records. [2025-09-26T19:02:21.574168] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-09-26T19:02:21.580776] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:02:21.582224] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-09-26T19:02:21.582315] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-09-26T19:02:21.583056] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-09-26T19:02:21.583128] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-09-26T19:02:21.993291] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:02:22.284895] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-26T19:02:22.356725] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-09-26T19:02:23.156697] [INFO ] [REMOTE ] GGT: Fetching primary data for 2024-12. [2025-09-26T19:02:23.405157] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-26T19:02:23.873587] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-26T19:02:23.956752] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-09-26T19:02:24.102050] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-26T19:02:24.756762] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-09-26T19:02:25.556700] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-09-26T19:02:25.728890] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-26T19:02:25.872624] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-26T19:02:26.356778] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-09-26T19:02:27.156785] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-09-26T19:02:27.765509] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-26T19:02:27.776687] [INFO ] [REMOTE ] GFI: Full fetch complete (76340 records). [2025-09-26T19:02:27.776862] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-09-26T19:02:27.960497] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-09-26T19:02:28.100836] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-26T19:02:28.263525] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-26T19:02:28.322029] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-09-26T19:02:28.322144] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-09-26T19:02:28.323827] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-09-26T19:02:28.323925] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-09-26T19:02:28.325532] [DEBUG] [LOCAL ] GFI: Trimmed 76340 records to 53887 (keeping 200 days of data) [2025-09-26T19:02:28.664289] [DEBUG] [LOCAL ] GFI: Primary data saved (53887 records). [2025-09-26T19:02:28.664459] [INFO ] [MAIN ] GFI: Full history saved. [2025-09-26T19:02:28.664556] [INFO ] [MAIN ] Update Progress: 924/2371 symbols completed. GFI took 37.0s. Estimated remaining: 3h 11m 43s. Rate: 7.5 symbols/min [2025-09-26T19:02:28.761862] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-09-26T19:02:28.865363] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:02:28.869824] [DEBUG] [LOCAL ] GGZ: Loaded 2457 existing records from primary storage. [2025-09-26T19:02:28.869904] [INFO ] [MAIN ] GGZ: Loaded 2457 existing records. [2025-09-26T19:02:29.061554] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:02:29.061885] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-09-26T19:02:29.061942] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-09-26T19:02:29.062229] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-09-26T19:02:29.062290] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-09-26T19:02:29.442555] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:02:29.556707] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2024-12. [2025-09-26T19:02:29.875802] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-26T19:02:30.148022] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-26T19:02:30.356781] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-09-26T19:02:30.974524] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-26T19:02:31.158124] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-09-26T19:02:31.168299] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-26T19:02:31.956786] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-09-26T19:02:32.751242] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-26T19:02:32.759945] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-09-26T19:02:32.780688] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-26T19:02:33.556725] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-09-26T19:02:34.356783] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-09-26T19:02:34.591842] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-26T19:02:35.047021] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-26T19:02:35.156718] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-09-26T19:02:35.337294] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-26T19:02:35.956763] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-09-26T19:02:36.702277] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-26T19:02:36.756720] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-09-26T19:02:36.903004] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-26T19:02:37.206298] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-26T19:02:37.556724] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-09-26T19:02:38.031986] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-26T19:02:38.356760] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-09-26T19:02:39.156743] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-09-26T19:02:39.395845] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-26T19:02:39.956772] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-09-26T19:02:40.531665] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-26T19:02:40.756750] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-09-26T19:02:40.876862] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T19:02:40.887364] [INFO ] [REMOTE ] GGB: Full fetch complete (74027 records). [2025-09-26T19:02:40.887543] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-09-26T19:02:41.302510] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-09-26T19:02:41.302604] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-09-26T19:02:41.303539] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-09-26T19:02:41.303628] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-09-26T19:02:41.305329] [DEBUG] [LOCAL ] GGB: Trimmed 74027 records to 51813 (keeping 200 days of data) [2025-09-26T19:02:41.556712] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-09-26T19:02:41.651494] [DEBUG] [LOCAL ] GGB: Primary data saved (51813 records). [2025-09-26T19:02:41.651697] [INFO ] [MAIN ] GGB: Full history saved. [2025-09-26T19:02:41.651851] [INFO ] [MAIN ] Update Progress: 925/2371 symbols completed. GGB took 35.0s. Estimated remaining: 3h 11m 43s. Rate: 7.5 symbols/min [2025-09-26T19:02:41.850906] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-26T19:02:41.854346] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:02:41.863177] [DEBUG] [LOCAL ] GHC: Loaded 2651 existing records from primary storage. [2025-09-26T19:02:41.863257] [INFO ] [MAIN ] GHC: Loaded 2651 existing records. [2025-09-26T19:02:42.055468] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:02:42.055850] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-09-26T19:02:42.055906] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-09-26T19:02:42.056177] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-09-26T19:02:42.056249] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-09-26T19:02:42.176176] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-26T19:02:42.361908] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-09-26T19:02:42.478980] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:02:43.156737] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-09-26T19:02:43.624424] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-26T19:02:43.956737] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-09-26T19:02:44.110896] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-26T19:02:44.756753] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-09-26T19:02:45.187545] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-26T19:02:45.556734] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-09-26T19:02:46.151876] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-26T19:02:46.356755] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-09-26T19:02:46.411247] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T19:02:46.418980] [INFO ] [REMOTE ] GGG: Full fetch complete (59038 records). [2025-09-26T19:02:46.419125] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-09-26T19:02:46.419972] [FATAL] [VALIDATOR ] GGG: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T19:02:46.420067] [FATAL] [MAIN ] GGG: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:02:46.420114] [WARN ] [MAIN ] GGG: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:02:46.420185] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-09-26T19:02:46.420260] [DEBUG] [LOCAL ] GGG: No primary data file found to delete. [2025-09-26T19:02:46.420300] [INFO ] [LOCAL ] GGG: Starting deletion of derivative data. [2025-09-26T19:02:46.420886] [DEBUG] [LOCAL ] GGG: Deleted derivative data file. [2025-09-26T19:02:46.420992] [INFO ] [MAIN ] Update Progress: 926/2371 symbols completed. GGG took 31.2s. Estimated remaining: 3h 11m 30s. Rate: 7.5 symbols/min [2025-09-26T19:02:46.611717] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:02:46.616770] [DEBUG] [LOCAL ] GHG: Loaded 3210 existing records from primary storage. [2025-09-26T19:02:46.616863] [INFO ] [MAIN ] GHG: Loaded 3210 existing records. [2025-09-26T19:02:46.814260] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:02:46.814542] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-09-26T19:02:46.814592] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-09-26T19:02:46.814858] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-09-26T19:02:46.814922] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-09-26T19:02:47.164867] [INFO ] [REMOTE ] GHC: Fetching primary data for 2024-12. [2025-09-26T19:02:47.213163] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:02:47.278871] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-26T19:02:47.602239] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-26T19:02:47.956772] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-09-26T19:02:48.756743] [INFO ] [REMOTE ] GHG: Fetching primary data for 2024-12. [2025-09-26T19:02:49.090480] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-26T19:02:49.090309] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-26T19:02:49.096556] [INFO ] [REMOTE ] GGT: Full fetch complete (18707 records). [2025-09-26T19:02:49.096698] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-09-26T19:02:49.532491] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-09-26T19:02:49.532636] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-09-26T19:02:49.533171] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-09-26T19:02:49.533238] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-09-26T19:02:49.535264] [DEBUG] [LOCAL ] GGT: Trimmed 18707 records to 14309 (keeping 200 days of data) [2025-09-26T19:02:49.571118] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-09-26T19:02:49.627202] [DEBUG] [LOCAL ] GGT: Primary data saved (14309 records). [2025-09-26T19:02:49.627373] [INFO ] [MAIN ] GGT: Full history saved. [2025-09-26T19:02:49.627475] [INFO ] [MAIN ] Update Progress: 927/2371 symbols completed. GGT took 28.5s. Estimated remaining: 3h 11m 15s. Rate: 7.6 symbols/min [2025-09-26T19:02:49.809818] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:02:49.819254] [DEBUG] [LOCAL ] GHI: Loaded 6903 existing records from primary storage. [2025-09-26T19:02:49.819360] [INFO ] [MAIN ] GHI: Loaded 6903 existing records. [2025-09-26T19:02:50.008528] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:02:50.008885] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-09-26T19:02:50.008945] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-09-26T19:02:50.009390] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-09-26T19:02:50.009493] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-09-26T19:02:50.118326] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-26T19:02:50.361908] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-09-26T19:02:50.394927] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:02:50.822245] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-26T19:02:51.156786] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-09-26T19:02:51.709973] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-26T19:02:51.711214] [INFO ] [REMOTE ] GGZ: Full fetch complete (4163 records). [2025-09-26T19:02:51.711317] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-09-26T19:02:51.961992] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-09-26T19:02:52.101696] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-09-26T19:02:52.101791] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-09-26T19:02:52.101939] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-09-26T19:02:52.101983] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-09-26T19:02:52.102413] [DEBUG] [LOCAL ] GGZ: Trimmed 4163 records to 2465 (keeping 200 days of data) [2025-09-26T19:02:52.118295] [DEBUG] [LOCAL ] GGZ: Primary data saved (2465 records). [2025-09-26T19:02:52.118396] [INFO ] [MAIN ] GGZ: Full history saved. [2025-09-26T19:02:52.118495] [INFO ] [MAIN ] Update Progress: 928/2371 symbols completed. GGZ took 23.5s. Estimated remaining: 3h 10m 59s. Rate: 7.6 symbols/min [2025-09-26T19:02:52.311017] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:02:52.317346] [DEBUG] [LOCAL ] GHLD: Loaded 4144 existing records from primary storage. [2025-09-26T19:02:52.317459] [INFO ] [MAIN ] GHLD: Loaded 4144 existing records. [2025-09-26T19:02:52.530908] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:02:52.537407] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-26T19:02:52.537893] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-09-26T19:02:52.539554] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-09-26T19:02:52.539942] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-09-26T19:02:52.540032] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-09-26T19:02:52.762626] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-09-26T19:02:52.930463] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:02:53.274477] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-26T19:02:53.556732] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-09-26T19:02:54.161496] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-26T19:02:54.356772] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-09-26T19:02:54.867807] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-26T19:02:55.156762] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2024-12. [2025-09-26T19:02:55.612266] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-26T19:02:55.956721] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-09-26T19:02:56.391023] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-26T19:02:56.756769] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-09-26T19:02:57.113839] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-26T19:02:57.556743] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-09-26T19:02:58.103056] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-26T19:02:58.356741] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-09-26T19:02:58.916498] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-26T19:02:59.156765] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-09-26T19:02:59.726063] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-26T19:02:59.956765] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-09-26T19:03:00.725741] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-26T19:03:00.756754] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-09-26T19:03:01.370006] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-26T19:03:01.556772] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-09-26T19:03:02.064100] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-26T19:03:02.356775] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-09-26T19:03:02.978780] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-26T19:03:03.156776] [INFO ] [REMOTE ] GHI: Fetching primary data for 2024-12. [2025-09-26T19:03:03.956712] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-09-26T19:03:04.146541] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-26T19:03:04.403541] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-26T19:03:04.756741] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-09-26T19:03:05.382791] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-26T19:03:05.556725] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-09-26T19:03:05.994404] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-26T19:03:06.356723] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-09-26T19:03:06.938889] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-26T19:03:07.156733] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-09-26T19:03:07.769429] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-26T19:03:07.956735] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-09-26T19:03:08.549810] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-26T19:03:08.756736] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-09-26T19:03:09.420844] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-26T19:03:09.556724] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-09-26T19:03:10.066681] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-26T19:03:10.356753] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-09-26T19:03:11.156693] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-09-26T19:03:11.166062] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-26T19:03:11.944810] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-26T19:03:11.956728] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-09-26T19:03:12.526940] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-26T19:03:12.756736] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-09-26T19:03:13.556729] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-09-26T19:03:13.660424] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-26T19:03:14.089119] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-26T19:03:14.356730] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-09-26T19:03:15.061549] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-26T19:03:15.062786] [INFO ] [REMOTE ] GHC: Full fetch complete (3271 records). [2025-09-26T19:03:15.062882] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-09-26T19:03:15.161857] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-09-26T19:03:15.461543] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-09-26T19:03:15.461665] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-09-26T19:03:15.461837] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-09-26T19:03:15.461924] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-09-26T19:03:15.462382] [DEBUG] [LOCAL ] GHC: Trimmed 3271 records to 2664 (keeping 200 days of data) [2025-09-26T19:03:15.482217] [DEBUG] [LOCAL ] GHC: Primary data saved (2664 records). [2025-09-26T19:03:15.482320] [INFO ] [MAIN ] GHC: Full history saved. [2025-09-26T19:03:15.482540] [INFO ] [MAIN ] Update Progress: 929/2371 symbols completed. GHC took 33.8s. Estimated remaining: 3h 11m 15s. Rate: 7.5 symbols/min [2025-09-26T19:03:15.676702] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:03:15.699445] [DEBUG] [LOCAL ] GHM: Loaded 14240 existing records from primary storage. [2025-09-26T19:03:15.699586] [INFO ] [MAIN ] GHM: Loaded 14240 existing records. [2025-09-26T19:03:15.900605] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:03:15.900926] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-09-26T19:03:15.900978] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-09-26T19:03:15.901542] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-09-26T19:03:15.901604] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-09-26T19:03:15.961839] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-09-26T19:03:16.203368] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-26T19:03:16.229861] [INFO ] [REMOTE ] GHG: Full fetch complete (4028 records). [2025-09-26T19:03:16.246634] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-09-26T19:03:16.410441] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:03:16.747966] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-09-26T19:03:16.748174] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-09-26T19:03:16.748376] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-09-26T19:03:16.748419] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-09-26T19:03:16.749081] [DEBUG] [LOCAL ] GHG: Trimmed 4028 records to 3226 (keeping 200 days of data) [2025-09-26T19:03:16.758981] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-09-26T19:03:16.772591] [DEBUG] [LOCAL ] GHG: Primary data saved (3226 records). [2025-09-26T19:03:16.772772] [INFO ] [MAIN ] GHG: Full history saved. [2025-09-26T19:03:16.772929] [INFO ] [MAIN ] Update Progress: 930/2371 symbols completed. GHG took 30.4s. Estimated remaining: 3h 10m 56s. Rate: 7.5 symbols/min [2025-09-26T19:03:16.886611] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-26T19:03:16.976825] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:03:17.006085] [DEBUG] [LOCAL ] GHY: Loaded 20903 existing records from primary storage. [2025-09-26T19:03:17.006236] [INFO ] [MAIN ] GHY: Loaded 20903 existing records. [2025-09-26T19:03:17.199863] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:03:17.200310] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-09-26T19:03:17.200432] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-09-26T19:03:17.201349] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-09-26T19:03:17.201413] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-09-26T19:03:17.528636] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-26T19:03:17.551326] [INFO ] [REMOTE ] GHLD: Full fetch complete (4769 records). [2025-09-26T19:03:17.569326] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-09-26T19:03:17.576764] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-09-26T19:03:17.616015] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:03:18.031740] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-09-26T19:03:18.031831] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-09-26T19:03:18.031975] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-09-26T19:03:18.032014] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-09-26T19:03:18.032416] [DEBUG] [LOCAL ] GHLD: Trimmed 4769 records to 4168 (keeping 200 days of data) [2025-09-26T19:03:18.062189] [DEBUG] [LOCAL ] GHLD: Primary data saved (4168 records). [2025-09-26T19:03:18.062347] [INFO ] [MAIN ] GHLD: Full history saved. [2025-09-26T19:03:18.062460] [INFO ] [MAIN ] Update Progress: 931/2371 symbols completed. GHLD took 25.9s. Estimated remaining: 3h 10m 38s. Rate: 7.6 symbols/min [2025-09-26T19:03:18.257716] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:03:18.308334] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-26T19:03:18.322595] [DEBUG] [LOCAL ] GIB: Loaded 32311 existing records from primary storage. [2025-09-26T19:03:18.322781] [INFO ] [MAIN ] GIB: Loaded 32311 existing records. [2025-09-26T19:03:18.362418] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-09-26T19:03:18.509975] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:03:18.510226] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-09-26T19:03:18.510287] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-09-26T19:03:18.511539] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-09-26T19:03:18.511602] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-09-26T19:03:18.908821] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:03:19.073797] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-26T19:03:19.156723] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-09-26T19:03:19.944137] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-26T19:03:19.956677] [INFO ] [REMOTE ] GHM: Fetching primary data for 2024-12. [2025-09-26T19:03:20.756696] [INFO ] [REMOTE ] GHY: Fetching primary data for 2024-12. [2025-09-26T19:03:21.050573] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-26T19:03:21.556731] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-09-26T19:03:21.868865] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-26T19:03:22.356728] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-09-26T19:03:22.453346] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-26T19:03:23.156783] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-09-26T19:03:23.528075] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-26T19:03:23.956710] [INFO ] [REMOTE ] GIB: Fetching primary data for 2024-12. [2025-09-26T19:03:24.086472] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-26T19:03:24.756694] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-09-26T19:03:25.148702] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-26T19:03:25.556703] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-09-26T19:03:25.930377] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-26T19:03:26.356707] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-09-26T19:03:26.369720] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-26T19:03:26.371547] [INFO ] [REMOTE ] GHI: Full fetch complete (11647 records). [2025-09-26T19:03:26.371622] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-09-26T19:03:26.792051] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-09-26T19:03:26.792147] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-09-26T19:03:26.792465] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-09-26T19:03:26.792518] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-09-26T19:03:26.793567] [DEBUG] [LOCAL ] GHI: Trimmed 11647 records to 6963 (keeping 200 days of data) [2025-09-26T19:03:26.841866] [DEBUG] [LOCAL ] GHI: Primary data saved (6963 records). [2025-09-26T19:03:26.842038] [INFO ] [MAIN ] GHI: Full history saved. [2025-09-26T19:03:26.842163] [INFO ] [MAIN ] Update Progress: 932/2371 symbols completed. GHI took 37.2s. Estimated remaining: 3h 10m 31s. Rate: 7.6 symbols/min [2025-09-26T19:03:27.043113] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:03:27.060938] [DEBUG] [LOCAL ] GIC: Loaded 13732 existing records from primary storage. [2025-09-26T19:03:27.061085] [INFO ] [MAIN ] GIC: Loaded 13732 existing records. [2025-09-26T19:03:27.161786] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-09-26T19:03:27.261739] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:03:27.262088] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-09-26T19:03:27.262204] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-09-26T19:03:27.262909] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-09-26T19:03:27.262972] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-09-26T19:03:27.538203] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-26T19:03:27.677190] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:03:27.956781] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-09-26T19:03:28.311917] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-26T19:03:28.756742] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-09-26T19:03:29.065978] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-26T19:03:29.556749] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-09-26T19:03:30.051101] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-26T19:03:30.356736] [INFO ] [REMOTE ] GIC: Fetching primary data for 2024-12. [2025-09-26T19:03:30.548044] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-26T19:03:31.156760] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-09-26T19:03:31.567541] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-26T19:03:31.956754] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-09-26T19:03:32.560725] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-26T19:03:32.756718] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-09-26T19:03:32.834588] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-26T19:03:33.556737] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-09-26T19:03:34.296358] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T19:03:34.356747] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-09-26T19:03:34.722594] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-26T19:03:35.156718] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-09-26T19:03:35.331363] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-26T19:03:35.956712] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-09-26T19:03:36.388206] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-26T19:03:36.756737] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-09-26T19:03:37.526417] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-26T19:03:37.556709] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-09-26T19:03:37.792723] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-26T19:03:38.356703] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-09-26T19:03:38.440919] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-26T19:03:39.156729] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-09-26T19:03:39.656374] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-26T19:03:39.956755] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-09-26T19:03:40.219152] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-26T19:03:40.756729] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-09-26T19:03:40.873859] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-26T19:03:41.556730] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-09-26T19:03:42.155215] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-26T19:03:42.356765] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-09-26T19:03:42.591519] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-26T19:03:43.156727] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-09-26T19:03:43.574030] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-26T19:03:43.956754] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-09-26T19:03:44.240638] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-26T19:03:44.756767] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-09-26T19:03:45.043027] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-26T19:03:45.556734] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-09-26T19:03:45.602437] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-26T19:03:46.356743] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-09-26T19:03:46.939479] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-26T19:03:47.156710] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-09-26T19:03:47.401135] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-26T19:03:47.956693] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-09-26T19:03:48.185556] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-26T19:03:48.756766] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-09-26T19:03:49.552316] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-26T19:03:49.558796] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-09-26T19:03:49.560473] [INFO ] [REMOTE ] GIB: Full fetch complete (45368 records). [2025-09-26T19:03:49.560592] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-09-26T19:03:49.897526] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-26T19:03:49.942044] [INFO ] [REMOTE ] GHM: Full fetch complete (21666 records). [2025-09-26T19:03:49.976787] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-09-26T19:03:49.995201] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-09-26T19:03:50.031250] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-09-26T19:03:50.058337] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-09-26T19:03:50.073563] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-09-26T19:03:50.120357] [DEBUG] [LOCAL ] GIB: Trimmed 45368 records to 32653 (keeping 200 days of data) [2025-09-26T19:03:50.361709] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-09-26T19:03:50.513432] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-09-26T19:03:50.513791] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-09-26T19:03:50.514548] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-09-26T19:03:50.516078] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-09-26T19:03:50.520503] [DEBUG] [LOCAL ] GHM: Trimmed 21666 records to 14350 (keeping 200 days of data) [2025-09-26T19:03:50.691675] [DEBUG] [LOCAL ] GHM: Primary data saved (14350 records). [2025-09-26T19:03:50.692449] [INFO ] [MAIN ] GHM: Full history saved. [2025-09-26T19:03:50.692629] [INFO ] [MAIN ] Update Progress: 933/2371 symbols completed. GHM took 35.2s. Estimated remaining: 3h 10m 48s. Rate: 7.5 symbols/min [2025-09-26T19:03:50.828362] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-26T19:03:50.850298] [INFO ] [REMOTE ] GHY: Full fetch complete (32103 records). [2025-09-26T19:03:50.861507] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-09-26T19:03:50.953262] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:03:51.254438] [DEBUG] [LOCAL ] GIB: Primary data saved (32653 records). [2025-09-26T19:03:51.260067] [INFO ] [MAIN ] GIB: Full history saved. [2025-09-26T19:03:51.282989] [INFO ] [MAIN ] Update Progress: 934/2371 symbols completed. GIB took 33.2s. Estimated remaining: 3h 10m 29s. Rate: 7.5 symbols/min [2025-09-26T19:03:51.355459] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-26T19:03:51.306528] [DEBUG] [LOCAL ] GIL: Loaded 43565 existing records from primary storage. [2025-09-26T19:03:51.383715] [INFO ] [MAIN ] GIL: Loaded 43565 existing records. [2025-09-26T19:03:51.393844] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-09-26T19:03:51.613011] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-09-26T19:03:51.654505] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-09-26T19:03:51.711453] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:03:51.717613] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-09-26T19:03:51.730588] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-09-26T19:03:51.765436] [DEBUG] [LOCAL ] GHY: Trimmed 32103 records to 21190 (keeping 200 days of data) [2025-09-26T19:03:51.863753] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:03:51.864392] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-09-26T19:03:51.864445] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-09-26T19:03:51.866169] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-09-26T19:03:51.866255] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-09-26T19:03:52.187363] [DEBUG] [LOCAL ] GIS: Loaded 54065 existing records from primary storage. [2025-09-26T19:03:52.209435] [INFO ] [MAIN ] GIS: Loaded 54065 existing records. [2025-09-26T19:03:52.681108] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:03:52.687579] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:03:52.688081] [INFO ] [REMOTE ] GIL: Fetching primary data for 2024-12. [2025-09-26T19:03:52.688966] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-09-26T19:03:52.691668] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-26T19:03:52.691762] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-09-26T19:03:52.699842] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-09-26T19:03:52.700458] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-09-26T19:03:52.762242] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-09-26T19:03:53.109232] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:03:53.124013] [DEBUG] [LOCAL ] GHY: Primary data saved (21190 records). [2025-09-26T19:03:53.124148] [INFO ] [MAIN ] GHY: Full history saved. [2025-09-26T19:03:53.124238] [INFO ] [MAIN ] Update Progress: 935/2371 symbols completed. GHY took 36.4s. Estimated remaining: 3h 10m 11s. Rate: 7.6 symbols/min [2025-09-26T19:03:53.306030] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:03:53.347748] [DEBUG] [LOCAL ] GKOS: Loaded 43265 existing records from primary storage. [2025-09-26T19:03:53.347895] [INFO ] [MAIN ] GKOS: Loaded 43265 existing records. [2025-09-26T19:03:53.557023] [INFO ] [REMOTE ] GIS: Fetching primary data for 2024-12. [2025-09-26T19:03:53.557266] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:03:53.558780] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-09-26T19:03:53.558849] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-09-26T19:03:53.560046] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-09-26T19:03:53.560114] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-09-26T19:03:53.974838] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-26T19:03:54.005108] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:03:54.032075] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-26T19:03:54.356761] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-09-26T19:03:55.156760] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2024-12. [2025-09-26T19:03:55.406325] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-26T19:03:55.410689] [INFO ] [REMOTE ] GIC: Full fetch complete (20297 records). [2025-09-26T19:03:55.410955] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-09-26T19:03:55.866927] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-26T19:03:55.890691] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-09-26T19:03:55.890801] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-09-26T19:03:55.891285] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-09-26T19:03:55.891329] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-09-26T19:03:55.892005] [DEBUG] [LOCAL ] GIC: Trimmed 20297 records to 13796 (keeping 200 days of data) [2025-09-26T19:03:55.960337] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-09-26T19:03:55.993493] [DEBUG] [LOCAL ] GIC: Primary data saved (13796 records). [2025-09-26T19:03:55.993770] [INFO ] [MAIN ] GIC: Full history saved. [2025-09-26T19:03:55.993912] [INFO ] [MAIN ] Update Progress: 936/2371 symbols completed. GIC took 29.2s. Estimated remaining: 3h 9m 56s. Rate: 7.6 symbols/min [2025-09-26T19:03:56.197986] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:03:56.261979] [DEBUG] [LOCAL ] GL: Loaded 38157 existing records from primary storage. [2025-09-26T19:03:56.262222] [INFO ] [MAIN ] GL: Loaded 38157 existing records. [2025-09-26T19:03:56.463396] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:03:56.464026] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-09-26T19:03:56.464139] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-09-26T19:03:56.465629] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-09-26T19:03:56.465733] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-09-26T19:03:56.617275] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-26T19:03:56.767347] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-09-26T19:03:56.907706] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:03:57.556738] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-09-26T19:03:57.637913] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-26T19:03:58.319447] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-26T19:03:58.356765] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-09-26T19:03:59.156753] [INFO ] [REMOTE ] GL: Fetching primary data for 2024-12. [2025-09-26T19:03:59.524084] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-26T19:03:59.875365] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-26T19:03:59.956756] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-09-26T19:04:00.726505] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-26T19:04:00.756686] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-09-26T19:04:01.556702] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-09-26T19:04:01.872861] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-26T19:04:02.356740] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-09-26T19:04:02.401181] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-26T19:04:03.155779] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-26T19:04:03.165739] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-09-26T19:04:03.961208] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-09-26T19:04:03.972248] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-26T19:04:04.625360] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-26T19:04:04.756777] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-09-26T19:04:05.556742] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-09-26T19:04:05.888321] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-26T19:04:06.356716] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-09-26T19:04:06.398316] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-26T19:04:07.156738] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-09-26T19:04:07.222871] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-26T19:04:07.956732] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-09-26T19:04:08.330361] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-26T19:04:08.751185] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-26T19:04:08.760587] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-09-26T19:04:09.542418] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-26T19:04:09.556687] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-09-26T19:04:10.356721] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-09-26T19:04:10.918418] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-26T19:04:11.025937] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-26T19:04:11.156767] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-09-26T19:04:11.844527] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-26T19:04:11.956809] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-09-26T19:04:12.756793] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-09-26T19:04:12.989909] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-26T19:04:13.556747] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-09-26T19:04:13.878797] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-26T19:04:14.251816] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-26T19:04:14.356678] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-09-26T19:04:15.122551] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-26T19:04:15.156740] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-09-26T19:04:15.961861] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-09-26T19:04:15.978224] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-26T19:04:16.756734] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-09-26T19:04:16.966846] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-26T19:04:16.975849] [INFO ] [REMOTE ] GKOS: Full fetch complete (59879 records). [2025-09-26T19:04:16.976032] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-09-26T19:04:17.401440] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-09-26T19:04:17.401732] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-09-26T19:04:17.402801] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-09-26T19:04:17.402931] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-09-26T19:04:17.404959] [DEBUG] [LOCAL ] GKOS: Trimmed 59879 records to 43585 (keeping 200 days of data) [2025-09-26T19:04:17.524716] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-26T19:04:17.557387] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-09-26T19:04:17.712797] [DEBUG] [LOCAL ] GKOS: Primary data saved (43585 records). [2025-09-26T19:04:17.712938] [INFO ] [MAIN ] GKOS: Full history saved. [2025-09-26T19:04:17.713027] [INFO ] [MAIN ] Update Progress: 937/2371 symbols completed. GKOS took 24.6s. Estimated remaining: 3h 10m 9s. Rate: 7.5 symbols/min [2025-09-26T19:04:17.896240] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:04:17.943618] [DEBUG] [LOCAL ] GLOB: Loaded 47734 existing records from primary storage. [2025-09-26T19:04:17.943846] [INFO ] [MAIN ] GLOB: Loaded 47734 existing records. [2025-09-26T19:04:18.142835] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:04:18.143086] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-09-26T19:04:18.143137] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-09-26T19:04:18.144381] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-09-26T19:04:18.144447] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-09-26T19:04:18.369227] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-09-26T19:04:18.544121] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:04:18.652783] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-26T19:04:19.156758] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2024-12. [2025-09-26T19:04:19.331942] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-26T19:04:19.343965] [INFO ] [REMOTE ] GIL: Full fetch complete (61403 records). [2025-09-26T19:04:19.344240] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-09-26T19:04:19.761261] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-09-26T19:04:19.761507] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-09-26T19:04:19.762679] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-09-26T19:04:19.762749] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-09-26T19:04:19.764467] [DEBUG] [LOCAL ] GIL: Trimmed 61403 records to 43906 (keeping 200 days of data) [2025-09-26T19:04:19.970757] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-09-26T19:04:20.109923] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-26T19:04:20.126671] [DEBUG] [LOCAL ] GIL: Primary data saved (43906 records). [2025-09-26T19:04:20.126952] [INFO ] [MAIN ] GIL: Full history saved. [2025-09-26T19:04:20.127201] [INFO ] [MAIN ] Update Progress: 938/2371 symbols completed. GIL took 29.4s. Estimated remaining: 3h 9m 52s. Rate: 7.5 symbols/min [2025-09-26T19:04:20.313507] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:04:20.326228] [DEBUG] [LOCAL ] GLP: Loaded 9528 existing records from primary storage. [2025-09-26T19:04:20.326473] [INFO ] [MAIN ] GLP: Loaded 9528 existing records. [2025-09-26T19:04:20.532906] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:04:20.533399] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-09-26T19:04:20.533493] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-09-26T19:04:20.534219] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-09-26T19:04:20.534299] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-09-26T19:04:20.650809] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-26T19:04:20.772466] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-09-26T19:04:20.989092] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:04:21.556779] [INFO ] [REMOTE ] GLP: Fetching primary data for 2024-12. [2025-09-26T19:04:22.115122] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-26T19:04:22.363980] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-09-26T19:04:22.367201] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-26T19:04:22.505600] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-26T19:04:23.156734] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-09-26T19:04:23.956771] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-09-26T19:04:24.456124] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-26T19:04:24.527188] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-26T19:04:24.756768] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-09-26T19:04:25.382377] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-26T19:04:25.556733] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-09-26T19:04:26.356788] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-09-26T19:04:26.870175] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-26T19:04:27.156703] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-09-26T19:04:27.246518] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-09-26T19:04:27.257421] [INFO ] [REMOTE ] GIS: Full fetch complete (77653 records). [2025-09-26T19:04:27.257685] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-09-26T19:04:27.679486] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-09-26T19:04:27.679745] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-09-26T19:04:27.681039] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-09-26T19:04:27.681149] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-09-26T19:04:27.683390] [DEBUG] [LOCAL ] GIS: Trimmed 77653 records to 54455 (keeping 200 days of data) [2025-09-26T19:04:27.814816] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-26T19:04:27.957123] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-09-26T19:04:28.065491] [DEBUG] [LOCAL ] GIS: Primary data saved (54455 records). [2025-09-26T19:04:28.065719] [INFO ] [MAIN ] GIS: Full history saved. [2025-09-26T19:04:28.065857] [INFO ] [MAIN ] Update Progress: 939/2371 symbols completed. GIS took 36.8s. Estimated remaining: 3h 9m 44s. Rate: 7.5 symbols/min [2025-09-26T19:04:28.241446] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:04:28.293736] [DEBUG] [LOCAL ] GLW: Loaded 54025 existing records from primary storage. [2025-09-26T19:04:28.293893] [INFO ] [MAIN ] GLW: Loaded 54025 existing records. [2025-09-26T19:04:28.480743] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:04:28.480970] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-09-26T19:04:28.481020] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-09-26T19:04:28.482545] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-09-26T19:04:28.482611] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-09-26T19:04:28.760719] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-09-26T19:04:28.903475] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:04:28.987903] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-26T19:04:29.051813] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-26T19:04:29.556715] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-09-26T19:04:30.356689] [INFO ] [REMOTE ] GLW: Fetching primary data for 2024-12. [2025-09-26T19:04:30.441622] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-26T19:04:30.660232] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-26T19:04:31.156736] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-09-26T19:04:31.956707] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-09-26T19:04:31.974673] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-26T19:04:32.230973] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-26T19:04:32.756753] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-09-26T19:04:33.556884] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-09-26T19:04:33.558271] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T19:04:34.356763] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-09-26T19:04:34.759223] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-26T19:04:35.140983] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-26T19:04:35.151355] [INFO ] [REMOTE ] GL: Full fetch complete (55449 records). [2025-09-26T19:04:35.151585] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-09-26T19:04:35.158399] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-09-26T19:04:35.188384] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-26T19:04:35.627934] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-09-26T19:04:35.628051] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-09-26T19:04:35.629295] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-09-26T19:04:35.629388] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-09-26T19:04:35.631146] [DEBUG] [LOCAL ] GL: Trimmed 55449 records to 38382 (keeping 200 days of data) [2025-09-26T19:04:35.914383] [DEBUG] [LOCAL ] GL: Primary data saved (38382 records). [2025-09-26T19:04:35.914700] [INFO ] [MAIN ] GL: Full history saved. [2025-09-26T19:04:35.916402] [INFO ] [MAIN ] Update Progress: 940/2371 symbols completed. GL took 39.9s. Estimated remaining: 3h 9m 36s. Rate: 7.5 symbols/min [2025-09-26T19:04:35.965899] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-09-26T19:04:36.176172] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:04:36.263906] [DEBUG] [LOCAL ] GM: Loaded 54118 existing records from primary storage. [2025-09-26T19:04:36.264188] [INFO ] [MAIN ] GM: Loaded 54118 existing records. [2025-09-26T19:04:36.549369] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:04:36.549742] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-09-26T19:04:36.549834] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-09-26T19:04:36.552012] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-09-26T19:04:36.552104] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-09-26T19:04:36.767951] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-09-26T19:04:36.949033] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-26T19:04:37.044985] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:04:37.088572] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-26T19:04:37.556739] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-09-26T19:04:38.356758] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-09-26T19:04:38.766378] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-26T19:04:38.852237] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-26T19:04:39.156765] [INFO ] [REMOTE ] GM: Fetching primary data for 2024-12. [2025-09-26T19:04:39.373448] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-26T19:04:39.956745] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-09-26T19:04:40.669255] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-26T19:04:40.756747] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-09-26T19:04:41.046898] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-26T19:04:41.556725] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-09-26T19:04:41.583980] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-26T19:04:42.356738] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-09-26T19:04:43.156706] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-09-26T19:04:43.654073] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-26T19:04:43.961842] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-09-26T19:04:43.984486] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-26T19:04:44.756760] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-09-26T19:04:44.927022] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-26T19:04:44.930369] [INFO ] [REMOTE ] GLP: Full fetch complete (14318 records). [2025-09-26T19:04:44.930479] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-09-26T19:04:45.426365] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-09-26T19:04:45.426626] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-09-26T19:04:45.428625] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-09-26T19:04:45.427472] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-09-26T19:04:45.428780] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-09-26T19:04:45.440297] [DEBUG] [LOCAL ] GLP: Trimmed 14318 records to 9585 (keeping 200 days of data) [2025-09-26T19:04:45.499476] [DEBUG] [LOCAL ] GLP: Primary data saved (9585 records). [2025-09-26T19:04:45.499602] [INFO ] [MAIN ] GLP: Full history saved. [2025-09-26T19:04:45.499716] [INFO ] [MAIN ] Update Progress: 941/2371 symbols completed. GLP took 25.4s. Estimated remaining: 3h 9m 31s. Rate: 7.5 symbols/min [2025-09-26T19:04:45.569618] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-09-26T19:04:45.687140] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:04:45.741537] [DEBUG] [LOCAL ] GME: Loaded 54151 existing records from primary storage. [2025-09-26T19:04:45.741722] [INFO ] [MAIN ] GME: Loaded 54151 existing records. [2025-09-26T19:04:45.944437] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:04:45.944928] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-09-26T19:04:45.944997] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-09-26T19:04:45.946703] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-09-26T19:04:45.946770] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-09-26T19:04:46.329468] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:04:46.356713] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-09-26T19:04:46.600537] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-26T19:04:47.156753] [INFO ] [REMOTE ] GME: Fetching primary data for 2024-12. [2025-09-26T19:04:47.613054] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-26T19:04:47.956691] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-09-26T19:04:48.521682] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-26T19:04:48.756762] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-09-26T19:04:49.556703] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-09-26T19:04:49.830332] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2024-12 (2.67 seconds). [2025-09-26T19:04:50.057603] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-26T19:04:50.356697] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-09-26T19:04:50.632467] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-26T19:04:50.937036] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-26T19:04:51.156737] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-09-26T19:04:51.956775] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-09-26T19:04:52.756720] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-09-26T19:04:52.914889] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.56 seconds). [2025-09-26T19:04:53.164804] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-26T19:04:53.408332] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-26T19:04:53.418563] [INFO ] [REMOTE ] GLOB: Full fetch complete (63667 records). [2025-09-26T19:04:53.418742] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-09-26T19:04:53.568058] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-09-26T19:04:53.837744] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-09-26T19:04:53.837847] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-09-26T19:04:53.838721] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-09-26T19:04:53.838802] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-09-26T19:04:53.840165] [DEBUG] [LOCAL ] GLOB: Trimmed 63667 records to 48111 (keeping 200 days of data) [2025-09-26T19:04:54.126985] [DEBUG] [LOCAL ] GLOB: Primary data saved (48111 records). [2025-09-26T19:04:54.127217] [INFO ] [MAIN ] GLOB: Full history saved. [2025-09-26T19:04:54.127321] [INFO ] [MAIN ] Update Progress: 942/2371 symbols completed. GLOB took 36.4s. Estimated remaining: 3h 9m 24s. Rate: 7.5 symbols/min [2025-09-26T19:04:54.317041] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:04:54.361862] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-09-26T19:04:54.365005] [DEBUG] [LOCAL ] GMED: Loaded 48718 existing records from primary storage. [2025-09-26T19:04:54.365266] [INFO ] [MAIN ] GMED: Loaded 48718 existing records. [2025-09-26T19:04:54.611025] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:04:54.611603] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-09-26T19:04:54.611709] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-09-26T19:04:54.612984] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-09-26T19:04:54.613060] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-09-26T19:04:55.032152] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-26T19:04:55.049186] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:04:55.156698] [INFO ] [REMOTE ] GMED: Fetching primary data for 2024-12. [2025-09-26T19:04:55.654110] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-26T19:04:55.956748] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-09-26T19:04:56.761865] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-09-26T19:04:56.777735] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-26T19:04:56.882263] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.52 seconds). [2025-09-26T19:04:57.556710] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-09-26T19:04:58.168053] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-26T19:04:58.356724] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-09-26T19:04:59.156775] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-09-26T19:04:59.243622] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-26T19:04:59.289408] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-09-26T19:04:59.300343] [INFO ] [REMOTE ] GLW: Full fetch complete (77616 records). [2025-09-26T19:04:59.300486] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-09-26T19:04:59.709469] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-09-26T19:04:59.709558] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-09-26T19:04:59.710493] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-09-26T19:04:59.710562] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-09-26T19:04:59.712244] [DEBUG] [LOCAL ] GLW: Trimmed 77616 records to 54415 (keeping 200 days of data) [2025-09-26T19:04:59.956801] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-09-26T19:05:00.055235] [DEBUG] [LOCAL ] GLW: Primary data saved (54415 records). [2025-09-26T19:05:00.055397] [INFO ] [MAIN ] GLW: Full history saved. [2025-09-26T19:05:00.055494] [INFO ] [MAIN ] Update Progress: 943/2371 symbols completed. GLW took 32.0s. Estimated remaining: 3h 9m 13s. Rate: 7.5 symbols/min [2025-09-26T19:05:00.238972] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:05:00.275487] [DEBUG] [LOCAL ] GMRE: Loaded 37959 existing records from primary storage. [2025-09-26T19:05:00.275634] [INFO ] [MAIN ] GMRE: Loaded 37959 existing records. [2025-09-26T19:05:00.461613] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:05:00.461894] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-09-26T19:05:00.461943] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-09-26T19:05:00.463027] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-09-26T19:05:00.463089] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-09-26T19:05:00.847523] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:05:00.847989] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2024-12. [2025-09-26T19:05:00.880707] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-09-26T19:05:01.556753] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-09-26T19:05:02.175336] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-26T19:05:02.223335] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (3.07 seconds). [2025-09-26T19:05:02.356763] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-09-26T19:05:02.560467] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-26T19:05:03.156745] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-09-26T19:05:03.956715] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-09-26T19:05:04.311107] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (2.75 seconds). [2025-09-26T19:05:04.343220] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-26T19:05:04.756718] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-09-26T19:05:04.820821] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-26T19:05:05.556767] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-09-26T19:05:06.356769] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-09-26T19:05:06.749737] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.79 seconds). [2025-09-26T19:05:06.897790] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-26T19:05:07.160847] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-09-26T19:05:07.176208] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-26T19:05:07.781187] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-26T19:05:07.956762] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-09-26T19:05:08.756724] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-09-26T19:05:09.201525] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-26T19:05:09.218047] [INFO ] [REMOTE ] GM: Full fetch complete (77821 records). [2025-09-26T19:05:09.218268] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-09-26T19:05:09.562756] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-09-26T19:05:09.646901] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-26T19:05:09.733515] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-09-26T19:05:09.733705] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-09-26T19:05:09.734800] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-09-26T19:05:09.734872] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-09-26T19:05:09.736613] [DEBUG] [LOCAL ] GM: Trimmed 77821 records to 54508 (keeping 200 days of data) [2025-09-26T19:05:10.083629] [DEBUG] [LOCAL ] GM: Primary data saved (54508 records). [2025-09-26T19:05:10.083842] [INFO ] [MAIN ] GM: Full history saved. [2025-09-26T19:05:10.084375] [INFO ] [MAIN ] Update Progress: 944/2371 symbols completed. GM took 34.2s. Estimated remaining: 3h 9m 8s. Rate: 7.5 symbols/min [2025-09-26T19:05:10.275103] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:05:10.295302] [DEBUG] [LOCAL ] GNE: Loaded 17844 existing records from primary storage. [2025-09-26T19:05:10.295437] [INFO ] [MAIN ] GNE: Loaded 17844 existing records. [2025-09-26T19:05:10.363485] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-09-26T19:05:10.510503] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:05:10.511001] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-09-26T19:05:10.511075] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-09-26T19:05:10.511755] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-09-26T19:05:10.511847] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-09-26T19:05:10.908868] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:05:11.157191] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-09-26T19:05:11.157277] [INFO ] [REMOTE ] GNE: Fetching primary data for 2024-12. [2025-09-26T19:05:11.345286] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-26T19:05:11.957712] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-09-26T19:05:11.962984] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T19:05:12.012977] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-26T19:05:12.756730] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-09-26T19:05:13.278019] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-26T19:05:13.562470] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-09-26T19:05:13.582044] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-26T19:05:14.356723] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-09-26T19:05:15.028824] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T19:05:15.125540] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-26T19:05:15.156705] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-09-26T19:05:15.956745] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-09-26T19:05:16.716562] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-26T19:05:16.756722] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-09-26T19:05:17.556730] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-09-26T19:05:17.741829] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.59 seconds). [2025-09-26T19:05:18.356704] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-09-26T19:05:18.365453] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-26T19:05:18.900821] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-26T19:05:19.156732] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-09-26T19:05:19.956769] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-09-26T19:05:20.628672] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-26T19:05:20.756802] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-09-26T19:05:20.975774] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-09-26T19:05:21.556998] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-09-26T19:05:21.573583] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-26T19:05:21.709023] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-26T19:05:22.356770] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-09-26T19:05:23.156746] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-09-26T19:05:23.538710] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-26T19:05:23.956696] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-09-26T19:05:24.449534] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.89 seconds). [2025-09-26T19:05:24.756720] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-09-26T19:05:24.922120] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-26T19:05:24.931863] [INFO ] [REMOTE ] GMED: Full fetch complete (69396 records). [2025-09-26T19:05:24.932034] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-09-26T19:05:25.378464] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-09-26T19:05:25.378706] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-09-26T19:05:25.379846] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-09-26T19:05:25.380042] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-09-26T19:05:25.381737] [DEBUG] [LOCAL ] GMED: Trimmed 69396 records to 49096 (keeping 200 days of data) [2025-09-26T19:05:25.502434] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-26T19:05:25.601972] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-09-26T19:05:25.735777] [DEBUG] [LOCAL ] GMED: Primary data saved (49096 records). [2025-09-26T19:05:25.735937] [INFO ] [MAIN ] GMED: Full history saved. [2025-09-26T19:05:25.736122] [INFO ] [MAIN ] Update Progress: 945/2371 symbols completed. GMED took 31.6s. Estimated remaining: 3h 9m 12s. Rate: 7.5 symbols/min [2025-09-26T19:05:25.920862] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:05:25.961877] [DEBUG] [LOCAL ] GNK: Loaded 40802 existing records from primary storage. [2025-09-26T19:05:25.962021] [INFO ] [MAIN ] GNK: Loaded 40802 existing records. [2025-09-26T19:05:26.153076] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:05:26.153390] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-09-26T19:05:26.153441] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-09-26T19:05:26.155205] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-09-26T19:05:26.155273] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-09-26T19:05:26.389347] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-09-26T19:05:26.556072] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:05:26.745366] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-26T19:05:27.156733] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-09-26T19:05:27.370239] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-09-26T19:05:27.383049] [INFO ] [REMOTE ] GME: Full fetch complete (77920 records). [2025-09-26T19:05:27.383323] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-09-26T19:05:27.842508] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-09-26T19:05:27.842635] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-09-26T19:05:27.843747] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-09-26T19:05:27.843818] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-09-26T19:05:27.845474] [DEBUG] [LOCAL ] GME: Trimmed 77920 records to 54540 (keeping 200 days of data) [2025-09-26T19:05:27.958052] [INFO ] [REMOTE ] GNK: Fetching primary data for 2024-12. [2025-09-26T19:05:28.061382] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-26T19:05:28.236555] [DEBUG] [LOCAL ] GME: Primary data saved (54540 records). [2025-09-26T19:05:28.236750] [INFO ] [MAIN ] GME: Full history saved. [2025-09-26T19:05:28.236883] [INFO ] [MAIN ] Update Progress: 946/2371 symbols completed. GME took 42.7s. Estimated remaining: 3h 8m 55s. Rate: 7.5 symbols/min [2025-09-26T19:05:28.449290] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-26T19:05:28.458573] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:05:28.521581] [DEBUG] [LOCAL ] GNL: Loaded 47530 existing records from primary storage. [2025-09-26T19:05:28.521787] [INFO ] [MAIN ] GNL: Loaded 47530 existing records. [2025-09-26T19:05:28.762077] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-09-26T19:05:28.792439] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:05:28.792793] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-09-26T19:05:28.792869] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-09-26T19:05:28.794180] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-09-26T19:05:28.794263] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-09-26T19:05:29.306029] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:05:29.345189] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-26T19:05:29.556743] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-09-26T19:05:30.006155] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-26T19:05:30.011977] [INFO ] [REMOTE ] GNE: Full fetch complete (22344 records). [2025-09-26T19:05:30.012174] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-09-26T19:05:30.361829] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-09-26T19:05:30.438170] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-09-26T19:05:30.438260] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-09-26T19:05:30.438821] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-09-26T19:05:30.438888] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-09-26T19:05:30.439919] [DEBUG] [LOCAL ] GNE: Trimmed 22344 records to 17940 (keeping 200 days of data) [2025-09-26T19:05:30.568546] [DEBUG] [LOCAL ] GNE: Primary data saved (17940 records). [2025-09-26T19:05:30.568726] [INFO ] [MAIN ] GNE: Full history saved. [2025-09-26T19:05:30.568831] [INFO ] [MAIN ] Update Progress: 947/2371 symbols completed. GNE took 20.5s. Estimated remaining: 3h 8m 39s. Rate: 7.5 symbols/min [2025-09-26T19:05:30.764799] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:05:30.823349] [DEBUG] [LOCAL ] GNRC: Loaded 45546 existing records from primary storage. [2025-09-26T19:05:30.823512] [INFO ] [MAIN ] GNRC: Loaded 45546 existing records. [2025-09-26T19:05:31.039866] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-26T19:05:31.045769] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:05:31.053738] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-09-26T19:05:31.053798] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-09-26T19:05:31.055144] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-09-26T19:05:31.055212] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-09-26T19:05:31.159952] [INFO ] [REMOTE ] GNL: Fetching primary data for 2024-12. [2025-09-26T19:05:31.457275] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:05:31.957554] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-09-26T19:05:31.962815] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-26T19:05:31.974543] [INFO ] [REMOTE ] GMRE: Full fetch complete (53587 records). [2025-09-26T19:05:31.974741] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-09-26T19:05:32.411291] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-09-26T19:05:32.411387] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-09-26T19:05:32.412215] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-09-26T19:05:32.412284] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-09-26T19:05:32.413906] [DEBUG] [LOCAL ] GMRE: Trimmed 53587 records to 38133 (keeping 200 days of data) [2025-09-26T19:05:32.674930] [DEBUG] [LOCAL ] GMRE: Primary data saved (38133 records). [2025-09-26T19:05:32.675108] [INFO ] [MAIN ] GMRE: Full history saved. [2025-09-26T19:05:32.675241] [INFO ] [MAIN ] Update Progress: 948/2371 symbols completed. GMRE took 32.6s. Estimated remaining: 3h 8m 22s. Rate: 7.6 symbols/min [2025-09-26T19:05:32.758387] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2024-12. [2025-09-26T19:05:32.864568] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:05:32.900160] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-26T19:05:32.914494] [DEBUG] [LOCAL ] GNT: Loaded 8105 existing records from primary storage. [2025-09-26T19:05:32.915252] [INFO ] [MAIN ] GNT: Loaded 8105 existing records. [2025-09-26T19:05:33.125858] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:05:33.126176] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-09-26T19:05:33.126230] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-09-26T19:05:33.126775] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-09-26T19:05:33.126840] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-09-26T19:05:33.552048] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:05:33.556673] [INFO ] [REMOTE ] GNT: Fetching primary data for 2024-12. [2025-09-26T19:05:33.752188] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-26T19:05:34.201481] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-26T19:05:34.356728] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-09-26T19:05:34.474752] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-26T19:05:34.767402] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-26T19:05:35.156755] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-09-26T19:05:35.741123] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-26T19:05:35.956765] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-09-26T19:05:36.732951] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-26T19:05:36.756730] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-09-26T19:05:37.532892] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-26T19:05:37.556690] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-09-26T19:05:38.222322] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-26T19:05:38.356776] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-09-26T19:05:39.156787] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-09-26T19:05:39.956718] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-09-26T19:05:40.013804] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-26T19:05:40.756753] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-09-26T19:05:41.051319] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-26T19:05:41.567992] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-09-26T19:05:41.596929] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-26T19:05:42.356699] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-09-26T19:05:42.389342] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T19:05:43.165419] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-09-26T19:05:43.167267] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-26T19:05:43.854797] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-26T19:05:43.865461] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-26T19:05:43.956765] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-09-26T19:05:44.756783] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-09-26T19:05:45.485749] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-26T19:05:45.556724] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-09-26T19:05:45.686437] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-26T19:05:46.172347] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-26T19:05:46.356778] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-09-26T19:05:47.156740] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-09-26T19:05:47.956748] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-09-26T19:05:48.177909] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-26T19:05:48.756806] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-09-26T19:05:48.878865] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-26T19:05:49.507284] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T19:05:49.556726] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-09-26T19:05:49.644457] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-26T19:05:49.647313] [INFO ] [REMOTE ] GNT: Full fetch complete (10695 records). [2025-09-26T19:05:49.647389] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-09-26T19:05:50.036234] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-09-26T19:05:50.036345] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-09-26T19:05:50.036622] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-09-26T19:05:50.036697] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-09-26T19:05:50.037309] [DEBUG] [LOCAL ] GNT: Trimmed 10695 records to 8177 (keeping 200 days of data) [2025-09-26T19:05:50.085433] [DEBUG] [LOCAL ] GNT: Primary data saved (8177 records). [2025-09-26T19:05:50.085574] [INFO ] [MAIN ] GNT: Full history saved. [2025-09-26T19:05:50.085689] [INFO ] [MAIN ] Update Progress: 949/2371 symbols completed. GNT took 17.4s. Estimated remaining: 3h 8m 29s. Rate: 7.5 symbols/min [2025-09-26T19:05:50.268493] [INFO ] [MAIN ] GNTY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:05:50.278101] [DEBUG] [LOCAL ] GNTY: Loaded 7283 existing records from primary storage. [2025-09-26T19:05:50.278230] [INFO ] [MAIN ] GNTY: Loaded 7283 existing records. [2025-09-26T19:05:50.361866] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-09-26T19:05:50.497230] [WARN ] [MAIN ] GNTY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:05:50.497627] [INFO ] [MAIN ] GNTY: Wiping existing primary data before full refresh. [2025-09-26T19:05:50.497713] [INFO ] [LOCAL ] GNTY: Starting deletion of primary data. [2025-09-26T19:05:50.498123] [DEBUG] [LOCAL ] GNTY: Deleted primary data file. [2025-09-26T19:05:50.498204] [INFO ] [MAIN ] GNTY: Starting full primary refresh. [2025-09-26T19:05:50.893151] [INFO ] [REMOTE ] GNTY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:05:51.157461] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-09-26T19:05:51.157380] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-26T19:05:51.923069] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-26T19:05:51.956694] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-09-26T19:05:52.756745] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2024-12. [2025-09-26T19:05:52.884226] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-26T19:05:53.327301] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-26T19:05:53.526072] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-26T19:05:53.556732] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-01. [2025-09-26T19:05:54.059850] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-26T19:05:54.356782] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-09-26T19:05:55.156756] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-02. [2025-09-26T19:05:55.766762] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-26T19:05:55.942614] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-26T19:05:55.956684] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-09-26T19:05:56.756737] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-09-26T19:05:57.556711] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-09-26T19:05:57.611076] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-26T19:05:58.324491] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-26T19:05:58.356704] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-03. [2025-09-26T19:05:59.136125] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-26T19:05:59.156689] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-04. [2025-09-26T19:05:59.183108] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-26T19:05:59.883150] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-26T19:05:59.956767] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-09-26T19:06:00.756725] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-05. [2025-09-26T19:06:01.556914] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-09-26T19:06:01.679712] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T19:06:01.681978] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-26T19:06:01.693809] [INFO ] [REMOTE ] GNK: Full fetch complete (56924 records). [2025-09-26T19:06:01.694149] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-09-26T19:06:02.142466] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-09-26T19:06:02.142585] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-09-26T19:06:02.143564] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-09-26T19:06:02.143634] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-09-26T19:06:02.146497] [DEBUG] [LOCAL ] GNK: Trimmed 56924 records to 41039 (keeping 200 days of data) [2025-09-26T19:06:02.368157] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-06. [2025-09-26T19:06:02.418928] [DEBUG] [LOCAL ] GNK: Primary data saved (41039 records). [2025-09-26T19:06:02.419126] [INFO ] [MAIN ] GNK: Full history saved. [2025-09-26T19:06:02.419239] [INFO ] [MAIN ] Update Progress: 950/2371 symbols completed. GNK took 36.7s. Estimated remaining: 3h 8m 27s. Rate: 7.5 symbols/min [2025-09-26T19:06:02.614372] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:06:02.675296] [DEBUG] [LOCAL ] GNW: Loaded 51708 existing records from primary storage. [2025-09-26T19:06:02.675538] [INFO ] [MAIN ] GNW: Loaded 51708 existing records. [2025-09-26T19:06:02.879018] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:06:02.879369] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-09-26T19:06:02.879425] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-09-26T19:06:02.880955] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-09-26T19:06:02.881043] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-09-26T19:06:03.159887] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-09-26T19:06:03.211552] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-26T19:06:03.295346] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:06:03.526891] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-26T19:06:03.956736] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-09-26T19:06:04.756711] [INFO ] [REMOTE ] GNW: Fetching primary data for 2024-12. [2025-09-26T19:06:04.866963] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-26T19:06:05.556790] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-07. [2025-09-26T19:06:05.752059] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-26T19:06:05.761217] [INFO ] [REMOTE ] GNRC: Full fetch complete (65314 records). [2025-09-26T19:06:05.761344] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-09-26T19:06:06.190315] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-09-26T19:06:06.190429] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-09-26T19:06:06.191392] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-09-26T19:06:06.191533] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-09-26T19:06:06.193368] [DEBUG] [LOCAL ] GNRC: Trimmed 65314 records to 45886 (keeping 200 days of data) [2025-09-26T19:06:06.382915] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-09-26T19:06:06.438466] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-26T19:06:06.487551] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-26T19:06:06.565792] [DEBUG] [LOCAL ] GNRC: Primary data saved (45886 records). [2025-09-26T19:06:06.565960] [INFO ] [MAIN ] GNRC: Full history saved. [2025-09-26T19:06:06.566763] [INFO ] [MAIN ] Update Progress: 951/2371 symbols completed. GNRC took 36.0s. Estimated remaining: 3h 8m 14s. Rate: 7.5 symbols/min [2025-09-26T19:06:06.761778] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:06:06.813888] [DEBUG] [LOCAL ] GOF: Loaded 43105 existing records from primary storage. [2025-09-26T19:06:06.814112] [INFO ] [MAIN ] GOF: Loaded 43105 existing records. [2025-09-26T19:06:07.002329] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:06:07.002751] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-09-26T19:06:07.002810] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-09-26T19:06:07.004183] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-09-26T19:06:07.004246] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-09-26T19:06:07.161871] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-08. [2025-09-26T19:06:07.391611] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:06:07.890288] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-26T19:06:07.956729] [INFO ] [REMOTE ] GOF: Fetching primary data for 2024-12. [2025-09-26T19:06:08.186834] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-26T19:06:08.756789] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-09-26T19:06:09.556708] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-09. [2025-09-26T19:06:09.759848] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T19:06:10.356741] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-09-26T19:06:10.399783] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-26T19:06:10.403468] [INFO ] [REMOTE ] GNTY: Full fetch complete (10365 records). [2025-09-26T19:06:10.403694] [DEBUG] [VALIDATOR ] GNTY: Validating primary data. [2025-09-26T19:06:10.809445] [DEBUG] [VALIDATOR ] GNTY: All expected trading days are present. [2025-09-26T19:06:10.809550] [DEBUG] [VALIDATOR ] GNTY: Primary data validation passed. [2025-09-26T19:06:10.809974] [INFO ] [MAIN ] GNTY: Fetched primary data is valid. [2025-09-26T19:06:10.810050] [DEBUG] [LOCAL ] GNTY: Saving primary data. [2025-09-26T19:06:10.810779] [DEBUG] [LOCAL ] GNTY: Trimmed 10365 records to 7353 (keeping 200 days of data) [2025-09-26T19:06:10.873677] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-26T19:06:10.895990] [DEBUG] [LOCAL ] GNTY: Primary data saved (7353 records). [2025-09-26T19:06:10.896129] [INFO ] [MAIN ] GNTY: Full history saved. [2025-09-26T19:06:10.896246] [INFO ] [MAIN ] Update Progress: 952/2371 symbols completed. GNTY took 20.8s. Estimated remaining: 3h 8m 0s. Rate: 7.5 symbols/min [2025-09-26T19:06:11.077236] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:06:11.114885] [DEBUG] [LOCAL ] GOLF: Loaded 31843 existing records from primary storage. [2025-09-26T19:06:11.115039] [INFO ] [MAIN ] GOLF: Loaded 31843 existing records. [2025-09-26T19:06:11.161919] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-09-26T19:06:11.314310] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:06:11.314688] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-09-26T19:06:11.314776] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-09-26T19:06:11.315757] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-09-26T19:06:11.315820] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-09-26T19:06:11.733229] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:06:11.956742] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2024-12. [2025-09-26T19:06:11.988157] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-26T19:06:12.756706] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-09-26T19:06:12.867835] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-26T19:06:13.079210] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-26T19:06:13.556719] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-09-26T19:06:14.297746] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-26T19:06:14.356771] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-09-26T19:06:15.156741] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-09-26T19:06:15.285232] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-26T19:06:15.349816] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-26T19:06:15.358893] [INFO ] [REMOTE ] GNL: Full fetch complete (68377 records). [2025-09-26T19:06:15.359021] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-09-26T19:06:15.806298] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-09-26T19:06:15.806406] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-09-26T19:06:15.807406] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-09-26T19:06:15.807486] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-09-26T19:06:15.809112] [DEBUG] [LOCAL ] GNL: Trimmed 68377 records to 47785 (keeping 200 days of data) [2025-09-26T19:06:15.989350] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-09-26T19:06:16.113533] [DEBUG] [LOCAL ] GNL: Primary data saved (47785 records). [2025-09-26T19:06:16.113715] [INFO ] [MAIN ] GNL: Full history saved. [2025-09-26T19:06:16.113864] [INFO ] [MAIN ] Update Progress: 953/2371 symbols completed. GNL took 47.9s. Estimated remaining: 3h 7m 48s. Rate: 7.6 symbols/min [2025-09-26T19:06:16.306786] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:06:16.354175] [DEBUG] [LOCAL ] GOOS: Loaded 45704 existing records from primary storage. [2025-09-26T19:06:16.354371] [INFO ] [MAIN ] GOOS: Loaded 45704 existing records. [2025-09-26T19:06:16.554156] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:06:16.554492] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-09-26T19:06:16.554552] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-09-26T19:06:16.555839] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-09-26T19:06:16.555913] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-09-26T19:06:16.763815] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-09-26T19:06:16.969796] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:06:17.000156] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-26T19:06:17.556740] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2024-12. [2025-09-26T19:06:17.808564] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-26T19:06:18.304430] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-26T19:06:18.356792] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-09-26T19:06:19.156740] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-09-26T19:06:19.455110] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-26T19:06:19.956749] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-09-26T19:06:20.302613] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-26T19:06:20.756787] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-09-26T19:06:20.868685] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-26T19:06:21.394856] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-26T19:06:21.556761] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-09-26T19:06:22.356720] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-09-26T19:06:22.484088] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-26T19:06:23.156788] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-09-26T19:06:23.360735] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-26T19:06:23.933261] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-26T19:06:23.956702] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-09-26T19:06:24.712919] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-26T19:06:24.756742] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-09-26T19:06:25.467316] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-26T19:06:25.556709] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-09-26T19:06:26.064972] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-26T19:06:26.356779] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-09-26T19:06:27.156768] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-09-26T19:06:27.380556] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-26T19:06:27.956774] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-09-26T19:06:28.224788] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-26T19:06:28.668518] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-26T19:06:28.756751] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-09-26T19:06:29.556682] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-09-26T19:06:29.670939] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-26T19:06:30.356737] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-09-26T19:06:30.582450] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-26T19:06:31.156765] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-09-26T19:06:31.461834] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-26T19:06:31.470982] [INFO ] [REMOTE ] GOF: Full fetch complete (62208 records). [2025-09-26T19:06:31.471171] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-09-26T19:06:31.907023] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-09-26T19:06:31.907160] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-09-26T19:06:31.908048] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-09-26T19:06:31.908120] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-09-26T19:06:31.909623] [DEBUG] [LOCAL ] GOF: Trimmed 62208 records to 43374 (keeping 200 days of data) [2025-09-26T19:06:31.969693] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-09-26T19:06:32.200023] [DEBUG] [LOCAL ] GOF: Primary data saved (43374 records). [2025-09-26T19:06:32.200341] [INFO ] [MAIN ] GOF: Full history saved. [2025-09-26T19:06:32.202194] [INFO ] [MAIN ] Update Progress: 954/2371 symbols completed. GOF took 25.6s. Estimated remaining: 3h 7m 52s. Rate: 7.5 symbols/min [2025-09-26T19:06:32.383521] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-26T19:06:32.444085] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:06:32.491074] [DEBUG] [LOCAL ] GOTU: Loaded 39241 existing records from primary storage. [2025-09-26T19:06:32.491248] [INFO ] [MAIN ] GOTU: Loaded 39241 existing records. [2025-09-26T19:06:32.698021] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:06:32.698624] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-09-26T19:06:32.698768] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-09-26T19:06:32.708701] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-09-26T19:06:32.722080] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-09-26T19:06:32.761808] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-09-26T19:06:32.804606] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-26T19:06:33.129387] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:06:33.485047] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-26T19:06:33.556714] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-09-26T19:06:34.356730] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-09-26T19:06:34.589568] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-26T19:06:35.156735] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-09-26T19:06:35.204485] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-26T19:06:35.720252] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-26T19:06:35.956737] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2024-12. [2025-09-26T19:06:36.756694] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-09-26T19:06:37.132007] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-26T19:06:37.145122] [INFO ] [REMOTE ] GNW: Full fetch complete (73507 records). [2025-09-26T19:06:37.145330] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-09-26T19:06:37.569274] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-09-26T19:06:37.594890] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-09-26T19:06:37.594998] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-09-26T19:06:37.596084] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-09-26T19:06:37.596154] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-09-26T19:06:37.598471] [DEBUG] [LOCAL ] GNW: Trimmed 73507 records to 52086 (keeping 200 days of data) [2025-09-26T19:06:37.625297] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-26T19:06:37.943858] [DEBUG] [LOCAL ] GNW: Primary data saved (52086 records). [2025-09-26T19:06:37.944003] [INFO ] [MAIN ] GNW: Full history saved. [2025-09-26T19:06:37.944093] [INFO ] [MAIN ] Update Progress: 955/2371 symbols completed. GNW took 35.5s. Estimated remaining: 3h 7m 41s. Rate: 7.5 symbols/min [2025-09-26T19:06:38.159485] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:06:38.173993] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-26T19:06:38.225963] [DEBUG] [LOCAL ] GPC: Loaded 46980 existing records from primary storage. [2025-09-26T19:06:38.226160] [INFO ] [MAIN ] GPC: Loaded 46980 existing records. [2025-09-26T19:06:38.361905] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-09-26T19:06:38.431918] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:06:38.432180] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-09-26T19:06:38.432233] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-09-26T19:06:38.433855] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-09-26T19:06:38.433919] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-09-26T19:06:38.868164] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:06:38.907814] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-26T19:06:39.156739] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-09-26T19:06:39.956754] [INFO ] [REMOTE ] GPC: Fetching primary data for 2024-12. [2025-09-26T19:06:40.120363] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-26T19:06:40.756713] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-09-26T19:06:41.012754] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-26T19:06:41.556696] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-09-26T19:06:41.735818] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-26T19:06:42.318291] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-26T19:06:42.356685] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-09-26T19:06:43.156770] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-09-26T19:06:43.383484] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-26T19:06:43.956748] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-09-26T19:06:44.108749] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-26T19:06:44.174106] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-26T19:06:44.756735] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-09-26T19:06:45.556701] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-09-26T19:06:45.747695] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-26T19:06:45.756466] [INFO ] [REMOTE ] GOOS: Full fetch complete (65782 records). [2025-09-26T19:06:45.756619] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-09-26T19:06:46.163525] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-09-26T19:06:46.163752] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-09-26T19:06:46.164585] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-09-26T19:06:46.164699] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-09-26T19:06:46.179691] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-26T19:06:46.185084] [DEBUG] [LOCAL ] GOOS: Trimmed 65782 records to 46008 (keeping 200 days of data) [2025-09-26T19:06:46.186275] [INFO ] [REMOTE ] GOLF: Full fetch complete (44905 records). [2025-09-26T19:06:46.186627] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-09-26T19:06:46.362215] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-09-26T19:06:46.736109] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-09-26T19:06:46.736214] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-09-26T19:06:46.737323] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-09-26T19:06:46.737407] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-09-26T19:06:46.740967] [DEBUG] [LOCAL ] GOLF: Trimmed 44905 records to 32049 (keeping 200 days of data) [2025-09-26T19:06:47.029597] [DEBUG] [LOCAL ] GOOS: Primary data saved (46008 records). [2025-09-26T19:06:47.034484] [INFO ] [MAIN ] GOOS: Full history saved. [2025-09-26T19:06:47.035352] [INFO ] [MAIN ] Update Progress: 956/2371 symbols completed. GOOS took 30.9s. Estimated remaining: 3h 7m 35s. Rate: 7.5 symbols/min [2025-09-26T19:06:47.298129] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:06:47.312770] [DEBUG] [LOCAL ] GOLF: Primary data saved (32049 records). [2025-09-26T19:06:47.313104] [INFO ] [MAIN ] GOLF: Full history saved. [2025-09-26T19:06:47.313237] [INFO ] [MAIN ] Update Progress: 957/2371 symbols completed. GOLF took 36.4s. Estimated remaining: 3h 7m 16s. Rate: 7.6 symbols/min [2025-09-26T19:06:47.326461] [DEBUG] [LOCAL ] GPI: Loaded 15035 existing records from primary storage. [2025-09-26T19:06:47.326630] [INFO ] [MAIN ] GPI: Loaded 15035 existing records. [2025-09-26T19:06:47.535087] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:06:47.549806] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-09-26T19:06:47.551105] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-26T19:06:47.561633] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-09-26T19:06:47.562710] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-09-26T19:06:47.563739] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-09-26T19:06:47.563809] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-09-26T19:06:47.971506] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:06:47.971954] [INFO ] [REMOTE ] GPI: Fetching primary data for 2024-12. [2025-09-26T19:06:47.998986] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-26T19:06:48.756732] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-09-26T19:06:48.851750] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-26T19:06:49.305942] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-26T19:06:49.556707] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-09-26T19:06:50.283792] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-26T19:06:50.356693] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-09-26T19:06:50.671913] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-26T19:06:51.156738] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-09-26T19:06:51.757709] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-26T19:06:51.956711] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-09-26T19:06:52.181278] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-26T19:06:52.756735] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-09-26T19:06:53.384698] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-26T19:06:53.556742] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-09-26T19:06:54.356754] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-09-26T19:06:54.809347] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-26T19:06:54.933223] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-26T19:06:55.156737] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-09-26T19:06:55.896409] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-26T19:06:55.956685] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-09-26T19:06:56.291488] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-26T19:06:56.756754] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-09-26T19:06:57.214504] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-26T19:06:57.222556] [INFO ] [REMOTE ] GOTU: Full fetch complete (59639 records). [2025-09-26T19:06:57.222751] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-09-26T19:06:57.561878] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-09-26T19:06:57.682816] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-09-26T19:06:57.690597] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-09-26T19:06:57.692198] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-09-26T19:06:57.692557] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-26T19:06:57.692744] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-09-26T19:06:57.697511] [DEBUG] [LOCAL ] GOTU: Trimmed 59639 records to 39533 (keeping 200 days of data) [2025-09-26T19:06:57.930222] [DEBUG] [LOCAL ] GOTU: Primary data saved (39533 records). [2025-09-26T19:06:57.930391] [INFO ] [MAIN ] GOTU: Full history saved. [2025-09-26T19:06:57.930815] [INFO ] [MAIN ] Update Progress: 958/2371 symbols completed. GOTU took 25.7s. Estimated remaining: 3h 7m 12s. Rate: 7.5 symbols/min [2025-09-26T19:06:58.356740] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-09-26T19:06:59.390921] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-26T19:06:59.390007] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-26T19:06:59.405861] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-09-26T19:06:59.956744] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-09-26T19:07:00.110543] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-26T19:07:00.756727] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-09-26T19:07:01.637962] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-26T19:07:01.649330] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-09-26T19:07:01.725239] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-26T19:07:02.356727] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-09-26T19:07:03.316393] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-26T19:07:03.326566] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-09-26T19:07:03.406596] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-26T19:07:03.410033] [INFO ] [REMOTE ] GPI: Full fetch complete (20931 records). [2025-09-26T19:07:03.410136] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-09-26T19:07:03.815271] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-09-26T19:07:03.815354] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-09-26T19:07:03.815904] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-09-26T19:07:03.815970] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-09-26T19:07:03.816689] [DEBUG] [LOCAL ] GPI: Trimmed 20931 records to 15126 (keeping 200 days of data) [2025-09-26T19:07:03.917562] [DEBUG] [LOCAL ] GPI: Primary data saved (15126 records). [2025-09-26T19:07:03.917755] [INFO ] [MAIN ] GPI: Full history saved. [2025-09-26T19:07:03.917861] [INFO ] [MAIN ] Update Progress: 959/2371 symbols completed. GPI took 16.9s. Estimated remaining: 3h 7m 1s. Rate: 7.6 symbols/min [2025-09-26T19:07:04.855352] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-26T19:07:04.866496] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-09-26T19:07:06.530293] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-26T19:07:06.545426] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-09-26T19:07:08.468321] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-26T19:07:08.480101] [INFO ] [REMOTE ] GPC: Full fetch complete (69077 records). [2025-09-26T19:07:08.480283] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-09-26T19:07:08.916556] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-09-26T19:07:08.916669] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-09-26T19:07:08.917596] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-09-26T19:07:08.917684] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-09-26T19:07:08.919143] [DEBUG] [LOCAL ] GPC: Trimmed 69077 records to 47289 (keeping 200 days of data) [2025-09-26T19:07:09.229883] [DEBUG] [LOCAL ] GPC: Primary data saved (47289 records). [2025-09-26T19:07:09.230171] [INFO ] [MAIN ] GPC: Full history saved. [2025-09-26T19:07:09.230296] [INFO ] [MAIN ] Update Progress: 960/2371 symbols completed. GPC took 31.3s. Estimated remaining: 3h 6m 49s. Rate: 7.6 symbols/min [2025-09-26T19:07:09.838868] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:07:09.972359] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:07:09.931661] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:07:10.003626] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:07:10.010797] [DEBUG] [LOCAL ] GPJA: Loaded 4119 existing records from primary storage. [2025-09-26T19:07:10.010993] [INFO ] [MAIN ] GPJA: Loaded 4119 existing records. [2025-09-26T19:07:10.228808] [DEBUG] [LOCAL ] GPMT: Loaded 26703 existing records from primary storage. [2025-09-26T19:07:10.229397] [INFO ] [MAIN ] GPMT: Loaded 26703 existing records. [2025-09-26T19:07:10.326296] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:07:10.326848] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-09-26T19:07:10.326919] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-09-26T19:07:10.327384] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-09-26T19:07:10.327458] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-09-26T19:07:10.505533] [DEBUG] [LOCAL ] GPN: Loaded 52461 existing records from primary storage. [2025-09-26T19:07:10.511546] [DEBUG] [LOCAL ] GPK: Loaded 53051 existing records from primary storage. [2025-09-26T19:07:10.532674] [INFO ] [MAIN ] GPK: Loaded 53051 existing records. [2025-09-26T19:07:10.532468] [INFO ] [MAIN ] GPN: Loaded 52461 existing records. [2025-09-26T19:07:11.033360] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:07:11.111743] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-09-26T19:07:11.129875] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-09-26T19:07:11.149039] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:07:11.201026] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-09-26T19:07:11.226572] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-09-26T19:07:11.249724] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-09-26T19:07:11.265402] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-09-26T19:07:11.249614] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:07:11.294755] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-09-26T19:07:11.320408] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-09-26T19:07:11.320302] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-09-26T19:07:11.336471] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-09-26T19:07:11.450392] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-09-26T19:07:11.517463] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-09-26T19:07:11.636394] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:07:11.722216] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2024-12. [2025-09-26T19:07:12.509009] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:07:12.540921] [INFO ] [REMOTE ] GPK: Fetching primary data for 2024-12. [2025-09-26T19:07:12.528117] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:07:12.554886] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2024-12. [2025-09-26T19:07:12.591190] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-26T19:07:12.608786] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-09-26T19:07:12.655145] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:07:12.656038] [INFO ] [REMOTE ] GPN: Fetching primary data for 2024-12. [2025-09-26T19:07:13.565026] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-26T19:07:13.568571] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-09-26T19:07:13.896248] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-26T19:07:13.902703] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-09-26T19:07:13.940278] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T19:07:13.950883] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-09-26T19:07:14.115889] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-26T19:07:14.117521] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-09-26T19:07:14.440515] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-26T19:07:14.451375] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-09-26T19:07:14.822612] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-26T19:07:14.824226] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-09-26T19:07:15.074319] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-26T19:07:15.080071] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-09-26T19:07:15.248457] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-26T19:07:15.259726] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-09-26T19:07:15.405144] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-26T19:07:15.849779] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-26T19:07:15.956693] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-09-26T19:07:16.198162] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-26T19:07:16.433726] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-26T19:07:16.756719] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-09-26T19:07:17.075715] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-26T19:07:17.556722] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-09-26T19:07:18.052808] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-26T19:07:18.356724] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-09-26T19:07:19.156711] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-09-26T19:07:19.303400] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-26T19:07:19.684875] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-26T19:07:19.684580] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-26T19:07:19.956749] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-09-26T19:07:20.604271] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-26T19:07:20.756764] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-09-26T19:07:21.556729] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-09-26T19:07:22.357778] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-26T19:07:22.357895] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-09-26T19:07:22.854889] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-26T19:07:23.156736] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-09-26T19:07:23.759249] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-26T19:07:23.956722] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-09-26T19:07:24.195615] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-26T19:07:24.435681] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-26T19:07:24.437305] [INFO ] [REMOTE ] GPJA: Full fetch complete (7271 records). [2025-09-26T19:07:24.437396] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-09-26T19:07:24.761906] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-09-26T19:07:24.850449] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-09-26T19:07:24.850533] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-09-26T19:07:24.850763] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-09-26T19:07:24.850850] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-09-26T19:07:24.851324] [DEBUG] [LOCAL ] GPJA: Trimmed 7271 records to 4140 (keeping 200 days of data) [2025-09-26T19:07:24.880973] [DEBUG] [LOCAL ] GPJA: Primary data saved (4140 records). [2025-09-26T19:07:24.881131] [INFO ] [MAIN ] GPJA: Full history saved. [2025-09-26T19:07:24.881321] [INFO ] [MAIN ] Update Progress: 961/2371 symbols completed. GPJA took 15.6s. Estimated remaining: 3h 6m 52s. Rate: 7.5 symbols/min [2025-09-26T19:07:25.062409] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:07:25.097291] [DEBUG] [LOCAL ] GPOR: Loaded 23115 existing records from primary storage. [2025-09-26T19:07:25.097451] [INFO ] [MAIN ] GPOR: Loaded 23115 existing records. [2025-09-26T19:07:25.282479] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:07:25.282883] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-09-26T19:07:25.282942] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-09-26T19:07:25.284306] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-09-26T19:07:25.284390] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-09-26T19:07:25.562025] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-09-26T19:07:25.656142] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:07:26.356711] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-09-26T19:07:26.450505] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-26T19:07:27.156767] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-09-26T19:07:27.612880] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-26T19:07:27.956723] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-09-26T19:07:28.057396] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-26T19:07:28.237827] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-26T19:07:28.756734] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-09-26T19:07:29.556691] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-09-26T19:07:29.876230] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-26T19:07:30.209732] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-26T19:07:30.356724] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-09-26T19:07:30.444008] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-26T19:07:31.156745] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-09-26T19:07:31.452748] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-26T19:07:31.456475] [INFO ] [REMOTE ] GPMT: Full fetch complete (37543 records). [2025-09-26T19:07:31.456598] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-09-26T19:07:31.860483] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-09-26T19:07:31.860580] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-09-26T19:07:31.861273] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-09-26T19:07:31.861338] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-09-26T19:07:31.862480] [DEBUG] [LOCAL ] GPMT: Trimmed 37543 records to 26788 (keeping 200 days of data) [2025-09-26T19:07:31.958033] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-09-26T19:07:32.032826] [DEBUG] [LOCAL ] GPMT: Primary data saved (26788 records). [2025-09-26T19:07:32.032997] [INFO ] [MAIN ] GPMT: Full history saved. [2025-09-26T19:07:32.033138] [INFO ] [MAIN ] Update Progress: 962/2371 symbols completed. GPMT took 22.8s. Estimated remaining: 3h 6m 43s. Rate: 7.5 symbols/min [2025-09-26T19:07:32.214234] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:07:32.254399] [DEBUG] [LOCAL ] GPRK: Loaded 39489 existing records from primary storage. [2025-09-26T19:07:32.254569] [INFO ] [MAIN ] GPRK: Loaded 39489 existing records. [2025-09-26T19:07:32.446385] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:07:32.446694] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-09-26T19:07:32.446763] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-09-26T19:07:32.447938] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-09-26T19:07:32.448002] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-09-26T19:07:32.771983] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2024-12. [2025-09-26T19:07:32.840262] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:07:32.877023] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-26T19:07:33.556709] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-09-26T19:07:33.928258] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-26T19:07:34.172087] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T19:07:34.356782] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-09-26T19:07:35.089099] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-26T19:07:35.156749] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-09-26T19:07:35.956731] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-09-26T19:07:36.224408] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-26T19:07:36.756724] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-09-26T19:07:36.946665] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-26T19:07:37.387359] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-26T19:07:37.556720] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2024-12. [2025-09-26T19:07:38.356724] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-09-26T19:07:38.917810] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-26T19:07:38.933264] [INFO ] [REMOTE ] GPK: Full fetch complete (75466 records). [2025-09-26T19:07:38.933448] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-09-26T19:07:39.134759] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-26T19:07:39.161474] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-09-26T19:07:39.413554] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-09-26T19:07:39.413713] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-09-26T19:07:39.414689] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-09-26T19:07:39.414840] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-09-26T19:07:39.416481] [DEBUG] [LOCAL ] GPK: Trimmed 75466 records to 53441 (keeping 200 days of data) [2025-09-26T19:07:39.638730] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-26T19:07:39.789937] [DEBUG] [LOCAL ] GPK: Primary data saved (53441 records). [2025-09-26T19:07:39.790086] [INFO ] [MAIN ] GPK: Full history saved. [2025-09-26T19:07:39.790688] [INFO ] [MAIN ] Update Progress: 963/2371 symbols completed. GPK took 30.6s. Estimated remaining: 3h 6m 35s. Rate: 7.5 symbols/min [2025-09-26T19:07:39.971659] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-09-26T19:07:39.975259] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:07:40.009940] [DEBUG] [LOCAL ] GRBK: Loaded 27195 existing records from primary storage. [2025-09-26T19:07:40.010121] [INFO ] [MAIN ] GRBK: Loaded 27195 existing records. [2025-09-26T19:07:40.202875] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:07:40.203168] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-09-26T19:07:40.203219] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-09-26T19:07:40.203983] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-09-26T19:07:40.204047] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-09-26T19:07:40.645066] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:07:40.756721] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-09-26T19:07:40.964616] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-26T19:07:41.277165] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-26T19:07:41.556734] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-09-26T19:07:42.290486] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-26T19:07:42.356722] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-09-26T19:07:43.156745] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-09-26T19:07:43.573837] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-26T19:07:43.588120] [INFO ] [REMOTE ] GPN: Full fetch complete (74807 records). [2025-09-26T19:07:43.588495] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-09-26T19:07:43.958840] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2024-12. [2025-09-26T19:07:44.016465] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-26T19:07:44.068639] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-09-26T19:07:44.068977] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-09-26T19:07:44.070058] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-09-26T19:07:44.070171] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-09-26T19:07:44.085614] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-26T19:07:44.090741] [DEBUG] [LOCAL ] GPN: Trimmed 74807 records to 52822 (keeping 200 days of data) [2025-09-26T19:07:44.432906] [DEBUG] [LOCAL ] GPN: Primary data saved (52822 records). [2025-09-26T19:07:44.433053] [INFO ] [MAIN ] GPN: Full history saved. [2025-09-26T19:07:44.433165] [INFO ] [MAIN ] Update Progress: 964/2371 symbols completed. GPN took 35.2s. Estimated remaining: 3h 6m 22s. Rate: 7.5 symbols/min [2025-09-26T19:07:44.615799] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:07:44.626429] [DEBUG] [LOCAL ] GRC: Loaded 8993 existing records from primary storage. [2025-09-26T19:07:44.626564] [INFO ] [MAIN ] GRC: Loaded 8993 existing records. [2025-09-26T19:07:44.761878] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-09-26T19:07:44.825008] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:07:44.825297] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-09-26T19:07:44.825352] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-09-26T19:07:44.825798] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-09-26T19:07:44.825866] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-09-26T19:07:45.197841] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:07:45.480234] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-26T19:07:45.556695] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-09-26T19:07:45.950350] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-26T19:07:46.356749] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-09-26T19:07:46.876304] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-26T19:07:47.156740] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-09-26T19:07:47.892418] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T19:07:47.956788] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-09-26T19:07:48.491466] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-26T19:07:48.756739] [INFO ] [REMOTE ] GRC: Fetching primary data for 2024-12. [2025-09-26T19:07:49.145071] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-26T19:07:49.556748] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-09-26T19:07:49.587291] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-26T19:07:50.356799] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-09-26T19:07:51.112954] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-26T19:07:51.156682] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-09-26T19:07:51.219056] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-26T19:07:51.956782] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-09-26T19:07:52.650867] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T19:07:52.756774] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-09-26T19:07:53.161484] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-26T19:07:53.522570] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-26T19:07:53.556709] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-09-26T19:07:54.356734] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-09-26T19:07:54.901473] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-26T19:07:55.156712] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-09-26T19:07:55.452895] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-26T19:07:55.956790] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-09-26T19:07:56.470148] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-26T19:07:56.756805] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-09-26T19:07:57.465225] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-26T19:07:57.556751] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-09-26T19:07:58.019384] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-26T19:07:58.356775] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-09-26T19:07:59.101793] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-26T19:07:59.156688] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-09-26T19:07:59.664740] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-26T19:07:59.671377] [INFO ] [REMOTE ] GPOR: Full fetch complete (34850 records). [2025-09-26T19:07:59.671621] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-09-26T19:07:59.961883] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-09-26T19:08:00.071590] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-09-26T19:08:00.071726] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-09-26T19:08:00.072424] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-09-26T19:08:00.072491] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-09-26T19:08:00.073546] [DEBUG] [LOCAL ] GPOR: Trimmed 34850 records to 23328 (keeping 200 days of data) [2025-09-26T19:08:00.235217] [DEBUG] [LOCAL ] GPOR: Primary data saved (23328 records). [2025-09-26T19:08:00.235387] [INFO ] [MAIN ] GPOR: Full history saved. [2025-09-26T19:08:00.235487] [INFO ] [MAIN ] Update Progress: 965/2371 symbols completed. GPOR took 35.4s. Estimated remaining: 3h 6m 26s. Rate: 7.5 symbols/min [2025-09-26T19:08:00.421287] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:08:00.443907] [DEBUG] [LOCAL ] GRDN: Loaded 19994 existing records from primary storage. [2025-09-26T19:08:00.444056] [INFO ] [MAIN ] GRDN: Loaded 19994 existing records. [2025-09-26T19:08:00.640250] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:08:00.640937] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-09-26T19:08:00.641091] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-09-26T19:08:00.642108] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-09-26T19:08:00.642178] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-09-26T19:08:00.771196] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-09-26T19:08:00.835529] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-26T19:08:00.991472] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-26T19:08:01.103012] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:08:01.556729] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2024-12. [2025-09-26T19:08:02.046456] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-26T19:08:02.356764] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-09-26T19:08:02.684052] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-26T19:08:03.156803] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-09-26T19:08:03.956882] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-09-26T19:08:03.969354] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-26T19:08:04.517272] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-26T19:08:04.525835] [INFO ] [REMOTE ] GPRK: Full fetch complete (57237 records). [2025-09-26T19:08:04.525965] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-09-26T19:08:04.761826] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-09-26T19:08:04.956846] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-09-26T19:08:04.956949] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-09-26T19:08:04.957793] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-09-26T19:08:04.957862] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-09-26T19:08:04.960624] [DEBUG] [LOCAL ] GPRK: Trimmed 57237 records to 39841 (keeping 200 days of data) [2025-09-26T19:08:05.200135] [DEBUG] [LOCAL ] GPRK: Primary data saved (39841 records). [2025-09-26T19:08:05.200297] [INFO ] [MAIN ] GPRK: Full history saved. [2025-09-26T19:08:05.200413] [INFO ] [MAIN ] Update Progress: 966/2371 symbols completed. GPRK took 33.2s. Estimated remaining: 3h 6m 13s. Rate: 7.5 symbols/min [2025-09-26T19:08:05.347174] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-26T19:08:05.405584] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:08:05.450813] [DEBUG] [LOCAL ] GRMN: Loaded 41576 existing records from primary storage. [2025-09-26T19:08:05.450984] [INFO ] [MAIN ] GRMN: Loaded 41576 existing records. [2025-09-26T19:08:05.561827] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-09-26T19:08:05.642589] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:08:05.646866] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-09-26T19:08:05.651455] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-09-26T19:08:05.651798] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-26T19:08:05.654469] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-09-26T19:08:05.655526] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-09-26T19:08:06.070116] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:08:06.356731] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-09-26T19:08:06.451121] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-26T19:08:07.156749] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2024-12. [2025-09-26T19:08:07.535579] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-26T19:08:07.956758] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-09-26T19:08:08.515208] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-26T19:08:08.762732] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-09-26T19:08:08.769882] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-26T19:08:09.556753] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-09-26T19:08:10.066040] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-26T19:08:10.072084] [INFO ] [REMOTE ] GRBK: Full fetch complete (40612 records). [2025-09-26T19:08:10.072314] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-09-26T19:08:10.351985] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-26T19:08:10.370125] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-09-26T19:08:10.499190] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-09-26T19:08:10.499298] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-09-26T19:08:10.500233] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-09-26T19:08:10.500298] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-09-26T19:08:10.501436] [DEBUG] [LOCAL ] GRBK: Trimmed 40612 records to 27375 (keeping 200 days of data) [2025-09-26T19:08:10.683124] [DEBUG] [LOCAL ] GRBK: Primary data saved (27375 records). [2025-09-26T19:08:10.683346] [INFO ] [MAIN ] GRBK: Full history saved. [2025-09-26T19:08:10.683467] [INFO ] [MAIN ] Update Progress: 967/2371 symbols completed. GRBK took 30.9s. Estimated remaining: 3h 6m 2s. Rate: 7.5 symbols/min [2025-09-26T19:08:10.864610] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:08:10.918271] [DEBUG] [LOCAL ] GRND: Loaded 50356 existing records from primary storage. [2025-09-26T19:08:10.918486] [INFO ] [MAIN ] GRND: Loaded 50356 existing records. [2025-09-26T19:08:11.107600] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:08:11.107951] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-09-26T19:08:11.108005] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-09-26T19:08:11.109413] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-09-26T19:08:11.109476] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-09-26T19:08:11.162760] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-09-26T19:08:11.195270] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-26T19:08:11.489403] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:08:11.956738] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-09-26T19:08:12.109454] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-26T19:08:12.729317] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-26T19:08:12.756732] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-09-26T19:08:13.525394] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-26T19:08:13.556758] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-09-26T19:08:14.356745] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-09-26T19:08:14.436894] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-26T19:08:14.440093] [INFO ] [REMOTE ] GRC: Full fetch complete (13080 records). [2025-09-26T19:08:14.440241] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-09-26T19:08:14.832975] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-09-26T19:08:14.833092] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-09-26T19:08:14.833537] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-09-26T19:08:14.833603] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-09-26T19:08:14.834426] [DEBUG] [LOCAL ] GRC: Trimmed 13080 records to 9061 (keeping 200 days of data) [2025-09-26T19:08:14.896191] [DEBUG] [LOCAL ] GRC: Primary data saved (9061 records). [2025-09-26T19:08:14.896346] [INFO ] [MAIN ] GRC: Full history saved. [2025-09-26T19:08:14.896482] [INFO ] [MAIN ] Update Progress: 968/2371 symbols completed. GRC took 30.5s. Estimated remaining: 3h 5m 48s. Rate: 7.6 symbols/min [2025-09-26T19:08:15.075932] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:08:15.108269] [DEBUG] [LOCAL ] GRNT: Loaded 34006 existing records from primary storage. [2025-09-26T19:08:15.108414] [INFO ] [MAIN ] GRNT: Loaded 34006 existing records. [2025-09-26T19:08:15.164970] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-09-26T19:08:15.299331] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:08:15.299635] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-09-26T19:08:15.299756] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-09-26T19:08:15.300922] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-09-26T19:08:15.300986] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-09-26T19:08:15.685980] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:08:15.914492] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-26T19:08:15.956766] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-09-26T19:08:16.423561] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-26T19:08:16.756759] [INFO ] [REMOTE ] GRND: Fetching primary data for 2024-12. [2025-09-26T19:08:17.449932] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-26T19:08:17.556758] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-09-26T19:08:18.274534] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-26T19:08:18.356699] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-09-26T19:08:18.662207] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-26T19:08:19.156768] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2024-12. [2025-09-26T19:08:19.957991] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-09-26T19:08:19.961407] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-26T19:08:20.570890] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-26T19:08:20.670262] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-26T19:08:20.756755] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-09-26T19:08:21.556738] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-09-26T19:08:22.356766] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-09-26T19:08:22.395206] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-26T19:08:22.704246] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-26T19:08:23.156776] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-09-26T19:08:23.698152] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-26T19:08:23.956781] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-09-26T19:08:24.756798] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-09-26T19:08:24.935466] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-26T19:08:25.064558] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-26T19:08:25.556738] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-09-26T19:08:26.356770] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-09-26T19:08:26.467739] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-26T19:08:27.156810] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-09-26T19:08:27.240010] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-26T19:08:27.250998] [INFO ] [REMOTE ] GRDN: Full fetch complete (26061 records). [2025-09-26T19:08:27.251205] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-09-26T19:08:27.694252] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-26T19:08:27.779850] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-09-26T19:08:27.779938] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-09-26T19:08:27.780521] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-09-26T19:08:27.780608] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-09-26T19:08:27.781504] [DEBUG] [LOCAL ] GRDN: Trimmed 26061 records to 20178 (keeping 200 days of data) [2025-09-26T19:08:27.906810] [DEBUG] [LOCAL ] GRDN: Primary data saved (20178 records). [2025-09-26T19:08:27.906948] [INFO ] [MAIN ] GRDN: Full history saved. [2025-09-26T19:08:27.907063] [INFO ] [MAIN ] Update Progress: 969/2371 symbols completed. GRDN took 27.7s. Estimated remaining: 3h 5m 48s. Rate: 7.5 symbols/min [2025-09-26T19:08:27.965262] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-09-26T19:08:28.098976] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:08:28.111774] [DEBUG] [LOCAL ] GROV: Loaded 9156 existing records from primary storage. [2025-09-26T19:08:28.111919] [INFO ] [MAIN ] GROV: Loaded 9156 existing records. [2025-09-26T19:08:28.293320] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:08:28.293710] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-09-26T19:08:28.293780] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-09-26T19:08:28.294249] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-09-26T19:08:28.294309] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-09-26T19:08:28.671359] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:08:28.756774] [INFO ] [REMOTE ] GROV: Fetching primary data for 2024-12. [2025-09-26T19:08:29.036330] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-26T19:08:29.556793] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-09-26T19:08:29.686097] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T19:08:29.725242] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-26T19:08:30.356769] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-09-26T19:08:31.141117] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-26T19:08:31.156693] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-09-26T19:08:31.246408] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-26T19:08:31.956742] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-09-26T19:08:32.675093] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-26T19:08:32.756747] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-09-26T19:08:33.404855] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-26T19:08:33.556768] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-09-26T19:08:34.356717] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-09-26T19:08:34.379321] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-26T19:08:34.491453] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-26T19:08:35.156760] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-09-26T19:08:35.956767] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-09-26T19:08:36.000800] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-26T19:08:36.167061] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-26T19:08:36.756740] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-09-26T19:08:37.377101] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-26T19:08:37.556723] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-09-26T19:08:38.357004] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-09-26T19:08:38.362884] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-26T19:08:38.962724] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-26T19:08:39.121204] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-26T19:08:39.156721] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-09-26T19:08:39.934859] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-26T19:08:39.956674] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-09-26T19:08:40.673035] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-26T19:08:40.756813] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-09-26T19:08:41.556730] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-09-26T19:08:42.356775] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-09-26T19:08:42.469370] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-26T19:08:42.721699] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-26T19:08:43.156781] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-09-26T19:08:43.956787] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-09-26T19:08:44.015825] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-26T19:08:44.024323] [INFO ] [REMOTE ] GRMN: Full fetch complete (60008 records). [2025-09-26T19:08:44.024574] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-09-26T19:08:44.506826] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-09-26T19:08:44.506966] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-09-26T19:08:44.507964] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-09-26T19:08:44.508060] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-09-26T19:08:44.509823] [DEBUG] [LOCAL ] GRMN: Trimmed 60008 records to 41798 (keeping 200 days of data) [2025-09-26T19:08:44.664904] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-26T19:08:44.779112] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-09-26T19:08:44.833319] [DEBUG] [LOCAL ] GRMN: Primary data saved (41798 records). [2025-09-26T19:08:44.833506] [INFO ] [MAIN ] GRMN: Full history saved. [2025-09-26T19:08:44.833660] [INFO ] [MAIN ] Update Progress: 970/2371 symbols completed. GRMN took 39.6s. Estimated remaining: 3h 5m 53s. Rate: 7.5 symbols/min [2025-09-26T19:08:45.021870] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:08:45.028046] [DEBUG] [LOCAL ] GRX: Loaded 4508 existing records from primary storage. [2025-09-26T19:08:45.028157] [INFO ] [MAIN ] GRX: Loaded 4508 existing records. [2025-09-26T19:08:45.221425] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:08:45.221958] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-09-26T19:08:45.222025] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-09-26T19:08:45.222561] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-09-26T19:08:45.222714] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-09-26T19:08:45.434201] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-26T19:08:45.557249] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-09-26T19:08:45.642442] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:08:46.349039] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-26T19:08:46.360971] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-09-26T19:08:46.364481] [INFO ] [REMOTE ] GRNT: Full fetch complete (48462 records). [2025-09-26T19:08:46.365729] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-09-26T19:08:46.365579] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-26T19:08:46.769506] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-09-26T19:08:46.769679] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-09-26T19:08:46.770421] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-09-26T19:08:46.770504] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-09-26T19:08:46.771765] [DEBUG] [LOCAL ] GRNT: Trimmed 48462 records to 34235 (keeping 200 days of data) [2025-09-26T19:08:46.978610] [DEBUG] [LOCAL ] GRNT: Primary data saved (34235 records). [2025-09-26T19:08:46.978788] [INFO ] [MAIN ] GRNT: Full history saved. [2025-09-26T19:08:46.978884] [INFO ] [MAIN ] Update Progress: 971/2371 symbols completed. GRNT took 32.1s. Estimated remaining: 3h 5m 36s. Rate: 7.5 symbols/min [2025-09-26T19:08:47.158703] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-09-26T19:08:47.160475] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:08:47.215423] [DEBUG] [LOCAL ] GS: Loaded 52395 existing records from primary storage. [2025-09-26T19:08:47.215580] [INFO ] [MAIN ] GS: Loaded 52395 existing records. [2025-09-26T19:08:47.458619] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:08:47.458924] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-09-26T19:08:47.458975] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-09-26T19:08:47.460940] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-09-26T19:08:47.461002] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-09-26T19:08:47.842237] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:08:47.956713] [INFO ] [REMOTE ] GRX: Fetching primary data for 2024-12. [2025-09-26T19:08:47.997445] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-26T19:08:47.999349] [INFO ] [REMOTE ] GROV: Full fetch complete (14574 records). [2025-09-26T19:08:47.999436] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-09-26T19:08:48.429805] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-09-26T19:08:48.433470] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-09-26T19:08:48.433959] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-09-26T19:08:48.434661] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-09-26T19:08:48.441849] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-26T19:08:48.455193] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-26T19:08:48.454744] [DEBUG] [LOCAL ] GROV: Trimmed 14574 records to 9240 (keeping 200 days of data) [2025-09-26T19:08:48.510619] [DEBUG] [LOCAL ] GROV: Primary data saved (9240 records). [2025-09-26T19:08:48.510796] [INFO ] [MAIN ] GROV: Full history saved. [2025-09-26T19:08:48.510945] [INFO ] [MAIN ] Update Progress: 972/2371 symbols completed. GROV took 20.6s. Estimated remaining: 3h 5m 19s. Rate: 7.5 symbols/min [2025-09-26T19:08:48.685374] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:08:48.731757] [DEBUG] [LOCAL ] GSBD: Loaded 39474 existing records from primary storage. [2025-09-26T19:08:48.731928] [INFO ] [MAIN ] GSBD: Loaded 39474 existing records. [2025-09-26T19:08:48.761821] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-09-26T19:08:48.919269] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:08:48.919522] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-09-26T19:08:48.919570] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-09-26T19:08:48.921048] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-09-26T19:08:48.921112] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-09-26T19:08:49.296515] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:08:49.415113] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-26T19:08:49.556731] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-09-26T19:08:50.040384] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-26T19:08:50.356747] [INFO ] [REMOTE ] GS: Fetching primary data for 2024-12. [2025-09-26T19:08:51.156719] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-09-26T19:08:51.956697] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2024-12. [2025-09-26T19:08:52.290321] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-26T19:08:52.756739] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-09-26T19:08:53.027464] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-26T19:08:53.149532] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-26T19:08:53.556732] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-09-26T19:08:54.207770] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-26T19:08:54.356704] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-09-26T19:08:54.834032] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-26T19:08:55.156724] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-09-26T19:08:55.733637] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-26T19:08:55.963416] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-09-26T19:08:55.982830] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-26T19:08:56.508589] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-26T19:08:56.756729] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-09-26T19:08:57.556732] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-09-26T19:08:58.284985] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-26T19:08:58.356768] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-09-26T19:08:59.156704] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-09-26T19:08:59.554544] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-26T19:08:59.640844] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-26T19:08:59.730009] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-26T19:08:59.956720] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-09-26T19:09:00.583269] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-26T19:09:00.756727] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-09-26T19:09:01.556733] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-09-26T19:09:02.356724] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-09-26T19:09:02.409498] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-26T19:09:02.448085] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-26T19:09:03.156724] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-09-26T19:09:03.956736] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-09-26T19:09:04.147390] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-26T19:09:04.149790] [INFO ] [REMOTE ] GRX: Full fetch complete (6463 records). [2025-09-26T19:09:04.149925] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-09-26T19:09:04.303271] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-26T19:09:04.370556] [INFO ] [REMOTE ] GRND: Full fetch complete (70442 records). [2025-09-26T19:09:04.428229] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-09-26T19:09:04.761076] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-09-26T19:09:04.761006] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-09-26T19:09:04.814580] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-09-26T19:09:04.833699] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-09-26T19:09:04.851086] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-09-26T19:09:04.885268] [DEBUG] [LOCAL ] GRX: Trimmed 6463 records to 4547 (keeping 200 days of data) [2025-09-26T19:09:05.050832] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-09-26T19:09:05.050910] [DEBUG] [LOCAL ] GRX: Primary data saved (4547 records). [2025-09-26T19:09:05.051037] [INFO ] [MAIN ] GRX: Full history saved. [2025-09-26T19:09:05.051151] [INFO ] [MAIN ] Update Progress: 973/2371 symbols completed. GRX took 20.2s. Estimated remaining: 3h 5m 24s. Rate: 7.5 symbols/min [2025-09-26T19:09:05.051232] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-09-26T19:09:05.063866] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-09-26T19:09:05.064061] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-09-26T19:09:05.163005] [DEBUG] [LOCAL ] GRND: Trimmed 70442 records to 50744 (keeping 200 days of data) [2025-09-26T19:09:05.296338] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:09:05.562836] [DEBUG] [LOCAL ] GSK: Loaded 53882 existing records from primary storage. [2025-09-26T19:09:05.563111] [INFO ] [MAIN ] GSK: Loaded 53882 existing records. [2025-09-26T19:09:05.718603] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-26T19:09:05.756873] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-09-26T19:09:05.825003] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:09:05.830718] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-09-26T19:09:05.834441] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-09-26T19:09:05.834383] [DEBUG] [LOCAL ] GRND: Primary data saved (50744 records). [2025-09-26T19:09:05.834599] [INFO ] [MAIN ] GRND: Full history saved. [2025-09-26T19:09:05.835842] [INFO ] [MAIN ] Update Progress: 974/2371 symbols completed. GRND took 55.2s. Estimated remaining: 3h 5m 5s. Rate: 7.5 symbols/min [2025-09-26T19:09:05.847573] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-09-26T19:09:05.859283] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-09-26T19:09:06.212612] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:09:06.449897] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:09:06.450920] [INFO ] [REMOTE ] GSK: Fetching primary data for 2024-12. [2025-09-26T19:09:06.463353] [DEBUG] [LOCAL ] GSL: Loaded 33647 existing records from primary storage. [2025-09-26T19:09:06.463484] [INFO ] [MAIN ] GSL: Loaded 33647 existing records. [2025-09-26T19:09:06.654558] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:09:06.654825] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-09-26T19:09:06.654876] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-09-26T19:09:06.656217] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-09-26T19:09:06.656282] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-09-26T19:09:07.052036] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:09:07.108684] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-26T19:09:07.156682] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-09-26T19:09:07.326736] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-26T19:09:07.956725] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-09-26T19:09:08.346765] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-26T19:09:08.756742] [INFO ] [REMOTE ] GSL: Fetching primary data for 2024-12. [2025-09-26T19:09:09.505805] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-26T19:09:09.556737] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-09-26T19:09:09.804834] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-26T19:09:10.165796] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-26T19:09:10.356739] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-09-26T19:09:11.156738] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-09-26T19:09:11.713272] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-26T19:09:11.956712] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-09-26T19:09:12.077187] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-26T19:09:12.240358] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-26T19:09:12.756741] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-09-26T19:09:13.556733] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-09-26T19:09:13.616406] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-26T19:09:14.108498] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-26T19:09:14.356770] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-09-26T19:09:15.105095] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-26T19:09:15.156788] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-09-26T19:09:15.850515] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-26T19:09:15.956749] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-09-26T19:09:16.756713] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-09-26T19:09:16.869939] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-26T19:09:16.881392] [INFO ] [REMOTE ] GSBD: Full fetch complete (58367 records). [2025-09-26T19:09:16.881571] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-09-26T19:09:17.294587] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-09-26T19:09:17.294738] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-09-26T19:09:17.296147] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-09-26T19:09:17.296257] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-09-26T19:09:17.297997] [DEBUG] [LOCAL ] GSBD: Trimmed 58367 records to 39756 (keeping 200 days of data) [2025-09-26T19:09:17.556865] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-09-26T19:09:17.577345] [DEBUG] [LOCAL ] GSBD: Primary data saved (39756 records). [2025-09-26T19:09:17.577579] [INFO ] [MAIN ] GSBD: Full history saved. [2025-09-26T19:09:17.577843] [INFO ] [MAIN ] Update Progress: 975/2371 symbols completed. GSBD took 29.1s. Estimated remaining: 3h 5m 3s. Rate: 7.5 symbols/min [2025-09-26T19:09:17.763003] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:09:17.799011] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-26T19:09:17.886748] [DEBUG] [LOCAL ] GTES: Loaded 51024 existing records from primary storage. [2025-09-26T19:09:17.888676] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-26T19:09:17.887799] [INFO ] [MAIN ] GTES: Loaded 51024 existing records. [2025-09-26T19:09:18.105142] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:09:18.105525] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-09-26T19:09:18.105579] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-09-26T19:09:18.107571] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-09-26T19:09:18.107700] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-09-26T19:09:18.362153] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-09-26T19:09:18.518900] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:09:19.156830] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-09-26T19:09:19.797403] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-26T19:09:19.956833] [INFO ] [REMOTE ] GTES: Fetching primary data for 2024-12. [2025-09-26T19:09:20.356545] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-26T19:09:20.537723] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-26T19:09:20.756747] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-09-26T19:09:21.290006] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-26T19:09:21.556749] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-09-26T19:09:21.783169] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-26T19:09:22.356770] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-09-26T19:09:23.156707] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-09-26T19:09:23.668435] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-26T19:09:23.954731] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-26T19:09:23.964534] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-09-26T19:09:24.756741] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-09-26T19:09:25.272110] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-26T19:09:25.463472] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-26T19:09:25.556735] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-09-26T19:09:26.024484] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-26T19:09:26.356734] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-09-26T19:09:27.156752] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-09-26T19:09:27.791822] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-26T19:09:27.819964] [INFO ] [REMOTE ] GS: Full fetch complete (75751 records). [2025-09-26T19:09:27.822418] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-09-26T19:09:27.824842] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-26T19:09:27.961846] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-09-26T19:09:28.258306] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-09-26T19:09:28.258403] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-09-26T19:09:28.259322] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-09-26T19:09:28.259391] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-09-26T19:09:28.260930] [DEBUG] [LOCAL ] GS: Trimmed 75751 records to 52736 (keeping 200 days of data) [2025-09-26T19:09:28.634418] [DEBUG] [LOCAL ] GS: Primary data saved (52736 records). [2025-09-26T19:09:28.634597] [INFO ] [MAIN ] GS: Full history saved. [2025-09-26T19:09:28.634770] [INFO ] [MAIN ] Update Progress: 976/2371 symbols completed. GS took 41.7s. Estimated remaining: 3h 4m 59s. Rate: 7.5 symbols/min [2025-09-26T19:09:28.759805] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-09-26T19:09:28.832682] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:09:28.881884] [DEBUG] [LOCAL ] GTLS: Loaded 43161 existing records from primary storage. [2025-09-26T19:09:28.882069] [INFO ] [MAIN ] GTLS: Loaded 43161 existing records. [2025-09-26T19:09:29.080194] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:09:29.080587] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-09-26T19:09:29.080757] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-09-26T19:09:29.091950] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-09-26T19:09:29.107723] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-09-26T19:09:29.183057] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-26T19:09:29.467736] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-26T19:09:29.516876] [INFO ] [REMOTE ] GSL: Full fetch complete (47871 records). [2025-09-26T19:09:29.541484] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:09:29.537792] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-09-26T19:09:29.563883] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-09-26T19:09:29.969005] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-09-26T19:09:29.969091] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-09-26T19:09:29.969798] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-09-26T19:09:29.969904] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-09-26T19:09:29.971081] [DEBUG] [LOCAL ] GSL: Trimmed 47871 records to 33824 (keeping 200 days of data) [2025-09-26T19:09:30.210885] [DEBUG] [LOCAL ] GSL: Primary data saved (33824 records). [2025-09-26T19:09:30.211074] [INFO ] [MAIN ] GSL: Full history saved. [2025-09-26T19:09:30.211189] [INFO ] [MAIN ] Update Progress: 977/2371 symbols completed. GSL took 24.4s. Estimated remaining: 3h 4m 42s. Rate: 7.5 symbols/min [2025-09-26T19:09:30.361889] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2024-12. [2025-09-26T19:09:30.425126] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:09:30.467750] [DEBUG] [LOCAL ] GTN: Loaded 46009 existing records from primary storage. [2025-09-26T19:09:30.467893] [INFO ] [MAIN ] GTN: Loaded 46009 existing records. [2025-09-26T19:09:30.686601] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:09:30.699944] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-09-26T19:09:30.700066] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-09-26T19:09:30.702274] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-09-26T19:09:30.702206] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-26T19:09:30.713457] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-09-26T19:09:31.079791] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:09:31.156729] [INFO ] [REMOTE ] GTN: Fetching primary data for 2024-12. [2025-09-26T19:09:31.531039] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-26T19:09:31.956698] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-09-26T19:09:32.044968] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-26T19:09:32.426894] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-26T19:09:32.756725] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-09-26T19:09:33.556724] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-09-26T19:09:34.099478] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-26T19:09:34.356762] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-09-26T19:09:34.357768] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-26T19:09:34.737181] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-26T19:09:35.156772] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-09-26T19:09:35.956782] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-09-26T19:09:36.296027] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-26T19:09:36.535033] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-26T19:09:36.756750] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-09-26T19:09:37.538390] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-26T19:09:37.556690] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-09-26T19:09:38.356732] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-09-26T19:09:38.780502] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-26T19:09:38.793711] [INFO ] [REMOTE ] GSK: Full fetch complete (77471 records). [2025-09-26T19:09:38.793894] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-09-26T19:09:39.159289] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-09-26T19:09:39.224577] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-09-26T19:09:39.224847] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-09-26T19:09:39.226039] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-09-26T19:09:39.226203] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-09-26T19:09:39.229433] [DEBUG] [LOCAL ] GSK: Trimmed 77471 records to 54272 (keeping 200 days of data) [2025-09-26T19:09:39.358447] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-26T19:09:39.633384] [DEBUG] [LOCAL ] GSK: Primary data saved (54272 records). [2025-09-26T19:09:39.633579] [INFO ] [MAIN ] GSK: Full history saved. [2025-09-26T19:09:39.633735] [INFO ] [MAIN ] Update Progress: 978/2371 symbols completed. GSK took 34.6s. Estimated remaining: 3h 4m 36s. Rate: 7.5 symbols/min [2025-09-26T19:09:39.828589] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:09:39.861286] [DEBUG] [LOCAL ] GTY: Loaded 30597 existing records from primary storage. [2025-09-26T19:09:39.861449] [INFO ] [MAIN ] GTY: Loaded 30597 existing records. [2025-09-26T19:09:39.959464] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-09-26T19:09:40.059723] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:09:40.060067] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-09-26T19:09:40.060118] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-09-26T19:09:40.061210] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-09-26T19:09:40.061292] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-09-26T19:09:40.366413] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-26T19:09:40.485119] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:09:40.756752] [INFO ] [REMOTE ] GTY: Fetching primary data for 2024-12. [2025-09-26T19:09:40.824999] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-26T19:09:41.244366] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-26T19:09:41.556742] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-09-26T19:09:41.588255] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-26T19:09:42.356752] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-09-26T19:09:43.155912] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-26T19:09:43.165339] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-09-26T19:09:43.382333] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-26T19:09:43.956780] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-09-26T19:09:44.747616] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-26T19:09:44.756751] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-09-26T19:09:45.464817] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-26T19:09:45.556737] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-09-26T19:09:45.984579] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-26T19:09:46.356742] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-09-26T19:09:47.156735] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-09-26T19:09:47.199743] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-26T19:09:47.699768] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-26T19:09:47.956740] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-09-26T19:09:48.756695] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-09-26T19:09:48.883539] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-26T19:09:49.425601] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T19:09:49.556721] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-09-26T19:09:50.310525] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T19:09:50.356740] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-09-26T19:09:50.828211] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-26T19:09:51.156755] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-09-26T19:09:51.956699] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-09-26T19:09:52.032093] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-26T19:09:52.660164] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-26T19:09:52.756729] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-09-26T19:09:53.228560] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-26T19:09:53.556754] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-09-26T19:09:54.047704] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-26T19:09:54.356746] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-09-26T19:09:55.156700] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-09-26T19:09:55.340825] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-26T19:09:55.350924] [INFO ] [REMOTE ] GTES: Full fetch complete (73958 records). [2025-09-26T19:09:55.351095] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-09-26T19:09:55.792192] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-26T19:09:55.801845] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-09-26T19:09:55.802383] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-09-26T19:09:55.803574] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-09-26T19:09:55.804039] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-09-26T19:09:55.806903] [DEBUG] [LOCAL ] GTES: Trimmed 73958 records to 51399 (keeping 200 days of data) [2025-09-26T19:09:55.990834] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-09-26T19:09:56.139212] [DEBUG] [LOCAL ] GTES: Primary data saved (51399 records). [2025-09-26T19:09:56.139466] [INFO ] [MAIN ] GTES: Full history saved. [2025-09-26T19:09:56.139673] [INFO ] [MAIN ] Update Progress: 979/2371 symbols completed. GTES took 38.6s. Estimated remaining: 3h 4m 41s. Rate: 7.5 symbols/min [2025-09-26T19:09:56.326057] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:09:56.341281] [DEBUG] [LOCAL ] GUG: Loaded 12087 existing records from primary storage. [2025-09-26T19:09:56.341426] [INFO ] [MAIN ] GUG: Loaded 12087 existing records. [2025-09-26T19:09:56.589254] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:09:56.589747] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-09-26T19:09:56.589810] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-09-26T19:09:56.590489] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-09-26T19:09:56.590594] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-09-26T19:09:56.758077] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-09-26T19:09:57.035484] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-26T19:09:57.040094] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:09:57.556698] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-09-26T19:09:57.615819] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-26T19:09:58.197054] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-26T19:09:58.356738] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-09-26T19:09:59.156708] [INFO ] [REMOTE ] GUG: Fetching primary data for 2024-12. [2025-09-26T19:09:59.332051] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-26T19:09:59.341276] [INFO ] [REMOTE ] GTN: Full fetch complete (66409 records). [2025-09-26T19:09:59.341460] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-09-26T19:09:59.753810] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-09-26T19:09:59.753907] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-09-26T19:09:59.754780] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-09-26T19:09:59.754847] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-09-26T19:09:59.756289] [DEBUG] [LOCAL ] GTN: Trimmed 66409 records to 46301 (keeping 200 days of data) [2025-09-26T19:09:59.964381] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-09-26T19:10:00.080456] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-26T19:10:00.096228] [DEBUG] [LOCAL ] GTN: Primary data saved (46301 records). [2025-09-26T19:10:00.096364] [INFO ] [MAIN ] GTN: Full history saved. [2025-09-26T19:10:00.097112] [INFO ] [MAIN ] Update Progress: 980/2371 symbols completed. GTN took 29.9s. Estimated remaining: 3h 4m 27s. Rate: 7.5 symbols/min [2025-09-26T19:10:00.310619] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-26T19:10:00.314494] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:10:00.319130] [DEBUG] [LOCAL ] GUT: No existing data file found in primary storage. [2025-09-26T19:10:00.319202] [WARN ] [MAIN ] GUT: No existing data found, performing full refresh instead. [2025-09-26T19:10:00.319421] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-09-26T19:10:00.319493] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-09-26T19:10:00.319568] [DEBUG] [LOCAL ] GUT: No primary data file found to delete. [2025-09-26T19:10:00.319614] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-09-26T19:10:00.729578] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:10:00.756742] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-09-26T19:10:01.186884] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-26T19:10:01.556731] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-09-26T19:10:01.982722] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-26T19:10:02.356727] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-09-26T19:10:03.139489] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-26T19:10:03.146337] [INFO ] [REMOTE ] GTY: Full fetch complete (43355 records). [2025-09-26T19:10:03.146486] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-09-26T19:10:03.162460] [INFO ] [REMOTE ] GUT: Fetching primary data for 2024-12. [2025-09-26T19:10:03.267342] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-26T19:10:03.585688] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-09-26T19:10:03.585795] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-09-26T19:10:03.586467] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-09-26T19:10:03.586514] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-09-26T19:10:03.587974] [DEBUG] [LOCAL ] GTY: Trimmed 43355 records to 30796 (keeping 200 days of data) [2025-09-26T19:10:03.792086] [DEBUG] [LOCAL ] GTY: Primary data saved (30796 records). [2025-09-26T19:10:03.792249] [INFO ] [MAIN ] GTY: Full history saved. [2025-09-26T19:10:03.792347] [INFO ] [MAIN ] Update Progress: 981/2371 symbols completed. GTY took 24.2s. Estimated remaining: 3h 4m 13s. Rate: 7.5 symbols/min [2025-09-26T19:10:03.959155] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-09-26T19:10:03.993639] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:10:04.031288] [DEBUG] [LOCAL ] GVA: Loaded 33882 existing records from primary storage. [2025-09-26T19:10:04.031464] [INFO ] [MAIN ] GVA: Loaded 33882 existing records. [2025-09-26T19:10:04.233201] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:10:04.233550] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-09-26T19:10:04.233609] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-09-26T19:10:04.235363] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-09-26T19:10:04.235427] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-09-26T19:10:04.564866] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T19:10:04.685216] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:10:04.756797] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-09-26T19:10:05.350450] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-26T19:10:05.360174] [INFO ] [REMOTE ] GTLS: Full fetch complete (61372 records). [2025-09-26T19:10:05.360335] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-09-26T19:10:05.568811] [INFO ] [REMOTE ] GVA: Fetching primary data for 2024-12. [2025-09-26T19:10:05.784924] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-09-26T19:10:05.793497] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-09-26T19:10:05.794425] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-09-26T19:10:05.794517] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-09-26T19:10:05.796400] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-26T19:10:05.802305] [DEBUG] [LOCAL ] GTLS: Trimmed 61372 records to 43461 (keeping 200 days of data) [2025-09-26T19:10:06.083735] [DEBUG] [LOCAL ] GTLS: Primary data saved (43461 records). [2025-09-26T19:10:06.083875] [INFO ] [MAIN ] GTLS: Full history saved. [2025-09-26T19:10:06.083965] [INFO ] [MAIN ] Update Progress: 982/2371 symbols completed. GTLS took 37.4s. Estimated remaining: 3h 3m 57s. Rate: 7.6 symbols/min [2025-09-26T19:10:06.264254] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:10:06.281383] [DEBUG] [LOCAL ] GWH: Loaded 15688 existing records from primary storage. [2025-09-26T19:10:06.281532] [INFO ] [MAIN ] GWH: Loaded 15688 existing records. [2025-09-26T19:10:06.361912] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-09-26T19:10:06.470249] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:10:06.470544] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-09-26T19:10:06.470716] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-09-26T19:10:06.471719] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-09-26T19:10:06.471780] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-09-26T19:10:06.846395] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:10:07.081138] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-26T19:10:07.124164] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-26T19:10:07.156782] [INFO ] [REMOTE ] GWH: Fetching primary data for 2024-12. [2025-09-26T19:10:07.956716] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-09-26T19:10:08.029497] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-26T19:10:08.756767] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-09-26T19:10:09.098041] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-26T19:10:09.556748] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-09-26T19:10:09.594037] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-26T19:10:10.356752] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-09-26T19:10:10.998087] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-26T19:10:11.156757] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-09-26T19:10:11.259452] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-26T19:10:11.956783] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-09-26T19:10:12.702110] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T19:10:12.756784] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-09-26T19:10:12.899624] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-26T19:10:13.417958] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-26T19:10:13.556743] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-09-26T19:10:14.338265] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-26T19:10:14.356704] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-09-26T19:10:15.156695] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-09-26T19:10:15.310964] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-26T19:10:15.956752] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-09-26T19:10:16.219741] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-26T19:10:16.756768] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-09-26T19:10:17.506215] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-26T19:10:17.556732] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-09-26T19:10:17.687549] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-26T19:10:18.356742] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-09-26T19:10:18.794078] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-26T19:10:19.156728] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-09-26T19:10:19.169528] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-26T19:10:19.956767] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-09-26T19:10:20.000086] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-26T19:10:20.756752] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-09-26T19:10:20.765333] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-26T19:10:21.556724] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-09-26T19:10:21.676721] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-26T19:10:21.679692] [INFO ] [REMOTE ] GUG: Full fetch complete (19921 records). [2025-09-26T19:10:21.679797] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-09-26T19:10:22.066698] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-09-26T19:10:22.066804] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-09-26T19:10:22.067371] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-09-26T19:10:22.067478] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-09-26T19:10:22.068484] [DEBUG] [LOCAL ] GUG: Trimmed 19921 records to 12138 (keeping 200 days of data) [2025-09-26T19:10:22.159853] [DEBUG] [LOCAL ] GUG: Primary data saved (12138 records). [2025-09-26T19:10:22.161315] [INFO ] [MAIN ] GUG: Full history saved. [2025-09-26T19:10:22.161536] [INFO ] [MAIN ] Update Progress: 983/2371 symbols completed. GUG took 26.0s. Estimated remaining: 3h 4m 1s. Rate: 7.5 symbols/min [2025-09-26T19:10:22.161192] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-26T19:10:22.356841] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-09-26T19:10:22.376827] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:10:22.430088] [DEBUG] [LOCAL ] GWRE: Loaded 41257 existing records from primary storage. [2025-09-26T19:10:22.430311] [INFO ] [MAIN ] GWRE: Loaded 41257 existing records. [2025-09-26T19:10:22.665511] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:10:22.665921] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-09-26T19:10:22.666003] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-09-26T19:10:22.667769] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-09-26T19:10:22.667839] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-09-26T19:10:23.049049] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:10:23.156743] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2024-12. [2025-09-26T19:10:23.316845] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-26T19:10:23.956794] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-09-26T19:10:24.756703] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-09-26T19:10:24.864367] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-26T19:10:25.287410] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-26T19:10:25.556714] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-09-26T19:10:25.743764] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-26T19:10:26.356752] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-09-26T19:10:27.156712] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-09-26T19:10:27.228616] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-26T19:10:27.378556] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-26T19:10:27.956769] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-09-26T19:10:28.517093] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-26T19:10:28.756743] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-09-26T19:10:29.519677] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-26T19:10:29.556716] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-09-26T19:10:29.722116] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-26T19:10:30.356753] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-09-26T19:10:31.156717] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-09-26T19:10:31.227675] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-26T19:10:31.374783] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-26T19:10:31.956733] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-09-26T19:10:32.297762] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-26T19:10:32.756743] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-09-26T19:10:33.455085] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-26T19:10:33.556714] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-09-26T19:10:33.784755] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-26T19:10:34.356755] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-09-26T19:10:35.099505] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-26T19:10:35.156784] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-09-26T19:10:35.439996] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-26T19:10:35.443408] [INFO ] [REMOTE ] GUT: Full fetch complete (22910 records). [2025-09-26T19:10:35.443529] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-09-26T19:10:35.847184] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-09-26T19:10:35.847321] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-09-26T19:10:35.847908] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-09-26T19:10:35.847971] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-09-26T19:10:35.848688] [DEBUG] [LOCAL ] GUT: Trimmed 22910 records to 15560 (keeping 200 days of data) [2025-09-26T19:10:35.946529] [DEBUG] [LOCAL ] GUT: Primary data saved (15560 records). [2025-09-26T19:10:35.946716] [INFO ] [MAIN ] GUT: Full history saved. [2025-09-26T19:10:35.946827] [INFO ] [MAIN ] Update Progress: 984/2371 symbols completed. GUT took 35.8s. Estimated remaining: 3h 4m 1s. Rate: 7.5 symbols/min [2025-09-26T19:10:35.963415] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-09-26T19:10:36.152183] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:10:36.175205] [DEBUG] [LOCAL ] GWW: Loaded 20010 existing records from primary storage. [2025-09-26T19:10:36.175355] [INFO ] [MAIN ] GWW: Loaded 20010 existing records. [2025-09-26T19:10:36.368984] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:10:36.369265] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-09-26T19:10:36.369316] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-09-26T19:10:36.370328] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-09-26T19:10:36.370394] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-09-26T19:10:36.785314] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:10:36.757706] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-09-26T19:10:36.814794] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-26T19:10:37.556728] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-09-26T19:10:37.679857] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T19:10:37.686141] [INFO ] [REMOTE ] GVA: Full fetch complete (48701 records). [2025-09-26T19:10:37.686312] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-09-26T19:10:38.120767] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-09-26T19:10:38.121006] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-09-26T19:10:38.122031] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-09-26T19:10:38.122132] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-09-26T19:10:38.140338] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-26T19:10:38.146854] [DEBUG] [LOCAL ] GVA: Trimmed 48701 records to 34030 (keeping 200 days of data) [2025-09-26T19:10:38.356977] [INFO ] [REMOTE ] GWW: Fetching primary data for 2024-12. [2025-09-26T19:10:38.363072] [DEBUG] [LOCAL ] GVA: Primary data saved (34030 records). [2025-09-26T19:10:38.364604] [INFO ] [MAIN ] GVA: Full history saved. [2025-09-26T19:10:38.364772] [INFO ] [MAIN ] Update Progress: 985/2371 symbols completed. GVA took 34.6s. Estimated remaining: 3h 3m 45s. Rate: 7.5 symbols/min [2025-09-26T19:10:38.557038] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:10:38.603254] [DEBUG] [LOCAL ] GXO: Loaded 47927 existing records from primary storage. [2025-09-26T19:10:38.603401] [INFO ] [MAIN ] GXO: Loaded 47927 existing records. [2025-09-26T19:10:38.806271] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:10:38.806523] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-09-26T19:10:38.806620] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-09-26T19:10:38.808431] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-09-26T19:10:38.808506] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-09-26T19:10:39.166147] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-09-26T19:10:39.243967] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:10:39.269069] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-26T19:10:39.494327] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-26T19:10:39.956732] [INFO ] [REMOTE ] GXO: Fetching primary data for 2024-12. [2025-09-26T19:10:40.306305] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-26T19:10:40.756731] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-09-26T19:10:41.562983] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-09-26T19:10:41.566073] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-26T19:10:41.939247] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-26T19:10:42.356684] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-09-26T19:10:42.752615] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-26T19:10:42.757219] [INFO ] [REMOTE ] GWH: Full fetch complete (20932 records). [2025-09-26T19:10:42.757343] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-09-26T19:10:43.156424] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-09-26T19:10:43.156507] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-09-26T19:10:43.156986] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-09-26T19:10:43.157170] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-09-26T19:10:43.157043] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-09-26T19:10:43.158724] [DEBUG] [LOCAL ] GWH: Trimmed 20932 records to 15825 (keeping 200 days of data) [2025-09-26T19:10:43.248680] [DEBUG] [LOCAL ] GWH: Primary data saved (15825 records). [2025-09-26T19:10:43.248837] [INFO ] [MAIN ] GWH: Full history saved. [2025-09-26T19:10:43.248995] [INFO ] [MAIN ] Update Progress: 986/2371 symbols completed. GWH took 37.2s. Estimated remaining: 3h 3m 33s. Rate: 7.5 symbols/min [2025-09-26T19:10:43.428375] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:10:43.431868] [DEBUG] [LOCAL ] GYLD: Loaded 1558 existing records from primary storage. [2025-09-26T19:10:43.431954] [INFO ] [MAIN ] GYLD: Loaded 1558 existing records. [2025-09-26T19:10:43.623660] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:10:43.623978] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-09-26T19:10:43.624033] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-09-26T19:10:43.624355] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-09-26T19:10:43.624416] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-09-26T19:10:43.972619] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-09-26T19:10:44.015737] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:10:44.044374] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-26T19:10:44.383027] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-26T19:10:44.756772] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2024-12. [2025-09-26T19:10:45.108137] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-26T19:10:45.552410] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-26T19:10:45.560807] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-09-26T19:10:46.356748] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-09-26T19:10:46.711927] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-26T19:10:47.156781] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-09-26T19:10:47.246548] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-26T19:10:47.956766] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-09-26T19:10:48.385359] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-26T19:10:48.756737] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-09-26T19:10:49.556698] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-09-26T19:10:49.757235] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-26T19:10:50.018098] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-26T19:10:50.356741] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-09-26T19:10:51.156768] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-09-26T19:10:51.278926] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T19:10:51.288286] [INFO ] [REMOTE ] GWRE: Full fetch complete (61325 records). [2025-09-26T19:10:51.288474] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-09-26T19:10:51.699339] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-09-26T19:10:51.699422] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-09-26T19:10:51.700228] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-09-26T19:10:51.700311] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-09-26T19:10:51.701634] [DEBUG] [LOCAL ] GWRE: Trimmed 61325 records to 41564 (keeping 200 days of data) [2025-09-26T19:10:51.956737] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-09-26T19:10:51.973948] [DEBUG] [LOCAL ] GWRE: Primary data saved (41564 records). [2025-09-26T19:10:51.974133] [INFO ] [MAIN ] GWRE: Full history saved. [2025-09-26T19:10:51.974253] [INFO ] [MAIN ] Update Progress: 987/2371 symbols completed. GWRE took 29.8s. Estimated remaining: 3h 3m 26s. Rate: 7.5 symbols/min [2025-09-26T19:10:52.196388] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:10:52.209835] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-26T19:10:52.283437] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-26T19:10:52.300239] [DEBUG] [LOCAL ] H: Loaded 45216 existing records from primary storage. [2025-09-26T19:10:52.302879] [INFO ] [MAIN ] H: Loaded 45216 existing records. [2025-09-26T19:10:52.302708] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-26T19:10:52.508724] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:10:52.509075] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-09-26T19:10:52.509136] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-09-26T19:10:52.511550] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-09-26T19:10:52.511620] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-09-26T19:10:52.761889] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-09-26T19:10:52.898471] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:10:53.255866] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-26T19:10:53.556730] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-09-26T19:10:54.356718] [INFO ] [REMOTE ] H: Fetching primary data for 2024-12. [2025-09-26T19:10:54.706506] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-26T19:10:55.156762] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-09-26T19:10:55.782503] [INFO ] [REMOTE ] H: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-26T19:10:55.956741] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-09-26T19:10:56.561447] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-26T19:10:56.713144] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-26T19:10:56.756749] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-09-26T19:10:57.556717] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-09-26T19:10:57.978050] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-26T19:10:57.981771] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-26T19:10:58.356729] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-09-26T19:10:58.800370] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-26T19:10:59.156729] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-09-26T19:10:59.610460] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-26T19:10:59.956725] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-09-26T19:11:00.481083] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-26T19:11:00.756720] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-09-26T19:11:01.378960] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-26T19:11:01.380141] [INFO ] [REMOTE ] GYLD: Full fetch complete (2056 records). [2025-09-26T19:11:01.380216] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-09-26T19:11:01.556824] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-09-26T19:11:01.793446] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-09-26T19:11:01.793533] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-09-26T19:11:01.793671] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-09-26T19:11:01.793735] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-09-26T19:11:01.794094] [DEBUG] [LOCAL ] GYLD: Trimmed 2056 records to 1569 (keeping 200 days of data) [2025-09-26T19:11:01.804759] [DEBUG] [LOCAL ] GYLD: Primary data saved (1569 records). [2025-09-26T19:11:01.805024] [INFO ] [MAIN ] GYLD: Full history saved. [2025-09-26T19:11:01.805132] [INFO ] [MAIN ] Update Progress: 988/2371 symbols completed. GYLD took 18.6s. Estimated remaining: 3h 3m 21s. Rate: 7.5 symbols/min [2025-09-26T19:11:01.999800] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:11:02.038590] [DEBUG] [LOCAL ] HAE: Loaded 39857 existing records from primary storage. [2025-09-26T19:11:02.038782] [INFO ] [MAIN ] HAE: Loaded 39857 existing records. [2025-09-26T19:11:02.237307] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:11:02.237604] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-09-26T19:11:02.237692] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-09-26T19:11:02.239030] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-09-26T19:11:02.239101] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-09-26T19:11:02.361901] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-09-26T19:11:02.627594] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:11:02.869848] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-26T19:11:03.156767] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-09-26T19:11:03.513971] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-26T19:11:03.956772] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-09-26T19:11:04.467783] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-26T19:11:04.472307] [INFO ] [REMOTE ] GWW: Full fetch complete (29304 records). [2025-09-26T19:11:04.472413] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-09-26T19:11:04.765345] [INFO ] [REMOTE ] HAE: Fetching primary data for 2024-12. [2025-09-26T19:11:04.911108] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-09-26T19:11:04.911242] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-09-26T19:11:04.912101] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-09-26T19:11:04.912178] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-09-26T19:11:04.913632] [DEBUG] [LOCAL ] GWW: Trimmed 29304 records to 20108 (keeping 200 days of data) [2025-09-26T19:11:05.053933] [DEBUG] [LOCAL ] GWW: Primary data saved (20108 records). [2025-09-26T19:11:05.054133] [INFO ] [MAIN ] GWW: Full history saved. [2025-09-26T19:11:05.054267] [INFO ] [MAIN ] Update Progress: 989/2371 symbols completed. GWW took 29.1s. Estimated remaining: 3h 3m 6s. Rate: 7.5 symbols/min [2025-09-26T19:11:05.290072] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:11:05.337510] [DEBUG] [LOCAL ] HAFN: Loaded 43874 existing records from primary storage. [2025-09-26T19:11:05.337752] [INFO ] [MAIN ] HAFN: Loaded 43874 existing records. [2025-09-26T19:11:05.526820] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:11:05.527520] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-09-26T19:11:05.527732] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-09-26T19:11:05.528999] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-09-26T19:11:05.529069] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-09-26T19:11:05.560969] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-09-26T19:11:05.730505] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-26T19:11:05.957529] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:11:06.356768] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2024-12. [2025-09-26T19:11:06.451282] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-26T19:11:07.156723] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-09-26T19:11:07.197732] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-26T19:11:07.956736] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-09-26T19:11:08.217452] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-26T19:11:08.645091] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-26T19:11:08.756748] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-09-26T19:11:09.556743] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-09-26T19:11:09.602461] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-26T19:11:10.356724] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-09-26T19:11:10.418908] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-26T19:11:11.156874] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-09-26T19:11:11.489855] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-26T19:11:11.956741] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-09-26T19:11:11.995927] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-26T19:11:12.755412] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-26T19:11:12.764548] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-09-26T19:11:13.414390] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-26T19:11:13.556740] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-09-26T19:11:14.082098] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-26T19:11:14.356762] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-09-26T19:11:15.156770] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-09-26T19:11:15.294732] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-26T19:11:15.956751] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-09-26T19:11:16.014247] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-26T19:11:16.028802] [INFO ] [REMOTE ] GXO: Full fetch complete (70006 records). [2025-09-26T19:11:16.029044] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-09-26T19:11:16.471761] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-09-26T19:11:16.471865] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-09-26T19:11:16.472782] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-09-26T19:11:16.472897] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-09-26T19:11:16.477540] [DEBUG] [LOCAL ] GXO: Trimmed 70006 records to 48260 (keeping 200 days of data) [2025-09-26T19:11:16.761864] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-09-26T19:11:16.799919] [DEBUG] [LOCAL ] GXO: Primary data saved (48260 records). [2025-09-26T19:11:16.800093] [INFO ] [MAIN ] GXO: Full history saved. [2025-09-26T19:11:16.800393] [INFO ] [MAIN ] Update Progress: 990/2371 symbols completed. GXO took 38.4s. Estimated remaining: 3h 3m 3s. Rate: 7.5 symbols/min [2025-09-26T19:11:16.996242] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:11:17.061479] [DEBUG] [LOCAL ] HAL: Loaded 54108 existing records from primary storage. [2025-09-26T19:11:17.061762] [INFO ] [MAIN ] HAL: Loaded 54108 existing records. [2025-09-26T19:11:17.287026] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:11:17.303266] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-09-26T19:11:17.303489] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-09-26T19:11:17.306727] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-09-26T19:11:17.307354] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-09-26T19:11:17.378969] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-26T19:11:17.564087] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-09-26T19:11:17.719726] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-26T19:11:17.803415] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:11:17.838569] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-26T19:11:18.356777] [INFO ] [REMOTE ] HAL: Fetching primary data for 2024-12. [2025-09-26T19:11:19.037150] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T19:11:19.156741] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-09-26T19:11:19.956709] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-09-26T19:11:20.396326] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-26T19:11:20.756743] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-09-26T19:11:20.829818] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-26T19:11:21.404432] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-26T19:11:21.556736] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-09-26T19:11:22.198811] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-26T19:11:22.356757] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-09-26T19:11:23.156713] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-09-26T19:11:23.573014] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-26T19:11:23.716351] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-26T19:11:23.956742] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-09-26T19:11:24.756786] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-09-26T19:11:24.886483] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-26T19:11:25.394027] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-26T19:11:25.556734] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-09-26T19:11:26.168783] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-26T19:11:26.356797] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-09-26T19:11:27.003852] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-26T19:11:27.156750] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-09-26T19:11:27.956768] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-09-26T19:11:28.207885] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-26T19:11:28.707527] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-26T19:11:28.756726] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-09-26T19:11:29.556698] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-09-26T19:11:29.606498] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-26T19:11:30.356734] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-09-26T19:11:30.694668] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-26T19:11:31.156763] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-09-26T19:11:31.283260] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-26T19:11:31.294018] [INFO ] [REMOTE ] H: Full fetch complete (61875 records). [2025-09-26T19:11:31.294194] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-09-26T19:11:31.752333] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-09-26T19:11:31.752478] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-09-26T19:11:31.753463] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-09-26T19:11:31.753560] [DEBUG] [LOCAL ] H: Saving primary data. [2025-09-26T19:11:31.755317] [DEBUG] [LOCAL ] H: Trimmed 61875 records to 45492 (keeping 200 days of data) [2025-09-26T19:11:31.974126] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-09-26T19:11:32.025691] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-26T19:11:32.105078] [DEBUG] [LOCAL ] H: Primary data saved (45492 records). [2025-09-26T19:11:32.105221] [INFO ] [MAIN ] H: Full history saved. [2025-09-26T19:11:32.105311] [INFO ] [MAIN ] Update Progress: 991/2371 symbols completed. H took 40.1s. Estimated remaining: 3h 3m 6s. Rate: 7.5 symbols/min [2025-09-26T19:11:32.288091] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:11:32.350795] [DEBUG] [LOCAL ] HASI: Loaded 47537 existing records from primary storage. [2025-09-26T19:11:32.350989] [INFO ] [MAIN ] HASI: Loaded 47537 existing records. [2025-09-26T19:11:32.535787] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:11:32.536067] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-09-26T19:11:32.536134] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-09-26T19:11:32.537825] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-09-26T19:11:32.537918] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-09-26T19:11:32.769880] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-09-26T19:11:32.913861] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:11:33.268076] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-26T19:11:33.556726] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-09-26T19:11:33.674725] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-26T19:11:33.684892] [INFO ] [REMOTE ] HAE: Full fetch complete (58009 records). [2025-09-26T19:11:33.685061] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-09-26T19:11:34.109827] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-09-26T19:11:34.109937] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-09-26T19:11:34.110760] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-09-26T19:11:34.110825] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-09-26T19:11:34.113289] [DEBUG] [LOCAL ] HAE: Trimmed 58009 records to 40176 (keeping 200 days of data) [2025-09-26T19:11:34.358603] [INFO ] [REMOTE ] HASI: Fetching primary data for 2024-12. [2025-09-26T19:11:34.371714] [DEBUG] [LOCAL ] HAE: Primary data saved (40176 records). [2025-09-26T19:11:34.371848] [INFO ] [MAIN ] HAE: Full history saved. [2025-09-26T19:11:34.371958] [INFO ] [MAIN ] Update Progress: 992/2371 symbols completed. HAE took 32.6s. Estimated remaining: 3h 2m 50s. Rate: 7.5 symbols/min [2025-09-26T19:11:34.577990] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:11:34.604034] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-26T19:11:34.615064] [INFO ] [REMOTE ] HAFN: Full fetch complete (65816 records). [2025-09-26T19:11:34.615230] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-09-26T19:11:34.902556] [DEBUG] [LOCAL ] HAYW: Loaded 49080 existing records from primary storage. [2025-09-26T19:11:34.935160] [INFO ] [MAIN ] HAYW: Loaded 49080 existing records. [2025-09-26T19:11:35.273940] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-09-26T19:11:35.290784] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-09-26T19:11:35.295672] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-09-26T19:11:35.295824] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:11:35.295955] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-09-26T19:11:35.296510] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-09-26T19:11:35.296580] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-09-26T19:11:35.298011] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-09-26T19:11:35.298313] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-09-26T19:11:35.298172] [DEBUG] [LOCAL ] HAFN: Trimmed 65816 records to 44189 (keeping 200 days of data) [2025-09-26T19:11:35.823184] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:11:35.825826] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2024-12. [2025-09-26T19:11:35.863612] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-26T19:11:35.974092] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-09-26T19:11:36.017129] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-26T19:11:36.075539] [DEBUG] [LOCAL ] HAFN: Primary data saved (44189 records). [2025-09-26T19:11:36.075709] [INFO ] [MAIN ] HAFN: Full history saved. [2025-09-26T19:11:36.076748] [INFO ] [MAIN ] Update Progress: 993/2371 symbols completed. HAFN took 31.0s. Estimated remaining: 3h 2m 33s. Rate: 7.5 symbols/min [2025-09-26T19:11:36.258059] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:11:36.268832] [DEBUG] [LOCAL ] HBB: Loaded 6893 existing records from primary storage. [2025-09-26T19:11:36.268968] [INFO ] [MAIN ] HBB: Loaded 6893 existing records. [2025-09-26T19:11:36.459813] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:11:36.460121] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-09-26T19:11:36.460174] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-09-26T19:11:36.460481] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-09-26T19:11:36.460545] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-09-26T19:11:36.758830] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-09-26T19:11:36.847210] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:11:37.021011] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-26T19:11:37.556717] [INFO ] [REMOTE ] HBB: Fetching primary data for 2024-12. [2025-09-26T19:11:37.932512] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-26T19:11:38.321453] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-26T19:11:38.356677] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-09-26T19:11:38.427446] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-26T19:11:39.156738] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-09-26T19:11:39.840975] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-26T19:11:39.956717] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-09-26T19:11:40.756732] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-09-26T19:11:40.965165] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-26T19:11:41.556753] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-09-26T19:11:42.042401] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-26T19:11:42.182186] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-26T19:11:42.338311] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-26T19:11:42.356677] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-09-26T19:11:43.156739] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-09-26T19:11:43.861351] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-26T19:11:43.956731] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-09-26T19:11:44.027153] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-26T19:11:44.756765] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-09-26T19:11:45.550839] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-26T19:11:45.561715] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-09-26T19:11:46.356767] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-09-26T19:11:46.482517] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-26T19:11:46.797411] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-26T19:11:47.156737] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-09-26T19:11:47.961860] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-09-26T19:11:47.975695] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-26T19:11:48.756756] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-09-26T19:11:49.192635] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-26T19:11:49.203839] [INFO ] [REMOTE ] HAL: Full fetch complete (77766 records). [2025-09-26T19:11:49.204016] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-09-26T19:11:49.419207] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-26T19:11:49.559169] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-09-26T19:11:49.710582] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-09-26T19:11:49.710746] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-09-26T19:11:49.712022] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-09-26T19:11:49.712188] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-09-26T19:11:49.714429] [DEBUG] [LOCAL ] HAL: Trimmed 77766 records to 54498 (keeping 200 days of data) [2025-09-26T19:11:49.850792] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-26T19:11:50.103936] [DEBUG] [LOCAL ] HAL: Primary data saved (54498 records). [2025-09-26T19:11:50.104090] [INFO ] [MAIN ] HAL: Full history saved. [2025-09-26T19:11:50.104223] [INFO ] [MAIN ] Update Progress: 994/2371 symbols completed. HAL took 33.3s. Estimated remaining: 3h 2m 34s. Rate: 7.5 symbols/min [2025-09-26T19:11:50.295355] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:11:50.347847] [DEBUG] [LOCAL ] HBI: Loaded 53387 existing records from primary storage. [2025-09-26T19:11:50.348002] [INFO ] [MAIN ] HBI: Loaded 53387 existing records. [2025-09-26T19:11:50.361839] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-09-26T19:11:50.467802] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-26T19:11:50.559715] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:11:50.560066] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-09-26T19:11:50.560124] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-09-26T19:11:50.561531] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-09-26T19:11:50.561620] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-09-26T19:11:50.940194] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:11:51.156730] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-09-26T19:11:51.746392] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-26T19:11:51.956722] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-09-26T19:11:52.185638] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-26T19:11:52.756743] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-09-26T19:11:53.565342] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-09-26T19:11:53.571519] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-26T19:11:54.336455] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-26T19:11:54.356678] [INFO ] [REMOTE ] HBI: Fetching primary data for 2024-12. [2025-09-26T19:11:54.387104] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-26T19:11:55.156745] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-09-26T19:11:55.956703] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-09-26T19:11:56.122948] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-26T19:11:56.760259] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-09-26T19:11:56.766968] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-26T19:11:57.042266] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-26T19:11:57.556738] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-09-26T19:11:58.278539] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-26T19:11:58.356748] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-09-26T19:11:58.468038] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-26T19:11:59.156723] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-09-26T19:11:59.956726] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-09-26T19:12:00.166564] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-26T19:12:00.756732] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-09-26T19:12:01.057933] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-26T19:12:01.502260] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-26T19:12:01.503684] [INFO ] [REMOTE ] HBB: Full fetch complete (9796 records). [2025-09-26T19:12:01.503872] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-09-26T19:12:01.577756] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-09-26T19:12:01.846074] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-26T19:12:01.986195] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-09-26T19:12:01.986289] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-09-26T19:12:01.986553] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-09-26T19:12:01.986596] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-09-26T19:12:01.987234] [DEBUG] [LOCAL ] HBB: Trimmed 9796 records to 6912 (keeping 200 days of data) [2025-09-26T19:12:02.035950] [DEBUG] [LOCAL ] HBB: Primary data saved (6912 records). [2025-09-26T19:12:02.036105] [INFO ] [MAIN ] HBB: Full history saved. [2025-09-26T19:12:02.036211] [INFO ] [MAIN ] Update Progress: 995/2371 symbols completed. HBB took 26.0s. Estimated remaining: 3h 2m 31s. Rate: 7.5 symbols/min [2025-09-26T19:12:02.215870] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:12:02.277227] [DEBUG] [LOCAL ] HBM: Loaded 53293 existing records from primary storage. [2025-09-26T19:12:02.277407] [INFO ] [MAIN ] HBM: Loaded 53293 existing records. [2025-09-26T19:12:02.361815] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-09-26T19:12:02.471247] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:12:02.471575] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-09-26T19:12:02.471634] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-09-26T19:12:02.473116] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-09-26T19:12:02.473183] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-09-26T19:12:02.856588] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:12:03.156700] [INFO ] [REMOTE ] HBM: Fetching primary data for 2024-12. [2025-09-26T19:12:03.284757] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-26T19:12:03.294729] [INFO ] [REMOTE ] HASI: Full fetch complete (68016 records). [2025-09-26T19:12:03.294882] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-09-26T19:12:03.752118] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-09-26T19:12:03.752309] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-09-26T19:12:03.753254] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-09-26T19:12:03.753335] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-09-26T19:12:03.754961] [DEBUG] [LOCAL ] HASI: Trimmed 68016 records to 47868 (keeping 200 days of data) [2025-09-26T19:12:03.974421] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-09-26T19:12:04.030541] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-26T19:12:04.105943] [DEBUG] [LOCAL ] HASI: Primary data saved (47868 records). [2025-09-26T19:12:04.106093] [INFO ] [MAIN ] HASI: Full history saved. [2025-09-26T19:12:04.106198] [INFO ] [MAIN ] Update Progress: 996/2371 symbols completed. HASI took 32.0s. Estimated remaining: 3h 2m 15s. Rate: 7.5 symbols/min [2025-09-26T19:12:04.284974] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:12:04.336824] [DEBUG] [LOCAL ] HCA: Loaded 47438 existing records from primary storage. [2025-09-26T19:12:04.337031] [INFO ] [MAIN ] HCA: Loaded 47438 existing records. [2025-09-26T19:12:04.559377] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:12:04.559807] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-09-26T19:12:04.559940] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-09-26T19:12:04.561244] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-09-26T19:12:04.561309] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-09-26T19:12:04.761921] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-09-26T19:12:04.970898] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:12:05.002520] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-26T19:12:05.556702] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-09-26T19:12:05.756057] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-26T19:12:06.356705] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-09-26T19:12:06.571766] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-26T19:12:06.582452] [INFO ] [REMOTE ] HAYW: Full fetch complete (70956 records). [2025-09-26T19:12:06.582638] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-09-26T19:12:06.999459] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-09-26T19:12:06.999565] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-09-26T19:12:07.000551] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-09-26T19:12:07.000625] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-09-26T19:12:07.002468] [DEBUG] [LOCAL ] HAYW: Trimmed 70956 records to 49444 (keeping 200 days of data) [2025-09-26T19:12:07.173279] [INFO ] [REMOTE ] HCA: Fetching primary data for 2024-12. [2025-09-26T19:12:07.323706] [DEBUG] [LOCAL ] HAYW: Primary data saved (49444 records). [2025-09-26T19:12:07.334233] [INFO ] [MAIN ] HAYW: Full history saved. [2025-09-26T19:12:07.336188] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-26T19:12:07.335071] [INFO ] [MAIN ] Update Progress: 997/2371 symbols completed. HAYW took 33.0s. Estimated remaining: 3h 2m 1s. Rate: 7.5 symbols/min [2025-09-26T19:12:07.732347] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-26T19:12:07.956791] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-09-26T19:12:08.530197] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-26T19:12:08.756766] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-09-26T19:12:09.556717] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-09-26T19:12:09.729262] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-26T19:12:10.356702] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-09-26T19:12:10.638489] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-26T19:12:11.156699] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-09-26T19:12:11.298332] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-26T19:12:11.956732] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-09-26T19:12:12.193304] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-26T19:12:12.756694] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-09-26T19:12:12.939106] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-26T19:12:13.556847] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-09-26T19:12:13.794615] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-26T19:12:14.356755] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-09-26T19:12:14.640765] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-26T19:12:15.156694] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-09-26T19:12:15.381622] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-26T19:12:15.956714] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-09-26T19:12:16.131783] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-26T19:12:16.756731] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-09-26T19:12:17.137606] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-26T19:12:17.564861] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-09-26T19:12:17.571194] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-26T19:12:18.356739] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-09-26T19:12:18.538734] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-26T19:12:19.156786] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-09-26T19:12:19.371046] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-26T19:12:19.382072] [INFO ] [REMOTE ] HBI: Full fetch complete (76890 records). [2025-09-26T19:12:19.382248] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-09-26T19:12:19.820161] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-09-26T19:12:19.820317] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-09-26T19:12:19.821384] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-09-26T19:12:19.821540] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-09-26T19:12:19.823355] [DEBUG] [LOCAL ] HBI: Trimmed 76890 records to 53769 (keeping 200 days of data) [2025-09-26T19:12:20.185425] [DEBUG] [LOCAL ] HBI: Primary data saved (53769 records). [2025-09-26T19:12:20.185713] [INFO ] [MAIN ] HBI: Full history saved. [2025-09-26T19:12:20.186202] [INFO ] [MAIN ] Update Progress: 998/2371 symbols completed. HBI took 30.1s. Estimated remaining: 3h 1m 60s. Rate: 7.5 symbols/min [2025-09-26T19:12:20.187954] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-26T19:12:20.199080] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-09-26T19:12:20.931869] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-26T19:12:20.943885] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-09-26T19:12:21.856302] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-26T19:12:21.866813] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-09-26T19:12:22.843251] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-26T19:12:22.856139] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-09-26T19:12:23.250716] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-26T19:12:23.262078] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-09-26T19:12:24.554898] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-26T19:12:24.567236] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-09-26T19:12:25.036168] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-26T19:12:25.051163] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-09-26T19:12:26.981193] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-09-26T19:12:26.992513] [INFO ] [REMOTE ] HBM: Full fetch complete (76165 records). [2025-09-26T19:12:26.992703] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-09-26T19:12:27.294970] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-26T19:12:27.355571] [INFO ] [REMOTE ] HCA: Full fetch complete (68996 records). [2025-09-26T19:12:27.366545] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-09-26T19:12:27.578181] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-09-26T19:12:27.578579] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-09-26T19:12:27.579625] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-09-26T19:12:27.585141] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-09-26T19:12:27.641878] [DEBUG] [LOCAL ] HBM: Trimmed 76165 records to 53683 (keeping 200 days of data) [2025-09-26T19:12:27.998365] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-09-26T19:12:27.998791] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-09-26T19:12:28.000496] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-09-26T19:12:28.000583] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-09-26T19:12:28.020326] [DEBUG] [LOCAL ] HCA: Trimmed 68996 records to 47781 (keeping 200 days of data) [2025-09-26T19:12:28.562839] [DEBUG] [LOCAL ] HCA: Primary data saved (47781 records). [2025-09-26T19:12:28.563529] [INFO ] [MAIN ] HCA: Full history saved. [2025-09-26T19:12:28.563954] [INFO ] [MAIN ] Update Progress: 999/2371 symbols completed. HCA took 24.5s. Estimated remaining: 3h 1m 52s. Rate: 7.5 symbols/min [2025-09-26T19:12:28.571466] [DEBUG] [LOCAL ] HBM: Primary data saved (53683 records). [2025-09-26T19:12:28.571551] [INFO ] [MAIN ] HBM: Full history saved. [2025-09-26T19:12:28.572054] [INFO ] [MAIN ] Update Progress: 1000/2371 symbols completed. HBM took 26.5s. Estimated remaining: 3h 1m 33s. Rate: 7.6 symbols/min [2025-09-26T19:12:29.228775] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:12:29.259823] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:12:29.264185] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:12:29.276314] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-09-26T19:12:29.282181] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-09-26T19:12:29.287911] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-09-26T19:12:29.312791] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-26T19:12:29.347615] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:12:29.347932] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-26T19:12:29.348106] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-09-26T19:12:29.486908] [DEBUG] [LOCAL ] HCI: Loaded 13999 existing records from primary storage. [2025-09-26T19:12:29.487401] [INFO ] [MAIN ] HCI: Loaded 13999 existing records. [2025-09-26T19:12:29.716754] [DEBUG] [LOCAL ] HCC: Loaded 45714 existing records from primary storage. [2025-09-26T19:12:29.779964] [INFO ] [MAIN ] HCC: Loaded 45714 existing records. [2025-09-26T19:12:30.038587] [DEBUG] [LOCAL ] HD: Loaded 53902 existing records from primary storage. [2025-09-26T19:12:30.084571] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:12:30.080605] [INFO ] [MAIN ] HD: Loaded 53902 existing records. [2025-09-26T19:12:30.174888] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-09-26T19:12:30.224148] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-09-26T19:12:30.196317] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:12:30.285293] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-09-26T19:12:30.309049] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-09-26T19:12:30.245817] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-12. [2025-09-26T19:12:30.405423] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:12:30.496162] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-09-26T19:12:30.518297] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-09-26T19:12:30.518440] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:12:30.539315] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-09-26T19:12:30.550673] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-09-26T19:12:30.550610] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-09-26T19:12:30.561336] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-09-26T19:12:30.608206] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-09-26T19:12:30.626745] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-09-26T19:12:31.038461] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-26T19:12:31.128574] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-09-26T19:12:31.537542] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:12:31.552246] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-26T19:12:31.572427] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-09-26T19:12:31.584744] [INFO ] [REMOTE ] HCI: Fetching primary data for 2024-12. [2025-09-26T19:12:31.671297] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:12:31.709246] [INFO ] [REMOTE ] HCC: Fetching primary data for 2024-12. [2025-09-26T19:12:31.713290] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:12:31.714805] [INFO ] [REMOTE ] HD: Fetching primary data for 2024-12. [2025-09-26T19:12:32.013134] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-26T19:12:32.014085] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-09-26T19:12:32.634712] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-26T19:12:32.635875] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-09-26T19:12:32.646711] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-26T19:12:32.650908] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-09-26T19:12:32.900595] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-09-26T19:12:32.901515] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-09-26T19:12:33.151219] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-09-26T19:12:33.243503] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-26T19:12:33.498628] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-26T19:12:33.556716] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-09-26T19:12:33.752549] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-26T19:12:34.356757] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-09-26T19:12:35.092812] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-26T19:12:35.156735] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-09-26T19:12:35.214291] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-26T19:12:35.956736] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-09-26T19:12:36.281166] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-26T19:12:36.756787] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-09-26T19:12:36.986256] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-09-26T19:12:37.055325] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-26T19:12:37.556728] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-09-26T19:12:38.356765] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-09-26T19:12:38.646598] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-26T19:12:39.156773] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-09-26T19:12:39.541042] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-26T19:12:39.541864] [INFO ] [REMOTE ] HCXY: Full fetch complete (592 records). [2025-09-26T19:12:39.542109] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-09-26T19:12:39.542614] [FATAL] [VALIDATOR ] HCXY: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T19:12:39.542720] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:12:39.542841] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:12:39.542914] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-26T19:12:39.542980] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-26T19:12:39.543016] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-09-26T19:12:39.543072] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-09-26T19:12:39.543184] [INFO ] [MAIN ] Update Progress: 1001/2371 symbols completed. HCXY took 11.0s. Estimated remaining: 3h 1m 29s. Rate: 7.5 symbols/min [2025-09-26T19:12:39.730897] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:12:39.762607] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-09-26T19:12:39.820335] [DEBUG] [LOCAL ] HDB: Loaded 52305 existing records from primary storage. [2025-09-26T19:12:39.820518] [INFO ] [MAIN ] HDB: Loaded 52305 existing records. [2025-09-26T19:12:39.964925] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-09-26T19:12:40.010039] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:12:40.010304] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-09-26T19:12:40.010353] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-09-26T19:12:40.012270] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-09-26T19:12:40.012334] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-09-26T19:12:40.399091] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:12:40.756740] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-09-26T19:12:41.556721] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-09-26T19:12:41.651552] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-26T19:12:41.913898] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-26T19:12:42.356751] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-09-26T19:12:43.156768] [INFO ] [REMOTE ] HDB: Fetching primary data for 2024-12. [2025-09-26T19:12:43.594567] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-26T19:12:43.956750] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-09-26T19:12:44.118146] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-26T19:12:44.756724] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-09-26T19:12:44.865200] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-26T19:12:45.019946] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-26T19:12:45.556729] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-09-26T19:12:46.356741] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-09-26T19:12:47.156755] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-09-26T19:12:47.239266] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-26T19:12:47.298863] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-09-26T19:12:47.320761] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-26T19:12:47.956739] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-09-26T19:12:48.649167] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T19:12:48.756749] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-09-26T19:12:48.959694] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-26T19:12:49.556736] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-09-26T19:12:50.356765] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-09-26T19:12:50.987200] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-26T19:12:51.156741] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-09-26T19:12:51.240267] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-26T19:12:51.289421] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-26T19:12:51.956763] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-09-26T19:12:52.756718] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-09-26T19:12:52.965021] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-26T19:12:53.327138] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-26T19:12:53.556737] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-09-26T19:12:54.083445] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-26T19:12:54.356731] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-09-26T19:12:55.156935] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-09-26T19:12:55.349892] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-26T19:12:55.638145] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-26T19:12:55.956743] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-09-26T19:12:56.209915] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-26T19:12:56.213727] [INFO ] [REMOTE ] HCI: Full fetch complete (19377 records). [2025-09-26T19:12:56.213938] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-09-26T19:12:56.613938] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-09-26T19:12:56.614052] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-09-26T19:12:56.614738] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-09-26T19:12:56.614830] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-09-26T19:12:56.615569] [DEBUG] [LOCAL ] HCI: Trimmed 19377 records to 14126 (keeping 200 days of data) [2025-09-26T19:12:56.711579] [DEBUG] [LOCAL ] HCI: Primary data saved (14126 records). [2025-09-26T19:12:56.711823] [INFO ] [MAIN ] HCI: Full history saved. [2025-09-26T19:12:56.711951] [INFO ] [MAIN ] Update Progress: 1002/2371 symbols completed. HCI took 28.1s. Estimated remaining: 3h 1m 34s. Rate: 7.5 symbols/min [2025-09-26T19:12:56.768952] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-09-26T19:12:56.900594] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:12:56.950282] [DEBUG] [LOCAL ] HE: Loaded 49539 existing records from primary storage. [2025-09-26T19:12:56.950444] [INFO ] [MAIN ] HE: Loaded 49539 existing records. [2025-09-26T19:12:57.139365] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:12:57.139705] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-09-26T19:12:57.139761] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-09-26T19:12:57.141318] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-09-26T19:12:57.141379] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-09-26T19:12:57.521715] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:12:57.557639] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-09-26T19:12:57.561327] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-26T19:12:58.356713] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-09-26T19:12:58.821970] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-26T19:12:59.156705] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-09-26T19:12:59.693509] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-26T19:12:59.733905] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-26T19:12:59.956774] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-09-26T19:13:00.756727] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-09-26T19:13:00.878179] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-26T19:13:01.556783] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-09-26T19:13:02.131779] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-26T19:13:02.278002] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-26T19:13:02.287146] [INFO ] [REMOTE ] HCC: Full fetch complete (64386 records). [2025-09-26T19:13:02.287285] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-09-26T19:13:02.361793] [INFO ] [REMOTE ] HE: Fetching primary data for 2024-12. [2025-09-26T19:13:02.712399] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-09-26T19:13:02.712520] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-09-26T19:13:02.713463] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-09-26T19:13:02.713547] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-09-26T19:13:02.715188] [DEBUG] [LOCAL ] HCC: Trimmed 64386 records to 46057 (keeping 200 days of data) [2025-09-26T19:13:02.971544] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-26T19:13:03.045350] [DEBUG] [LOCAL ] HCC: Primary data saved (46057 records). [2025-09-26T19:13:03.045505] [INFO ] [MAIN ] HCC: Full history saved. [2025-09-26T19:13:03.045600] [INFO ] [MAIN ] Update Progress: 1003/2371 symbols completed. HCC took 34.5s. Estimated remaining: 3h 1m 24s. Rate: 7.5 symbols/min [2025-09-26T19:13:03.161896] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-09-26T19:13:03.225273] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:13:03.259681] [DEBUG] [LOCAL ] HEI: Loaded 32653 existing records from primary storage. [2025-09-26T19:13:03.259825] [INFO ] [MAIN ] HEI: Loaded 32653 existing records. [2025-09-26T19:13:03.449217] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:13:03.449520] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-09-26T19:13:03.449576] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-09-26T19:13:03.450509] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-09-26T19:13:03.450586] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-09-26T19:13:03.830043] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:13:03.956729] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-09-26T19:13:04.108125] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-26T19:13:04.756733] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-09-26T19:13:05.446934] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-26T19:13:05.457820] [INFO ] [REMOTE ] HD: Full fetch complete (77445 records). [2025-09-26T19:13:05.457995] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-09-26T19:13:05.559605] [INFO ] [REMOTE ] HEI: Fetching primary data for 2024-12. [2025-09-26T19:13:05.818596] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-26T19:13:05.963128] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-09-26T19:13:05.963218] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-09-26T19:13:05.964205] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-09-26T19:13:05.964275] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-09-26T19:13:05.966020] [DEBUG] [LOCAL ] HD: Trimmed 77445 records to 54283 (keeping 200 days of data) [2025-09-26T19:13:06.323341] [DEBUG] [LOCAL ] HD: Primary data saved (54283 records). [2025-09-26T19:13:06.323500] [INFO ] [MAIN ] HD: Full history saved. [2025-09-26T19:13:06.324333] [INFO ] [MAIN ] Update Progress: 1004/2371 symbols completed. HD took 37.8s. Estimated remaining: 3h 1m 10s. Rate: 7.5 symbols/min [2025-09-26T19:13:06.356856] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-09-26T19:13:06.525716] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:13:06.565866] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-26T19:13:06.581613] [DEBUG] [LOCAL ] HEQ: Loaded 6173 existing records from primary storage. [2025-09-26T19:13:06.581904] [INFO ] [MAIN ] HEQ: Loaded 6173 existing records. [2025-09-26T19:13:06.765636] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:13:06.766060] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-09-26T19:13:06.766111] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-09-26T19:13:06.766539] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-09-26T19:13:06.766614] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-09-26T19:13:07.169744] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-09-26T19:13:07.174554] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:13:07.385022] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-26T19:13:07.956701] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-09-26T19:13:08.112392] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-26T19:13:08.756721] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-09-26T19:13:09.325199] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-26T19:13:09.423859] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-26T19:13:09.556757] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-09-26T19:13:10.356737] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-09-26T19:13:10.641118] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-26T19:13:10.652192] [INFO ] [REMOTE ] HDB: Full fetch complete (75250 records). [2025-09-26T19:13:10.652400] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-09-26T19:13:11.141330] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-09-26T19:13:11.141502] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-09-26T19:13:11.142574] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-09-26T19:13:11.142682] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-09-26T19:13:11.144458] [DEBUG] [LOCAL ] HDB: Trimmed 75250 records to 52695 (keeping 200 days of data) [2025-09-26T19:13:11.207415] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2024-12. [2025-09-26T19:13:11.361772] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-26T19:13:11.650085] [DEBUG] [LOCAL ] HDB: Primary data saved (52695 records). [2025-09-26T19:13:11.650386] [INFO ] [MAIN ] HDB: Full history saved. [2025-09-26T19:13:11.650829] [INFO ] [MAIN ] Update Progress: 1005/2371 symbols completed. HDB took 32.1s. Estimated remaining: 3h 0m 58s. Rate: 7.5 symbols/min [2025-09-26T19:13:11.948105] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:13:11.956805] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-09-26T19:13:11.970632] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-26T19:13:12.044483] [DEBUG] [LOCAL ] HESM: Loaded 48522 existing records from primary storage. [2025-09-26T19:13:12.044885] [INFO ] [MAIN ] HESM: Loaded 48522 existing records. [2025-09-26T19:13:12.296943] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:13:12.297565] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-09-26T19:13:12.297777] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-09-26T19:13:12.299485] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-09-26T19:13:12.299580] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-09-26T19:13:12.449723] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-26T19:13:12.750763] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:13:12.756688] [INFO ] [REMOTE ] HESM: Fetching primary data for 2024-12. [2025-09-26T19:13:13.480433] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T19:13:13.556745] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-09-26T19:13:14.356771] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-09-26T19:13:14.630978] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-26T19:13:15.053148] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-26T19:13:15.146096] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-26T19:13:15.156680] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-09-26T19:13:15.956706] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-09-26T19:13:16.021406] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-26T19:13:16.756747] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-09-26T19:13:17.508686] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T19:13:17.556711] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-09-26T19:13:18.356756] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-09-26T19:13:18.749939] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-26T19:13:19.101660] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-26T19:13:19.127555] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-26T19:13:19.156676] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-09-26T19:13:19.956764] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-09-26T19:13:20.740501] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-26T19:13:20.756679] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-09-26T19:13:21.560351] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-09-26T19:13:21.567539] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-26T19:13:22.318213] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-26T19:13:22.356712] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-09-26T19:13:22.419829] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-26T19:13:23.156782] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-09-26T19:13:23.736631] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-26T19:13:23.956764] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-09-26T19:13:24.561358] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-26T19:13:24.756731] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-09-26T19:13:24.785446] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T19:13:25.556734] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-09-26T19:13:26.011514] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-26T19:13:26.356749] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-09-26T19:13:26.886523] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-26T19:13:27.156728] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-09-26T19:13:27.678921] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-26T19:13:27.956721] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-09-26T19:13:28.756717] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-09-26T19:13:29.140544] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-26T19:13:29.556701] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-09-26T19:13:29.712810] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-26T19:13:30.136984] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-26T19:13:30.143565] [INFO ] [REMOTE ] HEI: Full fetch complete (48936 records). [2025-09-26T19:13:30.143703] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-09-26T19:13:30.260048] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-26T19:13:30.361980] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-09-26T19:13:30.561665] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-09-26T19:13:30.561758] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-09-26T19:13:30.562478] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-09-26T19:13:30.562541] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-09-26T19:13:30.564539] [DEBUG] [LOCAL ] HEI: Trimmed 48936 records to 32846 (keeping 200 days of data) [2025-09-26T19:13:30.787988] [DEBUG] [LOCAL ] HEI: Primary data saved (32846 records). [2025-09-26T19:13:30.788168] [INFO ] [MAIN ] HEI: Full history saved. [2025-09-26T19:13:30.788315] [INFO ] [MAIN ] Update Progress: 1006/2371 symbols completed. HEI took 27.7s. Estimated remaining: 3h 1m 5s. Rate: 7.5 symbols/min [2025-09-26T19:13:30.966376] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:13:30.966561] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-09-26T19:13:30.966620] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-09-26T19:13:30.966818] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-09-26T19:13:30.966864] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-26T19:13:30.966907] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-26T19:13:30.966942] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-09-26T19:13:31.157556] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-09-26T19:13:31.353269] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:13:31.956752] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-09-26T19:13:32.419750] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-26T19:13:32.432802] [INFO ] [REMOTE ] HE: Full fetch complete (72435 records). [2025-09-26T19:13:32.432960] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-09-26T19:13:32.670167] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-26T19:13:32.758246] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-09-26T19:13:32.926702] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-09-26T19:13:32.927227] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-09-26T19:13:32.928272] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-09-26T19:13:32.928377] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-09-26T19:13:32.930408] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-26T19:13:32.943878] [DEBUG] [LOCAL ] HE: Trimmed 72435 records to 49870 (keeping 200 days of data) [2025-09-26T19:13:33.269482] [DEBUG] [LOCAL ] HE: Primary data saved (49870 records). [2025-09-26T19:13:33.269717] [INFO ] [MAIN ] HE: Full history saved. [2025-09-26T19:13:33.269871] [INFO ] [MAIN ] Update Progress: 1007/2371 symbols completed. HE took 36.6s. Estimated remaining: 3h 0m 50s. Rate: 7.5 symbols/min [2025-09-26T19:13:33.466104] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:13:33.466326] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-09-26T19:13:33.466384] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-09-26T19:13:33.466530] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-09-26T19:13:33.466588] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-26T19:13:33.466682] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-26T19:13:33.466737] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-09-26T19:13:33.561806] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-12. [2025-09-26T19:13:33.754605] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-26T19:13:33.776015] [INFO ] [REMOTE ] HEQ: Full fetch complete (9140 records). [2025-09-26T19:13:33.788874] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-09-26T19:13:33.985044] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:13:34.010518] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-26T19:13:34.266209] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-09-26T19:13:34.266340] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-09-26T19:13:34.266836] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-09-26T19:13:34.266902] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-09-26T19:13:34.267509] [DEBUG] [LOCAL ] HEQ: Trimmed 9140 records to 6236 (keeping 200 days of data) [2025-09-26T19:13:34.317397] [DEBUG] [LOCAL ] HEQ: Primary data saved (6236 records). [2025-09-26T19:13:34.317621] [INFO ] [MAIN ] HEQ: Full history saved. [2025-09-26T19:13:34.317815] [INFO ] [MAIN ] Update Progress: 1008/2371 symbols completed. HEQ took 28.0s. Estimated remaining: 3h 0m 33s. Rate: 7.5 symbols/min [2025-09-26T19:13:34.361940] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-12. [2025-09-26T19:13:34.510789] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:13:34.537928] [DEBUG] [LOCAL ] HFRO: Loaded 17616 existing records from primary storage. [2025-09-26T19:13:34.538125] [INFO ] [MAIN ] HFRO: Loaded 17616 existing records. [2025-09-26T19:13:34.727886] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:13:34.728264] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-09-26T19:13:34.728317] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-09-26T19:13:34.729041] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-09-26T19:13:34.729107] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-09-26T19:13:35.013086] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-26T19:13:35.136710] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:13:35.156684] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2024-12. [2025-09-26T19:13:35.956745] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-09-26T19:13:36.280773] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-26T19:13:36.313558] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-26T19:13:36.756735] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-09-26T19:13:37.195111] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-26T19:13:37.556741] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-09-26T19:13:38.356729] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-09-26T19:13:38.684046] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-26T19:13:39.107549] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-26T19:13:39.156721] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-09-26T19:13:39.956731] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-09-26T19:13:40.756751] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-09-26T19:13:41.055049] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-26T19:13:41.109418] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-26T19:13:41.115249] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-26T19:13:41.556751] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-09-26T19:13:41.795381] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-09-26T19:13:42.356764] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-09-26T19:13:42.711397] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-26T19:13:43.156733] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-09-26T19:13:43.956742] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-09-26T19:13:44.756703] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-09-26T19:13:44.878188] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-26T19:13:44.987171] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-26T19:13:45.056475] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-26T19:13:45.556724] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-09-26T19:13:46.356722] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-09-26T19:13:46.539277] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-26T19:13:46.721137] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-26T19:13:47.156727] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-09-26T19:13:47.956736] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-09-26T19:13:48.133845] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-26T19:13:48.209323] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-09-26T19:13:48.756740] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-09-26T19:13:49.556724] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-09-26T19:13:50.358223] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-09-26T19:13:50.360353] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-26T19:13:50.518760] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-26T19:13:50.618447] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-09-26T19:13:51.156741] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-09-26T19:13:51.956715] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-09-26T19:13:52.224077] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-26T19:13:52.756693] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-09-26T19:13:53.118838] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-26T19:13:53.129297] [INFO ] [REMOTE ] HESM: Full fetch complete (69010 records). [2025-09-26T19:13:53.129503] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-09-26T19:13:53.556692] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-09-26T19:13:53.556816] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-09-26T19:13:53.556952] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-09-26T19:13:53.558924] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-09-26T19:13:53.559104] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-09-26T19:13:53.560767] [DEBUG] [LOCAL ] HESM: Trimmed 69010 records to 48879 (keeping 200 days of data) [2025-09-26T19:13:53.819028] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-26T19:13:53.869239] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-26T19:13:53.952192] [DEBUG] [LOCAL ] HESM: Primary data saved (48879 records). [2025-09-26T19:13:53.952393] [INFO ] [MAIN ] HESM: Full history saved. [2025-09-26T19:13:53.952537] [INFO ] [MAIN ] Update Progress: 1009/2371 symbols completed. HESM took 42.3s. Estimated remaining: 3h 0m 40s. Rate: 7.5 symbols/min [2025-09-26T19:13:54.158257] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:13:54.173270] [DEBUG] [LOCAL ] HGER: Loaded 13284 existing records from primary storage. [2025-09-26T19:13:54.173424] [INFO ] [MAIN ] HGER: Loaded 13284 existing records. [2025-09-26T19:13:54.362604] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-09-26T19:13:54.392615] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:13:54.394345] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-09-26T19:13:54.394406] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-09-26T19:13:54.395011] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-09-26T19:13:54.395185] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-09-26T19:13:54.844000] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:13:55.156688] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-09-26T19:13:55.359025] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-26T19:13:55.382201] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-09-26T19:13:55.956727] [INFO ] [REMOTE ] HGER: Fetching primary data for 2024-12. [2025-09-26T19:13:56.658420] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-26T19:13:56.756724] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-09-26T19:13:57.099336] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-26T19:13:57.556715] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-09-26T19:13:57.982196] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-26T19:13:58.356723] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-09-26T19:13:59.061717] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-26T19:13:59.156729] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-09-26T19:13:59.660004] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-26T19:13:59.660784] [INFO ] [REMOTE ] HF: Full fetch complete (505 records). [2025-09-26T19:13:59.660858] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-09-26T19:13:59.661240] [FATAL] [VALIDATOR ] HF: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T19:13:59.661345] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:13:59.661433] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:13:59.661529] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-26T19:13:59.661611] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-26T19:13:59.661681] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-09-26T19:13:59.661772] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-09-26T19:13:59.661866] [INFO ] [MAIN ] Update Progress: 1010/2371 symbols completed. HF took 28.9s. Estimated remaining: 3h 0m 30s. Rate: 7.5 symbols/min [2025-09-26T19:13:59.843529] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:13:59.843829] [DEBUG] [LOCAL ] HGLB: No existing data file found in primary storage. [2025-09-26T19:13:59.843888] [WARN ] [MAIN ] HGLB: No existing data found, performing full refresh instead. [2025-09-26T19:13:59.844141] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-09-26T19:13:59.844197] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-09-26T19:13:59.844243] [DEBUG] [LOCAL ] HGLB: No primary data file found to delete. [2025-09-26T19:13:59.844276] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-09-26T19:13:59.961810] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-09-26T19:14:00.221317] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:14:00.756725] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-09-26T19:14:01.228061] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-26T19:14:01.470988] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-26T19:14:01.556709] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-09-26T19:14:02.356734] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-09-26T19:14:02.406301] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-26T19:14:02.786633] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-26T19:14:03.156791] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-09-26T19:14:03.956778] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-09-26T19:14:04.366095] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-26T19:14:04.372986] [INFO ] [REMOTE ] HFRO: Full fetch complete (28947 records). [2025-09-26T19:14:04.373220] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-09-26T19:14:04.761940] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2024-12. [2025-09-26T19:14:04.837314] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-26T19:14:04.967533] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-09-26T19:14:04.967686] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-09-26T19:14:04.968387] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-09-26T19:14:04.968462] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-09-26T19:14:04.969692] [DEBUG] [LOCAL ] HFRO: Trimmed 28947 records to 17798 (keeping 200 days of data) [2025-09-26T19:14:05.099104] [DEBUG] [LOCAL ] HFRO: Primary data saved (17798 records). [2025-09-26T19:14:05.099295] [INFO ] [MAIN ] HFRO: Full history saved. [2025-09-26T19:14:05.099400] [INFO ] [MAIN ] Update Progress: 1011/2371 symbols completed. HFRO took 30.8s. Estimated remaining: 3h 0m 18s. Rate: 7.5 symbols/min [2025-09-26T19:14:05.331875] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:14:05.347785] [DEBUG] [LOCAL ] HGTY: Loaded 13226 existing records from primary storage. [2025-09-26T19:14:05.347935] [INFO ] [MAIN ] HGTY: Loaded 13226 existing records. [2025-09-26T19:14:05.573743] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:14:05.566402] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-09-26T19:14:05.574510] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-09-26T19:14:05.575942] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-09-26T19:14:05.576807] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-09-26T19:14:05.576895] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-09-26T19:14:05.706119] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-26T19:14:05.993922] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:14:06.356708] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-09-26T19:14:06.504429] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-26T19:14:06.927250] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-26T19:14:06.928296] [INFO ] [REMOTE ] HFND: Full fetch complete (1798 records). [2025-09-26T19:14:06.928386] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-09-26T19:14:07.126866] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-26T19:14:07.130492] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:14:07.130698] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:14:07.130802] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-26T19:14:07.130883] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-26T19:14:07.130943] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-09-26T19:14:07.131006] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-09-26T19:14:07.131147] [INFO ] [MAIN ] Update Progress: 1012/2371 symbols completed. HFND took 33.9s. Estimated remaining: 3h 0m 2s. Rate: 7.5 symbols/min [2025-09-26T19:14:07.162155] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-09-26T19:14:07.317011] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:14:07.373295] [DEBUG] [LOCAL ] HGV: Loaded 47168 existing records from primary storage. [2025-09-26T19:14:07.373469] [INFO ] [MAIN ] HGV: Loaded 47168 existing records. [2025-09-26T19:14:07.580123] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:14:07.580408] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-09-26T19:14:07.580458] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-09-26T19:14:07.581713] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-09-26T19:14:07.581777] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-09-26T19:14:07.964486] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-09-26T19:14:07.999805] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:14:08.052191] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-26T19:14:08.440990] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-26T19:14:08.756768] [INFO ] [REMOTE ] HGV: Fetching primary data for 2024-12. [2025-09-26T19:14:09.556739] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-09-26T19:14:10.189811] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-26T19:14:10.356700] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2024-12. [2025-09-26T19:14:10.520585] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-26T19:14:11.148945] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-26T19:14:11.156679] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-09-26T19:14:11.956710] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-09-26T19:14:12.058059] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-26T19:14:12.756760] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-09-26T19:14:13.306092] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-26T19:14:13.461540] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-26T19:14:13.556717] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-09-26T19:14:14.356743] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-09-26T19:14:15.020011] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-26T19:14:15.160924] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-09-26T19:14:15.162910] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-26T19:14:15.956809] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-09-26T19:14:16.734514] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-26T19:14:16.737372] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-26T19:14:16.756676] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-09-26T19:14:17.538722] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-26T19:14:17.556687] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-09-26T19:14:18.306275] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-26T19:14:18.356762] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-09-26T19:14:19.156759] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-09-26T19:14:19.927725] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-26T19:14:19.962206] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-09-26T19:14:19.976612] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-26T19:14:20.756762] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-09-26T19:14:21.009057] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-26T19:14:21.556748] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-09-26T19:14:22.356747] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-09-26T19:14:22.396899] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-26T19:14:22.534073] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-26T19:14:23.156808] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-09-26T19:14:23.956809] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-09-26T19:14:24.042626] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-26T19:14:24.577612] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-26T19:14:24.756780] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-09-26T19:14:25.556785] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-09-26T19:14:26.180367] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-26T19:14:26.333112] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-26T19:14:26.356742] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-09-26T19:14:27.156777] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-09-26T19:14:27.956775] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-09-26T19:14:28.223228] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-26T19:14:28.228234] [INFO ] [REMOTE ] HGER: Full fetch complete (16452 records). [2025-09-26T19:14:28.228385] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-09-26T19:14:28.590443] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-26T19:14:28.744052] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-09-26T19:14:28.744989] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-09-26T19:14:28.745780] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-09-26T19:14:28.746333] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-09-26T19:14:28.746210] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-26T19:14:28.750382] [DEBUG] [LOCAL ] HGER: Trimmed 16452 records to 13428 (keeping 200 days of data) [2025-09-26T19:14:28.787330] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-09-26T19:14:28.843067] [DEBUG] [LOCAL ] HGER: Primary data saved (13428 records). [2025-09-26T19:14:28.843259] [INFO ] [MAIN ] HGER: Full history saved. [2025-09-26T19:14:28.843410] [INFO ] [MAIN ] Update Progress: 1013/2371 symbols completed. HGER took 34.9s. Estimated remaining: 3h 0m 13s. Rate: 7.5 symbols/min [2025-09-26T19:14:29.036895] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:14:29.075759] [DEBUG] [LOCAL ] HHH: Loaded 32833 existing records from primary storage. [2025-09-26T19:14:29.075921] [INFO ] [MAIN ] HHH: Loaded 32833 existing records. [2025-09-26T19:14:29.284177] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:14:29.284451] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-09-26T19:14:29.284509] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-09-26T19:14:29.285729] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-09-26T19:14:29.285808] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-09-26T19:14:29.561796] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-09-26T19:14:29.622584] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-26T19:14:29.733333] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:14:30.356738] [INFO ] [REMOTE ] HHH: Fetching primary data for 2024-12. [2025-09-26T19:14:31.161951] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-09-26T19:14:31.181677] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-26T19:14:31.434584] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-26T19:14:31.943810] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-26T19:14:31.956679] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-09-26T19:14:32.737112] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-26T19:14:32.756672] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-09-26T19:14:33.462292] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (9.51 seconds). [2025-09-26T19:14:33.467312] [INFO ] [REMOTE ] HGTY: Full fetch complete (17254 records). [2025-09-26T19:14:33.467404] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-09-26T19:14:33.561824] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-09-26T19:14:33.857688] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-09-26T19:14:33.857804] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-09-26T19:14:33.858460] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-09-26T19:14:33.858538] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-09-26T19:14:33.859300] [DEBUG] [LOCAL ] HGTY: Trimmed 17254 records to 13290 (keeping 200 days of data) [2025-09-26T19:14:33.948682] [DEBUG] [LOCAL ] HGTY: Primary data saved (13290 records). [2025-09-26T19:14:33.949000] [INFO ] [MAIN ] HGTY: Full history saved. [2025-09-26T19:14:33.949174] [INFO ] [MAIN ] Update Progress: 1014/2371 symbols completed. HGTY took 28.8s. Estimated remaining: 3h 0m 1s. Rate: 7.5 symbols/min [2025-09-26T19:14:34.135701] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:14:34.185302] [DEBUG] [LOCAL ] HI: Loaded 35414 existing records from primary storage. [2025-09-26T19:14:34.185510] [INFO ] [MAIN ] HI: Loaded 35414 existing records. [2025-09-26T19:14:34.362541] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-09-26T19:14:34.369130] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:14:34.370468] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-09-26T19:14:34.370540] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-09-26T19:14:34.372134] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-09-26T19:14:34.372204] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-09-26T19:14:34.753530] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:14:35.156774] [INFO ] [REMOTE ] HI: Fetching primary data for 2024-12. [2025-09-26T19:14:35.503611] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-26T19:14:35.513511] [INFO ] [REMOTE ] HGV: Full fetch complete (65684 records). [2025-09-26T19:14:35.513710] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-09-26T19:14:35.883996] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-26T19:14:35.968143] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-09-26T19:14:35.971922] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-09-26T19:14:35.973299] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-09-26T19:14:35.974729] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-09-26T19:14:35.974942] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-09-26T19:14:35.977260] [DEBUG] [LOCAL ] HGV: Trimmed 65684 records to 47426 (keeping 200 days of data) [2025-09-26T19:14:36.293026] [DEBUG] [LOCAL ] HGV: Primary data saved (47426 records). [2025-09-26T19:14:36.293230] [INFO ] [MAIN ] HGV: Full history saved. [2025-09-26T19:14:36.293366] [INFO ] [MAIN ] Update Progress: 1015/2371 symbols completed. HGV took 29.2s. Estimated remaining: 2h 59m 46s. Rate: 7.5 symbols/min [2025-09-26T19:14:36.472484] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:14:36.501560] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-26T19:14:36.562784] [DEBUG] [LOCAL ] HIG: Loaded 51610 existing records from primary storage. [2025-09-26T19:14:36.562967] [INFO ] [MAIN ] HIG: Loaded 51610 existing records. [2025-09-26T19:14:36.757619] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:14:36.757386] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-09-26T19:14:36.758109] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-09-26T19:14:36.758214] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-09-26T19:14:36.761399] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-09-26T19:14:36.761466] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-09-26T19:14:37.194902] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:14:37.402950] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-26T19:14:37.556689] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-09-26T19:14:37.874685] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-26T19:14:38.356739] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-09-26T19:14:38.572238] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (5.82 seconds). [2025-09-26T19:14:38.576162] [INFO ] [REMOTE ] HGLB: Full fetch complete (14366 records). [2025-09-26T19:14:38.576299] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-09-26T19:14:39.031847] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-09-26T19:14:39.031929] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-09-26T19:14:39.032282] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-09-26T19:14:39.032324] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-09-26T19:14:39.032895] [DEBUG] [LOCAL ] HGLB: Trimmed 14366 records to 9836 (keeping 200 days of data) [2025-09-26T19:14:39.102293] [DEBUG] [LOCAL ] HGLB: Primary data saved (9836 records). [2025-09-26T19:14:39.102454] [INFO ] [MAIN ] HGLB: Full history saved. [2025-09-26T19:14:39.102543] [INFO ] [MAIN ] Update Progress: 1016/2371 symbols completed. HGLB took 39.4s. Estimated remaining: 2h 59m 31s. Rate: 7.5 symbols/min [2025-09-26T19:14:39.167859] [INFO ] [REMOTE ] HIG: Fetching primary data for 2024-12. [2025-09-26T19:14:39.287673] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:14:39.330349] [DEBUG] [LOCAL ] HII: Loaded 35496 existing records from primary storage. [2025-09-26T19:14:39.330570] [INFO ] [MAIN ] HII: Loaded 35496 existing records. [2025-09-26T19:14:39.511819] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:14:39.512133] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-09-26T19:14:39.512238] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-09-26T19:14:39.513770] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-09-26T19:14:39.513832] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-09-26T19:14:39.901208] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:14:39.956724] [INFO ] [REMOTE ] HII: Fetching primary data for 2024-12. [2025-09-26T19:14:50.772341] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (13.22 seconds). [2025-09-26T19:14:50.778848] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-09-26T19:14:51.672839] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2024-12 (11.72 seconds). [2025-09-26T19:14:51.681380] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-09-26T19:14:52.293536] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (13.94 seconds). [2025-09-26T19:14:52.300630] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-09-26T19:14:52.994753] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-26T19:14:53.003006] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-09-26T19:14:53.319897] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2024-12 (14.15 seconds). [2025-09-26T19:14:53.330156] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-09-26T19:14:53.353351] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-09-26T19:14:53.359555] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-09-26T19:14:53.708267] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-26T19:14:53.716452] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-09-26T19:14:54.304045] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-26T19:14:54.312958] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-09-26T19:14:54.968614] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-26T19:14:54.979627] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-09-26T19:14:55.045986] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-26T19:14:55.055320] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-09-26T19:14:55.286775] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-26T19:14:55.295713] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-09-26T19:14:56.086930] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-26T19:14:56.096821] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-09-26T19:14:56.160979] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-26T19:14:56.168908] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-09-26T19:14:56.264027] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-26T19:14:56.274539] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-09-26T19:14:56.777680] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-26T19:14:56.786173] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-09-26T19:14:57.291582] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-26T19:14:57.305150] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-09-26T19:14:57.561485] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-26T19:14:57.572304] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-09-26T19:14:57.806533] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-26T19:14:57.816132] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-09-26T19:14:58.618786] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-09-26T19:14:58.630035] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-09-26T19:14:58.900425] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-26T19:14:58.908587] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-09-26T19:14:59.491749] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-26T19:14:59.499334] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-09-26T19:15:00.184397] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-09-26T19:15:00.192732] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-09-26T19:15:00.608891] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-26T19:15:00.621352] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-09-26T19:15:00.720225] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-26T19:15:00.729522] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-09-26T19:15:00.787487] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-26T19:15:00.797317] [INFO ] [REMOTE ] HHH: Full fetch complete (45250 records). [2025-09-26T19:15:00.797566] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-09-26T19:15:01.239785] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-09-26T19:15:01.239878] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-09-26T19:15:01.240633] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-09-26T19:15:01.240759] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-09-26T19:15:01.242108] [DEBUG] [LOCAL ] HHH: Trimmed 45250 records to 33042 (keeping 200 days of data) [2025-09-26T19:15:01.455732] [DEBUG] [LOCAL ] HHH: Primary data saved (33042 records). [2025-09-26T19:15:01.455918] [INFO ] [MAIN ] HHH: Full history saved. [2025-09-26T19:15:01.456030] [INFO ] [MAIN ] Update Progress: 1017/2371 symbols completed. HHH took 32.6s. Estimated remaining: 2h 59m 42s. Rate: 7.5 symbols/min [2025-09-26T19:15:01.651667] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:15:01.704620] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-26T19:15:01.712599] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-09-26T19:15:01.732702] [DEBUG] [LOCAL ] HIMS: Loaded 54207 existing records from primary storage. [2025-09-26T19:15:01.732898] [INFO ] [MAIN ] HIMS: Loaded 54207 existing records. [2025-09-26T19:15:01.925999] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:15:01.926309] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-09-26T19:15:01.926359] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-09-26T19:15:01.928774] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-09-26T19:15:01.928837] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-09-26T19:15:02.318362] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:15:02.318986] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2024-12. [2025-09-26T19:15:02.532362] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-26T19:15:02.552493] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-09-26T19:15:02.718757] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-26T19:15:02.726060] [INFO ] [REMOTE ] HI: Full fetch complete (49813 records). [2025-09-26T19:15:02.726223] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-09-26T19:15:03.175889] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-09-26T19:15:03.176074] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-09-26T19:15:03.185204] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-09-26T19:15:03.195736] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-09-26T19:15:03.201154] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-26T19:15:03.209307] [DEBUG] [LOCAL ] HI: Trimmed 49813 records to 35713 (keeping 200 days of data) [2025-09-26T19:15:03.210793] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-09-26T19:15:03.453806] [DEBUG] [LOCAL ] HI: Primary data saved (35713 records). [2025-09-26T19:15:03.454001] [INFO ] [MAIN ] HI: Full history saved. [2025-09-26T19:15:03.455072] [INFO ] [MAIN ] Update Progress: 1018/2371 symbols completed. HI took 29.5s. Estimated remaining: 2h 59m 26s. Rate: 7.5 symbols/min [2025-09-26T19:15:03.655366] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:15:03.679705] [DEBUG] [LOCAL ] HIO: Loaded 23776 existing records from primary storage. [2025-09-26T19:15:03.679848] [INFO ] [MAIN ] HIO: Loaded 23776 existing records. [2025-09-26T19:15:03.870738] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:15:03.871010] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-09-26T19:15:03.871065] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-09-26T19:15:03.872071] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-09-26T19:15:03.872134] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-09-26T19:15:04.251805] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:15:04.252198] [INFO ] [REMOTE ] HIO: Fetching primary data for 2024-12. [2025-09-26T19:15:04.433987] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-26T19:15:04.444709] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-09-26T19:15:04.736275] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-09-26T19:15:04.756676] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-09-26T19:15:04.946164] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-26T19:15:05.531241] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-26T19:15:05.556678] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-09-26T19:15:06.356726] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-09-26T19:15:06.732483] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-26T19:15:06.845522] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-26T19:15:07.156747] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-09-26T19:15:07.188382] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-09-26T19:15:07.685202] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-26T19:15:07.693355] [INFO ] [REMOTE ] HII: Full fetch complete (53376 records). [2025-09-26T19:15:07.693608] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-09-26T19:15:07.962529] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-09-26T19:15:08.149854] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-09-26T19:15:08.149936] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-09-26T19:15:08.150685] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-09-26T19:15:08.150748] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-09-26T19:15:08.151866] [DEBUG] [LOCAL ] HII: Trimmed 53376 records to 35728 (keeping 200 days of data) [2025-09-26T19:15:08.403617] [DEBUG] [LOCAL ] HII: Primary data saved (35728 records). [2025-09-26T19:15:08.403802] [INFO ] [MAIN ] HII: Full history saved. [2025-09-26T19:15:08.403931] [INFO ] [MAIN ] Update Progress: 1019/2371 symbols completed. HII took 29.3s. Estimated remaining: 2h 59m 14s. Rate: 7.5 symbols/min [2025-09-26T19:15:08.584882] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:15:08.609084] [DEBUG] [LOCAL ] HIPO: Loaded 22682 existing records from primary storage. [2025-09-26T19:15:08.609229] [INFO ] [MAIN ] HIPO: Loaded 22682 existing records. [2025-09-26T19:15:08.775150] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-09-26T19:15:08.843472] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:15:08.846426] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-09-26T19:15:08.846563] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-09-26T19:15:08.846309] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-26T19:15:08.857498] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-09-26T19:15:08.857854] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-09-26T19:15:09.257594] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:15:09.368374] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-26T19:15:09.556738] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-09-26T19:15:10.356758] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2024-12. [2025-09-26T19:15:11.156697] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-09-26T19:15:11.290953] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.52 seconds). [2025-09-26T19:15:11.432635] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-26T19:15:11.443231] [INFO ] [REMOTE ] HIG: Full fetch complete (73297 records). [2025-09-26T19:15:11.443446] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-09-26T19:15:11.713902] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-26T19:15:11.957457] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-09-26T19:15:11.957774] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-09-26T19:15:11.959417] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-09-26T19:15:11.960568] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-09-26T19:15:11.960694] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-09-26T19:15:11.968407] [DEBUG] [LOCAL ] HIG: Trimmed 73297 records to 51962 (keeping 200 days of data) [2025-09-26T19:15:12.335511] [DEBUG] [LOCAL ] HIG: Primary data saved (51962 records). [2025-09-26T19:15:12.335690] [INFO ] [MAIN ] HIG: Full history saved. [2025-09-26T19:15:12.335917] [INFO ] [MAIN ] Update Progress: 1020/2371 symbols completed. HIG took 36.0s. Estimated remaining: 2h 59m 1s. Rate: 7.5 symbols/min [2025-09-26T19:15:12.512194] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-26T19:15:12.566919] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:15:12.614554] [DEBUG] [LOCAL ] HIW: Loaded 45015 existing records from primary storage. [2025-09-26T19:15:12.614728] [INFO ] [MAIN ] HIW: Loaded 45015 existing records. [2025-09-26T19:15:12.766474] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-09-26T19:15:12.814500] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:15:12.814901] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-09-26T19:15:12.814964] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-09-26T19:15:12.816300] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-09-26T19:15:12.816376] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-09-26T19:15:13.185834] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-26T19:15:13.235489] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:15:13.556769] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-09-26T19:15:14.001517] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-26T19:15:14.356737] [INFO ] [REMOTE ] HIW: Fetching primary data for 2024-12. [2025-09-26T19:15:15.156748] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-09-26T19:15:15.815769] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-26T19:15:15.956793] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-09-26T19:15:16.212362] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-26T19:15:16.277090] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.72 seconds). [2025-09-26T19:15:16.756981] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-09-26T19:15:17.556713] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-09-26T19:15:17.665709] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-26T19:15:17.817939] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-26T19:15:18.356761] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-09-26T19:15:18.530603] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-26T19:15:19.156752] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-09-26T19:15:19.956763] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-09-26T19:15:20.370611] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-26T19:15:20.756769] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-09-26T19:15:21.354912] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (3.00 seconds). [2025-09-26T19:15:21.422302] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-26T19:15:21.556717] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-09-26T19:15:21.894836] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-26T19:15:22.356720] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-09-26T19:15:22.637966] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-26T19:15:23.156762] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-09-26T19:15:23.579562] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-26T19:15:23.956734] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-09-26T19:15:24.756750] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-09-26T19:15:25.556728] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-09-26T19:15:25.744900] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-26T19:15:25.892388] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-26T19:15:25.940463] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.78 seconds). [2025-09-26T19:15:26.294601] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-26T19:15:26.356765] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-09-26T19:15:27.156714] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-09-26T19:15:27.531965] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-26T19:15:27.956752] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-09-26T19:15:28.756776] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-09-26T19:15:29.556811] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-09-26T19:15:29.701091] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-26T19:15:29.846168] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.69 seconds). [2025-09-26T19:15:29.874459] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-26T19:15:29.880957] [INFO ] [REMOTE ] HIO: Full fetch complete (36840 records). [2025-09-26T19:15:29.881110] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-09-26T19:15:30.286185] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-09-26T19:15:30.286304] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-09-26T19:15:30.287009] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-09-26T19:15:30.287094] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-09-26T19:15:30.289796] [DEBUG] [LOCAL ] HIO: Trimmed 36840 records to 24107 (keeping 200 days of data) [2025-09-26T19:15:30.381539] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-09-26T19:15:30.444826] [DEBUG] [LOCAL ] HIO: Primary data saved (24107 records). [2025-09-26T19:15:30.444965] [INFO ] [MAIN ] HIO: Full history saved. [2025-09-26T19:15:30.445093] [INFO ] [MAIN ] Update Progress: 1021/2371 symbols completed. HIO took 27.0s. Estimated remaining: 2h 59m 6s. Rate: 7.5 symbols/min [2025-09-26T19:15:30.651823] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:15:30.665774] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-26T19:15:30.689245] [DEBUG] [LOCAL ] HIX: Loaded 20487 existing records from primary storage. [2025-09-26T19:15:30.689423] [INFO ] [MAIN ] HIX: Loaded 20487 existing records. [2025-09-26T19:15:30.884236] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:15:30.884520] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-09-26T19:15:30.884571] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-09-26T19:15:30.885352] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-09-26T19:15:30.885420] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-09-26T19:15:31.163030] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-09-26T19:15:31.278329] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:15:31.956733] [INFO ] [REMOTE ] HIX: Fetching primary data for 2024-12. [2025-09-26T19:15:32.033953] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-26T19:15:32.756683] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-09-26T19:15:33.147602] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-26T19:15:33.556700] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-09-26T19:15:33.730950] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-09-26T19:15:34.358125] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-09-26T19:15:34.360820] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-26T19:15:34.748963] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-26T19:15:35.156731] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-09-26T19:15:35.956761] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-09-26T19:15:36.173178] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-26T19:15:36.742095] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-09-26T19:15:36.756683] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-09-26T19:15:37.147121] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-26T19:15:37.151965] [INFO ] [REMOTE ] HIPO: Full fetch complete (31633 records). [2025-09-26T19:15:37.152078] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-09-26T19:15:37.565219] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-09-26T19:15:37.604893] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-09-26T19:15:37.604998] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-09-26T19:15:37.605619] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-09-26T19:15:37.605709] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-09-26T19:15:37.606788] [DEBUG] [LOCAL ] HIPO: Trimmed 31633 records to 22774 (keeping 200 days of data) [2025-09-26T19:15:37.762264] [DEBUG] [LOCAL ] HIPO: Primary data saved (22774 records). [2025-09-26T19:15:37.762405] [INFO ] [MAIN ] HIPO: Full history saved. [2025-09-26T19:15:37.762508] [INFO ] [MAIN ] Update Progress: 1022/2371 symbols completed. HIPO took 29.4s. Estimated remaining: 2h 58m 57s. Rate: 7.5 symbols/min [2025-09-26T19:15:37.948096] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:15:37.968873] [DEBUG] [LOCAL ] HKD: Loaded 18493 existing records from primary storage. [2025-09-26T19:15:37.969048] [INFO ] [MAIN ] HKD: Loaded 18493 existing records. [2025-09-26T19:15:38.164683] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:15:38.164957] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-09-26T19:15:38.165021] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-09-26T19:15:38.165622] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-09-26T19:15:38.165720] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-09-26T19:15:38.377010] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-09-26T19:15:38.556871] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:15:38.615473] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-26T19:15:39.156745] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-09-26T19:15:39.850080] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (3.09 seconds). [2025-09-26T19:15:39.861382] [INFO ] [REMOTE ] HIMS: Full fetch complete (77935 records). [2025-09-26T19:15:39.861555] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-09-26T19:15:39.961331] [INFO ] [REMOTE ] HKD: Fetching primary data for 2024-12. [2025-09-26T19:15:40.294347] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-26T19:15:40.335767] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-09-26T19:15:40.349723] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-09-26T19:15:40.351420] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-09-26T19:15:40.351950] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-09-26T19:15:40.372701] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-26T19:15:40.379206] [DEBUG] [LOCAL ] HIMS: Trimmed 77935 records to 54597 (keeping 200 days of data) [2025-09-26T19:15:40.735068] [DEBUG] [LOCAL ] HIMS: Primary data saved (54597 records). [2025-09-26T19:15:40.735228] [INFO ] [MAIN ] HIMS: Full history saved. [2025-09-26T19:15:40.735348] [INFO ] [MAIN ] Update Progress: 1023/2371 symbols completed. HIMS took 39.3s. Estimated remaining: 2h 58m 43s. Rate: 7.5 symbols/min [2025-09-26T19:15:40.768800] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-09-26T19:15:40.979137] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:15:41.042788] [DEBUG] [LOCAL ] HL: Loaded 54061 existing records from primary storage. [2025-09-26T19:15:41.042977] [INFO ] [MAIN ] HL: Loaded 54061 existing records. [2025-09-26T19:15:41.233622] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:15:41.250198] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-09-26T19:15:41.251091] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-09-26T19:15:41.252190] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-26T19:15:41.257909] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-09-26T19:15:41.258201] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-09-26T19:15:41.562921] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-09-26T19:15:41.653778] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:15:42.356691] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-09-26T19:15:42.466199] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-26T19:15:42.591857] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-26T19:15:43.156729] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-09-26T19:15:43.539894] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-26T19:15:43.956746] [INFO ] [REMOTE ] HL: Fetching primary data for 2024-12. [2025-09-26T19:15:44.221429] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-26T19:15:44.756808] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-09-26T19:15:45.556719] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-09-26T19:15:45.771846] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-26T19:15:46.006793] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-26T19:15:46.284060] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-26T19:15:46.356718] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-09-26T19:15:47.156731] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-09-26T19:15:47.411129] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-26T19:15:47.924366] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-26T19:15:47.956742] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-09-26T19:15:48.756745] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-09-26T19:15:49.556689] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-09-26T19:15:49.951632] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-26T19:15:49.956198] [INFO ] [REMOTE ] HIX: Full fetch complete (30573 records). [2025-09-26T19:15:49.956346] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-09-26T19:15:50.088486] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-26T19:15:50.375840] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-09-26T19:15:50.391254] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-09-26T19:15:50.391371] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-09-26T19:15:50.391966] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-09-26T19:15:50.392030] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-09-26T19:15:50.392992] [DEBUG] [LOCAL ] HIX: Trimmed 30573 records to 20714 (keeping 200 days of data) [2025-09-26T19:15:50.523184] [DEBUG] [LOCAL ] HIX: Primary data saved (20714 records). [2025-09-26T19:15:50.523337] [INFO ] [MAIN ] HIX: Full history saved. [2025-09-26T19:15:50.523433] [INFO ] [MAIN ] Update Progress: 1024/2371 symbols completed. HIX took 20.1s. Estimated remaining: 2h 58m 37s. Rate: 7.5 symbols/min [2025-09-26T19:15:50.717405] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:15:50.767674] [DEBUG] [LOCAL ] HLF: Loaded 49031 existing records from primary storage. [2025-09-26T19:15:50.767854] [INFO ] [MAIN ] HLF: Loaded 49031 existing records. [2025-09-26T19:15:50.957237] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:15:50.957500] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-09-26T19:15:50.957548] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-09-26T19:15:50.958692] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-09-26T19:15:50.958753] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-09-26T19:15:51.165088] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-09-26T19:15:51.361023] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:15:51.436787] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-26T19:15:51.956726] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-09-26T19:15:52.767238] [INFO ] [REMOTE ] HLF: Fetching primary data for 2024-12. [2025-09-26T19:15:52.786761] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-26T19:15:52.798068] [INFO ] [REMOTE ] HIW: Full fetch complete (64677 records). [2025-09-26T19:15:52.798252] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-09-26T19:15:53.220418] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-09-26T19:15:53.220509] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-09-26T19:15:53.221369] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-09-26T19:15:53.221440] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-09-26T19:15:53.224904] [DEBUG] [LOCAL ] HIW: Trimmed 64677 records to 45329 (keeping 200 days of data) [2025-09-26T19:15:53.329588] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (2.95 seconds). [2025-09-26T19:15:53.538609] [DEBUG] [LOCAL ] HIW: Primary data saved (45329 records). [2025-09-26T19:15:53.538858] [INFO ] [MAIN ] HIW: Full history saved. [2025-09-26T19:15:53.539014] [INFO ] [MAIN ] Update Progress: 1025/2371 symbols completed. HIW took 41.2s. Estimated remaining: 2h 58m 23s. Rate: 7.5 symbols/min [2025-09-26T19:15:53.564549] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-09-26T19:15:53.783446] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:15:53.819611] [DEBUG] [LOCAL ] HLI: Loaded 31388 existing records from primary storage. [2025-09-26T19:15:53.819782] [INFO ] [MAIN ] HLI: Loaded 31388 existing records. [2025-09-26T19:15:54.008944] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:15:54.009235] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-09-26T19:15:54.009294] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-09-26T19:15:54.010370] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-09-26T19:15:54.010434] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-09-26T19:15:54.396178] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:15:54.396754] [INFO ] [REMOTE ] HLI: Fetching primary data for 2024-12. [2025-09-26T19:15:54.548372] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-26T19:15:55.080063] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-26T19:15:55.156733] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-09-26T19:15:55.956782] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-09-26T19:15:56.249327] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-26T19:15:56.756773] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-09-26T19:15:57.568942] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-26T19:15:57.579785] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-09-26T19:15:57.796758] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-26T19:15:58.356749] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-09-26T19:15:59.096309] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-26T19:15:59.156770] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-09-26T19:15:59.281281] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-26T19:15:59.286429] [INFO ] [REMOTE ] HKD: Full fetch complete (28690 records). [2025-09-26T19:15:59.286573] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-09-26T19:15:59.708631] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-09-26T19:15:59.708748] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-09-26T19:15:59.709370] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-09-26T19:15:59.709437] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-09-26T19:15:59.710457] [DEBUG] [LOCAL ] HKD: Trimmed 28690 records to 18654 (keeping 200 days of data) [2025-09-26T19:15:59.838432] [DEBUG] [LOCAL ] HKD: Primary data saved (18654 records). [2025-09-26T19:15:59.838609] [INFO ] [MAIN ] HKD: Full history saved. [2025-09-26T19:15:59.838757] [INFO ] [MAIN ] Update Progress: 1026/2371 symbols completed. HKD took 22.1s. Estimated remaining: 2h 58m 13s. Rate: 7.5 symbols/min [2025-09-26T19:16:00.036266] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:16:00.074223] [DEBUG] [LOCAL ] HLIO: Loaded 28351 existing records from primary storage. [2025-09-26T19:16:00.074390] [INFO ] [MAIN ] HLIO: Loaded 28351 existing records. [2025-09-26T19:16:00.287819] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:16:00.288120] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-09-26T19:16:00.288175] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-09-26T19:16:00.289009] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-09-26T19:16:00.289103] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-09-26T19:16:00.714061] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:16:00.714592] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2024-12. [2025-09-26T19:16:00.749529] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-26T19:16:00.763041] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-09-26T19:16:02.333948] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-26T19:16:02.349694] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-09-26T19:16:03.980071] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-26T19:16:03.991847] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-09-26T19:16:05.595482] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-26T19:16:05.606156] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-09-26T19:16:08.965184] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2024-12 (8.25 seconds). [2025-09-26T19:16:08.969364] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-09-26T19:16:10.004274] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-26T19:16:10.009323] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-09-26T19:16:11.060585] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-26T19:16:11.064953] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-09-26T19:16:12.235927] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-26T19:16:12.244142] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-09-26T19:16:17.768274] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (25.81 seconds). [2025-09-26T19:16:17.779409] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-09-26T19:16:38.772969] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2024-12 (44.38 seconds). [2025-09-26T19:16:38.780156] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-09-26T19:16:39.960197] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (34.35 seconds). [2025-09-26T19:16:39.972026] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-09-26T19:16:40.130096] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-26T19:16:40.137781] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-09-26T19:16:41.344042] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-26T19:16:41.351449] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-09-26T19:16:41.674858] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-26T19:16:41.686247] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-09-26T19:16:42.765464] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-26T19:16:42.773396] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-09-26T19:16:43.399373] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-26T19:16:43.410446] [INFO ] [REMOTE ] HLF: Full fetch complete (71343 records). [2025-09-26T19:16:43.410630] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-09-26T19:16:43.852635] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-09-26T19:16:43.852892] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-09-26T19:16:43.853906] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-09-26T19:16:43.853976] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-09-26T19:16:43.855484] [DEBUG] [LOCAL ] HLF: Trimmed 71343 records to 49357 (keeping 200 days of data) [2025-09-26T19:16:44.184054] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-26T19:16:44.194230] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-09-26T19:16:44.205866] [DEBUG] [LOCAL ] HLF: Primary data saved (49357 records). [2025-09-26T19:16:44.206055] [INFO ] [MAIN ] HLF: Full history saved. [2025-09-26T19:16:44.206828] [INFO ] [MAIN ] Update Progress: 1027/2371 symbols completed. HLF took 53.7s. Estimated remaining: 2h 58m 53s. Rate: 7.5 symbols/min [2025-09-26T19:16:44.389719] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:16:44.426371] [DEBUG] [LOCAL ] HLLY: Loaded 33705 existing records from primary storage. [2025-09-26T19:16:44.426536] [INFO ] [MAIN ] HLLY: Loaded 33705 existing records. [2025-09-26T19:16:44.615162] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:16:44.615444] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-09-26T19:16:44.615496] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-09-26T19:16:44.616434] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-09-26T19:16:44.616497] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-09-26T19:16:45.009628] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:16:45.010039] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2024-12. [2025-09-26T19:16:45.387614] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-26T19:16:45.395214] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-09-26T19:16:46.656189] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-26T19:16:46.662779] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-09-26T19:16:48.054774] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-26T19:16:48.062886] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-09-26T19:16:51.075826] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (38.83 seconds). [2025-09-26T19:16:51.084420] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-09-26T19:16:57.292359] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (39.51 seconds). [2025-09-26T19:16:57.304098] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-09-26T19:16:58.197848] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (10.13 seconds). [2025-09-26T19:16:58.205790] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-09-26T19:16:59.383688] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-26T19:16:59.395545] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-09-26T19:17:08.514474] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (17.43 seconds). [2025-09-26T19:17:08.522534] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-09-26T19:17:08.936788] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2024-12 (23.93 seconds). [2025-09-26T19:17:08.944874] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-09-26T19:17:10.242605] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-26T19:17:10.249436] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-09-26T19:17:11.243250] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-26T19:17:11.248749] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-09-26T19:17:12.500833] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-26T19:17:12.508407] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-09-26T19:17:13.878467] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-26T19:17:13.886618] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-09-26T19:17:15.065524] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (16.86 seconds). [2025-09-26T19:17:15.071923] [INFO ] [REMOTE ] HLI: Full fetch complete (45389 records). [2025-09-26T19:17:15.072071] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-09-26T19:17:15.484402] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-09-26T19:17:15.484506] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-09-26T19:17:15.485307] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-09-26T19:17:15.485386] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-09-26T19:17:15.486493] [DEBUG] [LOCAL ] HLI: Trimmed 45389 records to 31573 (keeping 200 days of data) [2025-09-26T19:17:15.696604] [DEBUG] [LOCAL ] HLI: Primary data saved (31573 records). [2025-09-26T19:17:15.696783] [INFO ] [MAIN ] HLI: Full history saved. [2025-09-26T19:17:15.696908] [INFO ] [MAIN ] Update Progress: 1028/2371 symbols completed. HLI took 1m 22s. Estimated remaining: 2h 59m 15s. Rate: 7.5 symbols/min [2025-09-26T19:17:15.894116] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:17:15.952159] [DEBUG] [LOCAL ] HLN: Loaded 53477 existing records from primary storage. [2025-09-26T19:17:15.952325] [INFO ] [MAIN ] HLN: Loaded 53477 existing records. [2025-09-26T19:17:16.143543] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:17:16.143855] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-09-26T19:17:16.143927] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-09-26T19:17:16.145363] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-09-26T19:17:16.145426] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-09-26T19:17:16.521888] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:17:16.522230] [INFO ] [REMOTE ] HLN: Fetching primary data for 2024-12. [2025-09-26T19:17:43.860237] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2024-12 (27.34 seconds). [2025-09-26T19:17:43.875162] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-09-26T19:17:45.425441] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-26T19:17:45.436614] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-09-26T19:17:47.001240] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (47.61 seconds). [2025-09-26T19:17:47.014450] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-09-26T19:17:47.048023] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-26T19:17:47.060080] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-09-26T19:17:49.018023] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-26T19:17:49.030782] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-09-26T19:17:49.063185] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-26T19:17:49.075110] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-09-26T19:17:51.060028] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-26T19:17:51.072417] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-09-26T19:17:53.179920] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-26T19:17:53.191832] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-09-26T19:17:55.350894] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-26T19:17:55.364480] [INFO ] [REMOTE ] HL: Full fetch complete (77654 records). [2025-09-26T19:17:55.364865] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-09-26T19:17:55.890150] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-09-26T19:17:55.890281] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-09-26T19:17:55.891899] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-09-26T19:17:55.891997] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-09-26T19:17:55.893918] [DEBUG] [LOCAL ] HL: Trimmed 77654 records to 54451 (keeping 200 days of data) [2025-09-26T19:17:56.341149] [DEBUG] [LOCAL ] HL: Primary data saved (54451 records). [2025-09-26T19:17:56.341349] [INFO ] [MAIN ] HL: Full history saved. [2025-09-26T19:17:56.341485] [INFO ] [MAIN ] Update Progress: 1029/2371 symbols completed. HL took 2m 16s. Estimated remaining: 2h 59m 50s. Rate: 7.5 symbols/min [2025-09-26T19:17:56.532261] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:17:56.587916] [DEBUG] [LOCAL ] HLT: Loaded 51092 existing records from primary storage. [2025-09-26T19:17:56.588097] [INFO ] [MAIN ] HLT: Loaded 51092 existing records. [2025-09-26T19:17:56.780784] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:17:56.781068] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-09-26T19:17:56.781120] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-09-26T19:17:56.782999] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-09-26T19:17:56.783065] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-09-26T19:17:57.254945] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:17:57.255357] [INFO ] [REMOTE ] HLT: Fetching primary data for 2024-12. [2025-09-26T19:17:59.086744] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-26T19:17:59.097549] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-09-26T19:18:01.043219] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-26T19:18:01.053748] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-09-26T19:18:02.640966] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-26T19:18:02.651287] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-09-26T19:18:04.631398] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-26T19:18:04.642802] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-09-26T19:18:06.288927] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (57.77 seconds). [2025-09-26T19:18:06.296690] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-09-26T19:18:23.646546] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (69.76 seconds). [2025-09-26T19:18:23.654078] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-09-26T19:18:24.779125] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-26T19:18:24.785200] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-09-26T19:18:26.134814] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-26T19:18:26.142440] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-09-26T19:18:26.253475] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (37.22 seconds). [2025-09-26T19:18:26.265235] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-09-26T19:18:48.614852] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (43.97 seconds). [2025-09-26T19:18:48.627915] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-09-26T19:18:50.469092] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-26T19:18:50.480319] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-09-26T19:18:51.091237] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (24.95 seconds). [2025-09-26T19:18:51.099808] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-09-26T19:18:52.119080] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (45.82 seconds). [2025-09-26T19:18:52.126451] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-09-26T19:18:52.652551] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-26T19:18:52.660237] [INFO ] [REMOTE ] HLLY: Full fetch complete (46178 records). [2025-09-26T19:18:52.660402] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-09-26T19:18:53.084287] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-09-26T19:18:53.084458] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-09-26T19:18:53.085345] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-09-26T19:18:53.085431] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-09-26T19:18:53.086703] [DEBUG] [LOCAL ] HLLY: Trimmed 46178 records to 33911 (keeping 200 days of data) [2025-09-26T19:18:53.291486] [DEBUG] [LOCAL ] HLLY: Primary data saved (33911 records). [2025-09-26T19:18:53.291679] [INFO ] [MAIN ] HLLY: Full history saved. [2025-09-26T19:18:53.293180] [INFO ] [MAIN ] Update Progress: 1030/2371 symbols completed. HLLY took 2m 9s. Estimated remaining: 3h 0m 45s. Rate: 7.4 symbols/min [2025-09-26T19:18:53.483155] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:18:53.503340] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-26T19:18:53.511558] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-09-26T19:18:53.556962] [DEBUG] [LOCAL ] HLX: Loaded 48349 existing records from primary storage. [2025-09-26T19:18:53.557182] [INFO ] [MAIN ] HLX: Loaded 48349 existing records. [2025-09-26T19:18:53.758920] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:18:53.759262] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-09-26T19:18:53.759326] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-09-26T19:18:53.760564] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-09-26T19:18:53.760637] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-09-26T19:18:54.201932] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:18:54.202382] [INFO ] [REMOTE ] HLX: Fetching primary data for 2024-12. [2025-09-26T19:18:54.619350] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (4.14 seconds). [2025-09-26T19:18:54.631823] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-09-26T19:18:54.690506] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (28.43 seconds). [2025-09-26T19:18:54.704514] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-09-26T19:18:54.728587] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-26T19:18:54.733192] [INFO ] [REMOTE ] HLIO: Full fetch complete (36199 records). [2025-09-26T19:18:54.733302] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-09-26T19:18:55.131253] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-09-26T19:18:55.131375] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-09-26T19:18:55.132098] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-09-26T19:18:55.132166] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-09-26T19:18:55.133167] [DEBUG] [LOCAL ] HLIO: Trimmed 36199 records to 28490 (keeping 200 days of data) [2025-09-26T19:18:55.308723] [DEBUG] [LOCAL ] HLIO: Primary data saved (28490 records). [2025-09-26T19:18:55.308884] [INFO ] [MAIN ] HLIO: Full history saved. [2025-09-26T19:18:55.308992] [INFO ] [MAIN ] Update Progress: 1031/2371 symbols completed. HLIO took 2m 55s. Estimated remaining: 3h 0m 29s. Rate: 7.4 symbols/min [2025-09-26T19:18:55.490694] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:18:55.534364] [DEBUG] [LOCAL ] HMC: Loaded 47152 existing records from primary storage. [2025-09-26T19:18:55.534518] [INFO ] [MAIN ] HMC: Loaded 47152 existing records. [2025-09-26T19:18:55.725744] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:18:55.726518] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-09-26T19:18:55.726677] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-09-26T19:18:55.728030] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-09-26T19:18:55.728097] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-09-26T19:18:55.955921] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-26T19:18:56.013350] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-09-26T19:18:56.182028] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:18:56.182449] [INFO ] [REMOTE ] HMC: Fetching primary data for 2024-12. [2025-09-26T19:18:56.447165] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-26T19:18:56.458932] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-09-26T19:18:56.518056] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-26T19:18:56.529625] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-09-26T19:18:57.708128] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-26T19:18:57.718287] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-09-26T19:18:58.098858] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-26T19:18:58.109963] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-09-26T19:18:58.239014] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-26T19:18:58.249956] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-09-26T19:18:59.338991] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (2.81 seconds). [2025-09-26T19:18:59.363404] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-09-26T19:19:00.047928] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-26T19:19:00.057898] [INFO ] [REMOTE ] HLT: Full fetch complete (73434 records). [2025-09-26T19:19:00.058061] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-09-26T19:19:00.552502] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-09-26T19:19:00.578811] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-09-26T19:19:00.580942] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-09-26T19:19:00.582123] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (2.86 seconds). [2025-09-26T19:19:00.582321] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-09-26T19:19:00.592621] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-09-26T19:19:00.594435] [DEBUG] [LOCAL ] HLT: Trimmed 73434 records to 51450 (keeping 200 days of data) [2025-09-26T19:19:00.933006] [DEBUG] [LOCAL ] HLT: Primary data saved (51450 records). [2025-09-26T19:19:00.933327] [INFO ] [MAIN ] HLT: Full history saved. [2025-09-26T19:19:00.933446] [INFO ] [MAIN ] Update Progress: 1032/2371 symbols completed. HLT took 1m 5s. Estimated remaining: 3h 0m 18s. Rate: 7.4 symbols/min [2025-09-26T19:19:01.115610] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:19:01.139022] [DEBUG] [LOCAL ] HMN: Loaded 23517 existing records from primary storage. [2025-09-26T19:19:01.139168] [INFO ] [MAIN ] HMN: Loaded 23517 existing records. [2025-09-26T19:19:01.350188] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:19:01.361824] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-09-26T19:19:01.364911] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-09-26T19:19:01.365788] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-09-26T19:19:01.365868] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-09-26T19:19:01.367169] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-26T19:19:01.438937] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-09-26T19:19:01.746447] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (3.50 seconds). [2025-09-26T19:19:01.801458] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-09-26T19:19:01.828635] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:19:01.830380] [INFO ] [REMOTE ] HMN: Fetching primary data for 2024-12. [2025-09-26T19:19:02.364000] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-26T19:19:02.374763] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-09-26T19:19:03.000956] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-26T19:19:03.005358] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-09-26T19:19:03.434182] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-26T19:19:03.447400] [INFO ] [REMOTE ] HLN: Full fetch complete (76780 records). [2025-09-26T19:19:03.447615] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-09-26T19:19:03.832579] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-26T19:19:03.931081] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-09-26T19:19:03.989316] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-09-26T19:19:03.990416] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-09-26T19:19:03.991812] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-09-26T19:19:03.992087] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-09-26T19:19:04.011978] [DEBUG] [LOCAL ] HLN: Trimmed 76780 records to 53861 (keeping 200 days of data) [2025-09-26T19:19:04.028095] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-26T19:19:04.137975] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-09-26T19:19:04.149096] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-26T19:19:04.161924] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-09-26T19:19:04.411020] [DEBUG] [LOCAL ] HLN: Primary data saved (53861 records). [2025-09-26T19:19:04.411271] [INFO ] [MAIN ] HLN: Full history saved. [2025-09-26T19:19:04.411528] [INFO ] [MAIN ] Update Progress: 1033/2371 symbols completed. HLN took 1m 49s. Estimated remaining: 3h 0m 4s. Rate: 7.4 symbols/min [2025-09-26T19:19:04.589565] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:19:04.651578] [DEBUG] [LOCAL ] HMY: Loaded 53525 existing records from primary storage. [2025-09-26T19:19:04.651815] [INFO ] [MAIN ] HMY: Loaded 53525 existing records. [2025-09-26T19:19:04.840968] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:19:04.841332] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-09-26T19:19:04.841392] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-09-26T19:19:04.842848] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-09-26T19:19:04.842937] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-09-26T19:19:05.168085] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-26T19:19:05.216142] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-09-26T19:19:05.259349] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:19:05.259859] [INFO ] [REMOTE ] HMY: Fetching primary data for 2024-12. [2025-09-26T19:19:05.495484] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-26T19:19:05.506581] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-09-26T19:19:05.579955] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-26T19:19:05.590992] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-09-26T19:19:06.293422] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-26T19:19:06.298203] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-09-26T19:19:07.094387] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-26T19:19:07.107235] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-09-26T19:19:07.208422] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-26T19:19:07.221384] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-09-26T19:19:07.263769] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-26T19:19:07.275369] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-09-26T19:19:07.636958] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-26T19:19:07.643281] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-09-26T19:19:09.021572] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-26T19:19:09.028975] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-09-26T19:19:09.143062] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-26T19:19:09.154927] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-09-26T19:19:09.376591] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-26T19:19:09.386606] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-09-26T19:19:09.433196] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-26T19:19:09.445990] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-09-26T19:19:10.222553] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-26T19:19:10.228182] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-09-26T19:19:10.735006] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-26T19:19:10.746195] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-09-26T19:19:10.822461] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-26T19:19:10.835080] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-09-26T19:19:11.106588] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-26T19:19:11.117680] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-09-26T19:19:11.508014] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-26T19:19:11.514306] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-09-26T19:19:12.395014] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-26T19:19:12.407118] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-09-26T19:19:12.541547] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-26T19:19:12.550913] [INFO ] [REMOTE ] HLX: Full fetch complete (69217 records). [2025-09-26T19:19:12.551106] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-09-26T19:19:12.735943] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-26T19:19:12.771102] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-09-26T19:19:13.008247] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-09-26T19:19:13.008445] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-09-26T19:19:13.009489] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-09-26T19:19:13.009675] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-09-26T19:19:13.013360] [DEBUG] [LOCAL ] HLX: Trimmed 69217 records to 48650 (keeping 200 days of data) [2025-09-26T19:19:13.153375] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-26T19:19:13.169183] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-09-26T19:19:13.369607] [DEBUG] [LOCAL ] HLX: Primary data saved (48650 records). [2025-09-26T19:19:13.369805] [INFO ] [MAIN ] HLX: Full history saved. [2025-09-26T19:19:13.370529] [INFO ] [MAIN ] Update Progress: 1034/2371 symbols completed. HLX took 20.1s. Estimated remaining: 2h 59m 57s. Rate: 7.4 symbols/min [2025-09-26T19:19:13.556611] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:19:13.556840] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-09-26T19:19:13.556898] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-09-26T19:19:13.557093] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-09-26T19:19:13.557157] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-26T19:19:13.557229] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-26T19:19:13.557267] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-09-26T19:19:13.990026] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:19:13.990711] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-09-26T19:19:14.033558] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-26T19:19:14.042846] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-26T19:19:14.053421] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-09-26T19:19:14.054506] [INFO ] [REMOTE ] HMN: Full fetch complete (31690 records). [2025-09-26T19:19:14.054606] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-09-26T19:19:14.234559] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:19:14.268628] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-09-26T19:19:14.332955] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-01. [2025-09-26T19:19:14.463558] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-09-26T19:19:14.463668] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-09-26T19:19:14.464273] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-09-26T19:19:14.464318] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-09-26T19:19:14.465174] [DEBUG] [LOCAL ] HMN: Trimmed 31690 records to 23671 (keeping 200 days of data) [2025-09-26T19:19:14.580827] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:19:14.597986] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-01 [2025-09-26T19:19:14.606698] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-02. [2025-09-26T19:19:14.633108] [DEBUG] [LOCAL ] HMN: Primary data saved (23671 records). [2025-09-26T19:19:14.633287] [INFO ] [MAIN ] HMN: Full history saved. [2025-09-26T19:19:14.633390] [INFO ] [MAIN ] Update Progress: 1035/2371 symbols completed. HMN took 13.7s. Estimated remaining: 2h 59m 40s. Rate: 7.4 symbols/min [2025-09-26T19:19:14.816049] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:19:14.848793] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:19:14.849147] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-02 [2025-09-26T19:19:14.849717] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-03. [2025-09-26T19:19:14.861223] [DEBUG] [LOCAL ] HNI: Loaded 29093 existing records from primary storage. [2025-09-26T19:19:14.861474] [INFO ] [MAIN ] HNI: Loaded 29093 existing records. [2025-09-26T19:19:15.057111] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:19:15.057408] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-09-26T19:19:15.057483] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-09-26T19:19:15.058543] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-09-26T19:19:15.058764] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-09-26T19:19:15.121250] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:19:15.171147] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-03 [2025-09-26T19:19:15.175965] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-04. [2025-09-26T19:19:15.278101] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-26T19:19:15.400884] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-09-26T19:19:15.414269] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:19:15.436869] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-04 [2025-09-26T19:19:15.437952] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-05. [2025-09-26T19:19:15.535146] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:19:15.535811] [INFO ] [REMOTE ] HNI: Fetching primary data for 2024-12. [2025-09-26T19:19:15.574289] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-26T19:19:15.583998] [INFO ] [REMOTE ] HMC: Full fetch complete (69517 records). [2025-09-26T19:19:15.584180] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-09-26T19:19:16.010750] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-09-26T19:19:16.010880] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-09-26T19:19:16.011894] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-09-26T19:19:16.011965] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-09-26T19:19:16.013520] [DEBUG] [LOCAL ] HMC: Trimmed 69517 records to 47500 (keeping 200 days of data) [2025-09-26T19:19:16.090842] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-26T19:19:16.121977] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-06. [2025-09-26T19:19:16.320625] [DEBUG] [LOCAL ] HMC: Primary data saved (47500 records). [2025-09-26T19:19:16.320824] [INFO ] [MAIN ] HMC: Full history saved. [2025-09-26T19:19:16.320957] [INFO ] [MAIN ] Update Progress: 1036/2371 symbols completed. HMC took 21.0s. Estimated remaining: 2h 59m 24s. Rate: 7.4 symbols/min [2025-09-26T19:19:16.498202] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:19:16.561271] [DEBUG] [LOCAL ] HOG: Loaded 51604 existing records from primary storage. [2025-09-26T19:19:16.561461] [INFO ] [MAIN ] HOG: Loaded 51604 existing records. [2025-09-26T19:19:16.754328] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:19:16.754889] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-09-26T19:19:16.754952] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-09-26T19:19:16.756315] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-09-26T19:19:16.756383] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-09-26T19:19:17.048624] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-26T19:19:17.072877] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-09-26T19:19:17.168730] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:19:17.169071] [INFO ] [REMOTE ] HOG: Fetching primary data for 2024-12. [2025-09-26T19:19:17.626040] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-26T19:19:17.637992] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-09-26T19:19:17.850682] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-26T19:19:17.859815] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-07. [2025-09-26T19:19:18.249314] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-26T19:19:18.254854] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-09-26T19:19:18.518941] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-26T19:19:18.529826] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-09-26T19:19:19.375025] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-26T19:19:19.384609] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-08. [2025-09-26T19:19:19.675708] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-26T19:19:19.687684] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-09-26T19:19:19.747095] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-26T19:19:19.756287] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-09-26T19:19:20.374499] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-26T19:19:20.385329] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-09-26T19:19:20.735596] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-26T19:19:20.744331] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-09. [2025-09-26T19:19:21.074740] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-26T19:19:21.081421] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-09-26T19:19:21.412443] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-26T19:19:21.424614] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-09-26T19:19:21.697144] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-26T19:19:21.707884] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-09-26T19:19:22.279058] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-26T19:19:22.285035] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-09-26T19:19:22.730174] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-26T19:19:22.739381] [INFO ] [REMOTE ] HNGE: Full fetch complete (27204 records). [2025-09-26T19:19:22.739508] [DEBUG] [VALIDATOR ] HNGE: Validating primary data. [2025-09-26T19:19:22.949668] [WARN ] [VALIDATOR ] HNGE: Validation failed - insufficient historical data. Have 88 unique days, need 200 days [2025-09-26T19:19:22.950207] [FATAL] [MAIN ] HNGE: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:19:22.950475] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:19:22.950591] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-26T19:19:22.950816] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-26T19:19:22.950954] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-09-26T19:19:22.951199] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-09-26T19:19:22.951387] [INFO ] [MAIN ] Update Progress: 1037/2371 symbols completed. HNGE took 9.6s. Estimated remaining: 2h 59m 14s. Rate: 7.4 symbols/min [2025-09-26T19:19:23.093442] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-26T19:19:23.105759] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-09-26T19:19:23.333800] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-26T19:19:23.345259] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-09-26T19:19:23.422413] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-26T19:19:23.428327] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-09-26T19:19:24.563170] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-26T19:19:24.569289] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-09-26T19:19:25.381988] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-26T19:19:25.410321] [INFO ] [REMOTE ] HMY: Full fetch complete (76669 records). [2025-09-26T19:19:25.424107] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-09-26T19:19:25.432504] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-26T19:19:25.527465] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-09-26T19:19:25.884479] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-26T19:19:25.907677] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-09-26T19:19:25.913196] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-09-26T19:19:25.914427] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-09-26T19:19:25.914882] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-09-26T19:19:25.915012] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-09-26T19:19:25.917970] [DEBUG] [LOCAL ] HMY: Trimmed 76669 records to 53914 (keeping 200 days of data) [2025-09-26T19:19:26.274166] [DEBUG] [LOCAL ] HMY: Primary data saved (53914 records). [2025-09-26T19:19:26.274415] [INFO ] [MAIN ] HMY: Full history saved. [2025-09-26T19:19:26.274595] [INFO ] [MAIN ] Update Progress: 1038/2371 symbols completed. HMY took 21.9s. Estimated remaining: 2h 59m 0s. Rate: 7.4 symbols/min [2025-09-26T19:19:27.405915] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-26T19:19:27.418772] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-09-26T19:19:27.608498] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-26T19:19:27.617727] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-09-26T19:19:29.117868] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-26T19:19:29.128515] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-09-26T19:19:29.263689] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T19:19:29.271392] [INFO ] [REMOTE ] HNI: Full fetch complete (41369 records). [2025-09-26T19:19:29.271549] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-09-26T19:19:29.665809] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-09-26T19:19:29.665903] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-09-26T19:19:29.666546] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-09-26T19:19:29.666587] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-09-26T19:19:29.668006] [DEBUG] [LOCAL ] HNI: Trimmed 41369 records to 29386 (keeping 200 days of data) [2025-09-26T19:19:29.852406] [DEBUG] [LOCAL ] HNI: Primary data saved (29386 records). [2025-09-26T19:19:29.852581] [INFO ] [MAIN ] HNI: Full history saved. [2025-09-26T19:19:29.852725] [INFO ] [MAIN ] Update Progress: 1039/2371 symbols completed. HNI took 15.2s. Estimated remaining: 2h 58m 46s. Rate: 7.5 symbols/min [2025-09-26T19:19:31.010391] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-26T19:19:31.022415] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-09-26T19:19:32.697038] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-26T19:19:32.709862] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-09-26T19:19:34.653804] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-26T19:19:34.665291] [INFO ] [REMOTE ] HOG: Full fetch complete (74238 records). [2025-09-26T19:19:34.665507] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-09-26T19:19:35.087307] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-09-26T19:19:35.087427] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-09-26T19:19:35.088625] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-09-26T19:19:35.088715] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-09-26T19:19:35.090958] [DEBUG] [LOCAL ] HOG: Trimmed 74238 records to 51958 (keeping 200 days of data) [2025-09-26T19:19:35.433271] [DEBUG] [LOCAL ] HOG: Primary data saved (51958 records). [2025-09-26T19:19:35.433451] [INFO ] [MAIN ] HOG: Full history saved. [2025-09-26T19:19:35.433563] [INFO ] [MAIN ] Update Progress: 1040/2371 symbols completed. HOG took 19.1s. Estimated remaining: 2h 58m 35s. Rate: 7.5 symbols/min [2025-09-26T19:19:36.120413] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:19:36.174446] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:19:36.241359] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:19:36.261492] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:19:36.277863] [DEBUG] [LOCAL ] HOV: Loaded 13886 existing records from primary storage. [2025-09-26T19:19:36.278419] [INFO ] [MAIN ] HOV: Loaded 13886 existing records. [2025-09-26T19:19:36.533422] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:19:36.548693] [DEBUG] [LOCAL ] HP: Loaded 51932 existing records from primary storage. [2025-09-26T19:19:36.566559] [INFO ] [MAIN ] HP: Loaded 51932 existing records. [2025-09-26T19:19:36.566390] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-09-26T19:19:36.581023] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-09-26T19:19:36.581837] [DEBUG] [LOCAL ] HOMB: Loaded 43979 existing records from primary storage. [2025-09-26T19:19:36.583168] [DEBUG] [LOCAL ] HOUS: Loaded 44514 existing records from primary storage. [2025-09-26T19:19:36.599376] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-09-26T19:19:36.599540] [INFO ] [MAIN ] HOUS: Loaded 44514 existing records. [2025-09-26T19:19:36.599630] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-09-26T19:19:36.611288] [INFO ] [MAIN ] HOMB: Loaded 43979 existing records. [2025-09-26T19:19:37.298878] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:19:37.473390] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:19:37.559939] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-09-26T19:19:37.609340] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-09-26T19:19:37.602917] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-09-26T19:19:37.609788] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-09-26T19:19:37.609573] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:19:37.620864] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-09-26T19:19:37.626257] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-09-26T19:19:37.644292] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-09-26T19:19:37.649175] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-09-26T19:19:37.649378] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-09-26T19:19:37.649491] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-09-26T19:19:37.813702] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-09-26T19:19:37.904883] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:19:37.936099] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-09-26T19:19:37.964707] [INFO ] [REMOTE ] HOV: Fetching primary data for 2024-12. [2025-09-26T19:19:38.811015] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:19:38.882775] [INFO ] [REMOTE ] HP: Fetching primary data for 2024-12. [2025-09-26T19:19:38.892781] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:19:38.904327] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2024-12. [2025-09-26T19:19:38.982842] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:19:38.983445] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2024-12. [2025-09-26T19:19:39.208841] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-26T19:19:39.212882] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-09-26T19:19:40.175261] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-26T19:19:40.178753] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-09-26T19:19:40.407698] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-26T19:19:40.416580] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-09-26T19:19:40.451931] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-26T19:19:40.462593] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-09-26T19:19:40.582046] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-26T19:19:40.593316] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-09-26T19:19:40.781930] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-26T19:19:40.784932] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-09-26T19:19:41.629458] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-26T19:19:41.632801] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-09-26T19:19:41.842236] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-26T19:19:41.851146] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-09-26T19:19:42.079126] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-26T19:19:42.089752] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-09-26T19:19:42.193240] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-26T19:19:42.203632] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-09-26T19:19:42.253564] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-26T19:19:42.257251] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-09-26T19:19:42.898389] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-26T19:19:42.901434] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-09-26T19:19:42.972170] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-26T19:19:42.980214] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-09-26T19:19:43.618811] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-26T19:19:43.630069] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-09-26T19:19:43.684283] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-26T19:19:43.686763] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-26T19:19:43.703230] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-09-26T19:19:43.703733] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-09-26T19:19:44.320295] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-26T19:19:44.329806] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-09-26T19:19:44.474012] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-26T19:19:44.478569] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-09-26T19:19:45.054684] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-26T19:19:45.064454] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-09-26T19:19:45.279060] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-26T19:19:45.283506] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-09-26T19:19:45.318109] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-26T19:19:45.328993] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-09-26T19:19:45.823370] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-26T19:19:45.832961] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-09-26T19:19:45.990965] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-26T19:19:45.994231] [INFO ] [REMOTE ] HOV: Full fetch complete (19403 records). [2025-09-26T19:19:45.994354] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-09-26T19:19:46.374729] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-09-26T19:19:46.374972] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-09-26T19:19:46.375447] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-09-26T19:19:46.375563] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-09-26T19:19:46.376189] [DEBUG] [LOCAL ] HOV: Trimmed 19403 records to 13975 (keeping 200 days of data) [2025-09-26T19:19:46.495530] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-26T19:19:46.508227] [DEBUG] [LOCAL ] HOV: Primary data saved (13975 records). [2025-09-26T19:19:46.508849] [INFO ] [MAIN ] HOV: Full history saved. [2025-09-26T19:19:46.508995] [INFO ] [MAIN ] Update Progress: 1041/2371 symbols completed. HOV took 11.1s. Estimated remaining: 2h 58m 31s. Rate: 7.5 symbols/min [2025-09-26T19:19:46.509469] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-09-26T19:19:46.689917] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:19:46.744230] [DEBUG] [LOCAL ] HPE: Loaded 54087 existing records from primary storage. [2025-09-26T19:19:46.744418] [INFO ] [MAIN ] HPE: Loaded 54087 existing records. [2025-09-26T19:19:46.935073] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:19:46.935438] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-09-26T19:19:46.935521] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-09-26T19:19:46.937378] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-09-26T19:19:46.937442] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-09-26T19:19:47.292365] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-26T19:19:47.363090] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-09-26T19:19:47.395400] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-26T19:19:47.471583] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:19:47.472329] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-09-26T19:19:47.472936] [INFO ] [REMOTE ] HPE: Fetching primary data for 2024-12. [2025-09-26T19:19:48.113698] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-26T19:19:48.122322] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-09-26T19:19:49.051218] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-26T19:19:49.062731] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-09-26T19:19:49.175807] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-26T19:19:49.185213] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-09-26T19:19:49.386804] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-26T19:19:49.396095] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-09-26T19:19:49.586028] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-26T19:19:49.597831] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-09-26T19:19:50.767276] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-26T19:19:50.777570] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-09-26T19:19:50.894961] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-26T19:19:50.907678] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-09-26T19:19:51.103279] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-26T19:19:51.114230] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-09-26T19:19:51.415223] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-26T19:19:51.426049] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-09-26T19:19:52.381130] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-26T19:19:52.391141] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-09-26T19:19:52.474217] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-26T19:19:52.483817] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-09-26T19:19:52.823275] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-26T19:19:52.835393] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-09-26T19:19:53.309773] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-26T19:19:53.320300] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-09-26T19:19:54.166694] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-26T19:19:54.176874] [INFO ] [REMOTE ] HOUS: Full fetch complete (63057 records). [2025-09-26T19:19:54.177115] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-09-26T19:19:54.449638] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-26T19:19:54.520136] [INFO ] [REMOTE ] HOMB: Full fetch complete (63885 records). [2025-09-26T19:19:54.548194] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-09-26T19:19:54.795454] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-09-26T19:19:54.795672] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-09-26T19:19:54.802136] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-09-26T19:19:54.812703] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-09-26T19:19:54.947876] [DEBUG] [LOCAL ] HOUS: Trimmed 63057 records to 44903 (keeping 200 days of data) [2025-09-26T19:19:54.974112] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-26T19:19:55.127929] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-09-26T19:19:55.275411] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-09-26T19:19:55.275989] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-09-26T19:19:55.277314] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-09-26T19:19:55.278538] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-09-26T19:19:55.284188] [DEBUG] [LOCAL ] HOMB: Trimmed 63885 records to 44272 (keeping 200 days of data) [2025-09-26T19:19:55.417204] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-26T19:19:55.433838] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-09-26T19:19:55.602876] [DEBUG] [LOCAL ] HOUS: Primary data saved (44903 records). [2025-09-26T19:19:55.603569] [INFO ] [MAIN ] HOUS: Full history saved. [2025-09-26T19:19:55.603767] [INFO ] [MAIN ] Update Progress: 1042/2371 symbols completed. HOUS took 20.2s. Estimated remaining: 2h 58m 24s. Rate: 7.4 symbols/min [2025-09-26T19:19:55.794582] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:19:55.806699] [DEBUG] [LOCAL ] HPF: Loaded 7349 existing records from primary storage. [2025-09-26T19:19:55.807423] [INFO ] [MAIN ] HPF: Loaded 7349 existing records. [2025-09-26T19:19:56.019533] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:19:56.021972] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-09-26T19:19:56.022093] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-09-26T19:19:56.022554] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-09-26T19:19:56.022618] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-09-26T19:19:56.618979] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:19:56.619121] [DEBUG] [LOCAL ] HOMB: Primary data saved (44272 records). [2025-09-26T19:19:56.619794] [INFO ] [MAIN ] HOMB: Full history saved. [2025-09-26T19:19:56.619565] [INFO ] [REMOTE ] HPF: Fetching primary data for 2024-12. [2025-09-26T19:19:56.620024] [INFO ] [MAIN ] Update Progress: 1043/2371 symbols completed. HOMB took 21.2s. Estimated remaining: 2h 58m 7s. Rate: 7.5 symbols/min [2025-09-26T19:19:56.811720] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:19:56.823741] [DEBUG] [LOCAL ] HPI: Loaded 10226 existing records from primary storage. [2025-09-26T19:19:56.824062] [INFO ] [MAIN ] HPI: Loaded 10226 existing records. [2025-09-26T19:19:57.018401] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:19:57.018924] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-09-26T19:19:57.019001] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-09-26T19:19:57.019626] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-09-26T19:19:57.019732] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-09-26T19:19:57.239471] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-26T19:19:57.363513] [INFO ] [REMOTE ] HP: Full fetch complete (73896 records). [2025-09-26T19:19:57.370024] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-09-26T19:19:57.492929] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:19:57.513185] [INFO ] [REMOTE ] HPI: Fetching primary data for 2024-12. [2025-09-26T19:19:57.599878] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-26T19:19:57.653998] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-09-26T19:19:57.932988] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-09-26T19:19:57.964713] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-09-26T19:19:57.965029] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-09-26T19:19:57.965411] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-09-26T19:19:57.968276] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-09-26T19:19:57.968517] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-09-26T19:19:57.971005] [DEBUG] [LOCAL ] HP: Trimmed 73896 records to 52313 (keeping 200 days of data) [2025-09-26T19:19:58.333760] [DEBUG] [LOCAL ] HP: Primary data saved (52313 records). [2025-09-26T19:19:58.333979] [INFO ] [MAIN ] HP: Full history saved. [2025-09-26T19:19:58.334115] [INFO ] [MAIN ] Update Progress: 1044/2371 symbols completed. HP took 22.9s. Estimated remaining: 2h 57m 51s. Rate: 7.5 symbols/min [2025-09-26T19:19:58.453363] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-26T19:19:58.456945] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-09-26T19:19:58.533636] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:19:58.542724] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-26T19:19:58.545863] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-09-26T19:19:58.596206] [DEBUG] [LOCAL ] HPP: Loaded 51214 existing records from primary storage. [2025-09-26T19:19:58.596489] [INFO ] [MAIN ] HPP: Loaded 51214 existing records. [2025-09-26T19:19:58.778850] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:19:58.779247] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-09-26T19:19:58.779300] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-09-26T19:19:58.780736] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-09-26T19:19:58.780800] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-09-26T19:19:59.171459] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:19:59.171935] [INFO ] [REMOTE ] HPP: Fetching primary data for 2024-12. [2025-09-26T19:19:59.184076] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-26T19:19:59.186605] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-09-26T19:19:59.270627] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-26T19:19:59.273378] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-09-26T19:19:59.819675] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-26T19:19:59.831273] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-09-26T19:19:59.898812] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-26T19:19:59.900953] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-09-26T19:19:59.922471] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-26T19:19:59.924855] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-09-26T19:20:00.450370] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-26T19:20:00.454268] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-09-26T19:20:00.669354] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-26T19:20:00.673025] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-09-26T19:20:00.883356] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-26T19:20:00.901972] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-09-26T19:20:01.037094] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-26T19:20:01.040289] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-09-26T19:20:01.406851] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-26T19:20:01.409140] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-09-26T19:20:01.552822] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-26T19:20:01.555289] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-09-26T19:20:01.998557] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-26T19:20:02.018012] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-09-26T19:20:02.228630] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-26T19:20:02.231148] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-09-26T19:20:02.445505] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-26T19:20:02.448972] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-09-26T19:20:02.699258] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-26T19:20:02.710075] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-09-26T19:20:02.772921] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-26T19:20:02.775820] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-09-26T19:20:03.204226] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-26T19:20:03.206733] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-09-26T19:20:03.327036] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-26T19:20:03.331445] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-09-26T19:20:03.890956] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-26T19:20:03.893528] [INFO ] [REMOTE ] HPF: Full fetch complete (10791 records). [2025-09-26T19:20:03.893713] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-09-26T19:20:04.307835] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-26T19:20:04.349846] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-09-26T19:20:04.349606] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-09-26T19:20:04.350107] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-09-26T19:20:04.351672] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-09-26T19:20:04.352126] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-09-26T19:20:04.353510] [DEBUG] [LOCAL ] HPF: Trimmed 10791 records to 7388 (keeping 200 days of data) [2025-09-26T19:20:04.438079] [DEBUG] [LOCAL ] HPF: Primary data saved (7388 records). [2025-09-26T19:20:04.439147] [INFO ] [MAIN ] HPF: Full history saved. [2025-09-26T19:20:04.441702] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-09-26T19:20:04.452593] [INFO ] [MAIN ] Update Progress: 1045/2371 symbols completed. HPF took 8.8s. Estimated remaining: 2h 57m 41s. Rate: 7.5 symbols/min [2025-09-26T19:20:04.502856] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-09-26T19:20:04.533513] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-26T19:20:04.609850] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-09-26T19:20:04.685548] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:20:04.745974] [DEBUG] [LOCAL ] HPQ: Loaded 54058 existing records from primary storage. [2025-09-26T19:20:04.746215] [INFO ] [MAIN ] HPQ: Loaded 54058 existing records. [2025-09-26T19:20:04.943134] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:20:04.943673] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-09-26T19:20:04.943745] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-09-26T19:20:04.945315] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-09-26T19:20:04.945379] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-09-26T19:20:05.319198] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:20:05.319640] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2024-12. [2025-09-26T19:20:05.482433] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-26T19:20:05.486334] [INFO ] [REMOTE ] HPI: Full fetch complete (13555 records). [2025-09-26T19:20:05.486442] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-09-26T19:20:05.875886] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-09-26T19:20:05.876017] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-09-26T19:20:05.876526] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-09-26T19:20:05.876592] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-09-26T19:20:05.877363] [DEBUG] [LOCAL ] HPI: Trimmed 13555 records to 10339 (keeping 200 days of data) [2025-09-26T19:20:05.948803] [DEBUG] [LOCAL ] HPI: Primary data saved (10339 records). [2025-09-26T19:20:05.949026] [INFO ] [MAIN ] HPI: Full history saved. [2025-09-26T19:20:05.949156] [INFO ] [MAIN ] Update Progress: 1046/2371 symbols completed. HPI took 9.3s. Estimated remaining: 2h 57m 24s. Rate: 7.5 symbols/min [2025-09-26T19:20:06.143061] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:20:06.156516] [DEBUG] [LOCAL ] HPS: Loaded 10230 existing records from primary storage. [2025-09-26T19:20:06.156728] [INFO ] [MAIN ] HPS: Loaded 10230 existing records. [2025-09-26T19:20:06.352855] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:20:06.353296] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-09-26T19:20:06.353463] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-09-26T19:20:06.354062] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-09-26T19:20:06.354124] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-09-26T19:20:06.601809] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-26T19:20:06.684144] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-09-26T19:20:06.800622] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:20:06.801324] [INFO ] [REMOTE ] HPS: Fetching primary data for 2024-12. [2025-09-26T19:20:06.878912] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-09-26T19:20:06.891347] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-09-26T19:20:07.478107] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-26T19:20:07.489080] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-09-26T19:20:07.714984] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-26T19:20:07.719490] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-09-26T19:20:08.374442] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-26T19:20:08.386711] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-09-26T19:20:08.505342] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-26T19:20:08.508181] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-09-26T19:20:08.743019] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-26T19:20:08.754621] [INFO ] [REMOTE ] HPE: Full fetch complete (77732 records). [2025-09-26T19:20:08.754873] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-09-26T19:20:09.187325] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-09-26T19:20:09.187423] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-09-26T19:20:09.188398] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-09-26T19:20:09.188468] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-09-26T19:20:09.190138] [DEBUG] [LOCAL ] HPE: Trimmed 77732 records to 54477 (keeping 200 days of data) [2025-09-26T19:20:09.291870] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-26T19:20:09.297314] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-09-26T19:20:09.574542] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-26T19:20:09.588960] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-09-26T19:20:09.609606] [DEBUG] [LOCAL ] HPE: Primary data saved (54477 records). [2025-09-26T19:20:09.609826] [INFO ] [MAIN ] HPE: Full history saved. [2025-09-26T19:20:09.609929] [INFO ] [MAIN ] Update Progress: 1047/2371 symbols completed. HPE took 23.1s. Estimated remaining: 2h 57m 11s. Rate: 7.5 symbols/min [2025-09-26T19:20:09.807908] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:20:09.839544] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-26T19:20:09.850727] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-09-26T19:20:09.873218] [DEBUG] [LOCAL ] HQH: Loaded 25135 existing records from primary storage. [2025-09-26T19:20:09.873390] [INFO ] [MAIN ] HQH: Loaded 25135 existing records. [2025-09-26T19:20:10.071290] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:20:10.071555] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-09-26T19:20:10.071603] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-09-26T19:20:10.072660] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-09-26T19:20:10.072730] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-09-26T19:20:10.194544] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-26T19:20:10.208870] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-09-26T19:20:10.465445] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:20:10.465824] [INFO ] [REMOTE ] HQH: Fetching primary data for 2024-12. [2025-09-26T19:20:11.122099] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-26T19:20:11.124625] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-09-26T19:20:11.260154] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-26T19:20:11.272108] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-09-26T19:20:11.384095] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-26T19:20:11.395778] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-09-26T19:20:11.898189] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-26T19:20:11.900823] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-09-26T19:20:11.929678] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-26T19:20:11.936538] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-09-26T19:20:12.467826] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-26T19:20:12.471142] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-09-26T19:20:12.892633] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-26T19:20:12.899121] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-09-26T19:20:13.000874] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-26T19:20:13.016037] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-09-26T19:20:13.078251] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-26T19:20:13.082340] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-09-26T19:20:13.139981] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-26T19:20:13.151910] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-09-26T19:20:13.661441] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-26T19:20:13.664329] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-09-26T19:20:14.036223] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-26T19:20:14.311732] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-09-26T19:20:14.413517] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-26T19:20:14.416065] [INFO ] [REMOTE ] HPS: Full fetch complete (15140 records). [2025-09-26T19:20:14.416146] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-09-26T19:20:14.830776] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-09-26T19:20:14.830906] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-09-26T19:20:14.831541] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-09-26T19:20:14.831758] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-09-26T19:20:14.832676] [DEBUG] [LOCAL ] HPS: Trimmed 15140 records to 10277 (keeping 200 days of data) [2025-09-26T19:20:14.920450] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-26T19:20:14.969414] [DEBUG] [LOCAL ] HPS: Primary data saved (10277 records). [2025-09-26T19:20:14.973019] [INFO ] [MAIN ] HPS: Full history saved. [2025-09-26T19:20:14.973369] [INFO ] [MAIN ] Update Progress: 1048/2371 symbols completed. HPS took 9.0s. Estimated remaining: 2h 56m 59s. Rate: 7.5 symbols/min [2025-09-26T19:20:14.975258] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-26T19:20:15.116833] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-09-26T19:20:15.177416] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:20:15.203237] [DEBUG] [LOCAL ] HQL: Loaded 15972 existing records from primary storage. [2025-09-26T19:20:15.203436] [INFO ] [MAIN ] HQL: Loaded 15972 existing records. [2025-09-26T19:20:15.334770] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-26T19:20:15.421233] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:20:15.421561] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-09-26T19:20:15.421613] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-09-26T19:20:15.422304] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-09-26T19:20:15.422367] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-09-26T19:20:15.814121] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:20:15.911766] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-09-26T19:20:16.711754] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-09-26T19:20:17.069825] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-26T19:20:17.459838] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-26T19:20:17.511767] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-09-26T19:20:18.311742] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-09-26T19:20:18.814576] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-26T19:20:18.825049] [INFO ] [REMOTE ] HPP: Full fetch complete (73375 records). [2025-09-26T19:20:18.825205] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-09-26T19:20:19.116612] [INFO ] [REMOTE ] HQL: Fetching primary data for 2024-12. [2025-09-26T19:20:19.270330] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-09-26T19:20:19.270482] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-09-26T19:20:19.272069] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-09-26T19:20:19.272160] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-09-26T19:20:19.274727] [DEBUG] [LOCAL ] HPP: Trimmed 73375 records to 51595 (keeping 200 days of data) [2025-09-26T19:20:19.402185] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-26T19:20:19.640458] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-26T19:20:19.659328] [DEBUG] [LOCAL ] HPP: Primary data saved (51595 records). [2025-09-26T19:20:19.659539] [INFO ] [MAIN ] HPP: Full history saved. [2025-09-26T19:20:19.659677] [INFO ] [MAIN ] Update Progress: 1049/2371 symbols completed. HPP took 21.3s. Estimated remaining: 2h 56m 47s. Rate: 7.5 symbols/min [2025-09-26T19:20:19.838708] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:20:19.851703] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-26T19:20:19.910620] [DEBUG] [LOCAL ] HR: Loaded 52347 existing records from primary storage. [2025-09-26T19:20:19.910887] [INFO ] [MAIN ] HR: Loaded 52347 existing records. [2025-09-26T19:20:19.917044] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-09-26T19:20:20.126383] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:20:20.139075] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-09-26T19:20:20.139335] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-09-26T19:20:20.141092] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-09-26T19:20:20.141213] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-09-26T19:20:20.547039] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:20:20.711786] [INFO ] [REMOTE ] HR: Fetching primary data for 2024-12. [2025-09-26T19:20:21.511896] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-09-26T19:20:22.101139] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-26T19:20:22.311693] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-09-26T19:20:22.434701] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-26T19:20:22.438665] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-26T19:20:23.111704] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-09-26T19:20:23.317077] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-26T19:20:23.911748] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-09-26T19:20:24.711740] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-09-26T19:20:24.950152] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-26T19:20:24.990513] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-26T19:20:25.511696] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-09-26T19:20:25.991873] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-26T19:20:26.311751] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-09-26T19:20:26.851498] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-26T19:20:27.111751] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-09-26T19:20:27.911736] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-09-26T19:20:28.365171] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-26T19:20:28.438210] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-26T19:20:28.449942] [INFO ] [REMOTE ] HPQ: Full fetch complete (77668 records). [2025-09-26T19:20:28.450155] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-09-26T19:20:28.716897] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-09-26T19:20:28.926133] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-09-26T19:20:28.926253] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-09-26T19:20:28.927300] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-09-26T19:20:28.927374] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-09-26T19:20:28.929637] [DEBUG] [LOCAL ] HPQ: Trimmed 77668 records to 54448 (keeping 200 days of data) [2025-09-26T19:20:29.060258] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-26T19:20:29.328747] [DEBUG] [LOCAL ] HPQ: Primary data saved (54448 records). [2025-09-26T19:20:29.328940] [INFO ] [MAIN ] HPQ: Full history saved. [2025-09-26T19:20:29.329101] [INFO ] [MAIN ] Update Progress: 1050/2371 symbols completed. HPQ took 24.9s. Estimated remaining: 2h 56m 41s. Rate: 7.5 symbols/min [2025-09-26T19:20:29.517712] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-09-26T19:20:29.517579] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:20:29.574157] [DEBUG] [LOCAL ] HRB: Loaded 48936 existing records from primary storage. [2025-09-26T19:20:29.574345] [INFO ] [MAIN ] HRB: Loaded 48936 existing records. [2025-09-26T19:20:29.778729] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:20:29.779083] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-09-26T19:20:29.779143] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-09-26T19:20:29.780740] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-09-26T19:20:29.780806] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-09-26T19:20:30.176760] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:20:30.232112] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-26T19:20:30.311734] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-09-26T19:20:30.908619] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-26T19:20:30.914879] [INFO ] [REMOTE ] HQH: Full fetch complete (37356 records). [2025-09-26T19:20:30.915084] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-09-26T19:20:31.122337] [INFO ] [REMOTE ] HRB: Fetching primary data for 2024-12. [2025-09-26T19:20:31.355238] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-09-26T19:20:31.355350] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-09-26T19:20:31.356106] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-09-26T19:20:31.356188] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-09-26T19:20:31.357197] [DEBUG] [LOCAL ] HQH: Trimmed 37356 records to 25387 (keeping 200 days of data) [2025-09-26T19:20:31.529182] [DEBUG] [LOCAL ] HQH: Primary data saved (25387 records). [2025-09-26T19:20:31.529343] [INFO ] [MAIN ] HQH: Full history saved. [2025-09-26T19:20:31.529496] [INFO ] [MAIN ] Update Progress: 1051/2371 symbols completed. HQH took 21.9s. Estimated remaining: 2h 56m 26s. Rate: 7.5 symbols/min [2025-09-26T19:20:31.713212] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:20:31.766801] [DEBUG] [LOCAL ] HRI: Loaded 33319 existing records from primary storage. [2025-09-26T19:20:31.766977] [INFO ] [MAIN ] HRI: Loaded 33319 existing records. [2025-09-26T19:20:31.916877] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-09-26T19:20:31.976235] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:20:31.976938] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-09-26T19:20:31.977072] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-09-26T19:20:31.978285] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-09-26T19:20:31.978363] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-09-26T19:20:32.330546] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-26T19:20:32.473858] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:20:32.711744] [INFO ] [REMOTE ] HRI: Fetching primary data for 2024-12. [2025-09-26T19:20:32.853628] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-26T19:20:33.005251] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-26T19:20:33.511763] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-09-26T19:20:33.945938] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-26T19:20:34.311752] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-09-26T19:20:35.111730] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-09-26T19:20:35.142582] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-26T19:20:35.303313] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-26T19:20:35.911743] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-09-26T19:20:36.348227] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-26T19:20:36.711769] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-09-26T19:20:36.746629] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-26T19:20:37.511723] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-09-26T19:20:38.311720] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-09-26T19:20:38.466404] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-26T19:20:39.096573] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-26T19:20:39.111683] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-09-26T19:20:39.300395] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-26T19:20:39.911742] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-09-26T19:20:40.261320] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-26T19:20:40.711739] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-09-26T19:20:41.515384] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-09-26T19:20:41.521925] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-26T19:20:41.710445] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-26T19:20:42.311744] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-09-26T19:20:43.111707] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-09-26T19:20:43.221924] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-26T19:20:43.767408] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-26T19:20:43.911729] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-09-26T19:20:44.230682] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-26T19:20:44.234297] [INFO ] [REMOTE ] HQL: Full fetch complete (24405 records). [2025-09-26T19:20:44.234384] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-09-26T19:20:44.642818] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-09-26T19:20:44.642915] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-09-26T19:20:44.643455] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-09-26T19:20:44.643517] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-09-26T19:20:44.644792] [DEBUG] [LOCAL ] HQL: Trimmed 24405 records to 16206 (keeping 200 days of data) [2025-09-26T19:20:44.727321] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-09-26T19:20:44.759038] [DEBUG] [LOCAL ] HQL: Primary data saved (16206 records). [2025-09-26T19:20:44.759221] [INFO ] [MAIN ] HQL: Full history saved. [2025-09-26T19:20:44.759337] [INFO ] [MAIN ] Update Progress: 1052/2371 symbols completed. HQL took 29.8s. Estimated remaining: 2h 56m 24s. Rate: 7.5 symbols/min [2025-09-26T19:20:44.945223] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:20:45.010893] [DEBUG] [LOCAL ] HRL: Loaded 53474 existing records from primary storage. [2025-09-26T19:20:45.011089] [INFO ] [MAIN ] HRL: Loaded 53474 existing records. [2025-09-26T19:20:45.220804] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:20:45.221327] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-09-26T19:20:45.221400] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-09-26T19:20:45.223073] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-09-26T19:20:45.223143] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-09-26T19:20:45.362998] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-26T19:20:45.518988] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-09-26T19:20:45.656012] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:20:46.311724] [INFO ] [REMOTE ] HRL: Fetching primary data for 2024-12. [2025-09-26T19:20:46.633981] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-26T19:20:47.017542] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-26T19:20:47.111737] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-09-26T19:20:47.911735] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-09-26T19:20:48.081029] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-26T19:20:48.657103] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-26T19:20:48.711717] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-09-26T19:20:49.511700] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-09-26T19:20:49.700704] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-26T19:20:50.311768] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-09-26T19:20:50.459339] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-26T19:20:50.833107] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-26T19:20:51.111744] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-09-26T19:20:51.911709] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-09-26T19:20:52.044817] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-26T19:20:52.186427] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-26T19:20:52.711752] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-09-26T19:20:53.511739] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-09-26T19:20:53.627776] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-26T19:20:54.169637] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-26T19:20:54.311796] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-09-26T19:20:55.111744] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-09-26T19:20:55.284952] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-26T19:20:55.852699] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-26T19:20:55.859172] [INFO ] [REMOTE ] HRI: Full fetch complete (46062 records). [2025-09-26T19:20:55.859334] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-09-26T19:20:55.921756] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-09-26T19:20:56.268621] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-09-26T19:20:56.268756] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-09-26T19:20:56.269490] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-09-26T19:20:56.269553] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-09-26T19:20:56.270770] [DEBUG] [LOCAL ] HRI: Trimmed 46062 records to 33507 (keeping 200 days of data) [2025-09-26T19:20:56.493690] [DEBUG] [LOCAL ] HRI: Primary data saved (33507 records). [2025-09-26T19:20:56.493894] [INFO ] [MAIN ] HRI: Full history saved. [2025-09-26T19:20:56.494024] [INFO ] [MAIN ] Update Progress: 1053/2371 symbols completed. HRI took 25.0s. Estimated remaining: 2h 56m 21s. Rate: 7.5 symbols/min [2025-09-26T19:20:56.683189] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:20:56.711713] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-09-26T19:20:56.728521] [DEBUG] [LOCAL ] HRTG: Loaded 33404 existing records from primary storage. [2025-09-26T19:20:56.728740] [INFO ] [MAIN ] HRTG: Loaded 33404 existing records. [2025-09-26T19:20:56.934038] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:20:56.934547] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-09-26T19:20:56.934687] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-09-26T19:20:56.945607] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-09-26T19:20:56.965374] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-09-26T19:20:57.008411] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-26T19:20:57.087368] [INFO ] [REMOTE ] HR: Full fetch complete (74846 records). [2025-09-26T19:20:57.105318] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-09-26T19:20:57.669608] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:20:57.683542] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2024-12. [2025-09-26T19:20:57.842241] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-09-26T19:20:57.842354] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-09-26T19:20:57.843369] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-09-26T19:20:57.843526] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-09-26T19:20:57.873717] [DEBUG] [LOCAL ] HR: Trimmed 74846 records to 52716 (keeping 200 days of data) [2025-09-26T19:20:57.875065] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-26T19:20:58.232286] [DEBUG] [LOCAL ] HR: Primary data saved (52716 records). [2025-09-26T19:20:58.232490] [INFO ] [MAIN ] HR: Full history saved. [2025-09-26T19:20:58.232637] [INFO ] [MAIN ] Update Progress: 1054/2371 symbols completed. HR took 38.6s. Estimated remaining: 2h 56m 5s. Rate: 7.5 symbols/min [2025-09-26T19:20:58.314512] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-09-26T19:20:58.419826] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:20:58.474187] [DEBUG] [LOCAL ] HSBC: Loaded 51502 existing records from primary storage. [2025-09-26T19:20:58.474348] [INFO ] [MAIN ] HSBC: Loaded 51502 existing records. [2025-09-26T19:20:58.663989] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:20:58.664509] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-09-26T19:20:58.664570] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-09-26T19:20:58.676762] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-09-26T19:20:58.695482] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-09-26T19:20:58.745229] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-26T19:20:59.036529] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-26T19:20:59.116857] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-09-26T19:20:59.159924] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:20:59.829239] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-26T19:20:59.911732] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-09-26T19:21:00.723473] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-09-26T19:21:00.730382] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-26T19:21:01.511707] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2024-12. [2025-09-26T19:21:01.692752] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-26T19:21:01.733388] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-26T19:21:02.311726] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-09-26T19:21:03.111705] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-09-26T19:21:03.292439] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-26T19:21:03.318969] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-26T19:21:03.911743] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-09-26T19:21:04.711728] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-09-26T19:21:05.005227] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-26T19:21:05.015068] [INFO ] [REMOTE ] HRB: Full fetch complete (69782 records). [2025-09-26T19:21:05.015233] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-09-26T19:21:05.446049] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-09-26T19:21:05.446239] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-09-26T19:21:05.447324] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-09-26T19:21:05.447426] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-09-26T19:21:05.449149] [DEBUG] [LOCAL ] HRB: Trimmed 69782 records to 49275 (keeping 200 days of data) [2025-09-26T19:21:05.519541] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-09-26T19:21:05.582146] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-26T19:21:05.821461] [DEBUG] [LOCAL ] HRB: Primary data saved (49275 records). [2025-09-26T19:21:05.821708] [INFO ] [MAIN ] HRB: Full history saved. [2025-09-26T19:21:05.821842] [INFO ] [MAIN ] Update Progress: 1055/2371 symbols completed. HRB took 36.5s. Estimated remaining: 2h 55m 56s. Rate: 7.5 symbols/min [2025-09-26T19:21:05.998051] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:21:06.016739] [DEBUG] [LOCAL ] HSHP: Loaded 15656 existing records from primary storage. [2025-09-26T19:21:06.016903] [INFO ] [MAIN ] HSHP: Loaded 15656 existing records. [2025-09-26T19:21:06.210010] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:21:06.210455] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-09-26T19:21:06.210537] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-09-26T19:21:06.211426] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-09-26T19:21:06.211498] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-09-26T19:21:06.312726] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-09-26T19:21:06.530684] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-26T19:21:06.644175] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:21:06.662271] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-26T19:21:07.111797] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-09-26T19:21:07.911731] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-09-26T19:21:08.049832] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-26T19:21:08.548828] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-26T19:21:08.711729] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2024-12. [2025-09-26T19:21:09.511772] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-09-26T19:21:09.715460] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-26T19:21:10.136328] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-26T19:21:10.311737] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-09-26T19:21:11.111755] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-09-26T19:21:11.325366] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-26T19:21:11.381712] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-26T19:21:11.911759] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-09-26T19:21:12.711739] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-09-26T19:21:13.200572] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-26T19:21:13.473150] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-26T19:21:13.511677] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-09-26T19:21:13.754077] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-26T19:21:14.311743] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-09-26T19:21:14.960060] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-26T19:21:15.111773] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-09-26T19:21:15.320729] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-26T19:21:15.911734] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-09-26T19:21:16.711757] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-09-26T19:21:17.199982] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-26T19:21:17.380624] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-26T19:21:17.511730] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-09-26T19:21:18.311710] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-09-26T19:21:18.663682] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-26T19:21:18.898179] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-26T19:21:19.111734] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-09-26T19:21:19.339232] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-26T19:21:19.911745] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-09-26T19:21:20.711735] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-09-26T19:21:20.783057] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-26T19:21:21.089749] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-26T19:21:21.511760] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-09-26T19:21:22.311771] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-09-26T19:21:22.357154] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T19:21:22.365268] [INFO ] [REMOTE ] HRTG: Full fetch complete (42599 records). [2025-09-26T19:21:22.365485] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-09-26T19:21:22.715787] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-26T19:21:22.811770] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-09-26T19:21:22.811877] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-09-26T19:21:22.812679] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-09-26T19:21:22.812749] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-09-26T19:21:22.814176] [DEBUG] [LOCAL ] HRTG: Trimmed 42599 records to 33658 (keeping 200 days of data) [2025-09-26T19:21:23.043237] [DEBUG] [LOCAL ] HRTG: Primary data saved (33658 records). [2025-09-26T19:21:23.043470] [INFO ] [MAIN ] HRTG: Full history saved. [2025-09-26T19:21:23.043700] [INFO ] [MAIN ] Update Progress: 1056/2371 symbols completed. HRTG took 26.5s. Estimated remaining: 2h 55m 60s. Rate: 7.5 symbols/min [2025-09-26T19:21:23.116881] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-09-26T19:21:23.235950] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:21:23.291926] [DEBUG] [LOCAL ] HSY: Loaded 50791 existing records from primary storage. [2025-09-26T19:21:23.292136] [INFO ] [MAIN ] HSY: Loaded 50791 existing records. [2025-09-26T19:21:23.489042] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:21:23.489338] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-09-26T19:21:23.489386] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-09-26T19:21:23.490887] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-09-26T19:21:23.490954] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-09-26T19:21:23.891145] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:21:23.911699] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-09-26T19:21:24.145005] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-26T19:21:24.411073] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-26T19:21:24.422409] [INFO ] [REMOTE ] HRL: Full fetch complete (76682 records). [2025-09-26T19:21:24.422594] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-09-26T19:21:24.716908] [INFO ] [REMOTE ] HSY: Fetching primary data for 2024-12. [2025-09-26T19:21:24.870680] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-09-26T19:21:24.870804] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-09-26T19:21:24.871880] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-09-26T19:21:24.871983] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-09-26T19:21:24.873855] [DEBUG] [LOCAL ] HRL: Trimmed 76682 records to 53855 (keeping 200 days of data) [2025-09-26T19:21:25.234307] [DEBUG] [LOCAL ] HRL: Primary data saved (53855 records). [2025-09-26T19:21:25.234567] [INFO ] [MAIN ] HRL: Full history saved. [2025-09-26T19:21:25.235962] [INFO ] [MAIN ] Update Progress: 1057/2371 symbols completed. HRL took 40.5s. Estimated remaining: 2h 55m 45s. Rate: 7.5 symbols/min [2025-09-26T19:21:25.445204] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:21:25.445536] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-09-26T19:21:25.445677] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-09-26T19:21:25.445849] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-09-26T19:21:25.445906] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-26T19:21:25.445979] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-26T19:21:25.446037] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-09-26T19:21:25.513964] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-09-26T19:21:25.890964] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:21:25.923299] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-26T19:21:26.267044] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-26T19:21:26.311751] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-12. [2025-09-26T19:21:26.531546] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:21:26.531987] [WARN ] [REMOTE ] HTB: No data returned for month 2024-12 [2025-09-26T19:21:26.640419] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-26T19:21:27.111718] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-01. [2025-09-26T19:21:27.473090] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:21:27.473455] [WARN ] [REMOTE ] HTB: No data returned for month 2025-01 [2025-09-26T19:21:27.911727] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-09-26T19:21:28.711778] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-09-26T19:21:29.511771] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-09-26T19:21:29.838735] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-26T19:21:29.843033] [INFO ] [REMOTE ] HSHP: Full fetch complete (23441 records). [2025-09-26T19:21:29.843195] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-09-26T19:21:30.067230] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-26T19:21:30.313364] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-09-26T19:21:30.313113] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-02. [2025-09-26T19:21:30.314489] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-09-26T19:21:30.315219] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-09-26T19:21:30.315287] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-09-26T19:21:30.316426] [DEBUG] [LOCAL ] HSHP: Trimmed 23441 records to 15773 (keeping 200 days of data) [2025-09-26T19:21:30.417126] [DEBUG] [LOCAL ] HSHP: Primary data saved (15773 records). [2025-09-26T19:21:30.417301] [INFO ] [MAIN ] HSHP: Full history saved. [2025-09-26T19:21:30.417412] [INFO ] [MAIN ] Update Progress: 1058/2371 symbols completed. HSHP took 24.6s. Estimated remaining: 2h 55m 33s. Rate: 7.5 symbols/min [2025-09-26T19:21:30.630842] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:21:30.626499] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-26T19:21:30.647975] [DEBUG] [LOCAL ] HTD: Loaded 13643 existing records from primary storage. [2025-09-26T19:21:30.648134] [INFO ] [MAIN ] HTD: Loaded 13643 existing records. [2025-09-26T19:21:30.836434] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:21:30.836811] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-09-26T19:21:30.836867] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-09-26T19:21:30.837575] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-09-26T19:21:30.837639] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-09-26T19:21:31.116895] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-03. [2025-09-26T19:21:31.241926] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:21:31.273953] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-26T19:21:31.911710] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-09-26T19:21:31.986858] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-26T19:21:32.711731] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-04. [2025-09-26T19:21:33.436914] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-26T19:21:33.511703] [INFO ] [REMOTE ] HTD: Fetching primary data for 2024-12. [2025-09-26T19:21:33.818388] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-26T19:21:34.179163] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-26T19:21:34.311725] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-09-26T19:21:35.111743] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-09-26T19:21:35.127124] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-26T19:21:35.911740] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-09-26T19:21:36.658213] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-26T19:21:36.711688] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-09-26T19:21:36.985885] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-26T19:21:37.511731] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-09-26T19:21:38.311720] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-09-26T19:21:38.434770] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-26T19:21:38.702477] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-26T19:21:39.111767] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-05. [2025-09-26T19:21:39.868563] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-26T19:21:39.911705] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-09-26T19:21:39.944420] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-26T19:21:40.711729] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-09-26T19:21:41.511758] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-09-26T19:21:41.626269] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-26T19:21:41.636462] [INFO ] [REMOTE ] HSBC: Full fetch complete (73676 records). [2025-09-26T19:21:41.636743] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-09-26T19:21:42.074542] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-09-26T19:21:42.074719] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-09-26T19:21:42.075748] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-09-26T19:21:42.075815] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-09-26T19:21:42.077699] [DEBUG] [LOCAL ] HSBC: Trimmed 73676 records to 51868 (keeping 200 days of data) [2025-09-26T19:21:42.312761] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-06. [2025-09-26T19:21:42.429820] [DEBUG] [LOCAL ] HSBC: Primary data saved (51868 records). [2025-09-26T19:21:42.430023] [INFO ] [MAIN ] HSBC: Full history saved. [2025-09-26T19:21:42.430160] [INFO ] [MAIN ] Update Progress: 1059/2371 symbols completed. HSBC took 44.2s. Estimated remaining: 2h 55m 30s. Rate: 7.5 symbols/min [2025-09-26T19:21:42.597773] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-26T19:21:42.650240] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:21:42.650739] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-09-26T19:21:42.650817] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-09-26T19:21:42.651116] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-09-26T19:21:42.651176] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-26T19:21:42.651421] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-26T19:21:42.651480] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-09-26T19:21:42.780719] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-26T19:21:43.070907] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-26T19:21:43.076622] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:21:43.111697] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-07. [2025-09-26T19:21:43.619128] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-26T19:21:43.911758] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-09-26T19:21:44.711790] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-09-26T19:21:45.511744] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-12. [2025-09-26T19:21:45.581434] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-26T19:21:45.618459] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-26T19:21:45.891337] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-09-26T19:21:46.311967] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-09-26T19:21:46.661242] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-26T19:21:47.111770] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-08. [2025-09-26T19:21:47.815776] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-26T19:21:47.911741] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-09-26T19:21:48.240638] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-26T19:21:48.711739] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-09-26T19:21:49.511711] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-09-26T19:21:49.586185] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-26T19:21:49.842216] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-26T19:21:50.311796] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-09-26T19:21:51.111738] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-09. [2025-09-26T19:21:51.346077] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-26T19:21:51.911734] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-09-26T19:21:52.045604] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-26T19:21:52.048514] [INFO ] [REMOTE ] HTB: Full fetch complete (7890 records). [2025-09-26T19:21:52.048633] [DEBUG] [VALIDATOR ] HTB: Validating primary data. [2025-09-26T19:21:52.251474] [WARN ] [VALIDATOR ] HTB: Validation failed - insufficient historical data. Have 146 unique days, need 200 days [2025-09-26T19:21:52.251784] [FATAL] [MAIN ] HTB: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:21:52.251858] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:21:52.251957] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-26T19:21:52.252085] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-26T19:21:52.252158] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-09-26T19:21:52.252240] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-09-26T19:21:52.252328] [INFO ] [MAIN ] Update Progress: 1060/2371 symbols completed. HTB took 27.0s. Estimated remaining: 2h 55m 24s. Rate: 7.5 symbols/min [2025-09-26T19:21:52.439523] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:21:52.503158] [DEBUG] [LOCAL ] HTGC: Loaded 47908 existing records from primary storage. [2025-09-26T19:21:52.503355] [INFO ] [MAIN ] HTGC: Loaded 47908 existing records. [2025-09-26T19:21:52.698233] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:21:52.698500] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-09-26T19:21:52.698549] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-09-26T19:21:52.699969] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-09-26T19:21:52.700031] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-09-26T19:21:52.721033] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-09-26T19:21:53.087681] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:21:53.511732] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-09-26T19:21:53.613831] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-26T19:21:53.841500] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-26T19:21:53.958876] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-26T19:21:54.311748] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-09-26T19:21:55.111735] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-09-26T19:21:55.911736] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-09-26T19:21:56.140049] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-26T19:21:56.204783] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-26T19:21:56.208258] [INFO ] [REMOTE ] HTD: Full fetch complete (18946 records). [2025-09-26T19:21:56.208342] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-09-26T19:21:56.298453] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-26T19:21:56.618551] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-09-26T19:21:56.618664] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-09-26T19:21:56.619121] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-09-26T19:21:56.619205] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-09-26T19:21:56.620054] [DEBUG] [LOCAL ] HTD: Trimmed 18946 records to 13754 (keeping 200 days of data) [2025-09-26T19:21:56.709975] [DEBUG] [LOCAL ] HTD: Primary data saved (13754 records). [2025-09-26T19:21:56.710153] [INFO ] [MAIN ] HTD: Full history saved. [2025-09-26T19:21:56.710249] [INFO ] [MAIN ] Update Progress: 1061/2371 symbols completed. HTD took 26.3s. Estimated remaining: 2h 55m 12s. Rate: 7.5 symbols/min [2025-09-26T19:21:56.716937] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2024-12. [2025-09-26T19:21:56.904751] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:21:56.939292] [DEBUG] [LOCAL ] HTH: Loaded 32572 existing records from primary storage. [2025-09-26T19:21:56.939483] [INFO ] [MAIN ] HTH: Loaded 32572 existing records. [2025-09-26T19:21:57.139990] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:21:57.140295] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-09-26T19:21:57.140348] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-09-26T19:21:57.141606] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-09-26T19:21:57.141699] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-09-26T19:21:57.522528] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-09-26T19:21:57.530527] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:21:58.311736] [INFO ] [REMOTE ] HTH: Fetching primary data for 2024-12. [2025-09-26T19:21:58.464246] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-26T19:21:59.111708] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-09-26T19:21:59.409924] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-26T19:21:59.420174] [INFO ] [REMOTE ] HSY: Full fetch complete (73779 records). [2025-09-26T19:21:59.420343] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-09-26T19:21:59.471003] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-26T19:21:59.554174] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-26T19:21:59.868958] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-09-26T19:21:59.869064] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-09-26T19:21:59.870026] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-09-26T19:21:59.870099] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-09-26T19:21:59.871823] [DEBUG] [LOCAL ] HSY: Trimmed 73779 records to 51161 (keeping 200 days of data) [2025-09-26T19:21:59.927913] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-09-26T19:22:00.216404] [DEBUG] [LOCAL ] HSY: Primary data saved (51161 records). [2025-09-26T19:22:00.216580] [INFO ] [MAIN ] HSY: Full history saved. [2025-09-26T19:22:00.216721] [INFO ] [MAIN ] Update Progress: 1062/2371 symbols completed. HSY took 37.2s. Estimated remaining: 2h 54m 58s. Rate: 7.5 symbols/min [2025-09-26T19:22:00.443838] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:22:00.483670] [DEBUG] [LOCAL ] HUBB: Loaded 37414 existing records from primary storage. [2025-09-26T19:22:00.483861] [INFO ] [MAIN ] HUBB: Loaded 37414 existing records. [2025-09-26T19:22:00.686048] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:22:00.686332] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-09-26T19:22:00.686383] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-09-26T19:22:00.687707] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-09-26T19:22:00.687770] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-09-26T19:22:00.720791] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-09-26T19:22:01.079124] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:22:01.511758] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-09-26T19:22:01.769003] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-26T19:22:01.845049] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-26T19:22:02.252329] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-26T19:22:02.311775] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-09-26T19:22:03.111727] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2024-12. [2025-09-26T19:22:03.835905] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-26T19:22:03.911732] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-09-26T19:22:04.128625] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-26T19:22:04.711773] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-09-26T19:22:05.488987] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-26T19:22:05.511684] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-09-26T19:22:05.589553] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-26T19:22:05.745785] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-09-26T19:22:06.311744] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-09-26T19:22:07.111736] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-09-26T19:22:07.738402] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-26T19:22:07.911733] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-09-26T19:22:08.365089] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-26T19:22:08.366101] [INFO ] [REMOTE ] HTFC: Full fetch complete (837 records). [2025-09-26T19:22:08.366177] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-09-26T19:22:08.603249] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-26T19:22:08.607910] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-09-26T19:22:08.615760] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:22:08.616340] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:22:08.616902] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-26T19:22:08.617060] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-26T19:22:08.617132] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-09-26T19:22:08.617219] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-09-26T19:22:08.617337] [INFO ] [MAIN ] Update Progress: 1063/2371 symbols completed. HTFC took 26.2s. Estimated remaining: 2h 54m 51s. Rate: 7.5 symbols/min [2025-09-26T19:22:08.716873] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-09-26T19:22:08.828611] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:22:08.892462] [DEBUG] [LOCAL ] HUBS: Loaded 39738 existing records from primary storage. [2025-09-26T19:22:08.892670] [INFO ] [MAIN ] HUBS: Loaded 39738 existing records. [2025-09-26T19:22:09.095935] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:22:09.096413] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-09-26T19:22:09.096481] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-09-26T19:22:09.098269] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-09-26T19:22:09.098359] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-09-26T19:22:09.525933] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-09-26T19:22:09.533030] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:22:10.311703] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2024-12. [2025-09-26T19:22:10.481183] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-26T19:22:11.111775] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-09-26T19:22:11.242865] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-26T19:22:11.718713] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-26T19:22:11.911722] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-09-26T19:22:12.711751] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-09-26T19:22:12.831144] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-26T19:22:13.344378] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-26T19:22:13.511740] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-09-26T19:22:14.311737] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-09-26T19:22:14.527120] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-26T19:22:14.775925] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-26T19:22:15.111756] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-09-26T19:22:15.524935] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-26T19:22:15.911732] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-09-26T19:22:16.711748] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-09-26T19:22:17.019749] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-26T19:22:17.504160] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-26T19:22:17.512484] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-09-26T19:22:18.242303] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-26T19:22:18.311726] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-09-26T19:22:18.967792] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-26T19:22:19.111724] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-09-26T19:22:19.911737] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-09-26T19:22:19.977029] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-26T19:22:20.541518] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-26T19:22:20.711743] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-09-26T19:22:21.275201] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-26T19:22:21.511778] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-09-26T19:22:22.250929] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-26T19:22:22.311731] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-09-26T19:22:22.996258] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-26T19:22:23.002534] [INFO ] [REMOTE ] HTH: Full fetch complete (46708 records). [2025-09-26T19:22:23.002677] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-09-26T19:22:23.112606] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-09-26T19:22:23.410967] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-09-26T19:22:23.411074] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-09-26T19:22:23.411817] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-09-26T19:22:23.411885] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-09-26T19:22:23.413127] [DEBUG] [LOCAL ] HTH: Trimmed 46708 records to 32696 (keeping 200 days of data) [2025-09-26T19:22:23.629801] [DEBUG] [LOCAL ] HTH: Primary data saved (32696 records). [2025-09-26T19:22:23.629962] [INFO ] [MAIN ] HTH: Full history saved. [2025-09-26T19:22:23.630103] [INFO ] [MAIN ] Update Progress: 1064/2371 symbols completed. HTH took 26.9s. Estimated remaining: 2h 54m 51s. Rate: 7.5 symbols/min [2025-09-26T19:22:23.821341] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:22:23.846070] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-26T19:22:23.900906] [DEBUG] [LOCAL ] HUM: Loaded 49222 existing records from primary storage. [2025-09-26T19:22:23.901089] [INFO ] [MAIN ] HUM: Loaded 49222 existing records. [2025-09-26T19:22:23.916835] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-09-26T19:22:24.101941] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:22:24.102270] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-09-26T19:22:24.102361] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-09-26T19:22:24.104332] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-09-26T19:22:24.104412] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-09-26T19:22:24.530366] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:22:24.711743] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-09-26T19:22:24.987387] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-26T19:22:25.374551] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-26T19:22:25.511760] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-09-26T19:22:25.982404] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-26T19:22:26.311740] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-09-26T19:22:27.111726] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-09-26T19:22:27.180065] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-26T19:22:27.191034] [INFO ] [REMOTE ] HUBB: Full fetch complete (53706 records). [2025-09-26T19:22:27.191215] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-09-26T19:22:27.662474] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-09-26T19:22:27.662688] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-09-26T19:22:27.664630] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-09-26T19:22:27.664750] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-09-26T19:22:27.667531] [DEBUG] [LOCAL ] HUBB: Trimmed 53706 records to 37650 (keeping 200 days of data) [2025-09-26T19:22:27.918165] [INFO ] [REMOTE ] HUM: Fetching primary data for 2024-12. [2025-09-26T19:22:27.944308] [DEBUG] [LOCAL ] HUBB: Primary data saved (37650 records). [2025-09-26T19:22:27.944872] [INFO ] [MAIN ] HUBB: Full history saved. [2025-09-26T19:22:27.945110] [INFO ] [MAIN ] Update Progress: 1065/2371 symbols completed. HUBB took 27.7s. Estimated remaining: 2h 54m 39s. Rate: 7.5 symbols/min [2025-09-26T19:22:28.021610] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-26T19:22:28.242395] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:22:28.311530] [DEBUG] [LOCAL ] HUN: Loaded 53586 existing records from primary storage. [2025-09-26T19:22:28.311726] [INFO ] [MAIN ] HUN: Loaded 53586 existing records. [2025-09-26T19:22:28.528134] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:22:28.528395] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-09-26T19:22:28.528467] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-09-26T19:22:28.530091] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-09-26T19:22:28.530153] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-09-26T19:22:28.714473] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-09-26T19:22:28.944764] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:22:28.963409] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-26T19:22:29.511715] [INFO ] [REMOTE ] HUN: Fetching primary data for 2024-12. [2025-09-26T19:22:29.759349] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-26T19:22:30.219537] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-26T19:22:30.311730] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-09-26T19:22:30.836103] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-26T19:22:31.111759] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-09-26T19:22:31.911719] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-09-26T19:22:32.162270] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-26T19:22:32.640863] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-26T19:22:32.711725] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-09-26T19:22:33.503158] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-26T19:22:33.513441] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-09-26T19:22:34.319423] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-09-26T19:22:34.336795] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-26T19:22:35.111711] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-09-26T19:22:35.320193] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-26T19:22:35.334979] [INFO ] [REMOTE ] HTGC: Full fetch complete (68170 records). [2025-09-26T19:22:35.335173] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-09-26T19:22:35.760725] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-09-26T19:22:35.760874] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-09-26T19:22:35.761899] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-09-26T19:22:35.762091] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-09-26T19:22:35.763818] [DEBUG] [LOCAL ] HTGC: Trimmed 68170 records to 48222 (keeping 200 days of data) [2025-09-26T19:22:35.912293] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-09-26T19:22:35.937520] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-26T19:22:36.141162] [DEBUG] [LOCAL ] HTGC: Primary data saved (48222 records). [2025-09-26T19:22:36.141343] [INFO ] [MAIN ] HTGC: Full history saved. [2025-09-26T19:22:36.142306] [INFO ] [MAIN ] Update Progress: 1066/2371 symbols completed. HTGC took 43.9s. Estimated remaining: 2h 54m 31s. Rate: 7.5 symbols/min [2025-09-26T19:22:36.324480] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:22:36.372253] [DEBUG] [LOCAL ] HUYA: Loaded 44671 existing records from primary storage. [2025-09-26T19:22:36.372439] [INFO ] [MAIN ] HUYA: Loaded 44671 existing records. [2025-09-26T19:22:36.617457] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:22:36.617855] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-09-26T19:22:36.617933] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-09-26T19:22:36.619399] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-09-26T19:22:36.619480] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-09-26T19:22:36.712995] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-09-26T19:22:37.030722] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:22:37.059432] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-26T19:22:37.511739] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2024-12. [2025-09-26T19:22:37.763839] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-26T19:22:38.248903] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T19:22:38.311730] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-09-26T19:22:39.095088] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-26T19:22:39.111670] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-09-26T19:22:39.911720] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-09-26T19:22:40.205332] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-26T19:22:40.713248] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-09-26T19:22:40.719582] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-26T19:22:41.344052] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-26T19:22:41.511757] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-09-26T19:22:42.311690] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-09-26T19:22:42.407229] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-26T19:22:42.417362] [INFO ] [REMOTE ] HUBS: Full fetch complete (55297 records). [2025-09-26T19:22:42.417677] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-09-26T19:22:42.817565] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-26T19:22:42.911678] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-09-26T19:22:42.911787] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-09-26T19:22:42.912676] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-09-26T19:22:42.912742] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-09-26T19:22:42.916393] [DEBUG] [LOCAL ] HUBS: Trimmed 55297 records to 39953 (keeping 200 days of data) [2025-09-26T19:22:43.112495] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-09-26T19:22:43.180180] [DEBUG] [LOCAL ] HUBS: Primary data saved (39953 records). [2025-09-26T19:22:43.180362] [INFO ] [MAIN ] HUBS: Full history saved. [2025-09-26T19:22:43.180474] [INFO ] [MAIN ] Update Progress: 1067/2371 symbols completed. HUBS took 34.6s. Estimated remaining: 2h 54m 21s. Rate: 7.5 symbols/min [2025-09-26T19:22:43.362044] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:22:43.379751] [DEBUG] [LOCAL ] HVT: Loaded 16061 existing records from primary storage. [2025-09-26T19:22:43.379883] [INFO ] [MAIN ] HVT: Loaded 16061 existing records. [2025-09-26T19:22:43.572213] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:22:43.572580] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-09-26T19:22:43.572635] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-09-26T19:22:43.573410] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-09-26T19:22:43.573475] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-09-26T19:22:43.912679] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-09-26T19:22:43.999590] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:22:44.081435] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-26T19:22:44.703780] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-26T19:22:44.714382] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-09-26T19:22:45.511719] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-09-26T19:22:45.652513] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-26T19:22:46.311697] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-09-26T19:22:46.836709] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-26T19:22:47.111739] [INFO ] [REMOTE ] HVT: Fetching primary data for 2024-12. [2025-09-26T19:22:47.554202] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-26T19:22:47.604818] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-26T19:22:47.911710] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-09-26T19:22:48.143729] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-26T19:22:48.711757] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-09-26T19:22:49.326152] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-26T19:22:49.366377] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-26T19:22:49.511732] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-09-26T19:22:50.311764] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-09-26T19:22:51.111773] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-09-26T19:22:51.288755] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-26T19:22:51.340473] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-26T19:22:51.911773] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-09-26T19:22:52.711757] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-09-26T19:22:53.511769] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-09-26T19:23:05.769369] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (13.86 seconds). [2025-09-26T19:23:05.774524] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-09-26T19:23:05.939792] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (13.23 seconds). [2025-09-26T19:23:05.949001] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-09-26T19:23:06.219148] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (12.71 seconds). [2025-09-26T19:23:06.231594] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-09-26T19:23:06.928499] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-26T19:23:06.933914] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-09-26T19:23:07.755004] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (16.64 seconds). [2025-09-26T19:23:07.766065] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-09-26T19:23:07.885969] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T19:23:07.896740] [INFO ] [REMOTE ] HUN: Full fetch complete (76608 records). [2025-09-26T19:23:07.896902] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-09-26T19:23:08.342010] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-09-26T19:23:08.342255] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-09-26T19:23:08.343223] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-09-26T19:23:08.343310] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-09-26T19:23:08.345320] [DEBUG] [LOCAL ] HUN: Trimmed 76608 records to 53976 (keeping 200 days of data) [2025-09-26T19:23:08.421331] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T19:23:08.453944] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-09-26T19:23:08.714797] [DEBUG] [LOCAL ] HUN: Primary data saved (53976 records). [2025-09-26T19:23:08.715041] [INFO ] [MAIN ] HUN: Full history saved. [2025-09-26T19:23:08.715206] [INFO ] [MAIN ] Update Progress: 1068/2371 symbols completed. HUN took 40.8s. Estimated remaining: 2h 54m 35s. Rate: 7.5 symbols/min [2025-09-26T19:23:08.902857] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:23:08.964518] [DEBUG] [LOCAL ] HWM: Loaded 53388 existing records from primary storage. [2025-09-26T19:23:08.964718] [INFO ] [MAIN ] HWM: Loaded 53388 existing records. [2025-09-26T19:23:09.162633] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:23:09.163230] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-09-26T19:23:09.163301] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-09-26T19:23:09.174612] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-09-26T19:23:09.194246] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-09-26T19:23:09.252147] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (3.30 seconds). [2025-09-26T19:23:09.327594] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-09-26T19:23:09.506388] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-26T19:23:09.554346] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-09-26T19:23:09.646479] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:23:09.647186] [INFO ] [REMOTE ] HWM: Fetching primary data for 2024-12. [2025-09-26T19:23:09.750462] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-26T19:23:09.762065] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-09-26T19:23:10.681696] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-26T19:23:10.686366] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-09-26T19:23:10.852116] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-26T19:23:10.862682] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-09-26T19:23:11.363674] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-26T19:23:11.375507] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-09-26T19:23:11.601782] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-26T19:23:11.617388] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-09-26T19:23:11.715620] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-26T19:23:11.719384] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-09-26T19:23:12.398052] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-26T19:23:12.410887] [INFO ] [REMOTE ] HUYA: Full fetch complete (63698 records). [2025-09-26T19:23:12.411096] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-09-26T19:23:12.962049] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-26T19:23:12.971739] [INFO ] [REMOTE ] HVT: Full fetch complete (23546 records). [2025-09-26T19:23:12.982133] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-09-26T19:23:13.228778] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-09-26T19:23:13.250191] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-09-26T19:23:13.271794] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-09-26T19:23:13.296077] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-09-26T19:23:13.372057] [DEBUG] [LOCAL ] HUYA: Trimmed 63698 records to 44956 (keeping 200 days of data) [2025-09-26T19:23:13.667378] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-09-26T19:23:13.697708] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-09-26T19:23:13.698678] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-09-26T19:23:13.699482] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-09-26T19:23:13.703547] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-26T19:23:13.715835] [DEBUG] [LOCAL ] HVT: Trimmed 23546 records to 16133 (keeping 200 days of data) [2025-09-26T19:23:13.719534] [INFO ] [REMOTE ] HUM: Full fetch complete (70944 records). [2025-09-26T19:23:13.721628] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-09-26T19:23:13.840284] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-09-26T19:23:13.946173] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-09-26T19:23:14.429031] [DEBUG] [LOCAL ] HVT: Primary data saved (16133 records). [2025-09-26T19:23:14.435050] [INFO ] [MAIN ] HVT: Full history saved. [2025-09-26T19:23:14.440431] [INFO ] [MAIN ] Update Progress: 1069/2371 symbols completed. HVT took 31.3s. Estimated remaining: 2h 54m 24s. Rate: 7.5 symbols/min [2025-09-26T19:23:14.843469] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:23:15.008122] [DEBUG] [LOCAL ] HUYA: Primary data saved (44956 records). [2025-09-26T19:23:15.042782] [INFO ] [MAIN ] HUYA: Full history saved. [2025-09-26T19:23:15.043149] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-09-26T19:23:15.043628] [INFO ] [MAIN ] Update Progress: 1070/2371 symbols completed. HUYA took 38.9s. Estimated remaining: 2h 54m 7s. Rate: 7.5 symbols/min [2025-09-26T19:23:15.043912] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-09-26T19:23:15.045512] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-09-26T19:23:15.046056] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-09-26T19:23:15.155897] [DEBUG] [LOCAL ] HUM: Trimmed 70944 records to 49568 (keeping 200 days of data) [2025-09-26T19:23:15.345354] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:23:15.375061] [DEBUG] [LOCAL ] HXL: Loaded 46282 existing records from primary storage. [2025-09-26T19:23:15.376098] [INFO ] [MAIN ] HXL: Loaded 46282 existing records. [2025-09-26T19:23:15.479844] [DEBUG] [LOCAL ] HY: Loaded 10146 existing records from primary storage. [2025-09-26T19:23:15.493877] [INFO ] [MAIN ] HY: Loaded 10146 existing records. [2025-09-26T19:23:15.706096] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:23:15.727677] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-09-26T19:23:15.738877] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-09-26T19:23:15.751872] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-09-26T19:23:15.753784] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-09-26T19:23:15.881763] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:23:15.919821] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-09-26T19:23:15.943328] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-09-26T19:23:15.955103] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-09-26T19:23:15.955745] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-09-26T19:23:16.748562] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:23:16.772231] [INFO ] [REMOTE ] HXL: Fetching primary data for 2024-12. [2025-09-26T19:23:16.826736] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (2.88 seconds). [2025-09-26T19:23:16.921078] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:23:16.923019] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-09-26T19:23:16.929674] [INFO ] [REMOTE ] HY: Fetching primary data for 2024-12. [2025-09-26T19:23:16.932256] [DEBUG] [LOCAL ] HUM: Primary data saved (49568 records). [2025-09-26T19:23:16.932485] [INFO ] [MAIN ] HUM: Full history saved. [2025-09-26T19:23:16.933479] [INFO ] [MAIN ] Update Progress: 1071/2371 symbols completed. HUM took 53.3s. Estimated remaining: 2h 53m 51s. Rate: 7.5 symbols/min [2025-09-26T19:23:17.118134] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:23:17.118351] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-09-26T19:23:17.118402] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-09-26T19:23:17.118554] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-09-26T19:23:17.118599] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-26T19:23:17.118664] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-26T19:23:17.118725] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-09-26T19:23:17.514036] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:23:17.514444] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-12. [2025-09-26T19:23:17.795017] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-26T19:23:17.798005] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-09-26T19:23:17.865766] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-26T19:23:17.866763] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-09-26T19:23:18.489510] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-26T19:23:18.490620] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-09-26T19:23:18.522299] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-26T19:23:18.531354] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-09-26T19:23:18.632598] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-26T19:23:18.635606] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-09-26T19:23:18.786442] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-26T19:23:18.787460] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-09-26T19:23:18.836615] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-26T19:23:18.847893] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-09-26T19:23:19.019378] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-09-26T19:23:19.020308] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-09-26T19:23:19.260987] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-09-26T19:23:19.261926] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-09-26T19:23:19.433254] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-26T19:23:19.436030] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-09-26T19:23:19.591709] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-26T19:23:19.592991] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-09-26T19:23:19.852394] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-09-26T19:23:19.853431] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-09-26T19:23:20.047151] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-26T19:23:20.057959] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-09-26T19:23:20.124298] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-26T19:23:20.135940] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-26T19:23:20.657464] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-26T19:23:20.711703] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-09-26T19:23:21.167781] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-26T19:23:21.511721] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-09-26T19:23:22.311730] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-09-26T19:23:22.362817] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-26T19:23:22.547154] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-09-26T19:23:22.643623] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-26T19:23:23.111739] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-09-26T19:23:23.911747] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-09-26T19:23:24.269836] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-26T19:23:24.270837] [INFO ] [REMOTE ] HYAC: Full fetch complete (866 records). [2025-09-26T19:23:24.270912] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-09-26T19:23:24.271457] [FATAL] [VALIDATOR ] HYAC: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T19:23:24.271545] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:23:24.271590] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:23:24.271639] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-26T19:23:24.271772] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-26T19:23:24.271830] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-09-26T19:23:24.271921] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-09-26T19:23:24.272028] [INFO ] [MAIN ] Update Progress: 1072/2371 symbols completed. HYAC took 7.3s. Estimated remaining: 2h 53m 43s. Rate: 7.5 symbols/min [2025-09-26T19:23:24.464630] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:23:24.464843] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-09-26T19:23:24.464898] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-09-26T19:23:24.465298] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-09-26T19:23:24.465351] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-26T19:23:24.465397] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-26T19:23:24.465430] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-09-26T19:23:24.716144] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-09-26T19:23:24.892388] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:23:24.925541] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-26T19:23:25.511794] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-09-26T19:23:25.630877] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-26T19:23:26.311755] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-12. [2025-09-26T19:23:26.650950] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-26T19:23:27.111720] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-09-26T19:23:27.576810] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-26T19:23:27.911738] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-09-26T19:23:28.711697] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-09-26T19:23:28.852871] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-26T19:23:29.466722] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-26T19:23:29.511726] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-09-26T19:23:30.030250] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-26T19:23:30.031308] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-26T19:23:30.311730] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-09-26T19:23:30.658625] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-26T19:23:31.111741] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-09-26T19:23:31.876858] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-26T19:23:31.911722] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-09-26T19:23:32.711686] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-09-26T19:23:32.756367] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-26T19:23:32.759531] [INFO ] [REMOTE ] HY: Full fetch complete (15210 records). [2025-09-26T19:23:32.759611] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-09-26T19:23:33.046727] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-26T19:23:33.172045] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-09-26T19:23:33.172148] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-09-26T19:23:33.172498] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-09-26T19:23:33.172552] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-09-26T19:23:33.173148] [DEBUG] [LOCAL ] HY: Trimmed 15210 records to 10192 (keeping 200 days of data) [2025-09-26T19:23:33.239216] [DEBUG] [LOCAL ] HY: Primary data saved (10192 records). [2025-09-26T19:23:33.239384] [INFO ] [MAIN ] HY: Full history saved. [2025-09-26T19:23:33.239535] [INFO ] [MAIN ] Update Progress: 1073/2371 symbols completed. HY took 18.2s. Estimated remaining: 2h 53m 36s. Rate: 7.5 symbols/min [2025-09-26T19:23:33.430475] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:23:33.442541] [DEBUG] [LOCAL ] HYI: Loaded 9110 existing records from primary storage. [2025-09-26T19:23:33.442715] [INFO ] [MAIN ] HYI: Loaded 9110 existing records. [2025-09-26T19:23:33.516909] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-09-26T19:23:33.677162] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:23:33.677541] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-09-26T19:23:33.677606] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-09-26T19:23:33.678263] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-09-26T19:23:33.678326] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-09-26T19:23:33.839850] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-26T19:23:34.076071] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:23:34.311729] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-09-26T19:23:35.111745] [INFO ] [REMOTE ] HYI: Fetching primary data for 2024-12. [2025-09-26T19:23:35.911701] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-09-26T19:23:36.012215] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-26T19:23:36.043192] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-26T19:23:36.249096] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-26T19:23:36.711728] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-09-26T19:23:37.511735] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-09-26T19:23:38.311746] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-09-26T19:23:38.361816] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-26T19:23:38.660172] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-26T19:23:38.663420] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-26T19:23:39.111748] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-09-26T19:23:39.911785] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-09-26T19:23:39.933710] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-26T19:23:40.251487] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-26T19:23:40.711735] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-09-26T19:23:41.511751] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-09-26T19:23:41.842455] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-26T19:23:42.312589] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-26T19:23:42.312735] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-09-26T19:23:43.111730] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-09-26T19:23:43.163691] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-26T19:23:43.911737] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-09-26T19:23:44.711731] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-09-26T19:23:44.930070] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-26T19:23:44.964050] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-26T19:23:45.511740] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-09-26T19:23:46.273091] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-26T19:23:46.311729] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-09-26T19:23:46.657551] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-26T19:23:46.751045] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-26T19:23:46.763064] [INFO ] [REMOTE ] HWM: Full fetch complete (76636 records). [2025-09-26T19:23:46.763268] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-09-26T19:23:47.116846] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-09-26T19:23:47.217664] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-09-26T19:23:47.218226] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-09-26T19:23:47.219346] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-09-26T19:23:47.219569] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-09-26T19:23:47.222773] [DEBUG] [LOCAL ] HWM: Trimmed 76636 records to 53767 (keeping 200 days of data) [2025-09-26T19:23:47.591713] [DEBUG] [LOCAL ] HWM: Primary data saved (53767 records). [2025-09-26T19:23:47.592073] [INFO ] [MAIN ] HWM: Full history saved. [2025-09-26T19:23:47.592200] [INFO ] [MAIN ] Update Progress: 1074/2371 symbols completed. HWM took 38.9s. Estimated remaining: 2h 53m 35s. Rate: 7.5 symbols/min [2025-09-26T19:23:47.783480] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:23:47.818209] [DEBUG] [LOCAL ] HYT: Loaded 33532 existing records from primary storage. [2025-09-26T19:23:47.818382] [INFO ] [MAIN ] HYT: Loaded 33532 existing records. [2025-09-26T19:23:47.915300] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-09-26T19:23:47.945151] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-26T19:23:48.038083] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:23:48.038385] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-09-26T19:23:48.038486] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-09-26T19:23:48.040272] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-09-26T19:23:48.040337] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-09-26T19:23:48.427540] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:23:48.711747] [INFO ] [REMOTE ] HYT: Fetching primary data for 2024-12. [2025-09-26T19:23:49.511704] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-09-26T19:23:49.551777] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-26T19:23:49.862816] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-26T19:23:49.863662] [INFO ] [REMOTE ] HYBX: Full fetch complete (799 records). [2025-09-26T19:23:49.863741] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-09-26T19:23:50.097017] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-26T19:23:50.097331] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:23:50.107601] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:23:50.113519] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-26T19:23:50.115076] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T19:23:50.114260] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-26T19:23:50.115195] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-09-26T19:23:50.121745] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-09-26T19:23:50.121848] [INFO ] [MAIN ] Update Progress: 1075/2371 symbols completed. HYBX took 25.8s. Estimated remaining: 2h 53m 21s. Rate: 7.5 symbols/min [2025-09-26T19:23:50.308993] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:23:50.311690] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-09-26T19:23:50.315105] [DEBUG] [LOCAL ] HYTR: Loaded 3189 existing records from primary storage. [2025-09-26T19:23:50.315298] [INFO ] [MAIN ] HYTR: Loaded 3189 existing records. [2025-09-26T19:23:50.520018] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:23:50.520327] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-09-26T19:23:50.520392] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-09-26T19:23:50.520860] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-09-26T19:23:50.520925] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-09-26T19:23:50.905298] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:23:51.111741] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2024-12. [2025-09-26T19:23:51.244420] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-26T19:23:51.568964] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-26T19:23:51.911770] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-09-26T19:23:52.711762] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-09-26T19:23:53.511731] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-09-26T19:23:53.731310] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-26T19:23:53.741039] [INFO ] [REMOTE ] HXL: Full fetch complete (66197 records). [2025-09-26T19:23:53.741299] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-09-26T19:23:54.110991] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-26T19:23:54.221692] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-09-26T19:23:54.224586] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-09-26T19:23:54.225716] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-09-26T19:23:54.225860] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-09-26T19:23:54.224467] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-26T19:23:54.235454] [DEBUG] [LOCAL ] HXL: Trimmed 66197 records to 46661 (keeping 200 days of data) [2025-09-26T19:23:54.327769] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-09-26T19:23:54.543238] [DEBUG] [LOCAL ] HXL: Primary data saved (46661 records). [2025-09-26T19:23:54.543400] [INFO ] [MAIN ] HXL: Full history saved. [2025-09-26T19:23:54.543495] [INFO ] [MAIN ] Update Progress: 1076/2371 symbols completed. HXL took 40.1s. Estimated remaining: 2h 53m 8s. Rate: 7.5 symbols/min [2025-09-26T19:23:54.734419] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:23:54.763681] [DEBUG] [LOCAL ] HZO: Loaded 29552 existing records from primary storage. [2025-09-26T19:23:54.763834] [INFO ] [MAIN ] HZO: Loaded 29552 existing records. [2025-09-26T19:23:54.960110] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:23:54.960381] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-09-26T19:23:54.960449] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-09-26T19:23:54.961869] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-09-26T19:23:54.961961] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-09-26T19:23:55.117006] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-09-26T19:23:55.379335] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:23:55.717106] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-26T19:23:55.717423] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-26T19:23:55.911769] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-09-26T19:23:56.469568] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-26T19:23:56.711751] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-09-26T19:23:57.511750] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-09-26T19:23:58.079257] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-26T19:23:58.147041] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-26T19:23:58.311732] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-09-26T19:23:59.111729] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-09-26T19:23:59.862907] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-26T19:23:59.867406] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-26T19:23:59.870202] [INFO ] [REMOTE ] HYI: Full fetch complete (13073 records). [2025-09-26T19:23:59.884518] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-09-26T19:23:59.917189] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-09-26T19:24:00.290007] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-09-26T19:24:00.290140] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-09-26T19:24:00.290746] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-09-26T19:24:00.290834] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-09-26T19:24:00.291851] [DEBUG] [LOCAL ] HYI: Trimmed 13073 records to 9254 (keeping 200 days of data) [2025-09-26T19:24:00.352176] [DEBUG] [LOCAL ] HYI: Primary data saved (9254 records). [2025-09-26T19:24:00.352362] [INFO ] [MAIN ] HYI: Full history saved. [2025-09-26T19:24:00.352495] [INFO ] [MAIN ] Update Progress: 1077/2371 symbols completed. HYI took 27.1s. Estimated remaining: 2h 52m 58s. Rate: 7.5 symbols/min [2025-09-26T19:24:00.711723] [INFO ] [REMOTE ] HZO: Fetching primary data for 2024-12. [2025-09-26T19:24:01.481214] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-26T19:24:01.511713] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-09-26T19:24:01.821116] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-26T19:24:02.083952] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-26T19:24:02.311762] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-09-26T19:24:02.892799] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-26T19:24:03.111735] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-09-26T19:24:03.911726] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-09-26T19:24:04.388118] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-26T19:24:04.453138] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-26T19:24:04.711772] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-09-26T19:24:05.266771] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-26T19:24:05.511749] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-09-26T19:24:06.311703] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-09-26T19:24:06.593203] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-26T19:24:06.779168] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-26T19:24:07.111729] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-09-26T19:24:07.911719] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-09-26T19:24:08.566629] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-26T19:24:08.711727] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-09-26T19:24:09.260169] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-26T19:24:09.283845] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-26T19:24:09.285041] [INFO ] [REMOTE ] HYTR: Full fetch complete (4472 records). [2025-09-26T19:24:09.285113] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-09-26T19:24:09.516963] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-09-26T19:24:09.674275] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-09-26T19:24:09.674369] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-09-26T19:24:09.674540] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-09-26T19:24:09.674582] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-09-26T19:24:09.675026] [DEBUG] [LOCAL ] HYTR: Trimmed 4472 records to 3208 (keeping 200 days of data) [2025-09-26T19:24:09.696218] [DEBUG] [LOCAL ] HYTR: Primary data saved (3208 records). [2025-09-26T19:24:09.696388] [INFO ] [MAIN ] HYTR: Full history saved. [2025-09-26T19:24:09.696500] [INFO ] [MAIN ] Update Progress: 1078/2371 symbols completed. HYTR took 19.6s. Estimated remaining: 2h 52m 51s. Rate: 7.5 symbols/min [2025-09-26T19:24:10.311751] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-09-26T19:24:11.102060] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-26T19:24:11.111683] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-09-26T19:24:11.731962] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-26T19:24:11.912192] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-09-26T19:24:11.915388] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-26T19:24:12.711763] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-09-26T19:24:13.530098] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-26T19:24:13.538704] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-09-26T19:24:13.948554] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-26T19:24:14.311792] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-09-26T19:24:15.035430] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-26T19:24:15.042305] [INFO ] [REMOTE ] HYT: Full fetch complete (47109 records). [2025-09-26T19:24:15.042491] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-09-26T19:24:15.472928] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-09-26T19:24:15.473062] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-09-26T19:24:15.474201] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-09-26T19:24:15.474275] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-09-26T19:24:15.476111] [DEBUG] [LOCAL ] HYT: Trimmed 47109 records to 33853 (keeping 200 days of data) [2025-09-26T19:24:15.723621] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-26T19:24:15.723847] [DEBUG] [LOCAL ] HYT: Primary data saved (33853 records). [2025-09-26T19:24:15.734432] [INFO ] [MAIN ] HYT: Full history saved. [2025-09-26T19:24:15.735214] [INFO ] [MAIN ] Update Progress: 1079/2371 symbols completed. HYT took 28.1s. Estimated remaining: 2h 52m 41s. Rate: 7.5 symbols/min [2025-09-26T19:24:15.735760] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-09-26T19:24:17.008992] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-26T19:24:17.015936] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-09-26T19:24:18.588610] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-26T19:24:18.594845] [INFO ] [REMOTE ] HZO: Full fetch complete (40819 records). [2025-09-26T19:24:18.594980] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-09-26T19:24:19.017562] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-09-26T19:24:19.017675] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-09-26T19:24:19.018407] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-09-26T19:24:19.018451] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-09-26T19:24:19.019421] [DEBUG] [LOCAL ] HZO: Trimmed 40819 records to 29733 (keeping 200 days of data) [2025-09-26T19:24:19.206046] [DEBUG] [LOCAL ] HZO: Primary data saved (29733 records). [2025-09-26T19:24:19.206192] [INFO ] [MAIN ] HZO: Full history saved. [2025-09-26T19:24:19.206325] [INFO ] [MAIN ] Update Progress: 1080/2371 symbols completed. HZO took 24.7s. Estimated remaining: 2h 52m 27s. Rate: 7.5 symbols/min [2025-09-26T19:24:19.986569] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:24:20.036416] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:24:20.077246] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:24:20.050766] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:24:20.089271] [DEBUG] [LOCAL ] IAE: Loaded 6040 existing records from primary storage. [2025-09-26T19:24:20.089624] [INFO ] [MAIN ] IAE: Loaded 6040 existing records. [2025-09-26T19:24:20.365261] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:24:20.398244] [DEBUG] [LOCAL ] IBM: Loaded 54026 existing records from primary storage. [2025-09-26T19:24:20.397476] [DEBUG] [LOCAL ] IBN: Loaded 53266 existing records from primary storage. [2025-09-26T19:24:20.398705] [INFO ] [MAIN ] IBM: Loaded 54026 existing records. [2025-09-26T19:24:20.398827] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-09-26T19:24:20.398939] [INFO ] [MAIN ] IBN: Loaded 53266 existing records. [2025-09-26T19:24:20.404185] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-09-26T19:24:20.464391] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-09-26T19:24:20.520958] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-09-26T19:24:20.643010] [DEBUG] [LOCAL ] IAG: Loaded 53835 existing records from primary storage. [2025-09-26T19:24:20.653579] [INFO ] [MAIN ] IAG: Loaded 53835 existing records. [2025-09-26T19:24:20.936864] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:24:21.032285] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-09-26T19:24:21.137242] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-09-26T19:24:21.131968] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:24:21.186142] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-09-26T19:24:21.253676] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-09-26T19:24:21.289869] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-09-26T19:24:21.325031] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-09-26T19:24:21.366437] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-09-26T19:24:21.361094] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:24:21.366596] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-09-26T19:24:21.499395] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-09-26T19:24:21.620125] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-09-26T19:24:21.631601] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:24:21.670562] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-09-26T19:24:21.686883] [INFO ] [REMOTE ] IAE: Fetching primary data for 2024-12. [2025-09-26T19:24:21.698406] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-09-26T19:24:22.557504] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:24:22.612089] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:24:22.633600] [INFO ] [REMOTE ] IBN: Fetching primary data for 2024-12. [2025-09-26T19:24:22.649679] [INFO ] [REMOTE ] IBM: Fetching primary data for 2024-12. [2025-09-26T19:24:22.641129] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-26T19:24:22.681492] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-09-26T19:24:22.774853] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:24:22.775180] [INFO ] [REMOTE ] IAG: Fetching primary data for 2024-12. [2025-09-26T19:24:23.354023] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-26T19:24:23.355804] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-09-26T19:24:24.146878] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-26T19:24:24.149070] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-09-26T19:24:24.515928] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-26T19:24:24.528534] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-09-26T19:24:24.609765] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-26T19:24:24.621972] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-09-26T19:24:24.953463] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-26T19:24:24.953737] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-26T19:24:24.967374] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-09-26T19:24:24.968528] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-09-26T19:24:25.564923] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-26T19:24:25.566588] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-09-26T19:24:26.385299] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-26T19:24:26.405815] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-09-26T19:24:26.407983] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-26T19:24:26.441008] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-26T19:24:27.111726] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-09-26T19:24:27.379745] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-09-26T19:24:27.847587] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-26T19:24:27.911742] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-09-26T19:24:28.177020] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-26T19:24:28.711742] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-09-26T19:24:29.511689] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-09-26T19:24:29.569739] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-26T19:24:29.986162] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-26T19:24:30.311717] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-09-26T19:24:30.736810] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-26T19:24:31.111723] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-09-26T19:24:31.740625] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-26T19:24:31.911759] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-09-26T19:24:32.120191] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-26T19:24:32.711761] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-09-26T19:24:33.511747] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-09-26T19:24:34.108496] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-26T19:24:34.311753] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-09-26T19:24:34.409047] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-26T19:24:34.412629] [INFO ] [REMOTE ] IAE: Full fetch complete (8681 records). [2025-09-26T19:24:34.412786] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-09-26T19:24:34.849249] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-09-26T19:24:34.863000] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-09-26T19:24:34.880472] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-09-26T19:24:34.883822] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-09-26T19:24:34.886935] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-26T19:24:34.887119] [DEBUG] [LOCAL ] IAE: Trimmed 8681 records to 6104 (keeping 200 days of data) [2025-09-26T19:24:34.943865] [DEBUG] [LOCAL ] IAE: Primary data saved (6104 records). [2025-09-26T19:24:34.944026] [INFO ] [MAIN ] IAE: Full history saved. [2025-09-26T19:24:34.944253] [INFO ] [MAIN ] Update Progress: 1081/2371 symbols completed. IAE took 15.7s. Estimated remaining: 2h 52m 28s. Rate: 7.5 symbols/min [2025-09-26T19:24:35.112720] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-09-26T19:24:35.134476] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:24:35.171425] [DEBUG] [LOCAL ] IBP: Loaded 29439 existing records from primary storage. [2025-09-26T19:24:35.171577] [INFO ] [MAIN ] IBP: Loaded 29439 existing records. [2025-09-26T19:24:35.359221] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:24:35.359548] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-09-26T19:24:35.359597] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-09-26T19:24:35.361046] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-09-26T19:24:35.361119] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-09-26T19:24:35.746621] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:24:35.911714] [INFO ] [REMOTE ] IBP: Fetching primary data for 2024-12. [2025-09-26T19:24:36.173683] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-26T19:24:36.711751] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-09-26T19:24:36.932555] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-26T19:24:37.446268] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-26T19:24:37.511743] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-09-26T19:24:38.311723] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-09-26T19:24:38.704773] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-26T19:24:39.111759] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-09-26T19:24:39.753908] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-26T19:24:39.901522] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-26T19:24:39.911664] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-09-26T19:24:40.103398] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-26T19:24:40.711728] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-09-26T19:24:41.216784] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-26T19:24:41.511760] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-09-26T19:24:42.311743] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-09-26T19:24:42.847831] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-26T19:24:42.926963] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-26T19:24:43.111739] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-09-26T19:24:43.911763] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-09-26T19:24:44.157988] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-26T19:24:44.534322] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-26T19:24:44.711763] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-09-26T19:24:45.511772] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-09-26T19:24:45.792325] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-26T19:24:46.311728] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-09-26T19:24:46.540910] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-26T19:24:47.111735] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-09-26T19:24:47.195556] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-09-26T19:24:47.809286] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-26T19:24:47.911723] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-09-26T19:24:48.449101] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-26T19:24:48.711712] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-09-26T19:24:49.511737] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-09-26T19:24:49.874297] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-26T19:24:50.311728] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-09-26T19:24:50.907137] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-26T19:24:50.981440] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-26T19:24:51.111736] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-09-26T19:24:51.165106] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-26T19:24:51.911733] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-09-26T19:24:52.711728] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-09-26T19:24:53.115189] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-26T19:24:53.201157] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-26T19:24:53.511724] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-09-26T19:24:54.311694] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-09-26T19:24:54.731862] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-26T19:24:54.743498] [INFO ] [REMOTE ] IBN: Full fetch complete (76263 records). [2025-09-26T19:24:54.743758] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-09-26T19:24:55.116597] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-09-26T19:24:55.120613] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-26T19:24:55.229241] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-09-26T19:24:55.229344] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-09-26T19:24:55.230415] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-09-26T19:24:55.230482] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-09-26T19:24:55.232627] [DEBUG] [LOCAL ] IBN: Trimmed 76263 records to 53654 (keeping 200 days of data) [2025-09-26T19:24:55.580563] [DEBUG] [LOCAL ] IBN: Primary data saved (53654 records). [2025-09-26T19:24:55.580738] [INFO ] [MAIN ] IBN: Full history saved. [2025-09-26T19:24:55.582952] [INFO ] [MAIN ] Update Progress: 1082/2371 symbols completed. IBN took 36.4s. Estimated remaining: 2h 52m 35s. Rate: 7.5 symbols/min [2025-09-26T19:24:55.759438] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:24:55.822687] [DEBUG] [LOCAL ] IBTA: Loaded 38211 existing records from primary storage. [2025-09-26T19:24:55.822853] [INFO ] [MAIN ] IBTA: Loaded 38211 existing records. [2025-09-26T19:24:55.921015] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-09-26T19:24:56.017564] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:24:56.017854] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-09-26T19:24:56.017917] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-09-26T19:24:56.018893] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-09-26T19:24:56.018954] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-09-26T19:24:56.388884] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:24:56.711726] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2024-12. [2025-09-26T19:24:56.964290] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-09-26T19:24:56.977191] [INFO ] [REMOTE ] IBM: Full fetch complete (77620 records). [2025-09-26T19:24:56.977364] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-09-26T19:24:57.087806] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-26T19:24:57.160190] [INFO ] [REMOTE ] IBP: Full fetch complete (41131 records). [2025-09-26T19:24:57.195897] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-09-26T19:24:57.620516] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-09-26T19:24:57.643736] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-09-26T19:24:57.658428] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-09-26T19:24:57.748114] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-09-26T19:24:57.850203] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (2.73 seconds). [2025-09-26T19:24:57.893098] [DEBUG] [LOCAL ] IBM: Trimmed 77620 records to 54416 (keeping 200 days of data) [2025-09-26T19:24:57.906250] [INFO ] [REMOTE ] IAG: Full fetch complete (77226 records). [2025-09-26T19:24:57.906749] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-09-26T19:24:57.922235] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-09-26T19:24:57.934508] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-09-26T19:24:58.000413] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-09-26T19:24:58.062193] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-09-26T19:24:58.121405] [DEBUG] [LOCAL ] IBP: Trimmed 41131 records to 29584 (keeping 200 days of data) [2025-09-26T19:24:58.145873] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-26T19:24:58.172917] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-09-26T19:24:58.722225] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-09-26T19:24:58.726077] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-09-26T19:24:58.728703] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-09-26T19:24:58.736993] [DEBUG] [LOCAL ] IBP: Primary data saved (29584 records). [2025-09-26T19:24:58.732544] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-09-26T19:24:58.737127] [INFO ] [MAIN ] IBP: Full history saved. [2025-09-26T19:24:58.738101] [INFO ] [MAIN ] Update Progress: 1083/2371 symbols completed. IBP took 23.8s. Estimated remaining: 2h 52m 22s. Rate: 7.5 symbols/min [2025-09-26T19:24:58.827147] [DEBUG] [LOCAL ] IAG: Trimmed 77226 records to 54225 (keeping 200 days of data) [2025-09-26T19:24:59.164941] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:24:59.337869] [DEBUG] [LOCAL ] ICE: Loaded 53415 existing records from primary storage. [2025-09-26T19:24:59.339281] [INFO ] [MAIN ] ICE: Loaded 53415 existing records. [2025-09-26T19:24:59.585058] [DEBUG] [LOCAL ] IBM: Primary data saved (54416 records). [2025-09-26T19:24:59.597388] [INFO ] [MAIN ] IBM: Full history saved. [2025-09-26T19:24:59.631148] [INFO ] [MAIN ] Update Progress: 1084/2371 symbols completed. IBM took 40.4s. Estimated remaining: 2h 52m 5s. Rate: 7.5 symbols/min [2025-09-26T19:24:59.732477] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:24:59.793324] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-09-26T19:24:59.803679] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-09-26T19:24:59.811070] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-26T19:24:59.822494] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-09-26T19:24:59.833904] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-09-26T19:24:59.839446] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-09-26T19:25:00.038826] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:25:00.386731] [DEBUG] [LOCAL ] ICL: Loaded 38902 existing records from primary storage. [2025-09-26T19:25:00.411325] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:25:00.412631] [INFO ] [REMOTE ] ICE: Fetching primary data for 2024-12. [2025-09-26T19:25:00.412801] [INFO ] [MAIN ] ICL: Loaded 38902 existing records. [2025-09-26T19:25:00.506054] [DEBUG] [LOCAL ] IAG: Primary data saved (54225 records). [2025-09-26T19:25:00.518943] [INFO ] [MAIN ] IAG: Full history saved. [2025-09-26T19:25:00.533052] [INFO ] [MAIN ] Update Progress: 1085/2371 symbols completed. IAG took 41.3s. Estimated remaining: 2h 51m 49s. Rate: 7.5 symbols/min [2025-09-26T19:25:00.849345] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:25:00.845033] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:25:00.850030] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-09-26T19:25:00.850092] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-09-26T19:25:00.851111] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-09-26T19:25:00.851174] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-09-26T19:25:01.184168] [DEBUG] [LOCAL ] IDA: Loaded 32201 existing records from primary storage. [2025-09-26T19:25:01.190185] [INFO ] [MAIN ] IDA: Loaded 32201 existing records. [2025-09-26T19:25:01.364517] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:25:01.365801] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-26T19:25:01.371639] [INFO ] [REMOTE ] ICL: Fetching primary data for 2024-12. [2025-09-26T19:25:01.410435] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-09-26T19:25:01.509558] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:25:01.509841] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-09-26T19:25:01.509895] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-09-26T19:25:01.510990] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-09-26T19:25:01.511052] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-09-26T19:25:01.892099] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:25:01.892462] [INFO ] [REMOTE ] IDA: Fetching primary data for 2024-12. [2025-09-26T19:25:02.582954] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-26T19:25:02.594525] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-09-26T19:25:03.012349] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-26T19:25:03.111706] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-09-26T19:25:03.180132] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-26T19:25:03.206276] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-26T19:25:03.911717] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-09-26T19:25:04.349736] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-26T19:25:04.528060] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-26T19:25:04.711732] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-09-26T19:25:05.511728] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-09-26T19:25:05.680131] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-26T19:25:06.121252] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-26T19:25:06.311758] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-09-26T19:25:07.111704] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-09-26T19:25:07.289445] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-26T19:25:07.701574] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-26T19:25:07.911733] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-09-26T19:25:08.663404] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T19:25:08.711770] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-09-26T19:25:09.511702] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-09-26T19:25:09.829600] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-26T19:25:10.250246] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-26T19:25:10.311741] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-09-26T19:25:10.870969] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-26T19:25:11.111761] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-09-26T19:25:11.911762] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-09-26T19:25:12.341078] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-26T19:25:12.370692] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-26T19:25:12.711747] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-09-26T19:25:13.205955] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-26T19:25:13.511730] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-09-26T19:25:14.311708] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-09-26T19:25:14.584356] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-26T19:25:14.639982] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-26T19:25:15.111759] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-09-26T19:25:15.806846] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-26T19:25:15.911729] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-09-26T19:25:16.272389] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-26T19:25:16.711729] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-09-26T19:25:17.511766] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-09-26T19:25:17.928161] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-26T19:25:18.311723] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-09-26T19:25:18.443705] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-26T19:25:18.981063] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-26T19:25:19.111771] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-09-26T19:25:19.911698] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-09-26T19:25:20.294880] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-26T19:25:20.370055] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-26T19:25:20.711782] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-09-26T19:25:21.152364] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-26T19:25:21.511752] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-09-26T19:25:22.311786] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-09-26T19:25:22.379349] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-26T19:25:22.387280] [INFO ] [REMOTE ] ICL: Full fetch complete (56067 records). [2025-09-26T19:25:22.387459] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-09-26T19:25:22.817255] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-09-26T19:25:22.817481] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-09-26T19:25:22.818380] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-09-26T19:25:22.818538] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-09-26T19:25:22.820079] [DEBUG] [LOCAL ] ICL: Trimmed 56067 records to 39135 (keeping 200 days of data) [2025-09-26T19:25:22.952177] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-26T19:25:23.085661] [DEBUG] [LOCAL ] ICL: Primary data saved (39135 records). [2025-09-26T19:25:23.085825] [INFO ] [MAIN ] ICL: Full history saved. [2025-09-26T19:25:23.085918] [INFO ] [MAIN ] Update Progress: 1086/2371 symbols completed. ICL took 23.4s. Estimated remaining: 2h 51m 58s. Rate: 7.5 symbols/min [2025-09-26T19:25:23.118613] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-09-26T19:25:23.268350] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:25:23.278780] [DEBUG] [LOCAL ] IDE: Loaded 8650 existing records from primary storage. [2025-09-26T19:25:23.278929] [INFO ] [MAIN ] IDE: Loaded 8650 existing records. [2025-09-26T19:25:23.463865] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:25:23.464200] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-09-26T19:25:23.464257] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-09-26T19:25:23.464638] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-09-26T19:25:23.464747] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-09-26T19:25:23.917363] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-09-26T19:25:23.922753] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:25:23.956062] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-26T19:25:23.964720] [INFO ] [REMOTE ] IBTA: Full fetch complete (50652 records). [2025-09-26T19:25:23.964898] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-09-26T19:25:24.402542] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-09-26T19:25:24.402636] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-09-26T19:25:24.403517] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-09-26T19:25:24.403585] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-09-26T19:25:24.404946] [DEBUG] [LOCAL ] IBTA: Trimmed 50652 records to 38445 (keeping 200 days of data) [2025-09-26T19:25:24.647010] [DEBUG] [LOCAL ] IBTA: Primary data saved (38445 records). [2025-09-26T19:25:24.647239] [INFO ] [MAIN ] IBTA: Full history saved. [2025-09-26T19:25:24.647347] [INFO ] [MAIN ] Update Progress: 1087/2371 symbols completed. IBTA took 29.1s. Estimated remaining: 2h 51m 42s. Rate: 7.5 symbols/min [2025-09-26T19:25:24.720349] [INFO ] [REMOTE ] IDE: Fetching primary data for 2024-12. [2025-09-26T19:25:24.847536] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:25:24.870902] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-26T19:25:24.892430] [DEBUG] [LOCAL ] IDT: Loaded 17791 existing records from primary storage. [2025-09-26T19:25:24.892573] [INFO ] [MAIN ] IDT: Loaded 17791 existing records. [2025-09-26T19:25:25.080732] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:25:25.081004] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-09-26T19:25:25.081052] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-09-26T19:25:25.082048] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-09-26T19:25:25.082109] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-09-26T19:25:25.487827] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-26T19:25:25.486514] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:25:25.511716] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-09-26T19:25:25.734588] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-26T19:25:26.311741] [INFO ] [REMOTE ] IDT: Fetching primary data for 2024-12. [2025-09-26T19:25:26.878462] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-26T19:25:27.111724] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-09-26T19:25:27.211379] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-26T19:25:27.911729] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-09-26T19:25:28.483165] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-26T19:25:28.697132] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-26T19:25:28.711713] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-09-26T19:25:29.475415] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-26T19:25:29.511760] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-09-26T19:25:30.311745] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-09-26T19:25:30.794795] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-26T19:25:31.111719] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-09-26T19:25:31.400864] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-26T19:25:31.911741] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-09-26T19:25:32.676502] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-26T19:25:32.711696] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-09-26T19:25:33.088327] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-26T19:25:33.099113] [INFO ] [REMOTE ] ICE: Full fetch complete (76767 records). [2025-09-26T19:25:33.099279] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-09-26T19:25:33.521007] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-09-26T19:25:33.517097] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-09-26T19:25:33.521169] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-09-26T19:25:33.523096] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-09-26T19:25:33.523261] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-09-26T19:25:33.524935] [DEBUG] [LOCAL ] ICE: Trimmed 76767 records to 53800 (keeping 200 days of data) [2025-09-26T19:25:33.891477] [DEBUG] [LOCAL ] ICE: Primary data saved (53800 records). [2025-09-26T19:25:33.891718] [INFO ] [MAIN ] ICE: Full history saved. [2025-09-26T19:25:33.891859] [INFO ] [MAIN ] Update Progress: 1088/2371 symbols completed. ICE took 35.2s. Estimated remaining: 2h 51m 36s. Rate: 7.5 symbols/min [2025-09-26T19:25:34.087298] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:25:34.132002] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-26T19:25:34.138376] [INFO ] [REMOTE ] IDA: Full fetch complete (44684 records). [2025-09-26T19:25:34.138588] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-09-26T19:25:34.199194] [DEBUG] [LOCAL ] IEX: Loaded 38697 existing records from primary storage. [2025-09-26T19:25:34.222606] [INFO ] [MAIN ] IEX: Loaded 38697 existing records. [2025-09-26T19:25:34.314838] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-09-26T19:25:34.659070] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:25:34.678009] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-09-26T19:25:34.690790] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-09-26T19:25:34.696818] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-09-26T19:25:34.712018] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-09-26T19:25:34.719736] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-26T19:25:34.897158] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-09-26T19:25:34.902672] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-09-26T19:25:34.923199] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-09-26T19:25:34.950036] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-09-26T19:25:34.951349] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-26T19:25:34.997682] [DEBUG] [LOCAL ] IDA: Trimmed 44684 records to 32398 (keeping 200 days of data) [2025-09-26T19:25:35.151276] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-09-26T19:25:35.324799] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:25:35.445161] [DEBUG] [LOCAL ] IDA: Primary data saved (32398 records). [2025-09-26T19:25:35.445367] [INFO ] [MAIN ] IDA: Full history saved. [2025-09-26T19:25:35.445472] [INFO ] [MAIN ] Update Progress: 1089/2371 symbols completed. IDA took 34.9s. Estimated remaining: 2h 51m 20s. Rate: 7.5 symbols/min [2025-09-26T19:25:35.636785] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:25:35.695409] [DEBUG] [LOCAL ] IFF: Loaded 51351 existing records from primary storage. [2025-09-26T19:25:35.695593] [INFO ] [MAIN ] IFF: Loaded 51351 existing records. [2025-09-26T19:25:35.881936] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:25:35.882304] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-09-26T19:25:35.882361] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-09-26T19:25:35.883914] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-09-26T19:25:35.883977] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-09-26T19:25:35.916802] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-09-26T19:25:36.221370] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-26T19:25:36.284589] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:25:36.683366] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-26T19:25:36.711689] [INFO ] [REMOTE ] IEX: Fetching primary data for 2024-12. [2025-09-26T19:25:37.511743] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-09-26T19:25:38.157199] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-26T19:25:38.163974] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-26T19:25:38.311781] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-09-26T19:25:38.845251] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-26T19:25:39.111769] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-09-26T19:25:39.909186] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-26T19:25:39.911941] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-09-26T19:25:40.697133] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-26T19:25:40.711677] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-09-26T19:25:41.511730] [INFO ] [REMOTE ] IFF: Fetching primary data for 2024-12. [2025-09-26T19:25:41.534051] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-26T19:25:42.311738] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-09-26T19:25:43.111705] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-09-26T19:25:43.199552] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-26T19:25:43.251186] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-26T19:25:43.254599] [INFO ] [REMOTE ] IDE: Full fetch complete (12813 records). [2025-09-26T19:25:43.254795] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-09-26T19:25:43.696544] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-09-26T19:25:43.696676] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-09-26T19:25:43.697083] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-09-26T19:25:43.697152] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-09-26T19:25:43.698002] [DEBUG] [LOCAL ] IDE: Trimmed 12813 records to 8755 (keeping 200 days of data) [2025-09-26T19:25:43.755970] [DEBUG] [LOCAL ] IDE: Primary data saved (8755 records). [2025-09-26T19:25:43.756161] [INFO ] [MAIN ] IDE: Full history saved. [2025-09-26T19:25:43.756312] [INFO ] [MAIN ] Update Progress: 1090/2371 symbols completed. IDE took 20.7s. Estimated remaining: 2h 51m 12s. Rate: 7.5 symbols/min [2025-09-26T19:25:43.917635] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-09-26T19:25:43.956622] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:25:43.978222] [DEBUG] [LOCAL ] IFN: Loaded 18336 existing records from primary storage. [2025-09-26T19:25:43.978387] [INFO ] [MAIN ] IFN: Loaded 18336 existing records. [2025-09-26T19:25:44.173340] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:25:44.173727] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-09-26T19:25:44.173800] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-09-26T19:25:44.174472] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-09-26T19:25:44.174544] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-09-26T19:25:44.579510] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:25:44.601278] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-26T19:25:44.711691] [INFO ] [REMOTE ] IFN: Fetching primary data for 2024-12. [2025-09-26T19:25:45.027733] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-26T19:25:45.508931] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-26T19:25:45.513974] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-09-26T19:25:46.311713] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-09-26T19:25:46.629938] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-26T19:25:47.111721] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-09-26T19:25:47.740741] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-26T19:25:47.911734] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-09-26T19:25:48.360243] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-26T19:25:48.711743] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-09-26T19:25:49.510064] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-26T19:25:49.517425] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-09-26T19:25:49.648207] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-26T19:25:50.311731] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-09-26T19:25:51.111728] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-09-26T19:25:51.208952] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-26T19:25:51.911711] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-09-26T19:25:51.960116] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-26T19:25:52.252017] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-26T19:25:52.711692] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-09-26T19:25:53.072771] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-26T19:25:53.076905] [INFO ] [REMOTE ] IDT: Full fetch complete (22484 records). [2025-09-26T19:25:53.077032] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-09-26T19:25:53.494044] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-09-26T19:25:53.494141] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-09-26T19:25:53.494712] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-09-26T19:25:53.494810] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-09-26T19:25:53.495784] [DEBUG] [LOCAL ] IDT: Trimmed 22484 records to 17885 (keeping 200 days of data) [2025-09-26T19:25:53.544376] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-09-26T19:25:53.616020] [DEBUG] [LOCAL ] IDT: Primary data saved (17885 records). [2025-09-26T19:25:53.616200] [INFO ] [MAIN ] IDT: Full history saved. [2025-09-26T19:25:53.616333] [INFO ] [MAIN ] Update Progress: 1091/2371 symbols completed. IDT took 29.0s. Estimated remaining: 2h 51m 6s. Rate: 7.5 symbols/min [2025-09-26T19:25:53.819224] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:25:53.844858] [DEBUG] [LOCAL ] IFS: Loaded 23244 existing records from primary storage. [2025-09-26T19:25:53.845019] [INFO ] [MAIN ] IFS: Loaded 23244 existing records. [2025-09-26T19:25:54.096583] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:25:54.097227] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-09-26T19:25:54.097323] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-09-26T19:25:54.098566] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-09-26T19:25:54.098699] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-09-26T19:25:54.324917] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-09-26T19:25:54.413813] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-26T19:25:54.547448] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:25:54.681193] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-26T19:25:55.111726] [INFO ] [REMOTE ] IFS: Fetching primary data for 2024-12. [2025-09-26T19:25:55.911711] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-09-26T19:25:56.019744] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-26T19:25:56.058719] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-26T19:25:56.711742] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-09-26T19:25:57.351490] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-26T19:25:57.511743] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-09-26T19:25:58.165840] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-26T19:25:58.311745] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-09-26T19:25:58.568114] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-26T19:25:59.111752] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-09-26T19:25:59.517328] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-26T19:25:59.911733] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-09-26T19:26:00.711742] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-09-26T19:26:01.056585] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-26T19:26:01.369455] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-26T19:26:01.511738] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-09-26T19:26:01.905773] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-26T19:26:02.311717] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-09-26T19:26:02.791701] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-26T19:26:03.111720] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-09-26T19:26:03.911722] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-09-26T19:26:03.980168] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-26T19:26:04.172772] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-26T19:26:04.711687] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-09-26T19:26:05.176338] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-26T19:26:05.511723] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-09-26T19:26:06.311726] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-09-26T19:26:06.377269] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-26T19:26:06.770209] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-26T19:26:06.778261] [INFO ] [REMOTE ] IEX: Full fetch complete (53425 records). [2025-09-26T19:26:06.778450] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-09-26T19:26:07.126918] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-09-26T19:26:07.186289] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-09-26T19:26:07.186383] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-09-26T19:26:07.187285] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-09-26T19:26:07.187370] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-09-26T19:26:07.188589] [DEBUG] [LOCAL ] IEX: Trimmed 53425 records to 38978 (keeping 200 days of data) [2025-09-26T19:26:07.446805] [DEBUG] [LOCAL ] IEX: Primary data saved (38978 records). [2025-09-26T19:26:07.446991] [INFO ] [MAIN ] IEX: Full history saved. [2025-09-26T19:26:07.448239] [INFO ] [MAIN ] Update Progress: 1092/2371 symbols completed. IEX took 33.6s. Estimated remaining: 2h 51m 5s. Rate: 7.5 symbols/min [2025-09-26T19:26:07.583511] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-26T19:26:07.652694] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:26:07.668281] [DEBUG] [LOCAL ] IGA: Loaded 9727 existing records from primary storage. [2025-09-26T19:26:07.668424] [INFO ] [MAIN ] IGA: Loaded 9727 existing records. [2025-09-26T19:26:07.863029] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:26:07.863298] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-09-26T19:26:07.863348] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-09-26T19:26:07.863836] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-09-26T19:26:07.863896] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-09-26T19:26:07.923305] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-09-26T19:26:08.248845] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:26:08.711697] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-09-26T19:26:09.041881] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-26T19:26:09.082084] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-26T19:26:09.511735] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-09-26T19:26:09.795898] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-26T19:26:10.311745] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-09-26T19:26:10.615986] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-26T19:26:11.111762] [INFO ] [REMOTE ] IGA: Fetching primary data for 2024-12. [2025-09-26T19:26:11.538482] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-26T19:26:11.911720] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-09-26T19:26:11.942728] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-26T19:26:12.711743] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-09-26T19:26:13.511785] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-09-26T19:26:13.736443] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-26T19:26:13.875390] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-26T19:26:14.311744] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-09-26T19:26:14.483727] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-26T19:26:15.111739] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-09-26T19:26:15.401012] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-26T19:26:15.911731] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-09-26T19:26:16.171609] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-26T19:26:16.711701] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-09-26T19:26:17.082089] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-26T19:26:17.086164] [INFO ] [REMOTE ] IFN: Full fetch complete (29023 records). [2025-09-26T19:26:17.086302] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-09-26T19:26:17.500095] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-09-26T19:26:17.500239] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-09-26T19:26:17.500934] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-09-26T19:26:17.501019] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-09-26T19:26:17.502512] [DEBUG] [LOCAL ] IFN: Trimmed 29023 records to 18475 (keeping 200 days of data) [2025-09-26T19:26:17.551854] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-09-26T19:26:17.625114] [DEBUG] [LOCAL ] IFN: Primary data saved (18475 records). [2025-09-26T19:26:17.625280] [INFO ] [MAIN ] IFN: Full history saved. [2025-09-26T19:26:17.625379] [INFO ] [MAIN ] Update Progress: 1093/2371 symbols completed. IFN took 33.9s. Estimated remaining: 2h 50m 60s. Rate: 7.5 symbols/min [2025-09-26T19:26:17.813504] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:26:17.833855] [DEBUG] [LOCAL ] IGD: Loaded 19050 existing records from primary storage. [2025-09-26T19:26:17.834013] [INFO ] [MAIN ] IGD: Loaded 19050 existing records. [2025-09-26T19:26:18.036504] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:26:18.036824] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-09-26T19:26:18.036876] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-09-26T19:26:18.037814] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-09-26T19:26:18.037884] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-09-26T19:26:18.316467] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-09-26T19:26:18.489910] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:26:18.592470] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-26T19:26:18.603119] [INFO ] [REMOTE ] IFF: Full fetch complete (72914 records). [2025-09-26T19:26:18.603309] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-09-26T19:26:19.014727] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-26T19:26:19.044395] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-09-26T19:26:19.045108] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-09-26T19:26:19.046134] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-09-26T19:26:19.044991] [INFO ] [REMOTE ] IFS: Full fetch complete (31470 records). [2025-09-26T19:26:19.046296] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-09-26T19:26:19.046423] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-09-26T19:26:19.116822] [INFO ] [REMOTE ] IGD: Fetching primary data for 2024-12. [2025-09-26T19:26:19.128222] [DEBUG] [LOCAL ] IFF: Trimmed 72914 records to 51727 (keeping 200 days of data) [2025-09-26T19:26:19.156786] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-26T19:26:19.724310] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-09-26T19:26:19.725348] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-09-26T19:26:19.726161] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-09-26T19:26:19.726519] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-09-26T19:26:19.743495] [DEBUG] [LOCAL ] IFS: Trimmed 31470 records to 23359 (keeping 200 days of data) [2025-09-26T19:26:19.914295] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-09-26T19:26:19.914183] [DEBUG] [LOCAL ] IFF: Primary data saved (51727 records). [2025-09-26T19:26:19.918310] [INFO ] [MAIN ] IFF: Full history saved. [2025-09-26T19:26:19.920116] [INFO ] [MAIN ] Update Progress: 1094/2371 symbols completed. IFF took 44.5s. Estimated remaining: 2h 50m 45s. Rate: 7.5 symbols/min [2025-09-26T19:26:20.144076] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:26:20.158511] [DEBUG] [LOCAL ] IFS: Primary data saved (23359 records). [2025-09-26T19:26:20.158786] [INFO ] [MAIN ] IFS: Full history saved. [2025-09-26T19:26:20.158956] [INFO ] [MAIN ] Update Progress: 1095/2371 symbols completed. IFS took 26.5s. Estimated remaining: 2h 50m 28s. Rate: 7.5 symbols/min [2025-09-26T19:26:20.202086] [DEBUG] [LOCAL ] IGI: Loaded 3710 existing records from primary storage. [2025-09-26T19:26:20.215102] [INFO ] [MAIN ] IGI: Loaded 3710 existing records. [2025-09-26T19:26:20.391158] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-26T19:26:20.544740] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-26T19:26:20.579560] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:26:20.605309] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:26:20.607296] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-09-26T19:26:20.607479] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-09-26T19:26:20.607806] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-09-26T19:26:20.607883] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-09-26T19:26:20.714406] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-09-26T19:26:20.906618] [DEBUG] [LOCAL ] IGR: Loaded 30674 existing records from primary storage. [2025-09-26T19:26:20.924033] [INFO ] [MAIN ] IGR: Loaded 30674 existing records. [2025-09-26T19:26:21.168316] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:26:21.252841] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:26:21.253111] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-09-26T19:26:21.253164] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-09-26T19:26:21.254118] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-09-26T19:26:21.254183] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-09-26T19:26:21.516798] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-09-26T19:26:21.631366] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:26:21.741915] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-26T19:26:22.311755] [INFO ] [REMOTE ] IGI: Fetching primary data for 2024-12. [2025-09-26T19:26:22.506857] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-26T19:26:22.805790] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-26T19:26:23.111711] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-09-26T19:26:23.911692] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-09-26T19:26:24.150507] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-26T19:26:24.641275] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-26T19:26:24.711738] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-09-26T19:26:25.477546] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-26T19:26:25.511694] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-09-26T19:26:26.311693] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-09-26T19:26:26.446242] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-26T19:26:27.111746] [INFO ] [REMOTE ] IGR: Fetching primary data for 2024-12. [2025-09-26T19:26:27.377768] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-26T19:26:27.911718] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-09-26T19:26:28.527113] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-26T19:26:28.716092] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-09-26T19:26:28.719258] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-26T19:26:29.511748] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-09-26T19:26:29.856005] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-26T19:26:30.311746] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-09-26T19:26:30.887530] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-26T19:26:31.111699] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-09-26T19:26:31.384003] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-26T19:26:31.911737] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-09-26T19:26:32.086492] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-26T19:26:32.089119] [INFO ] [REMOTE ] IGA: Full fetch complete (13620 records). [2025-09-26T19:26:32.089228] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-09-26T19:26:32.475576] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-09-26T19:26:32.475767] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-26T19:26:32.475833] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-09-26T19:26:32.477578] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-09-26T19:26:32.477630] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-09-26T19:26:32.478170] [DEBUG] [LOCAL ] IGA: Trimmed 13620 records to 9779 (keeping 200 days of data) [2025-09-26T19:26:32.541723] [DEBUG] [LOCAL ] IGA: Primary data saved (9779 records). [2025-09-26T19:26:32.541907] [INFO ] [MAIN ] IGA: Full history saved. [2025-09-26T19:26:32.542012] [INFO ] [MAIN ] Update Progress: 1096/2371 symbols completed. IGA took 25.1s. Estimated remaining: 2h 50m 25s. Rate: 7.5 symbols/min [2025-09-26T19:26:32.715173] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-09-26T19:26:32.738153] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:26:32.743429] [DEBUG] [LOCAL ] IH: Loaded 3429 existing records from primary storage. [2025-09-26T19:26:32.743540] [INFO ] [MAIN ] IH: Loaded 3429 existing records. [2025-09-26T19:26:32.927962] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:26:32.928229] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-09-26T19:26:32.928277] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-09-26T19:26:32.928596] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-09-26T19:26:32.928687] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-09-26T19:26:33.223548] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-26T19:26:33.312087] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:26:33.511756] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-09-26T19:26:34.311721] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-09-26T19:26:34.738086] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-26T19:26:34.905292] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-26T19:26:35.111734] [INFO ] [REMOTE ] IH: Fetching primary data for 2024-12. [2025-09-26T19:26:35.552617] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-26T19:26:35.911719] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-09-26T19:26:36.711734] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-09-26T19:26:37.198895] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-26T19:26:37.209591] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-26T19:26:37.511720] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-09-26T19:26:38.065788] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-26T19:26:38.311724] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-09-26T19:26:39.111699] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-09-26T19:26:39.352253] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-26T19:26:39.911725] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-09-26T19:26:40.451125] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-26T19:26:40.452382] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-26T19:26:40.711728] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-09-26T19:26:41.328132] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-26T19:26:41.511747] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-09-26T19:26:42.125776] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-26T19:26:42.311721] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-09-26T19:26:42.746232] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-26T19:26:43.111728] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-09-26T19:26:43.697359] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-26T19:26:43.911722] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-09-26T19:26:44.711685] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-09-26T19:26:45.076571] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-26T19:26:45.511699] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-09-26T19:26:45.905701] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-26T19:26:46.214970] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-26T19:26:46.216294] [INFO ] [REMOTE ] IGI: Full fetch complete (5223 records). [2025-09-26T19:26:46.216370] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-09-26T19:26:46.316888] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-09-26T19:26:46.607209] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-09-26T19:26:46.607297] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-09-26T19:26:46.607452] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-09-26T19:26:46.607493] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-09-26T19:26:46.607960] [DEBUG] [LOCAL ] IGI: Trimmed 5223 records to 3756 (keeping 200 days of data) [2025-09-26T19:26:46.631923] [DEBUG] [LOCAL ] IGI: Primary data saved (3756 records). [2025-09-26T19:26:46.632052] [INFO ] [MAIN ] IGI: Full history saved. [2025-09-26T19:26:46.632205] [INFO ] [MAIN ] Update Progress: 1097/2371 symbols completed. IGI took 26.7s. Estimated remaining: 2h 50m 24s. Rate: 7.5 symbols/min [2025-09-26T19:26:46.816113] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:26:46.826569] [DEBUG] [LOCAL ] IHD: Loaded 7189 existing records from primary storage. [2025-09-26T19:26:46.826696] [INFO ] [MAIN ] IHD: Loaded 7189 existing records. [2025-09-26T19:26:47.010217] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:26:47.010493] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-09-26T19:26:47.010541] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-09-26T19:26:47.010890] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-09-26T19:26:47.010988] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-09-26T19:26:47.116937] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-09-26T19:26:47.415126] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:26:47.436288] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-26T19:26:47.893818] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-26T19:26:47.911663] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-09-26T19:26:48.407950] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-26T19:26:48.711720] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-09-26T19:26:49.511737] [INFO ] [REMOTE ] IHD: Fetching primary data for 2024-12. [2025-09-26T19:26:49.844837] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-26T19:26:50.311724] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-09-26T19:26:50.352448] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-26T19:26:51.111731] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-09-26T19:26:51.525760] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-26T19:26:51.529934] [INFO ] [REMOTE ] IGD: Full fetch complete (29433 records). [2025-09-26T19:26:51.530142] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-09-26T19:26:51.914116] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-09-26T19:26:51.958505] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-09-26T19:26:51.958956] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-09-26T19:26:51.959812] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-09-26T19:26:51.959973] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-09-26T19:26:51.961215] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-26T19:26:51.965981] [DEBUG] [LOCAL ] IGD: Trimmed 29433 records to 19170 (keeping 200 days of data) [2025-09-26T19:26:52.090464] [DEBUG] [LOCAL ] IGD: Primary data saved (19170 records). [2025-09-26T19:26:52.090625] [INFO ] [MAIN ] IGD: Full history saved. [2025-09-26T19:26:52.090899] [INFO ] [MAIN ] Update Progress: 1098/2371 symbols completed. IGD took 34.5s. Estimated remaining: 2h 50m 13s. Rate: 7.5 symbols/min [2025-09-26T19:26:52.275086] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:26:52.309295] [DEBUG] [LOCAL ] IHG: Loaded 24781 existing records from primary storage. [2025-09-26T19:26:52.309543] [INFO ] [MAIN ] IHG: Loaded 24781 existing records. [2025-09-26T19:26:52.507181] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:26:52.507491] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-09-26T19:26:52.507553] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-09-26T19:26:52.508455] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-09-26T19:26:52.508540] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-09-26T19:26:52.716811] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-09-26T19:26:52.889375] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:26:53.431876] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-26T19:26:53.511731] [INFO ] [REMOTE ] IHG: Fetching primary data for 2024-12. [2025-09-26T19:26:53.663326] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-26T19:26:54.311727] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-09-26T19:26:54.753696] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-26T19:26:54.761983] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-26T19:26:55.111735] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-09-26T19:26:55.911758] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-09-26T19:26:56.167489] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-26T19:26:56.368749] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-26T19:26:56.711728] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-09-26T19:26:57.396168] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-26T19:26:57.511737] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-09-26T19:26:58.311748] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-09-26T19:26:58.656563] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-26T19:26:59.111764] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-09-26T19:26:59.748814] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-26T19:26:59.756912] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-26T19:26:59.911728] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-09-26T19:27:00.711693] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-09-26T19:27:01.116695] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-26T19:27:01.511716] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-09-26T19:27:02.088709] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-26T19:27:02.095754] [INFO ] [REMOTE ] IGR: Full fetch complete (45785 records). [2025-09-26T19:27:02.095954] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-09-26T19:27:02.278698] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-26T19:27:02.312989] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-09-26T19:27:02.534748] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-09-26T19:27:02.534851] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-09-26T19:27:02.535783] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-09-26T19:27:02.535849] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-09-26T19:27:02.536998] [DEBUG] [LOCAL ] IGR: Trimmed 45785 records to 30882 (keeping 200 days of data) [2025-09-26T19:27:02.737010] [DEBUG] [LOCAL ] IGR: Primary data saved (30882 records). [2025-09-26T19:27:02.737174] [INFO ] [MAIN ] IGR: Full history saved. [2025-09-26T19:27:02.737337] [INFO ] [MAIN ] Update Progress: 1099/2371 symbols completed. IGR took 42.6s. Estimated remaining: 2h 50m 8s. Rate: 7.5 symbols/min [2025-09-26T19:27:02.920140] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:27:02.962177] [DEBUG] [LOCAL ] IHS: Loaded 39219 existing records from primary storage. [2025-09-26T19:27:02.962319] [INFO ] [MAIN ] IHS: Loaded 39219 existing records. [2025-09-26T19:27:03.067335] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-26T19:27:03.119765] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-09-26T19:27:03.166469] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:27:03.166747] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-09-26T19:27:03.166805] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-09-26T19:27:03.168802] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-09-26T19:27:03.168885] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-09-26T19:27:03.550331] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:27:03.911223] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-26T19:27:03.912930] [INFO ] [REMOTE ] IH: Full fetch complete (4969 records). [2025-09-26T19:27:03.913029] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-09-26T19:27:03.911761] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-09-26T19:27:04.302200] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-09-26T19:27:04.302316] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-09-26T19:27:04.302483] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-09-26T19:27:04.302524] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-09-26T19:27:04.302944] [DEBUG] [LOCAL ] IH: Trimmed 4969 records to 3450 (keeping 200 days of data) [2025-09-26T19:27:04.325027] [DEBUG] [LOCAL ] IH: Primary data saved (3450 records). [2025-09-26T19:27:04.325165] [INFO ] [MAIN ] IH: Full history saved. [2025-09-26T19:27:04.325261] [INFO ] [MAIN ] Update Progress: 1100/2371 symbols completed. IH took 31.8s. Estimated remaining: 2h 49m 53s. Rate: 7.5 symbols/min [2025-09-26T19:27:04.504765] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:27:04.516049] [DEBUG] [LOCAL ] IIF: Loaded 5769 existing records from primary storage. [2025-09-26T19:27:04.516194] [INFO ] [MAIN ] IIF: Loaded 5769 existing records. [2025-09-26T19:27:04.714928] [INFO ] [REMOTE ] IHS: Fetching primary data for 2024-12. [2025-09-26T19:27:04.724187] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:27:04.725566] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-09-26T19:27:04.725671] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-09-26T19:27:04.726271] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-09-26T19:27:04.726341] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-09-26T19:27:04.859639] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-26T19:27:05.128822] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:27:05.511741] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-09-26T19:27:06.276437] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-26T19:27:06.297597] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-26T19:27:06.311680] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-09-26T19:27:07.105349] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-26T19:27:07.111667] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-09-26T19:27:07.735486] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-26T19:27:07.911759] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-09-26T19:27:08.711708] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-09-26T19:27:08.813283] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-26T19:27:08.815490] [INFO ] [REMOTE ] IHD: Full fetch complete (11865 records). [2025-09-26T19:27:08.815568] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-09-26T19:27:09.209690] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-09-26T19:27:09.209786] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-09-26T19:27:09.210105] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-09-26T19:27:09.210145] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-09-26T19:27:09.210696] [DEBUG] [LOCAL ] IHD: Trimmed 11865 records to 7225 (keeping 200 days of data) [2025-09-26T19:27:09.258122] [DEBUG] [LOCAL ] IHD: Primary data saved (7225 records). [2025-09-26T19:27:09.258277] [INFO ] [MAIN ] IHD: Full history saved. [2025-09-26T19:27:09.258395] [INFO ] [MAIN ] Update Progress: 1101/2371 symbols completed. IHD took 22.6s. Estimated remaining: 2h 49m 41s. Rate: 7.5 symbols/min [2025-09-26T19:27:09.437124] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:27:09.437340] [DEBUG] [LOCAL ] IIIN: No existing data file found in primary storage. [2025-09-26T19:27:09.437394] [WARN ] [MAIN ] IIIN: No existing data found, performing full refresh instead. [2025-09-26T19:27:09.437558] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-09-26T19:27:09.437621] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-09-26T19:27:09.437715] [DEBUG] [LOCAL ] IIIN: No primary data file found to delete. [2025-09-26T19:27:09.437757] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-09-26T19:27:09.516816] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-09-26T19:27:09.834230] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:27:10.219256] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-26T19:27:10.311704] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-09-26T19:27:10.817124] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-26T19:27:11.111738] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2024-12. [2025-09-26T19:27:11.798267] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T19:27:11.911725] [INFO ] [REMOTE ] IIF: Fetching primary data for 2024-12. [2025-09-26T19:27:12.144283] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-26T19:27:12.653550] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-26T19:27:12.711705] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-09-26T19:27:13.511744] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-09-26T19:27:13.797768] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-26T19:27:14.311697] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-09-26T19:27:14.327500] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-26T19:27:15.111717] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-09-26T19:27:15.450056] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-26T19:27:15.911715] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-09-26T19:27:15.930782] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-26T19:27:16.711713] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-09-26T19:27:16.928693] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-26T19:27:17.363745] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-26T19:27:17.511738] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-09-26T19:27:18.311734] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-09-26T19:27:18.713132] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-26T19:27:18.811826] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-26T19:27:19.111720] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-09-26T19:27:19.732245] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-26T19:27:19.911719] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-09-26T19:27:20.517944] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-26T19:27:20.711730] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-09-26T19:27:21.511688] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-09-26T19:27:21.831333] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-26T19:27:22.250680] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-26T19:27:22.311727] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-09-26T19:27:23.111725] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-09-26T19:27:23.753210] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-26T19:27:23.911722] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-09-26T19:27:24.294212] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-26T19:27:24.523940] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-26T19:27:24.711743] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-09-26T19:27:25.511733] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-09-26T19:27:26.147596] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-26T19:27:26.311728] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-09-26T19:27:26.831291] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-26T19:27:26.832740] [INFO ] [REMOTE ] IIF: Full fetch complete (9495 records). [2025-09-26T19:27:26.832936] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-09-26T19:27:26.890696] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-26T19:27:26.954522] [INFO ] [REMOTE ] IHG: Full fetch complete (33663 records). [2025-09-26T19:27:26.957205] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-09-26T19:27:27.116174] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-09-26T19:27:27.558921] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-09-26T19:27:27.564621] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-09-26T19:27:27.570036] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-09-26T19:27:27.575246] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-09-26T19:27:27.618891] [DEBUG] [LOCAL ] IIF: Trimmed 9495 records to 5787 (keeping 200 days of data) [2025-09-26T19:27:27.664601] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-09-26T19:27:27.675748] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-09-26T19:27:27.676716] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-09-26T19:27:27.679683] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-09-26T19:27:27.688408] [DEBUG] [LOCAL ] IIF: Primary data saved (5787 records). [2025-09-26T19:27:27.688801] [DEBUG] [LOCAL ] IHG: Trimmed 33663 records to 24977 (keeping 200 days of data) [2025-09-26T19:27:27.688699] [INFO ] [MAIN ] IIF: Full history saved. [2025-09-26T19:27:27.689298] [INFO ] [MAIN ] Update Progress: 1102/2371 symbols completed. IIF took 23.4s. Estimated remaining: 2h 49m 45s. Rate: 7.5 symbols/min [2025-09-26T19:27:27.915688] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-09-26T19:27:27.978574] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:27:28.027455] [DEBUG] [LOCAL ] IIM: Loaded 15993 existing records from primary storage. [2025-09-26T19:27:28.030614] [INFO ] [MAIN ] IIM: Loaded 15993 existing records. [2025-09-26T19:27:28.257208] [DEBUG] [LOCAL ] IHG: Primary data saved (24977 records). [2025-09-26T19:27:28.280199] [INFO ] [MAIN ] IHG: Full history saved. [2025-09-26T19:27:28.280523] [INFO ] [MAIN ] Update Progress: 1103/2371 symbols completed. IHG took 36.2s. Estimated remaining: 2h 49m 28s. Rate: 7.5 symbols/min [2025-09-26T19:27:28.280004] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:27:28.281388] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-09-26T19:27:28.327104] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-09-26T19:27:28.369923] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-09-26T19:27:28.394204] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-09-26T19:27:28.555379] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:27:28.846339] [DEBUG] [LOCAL ] IIPR: Loaded 29843 existing records from primary storage. [2025-09-26T19:27:28.850437] [INFO ] [MAIN ] IIPR: Loaded 29843 existing records. [2025-09-26T19:27:29.067296] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:27:29.095476] [INFO ] [REMOTE ] IIM: Fetching primary data for 2024-12. [2025-09-26T19:27:29.223472] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-26T19:27:29.232078] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:27:29.234171] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-09-26T19:27:29.234569] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-09-26T19:27:29.236186] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-26T19:27:29.245211] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-09-26T19:27:29.245495] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-09-26T19:27:29.516828] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-09-26T19:27:29.627570] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:27:30.320216] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2024-12. [2025-09-26T19:27:30.322312] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-26T19:27:30.692069] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-26T19:27:31.111735] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-09-26T19:27:31.779157] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-26T19:27:31.911732] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-09-26T19:27:32.205152] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-26T19:27:32.711723] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-09-26T19:27:33.378452] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-26T19:27:33.511719] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-09-26T19:27:34.218184] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-26T19:27:34.311699] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-09-26T19:27:34.622449] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-26T19:27:35.111762] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-09-26T19:27:35.809137] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-26T19:27:35.911725] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-09-26T19:27:36.387149] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-26T19:27:36.711726] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-09-26T19:27:37.303284] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-26T19:27:37.511725] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-09-26T19:27:37.647067] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-26T19:27:38.311740] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-09-26T19:27:38.865537] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-26T19:27:38.872113] [INFO ] [REMOTE ] IHS: Full fetch complete (52094 records). [2025-09-26T19:27:38.872262] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-09-26T19:27:39.116031] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-09-26T19:27:39.290118] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-09-26T19:27:39.290229] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-09-26T19:27:39.291069] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-09-26T19:27:39.291136] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-09-26T19:27:39.292487] [DEBUG] [LOCAL ] IHS: Trimmed 52094 records to 39400 (keeping 200 days of data) [2025-09-26T19:27:39.419589] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-26T19:27:39.545213] [DEBUG] [LOCAL ] IHS: Primary data saved (39400 records). [2025-09-26T19:27:39.545434] [INFO ] [MAIN ] IHS: Full history saved. [2025-09-26T19:27:39.545577] [INFO ] [MAIN ] Update Progress: 1104/2371 symbols completed. IHS took 36.8s. Estimated remaining: 2h 49m 24s. Rate: 7.5 symbols/min [2025-09-26T19:27:39.722045] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:27:39.762287] [DEBUG] [LOCAL ] IMAX: Loaded 43076 existing records from primary storage. [2025-09-26T19:27:39.762429] [INFO ] [MAIN ] IMAX: Loaded 43076 existing records. [2025-09-26T19:27:39.912039] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-09-26T19:27:39.951690] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:27:39.952819] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-09-26T19:27:39.952890] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-09-26T19:27:39.954023] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-09-26T19:27:39.954090] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-09-26T19:27:40.160748] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-26T19:27:40.360510] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:27:40.711715] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-09-26T19:27:41.511695] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2024-12. [2025-09-26T19:27:41.606168] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-26T19:27:41.746924] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-26T19:27:42.311719] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-09-26T19:27:42.869121] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-26T19:27:43.111786] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-09-26T19:27:43.303697] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-26T19:27:43.306990] [INFO ] [REMOTE ] IIIN: Full fetch complete (25128 records). [2025-09-26T19:27:43.307115] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-09-26T19:27:43.765254] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-09-26T19:27:43.765378] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-09-26T19:27:43.766048] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-09-26T19:27:43.766114] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-09-26T19:27:43.767838] [DEBUG] [LOCAL ] IIIN: Trimmed 25128 records to 16828 (keeping 200 days of data) [2025-09-26T19:27:43.887198] [DEBUG] [LOCAL ] IIIN: Primary data saved (16828 records). [2025-09-26T19:27:43.887362] [INFO ] [MAIN ] IIIN: Full history saved. [2025-09-26T19:27:43.887451] [INFO ] [MAIN ] Update Progress: 1105/2371 symbols completed. IIIN took 34.6s. Estimated remaining: 2h 49m 12s. Rate: 7.5 symbols/min [2025-09-26T19:27:43.921474] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-09-26T19:27:44.077511] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:27:44.096398] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-26T19:27:44.154933] [DEBUG] [LOCAL ] INFA: Loaded 50299 existing records from primary storage. [2025-09-26T19:27:44.155081] [INFO ] [MAIN ] INFA: Loaded 50299 existing records. [2025-09-26T19:27:44.373477] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:27:44.373877] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-09-26T19:27:44.373935] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-09-26T19:27:44.375572] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-09-26T19:27:44.375634] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-09-26T19:27:44.720635] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-09-26T19:27:44.767380] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:27:45.511717] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-09-26T19:27:45.556439] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-26T19:27:45.745502] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-26T19:27:46.311731] [INFO ] [REMOTE ] INFA: Fetching primary data for 2024-12. [2025-09-26T19:27:46.871317] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-26T19:27:47.111702] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-09-26T19:27:47.911702] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-09-26T19:27:48.045455] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-26T19:27:48.047394] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-26T19:27:48.711718] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-09-26T19:27:49.418639] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-26T19:27:49.511716] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-09-26T19:27:50.246786] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-26T19:27:50.311726] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-09-26T19:27:50.776499] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-26T19:27:50.984864] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-26T19:27:51.111733] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-09-26T19:27:51.911708] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-09-26T19:27:52.347862] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-26T19:27:52.711725] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-09-26T19:27:53.511734] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-09-26T19:27:53.669519] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-26T19:27:54.201854] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-26T19:27:54.311721] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-09-26T19:27:55.005674] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-26T19:27:55.111749] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-09-26T19:27:55.315271] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-26T19:27:55.911715] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-09-26T19:27:56.717918] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-09-26T19:27:56.735065] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-26T19:27:56.879287] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-26T19:27:57.511724] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-09-26T19:27:58.154723] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-26T19:27:58.311751] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-09-26T19:27:59.111755] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-09-26T19:27:59.184461] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-26T19:27:59.846031] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-26T19:27:59.851895] [INFO ] [REMOTE ] IIPR: Full fetch complete (44165 records). [2025-09-26T19:27:59.852044] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-09-26T19:27:59.918271] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-09-26T19:28:00.255894] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-09-26T19:28:00.255997] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-09-26T19:28:00.256733] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-09-26T19:28:00.256798] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-09-26T19:28:00.258311] [DEBUG] [LOCAL ] IIPR: Trimmed 44165 records to 30052 (keeping 200 days of data) [2025-09-26T19:28:00.461843] [DEBUG] [LOCAL ] IIPR: Primary data saved (30052 records). [2025-09-26T19:28:00.461992] [INFO ] [MAIN ] IIPR: Full history saved. [2025-09-26T19:28:00.462093] [INFO ] [MAIN ] Update Progress: 1106/2371 symbols completed. IIPR took 32.2s. Estimated remaining: 2h 49m 14s. Rate: 7.5 symbols/min [2025-09-26T19:28:00.643316] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:28:00.705780] [DEBUG] [LOCAL ] INFY: Loaded 53988 existing records from primary storage. [2025-09-26T19:28:00.705998] [INFO ] [MAIN ] INFY: Loaded 53988 existing records. [2025-09-26T19:28:00.738138] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-09-26T19:28:00.898557] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:28:00.899342] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-09-26T19:28:00.899440] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-09-26T19:28:00.901772] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-09-26T19:28:00.901863] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-09-26T19:28:01.318771] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:28:01.324581] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-26T19:28:01.365527] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-26T19:28:01.511722] [INFO ] [REMOTE ] INFY: Fetching primary data for 2024-12. [2025-09-26T19:28:02.022844] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-26T19:28:02.027971] [INFO ] [REMOTE ] IIM: Full fetch complete (25277 records). [2025-09-26T19:28:02.028118] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-09-26T19:28:02.320454] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-09-26T19:28:02.418365] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-09-26T19:28:02.418444] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-09-26T19:28:02.418979] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-09-26T19:28:02.419040] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-09-26T19:28:02.420584] [DEBUG] [LOCAL ] IIM: Trimmed 25277 records to 16102 (keeping 200 days of data) [2025-09-26T19:28:02.526800] [DEBUG] [LOCAL ] IIM: Primary data saved (16102 records). [2025-09-26T19:28:02.527094] [INFO ] [MAIN ] IIM: Full history saved. [2025-09-26T19:28:02.527204] [INFO ] [MAIN ] Update Progress: 1107/2371 symbols completed. IIM took 34.8s. Estimated remaining: 2h 48m 59s. Rate: 7.5 symbols/min [2025-09-26T19:28:02.701293] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:28:02.768975] [DEBUG] [LOCAL ] ING: Loaded 51166 existing records from primary storage. [2025-09-26T19:28:02.769161] [INFO ] [MAIN ] ING: Loaded 51166 existing records. [2025-09-26T19:28:02.953465] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:28:02.953793] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-09-26T19:28:02.953847] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-09-26T19:28:02.955849] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-09-26T19:28:02.955912] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-09-26T19:28:03.113904] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-09-26T19:28:03.360746] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:28:03.397840] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-26T19:28:03.655341] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-26T19:28:03.911727] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-09-26T19:28:04.650760] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-26T19:28:04.711709] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-09-26T19:28:05.208191] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-26T19:28:05.511746] [INFO ] [REMOTE ] ING: Fetching primary data for 2024-12. [2025-09-26T19:28:06.318637] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-09-26T19:28:06.337383] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-26T19:28:07.111716] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-09-26T19:28:07.318190] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-26T19:28:07.911707] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-09-26T19:28:07.994451] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-26T19:28:08.716213] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-09-26T19:28:08.723020] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-26T19:28:09.511708] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-09-26T19:28:09.668526] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-26T19:28:10.311740] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-09-26T19:28:10.449120] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-26T19:28:11.111736] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-09-26T19:28:11.291004] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-26T19:28:11.911713] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-09-26T19:28:11.955697] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-26T19:28:11.964685] [INFO ] [REMOTE ] IMAX: Full fetch complete (59679 records). [2025-09-26T19:28:11.964879] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-09-26T19:28:12.386967] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-09-26T19:28:12.387077] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-09-26T19:28:12.388182] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-09-26T19:28:12.388262] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-09-26T19:28:12.389694] [DEBUG] [LOCAL ] IMAX: Trimmed 59679 records to 43382 (keeping 200 days of data) [2025-09-26T19:28:12.658554] [DEBUG] [LOCAL ] IMAX: Primary data saved (43382 records). [2025-09-26T19:28:12.658727] [INFO ] [MAIN ] IMAX: Full history saved. [2025-09-26T19:28:12.658845] [INFO ] [MAIN ] Update Progress: 1108/2371 symbols completed. IMAX took 33.1s. Estimated remaining: 2h 48m 53s. Rate: 7.5 symbols/min [2025-09-26T19:28:12.718694] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-09-26T19:28:12.847720] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:28:12.880474] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-26T19:28:12.917983] [DEBUG] [LOCAL ] INGM: Loaded 28961 existing records from primary storage. [2025-09-26T19:28:12.918148] [INFO ] [MAIN ] INGM: Loaded 28961 existing records. [2025-09-26T19:28:13.110889] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:28:13.111610] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-09-26T19:28:13.111722] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-09-26T19:28:13.112751] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-09-26T19:28:13.112815] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-09-26T19:28:13.507831] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:28:13.518068] [INFO ] [REMOTE ] INGM: Fetching primary data for 2024-12. [2025-09-26T19:28:13.537119] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T19:28:14.311735] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-09-26T19:28:14.669825] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-26T19:28:14.919731] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T19:28:15.111726] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-09-26T19:28:15.911710] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-09-26T19:28:16.059769] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-26T19:28:16.072715] [INFO ] [REMOTE ] INFA: Full fetch complete (71699 records). [2025-09-26T19:28:16.072878] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-09-26T19:28:16.510201] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-09-26T19:28:16.510466] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-09-26T19:28:16.511593] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-09-26T19:28:16.511690] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-09-26T19:28:16.515459] [DEBUG] [LOCAL ] INFA: Trimmed 71699 records to 50602 (keeping 200 days of data) [2025-09-26T19:28:16.731724] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-09-26T19:28:16.841262] [DEBUG] [LOCAL ] INFA: Primary data saved (50602 records). [2025-09-26T19:28:16.841419] [INFO ] [MAIN ] INFA: Full history saved. [2025-09-26T19:28:16.841570] [INFO ] [MAIN ] Update Progress: 1109/2371 symbols completed. INFA took 33.0s. Estimated remaining: 2h 48m 41s. Rate: 7.5 symbols/min [2025-09-26T19:28:17.030578] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:28:17.067019] [DEBUG] [LOCAL ] INGR: Loaded 33657 existing records from primary storage. [2025-09-26T19:28:17.067205] [INFO ] [MAIN ] INGR: Loaded 33657 existing records. [2025-09-26T19:28:17.293619] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-26T19:28:17.300787] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:28:17.316940] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-09-26T19:28:17.317583] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-09-26T19:28:17.320279] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-09-26T19:28:17.320354] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-09-26T19:28:17.516857] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-09-26T19:28:17.767904] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:28:17.840849] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-26T19:28:17.851732] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-26T19:28:18.311728] [INFO ] [REMOTE ] INGR: Fetching primary data for 2024-12. [2025-09-26T19:28:19.111726] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-09-26T19:28:19.554503] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-26T19:28:19.679828] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-26T19:28:19.911724] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-09-26T19:28:20.271616] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-26T19:28:20.711729] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-09-26T19:28:21.511722] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-09-26T19:28:21.774981] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-26T19:28:22.311741] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-09-26T19:28:22.508948] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-26T19:28:22.962577] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-26T19:28:23.111719] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-09-26T19:28:23.785566] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T19:28:23.911717] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-09-26T19:28:24.525709] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-26T19:28:24.711745] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-09-26T19:28:25.511691] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-09-26T19:28:25.617790] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-26T19:28:26.056945] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-26T19:28:26.311744] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-09-26T19:28:26.943420] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-26T19:28:27.111719] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-09-26T19:28:27.701597] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-26T19:28:27.910759] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-26T19:28:27.917093] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-09-26T19:28:28.711720] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-09-26T19:28:29.511715] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-09-26T19:28:29.571357] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-26T19:28:30.311712] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-09-26T19:28:30.520824] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-26T19:28:30.764260] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-26T19:28:31.111723] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-09-26T19:28:31.843360] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-26T19:28:31.911688] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-09-26T19:28:32.667412] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-26T19:28:32.712886] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-09-26T19:28:32.715288] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-26T19:28:33.511740] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-09-26T19:28:34.311681] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-09-26T19:28:34.495867] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-26T19:28:34.531483] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-26T19:28:35.111776] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-09-26T19:28:35.344988] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-26T19:28:35.911767] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-09-26T19:28:36.402945] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-26T19:28:36.412062] [INFO ] [REMOTE ] INGM: Full fetch complete (42338 records). [2025-09-26T19:28:36.412277] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-09-26T19:28:36.717021] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-09-26T19:28:36.866209] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-09-26T19:28:36.866313] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-09-26T19:28:36.867273] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-09-26T19:28:36.867346] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-09-26T19:28:36.868767] [DEBUG] [LOCAL ] INGM: Trimmed 42338 records to 29224 (keeping 200 days of data) [2025-09-26T19:28:37.059248] [DEBUG] [LOCAL ] INGM: Primary data saved (29224 records). [2025-09-26T19:28:37.059414] [INFO ] [MAIN ] INGM: Full history saved. [2025-09-26T19:28:37.059514] [INFO ] [MAIN ] Update Progress: 1110/2371 symbols completed. INGM took 24.4s. Estimated remaining: 2h 48m 47s. Rate: 7.5 symbols/min [2025-09-26T19:28:37.249434] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:28:37.290746] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-26T19:28:37.311379] [DEBUG] [LOCAL ] INN: Loaded 42206 existing records from primary storage. [2025-09-26T19:28:37.311531] [INFO ] [MAIN ] INN: Loaded 42206 existing records. [2025-09-26T19:28:37.501877] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:28:37.502169] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-09-26T19:28:37.502221] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-09-26T19:28:37.504301] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-09-26T19:28:37.504374] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-09-26T19:28:37.516867] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-09-26T19:28:37.884526] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:28:38.311717] [INFO ] [REMOTE ] INN: Fetching primary data for 2024-12. [2025-09-26T19:28:38.867024] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-26T19:28:38.878867] [INFO ] [REMOTE ] INFY: Full fetch complete (77540 records). [2025-09-26T19:28:38.879035] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-09-26T19:28:39.046813] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-26T19:28:39.116001] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-09-26T19:28:39.362258] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-09-26T19:28:39.362501] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-09-26T19:28:39.363761] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-09-26T19:28:39.363887] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-09-26T19:28:39.365901] [DEBUG] [LOCAL ] INFY: Trimmed 77540 records to 54378 (keeping 200 days of data) [2025-09-26T19:28:39.486064] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-26T19:28:39.745760] [DEBUG] [LOCAL ] INFY: Primary data saved (54378 records). [2025-09-26T19:28:39.745917] [INFO ] [MAIN ] INFY: Full history saved. [2025-09-26T19:28:39.746055] [INFO ] [MAIN ] Update Progress: 1111/2371 symbols completed. INFY took 39.3s. Estimated remaining: 2h 48m 33s. Rate: 7.5 symbols/min [2025-09-26T19:28:39.916885] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-09-26T19:28:39.950991] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:28:39.951167] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-09-26T19:28:39.951206] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-09-26T19:28:39.951366] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-09-26T19:28:39.951457] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-26T19:28:39.951800] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-09-26T19:28:39.951860] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-09-26T19:28:40.335402] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:28:40.711723] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-09-26T19:28:41.001715] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-26T19:28:41.012103] [INFO ] [REMOTE ] ING: Full fetch complete (73638 records). [2025-09-26T19:28:41.012298] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-09-26T19:28:41.464089] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-09-26T19:28:41.464379] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-09-26T19:28:41.468287] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-26T19:28:41.466918] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-09-26T19:28:41.475147] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-09-26T19:28:41.477356] [DEBUG] [LOCAL ] ING: Trimmed 73638 records to 51537 (keeping 200 days of data) [2025-09-26T19:28:41.531826] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-09-26T19:28:41.635698] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-26T19:28:41.872968] [DEBUG] [LOCAL ] ING: Primary data saved (51537 records). [2025-09-26T19:28:41.873120] [INFO ] [MAIN ] ING: Full history saved. [2025-09-26T19:28:41.874382] [INFO ] [MAIN ] Update Progress: 1112/2371 symbols completed. ING took 39.3s. Estimated remaining: 2h 48m 18s. Rate: 7.5 symbols/min [2025-09-26T19:28:42.060489] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:28:42.105091] [DEBUG] [LOCAL ] INSP: Loaded 37201 existing records from primary storage. [2025-09-26T19:28:42.105267] [INFO ] [MAIN ] INSP: Loaded 37201 existing records. [2025-09-26T19:28:42.300018] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:28:42.300289] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-09-26T19:28:42.300339] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-09-26T19:28:42.301432] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-09-26T19:28:42.301496] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-09-26T19:28:42.316917] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-09-26T19:28:42.601573] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:28:42.610600] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-09-26T19:28:42.694223] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:28:42.866992] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-26T19:28:43.111755] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-09-26T19:28:43.911729] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-01. [2025-09-26T19:28:44.327205] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-26T19:28:44.701180] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-26T19:28:44.709071] [INFO ] [REMOTE ] INGR: Full fetch complete (49958 records). [2025-09-26T19:28:44.709226] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-09-26T19:28:44.721693] [INFO ] [REMOTE ] INSP: Fetching primary data for 2024-12. [2025-09-26T19:28:45.122625] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-09-26T19:28:45.122781] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-09-26T19:28:45.123611] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-09-26T19:28:45.123716] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-09-26T19:28:45.124928] [DEBUG] [LOCAL ] INGR: Trimmed 49958 records to 33913 (keeping 200 days of data) [2025-09-26T19:28:45.339352] [DEBUG] [LOCAL ] INGR: Primary data saved (33913 records). [2025-09-26T19:28:45.339514] [INFO ] [MAIN ] INGR: Full history saved. [2025-09-26T19:28:45.339625] [INFO ] [MAIN ] Update Progress: 1113/2371 symbols completed. INGR took 28.5s. Estimated remaining: 2h 48m 5s. Rate: 7.5 symbols/min [2025-09-26T19:28:45.518691] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-02. [2025-09-26T19:28:45.523204] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:28:45.564541] [DEBUG] [LOCAL ] INSW: Loaded 40590 existing records from primary storage. [2025-09-26T19:28:45.564719] [INFO ] [MAIN ] INSW: Loaded 40590 existing records. [2025-09-26T19:28:45.754281] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:28:45.754549] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-09-26T19:28:45.754597] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-09-26T19:28:45.755831] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-09-26T19:28:45.755896] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-09-26T19:28:46.141006] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:28:46.311713] [INFO ] [REMOTE ] INSW: Fetching primary data for 2024-12. [2025-09-26T19:28:46.342708] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-26T19:28:46.854161] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-26T19:28:47.111719] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-09-26T19:28:47.868981] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-26T19:28:47.911708] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-09-26T19:28:48.605429] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-26T19:28:48.711724] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-09-26T19:28:49.511729] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-09-26T19:28:49.604206] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-26T19:28:50.078050] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-26T19:28:50.311727] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-03. [2025-09-26T19:28:51.099414] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-26T19:28:51.111673] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-09-26T19:28:51.278137] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-26T19:28:51.911717] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-04. [2025-09-26T19:28:52.610013] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-26T19:28:52.711686] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-09-26T19:28:53.110869] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-26T19:28:53.511712] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-09-26T19:28:54.311717] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-05. [2025-09-26T19:28:54.371703] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-26T19:28:54.957987] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-26T19:28:55.111699] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-09-26T19:28:55.495816] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-26T19:28:55.911720] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-09-26T19:28:56.249617] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-26T19:28:56.711735] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-09-26T19:28:57.398850] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T19:28:57.511752] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-09-26T19:28:58.051693] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-26T19:28:58.311704] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-09-26T19:28:59.113222] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-09-26T19:28:59.116364] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-26T19:28:59.752482] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-26T19:28:59.911727] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-06. [2025-09-26T19:29:00.476750] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-26T19:29:00.711759] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-09-26T19:29:01.147878] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-26T19:29:01.511743] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-07. [2025-09-26T19:29:02.051246] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-26T19:29:02.311724] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-09-26T19:29:02.787995] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-26T19:29:03.111729] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-08. [2025-09-26T19:29:03.845603] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-26T19:29:03.911690] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-09-26T19:29:04.356635] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-26T19:29:04.711728] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-09-26T19:29:05.332125] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-26T19:29:05.511773] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-09-26T19:29:06.272312] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-26T19:29:06.279850] [INFO ] [REMOTE ] INN: Full fetch complete (57782 records). [2025-09-26T19:29:06.279994] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-09-26T19:29:06.316807] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-09-26T19:29:06.687799] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-09-26T19:29:06.687916] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-09-26T19:29:06.689081] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-09-26T19:29:06.689159] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-09-26T19:29:06.690695] [DEBUG] [LOCAL ] INN: Trimmed 57782 records to 42433 (keeping 200 days of data) [2025-09-26T19:29:06.969537] [DEBUG] [LOCAL ] INN: Primary data saved (42433 records). [2025-09-26T19:29:06.982529] [INFO ] [MAIN ] INN: Full history saved. [2025-09-26T19:29:06.982828] [INFO ] [MAIN ] Update Progress: 1114/2371 symbols completed. INN took 29.9s. Estimated remaining: 2h 48m 12s. Rate: 7.5 symbols/min [2025-09-26T19:29:07.024082] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-26T19:29:07.114143] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-09. [2025-09-26T19:29:07.199093] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:29:07.251567] [DEBUG] [LOCAL ] INVH: Loaded 53530 existing records from primary storage. [2025-09-26T19:29:07.251748] [INFO ] [MAIN ] INVH: Loaded 53530 existing records. [2025-09-26T19:29:07.443975] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:29:07.444308] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-09-26T19:29:07.444433] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-09-26T19:29:07.446560] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-09-26T19:29:07.446636] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-09-26T19:29:07.823207] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:29:07.911703] [INFO ] [REMOTE ] INVH: Fetching primary data for 2024-12. [2025-09-26T19:29:08.094251] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-26T19:29:08.397142] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-26T19:29:08.402884] [INFO ] [REMOTE ] INR: Full fetch complete (33416 records). [2025-09-26T19:29:08.402986] [DEBUG] [VALIDATOR ] INR: Validating primary data. [2025-09-26T19:29:08.620375] [WARN ] [VALIDATOR ] INR: Validation failed - insufficient historical data. Have 165 unique days, need 200 days [2025-09-26T19:29:08.620833] [FATAL] [MAIN ] INR: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:29:08.620906] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:29:08.620989] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-26T19:29:08.621064] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-09-26T19:29:08.621120] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-09-26T19:29:08.621204] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-09-26T19:29:08.621293] [INFO ] [MAIN ] Update Progress: 1115/2371 symbols completed. INR took 28.9s. Estimated remaining: 2h 47m 57s. Rate: 7.5 symbols/min [2025-09-26T19:29:08.716996] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-09-26T19:29:08.801954] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:29:08.832375] [DEBUG] [LOCAL ] INVX: Loaded 29093 existing records from primary storage. [2025-09-26T19:29:08.832519] [INFO ] [MAIN ] INVX: Loaded 29093 existing records. [2025-09-26T19:29:09.018030] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:29:09.018350] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-09-26T19:29:09.018412] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-09-26T19:29:09.019341] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-09-26T19:29:09.019434] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-09-26T19:29:09.399997] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:29:09.511747] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-09-26T19:29:09.772449] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-26T19:29:10.324133] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-09-26T19:29:10.348504] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-26T19:29:11.111691] [INFO ] [REMOTE ] INVX: Fetching primary data for 2024-12. [2025-09-26T19:29:11.305934] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-26T19:29:11.315173] [INFO ] [REMOTE ] INSP: Full fetch complete (52615 records). [2025-09-26T19:29:11.315331] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-09-26T19:29:11.740800] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-09-26T19:29:11.740905] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-09-26T19:29:11.741800] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-09-26T19:29:11.741874] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-09-26T19:29:11.743311] [DEBUG] [LOCAL ] INSP: Trimmed 52615 records to 37492 (keeping 200 days of data) [2025-09-26T19:29:11.912758] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-09-26T19:29:11.988017] [DEBUG] [LOCAL ] INSP: Primary data saved (37492 records). [2025-09-26T19:29:11.988253] [INFO ] [MAIN ] INSP: Full history saved. [2025-09-26T19:29:11.988885] [INFO ] [MAIN ] Update Progress: 1116/2371 symbols completed. INSP took 30.1s. Estimated remaining: 2h 47m 44s. Rate: 7.5 symbols/min [2025-09-26T19:29:12.182956] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:29:12.216899] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-26T19:29:12.252221] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-26T19:29:12.309165] [DEBUG] [LOCAL ] IONQ: Loaded 54178 existing records from primary storage. [2025-09-26T19:29:12.309354] [INFO ] [MAIN ] IONQ: Loaded 54178 existing records. [2025-09-26T19:29:12.501507] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:29:12.501847] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-09-26T19:29:12.501940] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-09-26T19:29:12.503588] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-09-26T19:29:12.503684] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-09-26T19:29:12.718383] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-09-26T19:29:12.911117] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:29:13.351972] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-26T19:29:13.511730] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-09-26T19:29:14.311689] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-09-26T19:29:14.427574] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-26T19:29:15.059085] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-26T19:29:15.111725] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-09-26T19:29:15.681801] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-26T19:29:15.911736] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2024-12. [2025-09-26T19:29:16.710571] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-26T19:29:16.718633] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-09-26T19:29:17.511761] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-09-26T19:29:18.311729] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-09-26T19:29:18.560611] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-26T19:29:18.672422] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2024-12 (2.76 seconds). [2025-09-26T19:29:19.111690] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-09-26T19:29:19.350546] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-26T19:29:19.358337] [INFO ] [REMOTE ] INSW: Full fetch complete (60690 records). [2025-09-26T19:29:19.358477] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-09-26T19:29:19.799224] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-09-26T19:29:19.799381] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-09-26T19:29:19.800338] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-09-26T19:29:19.800434] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-09-26T19:29:19.801961] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-26T19:29:19.809787] [DEBUG] [LOCAL ] INSW: Trimmed 60690 records to 40831 (keeping 200 days of data) [2025-09-26T19:29:19.912794] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-09-26T19:29:20.079823] [DEBUG] [LOCAL ] INSW: Primary data saved (40831 records). [2025-09-26T19:29:20.080122] [INFO ] [MAIN ] INSW: Full history saved. [2025-09-26T19:29:20.080606] [INFO ] [MAIN ] Update Progress: 1117/2371 symbols completed. INSW took 34.7s. Estimated remaining: 2h 47m 36s. Rate: 7.5 symbols/min [2025-09-26T19:29:20.712719] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-09-26T19:29:20.722907] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-26T19:29:21.093020] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-26T19:29:21.511827] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-09-26T19:29:22.311753] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-09-26T19:29:22.820585] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-26T19:29:23.003959] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-26T19:29:23.111760] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-09-26T19:29:23.911783] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-09-26T19:29:24.189891] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-26T19:29:24.711760] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-09-26T19:29:25.237534] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-26T19:29:25.511736] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-09-26T19:29:25.723091] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.61 seconds). [2025-09-26T19:29:26.311771] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-09-26T19:29:26.483137] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-26T19:29:26.682603] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-26T19:29:27.111724] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-09-26T19:29:27.911789] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-09-26T19:29:29.035000] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-26T19:29:29.050639] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-09-26T19:29:29.097539] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.79 seconds). [2025-09-26T19:29:29.150852] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-26T19:29:29.511768] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-09-26T19:29:30.311729] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-09-26T19:29:30.821578] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-26T19:29:30.822685] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-26T19:29:31.111744] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-09-26T19:29:31.911734] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-09-26T19:29:32.496531] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-26T19:29:32.502535] [INFO ] [REMOTE ] INVX: Full fetch complete (44396 records). [2025-09-26T19:29:32.502768] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-09-26T19:29:32.930916] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-09-26T19:29:32.931167] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-09-26T19:29:32.931951] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-09-26T19:29:32.932147] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-09-26T19:29:32.933316] [DEBUG] [LOCAL ] INVX: Trimmed 44396 records to 29366 (keeping 200 days of data) [2025-09-26T19:29:33.068942] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.76 seconds). [2025-09-26T19:29:33.089843] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-09-26T19:29:33.165138] [DEBUG] [LOCAL ] INVX: Primary data saved (29366 records). [2025-09-26T19:29:33.165300] [INFO ] [MAIN ] INVX: Full history saved. [2025-09-26T19:29:33.165438] [INFO ] [MAIN ] Update Progress: 1118/2371 symbols completed. INVX took 24.5s. Estimated remaining: 2h 47m 33s. Rate: 7.5 symbols/min [2025-09-26T19:29:33.585751] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-26T19:29:33.597006] [INFO ] [REMOTE ] INVH: Full fetch complete (76719 records). [2025-09-26T19:29:33.597151] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-09-26T19:29:34.013867] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-09-26T19:29:34.013972] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-09-26T19:29:34.015030] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-09-26T19:29:34.015096] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-09-26T19:29:34.017365] [DEBUG] [LOCAL ] INVH: Trimmed 76719 records to 53918 (keeping 200 days of data) [2025-09-26T19:29:34.370819] [DEBUG] [LOCAL ] INVH: Primary data saved (53918 records). [2025-09-26T19:29:34.370961] [INFO ] [MAIN ] INVH: Full history saved. [2025-09-26T19:29:34.371045] [INFO ] [MAIN ] Update Progress: 1119/2371 symbols completed. INVH took 27.4s. Estimated remaining: 2h 47m 18s. Rate: 7.5 symbols/min [2025-09-26T19:29:35.811933] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-09-26T19:29:35.823466] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-09-26T19:29:38.329732] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-09-26T19:29:38.340970] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-09-26T19:29:41.137608] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.80 seconds). [2025-09-26T19:29:41.149794] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-09-26T19:29:43.772559] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-09-26T19:29:43.784463] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-09-26T19:29:46.827960] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (3.04 seconds). [2025-09-26T19:29:46.839004] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-09-26T19:29:46.839206] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-09-26T19:29:47.262535] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-09-26T19:29:47.262623] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-09-26T19:29:47.263717] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-09-26T19:29:47.263787] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-09-26T19:29:47.265432] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 54568 (keeping 200 days of data) [2025-09-26T19:29:47.626447] [DEBUG] [LOCAL ] IONQ: Primary data saved (54568 records). [2025-09-26T19:29:47.626630] [INFO ] [MAIN ] IONQ: Full history saved. [2025-09-26T19:29:47.627363] [INFO ] [MAIN ] Update Progress: 1120/2371 symbols completed. IONQ took 35.6s. Estimated remaining: 2h 47m 15s. Rate: 7.5 symbols/min [2025-09-26T19:29:48.357176] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:29:48.382548] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:29:48.402539] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:29:48.423959] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:29:48.474188] [DEBUG] [LOCAL ] IPI: Loaded 21545 existing records from primary storage. [2025-09-26T19:29:48.474493] [INFO ] [MAIN ] IPI: Loaded 21545 existing records. [2025-09-26T19:29:48.666891] [DEBUG] [LOCAL ] IOT: Loaded 53859 existing records from primary storage. [2025-09-26T19:29:48.711105] [DEBUG] [LOCAL ] IPG: Loaded 53721 existing records from primary storage. [2025-09-26T19:29:48.711353] [INFO ] [MAIN ] IPG: Loaded 53721 existing records. [2025-09-26T19:29:48.725772] [INFO ] [MAIN ] IOT: Loaded 53859 existing records. [2025-09-26T19:29:48.857313] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:29:48.963311] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-09-26T19:29:48.969804] [DEBUG] [LOCAL ] IP: Loaded 53703 existing records from primary storage. [2025-09-26T19:29:48.963590] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-09-26T19:29:48.990627] [INFO ] [MAIN ] IP: Loaded 53703 existing records. [2025-09-26T19:29:49.033984] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-09-26T19:29:49.136706] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-09-26T19:29:49.362891] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:29:49.380094] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:29:49.405818] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-09-26T19:29:49.416300] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-09-26T19:29:49.446164] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-09-26T19:29:49.446360] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-09-26T19:29:49.446426] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-09-26T19:29:49.517466] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-09-26T19:29:49.558811] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:29:49.592907] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-09-26T19:29:49.637577] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-09-26T19:29:49.632359] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-09-26T19:29:49.725618] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-09-26T19:29:49.699824] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-09-26T19:29:49.807676] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-09-26T19:29:50.213710] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:29:50.308314] [INFO ] [REMOTE ] IPI: Fetching primary data for 2024-12. [2025-09-26T19:29:50.678694] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:29:50.729377] [INFO ] [REMOTE ] IPG: Fetching primary data for 2024-12. [2025-09-26T19:29:50.947292] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:29:50.966029] [INFO ] [REMOTE ] IOT: Fetching primary data for 2024-12. [2025-09-26T19:29:51.004273] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:29:51.004575] [INFO ] [REMOTE ] IP: Fetching primary data for 2024-12. [2025-09-26T19:29:51.565807] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-26T19:29:51.569715] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-09-26T19:29:52.606564] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-26T19:29:52.612366] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-09-26T19:29:52.711065] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-26T19:29:52.722336] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-09-26T19:29:53.066288] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-26T19:29:53.078087] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-09-26T19:29:53.152938] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-26T19:29:53.164001] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-09-26T19:29:53.433356] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-26T19:29:53.437718] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-09-26T19:29:54.482291] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-26T19:29:54.493668] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-09-26T19:29:54.526634] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-26T19:29:54.538506] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-09-26T19:29:54.600518] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-26T19:29:54.605862] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-09-26T19:29:54.780873] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-26T19:29:54.792255] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-09-26T19:29:55.745728] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-26T19:29:55.751250] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-09-26T19:29:56.107841] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-26T19:29:56.118871] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-09-26T19:29:56.148384] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-26T19:29:56.159672] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-09-26T19:29:56.518865] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-26T19:29:56.529233] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-09-26T19:29:57.047831] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-26T19:29:57.053846] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-09-26T19:29:57.819446] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-26T19:29:57.824815] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-09-26T19:29:57.992111] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-26T19:29:58.004804] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-09-26T19:29:58.076363] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-26T19:29:58.087961] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-09-26T19:29:58.573507] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-26T19:29:58.584993] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-09-26T19:29:58.926306] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-26T19:29:58.930919] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-09-26T19:29:59.783526] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-26T19:29:59.795334] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-09-26T19:29:59.945991] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-26T19:29:59.958432] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-09-26T19:29:59.989711] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-26T19:29:59.994298] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-09-26T19:30:00.496786] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-26T19:30:00.508428] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-09-26T19:30:01.217952] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-26T19:30:01.223047] [INFO ] [REMOTE ] IPI: Full fetch complete (29263 records). [2025-09-26T19:30:01.223294] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-09-26T19:30:01.619689] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-26T19:30:01.698485] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-09-26T19:30:01.699107] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-09-26T19:30:01.698665] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-09-26T19:30:01.700057] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-09-26T19:30:01.701079] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-09-26T19:30:01.702775] [DEBUG] [LOCAL ] IPI: Trimmed 29263 records to 21704 (keeping 200 days of data) [2025-09-26T19:30:01.843135] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-26T19:30:01.857746] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-09-26T19:30:01.895008] [DEBUG] [LOCAL ] IPI: Primary data saved (21704 records). [2025-09-26T19:30:01.895143] [INFO ] [MAIN ] IPI: Full history saved. [2025-09-26T19:30:01.895243] [INFO ] [MAIN ] Update Progress: 1121/2371 symbols completed. IPI took 14.3s. Estimated remaining: 2h 47m 14s. Rate: 7.5 symbols/min [2025-09-26T19:30:02.101236] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:30:02.144153] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-26T19:30:02.156394] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-09-26T19:30:02.163594] [DEBUG] [LOCAL ] IQI: Loaded 18062 existing records from primary storage. [2025-09-26T19:30:02.163706] [INFO ] [MAIN ] IQI: Loaded 18062 existing records. [2025-09-26T19:30:02.370960] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:30:02.371311] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-09-26T19:30:02.371368] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-09-26T19:30:02.371961] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-09-26T19:30:02.372022] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-09-26T19:30:02.768158] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:30:02.768523] [INFO ] [REMOTE ] IQI: Fetching primary data for 2024-12. [2025-09-26T19:30:03.443167] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-26T19:30:03.459451] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-09-26T19:30:03.713162] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-26T19:30:03.725990] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-09-26T19:30:03.870721] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-26T19:30:03.911682] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-09-26T19:30:04.024313] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-26T19:30:04.711757] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-09-26T19:30:05.199718] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-26T19:30:05.455957] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-26T19:30:05.511730] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-09-26T19:30:05.660605] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-26T19:30:06.311859] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-09-26T19:30:06.615503] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-26T19:30:06.657721] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-26T19:30:07.111732] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-09-26T19:30:07.911719] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-09-26T19:30:08.258867] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-26T19:30:08.711730] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-09-26T19:30:08.807422] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-26T19:30:08.950598] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-26T19:30:09.511756] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-09-26T19:30:10.311751] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-09-26T19:30:10.454100] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-26T19:30:11.111787] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-09-26T19:30:11.403275] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-26T19:30:11.575128] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-26T19:30:11.586230] [INFO ] [REMOTE ] IP: Full fetch complete (77056 records). [2025-09-26T19:30:11.586432] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-09-26T19:30:11.915587] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-09-26T19:30:12.014408] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-09-26T19:30:12.014505] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-09-26T19:30:12.015471] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-09-26T19:30:12.015537] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-09-26T19:30:12.019232] [DEBUG] [LOCAL ] IP: Trimmed 77056 records to 54093 (keeping 200 days of data) [2025-09-26T19:30:12.360460] [DEBUG] [LOCAL ] IP: Primary data saved (54093 records). [2025-09-26T19:30:12.360616] [INFO ] [MAIN ] IP: Full history saved. [2025-09-26T19:30:12.360755] [INFO ] [MAIN ] Update Progress: 1122/2371 symbols completed. IP took 24.7s. Estimated remaining: 2h 47m 9s. Rate: 7.5 symbols/min [2025-09-26T19:30:12.546473] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:30:12.601253] [DEBUG] [LOCAL ] IQV: Loaded 50564 existing records from primary storage. [2025-09-26T19:30:12.601438] [INFO ] [MAIN ] IQV: Loaded 50564 existing records. [2025-09-26T19:30:12.716902] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-09-26T19:30:12.795256] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:30:12.795576] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-09-26T19:30:12.795625] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-09-26T19:30:12.797176] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-09-26T19:30:12.797247] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-09-26T19:30:13.183899] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:30:13.258705] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-26T19:30:13.272152] [INFO ] [REMOTE ] IOT: Full fetch complete (77380 records). [2025-09-26T19:30:13.272427] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-09-26T19:30:13.523954] [INFO ] [REMOTE ] IQV: Fetching primary data for 2024-12. [2025-09-26T19:30:13.711899] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-09-26T19:30:13.712062] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-09-26T19:30:13.713364] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-09-26T19:30:13.719231] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-09-26T19:30:13.725242] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-26T19:30:13.757895] [DEBUG] [LOCAL ] IOT: Trimmed 77380 records to 54249 (keeping 200 days of data) [2025-09-26T19:30:13.760879] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-26T19:30:13.828696] [INFO ] [REMOTE ] IPG: Full fetch complete (77254 records). [2025-09-26T19:30:13.855047] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-09-26T19:30:14.322244] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-09-26T19:30:14.414528] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-09-26T19:30:14.415334] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-09-26T19:30:14.417180] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-09-26T19:30:14.417269] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-09-26T19:30:14.422087] [DEBUG] [LOCAL ] IPG: Trimmed 77254 records to 54110 (keeping 200 days of data) [2025-09-26T19:30:14.767631] [DEBUG] [LOCAL ] IOT: Primary data saved (54249 records). [2025-09-26T19:30:14.768583] [INFO ] [MAIN ] IOT: Full history saved. [2025-09-26T19:30:14.769035] [INFO ] [MAIN ] Update Progress: 1123/2371 symbols completed. IOT took 27.1s. Estimated remaining: 2h 46m 55s. Rate: 7.5 symbols/min [2025-09-26T19:30:14.964553] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:30:15.095943] [DEBUG] [LOCAL ] IR: Loaded 53084 existing records from primary storage. [2025-09-26T19:30:15.096773] [INFO ] [MAIN ] IR: Loaded 53084 existing records. [2025-09-26T19:30:15.336420] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:30:15.337381] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-26T19:30:15.336714] [DEBUG] [LOCAL ] IPG: Primary data saved (54110 records). [2025-09-26T19:30:15.341402] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-09-26T19:30:15.342051] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-09-26T19:30:15.342161] [INFO ] [MAIN ] IPG: Full history saved. [2025-09-26T19:30:15.342596] [INFO ] [MAIN ] Update Progress: 1124/2371 symbols completed. IPG took 27.7s. Estimated remaining: 2h 46m 38s. Rate: 7.5 symbols/min [2025-09-26T19:30:15.343571] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-09-26T19:30:15.348887] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-09-26T19:30:15.362489] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-09-26T19:30:15.709807] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:30:15.826869] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-26T19:30:15.916294] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-09-26T19:30:15.983973] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:30:16.017229] [DEBUG] [LOCAL ] IRM: Loaded 49808 existing records from primary storage. [2025-09-26T19:30:16.017404] [INFO ] [MAIN ] IRM: Loaded 49808 existing records. [2025-09-26T19:30:16.233777] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:30:16.234135] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-09-26T19:30:16.234193] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-09-26T19:30:16.236079] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-09-26T19:30:16.236144] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-09-26T19:30:16.586989] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-26T19:30:16.655002] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:30:16.711733] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-09-26T19:30:17.511727] [INFO ] [REMOTE ] IR: Fetching primary data for 2024-12. [2025-09-26T19:30:17.647338] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-26T19:30:17.820161] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-26T19:30:18.311741] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-09-26T19:30:19.111699] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-09-26T19:30:19.164604] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-26T19:30:19.419599] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-26T19:30:19.424589] [INFO ] [REMOTE ] IQI: Full fetch complete (27131 records). [2025-09-26T19:30:19.424773] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-09-26T19:30:19.829699] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-09-26T19:30:19.829804] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-09-26T19:30:19.830360] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-09-26T19:30:19.830406] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-09-26T19:30:19.831374] [DEBUG] [LOCAL ] IQI: Trimmed 27131 records to 18161 (keeping 200 days of data) [2025-09-26T19:30:19.926156] [INFO ] [REMOTE ] IRM: Fetching primary data for 2024-12. [2025-09-26T19:30:19.964235] [DEBUG] [LOCAL ] IQI: Primary data saved (18161 records). [2025-09-26T19:30:19.964405] [INFO ] [MAIN ] IQI: Full history saved. [2025-09-26T19:30:19.964534] [INFO ] [MAIN ] Update Progress: 1125/2371 symbols completed. IQI took 18.1s. Estimated remaining: 2h 46m 27s. Rate: 7.5 symbols/min [2025-09-26T19:30:20.151316] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:30:20.174728] [DEBUG] [LOCAL ] IRS: Loaded 21983 existing records from primary storage. [2025-09-26T19:30:20.174876] [INFO ] [MAIN ] IRS: Loaded 21983 existing records. [2025-09-26T19:30:20.363995] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:30:20.364281] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-09-26T19:30:20.364356] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-09-26T19:30:20.365011] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-09-26T19:30:20.365073] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-09-26T19:30:20.736697] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-09-26T19:30:20.776028] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:30:20.845539] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-26T19:30:21.511698] [INFO ] [REMOTE ] IRS: Fetching primary data for 2024-12. [2025-09-26T19:30:21.836429] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-26T19:30:22.311774] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-09-26T19:30:22.606801] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-26T19:30:22.725120] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-26T19:30:23.111725] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-09-26T19:30:23.911972] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-26T19:30:23.912123] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-09-26T19:30:24.711700] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-09-26T19:30:24.798211] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-26T19:30:25.511738] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-09-26T19:30:25.617020] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-26T19:30:26.359537] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-09-26T19:30:26.385133] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-26T19:30:26.741034] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-26T19:30:27.111730] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-09-26T19:30:27.911745] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-09-26T19:30:28.024969] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-26T19:30:28.711762] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-09-26T19:30:28.987770] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-26T19:30:29.511765] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-09-26T19:30:29.841749] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-26T19:30:30.183909] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T19:30:30.311979] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-09-26T19:30:30.521778] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-26T19:30:31.111720] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-09-26T19:30:31.911692] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-09-26T19:30:32.001815] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-26T19:30:32.093782] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-26T19:30:32.711753] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-09-26T19:30:33.511729] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-09-26T19:30:33.727173] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-26T19:30:33.808797] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-26T19:30:34.311725] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-09-26T19:30:35.111696] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-09-26T19:30:35.355243] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-26T19:30:35.391103] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-26T19:30:35.911716] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-09-26T19:30:36.711725] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-09-26T19:30:37.042386] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-26T19:30:37.516896] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-09-26T19:30:37.545626] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-26T19:30:38.311733] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-09-26T19:30:38.353923] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-26T19:30:38.674031] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-26T19:30:39.111727] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-09-26T19:30:39.911692] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-09-26T19:30:40.069967] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-26T19:30:40.178611] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-26T19:30:40.711728] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-09-26T19:30:41.516817] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-09-26T19:30:41.537390] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-26T19:30:42.311771] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-09-26T19:30:42.518238] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-26T19:30:42.618961] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-26T19:30:43.111753] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-09-26T19:30:43.825532] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-26T19:30:43.911716] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-09-26T19:30:44.711721] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-09-26T19:30:44.826954] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-26T19:30:45.511730] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-09-26T19:30:45.740594] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-26T19:30:45.897633] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-26T19:30:45.904632] [INFO ] [REMOTE ] IRS: Full fetch complete (32249 records). [2025-09-26T19:30:45.904834] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-09-26T19:30:46.300822] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-09-26T19:30:46.300921] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-09-26T19:30:46.301568] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-09-26T19:30:46.301612] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-09-26T19:30:46.302547] [DEBUG] [LOCAL ] IRS: Trimmed 32249 records to 22136 (keeping 200 days of data) [2025-09-26T19:30:46.351312] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-09-26T19:30:46.435342] [DEBUG] [LOCAL ] IRS: Primary data saved (22136 records). [2025-09-26T19:30:46.435485] [INFO ] [MAIN ] IRS: Full history saved. [2025-09-26T19:30:46.435586] [INFO ] [MAIN ] Update Progress: 1126/2371 symbols completed. IRS took 26.5s. Estimated remaining: 2h 46m 39s. Rate: 7.5 symbols/min [2025-09-26T19:30:46.619173] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:30:46.679752] [DEBUG] [LOCAL ] IRT: Loaded 50769 existing records from primary storage. [2025-09-26T19:30:46.679906] [INFO ] [MAIN ] IRT: Loaded 50769 existing records. [2025-09-26T19:30:46.877849] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:30:46.878129] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-09-26T19:30:46.878178] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-09-26T19:30:46.879879] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-09-26T19:30:46.879941] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-09-26T19:30:47.119216] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-09-26T19:30:47.276831] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:30:47.401141] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-26T19:30:47.411695] [INFO ] [REMOTE ] IR: Full fetch complete (76148 records). [2025-09-26T19:30:47.411862] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-09-26T19:30:47.837024] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-09-26T19:30:47.837120] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-09-26T19:30:47.838107] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-09-26T19:30:47.838176] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-09-26T19:30:47.839730] [DEBUG] [LOCAL ] IR: Trimmed 76148 records to 53470 (keeping 200 days of data) [2025-09-26T19:30:47.935593] [INFO ] [REMOTE ] IRT: Fetching primary data for 2024-12. [2025-09-26T19:30:48.193304] [DEBUG] [LOCAL ] IR: Primary data saved (53470 records). [2025-09-26T19:30:48.193614] [INFO ] [MAIN ] IR: Full history saved. [2025-09-26T19:30:48.193768] [INFO ] [MAIN ] Update Progress: 1127/2371 symbols completed. IR took 33.4s. Estimated remaining: 2h 46m 24s. Rate: 7.5 symbols/min [2025-09-26T19:30:48.302192] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-26T19:30:48.349117] [INFO ] [REMOTE ] IQV: Full fetch complete (72257 records). [2025-09-26T19:30:48.359620] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-09-26T19:30:48.470251] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:30:48.701968] [DEBUG] [LOCAL ] ISD: Loaded 15685 existing records from primary storage. [2025-09-26T19:30:48.724671] [INFO ] [MAIN ] ISD: Loaded 15685 existing records. [2025-09-26T19:30:48.984104] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-09-26T19:30:48.984406] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-09-26T19:30:48.985953] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-09-26T19:30:48.986097] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-09-26T19:30:49.070829] [DEBUG] [LOCAL ] IQV: Trimmed 72257 records to 50895 (keeping 200 days of data) [2025-09-26T19:30:49.071146] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:30:49.071587] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-09-26T19:30:49.071675] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-09-26T19:30:49.124792] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-09-26T19:30:49.134084] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-09-26T19:30:49.253870] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-26T19:30:49.351595] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-09-26T19:30:49.646679] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:30:49.647506] [INFO ] [REMOTE ] ISD: Fetching primary data for 2024-12. [2025-09-26T19:30:49.679169] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-26T19:30:49.883041] [DEBUG] [LOCAL ] IQV: Primary data saved (50895 records). [2025-09-26T19:30:49.883202] [INFO ] [MAIN ] IQV: Full history saved. [2025-09-26T19:30:49.883297] [INFO ] [MAIN ] Update Progress: 1128/2371 symbols completed. IQV took 37.5s. Estimated remaining: 2h 46m 9s. Rate: 7.5 symbols/min [2025-09-26T19:30:50.060840] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:30:50.099940] [DEBUG] [LOCAL ] IT: Loaded 41941 existing records from primary storage. [2025-09-26T19:30:50.100144] [INFO ] [MAIN ] IT: Loaded 41941 existing records. [2025-09-26T19:30:50.291089] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:30:50.291401] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-09-26T19:30:50.291469] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-09-26T19:30:50.293530] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-09-26T19:30:50.293598] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-09-26T19:30:50.327827] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-09-26T19:30:50.673953] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-26T19:30:50.735370] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:30:51.111700] [INFO ] [REMOTE ] IT: Fetching primary data for 2024-12. [2025-09-26T19:30:51.204043] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-26T19:30:51.214047] [INFO ] [REMOTE ] IRM: Full fetch complete (72260 records). [2025-09-26T19:30:51.214250] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-09-26T19:30:51.624040] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-09-26T19:30:51.624124] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-09-26T19:30:51.625132] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-09-26T19:30:51.625297] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-09-26T19:30:51.626764] [DEBUG] [LOCAL ] IRM: Trimmed 72260 records to 50159 (keeping 200 days of data) [2025-09-26T19:30:51.914544] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-09-26T19:30:51.956380] [DEBUG] [LOCAL ] IRM: Primary data saved (50159 records). [2025-09-26T19:30:51.956551] [INFO ] [MAIN ] IRM: Full history saved. [2025-09-26T19:30:51.956710] [INFO ] [MAIN ] Update Progress: 1129/2371 symbols completed. IRM took 36.6s. Estimated remaining: 2h 45m 55s. Rate: 7.5 symbols/min [2025-09-26T19:30:52.098071] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-26T19:30:52.181576] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:30:52.214304] [DEBUG] [LOCAL ] ITGR: Loaded 31817 existing records from primary storage. [2025-09-26T19:30:52.214478] [INFO ] [MAIN ] ITGR: Loaded 31817 existing records. [2025-09-26T19:30:52.404154] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:30:52.404539] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-09-26T19:30:52.404777] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-09-26T19:30:52.405784] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-09-26T19:30:52.405846] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-09-26T19:30:52.543762] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-26T19:30:52.716862] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-09-26T19:30:52.828188] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:30:52.986916] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-26T19:30:53.511751] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2024-12. [2025-09-26T19:30:54.157729] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-26T19:30:54.311718] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-09-26T19:30:54.609469] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-26T19:30:55.111733] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-09-26T19:30:55.753799] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-26T19:30:55.911718] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-09-26T19:30:56.637287] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-26T19:30:56.711752] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-09-26T19:30:57.435884] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-26T19:30:57.511697] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-09-26T19:30:58.311708] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-09-26T19:30:58.467424] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-26T19:30:58.913630] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-26T19:30:59.111730] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-09-26T19:30:59.311134] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-26T19:30:59.911750] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-09-26T19:31:00.413687] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-26T19:31:00.711745] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-09-26T19:31:01.019757] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-26T19:31:01.511746] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-09-26T19:31:01.585132] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-26T19:31:02.311759] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-09-26T19:31:02.933941] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-26T19:31:03.111704] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-09-26T19:31:03.469353] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-26T19:31:03.911771] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-09-26T19:31:04.711687] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-09-26T19:31:04.814340] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-26T19:31:05.400059] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-26T19:31:05.511755] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-09-26T19:31:06.311739] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-09-26T19:31:06.687399] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-26T19:31:06.722121] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-26T19:31:07.111781] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-09-26T19:31:07.911700] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-09-26T19:31:08.157634] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-26T19:31:08.180015] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-26T19:31:08.711736] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-09-26T19:31:09.516858] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-09-26T19:31:09.530310] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-26T19:31:10.252469] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-26T19:31:10.311759] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-09-26T19:31:11.069717] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-26T19:31:11.111673] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-09-26T19:31:11.911678] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-09-26T19:31:12.100185] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-26T19:31:12.711695] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-09-26T19:31:13.041042] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-26T19:31:13.050924] [INFO ] [REMOTE ] IT: Full fetch complete (55635 records). [2025-09-26T19:31:13.051142] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-09-26T19:31:13.521272] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-26T19:31:13.515129] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-09-26T19:31:13.523607] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-26T19:31:13.572911] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-09-26T19:31:13.573455] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-09-26T19:31:13.574819] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-09-26T19:31:13.574927] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-09-26T19:31:13.576548] [DEBUG] [LOCAL ] IT: Trimmed 55635 records to 42234 (keeping 200 days of data) [2025-09-26T19:31:13.838002] [DEBUG] [LOCAL ] IT: Primary data saved (42234 records). [2025-09-26T19:31:13.838170] [INFO ] [MAIN ] IT: Full history saved. [2025-09-26T19:31:13.838272] [INFO ] [MAIN ] Update Progress: 1130/2371 symbols completed. IT took 24.0s. Estimated remaining: 2h 46m 2s. Rate: 7.5 symbols/min [2025-09-26T19:31:14.015779] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:31:14.062077] [DEBUG] [LOCAL ] ITT: Loaded 33310 existing records from primary storage. [2025-09-26T19:31:14.062222] [INFO ] [MAIN ] ITT: Loaded 33310 existing records. [2025-09-26T19:31:14.252506] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:31:14.252845] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-09-26T19:31:14.252899] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-09-26T19:31:14.254121] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-09-26T19:31:14.254198] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-09-26T19:31:14.321107] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-09-26T19:31:14.629971] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:31:15.111696] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-09-26T19:31:15.300296] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-26T19:31:15.838489] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-26T19:31:15.911700] [INFO ] [REMOTE ] ITT: Fetching primary data for 2024-12. [2025-09-26T19:31:16.221233] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-26T19:31:16.711718] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-09-26T19:31:17.156473] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-26T19:31:17.511737] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-09-26T19:31:18.154438] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-26T19:31:18.311742] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-09-26T19:31:19.111719] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-09-26T19:31:19.204901] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-26T19:31:19.215049] [INFO ] [REMOTE ] IRT: Full fetch complete (72483 records). [2025-09-26T19:31:19.215235] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-09-26T19:31:19.550553] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-26T19:31:19.651937] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-09-26T19:31:19.652033] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-09-26T19:31:19.652999] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-09-26T19:31:19.653073] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-09-26T19:31:19.654811] [DEBUG] [LOCAL ] IRT: Trimmed 72483 records to 51146 (keeping 200 days of data) [2025-09-26T19:31:19.918346] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-09-26T19:31:20.005466] [DEBUG] [LOCAL ] IRT: Primary data saved (51146 records). [2025-09-26T19:31:20.005700] [INFO ] [MAIN ] IRT: Full history saved. [2025-09-26T19:31:20.006757] [INFO ] [MAIN ] Update Progress: 1131/2371 symbols completed. IRT took 33.6s. Estimated remaining: 2h 45m 52s. Rate: 7.5 symbols/min [2025-09-26T19:31:20.184919] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:31:20.217282] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-26T19:31:20.268887] [DEBUG] [LOCAL ] ITUB: Loaded 53694 existing records from primary storage. [2025-09-26T19:31:20.269076] [INFO ] [MAIN ] ITUB: Loaded 53694 existing records. [2025-09-26T19:31:20.500443] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:31:20.500821] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-09-26T19:31:20.500880] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-09-26T19:31:20.502457] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-09-26T19:31:20.502528] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-09-26T19:31:20.712888] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-09-26T19:31:20.901323] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:31:20.962463] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-26T19:31:20.965857] [INFO ] [REMOTE ] ISD: Full fetch complete (23916 records). [2025-09-26T19:31:20.965936] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-09-26T19:31:21.379306] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-09-26T19:31:21.379401] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-09-26T19:31:21.379991] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-09-26T19:31:21.380060] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-09-26T19:31:21.380974] [DEBUG] [LOCAL ] ISD: Trimmed 23916 records to 15803 (keeping 200 days of data) [2025-09-26T19:31:21.483295] [DEBUG] [LOCAL ] ISD: Primary data saved (15803 records). [2025-09-26T19:31:21.483454] [INFO ] [MAIN ] ISD: Full history saved. [2025-09-26T19:31:21.483549] [INFO ] [MAIN ] Update Progress: 1132/2371 symbols completed. ISD took 33.3s. Estimated remaining: 2h 45m 37s. Rate: 7.5 symbols/min [2025-09-26T19:31:21.517276] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-09-26T19:31:21.702354] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:31:21.749072] [DEBUG] [LOCAL ] ITW: Loaded 46541 existing records from primary storage. [2025-09-26T19:31:21.749236] [INFO ] [MAIN ] ITW: Loaded 46541 existing records. [2025-09-26T19:31:21.943419] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:31:21.943735] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-09-26T19:31:21.943814] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-09-26T19:31:21.945326] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-09-26T19:31:21.945398] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-09-26T19:31:22.311829] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2024-12. [2025-09-26T19:31:22.347929] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:31:22.435265] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T19:31:22.441538] [INFO ] [REMOTE ] ITGR: Full fetch complete (41524 records). [2025-09-26T19:31:22.441664] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-09-26T19:31:22.840015] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-09-26T19:31:22.840104] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-09-26T19:31:22.840791] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-09-26T19:31:22.840856] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-09-26T19:31:22.841948] [DEBUG] [LOCAL ] ITGR: Trimmed 41524 records to 31996 (keeping 200 days of data) [2025-09-26T19:31:23.042182] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-26T19:31:23.070761] [DEBUG] [LOCAL ] ITGR: Primary data saved (31996 records). [2025-09-26T19:31:23.070926] [INFO ] [MAIN ] ITGR: Full history saved. [2025-09-26T19:31:23.071023] [INFO ] [MAIN ] Update Progress: 1133/2371 symbols completed. ITGR took 31.1s. Estimated remaining: 2h 45m 21s. Rate: 7.5 symbols/min [2025-09-26T19:31:23.116976] [INFO ] [REMOTE ] ITW: Fetching primary data for 2024-12. [2025-09-26T19:31:23.280457] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:31:23.350688] [DEBUG] [LOCAL ] IVR: Loaded 48228 existing records from primary storage. [2025-09-26T19:31:23.350874] [INFO ] [MAIN ] IVR: Loaded 48228 existing records. [2025-09-26T19:31:23.548696] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:31:23.549152] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-09-26T19:31:23.549217] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-09-26T19:31:23.550512] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-09-26T19:31:23.550593] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-09-26T19:31:23.917710] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-09-26T19:31:23.946583] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:31:24.030093] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-26T19:31:24.711714] [INFO ] [REMOTE ] IVR: Fetching primary data for 2024-12. [2025-09-26T19:31:24.873214] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-26T19:31:25.408988] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-26T19:31:25.511725] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-09-26T19:31:26.311703] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-09-26T19:31:26.397849] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-26T19:31:26.927113] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-26T19:31:27.111726] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-09-26T19:31:27.569460] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-26T19:31:27.911740] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-09-26T19:31:28.671412] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-26T19:31:28.711705] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-09-26T19:31:29.511727] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-09-26T19:31:29.836208] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-26T19:31:30.157917] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-26T19:31:30.311722] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-09-26T19:31:31.111726] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-09-26T19:31:31.370358] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-26T19:31:31.911721] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-09-26T19:31:32.287732] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-26T19:31:32.711742] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-09-26T19:31:33.204049] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-26T19:31:33.511731] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-09-26T19:31:33.659110] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-26T19:31:34.317687] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-09-26T19:31:34.342330] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-26T19:31:35.111746] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-09-26T19:31:35.324051] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-26T19:31:35.911780] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-09-26T19:31:36.221049] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-26T19:31:36.711726] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-09-26T19:31:36.941277] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-26T19:31:37.513377] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-09-26T19:31:37.519330] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-26T19:31:38.311692] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-09-26T19:31:38.428359] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T19:31:38.496168] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-26T19:31:39.111713] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-09-26T19:31:39.911736] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-09-26T19:31:40.339473] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-26T19:31:40.711686] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-09-26T19:31:40.901594] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-26T19:31:41.462264] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T19:31:41.511727] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-09-26T19:31:42.054717] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-26T19:31:42.311738] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-09-26T19:31:43.111687] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-09-26T19:31:43.342075] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-26T19:31:43.911731] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-09-26T19:31:44.231755] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-26T19:31:44.711724] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-09-26T19:31:44.858757] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-26T19:31:44.888769] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-26T19:31:45.511738] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-09-26T19:31:46.311720] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-09-26T19:31:46.635698] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-26T19:31:47.116849] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-09-26T19:31:47.139792] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-26T19:31:47.911741] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-09-26T19:31:48.007796] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-26T19:31:48.594241] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-26T19:31:48.600244] [INFO ] [REMOTE ] ITT: Full fetch complete (46959 records). [2025-09-26T19:31:48.600368] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-09-26T19:31:48.713518] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-09-26T19:31:49.009427] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-09-26T19:31:49.009520] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-09-26T19:31:49.010304] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-09-26T19:31:49.010370] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-09-26T19:31:49.013367] [DEBUG] [LOCAL ] ITT: Trimmed 46959 records to 33511 (keeping 200 days of data) [2025-09-26T19:31:49.246978] [DEBUG] [LOCAL ] ITT: Primary data saved (33511 records). [2025-09-26T19:31:49.247135] [INFO ] [MAIN ] ITT: Full history saved. [2025-09-26T19:31:49.247330] [INFO ] [MAIN ] Update Progress: 1134/2371 symbols completed. ITT took 35.4s. Estimated remaining: 2h 45m 33s. Rate: 7.5 symbols/min [2025-09-26T19:31:49.427580] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:31:49.475546] [DEBUG] [LOCAL ] IVT: Loaded 31117 existing records from primary storage. [2025-09-26T19:31:49.475713] [INFO ] [MAIN ] IVT: Loaded 31117 existing records. [2025-09-26T19:31:49.521287] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-09-26T19:31:49.672052] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:31:49.672497] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-09-26T19:31:49.672589] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-09-26T19:31:49.673790] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-09-26T19:31:49.673856] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-09-26T19:31:50.026622] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-26T19:31:50.128631] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:31:50.311741] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-09-26T19:31:50.532422] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-26T19:31:50.545991] [INFO ] [REMOTE ] ITW: Full fetch complete (66445 records). [2025-09-26T19:31:50.546194] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-09-26T19:31:51.019673] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-09-26T19:31:51.019819] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-09-26T19:31:51.021233] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-09-26T19:31:51.021333] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-09-26T19:31:51.026576] [DEBUG] [LOCAL ] ITW: Trimmed 66445 records to 46782 (keeping 200 days of data) [2025-09-26T19:31:51.131012] [INFO ] [REMOTE ] IVT: Fetching primary data for 2024-12. [2025-09-26T19:31:51.351784] [DEBUG] [LOCAL ] ITW: Primary data saved (46782 records). [2025-09-26T19:31:51.352004] [INFO ] [MAIN ] ITW: Full history saved. [2025-09-26T19:31:51.352149] [INFO ] [MAIN ] Update Progress: 1135/2371 symbols completed. ITW took 29.9s. Estimated remaining: 2h 45m 19s. Rate: 7.5 symbols/min [2025-09-26T19:31:51.559176] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:31:51.596096] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-26T19:31:51.687088] [DEBUG] [LOCAL ] IVZ: Loaded 53522 existing records from primary storage. [2025-09-26T19:31:51.687285] [INFO ] [MAIN ] IVZ: Loaded 53522 existing records. [2025-09-26T19:31:51.913803] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-09-26T19:31:51.964549] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:31:51.965058] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-09-26T19:31:51.965139] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-09-26T19:31:51.966667] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-09-26T19:31:51.966746] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-09-26T19:31:52.366255] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:31:52.398626] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-26T19:31:52.412184] [INFO ] [REMOTE ] ITUB: Full fetch complete (77169 records). [2025-09-26T19:31:52.412351] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-09-26T19:31:52.719737] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2024-12. [2025-09-26T19:31:52.722042] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-26T19:31:52.879751] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-09-26T19:31:52.879863] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-09-26T19:31:52.880918] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-09-26T19:31:52.880989] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-09-26T19:31:52.882719] [DEBUG] [LOCAL ] ITUB: Trimmed 77169 records to 54084 (keeping 200 days of data) [2025-09-26T19:31:53.244379] [DEBUG] [LOCAL ] ITUB: Primary data saved (54084 records). [2025-09-26T19:31:53.244557] [INFO ] [MAIN ] ITUB: Full history saved. [2025-09-26T19:31:53.245333] [INFO ] [MAIN ] Update Progress: 1136/2371 symbols completed. ITUB took 33.2s. Estimated remaining: 2h 45m 4s. Rate: 7.5 symbols/min [2025-09-26T19:31:53.425598] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:31:53.458966] [DEBUG] [LOCAL ] IX: Loaded 22798 existing records from primary storage. [2025-09-26T19:31:53.459219] [INFO ] [MAIN ] IX: Loaded 22798 existing records. [2025-09-26T19:31:53.524889] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-09-26T19:31:53.665014] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:31:53.665331] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-09-26T19:31:53.665408] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-09-26T19:31:53.666168] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-09-26T19:31:53.666233] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-09-26T19:31:54.071465] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:31:54.109686] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-26T19:31:54.311733] [INFO ] [REMOTE ] IX: Fetching primary data for 2024-12. [2025-09-26T19:31:54.684191] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-26T19:31:54.717979] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-26T19:31:55.084425] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-26T19:31:55.111732] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-09-26T19:31:55.911716] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-09-26T19:31:56.689448] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-26T19:31:56.711680] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-09-26T19:31:57.511767] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-09-26T19:31:57.787547] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-26T19:31:57.797436] [INFO ] [REMOTE ] IVR: Full fetch complete (69005 records). [2025-09-26T19:31:57.797602] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-09-26T19:31:58.252183] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-09-26T19:31:58.259551] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-09-26T19:31:58.259316] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-26T19:31:58.260891] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-09-26T19:31:58.261412] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-09-26T19:31:58.277355] [DEBUG] [LOCAL ] IVR: Trimmed 69005 records to 48557 (keeping 200 days of data) [2025-09-26T19:31:58.302325] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-26T19:31:58.312499] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-09-26T19:31:58.612806] [DEBUG] [LOCAL ] IVR: Primary data saved (48557 records). [2025-09-26T19:31:58.612974] [INFO ] [MAIN ] IVR: Full history saved. [2025-09-26T19:31:58.613072] [INFO ] [MAIN ] Update Progress: 1137/2371 symbols completed. IVR took 35.5s. Estimated remaining: 2h 44m 53s. Rate: 7.5 symbols/min [2025-09-26T19:31:58.824099] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:31:58.870158] [DEBUG] [LOCAL ] J: Loaded 40657 existing records from primary storage. [2025-09-26T19:31:58.870312] [INFO ] [MAIN ] J: Loaded 40657 existing records. [2025-09-26T19:31:59.067473] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:31:59.067804] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-09-26T19:31:59.067864] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-09-26T19:31:59.069193] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-09-26T19:31:59.069263] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-09-26T19:31:59.116905] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-09-26T19:31:59.425234] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-26T19:31:59.459460] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:31:59.911730] [INFO ] [REMOTE ] J: Fetching primary data for 2024-12. [2025-09-26T19:32:00.328175] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-26T19:32:00.711718] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-09-26T19:32:01.496805] [INFO ] [REMOTE ] J: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-26T19:32:01.511682] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-09-26T19:32:01.850693] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-26T19:32:02.311726] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-09-26T19:32:03.101114] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-26T19:32:03.111664] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-09-26T19:32:03.517476] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-26T19:32:03.911721] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-09-26T19:32:04.632531] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-26T19:32:04.711724] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-09-26T19:32:05.275218] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-26T19:32:05.511753] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-09-26T19:32:06.007168] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-26T19:32:06.311748] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-09-26T19:32:07.076603] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-26T19:32:07.111703] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-09-26T19:32:07.911703] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-09-26T19:32:08.249749] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-26T19:32:08.685992] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-26T19:32:08.711715] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-09-26T19:32:09.186121] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-26T19:32:09.511725] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-09-26T19:32:10.311712] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-09-26T19:32:10.383429] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-26T19:32:10.620163] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-26T19:32:11.111742] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-09-26T19:32:11.911736] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-09-26T19:32:12.181223] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-26T19:32:12.384133] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-26T19:32:12.711727] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-09-26T19:32:13.451714] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-26T19:32:13.511742] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-09-26T19:32:13.907241] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-26T19:32:14.311760] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-09-26T19:32:14.932162] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-26T19:32:15.111750] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-09-26T19:32:15.329147] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-26T19:32:15.911718] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-09-26T19:32:16.434061] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-26T19:32:16.711748] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-09-26T19:32:17.507756] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-26T19:32:17.518096] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-09-26T19:32:18.257377] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-26T19:32:18.311693] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-09-26T19:32:18.637017] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-26T19:32:18.641107] [INFO ] [REMOTE ] IX: Full fetch complete (27070 records). [2025-09-26T19:32:18.641238] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-09-26T19:32:19.044599] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-09-26T19:32:19.044714] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-09-26T19:32:19.045280] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-09-26T19:32:19.045342] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-09-26T19:32:19.046115] [DEBUG] [LOCAL ] IX: Trimmed 27070 records to 22926 (keeping 200 days of data) [2025-09-26T19:32:19.115720] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-09-26T19:32:19.199092] [DEBUG] [LOCAL ] IX: Primary data saved (22926 records). [2025-09-26T19:32:19.199233] [INFO ] [MAIN ] IX: Full history saved. [2025-09-26T19:32:19.199344] [INFO ] [MAIN ] Update Progress: 1138/2371 symbols completed. IX took 26.0s. Estimated remaining: 2h 44m 59s. Rate: 7.5 symbols/min [2025-09-26T19:32:19.381133] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:32:19.432745] [DEBUG] [LOCAL ] JBGS: Loaded 42776 existing records from primary storage. [2025-09-26T19:32:19.432895] [INFO ] [MAIN ] JBGS: Loaded 42776 existing records. [2025-09-26T19:32:19.637120] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:32:19.637661] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-09-26T19:32:19.637789] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-09-26T19:32:19.640211] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-09-26T19:32:19.640280] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-09-26T19:32:19.915322] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-09-26T19:32:20.069666] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:32:20.076000] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-26T19:32:20.463948] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-26T19:32:20.711718] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2024-12. [2025-09-26T19:32:21.511705] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-09-26T19:32:21.915263] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-26T19:32:22.161229] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-26T19:32:22.311733] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-09-26T19:32:22.894949] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-26T19:32:22.901998] [INFO ] [REMOTE ] IVT: Full fetch complete (45555 records). [2025-09-26T19:32:22.902170] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-09-26T19:32:23.118058] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-09-26T19:32:23.322207] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-09-26T19:32:23.322307] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-09-26T19:32:23.323133] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-09-26T19:32:23.323205] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-09-26T19:32:23.324478] [DEBUG] [LOCAL ] IVT: Trimmed 45555 records to 31325 (keeping 200 days of data) [2025-09-26T19:32:23.556088] [DEBUG] [LOCAL ] IVT: Primary data saved (31325 records). [2025-09-26T19:32:23.556286] [INFO ] [MAIN ] IVT: Full history saved. [2025-09-26T19:32:23.556400] [INFO ] [MAIN ] Update Progress: 1139/2371 symbols completed. IVT took 34.3s. Estimated remaining: 2h 44m 47s. Rate: 7.5 symbols/min [2025-09-26T19:32:23.759467] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:32:23.803689] [DEBUG] [LOCAL ] JBI: Loaded 44143 existing records from primary storage. [2025-09-26T19:32:23.803858] [INFO ] [MAIN ] JBI: Loaded 44143 existing records. [2025-09-26T19:32:23.916175] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-09-26T19:32:24.004076] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:32:24.004374] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-09-26T19:32:24.004425] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-09-26T19:32:24.006151] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-09-26T19:32:24.006223] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-09-26T19:32:24.405781] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:32:24.443638] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-26T19:32:24.542429] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-26T19:32:24.711733] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-09-26T19:32:25.511734] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-09-26T19:32:25.563827] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T19:32:25.572465] [INFO ] [REMOTE ] J: Full fetch complete (59082 records). [2025-09-26T19:32:25.572636] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-09-26T19:32:26.034047] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-09-26T19:32:26.034287] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-09-26T19:32:26.035155] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-09-26T19:32:26.035246] [DEBUG] [LOCAL ] J: Saving primary data. [2025-09-26T19:32:26.059911] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-26T19:32:26.060097] [DEBUG] [LOCAL ] J: Trimmed 59082 records to 40873 (keeping 200 days of data) [2025-09-26T19:32:26.313780] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-09-26T19:32:26.351537] [DEBUG] [LOCAL ] J: Primary data saved (40873 records). [2025-09-26T19:32:26.351726] [INFO ] [MAIN ] J: Full history saved. [2025-09-26T19:32:26.352086] [INFO ] [MAIN ] Update Progress: 1140/2371 symbols completed. J took 27.7s. Estimated remaining: 2h 44m 33s. Rate: 7.5 symbols/min [2025-09-26T19:32:26.552794] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:32:26.600009] [DEBUG] [LOCAL ] JBL: Loaded 48770 existing records from primary storage. [2025-09-26T19:32:26.600179] [INFO ] [MAIN ] JBL: Loaded 48770 existing records. [2025-09-26T19:32:26.809114] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:32:26.809592] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-09-26T19:32:26.809704] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-09-26T19:32:26.811591] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-09-26T19:32:26.811693] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-09-26T19:32:27.118791] [INFO ] [REMOTE ] JBI: Fetching primary data for 2024-12. [2025-09-26T19:32:27.142918] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-26T19:32:27.259563] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:32:27.793488] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-26T19:32:27.911742] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-09-26T19:32:28.711785] [INFO ] [REMOTE ] JBL: Fetching primary data for 2024-12. [2025-09-26T19:32:28.854866] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-26T19:32:29.511709] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-09-26T19:32:29.630945] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T19:32:30.038864] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-26T19:32:30.311739] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-09-26T19:32:31.116247] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-09-26T19:32:31.122430] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-26T19:32:31.852269] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-26T19:32:31.911732] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-09-26T19:32:32.603193] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T19:32:32.711713] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-09-26T19:32:33.162055] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-26T19:32:33.511731] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-09-26T19:32:34.271841] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-26T19:32:34.311738] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-09-26T19:32:35.111689] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-09-26T19:32:35.456187] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-26T19:32:35.466903] [INFO ] [REMOTE ] IVZ: Full fetch complete (76766 records). [2025-09-26T19:32:35.467112] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-09-26T19:32:35.939239] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-09-26T19:32:35.940790] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-09-26T19:32:35.941466] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-09-26T19:32:35.944766] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-09-26T19:32:35.943156] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-26T19:32:35.944999] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-09-26T19:32:35.956701] [DEBUG] [LOCAL ] IVZ: Trimmed 76766 records to 53908 (keeping 200 days of data) [2025-09-26T19:32:36.320769] [DEBUG] [LOCAL ] IVZ: Primary data saved (53908 records). [2025-09-26T19:32:36.321248] [INFO ] [MAIN ] IVZ: Full history saved. [2025-09-26T19:32:36.321421] [INFO ] [MAIN ] Update Progress: 1141/2371 symbols completed. IVZ took 45.0s. Estimated remaining: 2h 44m 27s. Rate: 7.5 symbols/min [2025-09-26T19:32:36.521585] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:32:36.521845] [DEBUG] [LOCAL ] JBND: No existing data file found in primary storage. [2025-09-26T19:32:36.521902] [WARN ] [MAIN ] JBND: No existing data found, performing full refresh instead. [2025-09-26T19:32:36.522016] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-09-26T19:32:36.522056] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-09-26T19:32:36.522097] [DEBUG] [LOCAL ] JBND: No primary data file found to delete. [2025-09-26T19:32:36.522130] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-09-26T19:32:36.715012] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-09-26T19:32:36.989962] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:32:36.994808] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-26T19:32:37.469966] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-26T19:32:37.511720] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-09-26T19:32:38.311716] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-09-26T19:32:38.362364] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-26T19:32:39.111697] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-09-26T19:32:39.224066] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-26T19:32:39.911697] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-09-26T19:32:40.242334] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-26T19:32:40.711728] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-09-26T19:32:40.789815] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-26T19:32:40.798875] [INFO ] [REMOTE ] JBGS: Full fetch complete (59102 records). [2025-09-26T19:32:40.799038] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-09-26T19:32:41.217015] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-09-26T19:32:41.217116] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-09-26T19:32:41.217935] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-09-26T19:32:41.218002] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-09-26T19:32:41.219349] [DEBUG] [LOCAL ] JBGS: Trimmed 59102 records to 43089 (keeping 200 days of data) [2025-09-26T19:32:41.491688] [DEBUG] [LOCAL ] JBGS: Primary data saved (43089 records). [2025-09-26T19:32:41.491838] [INFO ] [MAIN ] JBGS: Full history saved. [2025-09-26T19:32:41.493283] [INFO ] [MAIN ] Update Progress: 1142/2371 symbols completed. JBGS took 22.3s. Estimated remaining: 2h 44m 16s. Rate: 7.5 symbols/min [2025-09-26T19:32:41.516964] [INFO ] [REMOTE ] JBND: Fetching primary data for 2024-12. [2025-09-26T19:32:41.709421] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:32:41.710135] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-09-26T19:32:41.710616] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-09-26T19:32:41.712437] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-26T19:32:41.712873] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-09-26T19:32:41.712949] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-26T19:32:41.722967] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-26T19:32:41.723162] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-09-26T19:32:42.121703] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:32:42.311695] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-09-26T19:32:42.707084] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-26T19:32:42.809966] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-26T19:32:43.111725] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-09-26T19:32:43.312813] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:32:43.313166] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-09-26T19:32:43.859032] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T19:32:43.911694] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-09-26T19:32:44.711804] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-09-26T19:32:44.861425] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-26T19:32:45.511741] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-09-26T19:32:46.316495] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-01. [2025-09-26T19:32:46.320175] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-26T19:32:46.461925] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-26T19:32:46.536229] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:32:46.536569] [WARN ] [REMOTE ] JBS: No data returned for month 2025-01 [2025-09-26T19:32:47.111728] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-09-26T19:32:47.911717] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-02. [2025-09-26T19:32:48.124126] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:32:48.124627] [WARN ] [REMOTE ] JBS: No data returned for month 2025-02 [2025-09-26T19:32:48.667072] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-26T19:32:48.711709] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-09-26T19:32:49.511731] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-09-26T19:32:50.311726] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-09-26T19:32:50.458992] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-26T19:32:50.518050] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-26T19:32:51.111722] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-09-26T19:32:51.555415] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-26T19:32:51.911740] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-09-26T19:32:52.435330] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-26T19:32:52.711733] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-09-26T19:32:53.481857] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-26T19:32:53.489573] [INFO ] [REMOTE ] JBI: Full fetch complete (64439 records). [2025-09-26T19:32:53.489752] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-09-26T19:32:53.521469] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-09-26T19:32:53.930520] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-09-26T19:32:53.930668] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-09-26T19:32:53.931926] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-09-26T19:32:53.932330] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-09-26T19:32:53.949432] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-26T19:32:53.954986] [DEBUG] [LOCAL ] JBI: Trimmed 64439 records to 44362 (keeping 200 days of data) [2025-09-26T19:32:54.216219] [DEBUG] [LOCAL ] JBI: Primary data saved (44362 records). [2025-09-26T19:32:54.216391] [INFO ] [MAIN ] JBI: Full history saved. [2025-09-26T19:32:54.216585] [INFO ] [MAIN ] Update Progress: 1143/2371 symbols completed. JBI took 30.7s. Estimated remaining: 2h 44m 13s. Rate: 7.5 symbols/min [2025-09-26T19:32:54.318350] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-03. [2025-09-26T19:32:54.408163] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:32:54.408345] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-09-26T19:32:54.408445] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-09-26T19:32:54.408604] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-09-26T19:32:54.408672] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-26T19:32:54.408748] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-09-26T19:32:54.408790] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-09-26T19:32:54.638014] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:32:54.672971] [WARN ] [REMOTE ] JBS: No data returned for month 2025-03 [2025-09-26T19:32:54.794961] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:32:55.111745] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-09-26T19:32:55.322510] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:32:55.323002] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-09-26T19:32:55.364018] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-26T19:32:55.911758] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-01. [2025-09-26T19:32:56.711779] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-04. [2025-09-26T19:32:56.914583] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:32:56.914941] [WARN ] [REMOTE ] JBS: No data returned for month 2025-04 [2025-09-26T19:32:57.233140] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-26T19:32:57.511748] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-05. [2025-09-26T19:32:57.740816] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:32:57.741153] [WARN ] [REMOTE ] JBS: No data returned for month 2025-05 [2025-09-26T19:32:58.311764] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-09-26T19:32:59.111753] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-09-26T19:32:59.911755] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-06. [2025-09-26T19:33:00.055782] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-26T19:33:00.116314] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-26T19:33:00.711777] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-09-26T19:33:01.165966] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-26T19:33:01.394018] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-26T19:33:01.511724] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-02. [2025-09-26T19:33:02.311746] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-07. [2025-09-26T19:33:02.753722] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-26T19:33:03.111741] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-03. [2025-09-26T19:33:03.918006] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-09-26T19:33:03.935099] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-26T19:33:04.540351] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-26T19:33:04.711746] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-08. [2025-09-26T19:33:05.511741] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-04. [2025-09-26T19:33:05.887360] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-26T19:33:05.898379] [INFO ] [REMOTE ] JBL: Full fetch complete (70128 records). [2025-09-26T19:33:05.898735] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-09-26T19:33:06.310660] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-09-26T19:33:06.310814] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-09-26T19:33:06.312146] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-09-26T19:33:06.312319] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-09-26T19:33:06.312245] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-09-26T19:33:06.315141] [DEBUG] [LOCAL ] JBL: Trimmed 70128 records to 49145 (keeping 200 days of data) [2025-09-26T19:33:06.654772] [DEBUG] [LOCAL ] JBL: Primary data saved (49145 records). [2025-09-26T19:33:06.655007] [INFO ] [MAIN ] JBL: Full history saved. [2025-09-26T19:33:06.655284] [INFO ] [MAIN ] Update Progress: 1144/2371 symbols completed. JBL took 40.3s. Estimated remaining: 2h 44m 10s. Rate: 7.5 symbols/min [2025-09-26T19:33:06.852862] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-26T19:33:06.897369] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:33:06.912014] [DEBUG] [LOCAL ] JCE: Loaded 6504 existing records from primary storage. [2025-09-26T19:33:06.912262] [INFO ] [MAIN ] JCE: Loaded 6504 existing records. [2025-09-26T19:33:07.126032] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-09. [2025-09-26T19:33:07.173830] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:33:07.174819] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-09-26T19:33:07.175132] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-09-26T19:33:07.189313] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-09-26T19:33:07.209690] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-09-26T19:33:07.273812] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-26T19:33:07.620188] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-26T19:33:07.705722] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:33:07.911932] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-09-26T19:33:08.711771] [INFO ] [REMOTE ] JCE: Fetching primary data for 2024-12. [2025-09-26T19:33:09.160738] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-26T19:33:09.161683] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-26T19:33:09.179479] [INFO ] [REMOTE ] JBS: Full fetch complete (27521 records). [2025-09-26T19:33:09.179996] [DEBUG] [VALIDATOR ] JBS: Validating primary data. [2025-09-26T19:33:09.404168] [WARN ] [VALIDATOR ] JBS: Validation failed - insufficient historical data. Have 72 unique days, need 200 days [2025-09-26T19:33:09.405561] [FATAL] [MAIN ] JBS: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:33:09.409380] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-26T19:33:09.409581] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:33:09.416683] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-26T19:33:09.417005] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-26T19:33:09.417471] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-09-26T19:33:09.417794] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-09-26T19:33:09.417958] [INFO ] [MAIN ] Update Progress: 1145/2371 symbols completed. JBS took 27.9s. Estimated remaining: 2h 43m 56s. Rate: 7.5 symbols/min [2025-09-26T19:33:09.418257] [INFO ] [REMOTE ] JBND: Full fetch complete (33727 records). [2025-09-26T19:33:09.463323] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-09-26T19:33:09.516879] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-05. [2025-09-26T19:33:09.728366] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:33:10.063873] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-09-26T19:33:10.063976] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-09-26T19:33:10.064979] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-09-26T19:33:10.065056] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-09-26T19:33:10.066456] [DEBUG] [LOCAL ] JBND: Trimmed 33727 records to 26051 (keeping 200 days of data) [2025-09-26T19:33:10.191161] [DEBUG] [LOCAL ] JCI: Loaded 53937 existing records from primary storage. [2025-09-26T19:33:10.195702] [INFO ] [MAIN ] JCI: Loaded 53937 existing records. [2025-09-26T19:33:10.313855] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-09-26T19:33:10.452510] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:33:10.453667] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-09-26T19:33:10.453759] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-09-26T19:33:10.465809] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-09-26T19:33:10.466838] [DEBUG] [LOCAL ] JBND: Primary data saved (26051 records). [2025-09-26T19:33:10.467311] [INFO ] [MAIN ] JBND: Full history saved. [2025-09-26T19:33:10.467195] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-09-26T19:33:10.467563] [INFO ] [MAIN ] Update Progress: 1146/2371 symbols completed. JBND took 34.1s. Estimated remaining: 2h 43m 41s. Rate: 7.5 symbols/min [2025-09-26T19:33:10.998747] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:33:11.054192] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-26T19:33:11.100994] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:33:11.123864] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-09-26T19:33:11.133017] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-26T19:33:11.180237] [DEBUG] [LOCAL ] JEF: Loaded 50382 existing records from primary storage. [2025-09-26T19:33:11.180435] [INFO ] [MAIN ] JEF: Loaded 50382 existing records. [2025-09-26T19:33:11.364937] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:33:11.365197] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-09-26T19:33:11.365246] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-09-26T19:33:11.367027] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-09-26T19:33:11.367093] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-09-26T19:33:11.654149] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-26T19:33:11.785106] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:33:11.911764] [INFO ] [REMOTE ] JCI: Fetching primary data for 2024-12. [2025-09-26T19:33:12.711776] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-06. [2025-09-26T19:33:13.511714] [INFO ] [REMOTE ] JEF: Fetching primary data for 2024-12. [2025-09-26T19:33:13.714921] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T19:33:14.027680] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-26T19:33:14.311768] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-07. [2025-09-26T19:33:15.114861] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-09-26T19:33:15.121066] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-26T19:33:15.263804] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-26T19:33:15.911796] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-09-26T19:33:16.711798] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-09-26T19:33:16.971468] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-26T19:33:17.358856] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-26T19:33:17.511708] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-08. [2025-09-26T19:33:17.648947] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-26T19:33:18.311753] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-09-26T19:33:18.514593] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-26T19:33:19.111760] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-09. [2025-09-26T19:33:19.835705] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-26T19:33:19.911769] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-09-26T19:33:20.538098] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-26T19:33:20.544990] [INFO ] [REMOTE ] JBTM: Full fetch complete (42431 records). [2025-09-26T19:33:20.545163] [DEBUG] [VALIDATOR ] JBTM: Validating primary data. [2025-09-26T19:33:20.712668] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-09-26T19:33:20.748758] [WARN ] [VALIDATOR ] JBTM: Validation failed - insufficient historical data. Have 183 unique days, need 200 days [2025-09-26T19:33:20.749358] [FATAL] [MAIN ] JBTM: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:33:20.749433] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:33:20.749521] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-26T19:33:20.749615] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-09-26T19:33:20.749692] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-09-26T19:33:20.749754] [DEBUG] [LOCAL ] JBTM: No derivative data file found to delete. [2025-09-26T19:33:20.749832] [INFO ] [MAIN ] Update Progress: 1147/2371 symbols completed. JBTM took 26.5s. Estimated remaining: 2h 43m 35s. Rate: 7.5 symbols/min [2025-09-26T19:33:20.925820] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:33:20.972209] [DEBUG] [LOCAL ] JELD: Loaded 46491 existing records from primary storage. [2025-09-26T19:33:20.972423] [INFO ] [MAIN ] JELD: Loaded 46491 existing records. [2025-09-26T19:33:21.160861] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:33:21.161225] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-09-26T19:33:21.161280] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-09-26T19:33:21.162487] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-09-26T19:33:21.162557] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-09-26T19:33:21.517276] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-09-26T19:33:21.594361] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:33:21.740520] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-26T19:33:21.768490] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-26T19:33:22.311787] [INFO ] [REMOTE ] JELD: Fetching primary data for 2024-12. [2025-09-26T19:33:23.111711] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-09-26T19:33:23.446378] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-26T19:33:23.706274] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-26T19:33:23.769695] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-26T19:33:23.911721] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-09-26T19:33:24.707278] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-26T19:33:24.711637] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-09-26T19:33:25.432754] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-26T19:33:25.511749] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-09-26T19:33:26.201665] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-26T19:33:26.311729] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-09-26T19:33:27.111722] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-09-26T19:33:27.911708] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-09-26T19:33:28.014559] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-26T19:33:28.017479] [INFO ] [REMOTE ] JCE: Full fetch complete (9143 records). [2025-09-26T19:33:28.017629] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-09-26T19:33:28.424557] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-09-26T19:33:28.424817] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-09-26T19:33:28.425114] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-09-26T19:33:28.425162] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-09-26T19:33:28.425781] [DEBUG] [LOCAL ] JCE: Trimmed 9143 records to 6591 (keeping 200 days of data) [2025-09-26T19:33:28.560564] [DEBUG] [LOCAL ] JCE: Primary data saved (6591 records). [2025-09-26T19:33:28.561236] [INFO ] [MAIN ] JCE: Full history saved. [2025-09-26T19:33:28.565893] [INFO ] [MAIN ] Update Progress: 1148/2371 symbols completed. JCE took 21.9s. Estimated remaining: 2h 43m 27s. Rate: 7.5 symbols/min [2025-09-26T19:33:28.565684] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-26T19:33:28.716989] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-09-26T19:33:28.767828] [INFO ] [MAIN ] JEQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:33:28.779358] [DEBUG] [LOCAL ] JEQ: Loaded 9203 existing records from primary storage. [2025-09-26T19:33:28.780052] [INFO ] [MAIN ] JEQ: Loaded 9203 existing records. [2025-09-26T19:33:28.961608] [WARN ] [MAIN ] JEQ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:33:28.962042] [INFO ] [MAIN ] JEQ: Wiping existing primary data before full refresh. [2025-09-26T19:33:28.962100] [INFO ] [LOCAL ] JEQ: Starting deletion of primary data. [2025-09-26T19:33:28.962611] [DEBUG] [LOCAL ] JEQ: Deleted primary data file. [2025-09-26T19:33:28.962708] [INFO ] [MAIN ] JEQ: Starting full primary refresh. [2025-09-26T19:33:29.335063] [INFO ] [REMOTE ] JEQ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:33:29.419271] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-26T19:33:29.511719] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2024-12. [2025-09-26T19:33:29.659506] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-26T19:33:30.136545] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-26T19:33:30.311726] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-01. [2025-09-26T19:33:30.940136] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-26T19:33:31.111729] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-02. [2025-09-26T19:33:31.722010] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-26T19:33:31.911722] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-09-26T19:33:32.711721] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-09-26T19:33:33.276816] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-26T19:33:33.511736] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-09-26T19:33:34.311727] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-03. [2025-09-26T19:33:34.462827] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-26T19:33:35.059565] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T19:33:35.111726] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-09-26T19:33:35.131593] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-26T19:33:35.911737] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-09-26T19:33:36.711725] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-09-26T19:33:36.833502] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T19:33:37.320372] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-26T19:33:37.511735] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-09-26T19:33:38.311725] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-04. [2025-09-26T19:33:38.663801] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-26T19:33:38.844675] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-26T19:33:39.111744] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-09-26T19:33:39.259618] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-26T19:33:39.911729] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-09-26T19:33:40.711713] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-05. [2025-09-26T19:33:40.863518] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-26T19:33:41.511697] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-09-26T19:33:41.556106] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-26T19:33:41.693743] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-26T19:33:42.311725] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-09-26T19:33:43.123150] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-06. [2025-09-26T19:33:43.129701] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-26T19:33:43.725195] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-26T19:33:43.738721] [INFO ] [REMOTE ] JEF: Full fetch complete (72893 records). [2025-09-26T19:33:43.738982] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-09-26T19:33:43.870699] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-26T19:33:43.911938] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-09-26T19:33:44.191179] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-09-26T19:33:44.191391] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-09-26T19:33:44.192356] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-09-26T19:33:44.192459] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-09-26T19:33:44.196840] [DEBUG] [LOCAL ] JEF: Trimmed 72893 records to 50763 (keeping 200 days of data) [2025-09-26T19:33:44.521046] [DEBUG] [LOCAL ] JEF: Primary data saved (50763 records). [2025-09-26T19:33:44.521194] [INFO ] [MAIN ] JEF: Full history saved. [2025-09-26T19:33:44.521352] [INFO ] [MAIN ] Update Progress: 1149/2371 symbols completed. JEF took 34.0s. Estimated remaining: 2h 43m 27s. Rate: 7.5 symbols/min [2025-09-26T19:33:44.702672] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:33:44.711707] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-09-26T19:33:44.738359] [DEBUG] [LOCAL ] JFR: Loaded 30635 existing records from primary storage. [2025-09-26T19:33:44.738507] [INFO ] [MAIN ] JFR: Loaded 30635 existing records. [2025-09-26T19:33:44.927907] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:33:44.928209] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-09-26T19:33:44.928265] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-09-26T19:33:44.929355] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-09-26T19:33:44.929432] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-09-26T19:33:45.312006] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:33:45.511761] [INFO ] [REMOTE ] JFR: Fetching primary data for 2024-12. [2025-09-26T19:33:46.010261] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-26T19:33:46.311736] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-09-26T19:33:47.000077] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-26T19:33:47.111725] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-09-26T19:33:47.224888] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-26T19:33:47.415500] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-26T19:33:47.911727] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-07. [2025-09-26T19:33:48.711736] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-09-26T19:33:48.886133] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-26T19:33:48.886408] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-26T19:33:49.511790] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-09-26T19:33:50.013888] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-26T19:33:50.311731] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-09-26T19:33:51.111761] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-08. [2025-09-26T19:33:51.652102] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-26T19:33:51.663940] [INFO ] [REMOTE ] JCI: Full fetch complete (77414 records). [2025-09-26T19:33:51.664128] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-09-26T19:33:51.915725] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-09-26T19:33:52.158912] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-09-26T19:33:52.165035] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-26T19:33:52.164338] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-09-26T19:33:52.172347] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-26T19:33:52.174037] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-09-26T19:33:52.174192] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-09-26T19:33:52.192539] [DEBUG] [LOCAL ] JCI: Trimmed 77414 records to 54327 (keeping 200 days of data) [2025-09-26T19:33:52.578495] [DEBUG] [LOCAL ] JCI: Primary data saved (54327 records). [2025-09-26T19:33:52.578692] [INFO ] [MAIN ] JCI: Full history saved. [2025-09-26T19:33:52.578797] [INFO ] [MAIN ] Update Progress: 1150/2371 symbols completed. JCI took 43.2s. Estimated remaining: 2h 43m 19s. Rate: 7.5 symbols/min [2025-09-26T19:33:52.716838] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-09. [2025-09-26T19:33:52.768530] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:33:52.783891] [DEBUG] [LOCAL ] JGH: Loaded 11018 existing records from primary storage. [2025-09-26T19:33:52.784101] [INFO ] [MAIN ] JGH: Loaded 11018 existing records. [2025-09-26T19:33:52.976093] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:33:52.976346] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-09-26T19:33:52.976411] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-09-26T19:33:52.976977] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-09-26T19:33:52.977038] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-09-26T19:33:53.367529] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:33:53.443950] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-26T19:33:53.511741] [INFO ] [REMOTE ] JGH: Fetching primary data for 2024-12. [2025-09-26T19:33:53.746892] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-26T19:33:53.749462] [INFO ] [REMOTE ] JEQ: Full fetch complete (11578 records). [2025-09-26T19:33:53.749560] [DEBUG] [VALIDATOR ] JEQ: Validating primary data. [2025-09-26T19:33:54.151517] [DEBUG] [VALIDATOR ] JEQ: All expected trading days are present. [2025-09-26T19:33:54.151622] [DEBUG] [VALIDATOR ] JEQ: Primary data validation passed. [2025-09-26T19:33:54.152034] [INFO ] [MAIN ] JEQ: Fetched primary data is valid. [2025-09-26T19:33:54.152099] [DEBUG] [LOCAL ] JEQ: Saving primary data. [2025-09-26T19:33:54.152722] [DEBUG] [LOCAL ] JEQ: Trimmed 11578 records to 9336 (keeping 200 days of data) [2025-09-26T19:33:54.216118] [DEBUG] [LOCAL ] JEQ: Primary data saved (9336 records). [2025-09-26T19:33:54.216313] [INFO ] [MAIN ] JEQ: Full history saved. [2025-09-26T19:33:54.216454] [INFO ] [MAIN ] Update Progress: 1151/2371 symbols completed. JEQ took 25.7s. Estimated remaining: 2h 43m 5s. Rate: 7.5 symbols/min [2025-09-26T19:33:54.316916] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-09-26T19:33:54.414588] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:33:54.485221] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-26T19:33:54.489487] [DEBUG] [LOCAL ] JHG: Loaded 48212 existing records from primary storage. [2025-09-26T19:33:54.490558] [INFO ] [MAIN ] JHG: Loaded 48212 existing records. [2025-09-26T19:33:54.684198] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:33:54.684568] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-09-26T19:33:54.684629] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-09-26T19:33:54.686121] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-09-26T19:33:54.686189] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-09-26T19:33:55.058071] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:33:55.111714] [INFO ] [REMOTE ] JHG: Fetching primary data for 2024-12. [2025-09-26T19:33:55.911703] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-09-26T19:33:56.065579] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-26T19:33:56.075364] [INFO ] [REMOTE ] JELD: Full fetch complete (63695 records). [2025-09-26T19:33:56.075521] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-09-26T19:33:56.479122] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-09-26T19:33:56.479238] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-09-26T19:33:56.480100] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-09-26T19:33:56.480163] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-09-26T19:33:56.481552] [DEBUG] [LOCAL ] JELD: Trimmed 63695 records to 46791 (keeping 200 days of data) [2025-09-26T19:33:56.711795] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-09-26T19:33:56.730759] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-26T19:33:56.784431] [DEBUG] [LOCAL ] JELD: Primary data saved (46791 records). [2025-09-26T19:33:56.784578] [INFO ] [MAIN ] JELD: Full history saved. [2025-09-26T19:33:56.784705] [INFO ] [MAIN ] Update Progress: 1152/2371 symbols completed. JELD took 36.0s. Estimated remaining: 2h 42m 51s. Rate: 7.5 symbols/min [2025-09-26T19:33:56.967635] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:33:56.975067] [DEBUG] [LOCAL ] JHI: Loaded 3617 existing records from primary storage. [2025-09-26T19:33:56.999053] [INFO ] [MAIN ] JHI: Loaded 3617 existing records. [2025-09-26T19:33:57.072811] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-26T19:33:57.208069] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:33:57.208342] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-09-26T19:33:57.208393] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-09-26T19:33:57.208723] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-09-26T19:33:57.208785] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-09-26T19:33:57.516887] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-09-26T19:33:57.593408] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:33:58.250906] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-26T19:33:58.311738] [INFO ] [REMOTE ] JHI: Fetching primary data for 2024-12. [2025-09-26T19:33:58.799265] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-26T19:33:59.111738] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-09-26T19:33:59.173562] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-26T19:33:59.911728] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-09-26T19:34:00.667157] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-26T19:34:00.667402] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-26T19:34:00.711688] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-09-26T19:34:01.511745] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-09-26T19:34:02.311698] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-09-26T19:34:02.513034] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-26T19:34:02.850412] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-26T19:34:03.090878] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-26T19:34:03.111701] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-09-26T19:34:03.911726] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-09-26T19:34:04.711701] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-09-26T19:34:04.823895] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-26T19:34:04.852586] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-26T19:34:05.304303] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-26T19:34:05.511729] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-09-26T19:34:06.311727] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-09-26T19:34:06.943490] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-26T19:34:07.063768] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-26T19:34:07.111690] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-09-26T19:34:07.911701] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-09-26T19:34:08.051563] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-26T19:34:08.577089] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-26T19:34:08.711740] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-09-26T19:34:09.511732] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-09-26T19:34:10.311734] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-09-26T19:34:10.490312] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-26T19:34:10.761458] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-26T19:34:11.105384] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-26T19:34:11.111668] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-09-26T19:34:11.794135] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-26T19:34:11.911725] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-09-26T19:34:12.497938] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-26T19:34:12.711730] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-09-26T19:34:13.281441] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-26T19:34:13.511734] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-09-26T19:34:14.311718] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-09-26T19:34:14.364065] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-26T19:34:14.919266] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-26T19:34:15.111725] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-09-26T19:34:15.911732] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-09-26T19:34:16.451596] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-26T19:34:16.547186] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-26T19:34:16.711746] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-09-26T19:34:17.511770] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-09-26T19:34:17.680844] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-26T19:34:17.682673] [INFO ] [REMOTE ] JHI: Full fetch complete (5261 records). [2025-09-26T19:34:17.682755] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-09-26T19:34:18.095841] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-09-26T19:34:18.095997] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-09-26T19:34:18.096201] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-09-26T19:34:18.096244] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-09-26T19:34:18.096712] [DEBUG] [LOCAL ] JHI: Trimmed 5261 records to 3641 (keeping 200 days of data) [2025-09-26T19:34:18.121716] [DEBUG] [LOCAL ] JHI: Primary data saved (3641 records). [2025-09-26T19:34:18.121830] [INFO ] [MAIN ] JHI: Full history saved. [2025-09-26T19:34:18.121937] [INFO ] [MAIN ] Update Progress: 1153/2371 symbols completed. JHI took 21.3s. Estimated remaining: 2h 42m 57s. Rate: 7.5 symbols/min [2025-09-26T19:34:18.296267] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:34:18.301510] [DEBUG] [LOCAL ] JHS: Loaded 2864 existing records from primary storage. [2025-09-26T19:34:18.301606] [INFO ] [MAIN ] JHS: Loaded 2864 existing records. [2025-09-26T19:34:18.316944] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-09-26T19:34:18.492225] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:34:18.492585] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-09-26T19:34:18.492635] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-09-26T19:34:18.493002] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-09-26T19:34:18.493064] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-09-26T19:34:18.887473] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:34:19.118562] [INFO ] [REMOTE ] JHS: Fetching primary data for 2024-12. [2025-09-26T19:34:19.148116] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-26T19:34:19.725262] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-26T19:34:19.911768] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-09-26T19:34:19.956139] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-26T19:34:20.711772] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-09-26T19:34:20.996215] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-26T19:34:21.301759] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-26T19:34:21.511735] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-09-26T19:34:22.079466] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-26T19:34:22.311723] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-09-26T19:34:23.111684] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-09-26T19:34:23.193256] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-26T19:34:23.578412] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-26T19:34:23.911721] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-09-26T19:34:24.711711] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-09-26T19:34:24.922449] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-26T19:34:24.925567] [INFO ] [REMOTE ] JGH: Full fetch complete (14868 records). [2025-09-26T19:34:24.925674] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-09-26T19:34:25.317981] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-09-26T19:34:25.318101] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-09-26T19:34:25.318511] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-09-26T19:34:25.318576] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-09-26T19:34:25.319184] [DEBUG] [LOCAL ] JGH: Trimmed 14868 records to 11064 (keeping 200 days of data) [2025-09-26T19:34:25.388451] [DEBUG] [LOCAL ] JGH: Primary data saved (11064 records). [2025-09-26T19:34:25.388596] [INFO ] [MAIN ] JGH: Full history saved. [2025-09-26T19:34:25.388759] [INFO ] [MAIN ] Update Progress: 1154/2371 symbols completed. JGH took 32.8s. Estimated remaining: 2h 42m 48s. Rate: 7.5 symbols/min [2025-09-26T19:34:25.516881] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-09-26T19:34:25.578133] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:34:25.633775] [DEBUG] [LOCAL ] JHX: Loaded 50827 existing records from primary storage. [2025-09-26T19:34:25.633999] [INFO ] [MAIN ] JHX: Loaded 50827 existing records. [2025-09-26T19:34:25.845358] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:34:25.845607] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-09-26T19:34:25.845682] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-09-26T19:34:25.847112] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-09-26T19:34:25.847174] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-09-26T19:34:26.118505] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-26T19:34:26.270179] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:34:26.272145] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-26T19:34:26.279368] [INFO ] [REMOTE ] JFR: Full fetch complete (48182 records). [2025-09-26T19:34:26.279499] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-09-26T19:34:26.316992] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-09-26T19:34:26.691888] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-09-26T19:34:26.691985] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-09-26T19:34:26.692836] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-09-26T19:34:26.692903] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-09-26T19:34:26.693965] [DEBUG] [LOCAL ] JFR: Trimmed 48182 records to 30975 (keeping 200 days of data) [2025-09-26T19:34:26.896014] [DEBUG] [LOCAL ] JFR: Primary data saved (30975 records). [2025-09-26T19:34:26.896167] [INFO ] [MAIN ] JFR: Full history saved. [2025-09-26T19:34:26.896280] [INFO ] [MAIN ] Update Progress: 1155/2371 symbols completed. JFR took 42.4s. Estimated remaining: 2h 42m 33s. Rate: 7.5 symbols/min [2025-09-26T19:34:27.079457] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:34:27.098397] [DEBUG] [LOCAL ] JILL: Loaded 16873 existing records from primary storage. [2025-09-26T19:34:27.098570] [INFO ] [MAIN ] JILL: Loaded 16873 existing records. [2025-09-26T19:34:27.120441] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-09-26T19:34:27.289823] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:34:27.290114] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-09-26T19:34:27.290172] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-09-26T19:34:27.290858] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-09-26T19:34:27.290931] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-09-26T19:34:27.673245] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:34:27.674137] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-26T19:34:27.911730] [INFO ] [REMOTE ] JILL: Fetching primary data for 2024-12. [2025-09-26T19:34:28.072512] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-26T19:34:28.711783] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-09-26T19:34:29.102103] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-26T19:34:29.511749] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-09-26T19:34:30.257628] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-26T19:34:30.311728] [INFO ] [REMOTE ] JHX: Fetching primary data for 2024-12. [2025-09-26T19:34:30.355104] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-26T19:34:31.111730] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-09-26T19:34:31.667351] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-26T19:34:31.838503] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-26T19:34:31.911685] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-09-26T19:34:32.711717] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-09-26T19:34:33.511727] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-09-26T19:34:33.601726] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-26T19:34:33.611174] [INFO ] [REMOTE ] JHG: Full fetch complete (68352 records). [2025-09-26T19:34:33.611349] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-09-26T19:34:33.768139] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-26T19:34:34.147861] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-09-26T19:34:34.147976] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-09-26T19:34:34.149006] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-09-26T19:34:34.149080] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-09-26T19:34:34.150622] [DEBUG] [LOCAL ] JHG: Trimmed 68352 records to 48497 (keeping 200 days of data) [2025-09-26T19:34:34.372724] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-09-26T19:34:34.564067] [DEBUG] [LOCAL ] JHG: Primary data saved (48497 records). [2025-09-26T19:34:34.575755] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-26T19:34:34.574893] [INFO ] [MAIN ] JHG: Full history saved. [2025-09-26T19:34:34.575996] [INFO ] [MAIN ] Update Progress: 1156/2371 symbols completed. JHG took 40.4s. Estimated remaining: 2h 42m 25s. Rate: 7.5 symbols/min [2025-09-26T19:34:34.809136] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:34:34.854488] [DEBUG] [LOCAL ] JKS: Loaded 40399 existing records from primary storage. [2025-09-26T19:34:34.854681] [INFO ] [MAIN ] JKS: Loaded 40399 existing records. [2025-09-26T19:34:35.051579] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-26T19:34:35.058518] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:34:35.060982] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-09-26T19:34:35.061035] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-09-26T19:34:35.062137] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-09-26T19:34:35.062204] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-09-26T19:34:35.121435] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-09-26T19:34:35.442977] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:34:35.781470] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-26T19:34:35.911719] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-09-26T19:34:36.711733] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-09-26T19:34:36.734571] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-26T19:34:37.511726] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-09-26T19:34:37.748380] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-26T19:34:38.311749] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-09-26T19:34:38.777386] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-26T19:34:38.857239] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-26T19:34:39.111724] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-09-26T19:34:39.911721] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-09-26T19:34:40.711716] [INFO ] [REMOTE ] JKS: Fetching primary data for 2024-12. [2025-09-26T19:34:40.778913] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-26T19:34:40.828302] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T19:34:41.511777] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-09-26T19:34:42.311739] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-09-26T19:34:42.880069] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-26T19:34:43.111725] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-09-26T19:34:43.239060] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-26T19:34:43.373111] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-26T19:34:43.911729] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-09-26T19:34:44.587297] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-26T19:34:44.711758] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-09-26T19:34:45.511730] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-09-26T19:34:45.766332] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-26T19:34:45.786821] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-26T19:34:46.238389] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-26T19:34:46.240158] [INFO ] [REMOTE ] JHS: Full fetch complete (4427 records). [2025-09-26T19:34:46.240251] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-09-26T19:34:46.316945] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-09-26T19:34:46.624284] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-09-26T19:34:46.624389] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-09-26T19:34:46.624562] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-09-26T19:34:46.624603] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-09-26T19:34:46.625100] [DEBUG] [LOCAL ] JHS: Trimmed 4427 records to 2878 (keeping 200 days of data) [2025-09-26T19:34:46.643779] [DEBUG] [LOCAL ] JHS: Primary data saved (2878 records). [2025-09-26T19:34:46.643889] [INFO ] [MAIN ] JHS: Full history saved. [2025-09-26T19:34:46.644009] [INFO ] [MAIN ] Update Progress: 1157/2371 symbols completed. JHS took 28.5s. Estimated remaining: 2h 42m 21s. Rate: 7.5 symbols/min [2025-09-26T19:34:47.111753] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-09-26T19:34:47.911722] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-09-26T19:34:48.231945] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-26T19:34:48.534048] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-26T19:34:48.553519] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-26T19:34:48.711730] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-09-26T19:34:49.511746] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-09-26T19:34:50.209323] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-26T19:34:50.311734] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-09-26T19:34:51.111702] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-09-26T19:34:51.396277] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-26T19:34:51.442207] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-26T19:34:51.446225] [INFO ] [REMOTE ] JILL: Full fetch complete (22997 records). [2025-09-26T19:34:51.446333] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-09-26T19:34:51.844938] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-09-26T19:34:51.845021] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-09-26T19:34:51.845569] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-09-26T19:34:51.845609] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-09-26T19:34:51.846284] [DEBUG] [LOCAL ] JILL: Trimmed 22997 records to 16931 (keeping 200 days of data) [2025-09-26T19:34:51.923720] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-09-26T19:34:51.966183] [DEBUG] [LOCAL ] JILL: Primary data saved (16931 records). [2025-09-26T19:34:51.966383] [INFO ] [MAIN ] JILL: Full history saved. [2025-09-26T19:34:51.966605] [INFO ] [MAIN ] Update Progress: 1158/2371 symbols completed. JILL took 25.1s. Estimated remaining: 2h 42m 10s. Rate: 7.5 symbols/min [2025-09-26T19:34:52.836531] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T19:34:52.847359] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-09-26T19:34:53.844739] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-26T19:34:53.855478] [INFO ] [REMOTE ] JHX: Full fetch complete (57608 records). [2025-09-26T19:34:53.855620] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-09-26T19:34:54.294597] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-09-26T19:34:54.294841] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-09-26T19:34:54.295983] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-09-26T19:34:54.296098] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-09-26T19:34:54.319372] [DEBUG] [LOCAL ] JHX: Trimmed 57608 records to 51216 (keeping 200 days of data) [2025-09-26T19:34:54.321225] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T19:34:54.330297] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-09-26T19:34:54.651968] [DEBUG] [LOCAL ] JHX: Primary data saved (51216 records). [2025-09-26T19:34:54.652176] [INFO ] [MAIN ] JHX: Full history saved. [2025-09-26T19:34:54.652324] [INFO ] [MAIN ] Update Progress: 1159/2371 symbols completed. JHX took 29.3s. Estimated remaining: 2h 41m 56s. Rate: 7.5 symbols/min [2025-09-26T19:34:55.778398] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-26T19:34:55.786963] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-09-26T19:34:57.349690] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-26T19:34:57.360607] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-09-26T19:34:58.756172] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-26T19:34:58.764457] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-09-26T19:35:00.476258] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-26T19:35:00.485844] [INFO ] [REMOTE ] JKS: Full fetch complete (59258 records). [2025-09-26T19:35:00.486044] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-09-26T19:35:00.975914] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-09-26T19:35:00.976029] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-09-26T19:35:00.976961] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-09-26T19:35:00.977043] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-09-26T19:35:00.978381] [DEBUG] [LOCAL ] JKS: Trimmed 59258 records to 40672 (keeping 200 days of data) [2025-09-26T19:35:01.241853] [DEBUG] [LOCAL ] JKS: Primary data saved (40672 records). [2025-09-26T19:35:01.241995] [INFO ] [MAIN ] JKS: Full history saved. [2025-09-26T19:35:01.242114] [INFO ] [MAIN ] Update Progress: 1160/2371 symbols completed. JKS took 26.7s. Estimated remaining: 2h 41m 47s. Rate: 7.5 symbols/min [2025-09-26T19:35:01.887717] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:35:01.984091] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:35:01.975122] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-09-26T19:35:02.027899] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-09-26T19:35:02.032242] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:35:02.055330] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-09-26T19:35:02.064423] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-26T19:35:02.088147] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:35:02.090422] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-26T19:35:02.090724] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-09-26T19:35:02.115590] [DEBUG] [LOCAL ] JLS: Loaded 4110 existing records from primary storage. [2025-09-26T19:35:02.147709] [INFO ] [MAIN ] JLS: Loaded 4110 existing records. [2025-09-26T19:35:02.381982] [DEBUG] [LOCAL ] JLL: Loaded 32288 existing records from primary storage. [2025-09-26T19:35:02.420188] [INFO ] [MAIN ] JLL: Loaded 32288 existing records. [2025-09-26T19:35:02.778736] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:35:02.820817] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-09-26T19:35:02.820574] [DEBUG] [LOCAL ] JMIA: Loaded 50895 existing records from primary storage. [2025-09-26T19:35:02.842267] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-09-26T19:35:02.842170] [INFO ] [MAIN ] JMIA: Loaded 50895 existing records. [2025-09-26T19:35:02.888861] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-09-26T19:35:02.969861] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-09-26T19:35:03.015320] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:35:03.066026] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-09-26T19:35:03.075939] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-09-26T19:35:03.133286] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-09-26T19:35:03.176889] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-09-26T19:35:03.146275] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:35:03.206903] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-09-26T19:35:03.535169] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:35:03.610811] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-09-26T19:35:03.714633] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-09-26T19:35:03.762963] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-09-26T19:35:03.819822] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-09-26T19:35:04.038929] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:35:04.077461] [INFO ] [REMOTE ] JLS: Fetching primary data for 2024-12. [2025-09-26T19:35:04.116834] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-26T19:35:04.184933] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-09-26T19:35:04.276812] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:35:04.293499] [INFO ] [REMOTE ] JLL: Fetching primary data for 2024-12. [2025-09-26T19:35:04.478495] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:35:04.478909] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2024-12. [2025-09-26T19:35:04.703719] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-26T19:35:04.704759] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-09-26T19:35:04.997016] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-26T19:35:04.998569] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-09-26T19:35:05.151781] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-26T19:35:05.152985] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-09-26T19:35:05.493382] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-26T19:35:05.499357] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-09-26T19:35:05.591534] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-26T19:35:05.593100] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-09-26T19:35:05.618543] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-26T19:35:05.619584] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-09-26T19:35:05.990848] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-26T19:35:05.992312] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-09-26T19:35:06.224783] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-26T19:35:06.311721] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-09-26T19:35:06.614453] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-26T19:35:06.617314] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-26T19:35:06.660258] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-26T19:35:06.818248] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-26T19:35:07.111715] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-09-26T19:35:07.805008] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-26T19:35:07.911709] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-09-26T19:35:08.562384] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-26T19:35:08.711736] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-09-26T19:35:09.511754] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-09-26T19:35:10.311711] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-09-26T19:35:10.564859] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-26T19:35:10.656811] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-26T19:35:10.944146] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-26T19:35:11.111718] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-09-26T19:35:11.911710] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-09-26T19:35:12.524027] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-26T19:35:12.549122] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-26T19:35:12.711748] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-09-26T19:35:13.511811] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-09-26T19:35:14.275893] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-26T19:35:14.311679] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-09-26T19:35:14.850844] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-26T19:35:15.111693] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-09-26T19:35:15.219165] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-26T19:35:15.613929] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-26T19:35:15.911707] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-09-26T19:35:16.711725] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-09-26T19:35:17.351538] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-26T19:35:17.353060] [INFO ] [REMOTE ] JLS: Full fetch complete (5820 records). [2025-09-26T19:35:17.353155] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-09-26T19:35:17.511962] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-09-26T19:35:17.522101] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-26T19:35:17.802949] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-09-26T19:35:17.803078] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-09-26T19:35:17.803293] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-09-26T19:35:17.803361] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-09-26T19:35:17.803907] [DEBUG] [LOCAL ] JLS: Trimmed 5820 records to 4142 (keeping 200 days of data) [2025-09-26T19:35:17.831170] [DEBUG] [LOCAL ] JLS: Primary data saved (4142 records). [2025-09-26T19:35:17.831324] [INFO ] [MAIN ] JLS: Full history saved. [2025-09-26T19:35:17.831471] [INFO ] [MAIN ] Update Progress: 1161/2371 symbols completed. JLS took 16.6s. Estimated remaining: 2h 41m 48s. Rate: 7.5 symbols/min [2025-09-26T19:35:18.047987] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:35:18.043479] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-26T19:35:18.111854] [DEBUG] [LOCAL ] JNJ: Loaded 54143 existing records from primary storage. [2025-09-26T19:35:18.112036] [INFO ] [MAIN ] JNJ: Loaded 54143 existing records. [2025-09-26T19:35:18.316544] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-09-26T19:35:18.321143] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:35:18.322503] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-09-26T19:35:18.322556] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-09-26T19:35:18.324214] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-09-26T19:35:18.324294] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-09-26T19:35:18.703321] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:35:19.111716] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2024-12. [2025-09-26T19:35:19.911742] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-09-26T19:35:20.087085] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-26T19:35:20.347974] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-26T19:35:20.711730] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-09-26T19:35:21.273633] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-26T19:35:21.274665] [INFO ] [REMOTE ] JMM: Full fetch complete (2292 records). [2025-09-26T19:35:21.274753] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-09-26T19:35:21.479926] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-09-26T19:35:21.480257] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:35:21.480414] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:35:21.480529] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-26T19:35:21.480634] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-26T19:35:21.480807] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-09-26T19:35:21.481006] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-09-26T19:35:21.481199] [INFO ] [MAIN ] Update Progress: 1162/2371 symbols completed. JMM took 20.2s. Estimated remaining: 2h 41m 35s. Rate: 7.5 symbols/min [2025-09-26T19:35:21.516789] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-09-26T19:35:21.665568] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-09-26T19:35:21.734480] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:35:21.790579] [DEBUG] [LOCAL ] JOBY: Loaded 54189 existing records from primary storage. [2025-09-26T19:35:21.790761] [INFO ] [MAIN ] JOBY: Loaded 54189 existing records. [2025-09-26T19:35:21.989744] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:35:21.990025] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-09-26T19:35:21.990101] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-09-26T19:35:21.991551] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-09-26T19:35:21.991627] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-09-26T19:35:22.316879] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-09-26T19:35:22.391756] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:35:22.853948] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-26T19:35:23.111717] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-09-26T19:35:23.911705] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-09-26T19:35:24.150716] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-26T19:35:24.711731] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-09-26T19:35:25.172949] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-26T19:35:25.277275] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-26T19:35:25.511720] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-09-26T19:35:26.311732] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2024-12. [2025-09-26T19:35:26.628557] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-26T19:35:27.111721] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-09-26T19:35:27.594409] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-26T19:35:27.911736] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-09-26T19:35:28.649950] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-26T19:35:28.711761] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-09-26T19:35:28.962687] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2024-12 (2.65 seconds). [2025-09-26T19:35:29.511719] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-09-26T19:35:29.672882] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-26T19:35:30.163210] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-26T19:35:30.170055] [INFO ] [REMOTE ] JLL: Full fetch complete (44863 records). [2025-09-26T19:35:30.170207] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-09-26T19:35:30.323975] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-09-26T19:35:30.621781] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-09-26T19:35:30.621865] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-09-26T19:35:30.622558] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-09-26T19:35:30.622600] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-09-26T19:35:30.623862] [DEBUG] [LOCAL ] JLL: Trimmed 44863 records to 32458 (keeping 200 days of data) [2025-09-26T19:35:30.830604] [DEBUG] [LOCAL ] JLL: Primary data saved (32458 records). [2025-09-26T19:35:30.830781] [INFO ] [MAIN ] JLL: Full history saved. [2025-09-26T19:35:30.830878] [INFO ] [MAIN ] Update Progress: 1163/2371 symbols completed. JLL took 29.6s. Estimated remaining: 2h 41m 29s. Rate: 7.5 symbols/min [2025-09-26T19:35:31.014693] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:35:31.039120] [DEBUG] [LOCAL ] JOE: Loaded 24733 existing records from primary storage. [2025-09-26T19:35:31.039346] [INFO ] [MAIN ] JOE: Loaded 24733 existing records. [2025-09-26T19:35:31.119960] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-09-26T19:35:31.250246] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:35:31.250485] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-09-26T19:35:31.250533] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-09-26T19:35:31.251272] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-09-26T19:35:31.251335] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-09-26T19:35:31.637140] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:35:31.773560] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-26T19:35:31.911717] [INFO ] [REMOTE ] JOE: Fetching primary data for 2024-12. [2025-09-26T19:35:32.618558] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-26T19:35:32.711739] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-09-26T19:35:33.068620] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-26T19:35:33.364192] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-26T19:35:33.511750] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-09-26T19:35:34.311754] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-09-26T19:35:34.817526] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-26T19:35:34.984454] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-26T19:35:35.111716] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-09-26T19:35:35.911727] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-09-26T19:35:36.711739] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-09-26T19:35:37.014352] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.70 seconds). [2025-09-26T19:35:37.235175] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-26T19:35:37.511705] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-09-26T19:35:37.858337] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-26T19:35:37.894975] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-26T19:35:38.311740] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-09-26T19:35:39.111753] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-09-26T19:35:39.379543] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-26T19:35:39.911721] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-09-26T19:35:40.575806] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-26T19:35:40.587601] [INFO ] [REMOTE ] JMIA: Full fetch complete (73263 records). [2025-09-26T19:35:40.587845] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-09-26T19:35:40.713070] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-09-26T19:35:41.036668] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-09-26T19:35:41.036778] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-09-26T19:35:41.042623] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-09-26T19:35:41.043163] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-09-26T19:35:41.047360] [DEBUG] [LOCAL ] JMIA: Trimmed 73263 records to 51279 (keeping 200 days of data) [2025-09-26T19:35:41.173750] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-26T19:35:41.388181] [DEBUG] [LOCAL ] JMIA: Primary data saved (51279 records). [2025-09-26T19:35:41.388342] [INFO ] [MAIN ] JMIA: Full history saved. [2025-09-26T19:35:41.388439] [INFO ] [MAIN ] Update Progress: 1164/2371 symbols completed. JMIA took 40.1s. Estimated remaining: 2h 41m 23s. Rate: 7.5 symbols/min [2025-09-26T19:35:41.513890] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-09-26T19:35:41.584287] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:35:41.594925] [DEBUG] [LOCAL ] JOF: Loaded 7145 existing records from primary storage. [2025-09-26T19:35:41.595456] [INFO ] [MAIN ] JOF: Loaded 7145 existing records. [2025-09-26T19:35:41.755720] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.64 seconds). [2025-09-26T19:35:41.856374] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:35:41.856719] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-09-26T19:35:41.856804] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-09-26T19:35:41.857351] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-09-26T19:35:41.857443] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-09-26T19:35:42.288979] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:35:42.311702] [INFO ] [REMOTE ] JOF: Fetching primary data for 2024-12. [2025-09-26T19:35:42.489106] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-26T19:35:43.123117] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-09-26T19:35:43.129455] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-09-26T19:35:43.370297] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-26T19:35:43.911909] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-09-26T19:35:44.711729] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-09-26T19:35:45.073240] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-26T19:35:45.511731] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-09-26T19:35:45.699471] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-09-26T19:35:46.311703] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-09-26T19:35:46.624623] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-26T19:35:46.953608] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-26T19:35:47.111722] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-09-26T19:35:47.911715] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-09-26T19:35:48.327764] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-26T19:35:48.711747] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-09-26T19:35:48.996133] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.68 seconds). [2025-09-26T19:35:49.191615] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-26T19:35:49.505816] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-09-26T19:35:49.515490] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-09-26T19:35:49.521778] [INFO ] [REMOTE ] JNJ: Full fetch complete (77855 records). [2025-09-26T19:35:49.521970] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-09-26T19:35:49.943196] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-09-26T19:35:49.943364] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-09-26T19:35:49.944353] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-09-26T19:35:49.944449] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-09-26T19:35:49.946110] [DEBUG] [LOCAL ] JNJ: Trimmed 77855 records to 54533 (keeping 200 days of data) [2025-09-26T19:35:50.302808] [DEBUG] [LOCAL ] JNJ: Primary data saved (54533 records). [2025-09-26T19:35:50.302956] [INFO ] [MAIN ] JNJ: Full history saved. [2025-09-26T19:35:50.303197] [INFO ] [MAIN ] Update Progress: 1165/2371 symbols completed. JNJ took 32.5s. Estimated remaining: 2h 41m 16s. Rate: 7.5 symbols/min [2025-09-26T19:35:50.317152] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-09-26T19:35:50.492364] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:35:50.533594] [DEBUG] [LOCAL ] JPC: Loaded 37351 existing records from primary storage. [2025-09-26T19:35:50.533792] [INFO ] [MAIN ] JPC: Loaded 37351 existing records. [2025-09-26T19:35:50.728309] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:35:50.728602] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-09-26T19:35:50.728677] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-09-26T19:35:50.729978] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-09-26T19:35:50.730050] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-09-26T19:35:51.115591] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:35:51.115915] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-09-26T19:35:51.262500] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-26T19:35:51.911712] [INFO ] [REMOTE ] JPC: Fetching primary data for 2024-12. [2025-09-26T19:35:52.110605] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-09-26T19:35:52.486961] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-26T19:35:52.711749] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-09-26T19:35:53.511737] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-09-26T19:35:53.772874] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-26T19:35:53.796136] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-26T19:35:54.311740] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-09-26T19:35:54.357722] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-26T19:35:55.111727] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-09-26T19:35:55.795879] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-26T19:35:55.911713] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-09-26T19:35:56.532322] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-26T19:35:56.538111] [INFO ] [REMOTE ] JOE: Full fetch complete (36213 records). [2025-09-26T19:35:56.538225] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-09-26T19:35:56.721794] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-09-26T19:35:56.936352] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-09-26T19:35:56.936449] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-09-26T19:35:56.937189] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-09-26T19:35:56.937258] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-09-26T19:35:56.938362] [DEBUG] [LOCAL ] JOE: Trimmed 36213 records to 24860 (keeping 200 days of data) [2025-09-26T19:35:57.113946] [DEBUG] [LOCAL ] JOE: Primary data saved (24860 records). [2025-09-26T19:35:57.114129] [INFO ] [MAIN ] JOE: Full history saved. [2025-09-26T19:35:57.114287] [INFO ] [MAIN ] Update Progress: 1166/2371 symbols completed. JOE took 26.3s. Estimated remaining: 2h 41m 7s. Rate: 7.5 symbols/min [2025-09-26T19:35:57.289958] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:35:57.357075] [DEBUG] [LOCAL ] JPM: Loaded 54184 existing records from primary storage. [2025-09-26T19:35:57.357230] [INFO ] [MAIN ] JPM: Loaded 54184 existing records. [2025-09-26T19:35:57.522553] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-09-26T19:35:57.547715] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:35:57.547986] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-09-26T19:35:57.548057] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-09-26T19:35:57.549896] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-09-26T19:35:57.549968] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-09-26T19:35:57.968283] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:35:58.164373] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-26T19:35:58.188995] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-26T19:35:58.311709] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-09-26T19:35:58.753746] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-26T19:35:58.795992] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.88 seconds). [2025-09-26T19:35:59.111747] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-09-26T19:35:59.911711] [INFO ] [REMOTE ] JPM: Fetching primary data for 2024-12. [2025-09-26T19:36:00.711730] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-09-26T19:36:01.511709] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-09-26T19:36:01.985662] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.87 seconds). [2025-09-26T19:36:02.061533] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-26T19:36:02.151869] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-26T19:36:02.172160] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-26T19:36:02.311714] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-09-26T19:36:03.111726] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-09-26T19:36:03.474216] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-26T19:36:03.911720] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-09-26T19:36:04.711716] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-09-26T19:36:05.511715] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-09-26T19:36:05.756042] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.64 seconds). [2025-09-26T19:36:05.770945] [INFO ] [REMOTE ] JOBY: Full fetch complete (77971 records). [2025-09-26T19:36:05.771170] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-09-26T19:36:06.171145] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-26T19:36:06.247257] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-09-26T19:36:06.247588] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-09-26T19:36:06.248612] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-09-26T19:36:06.248815] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-09-26T19:36:06.250723] [DEBUG] [LOCAL ] JOBY: Trimmed 77971 records to 54579 (keeping 200 days of data) [2025-09-26T19:36:06.312957] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-09-26T19:36:06.396313] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-26T19:36:06.427030] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-09-26T19:36:06.657879] [DEBUG] [LOCAL ] JOBY: Primary data saved (54579 records). [2025-09-26T19:36:06.658040] [INFO ] [MAIN ] JOBY: Full history saved. [2025-09-26T19:36:06.658157] [INFO ] [MAIN ] Update Progress: 1167/2371 symbols completed. JOBY took 45.2s. Estimated remaining: 2h 41m 0s. Rate: 7.5 symbols/min [2025-09-26T19:36:06.847386] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:36:06.881442] [DEBUG] [LOCAL ] JQC: Loaded 33842 existing records from primary storage. [2025-09-26T19:36:06.881590] [INFO ] [MAIN ] JQC: Loaded 33842 existing records. [2025-09-26T19:36:07.075553] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:36:07.075848] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-09-26T19:36:07.075929] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-09-26T19:36:07.076895] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-09-26T19:36:07.076983] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-09-26T19:36:07.121719] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-09-26T19:36:07.460268] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:36:07.481856] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-26T19:36:07.911714] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-09-26T19:36:08.711773] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-09-26T19:36:09.411718] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-26T19:36:09.489815] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-09-26T19:36:09.505995] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-26T19:36:09.508139] [INFO ] [REMOTE ] JOF: Full fetch complete (9496 records). [2025-09-26T19:36:09.508218] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-09-26T19:36:09.519902] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-09-26T19:36:09.895556] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-09-26T19:36:09.895664] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-09-26T19:36:09.895932] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-09-26T19:36:09.895973] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-09-26T19:36:09.896459] [DEBUG] [LOCAL ] JOF: Trimmed 9496 records to 7177 (keeping 200 days of data) [2025-09-26T19:36:09.942143] [DEBUG] [LOCAL ] JOF: Primary data saved (7177 records). [2025-09-26T19:36:09.942281] [INFO ] [MAIN ] JOF: Full history saved. [2025-09-26T19:36:09.942385] [INFO ] [MAIN ] Update Progress: 1168/2371 symbols completed. JOF took 28.6s. Estimated remaining: 2h 40m 48s. Rate: 7.5 symbols/min [2025-09-26T19:36:10.122140] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:36:10.143226] [DEBUG] [LOCAL ] JRI: Loaded 14986 existing records from primary storage. [2025-09-26T19:36:10.143367] [INFO ] [MAIN ] JRI: Loaded 14986 existing records. [2025-09-26T19:36:10.315277] [INFO ] [REMOTE ] JQC: Fetching primary data for 2024-12. [2025-09-26T19:36:10.341397] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:36:10.342514] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-09-26T19:36:10.342590] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-09-26T19:36:10.343391] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-09-26T19:36:10.343490] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-09-26T19:36:10.716367] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:36:11.079374] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-26T19:36:11.111700] [INFO ] [REMOTE ] JRI: Fetching primary data for 2024-12. [2025-09-26T19:36:11.599174] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-26T19:36:11.911711] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-09-26T19:36:12.309880] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-26T19:36:12.711728] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-09-26T19:36:13.471769] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-26T19:36:13.479734] [INFO ] [REMOTE ] JPC: Full fetch complete (55708 records). [2025-09-26T19:36:13.479894] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-09-26T19:36:13.518441] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-09-26T19:36:13.903426] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-09-26T19:36:13.903556] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-09-26T19:36:13.904685] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-09-26T19:36:13.904848] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-09-26T19:36:13.906856] [DEBUG] [LOCAL ] JPC: Trimmed 55708 records to 37620 (keeping 200 days of data) [2025-09-26T19:36:14.024908] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-26T19:36:14.174061] [DEBUG] [LOCAL ] JPC: Primary data saved (37620 records). [2025-09-26T19:36:14.174217] [INFO ] [MAIN ] JPC: Full history saved. [2025-09-26T19:36:14.174367] [INFO ] [MAIN ] Update Progress: 1169/2371 symbols completed. JPC took 23.9s. Estimated remaining: 2h 40m 36s. Rate: 7.5 symbols/min [2025-09-26T19:36:14.327036] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-09-26T19:36:14.363606] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:36:14.376541] [DEBUG] [LOCAL ] JRS: Loaded 11185 existing records from primary storage. [2025-09-26T19:36:14.376733] [INFO ] [MAIN ] JRS: Loaded 11185 existing records. [2025-09-26T19:36:14.585925] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:36:14.586263] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-09-26T19:36:14.586324] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-09-26T19:36:14.586830] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-09-26T19:36:14.586904] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-09-26T19:36:14.989991] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:36:15.111729] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-09-26T19:36:15.658418] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-26T19:36:15.911708] [INFO ] [REMOTE ] JRS: Fetching primary data for 2024-12. [2025-09-26T19:36:16.035353] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-09-26T19:36:16.127137] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-26T19:36:16.711756] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-09-26T19:36:16.995365] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-26T19:36:17.511744] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-09-26T19:36:18.166238] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-26T19:36:18.311699] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-09-26T19:36:18.361587] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-26T19:36:19.111733] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-09-26T19:36:19.911719] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-09-26T19:36:20.097684] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-26T19:36:20.711719] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-09-26T19:36:20.937938] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-09-26T19:36:21.314795] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-26T19:36:21.358155] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-26T19:36:21.511755] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-09-26T19:36:22.311711] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-09-26T19:36:22.507886] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-26T19:36:23.110594] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-26T19:36:23.114216] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-09-26T19:36:23.911713] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-09-26T19:36:24.696790] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-26T19:36:24.711671] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-09-26T19:36:24.734966] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-26T19:36:25.511715] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-09-26T19:36:25.944501] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-26T19:36:26.311727] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-09-26T19:36:26.482489] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-26T19:36:27.111726] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-09-26T19:36:27.129471] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-26T19:36:27.911719] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-09-26T19:36:28.711718] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-09-26T19:36:29.417324] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-26T19:36:29.511700] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-09-26T19:36:29.590904] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-09-26T19:36:29.611600] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-26T19:36:30.166297] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-26T19:36:30.311730] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-09-26T19:36:31.111698] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-09-26T19:36:31.158129] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-26T19:36:31.911714] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-09-26T19:36:32.711703] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-09-26T19:36:32.858600] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-26T19:36:33.092848] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-26T19:36:33.511693] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-09-26T19:36:33.593731] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-26T19:36:34.311741] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-09-26T19:36:35.111780] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-09-26T19:36:35.289056] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-26T19:36:35.291904] [INFO ] [REMOTE ] JRS: Full fetch complete (16146 records). [2025-09-26T19:36:35.291981] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-09-26T19:36:35.683101] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-09-26T19:36:35.683241] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-09-26T19:36:35.683752] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-09-26T19:36:35.683817] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-09-26T19:36:35.684416] [DEBUG] [LOCAL ] JRS: Trimmed 16146 records to 11250 (keeping 200 days of data) [2025-09-26T19:36:35.761848] [DEBUG] [LOCAL ] JRS: Primary data saved (11250 records). [2025-09-26T19:36:35.762017] [INFO ] [MAIN ] JRS: Full history saved. [2025-09-26T19:36:35.762155] [INFO ] [MAIN ] Update Progress: 1170/2371 symbols completed. JRS took 21.6s. Estimated remaining: 2h 40m 42s. Rate: 7.5 symbols/min [2025-09-26T19:36:35.939967] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-09-26T19:36:35.943478] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:36:35.994907] [DEBUG] [LOCAL ] JXN: Loaded 46259 existing records from primary storage. [2025-09-26T19:36:35.995121] [INFO ] [MAIN ] JXN: Loaded 46259 existing records. [2025-09-26T19:36:36.199640] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-26T19:36:36.203369] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:36:36.208829] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-09-26T19:36:36.209388] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-09-26T19:36:36.210768] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-09-26T19:36:36.210854] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-09-26T19:36:36.374349] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.86 seconds). [2025-09-26T19:36:36.633741] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:36:36.711746] [INFO ] [REMOTE ] JXN: Fetching primary data for 2024-12. [2025-09-26T19:36:37.298438] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-26T19:36:37.511726] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-09-26T19:36:38.320683] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-09-26T19:36:38.328049] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-26T19:36:39.111747] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-09-26T19:36:39.437888] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-26T19:36:39.788287] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-26T19:36:39.911709] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-09-26T19:36:40.684665] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T19:36:40.711695] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-09-26T19:36:41.511786] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-09-26T19:36:42.243522] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-26T19:36:42.311717] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-09-26T19:36:42.487690] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-09-26T19:36:42.498945] [INFO ] [REMOTE ] JPM: Full fetch complete (77892 records). [2025-09-26T19:36:42.499113] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-09-26T19:36:42.834754] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-26T19:36:42.877850] [INFO ] [REMOTE ] JRI: Full fetch complete (23142 records). [2025-09-26T19:36:42.894717] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-09-26T19:36:42.974573] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-09-26T19:36:43.000063] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-09-26T19:36:43.016752] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-09-26T19:36:43.028590] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-09-26T19:36:43.076408] [DEBUG] [LOCAL ] JPM: Trimmed 77892 records to 54574 (keeping 200 days of data) [2025-09-26T19:36:43.138569] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-09-26T19:36:43.454039] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-09-26T19:36:43.455112] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-09-26T19:36:43.456405] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-09-26T19:36:43.456488] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-09-26T19:36:43.459268] [DEBUG] [LOCAL ] JRI: Trimmed 23142 records to 15068 (keeping 200 days of data) [2025-09-26T19:36:43.736985] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-26T19:36:43.799173] [INFO ] [REMOTE ] JQC: Full fetch complete (48750 records). [2025-09-26T19:36:43.818881] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-09-26T19:36:43.914094] [DEBUG] [LOCAL ] JPM: Primary data saved (54574 records). [2025-09-26T19:36:43.930001] [INFO ] [MAIN ] JPM: Full history saved. [2025-09-26T19:36:43.930493] [INFO ] [MAIN ] Update Progress: 1171/2371 symbols completed. JPM took 46.8s. Estimated remaining: 2h 40m 34s. Rate: 7.5 symbols/min [2025-09-26T19:36:44.011680] [DEBUG] [LOCAL ] JRI: Primary data saved (15068 records). [2025-09-26T19:36:44.048015] [INFO ] [MAIN ] JRI: Full history saved. [2025-09-26T19:36:44.099964] [INFO ] [MAIN ] Update Progress: 1172/2371 symbols completed. JRI took 34.2s. Estimated remaining: 2h 40m 18s. Rate: 7.5 symbols/min [2025-09-26T19:36:44.369216] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:36:44.625587] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:36:44.683811] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-09-26T19:36:44.684038] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-09-26T19:36:44.685525] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-09-26T19:36:44.685755] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-09-26T19:36:44.688090] [DEBUG] [LOCAL ] JQC: Trimmed 48750 records to 34194 (keeping 200 days of data) [2025-09-26T19:36:44.712917] [DEBUG] [LOCAL ] KAI: Loaded 13650 existing records from primary storage. [2025-09-26T19:36:44.713107] [INFO ] [MAIN ] KAI: Loaded 13650 existing records. [2025-09-26T19:36:44.939055] [DEBUG] [LOCAL ] K: Loaded 50249 existing records from primary storage. [2025-09-26T19:36:44.945394] [INFO ] [MAIN ] K: Loaded 50249 existing records. [2025-09-26T19:36:45.218475] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:36:45.236329] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-09-26T19:36:45.241674] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-09-26T19:36:45.297917] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-09-26T19:36:45.315481] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-09-26T19:36:45.328975] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:36:45.380372] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-09-26T19:36:45.434128] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-09-26T19:36:45.476552] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-09-26T19:36:45.482063] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-09-26T19:36:45.520401] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-26T19:36:45.627498] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-09-26T19:36:45.951371] [DEBUG] [LOCAL ] JQC: Primary data saved (34194 records). [2025-09-26T19:36:45.957719] [INFO ] [MAIN ] JQC: Full history saved. [2025-09-26T19:36:45.962476] [INFO ] [MAIN ] Update Progress: 1173/2371 symbols completed. JQC took 39.3s. Estimated remaining: 2h 40m 3s. Rate: 7.5 symbols/min [2025-09-26T19:36:46.417108] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:36:46.442435] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:36:46.435195] [INFO ] [REMOTE ] KAI: Fetching primary data for 2024-12. [2025-09-26T19:36:46.528867] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:36:46.529350] [INFO ] [REMOTE ] K: Fetching primary data for 2024-12. [2025-09-26T19:36:46.573380] [DEBUG] [LOCAL ] KAR: Loaded 40122 existing records from primary storage. [2025-09-26T19:36:46.573630] [INFO ] [MAIN ] KAR: Loaded 40122 existing records. [2025-09-26T19:36:46.758988] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:36:46.759382] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-09-26T19:36:46.759438] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-09-26T19:36:46.760710] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-09-26T19:36:46.760772] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-09-26T19:36:47.138803] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:36:47.139225] [INFO ] [REMOTE ] KAR: Fetching primary data for 2024-12. [2025-09-26T19:36:47.442701] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-26T19:36:47.454306] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-09-26T19:36:47.619104] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-26T19:36:47.911705] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-09-26T19:36:48.261865] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-26T19:36:48.351620] [INFO ] [REMOTE ] K: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-26T19:36:48.711710] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-09-26T19:36:48.741184] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-26T19:36:48.941684] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T19:36:49.511734] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-09-26T19:36:50.311721] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-09-26T19:36:50.383078] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-26T19:36:50.606205] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-26T19:36:51.111748] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-09-26T19:36:51.868216] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-26T19:36:51.911690] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-09-26T19:36:52.161755] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-26T19:36:52.711746] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-09-26T19:36:53.402122] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-26T19:36:53.511689] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-09-26T19:36:54.057936] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-26T19:36:54.311764] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-09-26T19:36:55.096091] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-26T19:36:55.111686] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-09-26T19:36:55.659288] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-26T19:36:55.911759] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-09-26T19:36:56.711756] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-09-26T19:36:57.047974] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-26T19:36:57.057172] [INFO ] [REMOTE ] JXN: Full fetch complete (65362 records). [2025-09-26T19:36:57.057377] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-09-26T19:36:57.492778] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-26T19:36:57.513142] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-09-26T19:36:57.520627] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-09-26T19:36:57.521318] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-09-26T19:36:57.522879] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-09-26T19:36:57.523012] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-09-26T19:36:57.525164] [DEBUG] [LOCAL ] JXN: Trimmed 65362 records to 46558 (keeping 200 days of data) [2025-09-26T19:36:57.829163] [DEBUG] [LOCAL ] JXN: Primary data saved (46558 records). [2025-09-26T19:36:57.829473] [INFO ] [MAIN ] JXN: Full history saved. [2025-09-26T19:36:57.829725] [INFO ] [MAIN ] Update Progress: 1174/2371 symbols completed. JXN took 22.1s. Estimated remaining: 2h 39m 59s. Rate: 7.5 symbols/min [2025-09-26T19:36:58.052195] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:36:58.057930] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-26T19:36:58.093884] [DEBUG] [LOCAL ] KB: Loaded 24295 existing records from primary storage. [2025-09-26T19:36:58.094070] [INFO ] [MAIN ] KB: Loaded 24295 existing records. [2025-09-26T19:36:58.280958] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:36:58.281413] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-09-26T19:36:58.281490] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-09-26T19:36:58.282435] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-09-26T19:36:58.282499] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-09-26T19:36:58.314305] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-09-26T19:36:58.372386] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-26T19:36:58.696203] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:36:59.111806] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-09-26T19:36:59.911732] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-09-26T19:37:00.010032] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-26T19:37:00.058443] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-26T19:37:00.711746] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-09-26T19:37:01.309755] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-26T19:37:01.511760] [INFO ] [REMOTE ] KB: Fetching primary data for 2024-12. [2025-09-26T19:37:01.676788] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-26T19:37:02.311719] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-09-26T19:37:02.886715] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-26T19:37:03.111765] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-09-26T19:37:03.844766] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-26T19:37:03.883007] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-26T19:37:03.911681] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-09-26T19:37:04.711736] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-09-26T19:37:04.900867] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-26T19:37:04.904264] [INFO ] [REMOTE ] KAI: Full fetch complete (18883 records). [2025-09-26T19:37:04.904404] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-09-26T19:37:05.284126] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-09-26T19:37:05.284218] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-09-26T19:37:05.284680] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-09-26T19:37:05.284741] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-09-26T19:37:05.285323] [DEBUG] [LOCAL ] KAI: Trimmed 18883 records to 13729 (keeping 200 days of data) [2025-09-26T19:37:05.371061] [DEBUG] [LOCAL ] KAI: Primary data saved (13729 records). [2025-09-26T19:37:05.371207] [INFO ] [MAIN ] KAI: Full history saved. [2025-09-26T19:37:05.371327] [INFO ] [MAIN ] Update Progress: 1175/2371 symbols completed. KAI took 21.2s. Estimated remaining: 2h 39m 51s. Rate: 7.5 symbols/min [2025-09-26T19:37:05.519959] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-09-26T19:37:05.546468] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:37:05.568611] [DEBUG] [LOCAL ] KBDC: Loaded 21035 existing records from primary storage. [2025-09-26T19:37:05.568838] [INFO ] [MAIN ] KBDC: Loaded 21035 existing records. [2025-09-26T19:37:05.748283] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:37:05.748611] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-09-26T19:37:05.748687] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-09-26T19:37:05.749418] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-09-26T19:37:05.749478] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-09-26T19:37:06.119719] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:37:06.311738] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-09-26T19:37:06.583018] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-26T19:37:07.111689] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-12. [2025-09-26T19:37:07.158017] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-26T19:37:07.415278] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-26T19:37:07.911704] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-09-26T19:37:08.129724] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-26T19:37:08.711735] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-09-26T19:37:09.353519] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-26T19:37:09.511738] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-09-26T19:37:09.902871] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-26T19:37:10.311697] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-09-26T19:37:10.458096] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-26T19:37:11.111713] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-09-26T19:37:11.911748] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-09-26T19:37:12.034909] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-26T19:37:12.081162] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-26T19:37:12.711712] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-09-26T19:37:13.095013] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-26T19:37:13.511754] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-09-26T19:37:14.251227] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-26T19:37:14.311774] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-09-26T19:37:14.595557] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-26T19:37:15.111712] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-09-26T19:37:15.911705] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-09-26T19:37:16.164353] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-26T19:37:16.638761] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-26T19:37:16.711741] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-09-26T19:37:17.080046] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-26T19:37:17.511722] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-09-26T19:37:18.299561] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-26T19:37:18.311683] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-09-26T19:37:18.609134] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-26T19:37:19.111719] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-09-26T19:37:19.317700] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-26T19:37:19.911716] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-09-26T19:37:20.615034] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-26T19:37:20.623983] [INFO ] [REMOTE ] KAR: Full fetch complete (56713 records). [2025-09-26T19:37:20.624125] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-09-26T19:37:20.716804] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-09-26T19:37:21.069721] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-26T19:37:21.072766] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-09-26T19:37:21.077415] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-09-26T19:37:21.078831] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-09-26T19:37:21.078909] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-09-26T19:37:21.080323] [DEBUG] [LOCAL ] KAR: Trimmed 56713 records to 40411 (keeping 200 days of data) [2025-09-26T19:37:21.319583] [DEBUG] [LOCAL ] KAR: Primary data saved (40411 records). [2025-09-26T19:37:21.319740] [INFO ] [MAIN ] KAR: Full history saved. [2025-09-26T19:37:21.319837] [INFO ] [MAIN ] Update Progress: 1176/2371 symbols completed. KAR took 35.4s. Estimated remaining: 2h 39m 51s. Rate: 7.5 symbols/min [2025-09-26T19:37:21.499028] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:37:21.511705] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-09-26T19:37:21.549605] [DEBUG] [LOCAL ] KBH: Loaded 49303 existing records from primary storage. [2025-09-26T19:37:21.549792] [INFO ] [MAIN ] KBH: Loaded 49303 existing records. [2025-09-26T19:37:21.738628] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:37:21.738918] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-09-26T19:37:21.738969] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-09-26T19:37:21.740578] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-09-26T19:37:21.740677] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-09-26T19:37:22.131417] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:37:22.311689] [INFO ] [REMOTE ] KBH: Fetching primary data for 2024-12. [2025-09-26T19:37:22.477952] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-26T19:37:22.500143] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-26T19:37:23.111726] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-09-26T19:37:23.844581] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-26T19:37:23.911670] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-09-26T19:37:24.151716] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-26T19:37:24.711725] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-09-26T19:37:25.511720] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-09-26T19:37:25.638082] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-26T19:37:25.933744] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-26T19:37:26.311709] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-09-26T19:37:27.111726] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-09-26T19:37:27.489251] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-26T19:37:27.499825] [INFO ] [REMOTE ] K: Full fetch complete (71958 records). [2025-09-26T19:37:27.500011] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-09-26T19:37:27.937907] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-09-26T19:37:27.965262] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-09-26T19:37:27.965422] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-09-26T19:37:27.966596] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-09-26T19:37:27.967099] [DEBUG] [LOCAL ] K: Saving primary data. [2025-09-26T19:37:27.969033] [DEBUG] [LOCAL ] K: Trimmed 71958 records to 50637 (keeping 200 days of data) [2025-09-26T19:37:27.999130] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-26T19:37:28.328786] [DEBUG] [LOCAL ] K: Primary data saved (50637 records). [2025-09-26T19:37:28.328952] [INFO ] [MAIN ] K: Full history saved. [2025-09-26T19:37:28.329058] [INFO ] [MAIN ] Update Progress: 1177/2371 symbols completed. K took 44.4s. Estimated remaining: 2h 39m 42s. Rate: 7.5 symbols/min [2025-09-26T19:37:28.523591] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:37:28.548857] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-26T19:37:28.603771] [DEBUG] [LOCAL ] KBR: Loaded 48536 existing records from primary storage. [2025-09-26T19:37:28.604078] [INFO ] [MAIN ] KBR: Loaded 48536 existing records. [2025-09-26T19:37:28.713316] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-09-26T19:37:28.793821] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-26T19:37:28.842949] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:37:28.843237] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-09-26T19:37:28.843295] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-09-26T19:37:28.844662] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-09-26T19:37:28.844748] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-09-26T19:37:29.235291] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:37:29.511738] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-09-26T19:37:29.611867] [DEBUG] [REMOTE ] KBDC: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-09-26T19:37:29.612194] [WARN ] [REMOTE ] KBDC: No data returned for month 2025-09 [2025-09-26T19:37:29.612313] [INFO ] [REMOTE ] KBDC: Full fetch complete (24186 records). [2025-09-26T19:37:29.612389] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-09-26T19:37:29.613173] [FATAL] [VALIDATOR ] KBDC: Data is stale - most recent date (2025-08-29) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T19:37:29.613311] [FATAL] [MAIN ] KBDC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:37:29.613419] [WARN ] [MAIN ] KBDC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:37:29.613497] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-09-26T19:37:29.613617] [DEBUG] [LOCAL ] KBDC: No primary data file found to delete. [2025-09-26T19:37:29.613717] [INFO ] [LOCAL ] KBDC: Starting deletion of derivative data. [2025-09-26T19:37:29.614260] [DEBUG] [LOCAL ] KBDC: Deleted derivative data file. [2025-09-26T19:37:29.614392] [INFO ] [MAIN ] Update Progress: 1178/2371 symbols completed. KBDC took 24.2s. Estimated remaining: 2h 39m 27s. Rate: 7.5 symbols/min [2025-09-26T19:37:29.803114] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:37:29.865322] [DEBUG] [LOCAL ] KD: Loaded 52678 existing records from primary storage. [2025-09-26T19:37:29.865471] [INFO ] [MAIN ] KD: Loaded 52678 existing records. [2025-09-26T19:37:30.054004] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:37:30.054426] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-09-26T19:37:30.054495] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-09-26T19:37:30.061080] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-09-26T19:37:30.066526] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-09-26T19:37:30.128399] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-26T19:37:30.316849] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-09-26T19:37:30.459316] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:37:31.111732] [INFO ] [REMOTE ] KBR: Fetching primary data for 2024-12. [2025-09-26T19:37:31.911714] [INFO ] [REMOTE ] KD: Fetching primary data for 2024-12. [2025-09-26T19:37:32.115502] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-26T19:37:32.644422] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-26T19:37:32.711689] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-09-26T19:37:33.511770] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-09-26T19:37:33.721602] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-26T19:37:33.751144] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-26T19:37:33.756955] [INFO ] [REMOTE ] KB: Full fetch complete (34364 records). [2025-09-26T19:37:33.757195] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-09-26T19:37:34.160259] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-09-26T19:37:34.160345] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-09-26T19:37:34.160986] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-09-26T19:37:34.161050] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-09-26T19:37:34.162063] [DEBUG] [LOCAL ] KB: Trimmed 34364 records to 24453 (keeping 200 days of data) [2025-09-26T19:37:34.315576] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-09-26T19:37:34.325348] [DEBUG] [LOCAL ] KB: Primary data saved (24453 records). [2025-09-26T19:37:34.325534] [INFO ] [MAIN ] KB: Full history saved. [2025-09-26T19:37:34.325716] [INFO ] [MAIN ] Update Progress: 1179/2371 symbols completed. KB took 36.5s. Estimated remaining: 2h 39m 15s. Rate: 7.5 symbols/min [2025-09-26T19:37:34.524826] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:37:34.533851] [DEBUG] [LOCAL ] KEN: Loaded 4776 existing records from primary storage. [2025-09-26T19:37:34.534029] [INFO ] [MAIN ] KEN: Loaded 4776 existing records. [2025-09-26T19:37:34.745451] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:37:34.745748] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-09-26T19:37:34.745827] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-09-26T19:37:34.746186] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-09-26T19:37:34.746247] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-09-26T19:37:35.124625] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-09-26T19:37:35.130570] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:37:35.165904] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-26T19:37:35.911718] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-09-26T19:37:35.975536] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-26T19:37:36.711729] [INFO ] [REMOTE ] KEN: Fetching primary data for 2024-12. [2025-09-26T19:37:36.757004] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-26T19:37:37.050803] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-26T19:37:37.511713] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-09-26T19:37:37.540818] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T19:37:38.311726] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-09-26T19:37:39.111699] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-09-26T19:37:39.312087] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-26T19:37:39.692976] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-26T19:37:39.889699] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-26T19:37:39.911730] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-09-26T19:37:40.711733] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-09-26T19:37:41.169323] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-26T19:37:41.511730] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-09-26T19:37:41.744241] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-26T19:37:41.920304] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-26T19:37:42.311715] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-09-26T19:37:43.111749] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-09-26T19:37:43.893732] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-26T19:37:43.923258] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-09-26T19:37:43.948984] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-26T19:37:44.711728] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-09-26T19:37:45.430728] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-26T19:37:45.511717] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-09-26T19:37:46.311723] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-09-26T19:37:46.385211] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-26T19:37:46.708950] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-26T19:37:47.111693] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-09-26T19:37:47.232419] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T19:37:47.911722] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-09-26T19:37:48.519116] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-26T19:37:48.691836] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-26T19:37:48.711702] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-09-26T19:37:49.511727] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-09-26T19:37:50.216351] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-26T19:37:50.311776] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-09-26T19:37:51.111704] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-09-26T19:37:51.305857] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-26T19:37:51.752151] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-26T19:37:51.911721] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-09-26T19:37:52.142014] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-26T19:37:52.630216] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-26T19:37:52.711676] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-09-26T19:37:53.511744] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-09-26T19:37:54.279300] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-26T19:37:54.302296] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-26T19:37:54.304519] [INFO ] [REMOTE ] KEN: Full fetch complete (5938 records). [2025-09-26T19:37:54.304685] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-09-26T19:37:54.320276] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-09-26T19:37:54.748119] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-09-26T19:37:54.748227] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-09-26T19:37:54.748438] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-09-26T19:37:54.748536] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-09-26T19:37:54.749184] [DEBUG] [LOCAL ] KEN: Trimmed 5938 records to 4784 (keeping 200 days of data) [2025-09-26T19:37:54.781195] [DEBUG] [LOCAL ] KEN: Primary data saved (4784 records). [2025-09-26T19:37:54.781351] [INFO ] [MAIN ] KEN: Full history saved. [2025-09-26T19:37:54.781538] [INFO ] [MAIN ] Update Progress: 1180/2371 symbols completed. KEN took 20.5s. Estimated remaining: 2h 39m 20s. Rate: 7.5 symbols/min [2025-09-26T19:37:54.962051] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:37:55.005218] [DEBUG] [LOCAL ] KEP: Loaded 30936 existing records from primary storage. [2025-09-26T19:37:55.005386] [INFO ] [MAIN ] KEP: Loaded 30936 existing records. [2025-09-26T19:37:55.116788] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-09-26T19:37:55.220226] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:37:55.220560] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-09-26T19:37:55.220614] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-09-26T19:37:55.221797] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-09-26T19:37:55.221871] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-09-26T19:37:55.649167] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:37:55.911699] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-09-26T19:37:56.165206] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-26T19:37:56.711739] [INFO ] [REMOTE ] KEP: Fetching primary data for 2024-12. [2025-09-26T19:37:56.996326] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-26T19:37:57.008103] [INFO ] [REMOTE ] KBH: Full fetch complete (70724 records). [2025-09-26T19:37:57.008294] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-09-26T19:37:57.453850] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-09-26T19:37:57.454283] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-09-26T19:37:57.455632] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-09-26T19:37:57.479849] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-09-26T19:37:57.485542] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-26T19:37:57.496156] [DEBUG] [LOCAL ] KBH: Trimmed 70724 records to 49678 (keeping 200 days of data) [2025-09-26T19:37:57.511696] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-09-26T19:37:57.826748] [DEBUG] [LOCAL ] KBH: Primary data saved (49678 records). [2025-09-26T19:37:57.826945] [INFO ] [MAIN ] KBH: Full history saved. [2025-09-26T19:37:57.827070] [INFO ] [MAIN ] Update Progress: 1181/2371 symbols completed. KBH took 36.5s. Estimated remaining: 2h 39m 7s. Rate: 7.5 symbols/min [2025-09-26T19:37:58.017115] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:37:58.054741] [DEBUG] [LOCAL ] KEX: Loaded 38367 existing records from primary storage. [2025-09-26T19:37:58.054888] [INFO ] [MAIN ] KEX: Loaded 38367 existing records. [2025-09-26T19:37:58.254346] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:37:58.273074] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-09-26T19:37:58.273803] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-09-26T19:37:58.274415] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-26T19:37:58.280280] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-09-26T19:37:58.281010] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-09-26T19:37:58.316781] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-09-26T19:37:58.673519] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:37:59.111692] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-09-26T19:37:59.483706] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-26T19:37:59.650766] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-26T19:37:59.911698] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-09-26T19:38:00.238528] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-26T19:38:00.711737] [INFO ] [REMOTE ] KEX: Fetching primary data for 2024-12. [2025-09-26T19:38:01.511780] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-09-26T19:38:01.855243] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-26T19:38:02.311725] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-09-26T19:38:02.543950] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-26T19:38:03.111710] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-09-26T19:38:03.295790] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-26T19:38:03.305120] [INFO ] [REMOTE ] KBR: Full fetch complete (69982 records). [2025-09-26T19:38:03.305252] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-09-26T19:38:03.610499] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-26T19:38:03.765734] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-09-26T19:38:03.765832] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-09-26T19:38:03.766750] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-09-26T19:38:03.766817] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-09-26T19:38:03.771197] [DEBUG] [LOCAL ] KBR: Trimmed 69982 records to 48899 (keeping 200 days of data) [2025-09-26T19:38:03.913442] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-09-26T19:38:04.099609] [DEBUG] [LOCAL ] KBR: Primary data saved (48899 records). [2025-09-26T19:38:04.099793] [INFO ] [MAIN ] KBR: Full history saved. [2025-09-26T19:38:04.099911] [INFO ] [MAIN ] Update Progress: 1182/2371 symbols completed. KBR took 35.8s. Estimated remaining: 2h 38m 57s. Rate: 7.5 symbols/min [2025-09-26T19:38:04.300029] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:38:04.300243] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-09-26T19:38:04.300292] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-09-26T19:38:04.300448] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-09-26T19:38:04.300504] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-26T19:38:04.300573] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-26T19:38:04.300611] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-09-26T19:38:04.693014] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:38:04.711682] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-09-26T19:38:05.056007] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-26T19:38:05.067166] [INFO ] [REMOTE ] KD: Full fetch complete (75603 records). [2025-09-26T19:38:05.067354] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-09-26T19:38:05.218778] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-26T19:38:05.511930] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-09-26T19:38:05.511690] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-09-26T19:38:05.512955] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-09-26T19:38:05.513953] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-09-26T19:38:05.514144] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-09-26T19:38:05.518626] [DEBUG] [LOCAL ] KD: Trimmed 75603 records to 53068 (keeping 200 days of data) [2025-09-26T19:38:05.854411] [DEBUG] [LOCAL ] KD: Primary data saved (53068 records). [2025-09-26T19:38:05.854569] [INFO ] [MAIN ] KD: Full history saved. [2025-09-26T19:38:05.854694] [INFO ] [MAIN ] Update Progress: 1183/2371 symbols completed. KD took 36.2s. Estimated remaining: 2h 38m 43s. Rate: 7.5 symbols/min [2025-09-26T19:38:06.031693] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:38:06.081797] [DEBUG] [LOCAL ] KEYS: Loaded 43637 existing records from primary storage. [2025-09-26T19:38:06.081950] [INFO ] [MAIN ] KEYS: Loaded 43637 existing records. [2025-09-26T19:38:06.277781] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:38:06.278119] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-09-26T19:38:06.278167] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-09-26T19:38:06.279494] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-09-26T19:38:06.279560] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-09-26T19:38:06.324519] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-09-26T19:38:06.678602] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:38:06.696396] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-26T19:38:06.735861] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-26T19:38:07.111723] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-09-26T19:38:07.863379] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-26T19:38:07.911728] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2024-12. [2025-09-26T19:38:08.081855] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-26T19:38:08.711728] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-09-26T19:38:09.511708] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-09-26T19:38:09.586553] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-26T19:38:10.311708] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-09-26T19:38:10.565628] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-26T19:38:10.748882] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-26T19:38:11.111721] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-09-26T19:38:11.911696] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-09-26T19:38:11.944362] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-26T19:38:12.566249] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-26T19:38:12.711755] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-09-26T19:38:13.467225] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-26T19:38:13.511717] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-09-26T19:38:14.287190] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-26T19:38:14.311712] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-09-26T19:38:14.831267] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-26T19:38:15.111733] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-09-26T19:38:15.911727] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-09-26T19:38:16.001691] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-26T19:38:16.209727] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-26T19:38:16.711734] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-09-26T19:38:17.511730] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-09-26T19:38:17.795480] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-26T19:38:17.803634] [INFO ] [REMOTE ] KEP: Full fetch complete (41623 records). [2025-09-26T19:38:17.803880] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-09-26T19:38:18.304515] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-09-26T19:38:18.304632] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-09-26T19:38:18.305547] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-09-26T19:38:18.305620] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-09-26T19:38:18.306856] [DEBUG] [LOCAL ] KEP: Trimmed 41623 records to 31169 (keeping 200 days of data) [2025-09-26T19:38:18.311755] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-09-26T19:38:18.542024] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-26T19:38:18.566301] [DEBUG] [LOCAL ] KEP: Primary data saved (31169 records). [2025-09-26T19:38:18.566935] [INFO ] [MAIN ] KEP: Full history saved. [2025-09-26T19:38:18.567071] [INFO ] [MAIN ] Update Progress: 1184/2371 symbols completed. KEP took 23.8s. Estimated remaining: 2h 38m 40s. Rate: 7.5 symbols/min [2025-09-26T19:38:18.757545] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:38:18.761908] [DEBUG] [LOCAL ] KF: Loaded 2476 existing records from primary storage. [2025-09-26T19:38:18.761993] [INFO ] [MAIN ] KF: Loaded 2476 existing records. [2025-09-26T19:38:18.963346] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:38:18.963893] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-09-26T19:38:18.964040] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-09-26T19:38:18.964437] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-09-26T19:38:18.964542] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-09-26T19:38:19.097246] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-26T19:38:19.127068] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-09-26T19:38:19.402678] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:38:19.911738] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-09-26T19:38:20.064409] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-26T19:38:20.711706] [INFO ] [REMOTE ] KF: Fetching primary data for 2024-12. [2025-09-26T19:38:21.062096] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-26T19:38:21.375480] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-26T19:38:21.401952] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T19:38:21.511719] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-09-26T19:38:22.311824] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-09-26T19:38:23.111713] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-09-26T19:38:23.513147] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-26T19:38:23.640240] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-26T19:38:23.684065] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-26T19:38:23.911719] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-09-26T19:38:24.711718] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-09-26T19:38:25.511717] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-09-26T19:38:25.675867] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-26T19:38:26.130080] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-26T19:38:26.311787] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-09-26T19:38:26.789104] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-26T19:38:27.111727] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-09-26T19:38:27.664299] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-26T19:38:27.731475] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-26T19:38:27.911735] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-09-26T19:38:28.449763] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-26T19:38:28.711721] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-09-26T19:38:29.511746] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-09-26T19:38:30.077415] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-26T19:38:30.311714] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-09-26T19:38:30.382320] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-26T19:38:31.111728] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-09-26T19:38:31.911715] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-09-26T19:38:32.054622] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-26T19:38:32.064576] [INFO ] [REMOTE ] KEX: Full fetch complete (55668 records). [2025-09-26T19:38:32.064773] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-09-26T19:38:32.547054] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-09-26T19:38:32.547215] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-09-26T19:38:32.548156] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-09-26T19:38:32.548277] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-09-26T19:38:32.560005] [DEBUG] [LOCAL ] KEX: Trimmed 55668 records to 38712 (keeping 200 days of data) [2025-09-26T19:38:32.577314] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-26T19:38:32.757940] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-09-26T19:38:32.825870] [DEBUG] [LOCAL ] KEX: Primary data saved (38712 records). [2025-09-26T19:38:32.826026] [INFO ] [MAIN ] KEX: Full history saved. [2025-09-26T19:38:32.826116] [INFO ] [MAIN ] Update Progress: 1185/2371 symbols completed. KEX took 35.0s. Estimated remaining: 2h 38m 38s. Rate: 7.5 symbols/min [2025-09-26T19:38:33.011196] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:38:33.031262] [DEBUG] [LOCAL ] KFRC: Loaded 19601 existing records from primary storage. [2025-09-26T19:38:33.031407] [INFO ] [MAIN ] KFRC: Loaded 19601 existing records. [2025-09-26T19:38:33.228034] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:38:33.228305] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-09-26T19:38:33.228355] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-09-26T19:38:33.229097] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-09-26T19:38:33.229162] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-09-26T19:38:33.521592] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-09-26T19:38:33.621180] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:38:33.982067] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-26T19:38:34.143833] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-26T19:38:34.314040] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-09-26T19:38:34.316887] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-26T19:38:35.111750] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-09-26T19:38:35.740622] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-26T19:38:35.911703] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-09-26T19:38:36.301378] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-26T19:38:36.711714] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2024-12. [2025-09-26T19:38:37.500228] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-26T19:38:37.511674] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-09-26T19:38:37.621775] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-26T19:38:38.311718] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-09-26T19:38:38.762970] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-26T19:38:39.111695] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-09-26T19:38:39.538242] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-26T19:38:39.553534] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-26T19:38:39.555260] [INFO ] [REMOTE ] KEY: Full fetch complete (77256 records). [2025-09-26T19:38:39.555392] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-09-26T19:38:39.757831] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-26T19:38:39.758673] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:38:39.758760] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:38:39.758823] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-26T19:38:39.758980] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-26T19:38:39.759025] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-09-26T19:38:39.759069] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-09-26T19:38:39.759164] [INFO ] [MAIN ] Update Progress: 1186/2371 symbols completed. KEY took 35.7s. Estimated remaining: 2h 38m 29s. Rate: 7.5 symbols/min [2025-09-26T19:38:39.920411] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-09-26T19:38:39.944780] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:38:39.955862] [DEBUG] [LOCAL ] KFS: Loaded 8422 existing records from primary storage. [2025-09-26T19:38:39.956466] [INFO ] [MAIN ] KFS: Loaded 8422 existing records. [2025-09-26T19:38:40.141682] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:38:40.141983] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-09-26T19:38:40.142038] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-09-26T19:38:40.142610] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-09-26T19:38:40.142718] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-09-26T19:38:40.507802] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:38:40.711752] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-09-26T19:38:41.231605] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-26T19:38:41.232598] [INFO ] [REMOTE ] KF: Full fetch complete (3680 records). [2025-09-26T19:38:41.232696] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-09-26T19:38:41.529913] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-09-26T19:38:41.635553] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-09-26T19:38:41.635695] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-09-26T19:38:41.635872] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-09-26T19:38:41.636034] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-09-26T19:38:41.636630] [DEBUG] [LOCAL ] KF: Trimmed 3680 records to 2486 (keeping 200 days of data) [2025-09-26T19:38:41.652354] [DEBUG] [LOCAL ] KF: Primary data saved (2486 records). [2025-09-26T19:38:41.652445] [INFO ] [MAIN ] KF: Full history saved. [2025-09-26T19:38:41.652556] [INFO ] [MAIN ] Update Progress: 1187/2371 symbols completed. KF took 23.1s. Estimated remaining: 2h 38m 15s. Rate: 7.5 symbols/min [2025-09-26T19:38:41.844419] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:38:41.870317] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-26T19:38:41.879632] [INFO ] [REMOTE ] KEYS: Full fetch complete (62974 records). [2025-09-26T19:38:41.879803] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-09-26T19:38:42.099349] [DEBUG] [LOCAL ] KFY: Loaded 30872 existing records from primary storage. [2025-09-26T19:38:42.120083] [INFO ] [MAIN ] KFY: Loaded 30872 existing records. [2025-09-26T19:38:42.313316] [INFO ] [REMOTE ] KFS: Fetching primary data for 2024-12. [2025-09-26T19:38:42.517419] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-09-26T19:38:42.527681] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-09-26T19:38:42.548454] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-09-26T19:38:42.555311] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-09-26T19:38:42.555122] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:38:42.555957] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-09-26T19:38:42.556041] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-09-26T19:38:42.557760] [DEBUG] [LOCAL ] KEYS: Trimmed 62974 records to 43955 (keeping 200 days of data) [2025-09-26T19:38:42.557957] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-09-26T19:38:42.558802] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-09-26T19:38:42.816381] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-26T19:38:43.034259] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-26T19:38:43.115922] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-09-26T19:38:43.292185] [DEBUG] [LOCAL ] KEYS: Primary data saved (43955 records). [2025-09-26T19:38:43.290355] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:38:43.292453] [INFO ] [MAIN ] KEYS: Full history saved. [2025-09-26T19:38:43.292941] [INFO ] [MAIN ] Update Progress: 1188/2371 symbols completed. KEYS took 37.4s. Estimated remaining: 2h 38m 0s. Rate: 7.5 symbols/min [2025-09-26T19:38:43.477146] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:38:43.536040] [DEBUG] [LOCAL ] KGC: Loaded 54089 existing records from primary storage. [2025-09-26T19:38:43.536227] [INFO ] [MAIN ] KGC: Loaded 54089 existing records. [2025-09-26T19:38:43.724363] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:38:43.724698] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-09-26T19:38:43.724755] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-09-26T19:38:43.726280] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-09-26T19:38:43.726342] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-09-26T19:38:43.924014] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-09-26T19:38:44.143215] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:38:44.155246] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-26T19:38:44.666226] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-26T19:38:44.711685] [INFO ] [REMOTE ] KGC: Fetching primary data for 2024-12. [2025-09-26T19:38:45.511758] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-09-26T19:38:46.311772] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-09-26T19:38:46.436348] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-26T19:38:46.538901] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-26T19:38:46.880229] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-26T19:38:47.111717] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-09-26T19:38:47.911752] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-09-26T19:38:48.179970] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-26T19:38:48.711741] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-09-26T19:38:49.511713] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-09-26T19:38:49.602980] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-26T19:38:49.628815] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-26T19:38:50.124453] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-26T19:38:50.311768] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-09-26T19:38:51.059316] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-26T19:38:51.111777] [INFO ] [REMOTE ] KFY: Fetching primary data for 2024-12. [2025-09-26T19:38:51.911758] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-09-26T19:38:52.492812] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-26T19:38:52.632233] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-26T19:38:52.711776] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-09-26T19:38:53.511730] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-09-26T19:38:54.311736] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-09-26T19:38:54.669984] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-26T19:38:54.724253] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-26T19:38:54.875106] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-26T19:38:55.111723] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-09-26T19:38:55.911692] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-09-26T19:38:56.064922] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-26T19:38:56.706262] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-26T19:38:56.711661] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-09-26T19:38:57.468623] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-26T19:38:57.511713] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-09-26T19:38:58.311718] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-09-26T19:38:59.111762] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-09-26T19:38:59.223219] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-26T19:38:59.225768] [INFO ] [REMOTE ] KFS: Full fetch complete (10544 records). [2025-09-26T19:38:59.225839] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-09-26T19:38:59.634835] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-09-26T19:38:59.635012] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-09-26T19:38:59.635413] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-09-26T19:38:59.635499] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-09-26T19:38:59.677568] [DEBUG] [LOCAL ] KFS: Trimmed 10544 records to 8471 (keeping 200 days of data) [2025-09-26T19:38:59.683907] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-26T19:38:59.749571] [DEBUG] [LOCAL ] KFS: Primary data saved (8471 records). [2025-09-26T19:38:59.749756] [INFO ] [MAIN ] KFS: Full history saved. [2025-09-26T19:38:59.749881] [INFO ] [MAIN ] Update Progress: 1189/2371 symbols completed. KFS took 20.0s. Estimated remaining: 2h 38m 1s. Rate: 7.5 symbols/min [2025-09-26T19:38:59.915936] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-09-26T19:38:59.942879] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:38:59.962857] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-26T19:39:00.014916] [DEBUG] [LOCAL ] KGS: Loaded 46108 existing records from primary storage. [2025-09-26T19:39:00.015123] [INFO ] [MAIN ] KGS: Loaded 46108 existing records. [2025-09-26T19:39:00.213024] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:39:00.213329] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-09-26T19:39:00.213379] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-09-26T19:39:00.214731] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-09-26T19:39:00.214794] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-09-26T19:39:00.608741] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:39:00.711722] [INFO ] [REMOTE ] KGS: Fetching primary data for 2024-12. [2025-09-26T19:39:01.321531] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-26T19:39:01.511807] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-09-26T19:39:02.311721] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-09-26T19:39:02.419715] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-26T19:39:03.111682] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-09-26T19:39:03.526547] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-26T19:39:03.630272] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-26T19:39:03.911721] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-09-26T19:39:04.711722] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-09-26T19:39:04.866392] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-26T19:39:05.310580] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-26T19:39:05.316382] [INFO ] [REMOTE ] KFRC: Full fetch complete (25430 records). [2025-09-26T19:39:05.316607] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-09-26T19:39:05.516839] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-09-26T19:39:05.735370] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-09-26T19:39:05.735452] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-09-26T19:39:05.736102] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-09-26T19:39:05.736167] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-09-26T19:39:05.736920] [DEBUG] [LOCAL ] KFRC: Trimmed 25430 records to 19766 (keeping 200 days of data) [2025-09-26T19:39:05.861572] [DEBUG] [LOCAL ] KFRC: Primary data saved (19766 records). [2025-09-26T19:39:05.861748] [INFO ] [MAIN ] KFRC: Full history saved. [2025-09-26T19:39:05.861843] [INFO ] [MAIN ] Update Progress: 1190/2371 symbols completed. KFRC took 33.0s. Estimated remaining: 2h 37m 51s. Rate: 7.5 symbols/min [2025-09-26T19:39:06.036272] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:39:06.087047] [DEBUG] [LOCAL ] KIM: Loaded 53446 existing records from primary storage. [2025-09-26T19:39:06.087208] [INFO ] [MAIN ] KIM: Loaded 53446 existing records. [2025-09-26T19:39:06.276256] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:39:06.276506] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-09-26T19:39:06.276555] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-09-26T19:39:06.278093] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-09-26T19:39:06.278156] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-09-26T19:39:06.324788] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-09-26T19:39:06.672473] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:39:06.815045] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-26T19:39:07.111738] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-09-26T19:39:07.228618] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-26T19:39:07.710161] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-26T19:39:07.911752] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-09-26T19:39:08.711731] [INFO ] [REMOTE ] KIM: Fetching primary data for 2024-12. [2025-09-26T19:39:09.046962] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-26T19:39:09.204100] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-26T19:39:09.511740] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-09-26T19:39:10.206869] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-26T19:39:10.311725] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-09-26T19:39:10.744905] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-26T19:39:11.111721] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-09-26T19:39:11.911726] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-09-26T19:39:12.016639] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-26T19:39:12.624886] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-26T19:39:12.711708] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-09-26T19:39:13.511702] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-09-26T19:39:13.929681] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-26T19:39:13.963613] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-26T19:39:14.311737] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-09-26T19:39:15.108021] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-26T19:39:15.116991] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-09-26T19:39:15.174620] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-26T19:39:15.911754] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-09-26T19:39:16.711776] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-09-26T19:39:17.283871] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-26T19:39:17.511753] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-09-26T19:39:17.568837] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-26T19:39:18.311771] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-09-26T19:39:18.410806] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-26T19:39:18.745927] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-26T19:39:18.757592] [INFO ] [REMOTE ] KFY: Full fetch complete (43666 records). [2025-09-26T19:39:18.757976] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-09-26T19:39:19.117091] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-09-26T19:39:19.351424] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-09-26T19:39:19.351565] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-09-26T19:39:19.353684] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-09-26T19:39:19.353810] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-09-26T19:39:19.355487] [DEBUG] [LOCAL ] KFY: Trimmed 43666 records to 31057 (keeping 200 days of data) [2025-09-26T19:39:19.626664] [DEBUG] [LOCAL ] KFY: Primary data saved (31057 records). [2025-09-26T19:39:19.626839] [INFO ] [MAIN ] KFY: Full history saved. [2025-09-26T19:39:19.627007] [INFO ] [MAIN ] Update Progress: 1191/2371 symbols completed. KFY took 38.0s. Estimated remaining: 2h 37m 48s. Rate: 7.5 symbols/min [2025-09-26T19:39:19.860307] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:39:19.893983] [DEBUG] [LOCAL ] KIO: Loaded 21449 existing records from primary storage. [2025-09-26T19:39:19.894162] [INFO ] [MAIN ] KIO: Loaded 21449 existing records. [2025-09-26T19:39:19.933464] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-09-26T19:39:20.105904] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:39:20.106197] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-09-26T19:39:20.106277] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-09-26T19:39:20.107061] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-09-26T19:39:20.107136] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-09-26T19:39:20.520300] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:39:20.657693] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-26T19:39:20.701609] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-09-26T19:39:20.711685] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-09-26T19:39:20.714246] [INFO ] [REMOTE ] KGC: Full fetch complete (77695 records). [2025-09-26T19:39:20.714367] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-09-26T19:39:21.125704] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-09-26T19:39:21.125819] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-09-26T19:39:21.126987] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-09-26T19:39:21.127066] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-09-26T19:39:21.129019] [DEBUG] [LOCAL ] KGC: Trimmed 77695 records to 54479 (keeping 200 days of data) [2025-09-26T19:39:21.479829] [DEBUG] [LOCAL ] KGC: Primary data saved (54479 records). [2025-09-26T19:39:21.479981] [INFO ] [MAIN ] KGC: Full history saved. [2025-09-26T19:39:21.480083] [INFO ] [MAIN ] Update Progress: 1192/2371 symbols completed. KGC took 38.2s. Estimated remaining: 2h 37m 34s. Rate: 7.5 symbols/min [2025-09-26T19:39:21.516744] [INFO ] [REMOTE ] KIO: Fetching primary data for 2024-12. [2025-09-26T19:39:21.678569] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:39:21.746957] [DEBUG] [LOCAL ] KKR: Loaded 53891 existing records from primary storage. [2025-09-26T19:39:21.747265] [INFO ] [MAIN ] KKR: Loaded 53891 existing records. [2025-09-26T19:39:21.901169] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-26T19:39:21.981944] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:39:21.982532] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-09-26T19:39:21.982591] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-09-26T19:39:21.984139] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-09-26T19:39:21.984202] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-09-26T19:39:22.315871] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-09-26T19:39:22.365196] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:39:22.393208] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-26T19:39:22.735164] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-26T19:39:23.111733] [INFO ] [REMOTE ] KKR: Fetching primary data for 2024-12. [2025-09-26T19:39:23.911773] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-09-26T19:39:24.285905] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-26T19:39:24.711755] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-09-26T19:39:24.985602] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-26T19:39:25.063483] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-26T19:39:25.511788] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-09-26T19:39:26.332466] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-09-26T19:39:26.338964] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-26T19:39:26.704339] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-26T19:39:27.111732] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-09-26T19:39:27.911707] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-09-26T19:39:28.212339] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-26T19:39:28.696487] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-26T19:39:28.711691] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-09-26T19:39:29.509212] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-26T19:39:29.519848] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-09-26T19:39:30.311743] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-09-26T19:39:30.566037] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-26T19:39:30.576469] [INFO ] [REMOTE ] KGS: Full fetch complete (66134 records). [2025-09-26T19:39:30.576711] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-09-26T19:39:30.867435] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-26T19:39:31.005021] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-09-26T19:39:31.005127] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-09-26T19:39:31.006220] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-09-26T19:39:31.006290] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-09-26T19:39:31.008237] [DEBUG] [LOCAL ] KGS: Trimmed 66134 records to 46487 (keeping 200 days of data) [2025-09-26T19:39:31.114680] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-09-26T19:39:31.308939] [DEBUG] [LOCAL ] KGS: Primary data saved (46487 records). [2025-09-26T19:39:31.309254] [INFO ] [MAIN ] KGS: Full history saved. [2025-09-26T19:39:31.309399] [INFO ] [MAIN ] Update Progress: 1193/2371 symbols completed. KGS took 31.6s. Estimated remaining: 2h 37m 28s. Rate: 7.5 symbols/min [2025-09-26T19:39:31.484183] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:39:31.494539] [DEBUG] [LOCAL ] KKRS: Loaded 5781 existing records from primary storage. [2025-09-26T19:39:31.494750] [INFO ] [MAIN ] KKRS: Loaded 5781 existing records. [2025-09-26T19:39:31.686192] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:39:31.686563] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-09-26T19:39:31.686616] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-09-26T19:39:31.687163] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-09-26T19:39:31.687241] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-09-26T19:39:31.924736] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-09-26T19:39:32.133751] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:39:32.185398] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-26T19:39:32.711737] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-09-26T19:39:32.965979] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-26T19:39:33.057753] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-26T19:39:33.511800] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2024-12. [2025-09-26T19:39:34.311717] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-09-26T19:39:34.369196] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-26T19:39:34.406633] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-26T19:39:35.111747] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-09-26T19:39:35.356722] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-26T19:39:35.693757] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-26T19:39:35.911732] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-09-26T19:39:36.711752] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-09-26T19:39:37.374885] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-26T19:39:37.511761] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-09-26T19:39:37.892847] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-26T19:39:38.311736] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-09-26T19:39:38.348766] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-26T19:39:39.111716] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-09-26T19:39:39.719775] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-26T19:39:39.911701] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-09-26T19:39:40.228801] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-26T19:39:40.711726] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-09-26T19:39:41.511727] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-09-26T19:39:41.944320] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-26T19:39:42.216110] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-26T19:39:42.311712] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-09-26T19:39:42.933706] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-26T19:39:43.111726] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-09-26T19:39:43.586406] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-26T19:39:43.821082] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-26T19:39:43.911726] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-09-26T19:39:44.711757] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-09-26T19:39:44.930174] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-26T19:39:45.511725] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-09-26T19:39:46.311742] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-09-26T19:39:46.735177] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-26T19:39:46.745559] [INFO ] [REMOTE ] KIM: Full fetch complete (76822 records). [2025-09-26T19:39:46.745842] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-09-26T19:39:46.890197] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-26T19:39:46.928801] [INFO ] [REMOTE ] KIO: Full fetch complete (30935 records). [2025-09-26T19:39:47.020283] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-09-26T19:39:47.087840] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-26T19:39:47.125317] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-09-26T19:39:47.397909] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-09-26T19:39:47.422824] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-09-26T19:39:47.446511] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-09-26T19:39:47.451859] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-09-26T19:39:47.571608] [DEBUG] [LOCAL ] KIM: Trimmed 76822 records to 53831 (keeping 200 days of data) [2025-09-26T19:39:47.754229] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-09-26T19:39:47.754903] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-09-26T19:39:47.755540] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-09-26T19:39:47.755619] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-09-26T19:39:47.759051] [DEBUG] [LOCAL ] KIO: Trimmed 30935 records to 21625 (keeping 200 days of data) [2025-09-26T19:39:47.910441] [DEBUG] [LOCAL ] KIO: Primary data saved (21625 records). [2025-09-26T19:39:47.910929] [INFO ] [MAIN ] KIO: Full history saved. [2025-09-26T19:39:47.911437] [INFO ] [MAIN ] Update Progress: 1194/2371 symbols completed. KIO took 28.3s. Estimated remaining: 2h 37m 28s. Rate: 7.5 symbols/min [2025-09-26T19:39:47.912185] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-09-26T19:39:48.227825] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:39:48.229023] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-09-26T19:39:48.229373] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-09-26T19:39:48.230911] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-09-26T19:39:48.231220] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-26T19:39:48.232412] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-26T19:39:48.233001] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-09-26T19:39:48.570048] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-26T19:39:48.674393] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:39:48.716084] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-09-26T19:39:48.770213] [DEBUG] [LOCAL ] KIM: Primary data saved (53831 records). [2025-09-26T19:39:48.770387] [INFO ] [MAIN ] KIM: Full history saved. [2025-09-26T19:39:48.770519] [INFO ] [MAIN ] Update Progress: 1195/2371 symbols completed. KIM took 42.9s. Estimated remaining: 2h 37m 13s. Rate: 7.5 symbols/min [2025-09-26T19:39:48.951061] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:39:48.951272] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-09-26T19:39:48.951330] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-09-26T19:39:48.951476] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-09-26T19:39:48.951520] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-26T19:39:48.951566] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-26T19:39:48.951623] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-09-26T19:39:49.254714] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-26T19:39:49.365367] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:39:49.395398] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-09-26T19:39:49.511720] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-09-26T19:39:50.231159] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-26T19:39:50.232626] [INFO ] [REMOTE ] KKRS: Full fetch complete (8008 records). [2025-09-26T19:39:50.232763] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-09-26T19:39:50.316936] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-09-26T19:39:50.582937] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:39:50.612881] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-09-26T19:39:50.646878] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-09-26T19:39:50.646998] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-09-26T19:39:50.647215] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-09-26T19:39:50.647255] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-09-26T19:39:50.648201] [DEBUG] [LOCAL ] KKRS: Trimmed 8008 records to 5801 (keeping 200 days of data) [2025-09-26T19:39:50.691087] [DEBUG] [LOCAL ] KKRS: Primary data saved (5801 records). [2025-09-26T19:39:50.691216] [INFO ] [MAIN ] KKRS: Full history saved. [2025-09-26T19:39:50.691303] [INFO ] [MAIN ] Update Progress: 1196/2371 symbols completed. KKRS took 19.4s. Estimated remaining: 2h 36m 59s. Rate: 7.5 symbols/min [2025-09-26T19:39:50.868326] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:39:50.921135] [DEBUG] [LOCAL ] KLC: Loaded 36807 existing records from primary storage. [2025-09-26T19:39:50.921279] [INFO ] [MAIN ] KLC: Loaded 36807 existing records. [2025-09-26T19:39:51.113593] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-01. [2025-09-26T19:39:51.118992] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:39:51.119268] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-09-26T19:39:51.119332] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-09-26T19:39:51.120411] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-09-26T19:39:51.120477] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-09-26T19:39:51.413239] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:39:51.416613] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-01 [2025-09-26T19:39:51.494088] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:39:51.911742] [INFO ] [REMOTE ] KLC: Fetching primary data for 2024-12. [2025-09-26T19:39:52.711729] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-09-26T19:39:53.511690] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-09-26T19:39:53.549449] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-26T19:39:53.719618] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:39:53.720041] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-09-26T19:39:54.321201] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-09-26T19:39:54.328339] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-26T19:39:55.111718] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-02. [2025-09-26T19:39:55.345806] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:39:55.346164] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-02 [2025-09-26T19:39:55.648031] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-26T19:39:55.911736] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-09-26T19:39:56.711685] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-09-26T19:39:57.082705] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-26T19:39:57.511747] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-01. [2025-09-26T19:39:57.713090] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:39:57.713443] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-01 [2025-09-26T19:39:58.311720] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-02. [2025-09-26T19:39:58.538311] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:39:58.538698] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-02 [2025-09-26T19:39:58.601488] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-26T19:39:59.111729] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-09-26T19:39:59.911733] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-09-26T19:40:00.711722] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-03. [2025-09-26T19:40:00.996253] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:40:00.996596] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-03 [2025-09-26T19:40:01.262807] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-26T19:40:01.274248] [INFO ] [REMOTE ] KKR: Full fetch complete (77442 records). [2025-09-26T19:40:01.274418] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-09-26T19:40:01.525719] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-04. [2025-09-26T19:40:01.766031] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-26T19:40:01.766314] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-09-26T19:40:01.776069] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-09-26T19:40:01.777824] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-09-26T19:40:01.777940] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-09-26T19:40:01.779956] [DEBUG] [LOCAL ] KKR: Trimmed 77442 records to 54281 (keeping 200 days of data) [2025-09-26T19:40:01.793834] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:40:01.794176] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-04 [2025-09-26T19:40:02.169514] [DEBUG] [LOCAL ] KKR: Primary data saved (54281 records). [2025-09-26T19:40:02.169716] [INFO ] [MAIN ] KKR: Full history saved. [2025-09-26T19:40:02.171823] [INFO ] [MAIN ] Update Progress: 1197/2371 symbols completed. KKR took 40.7s. Estimated remaining: 2h 36m 55s. Rate: 7.5 symbols/min [2025-09-26T19:40:02.311751] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-09-26T19:40:03.111720] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-03. [2025-09-26T19:40:03.339819] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:40:03.340159] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-03 [2025-09-26T19:40:03.902133] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-26T19:40:03.911679] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-05. [2025-09-26T19:40:04.145991] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:40:04.146404] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-05 [2025-09-26T19:40:04.711720] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-09-26T19:40:05.511759] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-04. [2025-09-26T19:40:05.718603] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:40:05.719051] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-04 [2025-09-26T19:40:06.311706] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-05. [2025-09-26T19:40:06.342508] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-26T19:40:06.801778] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-26T19:40:07.111725] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-06. [2025-09-26T19:40:07.318034] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:40:07.318469] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-06 [2025-09-26T19:40:07.911740] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-06. [2025-09-26T19:40:08.711712] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-09-26T19:40:09.135541] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-26T19:40:09.511742] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-07. [2025-09-26T19:40:09.708705] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:40:09.709054] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-07 [2025-09-26T19:40:10.005302] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-26T19:40:10.311735] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-07. [2025-09-26T19:40:11.111754] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-08. [2025-09-26T19:40:11.139586] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-26T19:40:11.315747] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:40:11.316157] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-08 [2025-09-26T19:40:11.911749] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-08. [2025-09-26T19:40:12.707846] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-26T19:40:12.711988] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-09. [2025-09-26T19:40:13.511729] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-09-26T19:40:14.311712] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-09. [2025-09-26T19:40:14.705119] [INFO ] [REMOTE ] KLAR: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-26T19:40:14.712538] [INFO ] [REMOTE ] KLAR: Full fetch complete (4802 records). [2025-09-26T19:40:14.712726] [DEBUG] [VALIDATOR ] KLAR: Validating primary data. [2025-09-26T19:40:14.919841] [WARN ] [VALIDATOR ] KLAR: Validation failed - insufficient historical data. Have 13 unique days, need 200 days [2025-09-26T19:40:14.920241] [FATAL] [MAIN ] KLAR: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:40:14.920334] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:40:14.920411] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-26T19:40:14.920703] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-26T19:40:14.920761] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-09-26T19:40:14.928138] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-09-26T19:40:14.941599] [INFO ] [MAIN ] Update Progress: 1198/2371 symbols completed. KLAR took 26.2s. Estimated remaining: 2h 36m 51s. Rate: 7.5 symbols/min [2025-09-26T19:40:14.943620] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-26T19:40:15.111725] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-09-26T19:40:15.354749] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-26T19:40:15.357332] [INFO ] [REMOTE ] KKRT: Full fetch complete (8662 records). [2025-09-26T19:40:15.357529] [DEBUG] [VALIDATOR ] KKRT: Validating primary data. [2025-09-26T19:40:15.547035] [WARN ] [VALIDATOR ] KKRT: Validation failed - insufficient historical data. Have 83 unique days, need 200 days [2025-09-26T19:40:15.547321] [FATAL] [MAIN ] KKRT: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:40:15.547393] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:40:15.547466] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-26T19:40:15.547535] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-26T19:40:15.547579] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-09-26T19:40:15.547690] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-09-26T19:40:15.547778] [INFO ] [MAIN ] Update Progress: 1199/2371 symbols completed. KKRT took 27.6s. Estimated remaining: 2h 36m 36s. Rate: 7.5 symbols/min [2025-09-26T19:40:16.703976] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-26T19:40:16.712954] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-09-26T19:40:19.599800] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (2.89 seconds). [2025-09-26T19:40:19.607483] [INFO ] [REMOTE ] KLC: Full fetch complete (50788 records). [2025-09-26T19:40:19.607598] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-09-26T19:40:20.026596] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-09-26T19:40:20.026726] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-09-26T19:40:20.027832] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-09-26T19:40:20.027906] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-09-26T19:40:20.029301] [DEBUG] [LOCAL ] KLC: Trimmed 50788 records to 37107 (keeping 200 days of data) [2025-09-26T19:40:20.263063] [DEBUG] [LOCAL ] KLC: Primary data saved (37107 records). [2025-09-26T19:40:20.263245] [INFO ] [MAIN ] KLC: Full history saved. [2025-09-26T19:40:20.263349] [INFO ] [MAIN ] Update Progress: 1200/2371 symbols completed. KLC took 29.6s. Estimated remaining: 2h 36m 25s. Rate: 7.5 symbols/min [2025-09-26T19:40:20.830685] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:40:21.000739] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:40:21.031994] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:40:21.051337] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:40:21.060000] [DEBUG] [LOCAL ] KMPB: Loaded 3623 existing records from primary storage. [2025-09-26T19:40:21.060306] [INFO ] [MAIN ] KMPB: Loaded 3623 existing records. [2025-09-26T19:40:21.321830] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:40:21.321993] [DEBUG] [LOCAL ] KMPR: Loaded 38785 existing records from primary storage. [2025-09-26T19:40:21.349480] [DEBUG] [LOCAL ] KMT: Loaded 43390 existing records from primary storage. [2025-09-26T19:40:21.348857] [INFO ] [MAIN ] KMPR: Loaded 38785 existing records. [2025-09-26T19:40:21.350279] [INFO ] [MAIN ] KMT: Loaded 43390 existing records. [2025-09-26T19:40:21.350131] [DEBUG] [LOCAL ] KMI: Loaded 54083 existing records from primary storage. [2025-09-26T19:40:21.355754] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-09-26T19:40:21.398550] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-09-26T19:40:21.416530] [INFO ] [MAIN ] KMI: Loaded 54083 existing records. [2025-09-26T19:40:21.448742] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-09-26T19:40:21.448888] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-09-26T19:40:22.060374] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:40:22.115234] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:40:22.147941] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-09-26T19:40:22.206282] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:40:22.213924] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-09-26T19:40:22.195890] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-09-26T19:40:22.225934] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-09-26T19:40:22.236344] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-09-26T19:40:22.233773] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-09-26T19:40:22.272172] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-09-26T19:40:22.272334] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-09-26T19:40:22.272085] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-09-26T19:40:22.307797] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-09-26T19:40:22.313176] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-09-26T19:40:22.471210] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-09-26T19:40:22.824154] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:40:22.908067] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2024-12. [2025-09-26T19:40:23.507031] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:40:23.531817] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2024-12. [2025-09-26T19:40:23.584685] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:40:23.595859] [INFO ] [REMOTE ] KMI: Fetching primary data for 2024-12. [2025-09-26T19:40:23.659707] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:40:23.660303] [INFO ] [REMOTE ] KMT: Fetching primary data for 2024-12. [2025-09-26T19:40:23.795945] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-26T19:40:23.797453] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-09-26T19:40:24.268480] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-26T19:40:24.269898] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-09-26T19:40:24.720010] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-26T19:40:24.721470] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-09-26T19:40:25.002156] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-26T19:40:25.008406] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-09-26T19:40:25.186506] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-26T19:40:25.200186] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-09-26T19:40:25.304722] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-26T19:40:25.306534] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-09-26T19:40:25.653352] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-26T19:40:25.671278] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-09-26T19:40:25.854485] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-26T19:40:25.855957] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-09-26T19:40:26.164539] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-26T19:40:26.216577] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-26T19:40:26.311733] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-09-26T19:40:26.783807] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-26T19:40:26.888934] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-26T19:40:27.111730] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-09-26T19:40:27.581070] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-26T19:40:27.911728] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-09-26T19:40:28.377996] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-26T19:40:28.717672] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-09-26T19:40:28.734704] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-26T19:40:29.511775] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-09-26T19:40:30.001907] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-26T19:40:30.311721] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-09-26T19:40:31.111730] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-09-26T19:40:31.335317] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-26T19:40:31.526371] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-26T19:40:31.709373] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-26T19:40:31.911745] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-09-26T19:40:32.538103] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-26T19:40:32.539514] [INFO ] [REMOTE ] KMPB: Full fetch complete (4939 records). [2025-09-26T19:40:32.539589] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-09-26T19:40:32.723286] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-09-26T19:40:32.963198] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-09-26T19:40:32.963333] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-09-26T19:40:32.963509] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-09-26T19:40:32.963550] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-09-26T19:40:32.963962] [DEBUG] [LOCAL ] KMPB: Trimmed 4939 records to 3646 (keeping 200 days of data) [2025-09-26T19:40:32.986859] [DEBUG] [LOCAL ] KMPB: Primary data saved (3646 records). [2025-09-26T19:40:32.986967] [INFO ] [MAIN ] KMPB: Full history saved. [2025-09-26T19:40:32.987064] [INFO ] [MAIN ] Update Progress: 1201/2371 symbols completed. KMPB took 12.7s. Estimated remaining: 2h 36m 21s. Rate: 7.5 symbols/min [2025-09-26T19:40:33.166343] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:40:33.221581] [DEBUG] [LOCAL ] KMX: Loaded 53507 existing records from primary storage. [2025-09-26T19:40:33.221760] [INFO ] [MAIN ] KMX: Loaded 53507 existing records. [2025-09-26T19:40:33.407501] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:40:33.407784] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-09-26T19:40:33.407836] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-09-26T19:40:33.409320] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-09-26T19:40:33.409389] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-09-26T19:40:33.517134] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-09-26T19:40:33.793153] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:40:34.311717] [INFO ] [REMOTE ] KMX: Fetching primary data for 2024-12. [2025-09-26T19:40:34.603011] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-26T19:40:35.111721] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-09-26T19:40:35.190914] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-26T19:40:35.911694] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-09-26T19:40:36.078466] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-26T19:40:36.711719] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-09-26T19:40:36.759424] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-26T19:40:37.176208] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-26T19:40:37.511775] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-09-26T19:40:38.311725] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-09-26T19:40:38.369927] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-26T19:40:38.998783] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T19:40:39.111768] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-09-26T19:40:39.723461] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-26T19:40:39.911737] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-09-26T19:40:40.711715] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-09-26T19:40:40.972104] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-26T19:40:41.275034] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-26T19:40:41.511725] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-09-26T19:40:42.067473] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-26T19:40:42.311717] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-09-26T19:40:43.111716] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-09-26T19:40:43.261599] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-26T19:40:43.911716] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-09-26T19:40:43.992414] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-26T19:40:44.476801] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-26T19:40:44.711755] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-09-26T19:40:45.511746] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-09-26T19:40:46.068036] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-26T19:40:46.311725] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-09-26T19:40:46.676542] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-26T19:40:47.016880] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-26T19:40:47.111742] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-09-26T19:40:47.810804] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-26T19:40:47.911743] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-09-26T19:40:48.711735] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-09-26T19:40:48.780919] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-26T19:40:49.511692] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-09-26T19:40:49.958590] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-26T19:40:50.029312] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-26T19:40:50.311753] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-09-26T19:40:51.010577] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-26T19:40:51.111758] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-09-26T19:40:51.911691] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-09-26T19:40:52.400605] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-26T19:40:52.411690] [INFO ] [REMOTE ] KMI: Full fetch complete (77764 records). [2025-09-26T19:40:52.411957] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-09-26T19:40:52.716311] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-09-26T19:40:52.877223] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-09-26T19:40:52.877618] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-09-26T19:40:52.879515] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-09-26T19:40:52.881460] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-09-26T19:40:52.881334] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-26T19:40:52.894613] [DEBUG] [LOCAL ] KMI: Trimmed 77764 records to 54473 (keeping 200 days of data) [2025-09-26T19:40:53.266797] [DEBUG] [LOCAL ] KMI: Primary data saved (54473 records). [2025-09-26T19:40:53.267094] [INFO ] [MAIN ] KMI: Full history saved. [2025-09-26T19:40:53.267291] [INFO ] [MAIN ] Update Progress: 1202/2371 symbols completed. KMI took 33.0s. Estimated remaining: 2h 36m 25s. Rate: 7.5 symbols/min [2025-09-26T19:40:53.456799] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:40:53.500038] [DEBUG] [LOCAL ] KN: Loaded 39156 existing records from primary storage. [2025-09-26T19:40:53.500217] [INFO ] [MAIN ] KN: Loaded 39156 existing records. [2025-09-26T19:40:53.532528] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-09-26T19:40:53.726013] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:40:53.726595] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-09-26T19:40:53.726807] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-09-26T19:40:53.728083] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-09-26T19:40:53.728313] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-09-26T19:40:53.919769] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-26T19:40:54.313323] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-09-26T19:40:54.424057] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:40:54.451178] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-26T19:40:54.460386] [INFO ] [REMOTE ] KMT: Full fetch complete (62054 records). [2025-09-26T19:40:54.460598] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-09-26T19:40:54.862172] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-09-26T19:40:54.862284] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-09-26T19:40:54.863347] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-09-26T19:40:54.863435] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-09-26T19:40:54.865397] [DEBUG] [LOCAL ] KMT: Trimmed 62054 records to 43687 (keeping 200 days of data) [2025-09-26T19:40:55.113697] [INFO ] [REMOTE ] KN: Fetching primary data for 2024-12. [2025-09-26T19:40:55.162222] [DEBUG] [LOCAL ] KMT: Primary data saved (43687 records). [2025-09-26T19:40:55.162389] [INFO ] [MAIN ] KMT: Full history saved. [2025-09-26T19:40:55.162499] [INFO ] [MAIN ] Update Progress: 1203/2371 symbols completed. KMT took 34.9s. Estimated remaining: 2h 36m 11s. Rate: 7.5 symbols/min [2025-09-26T19:40:55.365999] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:40:55.398927] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-26T19:40:55.408745] [INFO ] [REMOTE ] KMPR: Full fetch complete (51000 records). [2025-09-26T19:40:55.408862] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-09-26T19:40:55.566492] [DEBUG] [LOCAL ] KNF: Loaded 36152 existing records from primary storage. [2025-09-26T19:40:55.576972] [INFO ] [MAIN ] KNF: Loaded 36152 existing records. [2025-09-26T19:40:56.061977] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:40:56.079977] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-09-26T19:40:56.080338] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-09-26T19:40:56.080569] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-09-26T19:40:56.080625] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-09-26T19:40:56.082215] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-09-26T19:40:56.082306] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-09-26T19:40:56.082786] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-09-26T19:40:56.083296] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-09-26T19:40:56.167938] [DEBUG] [LOCAL ] KMPR: Trimmed 51000 records to 39117 (keeping 200 days of data) [2025-09-26T19:40:56.827320] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-09-26T19:40:56.855440] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:40:56.875706] [INFO ] [REMOTE ] KNF: Fetching primary data for 2024-12. [2025-09-26T19:40:56.889092] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-09-26T19:40:56.921278] [DEBUG] [LOCAL ] KMPR: Primary data saved (39117 records). [2025-09-26T19:40:56.923468] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-26T19:40:56.922320] [INFO ] [MAIN ] KMPR: Full history saved. [2025-09-26T19:40:56.933074] [INFO ] [MAIN ] Update Progress: 1204/2371 symbols completed. KMPR took 36.7s. Estimated remaining: 2h 35m 57s. Rate: 7.5 symbols/min [2025-09-26T19:40:57.115185] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:40:57.126006] [DEBUG] [LOCAL ] KNOP: Loaded 10121 existing records from primary storage. [2025-09-26T19:40:57.126111] [INFO ] [MAIN ] KNOP: Loaded 10121 existing records. [2025-09-26T19:40:57.318196] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:40:57.318626] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-09-26T19:40:57.318714] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-09-26T19:40:57.319903] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-09-26T19:40:57.319969] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-09-26T19:40:57.543831] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-09-26T19:40:57.697941] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:40:58.257886] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-26T19:40:58.311715] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-09-26T19:40:58.787206] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-26T19:40:58.988344] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-26T19:40:59.111725] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-09-26T19:40:59.274230] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-26T19:40:59.911725] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2024-12. [2025-09-26T19:41:00.711721] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-09-26T19:41:01.004367] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-26T19:41:01.279433] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-26T19:41:01.289679] [INFO ] [REMOTE ] KMX: Full fetch complete (75973 records). [2025-09-26T19:41:01.289829] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-09-26T19:41:01.521026] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-09-26T19:41:01.735667] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-09-26T19:41:01.735779] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-09-26T19:41:01.736938] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-09-26T19:41:01.737014] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-09-26T19:41:01.738719] [DEBUG] [LOCAL ] KMX: Trimmed 75973 records to 53897 (keeping 200 days of data) [2025-09-26T19:41:02.080980] [DEBUG] [LOCAL ] KMX: Primary data saved (53897 records). [2025-09-26T19:41:02.081181] [INFO ] [MAIN ] KMX: Full history saved. [2025-09-26T19:41:02.081359] [INFO ] [MAIN ] Update Progress: 1205/2371 symbols completed. KMX took 29.1s. Estimated remaining: 2h 35m 46s. Rate: 7.5 symbols/min [2025-09-26T19:41:02.281003] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:41:02.292257] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-26T19:41:02.316779] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-09-26T19:41:02.318397] [DEBUG] [LOCAL ] KNSL: Loaded 18261 existing records from primary storage. [2025-09-26T19:41:02.318474] [INFO ] [MAIN ] KNSL: Loaded 18261 existing records. [2025-09-26T19:41:02.509101] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:41:02.509357] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-09-26T19:41:02.509405] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-09-26T19:41:02.511790] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-09-26T19:41:02.511856] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-09-26T19:41:02.902503] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:41:02.932343] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-26T19:41:03.111696] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-09-26T19:41:03.174189] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-26T19:41:03.911738] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-09-26T19:41:04.650386] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-26T19:41:04.652294] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T19:41:04.711753] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-09-26T19:41:05.511736] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-09-26T19:41:05.676992] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-26T19:41:06.311773] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-09-26T19:41:06.844959] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-26T19:41:07.111720] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-09-26T19:41:07.205382] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-26T19:41:07.911733] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-09-26T19:41:08.578525] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-26T19:41:08.711745] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2024-12. [2025-09-26T19:41:08.727248] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-26T19:41:09.511724] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-09-26T19:41:09.770895] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-26T19:41:10.311721] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-09-26T19:41:10.796876] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-26T19:41:11.111715] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-09-26T19:41:11.786042] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-26T19:41:11.911710] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-09-26T19:41:12.488484] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-26T19:41:12.715997] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-09-26T19:41:12.719997] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-26T19:41:13.511733] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-09-26T19:41:14.260463] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-26T19:41:14.311723] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-09-26T19:41:14.345948] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-26T19:41:15.111699] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-09-26T19:41:15.446022] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-26T19:41:15.911740] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-09-26T19:41:16.633609] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-26T19:41:16.711738] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-09-26T19:41:16.975862] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-26T19:41:17.511723] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-09-26T19:41:17.543284] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-26T19:41:18.311761] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-09-26T19:41:18.472894] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-26T19:41:19.111723] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-09-26T19:41:19.668908] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-26T19:41:19.911721] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-09-26T19:41:20.411540] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-26T19:41:20.419770] [INFO ] [REMOTE ] KN: Full fetch complete (56407 records). [2025-09-26T19:41:20.419949] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-09-26T19:41:20.716846] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-09-26T19:41:20.858003] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-09-26T19:41:20.858228] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-09-26T19:41:20.859114] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-09-26T19:41:20.859196] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-09-26T19:41:20.860540] [DEBUG] [LOCAL ] KN: Trimmed 56407 records to 39393 (keeping 200 days of data) [2025-09-26T19:41:20.987064] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-26T19:41:21.114418] [DEBUG] [LOCAL ] KN: Primary data saved (39393 records). [2025-09-26T19:41:21.114578] [INFO ] [MAIN ] KN: Full history saved. [2025-09-26T19:41:21.114691] [INFO ] [MAIN ] Update Progress: 1206/2371 symbols completed. KN took 27.8s. Estimated remaining: 2h 35m 49s. Rate: 7.5 symbols/min [2025-09-26T19:41:21.297563] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:41:21.339894] [DEBUG] [LOCAL ] KNTK: Loaded 46447 existing records from primary storage. [2025-09-26T19:41:21.340040] [INFO ] [MAIN ] KNTK: Loaded 46447 existing records. [2025-09-26T19:41:21.514215] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-09-26T19:41:21.558237] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-26T19:41:21.558598] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:41:21.562622] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-09-26T19:41:21.563045] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-09-26T19:41:21.564178] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-09-26T19:41:21.564272] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-09-26T19:41:21.978060] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:41:22.311721] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-09-26T19:41:23.027379] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-26T19:41:23.111736] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2024-12. [2025-09-26T19:41:23.407776] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-26T19:41:23.911737] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-09-26T19:41:24.629438] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-26T19:41:24.711689] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-09-26T19:41:24.922598] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-26T19:41:24.925289] [INFO ] [REMOTE ] KNOP: Full fetch complete (14697 records). [2025-09-26T19:41:24.925458] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-09-26T19:41:25.319559] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-09-26T19:41:25.319639] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-09-26T19:41:25.320027] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-09-26T19:41:25.320068] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-09-26T19:41:25.320589] [DEBUG] [LOCAL ] KNOP: Trimmed 14697 records to 10274 (keeping 200 days of data) [2025-09-26T19:41:25.383209] [DEBUG] [LOCAL ] KNOP: Primary data saved (10274 records). [2025-09-26T19:41:25.383365] [INFO ] [MAIN ] KNOP: Full history saved. [2025-09-26T19:41:25.383457] [INFO ] [MAIN ] Update Progress: 1207/2371 symbols completed. KNOP took 28.5s. Estimated remaining: 2h 35m 37s. Rate: 7.5 symbols/min [2025-09-26T19:41:25.516880] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-09-26T19:41:25.574067] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:41:25.634088] [DEBUG] [LOCAL ] KNX: Loaded 52981 existing records from primary storage. [2025-09-26T19:41:25.634272] [INFO ] [MAIN ] KNX: Loaded 52981 existing records. [2025-09-26T19:41:25.824270] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:41:25.824559] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-09-26T19:41:25.824614] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-09-26T19:41:25.825916] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-09-26T19:41:25.826001] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-09-26T19:41:26.201125] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-26T19:41:26.247924] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:41:26.311718] [INFO ] [REMOTE ] KNX: Fetching primary data for 2024-12. [2025-09-26T19:41:26.883532] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-26T19:41:27.111719] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-09-26T19:41:27.877609] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-26T19:41:27.911711] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-09-26T19:41:28.504300] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-26T19:41:28.711726] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-09-26T19:41:29.202015] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-26T19:41:29.511739] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-09-26T19:41:30.311736] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-09-26T19:41:30.348513] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-26T19:41:30.356301] [INFO ] [REMOTE ] KNF: Full fetch complete (50623 records). [2025-09-26T19:41:30.356473] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-09-26T19:41:30.759055] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-09-26T19:41:30.759145] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-09-26T19:41:30.760012] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-09-26T19:41:30.760080] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-09-26T19:41:30.761577] [DEBUG] [LOCAL ] KNF: Trimmed 50623 records to 36435 (keeping 200 days of data) [2025-09-26T19:41:31.025606] [DEBUG] [LOCAL ] KNF: Primary data saved (36435 records). [2025-09-26T19:41:31.026251] [INFO ] [MAIN ] KNF: Full history saved. [2025-09-26T19:41:31.026800] [INFO ] [MAIN ] Update Progress: 1208/2371 symbols completed. KNF took 35.9s. Estimated remaining: 2h 35m 27s. Rate: 7.5 symbols/min [2025-09-26T19:41:31.028011] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-26T19:41:31.115025] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-09-26T19:41:31.240132] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:41:31.240358] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-09-26T19:41:31.240415] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-09-26T19:41:31.240587] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-09-26T19:41:31.240635] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-09-26T19:41:31.240724] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-09-26T19:41:31.240765] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-09-26T19:41:31.631018] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:41:31.743730] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-26T19:41:31.911762] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-09-26T19:41:32.019758] [DEBUG] [REMOTE ] KO: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-09-26T19:41:32.020207] [WARN ] [REMOTE ] KO: No data returned for month 2024-12 [2025-09-26T19:41:32.161617] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-26T19:41:32.711735] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-09-26T19:41:33.511879] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-09-26T19:41:33.962148] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-26T19:41:33.966558] [INFO ] [REMOTE ] KNSL: Full fetch complete (26678 records). [2025-09-26T19:41:33.966768] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-09-26T19:41:34.313535] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-09-26T19:41:34.407725] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-09-26T19:41:34.407820] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-09-26T19:41:34.408504] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-09-26T19:41:34.408568] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-09-26T19:41:34.409328] [DEBUG] [LOCAL ] KNSL: Trimmed 26678 records to 18372 (keeping 200 days of data) [2025-09-26T19:41:34.531167] [DEBUG] [LOCAL ] KNSL: Primary data saved (18372 records). [2025-09-26T19:41:34.531362] [INFO ] [MAIN ] KNSL: Full history saved. [2025-09-26T19:41:34.531458] [INFO ] [MAIN ] Update Progress: 1209/2371 symbols completed. KNSL took 32.4s. Estimated remaining: 2h 35m 15s. Rate: 7.5 symbols/min [2025-09-26T19:41:34.726499] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:41:34.766834] [DEBUG] [LOCAL ] KODK: Loaded 43657 existing records from primary storage. [2025-09-26T19:41:34.767016] [INFO ] [MAIN ] KODK: Loaded 43657 existing records. [2025-09-26T19:41:34.957569] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:41:34.958052] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-09-26T19:41:34.958232] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-09-26T19:41:34.959346] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-09-26T19:41:34.959425] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-09-26T19:41:35.124713] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-09-26T19:41:35.218628] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-26T19:41:35.389214] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:41:35.911769] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-09-26T19:41:36.711724] [INFO ] [REMOTE ] KODK: Fetching primary data for 2024-12. [2025-09-26T19:41:36.863490] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-26T19:41:36.962964] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.65 seconds). [2025-09-26T19:41:37.126717] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-26T19:41:37.511796] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-09-26T19:41:38.311722] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-09-26T19:41:38.455130] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-26T19:41:39.111808] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-09-26T19:41:39.911695] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-09-26T19:41:39.994030] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-09-26T19:41:40.174730] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-26T19:41:40.711726] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-09-26T19:41:40.874930] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-26T19:41:41.194450] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-26T19:41:41.511818] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-09-26T19:41:42.311735] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-09-26T19:41:42.684238] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-26T19:41:42.989804] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-26T19:41:43.111732] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-09-26T19:41:43.911714] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-09-26T19:41:44.711898] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-09-26T19:41:44.918524] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.61 seconds). [2025-09-26T19:41:44.974350] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-26T19:41:45.511793] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-09-26T19:41:45.556346] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-26T19:41:46.289668] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-26T19:41:46.311675] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-09-26T19:41:47.111786] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-09-26T19:41:47.223048] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-26T19:41:47.911731] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-09-26T19:41:48.069989] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-26T19:41:48.710675] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T19:41:48.719573] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-09-26T19:41:49.511838] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-09-26T19:41:50.311754] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-09-26T19:41:50.573026] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-09-26T19:41:50.627689] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-26T19:41:51.111795] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-09-26T19:41:51.197965] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-26T19:41:51.921802] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-09-26T19:41:51.942769] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-26T19:41:52.711733] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-09-26T19:41:53.511676] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-09-26T19:41:53.764778] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-26T19:41:53.983873] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.87 seconds). [2025-09-26T19:41:54.311773] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-09-26T19:41:54.427780] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T19:41:54.437748] [INFO ] [REMOTE ] KNTK: Full fetch complete (64289 records). [2025-09-26T19:41:54.437887] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-09-26T19:41:54.883907] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-09-26T19:41:54.884021] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-09-26T19:41:54.885092] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-09-26T19:41:54.885159] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-09-26T19:41:54.886554] [DEBUG] [LOCAL ] KNTK: Trimmed 64289 records to 46794 (keeping 200 days of data) [2025-09-26T19:41:55.037074] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-26T19:41:55.146926] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-09-26T19:41:55.250076] [DEBUG] [LOCAL ] KNTK: Primary data saved (46794 records). [2025-09-26T19:41:55.250402] [INFO ] [MAIN ] KNTK: Full history saved. [2025-09-26T19:41:55.250936] [INFO ] [MAIN ] Update Progress: 1210/2371 symbols completed. KNTK took 34.1s. Estimated remaining: 2h 35m 19s. Rate: 7.5 symbols/min [2025-09-26T19:41:55.464071] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:41:55.497124] [DEBUG] [LOCAL ] KOF: Loaded 26094 existing records from primary storage. [2025-09-26T19:41:55.497352] [INFO ] [MAIN ] KOF: Loaded 26094 existing records. [2025-09-26T19:41:55.697360] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:41:55.697624] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-09-26T19:41:55.697749] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-09-26T19:41:55.698522] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-09-26T19:41:55.698598] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-09-26T19:41:55.929624] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-09-26T19:41:56.092387] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:41:56.441387] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-26T19:41:56.711750] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-09-26T19:41:57.126873] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-26T19:41:57.141603] [INFO ] [REMOTE ] KNX: Full fetch complete (75761 records). [2025-09-26T19:41:57.141850] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-09-26T19:41:57.518496] [INFO ] [REMOTE ] KOF: Fetching primary data for 2024-12. [2025-09-26T19:41:57.585317] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-09-26T19:41:57.586583] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-09-26T19:41:57.588118] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-09-26T19:41:57.588493] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-09-26T19:41:57.590987] [DEBUG] [LOCAL ] KNX: Trimmed 75761 records to 53363 (keeping 200 days of data) [2025-09-26T19:41:57.874401] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-26T19:41:57.990171] [DEBUG] [LOCAL ] KNX: Primary data saved (53363 records). [2025-09-26T19:41:57.990323] [INFO ] [MAIN ] KNX: Full history saved. [2025-09-26T19:41:57.990411] [INFO ] [MAIN ] Update Progress: 1211/2371 symbols completed. KNX took 32.6s. Estimated remaining: 2h 35m 6s. Rate: 7.5 symbols/min [2025-09-26T19:41:58.183199] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:41:58.203181] [DEBUG] [LOCAL ] KOP: Loaded 17944 existing records from primary storage. [2025-09-26T19:41:58.203386] [INFO ] [MAIN ] KOP: Loaded 17944 existing records. [2025-09-26T19:41:58.312284] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-09-26T19:41:58.406836] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:41:58.407506] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-09-26T19:41:58.407678] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-09-26T19:41:58.408722] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-09-26T19:41:58.408814] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-09-26T19:41:58.530075] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-26T19:41:58.898705] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:41:59.111710] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-09-26T19:41:59.388892] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-09-26T19:41:59.911682] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-09-26T19:42:00.004393] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-26T19:42:00.386389] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-26T19:42:00.711720] [INFO ] [REMOTE ] KOP: Fetching primary data for 2024-12. [2025-09-26T19:42:01.511727] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-09-26T19:42:01.744926] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-26T19:42:02.311711] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-09-26T19:42:02.820839] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.91 seconds). [2025-09-26T19:42:02.867630] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-26T19:42:03.111749] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-09-26T19:42:03.894509] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-26T19:42:03.911673] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-09-26T19:42:04.051613] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-26T19:42:04.060028] [INFO ] [REMOTE ] KODK: Full fetch complete (63451 records). [2025-09-26T19:42:04.060182] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-09-26T19:42:04.510682] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-09-26T19:42:04.510806] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-09-26T19:42:04.511873] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-09-26T19:42:04.511960] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-09-26T19:42:04.513404] [DEBUG] [LOCAL ] KODK: Trimmed 63451 records to 44025 (keeping 200 days of data) [2025-09-26T19:42:04.714708] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-09-26T19:42:04.714583] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-26T19:42:04.811503] [DEBUG] [LOCAL ] KODK: Primary data saved (44025 records). [2025-09-26T19:42:04.811673] [INFO ] [MAIN ] KODK: Full history saved. [2025-09-26T19:42:04.811807] [INFO ] [MAIN ] Update Progress: 1212/2371 symbols completed. KODK took 30.3s. Estimated remaining: 2h 34m 57s. Rate: 7.5 symbols/min [2025-09-26T19:42:04.995670] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:42:04.999967] [DEBUG] [LOCAL ] KORE: Loaded 1990 existing records from primary storage. [2025-09-26T19:42:05.000054] [INFO ] [MAIN ] KORE: Loaded 1990 existing records. [2025-09-26T19:42:05.200774] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:42:05.201069] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-09-26T19:42:05.201125] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-09-26T19:42:05.201341] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-09-26T19:42:05.201403] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-09-26T19:42:05.516814] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-09-26T19:42:05.589872] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:42:06.311751] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-09-26T19:42:06.756676] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-26T19:42:07.111685] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-09-26T19:42:07.384090] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.67 seconds). [2025-09-26T19:42:07.395731] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-26T19:42:07.412563] [INFO ] [REMOTE ] KO: Full fetch complete (70978 records). [2025-09-26T19:42:07.412796] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-09-26T19:42:07.619200] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-09-26T19:42:07.620146] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:42:07.620227] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:42:07.620305] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-09-26T19:42:07.620379] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-09-26T19:42:07.620419] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-09-26T19:42:07.620556] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-09-26T19:42:07.620680] [INFO ] [MAIN ] Update Progress: 1213/2371 symbols completed. KO took 36.6s. Estimated remaining: 2h 34m 44s. Rate: 7.5 symbols/min [2025-09-26T19:42:07.807049] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:42:07.879856] [DEBUG] [LOCAL ] KOS: Loaded 53448 existing records from primary storage. [2025-09-26T19:42:07.880039] [INFO ] [MAIN ] KOS: Loaded 53448 existing records. [2025-09-26T19:42:07.916850] [INFO ] [REMOTE ] KORE: Fetching primary data for 2024-12. [2025-09-26T19:42:08.081247] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:42:08.081571] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-09-26T19:42:08.081668] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-09-26T19:42:08.082705] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-09-26T19:42:08.082765] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-09-26T19:42:08.518511] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:42:08.538484] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-26T19:42:08.711694] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-09-26T19:42:08.870937] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-26T19:42:09.511701] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-09-26T19:42:09.815275] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-26T19:42:10.311709] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-09-26T19:42:10.445920] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-26T19:42:11.111690] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-09-26T19:42:11.541009] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-26T19:42:11.911716] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-09-26T19:42:12.222270] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-26T19:42:12.711726] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-09-26T19:42:13.227745] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-26T19:42:13.299228] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-26T19:42:13.511729] [INFO ] [REMOTE ] KOS: Fetching primary data for 2024-12. [2025-09-26T19:42:14.311728] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-09-26T19:42:14.749603] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-26T19:42:15.111687] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-09-26T19:42:15.212754] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-26T19:42:15.911726] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-09-26T19:42:16.378816] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-26T19:42:16.443422] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-26T19:42:16.711721] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-09-26T19:42:17.511757] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-09-26T19:42:17.576170] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-26T19:42:17.970050] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-26T19:42:18.311732] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-09-26T19:42:19.111723] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-09-26T19:42:19.434087] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-26T19:42:19.911724] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-09-26T19:42:20.711701] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-09-26T19:42:20.986670] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-26T19:42:21.116637] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-26T19:42:21.511724] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-09-26T19:42:21.861045] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-26T19:42:22.311693] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-09-26T19:42:22.667190] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-26T19:42:22.681088] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-26T19:42:22.686110] [INFO ] [REMOTE ] KOP: Full fetch complete (25438 records). [2025-09-26T19:42:22.686210] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-09-26T19:42:23.111696] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-09-26T19:42:23.111849] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-09-26T19:42:23.112345] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-09-26T19:42:23.114238] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-09-26T19:42:23.114310] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-09-26T19:42:23.115348] [DEBUG] [LOCAL ] KOP: Trimmed 25438 records to 18066 (keeping 200 days of data) [2025-09-26T19:42:23.232847] [DEBUG] [LOCAL ] KOP: Primary data saved (18066 records). [2025-09-26T19:42:23.233003] [INFO ] [MAIN ] KOP: Full history saved. [2025-09-26T19:42:23.233104] [INFO ] [MAIN ] Update Progress: 1214/2371 symbols completed. KOP took 25.2s. Estimated remaining: 2h 34m 43s. Rate: 7.5 symbols/min [2025-09-26T19:42:23.425090] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:42:23.486456] [DEBUG] [LOCAL ] KR: Loaded 54072 existing records from primary storage. [2025-09-26T19:42:23.486617] [INFO ] [MAIN ] KR: Loaded 54072 existing records. [2025-09-26T19:42:23.669699] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:42:23.669970] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-09-26T19:42:23.670020] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-09-26T19:42:23.671338] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-09-26T19:42:23.671405] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-09-26T19:42:23.916959] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-09-26T19:42:24.091995] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:42:24.499560] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-26T19:42:24.711703] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-09-26T19:42:24.883066] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-26T19:42:25.150459] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-26T19:42:25.511747] [INFO ] [REMOTE ] KR: Fetching primary data for 2024-12. [2025-09-26T19:42:26.311733] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-09-26T19:42:27.111711] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-09-26T19:42:27.668024] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-26T19:42:27.674102] [INFO ] [REMOTE ] KOF: Full fetch complete (36931 records). [2025-09-26T19:42:27.674219] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-09-26T19:42:27.918177] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-09-26T19:42:28.140699] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2024-12 (2.63 seconds). [2025-09-26T19:42:28.156359] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-09-26T19:42:28.156453] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-09-26T19:42:28.157320] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-09-26T19:42:28.168234] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-09-26T19:42:28.169150] [DEBUG] [LOCAL ] KOF: Trimmed 36931 records to 26219 (keeping 200 days of data) [2025-09-26T19:42:28.366213] [DEBUG] [LOCAL ] KOF: Primary data saved (26219 records). [2025-09-26T19:42:28.366470] [INFO ] [MAIN ] KOF: Full history saved. [2025-09-26T19:42:28.366598] [INFO ] [MAIN ] Update Progress: 1215/2371 symbols completed. KOF took 33.1s. Estimated remaining: 2h 34m 32s. Rate: 7.5 symbols/min [2025-09-26T19:42:28.559520] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:42:28.563999] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-26T19:42:28.566031] [INFO ] [REMOTE ] KORE: Full fetch complete (6050 records). [2025-09-26T19:42:28.566152] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-09-26T19:42:28.715409] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-09-26T19:42:28.966347] [DEBUG] [LOCAL ] KRC: Loaded 48747 existing records from primary storage. [2025-09-26T19:42:28.982523] [INFO ] [MAIN ] KRC: Loaded 48747 existing records. [2025-09-26T19:42:29.102726] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-09-26T19:42:29.087782] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-26T19:42:29.108099] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-09-26T19:42:29.138520] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-09-26T19:42:29.165318] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-09-26T19:42:29.184503] [DEBUG] [LOCAL ] KORE: Trimmed 6050 records to 2010 (keeping 200 days of data) [2025-09-26T19:42:29.275775] [DEBUG] [LOCAL ] KORE: Primary data saved (2010 records). [2025-09-26T19:42:29.285764] [INFO ] [MAIN ] KORE: Full history saved. [2025-09-26T19:42:29.294073] [INFO ] [MAIN ] Update Progress: 1216/2371 symbols completed. KORE took 24.5s. Estimated remaining: 2h 34m 17s. Rate: 7.5 symbols/min [2025-09-26T19:42:29.307245] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:42:29.353986] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-09-26T19:42:29.383134] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-09-26T19:42:29.414697] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-09-26T19:42:29.417530] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-09-26T19:42:29.516589] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-09-26T19:42:29.639130] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:42:29.943292] [DEBUG] [LOCAL ] KREF: Loaded 37458 existing records from primary storage. [2025-09-26T19:42:29.946171] [INFO ] [MAIN ] KREF: Loaded 37458 existing records. [2025-09-26T19:42:30.008523] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:42:30.184696] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:42:30.185021] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-09-26T19:42:30.185080] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-09-26T19:42:30.185980] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-09-26T19:42:30.186044] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-09-26T19:42:30.316824] [INFO ] [REMOTE ] KRC: Fetching primary data for 2024-12. [2025-09-26T19:42:30.595234] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:42:30.656127] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-26T19:42:31.111741] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-09-26T19:42:31.345849] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-26T19:42:31.911720] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-09-26T19:42:32.118353] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T19:42:32.711715] [INFO ] [REMOTE ] KREF: Fetching primary data for 2024-12. [2025-09-26T19:42:32.945093] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-26T19:42:33.511736] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-09-26T19:42:33.819416] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-26T19:42:34.239151] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-26T19:42:34.311754] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-09-26T19:42:34.668611] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-26T19:42:35.111770] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-09-26T19:42:35.840894] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-26T19:42:35.911734] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-09-26T19:42:36.711720] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-09-26T19:42:37.011431] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-26T19:42:37.511736] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-09-26T19:42:37.684256] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-26T19:42:38.027485] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-26T19:42:38.311725] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-09-26T19:42:39.089806] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-26T19:42:39.111685] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-09-26T19:42:39.870500] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-26T19:42:39.911666] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-09-26T19:42:40.691073] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-26T19:42:40.711687] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-09-26T19:42:41.511742] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-09-26T19:42:42.032957] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-26T19:42:42.311736] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-09-26T19:42:42.811547] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-26T19:42:42.821906] [INFO ] [REMOTE ] KOS: Full fetch complete (76838 records). [2025-09-26T19:42:42.822041] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-09-26T19:42:43.115261] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-09-26T19:42:43.255416] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-09-26T19:42:43.255612] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-09-26T19:42:43.256860] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-09-26T19:42:43.256966] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-09-26T19:42:43.259636] [DEBUG] [LOCAL ] KOS: Trimmed 76838 records to 53828 (keeping 200 days of data) [2025-09-26T19:42:43.384141] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-26T19:42:43.628802] [DEBUG] [LOCAL ] KOS: Primary data saved (53828 records). [2025-09-26T19:42:43.628960] [INFO ] [MAIN ] KOS: Full history saved. [2025-09-26T19:42:43.629065] [INFO ] [MAIN ] Update Progress: 1217/2371 symbols completed. KOS took 36.0s. Estimated remaining: 2h 34m 15s. Rate: 7.5 symbols/min [2025-09-26T19:42:43.813261] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:42:43.859389] [DEBUG] [LOCAL ] KRG: Loaded 49543 existing records from primary storage. [2025-09-26T19:42:43.859592] [INFO ] [MAIN ] KRG: Loaded 49543 existing records. [2025-09-26T19:42:43.918840] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-09-26T19:42:44.055351] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:42:44.055748] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-09-26T19:42:44.055804] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-09-26T19:42:44.057073] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-09-26T19:42:44.057133] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-09-26T19:42:44.460528] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:42:44.522687] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-26T19:42:44.525385] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-26T19:42:44.711749] [INFO ] [REMOTE ] KRG: Fetching primary data for 2024-12. [2025-09-26T19:42:45.511698] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-09-26T19:42:45.701755] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-26T19:42:45.910243] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-26T19:42:46.311728] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-09-26T19:42:47.111732] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-09-26T19:42:47.477686] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-26T19:42:47.794358] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-26T19:42:47.911739] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-09-26T19:42:48.538422] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-26T19:42:48.711722] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-09-26T19:42:49.463555] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-26T19:42:49.511732] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-09-26T19:42:50.311764] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-09-26T19:42:50.510915] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-26T19:42:51.111759] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-09-26T19:42:51.390086] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-26T19:42:51.911736] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-09-26T19:42:51.978018] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-26T19:42:52.698565] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-26T19:42:52.711674] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-09-26T19:42:53.511705] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-09-26T19:42:53.722297] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-26T19:42:54.213813] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-26T19:42:54.311689] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-09-26T19:42:55.111743] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-09-26T19:42:55.452193] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-26T19:42:55.463104] [INFO ] [REMOTE ] KR: Full fetch complete (77678 records). [2025-09-26T19:42:55.463353] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-09-26T19:42:55.886369] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-09-26T19:42:55.886569] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-09-26T19:42:55.887882] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-09-26T19:42:55.888088] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-09-26T19:42:55.890240] [DEBUG] [LOCAL ] KR: Trimmed 77678 records to 54461 (keeping 200 days of data) [2025-09-26T19:42:55.918225] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-09-26T19:42:55.921993] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-26T19:42:56.287224] [DEBUG] [LOCAL ] KR: Primary data saved (54461 records). [2025-09-26T19:42:56.287438] [INFO ] [MAIN ] KR: Full history saved. [2025-09-26T19:42:56.287623] [INFO ] [MAIN ] Update Progress: 1218/2371 symbols completed. KR took 33.1s. Estimated remaining: 2h 34m 12s. Rate: 7.5 symbols/min [2025-09-26T19:42:56.481561] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:42:56.481968] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-09-26T19:42:56.482066] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-09-26T19:42:56.482334] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-09-26T19:42:56.482382] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-26T19:42:56.482425] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-26T19:42:56.482456] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-09-26T19:42:56.712375] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-09-26T19:42:56.870816] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-26T19:42:56.917890] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:42:57.427752] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-26T19:42:57.511679] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-09-26T19:42:58.311702] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-09-26T19:42:58.595304] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-26T19:42:58.813888] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-26T19:42:59.111722] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-09-26T19:42:59.315227] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:42:59.315589] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-09-26T19:42:59.911795] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-09-26T19:43:00.035374] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-26T19:43:00.711763] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-09-26T19:43:01.290742] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-26T19:43:01.511836] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-09-26T19:43:02.311726] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-01. [2025-09-26T19:43:02.367108] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-26T19:43:02.522715] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:43:02.523060] [WARN ] [REMOTE ] KRMN: No data returned for month 2025-01 [2025-09-26T19:43:02.913035] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-26T19:43:03.111727] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-09-26T19:43:03.911719] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-02. [2025-09-26T19:43:04.656573] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-26T19:43:04.664095] [INFO ] [REMOTE ] KREF: Full fetch complete (52111 records). [2025-09-26T19:43:04.664211] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-09-26T19:43:04.723713] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-09-26T19:43:05.086806] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-09-26T19:43:05.087046] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-09-26T19:43:05.087992] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-09-26T19:43:05.088067] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-09-26T19:43:05.089309] [DEBUG] [LOCAL ] KREF: Trimmed 52111 records to 37767 (keeping 200 days of data) [2025-09-26T19:43:05.204452] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-26T19:43:05.343874] [DEBUG] [LOCAL ] KREF: Primary data saved (37767 records). [2025-09-26T19:43:05.344033] [INFO ] [MAIN ] KREF: Full history saved. [2025-09-26T19:43:05.344136] [INFO ] [MAIN ] Update Progress: 1219/2371 symbols completed. KREF took 36.0s. Estimated remaining: 2h 34m 5s. Rate: 7.5 symbols/min [2025-09-26T19:43:05.516966] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-03. [2025-09-26T19:43:05.563495] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:43:05.591257] [DEBUG] [LOCAL ] KRO: Loaded 26251 existing records from primary storage. [2025-09-26T19:43:05.591486] [INFO ] [MAIN ] KRO: Loaded 26251 existing records. [2025-09-26T19:43:05.815179] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:43:05.815717] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-09-26T19:43:05.815778] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-09-26T19:43:05.817045] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-09-26T19:43:05.817111] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-09-26T19:43:06.214557] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:43:06.245494] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-26T19:43:06.311743] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-09-26T19:43:06.714001] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-26T19:43:07.111726] [INFO ] [REMOTE ] KRO: Fetching primary data for 2024-12. [2025-09-26T19:43:07.797767] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-26T19:43:07.807518] [INFO ] [REMOTE ] KRC: Full fetch complete (69728 records). [2025-09-26T19:43:07.807738] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-09-26T19:43:07.916796] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-09-26T19:43:08.247449] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-09-26T19:43:08.247553] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-09-26T19:43:08.248714] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-09-26T19:43:08.248845] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-09-26T19:43:08.250465] [DEBUG] [LOCAL ] KRC: Trimmed 69728 records to 49114 (keeping 200 days of data) [2025-09-26T19:43:08.500450] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-26T19:43:08.600472] [DEBUG] [LOCAL ] KRC: Primary data saved (49114 records). [2025-09-26T19:43:08.600638] [INFO ] [MAIN ] KRC: Full history saved. [2025-09-26T19:43:08.600825] [INFO ] [MAIN ] Update Progress: 1220/2371 symbols completed. KRC took 40.2s. Estimated remaining: 2h 33m 52s. Rate: 7.5 symbols/min [2025-09-26T19:43:08.716842] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-09-26T19:43:08.843876] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:43:08.885416] [DEBUG] [LOCAL ] KRP: Loaded 37736 existing records from primary storage. [2025-09-26T19:43:08.885637] [INFO ] [MAIN ] KRP: Loaded 37736 existing records. [2025-09-26T19:43:09.084885] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:43:09.085314] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-09-26T19:43:09.085400] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-09-26T19:43:09.086528] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-09-26T19:43:09.086600] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-09-26T19:43:09.517440] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-04. [2025-09-26T19:43:09.524280] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:43:09.740216] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-26T19:43:09.751322] [INFO ] [REMOTE ] KRG: Full fetch complete (71056 records). [2025-09-26T19:43:09.751559] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-09-26T19:43:10.007734] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-26T19:43:10.321018] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-09-26T19:43:10.399904] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-09-26T19:43:10.400042] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-09-26T19:43:10.401970] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-09-26T19:43:10.402112] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-09-26T19:43:10.404425] [DEBUG] [LOCAL ] KRG: Trimmed 71056 records to 49859 (keeping 200 days of data) [2025-09-26T19:43:10.789356] [DEBUG] [LOCAL ] KRG: Primary data saved (49859 records). [2025-09-26T19:43:10.789606] [INFO ] [MAIN ] KRG: Full history saved. [2025-09-26T19:43:10.789776] [INFO ] [MAIN ] Update Progress: 1221/2371 symbols completed. KRG took 27.2s. Estimated remaining: 2h 33m 39s. Rate: 7.5 symbols/min [2025-09-26T19:43:10.987790] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:43:11.043096] [DEBUG] [LOCAL ] KSS: Loaded 53996 existing records from primary storage. [2025-09-26T19:43:11.066566] [INFO ] [MAIN ] KSS: Loaded 53996 existing records. [2025-09-26T19:43:11.108095] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-26T19:43:11.132541] [INFO ] [REMOTE ] KRP: Fetching primary data for 2024-12. [2025-09-26T19:43:11.178304] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-26T19:43:11.297503] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:43:11.297776] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-09-26T19:43:11.297829] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-09-26T19:43:11.298958] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-09-26T19:43:11.299019] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-09-26T19:43:11.685032] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:43:11.911728] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-09-26T19:43:12.552303] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-26T19:43:12.711720] [INFO ] [REMOTE ] KSS: Fetching primary data for 2024-12. [2025-09-26T19:43:13.056479] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-26T19:43:13.511732] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-09-26T19:43:14.311738] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-05. [2025-09-26T19:43:14.808525] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-26T19:43:15.079200] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T19:43:15.111688] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-09-26T19:43:15.912420] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-09-26T19:43:15.914591] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-26T19:43:16.497920] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-26T19:43:16.711726] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-09-26T19:43:17.511688] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-09-26T19:43:17.923282] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-26T19:43:17.970896] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-26T19:43:18.311729] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-06. [2025-09-26T19:43:18.954169] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-26T19:43:19.111748] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-09-26T19:43:19.716946] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-26T19:43:19.911684] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-09-26T19:43:20.220385] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-26T19:43:20.711743] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-07. [2025-09-26T19:43:21.511747] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-09-26T19:43:22.017933] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-26T19:43:22.311706] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-09-26T19:43:22.551031] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-26T19:43:23.111707] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-09-26T19:43:23.346578] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-26T19:43:23.911705] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-09-26T19:43:24.295310] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-26T19:43:24.452060] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-26T19:43:24.711758] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-09-26T19:43:25.439547] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-26T19:43:25.511769] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-09-26T19:43:26.084106] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-26T19:43:26.311753] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-09-26T19:43:27.111757] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-08. [2025-09-26T19:43:27.566316] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-26T19:43:27.812305] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-26T19:43:27.911739] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-09-26T19:43:28.711728] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-09-26T19:43:28.890485] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-26T19:43:29.511791] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-09-26T19:43:29.974418] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-26T19:43:30.030252] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-26T19:43:30.036744] [INFO ] [REMOTE ] KRO: Full fetch complete (34930 records). [2025-09-26T19:43:30.036941] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-09-26T19:43:30.316818] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-09-26T19:43:30.441834] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-09-26T19:43:30.441923] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-09-26T19:43:30.442678] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-09-26T19:43:30.442754] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-09-26T19:43:30.443805] [DEBUG] [LOCAL ] KRO: Trimmed 34930 records to 26448 (keeping 200 days of data) [2025-09-26T19:43:30.602671] [DEBUG] [LOCAL ] KRO: Primary data saved (26448 records). [2025-09-26T19:43:30.602886] [INFO ] [MAIN ] KRO: Full history saved. [2025-09-26T19:43:30.602998] [INFO ] [MAIN ] Update Progress: 1222/2371 symbols completed. KRO took 25.3s. Estimated remaining: 2h 33m 42s. Rate: 7.5 symbols/min [2025-09-26T19:43:30.785765] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:43:30.832690] [DEBUG] [LOCAL ] KT: Loaded 46028 existing records from primary storage. [2025-09-26T19:43:30.832876] [INFO ] [MAIN ] KT: Loaded 46028 existing records. [2025-09-26T19:43:31.036878] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:43:31.060047] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-09-26T19:43:31.061840] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T19:43:31.061948] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-09-26T19:43:31.071366] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-09-26T19:43:31.071452] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-09-26T19:43:31.118146] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-09-26T19:43:31.464919] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:43:31.911705] [INFO ] [REMOTE ] KT: Fetching primary data for 2024-12. [2025-09-26T19:43:31.952613] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-26T19:43:32.659959] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-26T19:43:32.711756] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-09-26T19:43:33.299555] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-26T19:43:33.511748] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-09-26T19:43:34.106693] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-26T19:43:34.311734] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-09-26T19:43:35.111767] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-09. [2025-09-26T19:43:35.628715] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-26T19:43:35.911739] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-09-26T19:43:35.955521] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-26T19:43:36.711775] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-09-26T19:43:37.315494] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-26T19:43:37.325428] [INFO ] [REMOTE ] KRMN: Full fetch complete (50587 records). [2025-09-26T19:43:37.325630] [DEBUG] [VALIDATOR ] KRMN: Validating primary data. [2025-09-26T19:43:37.517047] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-09-26T19:43:37.537297] [WARN ] [VALIDATOR ] KRMN: Validation failed - insufficient historical data. Have 156 unique days, need 200 days [2025-09-26T19:43:37.537995] [FATAL] [MAIN ] KRMN: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:43:37.538069] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:43:37.538142] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-26T19:43:37.538235] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-26T19:43:37.538305] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-09-26T19:43:37.538388] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-09-26T19:43:37.538504] [INFO ] [MAIN ] Update Progress: 1223/2371 symbols completed. KRMN took 41.3s. Estimated remaining: 2h 33m 33s. Rate: 7.5 symbols/min [2025-09-26T19:43:37.719812] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:43:37.760821] [DEBUG] [LOCAL ] KTB: Loaded 41408 existing records from primary storage. [2025-09-26T19:43:37.761036] [INFO ] [MAIN ] KTB: Loaded 41408 existing records. [2025-09-26T19:43:37.971816] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:43:37.972513] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-09-26T19:43:37.972719] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-09-26T19:43:37.973948] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-09-26T19:43:37.974024] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-09-26T19:43:38.358460] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T19:43:38.440941] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-09-26T19:43:38.437595] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:43:38.441270] [INFO ] [REMOTE ] KRP: Full fetch complete (54763 records). [2025-09-26T19:43:38.453167] [INFO ] [REMOTE ] KTB: Fetching primary data for 2024-12. [2025-09-26T19:43:38.454352] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-09-26T19:43:38.884195] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-09-26T19:43:38.884294] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-09-26T19:43:38.885147] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-09-26T19:43:38.885232] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-09-26T19:43:38.887026] [DEBUG] [LOCAL ] KRP: Trimmed 54763 records to 37947 (keeping 200 days of data) [2025-09-26T19:43:39.111891] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-09-26T19:43:39.138990] [DEBUG] [LOCAL ] KRP: Primary data saved (37947 records). [2025-09-26T19:43:39.139314] [INFO ] [MAIN ] KRP: Full history saved. [2025-09-26T19:43:39.139460] [INFO ] [MAIN ] Update Progress: 1224/2371 symbols completed. KRP took 30.5s. Estimated remaining: 2h 33m 19s. Rate: 7.5 symbols/min [2025-09-26T19:43:39.345798] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:43:39.348296] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-26T19:43:39.371639] [DEBUG] [LOCAL ] KTF: Loaded 13031 existing records from primary storage. [2025-09-26T19:43:39.371793] [INFO ] [MAIN ] KTF: Loaded 13031 existing records. [2025-09-26T19:43:39.560311] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:43:39.560765] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-09-26T19:43:39.560894] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-09-26T19:43:39.561406] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-09-26T19:43:39.561508] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-09-26T19:43:39.735276] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-26T19:43:39.923267] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-09-26T19:43:39.967050] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:43:40.711716] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-09-26T19:43:41.234052] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-26T19:43:41.244613] [INFO ] [REMOTE ] KSS: Full fetch complete (77637 records). [2025-09-26T19:43:41.244806] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-09-26T19:43:41.518125] [INFO ] [REMOTE ] KTF: Fetching primary data for 2024-12. [2025-09-26T19:43:41.698993] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-09-26T19:43:41.704692] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-09-26T19:43:41.707499] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-09-26T19:43:41.707605] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-09-26T19:43:41.725244] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-26T19:43:41.740670] [DEBUG] [LOCAL ] KSS: Trimmed 77637 records to 54385 (keeping 200 days of data) [2025-09-26T19:43:42.096006] [DEBUG] [LOCAL ] KSS: Primary data saved (54385 records). [2025-09-26T19:43:42.096282] [INFO ] [MAIN ] KSS: Full history saved. [2025-09-26T19:43:42.096412] [INFO ] [MAIN ] Update Progress: 1225/2371 symbols completed. KSS took 31.3s. Estimated remaining: 2h 33m 6s. Rate: 7.5 symbols/min [2025-09-26T19:43:42.239083] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-26T19:43:42.328387] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:43:42.324148] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-09-26T19:43:42.330244] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-09-26T19:43:42.330309] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-09-26T19:43:42.330441] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-09-26T19:43:42.330493] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-26T19:43:42.330543] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-26T19:43:42.330578] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-09-26T19:43:42.680808] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-26T19:43:42.751335] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:43:43.111735] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-09-26T19:43:43.731467] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-26T19:43:43.911701] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-09-26T19:43:44.105117] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-26T19:43:44.711745] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-09-26T19:43:44.835628] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-26T19:43:45.511745] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-09-26T19:43:46.266132] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-26T19:43:46.265916] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-26T19:43:46.311679] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-09-26T19:43:47.111728] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-09-26T19:43:47.894481] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-26T19:43:47.911675] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-09-26T19:43:47.958204] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-26T19:43:48.711720] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-09-26T19:43:49.511726] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-09-26T19:43:49.562205] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-26T19:43:49.605551] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-26T19:43:50.277380] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-26T19:43:50.311727] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-09-26T19:43:51.096377] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-26T19:43:51.111703] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-09-26T19:43:51.911697] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-09-26T19:43:52.144051] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-26T19:43:52.711749] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-09-26T19:43:53.511734] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-09-26T19:43:53.612251] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-26T19:43:53.686456] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-26T19:43:54.086787] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-26T19:43:54.311736] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-09-26T19:43:54.768372] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-26T19:43:55.111721] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-09-26T19:43:55.533131] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-26T19:43:55.911737] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-09-26T19:43:56.711699] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-09-26T19:43:56.875831] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-26T19:43:57.511741] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-09-26T19:43:58.311710] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-09-26T19:43:58.359201] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-26T19:43:58.828433] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-26T19:43:58.985214] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T19:43:59.111717] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-09-26T19:43:59.911720] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-09-26T19:44:00.666431] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T19:44:00.666604] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-26T19:44:00.711675] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-09-26T19:44:01.511739] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-09-26T19:44:02.311770] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-09-26T19:44:02.443399] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-26T19:44:03.063159] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-26T19:44:03.084245] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-26T19:44:03.087724] [INFO ] [REMOTE ] KUKE: Full fetch complete (8120 records). [2025-09-26T19:44:03.087900] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-09-26T19:44:03.116970] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-09-26T19:44:03.414800] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-26T19:44:03.415170] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:44:03.415266] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:44:03.415362] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-26T19:44:03.415464] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-26T19:44:03.415526] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-09-26T19:44:03.415592] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-09-26T19:44:03.415722] [INFO ] [MAIN ] Update Progress: 1226/2371 symbols completed. KUKE took 21.3s. Estimated remaining: 2h 33m 10s. Rate: 7.5 symbols/min [2025-09-26T19:44:03.624712] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:44:03.682851] [DEBUG] [LOCAL ] KVUE: Loaded 54057 existing records from primary storage. [2025-09-26T19:44:03.683018] [INFO ] [MAIN ] KVUE: Loaded 54057 existing records. [2025-09-26T19:44:03.878123] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:44:03.878368] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-09-26T19:44:03.878418] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-09-26T19:44:03.879590] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-09-26T19:44:03.879690] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-09-26T19:44:03.916941] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-09-26T19:44:04.276123] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:44:04.711743] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-09-26T19:44:04.803805] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-26T19:44:05.519349] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-09-26T19:44:05.522022] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-26T19:44:05.676251] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-26T19:44:06.311766] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-09-26T19:44:07.111744] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2024-12. [2025-09-26T19:44:07.279022] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-26T19:44:07.288730] [INFO ] [REMOTE ] KT: Full fetch complete (66732 records). [2025-09-26T19:44:07.288896] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-09-26T19:44:07.689328] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-09-26T19:44:07.689510] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-09-26T19:44:07.690617] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-09-26T19:44:07.690709] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-09-26T19:44:07.692588] [DEBUG] [LOCAL ] KT: Trimmed 66732 records to 46336 (keeping 200 days of data) [2025-09-26T19:44:07.918961] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-09-26T19:44:08.015127] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-26T19:44:08.027272] [DEBUG] [LOCAL ] KT: Primary data saved (46336 records). [2025-09-26T19:44:08.035639] [INFO ] [MAIN ] KT: Full history saved. [2025-09-26T19:44:08.035812] [INFO ] [MAIN ] Update Progress: 1227/2371 symbols completed. KT took 37.4s. Estimated remaining: 2h 32m 59s. Rate: 7.5 symbols/min [2025-09-26T19:44:08.070030] [INFO ] [REMOTE ] KTB: Full fetch complete (57710 records). [2025-09-26T19:44:08.103585] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-09-26T19:44:08.359318] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:44:08.694024] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-09-26T19:44:08.694220] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-09-26T19:44:08.695337] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-09-26T19:44:08.695570] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-09-26T19:44:08.697565] [DEBUG] [LOCAL ] KTB: Trimmed 57710 records to 41738 (keeping 200 days of data) [2025-09-26T19:44:08.714809] [DEBUG] [LOCAL ] KVYO: Loaded 50306 existing records from primary storage. [2025-09-26T19:44:08.715061] [INFO ] [MAIN ] KVYO: Loaded 50306 existing records. [2025-09-26T19:44:08.959761] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-26T19:44:09.001009] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-09-26T19:44:09.078680] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:44:09.086287] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-09-26T19:44:09.140002] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-09-26T19:44:09.177037] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-09-26T19:44:09.179739] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-09-26T19:44:09.515071] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-09-26T19:44:09.591381] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-09-26T19:44:09.695235] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:44:09.688243] [DEBUG] [LOCAL ] KTB: Primary data saved (41738 records). [2025-09-26T19:44:09.695455] [INFO ] [MAIN ] KTB: Full history saved. [2025-09-26T19:44:09.695898] [INFO ] [MAIN ] Update Progress: 1228/2371 symbols completed. KTB took 32.2s. Estimated remaining: 2h 32m 45s. Rate: 7.5 symbols/min [2025-09-26T19:44:09.878129] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:44:09.918272] [DEBUG] [LOCAL ] KW: Loaded 40961 existing records from primary storage. [2025-09-26T19:44:09.918427] [INFO ] [MAIN ] KW: Loaded 40961 existing records. [2025-09-26T19:44:10.047619] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-26T19:44:10.071583] [INFO ] [REMOTE ] KTF: Full fetch complete (18031 records). [2025-09-26T19:44:10.096032] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-09-26T19:44:10.187607] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:44:10.225311] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-09-26T19:44:10.255313] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-09-26T19:44:10.261511] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-09-26T19:44:10.266961] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-09-26T19:44:10.316262] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2024-12. [2025-09-26T19:44:10.795998] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-09-26T19:44:10.831453] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-09-26T19:44:10.855754] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-09-26T19:44:10.880063] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-09-26T19:44:10.935471] [DEBUG] [LOCAL ] KTF: Trimmed 18031 records to 13065 (keeping 200 days of data) [2025-09-26T19:44:11.047373] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:44:11.099673] [DEBUG] [LOCAL ] KTF: Primary data saved (13065 records). [2025-09-26T19:44:11.099857] [INFO ] [MAIN ] KTF: Full history saved. [2025-09-26T19:44:11.100123] [INFO ] [MAIN ] Update Progress: 1229/2371 symbols completed. KTF took 32.0s. Estimated remaining: 2h 32m 31s. Rate: 7.5 symbols/min [2025-09-26T19:44:11.129204] [INFO ] [REMOTE ] KW: Fetching primary data for 2024-12. [2025-09-26T19:44:11.306337] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:44:11.330833] [DEBUG] [LOCAL ] KWR: Loaded 16844 existing records from primary storage. [2025-09-26T19:44:11.330991] [INFO ] [MAIN ] KWR: Loaded 16844 existing records. [2025-09-26T19:44:11.530114] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:44:11.530437] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-09-26T19:44:11.530823] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-09-26T19:44:11.531541] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-09-26T19:44:11.531747] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-09-26T19:44:11.820928] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-26T19:44:11.936566] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-09-26T19:44:12.032018] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:44:12.175068] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-26T19:44:12.568614] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-26T19:44:12.711720] [INFO ] [REMOTE ] KWR: Fetching primary data for 2024-12. [2025-09-26T19:44:13.511716] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-09-26T19:44:13.653636] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-26T19:44:13.712614] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-26T19:44:14.311713] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-09-26T19:44:15.111716] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-09-26T19:44:15.157673] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-26T19:44:15.716694] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-26T19:44:15.911714] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-09-26T19:44:16.089702] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-26T19:44:16.711724] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-09-26T19:44:17.511751] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-09-26T19:44:17.749082] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-26T19:44:18.275746] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-26T19:44:18.311730] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-09-26T19:44:18.503873] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-26T19:44:19.111776] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-09-26T19:44:19.911735] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-09-26T19:44:20.213518] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-26T19:44:20.661838] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-26T19:44:20.690315] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-26T19:44:20.711674] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-09-26T19:44:21.511721] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-09-26T19:44:21.921201] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-26T19:44:22.311730] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-09-26T19:44:23.111699] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-09-26T19:44:23.147054] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-26T19:44:23.202718] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-26T19:44:23.911717] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-09-26T19:44:24.706079] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-26T19:44:24.715699] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-09-26T19:44:25.511746] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-09-26T19:44:25.792149] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-26T19:44:26.311729] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-09-26T19:44:26.500907] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-26T19:44:27.060677] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-26T19:44:27.111680] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-09-26T19:44:27.911703] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-09-26T19:44:28.172574] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-26T19:44:28.215801] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-26T19:44:28.711724] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-09-26T19:44:29.195883] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-26T19:44:29.511757] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-09-26T19:44:30.311746] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-09-26T19:44:30.433798] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-26T19:44:30.990433] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-26T19:44:31.111742] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-09-26T19:44:31.297437] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-26T19:44:31.911731] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-09-26T19:44:32.711703] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-09-26T19:44:32.904093] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-26T19:44:32.950109] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-26T19:44:33.511751] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-09-26T19:44:34.311697] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-09-26T19:44:34.412478] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-26T19:44:35.111707] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-09-26T19:44:35.201365] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-26T19:44:35.396767] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-26T19:44:35.911736] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-09-26T19:44:36.711711] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-09-26T19:44:36.849793] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-26T19:44:37.511711] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-09-26T19:44:37.709244] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-26T19:44:38.197594] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-26T19:44:38.311737] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-09-26T19:44:39.111721] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-09-26T19:44:39.273695] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-26T19:44:39.276822] [INFO ] [REMOTE ] KWR: Full fetch complete (23986 records). [2025-09-26T19:44:39.276939] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-09-26T19:44:39.702465] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-26T19:44:39.714516] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-09-26T19:44:39.723940] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-09-26T19:44:39.724873] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-09-26T19:44:39.724960] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-09-26T19:44:39.725793] [INFO ] [REMOTE ] KVYO: Full fetch complete (71475 records). [2025-09-26T19:44:39.726050] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-09-26T19:44:39.732178] [DEBUG] [LOCAL ] KWR: Trimmed 23986 records to 16931 (keeping 200 days of data) [2025-09-26T19:44:39.931368] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-09-26T19:44:40.264508] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-09-26T19:44:40.264685] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-09-26T19:44:40.266058] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-09-26T19:44:40.266421] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-09-26T19:44:40.274064] [DEBUG] [LOCAL ] KVYO: Trimmed 71475 records to 50696 (keeping 200 days of data) [2025-09-26T19:44:40.352317] [DEBUG] [LOCAL ] KWR: Primary data saved (16931 records). [2025-09-26T19:44:40.377811] [INFO ] [MAIN ] KWR: Full history saved. [2025-09-26T19:44:40.378570] [INFO ] [MAIN ] Update Progress: 1230/2371 symbols completed. KWR took 29.3s. Estimated remaining: 2h 32m 43s. Rate: 7.5 symbols/min [2025-09-26T19:44:40.573537] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:44:40.602751] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-26T19:44:40.613191] [INFO ] [REMOTE ] KW: Full fetch complete (56994 records). [2025-09-26T19:44:40.614152] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-09-26T19:44:40.761381] [DEBUG] [LOCAL ] KYN: Loaded 30234 existing records from primary storage. [2025-09-26T19:44:40.772470] [INFO ] [MAIN ] KYN: Loaded 30234 existing records. [2025-09-26T19:44:41.277958] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:44:41.356527] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-09-26T19:44:41.356963] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-09-26T19:44:41.376994] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-09-26T19:44:41.377517] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-09-26T19:44:41.390285] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-09-26T19:44:41.390692] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-09-26T19:44:41.392058] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-09-26T19:44:41.397536] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-09-26T19:44:41.474925] [DEBUG] [LOCAL ] KW: Trimmed 56994 records to 41236 (keeping 200 days of data) [2025-09-26T19:44:41.906773] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:44:41.909935] [INFO ] [REMOTE ] KYN: Fetching primary data for 2024-12. [2025-09-26T19:44:42.176828] [DEBUG] [LOCAL ] KW: Primary data saved (41236 records). [2025-09-26T19:44:42.178876] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-26T19:44:42.179121] [INFO ] [MAIN ] KW: Full history saved. [2025-09-26T19:44:42.177781] [DEBUG] [LOCAL ] KVYO: Primary data saved (50696 records). [2025-09-26T19:44:42.189486] [INFO ] [MAIN ] KVYO: Full history saved. [2025-09-26T19:44:42.188725] [INFO ] [MAIN ] Update Progress: 1231/2371 symbols completed. KW took 32.5s. Estimated remaining: 2h 32m 29s. Rate: 7.5 symbols/min [2025-09-26T19:44:42.190662] [INFO ] [MAIN ] Update Progress: 1232/2371 symbols completed. KVYO took 34.2s. Estimated remaining: 2h 32m 13s. Rate: 7.5 symbols/min [2025-09-26T19:44:42.195991] [INFO ] [REMOTE ] KVUE: Full fetch complete (77673 records). [2025-09-26T19:44:42.202776] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-09-26T19:44:42.675345] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:44:42.805456] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:44:43.060074] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-09-26T19:44:43.060196] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-09-26T19:44:43.061259] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-09-26T19:44:43.061525] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-09-26T19:44:43.075677] [DEBUG] [LOCAL ] L: Loaded 41261 existing records from primary storage. [2025-09-26T19:44:43.075904] [INFO ] [MAIN ] L: Loaded 41261 existing records. [2025-09-26T19:44:43.081240] [DEBUG] [LOCAL ] KVUE: Trimmed 77673 records to 54447 (keeping 200 days of data) [2025-09-26T19:44:43.326804] [DEBUG] [LOCAL ] LAC: Loaded 52701 existing records from primary storage. [2025-09-26T19:44:43.327991] [INFO ] [MAIN ] LAC: Loaded 52701 existing records. [2025-09-26T19:44:43.532554] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:44:43.565747] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-09-26T19:44:43.578446] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-09-26T19:44:43.582865] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-09-26T19:44:43.583253] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-09-26T19:44:43.753171] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-26T19:44:43.788730] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-09-26T19:44:43.805252] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:44:43.859952] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-09-26T19:44:43.865414] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-09-26T19:44:43.886809] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-09-26T19:44:43.887751] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-09-26T19:44:44.398460] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:44:44.417874] [INFO ] [REMOTE ] L: Fetching primary data for 2024-12. [2025-09-26T19:44:44.689445] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:44:44.691785] [INFO ] [REMOTE ] LAC: Fetching primary data for 2024-12. [2025-09-26T19:44:44.818494] [DEBUG] [LOCAL ] KVUE: Primary data saved (54447 records). [2025-09-26T19:44:44.818707] [INFO ] [MAIN ] KVUE: Full history saved. [2025-09-26T19:44:44.818817] [INFO ] [MAIN ] Update Progress: 1233/2371 symbols completed. KVUE took 41.4s. Estimated remaining: 2h 32m 0s. Rate: 7.5 symbols/min [2025-09-26T19:44:45.008214] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:44:45.033021] [DEBUG] [LOCAL ] LAD: Loaded 23870 existing records from primary storage. [2025-09-26T19:44:45.033169] [INFO ] [MAIN ] LAD: Loaded 23870 existing records. [2025-09-26T19:44:45.228536] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:44:45.228918] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-09-26T19:44:45.229094] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-09-26T19:44:45.229824] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-09-26T19:44:45.229887] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-09-26T19:44:45.375054] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-26T19:44:45.416264] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-09-26T19:44:45.644710] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:44:45.645039] [INFO ] [REMOTE ] LAD: Fetching primary data for 2024-12. [2025-09-26T19:44:46.079475] [INFO ] [REMOTE ] L: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-26T19:44:46.089631] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-09-26T19:44:46.304559] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-26T19:44:46.311694] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-09-26T19:44:46.798718] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-26T19:44:46.859023] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-26T19:44:47.111728] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-09-26T19:44:47.196504] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-26T19:44:47.647823] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-26T19:44:47.911719] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-09-26T19:44:48.080679] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-26T19:44:48.711753] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-09-26T19:44:49.444114] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-26T19:44:49.511689] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-09-26T19:44:49.893262] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-26T19:44:50.311775] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-09-26T19:44:50.890109] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-26T19:44:51.111722] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-09-26T19:44:51.888254] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-26T19:44:51.911670] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-09-26T19:44:52.461361] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-26T19:44:52.711721] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-09-26T19:44:53.449105] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-26T19:44:53.511731] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-09-26T19:44:54.288091] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-26T19:44:54.311711] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-09-26T19:44:54.830127] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-26T19:44:55.111722] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-09-26T19:44:55.644588] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-26T19:44:55.911742] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-09-26T19:44:56.711762] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-09-26T19:44:57.024776] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-26T19:44:57.391209] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-26T19:44:57.511740] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-09-26T19:44:57.626058] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-26T19:44:58.311735] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-09-26T19:44:59.112265] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-09-26T19:44:59.117303] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-26T19:44:59.185344] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-26T19:44:59.911729] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-09-26T19:45:00.711729] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-09-26T19:45:00.989367] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-26T19:45:01.508258] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-09-26T19:45:01.518198] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-09-26T19:45:02.311722] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-09-26T19:45:02.515485] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-26T19:45:02.858560] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-26T19:45:03.111743] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-09-26T19:45:03.847239] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-26T19:45:03.911684] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-09-26T19:45:04.297102] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-26T19:45:04.711783] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-09-26T19:45:05.511731] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-09-26T19:45:05.968092] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-26T19:45:06.311728] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-09-26T19:45:06.399617] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-26T19:45:06.861058] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-26T19:45:06.867735] [INFO ] [REMOTE ] KYN: Full fetch complete (44644 records). [2025-09-26T19:45:06.867875] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-09-26T19:45:07.116848] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-09-26T19:45:07.295734] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-09-26T19:45:07.295854] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-09-26T19:45:07.296598] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-09-26T19:45:07.296669] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-09-26T19:45:07.298045] [DEBUG] [LOCAL ] KYN: Trimmed 44644 records to 30432 (keeping 200 days of data) [2025-09-26T19:45:07.505623] [DEBUG] [LOCAL ] KYN: Primary data saved (30432 records). [2025-09-26T19:45:07.505800] [INFO ] [MAIN ] KYN: Full history saved. [2025-09-26T19:45:07.505894] [INFO ] [MAIN ] Update Progress: 1234/2371 symbols completed. KYN took 27.1s. Estimated remaining: 2h 32m 6s. Rate: 7.5 symbols/min [2025-09-26T19:45:07.640833] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-26T19:45:07.686161] [INFO ] [REMOTE ] LAD: Full fetch complete (35401 records). [2025-09-26T19:45:07.701898] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-09-26T19:45:07.729438] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:45:07.933665] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-09-26T19:45:08.110118] [DEBUG] [LOCAL ] LADR: Loaded 38917 existing records from primary storage. [2025-09-26T19:45:08.133989] [INFO ] [MAIN ] LADR: Loaded 38917 existing records. [2025-09-26T19:45:08.295583] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-09-26T19:45:08.299930] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-09-26T19:45:08.301105] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-09-26T19:45:08.316915] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-09-26T19:45:08.387399] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:45:08.388378] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-09-26T19:45:08.388687] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-09-26T19:45:08.388562] [DEBUG] [LOCAL ] LAD: Trimmed 35401 records to 24089 (keeping 200 days of data) [2025-09-26T19:45:08.389995] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-09-26T19:45:08.390153] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-09-26T19:45:08.784042] [DEBUG] [LOCAL ] LAD: Primary data saved (24089 records). [2025-09-26T19:45:08.806965] [INFO ] [MAIN ] LAD: Full history saved. [2025-09-26T19:45:08.822931] [INFO ] [MAIN ] Update Progress: 1235/2371 symbols completed. LAD took 24.0s. Estimated remaining: 2h 31m 52s. Rate: 7.5 symbols/min [2025-09-26T19:45:09.155810] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:45:09.171917] [INFO ] [REMOTE ] LADR: Fetching primary data for 2024-12. [2025-09-26T19:45:09.259183] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:45:09.262588] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-26T19:45:09.277382] [DEBUG] [LOCAL ] LANV: Loaded 2808 existing records from primary storage. [2025-09-26T19:45:09.277525] [INFO ] [MAIN ] LANV: Loaded 2808 existing records. [2025-09-26T19:45:09.478801] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:45:09.479056] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-09-26T19:45:09.479103] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-09-26T19:45:09.479395] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-09-26T19:45:09.479456] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-09-26T19:45:09.525623] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-09-26T19:45:09.923837] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:45:09.979849] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-26T19:45:10.311739] [INFO ] [REMOTE ] LANV: Fetching primary data for 2024-12. [2025-09-26T19:45:10.677965] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-26T19:45:10.907632] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-26T19:45:11.111690] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-09-26T19:45:11.451900] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-26T19:45:11.460065] [INFO ] [REMOTE ] L: Full fetch complete (59587 records). [2025-09-26T19:45:11.460207] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-09-26T19:45:11.891103] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-09-26T19:45:11.891223] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-09-26T19:45:11.892135] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-09-26T19:45:11.892203] [DEBUG] [LOCAL ] L: Saving primary data. [2025-09-26T19:45:11.893986] [DEBUG] [LOCAL ] L: Trimmed 59587 records to 41562 (keeping 200 days of data) [2025-09-26T19:45:11.955907] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-09-26T19:45:12.169142] [DEBUG] [LOCAL ] L: Primary data saved (41562 records). [2025-09-26T19:45:12.169284] [INFO ] [MAIN ] L: Full history saved. [2025-09-26T19:45:12.169379] [INFO ] [MAIN ] Update Progress: 1236/2371 symbols completed. L took 30.0s. Estimated remaining: 2h 31m 39s. Rate: 7.5 symbols/min [2025-09-26T19:45:12.359835] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:45:12.360040] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-09-26T19:45:12.360106] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-09-26T19:45:12.360328] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-09-26T19:45:12.360385] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-26T19:45:12.360432] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-09-26T19:45:12.360466] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-09-26T19:45:12.655300] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-26T19:45:12.722618] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-09-26T19:45:12.768610] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:45:12.957151] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-26T19:45:13.290309] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-26T19:45:13.511730] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-09-26T19:45:14.060273] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-26T19:45:14.311716] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-09-26T19:45:14.523062] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:45:14.523422] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-09-26T19:45:15.111719] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-09-26T19:45:15.911722] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-09-26T19:45:16.711757] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-01. [2025-09-26T19:45:17.346350] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-26T19:45:17.419907] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-26T19:45:17.511690] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-09-26T19:45:17.583161] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-26T19:45:17.994621] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-26T19:45:18.311758] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-09-26T19:45:19.111780] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-09-26T19:45:19.459629] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-26T19:45:19.653735] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-26T19:45:19.911745] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-09-26T19:45:20.711723] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-09-26T19:45:21.511728] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-09-26T19:45:21.637332] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-26T19:45:21.971829] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-26T19:45:22.311727] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-02. [2025-09-26T19:45:22.568386] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-26T19:45:23.111735] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-09-26T19:45:23.911765] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-09-26T19:45:23.998518] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-26T19:45:24.224420] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-26T19:45:24.711730] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-03. [2025-09-26T19:45:25.511718] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-09-26T19:45:25.547765] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-09-26T19:45:25.559390] [INFO ] [REMOTE ] LAC: Full fetch complete (75972 records). [2025-09-26T19:45:25.559574] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-09-26T19:45:25.994245] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-09-26T19:45:25.994351] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-09-26T19:45:25.995565] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-09-26T19:45:25.995639] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-09-26T19:45:25.997381] [DEBUG] [LOCAL ] LAC: Trimmed 75972 records to 53091 (keeping 200 days of data) [2025-09-26T19:45:26.098527] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-26T19:45:26.313338] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-09-26T19:45:26.346815] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-26T19:45:26.376497] [DEBUG] [LOCAL ] LAC: Primary data saved (53091 records). [2025-09-26T19:45:26.376674] [INFO ] [MAIN ] LAC: Full history saved. [2025-09-26T19:45:26.376785] [INFO ] [MAIN ] Update Progress: 1237/2371 symbols completed. LAC took 44.2s. Estimated remaining: 2h 31m 37s. Rate: 7.5 symbols/min [2025-09-26T19:45:27.003528] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-26T19:45:27.005358] [INFO ] [REMOTE ] LANV: Full fetch complete (4442 records). [2025-09-26T19:45:27.005447] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-09-26T19:45:27.113990] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-09-26T19:45:27.393181] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-09-26T19:45:27.393264] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-09-26T19:45:27.393421] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-09-26T19:45:27.393461] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-09-26T19:45:27.393969] [DEBUG] [LOCAL ] LANV: Trimmed 4442 records to 2851 (keeping 200 days of data) [2025-09-26T19:45:27.410475] [DEBUG] [LOCAL ] LANV: Primary data saved (2851 records). [2025-09-26T19:45:27.410578] [INFO ] [MAIN ] LANV: Full history saved. [2025-09-26T19:45:27.410731] [INFO ] [MAIN ] Update Progress: 1238/2371 symbols completed. LANV took 18.6s. Estimated remaining: 2h 31m 23s. Rate: 7.5 symbols/min [2025-09-26T19:45:27.911743] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-04. [2025-09-26T19:45:28.712900] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T19:45:28.723745] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-09-26T19:45:29.510098] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T19:45:29.519892] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-05. [2025-09-26T19:45:29.903850] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-26T19:45:30.311739] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-09-26T19:45:31.004299] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-26T19:45:31.111770] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-06. [2025-09-26T19:45:31.876597] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-26T19:45:31.911704] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-09-26T19:45:32.392027] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-26T19:45:32.711734] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-07. [2025-09-26T19:45:33.495780] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-26T19:45:33.511674] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-09-26T19:45:34.380026] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-26T19:45:34.391444] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-08. [2025-09-26T19:45:34.960484] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-26T19:45:35.111752] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-09-26T19:45:36.101587] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-26T19:45:36.112047] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-09. [2025-09-26T19:45:36.851870] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-26T19:45:36.859904] [INFO ] [REMOTE ] LADR: Full fetch complete (55107 records). [2025-09-26T19:45:36.860072] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-09-26T19:45:37.290469] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-09-26T19:45:37.290562] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-09-26T19:45:37.291436] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-09-26T19:45:37.291503] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-09-26T19:45:37.292856] [DEBUG] [LOCAL ] LADR: Trimmed 55107 records to 39204 (keeping 200 days of data) [2025-09-26T19:45:37.549965] [DEBUG] [LOCAL ] LADR: Primary data saved (39204 records). [2025-09-26T19:45:37.550214] [INFO ] [MAIN ] LADR: Full history saved. [2025-09-26T19:45:37.550386] [INFO ] [MAIN ] Update Progress: 1239/2371 symbols completed. LADR took 30.0s. Estimated remaining: 2h 31m 17s. Rate: 7.5 symbols/min [2025-09-26T19:45:37.688600] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-26T19:45:37.700899] [INFO ] [REMOTE ] LAR: Full fetch complete (55540 records). [2025-09-26T19:45:37.701090] [DEBUG] [VALIDATOR ] LAR: Validating primary data. [2025-09-26T19:45:37.910782] [WARN ] [VALIDATOR ] LAR: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-09-26T19:45:37.911408] [FATAL] [MAIN ] LAR: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:45:37.911482] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:45:37.911684] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-26T19:45:37.911804] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-09-26T19:45:37.911863] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-09-26T19:45:37.911931] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-09-26T19:45:37.912051] [INFO ] [MAIN ] Update Progress: 1240/2371 symbols completed. LAR took 25.7s. Estimated remaining: 2h 31m 2s. Rate: 7.5 symbols/min [2025-09-26T19:45:38.523542] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:45:38.623080] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:45:38.737858] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:45:38.752448] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:45:38.780568] [DEBUG] [LOCAL ] LAW: Loaded 14087 existing records from primary storage. [2025-09-26T19:45:38.780875] [INFO ] [MAIN ] LAW: Loaded 14087 existing records. [2025-09-26T19:45:38.938682] [DEBUG] [LOCAL ] LAZ: Loaded 45524 existing records from primary storage. [2025-09-26T19:45:38.942277] [INFO ] [MAIN ] LAZ: Loaded 45524 existing records. [2025-09-26T19:45:39.145358] [DEBUG] [LOCAL ] LB: Loaded 37889 existing records from primary storage. [2025-09-26T19:45:39.158109] [INFO ] [MAIN ] LB: Loaded 37889 existing records. [2025-09-26T19:45:39.174285] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:45:39.219814] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-09-26T19:45:39.273595] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-09-26T19:45:39.334055] [DEBUG] [LOCAL ] LBRT: Loaded 53307 existing records from primary storage. [2025-09-26T19:45:39.370547] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-09-26T19:45:39.453441] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:45:39.453304] [INFO ] [MAIN ] LBRT: Loaded 53307 existing records. [2025-09-26T19:45:39.454429] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-09-26T19:45:39.476577] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-09-26T19:45:39.661173] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-09-26T19:45:39.771750] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-09-26T19:45:39.755943] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:45:39.788336] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-09-26T19:45:39.788243] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-09-26T19:45:39.869904] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-09-26T19:45:39.924734] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-09-26T19:45:40.026140] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-09-26T19:45:40.052430] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:45:40.186567] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-09-26T19:45:40.236674] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-09-26T19:45:40.301189] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-09-26T19:45:40.301338] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-09-26T19:45:40.947183] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:45:40.995503] [INFO ] [REMOTE ] LAW: Fetching primary data for 2024-12. [2025-09-26T19:45:41.262639] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:45:41.326380] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2024-12. [2025-09-26T19:45:41.320797] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:45:41.336142] [INFO ] [REMOTE ] LB: Fetching primary data for 2024-12. [2025-09-26T19:45:41.472907] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:45:41.473293] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2024-12. [2025-09-26T19:45:42.200215] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-26T19:45:42.204953] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-09-26T19:45:42.677894] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-26T19:45:42.686066] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-09-26T19:45:42.941761] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-26T19:45:42.953029] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-09-26T19:45:42.995887] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-26T19:45:43.010154] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-09-26T19:45:43.040698] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-26T19:45:43.111722] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-09-26T19:45:44.127058] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-26T19:45:44.130985] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-09-26T19:45:44.273211] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-26T19:45:44.369000] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-26T19:45:44.711732] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-09-26T19:45:44.767369] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-26T19:45:44.800576] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-26T19:45:45.511729] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-09-26T19:45:46.315597] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-09-26T19:45:46.322621] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-26T19:45:46.970975] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-26T19:45:47.111720] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-09-26T19:45:47.915619] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-09-26T19:45:47.918466] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-26T19:45:48.005170] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-26T19:45:48.711715] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-09-26T19:45:49.291017] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-26T19:45:49.511761] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-09-26T19:45:50.285567] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-26T19:45:50.311682] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-09-26T19:45:51.111690] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-09-26T19:45:51.547703] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-26T19:45:51.835261] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T19:45:51.874928] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-26T19:45:51.911702] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-09-26T19:45:52.711730] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-09-26T19:45:53.511748] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-09-26T19:45:53.714633] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-26T19:45:54.304133] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-26T19:45:54.313889] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-09-26T19:45:55.009225] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-26T19:45:55.111752] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-09-26T19:45:55.303236] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-26T19:45:55.911722] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-09-26T19:45:56.703126] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-26T19:45:56.712183] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-09-26T19:45:57.226902] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-26T19:45:57.511716] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-09-26T19:45:57.627979] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-26T19:45:58.311744] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-09-26T19:45:59.111724] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-09-26T19:45:59.212772] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-26T19:45:59.921630] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-09-26T19:45:59.928779] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-26T19:46:00.048118] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-26T19:46:00.711743] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-09-26T19:46:01.511748] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-09-26T19:46:01.643742] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-26T19:46:02.311698] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-09-26T19:46:02.407381] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-26T19:46:02.607458] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-26T19:46:02.611167] [INFO ] [REMOTE ] LAW: Full fetch complete (20699 records). [2025-09-26T19:46:02.611257] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-09-26T19:46:03.006907] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-09-26T19:46:03.007005] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-09-26T19:46:03.007583] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-09-26T19:46:03.007689] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-09-26T19:46:03.008405] [DEBUG] [LOCAL ] LAW: Trimmed 20699 records to 14171 (keeping 200 days of data) [2025-09-26T19:46:03.089590] [DEBUG] [LOCAL ] LAW: Primary data saved (14171 records). [2025-09-26T19:46:03.089760] [INFO ] [MAIN ] LAW: Full history saved. [2025-09-26T19:46:03.089872] [INFO ] [MAIN ] Update Progress: 1241/2371 symbols completed. LAW took 25.2s. Estimated remaining: 2h 31m 9s. Rate: 7.5 symbols/min [2025-09-26T19:46:03.122238] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-09-26T19:46:03.278090] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:46:03.327858] [DEBUG] [LOCAL ] LC: Loaded 48267 existing records from primary storage. [2025-09-26T19:46:03.328061] [INFO ] [MAIN ] LC: Loaded 48267 existing records. [2025-09-26T19:46:03.523473] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:46:03.523855] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-09-26T19:46:03.523913] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-09-26T19:46:03.525314] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-09-26T19:46:03.525378] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-09-26T19:46:03.953717] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-09-26T19:46:03.959937] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:46:03.963535] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-26T19:46:04.711736] [INFO ] [REMOTE ] LC: Fetching primary data for 2024-12. [2025-09-26T19:46:04.764615] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-26T19:46:05.511744] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-09-26T19:46:05.754554] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-26T19:46:06.311743] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-09-26T19:46:06.396124] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-26T19:46:06.866739] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-26T19:46:06.875503] [INFO ] [REMOTE ] LAZ: Full fetch complete (65854 records). [2025-09-26T19:46:06.875698] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-09-26T19:46:07.120727] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-09-26T19:46:07.324300] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-09-26T19:46:07.324392] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-09-26T19:46:07.325381] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-09-26T19:46:07.325460] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-09-26T19:46:07.326974] [DEBUG] [LOCAL ] LAZ: Trimmed 65854 records to 45784 (keeping 200 days of data) [2025-09-26T19:46:07.641357] [DEBUG] [LOCAL ] LAZ: Primary data saved (45784 records). [2025-09-26T19:46:07.641516] [INFO ] [MAIN ] LAZ: Full history saved. [2025-09-26T19:46:07.641615] [INFO ] [MAIN ] Update Progress: 1242/2371 symbols completed. LAZ took 29.7s. Estimated remaining: 2h 30m 58s. Rate: 7.5 symbols/min [2025-09-26T19:46:07.864705] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:46:07.898998] [DEBUG] [LOCAL ] LCII: Loaded 28760 existing records from primary storage. [2025-09-26T19:46:07.899177] [INFO ] [MAIN ] LCII: Loaded 28760 existing records. [2025-09-26T19:46:07.928220] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-09-26T19:46:08.138253] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:46:08.138723] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-09-26T19:46:08.138834] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-09-26T19:46:08.139788] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-09-26T19:46:08.139856] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-09-26T19:46:08.367862] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-26T19:46:08.713092] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-09-26T19:46:08.828692] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:46:08.831312] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-26T19:46:08.840681] [INFO ] [REMOTE ] LB: Full fetch complete (55922 records). [2025-09-26T19:46:08.840883] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-09-26T19:46:09.372189] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-09-26T19:46:09.372288] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-09-26T19:46:09.373215] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-09-26T19:46:09.373348] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-09-26T19:46:09.374704] [DEBUG] [LOCAL ] LB: Trimmed 55922 records to 38116 (keeping 200 days of data) [2025-09-26T19:46:09.556607] [INFO ] [REMOTE ] LCII: Fetching primary data for 2024-12. [2025-09-26T19:46:09.629301] [DEBUG] [LOCAL ] LB: Primary data saved (38116 records). [2025-09-26T19:46:09.629488] [INFO ] [MAIN ] LB: Full history saved. [2025-09-26T19:46:09.629615] [INFO ] [MAIN ] Update Progress: 1243/2371 symbols completed. LB took 31.7s. Estimated remaining: 2h 30m 44s. Rate: 7.5 symbols/min [2025-09-26T19:46:09.852611] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:46:09.886195] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-26T19:46:09.942921] [DEBUG] [LOCAL ] LDI: Loaded 44397 existing records from primary storage. [2025-09-26T19:46:09.943074] [INFO ] [MAIN ] LDI: Loaded 44397 existing records. [2025-09-26T19:46:10.136628] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:46:10.136949] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-09-26T19:46:10.137008] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-09-26T19:46:10.137954] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-09-26T19:46:10.138017] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-09-26T19:46:10.351243] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-09-26T19:46:10.544595] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-26T19:46:10.569412] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:46:10.659665] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-26T19:46:11.111728] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-09-26T19:46:11.911722] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-09-26T19:46:12.193569] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-26T19:46:12.711711] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-09-26T19:46:12.787741] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-26T19:46:12.799083] [INFO ] [REMOTE ] LBRT: Full fetch complete (76531 records). [2025-09-26T19:46:12.799269] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-09-26T19:46:13.259731] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-09-26T19:46:13.260680] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-09-26T19:46:13.261717] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-26T19:46:13.267677] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-09-26T19:46:13.268632] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-09-26T19:46:13.270153] [DEBUG] [LOCAL ] LBRT: Trimmed 76531 records to 53695 (keeping 200 days of data) [2025-09-26T19:46:13.514322] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-09-26T19:46:13.617054] [DEBUG] [LOCAL ] LBRT: Primary data saved (53695 records). [2025-09-26T19:46:13.617216] [INFO ] [MAIN ] LBRT: Full history saved. [2025-09-26T19:46:13.617344] [INFO ] [MAIN ] Update Progress: 1244/2371 symbols completed. LBRT took 35.7s. Estimated remaining: 2h 30m 33s. Rate: 7.5 symbols/min [2025-09-26T19:46:13.821215] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:46:13.869802] [DEBUG] [LOCAL ] LDOS: Loaded 46091 existing records from primary storage. [2025-09-26T19:46:13.869958] [INFO ] [MAIN ] LDOS: Loaded 46091 existing records. [2025-09-26T19:46:14.082510] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:46:14.082784] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-09-26T19:46:14.082839] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-09-26T19:46:14.083964] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-09-26T19:46:14.084031] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-09-26T19:46:14.320681] [INFO ] [REMOTE ] LDI: Fetching primary data for 2024-12. [2025-09-26T19:46:14.518100] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:46:14.549878] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-26T19:46:14.722051] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-26T19:46:15.111768] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2024-12. [2025-09-26T19:46:15.596131] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-26T19:46:15.911734] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-09-26T19:46:16.711712] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-09-26T19:46:16.903991] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-26T19:46:17.511755] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-09-26T19:46:17.586796] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-26T19:46:18.157631] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-26T19:46:18.311721] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-09-26T19:46:18.655942] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-26T19:46:19.111721] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-09-26T19:46:19.911731] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-09-26T19:46:20.063985] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-26T19:46:20.318363] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-26T19:46:20.711719] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-09-26T19:46:21.280117] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-26T19:46:21.511738] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-09-26T19:46:22.228242] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T19:46:22.311727] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-09-26T19:46:23.111703] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-09-26T19:46:23.226681] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-26T19:46:23.841307] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-26T19:46:23.911712] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-09-26T19:46:24.369219] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-26T19:46:24.711732] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-09-26T19:46:25.511768] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-09-26T19:46:25.738825] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-26T19:46:25.823368] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-26T19:46:26.311718] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-09-26T19:46:27.111724] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-09-26T19:46:27.456550] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-26T19:46:27.525747] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-26T19:46:27.911732] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-09-26T19:46:28.711766] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-09-26T19:46:28.936012] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-26T19:46:29.511696] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-09-26T19:46:29.603427] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-26T19:46:29.981561] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-26T19:46:30.311758] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-09-26T19:46:31.111712] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-09-26T19:46:31.208782] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-26T19:46:31.218866] [INFO ] [REMOTE ] LC: Full fetch complete (70431 records). [2025-09-26T19:46:31.219068] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-09-26T19:46:31.677441] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-09-26T19:46:31.677542] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-09-26T19:46:31.678667] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-09-26T19:46:31.678757] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-09-26T19:46:31.680447] [DEBUG] [LOCAL ] LC: Trimmed 70431 records to 48605 (keeping 200 days of data) [2025-09-26T19:46:31.917733] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-09-26T19:46:31.991550] [DEBUG] [LOCAL ] LC: Primary data saved (48605 records). [2025-09-26T19:46:31.991738] [INFO ] [MAIN ] LC: Full history saved. [2025-09-26T19:46:31.993038] [INFO ] [MAIN ] Update Progress: 1245/2371 symbols completed. LC took 28.9s. Estimated remaining: 2h 30m 34s. Rate: 7.5 symbols/min [2025-09-26T19:46:32.185525] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:46:32.222754] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-26T19:46:32.244801] [DEBUG] [LOCAL ] LDP: Loaded 13041 existing records from primary storage. [2025-09-26T19:46:32.244953] [INFO ] [MAIN ] LDP: Loaded 13041 existing records. [2025-09-26T19:46:32.436918] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:46:32.437494] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-09-26T19:46:32.443844] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-09-26T19:46:32.457310] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-09-26T19:46:32.457423] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-09-26T19:46:32.578355] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-26T19:46:32.719394] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-09-26T19:46:32.865898] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:46:33.522291] [INFO ] [REMOTE ] LDP: Fetching primary data for 2024-12. [2025-09-26T19:46:33.528814] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-26T19:46:33.952835] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-26T19:46:33.957781] [INFO ] [REMOTE ] LCII: Full fetch complete (39096 records). [2025-09-26T19:46:33.957880] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-09-26T19:46:34.316693] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-09-26T19:46:34.353994] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-09-26T19:46:34.354183] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-09-26T19:46:34.355637] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-09-26T19:46:34.355880] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-09-26T19:46:34.371400] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-26T19:46:34.369915] [DEBUG] [LOCAL ] LCII: Trimmed 39096 records to 28900 (keeping 200 days of data) [2025-09-26T19:46:34.569914] [DEBUG] [LOCAL ] LCII: Primary data saved (28900 records). [2025-09-26T19:46:34.570097] [INFO ] [MAIN ] LCII: Full history saved. [2025-09-26T19:46:34.570226] [INFO ] [MAIN ] Update Progress: 1246/2371 symbols completed. LCII took 26.9s. Estimated remaining: 2h 30m 21s. Rate: 7.5 symbols/min [2025-09-26T19:46:34.745016] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:46:34.788437] [DEBUG] [LOCAL ] LEA: Loaded 42166 existing records from primary storage. [2025-09-26T19:46:34.788593] [INFO ] [MAIN ] LEA: Loaded 42166 existing records. [2025-09-26T19:46:34.970279] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:46:34.970560] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-09-26T19:46:34.970608] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-09-26T19:46:34.971565] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-09-26T19:46:34.971626] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-09-26T19:46:35.122152] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-09-26T19:46:35.372763] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:46:35.780541] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-26T19:46:35.911711] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-09-26T19:46:35.971901] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-26T19:46:36.711771] [INFO ] [REMOTE ] LEA: Fetching primary data for 2024-12. [2025-09-26T19:46:37.460719] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T19:46:37.511708] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-09-26T19:46:37.957809] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-26T19:46:38.311765] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-09-26T19:46:38.893362] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-26T19:46:39.111750] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-09-26T19:46:39.911713] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-09-26T19:46:39.990911] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-26T19:46:40.711726] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-09-26T19:46:40.815189] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-26T19:46:41.499267] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-26T19:46:41.511667] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-09-26T19:46:41.600940] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-26T19:46:42.311756] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-09-26T19:46:42.427924] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-26T19:46:43.111764] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-09-26T19:46:43.911725] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-09-26T19:46:44.613239] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-26T19:46:44.707308] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-09-26T19:46:44.717218] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-09-26T19:46:44.720279] [INFO ] [REMOTE ] LDI: Full fetch complete (60332 records). [2025-09-26T19:46:44.720466] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-09-26T19:46:45.184198] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-09-26T19:46:45.184340] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-09-26T19:46:45.186323] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-09-26T19:46:45.186437] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-09-26T19:46:45.191183] [DEBUG] [LOCAL ] LDI: Trimmed 60332 records to 44776 (keeping 200 days of data) [2025-09-26T19:46:45.398795] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-26T19:46:45.511974] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-09-26T19:46:45.523444] [DEBUG] [LOCAL ] LDI: Primary data saved (44776 records). [2025-09-26T19:46:45.523566] [INFO ] [MAIN ] LDI: Full history saved. [2025-09-26T19:46:45.523758] [INFO ] [MAIN ] Update Progress: 1247/2371 symbols completed. LDI took 35.9s. Estimated remaining: 2h 30m 16s. Rate: 7.5 symbols/min [2025-09-26T19:46:45.726319] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:46:45.740275] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-26T19:46:45.804011] [DEBUG] [LOCAL ] LEG: Loaded 50759 existing records from primary storage. [2025-09-26T19:46:45.804179] [INFO ] [MAIN ] LEG: Loaded 50759 existing records. [2025-09-26T19:46:46.007323] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:46:46.007711] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-09-26T19:46:46.007778] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-09-26T19:46:46.009053] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-09-26T19:46:46.009136] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-09-26T19:46:46.312992] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-09-26T19:46:46.398768] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:46:47.093495] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-26T19:46:47.111739] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-09-26T19:46:47.911724] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-09-26T19:46:47.987759] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-26T19:46:48.036739] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-26T19:46:48.711753] [INFO ] [REMOTE ] LEG: Fetching primary data for 2024-12. [2025-09-26T19:46:49.511698] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-09-26T19:46:49.554130] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-26T19:46:50.311729] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-09-26T19:46:50.460045] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-26T19:46:50.498507] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-26T19:46:51.111716] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-09-26T19:46:51.911694] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-09-26T19:46:51.991441] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-26T19:46:52.000832] [INFO ] [REMOTE ] LDOS: Full fetch complete (67729 records). [2025-09-26T19:46:52.001004] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-09-26T19:46:52.203676] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-26T19:46:52.436267] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-09-26T19:46:52.436593] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-09-26T19:46:52.437678] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-09-26T19:46:52.437745] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-09-26T19:46:52.441768] [DEBUG] [LOCAL ] LDOS: Trimmed 67729 records to 46407 (keeping 200 days of data) [2025-09-26T19:46:52.725724] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-09-26T19:46:52.753820] [DEBUG] [LOCAL ] LDOS: Primary data saved (46407 records). [2025-09-26T19:46:52.753991] [INFO ] [MAIN ] LDOS: Full history saved. [2025-09-26T19:46:52.754128] [INFO ] [MAIN ] Update Progress: 1248/2371 symbols completed. LDOS took 39.1s. Estimated remaining: 2h 30m 7s. Rate: 7.5 symbols/min [2025-09-26T19:46:52.939342] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:46:52.998938] [DEBUG] [LOCAL ] LEN: Loaded 53580 existing records from primary storage. [2025-09-26T19:46:52.999093] [INFO ] [MAIN ] LEN: Loaded 53580 existing records. [2025-09-26T19:46:53.200088] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:46:53.200537] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-09-26T19:46:53.200776] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-09-26T19:46:53.210098] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-09-26T19:46:53.215382] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-09-26T19:46:53.309180] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-26T19:46:53.523186] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-09-26T19:46:53.733190] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:46:54.311705] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-09-26T19:46:54.475554] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-26T19:46:54.548104] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-26T19:46:55.111747] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-09-26T19:46:55.911717] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-09-26T19:46:56.047126] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-26T19:46:56.051298] [INFO ] [REMOTE ] LDP: Full fetch complete (19438 records). [2025-09-26T19:46:56.051428] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-09-26T19:46:56.301059] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-26T19:46:56.524997] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-09-26T19:46:56.525088] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-09-26T19:46:56.525629] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-09-26T19:46:56.525757] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-09-26T19:46:56.526454] [DEBUG] [LOCAL ] LDP: Trimmed 19438 records to 13128 (keeping 200 days of data) [2025-09-26T19:46:56.625625] [DEBUG] [LOCAL ] LDP: Primary data saved (13128 records). [2025-09-26T19:46:56.625812] [INFO ] [MAIN ] LDP: Full history saved. [2025-09-26T19:46:56.625924] [INFO ] [MAIN ] Update Progress: 1249/2371 symbols completed. LDP took 24.6s. Estimated remaining: 2h 29m 55s. Rate: 7.5 symbols/min [2025-09-26T19:46:56.716846] [INFO ] [REMOTE ] LEN: Fetching primary data for 2024-12. [2025-09-26T19:46:56.824334] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:46:56.846959] [DEBUG] [LOCAL ] LEO: Loaded 17726 existing records from primary storage. [2025-09-26T19:46:56.847095] [INFO ] [MAIN ] LEO: Loaded 17726 existing records. [2025-09-26T19:46:57.054731] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:46:57.055032] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-09-26T19:46:57.055106] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-09-26T19:46:57.055718] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-09-26T19:46:57.055781] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-09-26T19:46:57.456945] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:46:57.522799] [INFO ] [REMOTE ] LEO: Fetching primary data for 2024-12. [2025-09-26T19:46:57.528939] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-26T19:46:58.311695] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-09-26T19:46:58.561767] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-26T19:46:58.708089] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-26T19:46:59.111752] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-09-26T19:46:59.911687] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-09-26T19:47:00.328704] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-26T19:47:00.537379] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-26T19:47:00.711735] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-09-26T19:47:01.511713] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-09-26T19:47:01.656518] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-26T19:47:02.311774] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-09-26T19:47:02.380676] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-26T19:47:02.565123] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-26T19:47:03.111771] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-09-26T19:47:03.911717] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-09-26T19:47:04.135087] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-26T19:47:04.711717] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-09-26T19:47:04.912104] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-26T19:47:05.168203] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-26T19:47:05.511719] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-09-26T19:47:06.311706] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-09-26T19:47:06.783494] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-26T19:47:06.824062] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-26T19:47:07.111724] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-09-26T19:47:07.311869] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-26T19:47:07.911715] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-09-26T19:47:08.711741] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-09-26T19:47:08.840120] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-26T19:47:09.511729] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-09-26T19:47:09.577726] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-26T19:47:09.586800] [INFO ] [REMOTE ] LEA: Full fetch complete (60973 records). [2025-09-26T19:47:09.587017] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-09-26T19:47:09.992826] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-09-26T19:47:09.992921] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-09-26T19:47:09.993855] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-09-26T19:47:09.993922] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-09-26T19:47:09.996292] [DEBUG] [LOCAL ] LEA: Trimmed 60973 records to 42464 (keeping 200 days of data) [2025-09-26T19:47:10.291942] [DEBUG] [LOCAL ] LEA: Primary data saved (42464 records). [2025-09-26T19:47:10.292107] [INFO ] [MAIN ] LEA: Full history saved. [2025-09-26T19:47:10.292234] [INFO ] [MAIN ] Update Progress: 1250/2371 symbols completed. LEA took 35.7s. Estimated remaining: 2h 29m 52s. Rate: 7.5 symbols/min [2025-09-26T19:47:10.314995] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-09-26T19:47:10.484154] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:47:10.551183] [DEBUG] [LOCAL ] LEVI: Loaded 51936 existing records from primary storage. [2025-09-26T19:47:10.551520] [INFO ] [MAIN ] LEVI: Loaded 51936 existing records. [2025-09-26T19:47:10.769812] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:47:10.772666] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-26T19:47:10.773047] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-09-26T19:47:10.775387] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-09-26T19:47:10.781343] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-09-26T19:47:10.781438] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-09-26T19:47:10.992452] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-26T19:47:11.119689] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-09-26T19:47:11.250564] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:47:11.911717] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-09-26T19:47:12.061909] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-26T19:47:12.141036] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-26T19:47:12.711754] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-09-26T19:47:13.511711] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2024-12. [2025-09-26T19:47:13.712720] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-26T19:47:13.823358] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-26T19:47:14.311763] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-09-26T19:47:15.016041] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-26T19:47:15.111719] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-09-26T19:47:15.268748] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-26T19:47:15.911726] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-09-26T19:47:16.711773] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-09-26T19:47:16.813801] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-26T19:47:17.511756] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-09-26T19:47:17.787409] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-26T19:47:17.819910] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-26T19:47:18.311769] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-09-26T19:47:19.111890] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-09-26T19:47:19.357805] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-26T19:47:19.361546] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-26T19:47:19.375764] [INFO ] [REMOTE ] LEO: Full fetch complete (27132 records). [2025-09-26T19:47:19.376610] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-09-26T19:47:19.413281] [INFO ] [REMOTE ] LEG: Full fetch complete (73208 records). [2025-09-26T19:47:19.424037] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-09-26T19:47:19.935773] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-09-26T19:47:20.248962] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-09-26T19:47:20.273210] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-09-26T19:47:20.273080] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-09-26T19:47:20.273916] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-09-26T19:47:20.274001] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-09-26T19:47:20.274077] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-09-26T19:47:20.275041] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-09-26T19:47:20.275127] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-09-26T19:47:20.276216] [DEBUG] [LOCAL ] LEO: Trimmed 27132 records to 17785 (keeping 200 days of data) [2025-09-26T19:47:20.277713] [DEBUG] [LOCAL ] LEG: Trimmed 73208 records to 51130 (keeping 200 days of data) [2025-09-26T19:47:20.493115] [DEBUG] [LOCAL ] LEO: Primary data saved (17785 records). [2025-09-26T19:47:20.510137] [INFO ] [MAIN ] LEO: Full history saved. [2025-09-26T19:47:20.518844] [INFO ] [MAIN ] Update Progress: 1251/2371 symbols completed. LEO took 23.9s. Estimated remaining: 2h 29m 46s. Rate: 7.5 symbols/min [2025-09-26T19:47:20.986454] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:47:21.045023] [DEBUG] [LOCAL ] LFT: Loaded 18180 existing records from primary storage. [2025-09-26T19:47:21.046568] [INFO ] [MAIN ] LFT: Loaded 18180 existing records. [2025-09-26T19:47:21.054048] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-26T19:47:21.127947] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-09-26T19:47:21.154319] [DEBUG] [LOCAL ] LEG: Primary data saved (51130 records). [2025-09-26T19:47:21.161968] [INFO ] [MAIN ] LEG: Full history saved. [2025-09-26T19:47:21.162214] [INFO ] [MAIN ] Update Progress: 1252/2371 symbols completed. LEG took 35.6s. Estimated remaining: 2h 29m 32s. Rate: 7.5 symbols/min [2025-09-26T19:47:21.411418] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:47:21.417072] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-09-26T19:47:21.427383] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-09-26T19:47:21.476114] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-09-26T19:47:21.475971] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:47:21.476548] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-09-26T19:47:21.696005] [DEBUG] [LOCAL ] LGI: Loaded 10065 existing records from primary storage. [2025-09-26T19:47:21.723585] [INFO ] [MAIN ] LGI: Loaded 10065 existing records. [2025-09-26T19:47:22.150526] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:47:22.169136] [INFO ] [REMOTE ] LFT: Fetching primary data for 2024-12. [2025-09-26T19:47:22.196549] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:47:22.197799] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-09-26T19:47:22.198359] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-09-26T19:47:22.204305] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-26T19:47:22.216197] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-09-26T19:47:22.216556] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-09-26T19:47:22.318715] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-09-26T19:47:22.630481] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:47:22.910622] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-26T19:47:23.111709] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-09-26T19:47:23.326851] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-26T19:47:23.911766] [INFO ] [REMOTE ] LGI: Fetching primary data for 2024-12. [2025-09-26T19:47:24.358860] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-26T19:47:24.716861] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-09-26T19:47:24.737971] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-26T19:47:24.843066] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-26T19:47:25.511759] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-09-26T19:47:26.311806] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-09-26T19:47:26.409884] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-26T19:47:26.857478] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-26T19:47:26.869089] [INFO ] [REMOTE ] LEN: Full fetch complete (77032 records). [2025-09-26T19:47:26.869300] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-09-26T19:47:27.116074] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-09-26T19:47:27.197090] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-26T19:47:27.300308] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-09-26T19:47:27.300422] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-09-26T19:47:27.301516] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-09-26T19:47:27.301634] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-09-26T19:47:27.303912] [DEBUG] [LOCAL ] LEN: Trimmed 77032 records to 53967 (keeping 200 days of data) [2025-09-26T19:47:27.673311] [DEBUG] [LOCAL ] LEN: Primary data saved (53967 records). [2025-09-26T19:47:27.673551] [INFO ] [MAIN ] LEN: Full history saved. [2025-09-26T19:47:27.673763] [INFO ] [MAIN ] Update Progress: 1253/2371 symbols completed. LEN took 34.9s. Estimated remaining: 2h 29m 22s. Rate: 7.5 symbols/min [2025-09-26T19:47:27.860756] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:47:27.900837] [DEBUG] [LOCAL ] LH: Loaded 38437 existing records from primary storage. [2025-09-26T19:47:27.901001] [INFO ] [MAIN ] LH: Loaded 38437 existing records. [2025-09-26T19:47:27.916829] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-09-26T19:47:28.024273] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-26T19:47:28.115420] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:47:28.115761] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-09-26T19:47:28.115835] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-09-26T19:47:28.116890] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-09-26T19:47:28.116954] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-09-26T19:47:28.514609] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:47:28.711738] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-09-26T19:47:28.813416] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-26T19:47:29.511720] [INFO ] [REMOTE ] LH: Fetching primary data for 2024-12. [2025-09-26T19:47:30.311713] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-09-26T19:47:30.569869] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-26T19:47:30.930245] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-26T19:47:30.956326] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-26T19:47:31.111720] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-09-26T19:47:31.911728] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-09-26T19:47:32.180320] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-26T19:47:32.711737] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-09-26T19:47:32.900352] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-26T19:47:33.511726] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-09-26T19:47:34.223740] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-26T19:47:34.311709] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-09-26T19:47:34.524563] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-26T19:47:35.111741] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-09-26T19:47:35.878047] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-26T19:47:35.911691] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-09-26T19:47:35.977425] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-26T19:47:36.711742] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-09-26T19:47:37.511717] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-09-26T19:47:37.526380] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-26T19:47:37.608699] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-26T19:47:38.311715] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-09-26T19:47:38.651164] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-26T19:47:39.111729] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-09-26T19:47:39.771637] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-26T19:47:39.905681] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-26T19:47:39.911638] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-09-26T19:47:40.438795] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-26T19:47:40.711746] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-09-26T19:47:41.511712] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-09-26T19:47:42.311686] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-09-26T19:47:42.420756] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-26T19:47:42.529843] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-26T19:47:43.053225] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-26T19:47:43.111725] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-09-26T19:47:43.911719] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-09-26T19:47:44.711698] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-09-26T19:47:44.804036] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-26T19:47:44.915748] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-26T19:47:44.919215] [INFO ] [REMOTE ] LFT: Full fetch complete (23981 records). [2025-09-26T19:47:44.919308] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-09-26T19:47:45.300296] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-09-26T19:47:45.300386] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-09-26T19:47:45.300922] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-09-26T19:47:45.300986] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-09-26T19:47:45.301718] [DEBUG] [LOCAL ] LFT: Trimmed 23981 records to 18286 (keeping 200 days of data) [2025-09-26T19:47:45.404341] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-26T19:47:45.434885] [DEBUG] [LOCAL ] LFT: Primary data saved (18286 records). [2025-09-26T19:47:45.435052] [INFO ] [MAIN ] LFT: Full history saved. [2025-09-26T19:47:45.435143] [INFO ] [MAIN ] Update Progress: 1254/2371 symbols completed. LFT took 24.9s. Estimated remaining: 2h 29m 23s. Rate: 7.5 symbols/min [2025-09-26T19:47:45.516909] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-09-26T19:47:45.626751] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:47:45.687927] [DEBUG] [LOCAL ] LHX: Loaded 49078 existing records from primary storage. [2025-09-26T19:47:45.688075] [INFO ] [MAIN ] LHX: Loaded 49078 existing records. [2025-09-26T19:47:45.880771] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:47:45.881084] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-09-26T19:47:45.881134] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-09-26T19:47:45.882352] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-09-26T19:47:45.882415] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-09-26T19:47:46.268448] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:47:46.311727] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-09-26T19:47:46.530608] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-26T19:47:46.532793] [INFO ] [REMOTE ] LGI: Full fetch complete (14336 records). [2025-09-26T19:47:46.532870] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-09-26T19:47:46.922061] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-09-26T19:47:46.922145] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-09-26T19:47:46.922549] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-09-26T19:47:46.922663] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-09-26T19:47:46.923689] [DEBUG] [LOCAL ] LGI: Trimmed 14336 records to 10137 (keeping 200 days of data) [2025-09-26T19:47:46.989962] [DEBUG] [LOCAL ] LGI: Primary data saved (10137 records). [2025-09-26T19:47:46.990108] [INFO ] [MAIN ] LGI: Full history saved. [2025-09-26T19:47:46.990197] [INFO ] [MAIN ] Update Progress: 1255/2371 symbols completed. LGI took 25.8s. Estimated remaining: 2h 29m 9s. Rate: 7.5 symbols/min [2025-09-26T19:47:47.116938] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-09-26T19:47:47.177637] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:47:47.206954] [DEBUG] [LOCAL ] LII: Loaded 28514 existing records from primary storage. [2025-09-26T19:47:47.207118] [INFO ] [MAIN ] LII: Loaded 28514 existing records. [2025-09-26T19:47:47.399169] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:47:47.399532] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-09-26T19:47:47.399588] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-09-26T19:47:47.400367] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-09-26T19:47:47.400429] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-09-26T19:47:47.820727] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:47:47.911723] [INFO ] [REMOTE ] LII: Fetching primary data for 2024-12. [2025-09-26T19:47:48.260097] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-26T19:47:48.687573] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-26T19:47:48.711690] [INFO ] [REMOTE ] LHX: Fetching primary data for 2024-12. [2025-09-26T19:47:48.751399] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-26T19:47:49.511727] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-09-26T19:47:50.311695] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-09-26T19:47:50.428856] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-26T19:47:51.111714] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-09-26T19:47:51.178190] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-26T19:47:51.891815] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-26T19:47:51.911671] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-09-26T19:47:52.527367] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-26T19:47:52.711726] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-09-26T19:47:53.511752] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-09-26T19:47:53.662564] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-26T19:47:54.321859] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-09-26T19:47:54.349399] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-26T19:47:55.111699] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-09-26T19:47:55.179369] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-26T19:47:55.189847] [INFO ] [REMOTE ] LEVI: Full fetch complete (74460 records). [2025-09-26T19:47:55.190013] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-09-26T19:47:55.611851] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-09-26T19:47:55.612013] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-09-26T19:47:55.613849] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-09-26T19:47:55.614001] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-09-26T19:47:55.615880] [DEBUG] [LOCAL ] LEVI: Trimmed 74460 records to 52306 (keeping 200 days of data) [2025-09-26T19:47:55.858491] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-26T19:47:55.930623] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-09-26T19:47:55.982045] [DEBUG] [LOCAL ] LEVI: Primary data saved (52306 records). [2025-09-26T19:47:55.982227] [INFO ] [MAIN ] LEVI: Full history saved. [2025-09-26T19:47:55.982359] [INFO ] [MAIN ] Update Progress: 1256/2371 symbols completed. LEVI took 45.7s. Estimated remaining: 2h 29m 2s. Rate: 7.5 symbols/min [2025-09-26T19:47:56.170705] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:47:56.212876] [DEBUG] [LOCAL ] LION: Loaded 43618 existing records from primary storage. [2025-09-26T19:47:56.213028] [INFO ] [MAIN ] LION: Loaded 43618 existing records. [2025-09-26T19:47:56.407300] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:47:56.407626] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-09-26T19:47:56.407719] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-09-26T19:47:56.408539] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-09-26T19:47:56.408599] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-09-26T19:47:56.718182] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-09-26T19:47:56.816805] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:47:56.846547] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-26T19:47:57.374486] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-26T19:47:57.511714] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-09-26T19:47:58.141780] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-26T19:47:58.311734] [INFO ] [REMOTE ] LION: Fetching primary data for 2024-12. [2025-09-26T19:47:59.111721] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-09-26T19:47:59.325587] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-26T19:47:59.406101] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-26T19:47:59.911723] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-09-26T19:48:00.520495] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-26T19:48:00.526609] [INFO ] [REMOTE ] LH: Full fetch complete (54877 records). [2025-09-26T19:48:00.526828] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-09-26T19:48:00.719638] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-09-26T19:48:00.935796] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-09-26T19:48:00.935882] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-09-26T19:48:00.936774] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-09-26T19:48:00.936852] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-09-26T19:48:00.938152] [DEBUG] [LOCAL ] LH: Trimmed 54877 records to 38660 (keeping 200 days of data) [2025-09-26T19:48:01.197512] [DEBUG] [LOCAL ] LH: Primary data saved (38660 records). [2025-09-26T19:48:01.198369] [INFO ] [MAIN ] LH: Full history saved. [2025-09-26T19:48:01.198780] [INFO ] [MAIN ] Update Progress: 1257/2371 symbols completed. LH took 33.5s. Estimated remaining: 2h 28m 52s. Rate: 7.5 symbols/min [2025-09-26T19:48:01.394076] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:48:01.402567] [DEBUG] [LOCAL ] LITB: Loaded 4406 existing records from primary storage. [2025-09-26T19:48:01.402766] [INFO ] [MAIN ] LITB: Loaded 4406 existing records. [2025-09-26T19:48:01.513413] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-09-26T19:48:01.630046] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:48:01.633069] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T19:48:01.633146] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-09-26T19:48:01.644202] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-09-26T19:48:01.644804] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-09-26T19:48:01.644939] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-09-26T19:48:01.772506] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-26T19:48:02.114386] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:48:02.311724] [INFO ] [REMOTE ] LITB: Fetching primary data for 2024-12. [2025-09-26T19:48:02.838242] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-26T19:48:03.111728] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-09-26T19:48:03.402991] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-26T19:48:03.911725] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-09-26T19:48:04.169253] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-26T19:48:04.487491] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-26T19:48:04.711724] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-09-26T19:48:05.511722] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-09-26T19:48:05.954157] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-26T19:48:05.995743] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-26T19:48:06.311728] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-09-26T19:48:07.111714] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-09-26T19:48:07.691689] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-26T19:48:07.828460] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-26T19:48:07.911719] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-09-26T19:48:08.711720] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-09-26T19:48:09.200010] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-26T19:48:09.511733] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-09-26T19:48:10.056339] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-26T19:48:10.120134] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-26T19:48:10.311754] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-09-26T19:48:11.111778] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-09-26T19:48:11.502674] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-26T19:48:11.748921] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-26T19:48:11.911797] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-09-26T19:48:12.711791] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-09-26T19:48:13.190222] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-26T19:48:13.511795] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-09-26T19:48:13.963555] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-26T19:48:14.311705] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-09-26T19:48:14.718196] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-26T19:48:15.111808] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-09-26T19:48:15.911758] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-09-26T19:48:16.053513] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-26T19:48:16.711744] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-09-26T19:48:17.095906] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-26T19:48:17.408751] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-26T19:48:17.414757] [INFO ] [REMOTE ] LII: Full fetch complete (41271 records). [2025-09-26T19:48:17.414884] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-09-26T19:48:17.501912] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-26T19:48:17.521052] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-09-26T19:48:17.838280] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-09-26T19:48:17.838407] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-09-26T19:48:17.839286] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-09-26T19:48:17.839357] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-09-26T19:48:17.840546] [DEBUG] [LOCAL ] LII: Trimmed 41271 records to 28648 (keeping 200 days of data) [2025-09-26T19:48:18.031618] [DEBUG] [LOCAL ] LII: Primary data saved (28648 records). [2025-09-26T19:48:18.031807] [INFO ] [MAIN ] LII: Full history saved. [2025-09-26T19:48:18.031924] [INFO ] [MAIN ] Update Progress: 1258/2371 symbols completed. LII took 31.0s. Estimated remaining: 2h 28m 51s. Rate: 7.5 symbols/min [2025-09-26T19:48:18.222612] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:48:18.285889] [DEBUG] [LOCAL ] LLY: Loaded 53678 existing records from primary storage. [2025-09-26T19:48:18.286122] [INFO ] [MAIN ] LLY: Loaded 53678 existing records. [2025-09-26T19:48:18.320186] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-09-26T19:48:18.486191] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:48:18.486444] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-09-26T19:48:18.486512] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-09-26T19:48:18.488498] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-09-26T19:48:18.488562] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-09-26T19:48:18.882155] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:48:19.111763] [INFO ] [REMOTE ] LLY: Fetching primary data for 2024-12. [2025-09-26T19:48:19.397150] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-26T19:48:19.911771] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-09-26T19:48:20.075791] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-26T19:48:20.711746] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-09-26T19:48:21.420148] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-26T19:48:21.511760] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-09-26T19:48:21.642560] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-26T19:48:22.311743] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-09-26T19:48:22.620377] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-26T19:48:23.111776] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-09-26T19:48:23.611601] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-26T19:48:23.911743] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-09-26T19:48:24.034284] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-09-26T19:48:24.154675] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-26T19:48:24.164907] [INFO ] [REMOTE ] LHX: Full fetch complete (70803 records). [2025-09-26T19:48:24.165097] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-09-26T19:48:24.526447] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-26T19:48:24.578929] [INFO ] [REMOTE ] LITB: Full fetch complete (5636 records). [2025-09-26T19:48:24.590550] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-09-26T19:48:24.717029] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-09-26T19:48:24.741782] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-09-26T19:48:24.755633] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-09-26T19:48:24.757504] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-09-26T19:48:24.768638] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-09-26T19:48:24.839770] [DEBUG] [LOCAL ] LHX: Trimmed 70803 records to 49413 (keeping 200 days of data) [2025-09-26T19:48:25.262684] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-09-26T19:48:25.289194] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-09-26T19:48:25.303684] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-09-26T19:48:25.316479] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-09-26T19:48:25.330313] [DEBUG] [LOCAL ] LITB: Trimmed 5636 records to 4436 (keeping 200 days of data) [2025-09-26T19:48:25.426861] [DEBUG] [LOCAL ] LHX: Primary data saved (49413 records). [2025-09-26T19:48:25.427727] [INFO ] [MAIN ] LHX: Full history saved. [2025-09-26T19:48:25.429189] [INFO ] [MAIN ] Update Progress: 1259/2371 symbols completed. LHX took 40.0s. Estimated remaining: 2h 28m 43s. Rate: 7.5 symbols/min [2025-09-26T19:48:25.523393] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-09-26T19:48:25.523774] [DEBUG] [LOCAL ] LITB: Primary data saved (4436 records). [2025-09-26T19:48:25.538918] [INFO ] [MAIN ] LITB: Full history saved. [2025-09-26T19:48:25.551781] [INFO ] [MAIN ] Update Progress: 1260/2371 symbols completed. LITB took 24.4s. Estimated remaining: 2h 28m 28s. Rate: 7.5 symbols/min [2025-09-26T19:48:25.740776] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:48:25.827641] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:48:25.897305] [DEBUG] [LOCAL ] LMND: Loaded 52260 existing records from primary storage. [2025-09-26T19:48:25.897559] [INFO ] [MAIN ] LMND: Loaded 52260 existing records. [2025-09-26T19:48:26.049009] [DEBUG] [LOCAL ] LMT: Loaded 50266 existing records from primary storage. [2025-09-26T19:48:26.067955] [INFO ] [MAIN ] LMT: Loaded 50266 existing records. [2025-09-26T19:48:26.211593] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:48:26.223869] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-09-26T19:48:26.234578] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-09-26T19:48:26.263120] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-09-26T19:48:26.273755] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-09-26T19:48:26.375725] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:48:26.404468] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-09-26T19:48:26.431844] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-09-26T19:48:26.442733] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-09-26T19:48:26.448064] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-09-26T19:48:27.088431] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:48:27.110208] [INFO ] [REMOTE ] LMND: Fetching primary data for 2024-12. [2025-09-26T19:48:27.211154] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:48:27.211875] [INFO ] [REMOTE ] LMT: Fetching primary data for 2024-12. [2025-09-26T19:48:27.248355] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.53 seconds). [2025-09-26T19:48:27.513812] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-26T19:48:27.911769] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-09-26T19:48:28.711737] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-09-26T19:48:29.294734] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-26T19:48:29.436993] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-26T19:48:29.511687] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-09-26T19:48:29.730132] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-26T19:48:29.740242] [INFO ] [REMOTE ] LION: Full fetch complete (54496 records). [2025-09-26T19:48:29.740398] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-09-26T19:48:30.137460] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-09-26T19:48:30.137661] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-09-26T19:48:30.139065] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-09-26T19:48:30.139151] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-09-26T19:48:30.140845] [DEBUG] [LOCAL ] LION: Trimmed 54496 records to 43950 (keeping 200 days of data) [2025-09-26T19:48:30.316120] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-09-26T19:48:30.402744] [DEBUG] [LOCAL ] LION: Primary data saved (43950 records). [2025-09-26T19:48:30.402951] [INFO ] [MAIN ] LION: Full history saved. [2025-09-26T19:48:30.403065] [INFO ] [MAIN ] Update Progress: 1261/2371 symbols completed. LION took 34.4s. Estimated remaining: 2h 28m 17s. Rate: 7.5 symbols/min [2025-09-26T19:48:30.582059] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:48:30.635371] [DEBUG] [LOCAL ] LNC: Loaded 51993 existing records from primary storage. [2025-09-26T19:48:30.635584] [INFO ] [MAIN ] LNC: Loaded 51993 existing records. [2025-09-26T19:48:30.834573] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:48:30.835079] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-09-26T19:48:30.835154] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-09-26T19:48:30.836427] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-09-26T19:48:30.836501] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-09-26T19:48:31.238943] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:48:31.239417] [INFO ] [REMOTE ] LNC: Fetching primary data for 2024-12. [2025-09-26T19:48:31.283201] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-09-26T19:48:31.525564] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-26T19:48:31.911685] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-09-26T19:48:32.281732] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-26T19:48:32.711721] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-09-26T19:48:33.036483] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T19:48:33.511767] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-09-26T19:48:34.034768] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-26T19:48:34.311713] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-09-26T19:48:34.630845] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-26T19:48:35.111759] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-09-26T19:48:35.819997] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-26T19:48:35.911702] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-09-26T19:48:36.014483] [DEBUG] [REMOTE ] LMT: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-09-26T19:48:36.016505] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-09-26T19:48:36.016601] [WARN ] [REMOTE ] LMT: No data returned for month 2025-03 [2025-09-26T19:48:36.711717] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-09-26T19:48:37.001981] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-26T19:48:37.511732] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-09-26T19:48:38.311703] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-09-26T19:48:38.345416] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T19:48:39.111728] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-09-26T19:48:39.581973] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-26T19:48:39.911722] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-09-26T19:48:40.496935] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-26T19:48:40.711723] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-09-26T19:48:41.511708] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-09-26T19:48:41.850041] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-26T19:48:41.894396] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.78 seconds). [2025-09-26T19:48:42.311697] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-09-26T19:48:42.433722] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-26T19:48:43.111737] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-09-26T19:48:43.286305] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-26T19:48:43.911724] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-09-26T19:48:44.450335] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-26T19:48:44.711739] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-09-26T19:48:45.380948] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-09-26T19:48:45.511735] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-09-26T19:48:45.559193] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-26T19:48:46.311728] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-09-26T19:48:47.111740] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-09-26T19:48:47.333977] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.62 seconds). [2025-09-26T19:48:47.911733] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-09-26T19:48:48.004146] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-26T19:48:48.509595] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-26T19:48:48.711723] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-09-26T19:48:49.511742] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-09-26T19:48:50.525618] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-09-26T19:48:50.537856] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-09-26T19:48:50.942463] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-26T19:48:51.111682] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-09-26T19:48:51.215982] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-26T19:48:51.911710] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-09-26T19:48:52.894358] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (5.78 seconds). [2025-09-26T19:48:52.905638] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-09-26T19:48:53.296457] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.76 seconds). [2025-09-26T19:48:53.366437] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-26T19:48:53.377059] [INFO ] [REMOTE ] LMT: Full fetch complete (64748 records). [2025-09-26T19:48:53.377204] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-09-26T19:48:53.516951] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-09-26T19:48:53.588939] [WARN ] [VALIDATOR ] LMT: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-26T19:48:53.590219] [FATAL] [MAIN ] LMT: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:48:53.590300] [WARN ] [MAIN ] LMT: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:48:53.590354] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-09-26T19:48:53.590415] [DEBUG] [LOCAL ] LMT: No primary data file found to delete. [2025-09-26T19:48:53.590453] [INFO ] [LOCAL ] LMT: Starting deletion of derivative data. [2025-09-26T19:48:53.590928] [DEBUG] [LOCAL ] LMT: Deleted derivative data file. [2025-09-26T19:48:53.591068] [INFO ] [MAIN ] Update Progress: 1262/2371 symbols completed. LMT took 28.0s. Estimated remaining: 2h 28m 22s. Rate: 7.5 symbols/min [2025-09-26T19:48:53.772060] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:48:53.779513] [DEBUG] [LOCAL ] LND: Loaded 4991 existing records from primary storage. [2025-09-26T19:48:53.779619] [INFO ] [MAIN ] LND: Loaded 4991 existing records. [2025-09-26T19:48:53.970674] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:48:53.971165] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-09-26T19:48:53.971225] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-09-26T19:48:53.971482] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-09-26T19:48:53.971544] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-09-26T19:48:54.378850] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:48:54.379592] [INFO ] [REMOTE ] LND: Fetching primary data for 2024-12. [2025-09-26T19:48:54.411135] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-09-26T19:48:54.422481] [INFO ] [REMOTE ] LMND: Full fetch complete (75295 records). [2025-09-26T19:48:54.422769] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-09-26T19:48:54.888678] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-09-26T19:48:54.891672] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-26T19:48:54.891804] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-09-26T19:48:54.902889] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-09-26T19:48:54.902979] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-09-26T19:48:54.905103] [DEBUG] [LOCAL ] LMND: Trimmed 75295 records to 52647 (keeping 200 days of data) [2025-09-26T19:48:55.112102] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-09-26T19:48:55.231113] [DEBUG] [LOCAL ] LMND: Primary data saved (52647 records). [2025-09-26T19:48:55.231347] [INFO ] [MAIN ] LMND: Full history saved. [2025-09-26T19:48:55.231455] [INFO ] [MAIN ] Update Progress: 1263/2371 symbols completed. LMND took 29.8s. Estimated remaining: 2h 28m 9s. Rate: 7.5 symbols/min [2025-09-26T19:48:55.358738] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-26T19:48:55.427921] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:48:55.480898] [DEBUG] [LOCAL ] LNG: Loaded 51871 existing records from primary storage. [2025-09-26T19:48:55.481048] [INFO ] [MAIN ] LNG: Loaded 51871 existing records. [2025-09-26T19:48:55.670029] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:48:55.670364] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-09-26T19:48:55.670414] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-09-26T19:48:55.671727] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-09-26T19:48:55.671792] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-09-26T19:48:55.915757] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-09-26T19:48:56.077820] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:48:56.339345] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.82 seconds). [2025-09-26T19:48:56.352319] [INFO ] [REMOTE ] LLY: Full fetch complete (77259 records). [2025-09-26T19:48:56.352542] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-09-26T19:48:56.714750] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-26T19:48:56.714941] [INFO ] [REMOTE ] LNG: Fetching primary data for 2024-12. [2025-09-26T19:48:56.812363] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-09-26T19:48:56.812536] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-09-26T19:48:56.814034] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-09-26T19:48:56.814195] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-09-26T19:48:56.818323] [DEBUG] [LOCAL ] LLY: Trimmed 77259 records to 54064 (keeping 200 days of data) [2025-09-26T19:48:57.113925] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-26T19:48:57.259404] [DEBUG] [LOCAL ] LLY: Primary data saved (54064 records). [2025-09-26T19:48:57.259570] [INFO ] [MAIN ] LLY: Full history saved. [2025-09-26T19:48:57.260958] [INFO ] [MAIN ] Update Progress: 1264/2371 symbols completed. LLY took 39.2s. Estimated remaining: 2h 27m 55s. Rate: 7.5 symbols/min [2025-09-26T19:48:57.441176] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:48:57.455666] [DEBUG] [LOCAL ] LNN: Loaded 11349 existing records from primary storage. [2025-09-26T19:48:57.455807] [INFO ] [MAIN ] LNN: Loaded 11349 existing records. [2025-09-26T19:48:57.522296] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-09-26T19:48:57.652004] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:48:57.652734] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-09-26T19:48:57.652794] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-09-26T19:48:57.653608] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-09-26T19:48:57.653712] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-09-26T19:48:58.022734] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:48:58.307249] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-26T19:48:58.311670] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-09-26T19:48:58.650696] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-26T19:48:59.000359] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-26T19:48:59.111744] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-09-26T19:48:59.747215] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-26T19:48:59.911721] [INFO ] [REMOTE ] LNN: Fetching primary data for 2024-12. [2025-09-26T19:49:00.711731] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-09-26T19:49:00.907692] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-26T19:49:01.511719] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-09-26T19:49:02.112089] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-26T19:49:02.311714] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-09-26T19:49:02.558687] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-26T19:49:02.954970] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-26T19:49:03.111708] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-09-26T19:49:03.911725] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-09-26T19:49:04.100277] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-26T19:49:04.711727] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-09-26T19:49:05.511736] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-09-26T19:49:05.521260] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-26T19:49:06.135122] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-26T19:49:06.145859] [INFO ] [REMOTE ] LNC: Full fetch complete (74118 records). [2025-09-26T19:49:06.146044] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-09-26T19:49:06.314742] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-09-26T19:49:06.450321] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-26T19:49:06.609503] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-09-26T19:49:06.609622] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-09-26T19:49:06.610781] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-09-26T19:49:06.610850] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-09-26T19:49:06.613685] [DEBUG] [LOCAL ] LNC: Trimmed 74118 records to 52369 (keeping 200 days of data) [2025-09-26T19:49:06.951044] [DEBUG] [LOCAL ] LNC: Primary data saved (52369 records). [2025-09-26T19:49:06.951192] [INFO ] [MAIN ] LNC: Full history saved. [2025-09-26T19:49:06.951283] [INFO ] [MAIN ] Update Progress: 1265/2371 symbols completed. LNC took 36.5s. Estimated remaining: 2h 27m 49s. Rate: 7.5 symbols/min [2025-09-26T19:49:07.115350] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-09-26T19:49:07.136569] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:49:07.182188] [DEBUG] [LOCAL ] LOAR: Loaded 41940 existing records from primary storage. [2025-09-26T19:49:07.182362] [INFO ] [MAIN ] LOAR: Loaded 41940 existing records. [2025-09-26T19:49:07.413415] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:49:07.413772] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-09-26T19:49:07.413845] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-09-26T19:49:07.414775] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-09-26T19:49:07.414839] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-09-26T19:49:07.830182] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:49:07.831164] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-26T19:49:07.911704] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-09-26T19:49:08.536798] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-09-26T19:49:08.541600] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-26T19:49:08.711733] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2024-12. [2025-09-26T19:49:09.511777] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-09-26T19:49:10.130852] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-26T19:49:10.311730] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-09-26T19:49:10.507710] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-26T19:49:11.111756] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-09-26T19:49:11.711472] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-26T19:49:11.881715] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-26T19:49:11.911698] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-09-26T19:49:12.711704] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-09-26T19:49:12.906204] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-26T19:49:13.173883] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-26T19:49:13.175329] [INFO ] [REMOTE ] LND: Full fetch complete (8608 records). [2025-09-26T19:49:13.175404] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-09-26T19:49:13.516843] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-09-26T19:49:13.588492] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-09-26T19:49:13.588571] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-09-26T19:49:13.588831] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-09-26T19:49:13.588896] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-09-26T19:49:13.589442] [DEBUG] [LOCAL ] LND: Trimmed 8608 records to 5013 (keeping 200 days of data) [2025-09-26T19:49:13.621610] [DEBUG] [LOCAL ] LND: Primary data saved (5013 records). [2025-09-26T19:49:13.621745] [INFO ] [MAIN ] LND: Full history saved. [2025-09-26T19:49:13.621897] [INFO ] [MAIN ] Update Progress: 1266/2371 symbols completed. LND took 20.0s. Estimated remaining: 2h 27m 40s. Rate: 7.5 symbols/min [2025-09-26T19:49:13.799401] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:49:13.847879] [DEBUG] [LOCAL ] LOB: Loaded 27742 existing records from primary storage. [2025-09-26T19:49:13.848042] [INFO ] [MAIN ] LOB: Loaded 27742 existing records. [2025-09-26T19:49:14.030347] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:49:14.030711] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-09-26T19:49:14.030785] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-09-26T19:49:14.031461] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-09-26T19:49:14.031527] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-09-26T19:49:14.318626] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-09-26T19:49:14.431867] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:49:14.749232] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-26T19:49:15.111752] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-09-26T19:49:15.911719] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-09-26T19:49:16.391457] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-26T19:49:16.606270] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-26T19:49:16.711707] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-09-26T19:49:16.742939] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-26T19:49:17.511737] [INFO ] [REMOTE ] LOB: Fetching primary data for 2024-12. [2025-09-26T19:49:18.311725] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-09-26T19:49:18.502932] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-26T19:49:18.533078] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-26T19:49:18.916927] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-26T19:49:18.919627] [INFO ] [REMOTE ] LNN: Full fetch complete (15564 records). [2025-09-26T19:49:18.919783] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-09-26T19:49:19.122224] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-09-26T19:49:19.323997] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-09-26T19:49:19.324168] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-09-26T19:49:19.324833] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-09-26T19:49:19.324902] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-09-26T19:49:19.325543] [DEBUG] [LOCAL ] LNN: Trimmed 15564 records to 11404 (keeping 200 days of data) [2025-09-26T19:49:19.420742] [DEBUG] [LOCAL ] LNN: Primary data saved (11404 records). [2025-09-26T19:49:19.420917] [INFO ] [MAIN ] LNN: Full history saved. [2025-09-26T19:49:19.421026] [INFO ] [MAIN ] Update Progress: 1267/2371 symbols completed. LNN took 22.2s. Estimated remaining: 2h 27m 30s. Rate: 7.5 symbols/min [2025-09-26T19:49:19.608200] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:49:19.613596] [DEBUG] [LOCAL ] LOCL: Loaded 3622 existing records from primary storage. [2025-09-26T19:49:19.613725] [INFO ] [MAIN ] LOCL: Loaded 3622 existing records. [2025-09-26T19:49:19.805473] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:49:19.805782] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-09-26T19:49:19.805838] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-09-26T19:49:19.806124] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-09-26T19:49:19.806184] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-09-26T19:49:19.916465] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-09-26T19:49:20.187196] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:49:20.612501] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-26T19:49:20.711731] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-09-26T19:49:21.116034] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-26T19:49:21.511761] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-09-26T19:49:22.311733] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2024-12. [2025-09-26T19:49:22.692719] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-26T19:49:22.985435] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-26T19:49:23.119861] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-09-26T19:49:23.137353] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-26T19:49:23.911686] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-09-26T19:49:24.304613] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-26T19:49:24.711728] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-09-26T19:49:25.511726] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-09-26T19:49:25.781678] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-26T19:49:25.834957] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-26T19:49:26.131448] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-26T19:49:26.311717] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-09-26T19:49:26.689194] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-26T19:49:27.111744] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-09-26T19:49:27.911802] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-09-26T19:49:28.711705] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-09-26T19:49:28.942700] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-26T19:49:29.062487] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-26T19:49:29.511738] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-09-26T19:49:29.808234] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-26T19:49:30.306759] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-26T19:49:30.311660] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-09-26T19:49:30.763357] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-26T19:49:31.111749] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-09-26T19:49:31.911723] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-09-26T19:49:32.711712] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-09-26T19:49:33.019708] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-26T19:49:33.054499] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-26T19:49:33.221847] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-26T19:49:33.511725] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-09-26T19:49:34.311730] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-09-26T19:49:35.111712] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-09-26T19:49:35.167690] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-26T19:49:35.230359] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-26T19:49:35.911723] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-09-26T19:49:36.711713] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-09-26T19:49:37.000021] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-26T19:49:37.278081] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-26T19:49:37.511738] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-09-26T19:49:38.311692] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-09-26T19:49:38.733779] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (3.62 seconds). [2025-09-26T19:49:38.807537] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-26T19:49:38.856172] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-26T19:49:39.111734] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-09-26T19:49:39.911719] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-09-26T19:49:40.390228] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-26T19:49:40.711741] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-09-26T19:49:40.848320] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-26T19:49:40.849945] [INFO ] [REMOTE ] LOCL: Full fetch complete (4811 records). [2025-09-26T19:49:40.850019] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-09-26T19:49:41.222928] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-09-26T19:49:41.223053] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-09-26T19:49:41.223238] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-09-26T19:49:41.223284] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-09-26T19:49:41.223737] [DEBUG] [LOCAL ] LOCL: Trimmed 4811 records to 3644 (keeping 200 days of data) [2025-09-26T19:49:41.245301] [DEBUG] [LOCAL ] LOCL: Primary data saved (3644 records). [2025-09-26T19:49:41.245410] [INFO ] [MAIN ] LOCL: Full history saved. [2025-09-26T19:49:41.245511] [INFO ] [MAIN ] Update Progress: 1268/2371 symbols completed. LOCL took 21.8s. Estimated remaining: 2h 27m 34s. Rate: 7.5 symbols/min [2025-09-26T19:49:41.433481] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:49:41.478515] [DEBUG] [LOCAL ] LOMA: Loaded 32261 existing records from primary storage. [2025-09-26T19:49:41.478688] [INFO ] [MAIN ] LOMA: Loaded 32261 existing records. [2025-09-26T19:49:41.516935] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-09-26T19:49:41.666570] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:49:41.666848] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-09-26T19:49:41.666933] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-09-26T19:49:41.667584] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-09-26T19:49:41.667675] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-09-26T19:49:42.042729] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:49:42.311732] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2024-12. [2025-09-26T19:49:42.609968] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-26T19:49:42.620140] [INFO ] [REMOTE ] LNG: Full fetch complete (74720 records). [2025-09-26T19:49:42.620280] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-09-26T19:49:43.038664] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-09-26T19:49:43.038841] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-09-26T19:49:43.039859] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-09-26T19:49:43.039982] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-09-26T19:49:43.056433] [DEBUG] [LOCAL ] LNG: Trimmed 74720 records to 52224 (keeping 200 days of data) [2025-09-26T19:49:43.068808] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-26T19:49:43.141903] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-09-26T19:49:43.427657] [DEBUG] [LOCAL ] LNG: Primary data saved (52224 records). [2025-09-26T19:49:43.427872] [INFO ] [MAIN ] LNG: Full history saved. [2025-09-26T19:49:43.428062] [INFO ] [MAIN ] Update Progress: 1269/2371 symbols completed. LNG took 48.2s. Estimated remaining: 2h 27m 21s. Rate: 7.5 symbols/min [2025-09-26T19:49:43.613605] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:49:43.670538] [DEBUG] [LOCAL ] LOW: Loaded 53346 existing records from primary storage. [2025-09-26T19:49:43.670743] [INFO ] [MAIN ] LOW: Loaded 53346 existing records. [2025-09-26T19:49:43.864004] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:49:43.864667] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-09-26T19:49:43.864791] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-09-26T19:49:43.875415] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-09-26T19:49:43.880727] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-09-26T19:49:43.926026] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-09-26T19:49:43.986974] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-26T19:49:44.303850] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:49:44.708828] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-26T19:49:44.717588] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-09-26T19:49:45.388478] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-26T19:49:45.396006] [INFO ] [REMOTE ] LOB: Full fetch complete (37791 records). [2025-09-26T19:49:45.396176] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-09-26T19:49:45.516981] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-09-26T19:49:45.811906] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-09-26T19:49:45.812009] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-09-26T19:49:45.812876] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-09-26T19:49:45.812944] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-09-26T19:49:45.814061] [DEBUG] [LOCAL ] LOB: Trimmed 37791 records to 27886 (keeping 200 days of data) [2025-09-26T19:49:46.009441] [DEBUG] [LOCAL ] LOB: Primary data saved (27886 records). [2025-09-26T19:49:46.009747] [INFO ] [MAIN ] LOB: Full history saved. [2025-09-26T19:49:46.010010] [INFO ] [MAIN ] Update Progress: 1270/2371 symbols completed. LOB took 32.4s. Estimated remaining: 2h 27m 8s. Rate: 7.5 symbols/min [2025-09-26T19:49:46.209291] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:49:46.233891] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-26T19:49:46.286665] [DEBUG] [LOCAL ] LPG: Loaded 40307 existing records from primary storage. [2025-09-26T19:49:46.286957] [INFO ] [MAIN ] LPG: Loaded 40307 existing records. [2025-09-26T19:49:46.319908] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-09-26T19:49:46.491575] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:49:46.491946] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-09-26T19:49:46.491999] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-09-26T19:49:46.492973] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-09-26T19:49:46.493036] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-09-26T19:49:46.883574] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:49:47.111724] [INFO ] [REMOTE ] LOW: Fetching primary data for 2024-12. [2025-09-26T19:49:47.213511] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-26T19:49:47.221541] [INFO ] [REMOTE ] LOAR: Full fetch complete (56473 records). [2025-09-26T19:49:47.221742] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-09-26T19:49:47.636846] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-09-26T19:49:47.636991] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-09-26T19:49:47.638180] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-09-26T19:49:47.638263] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-09-26T19:49:47.640039] [DEBUG] [LOCAL ] LOAR: Trimmed 56473 records to 42150 (keeping 200 days of data) [2025-09-26T19:49:47.793866] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-26T19:49:47.911904] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-09-26T19:49:47.941570] [DEBUG] [LOCAL ] LOAR: Primary data saved (42150 records). [2025-09-26T19:49:47.941743] [INFO ] [MAIN ] LOAR: Full history saved. [2025-09-26T19:49:47.941845] [INFO ] [MAIN ] Update Progress: 1271/2371 symbols completed. LOAR took 41.0s. Estimated remaining: 2h 26m 55s. Rate: 7.5 symbols/min [2025-09-26T19:49:48.129967] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:49:48.157812] [DEBUG] [LOCAL ] LPL: Loaded 26050 existing records from primary storage. [2025-09-26T19:49:48.157985] [INFO ] [MAIN ] LPL: Loaded 26050 existing records. [2025-09-26T19:49:48.349779] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:49:48.350052] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-09-26T19:49:48.350104] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-09-26T19:49:48.350793] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-09-26T19:49:48.350856] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-09-26T19:49:48.740811] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:49:48.734296] [INFO ] [REMOTE ] LPG: Fetching primary data for 2024-12. [2025-09-26T19:49:48.852195] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-26T19:49:49.290479] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-26T19:49:49.511724] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-09-26T19:49:50.267358] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-26T19:49:50.311696] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-09-26T19:49:51.111704] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-09-26T19:49:51.393795] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-26T19:49:51.911726] [INFO ] [REMOTE ] LPL: Fetching primary data for 2024-12. [2025-09-26T19:49:52.274704] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-26T19:49:52.711765] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-09-26T19:49:52.748220] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-26T19:49:53.505086] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-26T19:49:53.511664] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-09-26T19:49:54.311776] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-09-26T19:49:54.522041] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-26T19:49:54.621116] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-26T19:49:55.111738] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-09-26T19:49:55.904229] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-26T19:49:55.912455] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-09-26T19:49:56.538639] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-26T19:49:56.711715] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-09-26T19:49:56.933704] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-26T19:49:57.511802] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-09-26T19:49:58.318590] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-09-26T19:49:58.336716] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-26T19:49:58.372112] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-26T19:49:59.111733] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-09-26T19:49:59.604186] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-26T19:49:59.869323] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-26T19:49:59.911743] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-09-26T19:50:00.711753] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-09-26T19:50:01.081263] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-26T19:50:01.511714] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-09-26T19:50:02.311708] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-09-26T19:50:02.394864] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-26T19:50:03.111714] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-09-26T19:50:03.447316] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-26T19:50:03.648198] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-26T19:50:03.911733] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-09-26T19:50:04.711688] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-09-26T19:50:04.746245] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-26T19:50:05.178078] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-26T19:50:05.511723] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-09-26T19:50:06.311720] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-09-26T19:50:06.339701] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-26T19:50:07.111753] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-09-26T19:50:07.148685] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-26T19:50:07.882343] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-26T19:50:07.911675] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-09-26T19:50:07.994287] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-26T19:50:08.711769] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-09-26T19:50:09.469534] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-26T19:50:09.477942] [INFO ] [REMOTE ] LPL: Full fetch complete (34855 records). [2025-09-26T19:50:09.478141] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-09-26T19:50:09.516946] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-09-26T19:50:09.891737] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-09-26T19:50:09.891824] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-09-26T19:50:09.892466] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-09-26T19:50:09.892507] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-09-26T19:50:09.893439] [DEBUG] [LOCAL ] LPL: Trimmed 34855 records to 26305 (keeping 200 days of data) [2025-09-26T19:50:10.044482] [DEBUG] [LOCAL ] LPL: Primary data saved (26305 records). [2025-09-26T19:50:10.044629] [INFO ] [MAIN ] LPL: Full history saved. [2025-09-26T19:50:10.044788] [INFO ] [MAIN ] Update Progress: 1272/2371 symbols completed. LPL took 22.1s. Estimated remaining: 2h 26m 59s. Rate: 7.5 symbols/min [2025-09-26T19:50:10.243065] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:50:10.294811] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-26T19:50:10.315695] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-09-26T19:50:10.320114] [DEBUG] [LOCAL ] LPX: Loaded 40015 existing records from primary storage. [2025-09-26T19:50:10.321043] [INFO ] [MAIN ] LPX: Loaded 40015 existing records. [2025-09-26T19:50:10.514619] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:50:10.514932] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-09-26T19:50:10.514997] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-09-26T19:50:10.515964] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-09-26T19:50:10.516028] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-09-26T19:50:10.901283] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:50:11.111704] [INFO ] [REMOTE ] LPX: Fetching primary data for 2024-12. [2025-09-26T19:50:11.564441] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-26T19:50:11.911696] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-09-26T19:50:12.013915] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-26T19:50:12.022818] [INFO ] [REMOTE ] LOMA: Full fetch complete (48174 records). [2025-09-26T19:50:12.023015] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-09-26T19:50:12.471510] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-09-26T19:50:12.471684] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-09-26T19:50:12.472494] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-09-26T19:50:12.472557] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-09-26T19:50:12.473811] [DEBUG] [LOCAL ] LOMA: Trimmed 48174 records to 32576 (keeping 200 days of data) [2025-09-26T19:50:12.688030] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-26T19:50:12.715008] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-09-26T19:50:12.714873] [DEBUG] [LOCAL ] LOMA: Primary data saved (32576 records). [2025-09-26T19:50:12.716337] [INFO ] [MAIN ] LOMA: Full history saved. [2025-09-26T19:50:12.716458] [INFO ] [MAIN ] Update Progress: 1273/2371 symbols completed. LOMA took 31.5s. Estimated remaining: 2h 26m 46s. Rate: 7.5 symbols/min [2025-09-26T19:50:12.919267] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:50:12.963115] [DEBUG] [LOCAL ] LRN: Loaded 40224 existing records from primary storage. [2025-09-26T19:50:12.963278] [INFO ] [MAIN ] LRN: Loaded 40224 existing records. [2025-09-26T19:50:13.161470] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:50:13.162016] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-09-26T19:50:13.162077] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-09-26T19:50:13.163022] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-09-26T19:50:13.163085] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-09-26T19:50:13.516112] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-09-26T19:50:13.594197] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:50:13.634600] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-26T19:50:14.311717] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-09-26T19:50:14.614516] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-26T19:50:15.111738] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-09-26T19:50:15.757132] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-26T19:50:15.911735] [INFO ] [REMOTE ] LRN: Fetching primary data for 2024-12. [2025-09-26T19:50:16.377172] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-26T19:50:16.678495] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-26T19:50:16.711728] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-09-26T19:50:17.036247] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-26T19:50:17.511781] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-09-26T19:50:18.231977] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-26T19:50:18.239554] [INFO ] [REMOTE ] LPG: Full fetch complete (59732 records). [2025-09-26T19:50:18.239713] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-09-26T19:50:18.320677] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-09-26T19:50:18.652592] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-09-26T19:50:18.652719] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-09-26T19:50:18.653674] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-09-26T19:50:18.653743] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-09-26T19:50:18.655117] [DEBUG] [LOCAL ] LPG: Trimmed 59732 records to 40536 (keeping 200 days of data) [2025-09-26T19:50:18.911786] [DEBUG] [LOCAL ] LPG: Primary data saved (40536 records). [2025-09-26T19:50:18.911922] [INFO ] [MAIN ] LPG: Full history saved. [2025-09-26T19:50:18.912047] [INFO ] [MAIN ] Update Progress: 1274/2371 symbols completed. LPG took 32.9s. Estimated remaining: 2h 26m 37s. Rate: 7.5 symbols/min [2025-09-26T19:50:19.098949] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:50:19.111764] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-09-26T19:50:19.145250] [DEBUG] [LOCAL ] LSPD: Loaded 43518 existing records from primary storage. [2025-09-26T19:50:19.145409] [INFO ] [MAIN ] LSPD: Loaded 43518 existing records. [2025-09-26T19:50:19.332250] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:50:19.332509] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-09-26T19:50:19.332561] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-09-26T19:50:19.333687] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-09-26T19:50:19.333753] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-09-26T19:50:19.712803] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:50:19.911709] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2024-12. [2025-09-26T19:50:20.298730] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (2.79 seconds). [2025-09-26T19:50:20.656082] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-09-26T19:50:20.696973] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-26T19:50:20.711668] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-09-26T19:50:21.407781] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-26T19:50:21.511729] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-09-26T19:50:21.901059] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-26T19:50:22.311751] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-09-26T19:50:22.883667] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-26T19:50:23.111717] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-09-26T19:50:23.911719] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-09-26T19:50:24.234265] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-26T19:50:24.711745] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-09-26T19:50:24.920105] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-26T19:50:25.440953] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-26T19:50:25.511732] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-09-26T19:50:25.932188] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-26T19:50:26.311734] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-09-26T19:50:27.111720] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-09-26T19:50:27.147236] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-26T19:50:27.607749] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-26T19:50:27.911723] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-09-26T19:50:28.705325] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-26T19:50:28.717422] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-09-26T19:50:29.516798] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-09-26T19:50:29.537882] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-26T19:50:30.311734] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-09-26T19:50:30.447630] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-26T19:50:30.660212] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-26T19:50:31.111708] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-09-26T19:50:31.911727] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-09-26T19:50:32.122474] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-26T19:50:32.133059] [INFO ] [REMOTE ] LOW: Full fetch complete (76498 records). [2025-09-26T19:50:32.133238] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-09-26T19:50:32.574924] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-09-26T19:50:32.575120] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-09-26T19:50:32.576223] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-09-26T19:50:32.576332] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-09-26T19:50:32.578125] [DEBUG] [LOCAL ] LOW: Trimmed 76498 records to 53721 (keeping 200 days of data) [2025-09-26T19:50:32.719196] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-09-26T19:50:32.720818] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-26T19:50:32.968236] [DEBUG] [LOCAL ] LOW: Primary data saved (53721 records). [2025-09-26T19:50:32.968441] [INFO ] [MAIN ] LOW: Full history saved. [2025-09-26T19:50:32.968588] [INFO ] [MAIN ] Update Progress: 1275/2371 symbols completed. LOW took 49.5s. Estimated remaining: 2h 26m 34s. Rate: 7.5 symbols/min [2025-09-26T19:50:33.162792] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:50:33.194748] [DEBUG] [LOCAL ] LTC: Loaded 30236 existing records from primary storage. [2025-09-26T19:50:33.194923] [INFO ] [MAIN ] LTC: Loaded 30236 existing records. [2025-09-26T19:50:33.393557] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:50:33.394015] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-09-26T19:50:33.394113] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-09-26T19:50:33.405358] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-09-26T19:50:33.421262] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-09-26T19:50:33.511190] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T19:50:33.536534] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-09-26T19:50:33.880795] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:50:34.314734] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-09-26T19:50:34.319958] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-26T19:50:35.111730] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-09-26T19:50:35.200670] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-26T19:50:35.911698] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-09-26T19:50:36.014037] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-26T19:50:36.705529] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-26T19:50:36.714895] [INFO ] [REMOTE ] LTC: Fetching primary data for 2024-12. [2025-09-26T19:50:37.412194] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-26T19:50:37.421429] [INFO ] [REMOTE ] LRN: Full fetch complete (58423 records). [2025-09-26T19:50:37.421663] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-09-26T19:50:37.517900] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-09-26T19:50:37.859189] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-09-26T19:50:37.864991] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-09-26T19:50:37.865993] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-09-26T19:50:37.875712] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-09-26T19:50:37.877430] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-26T19:50:37.884463] [DEBUG] [LOCAL ] LRN: Trimmed 58423 records to 40503 (keeping 200 days of data) [2025-09-26T19:50:38.141496] [DEBUG] [LOCAL ] LRN: Primary data saved (40503 records). [2025-09-26T19:50:38.141630] [INFO ] [MAIN ] LRN: Full history saved. [2025-09-26T19:50:38.141776] [INFO ] [MAIN ] Update Progress: 1276/2371 symbols completed. LRN took 25.4s. Estimated remaining: 2h 26m 23s. Rate: 7.5 symbols/min [2025-09-26T19:50:38.324565] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-09-26T19:50:38.328534] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:50:38.383452] [DEBUG] [LOCAL ] LTH: Loaded 52212 existing records from primary storage. [2025-09-26T19:50:38.383635] [INFO ] [MAIN ] LTH: Loaded 52212 existing records. [2025-09-26T19:50:38.589411] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:50:38.589742] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-09-26T19:50:38.589800] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-09-26T19:50:38.591103] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-09-26T19:50:38.591188] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-09-26T19:50:39.111717] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-09-26T19:50:39.163231] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:50:39.192967] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-26T19:50:39.682346] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-26T19:50:39.911722] [INFO ] [REMOTE ] LTH: Fetching primary data for 2024-12. [2025-09-26T19:50:40.711743] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-09-26T19:50:40.764165] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T19:50:40.772586] [INFO ] [REMOTE ] LPX: Full fetch complete (58628 records). [2025-09-26T19:50:40.772767] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-09-26T19:50:41.191734] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-09-26T19:50:41.191968] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-09-26T19:50:41.192962] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-09-26T19:50:41.193031] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-09-26T19:50:41.194487] [DEBUG] [LOCAL ] LPX: Trimmed 58628 records to 40311 (keeping 200 days of data) [2025-09-26T19:50:41.461498] [DEBUG] [LOCAL ] LPX: Primary data saved (40311 records). [2025-09-26T19:50:41.461632] [INFO ] [MAIN ] LPX: Full history saved. [2025-09-26T19:50:41.461757] [INFO ] [MAIN ] Update Progress: 1277/2371 symbols completed. LPX took 31.4s. Estimated remaining: 2h 26m 11s. Rate: 7.5 symbols/min [2025-09-26T19:50:41.511733] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-09-26T19:50:41.791854] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-26T19:50:42.202951] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-26T19:50:42.311745] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-09-26T19:50:42.829037] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-26T19:50:43.111712] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-01. [2025-09-26T19:50:43.911720] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-09-26T19:50:43.993405] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-26T19:50:44.680618] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T19:50:44.711742] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-09-26T19:50:45.284754] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-26T19:50:45.511722] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-09-26T19:50:46.230330] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-26T19:50:46.238864] [INFO ] [REMOTE ] LSPD: Full fetch complete (61463 records). [2025-09-26T19:50:46.239032] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-09-26T19:50:46.322250] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-09-26T19:50:46.709281] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-09-26T19:50:46.709449] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-09-26T19:50:46.710568] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-09-26T19:50:46.710705] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-09-26T19:50:46.712330] [DEBUG] [LOCAL ] LSPD: Trimmed 61463 records to 43782 (keeping 200 days of data) [2025-09-26T19:50:46.963922] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-26T19:50:47.007580] [DEBUG] [LOCAL ] LSPD: Primary data saved (43782 records). [2025-09-26T19:50:47.007745] [INFO ] [MAIN ] LSPD: Full history saved. [2025-09-26T19:50:47.007856] [INFO ] [MAIN ] Update Progress: 1278/2371 symbols completed. LSPD took 28.1s. Estimated remaining: 2h 26m 1s. Rate: 7.5 symbols/min [2025-09-26T19:50:47.111722] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-09-26T19:50:47.942489] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-26T19:50:47.953128] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-09-26T19:50:48.486951] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-26T19:50:48.711757] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-09-26T19:50:49.397509] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-26T19:50:49.511736] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-09-26T19:50:50.104976] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-26T19:50:50.311756] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-09-26T19:50:51.266789] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-26T19:50:51.277772] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-09-26T19:50:51.846742] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-26T19:50:51.911740] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-09-26T19:50:53.039680] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-26T19:50:53.051083] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-09-26T19:50:53.348536] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-26T19:50:53.511758] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-09-26T19:50:54.665822] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-26T19:50:54.679739] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-09-26T19:50:54.705326] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-26T19:50:54.714114] [INFO ] [REMOTE ] LTC: Full fetch complete (43191 records). [2025-09-26T19:50:54.714311] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-09-26T19:50:55.142767] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-09-26T19:50:55.142859] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-09-26T19:50:55.143632] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-09-26T19:50:55.143781] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-09-26T19:50:55.145096] [DEBUG] [LOCAL ] LTC: Trimmed 43191 records to 30478 (keeping 200 days of data) [2025-09-26T19:50:55.351722] [DEBUG] [LOCAL ] LTC: Primary data saved (30478 records). [2025-09-26T19:50:55.351878] [INFO ] [MAIN ] LTC: Full history saved. [2025-09-26T19:50:55.351973] [INFO ] [MAIN ] Update Progress: 1279/2371 symbols completed. LTC took 22.4s. Estimated remaining: 2h 25m 53s. Rate: 7.5 symbols/min [2025-09-26T19:50:56.105277] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-26T19:50:56.117821] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-09-26T19:50:57.828952] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-26T19:50:57.841154] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-09-26T19:50:59.663565] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-26T19:50:59.675780] [INFO ] [REMOTE ] LTH: Full fetch complete (74025 records). [2025-09-26T19:50:59.675962] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-09-26T19:51:00.137933] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-09-26T19:51:00.138061] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-09-26T19:51:00.139045] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-09-26T19:51:00.139113] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-09-26T19:51:00.140718] [DEBUG] [LOCAL ] LTH: Trimmed 74025 records to 52563 (keeping 200 days of data) [2025-09-26T19:51:00.467857] [DEBUG] [LOCAL ] LTH: Primary data saved (52563 records). [2025-09-26T19:51:00.468008] [INFO ] [MAIN ] LTH: Full history saved. [2025-09-26T19:51:00.468113] [INFO ] [MAIN ] Update Progress: 1280/2371 symbols completed. LTH took 22.3s. Estimated remaining: 2h 25m 43s. Rate: 7.5 symbols/min [2025-09-26T19:51:01.078563] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:51:01.157271] [DEBUG] [LOCAL ] LUCK: No existing data file found in primary storage. [2025-09-26T19:51:01.260455] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:51:01.259434] [WARN ] [MAIN ] LUCK: No existing data found, performing full refresh instead. [2025-09-26T19:51:01.322055] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-09-26T19:51:01.321964] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:51:01.323250] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:51:01.323470] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-26T19:51:01.324075] [DEBUG] [LOCAL ] LUCK: No primary data file found to delete. [2025-09-26T19:51:01.324492] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-09-26T19:51:01.635247] [DEBUG] [LOCAL ] LTM: Loaded 36687 existing records from primary storage. [2025-09-26T19:51:01.641400] [INFO ] [MAIN ] LTM: Loaded 36687 existing records. [2025-09-26T19:51:01.734262] [DEBUG] [LOCAL ] LU: Loaded 49314 existing records from primary storage. [2025-09-26T19:51:01.826220] [INFO ] [MAIN ] LU: Loaded 49314 existing records. [2025-09-26T19:51:01.815452] [DEBUG] [LOCAL ] LUMN: Loaded 54024 existing records from primary storage. [2025-09-26T19:51:01.865048] [INFO ] [MAIN ] LUMN: Loaded 54024 existing records. [2025-09-26T19:51:02.120724] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:51:02.168373] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2024-12. [2025-09-26T19:51:02.305513] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:51:02.419667] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-09-26T19:51:02.445176] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-09-26T19:51:02.445039] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:51:02.487742] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-09-26T19:51:02.491214] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:51:02.491368] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-09-26T19:51:02.491614] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-09-26T19:51:02.491819] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-09-26T19:51:02.484188] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-09-26T19:51:02.491980] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-09-26T19:51:02.498198] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-09-26T19:51:02.498249] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-09-26T19:51:02.548729] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-09-26T19:51:02.548796] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-09-26T19:51:03.630216] [INFO ] [REMOTE ] LTM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:51:03.651854] [INFO ] [REMOTE ] LTM: Fetching primary data for 2024-12. [2025-09-26T19:51:03.660342] [INFO ] [REMOTE ] LU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:51:03.732448] [INFO ] [REMOTE ] LU: Fetching primary data for 2024-12. [2025-09-26T19:51:03.735672] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:51:03.749710] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2024-12. [2025-09-26T19:51:03.752197] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-26T19:51:03.757764] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-09-26T19:51:04.861603] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-26T19:51:04.867019] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-01. [2025-09-26T19:51:05.312498] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-26T19:51:05.322196] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-09-26T19:51:05.416268] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-26T19:51:05.426683] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-09-26T19:51:05.613286] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-26T19:51:05.619019] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-09-26T19:51:05.820118] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-26T19:51:05.831558] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-09-26T19:51:06.404160] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-26T19:51:06.410118] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-09-26T19:51:06.701466] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-26T19:51:06.709925] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-09-26T19:51:06.794028] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-26T19:51:06.803962] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-09-26T19:51:07.418400] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-26T19:51:07.425034] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-09-26T19:51:07.744752] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-26T19:51:07.781684] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-26T19:51:07.911738] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-09-26T19:51:08.552953] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-26T19:51:08.674041] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-26T19:51:08.711751] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-09-26T19:51:09.511698] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-09-26T19:51:09.653830] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-26T19:51:09.701969] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-26T19:51:10.311744] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-09-26T19:51:11.111698] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-09-26T19:51:11.234881] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-26T19:51:11.911757] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-09-26T19:51:12.234152] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-26T19:51:12.534527] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-26T19:51:12.711719] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-09-26T19:51:13.282853] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-26T19:51:13.511724] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-09-26T19:51:14.138826] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-26T19:51:14.311770] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-09-26T19:51:15.111763] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-09-26T19:51:15.500127] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-26T19:51:15.916272] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-09-26T19:51:15.923259] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-26T19:51:16.613465] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-26T19:51:16.711741] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-09-26T19:51:17.511731] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-09-26T19:51:17.772992] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-26T19:51:18.309919] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-26T19:51:18.319870] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-09-26T19:51:19.111708] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-09-26T19:51:19.488681] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-26T19:51:19.499848] [INFO ] [REMOTE ] LTM: Full fetch complete (47300 records). [2025-09-26T19:51:19.500058] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-09-26T19:51:19.637197] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-26T19:51:19.923689] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-09-26T19:51:19.964860] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-09-26T19:51:19.965232] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-09-26T19:51:19.966116] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-09-26T19:51:19.966220] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-09-26T19:51:19.967918] [DEBUG] [LOCAL ] LTM: Trimmed 47300 records to 37076 (keeping 200 days of data) [2025-09-26T19:51:20.210537] [DEBUG] [LOCAL ] LTM: Primary data saved (37076 records). [2025-09-26T19:51:20.210833] [INFO ] [MAIN ] LTM: Full history saved. [2025-09-26T19:51:20.211142] [INFO ] [MAIN ] Update Progress: 1281/2371 symbols completed. LTM took 19.7s. Estimated remaining: 2h 25m 45s. Rate: 7.5 symbols/min [2025-09-26T19:51:20.402828] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:51:20.464977] [DEBUG] [LOCAL ] LUV: Loaded 54079 existing records from primary storage. [2025-09-26T19:51:20.465129] [INFO ] [MAIN ] LUV: Loaded 54079 existing records. [2025-09-26T19:51:20.665383] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:51:20.665853] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-09-26T19:51:20.665913] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-09-26T19:51:20.667402] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-09-26T19:51:20.667475] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-09-26T19:51:20.716836] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-09-26T19:51:21.086111] [INFO ] [REMOTE ] LUV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:51:21.102598] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-26T19:51:21.145594] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-26T19:51:21.511748] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-09-26T19:51:22.311713] [INFO ] [REMOTE ] LUV: Fetching primary data for 2024-12. [2025-09-26T19:51:22.368902] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-26T19:51:22.799285] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-26T19:51:23.111713] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-09-26T19:51:23.911715] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-09-26T19:51:24.292680] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-26T19:51:24.711743] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-01. [2025-09-26T19:51:25.106101] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-26T19:51:25.186553] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-26T19:51:25.511746] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-09-26T19:51:26.311728] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-09-26T19:51:26.604799] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-26T19:51:27.073927] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-26T19:51:27.111679] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-09-26T19:51:27.911703] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-09-26T19:51:28.145941] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-26T19:51:28.593731] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-26T19:51:28.714484] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-09-26T19:51:28.718402] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-26T19:51:28.726199] [INFO ] [REMOTE ] LUCK: Full fetch complete (40658 records). [2025-09-26T19:51:28.726364] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-09-26T19:51:28.928898] [WARN ] [VALIDATOR ] LUCK: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-26T19:51:28.929409] [FATAL] [MAIN ] LUCK: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:51:28.929483] [WARN ] [MAIN ] LUCK: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:51:28.929557] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-26T19:51:28.929625] [DEBUG] [LOCAL ] LUCK: No primary data file found to delete. [2025-09-26T19:51:28.929701] [INFO ] [LOCAL ] LUCK: Starting deletion of derivative data. [2025-09-26T19:51:28.929779] [DEBUG] [LOCAL ] LUCK: No derivative data file found to delete. [2025-09-26T19:51:28.929886] [INFO ] [MAIN ] Update Progress: 1282/2371 symbols completed. LUCK took 28.5s. Estimated remaining: 2h 25m 37s. Rate: 7.5 symbols/min [2025-09-26T19:51:29.113757] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:51:29.113959] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-09-26T19:51:29.114059] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-09-26T19:51:29.114240] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-09-26T19:51:29.114289] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-26T19:51:29.114341] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-26T19:51:29.114435] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-09-26T19:51:29.507320] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:51:29.511693] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2024-12. [2025-09-26T19:51:29.729952] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:51:29.730320] [WARN ] [REMOTE ] LUXE: No data returned for month 2024-12 [2025-09-26T19:51:30.311730] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-09-26T19:51:30.443930] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-26T19:51:30.453696] [INFO ] [REMOTE ] LU: Full fetch complete (70415 records). [2025-09-26T19:51:30.453847] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-09-26T19:51:30.907961] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-09-26T19:51:30.908046] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-09-26T19:51:30.909036] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-09-26T19:51:30.909105] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-09-26T19:51:30.913282] [DEBUG] [LOCAL ] LU: Trimmed 70415 records to 49679 (keeping 200 days of data) [2025-09-26T19:51:31.129151] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-09-26T19:51:31.224529] [DEBUG] [LOCAL ] LU: Primary data saved (49679 records). [2025-09-26T19:51:31.224717] [INFO ] [MAIN ] LU: Full history saved. [2025-09-26T19:51:31.224850] [INFO ] [MAIN ] Update Progress: 1283/2371 symbols completed. LU took 30.8s. Estimated remaining: 2h 25m 24s. Rate: 7.5 symbols/min [2025-09-26T19:51:31.408024] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:51:31.469023] [DEBUG] [LOCAL ] LVS: Loaded 53954 existing records from primary storage. [2025-09-26T19:51:31.469170] [INFO ] [MAIN ] LVS: Loaded 53954 existing records. [2025-09-26T19:51:31.663186] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:51:31.663454] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-09-26T19:51:31.663504] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-09-26T19:51:31.664761] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-09-26T19:51:31.664833] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-09-26T19:51:31.912177] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-01. [2025-09-26T19:51:32.076859] [INFO ] [REMOTE ] LVS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:51:32.108637] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-26T19:51:32.185132] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:51:32.185534] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-01 [2025-09-26T19:51:32.711759] [INFO ] [REMOTE ] LVS: Fetching primary data for 2024-12. [2025-09-26T19:51:33.413446] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-26T19:51:33.427255] [INFO ] [REMOTE ] LUMN: Full fetch complete (77634 records). [2025-09-26T19:51:33.427428] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-09-26T19:51:33.522320] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-02. [2025-09-26T19:51:33.816286] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:51:33.859348] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-02 [2025-09-26T19:51:34.064293] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-09-26T19:51:34.064384] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-09-26T19:51:34.065397] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-09-26T19:51:34.065467] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-09-26T19:51:34.068699] [DEBUG] [LOCAL ] LUMN: Trimmed 77634 records to 54414 (keeping 200 days of data) [2025-09-26T19:51:34.311849] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-03. [2025-09-26T19:51:34.424079] [DEBUG] [LOCAL ] LUMN: Primary data saved (54414 records). [2025-09-26T19:51:34.424241] [INFO ] [MAIN ] LUMN: Full history saved. [2025-09-26T19:51:34.424348] [INFO ] [MAIN ] Update Progress: 1284/2371 symbols completed. LUMN took 34.0s. Estimated remaining: 2h 25m 12s. Rate: 7.5 symbols/min [2025-09-26T19:51:34.511839] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:51:34.537597] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-03 [2025-09-26T19:51:34.615821] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:51:34.654170] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-26T19:51:34.682535] [DEBUG] [LOCAL ] LVWR: Loaded 17624 existing records from primary storage. [2025-09-26T19:51:34.682733] [INFO ] [MAIN ] LVWR: Loaded 17624 existing records. [2025-09-26T19:51:34.894857] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:51:34.895122] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-09-26T19:51:34.895190] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-09-26T19:51:34.895899] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-09-26T19:51:34.895962] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-09-26T19:51:35.120314] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-04. [2025-09-26T19:51:35.289032] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:51:35.383158] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:51:35.383591] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-04 [2025-09-26T19:51:35.911727] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2024-12. [2025-09-26T19:51:36.499276] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-26T19:51:36.711740] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-09-26T19:51:37.425617] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-26T19:51:37.511709] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-09-26T19:51:38.103199] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-26T19:51:38.311726] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-05. [2025-09-26T19:51:39.111714] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-01. [2025-09-26T19:51:39.375579] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-26T19:51:39.911723] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-09-26T19:51:40.719759] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-06. [2025-09-26T19:51:40.725793] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-26T19:51:41.511705] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-09-26T19:51:41.627109] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-26T19:51:41.886924] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-26T19:51:42.311741] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-09-26T19:51:42.872609] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-26T19:51:42.995354] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-26T19:51:43.111684] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-09-26T19:51:43.911733] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-09-26T19:51:44.536537] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-26T19:51:44.711706] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-09-26T19:51:44.809113] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-26T19:51:45.511792] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-09-26T19:51:46.311835] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-07. [2025-09-26T19:51:46.886634] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-26T19:51:47.111748] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-09-26T19:51:47.230183] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-26T19:51:47.677869] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-26T19:51:47.911741] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-08. [2025-09-26T19:51:48.711761] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-09-26T19:51:48.988427] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-26T19:51:49.010694] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-26T19:51:49.511737] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-09-26T19:51:50.311716] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-09-26T19:51:50.517669] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-26T19:51:51.111711] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-09-26T19:51:51.425821] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-26T19:51:51.426717] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-26T19:51:51.911726] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-09-26T19:51:52.716836] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-09-26T19:51:52.752242] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-26T19:51:53.511700] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-09. [2025-09-26T19:51:53.546601] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-26T19:51:54.311707] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-09-26T19:51:54.588635] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-26T19:51:54.596690] [INFO ] [REMOTE ] LUXE: Full fetch complete (14057 records). [2025-09-26T19:51:54.596918] [DEBUG] [VALIDATOR ] LUXE: Validating primary data. [2025-09-26T19:51:54.801890] [WARN ] [VALIDATOR ] LUXE: Validation failed - insufficient historical data. Have 103 unique days, need 200 days [2025-09-26T19:51:54.802430] [FATAL] [MAIN ] LUXE: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:51:54.802557] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:51:54.802920] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-26T19:51:54.803040] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-26T19:51:54.803197] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-09-26T19:51:54.803269] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-09-26T19:51:54.803355] [INFO ] [MAIN ] Update Progress: 1285/2371 symbols completed. LUXE took 25.9s. Estimated remaining: 2h 25m 15s. Rate: 7.5 symbols/min [2025-09-26T19:51:54.994811] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:51:55.031169] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-26T19:51:55.105630] [DEBUG] [LOCAL ] LW: Loaded 51531 existing records from primary storage. [2025-09-26T19:51:55.105818] [INFO ] [MAIN ] LW: Loaded 51531 existing records. [2025-09-26T19:51:55.117380] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-09-26T19:51:55.299298] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:51:55.299552] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-09-26T19:51:55.299603] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-09-26T19:51:55.300834] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-09-26T19:51:55.300898] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-09-26T19:51:55.694289] [INFO ] [REMOTE ] LW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:51:55.911716] [INFO ] [REMOTE ] LW: Fetching primary data for 2024-12. [2025-09-26T19:51:56.271469] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-26T19:51:56.321004] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-26T19:51:56.711728] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-09-26T19:51:57.511696] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-09-26T19:51:57.553411] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-26T19:51:58.311696] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-09-26T19:51:58.341103] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-26T19:51:58.378094] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-26T19:51:59.111700] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-09-26T19:51:59.911687] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-09-26T19:52:00.236746] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-26T19:52:00.240888] [INFO ] [REMOTE ] LVWR: Full fetch complete (19857 records). [2025-09-26T19:52:00.240975] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-09-26T19:52:00.622727] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-26T19:52:00.689337] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-09-26T19:52:00.689439] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-09-26T19:52:00.689960] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-09-26T19:52:00.690027] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-09-26T19:52:00.690933] [DEBUG] [LOCAL ] LVWR: Trimmed 19857 records to 17668 (keeping 200 days of data) [2025-09-26T19:52:00.737022] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-01. [2025-09-26T19:52:00.801619] [DEBUG] [LOCAL ] LVWR: Primary data saved (17668 records). [2025-09-26T19:52:00.801818] [INFO ] [MAIN ] LVWR: Full history saved. [2025-09-26T19:52:00.801954] [INFO ] [MAIN ] Update Progress: 1286/2371 symbols completed. LVWR took 26.4s. Estimated remaining: 2h 25m 5s. Rate: 7.5 symbols/min [2025-09-26T19:52:00.973246] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:52:00.991690] [DEBUG] [LOCAL ] LXFR: Loaded 17187 existing records from primary storage. [2025-09-26T19:52:00.991832] [INFO ] [MAIN ] LXFR: Loaded 17187 existing records. [2025-09-26T19:52:01.171689] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:52:01.171958] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-09-26T19:52:01.172005] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-09-26T19:52:01.172538] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-09-26T19:52:01.172598] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-09-26T19:52:01.516940] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-09-26T19:52:01.567029] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:52:01.898752] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-26T19:52:01.911600] [INFO ] [REMOTE ] LVS: Full fetch complete (77513 records). [2025-09-26T19:52:01.911817] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-09-26T19:52:02.312609] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2024-12. [2025-09-26T19:52:02.333810] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-09-26T19:52:02.333971] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-09-26T19:52:02.335236] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-09-26T19:52:02.335507] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-09-26T19:52:02.337289] [DEBUG] [LOCAL ] LVS: Trimmed 77513 records to 54342 (keeping 200 days of data) [2025-09-26T19:52:02.686706] [DEBUG] [LOCAL ] LVS: Primary data saved (54342 records). [2025-09-26T19:52:02.686903] [INFO ] [MAIN ] LVS: Full history saved. [2025-09-26T19:52:02.687014] [INFO ] [MAIN ] Update Progress: 1287/2371 symbols completed. LVS took 31.5s. Estimated remaining: 2h 24m 52s. Rate: 7.5 symbols/min [2025-09-26T19:52:02.882869] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-26T19:52:02.925726] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:52:02.981527] [DEBUG] [LOCAL ] LXP: Loaded 51002 existing records from primary storage. [2025-09-26T19:52:02.981710] [INFO ] [MAIN ] LXP: Loaded 51002 existing records. [2025-09-26T19:52:03.116890] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-09-26T19:52:03.176708] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:52:03.177000] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-09-26T19:52:03.177055] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-09-26T19:52:03.178227] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-09-26T19:52:03.178304] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-09-26T19:52:03.382278] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-26T19:52:03.589168] [INFO ] [REMOTE ] LXP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:52:03.782606] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-26T19:52:03.793465] [INFO ] [REMOTE ] LUV: Full fetch complete (77727 records). [2025-09-26T19:52:03.793684] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-09-26T19:52:03.916792] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-01. [2025-09-26T19:52:04.206857] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-09-26T19:52:04.206980] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-09-26T19:52:04.208072] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-09-26T19:52:04.208141] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-09-26T19:52:04.211618] [DEBUG] [LOCAL ] LUV: Trimmed 77727 records to 54469 (keeping 200 days of data) [2025-09-26T19:52:04.576057] [DEBUG] [LOCAL ] LUV: Primary data saved (54469 records). [2025-09-26T19:52:04.576209] [INFO ] [MAIN ] LUV: Full history saved. [2025-09-26T19:52:04.576308] [INFO ] [MAIN ] Update Progress: 1288/2371 symbols completed. LUV took 44.4s. Estimated remaining: 2h 24m 39s. Rate: 7.5 symbols/min [2025-09-26T19:52:04.724419] [INFO ] [REMOTE ] LXP: Fetching primary data for 2024-12. [2025-09-26T19:52:04.760809] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:52:04.797850] [DEBUG] [LOCAL ] LXU: Loaded 32191 existing records from primary storage. [2025-09-26T19:52:04.798066] [INFO ] [MAIN ] LXU: Loaded 32191 existing records. [2025-09-26T19:52:04.993784] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:52:04.994496] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-09-26T19:52:04.994931] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-09-26T19:52:04.995706] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-09-26T19:52:04.995781] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-09-26T19:52:05.118731] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-26T19:52:05.170141] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-26T19:52:05.459668] [INFO ] [REMOTE ] LXU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:52:05.511716] [INFO ] [REMOTE ] LXU: Fetching primary data for 2024-12. [2025-09-26T19:52:06.311687] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-09-26T19:52:06.420374] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-26T19:52:06.645413] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-26T19:52:07.111731] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-09-26T19:52:07.246356] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-26T19:52:07.911733] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-09-26T19:52:08.602707] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-26T19:52:08.711728] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-09-26T19:52:09.511745] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-09-26T19:52:09.787599] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-26T19:52:09.815676] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-26T19:52:10.311741] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-09-26T19:52:10.866417] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-26T19:52:11.111732] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-09-26T19:52:11.301581] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-26T19:52:11.911714] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-09-26T19:52:12.711719] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-09-26T19:52:12.934841] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-26T19:52:13.432276] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-26T19:52:13.511698] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-09-26T19:52:13.686330] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-26T19:52:14.311753] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-09-26T19:52:15.111688] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-09-26T19:52:15.247483] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-26T19:52:15.365067] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-26T19:52:15.911719] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-09-26T19:52:16.711739] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-09-26T19:52:16.772615] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-26T19:52:17.511690] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-09-26T19:52:17.614514] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-26T19:52:18.047739] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-26T19:52:18.311714] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-09-26T19:52:18.533731] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-26T19:52:19.111709] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-09-26T19:52:19.911725] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-09-26T19:52:20.143424] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-26T19:52:20.618075] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-26T19:52:20.711728] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-09-26T19:52:21.511734] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-09-26T19:52:21.654112] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-26T19:52:22.311758] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-09-26T19:52:22.490285] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-26T19:52:22.581351] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-26T19:52:23.111710] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-09-26T19:52:23.911705] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-09-26T19:52:23.963682] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-26T19:52:24.209712] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-26T19:52:24.711736] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-09-26T19:52:25.239833] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-26T19:52:25.511738] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-09-26T19:52:26.311742] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-09-26T19:52:26.602613] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-26T19:52:26.614547] [INFO ] [REMOTE ] LW: Full fetch complete (74614 records). [2025-09-26T19:52:26.614778] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-09-26T19:52:27.063019] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-09-26T19:52:27.063126] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-09-26T19:52:27.064115] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-09-26T19:52:27.064183] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-09-26T19:52:27.065822] [DEBUG] [LOCAL ] LW: Trimmed 74614 records to 51915 (keeping 200 days of data) [2025-09-26T19:52:27.128062] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-09-26T19:52:27.359876] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-26T19:52:27.369623] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-26T19:52:27.479307] [DEBUG] [LOCAL ] LW: Primary data saved (51915 records). [2025-09-26T19:52:27.479560] [INFO ] [MAIN ] LW: Full history saved. [2025-09-26T19:52:27.479743] [INFO ] [MAIN ] Update Progress: 1289/2371 symbols completed. LW took 32.7s. Estimated remaining: 2h 24m 43s. Rate: 7.5 symbols/min [2025-09-26T19:52:27.668046] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:52:27.721890] [DEBUG] [LOCAL ] LYB: Loaded 53989 existing records from primary storage. [2025-09-26T19:52:27.722064] [INFO ] [MAIN ] LYB: Loaded 53989 existing records. [2025-09-26T19:52:27.914903] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-09-26T19:52:27.919712] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:52:27.920904] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-09-26T19:52:27.920999] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-09-26T19:52:27.922233] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-09-26T19:52:27.922322] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-09-26T19:52:28.301253] [INFO ] [REMOTE ] LYB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:52:28.511452] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-26T19:52:28.711764] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-09-26T19:52:29.511729] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-09-26T19:52:29.617612] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-26T19:52:29.718168] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-26T19:52:29.721598] [INFO ] [REMOTE ] LXFR: Full fetch complete (25146 records). [2025-09-26T19:52:29.721711] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-09-26T19:52:30.130247] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-09-26T19:52:30.130389] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-09-26T19:52:30.131111] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-09-26T19:52:30.131185] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-09-26T19:52:30.132142] [DEBUG] [LOCAL ] LXFR: Trimmed 25146 records to 17259 (keeping 200 days of data) [2025-09-26T19:52:30.240021] [DEBUG] [LOCAL ] LXFR: Primary data saved (17259 records). [2025-09-26T19:52:30.240222] [INFO ] [MAIN ] LXFR: Full history saved. [2025-09-26T19:52:30.240323] [INFO ] [MAIN ] Update Progress: 1290/2371 symbols completed. LXFR took 29.4s. Estimated remaining: 2h 24m 31s. Rate: 7.5 symbols/min [2025-09-26T19:52:30.316928] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-09-26T19:52:30.430413] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:52:30.492434] [DEBUG] [LOCAL ] LYG: Loaded 53243 existing records from primary storage. [2025-09-26T19:52:30.492615] [INFO ] [MAIN ] LYG: Loaded 53243 existing records. [2025-09-26T19:52:30.710554] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:52:30.711233] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-09-26T19:52:30.711474] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-09-26T19:52:30.712694] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-09-26T19:52:30.712765] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-09-26T19:52:30.862338] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-26T19:52:31.116834] [INFO ] [REMOTE ] LYB: Fetching primary data for 2024-12. [2025-09-26T19:52:31.149911] [INFO ] [REMOTE ] LYG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:52:31.911724] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-09-26T19:52:32.056204] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-26T19:52:32.711706] [INFO ] [REMOTE ] LYG: Fetching primary data for 2024-12. [2025-09-26T19:52:33.208551] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-26T19:52:33.214223] [INFO ] [REMOTE ] LXU: Full fetch complete (44982 records). [2025-09-26T19:52:33.214344] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-09-26T19:52:33.514303] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-09-26T19:52:33.642870] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-09-26T19:52:33.642976] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-09-26T19:52:33.643712] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-09-26T19:52:33.643777] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-09-26T19:52:33.644995] [DEBUG] [LOCAL ] LXU: Trimmed 44982 records to 32354 (keeping 200 days of data) [2025-09-26T19:52:33.781487] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2024-12 (2.66 seconds). [2025-09-26T19:52:33.880531] [DEBUG] [LOCAL ] LXU: Primary data saved (32354 records). [2025-09-26T19:52:33.880797] [INFO ] [MAIN ] LXU: Full history saved. [2025-09-26T19:52:33.880927] [INFO ] [MAIN ] Update Progress: 1291/2371 symbols completed. LXU took 29.3s. Estimated remaining: 2h 24m 19s. Rate: 7.5 symbols/min [2025-09-26T19:52:34.080985] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:52:34.136113] [DEBUG] [LOCAL ] LYV: Loaded 51528 existing records from primary storage. [2025-09-26T19:52:34.136363] [INFO ] [MAIN ] LYV: Loaded 51528 existing records. [2025-09-26T19:52:34.313496] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-01. [2025-09-26T19:52:34.337894] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:52:34.339722] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-09-26T19:52:34.339820] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-09-26T19:52:34.341069] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-09-26T19:52:34.341140] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-09-26T19:52:34.668153] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-26T19:52:34.800895] [INFO ] [REMOTE ] LYV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:52:35.111704] [INFO ] [REMOTE ] LYV: Fetching primary data for 2024-12. [2025-09-26T19:52:35.538795] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-26T19:52:35.550781] [INFO ] [REMOTE ] LXP: Full fetch complete (72504 records). [2025-09-26T19:52:35.550991] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-09-26T19:52:35.913322] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-01. [2025-09-26T19:52:35.991063] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-09-26T19:52:35.991259] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-09-26T19:52:35.992364] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-09-26T19:52:35.992709] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-09-26T19:52:35.995055] [DEBUG] [LOCAL ] LXP: Trimmed 72504 records to 51361 (keeping 200 days of data) [2025-09-26T19:52:36.136827] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-26T19:52:36.351635] [DEBUG] [LOCAL ] LXP: Primary data saved (51361 records). [2025-09-26T19:52:36.351807] [INFO ] [MAIN ] LXP: Full history saved. [2025-09-26T19:52:36.351940] [INFO ] [MAIN ] Update Progress: 1292/2371 symbols completed. LXP took 33.7s. Estimated remaining: 2h 24m 6s. Rate: 7.5 symbols/min [2025-09-26T19:52:36.544544] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:52:36.579879] [DEBUG] [LOCAL ] LZB: Loaded 35833 existing records from primary storage. [2025-09-26T19:52:36.580030] [INFO ] [MAIN ] LZB: Loaded 35833 existing records. [2025-09-26T19:52:36.715693] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-09-26T19:52:36.776381] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:52:36.776977] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-09-26T19:52:36.777110] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-09-26T19:52:36.778250] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-09-26T19:52:36.778451] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-09-26T19:52:36.935192] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-26T19:52:37.212262] [INFO ] [REMOTE ] LZB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:52:37.511723] [INFO ] [REMOTE ] LZB: Fetching primary data for 2024-12. [2025-09-26T19:52:37.759917] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-26T19:52:38.311692] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-01. [2025-09-26T19:52:38.484021] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-26T19:52:38.820379] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-26T19:52:39.111715] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-09-26T19:52:39.888866] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-26T19:52:39.911773] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-01. [2025-09-26T19:52:40.711725] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-09-26T19:52:40.805113] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-26T19:52:41.246150] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-26T19:52:41.511722] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-09-26T19:52:42.311698] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-09-26T19:52:42.485020] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-26T19:52:42.839048] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-26T19:52:43.111708] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-09-26T19:52:43.911715] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-09-26T19:52:44.266817] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-26T19:52:44.711733] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-09-26T19:52:45.070499] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-26T19:52:45.155017] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-26T19:52:45.511734] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-09-26T19:52:46.311728] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-09-26T19:52:46.650541] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-26T19:52:47.111703] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-09-26T19:52:47.803668] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-26T19:52:47.894530] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-26T19:52:47.911674] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-09-26T19:52:48.711730] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-09-26T19:52:48.782097] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-26T19:52:49.397122] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T19:52:49.511725] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-09-26T19:52:50.118752] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-26T19:52:50.311727] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-09-26T19:52:50.847881] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-26T19:52:51.111713] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-09-26T19:52:51.911699] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-09-26T19:52:52.000109] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-26T19:52:52.711694] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-09-26T19:52:52.761085] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-26T19:52:53.511701] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-09-26T19:52:53.620843] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-26T19:52:54.039561] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-26T19:52:54.311716] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-09-26T19:52:55.071197] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-26T19:52:55.111680] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-09-26T19:52:55.911699] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-09-26T19:52:56.084733] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-26T19:52:56.121133] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-26T19:52:56.711716] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-09-26T19:52:57.511701] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-09-26T19:52:57.995061] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-26T19:52:58.311682] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-09-26T19:52:58.483939] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-26T19:52:59.111704] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-09-26T19:52:59.449126] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-26T19:52:59.911711] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-09-26T19:53:00.166290] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-26T19:53:00.447663] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-26T19:53:00.711773] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-09-26T19:53:01.511695] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-09-26T19:53:02.005419] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-26T19:53:02.016119] [INFO ] [REMOTE ] LYG: Full fetch complete (76038 records). [2025-09-26T19:53:02.016332] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-09-26T19:53:02.316844] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-09-26T19:53:02.457959] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-09-26T19:53:02.458080] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-09-26T19:53:02.459256] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-09-26T19:53:02.459362] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-09-26T19:53:02.495206] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-26T19:53:02.495399] [DEBUG] [LOCAL ] LYG: Trimmed 76038 records to 53606 (keeping 200 days of data) [2025-09-26T19:53:02.832318] [DEBUG] [LOCAL ] LYG: Primary data saved (53606 records). [2025-09-26T19:53:02.832477] [INFO ] [MAIN ] LYG: Full history saved. [2025-09-26T19:53:02.832584] [INFO ] [MAIN ] Update Progress: 1293/2371 symbols completed. LYG took 32.6s. Estimated remaining: 2h 24m 14s. Rate: 7.5 symbols/min [2025-09-26T19:53:03.013771] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:53:03.028267] [DEBUG] [LOCAL ] LZM: Loaded 13758 existing records from primary storage. [2025-09-26T19:53:03.028403] [INFO ] [MAIN ] LZM: Loaded 13758 existing records. [2025-09-26T19:53:03.116763] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-09-26T19:53:03.227676] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:53:03.227967] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-09-26T19:53:03.228018] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-09-26T19:53:03.228422] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-09-26T19:53:03.228482] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-09-26T19:53:03.625635] [INFO ] [REMOTE ] LZM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:53:03.657118] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-26T19:53:03.668111] [INFO ] [REMOTE ] LYB: Full fetch complete (77456 records). [2025-09-26T19:53:03.668338] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-09-26T19:53:03.916981] [INFO ] [REMOTE ] LZM: Fetching primary data for 2024-12. [2025-09-26T19:53:04.100378] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-09-26T19:53:04.100525] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-09-26T19:53:04.101669] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-09-26T19:53:04.101847] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-09-26T19:53:04.103628] [DEBUG] [LOCAL ] LYB: Trimmed 77456 records to 54379 (keeping 200 days of data) [2025-09-26T19:53:04.254690] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-26T19:53:04.510593] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-26T19:53:04.543562] [DEBUG] [LOCAL ] LYB: Primary data saved (54379 records). [2025-09-26T19:53:04.543764] [INFO ] [MAIN ] LYB: Full history saved. [2025-09-26T19:53:04.543880] [INFO ] [MAIN ] Update Progress: 1294/2371 symbols completed. LYB took 37.1s. Estimated remaining: 2h 24m 1s. Rate: 7.5 symbols/min [2025-09-26T19:53:04.718056] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-09-26T19:53:04.759193] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:53:04.764521] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T19:53:04.773247] [INFO ] [REMOTE ] LZB: Full fetch complete (50395 records). [2025-09-26T19:53:04.773404] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-09-26T19:53:05.157901] [DEBUG] [LOCAL ] M: Loaded 53925 existing records from primary storage. [2025-09-26T19:53:05.168534] [INFO ] [MAIN ] M: Loaded 53925 existing records. [2025-09-26T19:53:05.349237] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-09-26T19:53:05.367466] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-09-26T19:53:05.368547] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-09-26T19:53:05.369002] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-09-26T19:53:05.433588] [DEBUG] [LOCAL ] LZB: Trimmed 50395 records to 36113 (keeping 200 days of data) [2025-09-26T19:53:05.455116] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:53:05.456102] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-09-26T19:53:05.456548] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-09-26T19:53:05.520749] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-09-26T19:53:05.520612] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-01. [2025-09-26T19:53:05.521012] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-09-26T19:53:05.993599] [INFO ] [REMOTE ] M: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:53:06.110367] [DEBUG] [LOCAL ] LZB: Primary data saved (36113 records). [2025-09-26T19:53:06.110579] [INFO ] [MAIN ] LZB: Full history saved. [2025-09-26T19:53:06.110722] [INFO ] [MAIN ] Update Progress: 1295/2371 symbols completed. LZB took 29.8s. Estimated remaining: 2h 23m 47s. Rate: 7.5 symbols/min [2025-09-26T19:53:06.290265] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:53:06.324191] [INFO ] [REMOTE ] M: Fetching primary data for 2024-12. [2025-09-26T19:53:06.348580] [DEBUG] [LOCAL ] MA: Loaded 52958 existing records from primary storage. [2025-09-26T19:53:06.348820] [INFO ] [MAIN ] MA: Loaded 52958 existing records. [2025-09-26T19:53:06.528099] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-26T19:53:06.602986] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:53:06.603768] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-09-26T19:53:06.603893] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-09-26T19:53:06.615874] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-09-26T19:53:06.639331] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-09-26T19:53:06.691906] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-26T19:53:06.768740] [INFO ] [REMOTE ] LYV: Full fetch complete (73640 records). [2025-09-26T19:53:06.779890] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-09-26T19:53:07.120282] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-09-26T19:53:07.463830] [INFO ] [REMOTE ] MA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:53:07.520827] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-09-26T19:53:07.520932] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-09-26T19:53:07.522245] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-09-26T19:53:07.522319] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-09-26T19:53:07.524140] [DEBUG] [LOCAL ] LYV: Trimmed 73640 records to 51906 (keeping 200 days of data) [2025-09-26T19:53:07.870896] [DEBUG] [LOCAL ] LYV: Primary data saved (51906 records). [2025-09-26T19:53:07.871106] [INFO ] [MAIN ] LYV: Full history saved. [2025-09-26T19:53:07.871241] [INFO ] [MAIN ] Update Progress: 1296/2371 symbols completed. LYV took 34.0s. Estimated remaining: 2h 23m 34s. Rate: 7.5 symbols/min [2025-09-26T19:53:07.918275] [INFO ] [REMOTE ] MA: Fetching primary data for 2024-12. [2025-09-26T19:53:08.005793] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-26T19:53:08.096714] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:53:08.142253] [DEBUG] [LOCAL ] MAA: Loaded 43062 existing records from primary storage. [2025-09-26T19:53:08.142457] [INFO ] [MAIN ] MAA: Loaded 43062 existing records. [2025-09-26T19:53:08.354467] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:53:08.354996] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-09-26T19:53:08.355169] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-09-26T19:53:08.356229] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-09-26T19:53:08.356304] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-09-26T19:53:08.731494] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-09-26T19:53:08.809948] [INFO ] [REMOTE ] MAA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:53:08.818114] [INFO ] [REMOTE ] M: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-09-26T19:53:09.511786] [INFO ] [REMOTE ] MAA: Fetching primary data for 2024-12. [2025-09-26T19:53:09.730297] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-26T19:53:09.767227] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-26T19:53:10.311817] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-09-26T19:53:11.104890] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-26T19:53:11.112587] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-01. [2025-09-26T19:53:11.159835] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-26T19:53:11.911757] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-09-26T19:53:12.709783] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-26T19:53:12.713952] [INFO ] [REMOTE ] M: Fetching primary data for 2025-01. [2025-09-26T19:53:12.845880] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-26T19:53:13.511728] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-01. [2025-09-26T19:53:14.311760] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-09-26T19:53:14.639223] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-26T19:53:14.994043] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-26T19:53:15.111753] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-09-26T19:53:15.786325] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-26T19:53:15.911773] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-09-26T19:53:16.429221] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-26T19:53:16.711846] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-09-26T19:53:17.511713] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-09-26T19:53:17.761214] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-26T19:53:18.311870] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-09-26T19:53:18.350112] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-26T19:53:18.761261] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-26T19:53:19.111843] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-09-26T19:53:19.905586] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-26T19:53:19.911660] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-09-26T19:53:20.057821] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-26T19:53:20.711746] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-09-26T19:53:20.818210] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-26T19:53:21.511757] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-09-26T19:53:22.311720] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-09-26T19:53:23.003862] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-26T19:53:23.114702] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-09-26T19:53:23.120665] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-26T19:53:23.348083] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-26T19:53:23.352387] [INFO ] [REMOTE ] LZM: Full fetch complete (18050 records). [2025-09-26T19:53:23.352485] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-09-26T19:53:23.746020] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-09-26T19:53:23.746133] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-09-26T19:53:23.746908] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-09-26T19:53:23.746975] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-09-26T19:53:23.747772] [DEBUG] [LOCAL ] LZM: Trimmed 18050 records to 13905 (keeping 200 days of data) [2025-09-26T19:53:23.829242] [DEBUG] [LOCAL ] LZM: Primary data saved (13905 records). [2025-09-26T19:53:23.829436] [INFO ] [MAIN ] LZM: Full history saved. [2025-09-26T19:53:23.829546] [INFO ] [MAIN ] Update Progress: 1297/2371 symbols completed. LZM took 21.0s. Estimated remaining: 2h 23m 33s. Rate: 7.5 symbols/min [2025-09-26T19:53:23.916815] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-09-26T19:53:24.017300] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:53:24.075800] [DEBUG] [LOCAL ] MAC: Loaded 50079 existing records from primary storage. [2025-09-26T19:53:24.076062] [INFO ] [MAIN ] MAC: Loaded 50079 existing records. [2025-09-26T19:53:24.269236] [WARN ] [MAIN ] MAC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:53:24.269728] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-09-26T19:53:24.269791] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-09-26T19:53:24.271266] [DEBUG] [LOCAL ] MAC: Deleted primary data file. [2025-09-26T19:53:24.271474] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-09-26T19:53:24.653018] [INFO ] [REMOTE ] MAC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:53:24.711827] [INFO ] [REMOTE ] MAC: Fetching primary data for 2024-12. [2025-09-26T19:53:24.989118] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-26T19:53:25.092874] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-26T19:53:25.511748] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-09-26T19:53:26.311757] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-09-26T19:53:26.445785] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-26T19:53:27.116809] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-09-26T19:53:27.137200] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-26T19:53:27.911729] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-01. [2025-09-26T19:53:28.082044] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-26T19:53:28.711756] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-09-26T19:53:29.293370] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-26T19:53:29.512342] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-09-26T19:53:29.515736] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-26T19:53:30.311223] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-26T19:53:30.320205] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-09-26T19:53:31.111800] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-09-26T19:53:31.197627] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-26T19:53:31.917954] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-09-26T19:53:31.936792] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-26T19:53:32.441920] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-26T19:53:32.711755] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-09-26T19:53:33.511760] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-09-26T19:53:34.106104] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-26T19:53:34.311692] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-09-26T19:53:34.508559] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-26T19:53:35.111708] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-09-26T19:53:35.376718] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-26T19:53:35.911701] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-09-26T19:53:35.992660] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-26T19:53:36.711758] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-09-26T19:53:37.428965] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-26T19:53:37.511689] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-09-26T19:53:37.659386] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-26T19:53:38.311702] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-09-26T19:53:38.770043] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-26T19:53:38.807789] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-26T19:53:38.816422] [INFO ] [REMOTE ] MAA: Full fetch complete (61032 records). [2025-09-26T19:53:38.816630] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-09-26T19:53:39.116902] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-09-26T19:53:39.232327] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-09-26T19:53:39.232444] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-09-26T19:53:39.233776] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-09-26T19:53:39.233942] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-09-26T19:53:39.235837] [DEBUG] [LOCAL ] MAA: Trimmed 61032 records to 43354 (keeping 200 days of data) [2025-09-26T19:53:39.544186] [DEBUG] [LOCAL ] MAA: Primary data saved (43354 records). [2025-09-26T19:53:39.544435] [INFO ] [MAIN ] MAA: Full history saved. [2025-09-26T19:53:39.544710] [INFO ] [MAIN ] Update Progress: 1298/2371 symbols completed. MAA took 31.7s. Estimated remaining: 2h 23m 31s. Rate: 7.5 symbols/min [2025-09-26T19:53:39.742383] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:53:39.788381] [DEBUG] [LOCAL ] MAGN: Loaded 35204 existing records from primary storage. [2025-09-26T19:53:39.788625] [INFO ] [MAIN ] MAGN: Loaded 35204 existing records. [2025-09-26T19:53:39.917065] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-09-26T19:53:40.001287] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:53:40.001664] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-09-26T19:53:40.001731] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-09-26T19:53:40.002542] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-09-26T19:53:40.002616] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-09-26T19:53:40.394881] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:53:40.429840] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-26T19:53:40.441920] [INFO ] [REMOTE ] M: Full fetch complete (77522 records). [2025-09-26T19:53:40.442161] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-09-26T19:53:40.719898] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2024-12. [2025-09-26T19:53:40.868411] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-09-26T19:53:40.868671] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-09-26T19:53:40.870677] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-09-26T19:53:40.870812] [DEBUG] [LOCAL ] M: Saving primary data. [2025-09-26T19:53:40.884865] [DEBUG] [LOCAL ] M: Trimmed 77522 records to 54315 (keeping 200 days of data) [2025-09-26T19:53:40.909232] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-26T19:53:41.288973] [DEBUG] [LOCAL ] M: Primary data saved (54315 records). [2025-09-26T19:53:41.289144] [INFO ] [MAIN ] M: Full history saved. [2025-09-26T19:53:41.289259] [INFO ] [MAIN ] Update Progress: 1299/2371 symbols completed. M took 36.7s. Estimated remaining: 2h 23m 18s. Rate: 7.5 symbols/min [2025-09-26T19:53:41.477471] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:53:41.522817] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-06. [2025-09-26T19:53:41.528202] [DEBUG] [LOCAL ] MAIN: Loaded 41683 existing records from primary storage. [2025-09-26T19:53:41.528573] [INFO ] [MAIN ] MAIN: Loaded 41683 existing records. [2025-09-26T19:53:41.729701] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:53:41.730121] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-09-26T19:53:41.730175] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-09-26T19:53:41.731378] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-09-26T19:53:41.731445] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-09-26T19:53:42.128084] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:53:42.171761] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-26T19:53:42.205837] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-26T19:53:42.311681] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-01. [2025-09-26T19:53:43.111774] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2024-12. [2025-09-26T19:53:43.266169] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-26T19:53:43.656751] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-26T19:53:43.911795] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-09-26T19:53:44.711736] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-09-26T19:53:44.832746] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-26T19:53:45.347703] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-26T19:53:45.511773] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-07. [2025-09-26T19:53:46.311743] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-01. [2025-09-26T19:53:46.679759] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-26T19:53:46.690339] [INFO ] [REMOTE ] MA: Full fetch complete (76263 records). [2025-09-26T19:53:46.690525] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-09-26T19:53:47.118724] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-09-26T19:53:47.124368] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-09-26T19:53:47.124513] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-09-26T19:53:47.126272] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-09-26T19:53:47.126462] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-09-26T19:53:47.130093] [DEBUG] [LOCAL ] MA: Trimmed 76263 records to 53329 (keeping 200 days of data) [2025-09-26T19:53:47.283264] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-26T19:53:47.554592] [DEBUG] [LOCAL ] MA: Primary data saved (53329 records). [2025-09-26T19:53:47.554820] [INFO ] [MAIN ] MA: Full history saved. [2025-09-26T19:53:47.554961] [INFO ] [MAIN ] Update Progress: 1300/2371 symbols completed. MA took 41.4s. Estimated remaining: 2h 23m 8s. Rate: 7.5 symbols/min [2025-09-26T19:53:47.731289] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:53:47.779894] [DEBUG] [LOCAL ] MAN: Loaded 43878 existing records from primary storage. [2025-09-26T19:53:47.780128] [INFO ] [MAIN ] MAN: Loaded 43878 existing records. [2025-09-26T19:53:47.923010] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-08. [2025-09-26T19:53:47.991722] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:53:47.994041] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-26T19:53:48.002732] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-09-26T19:53:48.003498] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-09-26T19:53:48.004863] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-09-26T19:53:48.004926] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-09-26T19:53:48.379886] [INFO ] [REMOTE ] MAN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:53:48.402527] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-26T19:53:48.711756] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-09-26T19:53:49.521019] [INFO ] [REMOTE ] MAN: Fetching primary data for 2024-12. [2025-09-26T19:53:49.554181] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-26T19:53:50.311747] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-09-26T19:53:50.373364] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-26T19:53:51.105545] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-26T19:53:51.115838] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-09. [2025-09-26T19:53:51.627310] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-26T19:53:51.911778] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-09-26T19:53:52.711769] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-01. [2025-09-26T19:53:53.405817] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T19:53:53.445592] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-09-26T19:53:53.456553] [INFO ] [REMOTE ] MAC: Full fetch complete (71461 records). [2025-09-26T19:53:53.456752] [DEBUG] [VALIDATOR ] MAC: Validating primary data. [2025-09-26T19:53:53.522032] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-09-26T19:53:53.856499] [DEBUG] [VALIDATOR ] MAC: All expected trading days are present. [2025-09-26T19:53:53.856617] [DEBUG] [VALIDATOR ] MAC: Primary data validation passed. [2025-09-26T19:53:53.858061] [INFO ] [MAIN ] MAC: Fetched primary data is valid. [2025-09-26T19:53:53.858136] [DEBUG] [LOCAL ] MAC: Saving primary data. [2025-09-26T19:53:53.860313] [DEBUG] [LOCAL ] MAC: Trimmed 71461 records to 50469 (keeping 200 days of data) [2025-09-26T19:53:54.211001] [DEBUG] [LOCAL ] MAC: Primary data saved (50469 records). [2025-09-26T19:53:54.211246] [INFO ] [MAIN ] MAC: Full history saved. [2025-09-26T19:53:54.211421] [INFO ] [MAIN ] Update Progress: 1301/2371 symbols completed. MAC took 30.4s. Estimated remaining: 2h 22m 59s. Rate: 7.5 symbols/min [2025-09-26T19:53:54.314319] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-09-26T19:53:54.393391] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:53:54.426531] [DEBUG] [LOCAL ] MANU: Loaded 27364 existing records from primary storage. [2025-09-26T19:53:54.426796] [INFO ] [MAIN ] MANU: Loaded 27364 existing records. [2025-09-26T19:53:54.590390] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-26T19:53:54.674278] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:53:54.675030] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-09-26T19:53:54.675117] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-09-26T19:53:54.675885] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-09-26T19:53:54.675951] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-09-26T19:53:55.086827] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-26T19:53:55.093876] [INFO ] [REMOTE ] MANU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:53:55.111674] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-09-26T19:53:55.922375] [INFO ] [REMOTE ] MANU: Fetching primary data for 2024-12. [2025-09-26T19:53:55.940622] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-26T19:53:56.652208] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-26T19:53:56.711757] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-09-26T19:53:57.051511] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-26T19:53:57.511755] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-01. [2025-09-26T19:53:58.316852] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-09-26T19:53:58.337024] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-26T19:53:58.615383] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-26T19:53:59.111758] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-09-26T19:53:59.911725] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-09-26T19:54:00.006962] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-26T19:54:00.597437] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-26T19:54:00.711791] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-09-26T19:54:01.511747] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-09-26T19:54:01.730638] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-26T19:54:02.311753] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-09-26T19:54:02.360163] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-26T19:54:02.661372] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-26T19:54:03.111760] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-09-26T19:54:03.911767] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-09-26T19:54:04.111525] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-26T19:54:04.645158] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-26T19:54:04.711749] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-09-26T19:54:05.254115] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-26T19:54:05.511777] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-09-26T19:54:06.311722] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-09-26T19:54:06.386583] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-26T19:54:06.606232] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-26T19:54:06.613460] [INFO ] [REMOTE ] MAGN: Full fetch complete (50999 records). [2025-09-26T19:54:06.613585] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-09-26T19:54:07.041405] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-09-26T19:54:07.041561] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-09-26T19:54:07.042792] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-09-26T19:54:07.042859] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-09-26T19:54:07.044585] [DEBUG] [LOCAL ] MAGN: Trimmed 50999 records to 35466 (keeping 200 days of data) [2025-09-26T19:54:07.114480] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-09-26T19:54:07.283001] [DEBUG] [LOCAL ] MAGN: Primary data saved (35466 records). [2025-09-26T19:54:07.283232] [INFO ] [MAIN ] MAGN: Full history saved. [2025-09-26T19:54:07.283369] [INFO ] [MAIN ] Update Progress: 1302/2371 symbols completed. MAGN took 27.7s. Estimated remaining: 2h 22m 55s. Rate: 7.5 symbols/min [2025-09-26T19:54:07.456907] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:54:07.518684] [DEBUG] [LOCAL ] MAS: Loaded 52722 existing records from primary storage. [2025-09-26T19:54:07.518947] [INFO ] [MAIN ] MAS: Loaded 52722 existing records. [2025-09-26T19:54:07.723767] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:54:07.743891] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-09-26T19:54:07.745483] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-09-26T19:54:07.745370] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-26T19:54:07.753561] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-09-26T19:54:07.753725] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-09-26T19:54:07.916899] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-09-26T19:54:08.128404] [INFO ] [REMOTE ] MAS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:54:08.711718] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-09-26T19:54:08.884475] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-26T19:54:09.511760] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-09-26T19:54:09.555764] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-26T19:54:09.846380] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-26T19:54:10.311762] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-09-26T19:54:11.111722] [INFO ] [REMOTE ] MAS: Fetching primary data for 2024-12. [2025-09-26T19:54:11.453859] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-26T19:54:11.478750] [INFO ] [REMOTE ] MAIN: Full fetch complete (59707 records). [2025-09-26T19:54:11.479409] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-26T19:54:11.479806] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-09-26T19:54:11.908324] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-09-26T19:54:11.908436] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-09-26T19:54:11.910067] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-09-26T19:54:11.910139] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-09-26T19:54:11.912025] [DEBUG] [LOCAL ] MAIN: Trimmed 59707 records to 41929 (keeping 200 days of data) [2025-09-26T19:54:11.911761] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-09-26T19:54:12.203190] [DEBUG] [LOCAL ] MAIN: Primary data saved (41929 records). [2025-09-26T19:54:12.203474] [INFO ] [MAIN ] MAIN: Full history saved. [2025-09-26T19:54:12.203721] [INFO ] [MAIN ] Update Progress: 1303/2371 symbols completed. MAIN took 30.9s. Estimated remaining: 2h 22m 45s. Rate: 7.5 symbols/min [2025-09-26T19:54:12.384796] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:54:12.430074] [DEBUG] [LOCAL ] MATV: Loaded 37749 existing records from primary storage. [2025-09-26T19:54:12.430289] [INFO ] [MAIN ] MATV: Loaded 37749 existing records. [2025-09-26T19:54:12.620444] [WARN ] [MAIN ] MATV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:54:12.621322] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-09-26T19:54:12.621439] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-09-26T19:54:12.622431] [DEBUG] [LOCAL ] MATV: Deleted primary data file. [2025-09-26T19:54:12.622504] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-09-26T19:54:12.714683] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-09-26T19:54:12.973446] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-26T19:54:13.063625] [INFO ] [REMOTE ] MATV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:54:13.462401] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T19:54:13.511676] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-09-26T19:54:14.311756] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-01. [2025-09-26T19:54:14.456727] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-26T19:54:14.518386] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-26T19:54:15.111756] [INFO ] [REMOTE ] MATV: Fetching primary data for 2024-12. [2025-09-26T19:54:15.911772] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-09-26T19:54:16.044115] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-26T19:54:16.518847] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-26T19:54:16.711794] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-01. [2025-09-26T19:54:17.491544] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-26T19:54:17.511684] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-09-26T19:54:17.936181] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-26T19:54:18.311761] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-09-26T19:54:19.111711] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-09-26T19:54:19.360685] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-26T19:54:19.564858] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-26T19:54:19.911697] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-09-26T19:54:20.214429] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-26T19:54:20.711758] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-09-26T19:54:21.466438] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-26T19:54:21.473039] [INFO ] [REMOTE ] MANU: Full fetch complete (38236 records). [2025-09-26T19:54:21.473147] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-09-26T19:54:21.518442] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-09-26T19:54:21.865908] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-09-26T19:54:21.866021] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-09-26T19:54:21.867071] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-09-26T19:54:21.867142] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-09-26T19:54:21.868260] [DEBUG] [LOCAL ] MANU: Trimmed 38236 records to 27544 (keeping 200 days of data) [2025-09-26T19:54:22.063852] [DEBUG] [LOCAL ] MANU: Primary data saved (27544 records). [2025-09-26T19:54:22.064084] [INFO ] [MAIN ] MANU: Full history saved. [2025-09-26T19:54:22.064237] [INFO ] [MAIN ] Update Progress: 1304/2371 symbols completed. MANU took 27.9s. Estimated remaining: 2h 22m 38s. Rate: 7.5 symbols/min [2025-09-26T19:54:22.324148] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-09-26T19:54:22.353043] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:54:22.356952] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-26T19:54:22.415571] [DEBUG] [LOCAL ] MATX: Loaded 31717 existing records from primary storage. [2025-09-26T19:54:22.415830] [INFO ] [MAIN ] MATX: Loaded 31717 existing records. [2025-09-26T19:54:22.596060] [WARN ] [MAIN ] MATX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:54:22.596460] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-09-26T19:54:22.596581] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-09-26T19:54:22.597634] [DEBUG] [LOCAL ] MATX: Deleted primary data file. [2025-09-26T19:54:22.597734] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-09-26T19:54:22.965347] [INFO ] [REMOTE ] MATX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:54:23.111725] [INFO ] [REMOTE ] MATX: Fetching primary data for 2024-12. [2025-09-26T19:54:23.387927] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-26T19:54:23.397239] [INFO ] [REMOTE ] MAN: Full fetch complete (62028 records). [2025-09-26T19:54:23.397399] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-09-26T19:54:23.819189] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-09-26T19:54:23.819412] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-09-26T19:54:23.820454] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-09-26T19:54:23.820692] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-09-26T19:54:23.823958] [DEBUG] [LOCAL ] MAN: Trimmed 62028 records to 44216 (keeping 200 days of data) [2025-09-26T19:54:23.934934] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-09-26T19:54:24.009559] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-26T19:54:24.218981] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-26T19:54:24.231623] [DEBUG] [LOCAL ] MAN: Primary data saved (44216 records). [2025-09-26T19:54:24.231854] [INFO ] [MAIN ] MAN: Full history saved. [2025-09-26T19:54:24.232033] [INFO ] [MAIN ] Update Progress: 1305/2371 symbols completed. MAN took 36.7s. Estimated remaining: 2h 22m 25s. Rate: 7.5 symbols/min [2025-09-26T19:54:24.419601] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:54:24.455858] [DEBUG] [LOCAL ] MAX: Loaded 31061 existing records from primary storage. [2025-09-26T19:54:24.456067] [INFO ] [MAIN ] MAX: Loaded 31061 existing records. [2025-09-26T19:54:24.657002] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:54:24.657347] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-09-26T19:54:24.657398] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-09-26T19:54:24.658159] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-09-26T19:54:24.658222] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-09-26T19:54:24.722786] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-01. [2025-09-26T19:54:25.022707] [INFO ] [REMOTE ] MAX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:54:25.511718] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-09-26T19:54:25.635043] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-26T19:54:26.018017] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-26T19:54:26.311771] [INFO ] [REMOTE ] MAX: Fetching primary data for 2024-12. [2025-09-26T19:54:26.683023] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-26T19:54:27.111765] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-09-26T19:54:27.833191] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-26T19:54:27.911741] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-09-26T19:54:28.711763] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-09-26T19:54:28.979223] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-26T19:54:29.223885] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-26T19:54:29.511761] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-09-26T19:54:29.798703] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-26T19:54:30.311780] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-09-26T19:54:30.773474] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-26T19:54:31.111736] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-09-26T19:54:31.921401] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-09-26T19:54:31.944096] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-26T19:54:32.619527] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-26T19:54:32.711733] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-09-26T19:54:33.378894] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-26T19:54:33.511772] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-01. [2025-09-26T19:54:34.311712] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-09-26T19:54:34.541203] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-26T19:54:34.970161] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-26T19:54:35.111721] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-09-26T19:54:35.641839] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-26T19:54:35.911726] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-09-26T19:54:36.583105] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-26T19:54:36.711722] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-09-26T19:54:37.178046] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-26T19:54:37.511723] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-09-26T19:54:38.311716] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-09-26T19:54:38.396881] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-26T19:54:38.472506] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-26T19:54:39.111746] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-09-26T19:54:39.253767] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-26T19:54:39.911747] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-09-26T19:54:40.711698] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-09-26T19:54:40.897307] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-26T19:54:40.907384] [INFO ] [REMOTE ] MAS: Full fetch complete (74824 records). [2025-09-26T19:54:40.907519] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-09-26T19:54:41.331104] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-09-26T19:54:41.331261] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-09-26T19:54:41.332501] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-09-26T19:54:41.332598] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-09-26T19:54:41.353283] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-26T19:54:41.360585] [INFO ] [REMOTE ] MATV: Full fetch complete (52442 records). [2025-09-26T19:54:41.360434] [DEBUG] [LOCAL ] MAS: Trimmed 74824 records to 53102 (keeping 200 days of data) [2025-09-26T19:54:41.360973] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-09-26T19:54:41.531807] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-09-26T19:54:42.113355] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-26T19:54:42.163000] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-09-26T19:54:42.163816] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-09-26T19:54:42.165337] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-09-26T19:54:42.165428] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-09-26T19:54:42.181098] [DEBUG] [LOCAL ] MATV: Trimmed 52442 records to 37964 (keeping 200 days of data) [2025-09-26T19:54:42.192956] [DEBUG] [LOCAL ] MAS: Primary data saved (53102 records). [2025-09-26T19:54:42.193334] [INFO ] [MAIN ] MAS: Full history saved. [2025-09-26T19:54:42.193518] [INFO ] [MAIN ] Update Progress: 1306/2371 symbols completed. MAS took 34.9s. Estimated remaining: 2h 22m 25s. Rate: 7.5 symbols/min [2025-09-26T19:54:42.327950] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-09-26T19:54:42.621800] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:54:42.671758] [DEBUG] [LOCAL ] MATV: Primary data saved (37964 records). [2025-09-26T19:54:42.671919] [INFO ] [MAIN ] MATV: Full history saved. [2025-09-26T19:54:42.672040] [INFO ] [MAIN ] Update Progress: 1307/2371 symbols completed. MATV took 30.5s. Estimated remaining: 2h 22m 11s. Rate: 7.5 symbols/min [2025-09-26T19:54:42.801210] [DEBUG] [LOCAL ] MBC: Loaded 43426 existing records from primary storage. [2025-09-26T19:54:42.836558] [INFO ] [MAIN ] MBC: Loaded 43426 existing records. [2025-09-26T19:54:42.870007] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:54:42.881577] [DEBUG] [LOCAL ] MBI: No existing data file found in primary storage. [2025-09-26T19:54:42.892048] [WARN ] [MAIN ] MBI: No existing data found, performing full refresh instead. [2025-09-26T19:54:42.921399] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-09-26T19:54:42.956278] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-09-26T19:54:42.986102] [DEBUG] [LOCAL ] MBI: No primary data file found to delete. [2025-09-26T19:54:43.002609] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-09-26T19:54:43.020109] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-26T19:54:43.133137] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:54:43.138672] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-09-26T19:54:43.162069] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-09-26T19:54:43.175186] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-09-26T19:54:43.199212] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-09-26T19:54:43.199382] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-09-26T19:54:43.733762] [INFO ] [REMOTE ] MBI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:54:43.913491] [INFO ] [REMOTE ] MBC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:54:43.913593] [INFO ] [REMOTE ] MBI: Fetching primary data for 2024-12. [2025-09-26T19:54:43.936150] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-26T19:54:44.575154] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-26T19:54:44.581288] [INFO ] [REMOTE ] MATX: Full fetch complete (42530 records). [2025-09-26T19:54:44.581415] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-09-26T19:54:44.716824] [INFO ] [REMOTE ] MBC: Fetching primary data for 2024-12. [2025-09-26T19:54:45.085392] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-09-26T19:54:45.085602] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-09-26T19:54:45.087386] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-09-26T19:54:45.087677] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-09-26T19:54:45.089580] [DEBUG] [LOCAL ] MATX: Trimmed 42530 records to 31851 (keeping 200 days of data) [2025-09-26T19:54:45.265881] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-26T19:54:45.458756] [DEBUG] [LOCAL ] MATX: Primary data saved (31851 records). [2025-09-26T19:54:45.459400] [INFO ] [MAIN ] MATX: Full history saved. [2025-09-26T19:54:45.461495] [INFO ] [MAIN ] Update Progress: 1308/2371 symbols completed. MATX took 23.4s. Estimated remaining: 2h 21m 59s. Rate: 7.5 symbols/min [2025-09-26T19:54:45.518692] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-09-26T19:54:45.716156] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:54:45.779213] [DEBUG] [LOCAL ] MC: Loaded 44594 existing records from primary storage. [2025-09-26T19:54:45.779430] [INFO ] [MAIN ] MC: Loaded 44594 existing records. [2025-09-26T19:54:45.985548] [WARN ] [MAIN ] MC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:54:45.985996] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-09-26T19:54:45.986055] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-09-26T19:54:45.987137] [DEBUG] [LOCAL ] MC: Deleted primary data file. [2025-09-26T19:54:45.987200] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-09-26T19:54:46.316678] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-01. [2025-09-26T19:54:46.375750] [INFO ] [REMOTE ] MC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:54:46.405930] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-26T19:54:46.982531] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-26T19:54:47.111719] [INFO ] [REMOTE ] MC: Fetching primary data for 2024-12. [2025-09-26T19:54:47.512943] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-26T19:54:47.911719] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-09-26T19:54:48.127030] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-26T19:54:48.711754] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-09-26T19:54:49.175905] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-26T19:54:49.511731] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-01. [2025-09-26T19:54:49.875696] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-26T19:54:50.311735] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-01. [2025-09-26T19:54:51.071631] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-26T19:54:51.111678] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-09-26T19:54:51.670266] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-26T19:54:51.911735] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-09-26T19:54:52.584459] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-26T19:54:52.711734] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-09-26T19:54:53.307031] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-26T19:54:53.511750] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-09-26T19:54:53.919141] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-26T19:54:54.311699] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-09-26T19:54:54.630834] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-26T19:54:55.111729] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-09-26T19:54:55.753609] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-26T19:54:55.911725] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-09-26T19:54:56.612106] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-26T19:54:56.711710] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-09-26T19:54:57.000556] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-26T19:54:57.511730] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-09-26T19:54:58.311698] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-09-26T19:54:58.391300] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-26T19:54:58.593691] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-26T19:54:59.111739] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-09-26T19:54:59.911719] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-09-26T19:55:00.173389] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-26T19:55:00.658442] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-26T19:55:00.711705] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-09-26T19:55:01.115725] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-26T19:55:01.511809] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-09-26T19:55:01.893336] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-26T19:55:02.311733] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-09-26T19:55:02.372063] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-26T19:55:03.111729] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-09-26T19:55:03.607624] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-26T19:55:03.911733] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-09-26T19:55:04.615959] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-26T19:55:04.711729] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-09-26T19:55:05.511717] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-09-26T19:55:06.057096] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-26T19:55:06.095751] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-26T19:55:06.311750] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-09-26T19:55:06.757800] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-26T19:55:06.762972] [INFO ] [REMOTE ] MBI: Full fetch complete (36601 records). [2025-09-26T19:55:06.763141] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-09-26T19:55:07.116824] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-09-26T19:55:07.190965] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-09-26T19:55:07.191060] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-09-26T19:55:07.191791] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-09-26T19:55:07.191885] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-09-26T19:55:07.192945] [DEBUG] [LOCAL ] MBI: Trimmed 36601 records to 24930 (keeping 200 days of data) [2025-09-26T19:55:07.345838] [DEBUG] [LOCAL ] MBI: Primary data saved (24930 records). [2025-09-26T19:55:07.345999] [INFO ] [MAIN ] MBI: Full history saved. [2025-09-26T19:55:07.346102] [INFO ] [MAIN ] Update Progress: 1309/2371 symbols completed. MBI took 24.7s. Estimated remaining: 2h 22m 2s. Rate: 7.5 symbols/min [2025-09-26T19:55:07.538983] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:55:07.553123] [DEBUG] [LOCAL ] MCB: Loaded 11768 existing records from primary storage. [2025-09-26T19:55:07.553272] [INFO ] [MAIN ] MCB: Loaded 11768 existing records. [2025-09-26T19:55:07.756906] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:55:07.757478] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-09-26T19:55:07.757540] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-09-26T19:55:07.758143] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-09-26T19:55:07.758206] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-09-26T19:55:07.915043] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-09-26T19:55:08.194908] [INFO ] [REMOTE ] MCB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:55:08.196800] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-26T19:55:08.711724] [INFO ] [REMOTE ] MCB: Fetching primary data for 2024-12. [2025-09-26T19:55:08.813285] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-26T19:55:09.514863] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-09-26T19:55:09.516677] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-26T19:55:09.724341] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-26T19:55:09.731892] [INFO ] [REMOTE ] MAX: Full fetch complete (45303 records). [2025-09-26T19:55:09.732059] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-09-26T19:55:10.180706] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-09-26T19:55:10.180847] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-09-26T19:55:10.182350] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-09-26T19:55:10.182460] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-09-26T19:55:10.183824] [DEBUG] [LOCAL ] MAX: Trimmed 45303 records to 31209 (keeping 200 days of data) [2025-09-26T19:55:10.326824] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-01. [2025-09-26T19:55:10.368200] [DEBUG] [LOCAL ] MAX: Primary data saved (31209 records). [2025-09-26T19:55:10.368353] [INFO ] [MAIN ] MAX: Full history saved. [2025-09-26T19:55:10.368447] [INFO ] [MAIN ] Update Progress: 1310/2371 symbols completed. MAX took 46.1s. Estimated remaining: 2h 21m 50s. Rate: 7.5 symbols/min [2025-09-26T19:55:10.553886] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:55:10.554103] [DEBUG] [LOCAL ] MCD: No existing data file found in primary storage. [2025-09-26T19:55:10.554161] [WARN ] [MAIN ] MCD: No existing data found, performing full refresh instead. [2025-09-26T19:55:10.554314] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-09-26T19:55:10.554376] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-09-26T19:55:10.554421] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-09-26T19:55:10.554465] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-09-26T19:55:10.974345] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:55:11.111732] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-09-26T19:55:11.240014] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-26T19:55:11.250296] [INFO ] [REMOTE ] MBC: Full fetch complete (62693 records). [2025-09-26T19:55:11.255776] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-09-26T19:55:11.261409] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-26T19:55:11.696356] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-09-26T19:55:11.696460] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-09-26T19:55:11.697453] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-09-26T19:55:11.697523] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-09-26T19:55:11.699056] [DEBUG] [LOCAL ] MBC: Trimmed 62693 records to 43803 (keeping 200 days of data) [2025-09-26T19:55:11.911743] [INFO ] [REMOTE ] MCD: Fetching primary data for 2024-12. [2025-09-26T19:55:11.986898] [DEBUG] [LOCAL ] MBC: Primary data saved (43803 records). [2025-09-26T19:55:11.987049] [INFO ] [MAIN ] MBC: Full history saved. [2025-09-26T19:55:11.987161] [INFO ] [MAIN ] Update Progress: 1311/2371 symbols completed. MBC took 29.8s. Estimated remaining: 2h 21m 37s. Rate: 7.5 symbols/min [2025-09-26T19:55:12.174079] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:55:12.183019] [DEBUG] [LOCAL ] MCI: Loaded 6446 existing records from primary storage. [2025-09-26T19:55:12.183164] [INFO ] [MAIN ] MCI: Loaded 6446 existing records. [2025-09-26T19:55:12.377301] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:55:12.377556] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-09-26T19:55:12.377679] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-09-26T19:55:12.378022] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-09-26T19:55:12.378083] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-09-26T19:55:12.727548] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-09-26T19:55:12.767270] [INFO ] [REMOTE ] MCI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:55:12.804321] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-26T19:55:13.511722] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-09-26T19:55:13.563379] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-26T19:55:14.080414] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-26T19:55:14.311743] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-09-26T19:55:14.708840] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-26T19:55:15.111722] [INFO ] [REMOTE ] MCI: Fetching primary data for 2024-12. [2025-09-26T19:55:15.909816] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-26T19:55:15.911716] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-01. [2025-09-26T19:55:16.502915] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-26T19:55:16.667744] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-26T19:55:16.711771] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-09-26T19:55:17.511723] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-09-26T19:55:18.311720] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-09-26T19:55:18.704121] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-26T19:55:18.827289] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-26T19:55:19.111711] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-09-26T19:55:19.254852] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-26T19:55:19.867614] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-26T19:55:19.911730] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-09-26T19:55:20.711714] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-09-26T19:55:21.511747] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-09-26T19:55:21.636462] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T19:55:21.648085] [INFO ] [REMOTE ] MC: Full fetch complete (62407 records). [2025-09-26T19:55:21.648270] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-09-26T19:55:22.109928] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-09-26T19:55:22.110094] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-09-26T19:55:22.111082] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-09-26T19:55:22.111157] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-09-26T19:55:22.112687] [DEBUG] [LOCAL ] MC: Trimmed 62407 records to 44878 (keeping 200 days of data) [2025-09-26T19:55:22.319578] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-09-26T19:55:22.429558] [DEBUG] [LOCAL ] MC: Primary data saved (44878 records). [2025-09-26T19:55:22.429869] [INFO ] [MAIN ] MC: Full history saved. [2025-09-26T19:55:22.429977] [INFO ] [MAIN ] Update Progress: 1312/2371 symbols completed. MC took 37.0s. Estimated remaining: 2h 21m 31s. Rate: 7.5 symbols/min [2025-09-26T19:55:22.597627] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-26T19:55:22.667363] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:55:22.709341] [DEBUG] [LOCAL ] MCK: Loaded 39698 existing records from primary storage. [2025-09-26T19:55:22.709550] [INFO ] [MAIN ] MCK: Loaded 39698 existing records. [2025-09-26T19:55:22.904116] [WARN ] [MAIN ] MCK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:55:22.904462] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-09-26T19:55:22.904620] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-09-26T19:55:22.918760] [DEBUG] [LOCAL ] MCK: Deleted primary data file. [2025-09-26T19:55:22.935874] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-09-26T19:55:23.015536] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-26T19:55:23.089147] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-26T19:55:23.123558] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-09-26T19:55:23.354201] [INFO ] [REMOTE ] MCK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:55:23.911720] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-09-26T19:55:23.949385] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-26T19:55:24.711754] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-09-26T19:55:25.511699] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-09-26T19:55:25.583331] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-26T19:55:26.191671] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-26T19:55:26.192696] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-26T19:55:26.311730] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-09-26T19:55:27.080487] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-26T19:55:27.111736] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-09-26T19:55:27.911719] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-09-26T19:55:28.094755] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-26T19:55:28.711755] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-09-26T19:55:29.487683] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-26T19:55:29.511717] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-09-26T19:55:30.131787] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-26T19:55:30.257405] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-26T19:55:30.311736] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-09-26T19:55:31.111726] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-09-26T19:55:31.465786] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-26T19:55:31.468690] [INFO ] [REMOTE ] MCB: Full fetch complete (16342 records). [2025-09-26T19:55:31.468838] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-09-26T19:55:31.676902] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-26T19:55:31.912344] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-09-26T19:55:31.913133] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-09-26T19:55:31.913974] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-09-26T19:55:31.914426] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-09-26T19:55:31.914529] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-09-26T19:55:31.915470] [DEBUG] [LOCAL ] MCB: Trimmed 16342 records to 11834 (keeping 200 days of data) [2025-09-26T19:55:31.998205] [DEBUG] [LOCAL ] MCB: Primary data saved (11834 records). [2025-09-26T19:55:31.998369] [INFO ] [MAIN ] MCB: Full history saved. [2025-09-26T19:55:31.998540] [INFO ] [MAIN ] Update Progress: 1313/2371 symbols completed. MCB took 24.7s. Estimated remaining: 2h 21m 24s. Rate: 7.5 symbols/min [2025-09-26T19:55:32.200321] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:55:32.212592] [DEBUG] [LOCAL ] MCN: Loaded 8199 existing records from primary storage. [2025-09-26T19:55:32.212776] [INFO ] [MAIN ] MCN: Loaded 8199 existing records. [2025-09-26T19:55:32.411253] [WARN ] [MAIN ] MCN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:55:32.411515] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-09-26T19:55:32.411574] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-09-26T19:55:32.411992] [DEBUG] [LOCAL ] MCN: Deleted primary data file. [2025-09-26T19:55:32.412066] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-09-26T19:55:32.665347] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-26T19:55:32.716837] [INFO ] [REMOTE ] MCK: Fetching primary data for 2024-12. [2025-09-26T19:55:32.821329] [INFO ] [REMOTE ] MCN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:55:33.511742] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-09-26T19:55:34.301507] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-26T19:55:34.313037] [INFO ] [REMOTE ] MCN: Fetching primary data for 2024-12. [2025-09-26T19:55:35.017464] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-26T19:55:35.111748] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-01. [2025-09-26T19:55:35.470892] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-26T19:55:35.911744] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-09-26T19:55:36.644915] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-26T19:55:36.711741] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-09-26T19:55:37.478073] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-26T19:55:37.480242] [INFO ] [REMOTE ] MCI: Full fetch complete (9933 records). [2025-09-26T19:55:37.480324] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-09-26T19:55:37.517048] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-01. [2025-09-26T19:55:37.947129] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-09-26T19:55:37.947574] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-09-26T19:55:37.948040] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-09-26T19:55:37.948118] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-09-26T19:55:37.949173] [DEBUG] [LOCAL ] MCI: Trimmed 9933 records to 6477 (keeping 200 days of data) [2025-09-26T19:55:38.018525] [DEBUG] [LOCAL ] MCI: Primary data saved (6477 records). [2025-09-26T19:55:38.018769] [INFO ] [MAIN ] MCI: Full history saved. [2025-09-26T19:55:38.018955] [INFO ] [MAIN ] Update Progress: 1314/2371 symbols completed. MCI took 26.0s. Estimated remaining: 2h 21m 14s. Rate: 7.5 symbols/min [2025-09-26T19:55:38.305298] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:55:38.314183] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-09-26T19:55:38.319027] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-26T19:55:38.396418] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-09-26T19:55:38.474417] [DEBUG] [LOCAL ] MCO: Loaded 39809 existing records from primary storage. [2025-09-26T19:55:38.474723] [INFO ] [MAIN ] MCO: Loaded 39809 existing records. [2025-09-26T19:55:38.786078] [WARN ] [MAIN ] MCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:55:38.786479] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-09-26T19:55:38.786551] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-09-26T19:55:38.792795] [DEBUG] [LOCAL ] MCO: Deleted primary data file. [2025-09-26T19:55:38.792955] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-09-26T19:55:39.124772] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-09-26T19:55:39.260065] [INFO ] [REMOTE ] MCO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:55:39.859305] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-26T19:55:39.911733] [INFO ] [REMOTE ] MCO: Fetching primary data for 2024-12. [2025-09-26T19:55:40.711719] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-09-26T19:55:41.148226] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-26T19:55:41.205304] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-26T19:55:41.511721] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-09-26T19:55:42.311720] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-09-26T19:55:42.398607] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-26T19:55:43.026774] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-26T19:55:43.111715] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-09-26T19:55:43.651682] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-26T19:55:43.661861] [INFO ] [REMOTE ] MCD: Full fetch complete (77031 records). [2025-09-26T19:55:43.662023] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-09-26T19:55:43.893147] [WARN ] [VALIDATOR ] MCD: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-26T19:55:43.893967] [FATAL] [MAIN ] MCD: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:55:43.894056] [WARN ] [MAIN ] MCD: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:55:43.894141] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-09-26T19:55:43.894250] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-09-26T19:55:43.894323] [INFO ] [LOCAL ] MCD: Starting deletion of derivative data. [2025-09-26T19:55:43.894408] [DEBUG] [LOCAL ] MCD: No derivative data file found to delete. [2025-09-26T19:55:43.894520] [INFO ] [MAIN ] Update Progress: 1315/2371 symbols completed. MCD took 33.5s. Estimated remaining: 2h 21m 5s. Rate: 7.5 symbols/min [2025-09-26T19:55:43.916798] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-09-26T19:55:44.076500] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:55:44.086363] [DEBUG] [LOCAL ] MCR: Loaded 8814 existing records from primary storage. [2025-09-26T19:55:44.086469] [INFO ] [MAIN ] MCR: Loaded 8814 existing records. [2025-09-26T19:55:44.276928] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:55:44.277278] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-09-26T19:55:44.277333] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-09-26T19:55:44.277758] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-09-26T19:55:44.277831] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-09-26T19:55:44.684100] [INFO ] [REMOTE ] MCR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:55:44.711711] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-01. [2025-09-26T19:55:44.720830] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-26T19:55:44.991083] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-26T19:55:45.511753] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-09-26T19:55:46.191998] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-26T19:55:46.311758] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-09-26T19:55:46.356820] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-26T19:55:47.111712] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-09-26T19:55:47.911725] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-09-26T19:55:47.979411] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-26T19:55:48.711717] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-09-26T19:55:48.757098] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-26T19:55:48.769887] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-26T19:55:49.511727] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-09-26T19:55:49.912275] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-26T19:55:50.311734] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-09-26T19:55:51.111708] [INFO ] [REMOTE ] MCR: Fetching primary data for 2024-12. [2025-09-26T19:55:51.203582] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-26T19:55:51.909377] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-26T19:55:51.916816] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-09-26T19:55:51.997614] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-26T19:55:52.711727] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-09-26T19:55:53.463068] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-26T19:55:53.511722] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-01. [2025-09-26T19:55:53.678155] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-26T19:55:54.311721] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-07. [2025-09-26T19:55:54.487874] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-26T19:55:55.063615] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-26T19:55:55.111720] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-08. [2025-09-26T19:55:55.884052] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-26T19:55:55.911711] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-09-26T19:55:56.711743] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-09-26T19:55:57.506609] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-26T19:55:57.511635] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-09-26T19:55:57.589007] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-26T19:55:58.282877] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-26T19:55:58.311667] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-09-26T19:55:59.111737] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-09-26T19:55:59.906030] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-26T19:55:59.911672] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-09-26T19:55:59.953222] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-26T19:55:59.961215] [INFO ] [REMOTE ] MCK: Full fetch complete (57499 records). [2025-09-26T19:55:59.961385] [DEBUG] [VALIDATOR ] MCK: Validating primary data. [2025-09-26T19:56:00.387409] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present. [2025-09-26T19:56:00.387532] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed. [2025-09-26T19:56:00.389331] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-09-26T19:56:00.389409] [DEBUG] [LOCAL ] MCK: Saving primary data. [2025-09-26T19:56:00.391213] [DEBUG] [LOCAL ] MCK: Trimmed 57499 records to 39985 (keeping 200 days of data) [2025-09-26T19:56:00.701439] [DEBUG] [LOCAL ] MCK: Primary data saved (39985 records). [2025-09-26T19:56:00.701774] [INFO ] [MAIN ] MCK: Full history saved. [2025-09-26T19:56:00.701968] [INFO ] [MAIN ] Update Progress: 1316/2371 symbols completed. MCK took 38.3s. Estimated remaining: 2h 21m 4s. Rate: 7.5 symbols/min [2025-09-26T19:56:00.716894] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-09-26T19:56:00.900971] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:56:00.926174] [DEBUG] [LOCAL ] MCS: Loaded 21354 existing records from primary storage. [2025-09-26T19:56:00.926348] [INFO ] [MAIN ] MCS: Loaded 21354 existing records. [2025-09-26T19:56:01.076941] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-26T19:56:01.140182] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:56:01.140449] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-09-26T19:56:01.140498] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-09-26T19:56:01.141111] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-09-26T19:56:01.141172] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-09-26T19:56:01.516806] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-09-26T19:56:01.551134] [INFO ] [REMOTE ] MCS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:56:02.311729] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-09-26T19:56:02.435961] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-26T19:56:02.437762] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-26T19:56:03.077177] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-26T19:56:03.079111] [INFO ] [REMOTE ] MCN: Full fetch complete (11577 records). [2025-09-26T19:56:03.079188] [DEBUG] [VALIDATOR ] MCN: Validating primary data. [2025-09-26T19:56:03.116813] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-09-26T19:56:03.485592] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present. [2025-09-26T19:56:03.485698] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed. [2025-09-26T19:56:03.486041] [INFO ] [MAIN ] MCN: Fetched primary data is valid. [2025-09-26T19:56:03.486097] [DEBUG] [LOCAL ] MCN: Saving primary data. [2025-09-26T19:56:03.486606] [DEBUG] [LOCAL ] MCN: Trimmed 11577 records to 8231 (keeping 200 days of data) [2025-09-26T19:56:03.546906] [DEBUG] [LOCAL ] MCN: Primary data saved (8231 records). [2025-09-26T19:56:03.547088] [INFO ] [MAIN ] MCN: Full history saved. [2025-09-26T19:56:03.547221] [INFO ] [MAIN ] Update Progress: 1317/2371 symbols completed. MCN took 31.5s. Estimated remaining: 2h 20m 52s. Rate: 7.5 symbols/min [2025-09-26T19:56:03.911735] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-09-26T19:56:04.653079] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-26T19:56:04.711704] [INFO ] [REMOTE ] MCS: Fetching primary data for 2024-12. [2025-09-26T19:56:04.887474] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-26T19:56:05.511699] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-09-26T19:56:05.749982] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-26T19:56:06.311766] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-09-26T19:56:06.959201] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-26T19:56:07.111716] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-09-26T19:56:07.207956] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-26T19:56:07.911716] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-01. [2025-09-26T19:56:08.627757] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-26T19:56:08.711700] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-09-26T19:56:08.948011] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-26T19:56:09.511762] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-09-26T19:56:10.308057] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-26T19:56:10.315534] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-09-26T19:56:10.317907] [INFO ] [REMOTE ] MCO: Full fetch complete (56689 records). [2025-09-26T19:56:10.318046] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-09-26T19:56:10.672253] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-26T19:56:10.763050] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-09-26T19:56:10.763130] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-09-26T19:56:10.764062] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-09-26T19:56:10.764128] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-09-26T19:56:10.765478] [DEBUG] [LOCAL ] MCO: Trimmed 56689 records to 40102 (keeping 200 days of data) [2025-09-26T19:56:11.040381] [DEBUG] [LOCAL ] MCO: Primary data saved (40102 records). [2025-09-26T19:56:11.040511] [INFO ] [MAIN ] MCO: Full history saved. [2025-09-26T19:56:11.040595] [INFO ] [MAIN ] Update Progress: 1318/2371 symbols completed. MCO took 33.0s. Estimated remaining: 2h 20m 43s. Rate: 7.5 symbols/min [2025-09-26T19:56:11.111719] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-09-26T19:56:11.157054] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-26T19:56:11.159069] [INFO ] [REMOTE ] MCR: Full fetch complete (14209 records). [2025-09-26T19:56:11.159147] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-09-26T19:56:11.553220] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-09-26T19:56:11.553302] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-09-26T19:56:11.553676] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-09-26T19:56:11.553737] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-09-26T19:56:11.554253] [DEBUG] [LOCAL ] MCR: Trimmed 14209 records to 8858 (keeping 200 days of data) [2025-09-26T19:56:11.610930] [DEBUG] [LOCAL ] MCR: Primary data saved (8858 records). [2025-09-26T19:56:11.611075] [INFO ] [MAIN ] MCR: Full history saved. [2025-09-26T19:56:11.611166] [INFO ] [MAIN ] Update Progress: 1319/2371 symbols completed. MCR took 27.7s. Estimated remaining: 2h 20m 29s. Rate: 7.5 symbols/min [2025-09-26T19:56:12.376551] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-26T19:56:12.382149] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-09-26T19:56:13.435174] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-26T19:56:13.440284] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-09-26T19:56:14.500568] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-26T19:56:14.505576] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-09-26T19:56:15.453068] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-26T19:56:15.457460] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-09-26T19:56:16.622341] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-26T19:56:16.628153] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-09-26T19:56:17.796581] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-26T19:56:17.806020] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-09-26T19:56:19.011312] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-26T19:56:19.016260] [INFO ] [REMOTE ] MCS: Full fetch complete (30353 records). [2025-09-26T19:56:19.016369] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-09-26T19:56:19.446733] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-09-26T19:56:19.446916] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-09-26T19:56:19.447626] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-09-26T19:56:19.447714] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-09-26T19:56:19.448590] [DEBUG] [LOCAL ] MCS: Trimmed 30353 records to 21454 (keeping 200 days of data) [2025-09-26T19:56:19.587232] [DEBUG] [LOCAL ] MCS: Primary data saved (21454 records). [2025-09-26T19:56:19.587372] [INFO ] [MAIN ] MCS: Full history saved. [2025-09-26T19:56:19.587458] [INFO ] [MAIN ] Update Progress: 1320/2371 symbols completed. MCS took 18.9s. Estimated remaining: 2h 20m 21s. Rate: 7.5 symbols/min [2025-09-26T19:56:20.258748] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:56:20.306164] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:56:20.376346] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:56:20.399534] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:56:20.410922] [DEBUG] [LOCAL ] MDST: Loaded 5600 existing records from primary storage. [2025-09-26T19:56:20.411261] [INFO ] [MAIN ] MDST: Loaded 5600 existing records. [2025-09-26T19:56:20.610185] [DEBUG] [LOCAL ] MCY: Loaded 25210 existing records from primary storage. [2025-09-26T19:56:20.663342] [INFO ] [MAIN ] MCY: Loaded 25210 existing records. [2025-09-26T19:56:20.663194] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:56:20.678485] [DEBUG] [LOCAL ] MD: Loaded 38877 existing records from primary storage. [2025-09-26T19:56:20.698976] [INFO ] [MAIN ] MD: Loaded 38877 existing records. [2025-09-26T19:56:20.714363] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-09-26T19:56:20.746934] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-09-26T19:56:20.853671] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-09-26T19:56:20.879450] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-09-26T19:56:20.869909] [DEBUG] [LOCAL ] MDT: Loaded 54068 existing records from primary storage. [2025-09-26T19:56:20.891683] [INFO ] [MAIN ] MDT: Loaded 54068 existing records. [2025-09-26T19:56:21.364191] [WARN ] [MAIN ] MCY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:56:21.434035] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-09-26T19:56:21.527243] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-09-26T19:56:21.540302] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:56:21.611197] [DEBUG] [LOCAL ] MCY: Deleted primary data file. [2025-09-26T19:56:21.626539] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-09-26T19:56:21.626405] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-09-26T19:56:21.711269] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-09-26T19:56:21.734534] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:56:21.791265] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-09-26T19:56:21.796745] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-09-26T19:56:21.791382] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-09-26T19:56:21.819060] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-09-26T19:56:21.860041] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-09-26T19:56:21.871599] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-09-26T19:56:22.117360] [INFO ] [REMOTE ] MDST: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:56:22.186223] [INFO ] [REMOTE ] MDST: Fetching primary data for 2024-12. [2025-09-26T19:56:22.892385] [INFO ] [REMOTE ] MCY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:56:22.949289] [INFO ] [REMOTE ] MCY: Fetching primary data for 2024-12. [2025-09-26T19:56:22.982364] [INFO ] [REMOTE ] MD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:56:23.010748] [INFO ] [REMOTE ] MD: Fetching primary data for 2024-12. [2025-09-26T19:56:23.068617] [INFO ] [REMOTE ] MDT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:56:23.074748] [INFO ] [REMOTE ] MDT: Fetching primary data for 2024-12. [2025-09-26T19:56:23.074458] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-26T19:56:23.077754] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-01. [2025-09-26T19:56:23.672771] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-26T19:56:23.674869] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-09-26T19:56:24.298740] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-26T19:56:24.304769] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-01. [2025-09-26T19:56:24.376546] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-26T19:56:24.379263] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-09-26T19:56:24.490263] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-26T19:56:24.499035] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-01. [2025-09-26T19:56:24.944885] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-26T19:56:24.956120] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-01. [2025-09-26T19:56:24.986321] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-26T19:56:24.988324] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-09-26T19:56:25.562392] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-26T19:56:25.564086] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-09-26T19:56:25.719194] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-26T19:56:25.875141] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T19:56:26.142103] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-26T19:56:26.311730] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-09-26T19:56:26.985085] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-26T19:56:27.111718] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-09-26T19:56:27.740337] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-26T19:56:27.911762] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-09-26T19:56:28.621052] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-26T19:56:28.711736] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-09-26T19:56:29.387943] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-26T19:56:29.511835] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-09-26T19:56:30.094438] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-26T19:56:30.311704] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-09-26T19:56:30.571905] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-26T19:56:31.062181] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-26T19:56:31.111768] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-09-26T19:56:31.878274] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-26T19:56:31.911707] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-09-26T19:56:32.711739] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-09-26T19:56:33.511746] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-09-26T19:56:33.913897] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-26T19:56:34.034126] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-26T19:56:34.311756] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-09-26T19:56:34.849973] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-26T19:56:35.111762] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-09-26T19:56:35.911689] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-09-26T19:56:36.195409] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-26T19:56:36.292970] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-26T19:56:36.711722] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-09-26T19:56:36.960019] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-26T19:56:36.962262] [INFO ] [REMOTE ] MDST: Full fetch complete (8527 records). [2025-09-26T19:56:36.962357] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-09-26T19:56:37.350837] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-09-26T19:56:37.350956] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-09-26T19:56:37.351283] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-09-26T19:56:37.351363] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-09-26T19:56:37.352021] [DEBUG] [LOCAL ] MDST: Trimmed 8527 records to 5688 (keeping 200 days of data) [2025-09-26T19:56:37.391267] [DEBUG] [LOCAL ] MDST: Primary data saved (5688 records). [2025-09-26T19:56:37.391428] [INFO ] [MAIN ] MDST: Full history saved. [2025-09-26T19:56:37.391545] [INFO ] [MAIN ] Update Progress: 1321/2371 symbols completed. MDST took 17.8s. Estimated remaining: 2h 20m 21s. Rate: 7.5 symbols/min [2025-09-26T19:56:37.516853] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-09-26T19:56:37.568215] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:56:37.631090] [DEBUG] [LOCAL ] MDU: Loaded 48273 existing records from primary storage. [2025-09-26T19:56:37.631263] [INFO ] [MAIN ] MDU: Loaded 48273 existing records. [2025-09-26T19:56:37.816855] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:56:37.820560] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-09-26T19:56:37.820616] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-09-26T19:56:37.821817] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-09-26T19:56:37.821892] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-09-26T19:56:38.210265] [INFO ] [REMOTE ] MDU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:56:38.237079] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-26T19:56:38.311727] [INFO ] [REMOTE ] MDU: Fetching primary data for 2024-12. [2025-09-26T19:56:38.847192] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-26T19:56:39.111721] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-09-26T19:56:39.911718] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-09-26T19:56:39.990784] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-26T19:56:40.444968] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-26T19:56:40.711727] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-09-26T19:56:41.511699] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-01. [2025-09-26T19:56:41.912428] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-26T19:56:41.947631] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-26T19:56:42.311724] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-09-26T19:56:43.111707] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-09-26T19:56:43.196714] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-26T19:56:43.282355] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-26T19:56:43.911709] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-09-26T19:56:44.711703] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-09-26T19:56:44.911867] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-26T19:56:45.011454] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-26T19:56:45.511725] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-09-26T19:56:46.143745] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-26T19:56:46.151080] [INFO ] [REMOTE ] MD: Full fetch complete (55155 records). [2025-09-26T19:56:46.151262] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-09-26T19:56:46.318514] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-09-26T19:56:46.567975] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-09-26T19:56:46.568059] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-09-26T19:56:46.568893] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-09-26T19:56:46.568961] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-09-26T19:56:46.570224] [DEBUG] [LOCAL ] MD: Trimmed 55155 records to 39064 (keeping 200 days of data) [2025-09-26T19:56:46.809635] [DEBUG] [LOCAL ] MD: Primary data saved (39064 records). [2025-09-26T19:56:46.809830] [INFO ] [MAIN ] MD: Full history saved. [2025-09-26T19:56:46.809942] [INFO ] [MAIN ] Update Progress: 1322/2371 symbols completed. MD took 27.2s. Estimated remaining: 2h 20m 14s. Rate: 7.5 symbols/min [2025-09-26T19:56:46.993141] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:56:47.024103] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-26T19:56:47.043339] [DEBUG] [LOCAL ] MDV: Loaded 8699 existing records from primary storage. [2025-09-26T19:56:47.043532] [INFO ] [MAIN ] MDV: Loaded 8699 existing records. [2025-09-26T19:56:47.116793] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-09-26T19:56:47.237270] [WARN ] [MAIN ] MDV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:56:47.237633] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-09-26T19:56:47.237716] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-09-26T19:56:47.238092] [DEBUG] [LOCAL ] MDV: Deleted primary data file. [2025-09-26T19:56:47.238152] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-09-26T19:56:47.630936] [INFO ] [REMOTE ] MDV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:56:47.822294] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-26T19:56:47.911726] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-09-26T19:56:48.711739] [INFO ] [REMOTE ] MDV: Fetching primary data for 2024-12. [2025-09-26T19:56:49.112266] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-26T19:56:49.334580] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-26T19:56:49.511718] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-09-26T19:56:49.549785] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-26T19:56:50.311746] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-09-26T19:56:51.111715] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-09-26T19:56:51.497744] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-26T19:56:51.570378] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-26T19:56:51.911744] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-09-26T19:56:52.288295] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-26T19:56:52.711754] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-01. [2025-09-26T19:56:53.506445] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-26T19:56:53.522176] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-09-26T19:56:53.542947] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-26T19:56:54.250499] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-26T19:56:54.311752] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-09-26T19:56:55.105465] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-26T19:56:55.111655] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-09-26T19:56:55.911738] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-09-26T19:56:55.964742] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-26T19:56:56.711750] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-09-26T19:56:57.460479] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T19:56:57.483703] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-26T19:56:57.511704] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-09-26T19:56:58.311723] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-09-26T19:56:59.114156] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-09-26T19:56:59.117268] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-26T19:56:59.173757] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-26T19:56:59.911730] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-09-26T19:57:00.711757] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-09-26T19:57:01.313460] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-26T19:57:01.325215] [INFO ] [REMOTE ] MDT: Full fetch complete (77699 records). [2025-09-26T19:57:01.325414] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-09-26T19:57:01.531872] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-09-26T19:57:01.619780] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-26T19:57:01.847716] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-26T19:57:01.933535] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-09-26T19:57:01.933625] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-09-26T19:57:01.934661] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-09-26T19:57:01.934726] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-09-26T19:57:01.936274] [DEBUG] [LOCAL ] MDT: Trimmed 77699 records to 54458 (keeping 200 days of data) [2025-09-26T19:57:02.298484] [DEBUG] [LOCAL ] MDT: Primary data saved (54458 records). [2025-09-26T19:57:02.298695] [INFO ] [MAIN ] MDT: Full history saved. [2025-09-26T19:57:02.298810] [INFO ] [MAIN ] Update Progress: 1323/2371 symbols completed. MDT took 42.7s. Estimated remaining: 2h 20m 12s. Rate: 7.5 symbols/min [2025-09-26T19:57:02.320768] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-09-26T19:57:02.489151] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:57:02.507684] [DEBUG] [LOCAL ] MEC: Loaded 16543 existing records from primary storage. [2025-09-26T19:57:02.507814] [INFO ] [MAIN ] MEC: Loaded 16543 existing records. [2025-09-26T19:57:02.712209] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:57:02.712764] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-09-26T19:57:02.712868] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-09-26T19:57:02.713397] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-09-26T19:57:02.713460] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-09-26T19:57:02.867511] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-26T19:57:02.917258] [INFO ] [REMOTE ] MCY: Full fetch complete (41545 records). [2025-09-26T19:57:02.935482] [DEBUG] [VALIDATOR ] MCY: Validating primary data. [2025-09-26T19:57:03.116873] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-09-26T19:57:03.324762] [INFO ] [REMOTE ] MEC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:57:03.559786] [DEBUG] [VALIDATOR ] MCY: All expected trading days are present. [2025-09-26T19:57:03.559873] [DEBUG] [VALIDATOR ] MCY: Primary data validation passed. [2025-09-26T19:57:03.560551] [INFO ] [MAIN ] MCY: Fetched primary data is valid. [2025-09-26T19:57:03.560607] [DEBUG] [LOCAL ] MCY: Saving primary data. [2025-09-26T19:57:03.561640] [DEBUG] [LOCAL ] MCY: Trimmed 41545 records to 25345 (keeping 200 days of data) [2025-09-26T19:57:03.732320] [DEBUG] [LOCAL ] MCY: Primary data saved (25345 records). [2025-09-26T19:57:03.732457] [INFO ] [MAIN ] MCY: Full history saved. [2025-09-26T19:57:03.732571] [INFO ] [MAIN ] Update Progress: 1324/2371 symbols completed. MCY took 44.1s. Estimated remaining: 2h 19m 59s. Rate: 7.5 symbols/min [2025-09-26T19:57:03.927378] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:57:03.921060] [INFO ] [REMOTE ] MEC: Fetching primary data for 2024-12. [2025-09-26T19:57:03.950771] [DEBUG] [LOCAL ] MED: Loaded 21913 existing records from primary storage. [2025-09-26T19:57:03.950931] [INFO ] [MAIN ] MED: Loaded 21913 existing records. [2025-09-26T19:57:04.064047] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-26T19:57:04.164180] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:57:04.173999] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-09-26T19:57:04.189766] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-09-26T19:57:04.190522] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-09-26T19:57:04.191685] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-26T19:57:04.191770] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-09-26T19:57:04.263219] [INFO ] [REMOTE ] MDU: Full fetch complete (70305 records). [2025-09-26T19:57:04.279855] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-09-26T19:57:04.714869] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-09-26T19:57:04.982398] [INFO ] [REMOTE ] MED: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:57:05.098669] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-09-26T19:57:05.099504] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-26T19:57:05.099739] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-09-26T19:57:05.105073] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-09-26T19:57:05.105205] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-09-26T19:57:05.107016] [DEBUG] [LOCAL ] MDU: Trimmed 70305 records to 48643 (keeping 200 days of data) [2025-09-26T19:57:05.425582] [DEBUG] [LOCAL ] MDU: Primary data saved (48643 records). [2025-09-26T19:57:05.425751] [INFO ] [MAIN ] MDU: Full history saved. [2025-09-26T19:57:05.425869] [INFO ] [MAIN ] Update Progress: 1325/2371 symbols completed. MDU took 28.0s. Estimated remaining: 2h 19m 46s. Rate: 7.5 symbols/min [2025-09-26T19:57:05.522053] [INFO ] [REMOTE ] MED: Fetching primary data for 2024-12. [2025-09-26T19:57:05.605799] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:57:05.611205] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-26T19:57:05.613129] [INFO ] [REMOTE ] MDV: Full fetch complete (11583 records). [2025-09-26T19:57:05.613232] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-09-26T19:57:05.876255] [DEBUG] [LOCAL ] MEG: Loaded 32202 existing records from primary storage. [2025-09-26T19:57:05.909071] [INFO ] [MAIN ] MEG: Loaded 32202 existing records. [2025-09-26T19:57:06.224047] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-09-26T19:57:06.224973] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-09-26T19:57:06.225675] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-09-26T19:57:06.225752] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-09-26T19:57:06.250628] [DEBUG] [LOCAL ] MDV: Trimmed 11583 records to 8733 (keeping 200 days of data) [2025-09-26T19:57:06.250846] [WARN ] [MAIN ] MEG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:57:06.251527] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-09-26T19:57:06.251606] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-09-26T19:57:06.274525] [DEBUG] [LOCAL ] MEG: Deleted primary data file. [2025-09-26T19:57:06.279099] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-09-26T19:57:06.318224] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-01. [2025-09-26T19:57:06.429579] [DEBUG] [LOCAL ] MDV: Primary data saved (8733 records). [2025-09-26T19:57:06.429796] [INFO ] [MAIN ] MDV: Full history saved. [2025-09-26T19:57:06.429984] [INFO ] [MAIN ] Update Progress: 1326/2371 symbols completed. MDV took 19.6s. Estimated remaining: 2h 19m 32s. Rate: 7.5 symbols/min [2025-09-26T19:57:06.852724] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:57:06.898595] [INFO ] [REMOTE ] MEG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:57:06.919448] [DEBUG] [LOCAL ] MEGI: Loaded 20538 existing records from primary storage. [2025-09-26T19:57:06.919714] [INFO ] [MAIN ] MEGI: Loaded 20538 existing records. [2025-09-26T19:57:07.126321] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-26T19:57:07.113685] [INFO ] [REMOTE ] MEG: Fetching primary data for 2024-12. [2025-09-26T19:57:07.160274] [WARN ] [MAIN ] MEGI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:57:07.161716] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-09-26T19:57:07.161784] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-09-26T19:57:07.162743] [DEBUG] [LOCAL ] MEGI: Deleted primary data file. [2025-09-26T19:57:07.162810] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-09-26T19:57:07.287895] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-26T19:57:07.569009] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:57:07.911763] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-09-26T19:57:08.637761] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-26T19:57:08.711855] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-09-26T19:57:08.713192] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-26T19:57:09.511734] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-01. [2025-09-26T19:57:09.739241] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-26T19:57:10.311721] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-01. [2025-09-26T19:57:10.599936] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-26T19:57:11.111685] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-09-26T19:57:11.481313] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-26T19:57:11.911733] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2024-12. [2025-09-26T19:57:12.400781] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-26T19:57:12.711746] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-09-26T19:57:13.059999] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-26T19:57:13.511700] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-09-26T19:57:13.658213] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-26T19:57:14.311704] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-01. [2025-09-26T19:57:14.629419] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-26T19:57:15.111693] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-09-26T19:57:15.359129] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-26T19:57:15.911723] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-09-26T19:57:16.289923] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-26T19:57:16.711704] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-09-26T19:57:16.871777] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-26T19:57:17.511730] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-09-26T19:57:18.174018] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-26T19:57:18.311736] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-09-26T19:57:18.597387] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-26T19:57:19.111747] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-09-26T19:57:19.305626] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-26T19:57:19.911758] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-09-26T19:57:20.500157] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-26T19:57:20.691844] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-26T19:57:20.711697] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-09-26T19:57:21.511717] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-09-26T19:57:22.090789] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-26T19:57:22.311729] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-09-26T19:57:22.562715] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-26T19:57:23.111716] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-09-26T19:57:23.285192] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-26T19:57:23.911695] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-09-26T19:57:24.134547] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-26T19:57:24.711756] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-09-26T19:57:25.077080] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-26T19:57:25.511766] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-09-26T19:57:25.845223] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-26T19:57:26.311716] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-09-26T19:57:26.412488] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-26T19:57:27.111715] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-09-26T19:57:27.226314] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-26T19:57:27.831172] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-26T19:57:27.911717] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-09-26T19:57:28.711696] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-09-26T19:57:28.943699] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-26T19:57:28.947487] [INFO ] [REMOTE ] MEC: Full fetch complete (22717 records). [2025-09-26T19:57:28.947594] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-09-26T19:57:29.346605] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-09-26T19:57:29.346740] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-09-26T19:57:29.347336] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-09-26T19:57:29.347409] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-09-26T19:57:29.348346] [DEBUG] [LOCAL ] MEC: Trimmed 22717 records to 16695 (keeping 200 days of data) [2025-09-26T19:57:29.452317] [DEBUG] [LOCAL ] MEC: Primary data saved (16695 records). [2025-09-26T19:57:29.452478] [INFO ] [MAIN ] MEC: Full history saved. [2025-09-26T19:57:29.452611] [INFO ] [MAIN ] Update Progress: 1327/2371 symbols completed. MEC took 27.2s. Estimated remaining: 2h 19m 36s. Rate: 7.5 symbols/min [2025-09-26T19:57:29.516102] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-09-26T19:57:29.648032] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:57:29.684443] [DEBUG] [LOCAL ] MEI: Loaded 32688 existing records from primary storage. [2025-09-26T19:57:29.684590] [INFO ] [MAIN ] MEI: Loaded 32688 existing records. [2025-09-26T19:57:29.884042] [WARN ] [MAIN ] MEI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:57:29.884439] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-09-26T19:57:29.884499] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-09-26T19:57:29.885301] [DEBUG] [LOCAL ] MEI: Deleted primary data file. [2025-09-26T19:57:29.885604] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-09-26T19:57:30.068255] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-26T19:57:30.296029] [INFO ] [REMOTE ] MEI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:57:30.311699] [INFO ] [REMOTE ] MEI: Fetching primary data for 2024-12. [2025-09-26T19:57:30.821602] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-26T19:57:31.111728] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-09-26T19:57:31.671932] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-26T19:57:31.911724] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-09-26T19:57:32.481759] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-26T19:57:32.711740] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-01. [2025-09-26T19:57:33.117404] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-26T19:57:33.511692] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-09-26T19:57:33.988142] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-26T19:57:34.311722] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-09-26T19:57:35.047701] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-26T19:57:35.054888] [INFO ] [REMOTE ] MEG: Full fetch complete (48107 records). [2025-09-26T19:57:35.055051] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-09-26T19:57:35.116856] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-09-26T19:57:35.504612] [DEBUG] [VALIDATOR ] MEG: All expected trading days are present. [2025-09-26T19:57:35.505905] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-26T19:57:35.505180] [DEBUG] [VALIDATOR ] MEG: Primary data validation passed. [2025-09-26T19:57:35.514169] [INFO ] [MAIN ] MEG: Fetched primary data is valid. [2025-09-26T19:57:35.514612] [DEBUG] [LOCAL ] MEG: Saving primary data. [2025-09-26T19:57:35.515892] [DEBUG] [LOCAL ] MEG: Trimmed 48107 records to 32426 (keeping 200 days of data) [2025-09-26T19:57:35.710134] [DEBUG] [LOCAL ] MEG: Primary data saved (32426 records). [2025-09-26T19:57:35.710272] [INFO ] [MAIN ] MEG: Full history saved. [2025-09-26T19:57:35.710436] [INFO ] [MAIN ] Update Progress: 1328/2371 symbols completed. MEG took 30.3s. Estimated remaining: 2h 19m 26s. Rate: 7.5 symbols/min [2025-09-26T19:57:35.894842] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:57:35.911689] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-09-26T19:57:35.955987] [DEBUG] [LOCAL ] MET: Loaded 53702 existing records from primary storage. [2025-09-26T19:57:35.956253] [INFO ] [MAIN ] MET: Loaded 53702 existing records. [2025-09-26T19:57:36.146267] [WARN ] [MAIN ] MET: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:57:36.146615] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-09-26T19:57:36.146699] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-09-26T19:57:36.147409] [DEBUG] [LOCAL ] MET: Deleted primary data file. [2025-09-26T19:57:36.147472] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-09-26T19:57:36.350762] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-26T19:57:36.422781] [INFO ] [REMOTE ] MEGI: Full fetch complete (30554 records). [2025-09-26T19:57:36.437574] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-09-26T19:57:36.723912] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-09-26T19:57:36.718543] [INFO ] [REMOTE ] MET: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:57:36.968014] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-09-26T19:57:36.968107] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-09-26T19:57:36.969050] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-09-26T19:57:36.969150] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-09-26T19:57:36.970022] [DEBUG] [LOCAL ] MEGI: Trimmed 30554 records to 20630 (keeping 200 days of data) [2025-09-26T19:57:37.099980] [DEBUG] [LOCAL ] MEGI: Primary data saved (20630 records). [2025-09-26T19:57:37.100127] [INFO ] [MAIN ] MEGI: Full history saved. [2025-09-26T19:57:37.100214] [INFO ] [MAIN ] Update Progress: 1329/2371 symbols completed. MEGI took 30.7s. Estimated remaining: 2h 19m 13s. Rate: 7.5 symbols/min [2025-09-26T19:57:37.279607] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:57:37.325197] [DEBUG] [LOCAL ] MFA: Loaded 45667 existing records from primary storage. [2025-09-26T19:57:37.325352] [INFO ] [MAIN ] MFA: Loaded 45667 existing records. [2025-09-26T19:57:37.517186] [WARN ] [MAIN ] MFA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:57:37.516958] [INFO ] [REMOTE ] MET: Fetching primary data for 2024-12. [2025-09-26T19:57:37.518390] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-09-26T19:57:37.519611] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-09-26T19:57:37.528003] [DEBUG] [LOCAL ] MFA: Deleted primary data file. [2025-09-26T19:57:37.540045] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-09-26T19:57:37.615469] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-26T19:57:37.937337] [INFO ] [REMOTE ] MFA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:57:38.023495] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-26T19:57:38.311767] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-09-26T19:57:39.111718] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-09-26T19:57:39.373121] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-26T19:57:39.443976] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-26T19:57:39.911721] [INFO ] [REMOTE ] MFA: Fetching primary data for 2024-12. [2025-09-26T19:57:40.500696] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-26T19:57:40.711761] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-09-26T19:57:41.511691] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-09-26T19:57:41.580225] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-26T19:57:41.680732] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-26T19:57:42.311714] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-09-26T19:57:42.346473] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-26T19:57:43.111713] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-01. [2025-09-26T19:57:43.418223] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-26T19:57:43.422467] [INFO ] [REMOTE ] MED: Full fetch complete (32874 records). [2025-09-26T19:57:43.422569] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-09-26T19:57:43.824128] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-09-26T19:57:43.824249] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-09-26T19:57:43.824987] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-09-26T19:57:43.825068] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-09-26T19:57:43.825964] [DEBUG] [LOCAL ] MED: Trimmed 32874 records to 22043 (keeping 200 days of data) [2025-09-26T19:57:43.911993] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-09-26T19:57:43.957857] [DEBUG] [LOCAL ] MED: Primary data saved (22043 records). [2025-09-26T19:57:43.958001] [INFO ] [MAIN ] MED: Full history saved. [2025-09-26T19:57:43.958091] [INFO ] [MAIN ] Update Progress: 1330/2371 symbols completed. MED took 40.2s. Estimated remaining: 2h 19m 4s. Rate: 7.5 symbols/min [2025-09-26T19:57:44.134927] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:57:44.142064] [DEBUG] [LOCAL ] MFAN: Loaded 4307 existing records from primary storage. [2025-09-26T19:57:44.142202] [INFO ] [MAIN ] MFAN: Loaded 4307 existing records. [2025-09-26T19:57:44.328193] [WARN ] [MAIN ] MFAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:57:44.328493] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-09-26T19:57:44.328540] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-09-26T19:57:44.328762] [DEBUG] [LOCAL ] MFAN: Deleted primary data file. [2025-09-26T19:57:44.328822] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-09-26T19:57:44.711863] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:57:44.712015] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-01. [2025-09-26T19:57:44.910442] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-26T19:57:44.987381] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-26T19:57:45.511722] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-09-26T19:57:46.298831] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-26T19:57:46.311638] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-09-26T19:57:47.111696] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-09-26T19:57:47.246847] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-26T19:57:47.885871] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-26T19:57:47.911710] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-09-26T19:57:48.309383] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-26T19:57:48.711739] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-09-26T19:57:49.491415] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-26T19:57:49.511741] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-09-26T19:57:50.311720] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2024-12. [2025-09-26T19:57:50.399335] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-26T19:57:50.765634] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-26T19:57:50.910746] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-26T19:57:51.111720] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-01. [2025-09-26T19:57:51.658555] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-26T19:57:51.911722] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-09-26T19:57:52.711713] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-02. [2025-09-26T19:57:53.424387] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-26T19:57:53.428119] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-26T19:57:53.437040] [INFO ] [REMOTE ] MEI: Full fetch complete (45560 records). [2025-09-26T19:57:53.437171] [DEBUG] [VALIDATOR ] MEI: Validating primary data. [2025-09-26T19:57:53.516783] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-09-26T19:57:53.846461] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present. [2025-09-26T19:57:53.846557] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed. [2025-09-26T19:57:53.847414] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-09-26T19:57:53.847484] [DEBUG] [LOCAL ] MEI: Saving primary data. [2025-09-26T19:57:53.848784] [DEBUG] [LOCAL ] MEI: Trimmed 45560 records to 32933 (keeping 200 days of data) [2025-09-26T19:57:54.081542] [DEBUG] [LOCAL ] MEI: Primary data saved (32933 records). [2025-09-26T19:57:54.081773] [INFO ] [MAIN ] MEI: Full history saved. [2025-09-26T19:57:54.081930] [INFO ] [MAIN ] Update Progress: 1331/2371 symbols completed. MEI took 24.6s. Estimated remaining: 2h 18m 58s. Rate: 7.5 symbols/min [2025-09-26T19:57:54.283380] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:57:54.290328] [DEBUG] [LOCAL ] MFAO: Loaded 3826 existing records from primary storage. [2025-09-26T19:57:54.290454] [INFO ] [MAIN ] MFAO: Loaded 3826 existing records. [2025-09-26T19:57:54.323611] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-03. [2025-09-26T19:57:54.491699] [WARN ] [MAIN ] MFAO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:57:54.491978] [INFO ] [MAIN ] MFAO: Wiping existing primary data before full refresh. [2025-09-26T19:57:54.492029] [INFO ] [LOCAL ] MFAO: Starting deletion of primary data. [2025-09-26T19:57:54.492284] [DEBUG] [LOCAL ] MFAO: Deleted primary data file. [2025-09-26T19:57:54.492360] [INFO ] [MAIN ] MFAO: Starting full primary refresh. [2025-09-26T19:57:54.907744] [INFO ] [REMOTE ] MFAO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:57:54.957398] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-26T19:57:55.111722] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-09-26T19:57:55.389843] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-26T19:57:55.911725] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-04. [2025-09-26T19:57:56.494954] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-26T19:57:56.711701] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-09-26T19:57:56.840745] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-26T19:57:57.511741] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2024-12. [2025-09-26T19:57:58.032087] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-26T19:57:58.311732] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-05. [2025-09-26T19:57:58.370454] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-26T19:57:59.111720] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-01. [2025-09-26T19:57:59.717218] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-26T19:57:59.917832] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-02. [2025-09-26T19:57:59.936403] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-26T19:58:00.543670] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-26T19:58:00.711735] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-09-26T19:58:01.511755] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-06. [2025-09-26T19:58:02.311743] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-03. [2025-09-26T19:58:02.477067] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-26T19:58:02.756058] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-26T19:58:03.043304] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-26T19:58:03.111723] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-04. [2025-09-26T19:58:03.728745] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-26T19:58:03.911718] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-05. [2025-09-26T19:58:04.522769] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-26T19:58:04.711725] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-05. [2025-09-26T19:58:05.323027] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-26T19:58:05.511718] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-07. [2025-09-26T19:58:06.311715] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-06. [2025-09-26T19:58:06.894141] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-26T19:58:07.111730] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-07. [2025-09-26T19:58:07.482157] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-26T19:58:07.911726] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-06. [2025-09-26T19:58:08.454503] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-26T19:58:08.716790] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-08. [2025-09-26T19:58:08.739669] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-26T19:58:09.511741] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-07. [2025-09-26T19:58:10.065240] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-26T19:58:10.311733] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-08. [2025-09-26T19:58:10.524374] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-26T19:58:11.111751] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-09. [2025-09-26T19:58:11.882827] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-26T19:58:11.911720] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-09. [2025-09-26T19:58:12.711728] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-08. [2025-09-26T19:58:12.789110] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-26T19:58:12.805356] [INFO ] [REMOTE ] MET: Full fetch complete (77117 records). [2025-09-26T19:58:12.805542] [DEBUG] [VALIDATOR ] MET: Validating primary data. [2025-09-26T19:58:13.244956] [DEBUG] [VALIDATOR ] MET: All expected trading days are present. [2025-09-26T19:58:13.245142] [DEBUG] [VALIDATOR ] MET: Primary data validation passed. [2025-09-26T19:58:13.246193] [INFO ] [MAIN ] MET: Fetched primary data is valid. [2025-09-26T19:58:13.246265] [DEBUG] [LOCAL ] MET: Saving primary data. [2025-09-26T19:58:13.248526] [DEBUG] [LOCAL ] MET: Trimmed 77117 records to 54089 (keeping 200 days of data) [2025-09-26T19:58:13.356330] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-26T19:58:13.511802] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-07. [2025-09-26T19:58:13.629920] [DEBUG] [LOCAL ] MET: Primary data saved (54089 records). [2025-09-26T19:58:13.630089] [INFO ] [MAIN ] MET: Full history saved. [2025-09-26T19:58:13.630203] [INFO ] [MAIN ] Update Progress: 1332/2371 symbols completed. MET took 37.9s. Estimated remaining: 2h 18m 59s. Rate: 7.5 symbols/min [2025-09-26T19:58:13.817597] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-26T19:58:13.854354] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:58:13.864678] [INFO ] [REMOTE ] MFA: Full fetch complete (64935 records). [2025-09-26T19:58:13.864854] [DEBUG] [VALIDATOR ] MFA: Validating primary data. [2025-09-26T19:58:14.078671] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-26T19:58:14.271239] [DEBUG] [LOCAL ] MFC: Loaded 51660 existing records from primary storage. [2025-09-26T19:58:14.286781] [INFO ] [MAIN ] MFC: Loaded 51660 existing records. [2025-09-26T19:58:14.319812] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-08. [2025-09-26T19:58:14.432835] [DEBUG] [VALIDATOR ] MFA: All expected trading days are present. [2025-09-26T19:58:14.466009] [DEBUG] [VALIDATOR ] MFA: Primary data validation passed. [2025-09-26T19:58:14.467902] [INFO ] [MAIN ] MFA: Fetched primary data is valid. [2025-09-26T19:58:14.473805] [DEBUG] [LOCAL ] MFA: Saving primary data. [2025-09-26T19:58:14.550198] [DEBUG] [LOCAL ] MFA: Trimmed 64935 records to 46019 (keeping 200 days of data) [2025-09-26T19:58:14.557948] [WARN ] [MAIN ] MFC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:58:14.558904] [INFO ] [MAIN ] MFC: Wiping existing primary data before full refresh. [2025-09-26T19:58:14.559432] [INFO ] [LOCAL ] MFC: Starting deletion of primary data. [2025-09-26T19:58:14.560461] [DEBUG] [LOCAL ] MFC: Deleted primary data file. [2025-09-26T19:58:14.560527] [INFO ] [MAIN ] MFC: Starting full primary refresh. [2025-09-26T19:58:15.014513] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-26T19:58:15.141744] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-09. [2025-09-26T19:58:15.170749] [INFO ] [REMOTE ] MFC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:58:15.276226] [DEBUG] [LOCAL ] MFA: Primary data saved (46019 records). [2025-09-26T19:58:15.276439] [INFO ] [MAIN ] MFA: Full history saved. [2025-09-26T19:58:15.276555] [INFO ] [MAIN ] Update Progress: 1333/2371 symbols completed. MFA took 38.2s. Estimated remaining: 2h 18m 46s. Rate: 7.5 symbols/min [2025-09-26T19:58:15.480951] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:58:15.554348] [DEBUG] [LOCAL ] MFG: Loaded 49399 existing records from primary storage. [2025-09-26T19:58:15.554635] [INFO ] [MAIN ] MFG: Loaded 49399 existing records. [2025-09-26T19:58:15.749049] [WARN ] [MAIN ] MFG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:58:15.749556] [INFO ] [MAIN ] MFG: Wiping existing primary data before full refresh. [2025-09-26T19:58:15.749679] [INFO ] [LOCAL ] MFG: Starting deletion of primary data. [2025-09-26T19:58:15.750741] [DEBUG] [LOCAL ] MFG: Deleted primary data file. [2025-09-26T19:58:15.750873] [INFO ] [MAIN ] MFG: Starting full primary refresh. [2025-09-26T19:58:15.869737] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-26T19:58:15.880984] [INFO ] [REMOTE ] MFAO: Full fetch complete (5238 records). [2025-09-26T19:58:15.886254] [DEBUG] [VALIDATOR ] MFAO: Validating primary data. [2025-09-26T19:58:15.916919] [INFO ] [REMOTE ] MFC: Fetching primary data for 2024-12. [2025-09-26T19:58:16.490844] [INFO ] [REMOTE ] MFG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:58:16.586815] [DEBUG] [VALIDATOR ] MFAO: All expected trading days are present. [2025-09-26T19:58:16.586931] [DEBUG] [VALIDATOR ] MFAO: Primary data validation passed. [2025-09-26T19:58:16.587149] [INFO ] [MAIN ] MFAO: Fetched primary data is valid. [2025-09-26T19:58:16.587211] [DEBUG] [LOCAL ] MFAO: Saving primary data. [2025-09-26T19:58:16.587905] [DEBUG] [LOCAL ] MFAO: Trimmed 5238 records to 3853 (keeping 200 days of data) [2025-09-26T19:58:16.612611] [DEBUG] [LOCAL ] MFAO: Primary data saved (3853 records). [2025-09-26T19:58:16.612760] [INFO ] [MAIN ] MFAO: Full history saved. [2025-09-26T19:58:16.612951] [INFO ] [MAIN ] Update Progress: 1334/2371 symbols completed. MFAO took 22.5s. Estimated remaining: 2h 18m 33s. Rate: 7.5 symbols/min [2025-09-26T19:58:16.721549] [INFO ] [REMOTE ] MFG: Fetching primary data for 2024-12. [2025-09-26T19:58:16.798484] [INFO ] [MAIN ] MFM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:58:16.825099] [DEBUG] [LOCAL ] MFM: Loaded 14330 existing records from primary storage. [2025-09-26T19:58:16.825278] [INFO ] [MAIN ] MFM: Loaded 14330 existing records. [2025-09-26T19:58:17.018756] [WARN ] [MAIN ] MFM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:58:17.019061] [INFO ] [MAIN ] MFM: Wiping existing primary data before full refresh. [2025-09-26T19:58:17.019125] [INFO ] [LOCAL ] MFM: Starting deletion of primary data. [2025-09-26T19:58:17.019374] [DEBUG] [LOCAL ] MFM: Deleted primary data file. [2025-09-26T19:58:17.019432] [INFO ] [MAIN ] MFM: Starting full primary refresh. [2025-09-26T19:58:17.391221] [INFO ] [REMOTE ] MFM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:58:17.511734] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-09. [2025-09-26T19:58:17.819141] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-26T19:58:18.311712] [INFO ] [REMOTE ] MFM: Fetching primary data for 2024-12. [2025-09-26T19:58:18.356903] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-26T19:58:18.359108] [INFO ] [REMOTE ] MFAN: Full fetch complete (5587 records). [2025-09-26T19:58:18.382314] [DEBUG] [VALIDATOR ] MFAN: Validating primary data. [2025-09-26T19:58:18.384139] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-26T19:58:18.773705] [DEBUG] [VALIDATOR ] MFAN: All expected trading days are present. [2025-09-26T19:58:18.773795] [DEBUG] [VALIDATOR ] MFAN: Primary data validation passed. [2025-09-26T19:58:18.773964] [INFO ] [MAIN ] MFAN: Fetched primary data is valid. [2025-09-26T19:58:18.774005] [DEBUG] [LOCAL ] MFAN: Saving primary data. [2025-09-26T19:58:18.774514] [DEBUG] [LOCAL ] MFAN: Trimmed 5587 records to 4331 (keeping 200 days of data) [2025-09-26T19:58:18.804163] [DEBUG] [LOCAL ] MFAN: Primary data saved (4331 records). [2025-09-26T19:58:18.804302] [INFO ] [MAIN ] MFAN: Full history saved. [2025-09-26T19:58:18.804443] [INFO ] [MAIN ] Update Progress: 1335/2371 symbols completed. MFAN took 34.8s. Estimated remaining: 2h 18m 20s. Rate: 7.5 symbols/min [2025-09-26T19:58:18.997129] [INFO ] [MAIN ] MFSB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:58:18.998351] [DEBUG] [LOCAL ] MFSB: No existing data file found in primary storage. [2025-09-26T19:58:18.998407] [WARN ] [MAIN ] MFSB: No existing data found, performing full refresh instead. [2025-09-26T19:58:18.998664] [INFO ] [MAIN ] MFSB: Wiping existing primary data before full refresh. [2025-09-26T19:58:18.998724] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-09-26T19:58:18.998773] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-09-26T19:58:18.998821] [INFO ] [MAIN ] MFSB: Starting full primary refresh. [2025-09-26T19:58:19.116796] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-01. [2025-09-26T19:58:19.386666] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:58:19.419594] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-26T19:58:19.911726] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2024-12. [2025-09-26T19:58:20.285812] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-09-26T19:58:20.709384] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-26T19:58:20.717974] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-01. [2025-09-26T19:58:21.511742] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-02. [2025-09-26T19:58:22.311720] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-01. [2025-09-26T19:58:22.457516] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-26T19:58:22.766690] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-26T19:58:23.011236] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-26T19:58:23.111730] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-02. [2025-09-26T19:58:23.911742] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-02. [2025-09-26T19:58:23.929238] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-26T19:58:24.711718] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-03. [2025-09-26T19:58:25.505360] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-26T19:58:25.511951] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-01. [2025-09-26T19:58:25.609215] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-26T19:58:25.838430] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-26T19:58:26.311725] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-03. [2025-09-26T19:58:27.111722] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-03. [2025-09-26T19:58:27.911689] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-02. [2025-09-26T19:58:28.098278] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-26T19:58:28.248576] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-26T19:58:28.711747] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-04. [2025-09-26T19:58:28.866599] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-26T19:58:29.511735] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-04. [2025-09-26T19:58:29.812804] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-26T19:58:30.311731] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-05. [2025-09-26T19:58:31.111733] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-04. [2025-09-26T19:58:31.317802] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-26T19:58:31.323682] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-26T19:58:31.911722] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-06. [2025-09-26T19:58:32.711729] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-03. [2025-09-26T19:58:32.844867] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-26T19:58:32.897662] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-26T19:58:33.046304] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-26T19:58:33.511728] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-05. [2025-09-26T19:58:34.311727] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-04. [2025-09-26T19:58:34.649417] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-26T19:58:35.111774] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-07. [2025-09-26T19:58:35.249163] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-26T19:58:35.911756] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-06. [2025-09-26T19:58:36.165315] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-26T19:58:36.711747] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-05. [2025-09-26T19:58:37.214419] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-26T19:58:37.511745] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-05. [2025-09-26T19:58:37.759806] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-09-26T19:58:38.311746] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-08. [2025-09-26T19:58:38.482739] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-26T19:58:39.111708] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-07. [2025-09-26T19:58:39.170506] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-26T19:58:39.911751] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-06. [2025-09-26T19:58:40.246166] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-26T19:58:40.711726] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-09. [2025-09-26T19:58:40.878900] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-26T19:58:41.511733] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-08. [2025-09-26T19:58:41.650903] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-26T19:58:41.654089] [INFO ] [REMOTE ] MFM: Full fetch complete (19214 records). [2025-09-26T19:58:41.654179] [DEBUG] [VALIDATOR ] MFM: Validating primary data. [2025-09-26T19:58:42.066778] [DEBUG] [VALIDATOR ] MFM: All expected trading days are present. [2025-09-26T19:58:42.066882] [DEBUG] [VALIDATOR ] MFM: Primary data validation passed. [2025-09-26T19:58:42.067334] [INFO ] [MAIN ] MFM: Fetched primary data is valid. [2025-09-26T19:58:42.067394] [DEBUG] [LOCAL ] MFM: Saving primary data. [2025-09-26T19:58:42.068162] [DEBUG] [LOCAL ] MFM: Trimmed 19214 records to 14390 (keeping 200 days of data) [2025-09-26T19:58:42.164379] [DEBUG] [LOCAL ] MFM: Primary data saved (14390 records). [2025-09-26T19:58:42.164554] [INFO ] [MAIN ] MFM: Full history saved. [2025-09-26T19:58:42.164690] [INFO ] [MAIN ] Update Progress: 1336/2371 symbols completed. MFM took 25.6s. Estimated remaining: 2h 18m 24s. Rate: 7.5 symbols/min [2025-09-26T19:58:42.316844] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-07. [2025-09-26T19:58:42.349176] [INFO ] [MAIN ] MFSG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:58:42.357400] [DEBUG] [LOCAL ] MFSG: Loaded 5222 existing records from primary storage. [2025-09-26T19:58:42.358029] [INFO ] [MAIN ] MFSG: Loaded 5222 existing records. [2025-09-26T19:58:42.546156] [WARN ] [MAIN ] MFSG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:58:42.546484] [INFO ] [MAIN ] MFSG: Wiping existing primary data before full refresh. [2025-09-26T19:58:42.546541] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-09-26T19:58:42.546900] [DEBUG] [LOCAL ] MFSG: Deleted primary data file. [2025-09-26T19:58:42.546962] [INFO ] [MAIN ] MFSG: Starting full primary refresh. [2025-09-26T19:58:42.716426] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-26T19:58:42.953785] [INFO ] [REMOTE ] MFSG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:58:43.116799] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-06. [2025-09-26T19:58:43.140309] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-26T19:58:43.911720] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2024-12. [2025-09-26T19:58:44.290904] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-09-26T19:58:44.681983] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-26T19:58:44.711694] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-07. [2025-09-26T19:58:45.511738] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-09. [2025-09-26T19:58:46.311691] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-01. [2025-09-26T19:58:46.452106] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-26T19:58:46.593016] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-09-26T19:58:47.111701] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-02. [2025-09-26T19:58:47.282150] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-26T19:58:47.292189] [INFO ] [REMOTE ] MFG: Full fetch complete (68657 records). [2025-09-26T19:58:47.292345] [DEBUG] [VALIDATOR ] MFG: Validating primary data. [2025-09-26T19:58:47.568411] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-26T19:58:47.723001] [DEBUG] [VALIDATOR ] MFG: All expected trading days are present. [2025-09-26T19:58:47.723102] [DEBUG] [VALIDATOR ] MFG: Primary data validation passed. [2025-09-26T19:58:47.724209] [INFO ] [MAIN ] MFG: Fetched primary data is valid. [2025-09-26T19:58:47.724278] [DEBUG] [LOCAL ] MFG: Saving primary data. [2025-09-26T19:58:47.726017] [DEBUG] [LOCAL ] MFG: Trimmed 68657 records to 49748 (keeping 200 days of data) [2025-09-26T19:58:47.914422] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-08. [2025-09-26T19:58:48.034416] [DEBUG] [LOCAL ] MFG: Primary data saved (49748 records). [2025-09-26T19:58:48.034574] [INFO ] [MAIN ] MFG: Full history saved. [2025-09-26T19:58:48.034715] [INFO ] [MAIN ] Update Progress: 1337/2371 symbols completed. MFG took 32.8s. Estimated remaining: 2h 18m 14s. Rate: 7.5 symbols/min [2025-09-26T19:58:48.220887] [INFO ] [MAIN ] MFSI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:58:48.235254] [DEBUG] [LOCAL ] MFSI: Loaded 11262 existing records from primary storage. [2025-09-26T19:58:48.235391] [INFO ] [MAIN ] MFSI: Loaded 11262 existing records. [2025-09-26T19:58:48.435827] [WARN ] [MAIN ] MFSI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:58:48.439585] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-26T19:58:48.441318] [INFO ] [MAIN ] MFSI: Wiping existing primary data before full refresh. [2025-09-26T19:58:48.441383] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-09-26T19:58:48.441577] [DEBUG] [LOCAL ] MFSI: Deleted primary data file. [2025-09-26T19:58:48.441636] [INFO ] [MAIN ] MFSI: Starting full primary refresh. [2025-09-26T19:58:48.716803] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-08. [2025-09-26T19:58:48.834262] [INFO ] [REMOTE ] MFSI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:58:49.511745] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-09-26T19:58:50.176486] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-26T19:58:50.177869] [INFO ] [REMOTE ] MFSB: Full fetch complete (1610 records). [2025-09-26T19:58:50.177942] [DEBUG] [VALIDATOR ] MFSB: Validating primary data. [2025-09-26T19:58:50.326570] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-03. [2025-09-26T19:58:50.378027] [WARN ] [VALIDATOR ] MFSB: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-09-26T19:58:50.378365] [FATAL] [MAIN ] MFSB: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:58:50.378570] [WARN ] [MAIN ] MFSB: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:58:50.378785] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-09-26T19:58:50.378956] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-09-26T19:58:50.379122] [INFO ] [LOCAL ] MFSB: Starting deletion of derivative data. [2025-09-26T19:58:50.379283] [DEBUG] [LOCAL ] MFSB: No derivative data file found to delete. [2025-09-26T19:58:50.379472] [INFO ] [MAIN ] Update Progress: 1338/2371 symbols completed. MFSB took 31.6s. Estimated remaining: 2h 18m 2s. Rate: 7.5 symbols/min [2025-09-26T19:58:50.563740] [INFO ] [MAIN ] MFSV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:58:50.597788] [DEBUG] [LOCAL ] MFSV: Loaded 2484 existing records from primary storage. [2025-09-26T19:58:50.597582] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-26T19:58:50.607956] [INFO ] [MAIN ] MFSV: Loaded 2484 existing records. [2025-09-26T19:58:50.720038] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-26T19:58:50.801595] [WARN ] [MAIN ] MFSV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:58:50.801895] [INFO ] [MAIN ] MFSV: Wiping existing primary data before full refresh. [2025-09-26T19:58:50.801945] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-09-26T19:58:50.802224] [DEBUG] [LOCAL ] MFSV: Deleted primary data file. [2025-09-26T19:58:50.802284] [INFO ] [MAIN ] MFSV: Starting full primary refresh. [2025-09-26T19:58:51.116855] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2024-12. [2025-09-26T19:58:51.189134] [INFO ] [REMOTE ] MFSV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:58:51.742720] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-26T19:58:51.911729] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-01. [2025-09-26T19:58:52.502466] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-26T19:58:52.711743] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-09. [2025-09-26T19:58:53.511751] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-04. [2025-09-26T19:58:54.105910] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-26T19:58:54.311755] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-02. [2025-09-26T19:58:54.516059] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-26T19:58:54.526164] [INFO ] [REMOTE ] MFC: Full fetch complete (74217 records). [2025-09-26T19:58:54.526323] [DEBUG] [VALIDATOR ] MFC: Validating primary data. [2025-09-26T19:58:54.869186] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-26T19:58:54.975961] [DEBUG] [VALIDATOR ] MFC: All expected trading days are present. [2025-09-26T19:58:54.976142] [DEBUG] [VALIDATOR ] MFC: Primary data validation passed. [2025-09-26T19:58:54.977243] [INFO ] [MAIN ] MFC: Fetched primary data is valid. [2025-09-26T19:58:54.977311] [DEBUG] [LOCAL ] MFC: Saving primary data. [2025-09-26T19:58:54.981846] [DEBUG] [LOCAL ] MFC: Trimmed 74217 records to 52000 (keeping 200 days of data) [2025-09-26T19:58:55.111991] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-05. [2025-09-26T19:58:55.330625] [DEBUG] [LOCAL ] MFC: Primary data saved (52000 records). [2025-09-26T19:58:55.330863] [INFO ] [MAIN ] MFC: Full history saved. [2025-09-26T19:58:55.331021] [INFO ] [MAIN ] Update Progress: 1339/2371 symbols completed. MFC took 41.7s. Estimated remaining: 2h 17m 52s. Rate: 7.5 symbols/min [2025-09-26T19:58:55.452054] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-26T19:58:55.521400] [INFO ] [MAIN ] MG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:58:55.541798] [DEBUG] [LOCAL ] MG: Loaded 16756 existing records from primary storage. [2025-09-26T19:58:55.541988] [INFO ] [MAIN ] MG: Loaded 16756 existing records. [2025-09-26T19:58:55.724848] [WARN ] [MAIN ] MG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:58:55.725224] [INFO ] [MAIN ] MG: Wiping existing primary data before full refresh. [2025-09-26T19:58:55.725272] [INFO ] [LOCAL ] MG: Starting deletion of primary data. [2025-09-26T19:58:55.725846] [DEBUG] [LOCAL ] MG: Deleted primary data file. [2025-09-26T19:58:55.725907] [INFO ] [MAIN ] MG: Starting full primary refresh. [2025-09-26T19:58:55.921323] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-03. [2025-09-26T19:58:56.099834] [INFO ] [REMOTE ] MG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:58:56.549015] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-26T19:58:56.711733] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-04. [2025-09-26T19:58:57.404765] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-26T19:58:57.511730] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-05. [2025-09-26T19:58:58.222212] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-26T19:58:58.311725] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-06. [2025-09-26T19:58:59.111768] [INFO ] [REMOTE ] MG: Fetching primary data for 2024-12. [2025-09-26T19:58:59.152817] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-26T19:58:59.911721] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-06. [2025-09-26T19:59:00.077485] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-26T19:59:00.536855] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-26T19:59:00.711768] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-07. [2025-09-26T19:59:01.325371] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-26T19:59:01.511788] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2024-12. [2025-09-26T19:59:01.864508] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-26T19:59:02.311730] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-07. [2025-09-26T19:59:03.111771] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-01. [2025-09-26T19:59:03.207901] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-26T19:59:03.911764] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-08. [2025-09-26T19:59:04.181058] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-26T19:59:04.584263] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-26T19:59:04.711754] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-02. [2025-09-26T19:59:05.511697] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-01. [2025-09-26T19:59:05.529083] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-26T19:59:05.929397] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-26T19:59:06.311739] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-03. [2025-09-26T19:59:07.111786] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-09. [2025-09-26T19:59:07.445349] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-26T19:59:07.911752] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-02. [2025-09-26T19:59:07.923211] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-26T19:59:07.925507] [INFO ] [REMOTE ] MFSG: Full fetch complete (5928 records). [2025-09-26T19:59:07.925587] [DEBUG] [VALIDATOR ] MFSG: Validating primary data. [2025-09-26T19:59:08.297058] [DEBUG] [VALIDATOR ] MFSG: All expected trading days are present. [2025-09-26T19:59:08.297183] [DEBUG] [VALIDATOR ] MFSG: Primary data validation passed. [2025-09-26T19:59:08.297402] [INFO ] [MAIN ] MFSG: Fetched primary data is valid. [2025-09-26T19:59:08.297441] [DEBUG] [LOCAL ] MFSG: Saving primary data. [2025-09-26T19:59:08.297908] [DEBUG] [LOCAL ] MFSG: Trimmed 5928 records to 5267 (keeping 200 days of data) [2025-09-26T19:59:08.332162] [DEBUG] [LOCAL ] MFSG: Primary data saved (5267 records). [2025-09-26T19:59:08.332298] [INFO ] [MAIN ] MFSG: Full history saved. [2025-09-26T19:59:08.332413] [INFO ] [MAIN ] Update Progress: 1340/2371 symbols completed. MFSG took 26.2s. Estimated remaining: 2h 17m 47s. Rate: 7.5 symbols/min [2025-09-26T19:59:08.435700] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-26T19:59:08.518393] [INFO ] [MAIN ] MGA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:59:08.584780] [DEBUG] [LOCAL ] MGA: Loaded 51028 existing records from primary storage. [2025-09-26T19:59:08.584998] [INFO ] [MAIN ] MGA: Loaded 51028 existing records. [2025-09-26T19:59:08.725836] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-04. [2025-09-26T19:59:08.769943] [WARN ] [MAIN ] MGA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:59:08.770234] [INFO ] [MAIN ] MGA: Wiping existing primary data before full refresh. [2025-09-26T19:59:08.770286] [INFO ] [LOCAL ] MGA: Starting deletion of primary data. [2025-09-26T19:59:08.771391] [DEBUG] [LOCAL ] MGA: Deleted primary data file. [2025-09-26T19:59:08.771453] [INFO ] [MAIN ] MGA: Starting full primary refresh. [2025-09-26T19:59:09.145690] [INFO ] [REMOTE ] MGA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:59:09.511704] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-03. [2025-09-26T19:59:09.908549] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-26T19:59:09.953126] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-26T19:59:10.311809] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-08. [2025-09-26T19:59:11.111700] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-04. [2025-09-26T19:59:11.318683] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-26T19:59:11.445154] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-26T19:59:11.911754] [INFO ] [REMOTE ] MGA: Fetching primary data for 2024-12. [2025-09-26T19:59:12.711737] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-05. [2025-09-26T19:59:13.511750] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-05. [2025-09-26T19:59:13.693495] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-26T19:59:13.739585] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-26T19:59:13.781755] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-09-26T19:59:14.311742] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-06. [2025-09-26T19:59:14.758441] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-26T19:59:15.111772] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-01. [2025-09-26T19:59:15.911730] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-09. [2025-09-26T19:59:16.711698] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-06. [2025-09-26T19:59:16.856142] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-26T19:59:16.991486] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-26T19:59:16.995676] [INFO ] [REMOTE ] MFSI: Full fetch complete (13400 records). [2025-09-26T19:59:16.995765] [DEBUG] [VALIDATOR ] MFSI: Validating primary data. [2025-09-26T19:59:17.383777] [DEBUG] [VALIDATOR ] MFSI: All expected trading days are present. [2025-09-26T19:59:17.383921] [DEBUG] [VALIDATOR ] MFSI: Primary data validation passed. [2025-09-26T19:59:17.384481] [INFO ] [MAIN ] MFSI: Fetched primary data is valid. [2025-09-26T19:59:17.384553] [DEBUG] [LOCAL ] MFSI: Saving primary data. [2025-09-26T19:59:17.385270] [DEBUG] [LOCAL ] MFSI: Trimmed 13400 records to 11358 (keeping 200 days of data) [2025-09-26T19:59:17.460397] [DEBUG] [LOCAL ] MFSI: Primary data saved (11358 records). [2025-09-26T19:59:17.460590] [INFO ] [MAIN ] MFSI: Full history saved. [2025-09-26T19:59:17.460718] [INFO ] [MAIN ] Update Progress: 1341/2371 symbols completed. MFSI took 29.4s. Estimated remaining: 2h 17m 40s. Rate: 7.5 symbols/min [2025-09-26T19:59:17.518694] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-07. [2025-09-26T19:59:17.666852] [INFO ] [MAIN ] MGF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:59:17.675545] [DEBUG] [LOCAL ] MGF: Loaded 4173 existing records from primary storage. [2025-09-26T19:59:17.675755] [INFO ] [MAIN ] MGF: Loaded 4173 existing records. [2025-09-26T19:59:17.817331] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-26T19:59:17.896002] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-26T19:59:17.933127] [WARN ] [MAIN ] MGF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:59:17.933459] [INFO ] [MAIN ] MGF: Wiping existing primary data before full refresh. [2025-09-26T19:59:17.933513] [INFO ] [LOCAL ] MGF: Starting deletion of primary data. [2025-09-26T19:59:17.933817] [DEBUG] [LOCAL ] MGF: Deleted primary data file. [2025-09-26T19:59:17.933878] [INFO ] [MAIN ] MGF: Starting full primary refresh. [2025-09-26T19:59:18.316960] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-08. [2025-09-26T19:59:18.381960] [INFO ] [REMOTE ] MGF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:59:18.783586] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-26T19:59:19.111732] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-02. [2025-09-26T19:59:19.911753] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-07. [2025-09-26T19:59:20.711702] [INFO ] [REMOTE ] MGF: Fetching primary data for 2024-12. [2025-09-26T19:59:20.855903] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-26T19:59:21.024112] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-26T19:59:21.313747] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-26T19:59:21.511780] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-08. [2025-09-26T19:59:22.311790] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-03. [2025-09-26T19:59:22.412297] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-26T19:59:23.111741] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-09. [2025-09-26T19:59:23.911714] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-01. [2025-09-26T19:59:24.174587] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-26T19:59:24.208894] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-26T19:59:24.212034] [INFO ] [REMOTE ] MG: Full fetch complete (24010 records). [2025-09-26T19:59:24.212112] [DEBUG] [VALIDATOR ] MG: Validating primary data. [2025-09-26T19:59:24.526944] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-26T19:59:24.620480] [DEBUG] [VALIDATOR ] MG: All expected trading days are present. [2025-09-26T19:59:24.620610] [DEBUG] [VALIDATOR ] MG: Primary data validation passed. [2025-09-26T19:59:24.621499] [INFO ] [MAIN ] MG: Fetched primary data is valid. [2025-09-26T19:59:24.621571] [DEBUG] [LOCAL ] MG: Saving primary data. [2025-09-26T19:59:24.622375] [DEBUG] [LOCAL ] MG: Trimmed 24010 records to 16832 (keeping 200 days of data) [2025-09-26T19:59:24.711722] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-02. [2025-09-26T19:59:24.728026] [DEBUG] [LOCAL ] MG: Primary data saved (16832 records). [2025-09-26T19:59:24.728257] [INFO ] [MAIN ] MG: Full history saved. [2025-09-26T19:59:24.728450] [INFO ] [MAIN ] Update Progress: 1342/2371 symbols completed. MG took 29.4s. Estimated remaining: 2h 17m 32s. Rate: 7.5 symbols/min [2025-09-26T19:59:24.915727] [INFO ] [MAIN ] MGM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:59:24.981198] [DEBUG] [LOCAL ] MGM: Loaded 53998 existing records from primary storage. [2025-09-26T19:59:24.981441] [INFO ] [MAIN ] MGM: Loaded 53998 existing records. [2025-09-26T19:59:25.180431] [WARN ] [MAIN ] MGM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:59:25.180757] [INFO ] [MAIN ] MGM: Wiping existing primary data before full refresh. [2025-09-26T19:59:25.180841] [INFO ] [LOCAL ] MGM: Starting deletion of primary data. [2025-09-26T19:59:25.181908] [DEBUG] [LOCAL ] MGM: Deleted primary data file. [2025-09-26T19:59:25.181973] [INFO ] [MAIN ] MGM: Starting full primary refresh. [2025-09-26T19:59:25.276759] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-26T19:59:25.516925] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-03. [2025-09-26T19:59:25.592793] [INFO ] [REMOTE ] MGM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:59:26.162813] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-26T19:59:26.311727] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-09. [2025-09-26T19:59:27.111712] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-04. [2025-09-26T19:59:27.178397] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-26T19:59:27.180384] [INFO ] [REMOTE ] MFSV: Full fetch complete (3101 records). [2025-09-26T19:59:27.180460] [DEBUG] [VALIDATOR ] MFSV: Validating primary data. [2025-09-26T19:59:27.589193] [DEBUG] [VALIDATOR ] MFSV: All expected trading days are present. [2025-09-26T19:59:27.589412] [DEBUG] [VALIDATOR ] MFSV: Primary data validation passed. [2025-09-26T19:59:27.589582] [INFO ] [MAIN ] MFSV: Fetched primary data is valid. [2025-09-26T19:59:27.589626] [DEBUG] [LOCAL ] MFSV: Saving primary data. [2025-09-26T19:59:27.590158] [DEBUG] [LOCAL ] MFSV: Trimmed 3101 records to 2514 (keeping 200 days of data) [2025-09-26T19:59:27.607551] [DEBUG] [LOCAL ] MFSV: Primary data saved (2514 records). [2025-09-26T19:59:27.607694] [INFO ] [MAIN ] MFSV: Full history saved. [2025-09-26T19:59:27.607846] [INFO ] [MAIN ] Update Progress: 1343/2371 symbols completed. MFSV took 37.2s. Estimated remaining: 2h 17m 20s. Rate: 7.5 symbols/min [2025-09-26T19:59:27.723300] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-26T19:59:27.803670] [INFO ] [MAIN ] MGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:59:27.813633] [DEBUG] [LOCAL ] MGR: Loaded 5649 existing records from primary storage. [2025-09-26T19:59:27.813786] [INFO ] [MAIN ] MGR: Loaded 5649 existing records. [2025-09-26T19:59:27.916832] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-04. [2025-09-26T19:59:28.004211] [WARN ] [MAIN ] MGR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:59:28.004472] [INFO ] [MAIN ] MGR: Wiping existing primary data before full refresh. [2025-09-26T19:59:28.004521] [INFO ] [LOCAL ] MGR: Starting deletion of primary data. [2025-09-26T19:59:28.004830] [DEBUG] [LOCAL ] MGR: Deleted primary data file. [2025-09-26T19:59:28.004891] [INFO ] [MAIN ] MGR: Starting full primary refresh. [2025-09-26T19:59:28.383496] [INFO ] [REMOTE ] MGR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:59:28.711757] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-05. [2025-09-26T19:59:29.511716] [INFO ] [REMOTE ] MGM: Fetching primary data for 2024-12. [2025-09-26T19:59:29.573578] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-26T19:59:29.667249] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-26T19:59:30.311727] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-05. [2025-09-26T19:59:31.111743] [INFO ] [REMOTE ] MGR: Fetching primary data for 2024-12. [2025-09-26T19:59:31.361823] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-26T19:59:31.844142] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-26T19:59:31.911693] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-06. [2025-09-26T19:59:32.057426] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-26T19:59:32.476846] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-26T19:59:32.711722] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-01. [2025-09-26T19:59:33.511719] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-01. [2025-09-26T19:59:34.081610] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-26T19:59:34.311718] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-07. [2025-09-26T19:59:34.536619] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-26T19:59:34.893761] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-26T19:59:35.111723] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-02. [2025-09-26T19:59:35.910667] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-26T19:59:35.911930] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-02. [2025-09-26T19:59:36.711731] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-06. [2025-09-26T19:59:37.511694] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-08. [2025-09-26T19:59:37.680782] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-26T19:59:38.222141] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-26T19:59:38.311682] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-09. [2025-09-26T19:59:38.388507] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-26T19:59:38.821847] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-26T19:59:38.823317] [INFO ] [REMOTE ] MGF: Full fetch complete (5835 records). [2025-09-26T19:59:38.823389] [DEBUG] [VALIDATOR ] MGF: Validating primary data. [2025-09-26T19:59:39.116808] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-03. [2025-09-26T19:59:39.211719] [DEBUG] [VALIDATOR ] MGF: All expected trading days are present. [2025-09-26T19:59:39.211808] [DEBUG] [VALIDATOR ] MGF: Primary data validation passed. [2025-09-26T19:59:39.212005] [INFO ] [MAIN ] MGF: Fetched primary data is valid. [2025-09-26T19:59:39.212046] [DEBUG] [LOCAL ] MGF: Saving primary data. [2025-09-26T19:59:39.212448] [DEBUG] [LOCAL ] MGF: Trimmed 5835 records to 4186 (keeping 200 days of data) [2025-09-26T19:59:39.239052] [DEBUG] [LOCAL ] MGF: Primary data saved (4186 records). [2025-09-26T19:59:39.239201] [INFO ] [MAIN ] MGF: Full history saved. [2025-09-26T19:59:39.239316] [INFO ] [MAIN ] Update Progress: 1344/2371 symbols completed. MGF took 21.8s. Estimated remaining: 2h 17m 14s. Rate: 7.5 symbols/min [2025-09-26T19:59:39.420058] [INFO ] [MAIN ] MGRB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:59:39.427407] [DEBUG] [LOCAL ] MGRB: Loaded 4096 existing records from primary storage. [2025-09-26T19:59:39.427531] [INFO ] [MAIN ] MGRB: Loaded 4096 existing records. [2025-09-26T19:59:39.622273] [WARN ] [MAIN ] MGRB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:59:39.622562] [INFO ] [MAIN ] MGRB: Wiping existing primary data before full refresh. [2025-09-26T19:59:39.622618] [INFO ] [LOCAL ] MGRB: Starting deletion of primary data. [2025-09-26T19:59:39.622897] [DEBUG] [LOCAL ] MGRB: Deleted primary data file. [2025-09-26T19:59:39.623016] [INFO ] [MAIN ] MGRB: Starting full primary refresh. [2025-09-26T19:59:39.917541] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-03. [2025-09-26T19:59:40.003841] [INFO ] [REMOTE ] MGRB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:59:40.574738] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-26T19:59:40.711723] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2024-12. [2025-09-26T19:59:40.994983] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-26T19:59:41.440489] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-26T19:59:41.511739] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-07. [2025-09-26T19:59:42.311763] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-04. [2025-09-26T19:59:43.111722] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-01. [2025-09-26T19:59:43.313102] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-26T19:59:43.618018] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-26T19:59:43.911739] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-04. [2025-09-26T19:59:44.214533] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-26T19:59:44.479524] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-26T19:59:44.711732] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-08. [2025-09-26T19:59:45.511746] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-02. [2025-09-26T19:59:45.990124] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-26T19:59:46.311698] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-05. [2025-09-26T19:59:46.402557] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-26T19:59:47.111713] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-05. [2025-09-26T19:59:47.749053] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-26T19:59:47.911723] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-06. [2025-09-26T19:59:48.213554] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-26T19:59:48.507288] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-26T19:59:48.711727] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-09. [2025-09-26T19:59:49.511743] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-07. [2025-09-26T19:59:50.094728] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-26T19:59:50.291565] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-26T19:59:50.301777] [INFO ] [REMOTE ] MGA: Full fetch complete (73716 records). [2025-09-26T19:59:50.302026] [DEBUG] [VALIDATOR ] MGA: Validating primary data. [2025-09-26T19:59:50.311733] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-03. [2025-09-26T19:59:50.788804] [DEBUG] [VALIDATOR ] MGA: All expected trading days are present. [2025-09-26T19:59:50.788924] [DEBUG] [VALIDATOR ] MGA: Primary data validation passed. [2025-09-26T19:59:50.790178] [INFO ] [MAIN ] MGA: Fetched primary data is valid. [2025-09-26T19:59:50.790278] [DEBUG] [LOCAL ] MGA: Saving primary data. [2025-09-26T19:59:50.792202] [DEBUG] [LOCAL ] MGA: Trimmed 73716 records to 51414 (keeping 200 days of data) [2025-09-26T19:59:50.895537] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-26T19:59:51.123538] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-06. [2025-09-26T19:59:51.149152] [DEBUG] [LOCAL ] MGA: Primary data saved (51414 records). [2025-09-26T19:59:51.149336] [INFO ] [MAIN ] MGA: Full history saved. [2025-09-26T19:59:51.149473] [INFO ] [MAIN ] Update Progress: 1345/2371 symbols completed. MGA took 42.8s. Estimated remaining: 2h 17m 9s. Rate: 7.5 symbols/min [2025-09-26T19:59:51.335052] [INFO ] [MAIN ] MGRD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:59:51.340182] [DEBUG] [LOCAL ] MGRD: Loaded 2222 existing records from primary storage. [2025-09-26T19:59:51.340294] [INFO ] [MAIN ] MGRD: Loaded 2222 existing records. [2025-09-26T19:59:51.549176] [WARN ] [MAIN ] MGRD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:59:51.549483] [INFO ] [MAIN ] MGRD: Wiping existing primary data before full refresh. [2025-09-26T19:59:51.549541] [INFO ] [LOCAL ] MGRD: Starting deletion of primary data. [2025-09-26T19:59:51.549787] [DEBUG] [LOCAL ] MGRD: Deleted primary data file. [2025-09-26T19:59:51.549849] [INFO ] [MAIN ] MGRD: Starting full primary refresh. [2025-09-26T19:59:51.916903] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-04. [2025-09-26T19:59:51.946812] [INFO ] [REMOTE ] MGRD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:59:52.640657] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-26T19:59:52.711717] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2024-12. [2025-09-26T19:59:52.785000] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-26T19:59:53.330768] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-26T19:59:53.511784] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-05. [2025-09-26T19:59:54.200997] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-26T19:59:54.311737] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-08. [2025-09-26T19:59:54.900505] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-26T19:59:55.111725] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-06. [2025-09-26T19:59:55.683789] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-26T19:59:55.911720] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-09. [2025-09-26T19:59:56.599603] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-26T19:59:56.601284] [INFO ] [REMOTE ] MGR: Full fetch complete (8323 records). [2025-09-26T19:59:56.601363] [DEBUG] [VALIDATOR ] MGR: Validating primary data. [2025-09-26T19:59:56.713367] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-07. [2025-09-26T19:59:56.993786] [DEBUG] [VALIDATOR ] MGR: All expected trading days are present. [2025-09-26T19:59:56.993869] [DEBUG] [VALIDATOR ] MGR: Primary data validation passed. [2025-09-26T19:59:56.994097] [INFO ] [MAIN ] MGR: Fetched primary data is valid. [2025-09-26T19:59:56.994158] [DEBUG] [LOCAL ] MGR: Saving primary data. [2025-09-26T19:59:56.994589] [DEBUG] [LOCAL ] MGR: Trimmed 8323 records to 5675 (keeping 200 days of data) [2025-09-26T19:59:57.030125] [DEBUG] [LOCAL ] MGR: Primary data saved (5675 records). [2025-09-26T19:59:57.030281] [INFO ] [MAIN ] MGR: Full history saved. [2025-09-26T19:59:57.030377] [INFO ] [MAIN ] Update Progress: 1346/2371 symbols completed. MGR took 29.4s. Estimated remaining: 2h 16m 60s. Rate: 7.5 symbols/min [2025-09-26T19:59:57.208613] [INFO ] [MAIN ] MGRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:59:57.218274] [DEBUG] [LOCAL ] MGRE: Loaded 6653 existing records from primary storage. [2025-09-26T19:59:57.218388] [INFO ] [MAIN ] MGRE: Loaded 6653 existing records. [2025-09-26T19:59:57.411794] [WARN ] [MAIN ] MGRE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:59:57.412103] [INFO ] [MAIN ] MGRE: Wiping existing primary data before full refresh. [2025-09-26T19:59:57.412160] [INFO ] [LOCAL ] MGRE: Starting deletion of primary data. [2025-09-26T19:59:57.412554] [DEBUG] [LOCAL ] MGRE: Deleted primary data file. [2025-09-26T19:59:57.412626] [INFO ] [MAIN ] MGRE: Starting full primary refresh. [2025-09-26T19:59:57.519579] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-01. [2025-09-26T19:59:57.802596] [INFO ] [REMOTE ] MGRE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:59:58.051997] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-26T19:59:58.311731] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-02. [2025-09-26T19:59:58.770305] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-26T19:59:58.993786] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-26T19:59:59.111720] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-08. [2025-09-26T19:59:59.911728] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-07. [2025-09-26T20:00:00.475460] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-26T20:00:00.711726] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2024-12. [2025-09-26T20:00:01.101404] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-26T20:00:01.396572] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-26T20:00:01.511728] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-01. [2025-09-26T20:00:02.220100] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-26T20:00:02.311716] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-09. [2025-09-26T20:00:03.111748] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-08. [2025-09-26T20:00:03.701984] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-26T20:00:03.911731] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-09. [2025-09-26T20:00:04.556034] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-26T20:00:04.558223] [INFO ] [REMOTE ] MGRB: Full fetch complete (6257 records). [2025-09-26T20:00:04.558405] [DEBUG] [VALIDATOR ] MGRB: Validating primary data. [2025-09-26T20:00:04.717088] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-03. [2025-09-26T20:00:05.011630] [DEBUG] [VALIDATOR ] MGRB: All expected trading days are present. [2025-09-26T20:00:05.011834] [DEBUG] [VALIDATOR ] MGRB: Primary data validation passed. [2025-09-26T20:00:05.012060] [INFO ] [MAIN ] MGRB: Fetched primary data is valid. [2025-09-26T20:00:05.012149] [DEBUG] [LOCAL ] MGRB: Saving primary data. [2025-09-26T20:00:05.013074] [DEBUG] [LOCAL ] MGRB: Trimmed 6257 records to 4102 (keeping 200 days of data) [2025-09-26T20:00:05.066833] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-09 (2.76 seconds). [2025-09-26T20:00:05.079991] [INFO ] [REMOTE ] MGM: Full fetch complete (77601 records). [2025-09-26T20:00:05.081106] [DEBUG] [VALIDATOR ] MGM: Validating primary data. [2025-09-26T20:00:05.158630] [DEBUG] [LOCAL ] MGRB: Primary data saved (4102 records). [2025-09-26T20:00:05.170867] [INFO ] [MAIN ] MGRB: Full history saved. [2025-09-26T20:00:05.187584] [INFO ] [MAIN ] Update Progress: 1347/2371 symbols completed. MGRB took 25.9s. Estimated remaining: 2h 16m 52s. Rate: 7.5 symbols/min [2025-09-26T20:00:05.496828] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-26T20:00:05.518140] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-02. [2025-09-26T20:00:05.638151] [INFO ] [MAIN ] MGY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:00:05.766088] [DEBUG] [VALIDATOR ] MGM: All expected trading days are present. [2025-09-26T20:00:05.766197] [DEBUG] [VALIDATOR ] MGM: Primary data validation passed. [2025-09-26T20:00:05.767346] [INFO ] [MAIN ] MGM: Fetched primary data is valid. [2025-09-26T20:00:05.767471] [DEBUG] [LOCAL ] MGM: Saving primary data. [2025-09-26T20:00:05.769874] [DEBUG] [LOCAL ] MGM: Trimmed 77601 records to 54388 (keeping 200 days of data) [2025-09-26T20:00:05.924206] [DEBUG] [LOCAL ] MGY: Loaded 52808 existing records from primary storage. [2025-09-26T20:00:05.928378] [INFO ] [MAIN ] MGY: Loaded 52808 existing records. [2025-09-26T20:00:06.243236] [WARN ] [MAIN ] MGY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:00:06.245932] [INFO ] [MAIN ] MGY: Wiping existing primary data before full refresh. [2025-09-26T20:00:06.247004] [INFO ] [LOCAL ] MGY: Starting deletion of primary data. [2025-09-26T20:00:06.248136] [DEBUG] [LOCAL ] MGY: Deleted primary data file. [2025-09-26T20:00:06.248224] [INFO ] [MAIN ] MGY: Starting full primary refresh. [2025-09-26T20:00:06.315144] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-04. [2025-09-26T20:00:06.427363] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-26T20:00:06.775409] [INFO ] [REMOTE ] MGY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:00:06.805543] [DEBUG] [LOCAL ] MGM: Primary data saved (54388 records). [2025-09-26T20:00:06.805757] [INFO ] [MAIN ] MGM: Full history saved. [2025-09-26T20:00:06.805871] [INFO ] [MAIN ] Update Progress: 1348/2371 symbols completed. MGM took 42.1s. Estimated remaining: 2h 16m 39s. Rate: 7.5 symbols/min [2025-09-26T20:00:07.001834] [INFO ] [MAIN ] MH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:00:07.002119] [DEBUG] [LOCAL ] MH: No existing data file found in primary storage. [2025-09-26T20:00:07.002179] [WARN ] [MAIN ] MH: No existing data found, performing full refresh instead. [2025-09-26T20:00:07.002368] [INFO ] [MAIN ] MH: Wiping existing primary data before full refresh. [2025-09-26T20:00:07.002421] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-09-26T20:00:07.002466] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-09-26T20:00:07.002504] [INFO ] [MAIN ] MH: Starting full primary refresh. [2025-09-26T20:00:07.076586] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-26T20:00:07.116975] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-03. [2025-09-26T20:00:07.415694] [INFO ] [REMOTE ] MH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:00:07.740570] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-26T20:00:07.911719] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-05. [2025-09-26T20:00:08.413471] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-26T20:00:08.711716] [INFO ] [REMOTE ] MGY: Fetching primary data for 2024-12. [2025-09-26T20:00:09.511728] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-06. [2025-09-26T20:00:10.079610] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-26T20:00:10.311757] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-04. [2025-09-26T20:00:10.454950] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-26T20:00:10.782950] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-26T20:00:11.111715] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-05. [2025-09-26T20:00:11.655414] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-26T20:00:11.911734] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-06. [2025-09-26T20:00:12.527744] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-26T20:00:12.711723] [INFO ] [REMOTE ] MH: Fetching primary data for 2024-12. [2025-09-26T20:00:12.941826] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:00:12.942496] [WARN ] [REMOTE ] MH: No data returned for month 2024-12 [2025-09-26T20:00:13.511743] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-07. [2025-09-26T20:00:13.993605] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-26T20:00:14.311761] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-08. [2025-09-26T20:00:14.650470] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-26T20:00:15.111726] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-07. [2025-09-26T20:00:15.879893] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-26T20:00:15.911731] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-09. [2025-09-26T20:00:16.711765] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-08. [2025-09-26T20:00:17.353884] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-26T20:00:17.511726] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-09. [2025-09-26T20:00:18.303016] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-26T20:00:18.305061] [INFO ] [REMOTE ] MGRE: Full fetch complete (9400 records). [2025-09-26T20:00:18.305175] [DEBUG] [VALIDATOR ] MGRE: Validating primary data. [2025-09-26T20:00:18.317291] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-01. [2025-09-26T20:00:18.433701] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-09-26T20:00:18.440013] [INFO ] [REMOTE ] MGRD: Full fetch complete (3480 records). [2025-09-26T20:00:18.446199] [DEBUG] [VALIDATOR ] MGRD: Validating primary data. [2025-09-26T20:00:18.597521] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:00:18.677006] [WARN ] [REMOTE ] MH: No data returned for month 2025-01 [2025-09-26T20:00:19.093670] [DEBUG] [VALIDATOR ] MGRE: All expected trading days are present. [2025-09-26T20:00:19.099249] [DEBUG] [VALIDATOR ] MGRE: Primary data validation passed. [2025-09-26T20:00:19.105094] [INFO ] [MAIN ] MGRE: Fetched primary data is valid. [2025-09-26T20:00:19.115533] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-02. [2025-09-26T20:00:19.155772] [DEBUG] [LOCAL ] MGRE: Saving primary data. [2025-09-26T20:00:19.185042] [DEBUG] [VALIDATOR ] MGRD: All expected trading days are present. [2025-09-26T20:00:19.185200] [DEBUG] [VALIDATOR ] MGRD: Primary data validation passed. [2025-09-26T20:00:19.185428] [INFO ] [MAIN ] MGRD: Fetched primary data is valid. [2025-09-26T20:00:19.185720] [DEBUG] [LOCAL ] MGRD: Saving primary data. [2025-09-26T20:00:19.186666] [DEBUG] [LOCAL ] MGRE: Trimmed 9400 records to 6684 (keeping 200 days of data) [2025-09-26T20:00:19.186769] [DEBUG] [LOCAL ] MGRD: Trimmed 3480 records to 2231 (keeping 200 days of data) [2025-09-26T20:00:19.234751] [DEBUG] [LOCAL ] MGRD: Primary data saved (2231 records). [2025-09-26T20:00:19.235742] [INFO ] [MAIN ] MGRD: Full history saved. [2025-09-26T20:00:19.236236] [INFO ] [MAIN ] Update Progress: 1349/2371 symbols completed. MGRD took 28.1s. Estimated remaining: 2h 16m 34s. Rate: 7.5 symbols/min [2025-09-26T20:00:19.414020] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:00:19.445095] [INFO ] [MAIN ] MHD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:00:19.446145] [WARN ] [REMOTE ] MH: No data returned for month 2025-02 [2025-09-26T20:00:19.449595] [DEBUG] [LOCAL ] MGRE: Primary data saved (6684 records). [2025-09-26T20:00:19.450726] [INFO ] [MAIN ] MGRE: Full history saved. [2025-09-26T20:00:19.451026] [INFO ] [MAIN ] Update Progress: 1350/2371 symbols completed. MGRE took 22.4s. Estimated remaining: 2h 16m 20s. Rate: 7.5 symbols/min [2025-09-26T20:00:19.574012] [DEBUG] [LOCAL ] MHD: Loaded 12200 existing records from primary storage. [2025-09-26T20:00:19.580010] [INFO ] [MAIN ] MHD: Loaded 12200 existing records. [2025-09-26T20:00:19.792444] [INFO ] [MAIN ] MHF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:00:19.904344] [DEBUG] [LOCAL ] MHF: Loaded 8678 existing records from primary storage. [2025-09-26T20:00:19.900614] [WARN ] [MAIN ] MHD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:00:19.904523] [INFO ] [MAIN ] MHF: Loaded 8678 existing records. [2025-09-26T20:00:19.917195] [INFO ] [MAIN ] MHD: Wiping existing primary data before full refresh. [2025-09-26T20:00:19.922601] [INFO ] [LOCAL ] MHD: Starting deletion of primary data. [2025-09-26T20:00:19.916829] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-03. [2025-09-26T20:00:19.957851] [DEBUG] [LOCAL ] MHD: Deleted primary data file. [2025-09-26T20:00:19.983875] [INFO ] [MAIN ] MHD: Starting full primary refresh. [2025-09-26T20:00:20.242782] [WARN ] [MAIN ] MHF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:00:20.243907] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:00:20.250456] [WARN ] [REMOTE ] MH: No data returned for month 2025-03 [2025-09-26T20:00:20.250327] [INFO ] [MAIN ] MHF: Wiping existing primary data before full refresh. [2025-09-26T20:00:20.256024] [INFO ] [LOCAL ] MHF: Starting deletion of primary data. [2025-09-26T20:00:20.276898] [DEBUG] [LOCAL ] MHF: Deleted primary data file. [2025-09-26T20:00:20.313481] [INFO ] [MAIN ] MHF: Starting full primary refresh. [2025-09-26T20:00:20.712853] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-04. [2025-09-26T20:00:20.949196] [INFO ] [REMOTE ] MHD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:00:20.996955] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:00:21.012770] [WARN ] [REMOTE ] MH: No data returned for month 2025-04 [2025-09-26T20:00:21.078057] [INFO ] [REMOTE ] MHF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:00:21.511764] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-05. [2025-09-26T20:00:21.738204] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:00:21.738688] [WARN ] [REMOTE ] MH: No data returned for month 2025-05 [2025-09-26T20:00:22.311763] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-06. [2025-09-26T20:00:22.517099] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:00:22.517558] [WARN ] [REMOTE ] MH: No data returned for month 2025-06 [2025-09-26T20:00:23.111729] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-01. [2025-09-26T20:00:23.911724] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-07. [2025-09-26T20:00:24.713829] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-26T20:00:24.711960] [INFO ] [REMOTE ] MHD: Fetching primary data for 2024-12. [2025-09-26T20:00:24.782119] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-26T20:00:25.511730] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-02. [2025-09-26T20:00:25.714192] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-26T20:00:26.311737] [INFO ] [REMOTE ] MHF: Fetching primary data for 2024-12. [2025-09-26T20:00:27.111713] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-01. [2025-09-26T20:00:27.158885] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-26T20:00:27.193974] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-26T20:00:27.911722] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-03. [2025-09-26T20:00:28.032299] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-26T20:00:28.711750] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-02. [2025-09-26T20:00:29.445290] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-26T20:00:29.511743] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-01. [2025-09-26T20:00:29.634445] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-26T20:00:30.028844] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-26T20:00:30.311769] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-08. [2025-09-26T20:00:31.111728] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-03. [2025-09-26T20:00:31.703869] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-26T20:00:31.911709] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-04. [2025-09-26T20:00:31.935679] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-26T20:00:32.711735] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-02. [2025-09-26T20:00:33.498298] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-26T20:00:33.511710] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-03. [2025-09-26T20:00:33.717082] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-26T20:00:34.178802] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-26T20:00:34.311720] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-04. [2025-09-26T20:00:35.004439] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-26T20:00:35.111721] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-05. [2025-09-26T20:00:35.911709] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-04. [2025-09-26T20:00:36.675518] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-26T20:00:36.711713] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-05. [2025-09-26T20:00:36.929017] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-26T20:00:37.405543] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-26T20:00:37.511741] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-05. [2025-09-26T20:00:38.311743] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-09. [2025-09-26T20:00:38.329592] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-26T20:00:39.111806] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-06. [2025-09-26T20:00:39.794064] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-26T20:00:39.801167] [INFO ] [REMOTE ] MH: Full fetch complete (12837 records). [2025-09-26T20:00:39.801325] [DEBUG] [VALIDATOR ] MH: Validating primary data. [2025-09-26T20:00:39.916940] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-06. [2025-09-26T20:00:40.014617] [WARN ] [VALIDATOR ] MH: Validation failed - insufficient historical data. Have 46 unique days, need 200 days [2025-09-26T20:00:40.014977] [FATAL] [MAIN ] MH: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:00:40.015065] [WARN ] [MAIN ] MH: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:00:40.015143] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-09-26T20:00:40.015234] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-09-26T20:00:40.015294] [INFO ] [LOCAL ] MH: Starting deletion of derivative data. [2025-09-26T20:00:40.015355] [DEBUG] [LOCAL ] MH: No derivative data file found to delete. [2025-09-26T20:00:40.015455] [INFO ] [MAIN ] Update Progress: 1351/2371 symbols completed. MH took 33.2s. Estimated remaining: 2h 16m 22s. Rate: 7.5 symbols/min [2025-09-26T20:00:40.204872] [INFO ] [MAIN ] MHK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:00:40.272758] [DEBUG] [LOCAL ] MHK: Loaded 42816 existing records from primary storage. [2025-09-26T20:00:40.272908] [INFO ] [MAIN ] MHK: Loaded 42816 existing records. [2025-09-26T20:00:40.479615] [WARN ] [MAIN ] MHK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:00:40.479916] [INFO ] [MAIN ] MHK: Wiping existing primary data before full refresh. [2025-09-26T20:00:40.479967] [INFO ] [LOCAL ] MHK: Starting deletion of primary data. [2025-09-26T20:00:40.480514] [DEBUG] [LOCAL ] MHK: Deleted primary data file. [2025-09-26T20:00:40.480575] [INFO ] [MAIN ] MHK: Starting full primary refresh. [2025-09-26T20:00:40.718509] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-06. [2025-09-26T20:00:40.923741] [INFO ] [REMOTE ] MHK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:00:41.033004] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-26T20:00:41.094764] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-26T20:00:41.511708] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-07. [2025-09-26T20:00:41.739686] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-26T20:00:42.311763] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-07. [2025-09-26T20:00:42.984572] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-26T20:00:43.104714] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-26T20:00:43.111669] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-08. [2025-09-26T20:00:43.911721] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-08. [2025-09-26T20:00:43.997339] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-26T20:00:44.711717] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-09. [2025-09-26T20:00:45.511704] [INFO ] [REMOTE ] MHK: Fetching primary data for 2024-12. [2025-09-26T20:00:45.623068] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-26T20:00:45.641506] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-26T20:00:45.644165] [INFO ] [REMOTE ] MHF: Full fetch complete (12758 records). [2025-09-26T20:00:45.644250] [DEBUG] [VALIDATOR ] MHF: Validating primary data. [2025-09-26T20:00:46.048563] [DEBUG] [VALIDATOR ] MHF: All expected trading days are present. [2025-09-26T20:00:46.048702] [DEBUG] [VALIDATOR ] MHF: Primary data validation passed. [2025-09-26T20:00:46.049097] [INFO ] [MAIN ] MHF: Fetched primary data is valid. [2025-09-26T20:00:46.049148] [DEBUG] [LOCAL ] MHF: Saving primary data. [2025-09-26T20:00:46.049739] [DEBUG] [LOCAL ] MHF: Trimmed 12758 records to 8713 (keeping 200 days of data) [2025-09-26T20:00:46.108289] [DEBUG] [LOCAL ] MHF: Primary data saved (8713 records). [2025-09-26T20:00:46.108447] [INFO ] [MAIN ] MHF: Full history saved. [2025-09-26T20:00:46.108556] [INFO ] [MAIN ] Update Progress: 1352/2371 symbols completed. MHF took 26.7s. Estimated remaining: 2h 16m 12s. Rate: 7.5 symbols/min [2025-09-26T20:00:46.306781] [INFO ] [MAIN ] MHLA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:00:46.307045] [DEBUG] [LOCAL ] MHLA: No existing data file found in primary storage. [2025-09-26T20:00:46.307115] [WARN ] [MAIN ] MHLA: No existing data found, performing full refresh instead. [2025-09-26T20:00:46.307316] [INFO ] [MAIN ] MHLA: Wiping existing primary data before full refresh. [2025-09-26T20:00:46.307390] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-26T20:00:46.307462] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-09-26T20:00:46.307499] [INFO ] [MAIN ] MHLA: Starting full primary refresh. [2025-09-26T20:00:46.321430] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-09. [2025-09-26T20:00:46.763619] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:00:46.992764] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-26T20:00:47.111724] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-07. [2025-09-26T20:00:47.892454] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-26T20:00:47.911702] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-01. [2025-09-26T20:00:48.314787] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-26T20:00:48.326015] [INFO ] [REMOTE ] MGY: Full fetch complete (75574 records). [2025-09-26T20:00:48.326241] [DEBUG] [VALIDATOR ] MGY: Validating primary data. [2025-09-26T20:00:48.723764] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-08. [2025-09-26T20:00:48.793808] [DEBUG] [VALIDATOR ] MGY: All expected trading days are present. [2025-09-26T20:00:48.793924] [DEBUG] [VALIDATOR ] MGY: Primary data validation passed. [2025-09-26T20:00:48.795075] [INFO ] [MAIN ] MGY: Fetched primary data is valid. [2025-09-26T20:00:48.795146] [DEBUG] [LOCAL ] MGY: Saving primary data. [2025-09-26T20:00:48.800117] [DEBUG] [LOCAL ] MGY: Trimmed 75574 records to 53195 (keeping 200 days of data) [2025-09-26T20:00:49.161894] [DEBUG] [LOCAL ] MGY: Primary data saved (53195 records). [2025-09-26T20:00:49.162046] [INFO ] [MAIN ] MGY: Full history saved. [2025-09-26T20:00:49.162164] [INFO ] [MAIN ] Update Progress: 1353/2371 symbols completed. MGY took 44.0s. Estimated remaining: 2h 16m 1s. Rate: 7.5 symbols/min [2025-09-26T20:00:49.357166] [INFO ] [MAIN ] MHN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:00:49.370414] [DEBUG] [LOCAL ] MHN: Loaded 7852 existing records from primary storage. [2025-09-26T20:00:49.370743] [INFO ] [MAIN ] MHN: Loaded 7852 existing records. [2025-09-26T20:00:49.511705] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2024-12. [2025-09-26T20:00:49.578244] [WARN ] [MAIN ] MHN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:00:49.580173] [INFO ] [MAIN ] MHN: Wiping existing primary data before full refresh. [2025-09-26T20:00:49.580701] [INFO ] [LOCAL ] MHN: Starting deletion of primary data. [2025-09-26T20:00:49.591504] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-26T20:00:49.590941] [DEBUG] [LOCAL ] MHN: Deleted primary data file. [2025-09-26T20:00:49.594866] [INFO ] [MAIN ] MHN: Starting full primary refresh. [2025-09-26T20:00:49.738315] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-26T20:00:49.978059] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-26T20:00:50.021362] [INFO ] [REMOTE ] MHN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:00:50.311713] [INFO ] [REMOTE ] MHN: Fetching primary data for 2024-12. [2025-09-26T20:00:51.081782] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-26T20:00:51.111877] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-01. [2025-09-26T20:00:51.452453] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-26T20:00:51.911717] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-09. [2025-09-26T20:00:52.711726] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-01. [2025-09-26T20:00:52.974475] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-26T20:00:52.978630] [INFO ] [REMOTE ] MHD: Full fetch complete (18782 records). [2025-09-26T20:00:52.978805] [DEBUG] [VALIDATOR ] MHD: Validating primary data. [2025-09-26T20:00:53.414142] [DEBUG] [VALIDATOR ] MHD: All expected trading days are present. [2025-09-26T20:00:53.414243] [DEBUG] [VALIDATOR ] MHD: Primary data validation passed. [2025-09-26T20:00:53.414795] [INFO ] [MAIN ] MHD: Fetched primary data is valid. [2025-09-26T20:00:53.414877] [DEBUG] [LOCAL ] MHD: Saving primary data. [2025-09-26T20:00:53.415719] [DEBUG] [LOCAL ] MHD: Trimmed 18782 records to 12297 (keeping 200 days of data) [2025-09-26T20:00:53.516685] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-09-26T20:00:53.525781] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-26T20:00:53.536053] [DEBUG] [LOCAL ] MHD: Primary data saved (12297 records). [2025-09-26T20:00:53.536264] [INFO ] [MAIN ] MHD: Full history saved. [2025-09-26T20:00:53.536437] [INFO ] [MAIN ] Update Progress: 1354/2371 symbols completed. MHD took 34.3s. Estimated remaining: 2h 15m 50s. Rate: 7.5 symbols/min [2025-09-26T20:00:53.774806] [INFO ] [MAIN ] MHO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:00:53.802825] [DEBUG] [LOCAL ] MHO: Loaded 24495 existing records from primary storage. [2025-09-26T20:00:53.802971] [INFO ] [MAIN ] MHO: Loaded 24495 existing records. [2025-09-26T20:00:54.007383] [WARN ] [MAIN ] MHO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:00:54.007569] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-26T20:00:54.009258] [INFO ] [MAIN ] MHO: Wiping existing primary data before full refresh. [2025-09-26T20:00:54.009332] [INFO ] [LOCAL ] MHO: Starting deletion of primary data. [2025-09-26T20:00:54.010014] [DEBUG] [LOCAL ] MHO: Deleted primary data file. [2025-09-26T20:00:54.010078] [INFO ] [MAIN ] MHO: Starting full primary refresh. [2025-09-26T20:00:54.316923] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-02. [2025-09-26T20:00:54.456812] [INFO ] [REMOTE ] MHO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:00:55.111712] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-09-26T20:00:55.169079] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-26T20:00:55.457447] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-26T20:00:55.911723] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-03. [2025-09-26T20:00:56.693684] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-26T20:00:56.711754] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-02. [2025-09-26T20:00:57.511764] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-04. [2025-09-26T20:00:58.125825] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-26T20:00:58.311736] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-03. [2025-09-26T20:00:58.323920] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-26T20:00:59.111718] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-05. [2025-09-26T20:00:59.582543] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-26T20:00:59.872570] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-26T20:00:59.911693] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-04. [2025-09-26T20:01:00.711751] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-06. [2025-09-26T20:01:01.511687] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-09-26T20:01:01.725091] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-26T20:01:01.723157] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-26T20:01:01.864140] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-26T20:01:02.311746] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-07. [2025-09-26T20:01:03.114574] [INFO ] [REMOTE ] MHO: Fetching primary data for 2024-12. [2025-09-26T20:01:03.115479] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-26T20:01:03.911730] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-08. [2025-09-26T20:01:04.286766] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-26T20:01:04.653484] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-26T20:01:04.711748] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-09-26T20:01:05.233175] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-26T20:01:05.511725] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-05. [2025-09-26T20:01:06.311749] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-09. [2025-09-26T20:01:07.106765] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-26T20:01:07.115773] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-01. [2025-09-26T20:01:07.141912] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-26T20:01:07.144059] [INFO ] [REMOTE ] MHN: Full fetch complete (11831 records). [2025-09-26T20:01:07.144159] [DEBUG] [VALIDATOR ] MHN: Validating primary data. [2025-09-26T20:01:07.546909] [DEBUG] [VALIDATOR ] MHN: All expected trading days are present. [2025-09-26T20:01:07.547037] [DEBUG] [VALIDATOR ] MHN: Primary data validation passed. [2025-09-26T20:01:07.547348] [INFO ] [MAIN ] MHN: Fetched primary data is valid. [2025-09-26T20:01:07.547391] [DEBUG] [LOCAL ] MHN: Saving primary data. [2025-09-26T20:01:07.547995] [DEBUG] [LOCAL ] MHN: Trimmed 11831 records to 7867 (keeping 200 days of data) [2025-09-26T20:01:07.598812] [DEBUG] [LOCAL ] MHN: Primary data saved (7867 records). [2025-09-26T20:01:07.598972] [INFO ] [MAIN ] MHN: Full history saved. [2025-09-26T20:01:07.599069] [INFO ] [MAIN ] Update Progress: 1355/2371 symbols completed. MHN took 18.4s. Estimated remaining: 2h 15m 46s. Rate: 7.5 symbols/min [2025-09-26T20:01:07.797848] [INFO ] [MAIN ] MIAX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:01:07.798080] [DEBUG] [LOCAL ] MIAX: No existing data file found in primary storage. [2025-09-26T20:01:07.798137] [WARN ] [MAIN ] MIAX: No existing data found, performing full refresh instead. [2025-09-26T20:01:07.798288] [INFO ] [MAIN ] MIAX: Wiping existing primary data before full refresh. [2025-09-26T20:01:07.798332] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-09-26T20:01:07.798375] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-09-26T20:01:07.798409] [INFO ] [MAIN ] MIAX: Starting full primary refresh. [2025-09-26T20:01:07.916905] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-06. [2025-09-26T20:01:08.224541] [INFO ] [REMOTE ] MIAX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:01:08.648586] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-26T20:01:08.711755] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-02. [2025-09-26T20:01:09.076584] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-26T20:01:09.511739] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2024-12. [2025-09-26T20:01:09.742092] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-26T20:01:09.798003] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:01:09.798369] [WARN ] [REMOTE ] MIAX: No data returned for month 2024-12 [2025-09-26T20:01:10.311723] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-07. [2025-09-26T20:01:11.111723] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-06. [2025-09-26T20:01:11.463112] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-26T20:01:11.916932] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-07. [2025-09-26T20:01:11.942751] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-26T20:01:12.187882] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-09-26T20:01:12.711727] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-08. [2025-09-26T20:01:13.511735] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-01. [2025-09-26T20:01:14.150689] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:01:14.151070] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-01 [2025-09-26T20:01:14.191322] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-26T20:01:14.311726] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-09. [2025-09-26T20:01:15.111753] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-03. [2025-09-26T20:01:15.911733] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-08. [2025-09-26T20:01:16.127331] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-26T20:01:16.135925] [INFO ] [REMOTE ] MHK: Full fetch complete (60818 records). [2025-09-26T20:01:16.136067] [DEBUG] [VALIDATOR ] MHK: Validating primary data. [2025-09-26T20:01:16.413408] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-26T20:01:16.519172] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-26T20:01:16.611878] [DEBUG] [VALIDATOR ] MHK: All expected trading days are present. [2025-09-26T20:01:16.611996] [DEBUG] [VALIDATOR ] MHK: Primary data validation passed. [2025-09-26T20:01:16.613052] [INFO ] [MAIN ] MHK: Fetched primary data is valid. [2025-09-26T20:01:16.613121] [DEBUG] [LOCAL ] MHK: Saving primary data. [2025-09-26T20:01:16.616162] [DEBUG] [LOCAL ] MHK: Trimmed 60818 records to 43076 (keeping 200 days of data) [2025-09-26T20:01:16.713836] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-04. [2025-09-26T20:01:16.904074] [DEBUG] [LOCAL ] MHK: Primary data saved (43076 records). [2025-09-26T20:01:16.904227] [INFO ] [MAIN ] MHK: Full history saved. [2025-09-26T20:01:16.904325] [INFO ] [MAIN ] Update Progress: 1356/2371 symbols completed. MHK took 36.9s. Estimated remaining: 2h 15m 39s. Rate: 7.5 symbols/min [2025-09-26T20:01:17.090670] [INFO ] [MAIN ] MIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:01:17.106576] [DEBUG] [LOCAL ] MIN: Loaded 13198 existing records from primary storage. [2025-09-26T20:01:17.106752] [INFO ] [MAIN ] MIN: Loaded 13198 existing records. [2025-09-26T20:01:17.301005] [WARN ] [MAIN ] MIN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:01:17.301298] [INFO ] [MAIN ] MIN: Wiping existing primary data before full refresh. [2025-09-26T20:01:17.301349] [INFO ] [LOCAL ] MIN: Starting deletion of primary data. [2025-09-26T20:01:17.301591] [DEBUG] [LOCAL ] MIN: Deleted primary data file. [2025-09-26T20:01:17.301686] [INFO ] [MAIN ] MIN: Starting full primary refresh. [2025-09-26T20:01:17.516829] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-02. [2025-09-26T20:01:17.695815] [INFO ] [REMOTE ] MIN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:01:17.783381] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-26T20:01:17.802139] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:01:17.802409] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-02 [2025-09-26T20:01:18.311727] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-09. [2025-09-26T20:01:18.781078] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-26T20:01:18.781991] [INFO ] [REMOTE ] MHLA: Full fetch complete (1547 records). [2025-09-26T20:01:18.782062] [DEBUG] [VALIDATOR ] MHLA: Validating primary data. [2025-09-26T20:01:18.977227] [WARN ] [VALIDATOR ] MHLA: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-26T20:01:18.977505] [FATAL] [MAIN ] MHLA: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:01:18.977597] [WARN ] [MAIN ] MHLA: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:01:18.977713] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-26T20:01:18.977795] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-09-26T20:01:18.977836] [INFO ] [LOCAL ] MHLA: Starting deletion of derivative data. [2025-09-26T20:01:18.977877] [DEBUG] [LOCAL ] MHLA: No derivative data file found to delete. [2025-09-26T20:01:18.977942] [INFO ] [MAIN ] Update Progress: 1357/2371 symbols completed. MHLA took 32.9s. Estimated remaining: 2h 15m 27s. Rate: 7.5 symbols/min [2025-09-26T20:01:19.111713] [INFO ] [REMOTE ] MIN: Fetching primary data for 2024-12. [2025-09-26T20:01:19.911743] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-05. [2025-09-26T20:01:20.063134] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-26T20:01:20.711737] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-01. [2025-09-26T20:01:21.077450] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-26T20:01:21.361554] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-26T20:01:21.511713] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-06. [2025-09-26T20:01:22.311712] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-02. [2025-09-26T20:01:22.437613] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-26T20:01:23.017179] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-26T20:01:23.111736] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-03. [2025-09-26T20:01:23.638328] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-26T20:01:23.911726] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-07. [2025-09-26T20:01:24.711799] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-04. [2025-09-26T20:01:25.225635] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-26T20:01:25.511731] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-08. [2025-09-26T20:01:25.549066] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-26T20:01:26.311739] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-05. [2025-09-26T20:01:26.474513] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-26T20:01:27.111731] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-09. [2025-09-26T20:01:27.127595] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-26T20:01:27.911718] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-03. [2025-09-26T20:01:28.158855] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:01:28.159291] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-03 [2025-09-26T20:01:28.385612] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-26T20:01:28.391289] [INFO ] [REMOTE ] MHO: Full fetch complete (37442 records). [2025-09-26T20:01:28.391401] [DEBUG] [VALIDATOR ] MHO: Validating primary data. [2025-09-26T20:01:28.721727] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-04. [2025-09-26T20:01:28.824428] [DEBUG] [VALIDATOR ] MHO: All expected trading days are present. [2025-09-26T20:01:28.824531] [DEBUG] [VALIDATOR ] MHO: Primary data validation passed. [2025-09-26T20:01:28.825305] [INFO ] [MAIN ] MHO: Fetched primary data is valid. [2025-09-26T20:01:28.825373] [DEBUG] [LOCAL ] MHO: Saving primary data. [2025-09-26T20:01:28.826358] [DEBUG] [LOCAL ] MHO: Trimmed 37442 records to 24650 (keeping 200 days of data) [2025-09-26T20:01:28.996026] [DEBUG] [LOCAL ] MHO: Primary data saved (24650 records). [2025-09-26T20:01:28.996179] [INFO ] [MAIN ] MHO: Full history saved. [2025-09-26T20:01:28.996345] [INFO ] [MAIN ] Update Progress: 1358/2371 symbols completed. MHO took 35.5s. Estimated remaining: 2h 15m 20s. Rate: 7.5 symbols/min [2025-09-26T20:01:29.000488] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:01:29.000820] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-04 [2025-09-26T20:01:29.511753] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-05. [2025-09-26T20:01:29.706252] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:01:29.706602] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-05 [2025-09-26T20:01:30.311721] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-06. [2025-09-26T20:01:30.514198] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:01:30.514680] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-06 [2025-09-26T20:01:31.111735] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-07. [2025-09-26T20:01:31.318168] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:01:31.318580] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-07 [2025-09-26T20:01:31.911720] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-08. [2025-09-26T20:01:32.711727] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-06. [2025-09-26T20:01:33.076257] [INFO ] [REMOTE ] MIAX: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-26T20:01:33.511723] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-09. [2025-09-26T20:01:33.711475] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-26T20:01:34.312360] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-07. [2025-09-26T20:01:35.236524] [INFO ] [REMOTE ] MIAX: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T20:01:35.244966] [INFO ] [REMOTE ] MIAX: Full fetch complete (9496 records). [2025-09-26T20:01:35.245134] [DEBUG] [VALIDATOR ] MIAX: Validating primary data. [2025-09-26T20:01:35.494770] [WARN ] [VALIDATOR ] MIAX: Validation failed - insufficient historical data. Have 31 unique days, need 200 days [2025-09-26T20:01:35.495169] [FATAL] [MAIN ] MIAX: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:01:35.495356] [WARN ] [MAIN ] MIAX: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:01:35.495589] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-09-26T20:01:35.495762] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-09-26T20:01:35.495971] [INFO ] [LOCAL ] MIAX: Starting deletion of derivative data. [2025-09-26T20:01:35.496116] [DEBUG] [LOCAL ] MIAX: No derivative data file found to delete. [2025-09-26T20:01:35.496424] [INFO ] [MAIN ] Update Progress: 1359/2371 symbols completed. MIAX took 27.9s. Estimated remaining: 2h 15m 11s. Rate: 7.5 symbols/min [2025-09-26T20:01:35.512274] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-26T20:01:35.518081] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-08. [2025-09-26T20:01:36.489869] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-26T20:01:36.494157] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-09. [2025-09-26T20:01:37.724869] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-26T20:01:37.727392] [INFO ] [REMOTE ] MIN: Full fetch complete (17693 records). [2025-09-26T20:01:37.727467] [DEBUG] [VALIDATOR ] MIN: Validating primary data. [2025-09-26T20:01:38.129875] [DEBUG] [VALIDATOR ] MIN: All expected trading days are present. [2025-09-26T20:01:38.130010] [DEBUG] [VALIDATOR ] MIN: Primary data validation passed. [2025-09-26T20:01:38.130410] [INFO ] [MAIN ] MIN: Fetched primary data is valid. [2025-09-26T20:01:38.130452] [DEBUG] [LOCAL ] MIN: Saving primary data. [2025-09-26T20:01:38.131138] [DEBUG] [LOCAL ] MIN: Trimmed 17693 records to 13224 (keeping 200 days of data) [2025-09-26T20:01:38.214257] [DEBUG] [LOCAL ] MIN: Primary data saved (13224 records). [2025-09-26T20:01:38.214412] [INFO ] [MAIN ] MIN: Full history saved. [2025-09-26T20:01:38.214517] [INFO ] [MAIN ] Update Progress: 1360/2371 symbols completed. MIN took 21.3s. Estimated remaining: 2h 14m 59s. Rate: 7.5 symbols/min [2025-09-26T20:01:38.827622] [INFO ] [MAIN ] MIR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:01:38.967751] [INFO ] [MAIN ] MITN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:01:39.002121] [DEBUG] [LOCAL ] MITN: No existing data file found in primary storage. [2025-09-26T20:01:38.998581] [INFO ] [MAIN ] MITP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:01:39.003208] [WARN ] [MAIN ] MITN: No existing data found, performing full refresh instead. [2025-09-26T20:01:39.030634] [INFO ] [MAIN ] MITN: Wiping existing primary data before full refresh. [2025-09-26T20:01:39.030131] [INFO ] [MAIN ] MITT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:01:39.030824] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-09-26T20:01:39.034341] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-09-26T20:01:39.034821] [INFO ] [MAIN ] MITN: Starting full primary refresh. [2025-09-26T20:01:39.034114] [DEBUG] [LOCAL ] MITP: Loaded 2455 existing records from primary storage. [2025-09-26T20:01:39.040129] [INFO ] [MAIN ] MITP: Loaded 2455 existing records. [2025-09-26T20:01:39.321832] [DEBUG] [LOCAL ] MITT: Loaded 23213 existing records from primary storage. [2025-09-26T20:01:39.431160] [INFO ] [MAIN ] MITT: Loaded 23213 existing records. [2025-09-26T20:01:39.489639] [WARN ] [MAIN ] MITP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:01:39.561734] [INFO ] [MAIN ] MITP: Wiping existing primary data before full refresh. [2025-09-26T20:01:39.605682] [INFO ] [LOCAL ] MITP: Starting deletion of primary data. [2025-09-26T20:01:39.649422] [DEBUG] [LOCAL ] MIR: Loaded 51232 existing records from primary storage. [2025-09-26T20:01:39.696482] [DEBUG] [LOCAL ] MITP: Deleted primary data file. [2025-09-26T20:01:39.721913] [INFO ] [MAIN ] MIR: Loaded 51232 existing records. [2025-09-26T20:01:39.727171] [INFO ] [MAIN ] MITP: Starting full primary refresh. [2025-09-26T20:01:40.112016] [WARN ] [MAIN ] MITT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:01:40.112404] [INFO ] [MAIN ] MITT: Wiping existing primary data before full refresh. [2025-09-26T20:01:40.112473] [INFO ] [LOCAL ] MITT: Starting deletion of primary data. [2025-09-26T20:01:40.112858] [DEBUG] [LOCAL ] MITT: Deleted primary data file. [2025-09-26T20:01:40.194703] [INFO ] [MAIN ] MITT: Starting full primary refresh. [2025-09-26T20:01:40.263083] [INFO ] [REMOTE ] MITN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:01:40.360881] [INFO ] [REMOTE ] MITN: Fetching primary data for 2024-12. [2025-09-26T20:01:40.495262] [WARN ] [MAIN ] MIR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:01:40.596163] [INFO ] [MAIN ] MIR: Wiping existing primary data before full refresh. [2025-09-26T20:01:40.611966] [INFO ] [LOCAL ] MIR: Starting deletion of primary data. [2025-09-26T20:01:40.701400] [DEBUG] [LOCAL ] MIR: Deleted primary data file. [2025-09-26T20:01:40.748703] [INFO ] [MAIN ] MIR: Starting full primary refresh. [2025-09-26T20:01:40.937014] [INFO ] [REMOTE ] MITP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:01:40.967618] [INFO ] [REMOTE ] MITP: Fetching primary data for 2024-12. [2025-09-26T20:01:41.064426] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-26T20:01:41.109266] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-01. [2025-09-26T20:01:41.284556] [INFO ] [REMOTE ] MITT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:01:41.299760] [INFO ] [REMOTE ] MITT: Fetching primary data for 2024-12. [2025-09-26T20:01:41.510012] [INFO ] [REMOTE ] MIR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:01:41.513556] [INFO ] [REMOTE ] MIR: Fetching primary data for 2024-12. [2025-09-26T20:01:41.513761] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-26T20:01:41.516096] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-02. [2025-09-26T20:01:41.554971] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-26T20:01:41.556211] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-01. [2025-09-26T20:01:41.970223] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-26T20:01:41.994506] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-26T20:01:42.311726] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-03. [2025-09-26T20:01:42.583949] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-26T20:01:42.841742] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-26T20:01:42.875330] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-26T20:01:43.111739] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-04. [2025-09-26T20:01:43.655254] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-26T20:01:43.911775] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-05. [2025-09-26T20:01:44.179859] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-09-26T20:01:44.711767] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-01. [2025-09-26T20:01:45.511744] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-01. [2025-09-26T20:01:46.270545] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-26T20:01:46.311685] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-02. [2025-09-26T20:01:46.337419] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-26T20:01:47.112131] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-06. [2025-09-26T20:01:47.459264] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-26T20:01:47.911691] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-07. [2025-09-26T20:01:48.011638] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-26T20:01:48.418522] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-26T20:01:48.711746] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-02. [2025-09-26T20:01:49.151558] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-26T20:01:49.511761] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-03. [2025-09-26T20:01:50.311716] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-03. [2025-09-26T20:01:50.751347] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-26T20:01:51.111721] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-04. [2025-09-26T20:01:51.239103] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-26T20:01:51.503840] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-26T20:01:51.911738] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-02. [2025-09-26T20:01:52.711721] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-08. [2025-09-26T20:01:52.989746] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-26T20:01:53.127608] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-26T20:01:53.511785] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-09-26T20:01:53.950769] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-26T20:01:53.951584] [INFO ] [REMOTE ] MITN: Full fetch complete (2309 records). [2025-09-26T20:01:53.951680] [DEBUG] [VALIDATOR ] MITN: Validating primary data. [2025-09-26T20:01:54.148602] [WARN ] [VALIDATOR ] MITN: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-26T20:01:54.148875] [FATAL] [MAIN ] MITN: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:01:54.148924] [WARN ] [MAIN ] MITN: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:01:54.148963] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-09-26T20:01:54.149050] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-09-26T20:01:54.149107] [INFO ] [LOCAL ] MITN: Starting deletion of derivative data. [2025-09-26T20:01:54.149151] [DEBUG] [LOCAL ] MITN: No derivative data file found to delete. [2025-09-26T20:01:54.149235] [INFO ] [MAIN ] Update Progress: 1361/2371 symbols completed. MITN took 15.9s. Estimated remaining: 2h 14m 57s. Rate: 7.5 symbols/min [2025-09-26T20:01:54.312344] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-05. [2025-09-26T20:01:54.334842] [INFO ] [MAIN ] MIY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:01:54.346415] [DEBUG] [LOCAL ] MIY: Loaded 6046 existing records from primary storage. [2025-09-26T20:01:54.346624] [INFO ] [MAIN ] MIY: Loaded 6046 existing records. [2025-09-26T20:01:54.536963] [WARN ] [MAIN ] MIY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:01:54.537275] [INFO ] [MAIN ] MIY: Wiping existing primary data before full refresh. [2025-09-26T20:01:54.537325] [INFO ] [LOCAL ] MIY: Starting deletion of primary data. [2025-09-26T20:01:54.537565] [DEBUG] [LOCAL ] MIY: Deleted primary data file. [2025-09-26T20:01:54.537623] [INFO ] [MAIN ] MIY: Starting full primary refresh. [2025-09-26T20:01:54.927570] [INFO ] [REMOTE ] MIY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:01:54.932069] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-26T20:01:55.111729] [INFO ] [REMOTE ] MIY: Fetching primary data for 2024-12. [2025-09-26T20:01:55.630955] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-26T20:01:55.911713] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-04. [2025-09-26T20:01:56.711731] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-06. [2025-09-26T20:01:57.137132] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-26T20:01:57.492739] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-26T20:01:57.511710] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-03. [2025-09-26T20:01:58.311696] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-05. [2025-09-26T20:01:58.687345] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-26T20:01:59.111749] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-04. [2025-09-26T20:01:59.849964] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-26T20:01:59.911717] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-06. [2025-09-26T20:02:00.566478] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-26T20:02:00.711743] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-05. [2025-09-26T20:02:01.511708] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-07. [2025-09-26T20:02:01.914164] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-26T20:02:01.960146] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-26T20:02:01.969230] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-26T20:02:02.311739] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-06. [2025-09-26T20:02:03.111728] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-07. [2025-09-26T20:02:03.585273] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-26T20:02:03.911716] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-07. [2025-09-26T20:02:04.711716] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-08. [2025-09-26T20:02:04.799080] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-26T20:02:05.042059] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-26T20:02:05.220544] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-26T20:02:05.511740] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-09. [2025-09-26T20:02:06.118935] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-26T20:02:06.120168] [INFO ] [REMOTE ] MITP: Full fetch complete (3356 records). [2025-09-26T20:02:06.120249] [DEBUG] [VALIDATOR ] MITP: Validating primary data. [2025-09-26T20:02:06.316997] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-08. [2025-09-26T20:02:06.500222] [DEBUG] [VALIDATOR ] MITP: All expected trading days are present. [2025-09-26T20:02:06.500312] [DEBUG] [VALIDATOR ] MITP: Primary data validation passed. [2025-09-26T20:02:06.500446] [INFO ] [MAIN ] MITP: Fetched primary data is valid. [2025-09-26T20:02:06.500495] [DEBUG] [LOCAL ] MITP: Saving primary data. [2025-09-26T20:02:06.500896] [DEBUG] [LOCAL ] MITP: Trimmed 3356 records to 2467 (keeping 200 days of data) [2025-09-26T20:02:06.516776] [DEBUG] [LOCAL ] MITP: Primary data saved (2467 records). [2025-09-26T20:02:06.516843] [INFO ] [MAIN ] MITP: Full history saved. [2025-09-26T20:02:06.517008] [INFO ] [MAIN ] Update Progress: 1362/2371 symbols completed. MITP took 28.3s. Estimated remaining: 2h 14m 52s. Rate: 7.5 symbols/min [2025-09-26T20:02:06.695267] [INFO ] [MAIN ] MKC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:02:06.753601] [DEBUG] [LOCAL ] MKC: Loaded 52820 existing records from primary storage. [2025-09-26T20:02:06.753805] [INFO ] [MAIN ] MKC: Loaded 52820 existing records. [2025-09-26T20:02:06.935265] [WARN ] [MAIN ] MKC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:02:06.935513] [INFO ] [MAIN ] MKC: Wiping existing primary data before full refresh. [2025-09-26T20:02:06.935560] [INFO ] [LOCAL ] MKC: Starting deletion of primary data. [2025-09-26T20:02:06.936359] [DEBUG] [LOCAL ] MKC: Deleted primary data file. [2025-09-26T20:02:06.936419] [INFO ] [MAIN ] MKC: Starting full primary refresh. [2025-09-26T20:02:07.117026] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-01. [2025-09-26T20:02:07.373283] [INFO ] [REMOTE ] MKC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:02:07.583758] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-26T20:02:07.911731] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-09. [2025-09-26T20:02:08.038248] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-26T20:02:08.711743] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-02. [2025-09-26T20:02:09.038615] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-26T20:02:09.043867] [INFO ] [REMOTE ] MITT: Full fetch complete (34986 records). [2025-09-26T20:02:09.043981] [DEBUG] [VALIDATOR ] MITT: Validating primary data. [2025-09-26T20:02:09.386580] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-26T20:02:09.467362] [DEBUG] [VALIDATOR ] MITT: All expected trading days are present. [2025-09-26T20:02:09.467470] [DEBUG] [VALIDATOR ] MITT: Primary data validation passed. [2025-09-26T20:02:09.468217] [INFO ] [MAIN ] MITT: Fetched primary data is valid. [2025-09-26T20:02:09.468294] [DEBUG] [LOCAL ] MITT: Saving primary data. [2025-09-26T20:02:09.469403] [DEBUG] [LOCAL ] MITT: Trimmed 34986 records to 23379 (keeping 200 days of data) [2025-09-26T20:02:09.517372] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-03. [2025-09-26T20:02:09.613152] [DEBUG] [LOCAL ] MITT: Primary data saved (23379 records). [2025-09-26T20:02:09.613313] [INFO ] [MAIN ] MITT: Full history saved. [2025-09-26T20:02:09.613423] [INFO ] [MAIN ] Update Progress: 1363/2371 symbols completed. MITT took 31.4s. Estimated remaining: 2h 14m 41s. Rate: 7.5 symbols/min [2025-09-26T20:02:09.796536] [INFO ] [MAIN ] MKL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:02:09.835333] [DEBUG] [LOCAL ] MKL: Loaded 34303 existing records from primary storage. [2025-09-26T20:02:09.835503] [INFO ] [MAIN ] MKL: Loaded 34303 existing records. [2025-09-26T20:02:10.034493] [WARN ] [MAIN ] MKL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:02:10.035133] [INFO ] [MAIN ] MKL: Wiping existing primary data before full refresh. [2025-09-26T20:02:10.035206] [INFO ] [LOCAL ] MKL: Starting deletion of primary data. [2025-09-26T20:02:10.035636] [DEBUG] [LOCAL ] MKL: Deleted primary data file. [2025-09-26T20:02:10.035740] [INFO ] [MAIN ] MKL: Starting full primary refresh. [2025-09-26T20:02:10.161233] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-26T20:02:10.316990] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-08. [2025-09-26T20:02:10.468084] [INFO ] [REMOTE ] MKL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:02:11.111751] [INFO ] [REMOTE ] MKL: Fetching primary data for 2024-12. [2025-09-26T20:02:11.911744] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-04. [2025-09-26T20:02:12.287090] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-26T20:02:12.414266] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-26T20:02:12.672009] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-26T20:02:12.711692] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-05. [2025-09-26T20:02:13.377039] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-26T20:02:13.511723] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-09. [2025-09-26T20:02:14.311750] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-06. [2025-09-26T20:02:15.062751] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-26T20:02:15.111730] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-01. [2025-09-26T20:02:15.319054] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-26T20:02:15.329872] [INFO ] [REMOTE ] MIR: Full fetch complete (73417 records). [2025-09-26T20:02:15.330054] [DEBUG] [VALIDATOR ] MIR: Validating primary data. [2025-09-26T20:02:15.738059] [DEBUG] [VALIDATOR ] MIR: All expected trading days are present. [2025-09-26T20:02:15.738167] [DEBUG] [VALIDATOR ] MIR: Primary data validation passed. [2025-09-26T20:02:15.739158] [INFO ] [MAIN ] MIR: Fetched primary data is valid. [2025-09-26T20:02:15.739242] [DEBUG] [LOCAL ] MIR: Saving primary data. [2025-09-26T20:02:15.740826] [DEBUG] [LOCAL ] MIR: Trimmed 73417 records to 51622 (keeping 200 days of data) [2025-09-26T20:02:15.914258] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-07. [2025-09-26T20:02:16.057193] [DEBUG] [LOCAL ] MIR: Primary data saved (51622 records). [2025-09-26T20:02:16.057360] [INFO ] [MAIN ] MIR: Full history saved. [2025-09-26T20:02:16.057460] [INFO ] [MAIN ] Update Progress: 1364/2371 symbols completed. MIR took 37.8s. Estimated remaining: 2h 14m 31s. Rate: 7.5 symbols/min [2025-09-26T20:02:16.261934] [INFO ] [MAIN ] MLI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:02:16.309051] [DEBUG] [LOCAL ] MLI: Loaded 44135 existing records from primary storage. [2025-09-26T20:02:16.309218] [INFO ] [MAIN ] MLI: Loaded 44135 existing records. [2025-09-26T20:02:16.549891] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-26T20:02:16.548413] [WARN ] [MAIN ] MLI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:02:16.553906] [INFO ] [MAIN ] MLI: Wiping existing primary data before full refresh. [2025-09-26T20:02:16.554003] [INFO ] [LOCAL ] MLI: Starting deletion of primary data. [2025-09-26T20:02:16.555172] [DEBUG] [LOCAL ] MLI: Deleted primary data file. [2025-09-26T20:02:16.555260] [INFO ] [MAIN ] MLI: Starting full primary refresh. [2025-09-26T20:02:16.679908] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T20:02:16.713170] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-08. [2025-09-26T20:02:16.994835] [INFO ] [REMOTE ] MLI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:02:17.389389] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-26T20:02:17.511751] [INFO ] [REMOTE ] MKC: Fetching primary data for 2024-12. [2025-09-26T20:02:18.311737] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-02. [2025-09-26T20:02:19.111711] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-09. [2025-09-26T20:02:19.285113] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-26T20:02:19.410385] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-26T20:02:19.638587] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-26T20:02:19.640774] [INFO ] [REMOTE ] MIY: Full fetch complete (9039 records). [2025-09-26T20:02:19.640919] [DEBUG] [VALIDATOR ] MIY: Validating primary data. [2025-09-26T20:02:19.916917] [INFO ] [REMOTE ] MLI: Fetching primary data for 2024-12. [2025-09-26T20:02:20.047084] [DEBUG] [VALIDATOR ] MIY: All expected trading days are present. [2025-09-26T20:02:20.047179] [DEBUG] [VALIDATOR ] MIY: Primary data validation passed. [2025-09-26T20:02:20.047483] [INFO ] [MAIN ] MIY: Fetched primary data is valid. [2025-09-26T20:02:20.047582] [DEBUG] [LOCAL ] MIY: Saving primary data. [2025-09-26T20:02:20.048192] [DEBUG] [LOCAL ] MIY: Trimmed 9039 records to 6084 (keeping 200 days of data) [2025-09-26T20:02:20.088048] [DEBUG] [LOCAL ] MIY: Primary data saved (6084 records). [2025-09-26T20:02:20.088213] [INFO ] [MAIN ] MIY: Full history saved. [2025-09-26T20:02:20.088309] [INFO ] [MAIN ] Update Progress: 1365/2371 symbols completed. MIY took 25.9s. Estimated remaining: 2h 14m 21s. Rate: 7.5 symbols/min [2025-09-26T20:02:20.262459] [INFO ] [MAIN ] MLM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:02:20.314661] [DEBUG] [LOCAL ] MLM: Loaded 30863 existing records from primary storage. [2025-09-26T20:02:20.314811] [INFO ] [MAIN ] MLM: Loaded 30863 existing records. [2025-09-26T20:02:20.507753] [WARN ] [MAIN ] MLM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:02:20.508036] [INFO ] [MAIN ] MLM: Wiping existing primary data before full refresh. [2025-09-26T20:02:20.508085] [INFO ] [LOCAL ] MLM: Starting deletion of primary data. [2025-09-26T20:02:20.508414] [DEBUG] [LOCAL ] MLM: Deleted primary data file. [2025-09-26T20:02:20.508473] [INFO ] [MAIN ] MLM: Starting full primary refresh. [2025-09-26T20:02:20.722132] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-01. [2025-09-26T20:02:20.937908] [INFO ] [REMOTE ] MLM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:02:21.511783] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-03. [2025-09-26T20:02:21.775484] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-26T20:02:22.311742] [INFO ] [REMOTE ] MLM: Fetching primary data for 2024-12. [2025-09-26T20:02:22.741154] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-26T20:02:22.839726] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-26T20:02:23.111746] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-04. [2025-09-26T20:02:23.783742] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-26T20:02:23.911782] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-01. [2025-09-26T20:02:24.442619] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-26T20:02:24.711755] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-01. [2025-09-26T20:02:25.065386] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-26T20:02:25.511736] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-05. [2025-09-26T20:02:26.192292] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-26T20:02:26.311738] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-02. [2025-09-26T20:02:27.018545] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-26T20:02:27.111742] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-02. [2025-09-26T20:02:27.689401] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-26T20:02:27.911781] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-06. [2025-09-26T20:02:28.479444] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-26T20:02:28.711769] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-03. [2025-09-26T20:02:29.430302] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-26T20:02:29.511699] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-07. [2025-09-26T20:02:30.311693] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-02. [2025-09-26T20:02:30.356758] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-26T20:02:30.944042] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-26T20:02:31.111734] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-03. [2025-09-26T20:02:31.528918] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-26T20:02:31.911728] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-04. [2025-09-26T20:02:32.658203] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T20:02:32.711748] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-04. [2025-09-26T20:02:33.511725] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-08. [2025-09-26T20:02:33.708829] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-26T20:02:34.228443] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T20:02:34.311744] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-05. [2025-09-26T20:02:35.014766] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-26T20:02:35.111760] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-05. [2025-09-26T20:02:35.598637] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-26T20:02:35.911737] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-03. [2025-09-26T20:02:36.579590] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T20:02:36.711719] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-09. [2025-09-26T20:02:37.511700] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-06. [2025-09-26T20:02:37.871601] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-26T20:02:38.237306] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-26T20:02:38.248018] [INFO ] [REMOTE ] MKL: Full fetch complete (49609 records). [2025-09-26T20:02:38.248340] [DEBUG] [VALIDATOR ] MKL: Validating primary data. [2025-09-26T20:02:38.314041] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-04. [2025-09-26T20:02:38.690888] [DEBUG] [VALIDATOR ] MKL: All expected trading days are present. [2025-09-26T20:02:38.691018] [DEBUG] [VALIDATOR ] MKL: Primary data validation passed. [2025-09-26T20:02:38.691943] [INFO ] [MAIN ] MKL: Fetched primary data is valid. [2025-09-26T20:02:38.692067] [DEBUG] [LOCAL ] MKL: Saving primary data. [2025-09-26T20:02:38.696584] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-26T20:02:38.702634] [DEBUG] [LOCAL ] MKL: Trimmed 49609 records to 34588 (keeping 200 days of data) [2025-09-26T20:02:38.950683] [DEBUG] [LOCAL ] MKL: Primary data saved (34588 records). [2025-09-26T20:02:38.950867] [INFO ] [MAIN ] MKL: Full history saved. [2025-09-26T20:02:38.951229] [INFO ] [MAIN ] Update Progress: 1366/2371 symbols completed. MKL took 29.3s. Estimated remaining: 2h 14m 21s. Rate: 7.5 symbols/min [2025-09-26T20:02:39.113489] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-06. [2025-09-26T20:02:39.139117] [INFO ] [MAIN ] MLNK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:02:39.172165] [DEBUG] [LOCAL ] MLNK: Loaded 25735 existing records from primary storage. [2025-09-26T20:02:39.172316] [INFO ] [MAIN ] MLNK: Loaded 25735 existing records. [2025-09-26T20:02:39.355846] [WARN ] [MAIN ] MLNK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:02:39.356101] [INFO ] [MAIN ] MLNK: Wiping existing primary data before full refresh. [2025-09-26T20:02:39.356149] [INFO ] [LOCAL ] MLNK: Starting deletion of primary data. [2025-09-26T20:02:39.357003] [DEBUG] [LOCAL ] MLNK: Deleted primary data file. [2025-09-26T20:02:39.357077] [INFO ] [MAIN ] MLNK: Starting full primary refresh. [2025-09-26T20:02:39.740857] [INFO ] [REMOTE ] MLNK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:02:39.911730] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2024-12. [2025-09-26T20:02:40.297754] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-26T20:02:40.711839] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-05. [2025-09-26T20:02:40.823353] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-26T20:02:40.996010] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-26T20:02:41.511717] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-07. [2025-09-26T20:02:42.311731] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-01. [2025-09-26T20:02:42.414547] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-26T20:02:42.865787] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-26T20:02:43.111738] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-07. [2025-09-26T20:02:43.415760] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-26T20:02:43.911724] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-02. [2025-09-26T20:02:44.711725] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-06. [2025-09-26T20:02:44.800003] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-26T20:02:44.940231] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-26T20:02:45.511765] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-08. [2025-09-26T20:02:46.311721] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-08. [2025-09-26T20:02:46.730816] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-26T20:02:47.013057] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-26T20:02:47.111715] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-03. [2025-09-26T20:02:47.621065] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-26T20:02:47.911723] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-09. [2025-09-26T20:02:48.211978] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-26T20:02:48.711746] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-09. [2025-09-26T20:02:49.312952] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-26T20:02:49.322213] [INFO ] [REMOTE ] MLI: Full fetch complete (63554 records). [2025-09-26T20:02:49.322578] [DEBUG] [VALIDATOR ] MLI: Validating primary data. [2025-09-26T20:02:49.529730] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-04. [2025-09-26T20:02:49.781294] [DEBUG] [VALIDATOR ] MLI: All expected trading days are present. [2025-09-26T20:02:49.781748] [DEBUG] [VALIDATOR ] MLI: Primary data validation passed. [2025-09-26T20:02:49.782719] [INFO ] [MAIN ] MLI: Fetched primary data is valid. [2025-09-26T20:02:49.782921] [DEBUG] [LOCAL ] MLI: Saving primary data. [2025-09-26T20:02:49.784716] [DEBUG] [LOCAL ] MLI: Trimmed 63554 records to 44447 (keeping 200 days of data) [2025-09-26T20:02:49.911919] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-26T20:02:49.920082] [INFO ] [REMOTE ] MLM: Full fetch complete (45699 records). [2025-09-26T20:02:49.920710] [DEBUG] [VALIDATOR ] MLM: Validating primary data. [2025-09-26T20:02:50.316684] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-07. [2025-09-26T20:02:50.447568] [DEBUG] [VALIDATOR ] MLM: All expected trading days are present. [2025-09-26T20:02:50.448221] [DEBUG] [VALIDATOR ] MLM: Primary data validation passed. [2025-09-26T20:02:50.449141] [INFO ] [MAIN ] MLM: Fetched primary data is valid. [2025-09-26T20:02:50.449766] [DEBUG] [LOCAL ] MLM: Saving primary data. [2025-09-26T20:02:50.455613] [DEBUG] [LOCAL ] MLM: Trimmed 45699 records to 31068 (keeping 200 days of data) [2025-09-26T20:02:50.701747] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-26T20:02:50.855772] [DEBUG] [LOCAL ] MLI: Primary data saved (44447 records). [2025-09-26T20:02:50.856787] [INFO ] [MAIN ] MLI: Full history saved. [2025-09-26T20:02:50.857605] [INFO ] [MAIN ] Update Progress: 1367/2371 symbols completed. MLI took 34.8s. Estimated remaining: 2h 14m 15s. Rate: 7.5 symbols/min [2025-09-26T20:02:51.055432] [INFO ] [MAIN ] MLP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:02:51.063810] [DEBUG] [LOCAL ] MLP: Loaded 3117 existing records from primary storage. [2025-09-26T20:02:51.064169] [INFO ] [MAIN ] MLP: Loaded 3117 existing records. [2025-09-26T20:02:51.100278] [DEBUG] [LOCAL ] MLM: Primary data saved (31068 records). [2025-09-26T20:02:51.112765] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-05. [2025-09-26T20:02:51.134392] [INFO ] [MAIN ] MLM: Full history saved. [2025-09-26T20:02:51.184617] [INFO ] [MAIN ] Update Progress: 1368/2371 symbols completed. MLM took 31.1s. Estimated remaining: 2h 14m 2s. Rate: 7.5 symbols/min [2025-09-26T20:02:51.423147] [WARN ] [MAIN ] MLP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:02:51.488708] [INFO ] [MAIN ] MLP: Wiping existing primary data before full refresh. [2025-09-26T20:02:51.488539] [INFO ] [MAIN ] MLR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:02:51.488889] [INFO ] [LOCAL ] MLP: Starting deletion of primary data. [2025-09-26T20:02:51.489491] [DEBUG] [LOCAL ] MLP: Deleted primary data file. [2025-09-26T20:02:51.489591] [INFO ] [MAIN ] MLP: Starting full primary refresh. [2025-09-26T20:02:51.638072] [DEBUG] [LOCAL ] MLR: Loaded 12887 existing records from primary storage. [2025-09-26T20:02:51.669116] [INFO ] [MAIN ] MLR: Loaded 12887 existing records. [2025-09-26T20:02:52.048392] [WARN ] [MAIN ] MLR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:02:52.126717] [INFO ] [REMOTE ] MLP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:02:52.127480] [INFO ] [MAIN ] MLR: Wiping existing primary data before full refresh. [2025-09-26T20:02:52.127705] [INFO ] [LOCAL ] MLR: Starting deletion of primary data. [2025-09-26T20:02:52.127421] [INFO ] [REMOTE ] MLP: Fetching primary data for 2024-12. [2025-09-26T20:02:52.128017] [DEBUG] [LOCAL ] MLR: Deleted primary data file. [2025-09-26T20:02:52.128937] [INFO ] [MAIN ] MLR: Starting full primary refresh. [2025-09-26T20:02:52.447852] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-26T20:02:52.625218] [INFO ] [REMOTE ] MLR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:02:52.627843] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-26T20:02:52.711687] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-08. [2025-09-26T20:02:52.725573] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-26T20:02:53.511715] [INFO ] [REMOTE ] MLR: Fetching primary data for 2024-12. [2025-09-26T20:02:54.311711] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-01. [2025-09-26T20:02:54.349154] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-26T20:02:54.396446] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-26T20:02:54.682502] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-26T20:02:55.111721] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-01. [2025-09-26T20:02:55.716124] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-26T20:02:55.911726] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-02. [2025-09-26T20:02:56.304889] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-26T20:02:56.711724] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-02. [2025-09-26T20:02:57.473950] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-26T20:02:57.511729] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-03. [2025-09-26T20:02:58.311737] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-09. [2025-09-26T20:02:58.637445] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-26T20:02:59.111744] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-03. [2025-09-26T20:02:59.727383] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-26T20:02:59.911737] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-04. [2025-09-26T20:03:00.209602] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-26T20:03:00.219941] [INFO ] [REMOTE ] MKC: Full fetch complete (75532 records). [2025-09-26T20:03:00.220088] [DEBUG] [VALIDATOR ] MKC: Validating primary data. [2025-09-26T20:03:00.552783] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-26T20:03:00.638388] [DEBUG] [VALIDATOR ] MKC: All expected trading days are present. [2025-09-26T20:03:00.638477] [DEBUG] [VALIDATOR ] MKC: Primary data validation passed. [2025-09-26T20:03:00.639552] [INFO ] [MAIN ] MKC: Fetched primary data is valid. [2025-09-26T20:03:00.639621] [DEBUG] [LOCAL ] MKC: Saving primary data. [2025-09-26T20:03:00.644161] [DEBUG] [LOCAL ] MKC: Trimmed 75532 records to 53204 (keeping 200 days of data) [2025-09-26T20:03:00.716220] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-04. [2025-09-26T20:03:01.006497] [DEBUG] [LOCAL ] MKC: Primary data saved (53204 records). [2025-09-26T20:03:01.006692] [INFO ] [MAIN ] MKC: Full history saved. [2025-09-26T20:03:01.006798] [INFO ] [MAIN ] Update Progress: 1369/2371 symbols completed. MKC took 54.5s. Estimated remaining: 2h 13m 55s. Rate: 7.5 symbols/min [2025-09-26T20:03:01.195920] [INFO ] [MAIN ] MMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:03:01.261167] [DEBUG] [LOCAL ] MMC: Loaded 52193 existing records from primary storage. [2025-09-26T20:03:01.261365] [INFO ] [MAIN ] MMC: Loaded 52193 existing records. [2025-09-26T20:03:01.464662] [WARN ] [MAIN ] MMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:03:01.465055] [INFO ] [MAIN ] MMC: Wiping existing primary data before full refresh. [2025-09-26T20:03:01.465126] [INFO ] [LOCAL ] MMC: Starting deletion of primary data. [2025-09-26T20:03:01.465495] [DEBUG] [LOCAL ] MMC: Deleted primary data file. [2025-09-26T20:03:01.465570] [INFO ] [MAIN ] MMC: Starting full primary refresh. [2025-09-26T20:03:01.516822] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-06. [2025-09-26T20:03:01.841904] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-26T20:03:01.932519] [INFO ] [REMOTE ] MMC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:03:02.311719] [INFO ] [REMOTE ] MMC: Fetching primary data for 2024-12. [2025-09-26T20:03:02.467486] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-26T20:03:03.111763] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-07. [2025-09-26T20:03:03.911760] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-05. [2025-09-26T20:03:03.984547] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-26T20:03:04.317349] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-26T20:03:04.504153] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-26T20:03:04.711750] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-05. [2025-09-26T20:03:05.511696] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-08. [2025-09-26T20:03:05.561339] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-26T20:03:06.311690] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-06. [2025-09-26T20:03:06.779194] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-26T20:03:07.000406] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-26T20:03:07.111717] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-06. [2025-09-26T20:03:07.704530] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-26T20:03:07.911723] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-01. [2025-09-26T20:03:08.711735] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-09. [2025-09-26T20:03:09.511705] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-07. [2025-09-26T20:03:09.733983] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-26T20:03:10.044516] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-26T20:03:10.052789] [INFO ] [REMOTE ] MLNK: Full fetch complete (35860 records). [2025-09-26T20:03:10.052990] [DEBUG] [VALIDATOR ] MLNK: Validating primary data. [2025-09-26T20:03:10.185224] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-26T20:03:10.320435] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-08. [2025-09-26T20:03:10.518193] [DEBUG] [VALIDATOR ] MLNK: All expected trading days are present. [2025-09-26T20:03:10.518297] [DEBUG] [VALIDATOR ] MLNK: Primary data validation passed. [2025-09-26T20:03:10.519070] [INFO ] [MAIN ] MLNK: Fetched primary data is valid. [2025-09-26T20:03:10.519138] [DEBUG] [LOCAL ] MLNK: Saving primary data. [2025-09-26T20:03:10.521146] [DEBUG] [LOCAL ] MLNK: Trimmed 35860 records to 25921 (keeping 200 days of data) [2025-09-26T20:03:10.685129] [DEBUG] [LOCAL ] MLNK: Primary data saved (25921 records). [2025-09-26T20:03:10.685275] [INFO ] [MAIN ] MLNK: Full history saved. [2025-09-26T20:03:10.685371] [INFO ] [MAIN ] Update Progress: 1370/2371 symbols completed. MLNK took 31.7s. Estimated remaining: 2h 13m 48s. Rate: 7.5 symbols/min [2025-09-26T20:03:10.867269] [INFO ] [MAIN ] MMD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:03:10.880874] [DEBUG] [LOCAL ] MMD: Loaded 11356 existing records from primary storage. [2025-09-26T20:03:10.880981] [INFO ] [MAIN ] MMD: Loaded 11356 existing records. [2025-09-26T20:03:11.070697] [WARN ] [MAIN ] MMD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:03:11.070941] [INFO ] [MAIN ] MMD: Wiping existing primary data before full refresh. [2025-09-26T20:03:11.070990] [INFO ] [LOCAL ] MMD: Starting deletion of primary data. [2025-09-26T20:03:11.071240] [DEBUG] [LOCAL ] MMD: Deleted primary data file. [2025-09-26T20:03:11.071300] [INFO ] [MAIN ] MMD: Starting full primary refresh. [2025-09-26T20:03:11.114739] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-02. [2025-09-26T20:03:11.456182] [INFO ] [REMOTE ] MMD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:03:11.457083] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-26T20:03:11.911756] [INFO ] [REMOTE ] MMD: Fetching primary data for 2024-12. [2025-09-26T20:03:12.711716] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-07. [2025-09-26T20:03:12.878966] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-26T20:03:13.059103] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-26T20:03:13.205732] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-26T20:03:13.511721] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-09. [2025-09-26T20:03:14.311747] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-03. [2025-09-26T20:03:14.683178] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-26T20:03:14.686704] [INFO ] [REMOTE ] MLR: Full fetch complete (18641 records). [2025-09-26T20:03:14.686782] [DEBUG] [VALIDATOR ] MLR: Validating primary data. [2025-09-26T20:03:15.073672] [DEBUG] [VALIDATOR ] MLR: All expected trading days are present. [2025-09-26T20:03:15.073786] [DEBUG] [VALIDATOR ] MLR: Primary data validation passed. [2025-09-26T20:03:15.074257] [INFO ] [MAIN ] MLR: Fetched primary data is valid. [2025-09-26T20:03:15.074302] [DEBUG] [LOCAL ] MLR: Saving primary data. [2025-09-26T20:03:15.074931] [DEBUG] [LOCAL ] MLR: Trimmed 18641 records to 12982 (keeping 200 days of data) [2025-09-26T20:03:15.119912] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-01. [2025-09-26T20:03:15.171446] [DEBUG] [LOCAL ] MLR: Primary data saved (12982 records). [2025-09-26T20:03:15.171605] [INFO ] [MAIN ] MLR: Full history saved. [2025-09-26T20:03:15.171723] [INFO ] [MAIN ] Update Progress: 1371/2371 symbols completed. MLR took 24.0s. Estimated remaining: 2h 13m 38s. Rate: 7.5 symbols/min [2025-09-26T20:03:15.355367] [INFO ] [MAIN ] MMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:03:15.373186] [DEBUG] [LOCAL ] MMI: Loaded 15372 existing records from primary storage. [2025-09-26T20:03:15.373324] [INFO ] [MAIN ] MMI: Loaded 15372 existing records. [2025-09-26T20:03:15.566049] [WARN ] [MAIN ] MMI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:03:15.566386] [INFO ] [MAIN ] MMI: Wiping existing primary data before full refresh. [2025-09-26T20:03:15.566439] [INFO ] [LOCAL ] MMI: Starting deletion of primary data. [2025-09-26T20:03:15.567039] [DEBUG] [LOCAL ] MMI: Deleted primary data file. [2025-09-26T20:03:15.567104] [INFO ] [MAIN ] MMI: Starting full primary refresh. [2025-09-26T20:03:15.916904] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-08. [2025-09-26T20:03:15.963949] [INFO ] [REMOTE ] MMI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:03:16.086958] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-26T20:03:16.429790] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-26T20:03:16.515843] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-26T20:03:16.711721] [INFO ] [REMOTE ] MMI: Fetching primary data for 2024-12. [2025-09-26T20:03:17.502903] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-26T20:03:17.511726] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-01. [2025-09-26T20:03:18.060239] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-26T20:03:18.311726] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-02. [2025-09-26T20:03:19.111717] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-04. [2025-09-26T20:03:19.363130] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-26T20:03:19.911747] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-09. [2025-09-26T20:03:20.597451] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-26T20:03:20.601051] [INFO ] [REMOTE ] MLP: Full fetch complete (4598 records). [2025-09-26T20:03:20.601241] [DEBUG] [VALIDATOR ] MLP: Validating primary data. [2025-09-26T20:03:20.715127] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-02. [2025-09-26T20:03:21.080135] [DEBUG] [VALIDATOR ] MLP: All expected trading days are present. [2025-09-26T20:03:21.080262] [DEBUG] [VALIDATOR ] MLP: Primary data validation passed. [2025-09-26T20:03:21.080682] [INFO ] [MAIN ] MLP: Fetched primary data is valid. [2025-09-26T20:03:21.080916] [DEBUG] [LOCAL ] MLP: Saving primary data. [2025-09-26T20:03:21.081854] [DEBUG] [LOCAL ] MLP: Trimmed 4598 records to 3120 (keeping 200 days of data) [2025-09-26T20:03:21.103066] [DEBUG] [LOCAL ] MLP: Primary data saved (3120 records). [2025-09-26T20:03:21.103297] [INFO ] [MAIN ] MLP: Full history saved. [2025-09-26T20:03:21.103532] [INFO ] [MAIN ] Update Progress: 1372/2371 symbols completed. MLP took 30.2s. Estimated remaining: 2h 13m 28s. Rate: 7.5 symbols/min [2025-09-26T20:03:21.264907] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-26T20:03:21.338926] [INFO ] [MAIN ] MMID: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:03:21.340003] [DEBUG] [LOCAL ] MMID: No existing data file found in primary storage. [2025-09-26T20:03:21.340327] [WARN ] [MAIN ] MMID: No existing data found, performing full refresh instead. [2025-09-26T20:03:21.340683] [INFO ] [MAIN ] MMID: Wiping existing primary data before full refresh. [2025-09-26T20:03:21.340795] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-09-26T20:03:21.340874] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-09-26T20:03:21.340924] [INFO ] [MAIN ] MMID: Starting full primary refresh. [2025-09-26T20:03:21.520185] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-26T20:03:21.519679] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-03. [2025-09-26T20:03:21.769618] [INFO ] [REMOTE ] MMID: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:03:22.311713] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-05. [2025-09-26T20:03:22.388104] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-26T20:03:23.111731] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-04. [2025-09-26T20:03:23.911712] [INFO ] [REMOTE ] MMID: Fetching primary data for 2024-12. [2025-09-26T20:03:24.218163] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:03:24.218557] [WARN ] [REMOTE ] MMID: No data returned for month 2024-12 [2025-09-26T20:03:24.233377] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-26T20:03:24.270411] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-26T20:03:24.711726] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-03. [2025-09-26T20:03:25.482729] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-26T20:03:25.511697] [INFO ] [REMOTE ] MMID: Fetching primary data for 2025-01. [2025-09-26T20:03:25.722380] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:03:25.722763] [WARN ] [REMOTE ] MMID: No data returned for month 2025-01 [2025-09-26T20:03:26.311741] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-06. [2025-09-26T20:03:27.111714] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-05. [2025-09-26T20:03:27.870211] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-26T20:03:27.911729] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-04. [2025-09-26T20:03:28.044341] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-26T20:03:28.711689] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-07. [2025-09-26T20:03:28.795459] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-26T20:03:29.511717] [INFO ] [REMOTE ] MMID: Fetching primary data for 2025-02. [2025-09-26T20:03:29.707596] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:03:29.708060] [WARN ] [REMOTE ] MMID: No data returned for month 2025-02 [2025-09-26T20:03:30.311737] [INFO ] [REMOTE ] MMID: Fetching primary data for 2025-03. [2025-09-26T20:03:30.512276] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:03:30.512615] [WARN ] [REMOTE ] MMID: No data returned for month 2025-03 [2025-09-26T20:03:30.688176] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-26T20:03:31.111762] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-06. [2025-09-26T20:03:31.911714] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-08. [2025-09-26T20:03:32.148813] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-26T20:03:32.711771] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-07. [2025-09-26T20:03:33.511709] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-05. [2025-09-26T20:03:33.635090] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-26T20:03:33.678920] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-26T20:03:34.216166] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-26T20:03:34.311724] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-06. [2025-09-26T20:03:34.829627] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-26T20:03:35.111721] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-09. [2025-09-26T20:03:35.911711] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-07. [2025-09-26T20:03:36.711702] [INFO ] [REMOTE ] MMID: Fetching primary data for 2025-04. [2025-09-26T20:03:36.749361] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-26T20:03:36.835399] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T20:03:36.845512] [INFO ] [REMOTE ] MMC: Full fetch complete (74728 records). [2025-09-26T20:03:36.845694] [DEBUG] [VALIDATOR ] MMC: Validating primary data. [2025-09-26T20:03:36.929613] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:03:36.957972] [WARN ] [REMOTE ] MMID: No data returned for month 2025-04 [2025-09-26T20:03:37.276343] [DEBUG] [VALIDATOR ] MMC: All expected trading days are present. [2025-09-26T20:03:37.276439] [DEBUG] [VALIDATOR ] MMC: Primary data validation passed. [2025-09-26T20:03:37.277528] [INFO ] [MAIN ] MMC: Fetched primary data is valid. [2025-09-26T20:03:37.277603] [DEBUG] [LOCAL ] MMC: Saving primary data. [2025-09-26T20:03:37.279262] [DEBUG] [LOCAL ] MMC: Trimmed 74728 records to 52551 (keeping 200 days of data) [2025-09-26T20:03:37.511789] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-08. [2025-09-26T20:03:37.640222] [DEBUG] [LOCAL ] MMC: Primary data saved (52551 records). [2025-09-26T20:03:37.640384] [INFO ] [MAIN ] MMC: Full history saved. [2025-09-26T20:03:37.640490] [INFO ] [MAIN ] Update Progress: 1373/2371 symbols completed. MMC took 36.6s. Estimated remaining: 2h 13m 26s. Rate: 7.5 symbols/min [2025-09-26T20:03:37.843143] [INFO ] [MAIN ] MMKT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:03:37.843419] [DEBUG] [LOCAL ] MMKT: No existing data file found in primary storage. [2025-09-26T20:03:37.843472] [WARN ] [MAIN ] MMKT: No existing data found, performing full refresh instead. [2025-09-26T20:03:37.843624] [INFO ] [MAIN ] MMKT: Wiping existing primary data before full refresh. [2025-09-26T20:03:37.843702] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-09-26T20:03:37.843758] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-09-26T20:03:37.843794] [INFO ] [MAIN ] MMKT: Starting full primary refresh. [2025-09-26T20:03:38.314594] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-08. [2025-09-26T20:03:38.358699] [INFO ] [REMOTE ] MMKT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:03:38.443571] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-26T20:03:39.111710] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-09. [2025-09-26T20:03:39.321065] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-26T20:03:39.911733] [INFO ] [REMOTE ] MMID: Fetching primary data for 2025-05. [2025-09-26T20:03:40.100686] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-26T20:03:40.103680] [INFO ] [REMOTE ] MMI: Full fetch complete (21021 records). [2025-09-26T20:03:40.103792] [DEBUG] [VALIDATOR ] MMI: Validating primary data. [2025-09-26T20:03:40.137179] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:03:40.177271] [WARN ] [REMOTE ] MMID: No data returned for month 2025-05 [2025-09-26T20:03:40.483795] [DEBUG] [VALIDATOR ] MMI: All expected trading days are present. [2025-09-26T20:03:40.483876] [DEBUG] [VALIDATOR ] MMI: Primary data validation passed. [2025-09-26T20:03:40.484372] [INFO ] [MAIN ] MMI: Fetched primary data is valid. [2025-09-26T20:03:40.484413] [DEBUG] [LOCAL ] MMI: Saving primary data. [2025-09-26T20:03:40.485047] [DEBUG] [LOCAL ] MMI: Trimmed 21021 records to 15452 (keeping 200 days of data) [2025-09-26T20:03:40.588589] [DEBUG] [LOCAL ] MMI: Primary data saved (15452 records). [2025-09-26T20:03:40.588783] [INFO ] [MAIN ] MMI: Full history saved. [2025-09-26T20:03:40.588883] [INFO ] [MAIN ] Update Progress: 1374/2371 symbols completed. MMI took 25.4s. Estimated remaining: 2h 13m 15s. Rate: 7.5 symbols/min [2025-09-26T20:03:40.716814] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-09. [2025-09-26T20:03:40.799694] [INFO ] [MAIN ] MMM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:03:40.877617] [DEBUG] [LOCAL ] MMM: Loaded 53617 existing records from primary storage. [2025-09-26T20:03:40.877812] [INFO ] [MAIN ] MMM: Loaded 53617 existing records. [2025-09-26T20:03:41.061422] [WARN ] [MAIN ] MMM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:03:41.061741] [INFO ] [MAIN ] MMM: Wiping existing primary data before full refresh. [2025-09-26T20:03:41.061798] [INFO ] [LOCAL ] MMM: Starting deletion of primary data. [2025-09-26T20:03:41.062377] [DEBUG] [LOCAL ] MMM: Deleted primary data file. [2025-09-26T20:03:41.062437] [INFO ] [MAIN ] MMM: Starting full primary refresh. [2025-09-26T20:03:41.440395] [INFO ] [REMOTE ] MMM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:03:41.511761] [INFO ] [REMOTE ] MMID: Fetching primary data for 2025-06. [2025-09-26T20:03:41.648535] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-26T20:03:41.651526] [INFO ] [REMOTE ] MMD: Full fetch complete (18105 records). [2025-09-26T20:03:41.651639] [DEBUG] [VALIDATOR ] MMD: Validating primary data. [2025-09-26T20:03:41.725050] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:03:41.746725] [WARN ] [REMOTE ] MMID: No data returned for month 2025-06 [2025-09-26T20:03:42.060330] [DEBUG] [VALIDATOR ] MMD: All expected trading days are present. [2025-09-26T20:03:42.060418] [DEBUG] [VALIDATOR ] MMD: Primary data validation passed. [2025-09-26T20:03:42.060878] [INFO ] [MAIN ] MMD: Fetched primary data is valid. [2025-09-26T20:03:42.060944] [DEBUG] [LOCAL ] MMD: Saving primary data. [2025-09-26T20:03:42.061706] [DEBUG] [LOCAL ] MMD: Trimmed 18105 records to 11435 (keeping 200 days of data) [2025-09-26T20:03:42.139833] [DEBUG] [LOCAL ] MMD: Primary data saved (11435 records). [2025-09-26T20:03:42.139988] [INFO ] [MAIN ] MMD: Full history saved. [2025-09-26T20:03:42.140095] [INFO ] [MAIN ] Update Progress: 1375/2371 symbols completed. MMD took 31.5s. Estimated remaining: 2h 13m 2s. Rate: 7.5 symbols/min [2025-09-26T20:03:42.325581] [INFO ] [REMOTE ] MMM: Fetching primary data for 2024-12. [2025-09-26T20:03:42.330314] [INFO ] [MAIN ] MMS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:03:42.371983] [DEBUG] [LOCAL ] MMS: Loaded 34138 existing records from primary storage. [2025-09-26T20:03:42.372135] [INFO ] [MAIN ] MMS: Loaded 34138 existing records. [2025-09-26T20:03:42.563970] [WARN ] [MAIN ] MMS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:03:42.564258] [INFO ] [MAIN ] MMS: Wiping existing primary data before full refresh. [2025-09-26T20:03:42.564319] [INFO ] [LOCAL ] MMS: Starting deletion of primary data. [2025-09-26T20:03:42.564697] [DEBUG] [LOCAL ] MMS: Deleted primary data file. [2025-09-26T20:03:42.564760] [INFO ] [MAIN ] MMS: Starting full primary refresh. [2025-09-26T20:03:42.931186] [INFO ] [REMOTE ] MMS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:03:43.111751] [INFO ] [REMOTE ] MMS: Fetching primary data for 2024-12. [2025-09-26T20:03:43.911707] [INFO ] [REMOTE ] MMID: Fetching primary data for 2025-07. [2025-09-26T20:03:44.120426] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:03:44.120784] [WARN ] [REMOTE ] MMID: No data returned for month 2025-07 [2025-09-26T20:03:44.261422] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-26T20:03:44.329056] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-26T20:03:44.711762] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-01. [2025-09-26T20:03:45.511757] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-01. [2025-09-26T20:03:46.220762] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-26T20:03:46.311742] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-02. [2025-09-26T20:03:47.111711] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2024-12. [2025-09-26T20:03:47.594030] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-26T20:03:47.597292] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-26T20:03:47.700896] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-26T20:03:47.911764] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-01. [2025-09-26T20:03:48.339742] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-26T20:03:48.711768] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-02. [2025-09-26T20:03:49.154473] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-26T20:03:49.511743] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-03. [2025-09-26T20:03:50.311745] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-03. [2025-09-26T20:03:50.738602] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-26T20:03:51.113031] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-02. [2025-09-26T20:03:51.121612] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-26T20:03:51.911723] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-04. [2025-09-26T20:03:52.711710] [INFO ] [REMOTE ] MMID: Fetching primary data for 2025-08. [2025-09-26T20:03:52.926540] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:03:52.926954] [WARN ] [REMOTE ] MMID: No data returned for month 2025-08 [2025-09-26T20:03:53.100008] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-26T20:03:53.511732] [INFO ] [REMOTE ] MMID: Fetching primary data for 2025-09. [2025-09-26T20:03:53.691346] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-26T20:03:54.005228] [INFO ] [REMOTE ] MMID: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-26T20:03:54.005874] [INFO ] [REMOTE ] MMID: Full fetch complete (22 records). [2025-09-26T20:03:54.006003] [DEBUG] [VALIDATOR ] MMID: Validating primary data. [2025-09-26T20:03:54.203215] [WARN ] [VALIDATOR ] MMID: Validation failed - insufficient historical data. Have 3 unique days, need 200 days [2025-09-26T20:03:54.203442] [FATAL] [MAIN ] MMID: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:03:54.203516] [WARN ] [MAIN ] MMID: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:03:54.203589] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-09-26T20:03:54.203694] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-09-26T20:03:54.203751] [INFO ] [LOCAL ] MMID: Starting deletion of derivative data. [2025-09-26T20:03:54.203797] [DEBUG] [LOCAL ] MMID: No derivative data file found to delete. [2025-09-26T20:03:54.203874] [INFO ] [MAIN ] Update Progress: 1376/2371 symbols completed. MMID took 33.1s. Estimated remaining: 2h 12m 57s. Rate: 7.5 symbols/min [2025-09-26T20:03:54.316850] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-04. [2025-09-26T20:03:54.386751] [INFO ] [MAIN ] MMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:03:54.401303] [DEBUG] [LOCAL ] MMT: Loaded 10959 existing records from primary storage. [2025-09-26T20:03:54.401430] [INFO ] [MAIN ] MMT: Loaded 10959 existing records. [2025-09-26T20:03:54.587115] [WARN ] [MAIN ] MMT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:03:54.587412] [INFO ] [MAIN ] MMT: Wiping existing primary data before full refresh. [2025-09-26T20:03:54.587461] [INFO ] [LOCAL ] MMT: Starting deletion of primary data. [2025-09-26T20:03:54.587780] [DEBUG] [LOCAL ] MMT: Deleted primary data file. [2025-09-26T20:03:54.587865] [INFO ] [MAIN ] MMT: Starting full primary refresh. [2025-09-26T20:03:54.877049] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-26T20:03:54.984018] [INFO ] [REMOTE ] MMT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:03:55.111722] [INFO ] [REMOTE ] MMT: Fetching primary data for 2024-12. [2025-09-26T20:03:55.911724] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-05. [2025-09-26T20:03:55.970323] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-26T20:03:56.711741] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-05. [2025-09-26T20:03:57.141485] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-26T20:03:57.266444] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-26T20:03:57.511722] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-01. [2025-09-26T20:03:58.214177] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-26T20:03:58.311679] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-03. [2025-09-26T20:03:59.111733] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-06. [2025-09-26T20:03:59.458602] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-26T20:03:59.911718] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-07. [2025-09-26T20:04:00.200764] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-26T20:04:00.317616] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-26T20:04:00.711728] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-06. [2025-09-26T20:04:01.511745] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-04. [2025-09-26T20:04:01.631543] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-26T20:04:02.311741] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-07. [2025-09-26T20:04:03.111732] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-08. [2025-09-26T20:04:03.560097] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-26T20:04:03.620622] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-26T20:04:03.652011] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-26T20:04:03.911734] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-05. [2025-09-26T20:04:04.711742] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-08. [2025-09-26T20:04:05.511765] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-09. [2025-09-26T20:04:05.972026] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-26T20:04:05.974106] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-26T20:04:05.975496] [INFO ] [REMOTE ] MMKT: Full fetch complete (2099 records). [2025-09-26T20:04:05.975690] [DEBUG] [VALIDATOR ] MMKT: Validating primary data. [2025-09-26T20:04:06.197440] [WARN ] [VALIDATOR ] MMKT: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-26T20:04:06.197674] [FATAL] [MAIN ] MMKT: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:04:06.197835] [WARN ] [MAIN ] MMKT: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:04:06.198052] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-09-26T20:04:06.198153] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-09-26T20:04:06.198213] [INFO ] [LOCAL ] MMKT: Starting deletion of derivative data. [2025-09-26T20:04:06.198348] [DEBUG] [LOCAL ] MMKT: No derivative data file found to delete. [2025-09-26T20:04:06.198488] [INFO ] [MAIN ] Update Progress: 1377/2371 symbols completed. MMKT took 28.6s. Estimated remaining: 2h 12m 52s. Rate: 7.5 symbols/min [2025-09-26T20:04:06.313618] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-02. [2025-09-26T20:04:06.417047] [INFO ] [MAIN ] MMU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:04:06.418701] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-26T20:04:06.446737] [DEBUG] [LOCAL ] MMU: Loaded 17066 existing records from primary storage. [2025-09-26T20:04:06.446928] [INFO ] [MAIN ] MMU: Loaded 17066 existing records. [2025-09-26T20:04:06.645914] [WARN ] [MAIN ] MMU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:04:06.646191] [INFO ] [MAIN ] MMU: Wiping existing primary data before full refresh. [2025-09-26T20:04:06.646253] [INFO ] [LOCAL ] MMU: Starting deletion of primary data. [2025-09-26T20:04:06.646612] [DEBUG] [LOCAL ] MMU: Deleted primary data file. [2025-09-26T20:04:06.646711] [INFO ] [MAIN ] MMU: Starting full primary refresh. [2025-09-26T20:04:06.976180] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-26T20:04:07.049799] [INFO ] [REMOTE ] MMU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:04:07.111731] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-03. [2025-09-26T20:04:07.911725] [INFO ] [REMOTE ] MMU: Fetching primary data for 2024-12. [2025-09-26T20:04:08.100746] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-26T20:04:08.711736] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-06. [2025-09-26T20:04:09.023346] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-26T20:04:09.511747] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-04. [2025-09-26T20:04:10.311684] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-01. [2025-09-26T20:04:10.378670] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-26T20:04:10.600065] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-26T20:04:11.111729] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-09. [2025-09-26T20:04:11.375034] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-26T20:04:11.911724] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-02. [2025-09-26T20:04:12.705466] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-26T20:04:12.712962] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-07. [2025-09-26T20:04:12.715404] [INFO ] [REMOTE ] MMS: Full fetch complete (52122 records). [2025-09-26T20:04:12.728467] [DEBUG] [VALIDATOR ] MMS: Validating primary data. [2025-09-26T20:04:12.729790] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-26T20:04:13.189571] [DEBUG] [VALIDATOR ] MMS: All expected trading days are present. [2025-09-26T20:04:13.189722] [DEBUG] [VALIDATOR ] MMS: Primary data validation passed. [2025-09-26T20:04:13.190770] [INFO ] [MAIN ] MMS: Fetched primary data is valid. [2025-09-26T20:04:13.190842] [DEBUG] [LOCAL ] MMS: Saving primary data. [2025-09-26T20:04:13.192406] [DEBUG] [LOCAL ] MMS: Trimmed 52122 records to 34398 (keeping 200 days of data) [2025-09-26T20:04:13.457230] [DEBUG] [LOCAL ] MMS: Primary data saved (34398 records). [2025-09-26T20:04:13.457409] [INFO ] [MAIN ] MMS: Full history saved. [2025-09-26T20:04:13.457508] [INFO ] [MAIN ] Update Progress: 1378/2371 symbols completed. MMS took 31.3s. Estimated remaining: 2h 12m 43s. Rate: 7.5 symbols/min [2025-09-26T20:04:13.520536] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-05. [2025-09-26T20:04:13.732064] [INFO ] [MAIN ] MNR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:04:13.766553] [DEBUG] [LOCAL ] MNR: Loaded 24782 existing records from primary storage. [2025-09-26T20:04:13.766756] [INFO ] [MAIN ] MNR: Loaded 24782 existing records. [2025-09-26T20:04:14.045373] [WARN ] [MAIN ] MNR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:04:14.045795] [INFO ] [MAIN ] MNR: Wiping existing primary data before full refresh. [2025-09-26T20:04:14.045866] [INFO ] [LOCAL ] MNR: Starting deletion of primary data. [2025-09-26T20:04:14.046531] [DEBUG] [LOCAL ] MNR: Deleted primary data file. [2025-09-26T20:04:14.046637] [INFO ] [MAIN ] MNR: Starting full primary refresh. [2025-09-26T20:04:14.315808] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-03. [2025-09-26T20:04:14.494322] [INFO ] [REMOTE ] MNR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:04:14.530718] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-26T20:04:14.942682] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-26T20:04:15.111701] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-08. [2025-09-26T20:04:15.421073] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-26T20:04:15.911766] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-06. [2025-09-26T20:04:16.704444] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-26T20:04:16.711636] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-07. [2025-09-26T20:04:17.180704] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-26T20:04:17.326512] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-26T20:04:17.511720] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-04. [2025-09-26T20:04:18.311706] [INFO ] [REMOTE ] MNR: Fetching primary data for 2024-12. [2025-09-26T20:04:18.518756] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-26T20:04:19.111711] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-05. [2025-09-26T20:04:19.440744] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-26T20:04:19.643405] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-26T20:04:19.911723] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-06. [2025-09-26T20:04:20.711767] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-08. [2025-09-26T20:04:21.009751] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-26T20:04:21.511979] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-26T20:04:21.511678] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-07. [2025-09-26T20:04:22.311692] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-09. [2025-09-26T20:04:22.509188] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-26T20:04:23.111737] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-09. [2025-09-26T20:04:23.911713] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-08. [2025-09-26T20:04:23.994405] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-26T20:04:23.996616] [INFO ] [REMOTE ] MMT: Full fetch complete (16199 records). [2025-09-26T20:04:23.996770] [DEBUG] [VALIDATOR ] MMT: Validating primary data. [2025-09-26T20:04:24.404823] [DEBUG] [VALIDATOR ] MMT: All expected trading days are present. [2025-09-26T20:04:24.404980] [DEBUG] [VALIDATOR ] MMT: Primary data validation passed. [2025-09-26T20:04:24.405447] [INFO ] [MAIN ] MMT: Fetched primary data is valid. [2025-09-26T20:04:24.405557] [DEBUG] [LOCAL ] MMT: Saving primary data. [2025-09-26T20:04:24.406352] [DEBUG] [LOCAL ] MMT: Trimmed 16199 records to 10987 (keeping 200 days of data) [2025-09-26T20:04:24.486235] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-26T20:04:24.501546] [INFO ] [REMOTE ] MMM: Full fetch complete (77134 records). [2025-09-26T20:04:24.502550] [DEBUG] [VALIDATOR ] MMM: Validating primary data. [2025-09-26T20:04:24.722256] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-01. [2025-09-26T20:04:24.725234] [DEBUG] [LOCAL ] MMT: Primary data saved (10987 records). [2025-09-26T20:04:24.747373] [INFO ] [MAIN ] MMT: Full history saved. [2025-09-26T20:04:24.785363] [INFO ] [MAIN ] Update Progress: 1379/2371 symbols completed. MMT took 30.6s. Estimated remaining: 2h 12m 37s. Rate: 7.5 symbols/min [2025-09-26T20:04:25.157108] [DEBUG] [VALIDATOR ] MMM: All expected trading days are present. [2025-09-26T20:04:25.162439] [DEBUG] [VALIDATOR ] MMM: Primary data validation passed. [2025-09-26T20:04:25.162338] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-26T20:04:25.181407] [INFO ] [MAIN ] MNSO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:04:25.183122] [INFO ] [MAIN ] MMM: Fetched primary data is valid. [2025-09-26T20:04:25.188152] [DEBUG] [LOCAL ] MMM: Saving primary data. [2025-09-26T20:04:25.194403] [DEBUG] [LOCAL ] MMM: Trimmed 77134 records to 53995 (keeping 200 days of data) [2025-09-26T20:04:25.340814] [DEBUG] [LOCAL ] MNSO: Loaded 44692 existing records from primary storage. [2025-09-26T20:04:25.342209] [INFO ] [MAIN ] MNSO: Loaded 44692 existing records. [2025-09-26T20:04:25.518590] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-09. [2025-09-26T20:04:25.571087] [WARN ] [MAIN ] MNSO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:04:25.574519] [INFO ] [MAIN ] MNSO: Wiping existing primary data before full refresh. [2025-09-26T20:04:25.574623] [INFO ] [LOCAL ] MNSO: Starting deletion of primary data. [2025-09-26T20:04:25.575556] [DEBUG] [LOCAL ] MNSO: Deleted primary data file. [2025-09-26T20:04:25.576417] [INFO ] [MAIN ] MNSO: Starting full primary refresh. [2025-09-26T20:04:25.890835] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-26T20:04:26.133195] [INFO ] [REMOTE ] MNSO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:04:26.263224] [DEBUG] [LOCAL ] MMM: Primary data saved (53995 records). [2025-09-26T20:04:26.263484] [INFO ] [MAIN ] MMM: Full history saved. [2025-09-26T20:04:26.265488] [INFO ] [MAIN ] Update Progress: 1380/2371 symbols completed. MMM took 45.7s. Estimated remaining: 2h 12m 25s. Rate: 7.5 symbols/min [2025-09-26T20:04:26.317308] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2024-12. [2025-09-26T20:04:26.462133] [INFO ] [MAIN ] MNTN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:04:26.462343] [DEBUG] [LOCAL ] MNTN: No existing data file found in primary storage. [2025-09-26T20:04:26.462399] [WARN ] [MAIN ] MNTN: No existing data found, performing full refresh instead. [2025-09-26T20:04:26.462555] [INFO ] [MAIN ] MNTN: Wiping existing primary data before full refresh. [2025-09-26T20:04:26.462599] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-09-26T20:04:26.462660] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-09-26T20:04:26.462727] [INFO ] [MAIN ] MNTN: Starting full primary refresh. [2025-09-26T20:04:26.810690] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-26T20:04:26.849537] [INFO ] [REMOTE ] MMU: Full fetch complete (25734 records). [2025-09-26T20:04:26.851543] [DEBUG] [VALIDATOR ] MMU: Validating primary data. [2025-09-26T20:04:26.873151] [INFO ] [REMOTE ] MNTN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:04:27.117280] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-02. [2025-09-26T20:04:27.312931] [DEBUG] [VALIDATOR ] MMU: All expected trading days are present. [2025-09-26T20:04:27.313060] [DEBUG] [VALIDATOR ] MMU: Primary data validation passed. [2025-09-26T20:04:27.313836] [INFO ] [MAIN ] MMU: Fetched primary data is valid. [2025-09-26T20:04:27.313918] [DEBUG] [LOCAL ] MMU: Saving primary data. [2025-09-26T20:04:27.315129] [DEBUG] [LOCAL ] MMU: Trimmed 25734 records to 17156 (keeping 200 days of data) [2025-09-26T20:04:27.423155] [DEBUG] [LOCAL ] MMU: Primary data saved (17156 records). [2025-09-26T20:04:27.423336] [INFO ] [MAIN ] MMU: Full history saved. [2025-09-26T20:04:27.423446] [INFO ] [MAIN ] Update Progress: 1381/2371 symbols completed. MMU took 21.2s. Estimated remaining: 2h 12m 12s. Rate: 7.5 symbols/min [2025-09-26T20:04:27.621300] [INFO ] [MAIN ] MO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:04:27.621503] [DEBUG] [LOCAL ] MO: No existing data file found in primary storage. [2025-09-26T20:04:27.621561] [WARN ] [MAIN ] MO: No existing data found, performing full refresh instead. [2025-09-26T20:04:27.621735] [INFO ] [MAIN ] MO: Wiping existing primary data before full refresh. [2025-09-26T20:04:27.621788] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-09-26T20:04:27.621834] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-09-26T20:04:27.621869] [INFO ] [MAIN ] MO: Starting full primary refresh. [2025-09-26T20:04:27.913015] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2024-12. [2025-09-26T20:04:28.022524] [INFO ] [REMOTE ] MO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:04:28.099779] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-26T20:04:28.485937] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:04:28.486344] [WARN ] [REMOTE ] MNTN: No data returned for month 2024-12 [2025-09-26T20:04:28.507341] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-26T20:04:28.711725] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-03. [2025-09-26T20:04:29.511693] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-01. [2025-09-26T20:04:29.728148] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:04:29.728468] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-01 [2025-09-26T20:04:29.831886] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-26T20:04:30.311763] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-02. [2025-09-26T20:04:30.551067] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:04:30.551425] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-02 [2025-09-26T20:04:31.111716] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-03. [2025-09-26T20:04:31.310574] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:04:31.310988] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-03 [2025-09-26T20:04:31.911723] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-04. [2025-09-26T20:04:32.711729] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-04. [2025-09-26T20:04:32.948572] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:04:32.948949] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-04 [2025-09-26T20:04:32.966272] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-26T20:04:33.511720] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-01. [2025-09-26T20:04:34.311741] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-05. [2025-09-26T20:04:35.111704] [INFO ] [REMOTE ] MO: Fetching primary data for 2024-12. [2025-09-26T20:04:35.139747] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-26T20:04:35.189482] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-26T20:04:35.911716] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-06. [2025-09-26T20:04:36.711727] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-05. [2025-09-26T20:04:37.440007] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-26T20:04:37.492563] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-09-26T20:04:37.511687] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-01. [2025-09-26T20:04:38.183743] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T20:04:38.311754] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-02. [2025-09-26T20:04:39.111736] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-07. [2025-09-26T20:04:39.892287] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-09-26T20:04:39.911700] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-06. [2025-09-26T20:04:39.943281] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T20:04:40.711705] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-09-26T20:04:40.828513] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-26T20:04:41.173995] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-26T20:04:41.511712] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-08. [2025-09-26T20:04:41.620173] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-09-26T20:04:41.620530] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-08 [2025-09-26T20:04:42.311727] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-03. [2025-09-26T20:04:42.711537] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-26T20:04:43.111721] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-09. [2025-09-26T20:04:43.855476] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T20:04:43.911684] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-04. [2025-09-26T20:04:44.417123] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-26T20:04:44.425216] [INFO ] [REMOTE ] MNTN: Full fetch complete (19559 records). [2025-09-26T20:04:44.425345] [DEBUG] [VALIDATOR ] MNTN: Validating primary data. [2025-09-26T20:04:44.619827] [WARN ] [VALIDATOR ] MNTN: Validation failed - insufficient historical data. Have 67 unique days, need 200 days [2025-09-26T20:04:44.620203] [FATAL] [MAIN ] MNTN: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:04:44.620279] [WARN ] [MAIN ] MNTN: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:04:44.620355] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-09-26T20:04:44.620427] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-09-26T20:04:44.620484] [INFO ] [LOCAL ] MNTN: Starting deletion of derivative data. [2025-09-26T20:04:44.620580] [DEBUG] [LOCAL ] MNTN: No derivative data file found to delete. [2025-09-26T20:04:44.620693] [INFO ] [MAIN ] Update Progress: 1382/2371 symbols completed. MNTN took 18.4s. Estimated remaining: 2h 12m 10s. Rate: 7.5 symbols/min [2025-09-26T20:04:44.719458] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-09-26T20:04:44.805797] [INFO ] [MAIN ] MOD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:04:44.854570] [DEBUG] [LOCAL ] MOD: Loaded 45879 existing records from primary storage. [2025-09-26T20:04:44.854777] [INFO ] [MAIN ] MOD: Loaded 45879 existing records. [2025-09-26T20:04:45.049176] [WARN ] [MAIN ] MOD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:04:45.050013] [INFO ] [MAIN ] MOD: Wiping existing primary data before full refresh. [2025-09-26T20:04:45.050072] [INFO ] [LOCAL ] MOD: Starting deletion of primary data. [2025-09-26T20:04:45.050610] [DEBUG] [LOCAL ] MOD: Deleted primary data file. [2025-09-26T20:04:45.050744] [INFO ] [MAIN ] MOD: Starting full primary refresh. [2025-09-26T20:04:45.434809] [INFO ] [REMOTE ] MOD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:04:45.511707] [INFO ] [REMOTE ] MOD: Fetching primary data for 2024-12. [2025-09-26T20:04:45.587626] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-26T20:04:46.311719] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-07. [2025-09-26T20:04:47.112138] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-05. [2025-09-26T20:04:47.117522] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-09-26T20:04:47.157137] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-26T20:04:47.212186] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-26T20:04:47.911774] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-08. [2025-09-26T20:04:48.711762] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-09-26T20:04:48.925500] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-26T20:04:49.064883] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-26T20:04:49.511765] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-06. [2025-09-26T20:04:50.311744] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-01. [2025-09-26T20:04:50.907683] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-26T20:04:50.963736] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-26T20:04:51.111729] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-09-26T20:04:51.911708] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-07. [2025-09-26T20:04:52.041589] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-26T20:04:52.711720] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-09. [2025-09-26T20:04:53.307118] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-26T20:04:53.511691] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-09-26T20:04:53.541799] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-26T20:04:53.830059] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-26T20:04:53.835396] [INFO ] [REMOTE ] MNR: Full fetch complete (36907 records). [2025-09-26T20:04:53.835558] [DEBUG] [VALIDATOR ] MNR: Validating primary data. [2025-09-26T20:04:54.235197] [DEBUG] [VALIDATOR ] MNR: All expected trading days are present. [2025-09-26T20:04:54.235281] [DEBUG] [VALIDATOR ] MNR: Primary data validation passed. [2025-09-26T20:04:54.235972] [INFO ] [MAIN ] MNR: Fetched primary data is valid. [2025-09-26T20:04:54.236035] [DEBUG] [LOCAL ] MNR: Saving primary data. [2025-09-26T20:04:54.236957] [DEBUG] [LOCAL ] MNR: Trimmed 36907 records to 24918 (keeping 200 days of data) [2025-09-26T20:04:54.326195] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-02. [2025-09-26T20:04:54.414360] [DEBUG] [LOCAL ] MNR: Primary data saved (24918 records). [2025-09-26T20:04:54.414737] [INFO ] [MAIN ] MNR: Full history saved. [2025-09-26T20:04:54.415289] [INFO ] [MAIN ] Update Progress: 1383/2371 symbols completed. MNR took 41.0s. Estimated remaining: 2h 12m 4s. Rate: 7.5 symbols/min [2025-09-26T20:04:54.612772] [INFO ] [MAIN ] MODG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:04:54.680970] [DEBUG] [LOCAL ] MODG: Loaded 51979 existing records from primary storage. [2025-09-26T20:04:54.681117] [INFO ] [MAIN ] MODG: Loaded 51979 existing records. [2025-09-26T20:04:54.870714] [WARN ] [MAIN ] MODG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:04:54.870992] [INFO ] [MAIN ] MODG: Wiping existing primary data before full refresh. [2025-09-26T20:04:54.871042] [INFO ] [LOCAL ] MODG: Starting deletion of primary data. [2025-09-26T20:04:54.871594] [DEBUG] [LOCAL ] MODG: Deleted primary data file. [2025-09-26T20:04:54.871711] [INFO ] [MAIN ] MODG: Starting full primary refresh. [2025-09-26T20:04:55.121041] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-08. [2025-09-26T20:04:55.291328] [INFO ] [REMOTE ] MODG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:04:55.630712] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-26T20:04:55.911727] [INFO ] [REMOTE ] MODG: Fetching primary data for 2024-12. [2025-09-26T20:04:55.977612] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-26T20:04:56.408323] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-26T20:04:56.711742] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-03. [2025-09-26T20:04:57.411551] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-26T20:04:57.511713] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-01. [2025-09-26T20:04:58.165488] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-26T20:04:58.311729] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-04. [2025-09-26T20:04:59.111723] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-09. [2025-09-26T20:04:59.323281] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-26T20:04:59.824682] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-26T20:04:59.911740] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-09-26T20:05:00.711703] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-05. [2025-09-26T20:05:01.213151] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-26T20:05:01.222201] [INFO ] [REMOTE ] MNSO: Full fetch complete (64247 records). [2025-09-26T20:05:01.222432] [DEBUG] [VALIDATOR ] MNSO: Validating primary data. [2025-09-26T20:05:01.521057] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-02. [2025-09-26T20:05:01.694568] [DEBUG] [VALIDATOR ] MNSO: All expected trading days are present. [2025-09-26T20:05:01.694727] [DEBUG] [VALIDATOR ] MNSO: Primary data validation passed. [2025-09-26T20:05:01.695733] [INFO ] [MAIN ] MNSO: Fetched primary data is valid. [2025-09-26T20:05:01.695805] [DEBUG] [LOCAL ] MNSO: Saving primary data. [2025-09-26T20:05:01.698397] [DEBUG] [LOCAL ] MNSO: Trimmed 64247 records to 45049 (keeping 200 days of data) [2025-09-26T20:05:02.023421] [DEBUG] [LOCAL ] MNSO: Primary data saved (45049 records). [2025-09-26T20:05:02.023634] [INFO ] [MAIN ] MNSO: Full history saved. [2025-09-26T20:05:02.023825] [INFO ] [MAIN ] Update Progress: 1384/2371 symbols completed. MNSO took 37.2s. Estimated remaining: 2h 11m 55s. Rate: 7.5 symbols/min [2025-09-26T20:05:02.272354] [INFO ] [MAIN ] MOH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:05:02.318945] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-26T20:05:02.332368] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-09-26T20:05:02.365270] [DEBUG] [LOCAL ] MOH: Loaded 42116 existing records from primary storage. [2025-09-26T20:05:02.365470] [INFO ] [MAIN ] MOH: Loaded 42116 existing records. [2025-09-26T20:05:02.585112] [WARN ] [MAIN ] MOH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:05:02.585632] [INFO ] [MAIN ] MOH: Wiping existing primary data before full refresh. [2025-09-26T20:05:02.585916] [INFO ] [LOCAL ] MOH: Starting deletion of primary data. [2025-09-26T20:05:02.586388] [DEBUG] [LOCAL ] MOH: Deleted primary data file. [2025-09-26T20:05:02.586510] [INFO ] [MAIN ] MOH: Starting full primary refresh. [2025-09-26T20:05:02.733942] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-26T20:05:03.033203] [INFO ] [REMOTE ] MOH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:05:03.062548] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-26T20:05:03.111684] [INFO ] [REMOTE ] MOH: Fetching primary data for 2024-12. [2025-09-26T20:05:03.911744] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-03. [2025-09-26T20:05:04.705710] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-26T20:05:04.716786] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-06. [2025-09-26T20:05:04.831111] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-26T20:05:05.511758] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-09-26T20:05:05.719312] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-26T20:05:06.192086] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-26T20:05:06.311731] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-01. [2025-09-26T20:05:07.111722] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-07. [2025-09-26T20:05:07.703218] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-26T20:05:07.806729] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-26T20:05:07.817089] [INFO ] [REMOTE ] MO: Full fetch complete (77495 records). [2025-09-26T20:05:07.817262] [DEBUG] [VALIDATOR ] MO: Validating primary data. [2025-09-26T20:05:07.916815] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-04. [2025-09-26T20:05:08.039909] [WARN ] [VALIDATOR ] MO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-26T20:05:08.040821] [FATAL] [MAIN ] MO: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:05:08.040911] [WARN ] [MAIN ] MO: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:05:08.040990] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-09-26T20:05:08.041066] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-09-26T20:05:08.041107] [INFO ] [LOCAL ] MO: Starting deletion of derivative data. [2025-09-26T20:05:08.041164] [DEBUG] [LOCAL ] MO: No derivative data file found to delete. [2025-09-26T20:05:08.041275] [INFO ] [MAIN ] Update Progress: 1385/2371 symbols completed. MO took 40.6s. Estimated remaining: 2h 11m 46s. Rate: 7.5 symbols/min [2025-09-26T20:05:08.225182] [INFO ] [MAIN ] MOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:05:08.302499] [DEBUG] [LOCAL ] MOS: Loaded 53896 existing records from primary storage. [2025-09-26T20:05:08.302706] [INFO ] [MAIN ] MOS: Loaded 53896 existing records. [2025-09-26T20:05:08.493348] [WARN ] [MAIN ] MOS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:05:08.493589] [INFO ] [MAIN ] MOS: Wiping existing primary data before full refresh. [2025-09-26T20:05:08.493661] [INFO ] [LOCAL ] MOS: Starting deletion of primary data. [2025-09-26T20:05:08.495281] [DEBUG] [LOCAL ] MOS: Deleted primary data file. [2025-09-26T20:05:08.495344] [INFO ] [MAIN ] MOS: Starting full primary refresh. [2025-09-26T20:05:08.719697] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-02. [2025-09-26T20:05:08.984589] [INFO ] [REMOTE ] MOS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:05:09.016457] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-26T20:05:09.511771] [INFO ] [REMOTE ] MOS: Fetching primary data for 2024-12. [2025-09-26T20:05:09.579737] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-26T20:05:10.311736] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-08. [2025-09-26T20:05:10.441746] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-26T20:05:11.111705] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-05. [2025-09-26T20:05:11.434053] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-26T20:05:11.575894] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-26T20:05:11.911723] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-03. [2025-09-26T20:05:12.711733] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-01. [2025-09-26T20:05:12.884206] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-26T20:05:13.511702] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-09. [2025-09-26T20:05:13.649869] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-26T20:05:14.311748] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-06. [2025-09-26T20:05:14.553545] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-26T20:05:15.111707] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-04. [2025-09-26T20:05:15.280531] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-26T20:05:15.289451] [INFO ] [REMOTE ] MOD: Full fetch complete (66354 records). [2025-09-26T20:05:15.289599] [DEBUG] [VALIDATOR ] MOD: Validating primary data. [2025-09-26T20:05:15.759949] [DEBUG] [VALIDATOR ] MOD: All expected trading days are present. [2025-09-26T20:05:15.760128] [DEBUG] [VALIDATOR ] MOD: Primary data validation passed. [2025-09-26T20:05:15.761111] [INFO ] [MAIN ] MOD: Fetched primary data is valid. [2025-09-26T20:05:15.761184] [DEBUG] [LOCAL ] MOD: Saving primary data. [2025-09-26T20:05:15.762820] [DEBUG] [LOCAL ] MOD: Trimmed 66354 records to 46169 (keeping 200 days of data) [2025-09-26T20:05:15.960830] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-02. [2025-09-26T20:05:16.089350] [DEBUG] [LOCAL ] MOD: Primary data saved (46169 records). [2025-09-26T20:05:16.089517] [INFO ] [MAIN ] MOD: Full history saved. [2025-09-26T20:05:16.089667] [INFO ] [MAIN ] Update Progress: 1386/2371 symbols completed. MOD took 31.5s. Estimated remaining: 2h 11m 38s. Rate: 7.5 symbols/min [2025-09-26T20:05:16.289287] [INFO ] [MAIN ] MOV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:05:16.326379] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-26T20:05:16.359635] [DEBUG] [LOCAL ] MOV: Loaded 22325 existing records from primary storage. [2025-09-26T20:05:16.359983] [INFO ] [MAIN ] MOV: Loaded 22325 existing records. [2025-09-26T20:05:16.566392] [WARN ] [MAIN ] MOV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:05:16.566850] [INFO ] [MAIN ] MOV: Wiping existing primary data before full refresh. [2025-09-26T20:05:16.566952] [INFO ] [LOCAL ] MOV: Starting deletion of primary data. [2025-09-26T20:05:16.575604] [DEBUG] [LOCAL ] MOV: Deleted primary data file. [2025-09-26T20:05:16.590125] [INFO ] [MAIN ] MOV: Starting full primary refresh. [2025-09-26T20:05:16.611795] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-26T20:05:16.719753] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-05. [2025-09-26T20:05:17.087264] [INFO ] [REMOTE ] MOV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:05:17.511715] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-07. [2025-09-26T20:05:17.806275] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-26T20:05:18.233383] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-26T20:05:18.311717] [INFO ] [REMOTE ] MOV: Fetching primary data for 2024-12. [2025-09-26T20:05:19.111730] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-03. [2025-09-26T20:05:19.334744] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-26T20:05:19.379845] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-26T20:05:19.911710] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-01. [2025-09-26T20:05:20.711718] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-06. [2025-09-26T20:05:20.858860] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-26T20:05:21.027587] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-26T20:05:21.511770] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-02. [2025-09-26T20:05:21.746989] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-26T20:05:22.311712] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-04. [2025-09-26T20:05:22.612262] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-26T20:05:23.111717] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-07. [2025-09-26T20:05:23.913016] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-03. [2025-09-26T20:05:23.919573] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-26T20:05:24.711721] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-08. [2025-09-26T20:05:24.809142] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-26T20:05:25.147363] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-26T20:05:25.511772] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-04. [2025-09-26T20:05:26.311768] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-08. [2025-09-26T20:05:26.442134] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-26T20:05:26.906998] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-26T20:05:27.111721] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-09. [2025-09-26T20:05:27.911728] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-05. [2025-09-26T20:05:28.711761] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-05. [2025-09-26T20:05:28.996764] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-26T20:05:29.011258] [INFO ] [REMOTE ] MODG: Full fetch complete (74768 records). [2025-09-26T20:05:29.011453] [DEBUG] [VALIDATOR ] MODG: Validating primary data. [2025-09-26T20:05:29.166273] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-26T20:05:29.501905] [DEBUG] [VALIDATOR ] MODG: All expected trading days are present. [2025-09-26T20:05:29.502048] [DEBUG] [VALIDATOR ] MODG: Primary data validation passed. [2025-09-26T20:05:29.503157] [INFO ] [MAIN ] MODG: Fetched primary data is valid. [2025-09-26T20:05:29.503229] [DEBUG] [LOCAL ] MODG: Saving primary data. [2025-09-26T20:05:29.505884] [DEBUG] [LOCAL ] MODG: Trimmed 74768 records to 52353 (keeping 200 days of data) [2025-09-26T20:05:29.511741] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-06. [2025-09-26T20:05:29.836851] [DEBUG] [LOCAL ] MODG: Primary data saved (52353 records). [2025-09-26T20:05:29.837096] [INFO ] [MAIN ] MODG: Full history saved. [2025-09-26T20:05:29.837234] [INFO ] [MAIN ] Update Progress: 1387/2371 symbols completed. MODG took 35.4s. Estimated remaining: 2h 11m 34s. Rate: 7.5 symbols/min [2025-09-26T20:05:30.012885] [INFO ] [MAIN ] MP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:05:30.067067] [DEBUG] [LOCAL ] MP: Loaded 54054 existing records from primary storage. [2025-09-26T20:05:30.067244] [INFO ] [MAIN ] MP: Loaded 54054 existing records. [2025-09-26T20:05:30.252733] [WARN ] [MAIN ] MP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:05:30.252981] [INFO ] [MAIN ] MP: Wiping existing primary data before full refresh. [2025-09-26T20:05:30.253032] [INFO ] [LOCAL ] MP: Starting deletion of primary data. [2025-09-26T20:05:30.253285] [DEBUG] [LOCAL ] MP: Deleted primary data file. [2025-09-26T20:05:30.253344] [INFO ] [MAIN ] MP: Starting full primary refresh. [2025-09-26T20:05:30.670718] [INFO ] [REMOTE ] MP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:05:30.671829] [INFO ] [REMOTE ] MP: Fetching primary data for 2024-12. [2025-09-26T20:05:30.688170] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-26T20:05:30.739389] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-26T20:05:31.111723] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-07. [2025-09-26T20:05:31.911728] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-06. [2025-09-26T20:05:32.191407] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-26T20:05:32.670609] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-26T20:05:32.711722] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-01. [2025-09-26T20:05:33.511737] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-08. [2025-09-26T20:05:33.732907] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-26T20:05:34.293508] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-26T20:05:34.311681] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-02. [2025-09-26T20:05:34.587853] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-26T20:05:35.111744] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-09. [2025-09-26T20:05:35.911728] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-07. [2025-09-26T20:05:36.329616] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-26T20:05:36.410481] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-26T20:05:36.415054] [INFO ] [REMOTE ] MOV: Full fetch complete (30636 records). [2025-09-26T20:05:36.415152] [DEBUG] [VALIDATOR ] MOV: Validating primary data. [2025-09-26T20:05:36.721985] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-03. [2025-09-26T20:05:36.825445] [DEBUG] [VALIDATOR ] MOV: All expected trading days are present. [2025-09-26T20:05:36.825536] [DEBUG] [VALIDATOR ] MOV: Primary data validation passed. [2025-09-26T20:05:36.826266] [INFO ] [MAIN ] MOV: Fetched primary data is valid. [2025-09-26T20:05:36.826332] [DEBUG] [LOCAL ] MOV: Saving primary data. [2025-09-26T20:05:36.827264] [DEBUG] [LOCAL ] MOV: Trimmed 30636 records to 22417 (keeping 200 days of data) [2025-09-26T20:05:36.981973] [DEBUG] [LOCAL ] MOV: Primary data saved (22417 records). [2025-09-26T20:05:36.982119] [INFO ] [MAIN ] MOV: Full history saved. [2025-09-26T20:05:36.982227] [INFO ] [MAIN ] Update Progress: 1388/2371 symbols completed. MOV took 20.9s. Estimated remaining: 2h 11m 25s. Rate: 7.5 symbols/min [2025-09-26T20:05:37.169776] [INFO ] [MAIN ] MPA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:05:37.181088] [DEBUG] [LOCAL ] MPA: Loaded 5231 existing records from primary storage. [2025-09-26T20:05:37.181254] [INFO ] [MAIN ] MPA: Loaded 5231 existing records. [2025-09-26T20:05:37.380613] [WARN ] [MAIN ] MPA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:05:37.380977] [INFO ] [MAIN ] MPA: Wiping existing primary data before full refresh. [2025-09-26T20:05:37.381057] [INFO ] [LOCAL ] MPA: Starting deletion of primary data. [2025-09-26T20:05:37.381314] [DEBUG] [LOCAL ] MPA: Deleted primary data file. [2025-09-26T20:05:37.381393] [INFO ] [MAIN ] MPA: Starting full primary refresh. [2025-09-26T20:05:37.792053] [INFO ] [REMOTE ] MPA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:05:37.792517] [INFO ] [REMOTE ] MPA: Fetching primary data for 2024-12. [2025-09-26T20:05:37.842426] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-26T20:05:38.311741] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-08. [2025-09-26T20:05:38.329327] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-26T20:05:39.033493] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-09-26T20:05:39.111721] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-01. [2025-09-26T20:05:39.582015] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-26T20:05:39.911766] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-04. [2025-09-26T20:05:40.019009] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-26T20:05:40.711745] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-09. [2025-09-26T20:05:41.511736] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-02. [2025-09-26T20:05:42.123018] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-26T20:05:42.265249] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-26T20:05:42.311725] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-05. [2025-09-26T20:05:42.490996] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-26T20:05:42.501978] [INFO ] [REMOTE ] MOS: Full fetch complete (77453 records). [2025-09-26T20:05:42.502155] [DEBUG] [VALIDATOR ] MOS: Validating primary data. [2025-09-26T20:05:42.978995] [DEBUG] [VALIDATOR ] MOS: All expected trading days are present. [2025-09-26T20:05:42.979092] [DEBUG] [VALIDATOR ] MOS: Primary data validation passed. [2025-09-26T20:05:42.980106] [INFO ] [MAIN ] MOS: Fetched primary data is valid. [2025-09-26T20:05:42.980175] [DEBUG] [LOCAL ] MOS: Saving primary data. [2025-09-26T20:05:42.982705] [DEBUG] [LOCAL ] MOS: Trimmed 77453 records to 54284 (keeping 200 days of data) [2025-09-26T20:05:43.113255] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-03. [2025-09-26T20:05:43.139042] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-08 (16.83 seconds). [2025-09-26T20:05:43.385564] [DEBUG] [LOCAL ] MOS: Primary data saved (54284 records). [2025-09-26T20:05:43.385806] [INFO ] [MAIN ] MOS: Full history saved. [2025-09-26T20:05:43.385938] [INFO ] [MAIN ] Update Progress: 1389/2371 symbols completed. MOS took 35.3s. Estimated remaining: 2h 11m 16s. Rate: 7.5 symbols/min [2025-09-26T20:05:43.576078] [INFO ] [MAIN ] MPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:05:43.644883] [DEBUG] [LOCAL ] MPC: Loaded 52505 existing records from primary storage. [2025-09-26T20:05:43.645111] [INFO ] [MAIN ] MPC: Loaded 52505 existing records. [2025-09-26T20:05:43.747339] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-26T20:05:43.846512] [WARN ] [MAIN ] MPC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:05:43.847008] [INFO ] [MAIN ] MPC: Wiping existing primary data before full refresh. [2025-09-26T20:05:43.847070] [INFO ] [LOCAL ] MPC: Starting deletion of primary data. [2025-09-26T20:05:43.847437] [DEBUG] [LOCAL ] MPC: Deleted primary data file. [2025-09-26T20:05:43.847498] [INFO ] [MAIN ] MPC: Starting full primary refresh. [2025-09-26T20:05:43.917036] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-09. [2025-09-26T20:05:44.249866] [INFO ] [REMOTE ] MPC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:05:44.297050] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-26T20:05:44.711739] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-06. [2025-09-26T20:05:45.511748] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-04. [2025-09-26T20:05:45.915666] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-26T20:05:45.925429] [INFO ] [REMOTE ] MOH: Full fetch complete (58379 records). [2025-09-26T20:05:45.925610] [DEBUG] [VALIDATOR ] MOH: Validating primary data. [2025-09-26T20:05:46.253736] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-26T20:05:46.316256] [INFO ] [REMOTE ] MPC: Fetching primary data for 2024-12. [2025-09-26T20:05:46.356449] [DEBUG] [VALIDATOR ] MOH: All expected trading days are present. [2025-09-26T20:05:46.356553] [DEBUG] [VALIDATOR ] MOH: Primary data validation passed. [2025-09-26T20:05:46.357590] [INFO ] [MAIN ] MOH: Fetched primary data is valid. [2025-09-26T20:05:46.357802] [DEBUG] [LOCAL ] MOH: Saving primary data. [2025-09-26T20:05:46.361145] [DEBUG] [LOCAL ] MOH: Trimmed 58379 records to 42444 (keeping 200 days of data) [2025-09-26T20:05:46.637773] [DEBUG] [LOCAL ] MOH: Primary data saved (42444 records). [2025-09-26T20:05:46.637916] [INFO ] [MAIN ] MOH: Full history saved. [2025-09-26T20:05:46.638009] [INFO ] [MAIN ] Update Progress: 1390/2371 symbols completed. MOH took 44.6s. Estimated remaining: 2h 11m 5s. Rate: 7.5 symbols/min [2025-09-26T20:05:46.830744] [INFO ] [MAIN ] MPLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:05:46.886630] [DEBUG] [LOCAL ] MPLX: Loaded 51120 existing records from primary storage. [2025-09-26T20:05:46.886819] [INFO ] [MAIN ] MPLX: Loaded 51120 existing records. [2025-09-26T20:05:47.074913] [WARN ] [MAIN ] MPLX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:05:47.075183] [INFO ] [MAIN ] MPLX: Wiping existing primary data before full refresh. [2025-09-26T20:05:47.075239] [INFO ] [LOCAL ] MPLX: Starting deletion of primary data. [2025-09-26T20:05:47.075802] [DEBUG] [LOCAL ] MPLX: Deleted primary data file. [2025-09-26T20:05:47.075863] [INFO ] [MAIN ] MPLX: Starting full primary refresh. [2025-09-26T20:05:47.121446] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-05. [2025-09-26T20:05:47.484252] [INFO ] [REMOTE ] MPLX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:05:47.527903] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-06 (2.82 seconds). [2025-09-26T20:05:47.913638] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2024-12. [2025-09-26T20:05:47.914480] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-26T20:05:48.446393] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-26T20:05:48.711735] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-06. [2025-09-26T20:05:49.355891] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-26T20:05:49.511689] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-07. [2025-09-26T20:05:49.764838] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-26T20:05:49.932364] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-26T20:05:50.311716] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-08. [2025-09-26T20:05:50.935972] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-26T20:05:51.111726] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-01. [2025-09-26T20:05:51.911746] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-07. [2025-09-26T20:05:52.711693] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-01. [2025-09-26T20:05:52.833472] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-26T20:05:53.511731] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-02. [2025-09-26T20:05:54.311766] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-09. [2025-09-26T20:05:54.561400] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-26T20:05:54.671001] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-07 (2.76 seconds). [2025-09-26T20:05:54.764205] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-26T20:05:54.766083] [INFO ] [REMOTE ] MPA: Full fetch complete (7112 records). [2025-09-26T20:05:54.766189] [DEBUG] [VALIDATOR ] MPA: Validating primary data. [2025-09-26T20:05:55.168045] [DEBUG] [VALIDATOR ] MPA: All expected trading days are present. [2025-09-26T20:05:55.140723] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-08. [2025-09-26T20:05:55.168509] [DEBUG] [VALIDATOR ] MPA: Primary data validation passed. [2025-09-26T20:05:55.170312] [INFO ] [MAIN ] MPA: Fetched primary data is valid. [2025-09-26T20:05:55.170411] [DEBUG] [LOCAL ] MPA: Saving primary data. [2025-09-26T20:05:55.171173] [DEBUG] [LOCAL ] MPA: Trimmed 7112 records to 5268 (keeping 200 days of data) [2025-09-26T20:05:55.236673] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-26T20:05:55.238267] [DEBUG] [LOCAL ] MPA: Primary data saved (5268 records). [2025-09-26T20:05:55.248983] [INFO ] [MAIN ] MPA: Full history saved. [2025-09-26T20:05:55.249264] [INFO ] [MAIN ] Update Progress: 1391/2371 symbols completed. MPA took 18.3s. Estimated remaining: 2h 10m 57s. Rate: 7.5 symbols/min [2025-09-26T20:05:55.425628] [INFO ] [MAIN ] MPV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:05:55.434100] [DEBUG] [LOCAL ] MPV: Loaded 5079 existing records from primary storage. [2025-09-26T20:05:55.434229] [INFO ] [MAIN ] MPV: Loaded 5079 existing records. [2025-09-26T20:05:55.617967] [WARN ] [MAIN ] MPV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:05:55.618245] [INFO ] [MAIN ] MPV: Wiping existing primary data before full refresh. [2025-09-26T20:05:55.618306] [INFO ] [LOCAL ] MPV: Starting deletion of primary data. [2025-09-26T20:05:55.618505] [DEBUG] [LOCAL ] MPV: Deleted primary data file. [2025-09-26T20:05:55.618562] [INFO ] [MAIN ] MPV: Starting full primary refresh. [2025-09-26T20:05:55.916790] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-02. [2025-09-26T20:05:55.994090] [INFO ] [REMOTE ] MPV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:05:56.711756] [INFO ] [REMOTE ] MPV: Fetching primary data for 2024-12. [2025-09-26T20:05:57.429405] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-26T20:05:57.511752] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-03. [2025-09-26T20:05:57.814394] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-26T20:05:58.034584] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-08 (2.89 seconds). [2025-09-26T20:05:58.311716] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-09. [2025-09-26T20:05:59.111699] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-03. [2025-09-26T20:05:59.326859] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-26T20:05:59.911724] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-01. [2025-09-26T20:06:00.711710] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-04. [2025-09-26T20:06:00.820949] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-26T20:06:01.511733] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-02. [2025-09-26T20:06:01.655489] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-09 (3.34 seconds). [2025-09-26T20:06:01.687926] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-09-26T20:06:01.686206] [INFO ] [REMOTE ] MP: Full fetch complete (77304 records). [2025-09-26T20:06:01.688133] [DEBUG] [VALIDATOR ] MP: Validating primary data. [2025-09-26T20:06:02.070726] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-26T20:06:02.155256] [DEBUG] [VALIDATOR ] MP: All expected trading days are present. [2025-09-26T20:06:02.155344] [DEBUG] [VALIDATOR ] MP: Primary data validation passed. [2025-09-26T20:06:02.156395] [INFO ] [MAIN ] MP: Fetched primary data is valid. [2025-09-26T20:06:02.156461] [DEBUG] [LOCAL ] MP: Saving primary data. [2025-09-26T20:06:02.158398] [DEBUG] [LOCAL ] MP: Trimmed 77304 records to 54444 (keeping 200 days of data) [2025-09-26T20:06:02.330908] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-04. [2025-09-26T20:06:02.497370] [DEBUG] [LOCAL ] MP: Primary data saved (54444 records). [2025-09-26T20:06:02.497530] [INFO ] [MAIN ] MP: Full history saved. [2025-09-26T20:06:02.497674] [INFO ] [MAIN ] Update Progress: 1392/2371 symbols completed. MP took 32.7s. Estimated remaining: 2h 10m 48s. Rate: 7.5 symbols/min [2025-09-26T20:06:02.716712] [INFO ] [MAIN ] MPW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:06:02.750066] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-26T20:06:02.808313] [DEBUG] [LOCAL ] MPW: Loaded 53889 existing records from primary storage. [2025-09-26T20:06:02.808463] [INFO ] [MAIN ] MPW: Loaded 53889 existing records. [2025-09-26T20:06:02.998217] [WARN ] [MAIN ] MPW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:06:02.998458] [INFO ] [MAIN ] MPW: Wiping existing primary data before full refresh. [2025-09-26T20:06:02.998509] [INFO ] [LOCAL ] MPW: Starting deletion of primary data. [2025-09-26T20:06:02.999040] [DEBUG] [LOCAL ] MPW: Deleted primary data file. [2025-09-26T20:06:02.999105] [INFO ] [MAIN ] MPW: Starting full primary refresh. [2025-09-26T20:06:03.116903] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-03. [2025-09-26T20:06:03.378919] [INFO ] [REMOTE ] MPW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:06:03.917134] [INFO ] [REMOTE ] MPW: Fetching primary data for 2024-12. [2025-09-26T20:06:03.923551] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-26T20:06:04.032323] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-26T20:06:04.711729] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-05. [2025-09-26T20:06:05.511759] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-04. [2025-09-26T20:06:06.032373] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-26T20:06:06.167388] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-26T20:06:06.311697] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-01. [2025-09-26T20:06:06.565110] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-26T20:06:07.111717] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-05. [2025-09-26T20:06:07.911725] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-05. [2025-09-26T20:06:08.340918] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-26T20:06:08.647244] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-26T20:06:08.711722] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-06. [2025-09-26T20:06:09.088898] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-26T20:06:09.391188] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-26T20:06:09.511728] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-02. [2025-09-26T20:06:10.311715] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-06. [2025-09-26T20:06:11.111713] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-06. [2025-09-26T20:06:11.368373] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-26T20:06:11.911727] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-07. [2025-09-26T20:06:12.138625] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-26T20:06:12.483581] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-26T20:06:12.711701] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-03. [2025-09-26T20:06:12.788951] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-26T20:06:13.511720] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-08. [2025-09-26T20:06:14.101278] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-26T20:06:14.311735] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-07. [2025-09-26T20:06:14.702559] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-26T20:06:15.111724] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-04. [2025-09-26T20:06:15.911761] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-07. [2025-09-26T20:06:16.363801] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-26T20:06:16.711749] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-09. [2025-09-26T20:06:16.770768] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-26T20:06:17.511740] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-05. [2025-09-26T20:06:17.695250] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-26T20:06:17.704487] [INFO ] [REMOTE ] MPV: Full fetch complete (8047 records). [2025-09-26T20:06:17.726989] [DEBUG] [VALIDATOR ] MPV: Validating primary data. [2025-09-26T20:06:17.748559] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-26T20:06:18.251795] [DEBUG] [VALIDATOR ] MPV: All expected trading days are present. [2025-09-26T20:06:18.251896] [DEBUG] [VALIDATOR ] MPV: Primary data validation passed. [2025-09-26T20:06:18.252162] [INFO ] [MAIN ] MPV: Fetched primary data is valid. [2025-09-26T20:06:18.252238] [DEBUG] [LOCAL ] MPV: Saving primary data. [2025-09-26T20:06:18.252879] [DEBUG] [LOCAL ] MPV: Trimmed 8047 records to 5098 (keeping 200 days of data) [2025-09-26T20:06:18.296232] [DEBUG] [LOCAL ] MPV: Primary data saved (5098 records). [2025-09-26T20:06:18.296422] [INFO ] [MAIN ] MPV: Full history saved. [2025-09-26T20:06:18.296568] [INFO ] [MAIN ] Update Progress: 1393/2371 symbols completed. MPV took 23.0s. Estimated remaining: 2h 10m 46s. Rate: 7.5 symbols/min [2025-09-26T20:06:18.316824] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-08. [2025-09-26T20:06:18.505615] [INFO ] [MAIN ] MPX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:06:18.513476] [DEBUG] [LOCAL ] MPX: Loaded 4198 existing records from primary storage. [2025-09-26T20:06:18.513620] [INFO ] [MAIN ] MPX: Loaded 4198 existing records. [2025-09-26T20:06:18.712269] [WARN ] [MAIN ] MPX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:06:18.712558] [INFO ] [MAIN ] MPX: Wiping existing primary data before full refresh. [2025-09-26T20:06:18.712614] [INFO ] [LOCAL ] MPX: Starting deletion of primary data. [2025-09-26T20:06:18.712904] [DEBUG] [LOCAL ] MPX: Deleted primary data file. [2025-09-26T20:06:18.712979] [INFO ] [MAIN ] MPX: Starting full primary refresh. [2025-09-26T20:06:19.117386] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-08. [2025-09-26T20:06:19.122392] [INFO ] [REMOTE ] MPX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:06:19.572617] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-26T20:06:19.911692] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-06. [2025-09-26T20:06:20.316399] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-26T20:06:20.711726] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-09. [2025-09-26T20:06:20.893763] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-26T20:06:21.511791] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-09. [2025-09-26T20:06:21.849198] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-26T20:06:22.223286] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-26T20:06:22.233676] [INFO ] [REMOTE ] MPC: Full fetch complete (75890 records). [2025-09-26T20:06:22.233831] [DEBUG] [VALIDATOR ] MPC: Validating primary data. [2025-09-26T20:06:22.321609] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-07. [2025-09-26T20:06:22.659898] [DEBUG] [VALIDATOR ] MPC: All expected trading days are present. [2025-09-26T20:06:22.660031] [DEBUG] [VALIDATOR ] MPC: Primary data validation passed. [2025-09-26T20:06:22.661090] [INFO ] [MAIN ] MPC: Fetched primary data is valid. [2025-09-26T20:06:22.661177] [DEBUG] [LOCAL ] MPC: Saving primary data. [2025-09-26T20:06:22.662797] [DEBUG] [LOCAL ] MPC: Trimmed 75890 records to 52889 (keeping 200 days of data) [2025-09-26T20:06:23.004510] [DEBUG] [LOCAL ] MPC: Primary data saved (52889 records). [2025-09-26T20:06:23.004700] [INFO ] [MAIN ] MPC: Full history saved. [2025-09-26T20:06:23.004824] [INFO ] [MAIN ] Update Progress: 1394/2371 symbols completed. MPC took 39.6s. Estimated remaining: 2h 10m 36s. Rate: 7.5 symbols/min [2025-09-26T20:06:23.117677] [INFO ] [REMOTE ] MPX: Fetching primary data for 2024-12. [2025-09-26T20:06:23.192226] [INFO ] [MAIN ] MQT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:06:23.204084] [DEBUG] [LOCAL ] MQT: Loaded 8472 existing records from primary storage. [2025-09-26T20:06:23.204215] [INFO ] [MAIN ] MQT: Loaded 8472 existing records. [2025-09-26T20:06:23.395369] [WARN ] [MAIN ] MQT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:06:23.395844] [INFO ] [MAIN ] MQT: Wiping existing primary data before full refresh. [2025-09-26T20:06:23.395921] [INFO ] [LOCAL ] MQT: Starting deletion of primary data. [2025-09-26T20:06:23.396218] [DEBUG] [LOCAL ] MQT: Deleted primary data file. [2025-09-26T20:06:23.396280] [INFO ] [MAIN ] MQT: Starting full primary refresh. [2025-09-26T20:06:23.676719] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-26T20:06:23.758975] [INFO ] [REMOTE ] MPLX: Full fetch complete (74033 records). [2025-09-26T20:06:23.766591] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-26T20:06:23.766224] [DEBUG] [VALIDATOR ] MPLX: Validating primary data. [2025-09-26T20:06:23.912341] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-01. [2025-09-26T20:06:24.034832] [INFO ] [REMOTE ] MQT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:06:24.365018] [DEBUG] [VALIDATOR ] MPLX: All expected trading days are present. [2025-09-26T20:06:24.365190] [DEBUG] [VALIDATOR ] MPLX: Primary data validation passed. [2025-09-26T20:06:24.366404] [INFO ] [MAIN ] MPLX: Fetched primary data is valid. [2025-09-26T20:06:24.366503] [DEBUG] [LOCAL ] MPLX: Saving primary data. [2025-09-26T20:06:24.368449] [DEBUG] [LOCAL ] MPLX: Trimmed 74033 records to 51491 (keeping 200 days of data) [2025-09-26T20:06:24.501876] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-26T20:06:24.526246] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-26T20:06:24.712228] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-08. [2025-09-26T20:06:24.756865] [DEBUG] [LOCAL ] MPLX: Primary data saved (51491 records). [2025-09-26T20:06:24.757021] [INFO ] [MAIN ] MPLX: Full history saved. [2025-09-26T20:06:24.757111] [INFO ] [MAIN ] Update Progress: 1395/2371 symbols completed. MPLX took 38.1s. Estimated remaining: 2h 10m 23s. Rate: 7.5 symbols/min [2025-09-26T20:06:24.933186] [INFO ] [MAIN ] MQY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:06:24.952208] [DEBUG] [LOCAL ] MQY: Loaded 16881 existing records from primary storage. [2025-09-26T20:06:24.952344] [INFO ] [MAIN ] MQY: Loaded 16881 existing records. [2025-09-26T20:06:25.142138] [WARN ] [MAIN ] MQY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:06:25.142401] [INFO ] [MAIN ] MQY: Wiping existing primary data before full refresh. [2025-09-26T20:06:25.142455] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-09-26T20:06:25.142841] [DEBUG] [LOCAL ] MQY: Deleted primary data file. [2025-09-26T20:06:25.142901] [INFO ] [MAIN ] MQY: Starting full primary refresh. [2025-09-26T20:06:25.529535] [INFO ] [REMOTE ] MQY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:06:25.523306] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-02. [2025-09-26T20:06:26.209718] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-26T20:06:26.311702] [INFO ] [REMOTE ] MQY: Fetching primary data for 2024-12. [2025-09-26T20:06:26.655235] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-26T20:06:27.111715] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-03. [2025-09-26T20:06:27.537883] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-26T20:06:27.884454] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-26T20:06:27.911727] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-09. [2025-09-26T20:06:28.711725] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-04. [2025-09-26T20:06:29.413377] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-26T20:06:29.511754] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-05. [2025-09-26T20:06:30.105205] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-26T20:06:30.117759] [INFO ] [REMOTE ] MPW: Full fetch complete (77520 records). [2025-09-26T20:06:30.117962] [DEBUG] [VALIDATOR ] MPW: Validating primary data. [2025-09-26T20:06:30.316072] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-26T20:06:30.315777] [INFO ] [REMOTE ] MQT: Fetching primary data for 2024-12. [2025-09-26T20:06:30.559711] [DEBUG] [VALIDATOR ] MPW: All expected trading days are present. [2025-09-26T20:06:30.559829] [DEBUG] [VALIDATOR ] MPW: Primary data validation passed. [2025-09-26T20:06:30.561017] [INFO ] [MAIN ] MPW: Fetched primary data is valid. [2025-09-26T20:06:30.561094] [DEBUG] [LOCAL ] MPW: Saving primary data. [2025-09-26T20:06:30.562923] [DEBUG] [LOCAL ] MPW: Trimmed 77520 records to 54275 (keeping 200 days of data) [2025-09-26T20:06:30.887598] [DEBUG] [LOCAL ] MPW: Primary data saved (54275 records). [2025-09-26T20:06:30.887765] [INFO ] [MAIN ] MPW: Full history saved. [2025-09-26T20:06:30.887859] [INFO ] [MAIN ] Update Progress: 1396/2371 symbols completed. MPW took 28.4s. Estimated remaining: 2h 10m 14s. Rate: 7.5 symbols/min [2025-09-26T20:06:31.075966] [INFO ] [MAIN ] MRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:06:31.115349] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-01. [2025-09-26T20:06:31.117579] [DEBUG] [LOCAL ] MRC: Loaded 37865 existing records from primary storage. [2025-09-26T20:06:31.117871] [INFO ] [MAIN ] MRC: Loaded 37865 existing records. [2025-09-26T20:06:31.310834] [WARN ] [MAIN ] MRC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:06:31.311266] [INFO ] [MAIN ] MRC: Wiping existing primary data before full refresh. [2025-09-26T20:06:31.311422] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-09-26T20:06:31.318636] [DEBUG] [LOCAL ] MRC: Deleted primary data file. [2025-09-26T20:06:31.318835] [INFO ] [MAIN ] MRC: Starting full primary refresh. [2025-09-26T20:06:31.353353] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-26T20:06:31.704787] [INFO ] [REMOTE ] MRC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:06:31.911737] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-06. [2025-09-26T20:06:32.118875] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-26T20:06:32.489144] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-26T20:06:32.711735] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-07. [2025-09-26T20:06:33.511715] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-01. [2025-09-26T20:06:33.517634] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-26T20:06:34.311937] [INFO ] [REMOTE ] MRC: Fetching primary data for 2024-12. [2025-09-26T20:06:34.327912] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-26T20:06:35.111727] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-02. [2025-09-26T20:06:35.601481] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-26T20:06:35.911729] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-08. [2025-09-26T20:06:36.352357] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-26T20:06:36.516669] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-26T20:06:36.711721] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-02. [2025-09-26T20:06:37.428816] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-26T20:06:37.511731] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-03. [2025-09-26T20:06:38.269437] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-26T20:06:38.311670] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-04. [2025-09-26T20:06:39.111703] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-03. [2025-09-26T20:06:39.286481] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-26T20:06:39.911714] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-05. [2025-09-26T20:06:40.127231] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-26T20:06:40.496220] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-26T20:06:40.711716] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-01. [2025-09-26T20:06:41.511726] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-06. [2025-09-26T20:06:42.232874] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-26T20:06:42.234462] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-26T20:06:42.311753] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-07. [2025-09-26T20:06:42.730596] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-26T20:06:43.111742] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-04. [2025-09-26T20:06:43.911713] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-09. [2025-09-26T20:06:44.161146] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-26T20:06:44.521430] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-26T20:06:44.522852] [INFO ] [REMOTE ] MPX: Full fetch complete (6794 records). [2025-09-26T20:06:44.522939] [DEBUG] [VALIDATOR ] MPX: Validating primary data. [2025-09-26T20:06:44.711753] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-02. [2025-09-26T20:06:44.910615] [DEBUG] [VALIDATOR ] MPX: All expected trading days are present. [2025-09-26T20:06:44.910732] [DEBUG] [VALIDATOR ] MPX: Primary data validation passed. [2025-09-26T20:06:44.910941] [INFO ] [MAIN ] MPX: Fetched primary data is valid. [2025-09-26T20:06:44.910984] [DEBUG] [LOCAL ] MPX: Saving primary data. [2025-09-26T20:06:44.911432] [DEBUG] [LOCAL ] MPX: Trimmed 6794 records to 4213 (keeping 200 days of data) [2025-09-26T20:06:44.936625] [DEBUG] [LOCAL ] MPX: Primary data saved (4213 records). [2025-09-26T20:06:44.936788] [INFO ] [MAIN ] MPX: Full history saved. [2025-09-26T20:06:44.936921] [INFO ] [MAIN ] Update Progress: 1397/2371 symbols completed. MPX took 26.6s. Estimated remaining: 2h 10m 10s. Rate: 7.5 symbols/min [2025-09-26T20:06:45.511756] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-08. [2025-09-26T20:06:46.224281] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-26T20:06:46.224557] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-26T20:06:46.311690] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-03. [2025-09-26T20:06:47.111710] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-09. [2025-09-26T20:06:47.838350] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-26T20:06:47.911735] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-05. [2025-09-26T20:06:47.991631] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-26T20:06:47.995180] [INFO ] [REMOTE ] MQT: Full fetch complete (13283 records). [2025-09-26T20:06:47.995271] [DEBUG] [VALIDATOR ] MQT: Validating primary data. [2025-09-26T20:06:48.387358] [DEBUG] [VALIDATOR ] MQT: All expected trading days are present. [2025-09-26T20:06:48.387442] [DEBUG] [VALIDATOR ] MQT: Primary data validation passed. [2025-09-26T20:06:48.387767] [INFO ] [MAIN ] MQT: Fetched primary data is valid. [2025-09-26T20:06:48.387830] [DEBUG] [LOCAL ] MQT: Saving primary data. [2025-09-26T20:06:48.388311] [DEBUG] [LOCAL ] MQT: Trimmed 13283 records to 8523 (keeping 200 days of data) [2025-09-26T20:06:48.453485] [DEBUG] [LOCAL ] MQT: Primary data saved (8523 records). [2025-09-26T20:06:48.453877] [INFO ] [MAIN ] MQT: Full history saved. [2025-09-26T20:06:48.454498] [INFO ] [MAIN ] Update Progress: 1398/2371 symbols completed. MQT took 25.4s. Estimated remaining: 2h 9m 59s. Rate: 7.5 symbols/min [2025-09-26T20:06:48.711821] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-04. [2025-09-26T20:06:48.854313] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-26T20:06:49.511755] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-06. [2025-09-26T20:06:50.206011] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-26T20:06:50.311744] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-05. [2025-09-26T20:06:50.443225] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-26T20:06:51.111733] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-07. [2025-09-26T20:06:51.780809] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T20:06:51.805136] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-26T20:06:51.911726] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-08. [2025-09-26T20:06:52.711705] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-06. [2025-09-26T20:06:52.951752] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-26T20:06:53.511758] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-09. [2025-09-26T20:06:54.101940] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-26T20:06:54.311716] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-07. [2025-09-26T20:06:54.660443] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-26T20:06:54.666772] [INFO ] [REMOTE ] MQY: Full fetch complete (27054 records). [2025-09-26T20:06:54.666955] [DEBUG] [VALIDATOR ] MQY: Validating primary data. [2025-09-26T20:06:55.100987] [DEBUG] [VALIDATOR ] MQY: All expected trading days are present. [2025-09-26T20:06:55.101512] [DEBUG] [VALIDATOR ] MQY: Primary data validation passed. [2025-09-26T20:06:55.102231] [INFO ] [MAIN ] MQY: Fetched primary data is valid. [2025-09-26T20:06:55.102303] [DEBUG] [LOCAL ] MQY: Saving primary data. [2025-09-26T20:06:55.103112] [DEBUG] [LOCAL ] MQY: Trimmed 27054 records to 16979 (keeping 200 days of data) [2025-09-26T20:06:55.229832] [DEBUG] [LOCAL ] MQY: Primary data saved (16979 records). [2025-09-26T20:06:55.230014] [INFO ] [MAIN ] MQY: Full history saved. [2025-09-26T20:06:55.230195] [INFO ] [MAIN ] Update Progress: 1399/2371 symbols completed. MQY took 30.5s. Estimated remaining: 2h 9m 50s. Rate: 7.5 symbols/min [2025-09-26T20:06:55.804417] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-26T20:06:55.814803] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-08. [2025-09-26T20:06:57.166334] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-26T20:06:57.174944] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-09. [2025-09-26T20:06:58.701849] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-26T20:06:58.709252] [INFO ] [REMOTE ] MRC: Full fetch complete (54739 records). [2025-09-26T20:06:58.709379] [DEBUG] [VALIDATOR ] MRC: Validating primary data. [2025-09-26T20:06:59.131273] [DEBUG] [VALIDATOR ] MRC: All expected trading days are present. [2025-09-26T20:06:59.131414] [DEBUG] [VALIDATOR ] MRC: Primary data validation passed. [2025-09-26T20:06:59.132447] [INFO ] [MAIN ] MRC: Fetched primary data is valid. [2025-09-26T20:06:59.132520] [DEBUG] [LOCAL ] MRC: Saving primary data. [2025-09-26T20:06:59.137067] [DEBUG] [LOCAL ] MRC: Trimmed 54739 records to 38128 (keeping 200 days of data) [2025-09-26T20:06:59.377445] [DEBUG] [LOCAL ] MRC: Primary data saved (38128 records). [2025-09-26T20:06:59.377606] [INFO ] [MAIN ] MRC: Full history saved. [2025-09-26T20:06:59.377777] [INFO ] [MAIN ] Update Progress: 1400/2371 symbols completed. MRC took 28.5s. Estimated remaining: 2h 9m 39s. Rate: 7.5 symbols/min [2025-09-26T20:06:59.997294] [INFO ] [MAIN ] MSA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:07:00.059890] [INFO ] [MAIN ] MS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:07:00.125095] [INFO ] [MAIN ] MRK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:07:00.166190] [INFO ] [MAIN ] MRP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:07:00.166810] [DEBUG] [LOCAL ] MRP: No existing data file found in primary storage. [2025-09-26T20:07:00.166868] [WARN ] [MAIN ] MRP: No existing data found, performing full refresh instead. [2025-09-26T20:07:00.167073] [INFO ] [MAIN ] MRP: Wiping existing primary data before full refresh. [2025-09-26T20:07:00.167128] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-09-26T20:07:00.167175] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-09-26T20:07:00.167221] [INFO ] [MAIN ] MRP: Starting full primary refresh. [2025-09-26T20:07:00.260035] [DEBUG] [LOCAL ] MSA: Loaded 18891 existing records from primary storage. [2025-09-26T20:07:00.267061] [INFO ] [MAIN ] MSA: Loaded 18891 existing records. [2025-09-26T20:07:00.698149] [DEBUG] [LOCAL ] MS: Loaded 54082 existing records from primary storage. [2025-09-26T20:07:00.784169] [WARN ] [MAIN ] MSA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:07:00.784578] [INFO ] [MAIN ] MSA: Wiping existing primary data before full refresh. [2025-09-26T20:07:00.775417] [INFO ] [MAIN ] MS: Loaded 54082 existing records. [2025-09-26T20:07:00.811952] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-09-26T20:07:00.801528] [DEBUG] [LOCAL ] MRK: Loaded 54179 existing records from primary storage. [2025-09-26T20:07:00.907248] [DEBUG] [LOCAL ] MSA: Deleted primary data file. [2025-09-26T20:07:00.924769] [INFO ] [MAIN ] MRK: Loaded 54179 existing records. [2025-09-26T20:07:00.957276] [INFO ] [MAIN ] MSA: Starting full primary refresh. [2025-09-26T20:07:00.965799] [INFO ] [REMOTE ] MRP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:07:00.973192] [INFO ] [REMOTE ] MRP: Fetching primary data for 2024-12. [2025-09-26T20:07:01.271717] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:07:01.320217] [WARN ] [REMOTE ] MRP: No data returned for month 2024-12 [2025-09-26T20:07:01.347306] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-01. [2025-09-26T20:07:01.492086] [WARN ] [MAIN ] MS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:07:01.550985] [WARN ] [MAIN ] MRK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:07:01.551173] [INFO ] [MAIN ] MS: Wiping existing primary data before full refresh. [2025-09-26T20:07:01.595382] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-09-26T20:07:01.612507] [DEBUG] [LOCAL ] MS: Deleted primary data file. [2025-09-26T20:07:01.619261] [INFO ] [MAIN ] MS: Starting full primary refresh. [2025-09-26T20:07:01.666321] [INFO ] [MAIN ] MRK: Wiping existing primary data before full refresh. [2025-09-26T20:07:01.696783] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-09-26T20:07:01.753532] [DEBUG] [LOCAL ] MRK: Deleted primary data file. [2025-09-26T20:07:01.753804] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:07:01.813869] [WARN ] [REMOTE ] MRP: No data returned for month 2025-01 [2025-09-26T20:07:01.824278] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-02. [2025-09-26T20:07:01.795702] [INFO ] [MAIN ] MRK: Starting full primary refresh. [2025-09-26T20:07:01.863315] [INFO ] [REMOTE ] MSA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:07:01.934371] [INFO ] [REMOTE ] MSA: Fetching primary data for 2024-12. [2025-09-26T20:07:02.450488] [INFO ] [REMOTE ] MS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:07:02.476770] [INFO ] [REMOTE ] MS: Fetching primary data for 2024-12. [2025-09-26T20:07:02.682311] [INFO ] [REMOTE ] MRK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:07:02.682667] [INFO ] [REMOTE ] MRK: Fetching primary data for 2024-12. [2025-09-26T20:07:03.127736] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-26T20:07:03.131780] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-01. [2025-09-26T20:07:03.456566] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T20:07:03.464833] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-03. [2025-09-26T20:07:04.069263] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-26T20:07:04.080768] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-01. [2025-09-26T20:07:04.091307] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-26T20:07:04.094963] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-02. [2025-09-26T20:07:04.810968] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-26T20:07:04.823028] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-01. [2025-09-26T20:07:05.235133] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-26T20:07:05.255195] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-26T20:07:05.511740] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-03. [2025-09-26T20:07:06.100634] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-26T20:07:06.311719] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-04. [2025-09-26T20:07:06.624163] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-26T20:07:06.879078] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-26T20:07:07.111733] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-02. [2025-09-26T20:07:07.916848] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-02. [2025-09-26T20:07:07.935102] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-26T20:07:08.711740] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-05. [2025-09-26T20:07:09.037145] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-26T20:07:09.511745] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-03. [2025-09-26T20:07:10.323922] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-04. [2025-09-26T20:07:10.328389] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-09-26T20:07:10.401626] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-26T20:07:11.111740] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-06. [2025-09-26T20:07:11.550597] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-26T20:07:11.582173] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-26T20:07:11.911721] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-03. [2025-09-26T20:07:12.235096] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-26T20:07:12.711727] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-07. [2025-09-26T20:07:13.511716] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-04. [2025-09-26T20:07:14.311697] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-05. [2025-09-26T20:07:14.425160] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-26T20:07:14.497251] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-09-26T20:07:15.111697] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-04. [2025-09-26T20:07:15.431852] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-26T20:07:15.729499] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-26T20:07:15.911724] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-08. [2025-09-26T20:07:16.711716] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-06. [2025-09-26T20:07:17.512296] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-05. [2025-09-26T20:07:17.519277] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-09-26T20:07:17.754005] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-26T20:07:17.847025] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-26T20:07:18.311730] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-07. [2025-09-26T20:07:19.111707] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-05. [2025-09-26T20:07:19.389245] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-26T20:07:19.507062] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-26T20:07:19.911729] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-06. [2025-09-26T20:07:20.711722] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-08. [2025-09-26T20:07:21.448444] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-09-26T20:07:21.511693] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-06. [2025-09-26T20:07:21.797977] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-26T20:07:21.864350] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-26T20:07:22.311754] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-09. [2025-09-26T20:07:23.111741] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-07. [2025-09-26T20:07:23.863285] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-09-26T20:07:23.911728] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-07. [2025-09-26T20:07:24.070741] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-26T20:07:24.084771] [INFO ] [REMOTE ] MRP: Full fetch complete (55266 records). [2025-09-26T20:07:24.084936] [DEBUG] [VALIDATOR ] MRP: Validating primary data. [2025-09-26T20:07:24.311223] [WARN ] [VALIDATOR ] MRP: Validation failed - insufficient historical data. Have 160 unique days, need 200 days [2025-09-26T20:07:24.311894] [FATAL] [MAIN ] MRP: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:07:24.311971] [WARN ] [MAIN ] MRP: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:07:24.312045] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-09-26T20:07:24.312117] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-09-26T20:07:24.312155] [INFO ] [LOCAL ] MRP: Starting deletion of derivative data. [2025-09-26T20:07:24.312217] [DEBUG] [LOCAL ] MRP: No derivative data file found to delete. [2025-09-26T20:07:24.312328] [INFO ] [MAIN ] Update Progress: 1401/2371 symbols completed. MRP took 24.9s. Estimated remaining: 2h 9m 43s. Rate: 7.5 symbols/min [2025-09-26T20:07:24.491308] [INFO ] [MAIN ] MSB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:07:24.506920] [DEBUG] [LOCAL ] MSB: Loaded 7865 existing records from primary storage. [2025-09-26T20:07:24.507055] [INFO ] [MAIN ] MSB: Loaded 7865 existing records. [2025-09-26T20:07:24.690576] [WARN ] [MAIN ] MSB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:07:24.690840] [INFO ] [MAIN ] MSB: Wiping existing primary data before full refresh. [2025-09-26T20:07:24.690888] [INFO ] [LOCAL ] MSB: Starting deletion of primary data. [2025-09-26T20:07:24.691259] [DEBUG] [LOCAL ] MSB: Deleted primary data file. [2025-09-26T20:07:24.691346] [INFO ] [MAIN ] MSB: Starting full primary refresh. [2025-09-26T20:07:24.723819] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-09. [2025-09-26T20:07:25.087999] [INFO ] [REMOTE ] MSB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:07:25.175487] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-26T20:07:25.511732] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-08. [2025-09-26T20:07:25.918352] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-26T20:07:25.922382] [INFO ] [REMOTE ] MSA: Full fetch complete (25749 records). [2025-09-26T20:07:25.922475] [DEBUG] [VALIDATOR ] MSA: Validating primary data. [2025-09-26T20:07:26.333247] [INFO ] [REMOTE ] MSB: Fetching primary data for 2024-12. [2025-09-26T20:07:26.347189] [DEBUG] [VALIDATOR ] MSA: All expected trading days are present. [2025-09-26T20:07:26.347272] [DEBUG] [VALIDATOR ] MSA: Primary data validation passed. [2025-09-26T20:07:26.347952] [INFO ] [MAIN ] MSA: Fetched primary data is valid. [2025-09-26T20:07:26.348111] [DEBUG] [LOCAL ] MSA: Saving primary data. [2025-09-26T20:07:26.349218] [DEBUG] [LOCAL ] MSA: Trimmed 25749 records to 18988 (keeping 200 days of data) [2025-09-26T20:07:26.506473] [DEBUG] [LOCAL ] MSA: Primary data saved (18988 records). [2025-09-26T20:07:26.506940] [INFO ] [MAIN ] MSA: Full history saved. [2025-09-26T20:07:26.508923] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-09-26T20:07:26.507549] [INFO ] [MAIN ] Update Progress: 1402/2371 symbols completed. MSA took 27.1s. Estimated remaining: 2h 9m 31s. Rate: 7.5 symbols/min [2025-09-26T20:07:26.707331] [INFO ] [MAIN ] MSC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:07:26.707553] [DEBUG] [LOCAL ] MSC: No existing data file found in primary storage. [2025-09-26T20:07:26.707609] [WARN ] [MAIN ] MSC: No existing data found, performing full refresh instead. [2025-09-26T20:07:26.707812] [INFO ] [MAIN ] MSC: Wiping existing primary data before full refresh. [2025-09-26T20:07:26.707883] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-09-26T20:07:26.707977] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-09-26T20:07:26.708046] [INFO ] [MAIN ] MSC: Starting full primary refresh. [2025-09-26T20:07:27.091927] [INFO ] [REMOTE ] MSC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:07:27.097380] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-26T20:07:27.111662] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-08. [2025-09-26T20:07:27.526354] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-26T20:07:27.911717] [INFO ] [REMOTE ] MSC: Fetching primary data for 2024-12. [2025-09-26T20:07:28.266169] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-26T20:07:28.711731] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-09. [2025-09-26T20:07:29.383679] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-26T20:07:29.511725] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-01. [2025-09-26T20:07:30.311694] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-09. [2025-09-26T20:07:30.598759] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-26T20:07:30.867377] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-26T20:07:30.877811] [INFO ] [REMOTE ] MS: Full fetch complete (77719 records). [2025-09-26T20:07:30.877953] [DEBUG] [VALIDATOR ] MS: Validating primary data. [2025-09-26T20:07:31.118411] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-01. [2025-09-26T20:07:31.291855] [DEBUG] [VALIDATOR ] MS: All expected trading days are present. [2025-09-26T20:07:31.291978] [DEBUG] [VALIDATOR ] MS: Primary data validation passed. [2025-09-26T20:07:31.293245] [INFO ] [MAIN ] MS: Fetched primary data is valid. [2025-09-26T20:07:31.293344] [DEBUG] [LOCAL ] MS: Saving primary data. [2025-09-26T20:07:31.295300] [DEBUG] [LOCAL ] MS: Trimmed 77719 records to 54472 (keeping 200 days of data) [2025-09-26T20:07:31.683414] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-26T20:07:31.714790] [DEBUG] [LOCAL ] MS: Primary data saved (54472 records). [2025-09-26T20:07:31.714971] [INFO ] [MAIN ] MS: Full history saved. [2025-09-26T20:07:31.716479] [INFO ] [MAIN ] Update Progress: 1403/2371 symbols completed. MS took 32.3s. Estimated remaining: 2h 9m 21s. Rate: 7.5 symbols/min [2025-09-26T20:07:31.889376] [INFO ] [MAIN ] MSCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:07:31.916040] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-02. [2025-09-26T20:07:31.932072] [DEBUG] [LOCAL ] MSCI: Loaded 35077 existing records from primary storage. [2025-09-26T20:07:31.932222] [INFO ] [MAIN ] MSCI: Loaded 35077 existing records. [2025-09-26T20:07:32.124776] [WARN ] [MAIN ] MSCI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:07:32.125047] [INFO ] [MAIN ] MSCI: Wiping existing primary data before full refresh. [2025-09-26T20:07:32.125097] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-09-26T20:07:32.126080] [DEBUG] [LOCAL ] MSCI: Deleted primary data file. [2025-09-26T20:07:32.126142] [INFO ] [MAIN ] MSCI: Starting full primary refresh. [2025-09-26T20:07:32.532561] [INFO ] [REMOTE ] MSCI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:07:32.525383] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-26T20:07:32.708686] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-09-26T20:07:32.712401] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-02. [2025-09-26T20:07:32.723270] [INFO ] [REMOTE ] MRK: Full fetch complete (77857 records). [2025-09-26T20:07:32.723453] [DEBUG] [VALIDATOR ] MRK: Validating primary data. [2025-09-26T20:07:33.136565] [DEBUG] [VALIDATOR ] MRK: All expected trading days are present. [2025-09-26T20:07:33.136688] [DEBUG] [VALIDATOR ] MRK: Primary data validation passed. [2025-09-26T20:07:33.137761] [INFO ] [MAIN ] MRK: Fetched primary data is valid. [2025-09-26T20:07:33.137845] [DEBUG] [LOCAL ] MRK: Saving primary data. [2025-09-26T20:07:33.139742] [DEBUG] [LOCAL ] MRK: Trimmed 77857 records to 54569 (keeping 200 days of data) [2025-09-26T20:07:33.505499] [DEBUG] [LOCAL ] MRK: Primary data saved (54569 records). [2025-09-26T20:07:33.505687] [INFO ] [MAIN ] MRK: Full history saved. [2025-09-26T20:07:33.505813] [INFO ] [MAIN ] Update Progress: 1404/2371 symbols completed. MRK took 34.1s. Estimated remaining: 2h 9m 9s. Rate: 7.5 symbols/min [2025-09-26T20:07:33.518439] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2024-12. [2025-09-26T20:07:33.642118] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-26T20:07:33.712883] [INFO ] [MAIN ] MSD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:07:33.730284] [DEBUG] [LOCAL ] MSD: Loaded 15655 existing records from primary storage. [2025-09-26T20:07:33.730469] [INFO ] [MAIN ] MSD: Loaded 15655 existing records. [2025-09-26T20:07:33.922913] [WARN ] [MAIN ] MSD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:07:33.923182] [INFO ] [MAIN ] MSD: Wiping existing primary data before full refresh. [2025-09-26T20:07:33.923234] [INFO ] [LOCAL ] MSD: Starting deletion of primary data. [2025-09-26T20:07:33.923808] [DEBUG] [LOCAL ] MSD: Deleted primary data file. [2025-09-26T20:07:33.923873] [INFO ] [MAIN ] MSD: Starting full primary refresh. [2025-09-26T20:07:34.305575] [INFO ] [REMOTE ] MSD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:07:34.311743] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-03. [2025-09-26T20:07:34.922791] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-26T20:07:34.949277] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-26T20:07:35.111747] [INFO ] [REMOTE ] MSD: Fetching primary data for 2024-12. [2025-09-26T20:07:35.911701] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-04. [2025-09-26T20:07:35.994691] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-26T20:07:36.174254] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-09-26T20:07:36.711731] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-01. [2025-09-26T20:07:37.511750] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-05. [2025-09-26T20:07:37.873332] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-26T20:07:38.049436] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-26T20:07:38.311697] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-02. [2025-09-26T20:07:39.111737] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-01. [2025-09-26T20:07:39.905952] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-26T20:07:39.913191] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-03. [2025-09-26T20:07:39.946003] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-26T20:07:40.711708] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-03. [2025-09-26T20:07:40.745374] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-26T20:07:41.511729] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-02. [2025-09-26T20:07:42.284351] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-26T20:07:42.311673] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-04. [2025-09-26T20:07:42.376101] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-26T20:07:43.111725] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-06. [2025-09-26T20:07:43.372837] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-09-26T20:07:43.902546] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-26T20:07:43.911661] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-05. [2025-09-26T20:07:44.711731] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-07. [2025-09-26T20:07:45.146915] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-26T20:07:45.293521] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-26T20:07:45.511727] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-04. [2025-09-26T20:07:46.311708] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-03. [2025-09-26T20:07:46.367495] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-26T20:07:47.111702] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-05. [2025-09-26T20:07:47.305734] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-26T20:07:47.911719] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-08. [2025-09-26T20:07:47.945154] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-26T20:07:48.260846] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-26T20:07:48.711725] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-04. [2025-09-26T20:07:49.511699] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-06. [2025-09-26T20:07:49.549105] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-26T20:07:50.311678] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-06. [2025-09-26T20:07:50.777575] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-26T20:07:51.040045] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-26T20:07:51.111724] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-09-26T20:07:51.554031] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-26T20:07:51.555286] [INFO ] [REMOTE ] MSC: Full fetch complete (2509 records). [2025-09-26T20:07:51.555358] [DEBUG] [VALIDATOR ] MSC: Validating primary data. [2025-09-26T20:07:51.756312] [WARN ] [VALIDATOR ] MSC: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-09-26T20:07:51.756532] [FATAL] [MAIN ] MSC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:07:51.756621] [WARN ] [MAIN ] MSC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:07:51.756735] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-09-26T20:07:51.756821] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-09-26T20:07:51.756924] [INFO ] [LOCAL ] MSC: Starting deletion of derivative data. [2025-09-26T20:07:51.757012] [DEBUG] [LOCAL ] MSC: No derivative data file found to delete. [2025-09-26T20:07:51.757126] [INFO ] [MAIN ] Update Progress: 1405/2371 symbols completed. MSC took 25.2s. Estimated remaining: 2h 9m 8s. Rate: 7.5 symbols/min [2025-09-26T20:07:51.933766] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-05. [2025-09-26T20:07:51.973347] [INFO ] [MAIN ] MSDL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:07:52.024425] [DEBUG] [LOCAL ] MSDL: Loaded 38380 existing records from primary storage. [2025-09-26T20:07:52.024600] [INFO ] [MAIN ] MSDL: Loaded 38380 existing records. [2025-09-26T20:07:52.208713] [WARN ] [MAIN ] MSDL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:07:52.208980] [INFO ] [MAIN ] MSDL: Wiping existing primary data before full refresh. [2025-09-26T20:07:52.209037] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-09-26T20:07:52.209884] [DEBUG] [LOCAL ] MSDL: Deleted primary data file. [2025-09-26T20:07:52.209949] [INFO ] [MAIN ] MSDL: Starting full primary refresh. [2025-09-26T20:07:52.580447] [INFO ] [REMOTE ] MSDL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:07:52.711739] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-07. [2025-09-26T20:07:52.852186] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-26T20:07:53.511720] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-07. [2025-09-26T20:07:53.532501] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-26T20:07:54.311715] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2024-12. [2025-09-26T20:07:55.100848] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-26T20:07:55.111674] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-08. [2025-09-26T20:07:55.768540] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-26T20:07:55.889092] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-26T20:07:55.911679] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-08. [2025-09-26T20:07:56.711732] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-06. [2025-09-26T20:07:57.432771] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-26T20:07:57.510144] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-26T20:07:57.512400] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-01. [2025-09-26T20:07:58.311709] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-07. [2025-09-26T20:07:59.014766] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-26T20:07:59.111717] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-09. [2025-09-26T20:07:59.300392] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-26T20:07:59.911728] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-09. [2025-09-26T20:08:00.627366] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-26T20:08:00.629243] [INFO ] [REMOTE ] MSB: Full fetch complete (12858 records). [2025-09-26T20:08:00.629318] [DEBUG] [VALIDATOR ] MSB: Validating primary data. [2025-09-26T20:08:00.718993] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-02. [2025-09-26T20:08:01.067961] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-26T20:08:01.068391] [DEBUG] [VALIDATOR ] MSB: All expected trading days are present. [2025-09-26T20:08:01.076329] [DEBUG] [VALIDATOR ] MSB: Primary data validation passed. [2025-09-26T20:08:01.077421] [INFO ] [MAIN ] MSB: Fetched primary data is valid. [2025-09-26T20:08:01.077510] [DEBUG] [LOCAL ] MSB: Saving primary data. [2025-09-26T20:08:01.078467] [INFO ] [REMOTE ] MSCI: Full fetch complete (50426 records). [2025-09-26T20:08:01.078914] [DEBUG] [LOCAL ] MSB: Trimmed 12858 records to 7895 (keeping 200 days of data) [2025-09-26T20:08:01.079094] [DEBUG] [VALIDATOR ] MSCI: Validating primary data. [2025-09-26T20:08:01.295939] [DEBUG] [LOCAL ] MSB: Primary data saved (7895 records). [2025-09-26T20:08:01.307276] [INFO ] [MAIN ] MSB: Full history saved. [2025-09-26T20:08:01.338991] [INFO ] [MAIN ] Update Progress: 1406/2371 symbols completed. MSB took 37.0s. Estimated remaining: 2h 9m 1s. Rate: 7.5 symbols/min [2025-09-26T20:08:01.517524] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-08. [2025-09-26T20:08:01.783736] [DEBUG] [VALIDATOR ] MSCI: All expected trading days are present. [2025-09-26T20:08:01.787546] [INFO ] [MAIN ] MSGE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:08:01.788109] [DEBUG] [VALIDATOR ] MSCI: Primary data validation passed. [2025-09-26T20:08:01.790073] [INFO ] [MAIN ] MSCI: Fetched primary data is valid. [2025-09-26T20:08:01.790308] [DEBUG] [LOCAL ] MSCI: Saving primary data. [2025-09-26T20:08:01.792466] [DEBUG] [LOCAL ] MSCI: Trimmed 50426 records to 35351 (keeping 200 days of data) [2025-09-26T20:08:01.937606] [DEBUG] [LOCAL ] MSGE: Loaded 27270 existing records from primary storage. [2025-09-26T20:08:01.942090] [INFO ] [MAIN ] MSGE: Loaded 27270 existing records. [2025-09-26T20:08:02.180370] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-26T20:08:02.189226] [WARN ] [MAIN ] MSGE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:08:02.199205] [INFO ] [MAIN ] MSGE: Wiping existing primary data before full refresh. [2025-09-26T20:08:02.199766] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-09-26T20:08:02.201053] [DEBUG] [LOCAL ] MSGE: Deleted primary data file. [2025-09-26T20:08:02.201708] [INFO ] [MAIN ] MSGE: Starting full primary refresh. [2025-09-26T20:08:02.313683] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-03. [2025-09-26T20:08:02.700504] [INFO ] [REMOTE ] MSGE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:08:02.719474] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-26T20:08:02.755942] [DEBUG] [LOCAL ] MSCI: Primary data saved (35351 records). [2025-09-26T20:08:02.756739] [INFO ] [MAIN ] MSCI: Full history saved. [2025-09-26T20:08:02.756908] [INFO ] [MAIN ] Update Progress: 1407/2371 symbols completed. MSCI took 31.0s. Estimated remaining: 2h 8m 48s. Rate: 7.5 symbols/min [2025-09-26T20:08:02.949873] [INFO ] [MAIN ] MSGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:08:02.972430] [DEBUG] [LOCAL ] MSGS: Loaded 17083 existing records from primary storage. [2025-09-26T20:08:02.972579] [INFO ] [MAIN ] MSGS: Loaded 17083 existing records. [2025-09-26T20:08:03.118338] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-09. [2025-09-26T20:08:03.212752] [WARN ] [MAIN ] MSGS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:08:03.213105] [INFO ] [MAIN ] MSGS: Wiping existing primary data before full refresh. [2025-09-26T20:08:03.213179] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-09-26T20:08:03.213563] [DEBUG] [LOCAL ] MSGS: Deleted primary data file. [2025-09-26T20:08:03.213626] [INFO ] [MAIN ] MSGS: Starting full primary refresh. [2025-09-26T20:08:03.772602] [INFO ] [REMOTE ] MSGS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:08:03.904264] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-26T20:08:03.914067] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2024-12. [2025-09-26T20:08:04.436079] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-26T20:08:04.445027] [INFO ] [REMOTE ] MSD: Full fetch complete (22270 records). [2025-09-26T20:08:04.445223] [DEBUG] [VALIDATOR ] MSD: Validating primary data. [2025-09-26T20:08:04.718217] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-04. [2025-09-26T20:08:04.877294] [DEBUG] [VALIDATOR ] MSD: All expected trading days are present. [2025-09-26T20:08:04.877496] [DEBUG] [VALIDATOR ] MSD: Primary data validation passed. [2025-09-26T20:08:04.878044] [INFO ] [MAIN ] MSD: Fetched primary data is valid. [2025-09-26T20:08:04.878124] [DEBUG] [LOCAL ] MSD: Saving primary data. [2025-09-26T20:08:04.879091] [DEBUG] [LOCAL ] MSD: Trimmed 22270 records to 15775 (keeping 200 days of data) [2025-09-26T20:08:04.970929] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-26T20:08:05.002411] [DEBUG] [LOCAL ] MSD: Primary data saved (15775 records). [2025-09-26T20:08:05.002577] [INFO ] [MAIN ] MSD: Full history saved. [2025-09-26T20:08:05.002695] [INFO ] [MAIN ] Update Progress: 1408/2371 symbols completed. MSD took 31.5s. Estimated remaining: 2h 8m 36s. Rate: 7.5 symbols/min [2025-09-26T20:08:05.175763] [INFO ] [MAIN ] MSI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:08:05.222505] [DEBUG] [LOCAL ] MSI: Loaded 40895 existing records from primary storage. [2025-09-26T20:08:05.222675] [INFO ] [MAIN ] MSI: Loaded 40895 existing records. [2025-09-26T20:08:05.414599] [WARN ] [MAIN ] MSI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:08:05.415231] [INFO ] [MAIN ] MSI: Wiping existing primary data before full refresh. [2025-09-26T20:08:05.415288] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-09-26T20:08:05.416201] [DEBUG] [LOCAL ] MSI: Deleted primary data file. [2025-09-26T20:08:05.416264] [INFO ] [MAIN ] MSI: Starting full primary refresh. [2025-09-26T20:08:05.518270] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2024-12. [2025-09-26T20:08:05.793888] [INFO ] [REMOTE ] MSI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:08:06.219959] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-26T20:08:06.311704] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-01. [2025-09-26T20:08:06.736617] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-26T20:08:07.111724] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-05. [2025-09-26T20:08:07.564853] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-26T20:08:07.911731] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-01. [2025-09-26T20:08:08.490162] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-26T20:08:08.523567] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-26T20:08:08.711730] [INFO ] [REMOTE ] MSI: Fetching primary data for 2024-12. [2025-09-26T20:08:09.511724] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-02. [2025-09-26T20:08:10.280166] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-26T20:08:10.311678] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-02. [2025-09-26T20:08:10.539990] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-26T20:08:11.111721] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-01. [2025-09-26T20:08:11.532110] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-26T20:08:11.911730] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-03. [2025-09-26T20:08:12.720922] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-06. [2025-09-26T20:08:12.724262] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-26T20:08:13.005732] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-26T20:08:13.511727] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-04. [2025-09-26T20:08:14.068514] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-26T20:08:14.311717] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-07. [2025-09-26T20:08:14.521932] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-26T20:08:15.111716] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-03. [2025-09-26T20:08:15.779084] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-26T20:08:15.911729] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-08. [2025-09-26T20:08:16.499752] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-26T20:08:16.711724] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-02. [2025-09-26T20:08:17.465128] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-26T20:08:17.511742] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-04. [2025-09-26T20:08:18.277863] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-26T20:08:18.311707] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-09. [2025-09-26T20:08:18.608277] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-26T20:08:19.111766] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-05. [2025-09-26T20:08:19.911735] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-05. [2025-09-26T20:08:19.978679] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-26T20:08:19.987160] [INFO ] [REMOTE ] MSDL: Full fetch complete (54441 records). [2025-09-26T20:08:19.987301] [DEBUG] [VALIDATOR ] MSDL: Validating primary data. [2025-09-26T20:08:20.224707] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-26T20:08:20.452885] [DEBUG] [VALIDATOR ] MSDL: All expected trading days are present. [2025-09-26T20:08:20.452988] [DEBUG] [VALIDATOR ] MSDL: Primary data validation passed. [2025-09-26T20:08:20.453951] [INFO ] [MAIN ] MSDL: Fetched primary data is valid. [2025-09-26T20:08:20.454021] [DEBUG] [LOCAL ] MSDL: Saving primary data. [2025-09-26T20:08:20.455400] [DEBUG] [LOCAL ] MSDL: Trimmed 54441 records to 38645 (keeping 200 days of data) [2025-09-26T20:08:20.704635] [DEBUG] [LOCAL ] MSDL: Primary data saved (38645 records). [2025-09-26T20:08:20.704831] [INFO ] [MAIN ] MSDL: Full history saved. [2025-09-26T20:08:20.704940] [INFO ] [MAIN ] Update Progress: 1409/2371 symbols completed. MSDL took 28.9s. Estimated remaining: 2h 8m 34s. Rate: 7.5 symbols/min [2025-09-26T20:08:20.717269] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-03. [2025-09-26T20:08:20.910907] [INFO ] [MAIN ] MSIF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:08:20.911101] [DEBUG] [LOCAL ] MSIF: No existing data file found in primary storage. [2025-09-26T20:08:20.911155] [WARN ] [MAIN ] MSIF: No existing data found, performing full refresh instead. [2025-09-26T20:08:20.911306] [INFO ] [MAIN ] MSIF: Wiping existing primary data before full refresh. [2025-09-26T20:08:20.911351] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-09-26T20:08:20.911399] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-09-26T20:08:20.911433] [INFO ] [MAIN ] MSIF: Starting full primary refresh. [2025-09-26T20:08:21.251287] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-26T20:08:21.340964] [INFO ] [REMOTE ] MSIF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:08:21.511758] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2024-12. [2025-09-26T20:08:21.738096] [DEBUG] [REMOTE ] MSIF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:08:21.738453] [WARN ] [REMOTE ] MSIF: No data returned for month 2024-12 [2025-09-26T20:08:22.295377] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-26T20:08:22.311682] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-04. [2025-09-26T20:08:23.111741] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-06. [2025-09-26T20:08:23.911712] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-01. [2025-09-26T20:08:24.021615] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-26T20:08:24.082459] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-26T20:08:24.376436] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-26T20:08:24.711753] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-02. [2025-09-26T20:08:25.511691] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-05. [2025-09-26T20:08:25.600069] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-26T20:08:26.311746] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-03. [2025-09-26T20:08:27.111701] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-06. [2025-09-26T20:08:27.206923] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-26T20:08:27.243157] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-26T20:08:27.912452] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-04. [2025-09-26T20:08:27.916220] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-26T20:08:28.711714] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-06. [2025-09-26T20:08:28.744887] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-26T20:08:29.511734] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-05. [2025-09-26T20:08:30.149706] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-26T20:08:30.231246] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-26T20:08:30.311722] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-07. [2025-09-26T20:08:31.111702] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-07. [2025-09-26T20:08:31.352598] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-26T20:08:31.911726] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-07. [2025-09-26T20:08:32.467789] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-26T20:08:32.711744] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-06. [2025-09-26T20:08:33.457675] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-26T20:08:33.511715] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-08. [2025-09-26T20:08:33.771401] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-26T20:08:34.311687] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-08. [2025-09-26T20:08:34.537107] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-26T20:08:35.111741] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-07. [2025-09-26T20:08:35.911703] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-09. [2025-09-26T20:08:35.931765] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-26T20:08:36.117077] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-26T20:08:36.711717] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-08. [2025-09-26T20:08:37.175349] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-26T20:08:37.180088] [INFO ] [REMOTE ] MSGS: Full fetch complete (22690 records). [2025-09-26T20:08:37.180185] [DEBUG] [VALIDATOR ] MSGS: Validating primary data. [2025-09-26T20:08:37.516816] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-08. [2025-09-26T20:08:37.602565] [DEBUG] [VALIDATOR ] MSGS: All expected trading days are present. [2025-09-26T20:08:37.602677] [DEBUG] [VALIDATOR ] MSGS: Primary data validation passed. [2025-09-26T20:08:37.603272] [INFO ] [MAIN ] MSGS: Fetched primary data is valid. [2025-09-26T20:08:37.603315] [DEBUG] [LOCAL ] MSGS: Saving primary data. [2025-09-26T20:08:37.604109] [DEBUG] [LOCAL ] MSGS: Trimmed 22690 records to 17318 (keeping 200 days of data) [2025-09-26T20:08:37.720914] [DEBUG] [LOCAL ] MSGS: Primary data saved (17318 records). [2025-09-26T20:08:37.721069] [INFO ] [MAIN ] MSGS: Full history saved. [2025-09-26T20:08:37.721164] [INFO ] [MAIN ] Update Progress: 1410/2371 symbols completed. MSGS took 35.0s. Estimated remaining: 2h 8m 32s. Rate: 7.5 symbols/min [2025-09-26T20:08:37.932550] [INFO ] [MAIN ] MSM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:08:37.943247] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-26T20:08:37.982409] [DEBUG] [LOCAL ] MSM: Loaded 35693 existing records from primary storage. [2025-09-26T20:08:37.982550] [INFO ] [MAIN ] MSM: Loaded 35693 existing records. [2025-09-26T20:08:38.162761] [WARN ] [MAIN ] MSM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:08:38.163010] [INFO ] [MAIN ] MSM: Wiping existing primary data before full refresh. [2025-09-26T20:08:38.163057] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-09-26T20:08:38.164024] [DEBUG] [LOCAL ] MSM: Deleted primary data file. [2025-09-26T20:08:38.164087] [INFO ] [MAIN ] MSM: Starting full primary refresh. [2025-09-26T20:08:38.317157] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-09. [2025-09-26T20:08:38.537994] [INFO ] [REMOTE ] MSM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:08:38.724292] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-26T20:08:39.111700] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-09. [2025-09-26T20:08:39.322891] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-26T20:08:39.327403] [INFO ] [REMOTE ] MSIF: Full fetch complete (16532 records). [2025-09-26T20:08:39.327493] [DEBUG] [VALIDATOR ] MSIF: Validating primary data. [2025-09-26T20:08:39.515297] [WARN ] [VALIDATOR ] MSIF: Validation failed - insufficient historical data. Have 166 unique days, need 200 days [2025-09-26T20:08:39.515631] [FATAL] [MAIN ] MSIF: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:08:39.515724] [WARN ] [MAIN ] MSIF: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:08:39.515795] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-09-26T20:08:39.515862] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-09-26T20:08:39.515900] [INFO ] [LOCAL ] MSIF: Starting deletion of derivative data. [2025-09-26T20:08:39.515980] [DEBUG] [LOCAL ] MSIF: No derivative data file found to delete. [2025-09-26T20:08:39.516074] [INFO ] [MAIN ] Update Progress: 1411/2371 symbols completed. MSIF took 18.8s. Estimated remaining: 2h 8m 19s. Rate: 7.5 symbols/min [2025-09-26T20:08:39.690450] [INFO ] [MAIN ] MT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:08:39.746392] [DEBUG] [LOCAL ] MT: Loaded 51034 existing records from primary storage. [2025-09-26T20:08:39.746540] [INFO ] [MAIN ] MT: Loaded 51034 existing records. [2025-09-26T20:08:39.911891] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-09. [2025-09-26T20:08:39.936229] [WARN ] [MAIN ] MT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:08:39.937437] [INFO ] [MAIN ] MT: Wiping existing primary data before full refresh. [2025-09-26T20:08:39.937490] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-09-26T20:08:39.938781] [DEBUG] [LOCAL ] MT: Deleted primary data file. [2025-09-26T20:08:39.938847] [INFO ] [MAIN ] MT: Starting full primary refresh. [2025-09-26T20:08:40.327006] [INFO ] [REMOTE ] MT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:08:40.343614] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-26T20:08:40.350775] [INFO ] [REMOTE ] MSGE: Full fetch complete (40180 records). [2025-09-26T20:08:40.350888] [DEBUG] [VALIDATOR ] MSGE: Validating primary data. [2025-09-26T20:08:40.712359] [INFO ] [REMOTE ] MSM: Fetching primary data for 2024-12. [2025-09-26T20:08:40.746721] [DEBUG] [VALIDATOR ] MSGE: All expected trading days are present. [2025-09-26T20:08:40.746820] [DEBUG] [VALIDATOR ] MSGE: Primary data validation passed. [2025-09-26T20:08:40.747723] [INFO ] [MAIN ] MSGE: Fetched primary data is valid. [2025-09-26T20:08:40.747791] [DEBUG] [LOCAL ] MSGE: Saving primary data. [2025-09-26T20:08:40.748977] [DEBUG] [LOCAL ] MSGE: Trimmed 40180 records to 27513 (keeping 200 days of data) [2025-09-26T20:08:40.929855] [DEBUG] [LOCAL ] MSGE: Primary data saved (27513 records). [2025-09-26T20:08:40.930037] [INFO ] [MAIN ] MSGE: Full history saved. [2025-09-26T20:08:40.930136] [INFO ] [MAIN ] Update Progress: 1412/2371 symbols completed. MSGE took 39.6s. Estimated remaining: 2h 8m 7s. Rate: 7.5 symbols/min [2025-09-26T20:08:41.111691] [INFO ] [MAIN ] MTAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:08:41.154300] [DEBUG] [LOCAL ] MTAL: Loaded 36633 existing records from primary storage. [2025-09-26T20:08:41.154442] [INFO ] [MAIN ] MTAL: Loaded 36633 existing records. [2025-09-26T20:08:41.347151] [WARN ] [MAIN ] MTAL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:08:41.347449] [INFO ] [MAIN ] MTAL: Wiping existing primary data before full refresh. [2025-09-26T20:08:41.347521] [INFO ] [LOCAL ] MTAL: Starting deletion of primary data. [2025-09-26T20:08:41.348309] [DEBUG] [LOCAL ] MTAL: Deleted primary data file. [2025-09-26T20:08:41.348395] [INFO ] [MAIN ] MTAL: Starting full primary refresh. [2025-09-26T20:08:41.516958] [INFO ] [REMOTE ] MT: Fetching primary data for 2024-12. [2025-09-26T20:08:41.748463] [INFO ] [REMOTE ] MTAL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:08:41.875418] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-26T20:08:41.883325] [INFO ] [REMOTE ] MSI: Full fetch complete (58602 records). [2025-09-26T20:08:41.883471] [DEBUG] [VALIDATOR ] MSI: Validating primary data. [2025-09-26T20:08:42.303776] [DEBUG] [VALIDATOR ] MSI: All expected trading days are present. [2025-09-26T20:08:42.304016] [DEBUG] [VALIDATOR ] MSI: Primary data validation passed. [2025-09-26T20:08:42.305099] [INFO ] [MAIN ] MSI: Fetched primary data is valid. [2025-09-26T20:08:42.318593] [DEBUG] [LOCAL ] MSI: Saving primary data. [2025-09-26T20:08:42.318473] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2024-12. [2025-09-26T20:08:42.329552] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-26T20:08:42.338370] [DEBUG] [LOCAL ] MSI: Trimmed 58602 records to 41128 (keeping 200 days of data) [2025-09-26T20:08:42.615189] [DEBUG] [LOCAL ] MSI: Primary data saved (41128 records). [2025-09-26T20:08:42.615330] [INFO ] [MAIN ] MSI: Full history saved. [2025-09-26T20:08:42.617377] [INFO ] [MAIN ] Update Progress: 1413/2371 symbols completed. MSI took 37.6s. Estimated remaining: 2h 7m 55s. Rate: 7.5 symbols/min [2025-09-26T20:08:42.803573] [INFO ] [MAIN ] MTB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:08:42.861993] [DEBUG] [LOCAL ] MTB: Loaded 47284 existing records from primary storage. [2025-09-26T20:08:42.862147] [INFO ] [MAIN ] MTB: Loaded 47284 existing records. [2025-09-26T20:08:43.048973] [WARN ] [MAIN ] MTB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:08:43.049216] [INFO ] [MAIN ] MTB: Wiping existing primary data before full refresh. [2025-09-26T20:08:43.049269] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-09-26T20:08:43.050188] [DEBUG] [LOCAL ] MTB: Deleted primary data file. [2025-09-26T20:08:43.050249] [INFO ] [MAIN ] MTB: Starting full primary refresh. [2025-09-26T20:08:43.117347] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-01. [2025-09-26T20:08:43.435630] [INFO ] [REMOTE ] MTB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:08:43.482050] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-26T20:08:43.645252] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-26T20:08:43.911790] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-01. [2025-09-26T20:08:44.661198] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-26T20:08:44.711702] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-01. [2025-09-26T20:08:45.036410] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-26T20:08:45.511766] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-02. [2025-09-26T20:08:46.311691] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-02. [2025-09-26T20:08:46.533559] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-26T20:08:46.937736] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-26T20:08:47.111726] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-03. [2025-09-26T20:08:47.540956] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-26T20:08:47.911739] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-02. [2025-09-26T20:08:48.577778] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-26T20:08:48.711738] [INFO ] [REMOTE ] MTB: Fetching primary data for 2024-12. [2025-09-26T20:08:49.237841] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-26T20:08:49.511734] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-03. [2025-09-26T20:08:50.311704] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-04. [2025-09-26T20:08:50.690465] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-26T20:08:51.111706] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-01. [2025-09-26T20:08:51.406072] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-26T20:08:51.901124] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-26T20:08:51.911681] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-05. [2025-09-26T20:08:52.711696] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-03. [2025-09-26T20:08:52.763256] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-26T20:08:53.309211] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-26T20:08:53.511680] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-06. [2025-09-26T20:08:53.912188] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-26T20:08:54.311733] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-04. [2025-09-26T20:08:54.935532] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-26T20:08:55.111714] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-07. [2025-09-26T20:08:55.911694] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-02. [2025-09-26T20:08:56.233020] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-26T20:08:56.711702] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-05. [2025-09-26T20:08:56.801589] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-26T20:08:57.488866] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-26T20:08:57.511674] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-03. [2025-09-26T20:08:58.311712] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-04. [2025-09-26T20:08:58.521267] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-26T20:08:59.111714] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-06. [2025-09-26T20:08:59.322605] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-26T20:08:59.688103] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-26T20:08:59.911729] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-04. [2025-09-26T20:09:00.501893] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-26T20:09:00.711734] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-07. [2025-09-26T20:09:01.511726] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-05. [2025-09-26T20:09:02.008148] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-26T20:09:02.311698] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-08. [2025-09-26T20:09:02.540407] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-26T20:09:02.555983] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-26T20:09:03.111744] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-05. [2025-09-26T20:09:03.630574] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-26T20:09:03.911727] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-06. [2025-09-26T20:09:04.716988] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-09. [2025-09-26T20:09:04.730591] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-26T20:09:05.360032] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-26T20:09:05.511742] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-07. [2025-09-26T20:09:06.311703] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-08. [2025-09-26T20:09:06.385276] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-26T20:09:06.393460] [INFO ] [REMOTE ] MSM: Full fetch complete (52161 records). [2025-09-26T20:09:06.393612] [DEBUG] [VALIDATOR ] MSM: Validating primary data. [2025-09-26T20:09:06.846428] [DEBUG] [VALIDATOR ] MSM: All expected trading days are present. [2025-09-26T20:09:06.846549] [DEBUG] [VALIDATOR ] MSM: Primary data validation passed. [2025-09-26T20:09:06.847605] [INFO ] [MAIN ] MSM: Fetched primary data is valid. [2025-09-26T20:09:06.848312] [DEBUG] [LOCAL ] MSM: Saving primary data. [2025-09-26T20:09:06.849413] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-26T20:09:06.859211] [DEBUG] [LOCAL ] MSM: Trimmed 52161 records to 36004 (keeping 200 days of data) [2025-09-26T20:09:07.085099] [DEBUG] [LOCAL ] MSM: Primary data saved (36004 records). [2025-09-26T20:09:07.085260] [INFO ] [MAIN ] MSM: Full history saved. [2025-09-26T20:09:07.085354] [INFO ] [MAIN ] Update Progress: 1414/2371 symbols completed. MSM took 29.4s. Estimated remaining: 2h 7m 58s. Rate: 7.5 symbols/min [2025-09-26T20:09:07.118246] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-06. [2025-09-26T20:09:07.264537] [INFO ] [MAIN ] MTD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:09:07.282334] [DEBUG] [LOCAL ] MTD: Loaded 15274 existing records from primary storage. [2025-09-26T20:09:07.282456] [INFO ] [MAIN ] MTD: Loaded 15274 existing records. [2025-09-26T20:09:07.465050] [WARN ] [MAIN ] MTD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:09:07.465321] [INFO ] [MAIN ] MTD: Wiping existing primary data before full refresh. [2025-09-26T20:09:07.465369] [INFO ] [LOCAL ] MTD: Starting deletion of primary data. [2025-09-26T20:09:07.465784] [DEBUG] [LOCAL ] MTD: Deleted primary data file. [2025-09-26T20:09:07.465849] [INFO ] [MAIN ] MTD: Starting full primary refresh. [2025-09-26T20:09:07.836456] [INFO ] [REMOTE ] MTD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:09:07.911693] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-08. [2025-09-26T20:09:08.151906] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-26T20:09:08.671429] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T20:09:08.711728] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-09. [2025-09-26T20:09:09.461500] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-26T20:09:09.511732] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-09. [2025-09-26T20:09:10.311705] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-07. [2025-09-26T20:09:10.531674] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-26T20:09:10.541384] [INFO ] [REMOTE ] MT: Full fetch complete (73461 records). [2025-09-26T20:09:10.541539] [DEBUG] [VALIDATOR ] MT: Validating primary data. [2025-09-26T20:09:10.958068] [DEBUG] [VALIDATOR ] MT: All expected trading days are present. [2025-09-26T20:09:10.958164] [DEBUG] [VALIDATOR ] MT: Primary data validation passed. [2025-09-26T20:09:10.959169] [INFO ] [MAIN ] MT: Fetched primary data is valid. [2025-09-26T20:09:10.959236] [DEBUG] [LOCAL ] MT: Saving primary data. [2025-09-26T20:09:10.961379] [DEBUG] [LOCAL ] MT: Trimmed 73461 records to 51417 (keeping 200 days of data) [2025-09-26T20:09:11.109625] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-26T20:09:11.112687] [INFO ] [REMOTE ] MTD: Fetching primary data for 2024-12. [2025-09-26T20:09:11.179293] [INFO ] [REMOTE ] MTAL: Full fetch complete (47162 records). [2025-09-26T20:09:11.179571] [DEBUG] [VALIDATOR ] MTAL: Validating primary data. [2025-09-26T20:09:11.648461] [DEBUG] [VALIDATOR ] MTAL: All expected trading days are present. [2025-09-26T20:09:11.648868] [DEBUG] [VALIDATOR ] MTAL: Primary data validation passed. [2025-09-26T20:09:11.651135] [INFO ] [MAIN ] MTAL: Fetched primary data is valid. [2025-09-26T20:09:11.651232] [DEBUG] [LOCAL ] MTAL: Saving primary data. [2025-09-26T20:09:11.660935] [DEBUG] [LOCAL ] MTAL: Trimmed 47162 records to 37002 (keeping 200 days of data) [2025-09-26T20:09:11.829335] [DEBUG] [LOCAL ] MT: Primary data saved (51417 records). [2025-09-26T20:09:11.830510] [INFO ] [MAIN ] MT: Full history saved. [2025-09-26T20:09:11.830987] [INFO ] [MAIN ] Update Progress: 1415/2371 symbols completed. MT took 32.3s. Estimated remaining: 2h 7m 47s. Rate: 7.5 symbols/min [2025-09-26T20:09:12.038110] [INFO ] [MAIN ] MTDR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:09:12.050372] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-26T20:09:12.055335] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-01. [2025-09-26T20:09:12.191487] [DEBUG] [LOCAL ] MTAL: Primary data saved (37002 records). [2025-09-26T20:09:12.192000] [INFO ] [MAIN ] MTAL: Full history saved. [2025-09-26T20:09:12.192187] [INFO ] [MAIN ] Update Progress: 1416/2371 symbols completed. MTAL took 31.3s. Estimated remaining: 2h 7m 34s. Rate: 7.5 symbols/min [2025-09-26T20:09:12.354983] [DEBUG] [LOCAL ] MTDR: Loaded 51936 existing records from primary storage. [2025-09-26T20:09:12.381902] [INFO ] [MAIN ] MTDR: Loaded 51936 existing records. [2025-09-26T20:09:12.397411] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-26T20:09:12.467034] [INFO ] [MAIN ] MTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:09:12.651963] [WARN ] [MAIN ] MTDR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:09:12.652397] [INFO ] [MAIN ] MTDR: Wiping existing primary data before full refresh. [2025-09-26T20:09:12.652453] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-09-26T20:09:12.653703] [DEBUG] [LOCAL ] MTDR: Deleted primary data file. [2025-09-26T20:09:12.653803] [INFO ] [MAIN ] MTDR: Starting full primary refresh. [2025-09-26T20:09:12.722271] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-08. [2025-09-26T20:09:12.854233] [DEBUG] [LOCAL ] MTG: Loaded 51745 existing records from primary storage. [2025-09-26T20:09:12.854506] [INFO ] [MAIN ] MTG: Loaded 51745 existing records. [2025-09-26T20:09:12.893403] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-26T20:09:13.338020] [WARN ] [MAIN ] MTG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:09:13.389949] [INFO ] [MAIN ] MTG: Wiping existing primary data before full refresh. [2025-09-26T20:09:13.411342] [INFO ] [REMOTE ] MTDR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:09:13.411436] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-09-26T20:09:13.412832] [DEBUG] [LOCAL ] MTG: Deleted primary data file. [2025-09-26T20:09:13.412897] [INFO ] [MAIN ] MTG: Starting full primary refresh. [2025-09-26T20:09:13.517355] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-02. [2025-09-26T20:09:13.787575] [INFO ] [REMOTE ] MTG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:09:14.311711] [INFO ] [REMOTE ] MTG: Fetching primary data for 2024-12. [2025-09-26T20:09:14.391180] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-26T20:09:14.595441] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-26T20:09:15.111721] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-03. [2025-09-26T20:09:15.857008] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-26T20:09:15.911722] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2024-12. [2025-09-26T20:09:16.118924] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-26T20:09:16.711729] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-04. [2025-09-26T20:09:17.511790] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-09. [2025-09-26T20:09:17.629610] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-26T20:09:18.048848] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-26T20:09:18.311708] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-01. [2025-09-26T20:09:19.111723] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-01. [2025-09-26T20:09:19.266347] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-26T20:09:19.275492] [INFO ] [REMOTE ] MTB: Full fetch complete (68266 records). [2025-09-26T20:09:19.275671] [DEBUG] [VALIDATOR ] MTB: Validating primary data. [2025-09-26T20:09:19.690028] [DEBUG] [VALIDATOR ] MTB: All expected trading days are present. [2025-09-26T20:09:19.690145] [DEBUG] [VALIDATOR ] MTB: Primary data validation passed. [2025-09-26T20:09:19.691126] [INFO ] [MAIN ] MTB: Fetched primary data is valid. [2025-09-26T20:09:19.691209] [DEBUG] [LOCAL ] MTB: Saving primary data. [2025-09-26T20:09:19.692814] [DEBUG] [LOCAL ] MTB: Trimmed 68266 records to 47562 (keeping 200 days of data) [2025-09-26T20:09:19.919706] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-05. [2025-09-26T20:09:19.958968] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-26T20:09:20.057028] [DEBUG] [LOCAL ] MTB: Primary data saved (47562 records). [2025-09-26T20:09:20.057180] [INFO ] [MAIN ] MTB: Full history saved. [2025-09-26T20:09:20.057961] [INFO ] [MAIN ] Update Progress: 1417/2371 symbols completed. MTB took 37.4s. Estimated remaining: 2h 7m 26s. Rate: 7.5 symbols/min [2025-09-26T20:09:20.247217] [INFO ] [MAIN ] MTH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:09:20.292719] [DEBUG] [LOCAL ] MTH: Loaded 44201 existing records from primary storage. [2025-09-26T20:09:20.292868] [INFO ] [MAIN ] MTH: Loaded 44201 existing records. [2025-09-26T20:09:20.487517] [WARN ] [MAIN ] MTH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:09:20.487892] [INFO ] [MAIN ] MTH: Wiping existing primary data before full refresh. [2025-09-26T20:09:20.487951] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-09-26T20:09:20.489128] [DEBUG] [LOCAL ] MTH: Deleted primary data file. [2025-09-26T20:09:20.489192] [INFO ] [MAIN ] MTH: Starting full primary refresh. [2025-09-26T20:09:20.720395] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-02. [2025-09-26T20:09:20.884100] [INFO ] [REMOTE ] MTH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:09:20.911046] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-26T20:09:21.229075] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-26T20:09:21.511715] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-06. [2025-09-26T20:09:22.311687] [INFO ] [REMOTE ] MTH: Fetching primary data for 2024-12. [2025-09-26T20:09:22.413040] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-26T20:09:22.531571] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-26T20:09:23.111735] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-02. [2025-09-26T20:09:23.864703] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-26T20:09:23.911717] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-01. [2025-09-26T20:09:24.557104] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-26T20:09:24.711723] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-03. [2025-09-26T20:09:25.459718] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-26T20:09:25.511714] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-03. [2025-09-26T20:09:26.311695] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-02. [2025-09-26T20:09:26.539040] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-26T20:09:27.068985] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-26T20:09:27.111693] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-04. [2025-09-26T20:09:27.911705] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-07. [2025-09-26T20:09:27.938117] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T20:09:28.711709] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-04. [2025-09-26T20:09:28.983407] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-26T20:09:28.989459] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-26T20:09:29.511745] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-05. [2025-09-26T20:09:30.311706] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-03. [2025-09-26T20:09:30.688061] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-26T20:09:31.111701] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-08. [2025-09-26T20:09:31.212461] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-26T20:09:31.910424] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-26T20:09:31.919157] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-05. [2025-09-26T20:09:32.204517] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-26T20:09:32.711728] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-06. [2025-09-26T20:09:33.511714] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-04. [2025-09-26T20:09:33.727280] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-26T20:09:34.311705] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-09. [2025-09-26T20:09:34.504676] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-26T20:09:35.114547] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-06. [2025-09-26T20:09:35.117748] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-26T20:09:35.298379] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-26T20:09:35.300923] [INFO ] [REMOTE ] MTD: Full fetch complete (21028 records). [2025-09-26T20:09:35.301052] [DEBUG] [VALIDATOR ] MTD: Validating primary data. [2025-09-26T20:09:35.692416] [DEBUG] [VALIDATOR ] MTD: All expected trading days are present. [2025-09-26T20:09:35.692522] [DEBUG] [VALIDATOR ] MTD: Primary data validation passed. [2025-09-26T20:09:35.693268] [INFO ] [MAIN ] MTD: Fetched primary data is valid. [2025-09-26T20:09:35.693332] [DEBUG] [LOCAL ] MTD: Saving primary data. [2025-09-26T20:09:35.694086] [DEBUG] [LOCAL ] MTD: Trimmed 21028 records to 15342 (keeping 200 days of data) [2025-09-26T20:09:35.797842] [DEBUG] [LOCAL ] MTD: Primary data saved (15342 records). [2025-09-26T20:09:35.798056] [INFO ] [MAIN ] MTD: Full history saved. [2025-09-26T20:09:35.798169] [INFO ] [MAIN ] Update Progress: 1418/2371 symbols completed. MTD took 28.7s. Estimated remaining: 2h 7m 23s. Rate: 7.5 symbols/min [2025-09-26T20:09:35.916996] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-05. [2025-09-26T20:09:35.979993] [INFO ] [MAIN ] MTN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:09:36.026058] [DEBUG] [LOCAL ] MTN: Loaded 39319 existing records from primary storage. [2025-09-26T20:09:36.026313] [INFO ] [MAIN ] MTN: Loaded 39319 existing records. [2025-09-26T20:09:36.220372] [WARN ] [MAIN ] MTN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:09:36.220746] [INFO ] [MAIN ] MTN: Wiping existing primary data before full refresh. [2025-09-26T20:09:36.220807] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-09-26T20:09:36.221762] [DEBUG] [LOCAL ] MTN: Deleted primary data file. [2025-09-26T20:09:36.221827] [INFO ] [MAIN ] MTN: Starting full primary refresh. [2025-09-26T20:09:36.626127] [INFO ] [REMOTE ] MTN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:09:36.711696] [INFO ] [REMOTE ] MTN: Fetching primary data for 2024-12. [2025-09-26T20:09:36.961892] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-26T20:09:37.489241] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-26T20:09:37.511681] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-06. [2025-09-26T20:09:38.268925] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-26T20:09:38.311713] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-07. [2025-09-26T20:09:39.012778] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-26T20:09:39.111730] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-07. [2025-09-26T20:09:39.911740] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-01. [2025-09-26T20:09:40.170430] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-26T20:09:40.711740] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-07. [2025-09-26T20:09:40.941518] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-26T20:09:41.012864] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-26T20:09:41.511724] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-08. [2025-09-26T20:09:42.316806] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-02. [2025-09-26T20:09:42.330638] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-26T20:09:42.910446] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-26T20:09:43.111728] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-09. [2025-09-26T20:09:43.307141] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-26T20:09:43.911747] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-08. [2025-09-26T20:09:44.711744] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-08. [2025-09-26T20:09:44.858844] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-26T20:09:44.870055] [INFO ] [REMOTE ] MTG: Full fetch complete (74021 records). [2025-09-26T20:09:44.870265] [DEBUG] [VALIDATOR ] MTG: Validating primary data. [2025-09-26T20:09:45.294151] [DEBUG] [VALIDATOR ] MTG: All expected trading days are present. [2025-09-26T20:09:45.294280] [DEBUG] [VALIDATOR ] MTG: Primary data validation passed. [2025-09-26T20:09:45.295829] [INFO ] [MAIN ] MTG: Fetched primary data is valid. [2025-09-26T20:09:45.295938] [DEBUG] [LOCAL ] MTG: Saving primary data. [2025-09-26T20:09:45.299254] [DEBUG] [LOCAL ] MTG: Trimmed 74021 records to 52091 (keeping 200 days of data) [2025-09-26T20:09:45.516420] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-03. [2025-09-26T20:09:45.678775] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-26T20:09:45.713340] [DEBUG] [LOCAL ] MTG: Primary data saved (52091 records). [2025-09-26T20:09:45.713632] [INFO ] [MAIN ] MTG: Full history saved. [2025-09-26T20:09:45.713966] [INFO ] [MAIN ] Update Progress: 1419/2371 symbols completed. MTG took 33.5s. Estimated remaining: 2h 7m 17s. Rate: 7.5 symbols/min [2025-09-26T20:09:45.906513] [INFO ] [MAIN ] MTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:09:45.906913] [DEBUG] [LOCAL ] MTR: No existing data file found in primary storage. [2025-09-26T20:09:45.906993] [WARN ] [MAIN ] MTR: No existing data found, performing full refresh instead. [2025-09-26T20:09:45.907313] [INFO ] [MAIN ] MTR: Wiping existing primary data before full refresh. [2025-09-26T20:09:45.907599] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-09-26T20:09:45.907704] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-09-26T20:09:45.907768] [INFO ] [MAIN ] MTR: Starting full primary refresh. [2025-09-26T20:09:46.317243] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-09. [2025-09-26T20:09:46.322353] [INFO ] [REMOTE ] MTR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:09:46.353073] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-26T20:09:47.111688] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-09. [2025-09-26T20:09:47.214922] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-26T20:09:47.911697] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-04. [2025-09-26T20:09:48.183374] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-26T20:09:48.196493] [INFO ] [REMOTE ] MTDR: Full fetch complete (73416 records). [2025-09-26T20:09:48.196728] [DEBUG] [VALIDATOR ] MTDR: Validating primary data. [2025-09-26T20:09:48.641369] [DEBUG] [VALIDATOR ] MTDR: All expected trading days are present. [2025-09-26T20:09:48.641522] [DEBUG] [VALIDATOR ] MTDR: Primary data validation passed. [2025-09-26T20:09:48.642912] [INFO ] [MAIN ] MTDR: Fetched primary data is valid. [2025-09-26T20:09:48.643019] [DEBUG] [LOCAL ] MTDR: Saving primary data. [2025-09-26T20:09:48.646294] [DEBUG] [LOCAL ] MTDR: Trimmed 73416 records to 52316 (keeping 200 days of data) [2025-09-26T20:09:48.725568] [INFO ] [REMOTE ] MTR: Fetching primary data for 2024-12. [2025-09-26T20:09:48.764540] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T20:09:48.776413] [INFO ] [REMOTE ] MTH: Full fetch complete (62964 records). [2025-09-26T20:09:48.785507] [DEBUG] [VALIDATOR ] MTH: Validating primary data. [2025-09-26T20:09:49.318455] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-26T20:09:49.450824] [DEBUG] [VALIDATOR ] MTH: All expected trading days are present. [2025-09-26T20:09:49.451680] [DEBUG] [VALIDATOR ] MTH: Primary data validation passed. [2025-09-26T20:09:49.454491] [INFO ] [MAIN ] MTH: Fetched primary data is valid. [2025-09-26T20:09:49.464693] [DEBUG] [LOCAL ] MTH: Saving primary data. [2025-09-26T20:09:49.464511] [DEBUG] [LOCAL ] MTDR: Primary data saved (52316 records). [2025-09-26T20:09:49.465008] [INFO ] [MAIN ] MTDR: Full history saved. [2025-09-26T20:09:49.465461] [INFO ] [MAIN ] Update Progress: 1420/2371 symbols completed. MTDR took 37.6s. Estimated remaining: 2h 7m 6s. Rate: 7.5 symbols/min [2025-09-26T20:09:49.556308] [DEBUG] [LOCAL ] MTH: Trimmed 62964 records to 44547 (keeping 200 days of data) [2025-09-26T20:09:49.545396] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-01. [2025-09-26T20:09:49.643125] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-26T20:09:49.804365] [INFO ] [MAIN ] MTRN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:09:49.836699] [DEBUG] [LOCAL ] MTRN: Loaded 18210 existing records from primary storage. [2025-09-26T20:09:49.837729] [INFO ] [MAIN ] MTRN: Loaded 18210 existing records. [2025-09-26T20:09:50.048761] [WARN ] [MAIN ] MTRN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:09:50.050857] [INFO ] [MAIN ] MTRN: Wiping existing primary data before full refresh. [2025-09-26T20:09:50.051506] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-09-26T20:09:50.053212] [DEBUG] [LOCAL ] MTRN: Deleted primary data file. [2025-09-26T20:09:50.054271] [INFO ] [MAIN ] MTRN: Starting full primary refresh. [2025-09-26T20:09:50.254394] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-26T20:09:50.317157] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-02. [2025-09-26T20:09:50.563820] [INFO ] [REMOTE ] MTRN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:09:50.629511] [DEBUG] [LOCAL ] MTH: Primary data saved (44547 records). [2025-09-26T20:09:50.629695] [INFO ] [MAIN ] MTH: Full history saved. [2025-09-26T20:09:50.629830] [INFO ] [MAIN ] Update Progress: 1421/2371 symbols completed. MTH took 30.6s. Estimated remaining: 2h 6m 53s. Rate: 7.5 symbols/min [2025-09-26T20:09:50.814703] [INFO ] [MAIN ] MTUS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:09:50.817232] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-26T20:09:50.851734] [DEBUG] [LOCAL ] MTUS: Loaded 28828 existing records from primary storage. [2025-09-26T20:09:50.851878] [INFO ] [MAIN ] MTUS: Loaded 28828 existing records. [2025-09-26T20:09:51.075021] [WARN ] [MAIN ] MTUS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:09:51.075348] [INFO ] [MAIN ] MTUS: Wiping existing primary data before full refresh. [2025-09-26T20:09:51.075405] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-09-26T20:09:51.076099] [DEBUG] [LOCAL ] MTUS: Deleted primary data file. [2025-09-26T20:09:51.076170] [INFO ] [MAIN ] MTUS: Starting full primary refresh. [2025-09-26T20:09:51.116945] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-03. [2025-09-26T20:09:51.475576] [INFO ] [REMOTE ] MTUS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:09:51.541837] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-26T20:09:51.911717] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-05. [2025-09-26T20:09:52.711741] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2024-12. [2025-09-26T20:09:53.414193] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-26T20:09:53.425912] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-26T20:09:53.511738] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-01. [2025-09-26T20:09:54.311703] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-04. [2025-09-26T20:09:54.440156] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-26T20:09:54.725736] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-26T20:09:55.111733] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-06. [2025-09-26T20:09:55.911723] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-02. [2025-09-26T20:09:56.681089] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-26T20:09:56.711698] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2024-12. [2025-09-26T20:09:56.725930] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-26T20:09:57.511724] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-05. [2025-09-26T20:09:57.924153] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-26T20:09:58.028253] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-26T20:09:58.311719] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-01. [2025-09-26T20:09:59.111694] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-07. [2025-09-26T20:09:59.583508] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-26T20:09:59.911711] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-02. [2025-09-26T20:10:00.647892] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-26T20:10:00.711719] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-03. [2025-09-26T20:10:01.228138] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-26T20:10:01.406911] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-26T20:10:01.511758] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-03. [2025-09-26T20:10:02.311752] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-04. [2025-09-26T20:10:02.840441] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-26T20:10:03.111740] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-04. [2025-09-26T20:10:03.545417] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-26T20:10:03.911728] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-05. [2025-09-26T20:10:04.512759] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-26T20:10:04.711720] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-08. [2025-09-26T20:10:05.074487] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-26T20:10:05.511738] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-06. [2025-09-26T20:10:06.168938] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-26T20:10:06.311713] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-05. [2025-09-26T20:10:06.443740] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-26T20:10:07.111732] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-07. [2025-09-26T20:10:07.593164] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-26T20:10:07.911729] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-06. [2025-09-26T20:10:08.105407] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-26T20:10:08.711686] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-09. [2025-09-26T20:10:09.175947] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-26T20:10:09.511756] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-07. [2025-09-26T20:10:10.302552] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-26T20:10:10.314007] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-06. [2025-09-26T20:10:10.316739] [INFO ] [REMOTE ] MTN: Full fetch complete (56016 records). [2025-09-26T20:10:10.316924] [DEBUG] [VALIDATOR ] MTN: Validating primary data. [2025-09-26T20:10:10.845300] [DEBUG] [VALIDATOR ] MTN: All expected trading days are present. [2025-09-26T20:10:10.845435] [DEBUG] [VALIDATOR ] MTN: Primary data validation passed. [2025-09-26T20:10:10.846491] [INFO ] [MAIN ] MTN: Fetched primary data is valid. [2025-09-26T20:10:10.846722] [DEBUG] [LOCAL ] MTN: Saving primary data. [2025-09-26T20:10:10.869361] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-26T20:10:10.878474] [DEBUG] [LOCAL ] MTN: Trimmed 56016 records to 39607 (keeping 200 days of data) [2025-09-26T20:10:11.111883] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-08. [2025-09-26T20:10:11.154019] [DEBUG] [LOCAL ] MTN: Primary data saved (39607 records). [2025-09-26T20:10:11.154193] [INFO ] [MAIN ] MTN: Full history saved. [2025-09-26T20:10:11.154318] [INFO ] [MAIN ] Update Progress: 1422/2371 symbols completed. MTN took 35.4s. Estimated remaining: 2h 6m 53s. Rate: 7.5 symbols/min [2025-09-26T20:10:11.248545] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-26T20:10:11.348685] [INFO ] [MAIN ] MTW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:10:11.380031] [DEBUG] [LOCAL ] MTW: Loaded 26735 existing records from primary storage. [2025-09-26T20:10:11.380180] [INFO ] [MAIN ] MTW: Loaded 26735 existing records. [2025-09-26T20:10:11.624342] [WARN ] [MAIN ] MTW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:10:11.624695] [INFO ] [MAIN ] MTW: Wiping existing primary data before full refresh. [2025-09-26T20:10:11.624756] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-09-26T20:10:11.625189] [DEBUG] [LOCAL ] MTW: Deleted primary data file. [2025-09-26T20:10:11.625252] [INFO ] [MAIN ] MTW: Starting full primary refresh. [2025-09-26T20:10:11.916815] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-07. [2025-09-26T20:10:12.023994] [INFO ] [REMOTE ] MTW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:10:12.156713] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-26T20:10:12.460387] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-26T20:10:12.711720] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-09. [2025-09-26T20:10:13.511721] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-08. [2025-09-26T20:10:13.849469] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-26T20:10:13.943915] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-26T20:10:13.949425] [INFO ] [REMOTE ] MTUS: Full fetch complete (42584 records). [2025-09-26T20:10:13.949528] [DEBUG] [VALIDATOR ] MTUS: Validating primary data. [2025-09-26T20:10:14.316818] [INFO ] [REMOTE ] MTW: Fetching primary data for 2024-12. [2025-09-26T20:10:14.393268] [DEBUG] [VALIDATOR ] MTUS: All expected trading days are present. [2025-09-26T20:10:14.393532] [DEBUG] [VALIDATOR ] MTUS: Primary data validation passed. [2025-09-26T20:10:14.394538] [INFO ] [MAIN ] MTUS: Fetched primary data is valid. [2025-09-26T20:10:14.394608] [DEBUG] [LOCAL ] MTUS: Saving primary data. [2025-09-26T20:10:14.397040] [DEBUG] [LOCAL ] MTUS: Trimmed 42584 records to 28984 (keeping 200 days of data) [2025-09-26T20:10:14.580047] [DEBUG] [LOCAL ] MTUS: Primary data saved (28984 records). [2025-09-26T20:10:14.580207] [INFO ] [MAIN ] MTUS: Full history saved. [2025-09-26T20:10:14.580325] [INFO ] [MAIN ] Update Progress: 1423/2371 symbols completed. MTUS took 24.0s. Estimated remaining: 2h 6m 42s. Rate: 7.5 symbols/min [2025-09-26T20:10:14.762682] [INFO ] [MAIN ] MTX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:10:14.786033] [DEBUG] [LOCAL ] MTX: Loaded 22995 existing records from primary storage. [2025-09-26T20:10:14.786171] [INFO ] [MAIN ] MTX: Loaded 22995 existing records. [2025-09-26T20:10:14.975241] [WARN ] [MAIN ] MTX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:10:14.975516] [INFO ] [MAIN ] MTX: Wiping existing primary data before full refresh. [2025-09-26T20:10:14.975576] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-09-26T20:10:14.976254] [DEBUG] [LOCAL ] MTX: Deleted primary data file. [2025-09-26T20:10:14.976320] [INFO ] [MAIN ] MTX: Starting full primary refresh. [2025-09-26T20:10:15.124249] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-09. [2025-09-26T20:10:15.364618] [INFO ] [REMOTE ] MTX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:10:15.460211] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-26T20:10:15.701443] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-26T20:10:15.702306] [INFO ] [REMOTE ] MTR: Full fetch complete (2549 records). [2025-09-26T20:10:15.702378] [DEBUG] [VALIDATOR ] MTR: Validating primary data. [2025-09-26T20:10:15.888332] [WARN ] [VALIDATOR ] MTR: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-26T20:10:15.888557] [FATAL] [MAIN ] MTR: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:10:15.888629] [WARN ] [MAIN ] MTR: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:10:15.888727] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-09-26T20:10:15.888807] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-09-26T20:10:15.888850] [INFO ] [LOCAL ] MTR: Starting deletion of derivative data. [2025-09-26T20:10:15.888908] [DEBUG] [LOCAL ] MTR: No derivative data file found to delete. [2025-09-26T20:10:15.888976] [INFO ] [MAIN ] Update Progress: 1424/2371 symbols completed. MTR took 30.2s. Estimated remaining: 2h 6m 30s. Rate: 7.5 symbols/min [2025-09-26T20:10:15.919414] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-01. [2025-09-26T20:10:16.074404] [INFO ] [MAIN ] MTZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:10:16.134471] [DEBUG] [LOCAL ] MTZ: Loaded 43650 existing records from primary storage. [2025-09-26T20:10:16.134624] [INFO ] [MAIN ] MTZ: Loaded 43650 existing records. [2025-09-26T20:10:16.326696] [WARN ] [MAIN ] MTZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:10:16.326989] [INFO ] [MAIN ] MTZ: Wiping existing primary data before full refresh. [2025-09-26T20:10:16.327045] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-09-26T20:10:16.327847] [DEBUG] [LOCAL ] MTZ: Deleted primary data file. [2025-09-26T20:10:16.327914] [INFO ] [MAIN ] MTZ: Starting full primary refresh. [2025-09-26T20:10:16.718791] [INFO ] [REMOTE ] MTZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:10:16.714327] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-08. [2025-09-26T20:10:17.141947] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-26T20:10:17.511712] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-02. [2025-09-26T20:10:17.800077] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-26T20:10:18.311766] [INFO ] [REMOTE ] MTX: Fetching primary data for 2024-12. [2025-09-26T20:10:18.746689] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-26T20:10:19.111751] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2024-12. [2025-09-26T20:10:19.306268] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-26T20:10:19.911736] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-03. [2025-09-26T20:10:20.477847] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-26T20:10:20.711717] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-09. [2025-09-26T20:10:20.971770] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-26T20:10:21.511693] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-01. [2025-09-26T20:10:21.863360] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-26T20:10:21.867197] [INFO ] [REMOTE ] MTRN: Full fetch complete (23427 records). [2025-09-26T20:10:21.867323] [DEBUG] [VALIDATOR ] MTRN: Validating primary data. [2025-09-26T20:10:22.285769] [DEBUG] [VALIDATOR ] MTRN: All expected trading days are present. [2025-09-26T20:10:22.285884] [DEBUG] [VALIDATOR ] MTRN: Primary data validation passed. [2025-09-26T20:10:22.286411] [INFO ] [MAIN ] MTRN: Fetched primary data is valid. [2025-09-26T20:10:22.286483] [DEBUG] [LOCAL ] MTRN: Saving primary data. [2025-09-26T20:10:22.298703] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-26T20:10:22.299034] [DEBUG] [LOCAL ] MTRN: Trimmed 23427 records to 18303 (keeping 200 days of data) [2025-09-26T20:10:22.354166] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-02. [2025-09-26T20:10:22.428734] [DEBUG] [LOCAL ] MTRN: Primary data saved (18303 records). [2025-09-26T20:10:22.428900] [INFO ] [MAIN ] MTRN: Full history saved. [2025-09-26T20:10:22.429005] [INFO ] [MAIN ] Update Progress: 1425/2371 symbols completed. MTRN took 33.0s. Estimated remaining: 2h 6m 21s. Rate: 7.5 symbols/min [2025-09-26T20:10:22.632107] [INFO ] [MAIN ] MUA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:10:22.646580] [DEBUG] [LOCAL ] MUA: Loaded 12338 existing records from primary storage. [2025-09-26T20:10:22.646755] [INFO ] [MAIN ] MUA: Loaded 12338 existing records. [2025-09-26T20:10:22.841316] [WARN ] [MAIN ] MUA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:10:22.841606] [INFO ] [MAIN ] MUA: Wiping existing primary data before full refresh. [2025-09-26T20:10:22.841686] [INFO ] [LOCAL ] MUA: Starting deletion of primary data. [2025-09-26T20:10:22.842129] [DEBUG] [LOCAL ] MUA: Deleted primary data file. [2025-09-26T20:10:22.842190] [INFO ] [MAIN ] MUA: Starting full primary refresh. [2025-09-26T20:10:23.113722] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-04. [2025-09-26T20:10:23.230865] [INFO ] [REMOTE ] MUA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:10:23.261962] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-26T20:10:23.911714] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-01. [2025-09-26T20:10:24.522887] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-26T20:10:24.711724] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-05. [2025-09-26T20:10:25.463416] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-26T20:10:25.511677] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-02. [2025-09-26T20:10:25.943820] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-26T20:10:26.311731] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-03. [2025-09-26T20:10:27.042817] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-26T20:10:27.111711] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-06. [2025-09-26T20:10:27.421199] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-26T20:10:27.911722] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-04. [2025-09-26T20:10:28.332050] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-26T20:10:28.711759] [INFO ] [REMOTE ] MUA: Fetching primary data for 2024-12. [2025-09-26T20:10:28.855367] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-26T20:10:29.511692] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-05. [2025-09-26T20:10:29.522159] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-26T20:10:30.311717] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-07. [2025-09-26T20:10:30.648935] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-26T20:10:31.111688] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-03. [2025-09-26T20:10:31.500536] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-26T20:10:31.911715] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-01. [2025-09-26T20:10:32.711696] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-06. [2025-09-26T20:10:32.788906] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-26T20:10:32.808532] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-26T20:10:33.511721] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-02. [2025-09-26T20:10:33.858313] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-26T20:10:34.311701] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-04. [2025-09-26T20:10:34.385104] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-26T20:10:35.111736] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-07. [2025-09-26T20:10:35.912106] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-08. [2025-09-26T20:10:35.911980] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T20:10:36.360207] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-26T20:10:36.711743] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-08. [2025-09-26T20:10:37.117485] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-26T20:10:37.511705] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-03. [2025-09-26T20:10:37.699070] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-26T20:10:38.311701] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-09. [2025-09-26T20:10:38.547063] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-26T20:10:39.111738] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-05. [2025-09-26T20:10:39.459027] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-26T20:10:39.464635] [INFO ] [REMOTE ] MTW: Full fetch complete (38427 records). [2025-09-26T20:10:39.464763] [DEBUG] [VALIDATOR ] MTW: Validating primary data. [2025-09-26T20:10:39.891481] [DEBUG] [VALIDATOR ] MTW: All expected trading days are present. [2025-09-26T20:10:39.891565] [DEBUG] [VALIDATOR ] MTW: Primary data validation passed. [2025-09-26T20:10:39.892326] [INFO ] [MAIN ] MTW: Fetched primary data is valid. [2025-09-26T20:10:39.892391] [DEBUG] [LOCAL ] MTW: Saving primary data. [2025-09-26T20:10:39.893399] [DEBUG] [LOCAL ] MTW: Trimmed 38427 records to 26888 (keeping 200 days of data) [2025-09-26T20:10:39.942636] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-09. [2025-09-26T20:10:40.056292] [DEBUG] [LOCAL ] MTW: Primary data saved (26888 records). [2025-09-26T20:10:40.056437] [INFO ] [MAIN ] MTW: Full history saved. [2025-09-26T20:10:40.056540] [INFO ] [MAIN ] Update Progress: 1426/2371 symbols completed. MTW took 28.9s. Estimated remaining: 2h 6m 19s. Rate: 7.5 symbols/min [2025-09-26T20:10:40.243275] [INFO ] [MAIN ] MUC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:10:40.265718] [DEBUG] [LOCAL ] MUC: Loaded 20556 existing records from primary storage. [2025-09-26T20:10:40.265846] [INFO ] [MAIN ] MUC: Loaded 20556 existing records. [2025-09-26T20:10:40.454342] [WARN ] [MAIN ] MUC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:10:40.454941] [INFO ] [MAIN ] MUC: Wiping existing primary data before full refresh. [2025-09-26T20:10:40.455034] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-09-26T20:10:40.455697] [DEBUG] [LOCAL ] MUC: Deleted primary data file. [2025-09-26T20:10:40.455760] [INFO ] [MAIN ] MUC: Starting full primary refresh. [2025-09-26T20:10:40.751785] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-04. [2025-09-26T20:10:40.791274] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-26T20:10:40.878983] [INFO ] [REMOTE ] MUC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:10:41.164457] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-26T20:10:41.169197] [INFO ] [REMOTE ] MTX: Full fetch complete (31201 records). [2025-09-26T20:10:41.169324] [DEBUG] [VALIDATOR ] MTX: Validating primary data. [2025-09-26T20:10:41.516801] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-06. [2025-09-26T20:10:41.571301] [DEBUG] [VALIDATOR ] MTX: All expected trading days are present. [2025-09-26T20:10:41.571455] [DEBUG] [VALIDATOR ] MTX: Primary data validation passed. [2025-09-26T20:10:41.572168] [INFO ] [MAIN ] MTX: Fetched primary data is valid. [2025-09-26T20:10:41.572234] [DEBUG] [LOCAL ] MTX: Saving primary data. [2025-09-26T20:10:41.573276] [DEBUG] [LOCAL ] MTX: Trimmed 31201 records to 23150 (keeping 200 days of data) [2025-09-26T20:10:41.696423] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-26T20:10:41.735897] [DEBUG] [LOCAL ] MTX: Primary data saved (23150 records). [2025-09-26T20:10:41.736102] [INFO ] [MAIN ] MTX: Full history saved. [2025-09-26T20:10:41.736212] [INFO ] [MAIN ] Update Progress: 1427/2371 symbols completed. MTX took 27.2s. Estimated remaining: 2h 6m 7s. Rate: 7.5 symbols/min [2025-09-26T20:10:41.918356] [INFO ] [MAIN ] MUE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:10:41.932391] [DEBUG] [LOCAL ] MUE: Loaded 12072 existing records from primary storage. [2025-09-26T20:10:41.932518] [INFO ] [MAIN ] MUE: Loaded 12072 existing records. [2025-09-26T20:10:42.140889] [WARN ] [MAIN ] MUE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:10:42.141190] [INFO ] [MAIN ] MUE: Wiping existing primary data before full refresh. [2025-09-26T20:10:42.141246] [INFO ] [LOCAL ] MUE: Starting deletion of primary data. [2025-09-26T20:10:42.141683] [DEBUG] [LOCAL ] MUE: Deleted primary data file. [2025-09-26T20:10:42.141781] [INFO ] [MAIN ] MUE: Starting full primary refresh. [2025-09-26T20:10:42.316691] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-05. [2025-09-26T20:10:42.559753] [INFO ] [REMOTE ] MUE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:10:43.111744] [INFO ] [REMOTE ] MUC: Fetching primary data for 2024-12. [2025-09-26T20:10:43.115007] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-26T20:10:43.284709] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-26T20:10:43.911735] [INFO ] [REMOTE ] MUE: Fetching primary data for 2024-12. [2025-09-26T20:10:44.359742] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-26T20:10:44.711721] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-06. [2025-09-26T20:10:45.077778] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-26T20:10:45.511730] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-01. [2025-09-26T20:10:45.665873] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-26T20:10:46.311737] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-07. [2025-09-26T20:10:46.488267] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-26T20:10:47.073133] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-26T20:10:47.111680] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-07. [2025-09-26T20:10:47.911730] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-01. [2025-09-26T20:10:48.619009] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-26T20:10:48.711769] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-02. [2025-09-26T20:10:48.747621] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-26T20:10:49.471077] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-26T20:10:49.511774] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-02. [2025-09-26T20:10:50.311728] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-08. [2025-09-26T20:10:50.328561] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-26T20:10:51.111705] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-03. [2025-09-26T20:10:51.413222] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-26T20:10:51.897450] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-26T20:10:51.911674] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-04. [2025-09-26T20:10:52.711745] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-03. [2025-09-26T20:10:52.744598] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-26T20:10:53.511750] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-09. [2025-09-26T20:10:53.772972] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-26T20:10:54.311767] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-08. [2025-09-26T20:10:54.436482] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-26T20:10:54.439352] [INFO ] [REMOTE ] MUA: Full fetch complete (18767 records). [2025-09-26T20:10:54.439453] [DEBUG] [VALIDATOR ] MUA: Validating primary data. [2025-09-26T20:10:54.865430] [DEBUG] [VALIDATOR ] MUA: All expected trading days are present. [2025-09-26T20:10:54.865532] [DEBUG] [VALIDATOR ] MUA: Primary data validation passed. [2025-09-26T20:10:54.866032] [INFO ] [MAIN ] MUA: Fetched primary data is valid. [2025-09-26T20:10:54.866108] [DEBUG] [LOCAL ] MUA: Saving primary data. [2025-09-26T20:10:54.866834] [DEBUG] [LOCAL ] MUA: Trimmed 18767 records to 12391 (keeping 200 days of data) [2025-09-26T20:10:54.953248] [DEBUG] [LOCAL ] MUA: Primary data saved (12391 records). [2025-09-26T20:10:54.953412] [INFO ] [MAIN ] MUA: Full history saved. [2025-09-26T20:10:54.953548] [INFO ] [MAIN ] Update Progress: 1428/2371 symbols completed. MUA took 32.5s. Estimated remaining: 2h 6m 2s. Rate: 7.5 symbols/min [2025-09-26T20:10:55.115630] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-04. [2025-09-26T20:10:55.139255] [INFO ] [MAIN ] MUFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:10:55.201555] [DEBUG] [LOCAL ] MUFG: Loaded 52971 existing records from primary storage. [2025-09-26T20:10:55.201749] [INFO ] [MAIN ] MUFG: Loaded 52971 existing records. [2025-09-26T20:10:55.391204] [WARN ] [MAIN ] MUFG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:10:55.391534] [INFO ] [MAIN ] MUFG: Wiping existing primary data before full refresh. [2025-09-26T20:10:55.391608] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-09-26T20:10:55.392767] [DEBUG] [LOCAL ] MUFG: Deleted primary data file. [2025-09-26T20:10:55.392832] [INFO ] [MAIN ] MUFG: Starting full primary refresh. [2025-09-26T20:10:55.801667] [INFO ] [REMOTE ] MUFG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:10:55.914423] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-05. [2025-09-26T20:10:55.917435] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-26T20:10:56.123975] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-26T20:10:56.701493] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-26T20:10:56.711679] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-06. [2025-09-26T20:10:57.511714] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-09. [2025-09-26T20:10:57.654608] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-26T20:10:58.311727] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2024-12. [2025-09-26T20:10:59.111733] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-07. [2025-09-26T20:10:59.333583] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-26T20:10:59.342293] [INFO ] [REMOTE ] MTZ: Full fetch complete (63385 records). [2025-09-26T20:10:59.342526] [DEBUG] [VALIDATOR ] MTZ: Validating primary data. [2025-09-26T20:10:59.766342] [DEBUG] [VALIDATOR ] MTZ: All expected trading days are present. [2025-09-26T20:10:59.766467] [DEBUG] [VALIDATOR ] MTZ: Primary data validation passed. [2025-09-26T20:10:59.767509] [INFO ] [MAIN ] MTZ: Fetched primary data is valid. [2025-09-26T20:10:59.767579] [DEBUG] [LOCAL ] MTZ: Saving primary data. [2025-09-26T20:10:59.769127] [DEBUG] [LOCAL ] MTZ: Trimmed 63385 records to 43922 (keeping 200 days of data) [2025-09-26T20:10:59.872198] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-26T20:10:59.911710] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-08. [2025-09-26T20:11:00.072264] [DEBUG] [LOCAL ] MTZ: Primary data saved (43922 records). [2025-09-26T20:11:00.072410] [INFO ] [MAIN ] MTZ: Full history saved. [2025-09-26T20:11:00.072530] [INFO ] [MAIN ] Update Progress: 1429/2371 symbols completed. MTZ took 44.2s. Estimated remaining: 2h 5m 52s. Rate: 7.5 symbols/min [2025-09-26T20:11:00.260747] [INFO ] [MAIN ] MUJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:11:00.276453] [DEBUG] [LOCAL ] MUJ: Loaded 13414 existing records from primary storage. [2025-09-26T20:11:00.276636] [INFO ] [MAIN ] MUJ: Loaded 13414 existing records. [2025-09-26T20:11:00.469295] [WARN ] [MAIN ] MUJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:11:00.469636] [INFO ] [MAIN ] MUJ: Wiping existing primary data before full refresh. [2025-09-26T20:11:00.469733] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-09-26T20:11:00.470223] [DEBUG] [LOCAL ] MUJ: Deleted primary data file. [2025-09-26T20:11:00.470285] [INFO ] [MAIN ] MUJ: Starting full primary refresh. [2025-09-26T20:11:00.716992] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-05. [2025-09-26T20:11:00.869884] [INFO ] [REMOTE ] MUJ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:11:01.009410] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-26T20:11:01.511731] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-09. [2025-09-26T20:11:02.311795] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2024-12. [2025-09-26T20:11:02.556258] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-26T20:11:02.559604] [INFO ] [REMOTE ] MUE: Full fetch complete (16198 records). [2025-09-26T20:11:02.559790] [DEBUG] [VALIDATOR ] MUE: Validating primary data. [2025-09-26T20:11:03.100106] [DEBUG] [VALIDATOR ] MUE: All expected trading days are present. [2025-09-26T20:11:03.100249] [DEBUG] [VALIDATOR ] MUE: Primary data validation passed. [2025-09-26T20:11:03.100947] [INFO ] [MAIN ] MUE: Fetched primary data is valid. [2025-09-26T20:11:03.101016] [DEBUG] [LOCAL ] MUE: Saving primary data. [2025-09-26T20:11:03.101910] [DEBUG] [LOCAL ] MUE: Trimmed 16198 records to 12092 (keeping 200 days of data) [2025-09-26T20:11:03.206325] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-26T20:11:03.215224] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-01. [2025-09-26T20:11:03.241623] [DEBUG] [LOCAL ] MUE: Primary data saved (12092 records). [2025-09-26T20:11:03.241864] [INFO ] [MAIN ] MUE: Full history saved. [2025-09-26T20:11:03.241998] [INFO ] [MAIN ] Update Progress: 1430/2371 symbols completed. MUE took 21.5s. Estimated remaining: 2h 5m 41s. Rate: 7.5 symbols/min [2025-09-26T20:11:03.523248] [INFO ] [MAIN ] MUR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:11:03.596778] [DEBUG] [LOCAL ] MUR: Loaded 53315 existing records from primary storage. [2025-09-26T20:11:03.597059] [INFO ] [MAIN ] MUR: Loaded 53315 existing records. [2025-09-26T20:11:03.818193] [WARN ] [MAIN ] MUR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:11:03.818489] [INFO ] [MAIN ] MUR: Wiping existing primary data before full refresh. [2025-09-26T20:11:03.818541] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-09-26T20:11:03.819848] [DEBUG] [LOCAL ] MUR: Deleted primary data file. [2025-09-26T20:11:03.819910] [INFO ] [MAIN ] MUR: Starting full primary refresh. [2025-09-26T20:11:04.201198] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2024-12 (5.89 seconds). [2025-09-26T20:11:04.238364] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-01. [2025-09-26T20:11:04.305164] [INFO ] [REMOTE ] MUR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:11:04.711793] [INFO ] [REMOTE ] MUR: Fetching primary data for 2024-12. [2025-09-26T20:11:04.879542] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-05 (4.16 seconds). [2025-09-26T20:11:05.511702] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-06. [2025-09-26T20:11:05.561962] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-09-26T20:11:06.012287] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-26T20:11:06.311786] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-02. [2025-09-26T20:11:06.591190] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-26T20:11:06.615472] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-26T20:11:07.111727] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-01. [2025-09-26T20:11:07.842044] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-26T20:11:07.911739] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-07. [2025-09-26T20:11:08.711680] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-02. [2025-09-26T20:11:08.907807] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-26T20:11:09.511707] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-02. [2025-09-26T20:11:09.539560] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-26T20:11:09.677702] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-26T20:11:10.311743] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-03. [2025-09-26T20:11:11.111752] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-03. [2025-09-26T20:11:11.223275] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-26T20:11:11.864488] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-26T20:11:11.911734] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-03. [2025-09-26T20:11:12.122469] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-26T20:11:12.711719] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-04. [2025-09-26T20:11:13.416198] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-26T20:11:13.511719] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-04. [2025-09-26T20:11:14.311722] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-04. [2025-09-26T20:11:14.772332] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-26T20:11:15.111723] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-05. [2025-09-26T20:11:15.258937] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-26T20:11:15.911750] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-05. [2025-09-26T20:11:16.585589] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-04 (3.07 seconds). [2025-09-26T20:11:16.711773] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-08. [2025-09-26T20:11:16.753404] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-26T20:11:17.511693] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-06. [2025-09-26T20:11:17.632292] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-09-26T20:11:17.834379] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-26T20:11:18.311739] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-05. [2025-09-26T20:11:18.682241] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-26T20:11:19.111720] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-07. [2025-09-26T20:11:19.911725] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-06. [2025-09-26T20:11:20.074752] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-26T20:11:20.464150] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-26T20:11:20.711744] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-09. [2025-09-26T20:11:21.511704] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-08. [2025-09-26T20:11:21.645498] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-26T20:11:21.827157] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-26T20:11:21.832200] [INFO ] [REMOTE ] MUC: Full fetch complete (30136 records). [2025-09-26T20:11:21.832426] [DEBUG] [VALIDATOR ] MUC: Validating primary data. [2025-09-26T20:11:22.269732] [DEBUG] [VALIDATOR ] MUC: All expected trading days are present. [2025-09-26T20:11:22.269837] [DEBUG] [VALIDATOR ] MUC: Primary data validation passed. [2025-09-26T20:11:22.270556] [INFO ] [MAIN ] MUC: Fetched primary data is valid. [2025-09-26T20:11:22.270602] [DEBUG] [LOCAL ] MUC: Saving primary data. [2025-09-26T20:11:22.271734] [DEBUG] [LOCAL ] MUC: Trimmed 30136 records to 20721 (keeping 200 days of data) [2025-09-26T20:11:22.326565] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-06. [2025-09-26T20:11:22.408276] [DEBUG] [LOCAL ] MUC: Primary data saved (20721 records). [2025-09-26T20:11:22.408526] [INFO ] [MAIN ] MUC: Full history saved. [2025-09-26T20:11:22.408738] [INFO ] [MAIN ] Update Progress: 1431/2371 symbols completed. MUC took 42.4s. Estimated remaining: 2h 5m 41s. Rate: 7.5 symbols/min [2025-09-26T20:11:22.512581] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-26T20:11:22.624375] [INFO ] [MAIN ] MUSA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:11:22.651320] [DEBUG] [LOCAL ] MUSA: Loaded 25043 existing records from primary storage. [2025-09-26T20:11:22.651530] [INFO ] [MAIN ] MUSA: Loaded 25043 existing records. [2025-09-26T20:11:22.862758] [WARN ] [MAIN ] MUSA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:11:22.863075] [INFO ] [MAIN ] MUSA: Wiping existing primary data before full refresh. [2025-09-26T20:11:22.863145] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-09-26T20:11:22.863961] [DEBUG] [LOCAL ] MUSA: Deleted primary data file. [2025-09-26T20:11:22.864026] [INFO ] [MAIN ] MUSA: Starting full primary refresh. [2025-09-26T20:11:23.124036] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-07. [2025-09-26T20:11:23.253153] [INFO ] [REMOTE ] MUSA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:11:23.911723] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2024-12. [2025-09-26T20:11:24.290103] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-26T20:11:24.711839] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-09. [2025-09-26T20:11:24.955430] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-26T20:11:25.031957] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-26T20:11:25.511728] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-07. [2025-09-26T20:11:25.536986] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-26T20:11:25.540504] [INFO ] [REMOTE ] MUJ: Full fetch complete (20296 records). [2025-09-26T20:11:25.540584] [DEBUG] [VALIDATOR ] MUJ: Validating primary data. [2025-09-26T20:11:25.919857] [DEBUG] [VALIDATOR ] MUJ: All expected trading days are present. [2025-09-26T20:11:25.919937] [DEBUG] [VALIDATOR ] MUJ: Primary data validation passed. [2025-09-26T20:11:25.920385] [INFO ] [MAIN ] MUJ: Fetched primary data is valid. [2025-09-26T20:11:25.920467] [DEBUG] [LOCAL ] MUJ: Saving primary data. [2025-09-26T20:11:25.921097] [DEBUG] [LOCAL ] MUJ: Trimmed 20296 records to 13473 (keeping 200 days of data) [2025-09-26T20:11:26.007500] [DEBUG] [LOCAL ] MUJ: Primary data saved (13473 records). [2025-09-26T20:11:26.007685] [INFO ] [MAIN ] MUJ: Full history saved. [2025-09-26T20:11:26.007803] [INFO ] [MAIN ] Update Progress: 1432/2371 symbols completed. MUJ took 25.9s. Estimated remaining: 2h 5m 30s. Rate: 7.5 symbols/min [2025-09-26T20:11:26.192850] [INFO ] [MAIN ] MUSE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:11:26.193081] [DEBUG] [LOCAL ] MUSE: No existing data file found in primary storage. [2025-09-26T20:11:26.193172] [WARN ] [MAIN ] MUSE: No existing data found, performing full refresh instead. [2025-09-26T20:11:26.193334] [INFO ] [MAIN ] MUSE: Wiping existing primary data before full refresh. [2025-09-26T20:11:26.193380] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-09-26T20:11:26.193424] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-09-26T20:11:26.193457] [INFO ] [MAIN ] MUSE: Starting full primary refresh. [2025-09-26T20:11:26.316805] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-08. [2025-09-26T20:11:26.575334] [INFO ] [REMOTE ] MUSE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:11:27.111703] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2024-12. [2025-09-26T20:11:27.354593] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2024-12 (0.24 seconds). [2025-09-26T20:11:27.536157] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-26T20:11:27.911700] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-08. [2025-09-26T20:11:28.251807] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-26T20:11:28.711719] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-09. [2025-09-26T20:11:29.511713] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-01. [2025-09-26T20:11:29.549238] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-26T20:11:29.758371] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:11:29.758769] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-01 [2025-09-26T20:11:30.311728] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-09. [2025-09-26T20:11:30.579358] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-26T20:11:30.590274] [INFO ] [REMOTE ] MUFG: Full fetch complete (75447 records). [2025-09-26T20:11:30.590428] [DEBUG] [VALIDATOR ] MUFG: Validating primary data. [2025-09-26T20:11:31.006840] [DEBUG] [VALIDATOR ] MUFG: All expected trading days are present. [2025-09-26T20:11:31.007104] [DEBUG] [VALIDATOR ] MUFG: Primary data validation passed. [2025-09-26T20:11:31.008285] [INFO ] [MAIN ] MUFG: Fetched primary data is valid. [2025-09-26T20:11:31.008358] [DEBUG] [LOCAL ] MUFG: Saving primary data. [2025-09-26T20:11:31.010102] [DEBUG] [LOCAL ] MUFG: Trimmed 75447 records to 53341 (keeping 200 days of data) [2025-09-26T20:11:31.121705] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-01. [2025-09-26T20:11:31.347091] [DEBUG] [LOCAL ] MUFG: Primary data saved (53341 records). [2025-09-26T20:11:31.347235] [INFO ] [MAIN ] MUFG: Full history saved. [2025-09-26T20:11:31.347336] [INFO ] [MAIN ] Update Progress: 1433/2371 symbols completed. MUFG took 36.4s. Estimated remaining: 2h 5m 20s. Rate: 7.5 symbols/min [2025-09-26T20:11:31.531502] [INFO ] [MAIN ] MUX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:11:31.578271] [DEBUG] [LOCAL ] MUX: Loaded 42890 existing records from primary storage. [2025-09-26T20:11:31.578447] [INFO ] [MAIN ] MUX: Loaded 42890 existing records. [2025-09-26T20:11:31.765895] [WARN ] [MAIN ] MUX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:11:31.766170] [INFO ] [MAIN ] MUX: Wiping existing primary data before full refresh. [2025-09-26T20:11:31.766228] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-09-26T20:11:31.766935] [DEBUG] [LOCAL ] MUX: Deleted primary data file. [2025-09-26T20:11:31.767008] [INFO ] [MAIN ] MUX: Starting full primary refresh. [2025-09-26T20:11:31.925782] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-02. [2025-09-26T20:11:32.181220] [INFO ] [REMOTE ] MUX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:11:32.197049] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-26T20:11:32.234812] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-26T20:11:32.245759] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:11:32.246832] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-02 [2025-09-26T20:11:32.247617] [INFO ] [REMOTE ] MUR: Full fetch complete (76446 records). [2025-09-26T20:11:32.247811] [DEBUG] [VALIDATOR ] MUR: Validating primary data. [2025-09-26T20:11:32.714090] [INFO ] [REMOTE ] MUX: Fetching primary data for 2024-12. [2025-09-26T20:11:32.714580] [DEBUG] [VALIDATOR ] MUR: All expected trading days are present. [2025-09-26T20:11:32.715580] [DEBUG] [VALIDATOR ] MUR: Primary data validation passed. [2025-09-26T20:11:32.716910] [INFO ] [MAIN ] MUR: Fetched primary data is valid. [2025-09-26T20:11:32.717100] [DEBUG] [LOCAL ] MUR: Saving primary data. [2025-09-26T20:11:32.718928] [DEBUG] [LOCAL ] MUR: Trimmed 76446 records to 53705 (keeping 200 days of data) [2025-09-26T20:11:33.070306] [DEBUG] [LOCAL ] MUR: Primary data saved (53705 records). [2025-09-26T20:11:33.070468] [INFO ] [MAIN ] MUR: Full history saved. [2025-09-26T20:11:33.070578] [INFO ] [MAIN ] Update Progress: 1434/2371 symbols completed. MUR took 29.8s. Estimated remaining: 2h 5m 8s. Rate: 7.5 symbols/min [2025-09-26T20:11:33.251610] [INFO ] [MAIN ] MVF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:11:33.267040] [DEBUG] [LOCAL ] MVF: Loaded 12867 existing records from primary storage. [2025-09-26T20:11:33.267208] [INFO ] [MAIN ] MVF: Loaded 12867 existing records. [2025-09-26T20:11:33.482515] [WARN ] [MAIN ] MVF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:11:33.482825] [INFO ] [MAIN ] MVF: Wiping existing primary data before full refresh. [2025-09-26T20:11:33.482877] [INFO ] [LOCAL ] MVF: Starting deletion of primary data. [2025-09-26T20:11:33.483321] [DEBUG] [LOCAL ] MVF: Deleted primary data file. [2025-09-26T20:11:33.483393] [INFO ] [MAIN ] MVF: Starting full primary refresh. [2025-09-26T20:11:33.519962] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-03. [2025-09-26T20:11:33.859402] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-26T20:11:33.896773] [INFO ] [REMOTE ] MVF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:11:34.280626] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-26T20:11:34.311701] [INFO ] [REMOTE ] MVF: Fetching primary data for 2024-12. [2025-09-26T20:11:35.111695] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-01. [2025-09-26T20:11:35.247322] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-26T20:11:35.911748] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-04. [2025-09-26T20:11:36.167476] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-09-26T20:11:36.469964] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-26T20:11:36.711728] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-05. [2025-09-26T20:11:36.928600] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-05 (0.22 seconds). [2025-09-26T20:11:37.511736] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-01. [2025-09-26T20:11:38.311804] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-02. [2025-09-26T20:11:38.352078] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-26T20:11:39.111753] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-02. [2025-09-26T20:11:39.814292] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-26T20:11:39.911721] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-03. [2025-09-26T20:11:40.000900] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-26T20:11:40.711750] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-03. [2025-09-26T20:11:41.515618] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-02. [2025-09-26T20:11:41.521622] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-26T20:11:41.595006] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-26T20:11:42.311751] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-04. [2025-09-26T20:11:42.800103] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-26T20:11:43.111724] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-03. [2025-09-26T20:11:43.752982] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-26T20:11:43.911726] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-05. [2025-09-26T20:11:44.399920] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-26T20:11:44.711727] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-06. [2025-09-26T20:11:44.962784] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-09-26T20:11:45.355508] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-26T20:11:45.511735] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-04. [2025-09-26T20:11:46.311733] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-06. [2025-09-26T20:11:46.747304] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-26T20:11:47.111723] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-07. [2025-09-26T20:11:47.340097] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-09-26T20:11:47.554342] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-26T20:11:47.911719] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-05. [2025-09-26T20:11:48.711730] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-04. [2025-09-26T20:11:49.246598] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-26T20:11:49.511689] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-06. [2025-09-26T20:11:49.596837] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-26T20:11:50.311749] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-05. [2025-09-26T20:11:50.669837] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-26T20:11:51.076510] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-26T20:11:51.111714] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-08. [2025-09-26T20:11:51.330553] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-09-26T20:11:51.911722] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-07. [2025-09-26T20:11:52.711720] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-09. [2025-09-26T20:11:53.054735] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-26T20:11:53.186574] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:11:53.187010] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-09 [2025-09-26T20:11:53.187173] [INFO ] [REMOTE ] MUSE: Full fetch complete (104 records). [2025-09-26T20:11:53.187329] [DEBUG] [VALIDATOR ] MUSE: Validating primary data. [2025-09-26T20:11:53.188118] [FATAL] [VALIDATOR ] MUSE: Data is stale - most recent date (2025-08-05) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T20:11:53.188200] [FATAL] [MAIN ] MUSE: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:11:53.188290] [WARN ] [MAIN ] MUSE: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:11:53.188399] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-09-26T20:11:53.188483] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-09-26T20:11:53.188549] [INFO ] [LOCAL ] MUSE: Starting deletion of derivative data. [2025-09-26T20:11:53.188664] [DEBUG] [LOCAL ] MUSE: No derivative data file found to delete. [2025-09-26T20:11:53.188825] [INFO ] [MAIN ] Update Progress: 1435/2371 symbols completed. MUSE took 27.2s. Estimated remaining: 2h 5m 8s. Rate: 7.5 symbols/min [2025-09-26T20:11:53.374549] [INFO ] [MAIN ] MVO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:11:53.397012] [DEBUG] [LOCAL ] MVO: Loaded 9106 existing records from primary storage. [2025-09-26T20:11:53.397151] [INFO ] [MAIN ] MVO: Loaded 9106 existing records. [2025-09-26T20:11:53.516812] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-06. [2025-09-26T20:11:53.621589] [WARN ] [MAIN ] MVO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:11:53.621901] [INFO ] [MAIN ] MVO: Wiping existing primary data before full refresh. [2025-09-26T20:11:53.621964] [INFO ] [LOCAL ] MVO: Starting deletion of primary data. [2025-09-26T20:11:53.622420] [DEBUG] [LOCAL ] MVO: Deleted primary data file. [2025-09-26T20:11:53.622484] [INFO ] [MAIN ] MVO: Starting full primary refresh. [2025-09-26T20:11:53.999040] [INFO ] [REMOTE ] MVO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:11:54.311735] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-07. [2025-09-26T20:11:54.410562] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-26T20:11:55.111713] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-08. [2025-09-26T20:11:55.824356] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-26T20:11:55.911764] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-07. [2025-09-26T20:11:56.268825] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-26T20:11:56.711700] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-08. [2025-09-26T20:11:56.792982] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-26T20:11:57.511723] [INFO ] [REMOTE ] MVO: Fetching primary data for 2024-12. [2025-09-26T20:11:58.293062] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-26T20:11:58.311673] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-01. [2025-09-26T20:11:58.371617] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-26T20:11:59.111720] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-08. [2025-09-26T20:11:59.294225] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-26T20:11:59.911814] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-09. [2025-09-26T20:11:59.994537] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-26T20:12:00.711747] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-09. [2025-09-26T20:12:01.511766] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-02. [2025-09-26T20:12:02.034392] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-26T20:12:02.047798] [INFO ] [REMOTE ] MUX: Full fetch complete (58965 records). [2025-09-26T20:12:02.048013] [DEBUG] [VALIDATOR ] MUX: Validating primary data. [2025-09-26T20:12:02.295024] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-26T20:12:02.319495] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-09. [2025-09-26T20:12:02.347051] [INFO ] [REMOTE ] MUSA: Full fetch complete (35101 records). [2025-09-26T20:12:02.381011] [DEBUG] [VALIDATOR ] MUSA: Validating primary data. [2025-09-26T20:12:02.580841] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-26T20:12:02.655854] [DEBUG] [VALIDATOR ] MUX: All expected trading days are present. [2025-09-26T20:12:02.661565] [DEBUG] [VALIDATOR ] MUX: Primary data validation passed. [2025-09-26T20:12:02.667855] [INFO ] [MAIN ] MUX: Fetched primary data is valid. [2025-09-26T20:12:02.678226] [DEBUG] [LOCAL ] MUX: Saving primary data. [2025-09-26T20:12:02.749268] [DEBUG] [LOCAL ] MUX: Trimmed 58965 records to 43253 (keeping 200 days of data) [2025-09-26T20:12:03.062490] [DEBUG] [VALIDATOR ] MUSA: All expected trading days are present. [2025-09-26T20:12:03.062624] [DEBUG] [VALIDATOR ] MUSA: Primary data validation passed. [2025-09-26T20:12:03.063829] [INFO ] [MAIN ] MUSA: Fetched primary data is valid. [2025-09-26T20:12:03.063915] [DEBUG] [LOCAL ] MUSA: Saving primary data. [2025-09-26T20:12:03.067605] [DEBUG] [LOCAL ] MUSA: Trimmed 35101 records to 25221 (keeping 200 days of data) [2025-09-26T20:12:03.140020] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-03. [2025-09-26T20:12:03.361248] [DEBUG] [LOCAL ] MUX: Primary data saved (43253 records). [2025-09-26T20:12:03.362027] [INFO ] [MAIN ] MUX: Full history saved. [2025-09-26T20:12:03.362481] [INFO ] [MAIN ] Update Progress: 1436/2371 symbols completed. MUX took 32.0s. Estimated remaining: 2h 5m 1s. Rate: 7.5 symbols/min [2025-09-26T20:12:03.503217] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-26T20:12:03.524252] [INFO ] [REMOTE ] MVF: Full fetch complete (19091 records). [2025-09-26T20:12:03.548015] [DEBUG] [VALIDATOR ] MVF: Validating primary data. [2025-09-26T20:12:03.583210] [INFO ] [MAIN ] MVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:12:03.711506] [DEBUG] [LOCAL ] MVT: Loaded 10252 existing records from primary storage. [2025-09-26T20:12:03.728277] [INFO ] [MAIN ] MVT: Loaded 10252 existing records. [2025-09-26T20:12:04.186984] [WARN ] [MAIN ] MVT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:12:04.194629] [INFO ] [MAIN ] MVT: Wiping existing primary data before full refresh. [2025-09-26T20:12:04.200053] [INFO ] [LOCAL ] MVT: Starting deletion of primary data. [2025-09-26T20:12:04.216720] [DEBUG] [LOCAL ] MVT: Deleted primary data file. [2025-09-26T20:12:04.241409] [INFO ] [MAIN ] MVT: Starting full primary refresh. [2025-09-26T20:12:04.278321] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-26T20:12:04.278503] [DEBUG] [VALIDATOR ] MVF: All expected trading days are present. [2025-09-26T20:12:04.278690] [DEBUG] [VALIDATOR ] MVF: Primary data validation passed. [2025-09-26T20:12:04.294513] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-04. [2025-09-26T20:12:04.306265] [INFO ] [MAIN ] MVF: Fetched primary data is valid. [2025-09-26T20:12:04.304678] [DEBUG] [LOCAL ] MUSA: Primary data saved (25221 records). [2025-09-26T20:12:04.321372] [DEBUG] [LOCAL ] MVF: Saving primary data. [2025-09-26T20:12:04.326754] [INFO ] [MAIN ] MUSA: Full history saved. [2025-09-26T20:12:04.332303] [INFO ] [MAIN ] Update Progress: 1437/2371 symbols completed. MUSA took 41.9s. Estimated remaining: 2h 4m 48s. Rate: 7.5 symbols/min [2025-09-26T20:12:04.394682] [DEBUG] [LOCAL ] MVF: Trimmed 19091 records to 12921 (keeping 200 days of data) [2025-09-26T20:12:04.751196] [DEBUG] [LOCAL ] MVF: Primary data saved (12921 records). [2025-09-26T20:12:04.751120] [INFO ] [REMOTE ] MVT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:12:04.751507] [INFO ] [REMOTE ] MVT: Fetching primary data for 2024-12. [2025-09-26T20:12:04.752344] [INFO ] [MAIN ] MVF: Full history saved. [2025-09-26T20:12:04.752443] [INFO ] [MAIN ] Update Progress: 1438/2371 symbols completed. MVF took 31.7s. Estimated remaining: 2h 4m 35s. Rate: 7.5 symbols/min [2025-09-26T20:12:05.130725] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-26T20:12:05.467492] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-26T20:12:05.511739] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-05. [2025-09-26T20:12:06.236814] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-26T20:12:06.311714] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-01. [2025-09-26T20:12:07.099456] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-26T20:12:07.111681] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-02. [2025-09-26T20:12:07.787803] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-26T20:12:07.911768] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-03. [2025-09-26T20:12:08.692868] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-26T20:12:08.711728] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-04. [2025-09-26T20:12:09.511743] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-06. [2025-09-26T20:12:09.640974] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-26T20:12:10.311725] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-05. [2025-09-26T20:12:10.363779] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-26T20:12:11.111749] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-07. [2025-09-26T20:12:11.160284] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-26T20:12:11.904246] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-26T20:12:11.911661] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-08. [2025-09-26T20:12:12.711717] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-06. [2025-09-26T20:12:12.746048] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-26T20:12:13.511730] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-09. [2025-09-26T20:12:13.604856] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-26T20:12:14.311744] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-07. [2025-09-26T20:12:14.379344] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-26T20:12:14.381551] [INFO ] [REMOTE ] MVO: Full fetch complete (14446 records). [2025-09-26T20:12:14.381677] [DEBUG] [VALIDATOR ] MVO: Validating primary data. [2025-09-26T20:12:14.784300] [DEBUG] [VALIDATOR ] MVO: All expected trading days are present. [2025-09-26T20:12:14.784400] [DEBUG] [VALIDATOR ] MVO: Primary data validation passed. [2025-09-26T20:12:14.784763] [INFO ] [MAIN ] MVO: Fetched primary data is valid. [2025-09-26T20:12:14.784827] [DEBUG] [LOCAL ] MVO: Saving primary data. [2025-09-26T20:12:14.785514] [DEBUG] [LOCAL ] MVO: Trimmed 14446 records to 9140 (keeping 200 days of data) [2025-09-26T20:12:14.847714] [DEBUG] [LOCAL ] MVO: Primary data saved (9140 records). [2025-09-26T20:12:14.847870] [INFO ] [MAIN ] MVO: Full history saved. [2025-09-26T20:12:14.847961] [INFO ] [MAIN ] Update Progress: 1439/2371 symbols completed. MVO took 21.7s. Estimated remaining: 2h 4m 29s. Rate: 7.5 symbols/min [2025-09-26T20:12:14.901391] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-26T20:12:15.111751] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-08. [2025-09-26T20:12:15.973264] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-26T20:12:15.976324] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-09. [2025-09-26T20:12:16.914293] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-26T20:12:16.917337] [INFO ] [REMOTE ] MVT: Full fetch complete (14726 records). [2025-09-26T20:12:16.917428] [DEBUG] [VALIDATOR ] MVT: Validating primary data. [2025-09-26T20:12:17.336563] [DEBUG] [VALIDATOR ] MVT: All expected trading days are present. [2025-09-26T20:12:17.336706] [DEBUG] [VALIDATOR ] MVT: Primary data validation passed. [2025-09-26T20:12:17.337144] [INFO ] [MAIN ] MVT: Fetched primary data is valid. [2025-09-26T20:12:17.337210] [DEBUG] [LOCAL ] MVT: Saving primary data. [2025-09-26T20:12:17.338087] [DEBUG] [LOCAL ] MVT: Trimmed 14726 records to 10355 (keeping 200 days of data) [2025-09-26T20:12:17.408842] [DEBUG] [LOCAL ] MVT: Primary data saved (10355 records). [2025-09-26T20:12:17.409005] [INFO ] [MAIN ] MVT: Full history saved. [2025-09-26T20:12:17.409102] [INFO ] [MAIN ] Update Progress: 1440/2371 symbols completed. MVT took 14.0s. Estimated remaining: 2h 4m 17s. Rate: 7.5 symbols/min [2025-09-26T20:12:18.153921] [INFO ] [MAIN ] MWA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:12:18.308243] [INFO ] [MAIN ] MXF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:12:18.331156] [INFO ] [MAIN ] MX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:12:18.309866] [INFO ] [MAIN ] MXE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:12:18.333366] [DEBUG] [LOCAL ] MXE: No existing data file found in primary storage. [2025-09-26T20:12:18.333454] [WARN ] [MAIN ] MXE: No existing data found, performing full refresh instead. [2025-09-26T20:12:18.333746] [INFO ] [MAIN ] MXE: Wiping existing primary data before full refresh. [2025-09-26T20:12:18.333800] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-09-26T20:12:18.333848] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-09-26T20:12:18.333894] [INFO ] [MAIN ] MXE: Starting full primary refresh. [2025-09-26T20:12:18.429364] [DEBUG] [LOCAL ] MXF: Loaded 5972 existing records from primary storage. [2025-09-26T20:12:18.434778] [INFO ] [MAIN ] MXF: Loaded 5972 existing records. [2025-09-26T20:12:18.576325] [DEBUG] [LOCAL ] MX: Loaded 23261 existing records from primary storage. [2025-09-26T20:12:18.626402] [INFO ] [MAIN ] MX: Loaded 23261 existing records. [2025-09-26T20:12:18.920017] [DEBUG] [LOCAL ] MWA: Loaded 47339 existing records from primary storage. [2025-09-26T20:12:18.997841] [INFO ] [MAIN ] MWA: Loaded 47339 existing records. [2025-09-26T20:12:19.090211] [WARN ] [MAIN ] MXF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:12:19.241545] [INFO ] [MAIN ] MXF: Wiping existing primary data before full refresh. [2025-09-26T20:12:19.324333] [INFO ] [REMOTE ] MXE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:12:19.303879] [INFO ] [LOCAL ] MXF: Starting deletion of primary data. [2025-09-26T20:12:19.364131] [DEBUG] [LOCAL ] MXF: Deleted primary data file. [2025-09-26T20:12:19.374996] [WARN ] [MAIN ] MX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:12:19.375134] [INFO ] [MAIN ] MXF: Starting full primary refresh. [2025-09-26T20:12:19.369627] [INFO ] [REMOTE ] MXE: Fetching primary data for 2024-12. [2025-09-26T20:12:19.402354] [INFO ] [MAIN ] MX: Wiping existing primary data before full refresh. [2025-09-26T20:12:19.435254] [INFO ] [LOCAL ] MX: Starting deletion of primary data. [2025-09-26T20:12:19.477794] [DEBUG] [LOCAL ] MX: Deleted primary data file. [2025-09-26T20:12:19.483007] [INFO ] [MAIN ] MX: Starting full primary refresh. [2025-09-26T20:12:19.630310] [WARN ] [MAIN ] MWA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:12:19.673930] [INFO ] [MAIN ] MWA: Wiping existing primary data before full refresh. [2025-09-26T20:12:19.756986] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-09-26T20:12:19.778754] [DEBUG] [LOCAL ] MWA: Deleted primary data file. [2025-09-26T20:12:19.784364] [INFO ] [MAIN ] MWA: Starting full primary refresh. [2025-09-26T20:12:20.068820] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-26T20:12:20.154622] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-01. [2025-09-26T20:12:20.354309] [INFO ] [REMOTE ] MXF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:12:20.414306] [INFO ] [REMOTE ] MXF: Fetching primary data for 2024-12. [2025-09-26T20:12:20.521310] [INFO ] [REMOTE ] MX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:12:20.547350] [INFO ] [REMOTE ] MX: Fetching primary data for 2024-12. [2025-09-26T20:12:20.703933] [INFO ] [REMOTE ] MWA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:12:20.704271] [INFO ] [REMOTE ] MWA: Fetching primary data for 2024-12. [2025-09-26T20:12:20.802437] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-26T20:12:20.804070] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-02. [2025-09-26T20:12:21.227420] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-26T20:12:21.362021] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-26T20:12:21.511707] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-01. [2025-09-26T20:12:21.612274] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-26T20:12:22.232465] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-26T20:12:22.305511] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-26T20:12:22.311660] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-02. [2025-09-26T20:12:22.758333] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-26T20:12:23.111719] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-03. [2025-09-26T20:12:23.559392] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-26T20:12:23.911720] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-01. [2025-09-26T20:12:24.711725] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-03. [2025-09-26T20:12:24.811882] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-26T20:12:25.145329] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-26T20:12:25.511736] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-02. [2025-09-26T20:12:26.311734] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-04. [2025-09-26T20:12:26.528343] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-26T20:12:26.875043] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-26T20:12:27.111748] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-01. [2025-09-26T20:12:27.911723] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-04. [2025-09-26T20:12:28.176310] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-09-26T20:12:28.589407] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-26T20:12:28.711742] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-05. [2025-09-26T20:12:29.067757] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-26T20:12:29.511727] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-05. [2025-09-26T20:12:30.311727] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-06. [2025-09-26T20:12:30.879466] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-26T20:12:30.947806] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-26T20:12:31.111728] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-07. [2025-09-26T20:12:31.671841] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-26T20:12:31.911729] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-08. [2025-09-26T20:12:32.438211] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-26T20:12:32.711734] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-09. [2025-09-26T20:12:33.200910] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-26T20:12:33.202009] [INFO ] [REMOTE ] MXE: Full fetch complete (2667 records). [2025-09-26T20:12:33.202082] [DEBUG] [VALIDATOR ] MXE: Validating primary data. [2025-09-26T20:12:33.392578] [WARN ] [VALIDATOR ] MXE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-26T20:12:33.392861] [FATAL] [MAIN ] MXE: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:12:33.392951] [WARN ] [MAIN ] MXE: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:12:33.393048] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-09-26T20:12:33.393137] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-09-26T20:12:33.393179] [INFO ] [LOCAL ] MXE: Starting deletion of derivative data. [2025-09-26T20:12:33.393224] [DEBUG] [LOCAL ] MXE: No derivative data file found to delete. [2025-09-26T20:12:33.393307] [INFO ] [MAIN ] Update Progress: 1441/2371 symbols completed. MXE took 16.0s. Estimated remaining: 2h 4m 14s. Rate: 7.5 symbols/min [2025-09-26T20:12:33.516981] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-02. [2025-09-26T20:12:33.607571] [INFO ] [MAIN ] MYD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:12:33.627546] [DEBUG] [LOCAL ] MYD: Loaded 13867 existing records from primary storage. [2025-09-26T20:12:33.627728] [INFO ] [MAIN ] MYD: Loaded 13867 existing records. [2025-09-26T20:12:33.817078] [WARN ] [MAIN ] MYD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:12:33.817388] [INFO ] [MAIN ] MYD: Wiping existing primary data before full refresh. [2025-09-26T20:12:33.817461] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-09-26T20:12:33.817969] [DEBUG] [LOCAL ] MYD: Deleted primary data file. [2025-09-26T20:12:33.818031] [INFO ] [MAIN ] MYD: Starting full primary refresh. [2025-09-26T20:12:34.187572] [INFO ] [REMOTE ] MYD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:12:34.311723] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-06. [2025-09-26T20:12:34.930976] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-26T20:12:34.996423] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-26T20:12:35.111722] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-03. [2025-09-26T20:12:35.911715] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-03. [2025-09-26T20:12:36.711702] [INFO ] [REMOTE ] MYD: Fetching primary data for 2024-12. [2025-09-26T20:12:37.103902] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-26T20:12:37.142610] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-26T20:12:37.511684] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-04. [2025-09-26T20:12:37.747622] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-26T20:12:38.311736] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-07. [2025-09-26T20:12:38.933107] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-26T20:12:39.111690] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-01. [2025-09-26T20:12:39.221508] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-26T20:12:39.911725] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-08. [2025-09-26T20:12:39.939078] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-26T20:12:40.423733] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-26T20:12:40.711725] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-09. [2025-09-26T20:12:41.292333] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-26T20:12:41.293463] [INFO ] [REMOTE ] MXF: Full fetch complete (10406 records). [2025-09-26T20:12:41.293536] [DEBUG] [VALIDATOR ] MXF: Validating primary data. [2025-09-26T20:12:41.519184] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-05. [2025-09-26T20:12:41.700516] [DEBUG] [VALIDATOR ] MXF: All expected trading days are present. [2025-09-26T20:12:41.700604] [DEBUG] [VALIDATOR ] MXF: Primary data validation passed. [2025-09-26T20:12:41.700962] [INFO ] [MAIN ] MXF: Fetched primary data is valid. [2025-09-26T20:12:41.701026] [DEBUG] [LOCAL ] MXF: Saving primary data. [2025-09-26T20:12:41.701539] [DEBUG] [LOCAL ] MXF: Trimmed 10406 records to 5984 (keeping 200 days of data) [2025-09-26T20:12:41.741782] [DEBUG] [LOCAL ] MXF: Primary data saved (5984 records). [2025-09-26T20:12:41.741934] [INFO ] [MAIN ] MXF: Full history saved. [2025-09-26T20:12:41.742032] [INFO ] [MAIN ] Update Progress: 1442/2371 symbols completed. MXF took 24.3s. Estimated remaining: 2h 4m 7s. Rate: 7.5 symbols/min [2025-09-26T20:12:41.927422] [INFO ] [MAIN ] MYE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:12:41.954727] [DEBUG] [LOCAL ] MYE: Loaded 25165 existing records from primary storage. [2025-09-26T20:12:41.954889] [INFO ] [MAIN ] MYE: Loaded 25165 existing records. [2025-09-26T20:12:42.152589] [WARN ] [MAIN ] MYE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:12:42.152882] [INFO ] [MAIN ] MYE: Wiping existing primary data before full refresh. [2025-09-26T20:12:42.152934] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-09-26T20:12:42.153554] [DEBUG] [LOCAL ] MYE: Deleted primary data file. [2025-09-26T20:12:42.153618] [INFO ] [MAIN ] MYE: Starting full primary refresh. [2025-09-26T20:12:42.316864] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-02. [2025-09-26T20:12:42.561075] [INFO ] [REMOTE ] MYE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:12:43.111695] [INFO ] [REMOTE ] MYE: Fetching primary data for 2024-12. [2025-09-26T20:12:43.221838] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-26T20:12:43.322815] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-26T20:12:43.911726] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-03. [2025-09-26T20:12:44.529903] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-26T20:12:44.711710] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-06. [2025-09-26T20:12:44.913323] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-26T20:12:45.511712] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-01. [2025-09-26T20:12:46.311721] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-04. [2025-09-26T20:12:46.841068] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-26T20:12:47.111740] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-02. [2025-09-26T20:12:47.218522] [DEBUG] [REMOTE ] MYE: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-26T20:12:47.218905] [WARN ] [REMOTE ] MYE: No data returned for month 2025-02 [2025-09-26T20:12:47.300179] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-26T20:12:47.911719] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-04. [2025-09-26T20:12:48.711710] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-03. [2025-09-26T20:12:49.055961] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-26T20:12:49.511747] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-05. [2025-09-26T20:12:49.956545] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-26T20:12:50.311727] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-04. [2025-09-26T20:12:50.336687] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-26T20:12:51.111711] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-05. [2025-09-26T20:12:51.846100] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-26T20:12:51.911705] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-05. [2025-09-26T20:12:52.125432] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-26T20:12:52.711768] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-06. [2025-09-26T20:12:52.996670] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-26T20:12:53.511728] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-06. [2025-09-26T20:12:53.846059] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-26T20:12:54.311731] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-07. [2025-09-26T20:12:54.336752] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-26T20:12:55.111723] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-06. [2025-09-26T20:12:55.353055] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-26T20:12:55.911690] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-07. [2025-09-26T20:12:56.342170] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-26T20:12:56.353725] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-06 (11.64 seconds). [2025-09-26T20:12:56.711733] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-07. [2025-09-26T20:12:57.511733] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-07. [2025-09-26T20:12:58.301350] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-26T20:12:58.311760] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-08. [2025-09-26T20:12:59.111703] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-08. [2025-09-26T20:12:59.629337] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-26T20:12:59.771980] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-07 (3.86 seconds). [2025-09-26T20:12:59.911804] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-08. [2025-09-26T20:13:00.711744] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-09. [2025-09-26T20:13:00.813021] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-26T20:13:01.511794] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-09. [2025-09-26T20:13:02.028340] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-26T20:13:02.033382] [INFO ] [REMOTE ] MX: Full fetch complete (31876 records). [2025-09-26T20:13:02.033525] [DEBUG] [VALIDATOR ] MX: Validating primary data. [2025-09-26T20:13:02.355320] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-07 (4.84 seconds). [2025-09-26T20:13:02.374202] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-08. [2025-09-26T20:13:02.466483] [DEBUG] [VALIDATOR ] MX: All expected trading days are present. [2025-09-26T20:13:02.466599] [DEBUG] [VALIDATOR ] MX: Primary data validation passed. [2025-09-26T20:13:02.467977] [INFO ] [MAIN ] MX: Fetched primary data is valid. [2025-09-26T20:13:02.468044] [DEBUG] [LOCAL ] MX: Saving primary data. [2025-09-26T20:13:02.470187] [DEBUG] [LOCAL ] MX: Trimmed 31876 records to 23379 (keeping 200 days of data) [2025-09-26T20:13:02.619113] [DEBUG] [LOCAL ] MX: Primary data saved (23379 records). [2025-09-26T20:13:02.619316] [INFO ] [MAIN ] MX: Full history saved. [2025-09-26T20:13:02.619437] [INFO ] [MAIN ] Update Progress: 1443/2371 symbols completed. MX took 45.2s. Estimated remaining: 2h 4m 7s. Rate: 7.5 symbols/min [2025-09-26T20:13:02.799272] [INFO ] [MAIN ] MYI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:13:02.827844] [DEBUG] [LOCAL ] MYI: Loaded 19516 existing records from primary storage. [2025-09-26T20:13:02.828138] [INFO ] [MAIN ] MYI: Loaded 19516 existing records. [2025-09-26T20:13:03.026179] [WARN ] [MAIN ] MYI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:13:03.026590] [INFO ] [MAIN ] MYI: Wiping existing primary data before full refresh. [2025-09-26T20:13:03.026690] [INFO ] [LOCAL ] MYI: Starting deletion of primary data. [2025-09-26T20:13:03.027335] [DEBUG] [LOCAL ] MYI: Deleted primary data file. [2025-09-26T20:13:03.027399] [INFO ] [MAIN ] MYI: Starting full primary refresh. [2025-09-26T20:13:03.230529] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T20:13:03.260097] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-08 (3.35 seconds). [2025-09-26T20:13:03.323516] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-09. [2025-09-26T20:13:03.332730] [INFO ] [REMOTE ] MWA: Full fetch complete (67765 records). [2025-09-26T20:13:03.365964] [DEBUG] [VALIDATOR ] MWA: Validating primary data. [2025-09-26T20:13:03.572920] [INFO ] [REMOTE ] MYI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:13:03.642328] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-26T20:13:03.899027] [DEBUG] [VALIDATOR ] MWA: All expected trading days are present. [2025-09-26T20:13:03.899123] [DEBUG] [VALIDATOR ] MWA: Primary data validation passed. [2025-09-26T20:13:03.900155] [INFO ] [MAIN ] MWA: Fetched primary data is valid. [2025-09-26T20:13:03.900220] [DEBUG] [LOCAL ] MWA: Saving primary data. [2025-09-26T20:13:03.901706] [DEBUG] [LOCAL ] MWA: Trimmed 67765 records to 47633 (keeping 200 days of data) [2025-09-26T20:13:03.911714] [INFO ] [REMOTE ] MYI: Fetching primary data for 2024-12. [2025-09-26T20:13:04.210783] [DEBUG] [LOCAL ] MWA: Primary data saved (47633 records). [2025-09-26T20:13:04.210928] [INFO ] [MAIN ] MWA: Full history saved. [2025-09-26T20:13:04.211041] [INFO ] [MAIN ] Update Progress: 1444/2371 symbols completed. MWA took 46.8s. Estimated remaining: 2h 3m 55s. Rate: 7.5 symbols/min [2025-09-26T20:13:04.347521] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-26T20:13:04.381017] [INFO ] [REMOTE ] MYD: Full fetch complete (20768 records). [2025-09-26T20:13:04.387608] [DEBUG] [VALIDATOR ] MYD: Validating primary data. [2025-09-26T20:13:04.409222] [INFO ] [MAIN ] MYN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:13:04.546034] [DEBUG] [LOCAL ] MYN: Loaded 10294 existing records from primary storage. [2025-09-26T20:13:04.551823] [INFO ] [MAIN ] MYN: Loaded 10294 existing records. [2025-09-26T20:13:04.716674] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-09. [2025-09-26T20:13:04.958628] [WARN ] [MAIN ] MYN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:13:05.002412] [INFO ] [MAIN ] MYN: Wiping existing primary data before full refresh. [2025-09-26T20:13:05.019096] [INFO ] [LOCAL ] MYN: Starting deletion of primary data. [2025-09-26T20:13:05.030975] [DEBUG] [LOCAL ] MYN: Deleted primary data file. [2025-09-26T20:13:05.031077] [INFO ] [MAIN ] MYN: Starting full primary refresh. [2025-09-26T20:13:05.036390] [DEBUG] [VALIDATOR ] MYD: All expected trading days are present. [2025-09-26T20:13:05.070221] [DEBUG] [VALIDATOR ] MYD: Primary data validation passed. [2025-09-26T20:13:05.083517] [INFO ] [MAIN ] MYD: Fetched primary data is valid. [2025-09-26T20:13:05.091709] [DEBUG] [LOCAL ] MYD: Saving primary data. [2025-09-26T20:13:05.147804] [DEBUG] [LOCAL ] MYD: Trimmed 20768 records to 13946 (keeping 200 days of data) [2025-09-26T20:13:05.320687] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-26T20:13:05.512673] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-01. [2025-09-26T20:13:05.535619] [INFO ] [REMOTE ] MYN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:13:05.548206] [DEBUG] [LOCAL ] MYD: Primary data saved (13946 records). [2025-09-26T20:13:05.548331] [INFO ] [MAIN ] MYD: Full history saved. [2025-09-26T20:13:05.548860] [INFO ] [MAIN ] Update Progress: 1445/2371 symbols completed. MYD took 32.2s. Estimated remaining: 2h 3m 42s. Rate: 7.5 symbols/min [2025-09-26T20:13:05.727173] [INFO ] [MAIN ] NABL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:13:05.776731] [DEBUG] [LOCAL ] NABL: Loaded 40059 existing records from primary storage. [2025-09-26T20:13:05.776920] [INFO ] [MAIN ] NABL: Loaded 40059 existing records. [2025-09-26T20:13:05.967147] [WARN ] [MAIN ] NABL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:13:05.967584] [INFO ] [MAIN ] NABL: Wiping existing primary data before full refresh. [2025-09-26T20:13:05.967672] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-09-26T20:13:05.968627] [DEBUG] [LOCAL ] NABL: Deleted primary data file. [2025-09-26T20:13:05.968721] [INFO ] [MAIN ] NABL: Starting full primary refresh. [2025-09-26T20:13:06.250604] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-26T20:13:06.287825] [INFO ] [REMOTE ] MYE: Full fetch complete (33414 records). [2025-09-26T20:13:06.299909] [DEBUG] [VALIDATOR ] MYE: Validating primary data. [2025-09-26T20:13:06.311778] [INFO ] [REMOTE ] MYN: Fetching primary data for 2024-12. [2025-09-26T20:13:06.516234] [INFO ] [REMOTE ] NABL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:13:06.609466] [WARN ] [VALIDATOR ] MYE: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-26T20:13:06.609926] [FATAL] [MAIN ] MYE: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:13:06.610000] [WARN ] [MAIN ] MYE: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:13:06.610074] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-09-26T20:13:06.610166] [DEBUG] [LOCAL ] MYE: No primary data file found to delete. [2025-09-26T20:13:06.610269] [INFO ] [LOCAL ] MYE: Starting deletion of derivative data. [2025-09-26T20:13:06.610821] [DEBUG] [LOCAL ] MYE: Deleted derivative data file. [2025-09-26T20:13:06.610968] [INFO ] [MAIN ] Update Progress: 1446/2371 symbols completed. MYE took 24.9s. Estimated remaining: 2h 3m 30s. Rate: 7.5 symbols/min [2025-09-26T20:13:06.788030] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-26T20:13:06.823994] [INFO ] [MAIN ] NAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:13:06.852282] [DEBUG] [LOCAL ] NAC: Loaded 24882 existing records from primary storage. [2025-09-26T20:13:06.852445] [INFO ] [MAIN ] NAC: Loaded 24882 existing records. [2025-09-26T20:13:07.043347] [WARN ] [MAIN ] NAC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:13:07.051393] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-26T20:13:07.054230] [INFO ] [MAIN ] NAC: Wiping existing primary data before full refresh. [2025-09-26T20:13:07.054834] [INFO ] [LOCAL ] NAC: Starting deletion of primary data. [2025-09-26T20:13:07.055455] [DEBUG] [LOCAL ] NAC: Deleted primary data file. [2025-09-26T20:13:07.055516] [INFO ] [MAIN ] NAC: Starting full primary refresh. [2025-09-26T20:13:07.116823] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-01. [2025-09-26T20:13:07.477713] [INFO ] [REMOTE ] NAC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:13:07.911738] [INFO ] [REMOTE ] NAC: Fetching primary data for 2024-12. [2025-09-26T20:13:08.163624] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-26T20:13:08.711725] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-02. [2025-09-26T20:13:09.204318] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-26T20:13:09.511732] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-02. [2025-09-26T20:13:09.797552] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-26T20:13:10.311717] [INFO ] [REMOTE ] NABL: Fetching primary data for 2024-12. [2025-09-26T20:13:10.324401] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-26T20:13:11.111713] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-03. [2025-09-26T20:13:11.823171] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-26T20:13:11.911717] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-01. [2025-09-26T20:13:12.249349] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-26T20:13:12.711718] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-04. [2025-09-26T20:13:13.251475] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-26T20:13:13.511713] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-01. [2025-09-26T20:13:13.960527] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-26T20:13:14.181140] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-26T20:13:14.311741] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-05. [2025-09-26T20:13:15.111745] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-03. [2025-09-26T20:13:15.284218] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-26T20:13:15.911688] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-02. [2025-09-26T20:13:15.984158] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-26T20:13:16.711761] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-02. [2025-09-26T20:13:17.204922] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-26T20:13:17.511718] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-06. [2025-09-26T20:13:18.311734] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-04. [2025-09-26T20:13:18.573207] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-26T20:13:19.097329] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-26T20:13:19.111639] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-05. [2025-09-26T20:13:19.629984] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-02 (2.92 seconds). [2025-09-26T20:13:19.911703] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-07. [2025-09-26T20:13:19.922337] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-26T20:13:20.711742] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-03. [2025-09-26T20:13:20.892583] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-26T20:13:21.511725] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-08. [2025-09-26T20:13:22.311714] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-06. [2025-09-26T20:13:22.604228] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-26T20:13:22.637110] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-26T20:13:23.111697] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-09. [2025-09-26T20:13:23.144786] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-26T20:13:23.911721] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-04. [2025-09-26T20:13:24.419359] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-26T20:13:24.425282] [INFO ] [REMOTE ] MYI: Full fetch complete (29561 records). [2025-09-26T20:13:24.425408] [DEBUG] [VALIDATOR ] MYI: Validating primary data. [2025-09-26T20:13:24.712513] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-03. [2025-09-26T20:13:24.845177] [DEBUG] [VALIDATOR ] MYI: All expected trading days are present. [2025-09-26T20:13:24.845351] [DEBUG] [VALIDATOR ] MYI: Primary data validation passed. [2025-09-26T20:13:24.846179] [INFO ] [MAIN ] MYI: Fetched primary data is valid. [2025-09-26T20:13:24.846247] [DEBUG] [LOCAL ] MYI: Saving primary data. [2025-09-26T20:13:24.847187] [DEBUG] [LOCAL ] MYI: Trimmed 29561 records to 19636 (keeping 200 days of data) [2025-09-26T20:13:24.977572] [DEBUG] [LOCAL ] MYI: Primary data saved (19636 records). [2025-09-26T20:13:24.978228] [INFO ] [MAIN ] MYI: Full history saved. [2025-09-26T20:13:24.978471] [INFO ] [MAIN ] Update Progress: 1447/2371 symbols completed. MYI took 22.4s. Estimated remaining: 2h 3m 29s. Rate: 7.5 symbols/min [2025-09-26T20:13:25.166364] [INFO ] [MAIN ] NAD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:13:25.185749] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-26T20:13:25.231818] [DEBUG] [LOCAL ] NAD: Loaded 34139 existing records from primary storage. [2025-09-26T20:13:25.231966] [INFO ] [MAIN ] NAD: Loaded 34139 existing records. [2025-09-26T20:13:25.418893] [WARN ] [MAIN ] NAD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:13:25.419139] [INFO ] [MAIN ] NAD: Wiping existing primary data before full refresh. [2025-09-26T20:13:25.419191] [INFO ] [LOCAL ] NAD: Starting deletion of primary data. [2025-09-26T20:13:25.419803] [DEBUG] [LOCAL ] NAD: Deleted primary data file. [2025-09-26T20:13:25.419869] [INFO ] [MAIN ] NAD: Starting full primary refresh. [2025-09-26T20:13:25.516961] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-07. [2025-09-26T20:13:25.795526] [INFO ] [REMOTE ] NAD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:13:26.311684] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-05. [2025-09-26T20:13:26.371715] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-26T20:13:26.475552] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-26T20:13:27.111742] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-08. [2025-09-26T20:13:27.487969] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-26T20:13:27.595210] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-26T20:13:27.911723] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-06. [2025-09-26T20:13:28.711744] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-04. [2025-09-26T20:13:29.125342] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-26T20:13:29.511730] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-09. [2025-09-26T20:13:30.009184] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-26T20:13:30.311705] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-07. [2025-09-26T20:13:30.393548] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-26T20:13:30.396706] [INFO ] [REMOTE ] MYN: Full fetch complete (15496 records). [2025-09-26T20:13:30.396814] [DEBUG] [VALIDATOR ] MYN: Validating primary data. [2025-09-26T20:13:30.795213] [DEBUG] [VALIDATOR ] MYN: All expected trading days are present. [2025-09-26T20:13:30.795307] [DEBUG] [VALIDATOR ] MYN: Primary data validation passed. [2025-09-26T20:13:30.795814] [INFO ] [MAIN ] MYN: Fetched primary data is valid. [2025-09-26T20:13:30.795879] [DEBUG] [LOCAL ] MYN: Saving primary data. [2025-09-26T20:13:30.796426] [DEBUG] [LOCAL ] MYN: Trimmed 15496 records to 10324 (keeping 200 days of data) [2025-09-26T20:13:30.863307] [DEBUG] [LOCAL ] MYN: Primary data saved (10324 records). [2025-09-26T20:13:30.863484] [INFO ] [MAIN ] MYN: Full history saved. [2025-09-26T20:13:30.863590] [INFO ] [MAIN ] Update Progress: 1448/2371 symbols completed. MYN took 26.7s. Estimated remaining: 2h 3m 19s. Rate: 7.5 symbols/min [2025-09-26T20:13:31.049052] [INFO ] [MAIN ] NAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:13:31.060208] [DEBUG] [LOCAL ] NAN: Loaded 9060 existing records from primary storage. [2025-09-26T20:13:31.060333] [INFO ] [MAIN ] NAN: Loaded 9060 existing records. [2025-09-26T20:13:31.119276] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-05. [2025-09-26T20:13:31.260997] [WARN ] [MAIN ] NAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:13:31.261389] [INFO ] [MAIN ] NAN: Wiping existing primary data before full refresh. [2025-09-26T20:13:31.261464] [INFO ] [LOCAL ] NAN: Starting deletion of primary data. [2025-09-26T20:13:31.262125] [DEBUG] [LOCAL ] NAN: Deleted primary data file. [2025-09-26T20:13:31.262199] [INFO ] [MAIN ] NAN: Starting full primary refresh. [2025-09-26T20:13:31.474169] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-26T20:13:31.685794] [INFO ] [REMOTE ] NAN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:13:31.911716] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-08. [2025-09-26T20:13:32.649069] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-26T20:13:32.711716] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-06. [2025-09-26T20:13:33.511692] [INFO ] [REMOTE ] NAN: Fetching primary data for 2024-12. [2025-09-26T20:13:33.703018] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-26T20:13:34.172355] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-26T20:13:34.311730] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-07. [2025-09-26T20:13:34.381864] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-26T20:13:35.111744] [INFO ] [REMOTE ] NAD: Fetching primary data for 2024-12. [2025-09-26T20:13:35.726293] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-26T20:13:35.911736] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-01. [2025-09-26T20:13:36.579082] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-26T20:13:36.608026] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-26T20:13:36.711722] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-09. [2025-09-26T20:13:37.511714] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-01. [2025-09-26T20:13:37.929567] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-26T20:13:37.935571] [INFO ] [REMOTE ] NAC: Full fetch complete (36266 records). [2025-09-26T20:13:37.935763] [DEBUG] [VALIDATOR ] NAC: Validating primary data. [2025-09-26T20:13:38.321510] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-02. [2025-09-26T20:13:38.354131] [DEBUG] [VALIDATOR ] NAC: All expected trading days are present. [2025-09-26T20:13:38.354218] [DEBUG] [VALIDATOR ] NAC: Primary data validation passed. [2025-09-26T20:13:38.354929] [INFO ] [MAIN ] NAC: Fetched primary data is valid. [2025-09-26T20:13:38.354996] [DEBUG] [LOCAL ] NAC: Saving primary data. [2025-09-26T20:13:38.356581] [DEBUG] [LOCAL ] NAC: Trimmed 36266 records to 25076 (keeping 200 days of data) [2025-09-26T20:13:38.513434] [DEBUG] [LOCAL ] NAC: Primary data saved (25076 records). [2025-09-26T20:13:38.513572] [INFO ] [MAIN ] NAC: Full history saved. [2025-09-26T20:13:38.513690] [INFO ] [MAIN ] Update Progress: 1449/2371 symbols completed. NAC took 31.9s. Estimated remaining: 2h 3m 11s. Rate: 7.5 symbols/min [2025-09-26T20:13:38.701735] [INFO ] [MAIN ] NAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:13:38.754767] [DEBUG] [LOCAL ] NAT: Loaded 49478 existing records from primary storage. [2025-09-26T20:13:38.754932] [INFO ] [MAIN ] NAT: Loaded 49478 existing records. [2025-09-26T20:13:38.968170] [WARN ] [MAIN ] NAT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:13:38.982322] [INFO ] [MAIN ] NAT: Wiping existing primary data before full refresh. [2025-09-26T20:13:38.982723] [INFO ] [LOCAL ] NAT: Starting deletion of primary data. [2025-09-26T20:13:38.984323] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-26T20:13:38.984398] [DEBUG] [LOCAL ] NAT: Deleted primary data file. [2025-09-26T20:13:38.984668] [INFO ] [MAIN ] NAT: Starting full primary refresh. [2025-09-26T20:13:39.112214] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-02. [2025-09-26T20:13:39.325944] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-26T20:13:39.398146] [INFO ] [REMOTE ] NAT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:13:39.911724] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-08. [2025-09-26T20:13:40.431128] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-26T20:13:40.711723] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-03. [2025-09-26T20:13:41.274485] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-26T20:13:41.511714] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-09. [2025-09-26T20:13:42.311706] [INFO ] [REMOTE ] NAT: Fetching primary data for 2024-12. [2025-09-26T20:13:42.359214] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-26T20:13:43.016503] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-26T20:13:43.024348] [INFO ] [REMOTE ] NABL: Full fetch complete (56723 records). [2025-09-26T20:13:43.024463] [DEBUG] [VALIDATOR ] NABL: Validating primary data. [2025-09-26T20:13:43.116821] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-04. [2025-09-26T20:13:43.441024] [DEBUG] [VALIDATOR ] NABL: All expected trading days are present. [2025-09-26T20:13:43.441122] [DEBUG] [VALIDATOR ] NABL: Primary data validation passed. [2025-09-26T20:13:43.441995] [INFO ] [MAIN ] NABL: Fetched primary data is valid. [2025-09-26T20:13:43.442062] [DEBUG] [LOCAL ] NABL: Saving primary data. [2025-09-26T20:13:43.443665] [DEBUG] [LOCAL ] NABL: Trimmed 56723 records to 40294 (keeping 200 days of data) [2025-09-26T20:13:43.680214] [DEBUG] [LOCAL ] NABL: Primary data saved (40294 records). [2025-09-26T20:13:43.680370] [INFO ] [MAIN ] NABL: Full history saved. [2025-09-26T20:13:43.680466] [INFO ] [MAIN ] Update Progress: 1450/2371 symbols completed. NABL took 38.1s. Estimated remaining: 2h 3m 1s. Rate: 7.5 symbols/min [2025-09-26T20:13:43.864717] [INFO ] [MAIN ] NATL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:13:43.903984] [DEBUG] [LOCAL ] NATL: Loaded 33145 existing records from primary storage. [2025-09-26T20:13:43.904240] [INFO ] [MAIN ] NATL: Loaded 33145 existing records. [2025-09-26T20:13:43.917682] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-03. [2025-09-26T20:13:44.098418] [WARN ] [MAIN ] NATL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:13:44.098727] [INFO ] [MAIN ] NATL: Wiping existing primary data before full refresh. [2025-09-26T20:13:44.098785] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-09-26T20:13:44.099524] [DEBUG] [LOCAL ] NATL: Deleted primary data file. [2025-09-26T20:13:44.099585] [INFO ] [MAIN ] NATL: Starting full primary refresh. [2025-09-26T20:13:44.503983] [INFO ] [REMOTE ] NATL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:13:44.711705] [INFO ] [REMOTE ] NATL: Fetching primary data for 2024-12. [2025-09-26T20:13:44.741040] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-26T20:13:44.769180] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-26T20:13:45.511715] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-05. [2025-09-26T20:13:45.672954] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2024-12 (3.36 seconds). [2025-09-26T20:13:46.311701] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-04. [2025-09-26T20:13:46.721227] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-26T20:13:46.959452] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-26T20:13:47.111695] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-01. [2025-09-26T20:13:47.270501] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-26T20:13:47.911721] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-06. [2025-09-26T20:13:48.711706] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-01. [2025-09-26T20:13:48.775960] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-26T20:13:49.136255] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-26T20:13:49.511711] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-05. [2025-09-26T20:13:49.834504] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-26T20:13:50.311694] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-02. [2025-09-26T20:13:50.320930] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-26T20:13:51.111754] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-06. [2025-09-26T20:13:51.453678] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-26T20:13:51.732257] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-26T20:13:51.911716] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-07. [2025-09-26T20:13:52.711711] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-07. [2025-09-26T20:13:53.279378] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-26T20:13:53.489434] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-26T20:13:53.511713] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-08. [2025-09-26T20:13:54.311716] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-08. [2025-09-26T20:13:54.846351] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-26T20:13:55.046621] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-26T20:13:55.111729] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-03. [2025-09-26T20:13:55.911722] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-02. [2025-09-26T20:13:56.369464] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-26T20:13:56.711718] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-09. [2025-09-26T20:13:57.511694] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-04. [2025-09-26T20:13:57.674484] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-26T20:13:58.142395] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-26T20:13:58.149097] [INFO ] [REMOTE ] NAD: Full fetch complete (49967 records). [2025-09-26T20:13:58.149259] [DEBUG] [VALIDATOR ] NAD: Validating primary data. [2025-09-26T20:13:58.316811] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-03. [2025-09-26T20:13:58.570946] [DEBUG] [VALIDATOR ] NAD: All expected trading days are present. [2025-09-26T20:13:58.571056] [DEBUG] [VALIDATOR ] NAD: Primary data validation passed. [2025-09-26T20:13:58.571962] [INFO ] [MAIN ] NAD: Fetched primary data is valid. [2025-09-26T20:13:58.572045] [DEBUG] [LOCAL ] NAD: Saving primary data. [2025-09-26T20:13:58.573404] [DEBUG] [LOCAL ] NAD: Trimmed 49967 records to 34318 (keeping 200 days of data) [2025-09-26T20:13:58.802369] [DEBUG] [LOCAL ] NAD: Primary data saved (34318 records). [2025-09-26T20:13:58.802563] [INFO ] [MAIN ] NAD: Full history saved. [2025-09-26T20:13:58.802721] [INFO ] [MAIN ] Update Progress: 1451/2371 symbols completed. NAD took 33.8s. Estimated remaining: 2h 2m 58s. Rate: 7.5 symbols/min [2025-09-26T20:13:58.993883] [INFO ] [MAIN ] NAZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:13:58.998964] [DEBUG] [LOCAL ] NAZ: Loaded 2685 existing records from primary storage. [2025-09-26T20:13:58.999073] [INFO ] [MAIN ] NAZ: Loaded 2685 existing records. [2025-09-26T20:13:59.114505] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-09. [2025-09-26T20:13:59.223086] [WARN ] [MAIN ] NAZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:13:59.223562] [INFO ] [MAIN ] NAZ: Wiping existing primary data before full refresh. [2025-09-26T20:13:59.223750] [INFO ] [LOCAL ] NAZ: Starting deletion of primary data. [2025-09-26T20:13:59.224201] [DEBUG] [LOCAL ] NAZ: Deleted primary data file. [2025-09-26T20:13:59.224271] [INFO ] [MAIN ] NAZ: Starting full primary refresh. [2025-09-26T20:13:59.330206] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-26T20:13:59.651369] [INFO ] [REMOTE ] NAZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:13:59.911696] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-05. [2025-09-26T20:13:59.994724] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-26T20:13:59.997099] [INFO ] [REMOTE ] NAN: Full fetch complete (13897 records). [2025-09-26T20:13:59.997173] [DEBUG] [VALIDATOR ] NAN: Validating primary data. [2025-09-26T20:14:00.398136] [DEBUG] [VALIDATOR ] NAN: All expected trading days are present. [2025-09-26T20:14:00.398244] [DEBUG] [VALIDATOR ] NAN: Primary data validation passed. [2025-09-26T20:14:00.398620] [INFO ] [MAIN ] NAN: Fetched primary data is valid. [2025-09-26T20:14:00.398736] [DEBUG] [LOCAL ] NAN: Saving primary data. [2025-09-26T20:14:00.430849] [DEBUG] [LOCAL ] NAN: Trimmed 13897 records to 9084 (keeping 200 days of data) [2025-09-26T20:14:00.433017] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-26T20:14:00.502548] [DEBUG] [LOCAL ] NAN: Primary data saved (9084 records). [2025-09-26T20:14:00.502717] [INFO ] [MAIN ] NAN: Full history saved. [2025-09-26T20:14:00.502912] [INFO ] [MAIN ] Update Progress: 1452/2371 symbols completed. NAN took 29.6s. Estimated remaining: 2h 2m 46s. Rate: 7.5 symbols/min [2025-09-26T20:14:00.679994] [INFO ] [MAIN ] NBB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:14:00.690993] [DEBUG] [LOCAL ] NBB: Loaded 8917 existing records from primary storage. [2025-09-26T20:14:00.691126] [INFO ] [MAIN ] NBB: Loaded 8917 existing records. [2025-09-26T20:14:00.722831] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-04. [2025-09-26T20:14:00.880919] [WARN ] [MAIN ] NBB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:14:00.881185] [INFO ] [MAIN ] NBB: Wiping existing primary data before full refresh. [2025-09-26T20:14:00.881233] [INFO ] [LOCAL ] NBB: Starting deletion of primary data. [2025-09-26T20:14:00.881677] [DEBUG] [LOCAL ] NBB: Deleted primary data file. [2025-09-26T20:14:00.881739] [INFO ] [MAIN ] NBB: Starting full primary refresh. [2025-09-26T20:14:01.242671] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-26T20:14:01.326027] [INFO ] [REMOTE ] NBB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:14:01.511773] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-06. [2025-09-26T20:14:02.311772] [INFO ] [REMOTE ] NBB: Fetching primary data for 2024-12. [2025-09-26T20:14:02.695776] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-26T20:14:02.704733] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-26T20:14:02.806287] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-26T20:14:03.111721] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2024-12. [2025-09-26T20:14:03.542035] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-26T20:14:03.911718] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-07. [2025-09-26T20:14:04.711729] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-01. [2025-09-26T20:14:05.438587] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-26T20:14:05.511702] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-01. [2025-09-26T20:14:05.550583] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-26T20:14:06.062050] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-26T20:14:06.311733] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-05. [2025-09-26T20:14:07.111714] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-08. [2025-09-26T20:14:07.859401] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-26T20:14:07.911686] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-02. [2025-09-26T20:14:08.516528] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-26T20:14:08.658915] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-26T20:14:08.711758] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-02. [2025-09-26T20:14:09.263766] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-26T20:14:09.511721] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-03. [2025-09-26T20:14:10.214206] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-26T20:14:10.311721] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-03. [2025-09-26T20:14:10.903699] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-26T20:14:11.111745] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-04. [2025-09-26T20:14:11.911719] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-09. [2025-09-26T20:14:11.936045] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-26T20:14:12.711736] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-04. [2025-09-26T20:14:13.189012] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-26T20:14:13.434154] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-26T20:14:13.441594] [INFO ] [REMOTE ] NATL: Full fetch complete (45702 records). [2025-09-26T20:14:13.441790] [DEBUG] [VALIDATOR ] NATL: Validating primary data. [2025-09-26T20:14:13.516839] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-06. [2025-09-26T20:14:13.845034] [DEBUG] [VALIDATOR ] NATL: All expected trading days are present. [2025-09-26T20:14:13.845122] [DEBUG] [VALIDATOR ] NATL: Primary data validation passed. [2025-09-26T20:14:13.846011] [INFO ] [MAIN ] NATL: Fetched primary data is valid. [2025-09-26T20:14:13.846078] [DEBUG] [LOCAL ] NATL: Saving primary data. [2025-09-26T20:14:13.847246] [DEBUG] [LOCAL ] NATL: Trimmed 45702 records to 33367 (keeping 200 days of data) [2025-09-26T20:14:14.056911] [DEBUG] [LOCAL ] NATL: Primary data saved (33367 records). [2025-09-26T20:14:14.057104] [INFO ] [MAIN ] NATL: Full history saved. [2025-09-26T20:14:14.057209] [INFO ] [MAIN ] Update Progress: 1453/2371 symbols completed. NATL took 30.4s. Estimated remaining: 2h 2m 41s. Rate: 7.5 symbols/min [2025-09-26T20:14:14.243287] [INFO ] [MAIN ] NBHC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:14:14.268621] [DEBUG] [LOCAL ] NBHC: Loaded 23359 existing records from primary storage. [2025-09-26T20:14:14.268788] [INFO ] [MAIN ] NBHC: Loaded 23359 existing records. [2025-09-26T20:14:14.317015] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-05. [2025-09-26T20:14:14.462791] [WARN ] [MAIN ] NBHC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:14:14.463176] [INFO ] [MAIN ] NBHC: Wiping existing primary data before full refresh. [2025-09-26T20:14:14.463228] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-09-26T20:14:14.463932] [DEBUG] [LOCAL ] NBHC: Deleted primary data file. [2025-09-26T20:14:14.464192] [INFO ] [MAIN ] NBHC: Starting full primary refresh. [2025-09-26T20:14:14.855129] [INFO ] [REMOTE ] NBHC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:14:15.111769] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2024-12. [2025-09-26T20:14:15.400751] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-26T20:14:15.441389] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-26T20:14:15.911721] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-05. [2025-09-26T20:14:16.114108] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-26T20:14:16.441208] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-26T20:14:16.711739] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-06. [2025-09-26T20:14:17.205748] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-26T20:14:17.511755] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-07. [2025-09-26T20:14:18.311727] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-06. [2025-09-26T20:14:19.114949] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-01. [2025-09-26T20:14:19.117285] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-26T20:14:19.309829] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-26T20:14:19.911726] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-07. [2025-09-26T20:14:20.146055] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-26T20:14:20.685950] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-26T20:14:20.711732] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-08. [2025-09-26T20:14:21.511723] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-07. [2025-09-26T20:14:22.090510] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-26T20:14:22.311723] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-02. [2025-09-26T20:14:22.460603] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-26T20:14:23.111707] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-08. [2025-09-26T20:14:23.224557] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-26T20:14:23.643100] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-26T20:14:23.911737] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-03. [2025-09-26T20:14:24.711763] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-09. [2025-09-26T20:14:25.203279] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-26T20:14:25.511763] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-09. [2025-09-26T20:14:26.311738] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-08. [2025-09-26T20:14:26.615705] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-26T20:14:26.625956] [INFO ] [REMOTE ] NAT: Full fetch complete (72134 records). [2025-09-26T20:14:26.626099] [DEBUG] [VALIDATOR ] NAT: Validating primary data. [2025-09-26T20:14:26.836094] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-26T20:14:27.106742] [DEBUG] [VALIDATOR ] NAT: All expected trading days are present. [2025-09-26T20:14:27.106840] [DEBUG] [VALIDATOR ] NAT: Primary data validation passed. [2025-09-26T20:14:27.107952] [INFO ] [MAIN ] NAT: Fetched primary data is valid. [2025-09-26T20:14:27.108023] [DEBUG] [LOCAL ] NAT: Saving primary data. [2025-09-26T20:14:27.109943] [DEBUG] [LOCAL ] NAT: Trimmed 72134 records to 49859 (keeping 200 days of data) [2025-09-26T20:14:27.111692] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-04. [2025-09-26T20:14:27.371863] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-26T20:14:27.378889] [INFO ] [REMOTE ] NBB: Full fetch complete (13799 records). [2025-09-26T20:14:27.379080] [DEBUG] [VALIDATOR ] NBB: Validating primary data. [2025-09-26T20:14:27.813866] [DEBUG] [VALIDATOR ] NBB: All expected trading days are present. [2025-09-26T20:14:27.814516] [DEBUG] [VALIDATOR ] NBB: Primary data validation passed. [2025-09-26T20:14:27.815254] [INFO ] [MAIN ] NBB: Fetched primary data is valid. [2025-09-26T20:14:27.815941] [DEBUG] [LOCAL ] NBB: Saving primary data. [2025-09-26T20:14:27.818978] [DEBUG] [LOCAL ] NBB: Trimmed 13799 records to 8967 (keeping 200 days of data) [2025-09-26T20:14:27.887352] [DEBUG] [LOCAL ] NBB: Primary data saved (8967 records). [2025-09-26T20:14:27.888067] [INFO ] [MAIN ] NBB: Full history saved. [2025-09-26T20:14:27.888688] [INFO ] [MAIN ] Update Progress: 1454/2371 symbols completed. NBB took 27.4s. Estimated remaining: 2h 2m 37s. Rate: 7.5 symbols/min [2025-09-26T20:14:27.916898] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-09. [2025-09-26T20:14:28.155202] [INFO ] [MAIN ] NBR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:14:28.172369] [DEBUG] [LOCAL ] NAT: Primary data saved (49859 records). [2025-09-26T20:14:28.172677] [INFO ] [MAIN ] NAT: Full history saved. [2025-09-26T20:14:28.172906] [INFO ] [MAIN ] Update Progress: 1455/2371 symbols completed. NAT took 49.7s. Estimated remaining: 2h 2m 24s. Rate: 7.5 symbols/min [2025-09-26T20:14:28.356855] [DEBUG] [LOCAL ] NBR: Loaded 35065 existing records from primary storage. [2025-09-26T20:14:28.386232] [INFO ] [MAIN ] NBXG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:14:28.386534] [INFO ] [MAIN ] NBR: Loaded 35065 existing records. [2025-09-26T20:14:28.577997] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-26T20:14:28.654890] [WARN ] [MAIN ] NBR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:14:28.655387] [INFO ] [MAIN ] NBR: Wiping existing primary data before full refresh. [2025-09-26T20:14:28.655449] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-09-26T20:14:28.656519] [DEBUG] [LOCAL ] NBXG: Loaded 22677 existing records from primary storage. [2025-09-26T20:14:28.656674] [INFO ] [MAIN ] NBXG: Loaded 22677 existing records. [2025-09-26T20:14:28.662169] [DEBUG] [LOCAL ] NBR: Deleted primary data file. [2025-09-26T20:14:28.718047] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-05. [2025-09-26T20:14:28.705415] [INFO ] [MAIN ] NBR: Starting full primary refresh. [2025-09-26T20:14:28.779747] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-26T20:14:28.844358] [INFO ] [REMOTE ] NAZ: Full fetch complete (4428 records). [2025-09-26T20:14:28.896228] [DEBUG] [VALIDATOR ] NAZ: Validating primary data. [2025-09-26T20:14:29.041695] [WARN ] [MAIN ] NBXG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:14:29.090399] [INFO ] [MAIN ] NBXG: Wiping existing primary data before full refresh. [2025-09-26T20:14:29.106018] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-09-26T20:14:29.153067] [DEBUG] [LOCAL ] NBXG: Deleted primary data file. [2025-09-26T20:14:29.173698] [INFO ] [MAIN ] NBXG: Starting full primary refresh. [2025-09-26T20:14:29.911420] [INFO ] [REMOTE ] NBR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:14:29.952921] [INFO ] [REMOTE ] NBR: Fetching primary data for 2024-12. [2025-09-26T20:14:30.069456] [DEBUG] [VALIDATOR ] NAZ: All expected trading days are present. [2025-09-26T20:14:30.122362] [DEBUG] [VALIDATOR ] NAZ: Primary data validation passed. [2025-09-26T20:14:30.146867] [INFO ] [MAIN ] NAZ: Fetched primary data is valid. [2025-09-26T20:14:30.162005] [DEBUG] [LOCAL ] NAZ: Saving primary data. [2025-09-26T20:14:30.169598] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-26T20:14:30.168785] [INFO ] [REMOTE ] NBXG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:14:30.175281] [DEBUG] [LOCAL ] NAZ: Trimmed 4428 records to 2703 (keeping 200 days of data) [2025-09-26T20:14:30.193349] [DEBUG] [LOCAL ] NAZ: Primary data saved (2703 records). [2025-09-26T20:14:30.193442] [INFO ] [MAIN ] NAZ: Full history saved. [2025-09-26T20:14:30.193552] [INFO ] [MAIN ] Update Progress: 1456/2371 symbols completed. NAZ took 31.4s. Estimated remaining: 2h 2m 12s. Rate: 7.5 symbols/min [2025-09-26T20:14:30.316852] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2024-12. [2025-09-26T20:14:30.381348] [INFO ] [MAIN ] NC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:14:30.388422] [DEBUG] [LOCAL ] NC: Loaded 1925 existing records from primary storage. [2025-09-26T20:14:30.388588] [INFO ] [MAIN ] NC: Loaded 1925 existing records. [2025-09-26T20:14:30.605872] [WARN ] [MAIN ] NC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:14:30.607196] [INFO ] [MAIN ] NC: Wiping existing primary data before full refresh. [2025-09-26T20:14:30.607253] [INFO ] [LOCAL ] NC: Starting deletion of primary data. [2025-09-26T20:14:30.608020] [DEBUG] [LOCAL ] NC: Deleted primary data file. [2025-09-26T20:14:30.608082] [INFO ] [MAIN ] NC: Starting full primary refresh. [2025-09-26T20:14:30.987252] [INFO ] [REMOTE ] NC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:14:31.111825] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-06. [2025-09-26T20:14:31.483001] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-26T20:14:31.509134] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-26T20:14:31.911703] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-01. [2025-09-26T20:14:32.068596] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-26T20:14:32.711731] [INFO ] [REMOTE ] NC: Fetching primary data for 2024-12. [2025-09-26T20:14:32.989457] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-26T20:14:33.158794] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-26T20:14:33.511744] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-07. [2025-09-26T20:14:34.311684] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-01. [2025-09-26T20:14:34.768512] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-26T20:14:35.111682] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-08. [2025-09-26T20:14:35.518749] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-26T20:14:35.911751] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-02. [2025-09-26T20:14:36.193196] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-26T20:14:36.711715] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-01. [2025-09-26T20:14:37.207580] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-26T20:14:37.224260] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-26T20:14:37.511736] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-09. [2025-09-26T20:14:38.311727] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-02. [2025-09-26T20:14:38.747616] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-26T20:14:38.837355] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-26T20:14:38.842896] [INFO ] [REMOTE ] NBHC: Full fetch complete (32022 records). [2025-09-26T20:14:38.843011] [DEBUG] [VALIDATOR ] NBHC: Validating primary data. [2025-09-26T20:14:39.116909] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-02. [2025-09-26T20:14:39.240429] [DEBUG] [VALIDATOR ] NBHC: All expected trading days are present. [2025-09-26T20:14:39.240527] [DEBUG] [VALIDATOR ] NBHC: Primary data validation passed. [2025-09-26T20:14:39.241450] [INFO ] [MAIN ] NBHC: Fetched primary data is valid. [2025-09-26T20:14:39.241518] [DEBUG] [LOCAL ] NBHC: Saving primary data. [2025-09-26T20:14:39.242522] [DEBUG] [LOCAL ] NBHC: Trimmed 32022 records to 23530 (keeping 200 days of data) [2025-09-26T20:14:39.411245] [DEBUG] [LOCAL ] NBHC: Primary data saved (23530 records). [2025-09-26T20:14:39.411405] [INFO ] [MAIN ] NBHC: Full history saved. [2025-09-26T20:14:39.411557] [INFO ] [MAIN ] Update Progress: 1457/2371 symbols completed. NBHC took 25.4s. Estimated remaining: 2h 2m 5s. Rate: 7.5 symbols/min [2025-09-26T20:14:39.586737] [INFO ] [MAIN ] NCA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:14:39.603292] [DEBUG] [LOCAL ] NCA: Loaded 10134 existing records from primary storage. [2025-09-26T20:14:39.603425] [INFO ] [MAIN ] NCA: Loaded 10134 existing records. [2025-09-26T20:14:39.790387] [WARN ] [MAIN ] NCA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:14:39.790725] [INFO ] [MAIN ] NCA: Wiping existing primary data before full refresh. [2025-09-26T20:14:39.790794] [INFO ] [LOCAL ] NCA: Starting deletion of primary data. [2025-09-26T20:14:39.791226] [DEBUG] [LOCAL ] NCA: Deleted primary data file. [2025-09-26T20:14:39.791287] [INFO ] [MAIN ] NCA: Starting full primary refresh. [2025-09-26T20:14:39.916861] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-03. [2025-09-26T20:14:40.179949] [INFO ] [REMOTE ] NCA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:14:40.215331] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-26T20:14:40.442380] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-26T20:14:40.711707] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-03. [2025-09-26T20:14:41.511741] [INFO ] [REMOTE ] NCA: Fetching primary data for 2024-12. [2025-09-26T20:14:42.032563] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-26T20:14:42.311708] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-04. [2025-09-26T20:14:42.468778] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-26T20:14:42.769495] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-26T20:14:43.111713] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-01. [2025-09-26T20:14:43.846457] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-26T20:14:43.911737] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-05. [2025-09-26T20:14:44.404003] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-26T20:14:44.711757] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-06. [2025-09-26T20:14:45.334054] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-26T20:14:45.511721] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-07. [2025-09-26T20:14:45.946557] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-26T20:14:46.311746] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-02. [2025-09-26T20:14:47.111718] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-08. [2025-09-26T20:14:47.204348] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-26T20:14:47.542897] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-26T20:14:47.911728] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-04. [2025-09-26T20:14:48.711715] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-09. [2025-09-26T20:14:49.336483] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-26T20:14:49.355559] [INFO ] [REMOTE ] NC: Full fetch complete (2720 records). [2025-09-26T20:14:49.358192] [DEBUG] [VALIDATOR ] NC: Validating primary data. [2025-09-26T20:14:49.359631] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-26T20:14:49.523334] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-03. [2025-09-26T20:14:49.772722] [DEBUG] [VALIDATOR ] NC: All expected trading days are present. [2025-09-26T20:14:49.772851] [DEBUG] [VALIDATOR ] NC: Primary data validation passed. [2025-09-26T20:14:49.772961] [INFO ] [MAIN ] NC: Fetched primary data is valid. [2025-09-26T20:14:49.773003] [DEBUG] [LOCAL ] NC: Saving primary data. [2025-09-26T20:14:49.773370] [DEBUG] [LOCAL ] NC: Trimmed 2720 records to 1933 (keeping 200 days of data) [2025-09-26T20:14:49.788767] [DEBUG] [LOCAL ] NC: Primary data saved (1933 records). [2025-09-26T20:14:49.788893] [INFO ] [MAIN ] NC: Full history saved. [2025-09-26T20:14:49.788999] [INFO ] [MAIN ] Update Progress: 1458/2371 symbols completed. NC took 19.6s. Estimated remaining: 2h 1m 58s. Rate: 7.5 symbols/min [2025-09-26T20:14:49.991217] [INFO ] [MAIN ] NCDL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:14:50.024149] [DEBUG] [LOCAL ] NCDL: Loaded 21698 existing records from primary storage. [2025-09-26T20:14:50.024312] [INFO ] [MAIN ] NCDL: Loaded 21698 existing records. [2025-09-26T20:14:50.218819] [WARN ] [MAIN ] NCDL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:14:50.219158] [INFO ] [MAIN ] NCDL: Wiping existing primary data before full refresh. [2025-09-26T20:14:50.219209] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-09-26T20:14:50.219823] [DEBUG] [LOCAL ] NCDL: Deleted primary data file. [2025-09-26T20:14:50.219886] [INFO ] [MAIN ] NCDL: Starting full primary refresh. [2025-09-26T20:14:50.316915] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-03. [2025-09-26T20:14:50.504663] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-26T20:14:50.635888] [INFO ] [REMOTE ] NCDL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:14:51.111733] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2024-12. [2025-09-26T20:14:51.583699] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-26T20:14:51.911717] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-04. [2025-09-26T20:14:52.343331] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-26T20:14:52.711723] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-04. [2025-09-26T20:14:52.737170] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-26T20:14:53.511734] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-05. [2025-09-26T20:14:53.896761] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-26T20:14:54.311775] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-05. [2025-09-26T20:14:54.927633] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-26T20:14:55.062487] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-26T20:14:55.111755] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-06. [2025-09-26T20:14:55.911717] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-05. [2025-09-26T20:14:55.938020] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-26T20:14:56.711748] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-01. [2025-09-26T20:14:57.007920] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-26T20:14:57.424844] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-26T20:14:57.511734] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-02. [2025-09-26T20:14:58.311697] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-07. [2025-09-26T20:14:58.684564] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-26T20:14:59.050349] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-26T20:14:59.111704] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-08. [2025-09-26T20:14:59.860422] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-26T20:14:59.911677] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-09. [2025-09-26T20:15:00.711726] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-06. [2025-09-26T20:15:00.954106] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-26T20:15:00.956671] [INFO ] [REMOTE ] NCA: Full fetch complete (15532 records). [2025-09-26T20:15:00.956750] [DEBUG] [VALIDATOR ] NCA: Validating primary data. [2025-09-26T20:15:01.351592] [DEBUG] [VALIDATOR ] NCA: All expected trading days are present. [2025-09-26T20:15:01.351734] [DEBUG] [VALIDATOR ] NCA: Primary data validation passed. [2025-09-26T20:15:01.352147] [INFO ] [MAIN ] NCA: Fetched primary data is valid. [2025-09-26T20:15:01.352231] [DEBUG] [LOCAL ] NCA: Saving primary data. [2025-09-26T20:15:01.353334] [DEBUG] [LOCAL ] NCA: Trimmed 15532 records to 10178 (keeping 200 days of data) [2025-09-26T20:15:01.424270] [DEBUG] [LOCAL ] NCA: Primary data saved (10178 records). [2025-09-26T20:15:01.424435] [INFO ] [MAIN ] NCA: Full history saved. [2025-09-26T20:15:01.424540] [INFO ] [MAIN ] Update Progress: 1459/2371 symbols completed. NCA took 22.0s. Estimated remaining: 2h 1m 52s. Rate: 7.5 symbols/min [2025-09-26T20:15:01.516990] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-06. [2025-09-26T20:15:01.633222] [INFO ] [MAIN ] NCLH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:15:01.703381] [DEBUG] [LOCAL ] NCLH: Loaded 54143 existing records from primary storage. [2025-09-26T20:15:01.703537] [INFO ] [MAIN ] NCLH: Loaded 54143 existing records. [2025-09-26T20:15:01.869513] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-26T20:15:01.957352] [WARN ] [MAIN ] NCLH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:15:01.957774] [INFO ] [MAIN ] NCLH: Wiping existing primary data before full refresh. [2025-09-26T20:15:01.957855] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-09-26T20:15:01.959119] [DEBUG] [LOCAL ] NCLH: Deleted primary data file. [2025-09-26T20:15:01.959185] [INFO ] [MAIN ] NCLH: Starting full primary refresh. [2025-09-26T20:15:02.316797] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-07. [2025-09-26T20:15:02.382023] [INFO ] [REMOTE ] NCLH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:15:02.997866] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-26T20:15:03.111716] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-07. [2025-09-26T20:15:03.581319] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-26T20:15:03.911722] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-03. [2025-09-26T20:15:04.664274] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-26T20:15:04.711710] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-08. [2025-09-26T20:15:05.335410] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-26T20:15:05.511733] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2024-12. [2025-09-26T20:15:06.200580] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-26T20:15:06.311728] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-08. [2025-09-26T20:15:07.111710] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-04. [2025-09-26T20:15:07.301250] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-26T20:15:07.670578] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-26T20:15:07.911694] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-09. [2025-09-26T20:15:07.981845] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-26T20:15:08.711747] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-09. [2025-09-26T20:15:09.134300] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-26T20:15:09.140463] [INFO ] [REMOTE ] NBXG: Full fetch complete (32992 records). [2025-09-26T20:15:09.140573] [DEBUG] [VALIDATOR ] NBXG: Validating primary data. [2025-09-26T20:15:09.517937] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-05. [2025-09-26T20:15:09.572050] [DEBUG] [VALIDATOR ] NBXG: All expected trading days are present. [2025-09-26T20:15:09.572142] [DEBUG] [VALIDATOR ] NBXG: Primary data validation passed. [2025-09-26T20:15:09.572846] [INFO ] [MAIN ] NBXG: Fetched primary data is valid. [2025-09-26T20:15:09.572911] [DEBUG] [LOCAL ] NBXG: Saving primary data. [2025-09-26T20:15:09.573818] [DEBUG] [LOCAL ] NBXG: Trimmed 32992 records to 22794 (keeping 200 days of data) [2025-09-26T20:15:09.727841] [DEBUG] [LOCAL ] NBXG: Primary data saved (22794 records). [2025-09-26T20:15:09.727977] [INFO ] [MAIN ] NBXG: Full history saved. [2025-09-26T20:15:09.728064] [INFO ] [MAIN ] Update Progress: 1460/2371 symbols completed. NBXG took 41.6s. Estimated remaining: 2h 1m 45s. Rate: 7.5 symbols/min [2025-09-26T20:15:09.916334] [INFO ] [MAIN ] NCV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:15:09.934585] [DEBUG] [LOCAL ] NCV: Loaded 13501 existing records from primary storage. [2025-09-26T20:15:09.934739] [INFO ] [MAIN ] NCV: Loaded 13501 existing records. [2025-09-26T20:15:10.127548] [WARN ] [MAIN ] NCV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:15:10.128102] [INFO ] [MAIN ] NCV: Wiping existing primary data before full refresh. [2025-09-26T20:15:10.128270] [INFO ] [LOCAL ] NCV: Starting deletion of primary data. [2025-09-26T20:15:10.128539] [DEBUG] [LOCAL ] NCV: Deleted primary data file. [2025-09-26T20:15:10.128619] [INFO ] [MAIN ] NCV: Starting full primary refresh. [2025-09-26T20:15:10.312612] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-01. [2025-09-26T20:15:10.407108] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-26T20:15:10.485092] [INFO ] [REMOTE ] NBR: Full fetch complete (49467 records). [2025-09-26T20:15:10.491073] [DEBUG] [VALIDATOR ] NBR: Validating primary data. [2025-09-26T20:15:10.653961] [INFO ] [REMOTE ] NCV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:15:10.697142] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-26T20:15:10.990053] [DEBUG] [VALIDATOR ] NBR: All expected trading days are present. [2025-09-26T20:15:10.990143] [DEBUG] [VALIDATOR ] NBR: Primary data validation passed. [2025-09-26T20:15:10.990944] [INFO ] [MAIN ] NBR: Fetched primary data is valid. [2025-09-26T20:15:10.991009] [DEBUG] [LOCAL ] NBR: Saving primary data. [2025-09-26T20:15:10.992256] [DEBUG] [LOCAL ] NBR: Trimmed 49467 records to 35286 (keeping 200 days of data) [2025-09-26T20:15:11.118303] [INFO ] [REMOTE ] NCV: Fetching primary data for 2024-12. [2025-09-26T20:15:11.220054] [DEBUG] [LOCAL ] NBR: Primary data saved (35286 records). [2025-09-26T20:15:11.220280] [INFO ] [MAIN ] NBR: Full history saved. [2025-09-26T20:15:11.220403] [INFO ] [MAIN ] Update Progress: 1461/2371 symbols completed. NBR took 43.3s. Estimated remaining: 2h 1m 33s. Rate: 7.5 symbols/min [2025-09-26T20:15:11.403358] [INFO ] [MAIN ] NCZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:15:11.417065] [DEBUG] [LOCAL ] NCZ: Loaded 11900 existing records from primary storage. [2025-09-26T20:15:11.417204] [INFO ] [MAIN ] NCZ: Loaded 11900 existing records. [2025-09-26T20:15:11.602578] [WARN ] [MAIN ] NCZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:15:11.602863] [INFO ] [MAIN ] NCZ: Wiping existing primary data before full refresh. [2025-09-26T20:15:11.602911] [INFO ] [LOCAL ] NCZ: Starting deletion of primary data. [2025-09-26T20:15:11.603399] [DEBUG] [LOCAL ] NCZ: Deleted primary data file. [2025-09-26T20:15:11.603460] [INFO ] [MAIN ] NCZ: Starting full primary refresh. [2025-09-26T20:15:11.917090] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-06. [2025-09-26T20:15:11.999774] [INFO ] [REMOTE ] NCZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:15:12.626814] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-09-26T20:15:12.711764] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-02. [2025-09-26T20:15:12.741865] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-26T20:15:13.122547] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-26T20:15:13.511729] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-01. [2025-09-26T20:15:14.311707] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-07. [2025-09-26T20:15:14.620602] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-26T20:15:14.645163] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-26T20:15:15.111702] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2024-12. [2025-09-26T20:15:15.426498] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-26T20:15:15.911715] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-02. [2025-09-26T20:15:16.266161] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-26T20:15:16.634134] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-26T20:15:16.711742] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-03. [2025-09-26T20:15:17.511704] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-03. [2025-09-26T20:15:17.567486] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-26T20:15:18.311732] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-04. [2025-09-26T20:15:19.111717] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-01. [2025-09-26T20:15:19.224063] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-26T20:15:19.711511] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-26T20:15:19.911756] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-08. [2025-09-26T20:15:20.411607] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-26T20:15:20.711721] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-02. [2025-09-26T20:15:21.012078] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-26T20:15:21.511747] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-09. [2025-09-26T20:15:21.847690] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-26T20:15:22.311724] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-04. [2025-09-26T20:15:22.694873] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-26T20:15:22.699595] [INFO ] [REMOTE ] NCDL: Full fetch complete (33079 records). [2025-09-26T20:15:22.699771] [DEBUG] [VALIDATOR ] NCDL: Validating primary data. [2025-09-26T20:15:23.112140] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-03. [2025-09-26T20:15:23.145366] [DEBUG] [VALIDATOR ] NCDL: All expected trading days are present. [2025-09-26T20:15:23.145489] [DEBUG] [VALIDATOR ] NCDL: Primary data validation passed. [2025-09-26T20:15:23.147311] [INFO ] [MAIN ] NCDL: Fetched primary data is valid. [2025-09-26T20:15:23.147394] [DEBUG] [LOCAL ] NCDL: Saving primary data. [2025-09-26T20:15:23.148629] [DEBUG] [LOCAL ] NCDL: Trimmed 33079 records to 21828 (keeping 200 days of data) [2025-09-26T20:15:23.301583] [DEBUG] [LOCAL ] NCDL: Primary data saved (21828 records). [2025-09-26T20:15:23.301753] [INFO ] [MAIN ] NCDL: Full history saved. [2025-09-26T20:15:23.301901] [INFO ] [MAIN ] Update Progress: 1462/2371 symbols completed. NCDL took 33.5s. Estimated remaining: 2h 1m 27s. Rate: 7.5 symbols/min [2025-09-26T20:15:23.494723] [INFO ] [MAIN ] NDMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:15:23.514318] [DEBUG] [LOCAL ] NDMO: Loaded 16814 existing records from primary storage. [2025-09-26T20:15:23.514493] [INFO ] [MAIN ] NDMO: Loaded 16814 existing records. [2025-09-26T20:15:23.767403] [WARN ] [MAIN ] NDMO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:15:23.767825] [INFO ] [MAIN ] NDMO: Wiping existing primary data before full refresh. [2025-09-26T20:15:23.767883] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-09-26T20:15:23.768521] [DEBUG] [LOCAL ] NDMO: Deleted primary data file. [2025-09-26T20:15:23.768584] [INFO ] [MAIN ] NDMO: Starting full primary refresh. [2025-09-26T20:15:23.917294] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-05. [2025-09-26T20:15:24.160748] [INFO ] [REMOTE ] NDMO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:15:24.169912] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-26T20:15:24.718152] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-04. [2025-09-26T20:15:24.740241] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-09-26T20:15:24.860216] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-26T20:15:25.511716] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-06. [2025-09-26T20:15:25.872587] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-26T20:15:26.310395] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-26T20:15:26.313429] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-05. [2025-09-26T20:15:27.111705] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2024-12. [2025-09-26T20:15:27.181131] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-26T20:15:27.911773] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-07. [2025-09-26T20:15:28.138120] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-26T20:15:28.711718] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-05. [2025-09-26T20:15:28.930794] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-26T20:15:29.511784] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-08. [2025-09-26T20:15:30.311711] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-01. [2025-09-26T20:15:30.463581] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-26T20:15:31.033604] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-09-26T20:15:31.111692] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-06. [2025-09-26T20:15:31.234725] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-26T20:15:31.911758] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-09. [2025-09-26T20:15:32.711725] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-06. [2025-09-26T20:15:33.070396] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-26T20:15:33.074051] [INFO ] [REMOTE ] NCV: Full fetch complete (22985 records). [2025-09-26T20:15:33.074132] [DEBUG] [VALIDATOR ] NCV: Validating primary data. [2025-09-26T20:15:33.484575] [DEBUG] [VALIDATOR ] NCV: All expected trading days are present. [2025-09-26T20:15:33.484728] [DEBUG] [VALIDATOR ] NCV: Primary data validation passed. [2025-09-26T20:15:33.485557] [INFO ] [MAIN ] NCV: Fetched primary data is valid. [2025-09-26T20:15:33.485623] [DEBUG] [LOCAL ] NCV: Saving primary data. [2025-09-26T20:15:33.486717] [DEBUG] [LOCAL ] NCV: Trimmed 22985 records to 13602 (keeping 200 days of data) [2025-09-26T20:15:33.534203] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-02. [2025-09-26T20:15:33.576371] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-26T20:15:33.613214] [DEBUG] [LOCAL ] NCV: Primary data saved (13602 records). [2025-09-26T20:15:33.613459] [INFO ] [MAIN ] NCV: Full history saved. [2025-09-26T20:15:33.613601] [INFO ] [MAIN ] Update Progress: 1463/2371 symbols completed. NCV took 23.9s. Estimated remaining: 2h 1m 20s. Rate: 7.5 symbols/min [2025-09-26T20:15:33.809073] [INFO ] [MAIN ] NE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:15:33.872843] [DEBUG] [LOCAL ] NE: Loaded 52771 existing records from primary storage. [2025-09-26T20:15:33.873070] [INFO ] [MAIN ] NE: Loaded 52771 existing records. [2025-09-26T20:15:34.072758] [WARN ] [MAIN ] NE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:15:34.073240] [INFO ] [MAIN ] NE: Wiping existing primary data before full refresh. [2025-09-26T20:15:34.073298] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-09-26T20:15:34.073871] [DEBUG] [LOCAL ] NE: Deleted primary data file. [2025-09-26T20:15:34.073941] [INFO ] [MAIN ] NE: Starting full primary refresh. [2025-09-26T20:15:34.319599] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-07. [2025-09-26T20:15:34.559283] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-06 (3.45 seconds). [2025-09-26T20:15:34.567530] [INFO ] [REMOTE ] NE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:15:34.593870] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-26T20:15:35.111713] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-07. [2025-09-26T20:15:35.281848] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-26T20:15:35.911748] [INFO ] [REMOTE ] NE: Fetching primary data for 2024-12. [2025-09-26T20:15:36.711760] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-08. [2025-09-26T20:15:37.453921] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-26T20:15:37.490331] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-26T20:15:37.511688] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-08. [2025-09-26T20:15:37.708299] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T20:15:38.311792] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-01. [2025-09-26T20:15:39.111726] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-03. [2025-09-26T20:15:39.593931] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-26T20:15:39.911761] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-09. [2025-09-26T20:15:39.942508] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-26T20:15:39.985899] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-26T20:15:40.711788] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-04. [2025-09-26T20:15:41.511727] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-02. [2025-09-26T20:15:41.813684] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-26T20:15:42.121751] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-26T20:15:42.132842] [INFO ] [REMOTE ] NCLH: Full fetch complete (77809 records). [2025-09-26T20:15:42.133038] [DEBUG] [VALIDATOR ] NCLH: Validating primary data. [2025-09-26T20:15:42.325888] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-09. [2025-09-26T20:15:42.560888] [DEBUG] [VALIDATOR ] NCLH: All expected trading days are present. [2025-09-26T20:15:42.561022] [DEBUG] [VALIDATOR ] NCLH: Primary data validation passed. [2025-09-26T20:15:42.562613] [INFO ] [MAIN ] NCLH: Fetched primary data is valid. [2025-09-26T20:15:42.562727] [DEBUG] [LOCAL ] NCLH: Saving primary data. [2025-09-26T20:15:42.565052] [DEBUG] [LOCAL ] NCLH: Trimmed 77809 records to 54533 (keeping 200 days of data) [2025-09-26T20:15:42.932507] [DEBUG] [LOCAL ] NCLH: Primary data saved (54533 records). [2025-09-26T20:15:42.932752] [INFO ] [MAIN ] NCLH: Full history saved. [2025-09-26T20:15:42.932876] [INFO ] [MAIN ] Update Progress: 1464/2371 symbols completed. NCLH took 41.5s. Estimated remaining: 2h 1m 13s. Rate: 7.5 symbols/min [2025-09-26T20:15:43.124049] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-05. [2025-09-26T20:15:43.129137] [INFO ] [MAIN ] NEA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:15:43.177989] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-26T20:15:43.220258] [DEBUG] [LOCAL ] NEA: Loaded 35520 existing records from primary storage. [2025-09-26T20:15:43.220419] [INFO ] [MAIN ] NEA: Loaded 35520 existing records. [2025-09-26T20:15:43.416266] [WARN ] [MAIN ] NEA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:15:43.425530] [INFO ] [MAIN ] NEA: Wiping existing primary data before full refresh. [2025-09-26T20:15:43.426316] [INFO ] [LOCAL ] NEA: Starting deletion of primary data. [2025-09-26T20:15:43.426090] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-26T20:15:43.430003] [DEBUG] [LOCAL ] NEA: Deleted primary data file. [2025-09-26T20:15:43.430217] [INFO ] [MAIN ] NEA: Starting full primary refresh. [2025-09-26T20:15:43.430331] [INFO ] [REMOTE ] NCZ: Full fetch complete (21524 records). [2025-09-26T20:15:43.498500] [DEBUG] [VALIDATOR ] NCZ: Validating primary data. [2025-09-26T20:15:43.947453] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-03. [2025-09-26T20:15:44.170769] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-26T20:15:44.200367] [INFO ] [REMOTE ] NEA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:15:44.317079] [DEBUG] [VALIDATOR ] NCZ: All expected trading days are present. [2025-09-26T20:15:44.317201] [DEBUG] [VALIDATOR ] NCZ: Primary data validation passed. [2025-09-26T20:15:44.318028] [INFO ] [MAIN ] NCZ: Fetched primary data is valid. [2025-09-26T20:15:44.318095] [DEBUG] [LOCAL ] NCZ: Saving primary data. [2025-09-26T20:15:44.319135] [DEBUG] [LOCAL ] NCZ: Trimmed 21524 records to 11998 (keeping 200 days of data) [2025-09-26T20:15:44.406495] [DEBUG] [LOCAL ] NCZ: Primary data saved (11998 records). [2025-09-26T20:15:44.406754] [INFO ] [MAIN ] NCZ: Full history saved. [2025-09-26T20:15:44.406922] [INFO ] [MAIN ] Update Progress: 1465/2371 symbols completed. NCZ took 33.2s. Estimated remaining: 2h 1m 1s. Rate: 7.5 symbols/min [2025-09-26T20:15:44.585450] [INFO ] [MAIN ] NEE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:15:44.647920] [DEBUG] [LOCAL ] NEE: Loaded 54097 existing records from primary storage. [2025-09-26T20:15:44.648220] [INFO ] [MAIN ] NEE: Loaded 54097 existing records. [2025-09-26T20:15:44.717427] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-06. [2025-09-26T20:15:44.854513] [WARN ] [MAIN ] NEE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:15:44.854862] [INFO ] [MAIN ] NEE: Wiping existing primary data before full refresh. [2025-09-26T20:15:44.854913] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-09-26T20:15:44.856246] [DEBUG] [LOCAL ] NEE: Deleted primary data file. [2025-09-26T20:15:44.856309] [INFO ] [MAIN ] NEE: Starting full primary refresh. [2025-09-26T20:15:45.257226] [INFO ] [REMOTE ] NEE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:15:45.511884] [INFO ] [REMOTE ] NEE: Fetching primary data for 2024-12. [2025-09-26T20:15:45.612154] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-26T20:15:45.872989] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-26T20:15:46.311792] [INFO ] [REMOTE ] NEA: Fetching primary data for 2024-12. [2025-09-26T20:15:47.111771] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-07. [2025-09-26T20:15:47.570036] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-26T20:15:47.837752] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-26T20:15:47.911956] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-01. [2025-09-26T20:15:48.140537] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-26T20:15:48.711797] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-08. [2025-09-26T20:15:49.293352] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-26T20:15:49.511731] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-02. [2025-09-26T20:15:49.989217] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-26T20:15:50.311724] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-09. [2025-09-26T20:15:50.868323] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-26T20:15:51.111744] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-01. [2025-09-26T20:15:51.546312] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-26T20:15:51.550889] [INFO ] [REMOTE ] NDMO: Full fetch complete (25041 records). [2025-09-26T20:15:51.551038] [DEBUG] [VALIDATOR ] NDMO: Validating primary data. [2025-09-26T20:15:51.922010] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-03. [2025-09-26T20:15:51.965323] [DEBUG] [VALIDATOR ] NDMO: All expected trading days are present. [2025-09-26T20:15:51.965454] [DEBUG] [VALIDATOR ] NDMO: Primary data validation passed. [2025-09-26T20:15:51.966034] [INFO ] [MAIN ] NDMO: Fetched primary data is valid. [2025-09-26T20:15:51.966150] [DEBUG] [LOCAL ] NDMO: Saving primary data. [2025-09-26T20:15:51.967115] [DEBUG] [LOCAL ] NDMO: Trimmed 25041 records to 16978 (keeping 200 days of data) [2025-09-26T20:15:52.072534] [DEBUG] [LOCAL ] NDMO: Primary data saved (16978 records). [2025-09-26T20:15:52.072773] [INFO ] [MAIN ] NDMO: Full history saved. [2025-09-26T20:15:52.072880] [INFO ] [MAIN ] Update Progress: 1466/2371 symbols completed. NDMO took 28.8s. Estimated remaining: 2h 0m 53s. Rate: 7.5 symbols/min [2025-09-26T20:15:52.268538] [INFO ] [MAIN ] NEM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:15:52.332499] [DEBUG] [LOCAL ] NEM: Loaded 54098 existing records from primary storage. [2025-09-26T20:15:52.332703] [INFO ] [MAIN ] NEM: Loaded 54098 existing records. [2025-09-26T20:15:52.544262] [WARN ] [MAIN ] NEM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:15:52.544626] [INFO ] [MAIN ] NEM: Wiping existing primary data before full refresh. [2025-09-26T20:15:52.544737] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-09-26T20:15:52.545879] [DEBUG] [LOCAL ] NEM: Deleted primary data file. [2025-09-26T20:15:52.545954] [INFO ] [MAIN ] NEM: Starting full primary refresh. [2025-09-26T20:15:52.716926] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-04. [2025-09-26T20:15:52.965350] [INFO ] [REMOTE ] NEM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:15:53.178623] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-26T20:15:53.410961] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-26T20:15:53.511725] [INFO ] [REMOTE ] NEM: Fetching primary data for 2024-12. [2025-09-26T20:15:54.311739] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-02. [2025-09-26T20:15:54.698615] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-26T20:15:55.111733] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-04. [2025-09-26T20:15:55.165976] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-26T20:15:55.911701] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-05. [2025-09-26T20:15:56.339429] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-26T20:15:56.614542] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-26T20:15:56.711757] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-05. [2025-09-26T20:15:57.511704] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-01. [2025-09-26T20:15:57.714992] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-26T20:15:58.180206] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T20:15:58.311719] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-03. [2025-09-26T20:15:59.111713] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-06. [2025-09-26T20:15:59.314174] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-26T20:15:59.911706] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-02. [2025-09-26T20:16:00.343797] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-26T20:16:00.711737] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-06. [2025-09-26T20:16:01.245141] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-26T20:16:01.511701] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-07. [2025-09-26T20:16:01.940490] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-26T20:16:02.311767] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-03. [2025-09-26T20:16:02.584462] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-26T20:16:03.111778] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-07. [2025-09-26T20:16:03.154470] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-26T20:16:03.911745] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-08. [2025-09-26T20:16:04.606289] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-09-26T20:16:04.695017] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-26T20:16:04.711727] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-04. [2025-09-26T20:16:05.511729] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-08. [2025-09-26T20:16:05.902054] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-26T20:16:06.311752] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-04. [2025-09-26T20:16:06.896997] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-26T20:16:07.020425] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-26T20:16:07.111780] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-09. [2025-09-26T20:16:07.911715] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-05. [2025-09-26T20:16:08.711759] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-09. [2025-09-26T20:16:09.049840] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-26T20:16:09.061671] [INFO ] [REMOTE ] NE: Full fetch complete (75415 records). [2025-09-26T20:16:09.061882] [DEBUG] [VALIDATOR ] NE: Validating primary data. [2025-09-26T20:16:09.552506] [DEBUG] [VALIDATOR ] NE: All expected trading days are present. [2025-09-26T20:16:09.552733] [DEBUG] [VALIDATOR ] NE: Primary data validation passed. [2025-09-26T20:16:09.554039] [INFO ] [MAIN ] NE: Fetched primary data is valid. [2025-09-26T20:16:09.554408] [DEBUG] [LOCAL ] NE: Saving primary data. [2025-09-26T20:16:09.557235] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-04 (3.25 seconds). [2025-09-26T20:16:09.570212] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-05. [2025-09-26T20:16:09.571527] [DEBUG] [LOCAL ] NE: Trimmed 75415 records to 53157 (keeping 200 days of data) [2025-09-26T20:16:09.950690] [DEBUG] [LOCAL ] NE: Primary data saved (53157 records). [2025-09-26T20:16:09.950867] [INFO ] [MAIN ] NE: Full history saved. [2025-09-26T20:16:09.950965] [INFO ] [MAIN ] Update Progress: 1467/2371 symbols completed. NE took 36.3s. Estimated remaining: 2h 0m 51s. Rate: 7.5 symbols/min [2025-09-26T20:16:10.158182] [INFO ] [MAIN ] NET: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:16:10.198994] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-09-26T20:16:10.282127] [DEBUG] [LOCAL ] NET: Loaded 53435 existing records from primary storage. [2025-09-26T20:16:10.282505] [INFO ] [MAIN ] NET: Loaded 53435 existing records. [2025-09-26T20:16:10.289257] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-26T20:16:10.327243] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-06. [2025-09-26T20:16:10.358989] [INFO ] [REMOTE ] NEA: Full fetch complete (52244 records). [2025-09-26T20:16:10.395761] [DEBUG] [VALIDATOR ] NEA: Validating primary data. [2025-09-26T20:16:10.644243] [WARN ] [MAIN ] NET: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:16:10.684608] [INFO ] [MAIN ] NET: Wiping existing primary data before full refresh. [2025-09-26T20:16:10.712092] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-09-26T20:16:10.801281] [DEBUG] [LOCAL ] NET: Deleted primary data file. [2025-09-26T20:16:10.813369] [INFO ] [MAIN ] NET: Starting full primary refresh. [2025-09-26T20:16:11.107572] [DEBUG] [VALIDATOR ] NEA: All expected trading days are present. [2025-09-26T20:16:11.123492] [DEBUG] [VALIDATOR ] NEA: Primary data validation passed. [2025-09-26T20:16:11.125772] [INFO ] [MAIN ] NEA: Fetched primary data is valid. [2025-09-26T20:16:11.125867] [DEBUG] [LOCAL ] NEA: Saving primary data. [2025-09-26T20:16:11.251529] [DEBUG] [LOCAL ] NEA: Trimmed 52244 records to 35808 (keeping 200 days of data) [2025-09-26T20:16:11.446168] [INFO ] [REMOTE ] NET: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:16:11.452422] [INFO ] [REMOTE ] NET: Fetching primary data for 2024-12. [2025-09-26T20:16:11.599393] [DEBUG] [LOCAL ] NEA: Primary data saved (35808 records). [2025-09-26T20:16:11.599562] [INFO ] [MAIN ] NEA: Full history saved. [2025-09-26T20:16:11.599698] [INFO ] [MAIN ] Update Progress: 1468/2371 symbols completed. NEA took 28.7s. Estimated remaining: 2h 0m 39s. Rate: 7.5 symbols/min [2025-09-26T20:16:11.800966] [INFO ] [MAIN ] NEU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:16:11.814328] [DEBUG] [LOCAL ] NEU: Loaded 8200 existing records from primary storage. [2025-09-26T20:16:11.814466] [INFO ] [MAIN ] NEU: Loaded 8200 existing records. [2025-09-26T20:16:12.015915] [WARN ] [MAIN ] NEU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:16:12.016503] [INFO ] [MAIN ] NEU: Wiping existing primary data before full refresh. [2025-09-26T20:16:12.016825] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-09-26T20:16:12.017261] [DEBUG] [LOCAL ] NEU: Deleted primary data file. [2025-09-26T20:16:12.017376] [INFO ] [MAIN ] NEU: Starting full primary refresh. [2025-09-26T20:16:12.176542] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-09-26T20:16:12.220118] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-06. [2025-09-26T20:16:12.483252] [INFO ] [REMOTE ] NEU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:16:12.522879] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-26T20:16:12.711722] [INFO ] [REMOTE ] NEU: Fetching primary data for 2024-12. [2025-09-26T20:16:13.423924] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-26T20:16:13.511698] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-01. [2025-09-26T20:16:13.662771] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-26T20:16:14.074414] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-26T20:16:14.311757] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-07. [2025-09-26T20:16:14.649831] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-09-26T20:16:15.111749] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-02. [2025-09-26T20:16:15.912982] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-07. [2025-09-26T20:16:15.916595] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-26T20:16:16.579155] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-26T20:16:16.711723] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-08. [2025-09-26T20:16:17.511726] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-03. [2025-09-26T20:16:18.311688] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-01. [2025-09-26T20:16:18.352525] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-26T20:16:18.357176] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-09-26T20:16:18.970380] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-26T20:16:19.111743] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-09. [2025-09-26T20:16:19.916798] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-08. [2025-09-26T20:16:19.933562] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-26T20:16:19.944539] [INFO ] [REMOTE ] NEE: Full fetch complete (77369 records). [2025-09-26T20:16:19.944728] [DEBUG] [VALIDATOR ] NEE: Validating primary data. [2025-09-26T20:16:19.945743] [FATAL] [VALIDATOR ] NEE: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T20:16:19.945848] [FATAL] [MAIN ] NEE: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:16:19.945983] [WARN ] [MAIN ] NEE: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:16:19.946069] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-09-26T20:16:19.946144] [DEBUG] [LOCAL ] NEE: No primary data file found to delete. [2025-09-26T20:16:19.946184] [INFO ] [LOCAL ] NEE: Starting deletion of derivative data. [2025-09-26T20:16:19.946661] [DEBUG] [LOCAL ] NEE: Deleted derivative data file. [2025-09-26T20:16:19.946966] [INFO ] [MAIN ] Update Progress: 1469/2371 symbols completed. NEE took 35.5s. Estimated remaining: 2h 0m 31s. Rate: 7.5 symbols/min [2025-09-26T20:16:20.131638] [INFO ] [MAIN ] NEUE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:16:20.136617] [DEBUG] [LOCAL ] NEUE: Loaded 2255 existing records from primary storage. [2025-09-26T20:16:20.136746] [INFO ] [MAIN ] NEUE: Loaded 2255 existing records. [2025-09-26T20:16:20.338843] [WARN ] [MAIN ] NEUE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:16:20.340263] [INFO ] [MAIN ] NEUE: Wiping existing primary data before full refresh. [2025-09-26T20:16:20.340726] [INFO ] [LOCAL ] NEUE: Starting deletion of primary data. [2025-09-26T20:16:20.341059] [DEBUG] [LOCAL ] NEUE: Deleted primary data file. [2025-09-26T20:16:20.341129] [INFO ] [MAIN ] NEUE: Starting full primary refresh. [2025-09-26T20:16:20.716368] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-04. [2025-09-26T20:16:20.824913] [INFO ] [REMOTE ] NEUE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:16:20.828431] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-09-26T20:16:21.511754] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-02. [2025-09-26T20:16:21.626946] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-26T20:16:21.966094] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-26T20:16:22.311743] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-05. [2025-09-26T20:16:22.998516] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-26T20:16:23.111726] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2024-12. [2025-09-26T20:16:23.764792] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-09-26T20:16:23.793795] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-26T20:16:23.911715] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-09. [2025-09-26T20:16:24.711698] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-01. [2025-09-26T20:16:24.747369] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-26T20:16:24.760379] [INFO ] [REMOTE ] NEM: Full fetch complete (77359 records). [2025-09-26T20:16:24.760569] [DEBUG] [VALIDATOR ] NEM: Validating primary data. [2025-09-26T20:16:24.761768] [FATAL] [VALIDATOR ] NEM: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T20:16:24.761893] [FATAL] [MAIN ] NEM: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:16:24.761976] [WARN ] [MAIN ] NEM: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:16:24.762059] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-09-26T20:16:24.762147] [DEBUG] [LOCAL ] NEM: No primary data file found to delete. [2025-09-26T20:16:24.762309] [INFO ] [LOCAL ] NEM: Starting deletion of derivative data. [2025-09-26T20:16:24.762792] [DEBUG] [LOCAL ] NEM: Deleted derivative data file. [2025-09-26T20:16:24.762968] [INFO ] [MAIN ] Update Progress: 1470/2371 symbols completed. NEM took 32.7s. Estimated remaining: 2h 0m 21s. Rate: 7.5 symbols/min [2025-09-26T20:16:24.941481] [INFO ] [MAIN ] NEXA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:16:24.948728] [DEBUG] [LOCAL ] NEXA: Loaded 4210 existing records from primary storage. [2025-09-26T20:16:24.948855] [INFO ] [MAIN ] NEXA: Loaded 4210 existing records. [2025-09-26T20:16:25.157424] [WARN ] [MAIN ] NEXA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:16:25.157865] [INFO ] [MAIN ] NEXA: Wiping existing primary data before full refresh. [2025-09-26T20:16:25.157941] [INFO ] [LOCAL ] NEXA: Starting deletion of primary data. [2025-09-26T20:16:25.158238] [DEBUG] [LOCAL ] NEXA: Deleted primary data file. [2025-09-26T20:16:25.158317] [INFO ] [MAIN ] NEXA: Starting full primary refresh. [2025-09-26T20:16:25.463701] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-26T20:16:25.516838] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-06. [2025-09-26T20:16:25.549265] [INFO ] [REMOTE ] NEXA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:16:26.311732] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-02. [2025-09-26T20:16:26.758239] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-26T20:16:26.798901] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-26T20:16:27.111726] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-03. [2025-09-26T20:16:27.801688] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-26T20:16:27.911727] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-03. [2025-09-26T20:16:28.711705] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2024-12. [2025-09-26T20:16:29.511709] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-04. [2025-09-26T20:16:29.663608] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-26T20:16:29.928282] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-26T20:16:30.017853] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-26T20:16:30.311753] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-04. [2025-09-26T20:16:31.111721] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-05. [2025-09-26T20:16:31.604229] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-26T20:16:31.911723] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-01. [2025-09-26T20:16:32.692820] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-26T20:16:32.711683] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-07. [2025-09-26T20:16:32.820916] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-26T20:16:33.511695] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-05. [2025-09-26T20:16:33.569322] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-26T20:16:34.311741] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-02. [2025-09-26T20:16:34.964483] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-26T20:16:35.111713] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-08. [2025-09-26T20:16:35.847960] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-09-26T20:16:35.911692] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-03. [2025-09-26T20:16:36.056705] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-26T20:16:36.587022] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-26T20:16:36.711753] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-04. [2025-09-26T20:16:37.316030] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-26T20:16:37.511737] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-06. [2025-09-26T20:16:38.311725] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-05. [2025-09-26T20:16:38.908679] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-26T20:16:39.111738] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-06. [2025-09-26T20:16:39.630718] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-26T20:16:39.755846] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-26T20:16:39.911718] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-07. [2025-09-26T20:16:40.650598] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-26T20:16:40.711727] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-06. [2025-09-26T20:16:41.209423] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-26T20:16:41.511722] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-07. [2025-09-26T20:16:42.311714] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-07. [2025-09-26T20:16:42.891079] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-26T20:16:43.111721] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-09. [2025-09-26T20:16:43.856957] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-26T20:16:43.911681] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-08. [2025-09-26T20:16:44.137278] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-26T20:16:44.139473] [INFO ] [REMOTE ] NEU: Full fetch complete (10333 records). [2025-09-26T20:16:44.139550] [DEBUG] [VALIDATOR ] NEU: Validating primary data. [2025-09-26T20:16:44.516782] [DEBUG] [VALIDATOR ] NEU: All expected trading days are present. [2025-09-26T20:16:44.516903] [DEBUG] [VALIDATOR ] NEU: Primary data validation passed. [2025-09-26T20:16:44.517189] [INFO ] [MAIN ] NEU: Fetched primary data is valid. [2025-09-26T20:16:44.517249] [DEBUG] [LOCAL ] NEU: Saving primary data. [2025-09-26T20:16:44.517790] [DEBUG] [LOCAL ] NEU: Trimmed 10333 records to 8259 (keeping 200 days of data) [2025-09-26T20:16:44.575895] [DEBUG] [LOCAL ] NEU: Primary data saved (8259 records). [2025-09-26T20:16:44.576013] [INFO ] [MAIN ] NEU: Full history saved. [2025-09-26T20:16:44.576123] [INFO ] [MAIN ] Update Progress: 1471/2371 symbols completed. NEU took 33.0s. Estimated remaining: 2h 0m 21s. Rate: 7.5 symbols/min [2025-09-26T20:16:44.722471] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-08. [2025-09-26T20:16:44.755978] [INFO ] [MAIN ] NFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:16:44.809699] [DEBUG] [LOCAL ] NFG: Loaded 38809 existing records from primary storage. [2025-09-26T20:16:44.809906] [INFO ] [MAIN ] NFG: Loaded 38809 existing records. [2025-09-26T20:16:45.011621] [WARN ] [MAIN ] NFG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:16:45.011960] [INFO ] [MAIN ] NFG: Wiping existing primary data before full refresh. [2025-09-26T20:16:45.012012] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-09-26T20:16:45.013004] [DEBUG] [LOCAL ] NFG: Deleted primary data file. [2025-09-26T20:16:45.013067] [INFO ] [MAIN ] NFG: Starting full primary refresh. [2025-09-26T20:16:45.323387] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-26T20:16:45.430282] [INFO ] [REMOTE ] NFG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:16:45.511716] [INFO ] [REMOTE ] NFG: Fetching primary data for 2024-12. [2025-09-26T20:16:46.060551] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-26T20:16:46.311726] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-09. [2025-09-26T20:16:46.718471] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-26T20:16:47.111739] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-01. [2025-09-26T20:16:47.911687] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-08. [2025-09-26T20:16:48.405063] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-26T20:16:48.408177] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-26T20:16:48.419008] [INFO ] [REMOTE ] NET: Full fetch complete (76848 records). [2025-09-26T20:16:48.419172] [DEBUG] [VALIDATOR ] NET: Validating primary data. [2025-09-26T20:16:48.716900] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-09. [2025-09-26T20:16:48.870277] [DEBUG] [VALIDATOR ] NET: All expected trading days are present. [2025-09-26T20:16:48.870524] [DEBUG] [VALIDATOR ] NET: Primary data validation passed. [2025-09-26T20:16:48.871765] [INFO ] [MAIN ] NET: Fetched primary data is valid. [2025-09-26T20:16:48.871883] [DEBUG] [LOCAL ] NET: Saving primary data. [2025-09-26T20:16:48.900910] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-26T20:16:48.909861] [DEBUG] [LOCAL ] NET: Trimmed 76848 records to 53808 (keeping 200 days of data) [2025-09-26T20:16:49.269197] [DEBUG] [LOCAL ] NET: Primary data saved (53808 records). [2025-09-26T20:16:49.269352] [INFO ] [MAIN ] NET: Full history saved. [2025-09-26T20:16:49.269474] [INFO ] [MAIN ] Update Progress: 1472/2371 symbols completed. NET took 39.3s. Estimated remaining: 2h 0m 10s. Rate: 7.5 symbols/min [2025-09-26T20:16:49.471119] [INFO ] [MAIN ] NFJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:16:49.497634] [DEBUG] [LOCAL ] NFJ: Loaded 20362 existing records from primary storage. [2025-09-26T20:16:49.497842] [INFO ] [MAIN ] NFJ: Loaded 20362 existing records. [2025-09-26T20:16:49.519770] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-09. [2025-09-26T20:16:49.554379] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-26T20:16:49.604355] [INFO ] [REMOTE ] NEXA: Full fetch complete (7613 records). [2025-09-26T20:16:49.629593] [DEBUG] [VALIDATOR ] NEXA: Validating primary data. [2025-09-26T20:16:49.842285] [WARN ] [MAIN ] NFJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:16:49.888055] [INFO ] [MAIN ] NFJ: Wiping existing primary data before full refresh. [2025-09-26T20:16:49.888523] [INFO ] [LOCAL ] NFJ: Starting deletion of primary data. [2025-09-26T20:16:49.904953] [DEBUG] [LOCAL ] NFJ: Deleted primary data file. [2025-09-26T20:16:49.916289] [INFO ] [MAIN ] NFJ: Starting full primary refresh. [2025-09-26T20:16:49.987062] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-26T20:16:50.014787] [INFO ] [REMOTE ] NEUE: Full fetch complete (4016 records). [2025-09-26T20:16:50.087016] [DEBUG] [VALIDATOR ] NEUE: Validating primary data. [2025-09-26T20:16:50.334052] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-02. [2025-09-26T20:16:50.447232] [DEBUG] [VALIDATOR ] NEXA: All expected trading days are present. [2025-09-26T20:16:50.497622] [DEBUG] [VALIDATOR ] NEXA: Primary data validation passed. [2025-09-26T20:16:50.531788] [INFO ] [MAIN ] NEXA: Fetched primary data is valid. [2025-09-26T20:16:50.550094] [DEBUG] [LOCAL ] NEXA: Saving primary data. [2025-09-26T20:16:50.693083] [DEBUG] [LOCAL ] NEXA: Trimmed 7613 records to 4307 (keeping 200 days of data) [2025-09-26T20:16:50.837481] [DEBUG] [LOCAL ] NEXA: Primary data saved (4307 records). [2025-09-26T20:16:50.901723] [INFO ] [MAIN ] NEXA: Full history saved. [2025-09-26T20:16:50.910627] [INFO ] [REMOTE ] NFJ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:16:50.918268] [INFO ] [MAIN ] Update Progress: 1473/2371 symbols completed. NEXA took 26.2s. Estimated remaining: 1h 59m 59s. Rate: 7.5 symbols/min [2025-09-26T20:16:51.117530] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2024-12. [2025-09-26T20:16:51.136448] [DEBUG] [VALIDATOR ] NEUE: All expected trading days are present. [2025-09-26T20:16:51.143562] [DEBUG] [VALIDATOR ] NEUE: Primary data validation passed. [2025-09-26T20:16:51.143850] [INFO ] [MAIN ] NEUE: Fetched primary data is valid. [2025-09-26T20:16:51.153464] [DEBUG] [LOCAL ] NEUE: Saving primary data. [2025-09-26T20:16:51.173768] [DEBUG] [LOCAL ] NEUE: Trimmed 4016 records to 2271 (keeping 200 days of data) [2025-09-26T20:16:51.221095] [DEBUG] [LOCAL ] NEUE: Primary data saved (2271 records). [2025-09-26T20:16:51.231538] [INFO ] [MAIN ] NEUE: Full history saved. [2025-09-26T20:16:51.248536] [INFO ] [MAIN ] Update Progress: 1474/2371 symbols completed. NEUE took 31.3s. Estimated remaining: 1h 59m 46s. Rate: 7.5 symbols/min [2025-09-26T20:16:51.323697] [INFO ] [MAIN ] NGG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:16:51.484245] [INFO ] [MAIN ] NGL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:16:51.524843] [DEBUG] [LOCAL ] NGG: Loaded 46497 existing records from primary storage. [2025-09-26T20:16:51.524991] [INFO ] [MAIN ] NGG: Loaded 46497 existing records. [2025-09-26T20:16:51.680901] [DEBUG] [LOCAL ] NGL: Loaded 30631 existing records from primary storage. [2025-09-26T20:16:51.712172] [INFO ] [MAIN ] NGL: Loaded 30631 existing records. [2025-09-26T20:16:51.816165] [WARN ] [MAIN ] NGG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:16:51.845876] [INFO ] [MAIN ] NGG: Wiping existing primary data before full refresh. [2025-09-26T20:16:51.870599] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-09-26T20:16:51.876835] [DEBUG] [LOCAL ] NGG: Deleted primary data file. [2025-09-26T20:16:51.892507] [INFO ] [MAIN ] NGG: Starting full primary refresh. [2025-09-26T20:16:52.013800] [WARN ] [MAIN ] NGL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:16:52.047813] [INFO ] [MAIN ] NGL: Wiping existing primary data before full refresh. [2025-09-26T20:16:52.081703] [INFO ] [LOCAL ] NGL: Starting deletion of primary data. [2025-09-26T20:16:52.092566] [DEBUG] [LOCAL ] NGL: Deleted primary data file. [2025-09-26T20:16:52.097922] [INFO ] [MAIN ] NGL: Starting full primary refresh. [2025-09-26T20:16:52.501030] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-26T20:16:52.716862] [INFO ] [REMOTE ] NGG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:16:52.710601] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-03. [2025-09-26T20:16:52.763078] [INFO ] [REMOTE ] NGG: Fetching primary data for 2024-12. [2025-09-26T20:16:52.780697] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-26T20:16:52.870854] [INFO ] [REMOTE ] NGL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:16:53.511736] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-01. [2025-09-26T20:16:54.311697] [INFO ] [REMOTE ] NGL: Fetching primary data for 2024-12. [2025-09-26T20:16:54.417591] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-26T20:16:54.520682] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-26T20:16:54.654751] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-26T20:16:55.111722] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-02. [2025-09-26T20:16:55.369892] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-26T20:16:55.911738] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-01. [2025-09-26T20:16:56.140754] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-26T20:16:56.711689] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-04. [2025-09-26T20:16:56.870619] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-26T20:16:57.511733] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-01. [2025-09-26T20:16:58.314668] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-02. [2025-09-26T20:16:58.318078] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-26T20:16:59.111713] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-03. [2025-09-26T20:16:59.193478] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-26T20:16:59.483408] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-26T20:16:59.911684] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-03. [2025-09-26T20:17:00.305723] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-26T20:17:00.711747] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-04. [2025-09-26T20:17:01.179704] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-26T20:17:01.511732] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-05. [2025-09-26T20:17:01.966449] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-26T20:17:02.311761] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-04. [2025-09-26T20:17:03.111717] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-02. [2025-09-26T20:17:03.171159] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-26T20:17:03.723239] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-26T20:17:03.911715] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-05. [2025-09-26T20:17:04.711755] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-05. [2025-09-26T20:17:04.985770] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-26T20:17:05.183530] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-26T20:17:05.483378] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-26T20:17:05.511722] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-06. [2025-09-26T20:17:06.311741] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-03. [2025-09-26T20:17:06.933780] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-26T20:17:07.111720] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-07. [2025-09-26T20:17:07.911725] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-06. [2025-09-26T20:17:08.043397] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-26T20:17:08.617459] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-26T20:17:08.711720] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-08. [2025-09-26T20:17:09.268386] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-26T20:17:09.511724] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-06. [2025-09-26T20:17:10.104465] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-26T20:17:10.311744] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-07. [2025-09-26T20:17:10.634758] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-26T20:17:11.111727] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-04. [2025-09-26T20:17:11.911737] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-07. [2025-09-26T20:17:11.977956] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-26T20:17:12.711719] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-08. [2025-09-26T20:17:12.932086] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-26T20:17:13.045680] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-26T20:17:13.511718] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-09. [2025-09-26T20:17:14.310813] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-26T20:17:14.318999] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-05. [2025-09-26T20:17:14.817569] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-26T20:17:14.826630] [INFO ] [REMOTE ] NGL: Full fetch complete (41146 records). [2025-09-26T20:17:14.826861] [DEBUG] [VALIDATOR ] NGL: Validating primary data. [2025-09-26T20:17:15.122042] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-09. [2025-09-26T20:17:15.268402] [DEBUG] [VALIDATOR ] NGL: All expected trading days are present. [2025-09-26T20:17:15.268497] [DEBUG] [VALIDATOR ] NGL: Primary data validation passed. [2025-09-26T20:17:15.269235] [INFO ] [MAIN ] NGL: Fetched primary data is valid. [2025-09-26T20:17:15.269300] [DEBUG] [LOCAL ] NGL: Saving primary data. [2025-09-26T20:17:15.270406] [DEBUG] [LOCAL ] NGL: Trimmed 41146 records to 30754 (keeping 200 days of data) [2025-09-26T20:17:15.458454] [DEBUG] [LOCAL ] NGL: Primary data saved (30754 records). [2025-09-26T20:17:15.458682] [INFO ] [MAIN ] NGL: Full history saved. [2025-09-26T20:17:15.460430] [INFO ] [MAIN ] Update Progress: 1475/2371 symbols completed. NGL took 24.2s. Estimated remaining: 1h 59m 48s. Rate: 7.5 symbols/min [2025-09-26T20:17:15.643571] [INFO ] [MAIN ] NGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:17:15.657989] [DEBUG] [LOCAL ] NGS: Loaded 11597 existing records from primary storage. [2025-09-26T20:17:15.658124] [INFO ] [MAIN ] NGS: Loaded 11597 existing records. [2025-09-26T20:17:15.842174] [WARN ] [MAIN ] NGS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:17:15.842426] [INFO ] [MAIN ] NGS: Wiping existing primary data before full refresh. [2025-09-26T20:17:15.842474] [INFO ] [LOCAL ] NGS: Starting deletion of primary data. [2025-09-26T20:17:15.842870] [DEBUG] [LOCAL ] NGS: Deleted primary data file. [2025-09-26T20:17:15.842930] [INFO ] [MAIN ] NGS: Starting full primary refresh. [2025-09-26T20:17:15.916833] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-08. [2025-09-26T20:17:16.234925] [INFO ] [REMOTE ] NGS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:17:16.282045] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-26T20:17:16.664724] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-26T20:17:16.675833] [INFO ] [REMOTE ] NFG: Full fetch complete (56788 records). [2025-09-26T20:17:16.676017] [DEBUG] [VALIDATOR ] NFG: Validating primary data. [2025-09-26T20:17:16.716962] [INFO ] [REMOTE ] NGS: Fetching primary data for 2024-12. [2025-09-26T20:17:17.100905] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-26T20:17:17.104162] [DEBUG] [VALIDATOR ] NFG: All expected trading days are present. [2025-09-26T20:17:17.108166] [DEBUG] [VALIDATOR ] NFG: Primary data validation passed. [2025-09-26T20:17:17.109817] [INFO ] [MAIN ] NFG: Fetched primary data is valid. [2025-09-26T20:17:17.110284] [DEBUG] [LOCAL ] NFG: Saving primary data. [2025-09-26T20:17:17.111681] [DEBUG] [LOCAL ] NFG: Trimmed 56788 records to 39084 (keeping 200 days of data) [2025-09-26T20:17:17.367411] [DEBUG] [LOCAL ] NFG: Primary data saved (39084 records). [2025-09-26T20:17:17.367586] [INFO ] [MAIN ] NFG: Full history saved. [2025-09-26T20:17:17.367741] [INFO ] [MAIN ] Update Progress: 1476/2371 symbols completed. NFG took 32.8s. Estimated remaining: 1h 59m 36s. Rate: 7.5 symbols/min [2025-09-26T20:17:17.514374] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-06. [2025-09-26T20:17:17.598983] [INFO ] [MAIN ] NGVC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:17:17.624935] [DEBUG] [LOCAL ] NGVC: Loaded 22506 existing records from primary storage. [2025-09-26T20:17:17.625084] [INFO ] [MAIN ] NGVC: Loaded 22506 existing records. [2025-09-26T20:17:17.782378] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-26T20:17:17.826605] [WARN ] [MAIN ] NGVC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:17:17.826946] [INFO ] [MAIN ] NGVC: Wiping existing primary data before full refresh. [2025-09-26T20:17:17.827004] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-09-26T20:17:17.827737] [DEBUG] [LOCAL ] NGVC: Deleted primary data file. [2025-09-26T20:17:17.827799] [INFO ] [MAIN ] NGVC: Starting full primary refresh. [2025-09-26T20:17:18.197831] [INFO ] [REMOTE ] NGVC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:17:18.311713] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2024-12. [2025-09-26T20:17:19.111689] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-09. [2025-09-26T20:17:19.294022] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-26T20:17:19.346074] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-26T20:17:19.911728] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-01. [2025-09-26T20:17:20.239893] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-26T20:17:20.244430] [INFO ] [REMOTE ] NFJ: Full fetch complete (30539 records). [2025-09-26T20:17:20.244539] [DEBUG] [VALIDATOR ] NFJ: Validating primary data. [2025-09-26T20:17:20.657994] [DEBUG] [VALIDATOR ] NFJ: All expected trading days are present. [2025-09-26T20:17:20.658090] [DEBUG] [VALIDATOR ] NFJ: Primary data validation passed. [2025-09-26T20:17:20.658804] [INFO ] [MAIN ] NFJ: Fetched primary data is valid. [2025-09-26T20:17:20.658873] [DEBUG] [LOCAL ] NFJ: Saving primary data. [2025-09-26T20:17:20.659803] [DEBUG] [LOCAL ] NFJ: Trimmed 30539 records to 20592 (keeping 200 days of data) [2025-09-26T20:17:20.715188] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-07. [2025-09-26T20:17:20.799418] [DEBUG] [LOCAL ] NFJ: Primary data saved (20592 records). [2025-09-26T20:17:20.799552] [INFO ] [MAIN ] NFJ: Full history saved. [2025-09-26T20:17:20.799747] [INFO ] [MAIN ] Update Progress: 1477/2371 symbols completed. NFJ took 31.5s. Estimated remaining: 1h 59m 25s. Rate: 7.5 symbols/min [2025-09-26T20:17:21.005368] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-26T20:17:21.511722] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-01. [2025-09-26T20:17:22.311753] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-02. [2025-09-26T20:17:22.425576] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-26T20:17:22.555505] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-26T20:17:23.111734] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-02. [2025-09-26T20:17:23.169249] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-26T20:17:23.911743] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-08. [2025-09-26T20:17:24.124228] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-26T20:17:24.711760] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-03. [2025-09-26T20:17:25.511766] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-03. [2025-09-26T20:17:25.603820] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-26T20:17:25.815801] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-26T20:17:26.311691] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-09. [2025-09-26T20:17:26.466334] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-26T20:17:27.111733] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-04. [2025-09-26T20:17:27.911692] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-04. [2025-09-26T20:17:28.172098] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-26T20:17:28.181300] [INFO ] [REMOTE ] NGG: Full fetch complete (66388 records). [2025-09-26T20:17:28.181467] [DEBUG] [VALIDATOR ] NGG: Validating primary data. [2025-09-26T20:17:28.358920] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-26T20:17:28.622821] [DEBUG] [VALIDATOR ] NGG: All expected trading days are present. [2025-09-26T20:17:28.622907] [DEBUG] [VALIDATOR ] NGG: Primary data validation passed. [2025-09-26T20:17:28.623850] [INFO ] [MAIN ] NGG: Fetched primary data is valid. [2025-09-26T20:17:28.623915] [DEBUG] [LOCAL ] NGG: Saving primary data. [2025-09-26T20:17:28.626424] [DEBUG] [LOCAL ] NGG: Trimmed 66388 records to 46809 (keeping 200 days of data) [2025-09-26T20:17:28.734194] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-05. [2025-09-26T20:17:28.940000] [DEBUG] [LOCAL ] NGG: Primary data saved (46809 records). [2025-09-26T20:17:28.940143] [INFO ] [MAIN ] NGG: Full history saved. [2025-09-26T20:17:28.940246] [INFO ] [MAIN ] Update Progress: 1478/2371 symbols completed. NGG took 38.0s. Estimated remaining: 1h 59m 17s. Rate: 7.5 symbols/min [2025-09-26T20:17:28.956548] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-26T20:17:29.511715] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-05. [2025-09-26T20:17:29.917906] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-26T20:17:30.311727] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-06. [2025-09-26T20:17:30.492661] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-26T20:17:31.111702] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-06. [2025-09-26T20:17:31.436680] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-26T20:17:31.911742] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-07. [2025-09-26T20:17:32.080576] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-26T20:17:32.711741] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-07. [2025-09-26T20:17:33.102747] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-26T20:17:33.511752] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-08. [2025-09-26T20:17:33.733902] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-26T20:17:34.311755] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-08. [2025-09-26T20:17:34.722051] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-26T20:17:35.111715] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-09. [2025-09-26T20:17:35.290899] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-26T20:17:35.911749] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-09. [2025-09-26T20:17:36.175363] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-26T20:17:36.180225] [INFO ] [REMOTE ] NGVC: Full fetch complete (30384 records). [2025-09-26T20:17:36.180316] [DEBUG] [VALIDATOR ] NGVC: Validating primary data. [2025-09-26T20:17:36.581391] [DEBUG] [VALIDATOR ] NGVC: All expected trading days are present. [2025-09-26T20:17:36.581487] [DEBUG] [VALIDATOR ] NGVC: Primary data validation passed. [2025-09-26T20:17:36.582200] [INFO ] [MAIN ] NGVC: Fetched primary data is valid. [2025-09-26T20:17:36.582265] [DEBUG] [LOCAL ] NGVC: Saving primary data. [2025-09-26T20:17:36.583236] [DEBUG] [LOCAL ] NGVC: Trimmed 30384 records to 22650 (keeping 200 days of data) [2025-09-26T20:17:36.726856] [DEBUG] [LOCAL ] NGVC: Primary data saved (22650 records). [2025-09-26T20:17:36.727056] [INFO ] [MAIN ] NGVC: Full history saved. [2025-09-26T20:17:36.727165] [INFO ] [MAIN ] Update Progress: 1479/2371 symbols completed. NGVC took 19.4s. Estimated remaining: 1h 59m 9s. Rate: 7.5 symbols/min [2025-09-26T20:17:36.769668] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-26T20:17:36.772415] [INFO ] [REMOTE ] NGS: Full fetch complete (17209 records). [2025-09-26T20:17:36.772548] [DEBUG] [VALIDATOR ] NGS: Validating primary data. [2025-09-26T20:17:37.173474] [DEBUG] [VALIDATOR ] NGS: All expected trading days are present. [2025-09-26T20:17:37.173566] [DEBUG] [VALIDATOR ] NGS: Primary data validation passed. [2025-09-26T20:17:37.174025] [INFO ] [MAIN ] NGS: Fetched primary data is valid. [2025-09-26T20:17:37.174091] [DEBUG] [LOCAL ] NGS: Saving primary data. [2025-09-26T20:17:37.174926] [DEBUG] [LOCAL ] NGS: Trimmed 17209 records to 11682 (keeping 200 days of data) [2025-09-26T20:17:37.261508] [DEBUG] [LOCAL ] NGS: Primary data saved (11682 records). [2025-09-26T20:17:37.261687] [INFO ] [MAIN ] NGS: Full history saved. [2025-09-26T20:17:37.261811] [INFO ] [MAIN ] Update Progress: 1480/2371 symbols completed. NGS took 21.8s. Estimated remaining: 1h 58m 57s. Rate: 7.5 symbols/min [2025-09-26T20:17:37.848272] [INFO ] [MAIN ] NGVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:17:37.980614] [INFO ] [MAIN ] NIC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:17:38.000456] [INFO ] [MAIN ] NI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:17:38.031301] [DEBUG] [LOCAL ] NI: No existing data file found in primary storage. [2025-09-26T20:17:38.055870] [WARN ] [MAIN ] NI: No existing data found, performing full refresh instead. [2025-09-26T20:17:38.060741] [INFO ] [MAIN ] NI: Wiping existing primary data before full refresh. [2025-09-26T20:17:38.060833] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-09-26T20:17:38.062067] [DEBUG] [LOCAL ] NI: No primary data file found to delete. [2025-09-26T20:17:38.062249] [INFO ] [MAIN ] NI: Starting full primary refresh. [2025-09-26T20:17:38.061994] [INFO ] [MAIN ] NHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:17:38.187086] [DEBUG] [LOCAL ] NIC: Loaded 8966 existing records from primary storage. [2025-09-26T20:17:38.193804] [INFO ] [MAIN ] NIC: Loaded 8966 existing records. [2025-09-26T20:17:38.206106] [DEBUG] [LOCAL ] NGVT: Loaded 24491 existing records from primary storage. [2025-09-26T20:17:38.278929] [INFO ] [MAIN ] NGVT: Loaded 24491 existing records. [2025-09-26T20:17:38.331989] [DEBUG] [LOCAL ] NHI: Loaded 22129 existing records from primary storage. [2025-09-26T20:17:38.452180] [INFO ] [MAIN ] NHI: Loaded 22129 existing records. [2025-09-26T20:17:38.999330] [WARN ] [MAIN ] NIC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:17:38.987361] [WARN ] [MAIN ] NGVT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:17:39.053568] [INFO ] [MAIN ] NIC: Wiping existing primary data before full refresh. [2025-09-26T20:17:39.086995] [INFO ] [MAIN ] NGVT: Wiping existing primary data before full refresh. [2025-09-26T20:17:39.087119] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-09-26T20:17:39.099684] [INFO ] [REMOTE ] NI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:17:39.115888] [DEBUG] [LOCAL ] NIC: Deleted primary data file. [2025-09-26T20:17:39.116088] [INFO ] [MAIN ] NIC: Starting full primary refresh. [2025-09-26T20:17:39.116204] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-09-26T20:17:39.115818] [INFO ] [REMOTE ] NI: Fetching primary data for 2024-12. [2025-09-26T20:17:39.151180] [DEBUG] [LOCAL ] NGVT: Deleted primary data file. [2025-09-26T20:17:39.183203] [INFO ] [MAIN ] NGVT: Starting full primary refresh. [2025-09-26T20:17:39.234015] [WARN ] [MAIN ] NHI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:17:39.324517] [INFO ] [MAIN ] NHI: Wiping existing primary data before full refresh. [2025-09-26T20:17:39.354324] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-09-26T20:17:39.392456] [DEBUG] [LOCAL ] NHI: Deleted primary data file. [2025-09-26T20:17:39.404752] [INFO ] [MAIN ] NHI: Starting full primary refresh. [2025-09-26T20:17:40.401999] [INFO ] [REMOTE ] NHI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:17:40.360561] [INFO ] [REMOTE ] NIC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:17:40.402963] [INFO ] [REMOTE ] NHI: Fetching primary data for 2024-12. [2025-09-26T20:17:40.376000] [INFO ] [REMOTE ] NGVT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:17:40.403295] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2024-12. [2025-09-26T20:17:40.404917] [INFO ] [REMOTE ] NIC: Fetching primary data for 2024-12. [2025-09-26T20:17:40.873966] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-26T20:17:40.886687] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-01. [2025-09-26T20:17:41.230805] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-26T20:17:41.232852] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-01. [2025-09-26T20:17:41.592204] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-26T20:17:41.597841] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-01. [2025-09-26T20:17:41.618178] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-26T20:17:42.158884] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-26T20:17:42.311710] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-02. [2025-09-26T20:17:42.726393] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-26T20:17:42.829018] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-26T20:17:43.111730] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-02. [2025-09-26T20:17:43.147721] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-26T20:17:43.911752] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-03. [2025-09-26T20:17:44.168105] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-26T20:17:44.711750] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-02. [2025-09-26T20:17:44.788823] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-26T20:17:45.511724] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-04. [2025-09-26T20:17:46.311695] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-01. [2025-09-26T20:17:46.414361] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-26T20:17:46.454776] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-26T20:17:47.111753] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-03. [2025-09-26T20:17:47.434816] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-26T20:17:47.911724] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-02. [2025-09-26T20:17:48.247903] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-26T20:17:48.711743] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-04. [2025-09-26T20:17:49.084262] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-26T20:17:49.511751] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-05. [2025-09-26T20:17:49.878129] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-26T20:17:50.311744] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-05. [2025-09-26T20:17:50.328975] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-26T20:17:51.111711] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-03. [2025-09-26T20:17:51.534296] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-26T20:17:51.911728] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-03. [2025-09-26T20:17:52.711722] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-06. [2025-09-26T20:17:52.867393] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-26T20:17:53.167036] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-26T20:17:53.264225] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-26T20:17:53.511779] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-07. [2025-09-26T20:17:54.311718] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-06. [2025-09-26T20:17:54.447550] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-26T20:17:55.111719] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-08. [2025-09-26T20:17:55.676262] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-26T20:17:55.911704] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-04. [2025-09-26T20:17:55.933614] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-26T20:17:56.711712] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-04. [2025-09-26T20:17:57.176519] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-26T20:17:57.511736] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-05. [2025-09-26T20:17:58.311722] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-07. [2025-09-26T20:17:58.605328] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-26T20:17:58.837886] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-26T20:17:59.111715] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-09. [2025-09-26T20:17:59.557817] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-26T20:17:59.911737] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-05. [2025-09-26T20:17:59.950784] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-26T20:17:59.953032] [INFO ] [REMOTE ] NIC: Full fetch complete (12137 records). [2025-09-26T20:17:59.953109] [DEBUG] [VALIDATOR ] NIC: Validating primary data. [2025-09-26T20:18:00.361498] [DEBUG] [VALIDATOR ] NIC: All expected trading days are present. [2025-09-26T20:18:00.361605] [DEBUG] [VALIDATOR ] NIC: Primary data validation passed. [2025-09-26T20:18:00.362065] [INFO ] [MAIN ] NIC: Fetched primary data is valid. [2025-09-26T20:18:00.362141] [DEBUG] [LOCAL ] NIC: Saving primary data. [2025-09-26T20:18:00.362749] [DEBUG] [LOCAL ] NIC: Trimmed 12137 records to 9026 (keeping 200 days of data) [2025-09-26T20:18:00.424380] [DEBUG] [LOCAL ] NIC: Primary data saved (9026 records). [2025-09-26T20:18:00.424537] [INFO ] [MAIN ] NIC: Full history saved. [2025-09-26T20:18:00.424692] [INFO ] [MAIN ] Update Progress: 1481/2371 symbols completed. NIC took 23.2s. Estimated remaining: 1h 58m 58s. Rate: 7.5 symbols/min [2025-09-26T20:18:00.613356] [INFO ] [MAIN ] NIE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:18:00.627231] [DEBUG] [LOCAL ] NIE: Loaded 11696 existing records from primary storage. [2025-09-26T20:18:00.627360] [INFO ] [MAIN ] NIE: Loaded 11696 existing records. [2025-09-26T20:18:00.716851] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-06. [2025-09-26T20:18:00.832310] [WARN ] [MAIN ] NIE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:18:00.832588] [INFO ] [MAIN ] NIE: Wiping existing primary data before full refresh. [2025-09-26T20:18:00.832694] [INFO ] [LOCAL ] NIE: Starting deletion of primary data. [2025-09-26T20:18:00.833183] [DEBUG] [LOCAL ] NIE: Deleted primary data file. [2025-09-26T20:18:00.833244] [INFO ] [MAIN ] NIE: Starting full primary refresh. [2025-09-26T20:18:01.244002] [INFO ] [REMOTE ] NIE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:18:01.511702] [INFO ] [REMOTE ] NIE: Fetching primary data for 2024-12. [2025-09-26T20:18:01.893905] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-26T20:18:02.311705] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-07. [2025-09-26T20:18:02.405510] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-09-26T20:18:02.457984] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-26T20:18:03.111692] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-01. [2025-09-26T20:18:03.437720] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-26T20:18:03.911715] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-08. [2025-09-26T20:18:04.045900] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-26T20:18:04.711744] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-08. [2025-09-26T20:18:04.894953] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-26T20:18:05.511695] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-09. [2025-09-26T20:18:05.864118] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-26T20:18:06.311744] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-02. [2025-09-26T20:18:06.579272] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-26T20:18:06.584429] [INFO ] [REMOTE ] NGVT: Full fetch complete (34523 records). [2025-09-26T20:18:06.584590] [DEBUG] [VALIDATOR ] NGVT: Validating primary data. [2025-09-26T20:18:06.993104] [DEBUG] [VALIDATOR ] NGVT: All expected trading days are present. [2025-09-26T20:18:06.993205] [DEBUG] [VALIDATOR ] NGVT: Primary data validation passed. [2025-09-26T20:18:06.993993] [INFO ] [MAIN ] NGVT: Fetched primary data is valid. [2025-09-26T20:18:06.994062] [DEBUG] [LOCAL ] NGVT: Saving primary data. [2025-09-26T20:18:06.995182] [DEBUG] [LOCAL ] NGVT: Trimmed 34523 records to 24631 (keeping 200 days of data) [2025-09-26T20:18:07.111794] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-06. [2025-09-26T20:18:07.156747] [DEBUG] [LOCAL ] NGVT: Primary data saved (24631 records). [2025-09-26T20:18:07.156975] [INFO ] [MAIN ] NGVT: Full history saved. [2025-09-26T20:18:07.157112] [INFO ] [MAIN ] Update Progress: 1482/2371 symbols completed. NGVT took 29.9s. Estimated remaining: 1h 58m 49s. Rate: 7.5 symbols/min [2025-09-26T20:18:07.343147] [INFO ] [MAIN ] NIM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:18:07.352115] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-26T20:18:07.361048] [DEBUG] [LOCAL ] NIM: Loaded 4117 existing records from primary storage. [2025-09-26T20:18:07.361193] [INFO ] [MAIN ] NIM: Loaded 4117 existing records. [2025-09-26T20:18:07.547959] [WARN ] [MAIN ] NIM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:18:07.548352] [INFO ] [MAIN ] NIM: Wiping existing primary data before full refresh. [2025-09-26T20:18:07.548403] [INFO ] [LOCAL ] NIM: Starting deletion of primary data. [2025-09-26T20:18:07.548849] [DEBUG] [LOCAL ] NIM: Deleted primary data file. [2025-09-26T20:18:07.548911] [INFO ] [MAIN ] NIM: Starting full primary refresh. [2025-09-26T20:18:07.916254] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-03. [2025-09-26T20:18:07.920952] [INFO ] [REMOTE ] NIM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:18:08.711717] [INFO ] [REMOTE ] NIM: Fetching primary data for 2024-12. [2025-09-26T20:18:08.770231] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-26T20:18:08.848128] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-26T20:18:09.511741] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-07. [2025-09-26T20:18:09.636341] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-26T20:18:10.311738] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-04. [2025-09-26T20:18:11.111771] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-01. [2025-09-26T20:18:11.228562] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-26T20:18:11.335549] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-26T20:18:11.852149] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-26T20:18:11.911677] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-09. [2025-09-26T20:18:12.711729] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-02. [2025-09-26T20:18:13.123145] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-26T20:18:13.127852] [INFO ] [REMOTE ] NHI: Full fetch complete (31567 records). [2025-09-26T20:18:13.127979] [DEBUG] [VALIDATOR ] NHI: Validating primary data. [2025-09-26T20:18:13.438612] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-26T20:18:13.518769] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-05. [2025-09-26T20:18:13.561145] [DEBUG] [VALIDATOR ] NHI: All expected trading days are present. [2025-09-26T20:18:13.561243] [DEBUG] [VALIDATOR ] NHI: Primary data validation passed. [2025-09-26T20:18:13.562050] [INFO ] [MAIN ] NHI: Fetched primary data is valid. [2025-09-26T20:18:13.562116] [DEBUG] [LOCAL ] NHI: Saving primary data. [2025-09-26T20:18:13.562975] [DEBUG] [LOCAL ] NHI: Trimmed 31567 records to 22283 (keeping 200 days of data) [2025-09-26T20:18:13.705094] [DEBUG] [LOCAL ] NHI: Primary data saved (22283 records). [2025-09-26T20:18:13.705236] [INFO ] [MAIN ] NHI: Full history saved. [2025-09-26T20:18:13.705324] [INFO ] [MAIN ] Update Progress: 1483/2371 symbols completed. NHI took 36.4s. Estimated remaining: 1h 58m 40s. Rate: 7.5 symbols/min [2025-09-26T20:18:13.880794] [INFO ] [MAIN ] NINE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:18:13.911855] [DEBUG] [LOCAL ] NINE: Loaded 28502 existing records from primary storage. [2025-09-26T20:18:13.912004] [INFO ] [MAIN ] NINE: Loaded 28502 existing records. [2025-09-26T20:18:14.096060] [WARN ] [MAIN ] NINE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:18:14.096372] [INFO ] [MAIN ] NINE: Wiping existing primary data before full refresh. [2025-09-26T20:18:14.096422] [INFO ] [LOCAL ] NINE: Starting deletion of primary data. [2025-09-26T20:18:14.097928] [DEBUG] [LOCAL ] NINE: Deleted primary data file. [2025-09-26T20:18:14.097990] [INFO ] [MAIN ] NINE: Starting full primary refresh. [2025-09-26T20:18:14.321263] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-08. [2025-09-26T20:18:14.434232] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-26T20:18:14.518095] [INFO ] [REMOTE ] NINE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:18:15.111716] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-06. [2025-09-26T20:18:15.911694] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-03. [2025-09-26T20:18:16.089936] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-26T20:18:16.294997] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-26T20:18:16.699235] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-26T20:18:16.711683] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-04. [2025-09-26T20:18:17.445127] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-26T20:18:17.511743] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-09. [2025-09-26T20:18:18.311731] [INFO ] [REMOTE ] NINE: Fetching primary data for 2024-12. [2025-09-26T20:18:18.433052] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-26T20:18:18.443726] [INFO ] [REMOTE ] NI: Full fetch complete (76877 records). [2025-09-26T20:18:18.443902] [DEBUG] [VALIDATOR ] NI: Validating primary data. [2025-09-26T20:18:18.444804] [FATAL] [VALIDATOR ] NI: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T20:18:18.444908] [FATAL] [MAIN ] NI: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:18:18.444976] [WARN ] [MAIN ] NI: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:18:18.445056] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-09-26T20:18:18.445125] [DEBUG] [LOCAL ] NI: No primary data file found to delete. [2025-09-26T20:18:18.445162] [INFO ] [LOCAL ] NI: Starting deletion of derivative data. [2025-09-26T20:18:18.445202] [DEBUG] [LOCAL ] NI: No derivative data file found to delete. [2025-09-26T20:18:18.445267] [INFO ] [MAIN ] Update Progress: 1484/2371 symbols completed. NI took 41.2s. Estimated remaining: 1h 58m 30s. Rate: 7.5 symbols/min [2025-09-26T20:18:18.621471] [INFO ] [MAIN ] NIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:18:18.678177] [DEBUG] [LOCAL ] NIO: Loaded 54192 existing records from primary storage. [2025-09-26T20:18:18.678390] [INFO ] [MAIN ] NIO: Loaded 54192 existing records. [2025-09-26T20:18:18.875915] [WARN ] [MAIN ] NIO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:18:18.876180] [INFO ] [MAIN ] NIO: Wiping existing primary data before full refresh. [2025-09-26T20:18:18.876230] [INFO ] [LOCAL ] NIO: Starting deletion of primary data. [2025-09-26T20:18:18.877679] [DEBUG] [LOCAL ] NIO: Deleted primary data file. [2025-09-26T20:18:18.877744] [INFO ] [MAIN ] NIO: Starting full primary refresh. [2025-09-26T20:18:19.116922] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-07. [2025-09-26T20:18:19.285356] [INFO ] [REMOTE ] NIO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:18:19.482264] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-26T20:18:19.802987] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-26T20:18:19.911725] [INFO ] [REMOTE ] NIO: Fetching primary data for 2024-12. [2025-09-26T20:18:20.711756] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-08. [2025-09-26T20:18:21.511718] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-01. [2025-09-26T20:18:21.678978] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-26T20:18:22.311737] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-05. [2025-09-26T20:18:22.544765] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2024-12 (2.63 seconds). [2025-09-26T20:18:22.993416] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-26T20:18:23.111720] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-09. [2025-09-26T20:18:23.263363] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-26T20:18:23.911735] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-06. [2025-09-26T20:18:23.933386] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-26T20:18:23.936130] [INFO ] [REMOTE ] NIE: Full fetch complete (16443 records). [2025-09-26T20:18:23.936212] [DEBUG] [VALIDATOR ] NIE: Validating primary data. [2025-09-26T20:18:24.316711] [DEBUG] [VALIDATOR ] NIE: All expected trading days are present. [2025-09-26T20:18:24.316798] [DEBUG] [VALIDATOR ] NIE: Primary data validation passed. [2025-09-26T20:18:24.317191] [INFO ] [MAIN ] NIE: Fetched primary data is valid. [2025-09-26T20:18:24.317252] [DEBUG] [LOCAL ] NIE: Saving primary data. [2025-09-26T20:18:24.317838] [DEBUG] [LOCAL ] NIE: Trimmed 16443 records to 11869 (keeping 200 days of data) [2025-09-26T20:18:24.397147] [DEBUG] [LOCAL ] NIE: Primary data saved (11869 records). [2025-09-26T20:18:24.397339] [INFO ] [MAIN ] NIE: Full history saved. [2025-09-26T20:18:24.397481] [INFO ] [MAIN ] Update Progress: 1485/2371 symbols completed. NIE took 24.0s. Estimated remaining: 1h 58m 21s. Rate: 7.5 symbols/min [2025-09-26T20:18:24.575220] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-26T20:18:24.593908] [INFO ] [MAIN ] NIQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:18:24.596606] [DEBUG] [LOCAL ] NIQ: No existing data file found in primary storage. [2025-09-26T20:18:24.596705] [WARN ] [MAIN ] NIQ: No existing data found, performing full refresh instead. [2025-09-26T20:18:24.596937] [INFO ] [MAIN ] NIQ: Wiping existing primary data before full refresh. [2025-09-26T20:18:24.597001] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-09-26T20:18:24.597052] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-09-26T20:18:24.597098] [INFO ] [MAIN ] NIQ: Starting full primary refresh. [2025-09-26T20:18:24.716943] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-01. [2025-09-26T20:18:24.991159] [INFO ] [REMOTE ] NIQ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:18:25.511719] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-07. [2025-09-26T20:18:26.132731] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-26T20:18:26.311757] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2024-12. [2025-09-26T20:18:26.582685] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:18:26.583058] [WARN ] [REMOTE ] NIQ: No data returned for month 2024-12 [2025-09-26T20:18:27.001442] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-09-26T20:18:27.111723] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-02. [2025-09-26T20:18:27.911724] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-08. [2025-09-26T20:18:28.481198] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-26T20:18:28.711760] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-09. [2025-09-26T20:18:29.289366] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-26T20:18:29.291475] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-26T20:18:29.293221] [INFO ] [REMOTE ] NIM: Full fetch complete (6816 records). [2025-09-26T20:18:29.303364] [DEBUG] [VALIDATOR ] NIM: Validating primary data. [2025-09-26T20:18:29.517617] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-03. [2025-09-26T20:18:29.690278] [DEBUG] [VALIDATOR ] NIM: All expected trading days are present. [2025-09-26T20:18:29.690363] [DEBUG] [VALIDATOR ] NIM: Primary data validation passed. [2025-09-26T20:18:29.690568] [INFO ] [MAIN ] NIM: Fetched primary data is valid. [2025-09-26T20:18:29.690623] [DEBUG] [LOCAL ] NIM: Saving primary data. [2025-09-26T20:18:29.691207] [DEBUG] [LOCAL ] NIM: Trimmed 6816 records to 4149 (keeping 200 days of data) [2025-09-26T20:18:29.717162] [DEBUG] [LOCAL ] NIM: Primary data saved (4149 records). [2025-09-26T20:18:29.717321] [INFO ] [MAIN ] NIM: Full history saved. [2025-09-26T20:18:29.717426] [INFO ] [MAIN ] Update Progress: 1486/2371 symbols completed. NIM took 22.6s. Estimated remaining: 1h 58m 11s. Rate: 7.5 symbols/min [2025-09-26T20:18:29.904675] [INFO ] [MAIN ] NJR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:18:29.945842] [DEBUG] [LOCAL ] NJR: Loaded 38433 existing records from primary storage. [2025-09-26T20:18:29.945990] [INFO ] [MAIN ] NJR: Loaded 38433 existing records. [2025-09-26T20:18:30.139012] [WARN ] [MAIN ] NJR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:18:30.139304] [INFO ] [MAIN ] NJR: Wiping existing primary data before full refresh. [2025-09-26T20:18:30.139420] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-09-26T20:18:30.140445] [DEBUG] [LOCAL ] NJR: Deleted primary data file. [2025-09-26T20:18:30.140523] [INFO ] [MAIN ] NJR: Starting full primary refresh. [2025-09-26T20:18:30.324296] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-01. [2025-09-26T20:18:30.515416] [INFO ] [REMOTE ] NJR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:18:30.703777] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:18:30.704147] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-01 [2025-09-26T20:18:31.111727] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-02. [2025-09-26T20:18:31.911692] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-02. [2025-09-26T20:18:32.084591] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-09-26T20:18:32.160192] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:18:32.160552] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-02 [2025-09-26T20:18:32.434832] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-26T20:18:32.711808] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-03. [2025-09-26T20:18:33.511747] [INFO ] [REMOTE ] NJR: Fetching primary data for 2024-12. [2025-09-26T20:18:34.041761] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-26T20:18:34.311750] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-04. [2025-09-26T20:18:35.109246] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-26T20:18:35.116624] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-04. [2025-09-26T20:18:35.911724] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-01. [2025-09-26T20:18:36.655425] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-26T20:18:36.692014] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-26T20:18:36.711748] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-03. [2025-09-26T20:18:36.991442] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:18:36.991829] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-03 [2025-09-26T20:18:37.341371] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-26T20:18:37.511736] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-04. [2025-09-26T20:18:37.772200] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:18:37.772560] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-04 [2025-09-26T20:18:38.311727] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-05. [2025-09-26T20:18:39.111717] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-05. [2025-09-26T20:18:39.694319] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-26T20:18:39.911713] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-02. [2025-09-26T20:18:40.711749] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-05. [2025-09-26T20:18:40.956589] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:18:40.960427] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-05 [2025-09-26T20:18:41.310183] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-26T20:18:41.476686] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-26T20:18:41.511699] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-03. [2025-09-26T20:18:42.311723] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-06. [2025-09-26T20:18:42.568497] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:18:42.569068] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-06 [2025-09-26T20:18:42.986077] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-26T20:18:43.111729] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-07. [2025-09-26T20:18:43.911770] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-06. [2025-09-26T20:18:44.094523] [INFO ] [REMOTE ] NIQ: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-26T20:18:44.711769] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-06. [2025-09-26T20:18:45.511766] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-04. [2025-09-26T20:18:45.723325] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-26T20:18:46.311774] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-07. [2025-09-26T20:18:46.691314] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-26T20:18:47.111783] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-07. [2025-09-26T20:18:47.182105] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-26T20:18:47.766198] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-26T20:18:47.911722] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-08. [2025-09-26T20:18:48.711711] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-05. [2025-09-26T20:18:49.517498] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-08. [2025-09-26T20:18:49.523822] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-26T20:18:49.642566] [INFO ] [REMOTE ] NIQ: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-26T20:18:49.785675] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-26T20:18:50.311736] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-09. [2025-09-26T20:18:50.826402] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-26T20:18:51.111729] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-08. [2025-09-26T20:18:51.911714] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-09. [2025-09-26T20:18:52.093013] [INFO ] [REMOTE ] NIQ: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-26T20:18:52.102941] [INFO ] [REMOTE ] NIQ: Full fetch complete (16111 records). [2025-09-26T20:18:52.103121] [DEBUG] [VALIDATOR ] NIQ: Validating primary data. [2025-09-26T20:18:52.297466] [WARN ] [VALIDATOR ] NIQ: Validation failed - insufficient historical data. Have 47 unique days, need 200 days [2025-09-26T20:18:52.297826] [FATAL] [MAIN ] NIQ: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:18:52.297899] [WARN ] [MAIN ] NIQ: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:18:52.297973] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-09-26T20:18:52.298056] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-09-26T20:18:52.298124] [INFO ] [LOCAL ] NIQ: Starting deletion of derivative data. [2025-09-26T20:18:52.298194] [DEBUG] [LOCAL ] NIQ: No derivative data file found to delete. [2025-09-26T20:18:52.298259] [INFO ] [MAIN ] Update Progress: 1487/2371 symbols completed. NIQ took 27.9s. Estimated remaining: 1h 58m 12s. Rate: 7.5 symbols/min [2025-09-26T20:18:52.476535] [INFO ] [MAIN ] NKE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:18:52.476785] [DEBUG] [LOCAL ] NKE: No existing data file found in primary storage. [2025-09-26T20:18:52.476842] [WARN ] [MAIN ] NKE: No existing data found, performing full refresh instead. [2025-09-26T20:18:52.477016] [INFO ] [MAIN ] NKE: Wiping existing primary data before full refresh. [2025-09-26T20:18:52.477100] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-09-26T20:18:52.477153] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-09-26T20:18:52.477199] [INFO ] [MAIN ] NKE: Starting full primary refresh. [2025-09-26T20:18:52.717231] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-06. [2025-09-26T20:18:52.873503] [INFO ] [REMOTE ] NKE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:18:53.055050] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-26T20:18:53.059896] [INFO ] [REMOTE ] NINE: Full fetch complete (44107 records). [2025-09-26T20:18:53.060011] [DEBUG] [VALIDATOR ] NINE: Validating primary data. [2025-09-26T20:18:53.485872] [DEBUG] [VALIDATOR ] NINE: All expected trading days are present. [2025-09-26T20:18:53.486154] [DEBUG] [VALIDATOR ] NINE: Primary data validation passed. [2025-09-26T20:18:53.487168] [INFO ] [MAIN ] NINE: Fetched primary data is valid. [2025-09-26T20:18:53.487300] [DEBUG] [LOCAL ] NINE: Saving primary data. [2025-09-26T20:18:53.518051] [INFO ] [REMOTE ] NKE: Fetching primary data for 2024-12. [2025-09-26T20:18:53.524362] [DEBUG] [LOCAL ] NINE: Trimmed 44107 records to 28624 (keeping 200 days of data) [2025-09-26T20:18:53.527753] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-26T20:18:53.722379] [DEBUG] [LOCAL ] NINE: Primary data saved (28624 records). [2025-09-26T20:18:53.722559] [INFO ] [MAIN ] NINE: Full history saved. [2025-09-26T20:18:53.722728] [INFO ] [MAIN ] Update Progress: 1488/2371 symbols completed. NINE took 40.0s. Estimated remaining: 1h 57m 60s. Rate: 7.5 symbols/min [2025-09-26T20:18:53.920013] [INFO ] [MAIN ] NKX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:18:53.939985] [DEBUG] [LOCAL ] NKX: Loaded 13747 existing records from primary storage. [2025-09-26T20:18:53.940125] [INFO ] [MAIN ] NKX: Loaded 13747 existing records. [2025-09-26T20:18:54.129894] [WARN ] [MAIN ] NKX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:18:54.130226] [INFO ] [MAIN ] NKX: Wiping existing primary data before full refresh. [2025-09-26T20:18:54.130340] [INFO ] [LOCAL ] NKX: Starting deletion of primary data. [2025-09-26T20:18:54.130984] [DEBUG] [LOCAL ] NKX: Deleted primary data file. [2025-09-26T20:18:54.131049] [INFO ] [MAIN ] NKX: Starting full primary refresh. [2025-09-26T20:18:54.322682] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-09. [2025-09-26T20:18:54.470577] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-26T20:18:54.563173] [INFO ] [REMOTE ] NKX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:18:55.111714] [INFO ] [REMOTE ] NKX: Fetching primary data for 2024-12. [2025-09-26T20:18:55.307708] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-26T20:18:55.318670] [INFO ] [REMOTE ] NIO: Full fetch complete (77974 records). [2025-09-26T20:18:55.318829] [DEBUG] [VALIDATOR ] NIO: Validating primary data. [2025-09-26T20:18:55.747802] [DEBUG] [VALIDATOR ] NIO: All expected trading days are present. [2025-09-26T20:18:55.747907] [DEBUG] [VALIDATOR ] NIO: Primary data validation passed. [2025-09-26T20:18:55.749123] [INFO ] [MAIN ] NIO: Fetched primary data is valid. [2025-09-26T20:18:55.749208] [DEBUG] [LOCAL ] NIO: Saving primary data. [2025-09-26T20:18:55.750947] [DEBUG] [LOCAL ] NIO: Trimmed 77974 records to 54582 (keeping 200 days of data) [2025-09-26T20:18:55.929716] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-07. [2025-09-26T20:18:56.095894] [DEBUG] [LOCAL ] NIO: Primary data saved (54582 records). [2025-09-26T20:18:56.096074] [INFO ] [MAIN ] NIO: Full history saved. [2025-09-26T20:18:56.096191] [INFO ] [MAIN ] Update Progress: 1489/2371 symbols completed. NIO took 37.7s. Estimated remaining: 1h 57m 48s. Rate: 7.5 symbols/min [2025-09-26T20:18:56.189322] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-26T20:18:56.297523] [INFO ] [MAIN ] NL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:18:56.297914] [DEBUG] [LOCAL ] NL: No existing data file found in primary storage. [2025-09-26T20:18:56.297985] [WARN ] [MAIN ] NL: No existing data found, performing full refresh instead. [2025-09-26T20:18:56.298346] [INFO ] [MAIN ] NL: Wiping existing primary data before full refresh. [2025-09-26T20:18:56.298421] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-09-26T20:18:56.298544] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-09-26T20:18:56.298694] [INFO ] [MAIN ] NL: Starting full primary refresh. [2025-09-26T20:18:56.511007] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2024-12 (2.99 seconds). [2025-09-26T20:18:56.721734] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-01. [2025-09-26T20:18:56.727707] [INFO ] [REMOTE ] NL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:18:57.427717] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-26T20:18:57.511762] [INFO ] [REMOTE ] NL: Fetching primary data for 2024-12. [2025-09-26T20:18:57.624636] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-26T20:18:58.169875] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-26T20:18:58.311731] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-08. [2025-09-26T20:18:59.111747] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-01. [2025-09-26T20:18:59.852368] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-26T20:18:59.911682] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-02. [2025-09-26T20:19:00.711729] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-01. [2025-09-26T20:19:01.041162] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-26T20:19:01.443152] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-26T20:19:01.508952] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-09-26T20:19:01.519021] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-02. [2025-09-26T20:19:02.240999] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-26T20:19:02.311732] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-03. [2025-09-26T20:19:03.063997] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-26T20:19:03.111713] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-09. [2025-09-26T20:19:03.911740] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-04. [2025-09-26T20:19:04.575741] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-26T20:19:04.721438] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-02. [2025-09-26T20:19:04.727029] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-26T20:19:04.735536] [INFO ] [REMOTE ] NJR: Full fetch complete (54522 records). [2025-09-26T20:19:04.735718] [DEBUG] [VALIDATOR ] NJR: Validating primary data. [2025-09-26T20:19:05.178150] [DEBUG] [VALIDATOR ] NJR: All expected trading days are present. [2025-09-26T20:19:05.178393] [DEBUG] [VALIDATOR ] NJR: Primary data validation passed. [2025-09-26T20:19:05.180181] [INFO ] [MAIN ] NJR: Fetched primary data is valid. [2025-09-26T20:19:05.180307] [DEBUG] [LOCAL ] NJR: Saving primary data. [2025-09-26T20:19:05.184715] [DEBUG] [LOCAL ] NJR: Trimmed 54522 records to 38739 (keeping 200 days of data) [2025-09-26T20:19:05.449881] [DEBUG] [LOCAL ] NJR: Primary data saved (38739 records). [2025-09-26T20:19:05.450038] [INFO ] [MAIN ] NJR: Full history saved. [2025-09-26T20:19:05.450301] [INFO ] [MAIN ] Update Progress: 1490/2371 symbols completed. NJR took 35.7s. Estimated remaining: 1h 57m 41s. Rate: 7.5 symbols/min [2025-09-26T20:19:05.522455] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-05. [2025-09-26T20:19:05.653996] [INFO ] [MAIN ] NLOP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:19:05.671490] [DEBUG] [LOCAL ] NLOP: Loaded 11904 existing records from primary storage. [2025-09-26T20:19:05.671637] [INFO ] [MAIN ] NLOP: Loaded 11904 existing records. [2025-09-26T20:19:05.868178] [WARN ] [MAIN ] NLOP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:19:05.868520] [INFO ] [MAIN ] NLOP: Wiping existing primary data before full refresh. [2025-09-26T20:19:05.868601] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-09-26T20:19:05.869262] [DEBUG] [LOCAL ] NLOP: Deleted primary data file. [2025-09-26T20:19:05.869336] [INFO ] [MAIN ] NLOP: Starting full primary refresh. [2025-09-26T20:19:06.253854] [INFO ] [REMOTE ] NLOP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:19:06.311699] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2024-12. [2025-09-26T20:19:06.384395] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-26T20:19:07.086107] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-09-26T20:19:07.111690] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-03. [2025-09-26T20:19:07.168309] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-26T20:19:07.911692] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-03. [2025-09-26T20:19:08.128538] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-26T20:19:08.711768] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-04. [2025-09-26T20:19:09.511740] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-06. [2025-09-26T20:19:09.864758] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-26T20:19:10.237815] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-26T20:19:10.311730] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-05. [2025-09-26T20:19:10.742305] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-03 (2.83 seconds). [2025-09-26T20:19:11.111741] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-01. [2025-09-26T20:19:11.127376] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-26T20:19:11.911740] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-06. [2025-09-26T20:19:12.143759] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-26T20:19:12.711714] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-02. [2025-09-26T20:19:13.058554] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-26T20:19:13.469844] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-26T20:19:13.511678] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-07. [2025-09-26T20:19:14.216416] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-26T20:19:14.311720] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-04. [2025-09-26T20:19:15.111736] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-03. [2025-09-26T20:19:15.911707] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-07. [2025-09-26T20:19:16.054192] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-26T20:19:16.711763] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-08. [2025-09-26T20:19:16.889669] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-09-26T20:19:16.968494] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-26T20:19:17.459379] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-26T20:19:17.511711] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-09. [2025-09-26T20:19:18.183196] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-26T20:19:18.184704] [INFO ] [REMOTE ] NL: Full fetch complete (6922 records). [2025-09-26T20:19:18.184778] [DEBUG] [VALIDATOR ] NL: Validating primary data. [2025-09-26T20:19:18.316908] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-05. [2025-09-26T20:19:18.382955] [WARN ] [VALIDATOR ] NL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-26T20:19:18.383205] [FATAL] [MAIN ] NL: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:19:18.383341] [WARN ] [MAIN ] NL: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:19:18.383964] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-09-26T20:19:18.384058] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-09-26T20:19:18.384101] [INFO ] [LOCAL ] NL: Starting deletion of derivative data. [2025-09-26T20:19:18.384145] [DEBUG] [LOCAL ] NL: No derivative data file found to delete. [2025-09-26T20:19:18.384218] [INFO ] [MAIN ] Update Progress: 1491/2371 symbols completed. NL took 22.3s. Estimated remaining: 1h 57m 36s. Rate: 7.5 symbols/min [2025-09-26T20:19:18.599019] [INFO ] [MAIN ] NLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:19:18.681570] [DEBUG] [LOCAL ] NLY: Loaded 53967 existing records from primary storage. [2025-09-26T20:19:18.682728] [INFO ] [MAIN ] NLY: Loaded 53967 existing records. [2025-09-26T20:19:18.882050] [WARN ] [MAIN ] NLY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:19:18.882429] [INFO ] [MAIN ] NLY: Wiping existing primary data before full refresh. [2025-09-26T20:19:18.882486] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-09-26T20:19:18.884333] [DEBUG] [LOCAL ] NLY: Deleted primary data file. [2025-09-26T20:19:18.884398] [INFO ] [MAIN ] NLY: Starting full primary refresh. [2025-09-26T20:19:19.116840] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-04. [2025-09-26T20:19:19.279703] [INFO ] [REMOTE ] NLY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:19:19.911791] [INFO ] [REMOTE ] NLY: Fetching primary data for 2024-12. [2025-09-26T20:19:20.182522] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-26T20:19:20.711693] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-08. [2025-09-26T20:19:21.033527] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-09-26T20:19:21.511725] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-06. [2025-09-26T20:19:21.741042] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-26T20:19:22.043588] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-26T20:19:22.311727] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-05. [2025-09-26T20:19:23.111727] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-09. [2025-09-26T20:19:23.170693] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-26T20:19:23.911700] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-06. [2025-09-26T20:19:24.108239] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-09-26T20:19:24.129214] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-26T20:19:24.133102] [INFO ] [REMOTE ] NKX: Full fetch complete (19424 records). [2025-09-26T20:19:24.133178] [DEBUG] [VALIDATOR ] NKX: Validating primary data. [2025-09-26T20:19:24.530694] [DEBUG] [VALIDATOR ] NKX: All expected trading days are present. [2025-09-26T20:19:24.530801] [DEBUG] [VALIDATOR ] NKX: Primary data validation passed. [2025-09-26T20:19:24.531296] [INFO ] [MAIN ] NKX: Fetched primary data is valid. [2025-09-26T20:19:24.531342] [DEBUG] [LOCAL ] NKX: Saving primary data. [2025-09-26T20:19:24.531990] [DEBUG] [LOCAL ] NKX: Trimmed 19424 records to 13801 (keeping 200 days of data) [2025-09-26T20:19:24.635930] [DEBUG] [LOCAL ] NKX: Primary data saved (13801 records). [2025-09-26T20:19:24.636087] [INFO ] [MAIN ] NKX: Full history saved. [2025-09-26T20:19:24.636226] [INFO ] [MAIN ] Update Progress: 1492/2371 symbols completed. NKX took 30.9s. Estimated remaining: 1h 57m 27s. Rate: 7.5 symbols/min [2025-09-26T20:19:24.721531] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-07. [2025-09-26T20:19:24.897577] [INFO ] [MAIN ] NMAI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:19:24.898731] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-26T20:19:24.917767] [DEBUG] [LOCAL ] NMAI: Loaded 13127 existing records from primary storage. [2025-09-26T20:19:24.917912] [INFO ] [MAIN ] NMAI: Loaded 13127 existing records. [2025-09-26T20:19:25.101669] [WARN ] [MAIN ] NMAI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:19:25.101932] [INFO ] [MAIN ] NMAI: Wiping existing primary data before full refresh. [2025-09-26T20:19:25.101980] [INFO ] [LOCAL ] NMAI: Starting deletion of primary data. [2025-09-26T20:19:25.102381] [DEBUG] [LOCAL ] NMAI: Deleted primary data file. [2025-09-26T20:19:25.102441] [INFO ] [MAIN ] NMAI: Starting full primary refresh. [2025-09-26T20:19:25.484702] [INFO ] [REMOTE ] NMAI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:19:25.511716] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-07. [2025-09-26T20:19:26.311763] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-01. [2025-09-26T20:19:26.336255] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-26T20:19:27.111749] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-08. [2025-09-26T20:19:27.472935] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-07 (2.75 seconds). [2025-09-26T20:19:27.911738] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-08. [2025-09-26T20:19:28.283589] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-26T20:19:28.482126] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-26T20:19:28.711733] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-02. [2025-09-26T20:19:29.511744] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-09. [2025-09-26T20:19:30.313530] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2024-12. [2025-09-26T20:19:30.334390] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-26T20:19:30.465580] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-26T20:19:30.469213] [INFO ] [REMOTE ] NLOP: Full fetch complete (17726 records). [2025-09-26T20:19:30.469297] [DEBUG] [VALIDATOR ] NLOP: Validating primary data. [2025-09-26T20:19:30.884716] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-26T20:19:30.922141] [DEBUG] [VALIDATOR ] NLOP: All expected trading days are present. [2025-09-26T20:19:30.922963] [DEBUG] [VALIDATOR ] NLOP: Primary data validation passed. [2025-09-26T20:19:30.923909] [INFO ] [MAIN ] NLOP: Fetched primary data is valid. [2025-09-26T20:19:30.923978] [DEBUG] [LOCAL ] NLOP: Saving primary data. [2025-09-26T20:19:30.924639] [DEBUG] [LOCAL ] NLOP: Trimmed 17726 records to 11997 (keeping 200 days of data) [2025-09-26T20:19:31.009816] [DEBUG] [LOCAL ] NLOP: Primary data saved (11997 records). [2025-09-26T20:19:31.009961] [INFO ] [MAIN ] NLOP: Full history saved. [2025-09-26T20:19:31.010050] [INFO ] [MAIN ] Update Progress: 1493/2371 symbols completed. NLOP took 25.6s. Estimated remaining: 1h 57m 18s. Rate: 7.5 symbols/min [2025-09-26T20:19:31.119171] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-09. [2025-09-26T20:19:31.179518] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-26T20:19:31.225955] [INFO ] [MAIN ] NMAX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:19:31.227337] [DEBUG] [LOCAL ] NMAX: No existing data file found in primary storage. [2025-09-26T20:19:31.227393] [WARN ] [MAIN ] NMAX: No existing data found, performing full refresh instead. [2025-09-26T20:19:31.227676] [INFO ] [MAIN ] NMAX: Wiping existing primary data before full refresh. [2025-09-26T20:19:31.227734] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-09-26T20:19:31.227783] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-09-26T20:19:31.227818] [INFO ] [MAIN ] NMAX: Starting full primary refresh. [2025-09-26T20:19:31.646028] [INFO ] [REMOTE ] NMAX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:19:31.911717] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-03. [2025-09-26T20:19:32.711741] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-01. [2025-09-26T20:19:33.511706] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2024-12. [2025-09-26T20:19:33.600515] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-09-26T20:19:33.610981] [INFO ] [REMOTE ] NKE: Full fetch complete (77197 records). [2025-09-26T20:19:33.611328] [DEBUG] [VALIDATOR ] NKE: Validating primary data. [2025-09-26T20:19:33.836782] [WARN ] [VALIDATOR ] NKE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-26T20:19:33.838288] [FATAL] [MAIN ] NKE: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:19:33.838445] [WARN ] [MAIN ] NKE: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:19:33.838580] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-09-26T20:19:33.838748] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-09-26T20:19:33.838891] [INFO ] [LOCAL ] NKE: Starting deletion of derivative data. [2025-09-26T20:19:33.839100] [DEBUG] [LOCAL ] NKE: No derivative data file found to delete. [2025-09-26T20:19:33.839248] [INFO ] [MAIN ] Update Progress: 1494/2371 symbols completed. NKE took 41.5s. Estimated remaining: 1h 57m 7s. Rate: 7.5 symbols/min [2025-09-26T20:19:33.852138] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:19:33.857924] [WARN ] [REMOTE ] NMAX: No data returned for month 2024-12 [2025-09-26T20:19:33.920924] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-26T20:19:34.053089] [INFO ] [MAIN ] NMCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:19:34.085489] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-26T20:19:34.111013] [DEBUG] [LOCAL ] NMCO: Loaded 16751 existing records from primary storage. [2025-09-26T20:19:34.111152] [INFO ] [MAIN ] NMCO: Loaded 16751 existing records. [2025-09-26T20:19:34.302282] [WARN ] [MAIN ] NMCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:19:34.302578] [INFO ] [MAIN ] NMCO: Wiping existing primary data before full refresh. [2025-09-26T20:19:34.302678] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-09-26T20:19:34.303242] [DEBUG] [LOCAL ] NMCO: Deleted primary data file. [2025-09-26T20:19:34.303307] [INFO ] [MAIN ] NMCO: Starting full primary refresh. [2025-09-26T20:19:34.318308] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-01. [2025-09-26T20:19:34.608728] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:19:34.636007] [WARN ] [REMOTE ] NMAX: No data returned for month 2025-01 [2025-09-26T20:19:34.716765] [INFO ] [REMOTE ] NMCO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:19:35.111721] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-02. [2025-09-26T20:19:35.357283] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:19:35.357620] [WARN ] [REMOTE ] NMAX: No data returned for month 2025-02 [2025-09-26T20:19:35.911734] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-04. [2025-09-26T20:19:36.711718] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-03. [2025-09-26T20:19:37.200470] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-26T20:19:37.511715] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2024-12. [2025-09-26T20:19:37.993012] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-26T20:19:38.311719] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-04. [2025-09-26T20:19:38.674221] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-26T20:19:39.111716] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-01. [2025-09-26T20:19:39.911739] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-02. [2025-09-26T20:19:40.062956] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-26T20:19:40.711740] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-05. [2025-09-26T20:19:40.791344] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-26T20:19:40.858721] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-09-26T20:19:41.511768] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-02. [2025-09-26T20:19:42.311727] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-05. [2025-09-26T20:19:42.451041] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-26T20:19:42.675491] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-26T20:19:43.111731] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-03. [2025-09-26T20:19:43.911711] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-06. [2025-09-26T20:19:44.032463] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-26T20:19:44.320468] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-26T20:19:44.711742] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-06. [2025-09-26T20:19:45.511729] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-03. [2025-09-26T20:19:45.963123] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-26T20:19:46.311691] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-04. [2025-09-26T20:19:46.540334] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-26T20:19:46.644892] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-26T20:19:47.111712] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-07. [2025-09-26T20:19:47.317722] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-26T20:19:47.911747] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-05. [2025-09-26T20:19:48.711735] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-04. [2025-09-26T20:19:48.830753] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-26T20:19:48.972110] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-26T20:19:49.304854] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-26T20:19:49.511716] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-06. [2025-09-26T20:19:50.311723] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-07. [2025-09-26T20:19:50.520851] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-26T20:19:51.111724] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-05. [2025-09-26T20:19:51.911714] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-07. [2025-09-26T20:19:51.939073] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-26T20:19:52.277529] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-26T20:19:52.711717] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-06. [2025-09-26T20:19:52.980078] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-26T20:19:53.511729] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-08. [2025-09-26T20:19:53.640802] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-26T20:19:54.311741] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-08. [2025-09-26T20:19:55.111758] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-08. [2025-09-26T20:19:55.180379] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-26T20:19:55.335786] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-26T20:19:55.911743] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-09. [2025-09-26T20:19:56.711697] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-07. [2025-09-26T20:19:56.823212] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-26T20:19:56.923337] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-26T20:19:56.927546] [INFO ] [REMOTE ] NMCO: Full fetch complete (24443 records). [2025-09-26T20:19:56.927635] [DEBUG] [VALIDATOR ] NMCO: Validating primary data. [2025-09-26T20:19:57.354358] [DEBUG] [VALIDATOR ] NMCO: All expected trading days are present. [2025-09-26T20:19:57.354445] [DEBUG] [VALIDATOR ] NMCO: Primary data validation passed. [2025-09-26T20:19:57.355030] [INFO ] [MAIN ] NMCO: Fetched primary data is valid. [2025-09-26T20:19:57.355096] [DEBUG] [LOCAL ] NMCO: Saving primary data. [2025-09-26T20:19:57.355991] [DEBUG] [LOCAL ] NMCO: Trimmed 24443 records to 16803 (keeping 200 days of data) [2025-09-26T20:19:57.489278] [DEBUG] [LOCAL ] NMCO: Primary data saved (16803 records). [2025-09-26T20:19:57.490171] [INFO ] [MAIN ] NMCO: Full history saved. [2025-09-26T20:19:57.490701] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-26T20:19:57.494700] [INFO ] [MAIN ] Update Progress: 1495/2371 symbols completed. NMCO took 23.7s. Estimated remaining: 1h 57m 8s. Rate: 7.5 symbols/min [2025-09-26T20:19:57.516816] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-09. [2025-09-26T20:19:57.676187] [INFO ] [MAIN ] NMG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:19:57.687044] [DEBUG] [LOCAL ] NMG: Loaded 7841 existing records from primary storage. [2025-09-26T20:19:57.687195] [INFO ] [MAIN ] NMG: Loaded 7841 existing records. [2025-09-26T20:19:57.896615] [WARN ] [MAIN ] NMG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:19:57.897101] [INFO ] [MAIN ] NMG: Wiping existing primary data before full refresh. [2025-09-26T20:19:57.897154] [INFO ] [LOCAL ] NMG: Starting deletion of primary data. [2025-09-26T20:19:57.897457] [DEBUG] [LOCAL ] NMG: Deleted primary data file. [2025-09-26T20:19:57.897517] [INFO ] [MAIN ] NMG: Starting full primary refresh. [2025-09-26T20:19:58.284734] [INFO ] [REMOTE ] NMG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:19:58.311724] [INFO ] [REMOTE ] NMG: Fetching primary data for 2024-12. [2025-09-26T20:19:59.111707] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-09. [2025-09-26T20:19:59.308708] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-26T20:19:59.336549] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-26T20:19:59.344941] [INFO ] [REMOTE ] NMAX: Full fetch complete (40767 records). [2025-09-26T20:19:59.345077] [DEBUG] [VALIDATOR ] NMAX: Validating primary data. [2025-09-26T20:19:59.562177] [WARN ] [VALIDATOR ] NMAX: Validation failed - insufficient historical data. Have 125 unique days, need 200 days [2025-09-26T20:19:59.562854] [FATAL] [MAIN ] NMAX: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:19:59.562932] [WARN ] [MAIN ] NMAX: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:19:59.563005] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-09-26T20:19:59.563082] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-09-26T20:19:59.563120] [INFO ] [LOCAL ] NMAX: Starting deletion of derivative data. [2025-09-26T20:19:59.563161] [DEBUG] [LOCAL ] NMAX: No derivative data file found to delete. [2025-09-26T20:19:59.563250] [INFO ] [MAIN ] Update Progress: 1496/2371 symbols completed. NMAX took 28.6s. Estimated remaining: 1h 56m 57s. Rate: 7.5 symbols/min [2025-09-26T20:19:59.752598] [INFO ] [MAIN ] NMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:19:59.759630] [DEBUG] [LOCAL ] NMI: Loaded 4078 existing records from primary storage. [2025-09-26T20:19:59.759772] [INFO ] [MAIN ] NMI: Loaded 4078 existing records. [2025-09-26T20:19:59.917097] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-01. [2025-09-26T20:19:59.963673] [WARN ] [MAIN ] NMI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:19:59.964257] [INFO ] [MAIN ] NMI: Wiping existing primary data before full refresh. [2025-09-26T20:19:59.964333] [INFO ] [LOCAL ] NMI: Starting deletion of primary data. [2025-09-26T20:19:59.964617] [DEBUG] [LOCAL ] NMI: Deleted primary data file. [2025-09-26T20:19:59.964719] [INFO ] [MAIN ] NMI: Starting full primary refresh. [2025-09-26T20:20:00.352188] [INFO ] [REMOTE ] NMI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:20:00.711683] [INFO ] [REMOTE ] NMI: Fetching primary data for 2024-12. [2025-09-26T20:20:01.153980] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-26T20:20:01.164528] [INFO ] [REMOTE ] NLY: Full fetch complete (77563 records). [2025-09-26T20:20:01.164717] [DEBUG] [VALIDATOR ] NLY: Validating primary data. [2025-09-26T20:20:01.386462] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-26T20:20:01.517923] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-02. [2025-09-26T20:20:01.561098] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-26T20:20:01.693233] [DEBUG] [VALIDATOR ] NLY: All expected trading days are present. [2025-09-26T20:20:01.693341] [DEBUG] [VALIDATOR ] NLY: Primary data validation passed. [2025-09-26T20:20:01.694825] [INFO ] [MAIN ] NLY: Fetched primary data is valid. [2025-09-26T20:20:01.694906] [DEBUG] [LOCAL ] NLY: Saving primary data. [2025-09-26T20:20:01.699482] [DEBUG] [LOCAL ] NLY: Trimmed 77563 records to 54358 (keeping 200 days of data) [2025-09-26T20:20:02.061398] [DEBUG] [LOCAL ] NLY: Primary data saved (54358 records). [2025-09-26T20:20:02.061557] [INFO ] [MAIN ] NLY: Full history saved. [2025-09-26T20:20:02.061693] [INFO ] [MAIN ] Update Progress: 1497/2371 symbols completed. NLY took 43.7s. Estimated remaining: 1h 56m 45s. Rate: 7.5 symbols/min [2025-09-26T20:20:02.245052] [INFO ] [MAIN ] NMM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:20:02.261370] [DEBUG] [LOCAL ] NMM: Loaded 14402 existing records from primary storage. [2025-09-26T20:20:02.261539] [INFO ] [MAIN ] NMM: Loaded 14402 existing records. [2025-09-26T20:20:02.322244] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-01. [2025-09-26T20:20:02.468197] [WARN ] [MAIN ] NMM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:20:02.468744] [INFO ] [MAIN ] NMM: Wiping existing primary data before full refresh. [2025-09-26T20:20:02.468810] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-09-26T20:20:02.469278] [DEBUG] [LOCAL ] NMM: Deleted primary data file. [2025-09-26T20:20:02.469347] [INFO ] [MAIN ] NMM: Starting full primary refresh. [2025-09-26T20:20:02.563926] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-26T20:20:02.871735] [INFO ] [REMOTE ] NMM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:20:03.010093] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-26T20:20:03.111723] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-03. [2025-09-26T20:20:03.872713] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-26T20:20:03.911714] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-04. [2025-09-26T20:20:04.711740] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-08. [2025-09-26T20:20:04.771836] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-26T20:20:05.511721] [INFO ] [REMOTE ] NMM: Fetching primary data for 2024-12. [2025-09-26T20:20:05.709687] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-26T20:20:06.311721] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-09. [2025-09-26T20:20:06.603239] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-26T20:20:07.111697] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-01. [2025-09-26T20:20:07.266711] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-26T20:20:07.270203] [INFO ] [REMOTE ] NMAI: Full fetch complete (19982 records). [2025-09-26T20:20:07.270295] [DEBUG] [VALIDATOR ] NMAI: Validating primary data. [2025-09-26T20:20:07.699380] [DEBUG] [VALIDATOR ] NMAI: All expected trading days are present. [2025-09-26T20:20:07.699465] [DEBUG] [VALIDATOR ] NMAI: Primary data validation passed. [2025-09-26T20:20:07.699963] [INFO ] [MAIN ] NMAI: Fetched primary data is valid. [2025-09-26T20:20:07.700026] [DEBUG] [LOCAL ] NMAI: Saving primary data. [2025-09-26T20:20:07.700762] [DEBUG] [LOCAL ] NMAI: Trimmed 19982 records to 13181 (keeping 200 days of data) [2025-09-26T20:20:07.785738] [DEBUG] [LOCAL ] NMAI: Primary data saved (13181 records). [2025-09-26T20:20:07.785898] [INFO ] [MAIN ] NMAI: Full history saved. [2025-09-26T20:20:07.786007] [INFO ] [MAIN ] Update Progress: 1498/2371 symbols completed. NMAI took 43.1s. Estimated remaining: 1h 56m 36s. Rate: 7.5 symbols/min [2025-09-26T20:20:07.916963] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-02. [2025-09-26T20:20:07.979228] [INFO ] [MAIN ] NMR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:20:08.026419] [DEBUG] [LOCAL ] NMR: Loaded 35332 existing records from primary storage. [2025-09-26T20:20:08.026568] [INFO ] [MAIN ] NMR: Loaded 35332 existing records. [2025-09-26T20:20:08.225757] [WARN ] [MAIN ] NMR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:20:08.226340] [INFO ] [MAIN ] NMR: Wiping existing primary data before full refresh. [2025-09-26T20:20:08.226402] [INFO ] [LOCAL ] NMR: Starting deletion of primary data. [2025-09-26T20:20:08.227488] [DEBUG] [LOCAL ] NMR: Deleted primary data file. [2025-09-26T20:20:08.227552] [INFO ] [MAIN ] NMR: Starting full primary refresh. [2025-09-26T20:20:08.393352] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-26T20:20:08.666598] [INFO ] [REMOTE ] NMR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:20:08.714212] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-05. [2025-09-26T20:20:08.717512] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-26T20:20:09.430292] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-26T20:20:09.511726] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-03. [2025-09-26T20:20:10.225214] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-26T20:20:10.311760] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-04. [2025-09-26T20:20:10.981241] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-26T20:20:11.111739] [INFO ] [REMOTE ] NMR: Fetching primary data for 2024-12. [2025-09-26T20:20:11.911726] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-02. [2025-09-26T20:20:12.417454] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-26T20:20:12.711743] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-01. [2025-09-26T20:20:13.176094] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-26T20:20:13.511722] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-06. [2025-09-26T20:20:14.212515] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-26T20:20:14.265965] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-26T20:20:14.311742] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-05. [2025-09-26T20:20:14.941411] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-26T20:20:15.111716] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-07. [2025-09-26T20:20:15.911709] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-03. [2025-09-26T20:20:16.059431] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-26T20:20:16.711753] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-06. [2025-09-26T20:20:16.926703] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-26T20:20:17.326020] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-26T20:20:17.511745] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-08. [2025-09-26T20:20:18.311699] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-02. [2025-09-26T20:20:18.376987] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-26T20:20:19.111746] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-04. [2025-09-26T20:20:19.640210] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-26T20:20:19.911737] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-09. [2025-09-26T20:20:20.372194] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-26T20:20:20.714411] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-05. [2025-09-26T20:20:20.718103] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-26T20:20:20.721433] [INFO ] [REMOTE ] NMG: Full fetch complete (13076 records). [2025-09-26T20:20:20.721537] [DEBUG] [VALIDATOR ] NMG: Validating primary data. [2025-09-26T20:20:21.121932] [DEBUG] [VALIDATOR ] NMG: All expected trading days are present. [2025-09-26T20:20:21.122020] [DEBUG] [VALIDATOR ] NMG: Primary data validation passed. [2025-09-26T20:20:21.122322] [INFO ] [MAIN ] NMG: Fetched primary data is valid. [2025-09-26T20:20:21.122371] [DEBUG] [LOCAL ] NMG: Saving primary data. [2025-09-26T20:20:21.122948] [DEBUG] [LOCAL ] NMG: Trimmed 13076 records to 7913 (keeping 200 days of data) [2025-09-26T20:20:21.170287] [DEBUG] [LOCAL ] NMG: Primary data saved (7913 records). [2025-09-26T20:20:21.170467] [INFO ] [MAIN ] NMG: Full history saved. [2025-09-26T20:20:21.170590] [INFO ] [MAIN ] Update Progress: 1499/2371 symbols completed. NMG took 23.7s. Estimated remaining: 1h 56m 31s. Rate: 7.5 symbols/min [2025-09-26T20:20:21.350032] [INFO ] [MAIN ] NMS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:20:21.355535] [DEBUG] [LOCAL ] NMS: Loaded 2889 existing records from primary storage. [2025-09-26T20:20:21.355671] [INFO ] [MAIN ] NMS: Loaded 2889 existing records. [2025-09-26T20:20:21.521506] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-07. [2025-09-26T20:20:21.556302] [WARN ] [MAIN ] NMS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:20:21.557835] [INFO ] [MAIN ] NMS: Wiping existing primary data before full refresh. [2025-09-26T20:20:21.557926] [INFO ] [LOCAL ] NMS: Starting deletion of primary data. [2025-09-26T20:20:21.558210] [DEBUG] [LOCAL ] NMS: Deleted primary data file. [2025-09-26T20:20:21.558293] [INFO ] [MAIN ] NMS: Starting full primary refresh. [2025-09-26T20:20:21.846385] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-26T20:20:21.978614] [INFO ] [REMOTE ] NMS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:20:22.311710] [INFO ] [REMOTE ] NMS: Fetching primary data for 2024-12. [2025-09-26T20:20:22.325479] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-26T20:20:22.843159] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-26T20:20:23.111730] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-06. [2025-09-26T20:20:23.911705] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-03. [2025-09-26T20:20:24.055839] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-26T20:20:24.711722] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-08. [2025-09-26T20:20:25.434406] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-26T20:20:25.435866] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-26T20:20:25.511755] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-01. [2025-09-26T20:20:26.030421] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-26T20:20:26.311723] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-02. [2025-09-26T20:20:26.981387] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-26T20:20:27.111803] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-04. [2025-09-26T20:20:27.911739] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-07. [2025-09-26T20:20:28.711690] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-03. [2025-09-26T20:20:28.807034] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-26T20:20:28.825535] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-26T20:20:29.212586] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-26T20:20:29.511756] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-05. [2025-09-26T20:20:30.311727] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-09. [2025-09-26T20:20:30.941522] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-26T20:20:30.955881] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-26T20:20:30.957535] [INFO ] [REMOTE ] NMI: Full fetch complete (6179 records). [2025-09-26T20:20:30.957609] [DEBUG] [VALIDATOR ] NMI: Validating primary data. [2025-09-26T20:20:31.116823] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-08. [2025-09-26T20:20:31.355065] [DEBUG] [VALIDATOR ] NMI: All expected trading days are present. [2025-09-26T20:20:31.355171] [DEBUG] [VALIDATOR ] NMI: Primary data validation passed. [2025-09-26T20:20:31.355357] [INFO ] [MAIN ] NMI: Fetched primary data is valid. [2025-09-26T20:20:31.355398] [DEBUG] [LOCAL ] NMI: Saving primary data. [2025-09-26T20:20:31.355890] [DEBUG] [LOCAL ] NMI: Trimmed 6179 records to 4091 (keeping 200 days of data) [2025-09-26T20:20:31.382086] [DEBUG] [LOCAL ] NMI: Primary data saved (4091 records). [2025-09-26T20:20:31.382183] [INFO ] [MAIN ] NMI: Full history saved. [2025-09-26T20:20:31.382287] [INFO ] [MAIN ] Update Progress: 1500/2371 symbols completed. NMI took 31.8s. Estimated remaining: 1h 56m 24s. Rate: 7.5 symbols/min [2025-09-26T20:20:31.567845] [INFO ] [MAIN ] NMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:20:31.573705] [DEBUG] [LOCAL ] NMT: Loaded 2867 existing records from primary storage. [2025-09-26T20:20:31.573821] [INFO ] [MAIN ] NMT: Loaded 2867 existing records. [2025-09-26T20:20:31.808959] [WARN ] [MAIN ] NMT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:20:31.809567] [INFO ] [MAIN ] NMT: Wiping existing primary data before full refresh. [2025-09-26T20:20:31.809626] [INFO ] [LOCAL ] NMT: Starting deletion of primary data. [2025-09-26T20:20:31.810009] [DEBUG] [LOCAL ] NMT: Deleted primary data file. [2025-09-26T20:20:31.810070] [INFO ] [MAIN ] NMT: Starting full primary refresh. [2025-09-26T20:20:31.921063] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-06. [2025-09-26T20:20:32.216566] [INFO ] [REMOTE ] NMT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:20:32.311166] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-26T20:20:32.711725] [INFO ] [REMOTE ] NMT: Fetching primary data for 2024-12. [2025-09-26T20:20:33.228994] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-26T20:20:33.383940] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-26T20:20:33.511750] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-01. [2025-09-26T20:20:34.091850] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-26T20:20:34.311768] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-07. [2025-09-26T20:20:35.111722] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-04. [2025-09-26T20:20:35.659160] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-26T20:20:35.911727] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-02. [2025-09-26T20:20:35.980626] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-26T20:20:36.361510] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-26T20:20:36.711750] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-03. [2025-09-26T20:20:37.294313] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-26T20:20:37.511742] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-05. [2025-09-26T20:20:38.138637] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-26T20:20:38.311733] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-09. [2025-09-26T20:20:39.111732] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-08. [2025-09-26T20:20:39.208933] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-26T20:20:39.212202] [INFO ] [REMOTE ] NMM: Full fetch complete (22159 records). [2025-09-26T20:20:39.212302] [DEBUG] [VALIDATOR ] NMM: Validating primary data. [2025-09-26T20:20:39.631172] [DEBUG] [VALIDATOR ] NMM: All expected trading days are present. [2025-09-26T20:20:39.631261] [DEBUG] [VALIDATOR ] NMM: Primary data validation passed. [2025-09-26T20:20:39.631779] [INFO ] [MAIN ] NMM: Fetched primary data is valid. [2025-09-26T20:20:39.631848] [DEBUG] [LOCAL ] NMM: Saving primary data. [2025-09-26T20:20:39.632456] [DEBUG] [LOCAL ] NMM: Trimmed 22159 records to 14470 (keeping 200 days of data) [2025-09-26T20:20:39.727855] [DEBUG] [LOCAL ] NMM: Primary data saved (14470 records). [2025-09-26T20:20:39.728063] [INFO ] [MAIN ] NMM: Full history saved. [2025-09-26T20:20:39.728234] [INFO ] [MAIN ] Update Progress: 1501/2371 symbols completed. NMM took 37.7s. Estimated remaining: 1h 56m 17s. Rate: 7.5 symbols/min [2025-09-26T20:20:39.955703] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-06. [2025-09-26T20:20:39.958555] [INFO ] [MAIN ] NMZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:20:39.983453] [DEBUG] [LOCAL ] NMZ: Loaded 21768 existing records from primary storage. [2025-09-26T20:20:39.983635] [INFO ] [MAIN ] NMZ: Loaded 21768 existing records. [2025-09-26T20:20:40.173512] [WARN ] [MAIN ] NMZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:20:40.173783] [INFO ] [MAIN ] NMZ: Wiping existing primary data before full refresh. [2025-09-26T20:20:40.173840] [INFO ] [LOCAL ] NMZ: Starting deletion of primary data. [2025-09-26T20:20:40.174572] [DEBUG] [LOCAL ] NMZ: Deleted primary data file. [2025-09-26T20:20:40.174635] [INFO ] [MAIN ] NMZ: Starting full primary refresh. [2025-09-26T20:20:40.563450] [INFO ] [REMOTE ] NMZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:20:40.590017] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-26T20:20:40.651705] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-26T20:20:40.711726] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-04. [2025-09-26T20:20:41.334563] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-26T20:20:41.511722] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-07. [2025-09-26T20:20:42.017443] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-26T20:20:42.311753] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2024-12. [2025-09-26T20:20:43.111716] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-05. [2025-09-26T20:20:43.686751] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-26T20:20:43.771167] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-26T20:20:43.911723] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-09. [2025-09-26T20:20:44.711721] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-08. [2025-09-26T20:20:45.266026] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-26T20:20:45.268680] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-26T20:20:45.278314] [INFO ] [REMOTE ] NMR: Full fetch complete (50335 records). [2025-09-26T20:20:45.278432] [DEBUG] [VALIDATOR ] NMR: Validating primary data. [2025-09-26T20:20:45.516912] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-06. [2025-09-26T20:20:45.691058] [DEBUG] [VALIDATOR ] NMR: All expected trading days are present. [2025-09-26T20:20:45.691153] [DEBUG] [VALIDATOR ] NMR: Primary data validation passed. [2025-09-26T20:20:45.691960] [INFO ] [MAIN ] NMR: Fetched primary data is valid. [2025-09-26T20:20:45.692031] [DEBUG] [LOCAL ] NMR: Saving primary data. [2025-09-26T20:20:45.693303] [DEBUG] [LOCAL ] NMR: Trimmed 50335 records to 35569 (keeping 200 days of data) [2025-09-26T20:20:45.907750] [DEBUG] [LOCAL ] NMR: Primary data saved (35569 records). [2025-09-26T20:20:45.907899] [INFO ] [MAIN ] NMR: Full history saved. [2025-09-26T20:20:45.908015] [INFO ] [MAIN ] Update Progress: 1502/2371 symbols completed. NMR took 38.1s. Estimated remaining: 1h 56m 8s. Rate: 7.5 symbols/min [2025-09-26T20:20:46.102152] [INFO ] [MAIN ] NNI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:20:46.116485] [DEBUG] [LOCAL ] NNI: Loaded 10071 existing records from primary storage. [2025-09-26T20:20:46.116628] [INFO ] [MAIN ] NNI: Loaded 10071 existing records. [2025-09-26T20:20:46.243067] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-26T20:20:46.313843] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-01. [2025-09-26T20:20:46.341136] [WARN ] [MAIN ] NNI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:20:46.341441] [INFO ] [MAIN ] NNI: Wiping existing primary data before full refresh. [2025-09-26T20:20:46.341494] [INFO ] [LOCAL ] NNI: Starting deletion of primary data. [2025-09-26T20:20:46.342018] [DEBUG] [LOCAL ] NNI: Deleted primary data file. [2025-09-26T20:20:46.342082] [INFO ] [MAIN ] NNI: Starting full primary refresh. [2025-09-26T20:20:46.741313] [INFO ] [REMOTE ] NNI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:20:47.111717] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-07. [2025-09-26T20:20:47.483214] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-26T20:20:47.653344] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-26T20:20:47.911733] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-08. [2025-09-26T20:20:48.576689] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-26T20:20:48.711725] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-09. [2025-09-26T20:20:49.260409] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-26T20:20:49.261735] [INFO ] [REMOTE ] NMT: Full fetch complete (4213 records). [2025-09-26T20:20:49.261820] [DEBUG] [VALIDATOR ] NMT: Validating primary data. [2025-09-26T20:20:49.516831] [INFO ] [REMOTE ] NNI: Fetching primary data for 2024-12. [2025-09-26T20:20:49.681912] [DEBUG] [VALIDATOR ] NMT: All expected trading days are present. [2025-09-26T20:20:49.682001] [DEBUG] [VALIDATOR ] NMT: Primary data validation passed. [2025-09-26T20:20:49.682183] [INFO ] [MAIN ] NMT: Fetched primary data is valid. [2025-09-26T20:20:49.682224] [DEBUG] [LOCAL ] NMT: Saving primary data. [2025-09-26T20:20:49.682613] [DEBUG] [LOCAL ] NMT: Trimmed 4213 records to 2884 (keeping 200 days of data) [2025-09-26T20:20:49.701394] [DEBUG] [LOCAL ] NMT: Primary data saved (2884 records). [2025-09-26T20:20:49.701513] [INFO ] [MAIN ] NMT: Full history saved. [2025-09-26T20:20:49.701602] [INFO ] [MAIN ] Update Progress: 1503/2371 symbols completed. NMT took 18.3s. Estimated remaining: 1h 55m 57s. Rate: 7.5 symbols/min [2025-09-26T20:20:49.894680] [INFO ] [MAIN ] NNN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:20:49.963349] [DEBUG] [LOCAL ] NNN: Loaded 48783 existing records from primary storage. [2025-09-26T20:20:49.963570] [INFO ] [MAIN ] NNN: Loaded 48783 existing records. [2025-09-26T20:20:50.158051] [WARN ] [MAIN ] NNN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:20:50.158351] [INFO ] [MAIN ] NNN: Wiping existing primary data before full refresh. [2025-09-26T20:20:50.158415] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-09-26T20:20:50.159913] [DEBUG] [LOCAL ] NNN: Deleted primary data file. [2025-09-26T20:20:50.159985] [INFO ] [MAIN ] NNN: Starting full primary refresh. [2025-09-26T20:20:50.319914] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-09. [2025-09-26T20:20:50.453224] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-26T20:20:50.559226] [INFO ] [REMOTE ] NNN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:20:51.020593] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-26T20:20:51.021868] [INFO ] [REMOTE ] NMS: Full fetch complete (4033 records). [2025-09-26T20:20:51.021945] [DEBUG] [VALIDATOR ] NMS: Validating primary data. [2025-09-26T20:20:51.116839] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-01. [2025-09-26T20:20:51.413198] [DEBUG] [VALIDATOR ] NMS: All expected trading days are present. [2025-09-26T20:20:51.413280] [DEBUG] [VALIDATOR ] NMS: Primary data validation passed. [2025-09-26T20:20:51.413408] [INFO ] [MAIN ] NMS: Fetched primary data is valid. [2025-09-26T20:20:51.413446] [DEBUG] [LOCAL ] NMS: Saving primary data. [2025-09-26T20:20:51.413924] [DEBUG] [LOCAL ] NMS: Trimmed 4033 records to 2893 (keeping 200 days of data) [2025-09-26T20:20:51.432464] [DEBUG] [LOCAL ] NMS: Primary data saved (2893 records). [2025-09-26T20:20:51.432576] [INFO ] [MAIN ] NMS: Full history saved. [2025-09-26T20:20:51.432683] [INFO ] [MAIN ] Update Progress: 1504/2371 symbols completed. NMS took 30.3s. Estimated remaining: 1h 55m 45s. Rate: 7.5 symbols/min [2025-09-26T20:20:51.613846] [INFO ] [MAIN ] NNY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:20:51.621518] [DEBUG] [LOCAL ] NNY: Loaded 5728 existing records from primary storage. [2025-09-26T20:20:51.621621] [INFO ] [MAIN ] NNY: Loaded 5728 existing records. [2025-09-26T20:20:51.821372] [WARN ] [MAIN ] NNY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:20:51.821903] [INFO ] [MAIN ] NNY: Wiping existing primary data before full refresh. [2025-09-26T20:20:51.821989] [INFO ] [LOCAL ] NNY: Starting deletion of primary data. [2025-09-26T20:20:51.822343] [DEBUG] [LOCAL ] NNY: Deleted primary data file. [2025-09-26T20:20:51.822409] [INFO ] [MAIN ] NNY: Starting full primary refresh. [2025-09-26T20:20:51.916779] [INFO ] [REMOTE ] NNN: Fetching primary data for 2024-12. [2025-09-26T20:20:51.943433] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-26T20:20:52.234540] [INFO ] [REMOTE ] NNY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:20:52.711731] [INFO ] [REMOTE ] NNY: Fetching primary data for 2024-12. [2025-09-26T20:20:53.511732] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-02. [2025-09-26T20:20:53.651881] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-26T20:20:53.652783] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-26T20:20:54.239918] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-26T20:20:54.311805] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-03. [2025-09-26T20:20:55.093593] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-26T20:20:55.111671] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-04. [2025-09-26T20:20:55.911709] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-02. [2025-09-26T20:20:55.932910] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-26T20:20:56.711744] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-01. [2025-09-26T20:20:57.098939] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-26T20:20:57.374551] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-26T20:20:57.511729] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-03. [2025-09-26T20:20:58.311732] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-01. [2025-09-26T20:20:58.704961] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-26T20:20:59.111748] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-04. [2025-09-26T20:20:59.911719] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-02. [2025-09-26T20:21:00.043735] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-26T20:21:00.108758] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-26T20:21:00.672557] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-26T20:21:00.711759] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-03. [2025-09-26T20:21:01.487295] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-26T20:21:01.511758] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-05. [2025-09-26T20:21:02.311717] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-02. [2025-09-26T20:21:02.476728] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-26T20:21:03.111724] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-06. [2025-09-26T20:21:03.908966] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-26T20:21:03.917821] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-04. [2025-09-26T20:21:04.091698] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-26T20:21:04.711762] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-03. [2025-09-26T20:21:04.816979] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-26T20:21:05.511779] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-07. [2025-09-26T20:21:06.311741] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-05. [2025-09-26T20:21:06.457501] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-26T20:21:06.682618] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-26T20:21:07.111703] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-05. [2025-09-26T20:21:07.461942] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-26T20:21:07.896806] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-26T20:21:07.911669] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-06. [2025-09-26T20:21:08.671391] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-26T20:21:08.711724] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-04. [2025-09-26T20:21:09.511751] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-08. [2025-09-26T20:21:10.311730] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-06. [2025-09-26T20:21:10.507490] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-26T20:21:10.512980] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-26T20:21:11.111727] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-05. [2025-09-26T20:21:11.460184] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-26T20:21:11.911746] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-07. [2025-09-26T20:21:12.711691] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-09. [2025-09-26T20:21:12.883717] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-26T20:21:13.018385] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-26T20:21:13.511717] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-08. [2025-09-26T20:21:13.784606] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-26T20:21:13.788345] [INFO ] [REMOTE ] NNI: Full fetch complete (12729 records). [2025-09-26T20:21:13.788503] [DEBUG] [VALIDATOR ] NNI: Validating primary data. [2025-09-26T20:21:14.183921] [DEBUG] [VALIDATOR ] NNI: All expected trading days are present. [2025-09-26T20:21:14.184006] [DEBUG] [VALIDATOR ] NNI: Primary data validation passed. [2025-09-26T20:21:14.184346] [INFO ] [MAIN ] NNI: Fetched primary data is valid. [2025-09-26T20:21:14.184426] [DEBUG] [LOCAL ] NNI: Saving primary data. [2025-09-26T20:21:14.185147] [DEBUG] [LOCAL ] NNI: Trimmed 12729 records to 10159 (keeping 200 days of data) [2025-09-26T20:21:14.253695] [DEBUG] [LOCAL ] NNI: Primary data saved (10159 records). [2025-09-26T20:21:14.253854] [INFO ] [MAIN ] NNI: Full history saved. [2025-09-26T20:21:14.253969] [INFO ] [MAIN ] Update Progress: 1505/2371 symbols completed. NNI took 28.3s. Estimated remaining: 1h 55m 46s. Rate: 7.5 symbols/min [2025-09-26T20:21:14.314945] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-07. [2025-09-26T20:21:14.485226] [INFO ] [MAIN ] NOA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:21:14.507492] [DEBUG] [LOCAL ] NOA: Loaded 16401 existing records from primary storage. [2025-09-26T20:21:14.507690] [INFO ] [MAIN ] NOA: Loaded 16401 existing records. [2025-09-26T20:21:14.698480] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-26T20:21:14.726216] [WARN ] [MAIN ] NOA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:21:14.732276] [INFO ] [MAIN ] NOA: Wiping existing primary data before full refresh. [2025-09-26T20:21:14.732384] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-09-26T20:21:14.733043] [DEBUG] [LOCAL ] NOA: Deleted primary data file. [2025-09-26T20:21:14.733131] [INFO ] [MAIN ] NOA: Starting full primary refresh. [2025-09-26T20:21:15.116775] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-06. [2025-09-26T20:21:15.120683] [INFO ] [REMOTE ] NOA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:21:15.228102] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-26T20:21:15.911739] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-09. [2025-09-26T20:21:16.711717] [INFO ] [REMOTE ] NOA: Fetching primary data for 2024-12. [2025-09-26T20:21:16.775797] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-26T20:21:17.114702] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-26T20:21:17.120174] [INFO ] [REMOTE ] NMZ: Full fetch complete (31929 records). [2025-09-26T20:21:17.120414] [DEBUG] [VALIDATOR ] NMZ: Validating primary data. [2025-09-26T20:21:17.517970] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-08. [2025-09-26T20:21:17.567228] [DEBUG] [VALIDATOR ] NMZ: All expected trading days are present. [2025-09-26T20:21:17.576803] [DEBUG] [VALIDATOR ] NMZ: Primary data validation passed. [2025-09-26T20:21:17.578468] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-26T20:21:17.580431] [INFO ] [MAIN ] NMZ: Fetched primary data is valid. [2025-09-26T20:21:17.580603] [DEBUG] [LOCAL ] NMZ: Saving primary data. [2025-09-26T20:21:17.586076] [DEBUG] [LOCAL ] NMZ: Trimmed 31929 records to 21872 (keeping 200 days of data) [2025-09-26T20:21:17.730051] [DEBUG] [LOCAL ] NMZ: Primary data saved (21872 records). [2025-09-26T20:21:17.730193] [INFO ] [MAIN ] NMZ: Full history saved. [2025-09-26T20:21:17.730283] [INFO ] [MAIN ] Update Progress: 1506/2371 symbols completed. NMZ took 38.0s. Estimated remaining: 1h 55m 35s. Rate: 7.5 symbols/min [2025-09-26T20:21:17.910114] [INFO ] [MAIN ] NOAH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:21:17.932669] [DEBUG] [LOCAL ] NOAH: Loaded 20272 existing records from primary storage. [2025-09-26T20:21:17.932819] [INFO ] [MAIN ] NOAH: Loaded 20272 existing records. [2025-09-26T20:21:18.140537] [WARN ] [MAIN ] NOAH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:21:18.140820] [INFO ] [MAIN ] NOAH: Wiping existing primary data before full refresh. [2025-09-26T20:21:18.140870] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-09-26T20:21:18.143103] [DEBUG] [LOCAL ] NOAH: Deleted primary data file. [2025-09-26T20:21:18.143168] [INFO ] [MAIN ] NOAH: Starting full primary refresh. [2025-09-26T20:21:18.322487] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-01. [2025-09-26T20:21:18.419107] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-26T20:21:18.532951] [INFO ] [REMOTE ] NOAH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:21:19.111723] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-07. [2025-09-26T20:21:19.256830] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-26T20:21:19.911757] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2024-12. [2025-09-26T20:21:20.711747] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-02. [2025-09-26T20:21:21.245449] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-26T20:21:21.275854] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-26T20:21:21.358301] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-26T20:21:21.511777] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-09. [2025-09-26T20:21:22.190206] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-26T20:21:22.192216] [INFO ] [REMOTE ] NNY: Full fetch complete (8846 records). [2025-09-26T20:21:22.192302] [DEBUG] [VALIDATOR ] NNY: Validating primary data. [2025-09-26T20:21:22.316775] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-01. [2025-09-26T20:21:22.604027] [DEBUG] [VALIDATOR ] NNY: All expected trading days are present. [2025-09-26T20:21:22.604197] [DEBUG] [VALIDATOR ] NNY: Primary data validation passed. [2025-09-26T20:21:22.604461] [INFO ] [MAIN ] NNY: Fetched primary data is valid. [2025-09-26T20:21:22.604533] [DEBUG] [LOCAL ] NNY: Saving primary data. [2025-09-26T20:21:22.605084] [DEBUG] [LOCAL ] NNY: Trimmed 8846 records to 5750 (keeping 200 days of data) [2025-09-26T20:21:22.641049] [DEBUG] [LOCAL ] NNY: Primary data saved (5750 records). [2025-09-26T20:21:22.641201] [INFO ] [MAIN ] NNY: Full history saved. [2025-09-26T20:21:22.641295] [INFO ] [MAIN ] Update Progress: 1507/2371 symbols completed. NNY took 31.2s. Estimated remaining: 1h 55m 26s. Rate: 7.5 symbols/min [2025-09-26T20:21:22.838154] [INFO ] [MAIN ] NOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:21:22.899709] [DEBUG] [LOCAL ] NOC: Loaded 42916 existing records from primary storage. [2025-09-26T20:21:22.899857] [INFO ] [MAIN ] NOC: Loaded 42916 existing records. [2025-09-26T20:21:23.107427] [WARN ] [MAIN ] NOC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:21:23.107793] [INFO ] [MAIN ] NOC: Wiping existing primary data before full refresh. [2025-09-26T20:21:23.107850] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-09-26T20:21:23.109525] [DEBUG] [LOCAL ] NOC: Deleted primary data file. [2025-09-26T20:21:23.109606] [INFO ] [MAIN ] NOC: Starting full primary refresh. [2025-09-26T20:21:23.121790] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-03. [2025-09-26T20:21:23.465547] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-26T20:21:23.551266] [INFO ] [REMOTE ] NOC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:21:23.911694] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-08. [2025-09-26T20:21:24.005187] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-26T20:21:24.711729] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-02. [2025-09-26T20:21:25.511717] [INFO ] [REMOTE ] NOC: Fetching primary data for 2024-12. [2025-09-26T20:21:25.699420] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-26T20:21:25.762246] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-26T20:21:26.311737] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-03. [2025-09-26T20:21:27.111684] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-09. [2025-09-26T20:21:27.215994] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-26T20:21:27.385241] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-26T20:21:27.911733] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-01. [2025-09-26T20:21:28.681786] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-26T20:21:28.691954] [INFO ] [REMOTE ] NNN: Full fetch complete (70252 records). [2025-09-26T20:21:28.692111] [DEBUG] [VALIDATOR ] NNN: Validating primary data. [2025-09-26T20:21:28.716835] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-04. [2025-09-26T20:21:29.139153] [DEBUG] [VALIDATOR ] NNN: All expected trading days are present. [2025-09-26T20:21:29.139296] [DEBUG] [VALIDATOR ] NNN: Primary data validation passed. [2025-09-26T20:21:29.140341] [INFO ] [MAIN ] NNN: Fetched primary data is valid. [2025-09-26T20:21:29.140448] [DEBUG] [LOCAL ] NNN: Saving primary data. [2025-09-26T20:21:29.150465] [DEBUG] [LOCAL ] NNN: Trimmed 70252 records to 49151 (keeping 200 days of data) [2025-09-26T20:21:29.478319] [DEBUG] [LOCAL ] NNN: Primary data saved (49151 records). [2025-09-26T20:21:29.478497] [INFO ] [MAIN ] NNN: Full history saved. [2025-09-26T20:21:29.478721] [INFO ] [MAIN ] Update Progress: 1508/2371 symbols completed. NNN took 39.8s. Estimated remaining: 1h 55m 17s. Rate: 7.5 symbols/min [2025-09-26T20:21:29.513226] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-04. [2025-09-26T20:21:29.687335] [INFO ] [MAIN ] NOG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:21:29.756955] [DEBUG] [LOCAL ] NOG: Loaded 51547 existing records from primary storage. [2025-09-26T20:21:29.757515] [INFO ] [MAIN ] NOG: Loaded 51547 existing records. [2025-09-26T20:21:29.908818] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-26T20:21:29.993099] [WARN ] [MAIN ] NOG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:21:29.993847] [INFO ] [MAIN ] NOG: Wiping existing primary data before full refresh. [2025-09-26T20:21:29.999116] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-09-26T20:21:30.006055] [DEBUG] [LOCAL ] NOG: Deleted primary data file. [2025-09-26T20:21:30.006357] [INFO ] [MAIN ] NOG: Starting full primary refresh. [2025-09-26T20:21:30.012568] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-26T20:21:30.312962] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-02. [2025-09-26T20:21:30.396113] [INFO ] [REMOTE ] NOG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:21:30.548114] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-26T20:21:31.111721] [INFO ] [REMOTE ] NOG: Fetching primary data for 2024-12. [2025-09-26T20:21:31.911723] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-05. [2025-09-26T20:21:32.230210] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-26T20:21:32.697069] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-26T20:21:32.711667] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-01. [2025-09-26T20:21:32.834894] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-26T20:21:33.511760] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-06. [2025-09-26T20:21:34.311684] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-05. [2025-09-26T20:21:34.423288] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-26T20:21:34.762978] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-26T20:21:35.111721] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-03. [2025-09-26T20:21:35.612796] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-26T20:21:35.911720] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-02. [2025-09-26T20:21:36.662472] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T20:21:36.711705] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-04. [2025-09-26T20:21:37.511713] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-07. [2025-09-26T20:21:37.641363] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-26T20:21:38.311720] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-03. [2025-09-26T20:21:38.684758] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-26T20:21:38.846680] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-26T20:21:39.111716] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-06. [2025-09-26T20:21:39.911685] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-05. [2025-09-26T20:21:40.063922] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-26T20:21:40.147437] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-26T20:21:40.711727] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-08. [2025-09-26T20:21:41.511746] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-04. [2025-09-26T20:21:41.761353] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-26T20:21:41.818118] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-26T20:21:42.311754] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-09. [2025-09-26T20:21:43.111698] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-07. [2025-09-26T20:21:43.463146] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-26T20:21:43.506973] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-26T20:21:43.514541] [INFO ] [REMOTE ] NOAH: Full fetch complete (28758 records). [2025-09-26T20:21:43.514790] [DEBUG] [VALIDATOR ] NOAH: Validating primary data. [2025-09-26T20:21:43.934350] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-05. [2025-09-26T20:21:43.948881] [DEBUG] [VALIDATOR ] NOAH: All expected trading days are present. [2025-09-26T20:21:43.948987] [DEBUG] [VALIDATOR ] NOAH: Primary data validation passed. [2025-09-26T20:21:43.949681] [INFO ] [MAIN ] NOAH: Fetched primary data is valid. [2025-09-26T20:21:43.949756] [DEBUG] [LOCAL ] NOAH: Saving primary data. [2025-09-26T20:21:43.951231] [DEBUG] [LOCAL ] NOAH: Trimmed 28758 records to 20358 (keeping 200 days of data) [2025-09-26T20:21:44.060227] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-26T20:21:44.105246] [DEBUG] [LOCAL ] NOAH: Primary data saved (20358 records). [2025-09-26T20:21:44.105381] [INFO ] [MAIN ] NOAH: Full history saved. [2025-09-26T20:21:44.105477] [INFO ] [MAIN ] Update Progress: 1509/2371 symbols completed. NOAH took 26.4s. Estimated remaining: 1h 55m 13s. Rate: 7.5 symbols/min [2025-09-26T20:21:44.279873] [INFO ] [MAIN ] NOK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:21:44.355482] [DEBUG] [LOCAL ] NOK: Loaded 54011 existing records from primary storage. [2025-09-26T20:21:44.355694] [INFO ] [MAIN ] NOK: Loaded 54011 existing records. [2025-09-26T20:21:44.542045] [WARN ] [MAIN ] NOK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:21:44.542353] [INFO ] [MAIN ] NOK: Wiping existing primary data before full refresh. [2025-09-26T20:21:44.542400] [INFO ] [LOCAL ] NOK: Starting deletion of primary data. [2025-09-26T20:21:44.543768] [DEBUG] [LOCAL ] NOK: Deleted primary data file. [2025-09-26T20:21:44.543833] [INFO ] [MAIN ] NOK: Starting full primary refresh. [2025-09-26T20:21:44.723620] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-08. [2025-09-26T20:21:44.917710] [INFO ] [REMOTE ] NOK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:21:45.511697] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-06. [2025-09-26T20:21:45.664381] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-26T20:21:46.042372] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-26T20:21:46.311737] [INFO ] [REMOTE ] NOK: Fetching primary data for 2024-12. [2025-09-26T20:21:47.111739] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-06. [2025-09-26T20:21:47.232692] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-26T20:21:47.911721] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-09. [2025-09-26T20:21:48.539287] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-26T20:21:48.711734] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-07. [2025-09-26T20:21:48.852783] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-26T20:21:48.921059] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-26T20:21:48.924855] [INFO ] [REMOTE ] NOA: Full fetch complete (21842 records). [2025-09-26T20:21:48.924968] [DEBUG] [VALIDATOR ] NOA: Validating primary data. [2025-09-26T20:21:49.320779] [DEBUG] [VALIDATOR ] NOA: All expected trading days are present. [2025-09-26T20:21:49.320868] [DEBUG] [VALIDATOR ] NOA: Primary data validation passed. [2025-09-26T20:21:49.321412] [INFO ] [MAIN ] NOA: Fetched primary data is valid. [2025-09-26T20:21:49.321457] [DEBUG] [LOCAL ] NOA: Saving primary data. [2025-09-26T20:21:49.322144] [DEBUG] [LOCAL ] NOA: Trimmed 21842 records to 16497 (keeping 200 days of data) [2025-09-26T20:21:49.447334] [DEBUG] [LOCAL ] NOA: Primary data saved (16497 records). [2025-09-26T20:21:49.447514] [INFO ] [MAIN ] NOA: Full history saved. [2025-09-26T20:21:49.447694] [INFO ] [MAIN ] Update Progress: 1510/2371 symbols completed. NOA took 35.2s. Estimated remaining: 1h 55m 3s. Rate: 7.5 symbols/min [2025-09-26T20:21:49.516902] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-01. [2025-09-26T20:21:49.630112] [INFO ] [MAIN ] NOM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:21:49.630286] [DEBUG] [LOCAL ] NOM: No existing data file found in primary storage. [2025-09-26T20:21:49.630326] [WARN ] [MAIN ] NOM: No existing data found, performing full refresh instead. [2025-09-26T20:21:49.630475] [INFO ] [MAIN ] NOM: Wiping existing primary data before full refresh. [2025-09-26T20:21:49.630539] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-09-26T20:21:49.630610] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-09-26T20:21:49.630672] [INFO ] [MAIN ] NOM: Starting full primary refresh. [2025-09-26T20:21:50.026930] [INFO ] [REMOTE ] NOM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:21:50.311709] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-07. [2025-09-26T20:21:50.355128] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-26T20:21:51.111728] [INFO ] [REMOTE ] NOM: Fetching primary data for 2024-12. [2025-09-26T20:21:51.464077] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-26T20:21:51.743224] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-26T20:21:51.839878] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-26T20:21:51.911689] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-02. [2025-09-26T20:21:52.711771] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-08. [2025-09-26T20:21:53.511723] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-08. [2025-09-26T20:21:53.944382] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-26T20:21:54.311752] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-01. [2025-09-26T20:21:54.508393] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-26T20:21:54.702717] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-26T20:21:55.111708] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-02. [2025-09-26T20:21:55.242311] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-26T20:21:55.434421] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-26T20:21:55.911754] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-03. [2025-09-26T20:21:56.364012] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-26T20:21:56.711744] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-04. [2025-09-26T20:21:57.202691] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-26T20:21:57.511759] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-09. [2025-09-26T20:21:58.311743] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-03. [2025-09-26T20:21:59.111724] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-09. [2025-09-26T20:21:59.337804] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-26T20:21:59.348687] [INFO ] [REMOTE ] NOG: Full fetch complete (73713 records). [2025-09-26T20:21:59.348855] [DEBUG] [VALIDATOR ] NOG: Validating primary data. [2025-09-26T20:21:59.817819] [DEBUG] [VALIDATOR ] NOG: All expected trading days are present. [2025-09-26T20:21:59.817918] [DEBUG] [VALIDATOR ] NOG: Primary data validation passed. [2025-09-26T20:21:59.818926] [INFO ] [MAIN ] NOG: Fetched primary data is valid. [2025-09-26T20:21:59.818996] [DEBUG] [LOCAL ] NOG: Saving primary data. [2025-09-26T20:21:59.820611] [DEBUG] [LOCAL ] NOG: Trimmed 73713 records to 51932 (keeping 200 days of data) [2025-09-26T20:21:59.919325] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-05. [2025-09-26T20:22:00.175232] [DEBUG] [LOCAL ] NOG: Primary data saved (51932 records). [2025-09-26T20:22:00.175394] [INFO ] [MAIN ] NOG: Full history saved. [2025-09-26T20:22:00.175538] [INFO ] [MAIN ] Update Progress: 1511/2371 symbols completed. NOG took 30.7s. Estimated remaining: 1h 54m 57s. Rate: 7.5 symbols/min [2025-09-26T20:22:00.369139] [INFO ] [MAIN ] NOMD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:22:00.414254] [DEBUG] [LOCAL ] NOMD: Loaded 41665 existing records from primary storage. [2025-09-26T20:22:00.414407] [INFO ] [MAIN ] NOMD: Loaded 41665 existing records. [2025-09-26T20:22:00.495759] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-26T20:22:00.634015] [WARN ] [MAIN ] NOMD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:22:00.634496] [INFO ] [MAIN ] NOMD: Wiping existing primary data before full refresh. [2025-09-26T20:22:00.634583] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-09-26T20:22:00.635760] [DEBUG] [LOCAL ] NOMD: Deleted primary data file. [2025-09-26T20:22:00.635871] [INFO ] [MAIN ] NOMD: Starting full primary refresh. [2025-09-26T20:22:00.726948] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-06. [2025-09-26T20:22:00.800311] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-09-26T20:22:01.132532] [INFO ] [REMOTE ] NOMD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:22:01.154188] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-26T20:22:01.162469] [INFO ] [REMOTE ] NOC: Full fetch complete (62054 records). [2025-09-26T20:22:01.162713] [DEBUG] [VALIDATOR ] NOC: Validating primary data. [2025-09-26T20:22:01.246026] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-26T20:22:01.516863] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-07. [2025-09-26T20:22:01.659672] [DEBUG] [VALIDATOR ] NOC: All expected trading days are present. [2025-09-26T20:22:01.659782] [DEBUG] [VALIDATOR ] NOC: Primary data validation passed. [2025-09-26T20:22:01.660770] [INFO ] [MAIN ] NOC: Fetched primary data is valid. [2025-09-26T20:22:01.660840] [DEBUG] [LOCAL ] NOC: Saving primary data. [2025-09-26T20:22:01.664084] [DEBUG] [LOCAL ] NOC: Trimmed 62054 records to 43141 (keeping 200 days of data) [2025-09-26T20:22:01.975110] [DEBUG] [LOCAL ] NOC: Primary data saved (43141 records). [2025-09-26T20:22:01.975285] [INFO ] [MAIN ] NOC: Full history saved. [2025-09-26T20:22:01.975415] [INFO ] [MAIN ] Update Progress: 1512/2371 symbols completed. NOC took 39.3s. Estimated remaining: 1h 54m 45s. Rate: 7.5 symbols/min [2025-09-26T20:22:02.166920] [INFO ] [MAIN ] NOTE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:22:02.208181] [DEBUG] [LOCAL ] NOTE: Loaded 43022 existing records from primary storage. [2025-09-26T20:22:02.208365] [INFO ] [MAIN ] NOTE: Loaded 43022 existing records. [2025-09-26T20:22:02.300928] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-26T20:22:02.314587] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-04. [2025-09-26T20:22:02.419777] [WARN ] [MAIN ] NOTE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:22:02.420042] [INFO ] [MAIN ] NOTE: Wiping existing primary data before full refresh. [2025-09-26T20:22:02.420094] [INFO ] [LOCAL ] NOTE: Starting deletion of primary data. [2025-09-26T20:22:02.421069] [DEBUG] [LOCAL ] NOTE: Deleted primary data file. [2025-09-26T20:22:02.421133] [INFO ] [MAIN ] NOTE: Starting full primary refresh. [2025-09-26T20:22:02.806940] [INFO ] [REMOTE ] NOTE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:22:03.111719] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-08. [2025-09-26T20:22:03.628365] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-26T20:22:03.911726] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2024-12. [2025-09-26T20:22:04.588384] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-26T20:22:04.711741] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2024-12. [2025-09-26T20:22:05.511714] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-05. [2025-09-26T20:22:05.573634] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-26T20:22:06.311765] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-09. [2025-09-26T20:22:06.815825] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-26T20:22:06.816841] [INFO ] [REMOTE ] NOM: Full fetch complete (1626 records). [2025-09-26T20:22:06.816975] [DEBUG] [VALIDATOR ] NOM: Validating primary data. [2025-09-26T20:22:07.036049] [WARN ] [VALIDATOR ] NOM: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-09-26T20:22:07.036626] [FATAL] [MAIN ] NOM: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:22:07.036798] [WARN ] [MAIN ] NOM: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:22:07.036983] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-09-26T20:22:07.037128] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-09-26T20:22:07.037251] [INFO ] [LOCAL ] NOM: Starting deletion of derivative data. [2025-09-26T20:22:07.037569] [DEBUG] [LOCAL ] NOM: No derivative data file found to delete. [2025-09-26T20:22:07.037723] [INFO ] [MAIN ] Update Progress: 1513/2371 symbols completed. NOM took 17.6s. Estimated remaining: 1h 54m 35s. Rate: 7.5 symbols/min [2025-09-26T20:22:07.121379] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-01. [2025-09-26T20:22:07.107993] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-09-26T20:22:07.277992] [INFO ] [MAIN ] NOV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:22:07.365867] [DEBUG] [LOCAL ] NOV: Loaded 53572 existing records from primary storage. [2025-09-26T20:22:07.366144] [INFO ] [MAIN ] NOV: Loaded 53572 existing records. [2025-09-26T20:22:07.583128] [WARN ] [MAIN ] NOV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:22:07.583845] [INFO ] [MAIN ] NOV: Wiping existing primary data before full refresh. [2025-09-26T20:22:07.583940] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-09-26T20:22:07.598658] [DEBUG] [LOCAL ] NOV: Deleted primary data file. [2025-09-26T20:22:07.620361] [INFO ] [MAIN ] NOV: Starting full primary refresh. [2025-09-26T20:22:07.702384] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-26T20:22:07.917743] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-06. [2025-09-26T20:22:08.048511] [INFO ] [REMOTE ] NOV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:22:08.711769] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-01. [2025-09-26T20:22:08.856454] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-26T20:22:09.511780] [INFO ] [REMOTE ] NOV: Fetching primary data for 2024-12. [2025-09-26T20:22:10.064850] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-26T20:22:10.311757] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-07. [2025-09-26T20:22:10.728963] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-26T20:22:11.002713] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-26T20:22:11.111679] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-01. [2025-09-26T20:22:11.911756] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-02. [2025-09-26T20:22:12.571263] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-26T20:22:12.711761] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-08. [2025-09-26T20:22:12.974761] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-26T20:22:13.511779] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-02. [2025-09-26T20:22:13.928914] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-26T20:22:14.247918] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-26T20:22:14.311704] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-02. [2025-09-26T20:22:15.111733] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-09. [2025-09-26T20:22:15.315605] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-26T20:22:15.378908] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-26T20:22:15.911762] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-03. [2025-09-26T20:22:16.711752] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-03. [2025-09-26T20:22:17.257600] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-26T20:22:17.268799] [INFO ] [REMOTE ] NOK: Full fetch complete (77635 records). [2025-09-26T20:22:17.268978] [DEBUG] [VALIDATOR ] NOK: Validating primary data. [2025-09-26T20:22:17.526109] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-03. [2025-09-26T20:22:17.721806] [DEBUG] [VALIDATOR ] NOK: All expected trading days are present. [2025-09-26T20:22:17.722197] [DEBUG] [VALIDATOR ] NOK: Primary data validation passed. [2025-09-26T20:22:17.723508] [INFO ] [MAIN ] NOK: Fetched primary data is valid. [2025-09-26T20:22:17.723671] [DEBUG] [LOCAL ] NOK: Saving primary data. [2025-09-26T20:22:17.727790] [DEBUG] [LOCAL ] NOK: Trimmed 77635 records to 54401 (keeping 200 days of data) [2025-09-26T20:22:17.962345] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-26T20:22:18.124042] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-26T20:22:18.159727] [DEBUG] [LOCAL ] NOK: Primary data saved (54401 records). [2025-09-26T20:22:18.159898] [INFO ] [MAIN ] NOK: Full history saved. [2025-09-26T20:22:18.159995] [INFO ] [MAIN ] Update Progress: 1514/2371 symbols completed. NOK took 34.1s. Estimated remaining: 1h 54m 29s. Rate: 7.5 symbols/min [2025-09-26T20:22:18.321800] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-04. [2025-09-26T20:22:18.357452] [INFO ] [MAIN ] NOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:22:18.357737] [DEBUG] [LOCAL ] NOW: No existing data file found in primary storage. [2025-09-26T20:22:18.357787] [WARN ] [MAIN ] NOW: No existing data found, performing full refresh instead. [2025-09-26T20:22:18.357937] [INFO ] [MAIN ] NOW: Wiping existing primary data before full refresh. [2025-09-26T20:22:18.357981] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-09-26T20:22:18.358023] [DEBUG] [LOCAL ] NOW: No primary data file found to delete. [2025-09-26T20:22:18.358055] [INFO ] [MAIN ] NOW: Starting full primary refresh. [2025-09-26T20:22:18.751857] [INFO ] [REMOTE ] NOW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:22:19.061421] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T20:22:19.111718] [INFO ] [REMOTE ] NOW: Fetching primary data for 2024-12. [2025-09-26T20:22:19.911691] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-04. [2025-09-26T20:22:20.043384] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T20:22:20.711740] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-05. [2025-09-26T20:22:21.260818] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-26T20:22:21.511755] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-04. [2025-09-26T20:22:21.638755] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-26T20:22:22.311723] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-05. [2025-09-26T20:22:22.433001] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-26T20:22:23.082719] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-26T20:22:23.111706] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-01. [2025-09-26T20:22:23.911697] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-05. [2025-09-26T20:22:23.998284] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-26T20:22:24.711902] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-06. [2025-09-26T20:22:25.390903] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-09-26T20:22:25.511702] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-02. [2025-09-26T20:22:25.588980] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-26T20:22:26.311717] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-06. [2025-09-26T20:22:26.350048] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-26T20:22:27.111677] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-07. [2025-09-26T20:22:27.439422] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-26T20:22:27.911765] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-06. [2025-09-26T20:22:28.146836] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-26T20:22:28.373350] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-26T20:22:28.711767] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-07. [2025-09-26T20:22:29.511749] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-08. [2025-09-26T20:22:29.586938] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-26T20:22:30.180557] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-26T20:22:30.311718] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-07. [2025-09-26T20:22:31.112278] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-03. [2025-09-26T20:22:31.112203] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-26T20:22:31.911717] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-09. [2025-09-26T20:22:32.285970] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-26T20:22:32.711729] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-08. [2025-09-26T20:22:33.402567] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-09-26T20:22:33.511392] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-26T20:22:33.520692] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-04. [2025-09-26T20:22:33.523161] [INFO ] [REMOTE ] NOMD: Full fetch complete (58952 records). [2025-09-26T20:22:33.523269] [DEBUG] [VALIDATOR ] NOMD: Validating primary data. [2025-09-26T20:22:33.977891] [DEBUG] [VALIDATOR ] NOMD: All expected trading days are present. [2025-09-26T20:22:33.978064] [DEBUG] [VALIDATOR ] NOMD: Primary data validation passed. [2025-09-26T20:22:33.979178] [INFO ] [MAIN ] NOMD: Fetched primary data is valid. [2025-09-26T20:22:33.979327] [DEBUG] [LOCAL ] NOMD: Saving primary data. [2025-09-26T20:22:33.980938] [DEBUG] [LOCAL ] NOMD: Trimmed 58952 records to 42016 (keeping 200 days of data) [2025-09-26T20:22:34.253203] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-26T20:22:34.311840] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-09. [2025-09-26T20:22:34.319414] [DEBUG] [LOCAL ] NOMD: Primary data saved (42016 records). [2025-09-26T20:22:34.319850] [INFO ] [MAIN ] NOMD: Full history saved. [2025-09-26T20:22:34.320008] [INFO ] [MAIN ] Update Progress: 1515/2371 symbols completed. NOMD took 34.1s. Estimated remaining: 1h 54m 26s. Rate: 7.5 symbols/min [2025-09-26T20:22:34.524476] [INFO ] [MAIN ] NPB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:22:34.524679] [DEBUG] [LOCAL ] NPB: No existing data file found in primary storage. [2025-09-26T20:22:34.524819] [WARN ] [MAIN ] NPB: No existing data found, performing full refresh instead. [2025-09-26T20:22:34.524986] [INFO ] [MAIN ] NPB: Wiping existing primary data before full refresh. [2025-09-26T20:22:34.525030] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-09-26T20:22:34.525074] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-09-26T20:22:34.525108] [INFO ] [MAIN ] NPB: Starting full primary refresh. [2025-09-26T20:22:34.937451] [INFO ] [REMOTE ] NPB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:22:35.111735] [INFO ] [REMOTE ] NPB: Fetching primary data for 2024-12. [2025-09-26T20:22:35.366767] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:22:35.367157] [WARN ] [REMOTE ] NPB: No data returned for month 2024-12 [2025-09-26T20:22:35.911720] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-08. [2025-09-26T20:22:35.946234] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-09-26T20:22:36.284482] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-26T20:22:36.295298] [INFO ] [REMOTE ] NOV: Full fetch complete (76986 records). [2025-09-26T20:22:36.295451] [DEBUG] [VALIDATOR ] NOV: Validating primary data. [2025-09-26T20:22:36.723053] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-05. [2025-09-26T20:22:36.727189] [DEBUG] [VALIDATOR ] NOV: All expected trading days are present. [2025-09-26T20:22:36.728278] [DEBUG] [VALIDATOR ] NOV: Primary data validation passed. [2025-09-26T20:22:36.729439] [INFO ] [MAIN ] NOV: Fetched primary data is valid. [2025-09-26T20:22:36.729606] [DEBUG] [LOCAL ] NOV: Saving primary data. [2025-09-26T20:22:36.731319] [DEBUG] [LOCAL ] NOV: Trimmed 76986 records to 53961 (keeping 200 days of data) [2025-09-26T20:22:37.110577] [DEBUG] [LOCAL ] NOV: Primary data saved (53961 records). [2025-09-26T20:22:37.110861] [INFO ] [MAIN ] NOV: Full history saved. [2025-09-26T20:22:37.110967] [INFO ] [MAIN ] Update Progress: 1516/2371 symbols completed. NOV took 30.0s. Estimated remaining: 1h 54m 15s. Rate: 7.5 symbols/min [2025-09-26T20:22:37.304784] [INFO ] [MAIN ] NPCT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:22:37.322167] [DEBUG] [LOCAL ] NPCT: Loaded 16872 existing records from primary storage. [2025-09-26T20:22:37.322296] [INFO ] [MAIN ] NPCT: Loaded 16872 existing records. [2025-09-26T20:22:37.505834] [WARN ] [MAIN ] NPCT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:22:37.506151] [INFO ] [MAIN ] NPCT: Wiping existing primary data before full refresh. [2025-09-26T20:22:37.506206] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-09-26T20:22:37.506821] [DEBUG] [LOCAL ] NPCT: Deleted primary data file. [2025-09-26T20:22:37.506906] [INFO ] [MAIN ] NPCT: Starting full primary refresh. [2025-09-26T20:22:37.518327] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-01. [2025-09-26T20:22:37.858728] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:22:37.915946] [INFO ] [REMOTE ] NPCT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:22:37.921335] [WARN ] [REMOTE ] NPB: No data returned for month 2025-01 [2025-09-26T20:22:37.934869] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-26T20:22:38.311719] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-09. [2025-09-26T20:22:39.111726] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2024-12. [2025-09-26T20:22:39.197554] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-09-26T20:22:39.695310] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-26T20:22:39.701878] [INFO ] [REMOTE ] NOTE: Full fetch complete (64235 records). [2025-09-26T20:22:39.702066] [DEBUG] [VALIDATOR ] NOTE: Validating primary data. [2025-09-26T20:22:39.924946] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-06. [2025-09-26T20:22:40.237948] [DEBUG] [VALIDATOR ] NOTE: All expected trading days are present. [2025-09-26T20:22:40.238203] [DEBUG] [VALIDATOR ] NOTE: Primary data validation passed. [2025-09-26T20:22:40.239788] [INFO ] [MAIN ] NOTE: Fetched primary data is valid. [2025-09-26T20:22:40.239887] [DEBUG] [LOCAL ] NOTE: Saving primary data. [2025-09-26T20:22:40.258792] [DEBUG] [LOCAL ] NOTE: Trimmed 64235 records to 43143 (keeping 200 days of data) [2025-09-26T20:22:40.272911] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-26T20:22:40.628358] [DEBUG] [LOCAL ] NOTE: Primary data saved (43143 records). [2025-09-26T20:22:40.628513] [INFO ] [MAIN ] NOTE: Full history saved. [2025-09-26T20:22:40.628627] [INFO ] [MAIN ] Update Progress: 1517/2371 symbols completed. NOTE took 38.7s. Estimated remaining: 1h 54m 4s. Rate: 7.5 symbols/min [2025-09-26T20:22:40.711727] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-02. [2025-09-26T20:22:41.511702] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-01. [2025-09-26T20:22:41.534847] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-26T20:22:41.925725] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-26T20:22:42.311696] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-07. [2025-09-26T20:22:42.374223] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-26T20:22:43.111726] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-02. [2025-09-26T20:22:43.911735] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-03. [2025-09-26T20:22:44.162132] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-26T20:22:44.484904] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-26T20:22:44.711778] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-03. [2025-09-26T20:22:44.921581] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-26T20:22:45.511689] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-08. [2025-09-26T20:22:45.790201] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-26T20:22:46.311750] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-04. [2025-09-26T20:22:47.111816] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-04. [2025-09-26T20:22:47.354761] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-26T20:22:47.797744] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-26T20:22:47.911709] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-05. [2025-09-26T20:22:48.207410] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-26T20:22:48.711692] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-09. [2025-09-26T20:22:49.023583] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-26T20:22:49.501189] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-26T20:22:49.510280] [INFO ] [REMOTE ] NOW: Full fetch complete (70447 records). [2025-09-26T20:22:49.510428] [DEBUG] [VALIDATOR ] NOW: Validating primary data. [2025-09-26T20:22:49.511553] [FATAL] [VALIDATOR ] NOW: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T20:22:49.511711] [FATAL] [MAIN ] NOW: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:22:49.511860] [WARN ] [MAIN ] NOW: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:22:49.511963] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-09-26T20:22:49.511671] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-06. [2025-09-26T20:22:49.512360] [DEBUG] [LOCAL ] NOW: No primary data file found to delete. [2025-09-26T20:22:49.513380] [INFO ] [LOCAL ] NOW: Starting deletion of derivative data. [2025-09-26T20:22:49.513467] [DEBUG] [LOCAL ] NOW: No derivative data file found to delete. [2025-09-26T20:22:49.513567] [INFO ] [MAIN ] Update Progress: 1518/2371 symbols completed. NOW took 31.4s. Estimated remaining: 1h 53m 57s. Rate: 7.5 symbols/min [2025-09-26T20:22:50.311684] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-05. [2025-09-26T20:22:50.645765] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-26T20:22:51.111750] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-07. [2025-09-26T20:22:51.169712] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-26T20:22:51.911755] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-06. [2025-09-26T20:23:07.065452] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-06 (15.15 seconds). [2025-09-26T20:23:07.069208] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-07. [2025-09-26T20:23:08.156762] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-26T20:23:08.161386] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-08. [2025-09-26T20:23:08.658814] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-07 (17.55 seconds). [2025-09-26T20:23:08.664180] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-08. [2025-09-26T20:23:09.237290] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-26T20:23:09.242011] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-09. [2025-09-26T20:23:09.630683] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-26T20:23:09.634482] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-09. [2025-09-26T20:23:10.259953] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-26T20:23:10.263785] [INFO ] [REMOTE ] NPB: Full fetch complete (16425 records). [2025-09-26T20:23:10.263868] [DEBUG] [VALIDATOR ] NPB: Validating primary data. [2025-09-26T20:23:10.475311] [WARN ] [VALIDATOR ] NPB: Validation failed - insufficient historical data. Have 155 unique days, need 200 days [2025-09-26T20:23:10.476012] [FATAL] [MAIN ] NPB: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:23:10.476107] [WARN ] [MAIN ] NPB: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:23:10.476203] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-09-26T20:23:10.476318] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-09-26T20:23:10.476377] [INFO ] [LOCAL ] NPB: Starting deletion of derivative data. [2025-09-26T20:23:10.476432] [DEBUG] [LOCAL ] NPB: No derivative data file found to delete. [2025-09-26T20:23:10.476588] [INFO ] [MAIN ] Update Progress: 1519/2371 symbols completed. NPB took 36.2s. Estimated remaining: 1h 53m 56s. Rate: 7.5 symbols/min [2025-09-26T20:23:11.991282] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-09-26T20:23:11.995152] [INFO ] [REMOTE ] NPCT: Full fetch complete (25250 records). [2025-09-26T20:23:11.995242] [DEBUG] [VALIDATOR ] NPCT: Validating primary data. [2025-09-26T20:23:12.393709] [DEBUG] [VALIDATOR ] NPCT: All expected trading days are present. [2025-09-26T20:23:12.393822] [DEBUG] [VALIDATOR ] NPCT: Primary data validation passed. [2025-09-26T20:23:12.394429] [INFO ] [MAIN ] NPCT: Fetched primary data is valid. [2025-09-26T20:23:12.394500] [DEBUG] [LOCAL ] NPCT: Saving primary data. [2025-09-26T20:23:12.395249] [DEBUG] [LOCAL ] NPCT: Trimmed 25250 records to 17114 (keeping 200 days of data) [2025-09-26T20:23:12.510811] [DEBUG] [LOCAL ] NPCT: Primary data saved (17114 records). [2025-09-26T20:23:12.510970] [INFO ] [MAIN ] NPCT: Full history saved. [2025-09-26T20:23:12.511079] [INFO ] [MAIN ] Update Progress: 1520/2371 symbols completed. NPCT took 35.4s. Estimated remaining: 1h 53m 44s. Rate: 7.5 symbols/min [2025-09-26T20:23:13.190664] [INFO ] [MAIN ] NPO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:23:13.289208] [INFO ] [MAIN ] NPFD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:23:13.319206] [INFO ] [MAIN ] NPK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:23:13.285114] [INFO ] [MAIN ] NPKI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:23:13.320086] [DEBUG] [LOCAL ] NPKI: No existing data file found in primary storage. [2025-09-26T20:23:13.320350] [WARN ] [MAIN ] NPKI: No existing data found, performing full refresh instead. [2025-09-26T20:23:13.320538] [INFO ] [MAIN ] NPKI: Wiping existing primary data before full refresh. [2025-09-26T20:23:13.320591] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-09-26T20:23:13.320685] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-09-26T20:23:13.320735] [INFO ] [MAIN ] NPKI: Starting full primary refresh. [2025-09-26T20:23:13.424328] [DEBUG] [LOCAL ] NPO: Loaded 12914 existing records from primary storage. [2025-09-26T20:23:13.437267] [DEBUG] [LOCAL ] NPK: Loaded 8072 existing records from primary storage. [2025-09-26T20:23:13.456109] [INFO ] [MAIN ] NPO: Loaded 12914 existing records. [2025-09-26T20:23:13.455469] [INFO ] [MAIN ] NPK: Loaded 8072 existing records. [2025-09-26T20:23:13.455895] [DEBUG] [LOCAL ] NPFD: Loaded 9713 existing records from primary storage. [2025-09-26T20:23:13.514166] [INFO ] [MAIN ] NPFD: Loaded 9713 existing records. [2025-09-26T20:23:14.049865] [WARN ] [MAIN ] NPK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:23:14.227347] [INFO ] [MAIN ] NPK: Wiping existing primary data before full refresh. [2025-09-26T20:23:14.270374] [WARN ] [MAIN ] NPFD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:23:14.282362] [WARN ] [MAIN ] NPO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:23:14.270493] [INFO ] [LOCAL ] NPK: Starting deletion of primary data. [2025-09-26T20:23:14.287416] [DEBUG] [LOCAL ] NPK: Deleted primary data file. [2025-09-26T20:23:14.287259] [INFO ] [MAIN ] NPO: Wiping existing primary data before full refresh. [2025-09-26T20:23:14.287615] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-09-26T20:23:14.287365] [INFO ] [MAIN ] NPFD: Wiping existing primary data before full refresh. [2025-09-26T20:23:14.288049] [INFO ] [MAIN ] NPK: Starting full primary refresh. [2025-09-26T20:23:14.304439] [DEBUG] [LOCAL ] NPO: Deleted primary data file. [2025-09-26T20:23:14.309885] [INFO ] [LOCAL ] NPFD: Starting deletion of primary data. [2025-09-26T20:23:14.322230] [INFO ] [MAIN ] NPO: Starting full primary refresh. [2025-09-26T20:23:14.358345] [DEBUG] [LOCAL ] NPFD: Deleted primary data file. [2025-09-26T20:23:14.464625] [INFO ] [MAIN ] NPFD: Starting full primary refresh. [2025-09-26T20:23:14.633774] [INFO ] [REMOTE ] NPKI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:23:14.680240] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2024-12. [2025-09-26T20:23:15.464511] [INFO ] [REMOTE ] NPO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:23:15.490540] [INFO ] [REMOTE ] NPO: Fetching primary data for 2024-12. [2025-09-26T20:23:15.567622] [INFO ] [REMOTE ] NPK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:23:15.594968] [INFO ] [REMOTE ] NPK: Fetching primary data for 2024-12. [2025-09-26T20:23:15.594701] [INFO ] [REMOTE ] NPFD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:23:15.595277] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2024-12. [2025-09-26T20:23:15.730402] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-26T20:23:15.733700] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-01. [2025-09-26T20:23:16.581918] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-26T20:23:16.585900] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-01. [2025-09-26T20:23:16.656219] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-26T20:23:16.660438] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-01. [2025-09-26T20:23:16.668716] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-26T20:23:16.671359] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-01. [2025-09-26T20:23:17.019687] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-26T20:23:17.028349] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-02. [2025-09-26T20:23:17.370916] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-26T20:23:17.373043] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-02. [2025-09-26T20:23:17.459688] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-26T20:23:17.462672] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-02. [2025-09-26T20:23:17.567511] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-26T20:23:17.570447] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-02. [2025-09-26T20:23:18.057451] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-26T20:23:18.059351] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-03. [2025-09-26T20:23:18.089000] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-26T20:23:18.098931] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-03. [2025-09-26T20:23:18.279751] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-26T20:23:18.282880] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-03. [2025-09-26T20:23:18.373840] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-26T20:23:18.377086] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-03. [2025-09-26T20:23:18.702446] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-26T20:23:18.704618] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-04. [2025-09-26T20:23:19.076288] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-26T20:23:19.079503] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-04. [2025-09-26T20:23:19.099583] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-26T20:23:19.102735] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-04. [2025-09-26T20:23:19.320858] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-26T20:23:19.334542] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-04. [2025-09-26T20:23:19.334885] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-26T20:23:19.338449] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-05. [2025-09-26T20:23:19.955958] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-26T20:23:19.967247] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-05. [2025-09-26T20:23:19.968790] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-26T20:23:19.972221] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-05. [2025-09-26T20:23:20.018169] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-26T20:23:20.020632] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-06. [2025-09-26T20:23:20.641562] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-26T20:23:20.651879] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-05. [2025-09-26T20:23:20.833585] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-26T20:23:20.836528] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-06. [2025-09-26T20:23:20.956804] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-26T20:23:20.960759] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-06. [2025-09-26T20:23:21.125015] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-26T20:23:21.128090] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-07. [2025-09-26T20:23:21.425736] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-26T20:23:21.428493] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-07. [2025-09-26T20:23:21.941597] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-26T20:23:21.951438] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-06. [2025-09-26T20:23:22.144904] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-26T20:23:22.154071] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-07. [2025-09-26T20:23:22.161188] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-26T20:23:22.165544] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-08. [2025-09-26T20:23:22.388893] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-26T20:23:22.392333] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-08. [2025-09-26T20:23:22.827132] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-26T20:23:22.905312] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-26T20:23:23.015820] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-26T20:23:23.111696] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-09. [2025-09-26T20:23:23.178496] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-26T20:23:23.832222] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-26T20:23:23.834053] [INFO ] [REMOTE ] NPK: Full fetch complete (10869 records). [2025-09-26T20:23:23.834159] [DEBUG] [VALIDATOR ] NPK: Validating primary data. [2025-09-26T20:23:23.916969] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-08. [2025-09-26T20:23:24.259842] [DEBUG] [VALIDATOR ] NPK: All expected trading days are present. [2025-09-26T20:23:24.259948] [DEBUG] [VALIDATOR ] NPK: Primary data validation passed. [2025-09-26T20:23:24.260421] [INFO ] [MAIN ] NPK: Fetched primary data is valid. [2025-09-26T20:23:24.260489] [DEBUG] [LOCAL ] NPK: Saving primary data. [2025-09-26T20:23:24.261174] [DEBUG] [LOCAL ] NPK: Trimmed 10869 records to 8120 (keeping 200 days of data) [2025-09-26T20:23:24.317051] [DEBUG] [LOCAL ] NPK: Primary data saved (8120 records). [2025-09-26T20:23:24.317215] [INFO ] [MAIN ] NPK: Full history saved. [2025-09-26T20:23:24.317365] [INFO ] [MAIN ] Update Progress: 1521/2371 symbols completed. NPK took 11.8s. Estimated remaining: 1h 53m 39s. Rate: 7.5 symbols/min [2025-09-26T20:23:24.497601] [INFO ] [MAIN ] NPV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:23:24.505436] [DEBUG] [LOCAL ] NPV: Loaded 5042 existing records from primary storage. [2025-09-26T20:23:24.505574] [INFO ] [MAIN ] NPV: Loaded 5042 existing records. [2025-09-26T20:23:24.706676] [WARN ] [MAIN ] NPV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:23:24.706975] [INFO ] [MAIN ] NPV: Wiping existing primary data before full refresh. [2025-09-26T20:23:24.707034] [INFO ] [LOCAL ] NPV: Starting deletion of primary data. [2025-09-26T20:23:24.707377] [DEBUG] [LOCAL ] NPV: Deleted primary data file. [2025-09-26T20:23:24.707437] [INFO ] [MAIN ] NPV: Starting full primary refresh. [2025-09-26T20:23:24.720139] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-09. [2025-09-26T20:23:25.060411] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-26T20:23:25.132873] [INFO ] [REMOTE ] NPV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:23:25.511700] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-07. [2025-09-26T20:23:25.664945] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-26T20:23:25.667826] [INFO ] [REMOTE ] NPFD: Full fetch complete (14797 records). [2025-09-26T20:23:25.667927] [DEBUG] [VALIDATOR ] NPFD: Validating primary data. [2025-09-26T20:23:26.070094] [DEBUG] [VALIDATOR ] NPFD: All expected trading days are present. [2025-09-26T20:23:26.070180] [DEBUG] [VALIDATOR ] NPFD: Primary data validation passed. [2025-09-26T20:23:26.070543] [INFO ] [MAIN ] NPFD: Fetched primary data is valid. [2025-09-26T20:23:26.070584] [DEBUG] [LOCAL ] NPFD: Saving primary data. [2025-09-26T20:23:26.071229] [DEBUG] [LOCAL ] NPFD: Trimmed 14797 records to 9814 (keeping 200 days of data) [2025-09-26T20:23:26.134796] [DEBUG] [LOCAL ] NPFD: Primary data saved (9814 records). [2025-09-26T20:23:26.134984] [INFO ] [MAIN ] NPFD: Full history saved. [2025-09-26T20:23:26.135101] [INFO ] [MAIN ] Update Progress: 1522/2371 symbols completed. NPFD took 13.6s. Estimated remaining: 1h 53m 27s. Rate: 7.5 symbols/min [2025-09-26T20:23:26.316965] [INFO ] [REMOTE ] NPV: Fetching primary data for 2024-12. [2025-09-26T20:23:26.320916] [INFO ] [MAIN ] NPWR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:23:26.363487] [DEBUG] [LOCAL ] NPWR: Loaded 43581 existing records from primary storage. [2025-09-26T20:23:26.363659] [INFO ] [MAIN ] NPWR: Loaded 43581 existing records. [2025-09-26T20:23:26.559041] [WARN ] [MAIN ] NPWR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:23:26.559293] [INFO ] [MAIN ] NPWR: Wiping existing primary data before full refresh. [2025-09-26T20:23:26.559343] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-09-26T20:23:26.560313] [DEBUG] [LOCAL ] NPWR: Deleted primary data file. [2025-09-26T20:23:26.560376] [INFO ] [MAIN ] NPWR: Starting full primary refresh. [2025-09-26T20:23:26.963970] [INFO ] [REMOTE ] NPWR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:23:26.968881] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-26T20:23:27.079319] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-26T20:23:27.111674] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-08. [2025-09-26T20:23:27.911729] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-01. [2025-09-26T20:23:28.542624] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-26T20:23:28.693887] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-26T20:23:28.711670] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-09. [2025-09-26T20:23:29.511720] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-09. [2025-09-26T20:23:30.115815] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-26T20:23:30.123569] [INFO ] [REMOTE ] NPKI: Full fetch complete (53554 records). [2025-09-26T20:23:30.123810] [DEBUG] [VALIDATOR ] NPKI: Validating primary data. [2025-09-26T20:23:30.316721] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2024-12. [2025-09-26T20:23:30.367692] [WARN ] [VALIDATOR ] NPKI: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-26T20:23:30.368860] [FATAL] [MAIN ] NPKI: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:23:30.369005] [WARN ] [MAIN ] NPKI: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:23:30.369102] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-09-26T20:23:30.369192] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-09-26T20:23:30.369263] [INFO ] [LOCAL ] NPKI: Starting deletion of derivative data. [2025-09-26T20:23:30.369333] [DEBUG] [LOCAL ] NPKI: No derivative data file found to delete. [2025-09-26T20:23:30.369415] [INFO ] [MAIN ] Update Progress: 1523/2371 symbols completed. NPKI took 17.9s. Estimated remaining: 1h 53m 17s. Rate: 7.5 symbols/min [2025-09-26T20:23:30.503042] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-26T20:23:30.542898] [INFO ] [REMOTE ] NPO: Full fetch complete (17901 records). [2025-09-26T20:23:30.570818] [INFO ] [MAIN ] NQP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:23:30.570953] [DEBUG] [VALIDATOR ] NPO: Validating primary data. [2025-09-26T20:23:30.703317] [DEBUG] [LOCAL ] NQP: Loaded 9373 existing records from primary storage. [2025-09-26T20:23:30.713872] [INFO ] [MAIN ] NQP: Loaded 9373 existing records. [2025-09-26T20:23:31.127930] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-02. [2025-09-26T20:23:31.158315] [WARN ] [MAIN ] NQP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:23:31.211074] [INFO ] [MAIN ] NQP: Wiping existing primary data before full refresh. [2025-09-26T20:23:31.211004] [DEBUG] [VALIDATOR ] NPO: All expected trading days are present. [2025-09-26T20:23:31.211194] [DEBUG] [VALIDATOR ] NPO: Primary data validation passed. [2025-09-26T20:23:31.211260] [INFO ] [LOCAL ] NQP: Starting deletion of primary data. [2025-09-26T20:23:31.211808] [INFO ] [MAIN ] NPO: Fetched primary data is valid. [2025-09-26T20:23:31.212339] [DEBUG] [LOCAL ] NPO: Saving primary data. [2025-09-26T20:23:31.213051] [DEBUG] [LOCAL ] NQP: Deleted primary data file. [2025-09-26T20:23:31.213227] [INFO ] [MAIN ] NQP: Starting full primary refresh. [2025-09-26T20:23:31.213345] [DEBUG] [LOCAL ] NPO: Trimmed 17901 records to 13019 (keeping 200 days of data) [2025-09-26T20:23:31.700978] [INFO ] [REMOTE ] NQP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:23:31.714023] [DEBUG] [LOCAL ] NPO: Primary data saved (13019 records). [2025-09-26T20:23:31.714171] [INFO ] [MAIN ] NPO: Full history saved. [2025-09-26T20:23:31.714265] [INFO ] [MAIN ] Update Progress: 1524/2371 symbols completed. NPO took 19.2s. Estimated remaining: 1h 53m 5s. Rate: 7.5 symbols/min [2025-09-26T20:23:31.850520] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-26T20:23:31.915565] [INFO ] [REMOTE ] NQP: Fetching primary data for 2024-12. [2025-09-26T20:23:31.921740] [INFO ] [MAIN ] NRDY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:23:31.948615] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-26T20:23:31.987063] [DEBUG] [LOCAL ] NRDY: Loaded 33222 existing records from primary storage. [2025-09-26T20:23:31.987219] [INFO ] [MAIN ] NRDY: Loaded 33222 existing records. [2025-09-26T20:23:32.191148] [WARN ] [MAIN ] NRDY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:23:32.191476] [INFO ] [MAIN ] NRDY: Wiping existing primary data before full refresh. [2025-09-26T20:23:32.191541] [INFO ] [LOCAL ] NRDY: Starting deletion of primary data. [2025-09-26T20:23:32.192484] [DEBUG] [LOCAL ] NRDY: Deleted primary data file. [2025-09-26T20:23:32.192550] [INFO ] [MAIN ] NRDY: Starting full primary refresh. [2025-09-26T20:23:32.653193] [INFO ] [REMOTE ] NRDY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:23:32.711698] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2024-12. [2025-09-26T20:23:32.856782] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-26T20:23:33.511760] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-01. [2025-09-26T20:23:34.299822] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-26T20:23:34.311696] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-01. [2025-09-26T20:23:34.637043] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-26T20:23:35.111721] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-03. [2025-09-26T20:23:35.756758] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-26T20:23:35.838771] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-26T20:23:35.911724] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-02. [2025-09-26T20:23:36.711726] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-01. [2025-09-26T20:23:36.883056] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-26T20:23:37.511723] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-04. [2025-09-26T20:23:38.262513] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-26T20:23:38.289952] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-26T20:23:38.311699] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-02. [2025-09-26T20:23:39.111749] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-05. [2025-09-26T20:23:39.773559] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-26T20:23:39.900214] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-26T20:23:39.911673] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-03. [2025-09-26T20:23:40.711721] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-06. [2025-09-26T20:23:41.343188] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-26T20:23:41.516084] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-07. [2025-09-26T20:23:41.522234] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-26T20:23:42.284954] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-26T20:23:42.311694] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-08. [2025-09-26T20:23:42.951307] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-26T20:23:43.111722] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-09. [2025-09-26T20:23:43.911749] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-04. [2025-09-26T20:23:44.127673] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-26T20:23:44.129456] [INFO ] [REMOTE ] NPV: Full fetch complete (6892 records). [2025-09-26T20:23:44.129529] [DEBUG] [VALIDATOR ] NPV: Validating primary data. [2025-09-26T20:23:44.558127] [DEBUG] [VALIDATOR ] NPV: All expected trading days are present. [2025-09-26T20:23:44.558222] [DEBUG] [VALIDATOR ] NPV: Primary data validation passed. [2025-09-26T20:23:44.558423] [INFO ] [MAIN ] NPV: Fetched primary data is valid. [2025-09-26T20:23:44.558464] [DEBUG] [LOCAL ] NPV: Saving primary data. [2025-09-26T20:23:44.558924] [DEBUG] [LOCAL ] NPV: Trimmed 6892 records to 5070 (keeping 200 days of data) [2025-09-26T20:23:44.590703] [DEBUG] [LOCAL ] NPV: Primary data saved (5070 records). [2025-09-26T20:23:44.590840] [INFO ] [MAIN ] NPV: Full history saved. [2025-09-26T20:23:44.590932] [INFO ] [MAIN ] Update Progress: 1525/2371 symbols completed. NPV took 20.3s. Estimated remaining: 1h 52m 60s. Rate: 7.5 symbols/min [2025-09-26T20:23:44.716295] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-03. [2025-09-26T20:23:44.802131] [INFO ] [MAIN ] NREF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:23:44.814696] [DEBUG] [LOCAL ] NREF: Loaded 7893 existing records from primary storage. [2025-09-26T20:23:44.814896] [INFO ] [MAIN ] NREF: Loaded 7893 existing records. [2025-09-26T20:23:45.042033] [WARN ] [MAIN ] NREF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:23:45.042424] [INFO ] [MAIN ] NREF: Wiping existing primary data before full refresh. [2025-09-26T20:23:45.042489] [INFO ] [LOCAL ] NREF: Starting deletion of primary data. [2025-09-26T20:23:45.042896] [DEBUG] [LOCAL ] NREF: Deleted primary data file. [2025-09-26T20:23:45.042958] [INFO ] [MAIN ] NREF: Starting full primary refresh. [2025-09-26T20:23:45.439697] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-26T20:23:45.516169] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-02. [2025-09-26T20:23:45.516055] [INFO ] [REMOTE ] NREF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:23:45.597263] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-26T20:23:46.311741] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-05. [2025-09-26T20:23:46.854123] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-26T20:23:47.111764] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-03. [2025-09-26T20:23:47.672865] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-26T20:23:47.911734] [INFO ] [REMOTE ] NREF: Fetching primary data for 2024-12. [2025-09-26T20:23:48.712031] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-04. [2025-09-26T20:23:48.715914] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-26T20:23:48.764453] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-26T20:23:49.511719] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-01. [2025-09-26T20:23:49.637493] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-26T20:23:50.224513] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-26T20:23:50.311730] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-04. [2025-09-26T20:23:51.111733] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-02. [2025-09-26T20:23:51.846072] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-26T20:23:51.911725] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-05. [2025-09-26T20:23:52.032858] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T20:23:52.711711] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-06. [2025-09-26T20:23:52.766361] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-26T20:23:53.511738] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-06. [2025-09-26T20:23:54.154606] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-26T20:23:54.311762] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-03. [2025-09-26T20:23:54.374264] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-26T20:23:55.111731] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-07. [2025-09-26T20:23:55.175495] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-26T20:23:55.911709] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-05. [2025-09-26T20:23:55.995814] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-26T20:23:56.711736] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-08. [2025-09-26T20:23:57.517008] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-04. [2025-09-26T20:23:57.547981] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-26T20:23:57.549239] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-26T20:23:58.311753] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-09. [2025-09-26T20:23:58.336639] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-26T20:23:59.003442] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-26T20:23:59.006109] [INFO ] [REMOTE ] NQP: Full fetch complete (13489 records). [2025-09-26T20:23:59.006204] [DEBUG] [VALIDATOR ] NQP: Validating primary data. [2025-09-26T20:23:59.115034] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-05. [2025-09-26T20:23:59.408620] [DEBUG] [VALIDATOR ] NQP: All expected trading days are present. [2025-09-26T20:23:59.408736] [DEBUG] [VALIDATOR ] NQP: Primary data validation passed. [2025-09-26T20:23:59.409101] [INFO ] [MAIN ] NQP: Fetched primary data is valid. [2025-09-26T20:23:59.409166] [DEBUG] [LOCAL ] NQP: Saving primary data. [2025-09-26T20:23:59.409777] [DEBUG] [LOCAL ] NQP: Trimmed 13489 records to 9406 (keeping 200 days of data) [2025-09-26T20:23:59.474070] [DEBUG] [LOCAL ] NQP: Primary data saved (9406 records). [2025-09-26T20:23:59.474246] [INFO ] [MAIN ] NQP: Full history saved. [2025-09-26T20:23:59.474470] [INFO ] [MAIN ] Update Progress: 1526/2371 symbols completed. NQP took 29.1s. Estimated remaining: 1h 52m 56s. Rate: 7.5 symbols/min [2025-09-26T20:23:59.666189] [INFO ] [MAIN ] NRG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:23:59.666410] [DEBUG] [LOCAL ] NRG: No existing data file found in primary storage. [2025-09-26T20:23:59.666465] [WARN ] [MAIN ] NRG: No existing data found, performing full refresh instead. [2025-09-26T20:23:59.666669] [INFO ] [MAIN ] NRG: Wiping existing primary data before full refresh. [2025-09-26T20:23:59.666739] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-09-26T20:23:59.666801] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-09-26T20:23:59.666847] [INFO ] [MAIN ] NRG: Starting full primary refresh. [2025-09-26T20:23:59.912752] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-06. [2025-09-26T20:23:59.931211] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-26T20:24:00.067150] [INFO ] [REMOTE ] NRG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:24:00.711723] [INFO ] [REMOTE ] NRG: Fetching primary data for 2024-12. [2025-09-26T20:24:01.511741] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-07. [2025-09-26T20:24:01.831463] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-26T20:24:02.311779] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-06. [2025-09-26T20:24:02.465295] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-26T20:24:02.638438] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-26T20:24:03.111792] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-08. [2025-09-26T20:24:03.215885] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-26T20:24:03.911767] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-07. [2025-09-26T20:24:04.479340] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-26T20:24:04.493351] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-26T20:24:04.711746] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-09. [2025-09-26T20:24:05.511715] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-01. [2025-09-26T20:24:06.146192] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-26T20:24:06.156235] [INFO ] [REMOTE ] NRDY: Full fetch complete (52042 records). [2025-09-26T20:24:06.156510] [DEBUG] [VALIDATOR ] NRDY: Validating primary data. [2025-09-26T20:24:06.316898] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-07. [2025-09-26T20:24:06.722158] [DEBUG] [VALIDATOR ] NRDY: All expected trading days are present. [2025-09-26T20:24:06.722254] [DEBUG] [VALIDATOR ] NRDY: Primary data validation passed. [2025-09-26T20:24:06.723090] [INFO ] [MAIN ] NRDY: Fetched primary data is valid. [2025-09-26T20:24:06.723192] [DEBUG] [LOCAL ] NRDY: Saving primary data. [2025-09-26T20:24:06.724629] [DEBUG] [LOCAL ] NRDY: Trimmed 52042 records to 33402 (keeping 200 days of data) [2025-09-26T20:24:06.941887] [DEBUG] [LOCAL ] NRDY: Primary data saved (33402 records). [2025-09-26T20:24:06.942050] [INFO ] [MAIN ] NRDY: Full history saved. [2025-09-26T20:24:06.942292] [INFO ] [MAIN ] Update Progress: 1527/2371 symbols completed. NRDY took 35.2s. Estimated remaining: 1h 52m 47s. Rate: 7.5 symbols/min [2025-09-26T20:24:07.121500] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-08. [2025-09-26T20:24:07.131607] [INFO ] [MAIN ] NRGV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:24:07.180678] [DEBUG] [LOCAL ] NRGV: Loaded 43355 existing records from primary storage. [2025-09-26T20:24:07.180841] [INFO ] [MAIN ] NRGV: Loaded 43355 existing records. [2025-09-26T20:24:07.370504] [WARN ] [MAIN ] NRGV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:24:07.371004] [INFO ] [MAIN ] NRGV: Wiping existing primary data before full refresh. [2025-09-26T20:24:07.371125] [INFO ] [LOCAL ] NRGV: Starting deletion of primary data. [2025-09-26T20:24:07.372381] [DEBUG] [LOCAL ] NRGV: Deleted primary data file. [2025-09-26T20:24:07.372468] [INFO ] [MAIN ] NRGV: Starting full primary refresh. [2025-09-26T20:24:07.767214] [INFO ] [REMOTE ] NRGV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:24:07.799864] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-26T20:24:07.910779] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-26T20:24:07.912977] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2024-12. [2025-09-26T20:24:08.226145] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-26T20:24:08.711728] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-09. [2025-09-26T20:24:09.511687] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-08. [2025-09-26T20:24:09.567127] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-26T20:24:09.564876] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-26T20:24:09.585772] [INFO ] [REMOTE ] NREF: Full fetch complete (10859 records). [2025-09-26T20:24:09.585931] [DEBUG] [VALIDATOR ] NREF: Validating primary data. [2025-09-26T20:24:09.975250] [DEBUG] [VALIDATOR ] NREF: All expected trading days are present. [2025-09-26T20:24:09.975357] [DEBUG] [VALIDATOR ] NREF: Primary data validation passed. [2025-09-26T20:24:09.975661] [INFO ] [MAIN ] NREF: Fetched primary data is valid. [2025-09-26T20:24:09.975725] [DEBUG] [LOCAL ] NREF: Saving primary data. [2025-09-26T20:24:09.976267] [DEBUG] [LOCAL ] NREF: Trimmed 10859 records to 7957 (keeping 200 days of data) [2025-09-26T20:24:10.034436] [DEBUG] [LOCAL ] NREF: Primary data saved (7957 records). [2025-09-26T20:24:10.034594] [INFO ] [MAIN ] NREF: Full history saved. [2025-09-26T20:24:10.034726] [INFO ] [MAIN ] Update Progress: 1528/2371 symbols completed. NREF took 25.4s. Estimated remaining: 1h 52m 37s. Rate: 7.5 symbols/min [2025-09-26T20:24:10.221506] [INFO ] [MAIN ] NRK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:24:10.250176] [DEBUG] [LOCAL ] NRK: Loaded 19862 existing records from primary storage. [2025-09-26T20:24:10.250329] [INFO ] [MAIN ] NRK: Loaded 19862 existing records. [2025-09-26T20:24:10.319305] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-01. [2025-09-26T20:24:10.449414] [WARN ] [MAIN ] NRK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:24:10.449710] [INFO ] [MAIN ] NRK: Wiping existing primary data before full refresh. [2025-09-26T20:24:10.449769] [INFO ] [LOCAL ] NRK: Starting deletion of primary data. [2025-09-26T20:24:10.450424] [DEBUG] [LOCAL ] NRK: Deleted primary data file. [2025-09-26T20:24:10.450487] [INFO ] [MAIN ] NRK: Starting full primary refresh. [2025-09-26T20:24:10.844934] [INFO ] [REMOTE ] NRK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:24:11.093445] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-26T20:24:11.111682] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-09. [2025-09-26T20:24:11.911726] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-02. [2025-09-26T20:24:12.042693] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-26T20:24:12.633593] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-26T20:24:12.644959] [INFO ] [REMOTE ] NPWR: Full fetch complete (59221 records). [2025-09-26T20:24:12.645168] [DEBUG] [VALIDATOR ] NPWR: Validating primary data. [2025-09-26T20:24:12.717057] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-02. [2025-09-26T20:24:13.077729] [DEBUG] [VALIDATOR ] NPWR: All expected trading days are present. [2025-09-26T20:24:13.077832] [DEBUG] [VALIDATOR ] NPWR: Primary data validation passed. [2025-09-26T20:24:13.078843] [INFO ] [MAIN ] NPWR: Fetched primary data is valid. [2025-09-26T20:24:13.078913] [DEBUG] [LOCAL ] NPWR: Saving primary data. [2025-09-26T20:24:13.081340] [DEBUG] [LOCAL ] NPWR: Trimmed 59221 records to 43857 (keeping 200 days of data) [2025-09-26T20:24:13.362156] [DEBUG] [LOCAL ] NPWR: Primary data saved (43857 records). [2025-09-26T20:24:13.362327] [INFO ] [MAIN ] NPWR: Full history saved. [2025-09-26T20:24:13.362474] [INFO ] [MAIN ] Update Progress: 1529/2371 symbols completed. NPWR took 47.2s. Estimated remaining: 1h 52m 26s. Rate: 7.5 symbols/min [2025-09-26T20:24:13.525239] [INFO ] [REMOTE ] NRK: Fetching primary data for 2024-12. [2025-09-26T20:24:13.562100] [INFO ] [MAIN ] NRP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:24:13.569195] [DEBUG] [LOCAL ] NRP: Loaded 4098 existing records from primary storage. [2025-09-26T20:24:13.569356] [INFO ] [MAIN ] NRP: Loaded 4098 existing records. [2025-09-26T20:24:13.771721] [WARN ] [MAIN ] NRP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:24:13.772405] [INFO ] [MAIN ] NRP: Wiping existing primary data before full refresh. [2025-09-26T20:24:13.772612] [INFO ] [LOCAL ] NRP: Starting deletion of primary data. [2025-09-26T20:24:13.772958] [DEBUG] [LOCAL ] NRP: Deleted primary data file. [2025-09-26T20:24:13.773023] [INFO ] [MAIN ] NRP: Starting full primary refresh. [2025-09-26T20:24:14.194779] [INFO ] [REMOTE ] NRP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:24:14.248430] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-26T20:24:14.257034] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-09-26T20:24:14.311703] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-03. [2025-09-26T20:24:14.346461] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-26T20:24:15.111741] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-01. [2025-09-26T20:24:15.917154] [INFO ] [REMOTE ] NRP: Fetching primary data for 2024-12. [2025-09-26T20:24:15.936253] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-26T20:24:16.166694] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-26T20:24:16.633924] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-26T20:24:16.711753] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-02. [2025-09-26T20:24:17.511707] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-03. [2025-09-26T20:24:17.660980] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-26T20:24:18.311772] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-03. [2025-09-26T20:24:19.111696] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-01. [2025-09-26T20:24:19.490084] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-26T20:24:19.715450] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-26T20:24:19.716172] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-26T20:24:19.911759] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-04. [2025-09-26T20:24:20.711721] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-04. [2025-09-26T20:24:21.511688] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-02. [2025-09-26T20:24:22.069227] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-26T20:24:22.148077] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-26T20:24:22.311691] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-04. [2025-09-26T20:24:22.425611] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-26T20:24:23.111712] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-05. [2025-09-26T20:24:23.401023] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-26T20:24:23.911716] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-05. [2025-09-26T20:24:24.711691] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-03. [2025-09-26T20:24:25.095408] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-26T20:24:25.250199] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-26T20:24:25.371890] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-26T20:24:25.511703] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-06. [2025-09-26T20:24:26.311727] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-05. [2025-09-26T20:24:26.546079] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-26T20:24:27.111724] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-04. [2025-09-26T20:24:27.813361] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-26T20:24:27.870442] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-26T20:24:27.911718] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-06. [2025-09-26T20:24:28.711719] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-05. [2025-09-26T20:24:29.351891] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-26T20:24:29.511724] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-06. [2025-09-26T20:24:29.721059] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-26T20:24:30.253006] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-26T20:24:30.311722] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-07. [2025-09-26T20:24:31.111730] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-06. [2025-09-26T20:24:31.911691] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-07. [2025-09-26T20:24:32.463955] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-26T20:24:32.503536] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-26T20:24:32.676245] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-26T20:24:32.711737] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-07. [2025-09-26T20:24:33.511708] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-08. [2025-09-26T20:24:33.932285] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-26T20:24:34.099370] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-26T20:24:34.311735] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-07. [2025-09-26T20:24:35.111738] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-08. [2025-09-26T20:24:35.786610] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-26T20:24:35.911718] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-08. [2025-09-26T20:24:36.711742] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-09. [2025-09-26T20:24:36.982898] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-26T20:24:37.345382] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-26T20:24:37.346903] [INFO ] [REMOTE ] NRP: Full fetch complete (6481 records). [2025-09-26T20:24:37.346987] [DEBUG] [VALIDATOR ] NRP: Validating primary data. [2025-09-26T20:24:37.519457] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-09. [2025-09-26T20:24:37.750765] [DEBUG] [VALIDATOR ] NRP: All expected trading days are present. [2025-09-26T20:24:37.750876] [DEBUG] [VALIDATOR ] NRP: Primary data validation passed. [2025-09-26T20:24:37.751137] [INFO ] [MAIN ] NRP: Fetched primary data is valid. [2025-09-26T20:24:37.751255] [DEBUG] [LOCAL ] NRP: Saving primary data. [2025-09-26T20:24:37.752205] [DEBUG] [LOCAL ] NRP: Trimmed 6481 records to 4114 (keeping 200 days of data) [2025-09-26T20:24:37.780486] [DEBUG] [LOCAL ] NRP: Primary data saved (4114 records). [2025-09-26T20:24:37.780631] [INFO ] [MAIN ] NRP: Full history saved. [2025-09-26T20:24:37.780766] [INFO ] [MAIN ] Update Progress: 1530/2371 symbols completed. NRP took 24.4s. Estimated remaining: 1h 52m 27s. Rate: 7.5 symbols/min [2025-09-26T20:24:38.000878] [INFO ] [MAIN ] NRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:24:38.002945] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-26T20:24:38.021143] [DEBUG] [LOCAL ] NRT: Loaded 4906 existing records from primary storage. [2025-09-26T20:24:38.021401] [INFO ] [MAIN ] NRT: Loaded 4906 existing records. [2025-09-26T20:24:38.240161] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-26T20:24:38.238311] [WARN ] [MAIN ] NRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:24:38.250129] [INFO ] [MAIN ] NRT: Wiping existing primary data before full refresh. [2025-09-26T20:24:38.250514] [INFO ] [LOCAL ] NRT: Starting deletion of primary data. [2025-09-26T20:24:38.251143] [DEBUG] [LOCAL ] NRT: Deleted primary data file. [2025-09-26T20:24:38.251218] [INFO ] [MAIN ] NRT: Starting full primary refresh. [2025-09-26T20:24:38.251082] [INFO ] [REMOTE ] NRG: Full fetch complete (76196 records). [2025-09-26T20:24:38.312398] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-09. [2025-09-26T20:24:38.291375] [DEBUG] [VALIDATOR ] NRG: Validating primary data. [2025-09-26T20:24:38.364978] [FATAL] [VALIDATOR ] NRG: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T20:24:38.365255] [FATAL] [MAIN ] NRG: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:24:38.365714] [WARN ] [MAIN ] NRG: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:24:38.371421] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-09-26T20:24:38.392677] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-09-26T20:24:38.417068] [INFO ] [LOCAL ] NRG: Starting deletion of derivative data. [2025-09-26T20:24:38.426742] [DEBUG] [LOCAL ] NRG: No derivative data file found to delete. [2025-09-26T20:24:38.426925] [INFO ] [MAIN ] Update Progress: 1531/2371 symbols completed. NRG took 39.0s. Estimated remaining: 1h 52m 15s. Rate: 7.5 symbols/min [2025-09-26T20:24:38.863070] [INFO ] [REMOTE ] NRT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:24:38.865030] [INFO ] [MAIN ] NRUC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:24:38.870692] [DEBUG] [LOCAL ] NRUC: Loaded 3116 existing records from primary storage. [2025-09-26T20:24:38.870842] [INFO ] [MAIN ] NRUC: Loaded 3116 existing records. [2025-09-26T20:24:39.064862] [WARN ] [MAIN ] NRUC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:24:39.065122] [INFO ] [MAIN ] NRUC: Wiping existing primary data before full refresh. [2025-09-26T20:24:39.065168] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-09-26T20:24:39.065422] [DEBUG] [LOCAL ] NRUC: Deleted primary data file. [2025-09-26T20:24:39.065479] [INFO ] [MAIN ] NRUC: Starting full primary refresh. [2025-09-26T20:24:39.121583] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-08. [2025-09-26T20:24:39.429953] [INFO ] [REMOTE ] NRUC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:24:39.911702] [INFO ] [REMOTE ] NRT: Fetching primary data for 2024-12. [2025-09-26T20:24:40.294389] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-26T20:24:40.329759] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-26T20:24:40.340201] [INFO ] [REMOTE ] NRGV: Full fetch complete (61944 records). [2025-09-26T20:24:40.340377] [DEBUG] [VALIDATOR ] NRGV: Validating primary data. [2025-09-26T20:24:40.716829] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2024-12. [2025-09-26T20:24:40.854754] [DEBUG] [VALIDATOR ] NRGV: All expected trading days are present. [2025-09-26T20:24:40.855192] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-26T20:24:40.855277] [DEBUG] [VALIDATOR ] NRGV: Primary data validation passed. [2025-09-26T20:24:40.858779] [INFO ] [MAIN ] NRGV: Fetched primary data is valid. [2025-09-26T20:24:40.859343] [DEBUG] [LOCAL ] NRGV: Saving primary data. [2025-09-26T20:24:40.862569] [DEBUG] [LOCAL ] NRGV: Trimmed 61944 records to 43716 (keeping 200 days of data) [2025-09-26T20:24:41.121593] [DEBUG] [LOCAL ] NRGV: Primary data saved (43716 records). [2025-09-26T20:24:41.121763] [INFO ] [MAIN ] NRGV: Full history saved. [2025-09-26T20:24:41.121873] [INFO ] [MAIN ] Update Progress: 1532/2371 symbols completed. NRGV took 34.2s. Estimated remaining: 1h 52m 4s. Rate: 7.5 symbols/min [2025-09-26T20:24:41.310987] [INFO ] [MAIN ] NSA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:24:41.361206] [DEBUG] [LOCAL ] NSA: Loaded 45202 existing records from primary storage. [2025-09-26T20:24:41.361374] [INFO ] [MAIN ] NSA: Loaded 45202 existing records. [2025-09-26T20:24:41.515444] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-09. [2025-09-26T20:24:41.558149] [WARN ] [MAIN ] NSA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:24:41.558411] [INFO ] [MAIN ] NSA: Wiping existing primary data before full refresh. [2025-09-26T20:24:41.558462] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-09-26T20:24:41.559607] [DEBUG] [LOCAL ] NSA: Deleted primary data file. [2025-09-26T20:24:41.559707] [INFO ] [MAIN ] NSA: Starting full primary refresh. [2025-09-26T20:24:41.660802] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-26T20:24:42.036262] [INFO ] [REMOTE ] NSA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:24:42.311732] [INFO ] [REMOTE ] NSA: Fetching primary data for 2024-12. [2025-09-26T20:24:42.619515] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-26T20:24:42.625469] [INFO ] [REMOTE ] NRK: Full fetch complete (27795 records). [2025-09-26T20:24:42.625691] [DEBUG] [VALIDATOR ] NRK: Validating primary data. [2025-09-26T20:24:43.053475] [DEBUG] [VALIDATOR ] NRK: All expected trading days are present. [2025-09-26T20:24:43.053597] [DEBUG] [VALIDATOR ] NRK: Primary data validation passed. [2025-09-26T20:24:43.054214] [INFO ] [MAIN ] NRK: Fetched primary data is valid. [2025-09-26T20:24:43.054274] [DEBUG] [LOCAL ] NRK: Saving primary data. [2025-09-26T20:24:43.055501] [DEBUG] [LOCAL ] NRK: Trimmed 27795 records to 19991 (keeping 200 days of data) [2025-09-26T20:24:43.118300] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-01. [2025-09-26T20:24:43.194423] [DEBUG] [LOCAL ] NRK: Primary data saved (19991 records). [2025-09-26T20:24:43.194596] [INFO ] [MAIN ] NRK: Full history saved. [2025-09-26T20:24:43.194717] [INFO ] [MAIN ] Update Progress: 1533/2371 symbols completed. NRK took 33.2s. Estimated remaining: 1h 51m 53s. Rate: 7.5 symbols/min [2025-09-26T20:24:43.378019] [INFO ] [MAIN ] NSC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:24:43.378247] [DEBUG] [LOCAL ] NSC: No existing data file found in primary storage. [2025-09-26T20:24:43.378305] [WARN ] [MAIN ] NSC: No existing data found, performing full refresh instead. [2025-09-26T20:24:43.378476] [INFO ] [MAIN ] NSC: Wiping existing primary data before full refresh. [2025-09-26T20:24:43.378523] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-09-26T20:24:43.378575] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-09-26T20:24:43.378612] [INFO ] [MAIN ] NSC: Starting full primary refresh. [2025-09-26T20:24:43.773936] [INFO ] [REMOTE ] NSC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:24:43.911687] [INFO ] [REMOTE ] NSC: Fetching primary data for 2024-12. [2025-09-26T20:24:43.972160] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-26T20:24:44.162052] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-26T20:24:44.711768] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-01. [2025-09-26T20:24:45.511721] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-01. [2025-09-26T20:24:45.705384] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-26T20:24:46.130638] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-26T20:24:46.151138] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-26T20:24:46.311726] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-02. [2025-09-26T20:24:47.017300] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-26T20:24:47.111739] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-03. [2025-09-26T20:24:47.778630] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-26T20:24:47.911689] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-04. [2025-09-26T20:24:48.572732] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-26T20:24:48.711756] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-02. [2025-09-26T20:24:49.416858] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-26T20:24:49.511770] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-05. [2025-09-26T20:24:50.229622] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-26T20:24:50.311721] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-02. [2025-09-26T20:24:51.111721] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-06. [2025-09-26T20:24:51.720048] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-26T20:24:51.764229] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-26T20:24:51.911724] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-03. [2025-09-26T20:24:52.538054] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-26T20:24:52.711713] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-01. [2025-09-26T20:24:53.511704] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-07. [2025-09-26T20:24:54.156524] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-26T20:24:54.311731] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-04. [2025-09-26T20:24:54.606371] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-26T20:24:54.941337] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-26T20:24:55.111735] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-05. [2025-09-26T20:24:55.773782] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-26T20:24:55.911725] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-03. [2025-09-26T20:24:56.711727] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-06. [2025-09-26T20:24:57.245036] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-26T20:24:57.511768] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-02. [2025-09-26T20:24:57.573213] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-26T20:24:58.311737] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-04. [2025-09-26T20:24:59.111720] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-07. [2025-09-26T20:24:59.305575] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-26T20:24:59.701606] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-26T20:24:59.911692] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-08. [2025-09-26T20:25:00.002525] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-26T20:25:00.463858] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-26T20:25:00.711722] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-03. [2025-09-26T20:25:01.511723] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-08. [2025-09-26T20:25:02.126358] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-26T20:25:02.311715] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-09. [2025-09-26T20:25:02.804872] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-26T20:25:02.860935] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-26T20:25:02.862182] [INFO ] [REMOTE ] NRUC: Full fetch complete (5569 records). [2025-09-26T20:25:02.862257] [DEBUG] [VALIDATOR ] NRUC: Validating primary data. [2025-09-26T20:25:03.120233] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-09. [2025-09-26T20:25:03.264328] [DEBUG] [VALIDATOR ] NRUC: All expected trading days are present. [2025-09-26T20:25:03.264416] [DEBUG] [VALIDATOR ] NRUC: Primary data validation passed. [2025-09-26T20:25:03.264588] [INFO ] [MAIN ] NRUC: Fetched primary data is valid. [2025-09-26T20:25:03.264629] [DEBUG] [LOCAL ] NRUC: Saving primary data. [2025-09-26T20:25:03.265067] [DEBUG] [LOCAL ] NRUC: Trimmed 5569 records to 3136 (keeping 200 days of data) [2025-09-26T20:25:03.284560] [DEBUG] [LOCAL ] NRUC: Primary data saved (3136 records). [2025-09-26T20:25:03.284676] [INFO ] [MAIN ] NRUC: Full history saved. [2025-09-26T20:25:03.284792] [INFO ] [MAIN ] Update Progress: 1534/2371 symbols completed. NRUC took 24.8s. Estimated remaining: 1h 51m 51s. Rate: 7.5 symbols/min [2025-09-26T20:25:03.465919] [INFO ] [MAIN ] NSP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:25:03.516334] [DEBUG] [LOCAL ] NSP: Loaded 35210 existing records from primary storage. [2025-09-26T20:25:03.516503] [INFO ] [MAIN ] NSP: Loaded 35210 existing records. [2025-09-26T20:25:03.728183] [WARN ] [MAIN ] NSP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:25:03.728477] [INFO ] [MAIN ] NSP: Wiping existing primary data before full refresh. [2025-09-26T20:25:03.728530] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-09-26T20:25:03.729516] [DEBUG] [LOCAL ] NSP: Deleted primary data file. [2025-09-26T20:25:03.729608] [INFO ] [MAIN ] NSP: Starting full primary refresh. [2025-09-26T20:25:03.922616] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-04. [2025-09-26T20:25:03.925574] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-26T20:25:03.944495] [INFO ] [REMOTE ] NRT: Full fetch complete (8070 records). [2025-09-26T20:25:03.980059] [DEBUG] [VALIDATOR ] NRT: Validating primary data. [2025-09-26T20:25:04.316944] [INFO ] [REMOTE ] NSP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:25:04.546347] [DEBUG] [VALIDATOR ] NRT: All expected trading days are present. [2025-09-26T20:25:04.546433] [DEBUG] [VALIDATOR ] NRT: Primary data validation passed. [2025-09-26T20:25:04.546684] [INFO ] [MAIN ] NRT: Fetched primary data is valid. [2025-09-26T20:25:04.546745] [DEBUG] [LOCAL ] NRT: Saving primary data. [2025-09-26T20:25:04.547292] [DEBUG] [LOCAL ] NRT: Trimmed 8070 records to 4994 (keeping 200 days of data) [2025-09-26T20:25:04.576960] [DEBUG] [LOCAL ] NRT: Primary data saved (4994 records). [2025-09-26T20:25:04.577092] [INFO ] [MAIN ] NRT: Full history saved. [2025-09-26T20:25:04.577183] [INFO ] [MAIN ] Update Progress: 1535/2371 symbols completed. NRT took 26.8s. Estimated remaining: 1h 51m 40s. Rate: 7.5 symbols/min [2025-09-26T20:25:04.721872] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-05. [2025-09-26T20:25:04.755707] [INFO ] [MAIN ] NTB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:25:04.778146] [DEBUG] [LOCAL ] NTB: Loaded 20819 existing records from primary storage. [2025-09-26T20:25:04.778282] [INFO ] [MAIN ] NTB: Loaded 20819 existing records. [2025-09-26T20:25:04.965144] [WARN ] [MAIN ] NTB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:25:04.965398] [INFO ] [MAIN ] NTB: Wiping existing primary data before full refresh. [2025-09-26T20:25:04.965449] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-09-26T20:25:04.966188] [DEBUG] [LOCAL ] NTB: Deleted primary data file. [2025-09-26T20:25:04.966250] [INFO ] [MAIN ] NTB: Starting full primary refresh. [2025-09-26T20:25:05.355170] [INFO ] [REMOTE ] NTB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:25:05.511689] [INFO ] [REMOTE ] NSP: Fetching primary data for 2024-12. [2025-09-26T20:25:05.798563] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-26T20:25:06.311712] [INFO ] [REMOTE ] NTB: Fetching primary data for 2024-12. [2025-09-26T20:25:06.378406] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-26T20:25:07.029034] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-26T20:25:07.111748] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-06. [2025-09-26T20:25:07.591932] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-26T20:25:07.911717] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-05. [2025-09-26T20:25:08.598969] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-26T20:25:08.711753] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-07. [2025-09-26T20:25:09.511695] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-01. [2025-09-26T20:25:09.584922] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-26T20:25:10.316839] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-01. [2025-09-26T20:25:10.341965] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-26T20:25:10.666714] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-26T20:25:11.111730] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-02. [2025-09-26T20:25:11.632964] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-26T20:25:11.911722] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-02. [2025-09-26T20:25:12.255813] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-26T20:25:12.711741] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-03. [2025-09-26T20:25:13.333914] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-26T20:25:13.511714] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-06. [2025-09-26T20:25:13.915951] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-26T20:25:14.311954] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-04. [2025-09-26T20:25:15.111733] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-08. [2025-09-26T20:25:15.241304] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-26T20:25:15.562082] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-26T20:25:15.911728] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-03. [2025-09-26T20:25:16.711749] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-05. [2025-09-26T20:25:16.927410] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-26T20:25:17.421864] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-26T20:25:17.511757] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-07. [2025-09-26T20:25:17.809452] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-26T20:25:18.311731] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-09. [2025-09-26T20:25:19.111703] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-06. [2025-09-26T20:25:19.455997] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-26T20:25:19.617337] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-26T20:25:19.627053] [INFO ] [REMOTE ] NSA: Full fetch complete (61877 records). [2025-09-26T20:25:19.627218] [DEBUG] [VALIDATOR ] NSA: Validating primary data. [2025-09-26T20:25:19.916924] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-04. [2025-09-26T20:25:20.093996] [DEBUG] [VALIDATOR ] NSA: All expected trading days are present. [2025-09-26T20:25:20.094252] [DEBUG] [VALIDATOR ] NSA: Primary data validation passed. [2025-09-26T20:25:20.096154] [INFO ] [MAIN ] NSA: Fetched primary data is valid. [2025-09-26T20:25:20.096704] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-26T20:25:20.097002] [DEBUG] [LOCAL ] NSA: Saving primary data. [2025-09-26T20:25:20.103860] [DEBUG] [LOCAL ] NSA: Trimmed 61877 records to 45528 (keeping 200 days of data) [2025-09-26T20:25:20.398346] [DEBUG] [LOCAL ] NSA: Primary data saved (45528 records). [2025-09-26T20:25:20.398524] [INFO ] [MAIN ] NSA: Full history saved. [2025-09-26T20:25:20.398697] [INFO ] [MAIN ] Update Progress: 1536/2371 symbols completed. NSA took 39.3s. Estimated remaining: 1h 51m 36s. Rate: 7.5 symbols/min [2025-09-26T20:25:20.580074] [INFO ] [MAIN ] NTEST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:25:20.580271] [DEBUG] [LOCAL ] NTEST: No existing data file found in primary storage. [2025-09-26T20:25:20.580310] [WARN ] [MAIN ] NTEST: No existing data found, performing full refresh instead. [2025-09-26T20:25:20.580461] [INFO ] [MAIN ] NTEST: Wiping existing primary data before full refresh. [2025-09-26T20:25:20.580518] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-09-26T20:25:20.580585] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-09-26T20:25:20.580620] [INFO ] [MAIN ] NTEST: Starting full primary refresh. [2025-09-26T20:25:20.716853] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-08. [2025-09-26T20:25:21.007215] [INFO ] [REMOTE ] NTEST: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:25:21.376914] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-26T20:25:21.511716] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-05. [2025-09-26T20:25:22.311727] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2024-12. [2025-09-26T20:25:22.786960] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-26T20:25:22.809829] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-26T20:25:23.066416] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-26T20:25:23.111747] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-09. [2025-09-26T20:25:23.916168] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-07. [2025-09-26T20:25:23.921892] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-26T20:25:23.931760] [INFO ] [REMOTE ] NSC: Full fetch complete (70742 records). [2025-09-26T20:25:23.931930] [DEBUG] [VALIDATOR ] NSC: Validating primary data. [2025-09-26T20:25:23.932725] [FATAL] [VALIDATOR ] NSC: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T20:25:23.932857] [FATAL] [MAIN ] NSC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:25:23.932914] [WARN ] [MAIN ] NSC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:25:23.932985] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-09-26T20:25:23.933070] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-09-26T20:25:23.933128] [INFO ] [LOCAL ] NSC: Starting deletion of derivative data. [2025-09-26T20:25:23.933199] [DEBUG] [LOCAL ] NSC: No derivative data file found to delete. [2025-09-26T20:25:23.933297] [INFO ] [MAIN ] Update Progress: 1537/2371 symbols completed. NSC took 40.7s. Estimated remaining: 1h 51m 25s. Rate: 7.5 symbols/min [2025-09-26T20:25:24.132774] [INFO ] [MAIN ] NTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:25:24.203415] [DEBUG] [LOCAL ] NTR: Loaded 52969 existing records from primary storage. [2025-09-26T20:25:24.203700] [INFO ] [MAIN ] NTR: Loaded 52969 existing records. [2025-09-26T20:25:24.427971] [WARN ] [MAIN ] NTR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:25:24.428323] [INFO ] [MAIN ] NTR: Wiping existing primary data before full refresh. [2025-09-26T20:25:24.428427] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-09-26T20:25:24.431868] [DEBUG] [LOCAL ] NTR: Deleted primary data file. [2025-09-26T20:25:24.431943] [INFO ] [MAIN ] NTR: Starting full primary refresh. [2025-09-26T20:25:24.718673] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-01. [2025-09-26T20:25:24.836204] [INFO ] [REMOTE ] NTR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:25:25.007365] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-26T20:25:25.511721] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-08. [2025-09-26T20:25:25.519021] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-26T20:25:26.311745] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-06. [2025-09-26T20:25:26.576012] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-26T20:25:27.111713] [INFO ] [REMOTE ] NTR: Fetching primary data for 2024-12. [2025-09-26T20:25:27.703815] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-26T20:25:27.911739] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-07. [2025-09-26T20:25:28.711729] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-09. [2025-09-26T20:25:29.008465] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-26T20:25:29.354853] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-26T20:25:29.511722] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-02. [2025-09-26T20:25:29.772834] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-26T20:25:29.777235] [INFO ] [REMOTE ] NTB: Full fetch complete (30829 records). [2025-09-26T20:25:29.777357] [DEBUG] [VALIDATOR ] NTB: Validating primary data. [2025-09-26T20:25:30.173926] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-26T20:25:30.187055] [DEBUG] [VALIDATOR ] NTB: All expected trading days are present. [2025-09-26T20:25:30.187126] [DEBUG] [VALIDATOR ] NTB: Primary data validation passed. [2025-09-26T20:25:30.187820] [INFO ] [MAIN ] NTB: Fetched primary data is valid. [2025-09-26T20:25:30.187883] [DEBUG] [LOCAL ] NTB: Saving primary data. [2025-09-26T20:25:30.188600] [DEBUG] [LOCAL ] NTB: Trimmed 30829 records to 20927 (keeping 200 days of data) [2025-09-26T20:25:30.311801] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-01. [2025-09-26T20:25:30.332462] [DEBUG] [LOCAL ] NTB: Primary data saved (20927 records). [2025-09-26T20:25:30.332586] [INFO ] [MAIN ] NTB: Full history saved. [2025-09-26T20:25:30.332718] [INFO ] [MAIN ] Update Progress: 1538/2371 symbols completed. NTB took 25.8s. Estimated remaining: 1h 51m 17s. Rate: 7.5 symbols/min [2025-09-26T20:25:30.510984] [INFO ] [MAIN ] NTST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:25:30.555928] [DEBUG] [LOCAL ] NTST: Loaded 43910 existing records from primary storage. [2025-09-26T20:25:30.556077] [INFO ] [MAIN ] NTST: Loaded 43910 existing records. [2025-09-26T20:25:30.744105] [WARN ] [MAIN ] NTST: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:25:30.744396] [INFO ] [MAIN ] NTST: Wiping existing primary data before full refresh. [2025-09-26T20:25:30.744457] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-09-26T20:25:30.745592] [DEBUG] [LOCAL ] NTST: Deleted primary data file. [2025-09-26T20:25:30.745690] [INFO ] [MAIN ] NTST: Starting full primary refresh. [2025-09-26T20:25:31.116809] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-08. [2025-09-26T20:25:31.155958] [INFO ] [REMOTE ] NTST: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:25:31.911745] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-03. [2025-09-26T20:25:32.235361] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-26T20:25:32.450288] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-26T20:25:32.711681] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-02. [2025-09-26T20:25:32.896173] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-26T20:25:33.511736] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-04. [2025-09-26T20:25:34.012187] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-26T20:25:34.311715] [INFO ] [REMOTE ] NTST: Fetching primary data for 2024-12. [2025-09-26T20:25:34.392594] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-26T20:25:35.111723] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-03. [2025-09-26T20:25:35.837834] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-26T20:25:35.911715] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-05. [2025-09-26T20:25:36.711711] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-01. [2025-09-26T20:25:36.994469] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-26T20:25:37.031953] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-26T20:25:37.511725] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-04. [2025-09-26T20:25:38.250221] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-26T20:25:38.311735] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-02. [2025-09-26T20:25:39.111755] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-09. [2025-09-26T20:25:39.578566] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-26T20:25:39.750422] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-26T20:25:39.911758] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-06. [2025-09-26T20:25:40.389207] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-26T20:25:40.397046] [INFO ] [REMOTE ] NSP: Full fetch complete (49532 records). [2025-09-26T20:25:40.397230] [DEBUG] [VALIDATOR ] NSP: Validating primary data. [2025-09-26T20:25:40.518429] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-26T20:25:40.716984] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-07. [2025-09-26T20:25:40.829306] [DEBUG] [VALIDATOR ] NSP: All expected trading days are present. [2025-09-26T20:25:40.829403] [DEBUG] [VALIDATOR ] NSP: Primary data validation passed. [2025-09-26T20:25:40.830325] [INFO ] [MAIN ] NSP: Fetched primary data is valid. [2025-09-26T20:25:40.830398] [DEBUG] [LOCAL ] NSP: Saving primary data. [2025-09-26T20:25:40.831712] [DEBUG] [LOCAL ] NSP: Trimmed 49532 records to 35480 (keeping 200 days of data) [2025-09-26T20:25:41.069439] [DEBUG] [LOCAL ] NSP: Primary data saved (35480 records). [2025-09-26T20:25:41.069602] [INFO ] [MAIN ] NSP: Full history saved. [2025-09-26T20:25:41.069723] [INFO ] [MAIN ] Update Progress: 1539/2371 symbols completed. NSP took 37.8s. Estimated remaining: 1h 51m 10s. Rate: 7.5 symbols/min [2025-09-26T20:25:41.250374] [INFO ] [MAIN ] NU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:25:41.310442] [DEBUG] [LOCAL ] NU: Loaded 54136 existing records from primary storage. [2025-09-26T20:25:41.310597] [INFO ] [MAIN ] NU: Loaded 54136 existing records. [2025-09-26T20:25:41.500144] [WARN ] [MAIN ] NU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:25:41.504441] [INFO ] [MAIN ] NU: Wiping existing primary data before full refresh. [2025-09-26T20:25:41.504185] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-26T20:25:41.504676] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-09-26T20:25:41.508434] [DEBUG] [LOCAL ] NU: Deleted primary data file. [2025-09-26T20:25:41.508499] [INFO ] [MAIN ] NU: Starting full primary refresh. [2025-09-26T20:25:41.521287] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-05. [2025-09-26T20:25:41.904405] [INFO ] [REMOTE ] NU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:25:42.311750] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-08. [2025-09-26T20:25:42.925857] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-26T20:25:43.111712] [INFO ] [REMOTE ] NU: Fetching primary data for 2024-12. [2025-09-26T20:25:43.398842] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-26T20:25:43.911755] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-03. [2025-09-26T20:25:44.711744] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-06. [2025-09-26T20:25:45.484530] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-26T20:25:45.511687] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-04. [2025-09-26T20:25:45.688451] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2024-12 (2.58 seconds). [2025-09-26T20:25:46.311722] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-09. [2025-09-26T20:25:46.631386] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-26T20:25:46.820120] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-26T20:25:47.079557] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-26T20:25:47.080392] [INFO ] [REMOTE ] NTEST: Full fetch complete (1986 records). [2025-09-26T20:25:47.080467] [DEBUG] [VALIDATOR ] NTEST: Validating primary data. [2025-09-26T20:25:47.116956] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-01. [2025-09-26T20:25:47.294984] [WARN ] [VALIDATOR ] NTEST: Validation failed - insufficient historical data. Have 168 unique days, need 200 days [2025-09-26T20:25:47.295212] [FATAL] [MAIN ] NTEST: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:25:47.295296] [WARN ] [MAIN ] NTEST: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:25:47.295410] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-09-26T20:25:47.295522] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-09-26T20:25:47.295593] [INFO ] [LOCAL ] NTEST: Starting deletion of derivative data. [2025-09-26T20:25:47.295695] [DEBUG] [LOCAL ] NTEST: No derivative data file found to delete. [2025-09-26T20:25:47.295812] [INFO ] [MAIN ] Update Progress: 1540/2371 symbols completed. NTEST took 26.9s. Estimated remaining: 1h 51m 1s. Rate: 7.5 symbols/min [2025-09-26T20:25:47.493941] [INFO ] [MAIN ] NUE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:25:47.494149] [DEBUG] [LOCAL ] NUE: No existing data file found in primary storage. [2025-09-26T20:25:47.494201] [WARN ] [MAIN ] NUE: No existing data found, performing full refresh instead. [2025-09-26T20:25:47.494373] [INFO ] [MAIN ] NUE: Wiping existing primary data before full refresh. [2025-09-26T20:25:47.494456] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-09-26T20:25:47.494537] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-09-26T20:25:47.494595] [INFO ] [MAIN ] NUE: Starting full primary refresh. [2025-09-26T20:25:47.916854] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-05. [2025-09-26T20:25:48.001408] [INFO ] [REMOTE ] NUE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:25:48.711797] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-07. [2025-09-26T20:25:49.249940] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-26T20:25:49.511745] [INFO ] [REMOTE ] NUE: Fetching primary data for 2024-12. [2025-09-26T20:25:49.637566] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-26T20:25:50.311691] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-02. [2025-09-26T20:25:50.577134] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-26T20:25:51.111738] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-08. [2025-09-26T20:25:51.670848] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-26T20:25:51.911723] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-01. [2025-09-26T20:25:52.538837] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-26T20:25:52.711735] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-06. [2025-09-26T20:25:52.782839] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-26T20:25:53.511706] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-09. [2025-09-26T20:25:53.842771] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-26T20:25:54.152424] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-26T20:25:54.311767] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-02. [2025-09-26T20:25:55.111731] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-03. [2025-09-26T20:25:55.321339] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-26T20:25:55.332391] [INFO ] [REMOTE ] NTR: Full fetch complete (76295 records). [2025-09-26T20:25:55.332547] [DEBUG] [VALIDATOR ] NTR: Validating primary data. [2025-09-26T20:25:55.798659] [DEBUG] [VALIDATOR ] NTR: All expected trading days are present. [2025-09-26T20:25:55.798807] [DEBUG] [VALIDATOR ] NTR: Primary data validation passed. [2025-09-26T20:25:55.799939] [INFO ] [MAIN ] NTR: Fetched primary data is valid. [2025-09-26T20:25:55.800026] [DEBUG] [LOCAL ] NTR: Saving primary data. [2025-09-26T20:25:55.801614] [DEBUG] [LOCAL ] NTR: Trimmed 76295 records to 53356 (keeping 200 days of data) [2025-09-26T20:25:55.911792] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-07. [2025-09-26T20:25:56.161601] [DEBUG] [LOCAL ] NTR: Primary data saved (53356 records). [2025-09-26T20:25:56.161803] [INFO ] [MAIN ] NTR: Full history saved. [2025-09-26T20:25:56.161912] [INFO ] [MAIN ] Update Progress: 1541/2371 symbols completed. NTR took 32.2s. Estimated remaining: 1h 50m 54s. Rate: 7.5 symbols/min [2025-09-26T20:25:56.356250] [INFO ] [MAIN ] NUS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:25:56.389082] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-26T20:25:56.430034] [DEBUG] [LOCAL ] NUS: Loaded 36728 existing records from primary storage. [2025-09-26T20:25:56.430200] [INFO ] [MAIN ] NUS: Loaded 36728 existing records. [2025-09-26T20:25:56.617509] [WARN ] [MAIN ] NUS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:25:56.617826] [INFO ] [MAIN ] NUS: Wiping existing primary data before full refresh. [2025-09-26T20:25:56.617876] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-09-26T20:25:56.618726] [DEBUG] [LOCAL ] NUS: Deleted primary data file. [2025-09-26T20:25:56.618787] [INFO ] [MAIN ] NUS: Starting full primary refresh. [2025-09-26T20:25:56.721274] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-03. [2025-09-26T20:25:57.015488] [INFO ] [REMOTE ] NUS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:25:57.172227] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-26T20:25:57.335567] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-26T20:25:57.511741] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-04. [2025-09-26T20:25:58.311717] [INFO ] [REMOTE ] NUS: Fetching primary data for 2024-12. [2025-09-26T20:25:58.741137] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-26T20:25:59.111731] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-08. [2025-09-26T20:25:59.757240] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-26T20:25:59.797376] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-26T20:25:59.911747] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-01. [2025-09-26T20:26:00.711725] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-05. [2025-09-26T20:26:01.085552] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-26T20:26:01.180302] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-26T20:26:01.511719] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-09. [2025-09-26T20:26:02.311724] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-04. [2025-09-26T20:26:03.105101] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-09-26T20:26:03.115957] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-02. [2025-09-26T20:26:03.146430] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-26T20:26:03.155906] [INFO ] [REMOTE ] NTST: Full fetch complete (60874 records). [2025-09-26T20:26:03.156054] [DEBUG] [VALIDATOR ] NTST: Validating primary data. [2025-09-26T20:26:03.565866] [DEBUG] [VALIDATOR ] NTST: All expected trading days are present. [2025-09-26T20:26:03.565971] [DEBUG] [VALIDATOR ] NTST: Primary data validation passed. [2025-09-26T20:26:03.567111] [INFO ] [MAIN ] NTST: Fetched primary data is valid. [2025-09-26T20:26:03.567184] [DEBUG] [LOCAL ] NTST: Saving primary data. [2025-09-26T20:26:03.568796] [DEBUG] [LOCAL ] NTST: Trimmed 60874 records to 44211 (keeping 200 days of data) [2025-09-26T20:26:03.846102] [DEBUG] [LOCAL ] NTST: Primary data saved (44211 records). [2025-09-26T20:26:03.846237] [INFO ] [MAIN ] NTST: Full history saved. [2025-09-26T20:26:03.846340] [INFO ] [MAIN ] Update Progress: 1542/2371 symbols completed. NTST took 33.5s. Estimated remaining: 1h 50m 45s. Rate: 7.5 symbols/min [2025-09-26T20:26:03.920315] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-06. [2025-09-26T20:26:04.041179] [INFO ] [MAIN ] NUV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:26:04.065774] [DEBUG] [LOCAL ] NUV: Loaded 23442 existing records from primary storage. [2025-09-26T20:26:04.065942] [INFO ] [MAIN ] NUV: Loaded 23442 existing records. [2025-09-26T20:26:04.270718] [WARN ] [MAIN ] NUV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:26:04.271741] [INFO ] [MAIN ] NUV: Wiping existing primary data before full refresh. [2025-09-26T20:26:04.271955] [INFO ] [LOCAL ] NUV: Starting deletion of primary data. [2025-09-26T20:26:04.272620] [DEBUG] [LOCAL ] NUV: Deleted primary data file. [2025-09-26T20:26:04.272722] [INFO ] [MAIN ] NUV: Starting full primary refresh. [2025-09-26T20:26:04.722474] [INFO ] [REMOTE ] NUV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:26:04.722905] [INFO ] [REMOTE ] NUV: Fetching primary data for 2024-12. [2025-09-26T20:26:04.774397] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-26T20:26:04.789533] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-26T20:26:05.511720] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-03. [2025-09-26T20:26:05.598154] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-26T20:26:06.172046] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-26T20:26:06.311732] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-05. [2025-09-26T20:26:07.023275] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-26T20:26:07.111722] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-04. [2025-09-26T20:26:07.911678] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-07. [2025-09-26T20:26:08.467967] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-26T20:26:08.706260] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-26T20:26:08.714619] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-01. [2025-09-26T20:26:09.511730] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-05. [2025-09-26T20:26:09.762792] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-26T20:26:09.890774] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-26T20:26:10.311752] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-06. [2025-09-26T20:26:11.073291] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-26T20:26:11.111694] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-06. [2025-09-26T20:26:11.911713] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-08. [2025-09-26T20:26:12.197818] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-26T20:26:12.383141] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-26T20:26:12.711741] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-07. [2025-09-26T20:26:13.511702] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-02. [2025-09-26T20:26:14.312032] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-07. [2025-09-26T20:26:14.359138] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-09-26T20:26:14.622757] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-26T20:26:14.883964] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-26T20:26:15.111764] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-09. [2025-09-26T20:26:15.639369] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-26T20:26:15.911719] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-08. [2025-09-26T20:26:16.711731] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-03. [2025-09-26T20:26:17.354106] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-26T20:26:17.366373] [INFO ] [REMOTE ] NU: Full fetch complete (77880 records). [2025-09-26T20:26:17.366553] [DEBUG] [VALIDATOR ] NU: Validating primary data. [2025-09-26T20:26:17.528177] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-08. [2025-09-26T20:26:17.823677] [DEBUG] [VALIDATOR ] NU: All expected trading days are present. [2025-09-26T20:26:17.825197] [DEBUG] [VALIDATOR ] NU: Primary data validation passed. [2025-09-26T20:26:17.825078] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-26T20:26:17.834329] [INFO ] [MAIN ] NU: Fetched primary data is valid. [2025-09-26T20:26:17.835121] [DEBUG] [LOCAL ] NU: Saving primary data. [2025-09-26T20:26:17.837094] [DEBUG] [LOCAL ] NU: Trimmed 77880 records to 54526 (keeping 200 days of data) [2025-09-26T20:26:17.948234] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-26T20:26:18.208584] [DEBUG] [LOCAL ] NU: Primary data saved (54526 records). [2025-09-26T20:26:18.208777] [INFO ] [MAIN ] NU: Full history saved. [2025-09-26T20:26:18.208887] [INFO ] [MAIN ] Update Progress: 1543/2371 symbols completed. NU took 37.1s. Estimated remaining: 1h 50m 41s. Rate: 7.5 symbols/min [2025-09-26T20:26:18.318994] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-09. [2025-09-26T20:26:18.399683] [INFO ] [MAIN ] NUVB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:26:18.457281] [DEBUG] [LOCAL ] NUVB: Loaded 51622 existing records from primary storage. [2025-09-26T20:26:18.457460] [INFO ] [MAIN ] NUVB: Loaded 51622 existing records. [2025-09-26T20:26:18.647022] [WARN ] [MAIN ] NUVB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:26:18.647371] [INFO ] [MAIN ] NUVB: Wiping existing primary data before full refresh. [2025-09-26T20:26:18.647426] [INFO ] [LOCAL ] NUVB: Starting deletion of primary data. [2025-09-26T20:26:18.648770] [DEBUG] [LOCAL ] NUVB: Deleted primary data file. [2025-09-26T20:26:18.648837] [INFO ] [MAIN ] NUVB: Starting full primary refresh. [2025-09-26T20:26:19.042337] [INFO ] [REMOTE ] NUVB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:26:19.111690] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2024-12. [2025-09-26T20:26:19.615132] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-26T20:26:19.915128] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-09. [2025-09-26T20:26:19.924364] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-26T20:26:19.932299] [INFO ] [REMOTE ] NUS: Full fetch complete (53938 records). [2025-09-26T20:26:19.932415] [DEBUG] [VALIDATOR ] NUS: Validating primary data. [2025-09-26T20:26:20.347178] [DEBUG] [VALIDATOR ] NUS: All expected trading days are present. [2025-09-26T20:26:20.347291] [DEBUG] [VALIDATOR ] NUS: Primary data validation passed. [2025-09-26T20:26:20.348165] [INFO ] [MAIN ] NUS: Fetched primary data is valid. [2025-09-26T20:26:20.348349] [DEBUG] [LOCAL ] NUS: Saving primary data. [2025-09-26T20:26:20.349904] [DEBUG] [LOCAL ] NUS: Trimmed 53938 records to 37005 (keeping 200 days of data) [2025-09-26T20:26:20.503579] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-26T20:26:20.638511] [DEBUG] [LOCAL ] NUS: Primary data saved (37005 records). [2025-09-26T20:26:20.638747] [INFO ] [MAIN ] NUS: Full history saved. [2025-09-26T20:26:20.638888] [INFO ] [MAIN ] Update Progress: 1544/2371 symbols completed. NUS took 24.5s. Estimated remaining: 1h 50m 30s. Rate: 7.5 symbols/min [2025-09-26T20:26:20.716458] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-01. [2025-09-26T20:26:20.838575] [INFO ] [MAIN ] NUW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:26:20.866527] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-26T20:26:20.879024] [INFO ] [REMOTE ] NUE: Full fetch complete (74538 records). [2025-09-26T20:26:20.879249] [DEBUG] [VALIDATOR ] NUE: Validating primary data. [2025-09-26T20:26:20.883898] [DEBUG] [LOCAL ] NUW: Loaded 7466 existing records from primary storage. [2025-09-26T20:26:20.884556] [FATAL] [VALIDATOR ] NUE: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T20:26:20.884933] [INFO ] [MAIN ] NUW: Loaded 7466 existing records. [2025-09-26T20:26:20.884844] [FATAL] [MAIN ] NUE: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:26:20.890218] [WARN ] [MAIN ] NUE: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:26:20.929477] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-09-26T20:26:20.957121] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-09-26T20:26:20.968392] [INFO ] [LOCAL ] NUE: Starting deletion of derivative data. [2025-09-26T20:26:20.988174] [DEBUG] [LOCAL ] NUE: No derivative data file found to delete. [2025-09-26T20:26:20.990948] [INFO ] [MAIN ] Update Progress: 1545/2371 symbols completed. NUE took 33.7s. Estimated remaining: 1h 50m 18s. Rate: 7.5 symbols/min [2025-09-26T20:26:21.271476] [WARN ] [MAIN ] NUW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:26:21.279061] [INFO ] [MAIN ] NUW: Wiping existing primary data before full refresh. [2025-09-26T20:26:21.280683] [INFO ] [LOCAL ] NUW: Starting deletion of primary data. [2025-09-26T20:26:21.300573] [INFO ] [MAIN ] NVG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:26:21.301759] [DEBUG] [LOCAL ] NUW: Deleted primary data file. [2025-09-26T20:26:21.301947] [INFO ] [MAIN ] NUW: Starting full primary refresh. [2025-09-26T20:26:21.528396] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-04. [2025-09-26T20:26:21.571913] [DEBUG] [LOCAL ] NVG: Loaded 27503 existing records from primary storage. [2025-09-26T20:26:21.581892] [INFO ] [MAIN ] NVG: Loaded 27503 existing records. [2025-09-26T20:26:21.927150] [INFO ] [REMOTE ] NUW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:26:21.969079] [WARN ] [MAIN ] NVG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:26:21.969484] [INFO ] [MAIN ] NVG: Wiping existing primary data before full refresh. [2025-09-26T20:26:21.969546] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-09-26T20:26:21.971083] [DEBUG] [LOCAL ] NVG: Deleted primary data file. [2025-09-26T20:26:21.971151] [INFO ] [MAIN ] NVG: Starting full primary refresh. [2025-09-26T20:26:22.316999] [INFO ] [REMOTE ] NUW: Fetching primary data for 2024-12. [2025-09-26T20:26:22.389212] [INFO ] [REMOTE ] NVG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:26:22.516527] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-26T20:26:22.963728] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-26T20:26:23.111697] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-02. [2025-09-26T20:26:23.193922] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-26T20:26:23.911737] [INFO ] [REMOTE ] NVG: Fetching primary data for 2024-12. [2025-09-26T20:26:24.711690] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-05. [2025-09-26T20:26:24.809194] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-26T20:26:25.428193] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-26T20:26:25.511711] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-01. [2025-09-26T20:26:25.841432] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-26T20:26:26.311724] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-03. [2025-09-26T20:26:26.834110] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-26T20:26:27.111741] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-01. [2025-09-26T20:26:27.911709] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-06. [2025-09-26T20:26:28.110993] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-26T20:26:28.145185] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-26T20:26:28.711724] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-02. [2025-09-26T20:26:28.982728] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-26T20:26:29.511709] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-02. [2025-09-26T20:26:29.703723] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-26T20:26:30.311730] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-04. [2025-09-26T20:26:30.415177] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-26T20:26:31.111720] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-03. [2025-09-26T20:26:31.911694] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-03. [2025-09-26T20:26:32.061176] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-26T20:26:32.358425] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-26T20:26:32.437482] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-26T20:26:32.711724] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-04. [2025-09-26T20:26:33.511720] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-04. [2025-09-26T20:26:34.311726] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-07. [2025-09-26T20:26:34.345729] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-26T20:26:34.424350] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-26T20:26:35.111719] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-05. [2025-09-26T20:26:35.541147] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-26T20:26:35.911712] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-08. [2025-09-26T20:26:36.711733] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-05. [2025-09-26T20:26:36.873886] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-26T20:26:36.927081] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-26T20:26:37.511706] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-09. [2025-09-26T20:26:37.543159] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-26T20:26:38.311717] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-05. [2025-09-26T20:26:38.440924] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-26T20:26:38.447764] [INFO ] [REMOTE ] NUV: Full fetch complete (34393 records). [2025-09-26T20:26:38.447898] [DEBUG] [VALIDATOR ] NUV: Validating primary data. [2025-09-26T20:26:38.866613] [DEBUG] [VALIDATOR ] NUV: All expected trading days are present. [2025-09-26T20:26:38.867156] [DEBUG] [VALIDATOR ] NUV: Primary data validation passed. [2025-09-26T20:26:38.868007] [INFO ] [MAIN ] NUV: Fetched primary data is valid. [2025-09-26T20:26:38.868075] [DEBUG] [LOCAL ] NUV: Saving primary data. [2025-09-26T20:26:38.869195] [DEBUG] [LOCAL ] NUV: Trimmed 34393 records to 23576 (keeping 200 days of data) [2025-09-26T20:26:39.039223] [DEBUG] [LOCAL ] NUV: Primary data saved (23576 records). [2025-09-26T20:26:39.039427] [INFO ] [MAIN ] NUV: Full history saved. [2025-09-26T20:26:39.039578] [INFO ] [MAIN ] Update Progress: 1546/2371 symbols completed. NUV took 35.2s. Estimated remaining: 1h 50m 15s. Rate: 7.5 symbols/min [2025-09-26T20:26:39.118101] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-06. [2025-09-26T20:26:39.218860] [INFO ] [MAIN ] NVGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:26:39.258908] [DEBUG] [LOCAL ] NVGS: Loaded 31272 existing records from primary storage. [2025-09-26T20:26:39.259116] [INFO ] [MAIN ] NVGS: Loaded 31272 existing records. [2025-09-26T20:26:39.456105] [WARN ] [MAIN ] NVGS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:26:39.456501] [INFO ] [MAIN ] NVGS: Wiping existing primary data before full refresh. [2025-09-26T20:26:39.456767] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-09-26T20:26:39.457958] [DEBUG] [LOCAL ] NVGS: Deleted primary data file. [2025-09-26T20:26:39.458026] [INFO ] [MAIN ] NVGS: Starting full primary refresh. [2025-09-26T20:26:39.684582] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-26T20:26:39.875010] [INFO ] [REMOTE ] NVGS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:26:39.911675] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2024-12. [2025-09-26T20:26:40.711736] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-06. [2025-09-26T20:26:40.928249] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-26T20:26:40.955438] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-26T20:26:41.511712] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-06. [2025-09-26T20:26:41.523298] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-26T20:26:42.311888] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-07. [2025-09-26T20:26:42.780921] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-26T20:26:42.981794] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-26T20:26:43.111762] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-08. [2025-09-26T20:26:43.777451] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-26T20:26:43.911748] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-07. [2025-09-26T20:26:44.711772] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-01. [2025-09-26T20:26:45.511772] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-07. [2025-09-26T20:26:46.044705] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-26T20:26:46.183174] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-26T20:26:46.311762] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-08. [2025-09-26T20:26:46.456265] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-26T20:26:47.111725] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-08. [2025-09-26T20:26:47.911764] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-09. [2025-09-26T20:26:48.278149] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-26T20:26:48.380057] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-26T20:26:48.382811] [INFO ] [REMOTE ] NUW: Full fetch complete (11748 records). [2025-09-26T20:26:48.382931] [DEBUG] [VALIDATOR ] NUW: Validating primary data. [2025-09-26T20:26:48.498606] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-26T20:26:48.717023] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-09. [2025-09-26T20:26:48.831999] [DEBUG] [VALIDATOR ] NUW: All expected trading days are present. [2025-09-26T20:26:48.832092] [DEBUG] [VALIDATOR ] NUW: Primary data validation passed. [2025-09-26T20:26:48.832444] [INFO ] [MAIN ] NUW: Fetched primary data is valid. [2025-09-26T20:26:48.832491] [DEBUG] [LOCAL ] NUW: Saving primary data. [2025-09-26T20:26:48.833169] [DEBUG] [LOCAL ] NUW: Trimmed 11748 records to 7512 (keeping 200 days of data) [2025-09-26T20:26:48.886132] [DEBUG] [LOCAL ] NUW: Primary data saved (7512 records). [2025-09-26T20:26:48.886282] [INFO ] [MAIN ] NUW: Full history saved. [2025-09-26T20:26:48.886398] [INFO ] [MAIN ] Update Progress: 1547/2371 symbols completed. NUW took 28.2s. Estimated remaining: 1h 50m 8s. Rate: 7.5 symbols/min [2025-09-26T20:26:49.068232] [INFO ] [MAIN ] NVO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:26:49.142421] [DEBUG] [LOCAL ] NVO: Loaded 54174 existing records from primary storage. [2025-09-26T20:26:49.142582] [INFO ] [MAIN ] NVO: Loaded 54174 existing records. [2025-09-26T20:26:49.331618] [WARN ] [MAIN ] NVO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:26:49.331899] [INFO ] [MAIN ] NVO: Wiping existing primary data before full refresh. [2025-09-26T20:26:49.331991] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-09-26T20:26:49.333380] [DEBUG] [LOCAL ] NVO: Deleted primary data file. [2025-09-26T20:26:49.333443] [INFO ] [MAIN ] NVO: Starting full primary refresh. [2025-09-26T20:26:49.517353] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-09. [2025-09-26T20:26:49.716314] [INFO ] [REMOTE ] NVO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:26:50.311762] [INFO ] [REMOTE ] NVO: Fetching primary data for 2024-12. [2025-09-26T20:26:50.876293] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-26T20:26:50.905951] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-26T20:26:50.912923] [INFO ] [REMOTE ] NVG: Full fetch complete (40728 records). [2025-09-26T20:26:50.912772] [INFO ] [REMOTE ] NUVB: Full fetch complete (72677 records). [2025-09-26T20:26:50.913173] [DEBUG] [VALIDATOR ] NVG: Validating primary data. [2025-09-26T20:26:50.913447] [DEBUG] [VALIDATOR ] NUVB: Validating primary data. [2025-09-26T20:26:51.124098] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-02. [2025-09-26T20:26:51.831833] [DEBUG] [VALIDATOR ] NUVB: All expected trading days are present. [2025-09-26T20:26:51.831989] [DEBUG] [VALIDATOR ] NVG: All expected trading days are present. [2025-09-26T20:26:51.832067] [DEBUG] [VALIDATOR ] NVG: Primary data validation passed. [2025-09-26T20:26:51.832526] [INFO ] [MAIN ] NVG: Fetched primary data is valid. [2025-09-26T20:26:51.832128] [DEBUG] [VALIDATOR ] NUVB: Primary data validation passed. [2025-09-26T20:26:51.832636] [DEBUG] [LOCAL ] NVG: Saving primary data. [2025-09-26T20:26:51.833978] [INFO ] [MAIN ] NUVB: Fetched primary data is valid. [2025-09-26T20:26:51.834062] [DEBUG] [LOCAL ] NUVB: Saving primary data. [2025-09-26T20:26:51.835844] [DEBUG] [LOCAL ] NVG: Trimmed 40728 records to 27703 (keeping 200 days of data) [2025-09-26T20:26:51.836593] [DEBUG] [LOCAL ] NUVB: Trimmed 72677 records to 51998 (keeping 200 days of data) [2025-09-26T20:26:52.130833] [DEBUG] [LOCAL ] NVG: Primary data saved (27703 records). [2025-09-26T20:26:52.131494] [INFO ] [MAIN ] NVG: Full history saved. [2025-09-26T20:26:52.131956] [INFO ] [MAIN ] Update Progress: 1548/2371 symbols completed. NVG took 31.1s. Estimated remaining: 1h 49m 57s. Rate: 7.5 symbols/min [2025-09-26T20:26:52.336593] [INFO ] [MAIN ] NVR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:26:52.465212] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-26T20:26:52.474523] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-03. [2025-09-26T20:26:52.474064] [DEBUG] [LOCAL ] NVR: Loaded 19212 existing records from primary storage. [2025-09-26T20:26:52.476597] [INFO ] [MAIN ] NVR: Loaded 19212 existing records. [2025-09-26T20:26:52.688522] [WARN ] [MAIN ] NVR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:26:52.690884] [INFO ] [MAIN ] NVR: Wiping existing primary data before full refresh. [2025-09-26T20:26:52.692004] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-09-26T20:26:52.694303] [DEBUG] [LOCAL ] NVR: Deleted primary data file. [2025-09-26T20:26:52.694394] [INFO ] [MAIN ] NVR: Starting full primary refresh. [2025-09-26T20:26:53.131044] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2024-12 (2.82 seconds). [2025-09-26T20:26:53.229872] [INFO ] [REMOTE ] NVR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:26:53.221413] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-01. [2025-09-26T20:26:53.249365] [DEBUG] [LOCAL ] NUVB: Primary data saved (51998 records). [2025-09-26T20:26:53.249547] [INFO ] [MAIN ] NUVB: Full history saved. [2025-09-26T20:26:53.249688] [INFO ] [MAIN ] Update Progress: 1549/2371 symbols completed. NUVB took 35.0s. Estimated remaining: 1h 49m 46s. Rate: 7.5 symbols/min [2025-09-26T20:26:53.429197] [INFO ] [MAIN ] NVRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:26:53.469234] [DEBUG] [LOCAL ] NVRI: Loaded 39056 existing records from primary storage. [2025-09-26T20:26:53.469427] [INFO ] [MAIN ] NVRI: Loaded 39056 existing records. [2025-09-26T20:26:53.526155] [INFO ] [REMOTE ] NVR: Fetching primary data for 2024-12. [2025-09-26T20:26:53.690611] [WARN ] [MAIN ] NVRI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:26:53.690913] [INFO ] [MAIN ] NVRI: Wiping existing primary data before full refresh. [2025-09-26T20:26:53.690963] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-09-26T20:26:53.691749] [DEBUG] [LOCAL ] NVRI: Deleted primary data file. [2025-09-26T20:26:53.691810] [INFO ] [MAIN ] NVRI: Starting full primary refresh. [2025-09-26T20:26:54.095673] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-26T20:26:54.101766] [INFO ] [REMOTE ] NVRI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:26:54.311733] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-04. [2025-09-26T20:26:54.797517] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-26T20:26:55.111747] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2024-12. [2025-09-26T20:26:55.712988] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-26T20:26:55.916806] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-05. [2025-09-26T20:26:55.933671] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-01 (2.71 seconds). [2025-09-26T20:26:56.711692] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-01. [2025-09-26T20:26:56.864167] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-26T20:26:57.341894] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-26T20:26:57.514005] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-02. [2025-09-26T20:26:57.517829] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-26T20:26:58.311777] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-01. [2025-09-26T20:26:59.111722] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-06. [2025-09-26T20:26:59.746488] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-26T20:26:59.816251] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-26T20:26:59.911722] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-03. [2025-09-26T20:27:00.493199] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-26T20:27:00.711728] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-07. [2025-09-26T20:27:01.511737] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-02. [2025-09-26T20:27:02.311752] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-02. [2025-09-26T20:27:02.442123] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-09-26T20:27:02.604576] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-26T20:27:02.688985] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-26T20:27:03.111728] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-08. [2025-09-26T20:27:03.772754] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-26T20:27:03.911702] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-04. [2025-09-26T20:27:04.447667] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-26T20:27:04.711721] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-03. [2025-09-26T20:27:05.511702] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-09. [2025-09-26T20:27:06.006281] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-26T20:27:06.311697] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-03. [2025-09-26T20:27:06.639314] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-26T20:27:06.664610] [INFO ] [REMOTE ] NVGS: Full fetch complete (41500 records). [2025-09-26T20:27:06.678078] [DEBUG] [VALIDATOR ] NVGS: Validating primary data. [2025-09-26T20:27:06.680808] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-09-26T20:27:07.094847] [DEBUG] [VALIDATOR ] NVGS: All expected trading days are present. [2025-09-26T20:27:07.094966] [DEBUG] [VALIDATOR ] NVGS: Primary data validation passed. [2025-09-26T20:27:07.096263] [INFO ] [MAIN ] NVGS: Fetched primary data is valid. [2025-09-26T20:27:07.096326] [DEBUG] [LOCAL ] NVGS: Saving primary data. [2025-09-26T20:27:07.097547] [DEBUG] [LOCAL ] NVGS: Trimmed 41500 records to 31403 (keeping 200 days of data) [2025-09-26T20:27:07.159153] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-04. [2025-09-26T20:27:07.311465] [DEBUG] [LOCAL ] NVGS: Primary data saved (31403 records). [2025-09-26T20:27:07.311703] [INFO ] [MAIN ] NVGS: Full history saved. [2025-09-26T20:27:07.311829] [INFO ] [MAIN ] Update Progress: 1550/2371 symbols completed. NVGS took 28.3s. Estimated remaining: 1h 49m 41s. Rate: 7.5 symbols/min [2025-09-26T20:27:07.503283] [INFO ] [MAIN ] NVS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:27:07.565860] [DEBUG] [LOCAL ] NVS: Loaded 51965 existing records from primary storage. [2025-09-26T20:27:07.566093] [INFO ] [MAIN ] NVS: Loaded 51965 existing records. [2025-09-26T20:27:07.775195] [WARN ] [MAIN ] NVS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:27:07.775770] [INFO ] [MAIN ] NVS: Wiping existing primary data before full refresh. [2025-09-26T20:27:07.775892] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-09-26T20:27:07.786157] [DEBUG] [LOCAL ] NVS: Deleted primary data file. [2025-09-26T20:27:07.798954] [INFO ] [MAIN ] NVS: Starting full primary refresh. [2025-09-26T20:27:07.865494] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T20:27:07.913731] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-05. [2025-09-26T20:27:08.215457] [INFO ] [REMOTE ] NVS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:27:08.473367] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-26T20:27:08.711727] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-05. [2025-09-26T20:27:09.511735] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-04. [2025-09-26T20:27:09.895932] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-26T20:27:10.311727] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-06. [2025-09-26T20:27:10.911528] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-05 (3.00 seconds). [2025-09-26T20:27:11.111745] [INFO ] [REMOTE ] NVS: Fetching primary data for 2024-12. [2025-09-26T20:27:11.148512] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-26T20:27:11.209976] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-26T20:27:11.911750] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-05. [2025-09-26T20:27:12.711737] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-06. [2025-09-26T20:27:12.866143] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-26T20:27:13.473132] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-26T20:27:13.511679] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-07. [2025-09-26T20:27:14.311757] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-06. [2025-09-26T20:27:14.682834] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-26T20:27:15.111719] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-01. [2025-09-26T20:27:15.392552] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-06 (2.68 seconds). [2025-09-26T20:27:15.851894] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-26T20:27:15.911732] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-07. [2025-09-26T20:27:16.711697] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-08. [2025-09-26T20:27:16.885847] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-26T20:27:17.378842] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-26T20:27:17.511734] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-08. [2025-09-26T20:27:17.783021] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-26T20:27:18.311765] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-09. [2025-09-26T20:27:19.111813] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-07. [2025-09-26T20:27:19.260180] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-26T20:27:19.365750] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-26T20:27:19.370356] [INFO ] [REMOTE ] NVR: Full fetch complete (29768 records). [2025-09-26T20:27:19.370480] [DEBUG] [VALIDATOR ] NVR: Validating primary data. [2025-09-26T20:27:19.789019] [DEBUG] [VALIDATOR ] NVR: All expected trading days are present. [2025-09-26T20:27:19.789118] [DEBUG] [VALIDATOR ] NVR: Primary data validation passed. [2025-09-26T20:27:19.789903] [INFO ] [MAIN ] NVR: Fetched primary data is valid. [2025-09-26T20:27:19.789970] [DEBUG] [LOCAL ] NVR: Saving primary data. [2025-09-26T20:27:19.791042] [DEBUG] [LOCAL ] NVR: Trimmed 29768 records to 19323 (keeping 200 days of data) [2025-09-26T20:27:19.911961] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-02. [2025-09-26T20:27:19.932505] [DEBUG] [LOCAL ] NVR: Primary data saved (19323 records). [2025-09-26T20:27:19.932754] [INFO ] [MAIN ] NVR: Full history saved. [2025-09-26T20:27:19.932887] [INFO ] [MAIN ] Update Progress: 1551/2371 symbols completed. NVR took 27.8s. Estimated remaining: 1h 49m 35s. Rate: 7.5 symbols/min [2025-09-26T20:27:20.107249] [INFO ] [MAIN ] NVST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:27:20.162925] [DEBUG] [LOCAL ] NVST: Loaded 51987 existing records from primary storage. [2025-09-26T20:27:20.163082] [INFO ] [MAIN ] NVST: Loaded 51987 existing records. [2025-09-26T20:27:20.351345] [WARN ] [MAIN ] NVST: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:27:20.351601] [INFO ] [MAIN ] NVST: Wiping existing primary data before full refresh. [2025-09-26T20:27:20.351678] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-09-26T20:27:20.352828] [DEBUG] [LOCAL ] NVST: Deleted primary data file. [2025-09-26T20:27:20.352889] [INFO ] [MAIN ] NVST: Starting full primary refresh. [2025-09-26T20:27:20.717089] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-09. [2025-09-26T20:27:20.747993] [INFO ] [REMOTE ] NVST: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:27:21.511698] [INFO ] [REMOTE ] NVST: Fetching primary data for 2024-12. [2025-09-26T20:27:21.721474] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-26T20:27:21.961287] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-07 (2.85 seconds). [2025-09-26T20:27:22.311907] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-03. [2025-09-26T20:27:22.423619] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-26T20:27:22.432522] [INFO ] [REMOTE ] NVRI: Full fetch complete (55836 records). [2025-09-26T20:27:22.432747] [DEBUG] [VALIDATOR ] NVRI: Validating primary data. [2025-09-26T20:27:22.842887] [DEBUG] [VALIDATOR ] NVRI: All expected trading days are present. [2025-09-26T20:27:22.843132] [DEBUG] [VALIDATOR ] NVRI: Primary data validation passed. [2025-09-26T20:27:22.844371] [INFO ] [MAIN ] NVRI: Fetched primary data is valid. [2025-09-26T20:27:22.844473] [DEBUG] [LOCAL ] NVRI: Saving primary data. [2025-09-26T20:27:22.846001] [DEBUG] [LOCAL ] NVRI: Trimmed 55836 records to 39367 (keeping 200 days of data) [2025-09-26T20:27:23.082146] [DEBUG] [LOCAL ] NVRI: Primary data saved (39367 records). [2025-09-26T20:27:23.082489] [INFO ] [MAIN ] NVRI: Full history saved. [2025-09-26T20:27:23.082860] [INFO ] [MAIN ] Update Progress: 1552/2371 symbols completed. NVRI took 29.8s. Estimated remaining: 1h 49m 25s. Rate: 7.5 symbols/min [2025-09-26T20:27:23.124763] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-08. [2025-09-26T20:27:23.203254] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-26T20:27:23.321405] [INFO ] [MAIN ] NVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:27:23.376664] [DEBUG] [LOCAL ] NVT: Loaded 51970 existing records from primary storage. [2025-09-26T20:27:23.376900] [INFO ] [MAIN ] NVT: Loaded 51970 existing records. [2025-09-26T20:27:23.555099] [WARN ] [MAIN ] NVT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:27:23.555371] [INFO ] [MAIN ] NVT: Wiping existing primary data before full refresh. [2025-09-26T20:27:23.555422] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-09-26T20:27:23.556722] [DEBUG] [LOCAL ] NVT: Deleted primary data file. [2025-09-26T20:27:23.556784] [INFO ] [MAIN ] NVT: Starting full primary refresh. [2025-09-26T20:27:23.918730] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-01. [2025-09-26T20:27:23.924480] [INFO ] [REMOTE ] NVT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:27:24.326429] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-26T20:27:24.711755] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-04. [2025-09-26T20:27:25.484927] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T20:27:25.511768] [INFO ] [REMOTE ] NVT: Fetching primary data for 2024-12. [2025-09-26T20:27:26.178100] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-08 (3.05 seconds). [2025-09-26T20:27:26.311744] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-02. [2025-09-26T20:27:26.575110] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-26T20:27:27.111706] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-05. [2025-09-26T20:27:27.323756] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-26T20:27:27.911717] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-01. [2025-09-26T20:27:27.963441] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-26T20:27:28.711731] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-03. [2025-09-26T20:27:29.092687] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-26T20:27:29.516832] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-06. [2025-09-26T20:27:29.530330] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-26T20:27:30.316827] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-09. [2025-09-26T20:27:30.338554] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-26T20:27:31.111712] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-04. [2025-09-26T20:27:31.399719] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-26T20:27:31.911731] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-07. [2025-09-26T20:27:32.711722] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-02. [2025-09-26T20:27:32.826044] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-09-26T20:27:32.837558] [INFO ] [REMOTE ] NVO: Full fetch complete (77955 records). [2025-09-26T20:27:32.837795] [DEBUG] [VALIDATOR ] NVO: Validating primary data. [2025-09-26T20:27:33.220820] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-26T20:27:33.322410] [DEBUG] [VALIDATOR ] NVO: All expected trading days are present. [2025-09-26T20:27:33.322507] [DEBUG] [VALIDATOR ] NVO: Primary data validation passed. [2025-09-26T20:27:33.323560] [INFO ] [MAIN ] NVO: Fetched primary data is valid. [2025-09-26T20:27:33.323632] [DEBUG] [LOCAL ] NVO: Saving primary data. [2025-09-26T20:27:33.326267] [DEBUG] [LOCAL ] NVO: Trimmed 77955 records to 54564 (keeping 200 days of data) [2025-09-26T20:27:33.517380] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-05. [2025-09-26T20:27:33.687302] [DEBUG] [LOCAL ] NVO: Primary data saved (54564 records). [2025-09-26T20:27:33.687458] [INFO ] [MAIN ] NVO: Full history saved. [2025-09-26T20:27:33.687560] [INFO ] [MAIN ] Update Progress: 1553/2371 symbols completed. NVO took 44.8s. Estimated remaining: 1h 49m 18s. Rate: 7.5 symbols/min [2025-09-26T20:27:33.875665] [INFO ] [MAIN ] NWG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:27:33.935560] [DEBUG] [LOCAL ] NWG: Loaded 51950 existing records from primary storage. [2025-09-26T20:27:33.935773] [INFO ] [MAIN ] NWG: Loaded 51950 existing records. [2025-09-26T20:27:34.170350] [WARN ] [MAIN ] NWG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:27:34.144931] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-26T20:27:34.182389] [INFO ] [MAIN ] NWG: Wiping existing primary data before full refresh. [2025-09-26T20:27:34.182878] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-09-26T20:27:34.184321] [DEBUG] [LOCAL ] NWG: Deleted primary data file. [2025-09-26T20:27:34.184393] [INFO ] [MAIN ] NWG: Starting full primary refresh. [2025-09-26T20:27:34.314130] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-08. [2025-09-26T20:27:34.589445] [INFO ] [REMOTE ] NWG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:27:34.622342] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-26T20:27:34.982044] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-26T20:27:35.111739] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-06. [2025-09-26T20:27:35.911784] [INFO ] [REMOTE ] NWG: Fetching primary data for 2024-12. [2025-09-26T20:27:36.227621] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-26T20:27:36.711710] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-09. [2025-09-26T20:27:36.881313] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-26T20:27:37.189443] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-26T20:27:37.511754] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-03. [2025-09-26T20:27:38.311685] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-07. [2025-09-26T20:27:38.425226] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-26T20:27:38.435014] [INFO ] [REMOTE ] NVS: Full fetch complete (74771 records). [2025-09-26T20:27:38.435165] [DEBUG] [VALIDATOR ] NVS: Validating primary data. [2025-09-26T20:27:38.853730] [DEBUG] [VALIDATOR ] NVS: All expected trading days are present. [2025-09-26T20:27:38.853824] [DEBUG] [VALIDATOR ] NVS: Primary data validation passed. [2025-09-26T20:27:38.854932] [INFO ] [MAIN ] NVS: Fetched primary data is valid. [2025-09-26T20:27:38.855013] [DEBUG] [LOCAL ] NVS: Saving primary data. [2025-09-26T20:27:38.856788] [DEBUG] [LOCAL ] NVS: Trimmed 74771 records to 52338 (keeping 200 days of data) [2025-09-26T20:27:39.139195] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-01. [2025-09-26T20:27:39.190623] [DEBUG] [LOCAL ] NVS: Primary data saved (52338 records). [2025-09-26T20:27:39.190819] [INFO ] [MAIN ] NVS: Full history saved. [2025-09-26T20:27:39.190919] [INFO ] [MAIN ] Update Progress: 1554/2371 symbols completed. NVS took 31.9s. Estimated remaining: 1h 49m 9s. Rate: 7.5 symbols/min [2025-09-26T20:27:39.391134] [INFO ] [MAIN ] NWN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:27:39.425080] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-26T20:27:39.458443] [DEBUG] [LOCAL ] NWN: Loaded 27059 existing records from primary storage. [2025-09-26T20:27:39.458591] [INFO ] [MAIN ] NWN: Loaded 27059 existing records. [2025-09-26T20:27:39.696698] [WARN ] [MAIN ] NWN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:27:39.697299] [INFO ] [MAIN ] NWN: Wiping existing primary data before full refresh. [2025-09-26T20:27:39.697408] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-09-26T20:27:39.698168] [DEBUG] [LOCAL ] NWN: Deleted primary data file. [2025-09-26T20:27:39.698232] [INFO ] [MAIN ] NWN: Starting full primary refresh. [2025-09-26T20:27:39.916843] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-04. [2025-09-26T20:27:40.074476] [INFO ] [REMOTE ] NWN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:27:40.104750] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-26T20:27:40.705052] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T20:27:40.714820] [INFO ] [REMOTE ] NWN: Fetching primary data for 2024-12. [2025-09-26T20:27:41.511707] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-02. [2025-09-26T20:27:41.864327] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-26T20:27:41.902574] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-26T20:27:42.311763] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-01. [2025-09-26T20:27:43.116756] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-05. [2025-09-26T20:27:43.135093] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-26T20:27:43.525563] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-26T20:27:43.911732] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-02. [2025-09-26T20:27:44.711726] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-08. [2025-09-26T20:27:45.035096] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-26T20:27:45.062110] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-26T20:27:45.511742] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-06. [2025-09-26T20:27:46.311698] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-03. [2025-09-26T20:27:46.516243] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-26T20:27:47.111718] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-09. [2025-09-26T20:27:47.294092] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-26T20:27:47.818687] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-26T20:27:47.911739] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-04. [2025-09-26T20:27:48.711737] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-03. [2025-09-26T20:27:48.775602] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-26T20:27:48.785687] [INFO ] [REMOTE ] NVST: Full fetch complete (74064 records). [2025-09-26T20:27:48.785884] [DEBUG] [VALIDATOR ] NVST: Validating primary data. [2025-09-26T20:27:49.215969] [DEBUG] [VALIDATOR ] NVST: All expected trading days are present. [2025-09-26T20:27:49.216115] [DEBUG] [VALIDATOR ] NVST: Primary data validation passed. [2025-09-26T20:27:49.217235] [INFO ] [MAIN ] NVST: Fetched primary data is valid. [2025-09-26T20:27:49.217328] [DEBUG] [LOCAL ] NVST: Saving primary data. [2025-09-26T20:27:49.238491] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-26T20:27:49.237607] [DEBUG] [LOCAL ] NVST: Trimmed 74064 records to 52381 (keeping 200 days of data) [2025-09-26T20:27:49.532863] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-07. [2025-09-26T20:27:49.582322] [DEBUG] [LOCAL ] NVST: Primary data saved (52381 records). [2025-09-26T20:27:49.582525] [INFO ] [MAIN ] NVST: Full history saved. [2025-09-26T20:27:49.582715] [INFO ] [MAIN ] Update Progress: 1555/2371 symbols completed. NVST took 29.6s. Estimated remaining: 1h 49m 2s. Rate: 7.5 symbols/min [2025-09-26T20:27:49.762578] [INFO ] [MAIN ] NX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:27:49.805064] [DEBUG] [LOCAL ] NX: Loaded 33642 existing records from primary storage. [2025-09-26T20:27:49.805263] [INFO ] [MAIN ] NX: Loaded 33642 existing records. [2025-09-26T20:27:49.997816] [WARN ] [MAIN ] NX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:27:49.998150] [INFO ] [MAIN ] NX: Wiping existing primary data before full refresh. [2025-09-26T20:27:49.998233] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-09-26T20:27:49.999209] [DEBUG] [LOCAL ] NX: Deleted primary data file. [2025-09-26T20:27:49.999272] [INFO ] [MAIN ] NX: Starting full primary refresh. [2025-09-26T20:27:50.316843] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-05. [2025-09-26T20:27:50.377313] [INFO ] [REMOTE ] NX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:27:50.628914] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-26T20:27:51.111721] [INFO ] [REMOTE ] NX: Fetching primary data for 2024-12. [2025-09-26T20:27:51.397353] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-26T20:27:51.729027] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-26T20:27:51.911735] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-04. [2025-09-26T20:27:52.711257] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-26T20:27:52.718406] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-06. [2025-09-26T20:27:53.511679] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-08. [2025-09-26T20:27:53.871764] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-26T20:27:53.989475] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-26T20:27:54.311746] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-05. [2025-09-26T20:27:55.111725] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-01. [2025-09-26T20:27:55.297117] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-26T20:27:55.911714] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-07. [2025-09-26T20:27:56.337899] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-26T20:27:56.492416] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-26T20:27:56.711712] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-02. [2025-09-26T20:27:57.239050] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-26T20:27:57.511726] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-09. [2025-09-26T20:27:58.157576] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-26T20:27:58.311737] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-03. [2025-09-26T20:27:59.111695] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-06. [2025-09-26T20:27:59.267586] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-26T20:27:59.277870] [INFO ] [REMOTE ] NVT: Full fetch complete (74542 records). [2025-09-26T20:27:59.278038] [DEBUG] [VALIDATOR ] NVT: Validating primary data. [2025-09-26T20:27:59.707058] [DEBUG] [VALIDATOR ] NVT: All expected trading days are present. [2025-09-26T20:27:59.707552] [DEBUG] [VALIDATOR ] NVT: Primary data validation passed. [2025-09-26T20:27:59.708590] [INFO ] [MAIN ] NVT: Fetched primary data is valid. [2025-09-26T20:27:59.708679] [DEBUG] [LOCAL ] NVT: Saving primary data. [2025-09-26T20:27:59.710195] [DEBUG] [LOCAL ] NVT: Trimmed 74542 records to 52330 (keeping 200 days of data) [2025-09-26T20:27:59.837602] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-26T20:27:59.932825] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-08. [2025-09-26T20:28:00.086760] [DEBUG] [LOCAL ] NVT: Primary data saved (52330 records). [2025-09-26T20:28:00.086936] [INFO ] [MAIN ] NVT: Full history saved. [2025-09-26T20:28:00.087049] [INFO ] [MAIN ] Update Progress: 1556/2371 symbols completed. NVT took 37.0s. Estimated remaining: 1h 48m 55s. Rate: 7.5 symbols/min [2025-09-26T20:28:00.267827] [INFO ] [MAIN ] NXC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:28:00.275239] [DEBUG] [LOCAL ] NXC: Loaded 4285 existing records from primary storage. [2025-09-26T20:28:00.275376] [INFO ] [MAIN ] NXC: Loaded 4285 existing records. [2025-09-26T20:28:00.467615] [WARN ] [MAIN ] NXC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:28:00.467892] [INFO ] [MAIN ] NXC: Wiping existing primary data before full refresh. [2025-09-26T20:28:00.467942] [INFO ] [LOCAL ] NXC: Starting deletion of primary data. [2025-09-26T20:28:00.468320] [DEBUG] [LOCAL ] NXC: Deleted primary data file. [2025-09-26T20:28:00.468383] [INFO ] [MAIN ] NXC: Starting full primary refresh. [2025-09-26T20:28:00.724924] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-04. [2025-09-26T20:28:00.889591] [INFO ] [REMOTE ] NXC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:28:01.095742] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-26T20:28:01.285761] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-26T20:28:01.511727] [INFO ] [REMOTE ] NXC: Fetching primary data for 2024-12. [2025-09-26T20:28:02.236266] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-26T20:28:02.289660] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-26T20:28:02.311683] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-01. [2025-09-26T20:28:02.786888] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-26T20:28:03.111740] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-09. [2025-09-26T20:28:03.911734] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-05. [2025-09-26T20:28:04.348952] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-26T20:28:04.353763] [INFO ] [REMOTE ] NWN: Full fetch complete (37200 records). [2025-09-26T20:28:04.353854] [DEBUG] [VALIDATOR ] NWN: Validating primary data. [2025-09-26T20:28:04.714727] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-02. [2025-09-26T20:28:04.748536] [DEBUG] [VALIDATOR ] NWN: All expected trading days are present. [2025-09-26T20:28:04.748625] [DEBUG] [VALIDATOR ] NWN: Primary data validation passed. [2025-09-26T20:28:04.749383] [INFO ] [MAIN ] NWN: Fetched primary data is valid. [2025-09-26T20:28:04.749436] [DEBUG] [LOCAL ] NWN: Saving primary data. [2025-09-26T20:28:04.750802] [DEBUG] [LOCAL ] NWN: Trimmed 37200 records to 27222 (keeping 200 days of data) [2025-09-26T20:28:04.924318] [DEBUG] [LOCAL ] NWN: Primary data saved (27222 records). [2025-09-26T20:28:04.924452] [INFO ] [MAIN ] NWN: Full history saved. [2025-09-26T20:28:04.924563] [INFO ] [MAIN ] Update Progress: 1557/2371 symbols completed. NWN took 25.7s. Estimated remaining: 1h 48m 46s. Rate: 7.5 symbols/min [2025-09-26T20:28:05.282318] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-26T20:28:05.443990] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-26T20:28:05.511704] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-03. [2025-09-26T20:28:06.171144] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-26T20:28:06.311732] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-07. [2025-09-26T20:28:07.111715] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-04. [2025-09-26T20:28:07.778669] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-26T20:28:07.911717] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-06. [2025-09-26T20:28:08.082147] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-26T20:28:08.711761] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-08. [2025-09-26T20:28:09.414040] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-26T20:28:09.511704] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-07. [2025-09-26T20:28:10.311733] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-05. [2025-09-26T20:28:10.621974] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-26T20:28:10.855043] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-26T20:28:10.965411] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-26T20:28:11.111745] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-08. [2025-09-26T20:28:11.911722] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-09. [2025-09-26T20:28:12.396501] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-26T20:28:12.711721] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-09. [2025-09-26T20:28:13.511706] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-06. [2025-09-26T20:28:13.665771] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-26T20:28:13.677146] [INFO ] [REMOTE ] NWG: Full fetch complete (73200 records). [2025-09-26T20:28:13.677326] [DEBUG] [VALIDATOR ] NWG: Validating primary data. [2025-09-26T20:28:14.128972] [DEBUG] [VALIDATOR ] NWG: All expected trading days are present. [2025-09-26T20:28:14.129144] [DEBUG] [VALIDATOR ] NWG: Primary data validation passed. [2025-09-26T20:28:14.130315] [INFO ] [MAIN ] NWG: Fetched primary data is valid. [2025-09-26T20:28:14.136118] [DEBUG] [LOCAL ] NWG: Saving primary data. [2025-09-26T20:28:14.137834] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-26T20:28:14.141820] [DEBUG] [LOCAL ] NWG: Trimmed 73200 records to 52318 (keeping 200 days of data) [2025-09-26T20:28:14.332852] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-07. [2025-09-26T20:28:14.403756] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-26T20:28:14.413708] [INFO ] [REMOTE ] NX: Full fetch complete (48410 records). [2025-09-26T20:28:14.415944] [DEBUG] [VALIDATOR ] NX: Validating primary data. [2025-09-26T20:28:14.874707] [DEBUG] [VALIDATOR ] NX: All expected trading days are present. [2025-09-26T20:28:14.875221] [DEBUG] [VALIDATOR ] NX: Primary data validation passed. [2025-09-26T20:28:14.877458] [INFO ] [MAIN ] NX: Fetched primary data is valid. [2025-09-26T20:28:14.878036] [DEBUG] [LOCAL ] NX: Saving primary data. [2025-09-26T20:28:14.883746] [DEBUG] [LOCAL ] NX: Trimmed 48410 records to 33894 (keeping 200 days of data) [2025-09-26T20:28:15.084312] [DEBUG] [LOCAL ] NWG: Primary data saved (52318 records). [2025-09-26T20:28:15.085347] [INFO ] [MAIN ] NWG: Full history saved. [2025-09-26T20:28:15.086338] [INFO ] [MAIN ] Update Progress: 1558/2371 symbols completed. NWG took 41.4s. Estimated remaining: 1h 48m 39s. Rate: 7.5 symbols/min [2025-09-26T20:28:15.191741] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-26T20:28:15.195320] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-08. [2025-09-26T20:28:15.228982] [DEBUG] [LOCAL ] NX: Primary data saved (33894 records). [2025-09-26T20:28:15.229203] [INFO ] [MAIN ] NX: Full history saved. [2025-09-26T20:28:15.229354] [INFO ] [MAIN ] Update Progress: 1559/2371 symbols completed. NX took 25.6s. Estimated remaining: 1h 48m 27s. Rate: 7.5 symbols/min [2025-09-26T20:28:15.783668] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-26T20:28:15.911740] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-09. [2025-09-26T20:28:16.558736] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-26T20:28:16.560426] [INFO ] [REMOTE ] NXC: Full fetch complete (6052 records). [2025-09-26T20:28:16.560499] [DEBUG] [VALIDATOR ] NXC: Validating primary data. [2025-09-26T20:28:16.977994] [DEBUG] [VALIDATOR ] NXC: All expected trading days are present. [2025-09-26T20:28:16.978095] [DEBUG] [VALIDATOR ] NXC: Primary data validation passed. [2025-09-26T20:28:16.978297] [INFO ] [MAIN ] NXC: Fetched primary data is valid. [2025-09-26T20:28:16.978339] [DEBUG] [LOCAL ] NXC: Saving primary data. [2025-09-26T20:28:16.978773] [DEBUG] [LOCAL ] NXC: Trimmed 6052 records to 4313 (keeping 200 days of data) [2025-09-26T20:28:17.005400] [DEBUG] [LOCAL ] NXC: Primary data saved (4313 records). [2025-09-26T20:28:17.005524] [INFO ] [MAIN ] NXC: Full history saved. [2025-09-26T20:28:17.005612] [INFO ] [MAIN ] Update Progress: 1560/2371 symbols completed. NXC took 16.9s. Estimated remaining: 1h 48m 15s. Rate: 7.5 symbols/min [2025-09-26T20:28:17.729978] [INFO ] [MAIN ] NXE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:28:17.746625] [INFO ] [MAIN ] NXDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:28:17.811811] [INFO ] [MAIN ] NXDR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:28:17.810311] [INFO ] [MAIN ] NXG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:28:17.812435] [DEBUG] [LOCAL ] NXDR: No existing data file found in primary storage. [2025-09-26T20:28:17.812590] [WARN ] [MAIN ] NXDR: No existing data found, performing full refresh instead. [2025-09-26T20:28:17.813326] [INFO ] [MAIN ] NXDR: Wiping existing primary data before full refresh. [2025-09-26T20:28:17.813382] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-09-26T20:28:17.813430] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-09-26T20:28:17.813730] [INFO ] [MAIN ] NXDR: Starting full primary refresh. [2025-09-26T20:28:17.923886] [DEBUG] [LOCAL ] NXG: Loaded 10539 existing records from primary storage. [2025-09-26T20:28:17.940387] [INFO ] [MAIN ] NXG: Loaded 10539 existing records. [2025-09-26T20:28:17.952461] [DEBUG] [LOCAL ] NXDT: Loaded 16464 existing records from primary storage. [2025-09-26T20:28:17.963791] [INFO ] [MAIN ] NXDT: Loaded 16464 existing records. [2025-09-26T20:28:18.477900] [DEBUG] [LOCAL ] NXE: Loaded 53375 existing records from primary storage. [2025-09-26T20:28:18.496160] [INFO ] [MAIN ] NXE: Loaded 53375 existing records. [2025-09-26T20:28:18.577031] [WARN ] [MAIN ] NXG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:28:18.656247] [WARN ] [MAIN ] NXDT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:28:18.727029] [INFO ] [MAIN ] NXDT: Wiping existing primary data before full refresh. [2025-09-26T20:28:18.709188] [INFO ] [MAIN ] NXG: Wiping existing primary data before full refresh. [2025-09-26T20:28:18.766994] [INFO ] [REMOTE ] NXDR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:28:18.787020] [INFO ] [LOCAL ] NXG: Starting deletion of primary data. [2025-09-26T20:28:18.787466] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2024-12. [2025-09-26T20:28:18.786810] [INFO ] [LOCAL ] NXDT: Starting deletion of primary data. [2025-09-26T20:28:18.815635] [DEBUG] [LOCAL ] NXG: Deleted primary data file. [2025-09-26T20:28:18.815732] [DEBUG] [LOCAL ] NXDT: Deleted primary data file. [2025-09-26T20:28:18.821503] [INFO ] [MAIN ] NXG: Starting full primary refresh. [2025-09-26T20:28:18.842111] [INFO ] [MAIN ] NXDT: Starting full primary refresh. [2025-09-26T20:28:19.039780] [WARN ] [MAIN ] NXE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:28:19.073208] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:28:19.100245] [INFO ] [MAIN ] NXE: Wiping existing primary data before full refresh. [2025-09-26T20:28:19.120733] [WARN ] [REMOTE ] NXDR: No data returned for month 2024-12 [2025-09-26T20:28:19.120570] [INFO ] [LOCAL ] NXE: Starting deletion of primary data. [2025-09-26T20:28:19.137386] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-01. [2025-09-26T20:28:19.257075] [DEBUG] [LOCAL ] NXE: Deleted primary data file. [2025-09-26T20:28:19.306680] [INFO ] [MAIN ] NXE: Starting full primary refresh. [2025-09-26T20:28:19.609365] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:28:19.637872] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-01 [2025-09-26T20:28:19.649055] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-02. [2025-09-26T20:28:19.886415] [INFO ] [REMOTE ] NXDT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:28:19.880724] [INFO ] [REMOTE ] NXG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:28:19.915200] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2024-12. [2025-09-26T20:28:19.914899] [INFO ] [REMOTE ] NXG: Fetching primary data for 2024-12. [2025-09-26T20:28:20.067494] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:28:20.078188] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-02 [2025-09-26T20:28:20.143509] [INFO ] [REMOTE ] NXE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:28:20.711725] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-03. [2025-09-26T20:28:20.836979] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-26T20:28:20.956771] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:28:20.957149] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-03 [2025-09-26T20:28:21.153886] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-26T20:28:21.511720] [INFO ] [REMOTE ] NXE: Fetching primary data for 2024-12. [2025-09-26T20:28:22.311718] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-01. [2025-09-26T20:28:23.111714] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-01. [2025-09-26T20:28:23.139076] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-26T20:28:23.343550] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-26T20:28:23.911721] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-01. [2025-09-26T20:28:24.408573] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-26T20:28:24.711734] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-04. [2025-09-26T20:28:24.973427] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:28:24.973818] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-04 [2025-09-26T20:28:25.511728] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-05. [2025-09-26T20:28:25.890155] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-26T20:28:26.192988] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:28:26.193369] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-05 [2025-09-26T20:28:26.311721] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-02. [2025-09-26T20:28:27.111730] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-06. [2025-09-26T20:28:27.356502] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:28:27.356992] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-06 [2025-09-26T20:28:27.395927] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-26T20:28:27.911728] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-02. [2025-09-26T20:28:28.663508] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-26T20:28:28.711724] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-07. [2025-09-26T20:28:29.511753] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-02. [2025-09-26T20:28:29.875097] [INFO ] [REMOTE ] NXDR: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-26T20:28:30.311739] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-08. [2025-09-26T20:28:31.111733] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-03. [2025-09-26T20:28:31.237040] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-26T20:28:31.911729] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-03. [2025-09-26T20:28:31.977470] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-26T20:28:32.138107] [INFO ] [REMOTE ] NXDR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-26T20:28:32.711692] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-09. [2025-09-26T20:28:33.038572] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-26T20:28:33.511734] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-04. [2025-09-26T20:28:34.311727] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-03. [2025-09-26T20:28:34.438849] [INFO ] [REMOTE ] NXDR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-26T20:28:34.448930] [INFO ] [REMOTE ] NXDR: Full fetch complete (17646 records). [2025-09-26T20:28:34.449183] [DEBUG] [VALIDATOR ] NXDR: Validating primary data. [2025-09-26T20:28:34.544451] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-26T20:28:34.653763] [WARN ] [VALIDATOR ] NXDR: Validation failed - insufficient historical data. Have 49 unique days, need 200 days [2025-09-26T20:28:34.654158] [FATAL] [MAIN ] NXDR: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:28:34.654248] [WARN ] [MAIN ] NXDR: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:28:34.654343] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-09-26T20:28:34.654467] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-09-26T20:28:34.654559] [INFO ] [LOCAL ] NXDR: Starting deletion of derivative data. [2025-09-26T20:28:34.654683] [DEBUG] [LOCAL ] NXDR: No derivative data file found to delete. [2025-09-26T20:28:34.654819] [INFO ] [MAIN ] Update Progress: 1561/2371 symbols completed. NXDR took 17.6s. Estimated remaining: 1h 48m 12s. Rate: 7.5 symbols/min [2025-09-26T20:28:34.835786] [INFO ] [MAIN ] NXJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:28:34.852847] [DEBUG] [LOCAL ] NXJ: Loaded 15011 existing records from primary storage. [2025-09-26T20:28:34.853010] [INFO ] [MAIN ] NXJ: Loaded 15011 existing records. [2025-09-26T20:28:35.042494] [WARN ] [MAIN ] NXJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:28:35.042942] [INFO ] [MAIN ] NXJ: Wiping existing primary data before full refresh. [2025-09-26T20:28:35.043018] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-09-26T20:28:35.044945] [DEBUG] [LOCAL ] NXJ: Deleted primary data file. [2025-09-26T20:28:35.045008] [INFO ] [MAIN ] NXJ: Starting full primary refresh. [2025-09-26T20:28:35.120944] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-05. [2025-09-26T20:28:35.510608] [INFO ] [REMOTE ] NXJ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:28:35.911776] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2024-12. [2025-09-26T20:28:35.952039] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-26T20:28:36.208116] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-26T20:28:36.711819] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-06. [2025-09-26T20:28:37.070177] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-26T20:28:37.508087] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-26T20:28:37.511636] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-07. [2025-09-26T20:28:38.311743] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-04. [2025-09-26T20:28:38.407483] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-26T20:28:39.111693] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-01. [2025-09-26T20:28:39.416383] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-26T20:28:39.911721] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-08. [2025-09-26T20:28:40.305762] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-26T20:28:40.711776] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-05. [2025-09-26T20:28:40.905330] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-26T20:28:41.511723] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-02. [2025-09-26T20:28:41.777863] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-26T20:28:42.311694] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-06. [2025-09-26T20:28:42.390900] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-26T20:28:43.111690] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-03. [2025-09-26T20:28:43.192844] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-26T20:28:43.911726] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-09. [2025-09-26T20:28:43.966674] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-26T20:28:44.553458] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-26T20:28:44.557328] [INFO ] [REMOTE ] NXG: Full fetch complete (14367 records). [2025-09-26T20:28:44.557421] [DEBUG] [VALIDATOR ] NXG: Validating primary data. [2025-09-26T20:28:44.716784] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-04. [2025-09-26T20:28:44.948726] [DEBUG] [VALIDATOR ] NXG: All expected trading days are present. [2025-09-26T20:28:44.948812] [DEBUG] [VALIDATOR ] NXG: Primary data validation passed. [2025-09-26T20:28:44.949191] [INFO ] [MAIN ] NXG: Fetched primary data is valid. [2025-09-26T20:28:44.949252] [DEBUG] [LOCAL ] NXG: Saving primary data. [2025-09-26T20:28:44.949902] [DEBUG] [LOCAL ] NXG: Trimmed 14367 records to 10647 (keeping 200 days of data) [2025-09-26T20:28:45.019444] [DEBUG] [LOCAL ] NXG: Primary data saved (10647 records). [2025-09-26T20:28:45.019622] [INFO ] [MAIN ] NXG: Full history saved. [2025-09-26T20:28:45.019754] [INFO ] [MAIN ] Update Progress: 1562/2371 symbols completed. NXG took 28.0s. Estimated remaining: 1h 48m 5s. Rate: 7.5 symbols/min [2025-09-26T20:28:45.197145] [INFO ] [MAIN ] NXN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:28:45.201725] [DEBUG] [LOCAL ] NXN: Loaded 2368 existing records from primary storage. [2025-09-26T20:28:45.201826] [INFO ] [MAIN ] NXN: Loaded 2368 existing records. [2025-09-26T20:28:45.393763] [WARN ] [MAIN ] NXN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:28:45.394023] [INFO ] [MAIN ] NXN: Wiping existing primary data before full refresh. [2025-09-26T20:28:45.394073] [INFO ] [LOCAL ] NXN: Starting deletion of primary data. [2025-09-26T20:28:45.394350] [DEBUG] [LOCAL ] NXN: Deleted primary data file. [2025-09-26T20:28:45.394426] [INFO ] [MAIN ] NXN: Starting full primary refresh. [2025-09-26T20:28:45.516798] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-04. [2025-09-26T20:28:45.785795] [INFO ] [REMOTE ] NXN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:28:46.311711] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-07. [2025-09-26T20:28:46.625078] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-26T20:28:46.715061] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-26T20:28:47.049322] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-26T20:28:47.111687] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-05. [2025-09-26T20:28:47.911725] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-05. [2025-09-26T20:28:48.101168] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-26T20:28:48.711786] [INFO ] [REMOTE ] NXN: Fetching primary data for 2024-12. [2025-09-26T20:28:49.424704] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-26T20:28:49.511716] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-06. [2025-09-26T20:28:49.894341] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-26T20:28:50.311703] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-01. [2025-09-26T20:28:50.399705] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-26T20:28:50.814794] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-26T20:28:51.111721] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-07. [2025-09-26T20:28:51.911723] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-06. [2025-09-26T20:28:52.391786] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-26T20:28:52.711745] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-02. [2025-09-26T20:28:53.228798] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-26T20:28:53.511705] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-08. [2025-09-26T20:28:53.820448] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-26T20:28:54.138233] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-26T20:28:54.311718] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-07. [2025-09-26T20:28:55.111743] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-08. [2025-09-26T20:28:55.911696] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-09. [2025-09-26T20:28:56.154542] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-26T20:28:56.213372] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-26T20:28:56.711699] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-03. [2025-09-26T20:28:56.847531] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-26T20:28:56.850748] [INFO ] [REMOTE ] NXDT: Full fetch complete (25582 records). [2025-09-26T20:28:56.850831] [DEBUG] [VALIDATOR ] NXDT: Validating primary data. [2025-09-26T20:28:57.178869] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-26T20:28:57.268206] [DEBUG] [VALIDATOR ] NXDT: All expected trading days are present. [2025-09-26T20:28:57.268299] [DEBUG] [VALIDATOR ] NXDT: Primary data validation passed. [2025-09-26T20:28:57.268852] [INFO ] [MAIN ] NXDT: Fetched primary data is valid. [2025-09-26T20:28:57.268917] [DEBUG] [LOCAL ] NXDT: Saving primary data. [2025-09-26T20:28:57.269829] [DEBUG] [LOCAL ] NXDT: Trimmed 25582 records to 16531 (keeping 200 days of data) [2025-09-26T20:28:57.369344] [DEBUG] [LOCAL ] NXDT: Primary data saved (16531 records). [2025-09-26T20:28:57.369507] [INFO ] [MAIN ] NXDT: Full history saved. [2025-09-26T20:28:57.369666] [INFO ] [MAIN ] Update Progress: 1563/2371 symbols completed. NXDT took 40.4s. Estimated remaining: 1h 47m 60s. Rate: 7.5 symbols/min [2025-09-26T20:28:57.520736] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-08. [2025-09-26T20:28:57.563049] [INFO ] [MAIN ] NXP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:28:57.582943] [DEBUG] [LOCAL ] NXP: Loaded 12391 existing records from primary storage. [2025-09-26T20:28:57.583091] [INFO ] [MAIN ] NXP: Loaded 12391 existing records. [2025-09-26T20:28:57.785724] [WARN ] [MAIN ] NXP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:28:57.786074] [INFO ] [MAIN ] NXP: Wiping existing primary data before full refresh. [2025-09-26T20:28:57.786126] [INFO ] [LOCAL ] NXP: Starting deletion of primary data. [2025-09-26T20:28:57.786731] [DEBUG] [LOCAL ] NXP: Deleted primary data file. [2025-09-26T20:28:57.786796] [INFO ] [MAIN ] NXP: Starting full primary refresh. [2025-09-26T20:28:58.177215] [INFO ] [REMOTE ] NXP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:28:58.311746] [INFO ] [REMOTE ] NXP: Fetching primary data for 2024-12. [2025-09-26T20:28:59.111696] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-09. [2025-09-26T20:28:59.206663] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-26T20:28:59.484007] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-26T20:28:59.722120] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-26T20:28:59.727042] [INFO ] [REMOTE ] NXJ: Full fetch complete (20978 records). [2025-09-26T20:28:59.727138] [DEBUG] [VALIDATOR ] NXJ: Validating primary data. [2025-09-26T20:28:59.920688] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-09. [2025-09-26T20:29:00.178701] [DEBUG] [VALIDATOR ] NXJ: All expected trading days are present. [2025-09-26T20:29:00.178789] [DEBUG] [VALIDATOR ] NXJ: Primary data validation passed. [2025-09-26T20:29:00.179229] [INFO ] [MAIN ] NXJ: Fetched primary data is valid. [2025-09-26T20:29:00.179269] [DEBUG] [LOCAL ] NXJ: Saving primary data. [2025-09-26T20:29:00.179910] [DEBUG] [LOCAL ] NXJ: Trimmed 20978 records to 15066 (keeping 200 days of data) [2025-09-26T20:29:00.300322] [DEBUG] [LOCAL ] NXJ: Primary data saved (15066 records). [2025-09-26T20:29:00.300692] [INFO ] [MAIN ] NXJ: Full history saved. [2025-09-26T20:29:00.301235] [INFO ] [MAIN ] Update Progress: 1564/2371 symbols completed. NXJ took 25.6s. Estimated remaining: 1h 47m 49s. Rate: 7.5 symbols/min [2025-09-26T20:29:00.500169] [INFO ] [MAIN ] NXRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:29:00.524812] [DEBUG] [LOCAL ] NXRT: Loaded 19162 existing records from primary storage. [2025-09-26T20:29:00.525016] [INFO ] [MAIN ] NXRT: Loaded 19162 existing records. [2025-09-26T20:29:00.715451] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-04. [2025-09-26T20:29:00.719943] [WARN ] [MAIN ] NXRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:29:00.723022] [INFO ] [MAIN ] NXRT: Wiping existing primary data before full refresh. [2025-09-26T20:29:00.723138] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-09-26T20:29:00.723880] [DEBUG] [LOCAL ] NXRT: Deleted primary data file. [2025-09-26T20:29:00.723960] [INFO ] [MAIN ] NXRT: Starting full primary refresh. [2025-09-26T20:29:01.120114] [INFO ] [REMOTE ] NXRT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:29:01.302430] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-26T20:29:01.511755] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-05. [2025-09-26T20:29:02.037191] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-26T20:29:02.081842] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-26T20:29:02.095849] [INFO ] [REMOTE ] NXE: Full fetch complete (76668 records). [2025-09-26T20:29:02.095996] [DEBUG] [VALIDATOR ] NXE: Validating primary data. [2025-09-26T20:29:02.320764] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-01. [2025-09-26T20:29:02.532261] [DEBUG] [VALIDATOR ] NXE: All expected trading days are present. [2025-09-26T20:29:02.532347] [DEBUG] [VALIDATOR ] NXE: Primary data validation passed. [2025-09-26T20:29:02.533358] [INFO ] [MAIN ] NXE: Fetched primary data is valid. [2025-09-26T20:29:02.533451] [DEBUG] [LOCAL ] NXE: Saving primary data. [2025-09-26T20:29:02.535718] [DEBUG] [LOCAL ] NXE: Trimmed 76668 records to 53762 (keeping 200 days of data) [2025-09-26T20:29:02.867491] [DEBUG] [LOCAL ] NXE: Primary data saved (53762 records). [2025-09-26T20:29:02.867714] [INFO ] [MAIN ] NXE: Full history saved. [2025-09-26T20:29:02.867944] [INFO ] [MAIN ] Update Progress: 1565/2371 symbols completed. NXE took 45.9s. Estimated remaining: 1h 47m 38s. Rate: 7.5 symbols/min [2025-09-26T20:29:03.052097] [INFO ] [MAIN ] NYC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:29:03.052261] [DEBUG] [LOCAL ] NYC: No existing data file found in primary storage. [2025-09-26T20:29:03.052299] [WARN ] [MAIN ] NYC: No existing data found, performing full refresh instead. [2025-09-26T20:29:03.052474] [INFO ] [MAIN ] NYC: Wiping existing primary data before full refresh. [2025-09-26T20:29:03.052519] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-09-26T20:29:03.052577] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-09-26T20:29:03.052635] [INFO ] [MAIN ] NYC: Starting full primary refresh. [2025-09-26T20:29:03.114464] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-06. [2025-09-26T20:29:03.373452] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-26T20:29:03.467219] [INFO ] [REMOTE ] NYC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:29:03.778711] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-26T20:29:03.911720] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-02. [2025-09-26T20:29:04.711702] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-07. [2025-09-26T20:29:04.781995] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-26T20:29:05.202312] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-26T20:29:05.511720] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2024-12. [2025-09-26T20:29:06.311735] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-03. [2025-09-26T20:29:06.449748] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-26T20:29:07.111763] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-08. [2025-09-26T20:29:07.117379] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-26T20:29:07.654250] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-26T20:29:07.911733] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-04. [2025-09-26T20:29:08.711726] [INFO ] [REMOTE ] NYC: Fetching primary data for 2024-12. [2025-09-26T20:29:08.929356] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-26T20:29:09.130242] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-26T20:29:09.511716] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-01. [2025-09-26T20:29:10.311700] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-01. [2025-09-26T20:29:10.401621] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-26T20:29:10.787698] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-26T20:29:11.111718] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-09. [2025-09-26T20:29:11.611143] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-26T20:29:11.612510] [INFO ] [REMOTE ] NXN: Full fetch complete (3673 records). [2025-09-26T20:29:11.612585] [DEBUG] [VALIDATOR ] NXN: Validating primary data. [2025-09-26T20:29:11.916910] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-05. [2025-09-26T20:29:12.001528] [DEBUG] [VALIDATOR ] NXN: All expected trading days are present. [2025-09-26T20:29:12.001618] [DEBUG] [VALIDATOR ] NXN: Primary data validation passed. [2025-09-26T20:29:12.001786] [INFO ] [MAIN ] NXN: Fetched primary data is valid. [2025-09-26T20:29:12.001841] [DEBUG] [LOCAL ] NXN: Saving primary data. [2025-09-26T20:29:12.002299] [DEBUG] [LOCAL ] NXN: Trimmed 3673 records to 2376 (keeping 200 days of data) [2025-09-26T20:29:12.018917] [DEBUG] [LOCAL ] NXN: Primary data saved (2376 records). [2025-09-26T20:29:12.019017] [INFO ] [MAIN ] NXN: Full history saved. [2025-09-26T20:29:12.019123] [INFO ] [MAIN ] Update Progress: 1566/2371 symbols completed. NXN took 27.0s. Estimated remaining: 1h 47m 31s. Rate: 7.5 symbols/min [2025-09-26T20:29:12.203813] [INFO ] [MAIN ] NYT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:29:12.274748] [DEBUG] [LOCAL ] NYT: Loaded 50259 existing records from primary storage. [2025-09-26T20:29:12.274897] [INFO ] [MAIN ] NYT: Loaded 50259 existing records. [2025-09-26T20:29:12.461199] [WARN ] [MAIN ] NYT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:29:12.461450] [INFO ] [MAIN ] NYT: Wiping existing primary data before full refresh. [2025-09-26T20:29:12.461497] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-09-26T20:29:12.462729] [DEBUG] [LOCAL ] NYT: Deleted primary data file. [2025-09-26T20:29:12.462792] [INFO ] [MAIN ] NYT: Starting full primary refresh. [2025-09-26T20:29:12.716844] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-02. [2025-09-26T20:29:12.860577] [INFO ] [REMOTE ] NYT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:29:12.861948] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-26T20:29:13.511748] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-02. [2025-09-26T20:29:13.788499] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-26T20:29:14.004276] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-26T20:29:14.311723] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-06. [2025-09-26T20:29:15.111730] [INFO ] [REMOTE ] NYT: Fetching primary data for 2024-12. [2025-09-26T20:29:15.198715] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-26T20:29:15.911722] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-03. [2025-09-26T20:29:16.697481] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-26T20:29:16.711678] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-01. [2025-09-26T20:29:16.745893] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-26T20:29:17.511751] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-04. [2025-09-26T20:29:18.311773] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-07. [2025-09-26T20:29:18.399272] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-26T20:29:18.657532] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-26T20:29:19.111694] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-03. [2025-09-26T20:29:19.321337] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-26T20:29:19.650127] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-26T20:29:19.911737] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-05. [2025-09-26T20:29:20.711702] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-08. [2025-09-26T20:29:20.984073] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-26T20:29:21.511738] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-02. [2025-09-26T20:29:21.531098] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-26T20:29:22.311718] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-06. [2025-09-26T20:29:23.111694] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-04. [2025-09-26T20:29:23.239816] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-26T20:29:23.351266] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-26T20:29:23.496217] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-26T20:29:23.911719] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-09. [2025-09-26T20:29:24.711745] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-03. [2025-09-26T20:29:24.815122] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-26T20:29:24.818300] [INFO ] [REMOTE ] NXP: Full fetch complete (16685 records). [2025-09-26T20:29:24.818379] [DEBUG] [VALIDATOR ] NXP: Validating primary data. [2025-09-26T20:29:25.212345] [DEBUG] [VALIDATOR ] NXP: All expected trading days are present. [2025-09-26T20:29:25.212428] [DEBUG] [VALIDATOR ] NXP: Primary data validation passed. [2025-09-26T20:29:25.212980] [INFO ] [MAIN ] NXP: Fetched primary data is valid. [2025-09-26T20:29:25.213049] [DEBUG] [LOCAL ] NXP: Saving primary data. [2025-09-26T20:29:25.213615] [DEBUG] [LOCAL ] NXP: Trimmed 16685 records to 12465 (keeping 200 days of data) [2025-09-26T20:29:25.303878] [DEBUG] [LOCAL ] NXP: Primary data saved (12465 records). [2025-09-26T20:29:25.304029] [INFO ] [MAIN ] NXP: Full history saved. [2025-09-26T20:29:25.304168] [INFO ] [MAIN ] Update Progress: 1567/2371 symbols completed. NXP took 27.9s. Estimated remaining: 1h 47m 25s. Rate: 7.5 symbols/min [2025-09-26T20:29:25.481566] [INFO ] [MAIN ] NZF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:29:25.511728] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-07. [2025-09-26T20:29:25.537487] [DEBUG] [LOCAL ] NZF: Loaded 29224 existing records from primary storage. [2025-09-26T20:29:25.537665] [INFO ] [MAIN ] NZF: Loaded 29224 existing records. [2025-09-26T20:29:25.725865] [WARN ] [MAIN ] NZF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:29:25.726151] [INFO ] [MAIN ] NZF: Wiping existing primary data before full refresh. [2025-09-26T20:29:25.726221] [INFO ] [LOCAL ] NZF: Starting deletion of primary data. [2025-09-26T20:29:25.727079] [DEBUG] [LOCAL ] NZF: Deleted primary data file. [2025-09-26T20:29:25.727175] [INFO ] [MAIN ] NZF: Starting full primary refresh. [2025-09-26T20:29:26.101212] [INFO ] [REMOTE ] NZF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:29:26.311721] [INFO ] [REMOTE ] NZF: Fetching primary data for 2024-12. [2025-09-26T20:29:26.514682] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-26T20:29:26.607413] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-26T20:29:27.111721] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-05. [2025-09-26T20:29:27.533109] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-26T20:29:27.781451] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-26T20:29:27.911726] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-08. [2025-09-26T20:29:28.711719] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-06. [2025-09-26T20:29:29.076078] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-26T20:29:29.240583] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-26T20:29:29.511726] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-09. [2025-09-26T20:29:30.311680] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-07. [2025-09-26T20:29:30.674079] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-26T20:29:30.678284] [INFO ] [REMOTE ] NXRT: Full fetch complete (25276 records). [2025-09-26T20:29:30.678367] [DEBUG] [VALIDATOR ] NXRT: Validating primary data. [2025-09-26T20:29:30.793958] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-26T20:29:31.073547] [DEBUG] [VALIDATOR ] NXRT: All expected trading days are present. [2025-09-26T20:29:31.073631] [DEBUG] [VALIDATOR ] NXRT: Primary data validation passed. [2025-09-26T20:29:31.074260] [INFO ] [MAIN ] NXRT: Fetched primary data is valid. [2025-09-26T20:29:31.074313] [DEBUG] [LOCAL ] NXRT: Saving primary data. [2025-09-26T20:29:31.075811] [DEBUG] [LOCAL ] NXRT: Trimmed 25276 records to 19307 (keeping 200 days of data) [2025-09-26T20:29:31.133777] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-01. [2025-09-26T20:29:31.206066] [DEBUG] [LOCAL ] NXRT: Primary data saved (19307 records). [2025-09-26T20:29:31.206221] [INFO ] [MAIN ] NXRT: Full history saved. [2025-09-26T20:29:31.206311] [INFO ] [MAIN ] Update Progress: 1568/2371 symbols completed. NXRT took 30.9s. Estimated remaining: 1h 47m 16s. Rate: 7.5 symbols/min [2025-09-26T20:29:31.381776] [INFO ] [MAIN ] O: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:29:31.381946] [DEBUG] [LOCAL ] O: No existing data file found in primary storage. [2025-09-26T20:29:31.381985] [WARN ] [MAIN ] O: No existing data found, performing full refresh instead. [2025-09-26T20:29:31.382127] [INFO ] [MAIN ] O: Wiping existing primary data before full refresh. [2025-09-26T20:29:31.382170] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-09-26T20:29:31.382212] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-09-26T20:29:31.382244] [INFO ] [MAIN ] O: Starting full primary refresh. [2025-09-26T20:29:31.756540] [INFO ] [REMOTE ] O: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:29:31.911726] [INFO ] [REMOTE ] O: Fetching primary data for 2024-12. [2025-09-26T20:29:32.485260] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-26T20:29:32.711740] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-08. [2025-09-26T20:29:33.123995] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-26T20:29:33.511725] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-02. [2025-09-26T20:29:34.311723] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-04. [2025-09-26T20:29:34.707040] [INFO ] [REMOTE ] O: Incremental fetch complete for 2024-12 (2.80 seconds). [2025-09-26T20:29:34.939116] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-26T20:29:35.111727] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-03. [2025-09-26T20:29:35.650591] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-26T20:29:35.911733] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-09. [2025-09-26T20:29:36.001439] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-26T20:29:36.418712] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-26T20:29:36.419772] [INFO ] [REMOTE ] NYC: Full fetch complete (1919 records). [2025-09-26T20:29:36.419845] [DEBUG] [VALIDATOR ] NYC: Validating primary data. [2025-09-26T20:29:36.624431] [WARN ] [VALIDATOR ] NYC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-26T20:29:36.624697] [FATAL] [MAIN ] NYC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:29:36.624801] [WARN ] [MAIN ] NYC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:29:36.624895] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-09-26T20:29:36.624999] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-09-26T20:29:36.625072] [INFO ] [LOCAL ] NYC: Starting deletion of derivative data. [2025-09-26T20:29:36.625165] [DEBUG] [LOCAL ] NYC: No derivative data file found to delete. [2025-09-26T20:29:36.625288] [INFO ] [MAIN ] Update Progress: 1569/2371 symbols completed. NYC took 33.8s. Estimated remaining: 1h 47m 7s. Rate: 7.5 symbols/min [2025-09-26T20:29:36.716805] [INFO ] [REMOTE ] O: Fetching primary data for 2025-01. [2025-09-26T20:29:36.840101] [INFO ] [MAIN ] OBDC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:29:36.908322] [DEBUG] [LOCAL ] OBDC: Loaded 52042 existing records from primary storage. [2025-09-26T20:29:36.908470] [INFO ] [MAIN ] OBDC: Loaded 52042 existing records. [2025-09-26T20:29:37.095200] [WARN ] [MAIN ] OBDC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:29:37.095473] [INFO ] [MAIN ] OBDC: Wiping existing primary data before full refresh. [2025-09-26T20:29:37.095524] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-09-26T20:29:37.096978] [DEBUG] [LOCAL ] OBDC: Deleted primary data file. [2025-09-26T20:29:37.097044] [INFO ] [MAIN ] OBDC: Starting full primary refresh. [2025-09-26T20:29:37.470608] [INFO ] [REMOTE ] OBDC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:29:37.511674] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-05. [2025-09-26T20:29:38.311732] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-04. [2025-09-26T20:29:39.111715] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2024-12. [2025-09-26T20:29:39.265330] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-26T20:29:39.428343] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-01 (2.71 seconds). [2025-09-26T20:29:39.463518] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-26T20:29:39.911734] [INFO ] [REMOTE ] O: Fetching primary data for 2025-02. [2025-09-26T20:29:40.711729] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-05. [2025-09-26T20:29:40.789843] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-26T20:29:41.511719] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-01. [2025-09-26T20:29:41.892328] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-26T20:29:42.253415] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-09-26T20:29:42.311755] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-06. [2025-09-26T20:29:43.111703] [INFO ] [REMOTE ] O: Fetching primary data for 2025-03. [2025-09-26T20:29:43.368123] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-26T20:29:43.560533] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-26T20:29:43.911721] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-06. [2025-09-26T20:29:44.711752] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-02. [2025-09-26T20:29:45.252546] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-26T20:29:45.511738] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-07. [2025-09-26T20:29:45.773539] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-09-26T20:29:46.311702] [INFO ] [REMOTE ] O: Fetching primary data for 2025-04. [2025-09-26T20:29:46.450364] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-26T20:29:47.111702] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-03. [2025-09-26T20:29:47.497355] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-26T20:29:47.911716] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-08. [2025-09-26T20:29:48.711749] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-07. [2025-09-26T20:29:49.050596] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-26T20:29:49.094309] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-04 (2.78 seconds). [2025-09-26T20:29:49.374765] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-26T20:29:49.511714] [INFO ] [REMOTE ] O: Fetching primary data for 2025-05. [2025-09-26T20:29:50.134946] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-26T20:29:50.311725] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-04. [2025-09-26T20:29:51.111734] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-09. [2025-09-26T20:29:51.911721] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-08. [2025-09-26T20:29:52.137581] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-26T20:29:52.150570] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-09-26T20:29:52.238811] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-26T20:29:52.248731] [INFO ] [REMOTE ] NYT: Full fetch complete (72089 records). [2025-09-26T20:29:52.248880] [DEBUG] [VALIDATOR ] NYT: Validating primary data. [2025-09-26T20:29:52.652742] [DEBUG] [VALIDATOR ] NYT: All expected trading days are present. [2025-09-26T20:29:52.652840] [DEBUG] [VALIDATOR ] NYT: Primary data validation passed. [2025-09-26T20:29:52.653830] [INFO ] [MAIN ] NYT: Fetched primary data is valid. [2025-09-26T20:29:52.653897] [DEBUG] [LOCAL ] NYT: Saving primary data. [2025-09-26T20:29:52.657366] [DEBUG] [LOCAL ] NYT: Trimmed 72089 records to 50645 (keeping 200 days of data) [2025-09-26T20:29:52.718942] [INFO ] [REMOTE ] O: Fetching primary data for 2025-06. [2025-09-26T20:29:52.999286] [DEBUG] [LOCAL ] NYT: Primary data saved (50645 records). [2025-09-26T20:29:52.999534] [INFO ] [MAIN ] NYT: Full history saved. [2025-09-26T20:29:52.999751] [INFO ] [MAIN ] Update Progress: 1570/2371 symbols completed. NYT took 41.0s. Estimated remaining: 1h 47m 3s. Rate: 7.5 symbols/min [2025-09-26T20:29:53.186690] [INFO ] [MAIN ] OBK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:29:53.207844] [DEBUG] [LOCAL ] OBK: Loaded 16432 existing records from primary storage. [2025-09-26T20:29:53.208021] [INFO ] [MAIN ] OBK: Loaded 16432 existing records. [2025-09-26T20:29:53.339455] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-26T20:29:53.420736] [WARN ] [MAIN ] OBK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:29:53.421091] [INFO ] [MAIN ] OBK: Wiping existing primary data before full refresh. [2025-09-26T20:29:53.421142] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-09-26T20:29:53.421867] [DEBUG] [LOCAL ] OBK: Deleted primary data file. [2025-09-26T20:29:53.421930] [INFO ] [MAIN ] OBK: Starting full primary refresh. [2025-09-26T20:29:53.516928] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-05. [2025-09-26T20:29:53.796742] [INFO ] [REMOTE ] OBK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:29:54.311745] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-09. [2025-09-26T20:29:55.111785] [INFO ] [REMOTE ] OBK: Fetching primary data for 2024-12. [2025-09-26T20:29:55.321850] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-09-26T20:29:55.447533] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-26T20:29:55.729490] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-26T20:29:55.735745] [INFO ] [REMOTE ] NZF: Full fetch complete (43550 records). [2025-09-26T20:29:55.735900] [DEBUG] [VALIDATOR ] NZF: Validating primary data. [2025-09-26T20:29:55.924337] [INFO ] [REMOTE ] O: Fetching primary data for 2025-07. [2025-09-26T20:29:56.150520] [DEBUG] [VALIDATOR ] NZF: All expected trading days are present. [2025-09-26T20:29:56.150628] [DEBUG] [VALIDATOR ] NZF: Primary data validation passed. [2025-09-26T20:29:56.151458] [INFO ] [MAIN ] NZF: Fetched primary data is valid. [2025-09-26T20:29:56.151513] [DEBUG] [LOCAL ] NZF: Saving primary data. [2025-09-26T20:29:56.152886] [DEBUG] [LOCAL ] NZF: Trimmed 43550 records to 29361 (keeping 200 days of data) [2025-09-26T20:29:56.267205] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-26T20:29:56.360882] [DEBUG] [LOCAL ] NZF: Primary data saved (29361 records). [2025-09-26T20:29:56.361028] [INFO ] [MAIN ] NZF: Full history saved. [2025-09-26T20:29:56.361121] [INFO ] [MAIN ] Update Progress: 1571/2371 symbols completed. NZF took 31.1s. Estimated remaining: 1h 46m 53s. Rate: 7.5 symbols/min [2025-09-26T20:29:56.537851] [INFO ] [MAIN ] OC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:29:56.591977] [DEBUG] [LOCAL ] OC: Loaded 45024 existing records from primary storage. [2025-09-26T20:29:56.592208] [INFO ] [MAIN ] OC: Loaded 45024 existing records. [2025-09-26T20:29:56.716945] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-01. [2025-09-26T20:29:56.782890] [WARN ] [MAIN ] OC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:29:56.783226] [INFO ] [MAIN ] OC: Wiping existing primary data before full refresh. [2025-09-26T20:29:56.783279] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-09-26T20:29:56.784454] [DEBUG] [LOCAL ] OC: Deleted primary data file. [2025-09-26T20:29:56.784517] [INFO ] [MAIN ] OC: Starting full primary refresh. [2025-09-26T20:29:57.166490] [INFO ] [REMOTE ] OC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:29:57.511751] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-06. [2025-09-26T20:29:57.837830] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-26T20:29:58.281312] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-26T20:29:58.311690] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-02. [2025-09-26T20:29:59.124298] [INFO ] [REMOTE ] OC: Fetching primary data for 2024-12. [2025-09-26T20:29:59.131930] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-26T20:29:59.277516] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-26T20:29:59.911735] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-03. [2025-09-26T20:30:00.584556] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-26T20:30:00.711736] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-01. [2025-09-26T20:30:00.901819] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-26T20:30:01.511743] [INFO ] [REMOTE ] O: Fetching primary data for 2025-08. [2025-09-26T20:30:02.311702] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-07. [2025-09-26T20:30:02.582528] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-26T20:30:03.111731] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-04. [2025-09-26T20:30:03.911740] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-02. [2025-09-26T20:30:04.266223] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-08 (2.75 seconds). [2025-09-26T20:30:04.334723] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-26T20:30:04.393974] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-26T20:30:04.711725] [INFO ] [REMOTE ] O: Fetching primary data for 2025-09. [2025-09-26T20:30:05.511701] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-05. [2025-09-26T20:30:05.628414] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-26T20:30:06.311730] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-03. [2025-09-26T20:30:06.576229] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-26T20:30:07.111725] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-08. [2025-09-26T20:30:07.245897] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-09-26T20:30:07.256153] [INFO ] [REMOTE ] O: Full fetch complete (77559 records). [2025-09-26T20:30:07.256349] [DEBUG] [VALIDATOR ] O: Validating primary data. [2025-09-26T20:30:07.474018] [WARN ] [VALIDATOR ] O: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-26T20:30:07.474992] [FATAL] [MAIN ] O: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:30:07.475078] [WARN ] [MAIN ] O: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:30:07.475158] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-09-26T20:30:07.475260] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-09-26T20:30:07.475319] [INFO ] [LOCAL ] O: Starting deletion of derivative data. [2025-09-26T20:30:07.475380] [DEBUG] [LOCAL ] O: No derivative data file found to delete. [2025-09-26T20:30:07.475478] [INFO ] [MAIN ] Update Progress: 1572/2371 symbols completed. O took 36.3s. Estimated remaining: 1h 46m 46s. Rate: 7.5 symbols/min [2025-09-26T20:30:07.689302] [INFO ] [MAIN ] OCFT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:30:07.701202] [DEBUG] [LOCAL ] OCFT: Loaded 8902 existing records from primary storage. [2025-09-26T20:30:07.701345] [INFO ] [MAIN ] OCFT: Loaded 8902 existing records. [2025-09-26T20:30:07.894145] [WARN ] [MAIN ] OCFT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:30:07.894418] [INFO ] [MAIN ] OCFT: Wiping existing primary data before full refresh. [2025-09-26T20:30:07.894469] [INFO ] [LOCAL ] OCFT: Starting deletion of primary data. [2025-09-26T20:30:07.894853] [DEBUG] [LOCAL ] OCFT: Deleted primary data file. [2025-09-26T20:30:07.894913] [INFO ] [MAIN ] OCFT: Starting full primary refresh. [2025-09-26T20:30:07.927867] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-06. [2025-09-26T20:30:08.308800] [INFO ] [REMOTE ] OCFT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:30:08.341274] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-26T20:30:08.544901] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-26T20:30:08.711729] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-09. [2025-09-26T20:30:09.291815] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-26T20:30:09.511775] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2024-12. [2025-09-26T20:30:10.191399] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-26T20:30:10.311705] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-04. [2025-09-26T20:30:10.344427] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-26T20:30:10.359122] [INFO ] [REMOTE ] OBDC: Full fetch complete (74892 records). [2025-09-26T20:30:10.359351] [DEBUG] [VALIDATOR ] OBDC: Validating primary data. [2025-09-26T20:30:10.775478] [DEBUG] [VALIDATOR ] OBDC: All expected trading days are present. [2025-09-26T20:30:10.775575] [DEBUG] [VALIDATOR ] OBDC: Primary data validation passed. [2025-09-26T20:30:10.776702] [INFO ] [MAIN ] OBDC: Fetched primary data is valid. [2025-09-26T20:30:10.776772] [DEBUG] [LOCAL ] OBDC: Saving primary data. [2025-09-26T20:30:10.778338] [DEBUG] [LOCAL ] OBDC: Trimmed 74892 records to 52426 (keeping 200 days of data) [2025-09-26T20:30:11.111762] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-07. [2025-09-26T20:30:11.136635] [DEBUG] [LOCAL ] OBDC: Primary data saved (52426 records). [2025-09-26T20:30:11.136869] [INFO ] [MAIN ] OBDC: Full history saved. [2025-09-26T20:30:11.137024] [INFO ] [MAIN ] Update Progress: 1573/2371 symbols completed. OBDC took 34.5s. Estimated remaining: 1h 46m 36s. Rate: 7.5 symbols/min [2025-09-26T20:30:11.319917] [INFO ] [MAIN ] ODC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:30:11.331070] [DEBUG] [LOCAL ] ODC: Loaded 8582 existing records from primary storage. [2025-09-26T20:30:11.331199] [INFO ] [MAIN ] ODC: Loaded 8582 existing records. [2025-09-26T20:30:11.519140] [WARN ] [MAIN ] ODC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:30:11.519522] [INFO ] [MAIN ] ODC: Wiping existing primary data before full refresh. [2025-09-26T20:30:11.519584] [INFO ] [LOCAL ] ODC: Starting deletion of primary data. [2025-09-26T20:30:11.519972] [DEBUG] [LOCAL ] ODC: Deleted primary data file. [2025-09-26T20:30:11.520034] [INFO ] [MAIN ] ODC: Starting full primary refresh. [2025-09-26T20:30:11.912844] [INFO ] [REMOTE ] ODC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:30:11.912913] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-01. [2025-09-26T20:30:11.946821] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-26T20:30:12.292462] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-26T20:30:12.300100] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-26T20:30:12.711762] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-02. [2025-09-26T20:30:13.511688] [INFO ] [REMOTE ] ODC: Fetching primary data for 2024-12. [2025-09-26T20:30:13.593079] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-26T20:30:14.210748] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-26T20:30:14.311747] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-01. [2025-09-26T20:30:15.101497] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-26T20:30:15.111664] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-02. [2025-09-26T20:30:15.821996] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-26T20:30:15.911732] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-08. [2025-09-26T20:30:16.711707] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-03. [2025-09-26T20:30:16.887906] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-26T20:30:17.511731] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-09. [2025-09-26T20:30:17.760020] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-26T20:30:18.311737] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-03. [2025-09-26T20:30:18.512975] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-26T20:30:18.518263] [INFO ] [REMOTE ] OBK: Full fetch complete (24001 records). [2025-09-26T20:30:18.518451] [DEBUG] [VALIDATOR ] OBK: Validating primary data. [2025-09-26T20:30:18.935807] [DEBUG] [VALIDATOR ] OBK: All expected trading days are present. [2025-09-26T20:30:18.935908] [DEBUG] [VALIDATOR ] OBK: Primary data validation passed. [2025-09-26T20:30:18.936493] [INFO ] [MAIN ] OBK: Fetched primary data is valid. [2025-09-26T20:30:18.936539] [DEBUG] [LOCAL ] OBK: Saving primary data. [2025-09-26T20:30:18.937347] [DEBUG] [LOCAL ] OBK: Trimmed 24001 records to 16512 (keeping 200 days of data) [2025-09-26T20:30:19.045149] [DEBUG] [LOCAL ] OBK: Primary data saved (16512 records). [2025-09-26T20:30:19.045307] [INFO ] [MAIN ] OBK: Full history saved. [2025-09-26T20:30:19.045467] [INFO ] [MAIN ] Update Progress: 1574/2371 symbols completed. OBK took 26.0s. Estimated remaining: 1h 46m 28s. Rate: 7.5 symbols/min [2025-09-26T20:30:19.114536] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-05. [2025-09-26T20:30:19.234891] [INFO ] [MAIN ] ODV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:30:19.241986] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-26T20:30:19.273724] [DEBUG] [LOCAL ] ODV: Loaded 25988 existing records from primary storage. [2025-09-26T20:30:19.274012] [INFO ] [MAIN ] ODV: Loaded 25988 existing records. [2025-09-26T20:30:19.486165] [WARN ] [MAIN ] ODV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:30:19.486504] [INFO ] [MAIN ] ODV: Wiping existing primary data before full refresh. [2025-09-26T20:30:19.486587] [INFO ] [LOCAL ] ODV: Starting deletion of primary data. [2025-09-26T20:30:19.487837] [DEBUG] [LOCAL ] ODV: Deleted primary data file. [2025-09-26T20:30:19.488038] [INFO ] [MAIN ] ODV: Starting full primary refresh. [2025-09-26T20:30:19.873946] [INFO ] [REMOTE ] ODV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:30:19.911690] [INFO ] [REMOTE ] ODV: Fetching primary data for 2024-12. [2025-09-26T20:30:20.711729] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-04. [2025-09-26T20:30:20.956299] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-26T20:30:20.956822] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-26T20:30:21.260854] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-26T20:30:21.511722] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-04. [2025-09-26T20:30:22.311729] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-05. [2025-09-26T20:30:22.337570] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-26T20:30:23.111723] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-05. [2025-09-26T20:30:23.139570] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-26T20:30:23.903832] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-26T20:30:23.911722] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-06. [2025-09-26T20:30:24.665141] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-26T20:30:24.711732] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-06. [2025-09-26T20:30:25.511781] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-06. [2025-09-26T20:30:26.234919] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-26T20:30:26.311738] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-07. [2025-09-26T20:30:26.388561] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-26T20:30:27.111722] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-01. [2025-09-26T20:30:27.911709] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-07. [2025-09-26T20:30:27.949314] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-26T20:30:27.968513] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-26T20:30:28.712444] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-07. [2025-09-26T20:30:28.715837] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-26T20:30:29.511736] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-02. [2025-09-26T20:30:29.585830] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-26T20:30:30.184715] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-26T20:30:30.311732] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-03. [2025-09-26T20:30:31.111704] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-08. [2025-09-26T20:30:31.329728] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-26T20:30:31.732724] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-26T20:30:31.911718] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-08. [2025-09-26T20:30:32.711735] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-09. [2025-09-26T20:30:33.481835] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-26T20:30:33.511718] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-09. [2025-09-26T20:30:33.551866] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-26T20:30:33.554471] [INFO ] [REMOTE ] ODC: Full fetch complete (10974 records). [2025-09-26T20:30:33.554557] [DEBUG] [VALIDATOR ] ODC: Validating primary data. [2025-09-26T20:30:33.967303] [DEBUG] [VALIDATOR ] ODC: All expected trading days are present. [2025-09-26T20:30:33.967447] [DEBUG] [VALIDATOR ] ODC: Primary data validation passed. [2025-09-26T20:30:33.967858] [INFO ] [MAIN ] ODC: Fetched primary data is valid. [2025-09-26T20:30:33.967956] [DEBUG] [LOCAL ] ODC: Saving primary data. [2025-09-26T20:30:33.969103] [DEBUG] [LOCAL ] ODC: Trimmed 10974 records to 8633 (keeping 200 days of data) [2025-09-26T20:30:34.031404] [DEBUG] [LOCAL ] ODC: Primary data saved (8633 records). [2025-09-26T20:30:34.031566] [INFO ] [MAIN ] ODC: Full history saved. [2025-09-26T20:30:34.031692] [INFO ] [MAIN ] Update Progress: 1575/2371 symbols completed. ODC took 22.9s. Estimated remaining: 1h 46m 24s. Rate: 7.5 symbols/min [2025-09-26T20:30:34.221473] [INFO ] [MAIN ] OEC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:30:34.260729] [DEBUG] [LOCAL ] OEC: Loaded 37431 existing records from primary storage. [2025-09-26T20:30:34.260902] [INFO ] [MAIN ] OEC: Loaded 37431 existing records. [2025-09-26T20:30:34.322023] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-08. [2025-09-26T20:30:34.461732] [WARN ] [MAIN ] OEC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:30:34.462020] [INFO ] [MAIN ] OEC: Wiping existing primary data before full refresh. [2025-09-26T20:30:34.462072] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-09-26T20:30:34.464966] [DEBUG] [LOCAL ] OEC: Deleted primary data file. [2025-09-26T20:30:34.465043] [INFO ] [MAIN ] OEC: Starting full primary refresh. [2025-09-26T20:30:34.910772] [INFO ] [REMOTE ] OEC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:30:35.022483] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-26T20:30:35.075524] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-26T20:30:35.085275] [INFO ] [REMOTE ] OC: Full fetch complete (64153 records). [2025-09-26T20:30:35.085461] [DEBUG] [VALIDATOR ] OC: Validating primary data. [2025-09-26T20:30:35.118198] [INFO ] [REMOTE ] OEC: Fetching primary data for 2024-12. [2025-09-26T20:30:35.503845] [DEBUG] [VALIDATOR ] OC: All expected trading days are present. [2025-09-26T20:30:35.503925] [DEBUG] [VALIDATOR ] OC: Primary data validation passed. [2025-09-26T20:30:35.504921] [INFO ] [MAIN ] OC: Fetched primary data is valid. [2025-09-26T20:30:35.504990] [DEBUG] [LOCAL ] OC: Saving primary data. [2025-09-26T20:30:35.506366] [DEBUG] [LOCAL ] OC: Trimmed 64153 records to 45369 (keeping 200 days of data) [2025-09-26T20:30:35.801509] [DEBUG] [LOCAL ] OC: Primary data saved (45369 records). [2025-09-26T20:30:35.801668] [INFO ] [MAIN ] OC: Full history saved. [2025-09-26T20:30:35.801779] [INFO ] [MAIN ] Update Progress: 1576/2371 symbols completed. OC took 39.4s. Estimated remaining: 1h 46m 12s. Rate: 7.5 symbols/min [2025-09-26T20:30:35.916871] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-04. [2025-09-26T20:30:35.983973] [INFO ] [MAIN ] OFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:30:36.007485] [DEBUG] [LOCAL ] OFG: Loaded 22255 existing records from primary storage. [2025-09-26T20:30:36.007636] [INFO ] [MAIN ] OFG: Loaded 22255 existing records. [2025-09-26T20:30:36.203832] [WARN ] [MAIN ] OFG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:30:36.204076] [INFO ] [MAIN ] OFG: Wiping existing primary data before full refresh. [2025-09-26T20:30:36.204125] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-09-26T20:30:36.204800] [DEBUG] [LOCAL ] OFG: Deleted primary data file. [2025-09-26T20:30:36.204863] [INFO ] [MAIN ] OFG: Starting full primary refresh. [2025-09-26T20:30:36.610801] [INFO ] [REMOTE ] OFG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:30:36.631716] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-26T20:30:36.711745] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-01. [2025-09-26T20:30:36.790786] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-26T20:30:37.511728] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-05. [2025-09-26T20:30:38.041881] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-26T20:30:38.311710] [INFO ] [REMOTE ] OFG: Fetching primary data for 2024-12. [2025-09-26T20:30:38.546223] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-26T20:30:39.111753] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-06. [2025-09-26T20:30:39.629320] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-26T20:30:39.911727] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-01. [2025-09-26T20:30:40.126357] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-26T20:30:40.711728] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-02. [2025-09-26T20:30:41.257008] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-26T20:30:41.511745] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-02. [2025-09-26T20:30:41.770585] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-26T20:30:42.311739] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-09. [2025-09-26T20:30:42.854065] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-26T20:30:42.940075] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-26T20:30:42.941592] [INFO ] [REMOTE ] OCFT: Full fetch complete (11829 records). [2025-09-26T20:30:42.941703] [DEBUG] [VALIDATOR ] OCFT: Validating primary data. [2025-09-26T20:30:43.111817] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-03. [2025-09-26T20:30:43.348953] [DEBUG] [VALIDATOR ] OCFT: All expected trading days are present. [2025-09-26T20:30:43.349106] [DEBUG] [VALIDATOR ] OCFT: Primary data validation passed. [2025-09-26T20:30:43.349491] [INFO ] [MAIN ] OCFT: Fetched primary data is valid. [2025-09-26T20:30:43.349576] [DEBUG] [LOCAL ] OCFT: Saving primary data. [2025-09-26T20:30:43.350159] [DEBUG] [LOCAL ] OCFT: Trimmed 11829 records to 8916 (keeping 200 days of data) [2025-09-26T20:30:43.401056] [DEBUG] [LOCAL ] OCFT: Primary data saved (8916 records). [2025-09-26T20:30:43.401199] [INFO ] [MAIN ] OCFT: Full history saved. [2025-09-26T20:30:43.401311] [INFO ] [MAIN ] Update Progress: 1577/2371 symbols completed. OCFT took 35.9s. Estimated remaining: 1h 46m 4s. Rate: 7.5 symbols/min [2025-09-26T20:30:43.582298] [INFO ] [MAIN ] OGE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:30:43.633283] [DEBUG] [LOCAL ] OGE: Loaded 46726 existing records from primary storage. [2025-09-26T20:30:43.633454] [INFO ] [MAIN ] OGE: Loaded 46726 existing records. [2025-09-26T20:30:43.830899] [WARN ] [MAIN ] OGE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:30:43.831188] [INFO ] [MAIN ] OGE: Wiping existing primary data before full refresh. [2025-09-26T20:30:43.831253] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-09-26T20:30:43.833846] [DEBUG] [LOCAL ] OGE: Deleted primary data file. [2025-09-26T20:30:43.833912] [INFO ] [MAIN ] OGE: Starting full primary refresh. [2025-09-26T20:30:43.916895] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-07. [2025-09-26T20:30:44.224390] [INFO ] [REMOTE ] OGE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:30:44.445338] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-26T20:30:44.711737] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-03. [2025-09-26T20:30:45.324794] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-26T20:30:45.511752] [INFO ] [REMOTE ] OGE: Fetching primary data for 2024-12. [2025-09-26T20:30:46.218341] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-26T20:30:46.311731] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-08. [2025-09-26T20:30:47.111751] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-04. [2025-09-26T20:30:47.305678] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-26T20:30:47.746637] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-26T20:30:47.911741] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-09. [2025-09-26T20:30:48.556909] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-26T20:30:48.711725] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-05. [2025-09-26T20:30:49.498488] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-26T20:30:49.507051] [INFO ] [REMOTE ] ODV: Full fetch complete (32310 records). [2025-09-26T20:30:49.507228] [DEBUG] [VALIDATOR ] ODV: Validating primary data. [2025-09-26T20:30:49.519514] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-04. [2025-09-26T20:30:49.931136] [DEBUG] [VALIDATOR ] ODV: All expected trading days are present. [2025-09-26T20:30:49.931306] [DEBUG] [VALIDATOR ] ODV: Primary data validation passed. [2025-09-26T20:30:49.932238] [INFO ] [MAIN ] ODV: Fetched primary data is valid. [2025-09-26T20:30:49.932325] [DEBUG] [LOCAL ] ODV: Saving primary data. [2025-09-26T20:30:49.933344] [DEBUG] [LOCAL ] ODV: Trimmed 32310 records to 26258 (keeping 200 days of data) [2025-09-26T20:30:50.086268] [DEBUG] [LOCAL ] ODV: Primary data saved (26258 records). [2025-09-26T20:30:50.086546] [INFO ] [MAIN ] ODV: Full history saved. [2025-09-26T20:30:50.086715] [INFO ] [MAIN ] Update Progress: 1578/2371 symbols completed. ODV took 31.0s. Estimated remaining: 1h 45m 56s. Rate: 7.5 symbols/min [2025-09-26T20:30:50.299597] [INFO ] [MAIN ] OGN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:30:50.302670] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-26T20:30:50.311747] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-01. [2025-09-26T20:30:50.369717] [DEBUG] [LOCAL ] OGN: Loaded 53493 existing records from primary storage. [2025-09-26T20:30:50.369883] [INFO ] [MAIN ] OGN: Loaded 53493 existing records. [2025-09-26T20:30:50.576195] [WARN ] [MAIN ] OGN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:30:50.576726] [INFO ] [MAIN ] OGN: Wiping existing primary data before full refresh. [2025-09-26T20:30:50.576874] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-09-26T20:30:50.583855] [DEBUG] [LOCAL ] OGN: Deleted primary data file. [2025-09-26T20:30:50.593362] [INFO ] [MAIN ] OGN: Starting full primary refresh. [2025-09-26T20:30:50.669268] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-26T20:30:51.005480] [INFO ] [REMOTE ] OGN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:30:51.111719] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-06. [2025-09-26T20:30:51.916800] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-05. [2025-09-26T20:30:51.930254] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-26T20:30:52.424829] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-26T20:30:52.711710] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-02. [2025-09-26T20:30:53.065514] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-26T20:30:53.511765] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-07. [2025-09-26T20:30:53.915205] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-26T20:30:54.311749] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-06. [2025-09-26T20:30:54.971288] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-26T20:30:55.111738] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-03. [2025-09-26T20:30:55.473056] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-26T20:30:55.911740] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-08. [2025-09-26T20:30:56.711728] [INFO ] [REMOTE ] OGN: Fetching primary data for 2024-12. [2025-09-26T20:30:56.929806] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-26T20:30:57.371404] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-26T20:30:57.511748] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-07. [2025-09-26T20:30:58.311688] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-04. [2025-09-26T20:30:58.708561] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-26T20:30:58.748919] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-26T20:30:59.111723] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-01. [2025-09-26T20:30:59.911731] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-09. [2025-09-26T20:31:00.120796] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-26T20:31:00.711693] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-05. [2025-09-26T20:31:01.179240] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-26T20:31:01.220925] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-26T20:31:01.228351] [INFO ] [REMOTE ] OEC: Full fetch complete (52624 records). [2025-09-26T20:31:01.228525] [DEBUG] [VALIDATOR ] OEC: Validating primary data. [2025-09-26T20:31:01.516891] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-08. [2025-09-26T20:31:01.698834] [DEBUG] [VALIDATOR ] OEC: All expected trading days are present. [2025-09-26T20:31:01.698915] [DEBUG] [VALIDATOR ] OEC: Primary data validation passed. [2025-09-26T20:31:01.699771] [INFO ] [MAIN ] OEC: Fetched primary data is valid. [2025-09-26T20:31:01.699836] [DEBUG] [LOCAL ] OEC: Saving primary data. [2025-09-26T20:31:01.700909] [DEBUG] [LOCAL ] OEC: Trimmed 52624 records to 37689 (keeping 200 days of data) [2025-09-26T20:31:01.944557] [DEBUG] [LOCAL ] OEC: Primary data saved (37689 records). [2025-09-26T20:31:01.944734] [INFO ] [MAIN ] OEC: Full history saved. [2025-09-26T20:31:01.944850] [INFO ] [MAIN ] Update Progress: 1579/2371 symbols completed. OEC took 27.9s. Estimated remaining: 1h 45m 49s. Rate: 7.5 symbols/min [2025-09-26T20:31:02.133013] [INFO ] [MAIN ] OGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:31:02.167990] [DEBUG] [LOCAL ] OGS: Loaded 34239 existing records from primary storage. [2025-09-26T20:31:02.168160] [INFO ] [MAIN ] OGS: Loaded 34239 existing records. [2025-09-26T20:31:02.323502] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-02. [2025-09-26T20:31:02.370355] [WARN ] [MAIN ] OGS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:31:02.370680] [INFO ] [MAIN ] OGS: Wiping existing primary data before full refresh. [2025-09-26T20:31:02.370742] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-09-26T20:31:02.371562] [DEBUG] [LOCAL ] OGS: Deleted primary data file. [2025-09-26T20:31:02.371624] [INFO ] [MAIN ] OGS: Starting full primary refresh. [2025-09-26T20:31:02.763439] [INFO ] [REMOTE ] OGS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:31:02.776755] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-26T20:31:02.808861] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-26T20:31:03.111713] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-09. [2025-09-26T20:31:03.911725] [INFO ] [REMOTE ] OGS: Fetching primary data for 2024-12. [2025-09-26T20:31:04.179875] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-26T20:31:04.203364] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-26T20:31:04.207728] [INFO ] [REMOTE ] OFG: Full fetch complete (34487 records). [2025-09-26T20:31:04.207830] [DEBUG] [VALIDATOR ] OFG: Validating primary data. [2025-09-26T20:31:04.613392] [DEBUG] [VALIDATOR ] OFG: All expected trading days are present. [2025-09-26T20:31:04.613482] [DEBUG] [VALIDATOR ] OFG: Primary data validation passed. [2025-09-26T20:31:04.614245] [INFO ] [MAIN ] OFG: Fetched primary data is valid. [2025-09-26T20:31:04.614311] [DEBUG] [LOCAL ] OFG: Saving primary data. [2025-09-26T20:31:04.615783] [DEBUG] [LOCAL ] OFG: Trimmed 34487 records to 22393 (keeping 200 days of data) [2025-09-26T20:31:04.712809] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-03. [2025-09-26T20:31:04.761599] [DEBUG] [LOCAL ] OFG: Primary data saved (22393 records). [2025-09-26T20:31:04.761780] [INFO ] [MAIN ] OFG: Full history saved. [2025-09-26T20:31:04.761906] [INFO ] [MAIN ] Update Progress: 1580/2371 symbols completed. OFG took 29.0s. Estimated remaining: 1h 45m 39s. Rate: 7.5 symbols/min [2025-09-26T20:31:04.944029] [INFO ] [MAIN ] OHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:31:05.001668] [DEBUG] [LOCAL ] OHI: Loaded 52459 existing records from primary storage. [2025-09-26T20:31:05.001853] [INFO ] [MAIN ] OHI: Loaded 52459 existing records. [2025-09-26T20:31:05.200943] [WARN ] [MAIN ] OHI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:31:05.201509] [INFO ] [MAIN ] OHI: Wiping existing primary data before full refresh. [2025-09-26T20:31:05.201564] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-09-26T20:31:05.202886] [DEBUG] [LOCAL ] OHI: Deleted primary data file. [2025-09-26T20:31:05.202973] [INFO ] [MAIN ] OHI: Starting full primary refresh. [2025-09-26T20:31:05.514437] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-06. [2025-09-26T20:31:05.609302] [INFO ] [REMOTE ] OHI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:31:05.623505] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-26T20:31:06.311738] [INFO ] [REMOTE ] OHI: Fetching primary data for 2024-12. [2025-09-26T20:31:06.624838] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-26T20:31:07.111737] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-01. [2025-09-26T20:31:07.283556] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-26T20:31:07.911722] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-07. [2025-09-26T20:31:07.997207] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-26T20:31:08.173341] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-26T20:31:08.711713] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-01. [2025-09-26T20:31:09.511732] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-04. [2025-09-26T20:31:09.834548] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-26T20:31:10.311697] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-02. [2025-09-26T20:31:10.650578] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-26T20:31:11.111715] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-02. [2025-09-26T20:31:11.540794] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-26T20:31:11.821423] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-26T20:31:11.911713] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-08. [2025-09-26T20:31:12.561296] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-26T20:31:12.711749] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-03. [2025-09-26T20:31:13.516909] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-05. [2025-09-26T20:31:13.525235] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-26T20:31:14.312842] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-09. [2025-09-26T20:31:14.317259] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-26T20:31:15.111691] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-03. [2025-09-26T20:31:15.685679] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-26T20:31:15.848538] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-26T20:31:15.857546] [INFO ] [REMOTE ] OGE: Full fetch complete (66741 records). [2025-09-26T20:31:15.857717] [DEBUG] [VALIDATOR ] OGE: Validating primary data. [2025-09-26T20:31:15.919258] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-06. [2025-09-26T20:31:16.336247] [DEBUG] [VALIDATOR ] OGE: All expected trading days are present. [2025-09-26T20:31:16.336457] [DEBUG] [VALIDATOR ] OGE: Primary data validation passed. [2025-09-26T20:31:16.339787] [INFO ] [MAIN ] OGE: Fetched primary data is valid. [2025-09-26T20:31:16.339910] [DEBUG] [LOCAL ] OGE: Saving primary data. [2025-09-26T20:31:16.348627] [DEBUG] [LOCAL ] OGE: Trimmed 66741 records to 47046 (keeping 200 days of data) [2025-09-26T20:31:16.672437] [DEBUG] [LOCAL ] OGE: Primary data saved (47046 records). [2025-09-26T20:31:16.672585] [INFO ] [MAIN ] OGE: Full history saved. [2025-09-26T20:31:16.672882] [INFO ] [MAIN ] Update Progress: 1581/2371 symbols completed. OGE took 33.3s. Estimated remaining: 1h 45m 33s. Rate: 7.5 symbols/min [2025-09-26T20:31:16.723708] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-04. [2025-09-26T20:31:16.874169] [INFO ] [MAIN ] OI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:31:16.962809] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-26T20:31:16.961042] [DEBUG] [LOCAL ] OI: Loaded 47657 existing records from primary storage. [2025-09-26T20:31:16.975706] [INFO ] [MAIN ] OI: Loaded 47657 existing records. [2025-09-26T20:31:17.179797] [WARN ] [MAIN ] OI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:31:17.180081] [INFO ] [MAIN ] OI: Wiping existing primary data before full refresh. [2025-09-26T20:31:17.180138] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-09-26T20:31:17.181408] [DEBUG] [LOCAL ] OI: Deleted primary data file. [2025-09-26T20:31:17.181485] [INFO ] [MAIN ] OI: Starting full primary refresh. [2025-09-26T20:31:17.513538] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-04. [2025-09-26T20:31:17.592167] [INFO ] [REMOTE ] OI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:31:17.793550] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-26T20:31:18.318200] [INFO ] [REMOTE ] OI: Fetching primary data for 2024-12. [2025-09-26T20:31:18.333635] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-26T20:31:19.111722] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-05. [2025-09-26T20:31:19.247072] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-26T20:31:19.911751] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-07. [2025-09-26T20:31:20.052186] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-26T20:31:20.352330] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-26T20:31:20.711723] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-01. [2025-09-26T20:31:21.511707] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-05. [2025-09-26T20:31:21.683498] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-26T20:31:22.241375] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-26T20:31:22.311721] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-02. [2025-09-26T20:31:23.111751] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-06. [2025-09-26T20:31:23.178994] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-26T20:31:23.824557] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-26T20:31:23.911731] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-06. [2025-09-26T20:31:24.616523] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-26T20:31:24.711733] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-07. [2025-09-26T20:31:25.511733] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-08. [2025-09-26T20:31:25.695719] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-26T20:31:26.248189] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-26T20:31:26.311706] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-03. [2025-09-26T20:31:27.111777] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-07. [2025-09-26T20:31:27.473062] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-26T20:31:27.911708] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-08. [2025-09-26T20:31:28.069866] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-26T20:31:28.711717] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-09. [2025-09-26T20:31:28.891778] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-26T20:31:29.307286] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-26T20:31:29.511726] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-08. [2025-09-26T20:31:30.311690] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-04. [2025-09-26T20:31:30.498100] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-26T20:31:30.513212] [INFO ] [REMOTE ] OGN: Full fetch complete (76817 records). [2025-09-26T20:31:30.513431] [DEBUG] [VALIDATOR ] OGN: Validating primary data. [2025-09-26T20:31:30.947888] [DEBUG] [VALIDATOR ] OGN: All expected trading days are present. [2025-09-26T20:31:30.948116] [DEBUG] [VALIDATOR ] OGN: Primary data validation passed. [2025-09-26T20:31:30.949349] [INFO ] [MAIN ] OGN: Fetched primary data is valid. [2025-09-26T20:31:30.949420] [DEBUG] [LOCAL ] OGN: Saving primary data. [2025-09-26T20:31:30.951171] [DEBUG] [LOCAL ] OGN: Trimmed 76817 records to 53882 (keeping 200 days of data) [2025-09-26T20:31:31.111701] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-09. [2025-09-26T20:31:31.251040] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-26T20:31:31.387929] [DEBUG] [LOCAL ] OGN: Primary data saved (53882 records). [2025-09-26T20:31:31.388105] [INFO ] [MAIN ] OGN: Full history saved. [2025-09-26T20:31:31.388200] [INFO ] [MAIN ] Update Progress: 1582/2371 symbols completed. OGN took 41.3s. Estimated remaining: 1h 45m 28s. Rate: 7.5 symbols/min [2025-09-26T20:31:31.575790] [INFO ] [MAIN ] OIA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:31:31.592996] [DEBUG] [LOCAL ] OIA: Loaded 14159 existing records from primary storage. [2025-09-26T20:31:31.593143] [INFO ] [MAIN ] OIA: Loaded 14159 existing records. [2025-09-26T20:31:31.792769] [WARN ] [MAIN ] OIA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:31:31.793360] [INFO ] [MAIN ] OIA: Wiping existing primary data before full refresh. [2025-09-26T20:31:31.793421] [INFO ] [LOCAL ] OIA: Starting deletion of primary data. [2025-09-26T20:31:31.793986] [DEBUG] [LOCAL ] OIA: Deleted primary data file. [2025-09-26T20:31:31.794099] [INFO ] [MAIN ] OIA: Starting full primary refresh. [2025-09-26T20:31:31.914264] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-09. [2025-09-26T20:31:32.204992] [INFO ] [REMOTE ] OIA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:31:32.239164] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-26T20:31:32.267978] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-26T20:31:32.274842] [INFO ] [REMOTE ] OGS: Full fetch complete (48012 records). [2025-09-26T20:31:32.275015] [DEBUG] [VALIDATOR ] OGS: Validating primary data. [2025-09-26T20:31:32.721333] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-05. [2025-09-26T20:31:32.741105] [DEBUG] [VALIDATOR ] OGS: All expected trading days are present. [2025-09-26T20:31:32.741217] [DEBUG] [VALIDATOR ] OGS: Primary data validation passed. [2025-09-26T20:31:32.742052] [INFO ] [MAIN ] OGS: Fetched primary data is valid. [2025-09-26T20:31:32.742119] [DEBUG] [LOCAL ] OGS: Saving primary data. [2025-09-26T20:31:32.743692] [DEBUG] [LOCAL ] OGS: Trimmed 48012 records to 34591 (keeping 200 days of data) [2025-09-26T20:31:33.001722] [DEBUG] [LOCAL ] OGS: Primary data saved (34591 records). [2025-09-26T20:31:33.001886] [INFO ] [MAIN ] OGS: Full history saved. [2025-09-26T20:31:33.002030] [INFO ] [MAIN ] Update Progress: 1583/2371 symbols completed. OGS took 31.1s. Estimated remaining: 1h 45m 17s. Rate: 7.5 symbols/min [2025-09-26T20:31:33.220050] [INFO ] [MAIN ] OII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:31:33.273240] [DEBUG] [LOCAL ] OII: Loaded 43123 existing records from primary storage. [2025-09-26T20:31:33.273392] [INFO ] [MAIN ] OII: Loaded 43123 existing records. [2025-09-26T20:31:33.486749] [WARN ] [MAIN ] OII: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:31:33.487121] [INFO ] [MAIN ] OII: Wiping existing primary data before full refresh. [2025-09-26T20:31:33.487185] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-09-26T20:31:33.488224] [DEBUG] [LOCAL ] OII: Deleted primary data file. [2025-09-26T20:31:33.488290] [INFO ] [MAIN ] OII: Starting full primary refresh. [2025-09-26T20:31:33.523757] [INFO ] [REMOTE ] OIA: Fetching primary data for 2024-12. [2025-09-26T20:31:33.905698] [INFO ] [REMOTE ] OII: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:31:33.937853] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-26T20:31:33.950414] [INFO ] [REMOTE ] OHI: Full fetch complete (75129 records). [2025-09-26T20:31:33.950583] [DEBUG] [VALIDATOR ] OHI: Validating primary data. [2025-09-26T20:31:34.104106] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-26T20:31:34.316889] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-06. [2025-09-26T20:31:34.435909] [DEBUG] [VALIDATOR ] OHI: All expected trading days are present. [2025-09-26T20:31:34.436009] [DEBUG] [VALIDATOR ] OHI: Primary data validation passed. [2025-09-26T20:31:34.437090] [INFO ] [MAIN ] OHI: Fetched primary data is valid. [2025-09-26T20:31:34.437162] [DEBUG] [LOCAL ] OHI: Saving primary data. [2025-09-26T20:31:34.442069] [DEBUG] [LOCAL ] OHI: Trimmed 75129 records to 52824 (keeping 200 days of data) [2025-09-26T20:31:34.696304] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-26T20:31:34.819271] [DEBUG] [LOCAL ] OHI: Primary data saved (52824 records). [2025-09-26T20:31:34.819423] [INFO ] [MAIN ] OHI: Full history saved. [2025-09-26T20:31:34.819536] [INFO ] [MAIN ] Update Progress: 1584/2371 symbols completed. OHI took 30.1s. Estimated remaining: 1h 45m 6s. Rate: 7.5 symbols/min [2025-09-26T20:31:35.003891] [INFO ] [MAIN ] OIS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:31:35.047343] [DEBUG] [LOCAL ] OIS: Loaded 40891 existing records from primary storage. [2025-09-26T20:31:35.047503] [INFO ] [MAIN ] OIS: Loaded 40891 existing records. [2025-09-26T20:31:35.116924] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-01. [2025-09-26T20:31:35.240084] [WARN ] [MAIN ] OIS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:31:35.240413] [INFO ] [MAIN ] OIS: Wiping existing primary data before full refresh. [2025-09-26T20:31:35.240516] [INFO ] [LOCAL ] OIS: Starting deletion of primary data. [2025-09-26T20:31:35.241575] [DEBUG] [LOCAL ] OIS: Deleted primary data file. [2025-09-26T20:31:35.241636] [INFO ] [MAIN ] OIS: Starting full primary refresh. [2025-09-26T20:31:35.624590] [INFO ] [REMOTE ] OIS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:31:35.911741] [INFO ] [REMOTE ] OII: Fetching primary data for 2024-12. [2025-09-26T20:31:35.947898] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-26T20:31:36.111343] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-26T20:31:36.711725] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-02. [2025-09-26T20:31:37.422608] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-26T20:31:37.511736] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-01. [2025-09-26T20:31:37.799528] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-26T20:31:38.311714] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-07. [2025-09-26T20:31:39.044111] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-26T20:31:39.111719] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-02. [2025-09-26T20:31:39.787610] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-26T20:31:39.911725] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-08. [2025-09-26T20:31:40.622499] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-26T20:31:40.711713] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-03. [2025-09-26T20:31:41.517327] [INFO ] [REMOTE ] OIS: Fetching primary data for 2024-12. [2025-09-26T20:31:41.540161] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-26T20:31:42.129607] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-26T20:31:42.311758] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-03. [2025-09-26T20:31:43.062022] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-26T20:31:43.111674] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-01. [2025-09-26T20:31:43.443106] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-26T20:31:43.911722] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-04. [2025-09-26T20:31:44.415412] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-26T20:31:44.711726] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-09. [2025-09-26T20:31:45.511741] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-04. [2025-09-26T20:31:45.573529] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-26T20:31:46.311798] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-02. [2025-09-26T20:31:46.589282] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-26T20:31:46.598576] [INFO ] [REMOTE ] OI: Full fetch complete (68243 records). [2025-09-26T20:31:46.598753] [DEBUG] [VALIDATOR ] OI: Validating primary data. [2025-09-26T20:31:46.745375] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-26T20:31:47.126232] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-05. [2025-09-26T20:31:47.152016] [DEBUG] [VALIDATOR ] OI: All expected trading days are present. [2025-09-26T20:31:47.152119] [DEBUG] [VALIDATOR ] OI: Primary data validation passed. [2025-09-26T20:31:47.153214] [INFO ] [MAIN ] OI: Fetched primary data is valid. [2025-09-26T20:31:47.153287] [DEBUG] [LOCAL ] OI: Saving primary data. [2025-09-26T20:31:47.156627] [DEBUG] [LOCAL ] OI: Trimmed 68243 records to 48011 (keeping 200 days of data) [2025-09-26T20:31:47.457002] [DEBUG] [LOCAL ] OI: Primary data saved (48011 records). [2025-09-26T20:31:47.457158] [INFO ] [MAIN ] OI: Full history saved. [2025-09-26T20:31:47.457254] [INFO ] [MAIN ] Update Progress: 1585/2371 symbols completed. OI took 30.8s. Estimated remaining: 1h 45m 0s. Rate: 7.5 symbols/min [2025-09-26T20:31:47.656318] [INFO ] [MAIN ] OKE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:31:47.679010] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-26T20:31:47.728670] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-26T20:31:47.754029] [DEBUG] [LOCAL ] OKE: Loaded 53926 existing records from primary storage. [2025-09-26T20:31:47.754241] [INFO ] [MAIN ] OKE: Loaded 53926 existing records. [2025-09-26T20:31:47.918179] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-03. [2025-09-26T20:31:47.952017] [WARN ] [MAIN ] OKE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:31:47.952232] [INFO ] [MAIN ] OKE: Wiping existing primary data before full refresh. [2025-09-26T20:31:47.952281] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-09-26T20:31:47.953931] [DEBUG] [LOCAL ] OKE: Deleted primary data file. [2025-09-26T20:31:47.954049] [INFO ] [MAIN ] OKE: Starting full primary refresh. [2025-09-26T20:31:48.331998] [INFO ] [REMOTE ] OKE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:31:48.711719] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-05. [2025-09-26T20:31:49.511752] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-06. [2025-09-26T20:31:49.575529] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-26T20:31:49.850010] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-26T20:31:50.311744] [INFO ] [REMOTE ] OKE: Fetching primary data for 2024-12. [2025-09-26T20:31:50.414116] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-26T20:31:51.111756] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-07. [2025-09-26T20:31:51.911753] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-04. [2025-09-26T20:31:52.032935] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-26T20:31:52.223137] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-26T20:31:52.711791] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-08. [2025-09-26T20:31:53.523060] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-01. [2025-09-26T20:31:53.529901] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-26T20:31:53.573257] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-26T20:31:54.311729] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-05. [2025-09-26T20:31:55.111704] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-09. [2025-09-26T20:31:55.439860] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-26T20:31:55.911723] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-06. [2025-09-26T20:31:56.073044] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-26T20:31:56.154770] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-26T20:31:56.158478] [INFO ] [REMOTE ] OIA: Full fetch complete (21304 records). [2025-09-26T20:31:56.158577] [DEBUG] [VALIDATOR ] OIA: Validating primary data. [2025-09-26T20:31:56.559564] [DEBUG] [VALIDATOR ] OIA: All expected trading days are present. [2025-09-26T20:31:56.559695] [DEBUG] [VALIDATOR ] OIA: Primary data validation passed. [2025-09-26T20:31:56.560285] [INFO ] [MAIN ] OIA: Fetched primary data is valid. [2025-09-26T20:31:56.560364] [DEBUG] [LOCAL ] OIA: Saving primary data. [2025-09-26T20:31:56.561427] [DEBUG] [LOCAL ] OIA: Trimmed 21304 records to 14218 (keeping 200 days of data) [2025-09-26T20:31:56.658801] [DEBUG] [LOCAL ] OIA: Primary data saved (14218 records). [2025-09-26T20:31:56.659067] [INFO ] [MAIN ] OIA: Full history saved. [2025-09-26T20:31:56.659213] [INFO ] [MAIN ] Update Progress: 1586/2371 symbols completed. OIA took 25.3s. Estimated remaining: 1h 44m 53s. Rate: 7.5 symbols/min [2025-09-26T20:31:56.716963] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-06. [2025-09-26T20:31:56.884134] [INFO ] [MAIN ] OKLO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:31:56.884339] [DEBUG] [LOCAL ] OKLO: No existing data file found in primary storage. [2025-09-26T20:31:56.884380] [WARN ] [MAIN ] OKLO: No existing data found, performing full refresh instead. [2025-09-26T20:31:56.884539] [INFO ] [MAIN ] OKLO: Wiping existing primary data before full refresh. [2025-09-26T20:31:56.884585] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-09-26T20:31:56.884630] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-09-26T20:31:56.884704] [INFO ] [MAIN ] OKLO: Starting full primary refresh. [2025-09-26T20:31:57.313320] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-26T20:31:57.349872] [INFO ] [REMOTE ] OKLO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:31:57.511715] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-02. [2025-09-26T20:31:58.311702] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2024-12. [2025-09-26T20:31:58.347335] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-26T20:31:59.111778] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-07. [2025-09-26T20:31:59.400234] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-26T20:31:59.911721] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-03. [2025-09-26T20:32:00.711692] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-07. [2025-09-26T20:32:00.810172] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-26T20:32:01.273031] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2024-12 (2.96 seconds). [2025-09-26T20:32:01.511736] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-08. [2025-09-26T20:32:01.842467] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-26T20:32:02.311702] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-04. [2025-09-26T20:32:02.388317] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-26T20:32:03.106055] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-26T20:32:03.114947] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-01. [2025-09-26T20:32:03.911750] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-08. [2025-09-26T20:32:04.285977] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-26T20:32:04.711729] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-05. [2025-09-26T20:32:05.432521] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-26T20:32:05.511723] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-09. [2025-09-26T20:32:05.758871] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-01 (2.64 seconds). [2025-09-26T20:32:06.311695] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-09. [2025-09-26T20:32:06.789097] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-26T20:32:06.911597] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-26T20:32:06.918929] [INFO ] [REMOTE ] OIS: Full fetch complete (57040 records). [2025-09-26T20:32:06.919101] [DEBUG] [VALIDATOR ] OIS: Validating primary data. [2025-09-26T20:32:07.114051] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-06. [2025-09-26T20:32:07.343001] [DEBUG] [VALIDATOR ] OIS: All expected trading days are present. [2025-09-26T20:32:07.343095] [DEBUG] [VALIDATOR ] OIS: Primary data validation passed. [2025-09-26T20:32:07.344099] [INFO ] [MAIN ] OIS: Fetched primary data is valid. [2025-09-26T20:32:07.344164] [DEBUG] [LOCAL ] OIS: Saving primary data. [2025-09-26T20:32:07.345477] [DEBUG] [LOCAL ] OIS: Trimmed 57040 records to 41135 (keeping 200 days of data) [2025-09-26T20:32:07.606509] [DEBUG] [LOCAL ] OIS: Primary data saved (41135 records). [2025-09-26T20:32:07.606681] [INFO ] [MAIN ] OIS: Full history saved. [2025-09-26T20:32:07.606812] [INFO ] [MAIN ] Update Progress: 1587/2371 symbols completed. OIS took 32.8s. Estimated remaining: 1h 44m 46s. Rate: 7.5 symbols/min [2025-09-26T20:32:07.808576] [INFO ] [MAIN ] OLN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:32:07.834140] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-26T20:32:07.842781] [INFO ] [REMOTE ] OII: Full fetch complete (62047 records). [2025-09-26T20:32:07.842975] [DEBUG] [VALIDATOR ] OII: Validating primary data. [2025-09-26T20:32:07.916309] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-02. [2025-09-26T20:32:08.211604] [DEBUG] [LOCAL ] OLN: Loaded 52126 existing records from primary storage. [2025-09-26T20:32:08.217667] [INFO ] [MAIN ] OLN: Loaded 52126 existing records. [2025-09-26T20:32:08.449061] [DEBUG] [VALIDATOR ] OII: All expected trading days are present. [2025-09-26T20:32:08.459410] [DEBUG] [VALIDATOR ] OII: Primary data validation passed. [2025-09-26T20:32:08.470844] [INFO ] [MAIN ] OII: Fetched primary data is valid. [2025-09-26T20:32:08.491515] [DEBUG] [LOCAL ] OII: Saving primary data. [2025-09-26T20:32:08.533587] [WARN ] [MAIN ] OLN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:32:08.534120] [INFO ] [MAIN ] OLN: Wiping existing primary data before full refresh. [2025-09-26T20:32:08.534281] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-09-26T20:32:08.534800] [DEBUG] [LOCAL ] OII: Trimmed 62047 records to 43406 (keeping 200 days of data) [2025-09-26T20:32:08.536062] [DEBUG] [LOCAL ] OLN: Deleted primary data file. [2025-09-26T20:32:08.536148] [INFO ] [MAIN ] OLN: Starting full primary refresh. [2025-09-26T20:32:09.129072] [INFO ] [REMOTE ] OLN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:32:09.132528] [INFO ] [REMOTE ] OLN: Fetching primary data for 2024-12. [2025-09-26T20:32:09.269025] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-26T20:32:09.335233] [DEBUG] [LOCAL ] OII: Primary data saved (43406 records). [2025-09-26T20:32:09.335416] [INFO ] [MAIN ] OII: Full history saved. [2025-09-26T20:32:09.335526] [INFO ] [MAIN ] Update Progress: 1588/2371 symbols completed. OII took 36.3s. Estimated remaining: 1h 44m 35s. Rate: 7.5 symbols/min [2025-09-26T20:32:09.517223] [INFO ] [MAIN ] OLP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:32:09.517295] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-07. [2025-09-26T20:32:09.530287] [DEBUG] [LOCAL ] OLP: Loaded 9853 existing records from primary storage. [2025-09-26T20:32:09.530489] [INFO ] [MAIN ] OLP: Loaded 9853 existing records. [2025-09-26T20:32:09.723680] [WARN ] [MAIN ] OLP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:32:09.723998] [INFO ] [MAIN ] OLP: Wiping existing primary data before full refresh. [2025-09-26T20:32:09.724064] [INFO ] [LOCAL ] OLP: Starting deletion of primary data. [2025-09-26T20:32:09.724524] [DEBUG] [LOCAL ] OLP: Deleted primary data file. [2025-09-26T20:32:09.724590] [INFO ] [MAIN ] OLP: Starting full primary refresh. [2025-09-26T20:32:10.108196] [INFO ] [REMOTE ] OLP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:32:10.311757] [INFO ] [REMOTE ] OLP: Fetching primary data for 2024-12. [2025-09-26T20:32:10.733678] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-02 (2.82 seconds). [2025-09-26T20:32:10.811105] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-26T20:32:11.111721] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-01. [2025-09-26T20:32:11.181712] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-26T20:32:11.458464] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-26T20:32:11.911725] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-01. [2025-09-26T20:32:12.711708] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-03. [2025-09-26T20:32:12.749770] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-26T20:32:12.889962] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-26T20:32:13.511744] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-02. [2025-09-26T20:32:14.311717] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-02. [2025-09-26T20:32:14.346269] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-26T20:32:15.111718] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-03. [2025-09-26T20:32:15.350419] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-03 (2.64 seconds). [2025-09-26T20:32:15.911721] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-08. [2025-09-26T20:32:15.988839] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-26T20:32:16.007253] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-26T20:32:16.711722] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-03. [2025-09-26T20:32:17.511782] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-04. [2025-09-26T20:32:17.977550] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-26T20:32:18.311718] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-04. [2025-09-26T20:32:18.442282] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-26T20:32:18.501947] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-26T20:32:19.111722] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-09. [2025-09-26T20:32:19.911725] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-04. [2025-09-26T20:32:20.711757] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-05. [2025-09-26T20:32:21.031896] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-09-26T20:32:21.104827] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-26T20:32:21.115739] [INFO ] [REMOTE ] OKE: Full fetch complete (77486 records). [2025-09-26T20:32:21.115905] [DEBUG] [VALIDATOR ] OKE: Validating primary data. [2025-09-26T20:32:21.519222] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-05. [2025-09-26T20:32:21.563207] [DEBUG] [VALIDATOR ] OKE: All expected trading days are present. [2025-09-26T20:32:21.563469] [DEBUG] [VALIDATOR ] OKE: Primary data validation passed. [2025-09-26T20:32:21.565045] [INFO ] [MAIN ] OKE: Fetched primary data is valid. [2025-09-26T20:32:21.565200] [DEBUG] [LOCAL ] OKE: Saving primary data. [2025-09-26T20:32:21.567293] [DEBUG] [LOCAL ] OKE: Trimmed 77486 records to 54316 (keeping 200 days of data) [2025-09-26T20:32:21.722636] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-26T20:32:21.735328] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-26T20:32:21.994510] [DEBUG] [LOCAL ] OKE: Primary data saved (54316 records). [2025-09-26T20:32:21.994721] [INFO ] [MAIN ] OKE: Full history saved. [2025-09-26T20:32:21.994903] [INFO ] [MAIN ] Update Progress: 1589/2371 symbols completed. OKE took 34.5s. Estimated remaining: 1h 44m 29s. Rate: 7.5 symbols/min [2025-09-26T20:32:22.183969] [INFO ] [MAIN ] OMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:32:22.239786] [DEBUG] [LOCAL ] OMC: Loaded 53680 existing records from primary storage. [2025-09-26T20:32:22.239965] [INFO ] [MAIN ] OMC: Loaded 53680 existing records. [2025-09-26T20:32:22.318266] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-06. [2025-09-26T20:32:22.436395] [WARN ] [MAIN ] OMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:32:22.436725] [INFO ] [MAIN ] OMC: Wiping existing primary data before full refresh. [2025-09-26T20:32:22.436784] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-09-26T20:32:22.438352] [DEBUG] [LOCAL ] OMC: Deleted primary data file. [2025-09-26T20:32:22.438418] [INFO ] [MAIN ] OMC: Starting full primary refresh. [2025-09-26T20:32:22.841432] [INFO ] [REMOTE ] OMC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:32:23.111737] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-05. [2025-09-26T20:32:23.309412] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-26T20:32:23.911697] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-07. [2025-09-26T20:32:24.316632] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-05 (2.80 seconds). [2025-09-26T20:32:24.711712] [INFO ] [REMOTE ] OMC: Fetching primary data for 2024-12. [2025-09-26T20:32:24.866520] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-26T20:32:24.875183] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-26T20:32:25.511726] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-06. [2025-09-26T20:32:26.311718] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-06. [2025-09-26T20:32:26.499888] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-26T20:32:27.111738] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-01. [2025-09-26T20:32:27.374494] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-26T20:32:27.911715] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-07. [2025-09-26T20:32:28.711737] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-08. [2025-09-26T20:32:28.807844] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-26T20:32:29.071084] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-06 (2.76 seconds). [2025-09-26T20:32:29.342072] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-26T20:32:29.511726] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-02. [2025-09-26T20:32:29.784748] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-26T20:32:30.311760] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-07. [2025-09-26T20:32:31.111758] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-09. [2025-09-26T20:32:31.350601] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-26T20:32:31.911687] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-08. [2025-09-26T20:32:31.996579] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-26T20:32:32.006437] [INFO ] [REMOTE ] OLP: Full fetch complete (14096 records). [2025-09-26T20:32:32.007006] [DEBUG] [VALIDATOR ] OLP: Validating primary data. [2025-09-26T20:32:32.404483] [DEBUG] [VALIDATOR ] OLP: All expected trading days are present. [2025-09-26T20:32:32.404579] [DEBUG] [VALIDATOR ] OLP: Primary data validation passed. [2025-09-26T20:32:32.404952] [INFO ] [MAIN ] OLP: Fetched primary data is valid. [2025-09-26T20:32:32.405026] [DEBUG] [LOCAL ] OLP: Saving primary data. [2025-09-26T20:32:32.405730] [DEBUG] [LOCAL ] OLP: Trimmed 14096 records to 9963 (keeping 200 days of data) [2025-09-26T20:32:32.474375] [DEBUG] [LOCAL ] OLP: Primary data saved (9963 records). [2025-09-26T20:32:32.474536] [INFO ] [MAIN ] OLP: Full history saved. [2025-09-26T20:32:32.474696] [INFO ] [MAIN ] Update Progress: 1590/2371 symbols completed. OLP took 23.1s. Estimated remaining: 1h 44m 22s. Rate: 7.5 symbols/min [2025-09-26T20:32:32.661208] [INFO ] [MAIN ] OMF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:32:32.708799] [DEBUG] [LOCAL ] OMF: Loaded 46577 existing records from primary storage. [2025-09-26T20:32:32.708984] [INFO ] [MAIN ] OMF: Loaded 46577 existing records. [2025-09-26T20:32:32.741762] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-03. [2025-09-26T20:32:32.906532] [WARN ] [MAIN ] OMF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:32:32.907200] [INFO ] [MAIN ] OMF: Wiping existing primary data before full refresh. [2025-09-26T20:32:32.907293] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-09-26T20:32:32.909745] [DEBUG] [LOCAL ] OMF: Deleted primary data file. [2025-09-26T20:32:32.909831] [INFO ] [MAIN ] OMF: Starting full primary refresh. [2025-09-26T20:32:33.256331] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-07 (2.94 seconds). [2025-09-26T20:32:33.355414] [INFO ] [REMOTE ] OMF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:32:33.511702] [INFO ] [REMOTE ] OMF: Fetching primary data for 2024-12. [2025-09-26T20:32:33.748746] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-26T20:32:34.311753] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-09. [2025-09-26T20:32:34.711797] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-26T20:32:35.111729] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-08. [2025-09-26T20:32:35.168916] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-26T20:32:35.911744] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-04. [2025-09-26T20:32:36.043550] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-26T20:32:36.054052] [INFO ] [REMOTE ] OLN: Full fetch complete (74617 records). [2025-09-26T20:32:36.054212] [DEBUG] [VALIDATOR ] OLN: Validating primary data. [2025-09-26T20:32:36.458207] [DEBUG] [VALIDATOR ] OLN: All expected trading days are present. [2025-09-26T20:32:36.458300] [DEBUG] [VALIDATOR ] OLN: Primary data validation passed. [2025-09-26T20:32:36.459296] [INFO ] [MAIN ] OLN: Fetched primary data is valid. [2025-09-26T20:32:36.459361] [DEBUG] [LOCAL ] OLN: Saving primary data. [2025-09-26T20:32:36.460893] [DEBUG] [LOCAL ] OLN: Trimmed 74617 records to 52512 (keeping 200 days of data) [2025-09-26T20:32:36.712615] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-01. [2025-09-26T20:32:36.798145] [DEBUG] [LOCAL ] OLN: Primary data saved (52512 records). [2025-09-26T20:32:36.798308] [INFO ] [MAIN ] OLN: Full history saved. [2025-09-26T20:32:36.798397] [INFO ] [MAIN ] Update Progress: 1591/2371 symbols completed. OLN took 29.2s. Estimated remaining: 1h 44m 13s. Rate: 7.5 symbols/min [2025-09-26T20:32:36.981054] [INFO ] [MAIN ] OMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:32:37.027803] [DEBUG] [LOCAL ] OMI: Loaded 46205 existing records from primary storage. [2025-09-26T20:32:37.027962] [INFO ] [MAIN ] OMI: Loaded 46205 existing records. [2025-09-26T20:32:37.237910] [WARN ] [MAIN ] OMI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:32:37.238174] [INFO ] [MAIN ] OMI: Wiping existing primary data before full refresh. [2025-09-26T20:32:37.238223] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-09-26T20:32:37.239219] [DEBUG] [LOCAL ] OMI: Deleted primary data file. [2025-09-26T20:32:37.239286] [INFO ] [MAIN ] OMI: Starting full primary refresh. [2025-09-26T20:32:37.630125] [INFO ] [REMOTE ] OMI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:32:37.630595] [INFO ] [REMOTE ] OMI: Fetching primary data for 2024-12. [2025-09-26T20:32:37.716153] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-26T20:32:37.805809] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-08 (2.69 seconds). [2025-09-26T20:32:38.311756] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-05. [2025-09-26T20:32:38.521923] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-26T20:32:39.030594] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T20:32:39.111753] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-02. [2025-09-26T20:32:39.911725] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-01. [2025-09-26T20:32:40.211406] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-26T20:32:40.697662] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-26T20:32:40.711698] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-03. [2025-09-26T20:32:41.370682] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-26T20:32:41.511723] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-02. [2025-09-26T20:32:42.314422] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-06. [2025-09-26T20:32:42.320537] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-26T20:32:43.111709] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-04. [2025-09-26T20:32:43.242925] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-26T20:32:43.911724] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-03. [2025-09-26T20:32:44.252253] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-26T20:32:44.711729] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-09. [2025-09-26T20:32:44.983599] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-26T20:32:45.511680] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-05. [2025-09-26T20:32:45.553607] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-26T20:32:45.564185] [INFO ] [REMOTE ] OKLO: Full fetch complete (77603 records). [2025-09-26T20:32:45.564333] [DEBUG] [VALIDATOR ] OKLO: Validating primary data. [2025-09-26T20:32:45.565380] [FATAL] [VALIDATOR ] OKLO: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T20:32:45.565477] [FATAL] [MAIN ] OKLO: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:32:45.565524] [WARN ] [MAIN ] OKLO: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:32:45.565567] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-09-26T20:32:45.565631] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-09-26T20:32:45.565709] [INFO ] [LOCAL ] OKLO: Starting deletion of derivative data. [2025-09-26T20:32:45.565787] [DEBUG] [LOCAL ] OKLO: No derivative data file found to delete. [2025-09-26T20:32:45.565873] [INFO ] [MAIN ] Update Progress: 1592/2371 symbols completed. OKLO took 48.9s. Estimated remaining: 1h 44m 5s. Rate: 7.5 symbols/min [2025-09-26T20:32:45.773588] [INFO ] [MAIN ] ONIT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:32:45.814256] [DEBUG] [LOCAL ] ONIT: Loaded 7831 existing records from primary storage. [2025-09-26T20:32:45.814411] [INFO ] [MAIN ] ONIT: Loaded 7831 existing records. [2025-09-26T20:32:45.813972] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-26T20:32:46.014236] [WARN ] [MAIN ] ONIT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:32:46.014504] [INFO ] [MAIN ] ONIT: Wiping existing primary data before full refresh. [2025-09-26T20:32:46.014553] [INFO ] [LOCAL ] ONIT: Starting deletion of primary data. [2025-09-26T20:32:46.014926] [DEBUG] [LOCAL ] ONIT: Deleted primary data file. [2025-09-26T20:32:46.014987] [INFO ] [MAIN ] ONIT: Starting full primary refresh. [2025-09-26T20:32:46.313439] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-07. [2025-09-26T20:32:46.400250] [INFO ] [REMOTE ] ONIT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:32:47.111730] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-04. [2025-09-26T20:32:47.250823] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-26T20:32:47.911713] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-06. [2025-09-26T20:32:48.268019] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-26T20:32:48.688958] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-26T20:32:48.711688] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-05. [2025-09-26T20:32:49.378574] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-26T20:32:49.511745] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-08. [2025-09-26T20:32:50.311688] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-07. [2025-09-26T20:32:50.381526] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-26T20:32:51.111689] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2024-12. [2025-09-26T20:32:51.203287] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-26T20:32:51.685317] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-26T20:32:51.911730] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-01. [2025-09-26T20:32:52.171202] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-26T20:32:52.711718] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-09. [2025-09-26T20:32:52.744595] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-26T20:32:53.511717] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-02. [2025-09-26T20:32:54.315088] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-06. [2025-09-26T20:32:54.315997] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-26T20:32:54.378557] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-26T20:32:54.389133] [INFO ] [REMOTE ] OMC: Full fetch complete (76981 records). [2025-09-26T20:32:54.389284] [DEBUG] [VALIDATOR ] OMC: Validating primary data. [2025-09-26T20:32:54.806054] [DEBUG] [VALIDATOR ] OMC: All expected trading days are present. [2025-09-26T20:32:54.806147] [DEBUG] [VALIDATOR ] OMC: Primary data validation passed. [2025-09-26T20:32:54.807199] [INFO ] [MAIN ] OMC: Fetched primary data is valid. [2025-09-26T20:32:54.807270] [DEBUG] [LOCAL ] OMC: Saving primary data. [2025-09-26T20:32:54.808881] [DEBUG] [LOCAL ] OMC: Trimmed 76981 records to 54068 (keeping 200 days of data) [2025-09-26T20:32:55.111961] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-03. [2025-09-26T20:32:55.167738] [DEBUG] [LOCAL ] OMC: Primary data saved (54068 records). [2025-09-26T20:32:55.167992] [INFO ] [MAIN ] OMC: Full history saved. [2025-09-26T20:32:55.168103] [INFO ] [MAIN ] Update Progress: 1593/2371 symbols completed. OMC took 33.2s. Estimated remaining: 1h 43m 58s. Rate: 7.5 symbols/min [2025-09-26T20:32:55.345517] [INFO ] [MAIN ] ONL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:32:55.376816] [DEBUG] [LOCAL ] ONL: Loaded 31704 existing records from primary storage. [2025-09-26T20:32:55.377006] [INFO ] [MAIN ] ONL: Loaded 31704 existing records. [2025-09-26T20:32:55.565976] [WARN ] [MAIN ] ONL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:32:55.566213] [INFO ] [MAIN ] ONL: Wiping existing primary data before full refresh. [2025-09-26T20:32:55.566262] [INFO ] [LOCAL ] ONL: Starting deletion of primary data. [2025-09-26T20:32:55.567015] [DEBUG] [LOCAL ] ONL: Deleted primary data file. [2025-09-26T20:32:55.567076] [INFO ] [MAIN ] ONL: Starting full primary refresh. [2025-09-26T20:32:55.921463] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-08. [2025-09-26T20:32:55.954531] [INFO ] [REMOTE ] ONL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:32:55.962417] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-26T20:32:55.992460] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-26T20:32:56.711747] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-07. [2025-09-26T20:32:57.511711] [INFO ] [REMOTE ] ONL: Fetching primary data for 2024-12. [2025-09-26T20:32:57.566236] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-26T20:32:58.311709] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-09. [2025-09-26T20:32:58.363718] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-26T20:32:58.973040] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-26T20:32:59.111734] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-08. [2025-09-26T20:32:59.539120] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-26T20:32:59.547828] [INFO ] [REMOTE ] OMF: Full fetch complete (66711 records). [2025-09-26T20:32:59.548008] [DEBUG] [VALIDATOR ] OMF: Validating primary data. [2025-09-26T20:32:59.916809] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-01. [2025-09-26T20:32:59.974374] [DEBUG] [VALIDATOR ] OMF: All expected trading days are present. [2025-09-26T20:32:59.974517] [DEBUG] [VALIDATOR ] OMF: Primary data validation passed. [2025-09-26T20:32:59.975610] [INFO ] [MAIN ] OMF: Fetched primary data is valid. [2025-09-26T20:32:59.975703] [DEBUG] [LOCAL ] OMF: Saving primary data. [2025-09-26T20:32:59.977476] [DEBUG] [LOCAL ] OMF: Trimmed 66711 records to 46898 (keeping 200 days of data) [2025-09-26T20:33:00.274887] [DEBUG] [LOCAL ] OMF: Primary data saved (46898 records). [2025-09-26T20:33:00.275026] [INFO ] [MAIN ] OMF: Full history saved. [2025-09-26T20:33:00.275117] [INFO ] [MAIN ] Update Progress: 1594/2371 symbols completed. OMF took 27.8s. Estimated remaining: 1h 43m 48s. Rate: 7.5 symbols/min [2025-09-26T20:33:00.480008] [INFO ] [MAIN ] ONON: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:33:00.533425] [DEBUG] [LOCAL ] ONON: Loaded 54002 existing records from primary storage. [2025-09-26T20:33:00.533573] [INFO ] [MAIN ] ONON: Loaded 54002 existing records. [2025-09-26T20:33:00.723894] [WARN ] [MAIN ] ONON: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:33:00.717523] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-04. [2025-09-26T20:33:00.725818] [INFO ] [MAIN ] ONON: Wiping existing primary data before full refresh. [2025-09-26T20:33:00.725895] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-09-26T20:33:00.737070] [DEBUG] [LOCAL ] ONON: Deleted primary data file. [2025-09-26T20:33:00.755033] [INFO ] [MAIN ] ONON: Starting full primary refresh. [2025-09-26T20:33:00.792091] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-26T20:33:01.139299] [INFO ] [REMOTE ] ONON: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:33:01.296877] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-26T20:33:01.511694] [INFO ] [REMOTE ] ONON: Fetching primary data for 2024-12. [2025-09-26T20:33:01.578075] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-26T20:33:02.311712] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-09. [2025-09-26T20:33:03.111706] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-02. [2025-09-26T20:33:03.623909] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-26T20:33:03.911712] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-05. [2025-09-26T20:33:04.093062] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-26T20:33:04.103214] [INFO ] [REMOTE ] OMI: Full fetch complete (64120 records). [2025-09-26T20:33:04.103382] [DEBUG] [VALIDATOR ] OMI: Validating primary data. [2025-09-26T20:33:04.389910] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-26T20:33:04.499695] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-26T20:33:04.555975] [DEBUG] [VALIDATOR ] OMI: All expected trading days are present. [2025-09-26T20:33:04.556056] [DEBUG] [VALIDATOR ] OMI: Primary data validation passed. [2025-09-26T20:33:04.557075] [INFO ] [MAIN ] OMI: Fetched primary data is valid. [2025-09-26T20:33:04.557165] [DEBUG] [LOCAL ] OMI: Saving primary data. [2025-09-26T20:33:04.558448] [DEBUG] [LOCAL ] OMI: Trimmed 64120 records to 46583 (keeping 200 days of data) [2025-09-26T20:33:04.724195] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-06. [2025-09-26T20:33:04.836778] [DEBUG] [LOCAL ] OMI: Primary data saved (46583 records). [2025-09-26T20:33:04.836963] [INFO ] [MAIN ] OMI: Full history saved. [2025-09-26T20:33:04.837077] [INFO ] [MAIN ] Update Progress: 1595/2371 symbols completed. OMI took 28.0s. Estimated remaining: 1h 43m 39s. Rate: 7.5 symbols/min [2025-09-26T20:33:05.026242] [INFO ] [MAIN ] ONTF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:33:05.048298] [DEBUG] [LOCAL ] ONTF: Loaded 23075 existing records from primary storage. [2025-09-26T20:33:05.048456] [INFO ] [MAIN ] ONTF: Loaded 23075 existing records. [2025-09-26T20:33:05.235117] [WARN ] [MAIN ] ONTF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:33:05.235435] [INFO ] [MAIN ] ONTF: Wiping existing primary data before full refresh. [2025-09-26T20:33:05.235493] [INFO ] [LOCAL ] ONTF: Starting deletion of primary data. [2025-09-26T20:33:05.235967] [DEBUG] [LOCAL ] ONTF: Deleted primary data file. [2025-09-26T20:33:05.236027] [INFO ] [MAIN ] ONTF: Starting full primary refresh. [2025-09-26T20:33:05.527193] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-01. [2025-09-26T20:33:05.624225] [INFO ] [REMOTE ] ONTF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:33:05.627501] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-26T20:33:06.311726] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-03. [2025-09-26T20:33:07.111724] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2024-12. [2025-09-26T20:33:07.410453] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-26T20:33:07.830975] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-26T20:33:07.891778] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-26T20:33:07.911678] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-01. [2025-09-26T20:33:08.711705] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-04. [2025-09-26T20:33:08.952594] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-26T20:33:09.511726] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-02. [2025-09-26T20:33:10.259300] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-26T20:33:10.311687] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-02. [2025-09-26T20:33:11.111727] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-05. [2025-09-26T20:33:11.263036] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-26T20:33:11.338803] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-26T20:33:11.911737] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-03. [2025-09-26T20:33:12.620163] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-26T20:33:12.711681] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-07. [2025-09-26T20:33:13.105901] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-26T20:33:13.511718] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-04. [2025-09-26T20:33:13.543753] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-26T20:33:14.311700] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-03. [2025-09-26T20:33:14.673532] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-26T20:33:15.111762] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-08. [2025-09-26T20:33:15.911687] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-06. [2025-09-26T20:33:15.965540] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-26T20:33:16.223716] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-26T20:33:16.711736] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-09. [2025-09-26T20:33:17.200681] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-26T20:33:17.289932] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-26T20:33:17.291947] [INFO ] [REMOTE ] ONIT: Full fetch complete (11180 records). [2025-09-26T20:33:17.292036] [DEBUG] [VALIDATOR ] ONIT: Validating primary data. [2025-09-26T20:33:17.516877] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-07. [2025-09-26T20:33:17.691348] [DEBUG] [VALIDATOR ] ONIT: All expected trading days are present. [2025-09-26T20:33:17.691450] [DEBUG] [VALIDATOR ] ONIT: Primary data validation passed. [2025-09-26T20:33:17.691844] [INFO ] [MAIN ] ONIT: Fetched primary data is valid. [2025-09-26T20:33:17.691917] [DEBUG] [LOCAL ] ONIT: Saving primary data. [2025-09-26T20:33:17.693382] [DEBUG] [LOCAL ] ONIT: Trimmed 11180 records to 7871 (keeping 200 days of data) [2025-09-26T20:33:17.750255] [DEBUG] [LOCAL ] ONIT: Primary data saved (7871 records). [2025-09-26T20:33:17.750450] [INFO ] [MAIN ] ONIT: Full history saved. [2025-09-26T20:33:17.750603] [INFO ] [MAIN ] Update Progress: 1596/2371 symbols completed. ONIT took 32.2s. Estimated remaining: 1h 43m 33s. Rate: 7.5 symbols/min [2025-09-26T20:33:17.988681] [INFO ] [MAIN ] ONTO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:33:18.044359] [DEBUG] [LOCAL ] ONTO: Loaded 46992 existing records from primary storage. [2025-09-26T20:33:18.044529] [INFO ] [MAIN ] ONTO: Loaded 46992 existing records. [2025-09-26T20:33:18.237557] [WARN ] [MAIN ] ONTO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:33:18.237882] [INFO ] [MAIN ] ONTO: Wiping existing primary data before full refresh. [2025-09-26T20:33:18.237940] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-09-26T20:33:18.239045] [DEBUG] [LOCAL ] ONTO: Deleted primary data file. [2025-09-26T20:33:18.239119] [INFO ] [MAIN ] ONTO: Starting full primary refresh. [2025-09-26T20:33:18.316807] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-05. [2025-09-26T20:33:18.634489] [INFO ] [REMOTE ] ONTO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:33:18.979259] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-26T20:33:19.111723] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-08. [2025-09-26T20:33:19.525076] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-26T20:33:19.911692] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-06. [2025-09-26T20:33:20.314927] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-26T20:33:20.711721] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2024-12. [2025-09-26T20:33:21.154329] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-26T20:33:21.511722] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-09. [2025-09-26T20:33:21.934114] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-26T20:33:22.311693] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-04. [2025-09-26T20:33:22.563088] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-26T20:33:22.568227] [INFO ] [REMOTE ] ONL: Full fetch complete (43448 records). [2025-09-26T20:33:22.568398] [DEBUG] [VALIDATOR ] ONL: Validating primary data. [2025-09-26T20:33:22.969783] [DEBUG] [VALIDATOR ] ONL: All expected trading days are present. [2025-09-26T20:33:22.969862] [DEBUG] [VALIDATOR ] ONL: Primary data validation passed. [2025-09-26T20:33:22.970607] [INFO ] [MAIN ] ONL: Fetched primary data is valid. [2025-09-26T20:33:22.970674] [DEBUG] [LOCAL ] ONL: Saving primary data. [2025-09-26T20:33:22.971708] [DEBUG] [LOCAL ] ONL: Trimmed 43448 records to 31806 (keeping 200 days of data) [2025-09-26T20:33:23.121123] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-07. [2025-09-26T20:33:23.166126] [DEBUG] [LOCAL ] ONL: Primary data saved (31806 records). [2025-09-26T20:33:23.166294] [INFO ] [MAIN ] ONL: Full history saved. [2025-09-26T20:33:23.166398] [INFO ] [MAIN ] Update Progress: 1597/2371 symbols completed. ONL took 28.0s. Estimated remaining: 1h 43m 24s. Rate: 7.5 symbols/min [2025-09-26T20:33:23.911739] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-01. [2025-09-26T20:33:24.205865] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-26T20:33:24.470636] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-26T20:33:24.711750] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-08. [2025-09-26T20:33:25.516803] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-05. [2025-09-26T20:33:25.537262] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-26T20:33:25.821935] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-26T20:33:26.311735] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-09. [2025-09-26T20:33:27.111763] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-02. [2025-09-26T20:33:27.359583] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-26T20:33:27.365399] [INFO ] [REMOTE ] ONTF: Full fetch complete (31631 records). [2025-09-26T20:33:27.365532] [DEBUG] [VALIDATOR ] ONTF: Validating primary data. [2025-09-26T20:33:27.816611] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-26T20:33:27.837873] [DEBUG] [VALIDATOR ] ONTF: All expected trading days are present. [2025-09-26T20:33:27.838107] [DEBUG] [VALIDATOR ] ONTF: Primary data validation passed. [2025-09-26T20:33:27.838855] [INFO ] [MAIN ] ONTF: Fetched primary data is valid. [2025-09-26T20:33:27.839360] [DEBUG] [LOCAL ] ONTF: Saving primary data. [2025-09-26T20:33:27.840304] [DEBUG] [LOCAL ] ONTF: Trimmed 31631 records to 23187 (keeping 200 days of data) [2025-09-26T20:33:27.920877] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-06. [2025-09-26T20:33:27.978006] [DEBUG] [LOCAL ] ONTF: Primary data saved (23187 records). [2025-09-26T20:33:27.978163] [INFO ] [MAIN ] ONTF: Full history saved. [2025-09-26T20:33:27.978257] [INFO ] [MAIN ] Update Progress: 1598/2371 symbols completed. ONTF took 23.1s. Estimated remaining: 1h 43m 14s. Rate: 7.5 symbols/min [2025-09-26T20:33:28.828454] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-26T20:33:28.837430] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-03. [2025-09-26T20:33:29.961799] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-26T20:33:29.973959] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-07. [2025-09-26T20:33:30.406990] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-26T20:33:30.416601] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-04. [2025-09-26T20:33:32.267935] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-26T20:33:32.277606] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-05. [2025-09-26T20:33:33.165318] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-07 (3.19 seconds). [2025-09-26T20:33:33.177698] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-08. [2025-09-26T20:33:34.109867] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-26T20:33:34.120356] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-06. [2025-09-26T20:33:35.339497] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-26T20:33:35.351581] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-09. [2025-09-26T20:33:35.764746] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-26T20:33:35.777119] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-07. [2025-09-26T20:33:37.491430] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-26T20:33:37.529903] [INFO ] [REMOTE ] ONON: Full fetch complete (77565 records). [2025-09-26T20:33:37.531919] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-26T20:33:37.532205] [DEBUG] [VALIDATOR ] ONON: Validating primary data. [2025-09-26T20:33:37.543726] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-08. [2025-09-26T20:33:37.951334] [DEBUG] [VALIDATOR ] ONON: All expected trading days are present. [2025-09-26T20:33:37.951430] [DEBUG] [VALIDATOR ] ONON: Primary data validation passed. [2025-09-26T20:33:37.952495] [INFO ] [MAIN ] ONON: Fetched primary data is valid. [2025-09-26T20:33:37.952574] [DEBUG] [LOCAL ] ONON: Saving primary data. [2025-09-26T20:33:37.954190] [DEBUG] [LOCAL ] ONON: Trimmed 77565 records to 54392 (keeping 200 days of data) [2025-09-26T20:33:38.280437] [DEBUG] [LOCAL ] ONON: Primary data saved (54392 records). [2025-09-26T20:33:38.280583] [INFO ] [MAIN ] ONON: Full history saved. [2025-09-26T20:33:38.280695] [INFO ] [MAIN ] Update Progress: 1599/2371 symbols completed. ONON took 38.0s. Estimated remaining: 1h 43m 7s. Rate: 7.5 symbols/min [2025-09-26T20:33:39.434197] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-26T20:33:39.444574] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-09. [2025-09-26T20:33:41.247201] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-26T20:33:41.256811] [INFO ] [REMOTE ] ONTO: Full fetch complete (65732 records). [2025-09-26T20:33:41.256966] [DEBUG] [VALIDATOR ] ONTO: Validating primary data. [2025-09-26T20:33:41.667078] [DEBUG] [VALIDATOR ] ONTO: All expected trading days are present. [2025-09-26T20:33:41.667204] [DEBUG] [VALIDATOR ] ONTO: Primary data validation passed. [2025-09-26T20:33:41.668482] [INFO ] [MAIN ] ONTO: Fetched primary data is valid. [2025-09-26T20:33:41.668561] [DEBUG] [LOCAL ] ONTO: Saving primary data. [2025-09-26T20:33:41.670367] [DEBUG] [LOCAL ] ONTO: Trimmed 65732 records to 47339 (keeping 200 days of data) [2025-09-26T20:33:41.981491] [DEBUG] [LOCAL ] ONTO: Primary data saved (47339 records). [2025-09-26T20:33:41.981662] [INFO ] [MAIN ] ONTO: Full history saved. [2025-09-26T20:33:41.981799] [INFO ] [MAIN ] Update Progress: 1600/2371 symbols completed. ONTO took 24.2s. Estimated remaining: 1h 42m 57s. Rate: 7.5 symbols/min [2025-09-26T20:33:42.623927] [INFO ] [MAIN ] OOMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:33:42.693930] [INFO ] [MAIN ] OPFI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:33:42.689874] [INFO ] [MAIN ] OPAD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:33:42.789082] [INFO ] [MAIN ] OPP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:33:42.810850] [DEBUG] [LOCAL ] OOMA: Loaded 19157 existing records from primary storage. [2025-09-26T20:33:42.811633] [INFO ] [MAIN ] OOMA: Loaded 19157 existing records. [2025-09-26T20:33:42.859896] [DEBUG] [LOCAL ] OPP: Loaded 11630 existing records from primary storage. [2025-09-26T20:33:42.880978] [INFO ] [MAIN ] OPP: Loaded 11630 existing records. [2025-09-26T20:33:42.991762] [DEBUG] [LOCAL ] OPAD: Loaded 20422 existing records from primary storage. [2025-09-26T20:33:43.021792] [INFO ] [MAIN ] OPAD: Loaded 20422 existing records. [2025-09-26T20:33:43.105309] [DEBUG] [LOCAL ] OPFI: Loaded 46918 existing records from primary storage. [2025-09-26T20:33:43.152762] [INFO ] [MAIN ] OPFI: Loaded 46918 existing records. [2025-09-26T20:33:43.333337] [WARN ] [MAIN ] OPP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:33:43.434741] [INFO ] [MAIN ] OPP: Wiping existing primary data before full refresh. [2025-09-26T20:33:43.434591] [WARN ] [MAIN ] OOMA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:33:43.444300] [INFO ] [LOCAL ] OPP: Starting deletion of primary data. [2025-09-26T20:33:43.465779] [INFO ] [MAIN ] OOMA: Wiping existing primary data before full refresh. [2025-09-26T20:33:43.476343] [DEBUG] [LOCAL ] OPP: Deleted primary data file. [2025-09-26T20:33:43.471142] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-09-26T20:33:43.497257] [INFO ] [MAIN ] OPP: Starting full primary refresh. [2025-09-26T20:33:43.574846] [DEBUG] [LOCAL ] OOMA: Deleted primary data file. [2025-09-26T20:33:43.592764] [INFO ] [MAIN ] OOMA: Starting full primary refresh. [2025-09-26T20:33:43.679113] [WARN ] [MAIN ] OPAD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:33:43.798737] [INFO ] [MAIN ] OPAD: Wiping existing primary data before full refresh. [2025-09-26T20:33:43.860076] [INFO ] [LOCAL ] OPAD: Starting deletion of primary data. [2025-09-26T20:33:43.859911] [WARN ] [MAIN ] OPFI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:33:43.958438] [INFO ] [MAIN ] OPFI: Wiping existing primary data before full refresh. [2025-09-26T20:33:43.978474] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-09-26T20:33:43.917824] [DEBUG] [LOCAL ] OPAD: Deleted primary data file. [2025-09-26T20:33:43.997241] [DEBUG] [LOCAL ] OPFI: Deleted primary data file. [2025-09-26T20:33:44.033249] [INFO ] [MAIN ] OPAD: Starting full primary refresh. [2025-09-26T20:33:44.033398] [INFO ] [MAIN ] OPFI: Starting full primary refresh. [2025-09-26T20:33:44.615622] [INFO ] [REMOTE ] OPP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:33:44.683010] [INFO ] [REMOTE ] OPP: Fetching primary data for 2024-12. [2025-09-26T20:33:44.886374] [INFO ] [REMOTE ] OOMA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:33:44.934787] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2024-12. [2025-09-26T20:33:45.292015] [INFO ] [REMOTE ] OPFI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:33:45.310848] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2024-12. [2025-09-26T20:33:45.314220] [INFO ] [REMOTE ] OPAD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:33:45.315288] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2024-12. [2025-09-26T20:33:46.001104] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-26T20:33:46.008110] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-01. [2025-09-26T20:33:46.189514] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-26T20:33:46.194146] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-01. [2025-09-26T20:33:46.261804] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-26T20:33:46.264536] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-01. [2025-09-26T20:33:46.868543] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-26T20:33:46.885134] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-01. [2025-09-26T20:33:46.887117] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-26T20:33:46.890631] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-02. [2025-09-26T20:33:46.909139] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-26T20:33:46.912720] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-02. [2025-09-26T20:33:46.940569] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-26T20:33:46.943423] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-02. [2025-09-26T20:33:47.701279] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-26T20:33:47.703274] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-03. [2025-09-26T20:33:47.738479] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-26T20:33:47.741433] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-03. [2025-09-26T20:33:47.940508] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-26T20:33:47.945386] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-03. [2025-09-26T20:33:48.214367] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-26T20:33:48.216810] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-04. [2025-09-26T20:33:48.655959] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-26T20:33:48.711680] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-04. [2025-09-26T20:33:48.782145] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-26T20:33:48.815093] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-26T20:33:49.019854] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-26T20:33:49.511729] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-04. [2025-09-26T20:33:49.665517] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-26T20:33:50.311723] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-02. [2025-09-26T20:33:50.680795] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-26T20:33:51.111723] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-05. [2025-09-26T20:33:51.911721] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-05. [2025-09-26T20:33:52.101670] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-26T20:33:52.288940] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-26T20:33:52.556388] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-26T20:33:52.711757] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-05. [2025-09-26T20:33:53.397044] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-26T20:33:53.511725] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-06. [2025-09-26T20:33:54.311731] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-03. [2025-09-26T20:33:54.604464] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-26T20:33:55.111721] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-07. [2025-09-26T20:33:55.911718] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-06. [2025-09-26T20:33:56.161186] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-26T20:33:56.204706] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-26T20:33:56.711710] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-04. [2025-09-26T20:33:56.741018] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-26T20:33:57.511754] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-07. [2025-09-26T20:33:58.311721] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-08. [2025-09-26T20:33:58.401862] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-26T20:33:58.432270] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T20:33:59.111735] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-06. [2025-09-26T20:33:59.255940] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-26T20:33:59.604250] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-26T20:33:59.911718] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-08. [2025-09-26T20:34:00.711736] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-07. [2025-09-26T20:34:00.971755] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-26T20:34:01.511742] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-05. [2025-09-26T20:34:02.159352] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-26T20:34:02.311736] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-08. [2025-09-26T20:34:03.111704] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-09. [2025-09-26T20:34:03.208970] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-26T20:34:03.911720] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-09. [2025-09-26T20:34:04.024832] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-26T20:34:04.027674] [INFO ] [REMOTE ] OPP: Full fetch complete (17473 records). [2025-09-26T20:34:04.027772] [DEBUG] [VALIDATOR ] OPP: Validating primary data. [2025-09-26T20:34:04.395484] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-26T20:34:04.465696] [DEBUG] [VALIDATOR ] OPP: All expected trading days are present. [2025-09-26T20:34:04.465810] [DEBUG] [VALIDATOR ] OPP: Primary data validation passed. [2025-09-26T20:34:04.466277] [INFO ] [MAIN ] OPP: Fetched primary data is valid. [2025-09-26T20:34:04.466360] [DEBUG] [LOCAL ] OPP: Saving primary data. [2025-09-26T20:34:04.467146] [DEBUG] [LOCAL ] OPP: Trimmed 17473 records to 11678 (keeping 200 days of data) [2025-09-26T20:34:04.550716] [DEBUG] [LOCAL ] OPP: Primary data saved (11678 records). [2025-09-26T20:34:04.550873] [INFO ] [MAIN ] OPP: Full history saved. [2025-09-26T20:34:04.551040] [INFO ] [MAIN ] Update Progress: 1601/2371 symbols completed. OPP took 22.6s. Estimated remaining: 1h 42m 56s. Rate: 7.5 symbols/min [2025-09-26T20:34:04.712489] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-06. [2025-09-26T20:34:04.734062] [INFO ] [MAIN ] OPY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:34:04.735017] [DEBUG] [LOCAL ] OPY: No existing data file found in primary storage. [2025-09-26T20:34:04.735090] [WARN ] [MAIN ] OPY: No existing data found, performing full refresh instead. [2025-09-26T20:34:04.735278] [INFO ] [MAIN ] OPY: Wiping existing primary data before full refresh. [2025-09-26T20:34:04.735323] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-09-26T20:34:04.735436] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-09-26T20:34:04.735478] [INFO ] [MAIN ] OPY: Starting full primary refresh. [2025-09-26T20:34:05.099692] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-26T20:34:05.120895] [INFO ] [REMOTE ] OOMA: Full fetch complete (26110 records). [2025-09-26T20:34:05.144321] [INFO ] [REMOTE ] OPY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:34:05.144737] [DEBUG] [VALIDATOR ] OOMA: Validating primary data. [2025-09-26T20:34:05.516907] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-09. [2025-09-26T20:34:05.529461] [DEBUG] [VALIDATOR ] OOMA: All expected trading days are present. [2025-09-26T20:34:05.529551] [DEBUG] [VALIDATOR ] OOMA: Primary data validation passed. [2025-09-26T20:34:05.530260] [INFO ] [MAIN ] OOMA: Fetched primary data is valid. [2025-09-26T20:34:05.530440] [DEBUG] [LOCAL ] OOMA: Saving primary data. [2025-09-26T20:34:05.531907] [DEBUG] [LOCAL ] OOMA: Trimmed 26110 records to 19260 (keeping 200 days of data) [2025-09-26T20:34:05.661818] [DEBUG] [LOCAL ] OOMA: Primary data saved (19260 records). [2025-09-26T20:34:05.661972] [INFO ] [MAIN ] OOMA: Full history saved. [2025-09-26T20:34:05.662074] [INFO ] [MAIN ] Update Progress: 1602/2371 symbols completed. OOMA took 23.7s. Estimated remaining: 1h 42m 45s. Rate: 7.5 symbols/min [2025-09-26T20:34:05.838344] [INFO ] [MAIN ] OR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:34:05.891195] [DEBUG] [LOCAL ] OR: Loaded 46423 existing records from primary storage. [2025-09-26T20:34:05.891338] [INFO ] [MAIN ] OR: Loaded 46423 existing records. [2025-09-26T20:34:06.075836] [WARN ] [MAIN ] OR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:34:06.076079] [INFO ] [MAIN ] OR: Wiping existing primary data before full refresh. [2025-09-26T20:34:06.076142] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-09-26T20:34:06.077724] [DEBUG] [LOCAL ] OR: Deleted primary data file. [2025-09-26T20:34:06.077786] [INFO ] [MAIN ] OR: Starting full primary refresh. [2025-09-26T20:34:06.313816] [INFO ] [REMOTE ] OPY: Fetching primary data for 2024-12. [2025-09-26T20:34:06.464836] [INFO ] [REMOTE ] OR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:34:06.568083] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-26T20:34:07.111693] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-07. [2025-09-26T20:34:07.187853] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-26T20:34:07.637956] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-26T20:34:07.649578] [INFO ] [REMOTE ] OPAD: Full fetch complete (23834 records). [2025-09-26T20:34:07.649839] [DEBUG] [VALIDATOR ] OPAD: Validating primary data. [2025-09-26T20:34:07.923314] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-01. [2025-09-26T20:34:08.066440] [DEBUG] [VALIDATOR ] OPAD: All expected trading days are present. [2025-09-26T20:34:08.066525] [DEBUG] [VALIDATOR ] OPAD: Primary data validation passed. [2025-09-26T20:34:08.067134] [INFO ] [MAIN ] OPAD: Fetched primary data is valid. [2025-09-26T20:34:08.067200] [DEBUG] [LOCAL ] OPAD: Saving primary data. [2025-09-26T20:34:08.068034] [DEBUG] [LOCAL ] OPAD: Trimmed 23834 records to 20793 (keeping 200 days of data) [2025-09-26T20:34:08.219766] [DEBUG] [LOCAL ] OPAD: Primary data saved (20793 records). [2025-09-26T20:34:08.219983] [INFO ] [MAIN ] OPAD: Full history saved. [2025-09-26T20:34:08.220147] [INFO ] [MAIN ] Update Progress: 1603/2371 symbols completed. OPAD took 26.2s. Estimated remaining: 1h 42m 34s. Rate: 7.5 symbols/min [2025-09-26T20:34:08.398353] [INFO ] [MAIN ] ORA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:34:08.450673] [DEBUG] [LOCAL ] ORA: Loaded 32800 existing records from primary storage. [2025-09-26T20:34:08.450828] [INFO ] [MAIN ] ORA: Loaded 32800 existing records. [2025-09-26T20:34:08.665201] [WARN ] [MAIN ] ORA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:34:08.670711] [INFO ] [MAIN ] ORA: Wiping existing primary data before full refresh. [2025-09-26T20:34:08.670389] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-26T20:34:08.670915] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-09-26T20:34:08.673917] [DEBUG] [LOCAL ] ORA: Deleted primary data file. [2025-09-26T20:34:08.673985] [INFO ] [MAIN ] ORA: Starting full primary refresh. [2025-09-26T20:34:08.716327] [INFO ] [REMOTE ] OR: Fetching primary data for 2024-12. [2025-09-26T20:34:09.121247] [INFO ] [REMOTE ] ORA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:34:09.154333] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-26T20:34:09.511732] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-08. [2025-09-26T20:34:10.311724] [INFO ] [REMOTE ] ORA: Fetching primary data for 2024-12. [2025-09-26T20:34:10.363391] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-26T20:34:11.111719] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-02. [2025-09-26T20:34:11.366945] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-26T20:34:11.802319] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-26T20:34:11.804204] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-26T20:34:11.911731] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-01. [2025-09-26T20:34:12.711716] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-09. [2025-09-26T20:34:13.513621] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-03. [2025-09-26T20:34:13.517448] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-26T20:34:14.213527] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-26T20:34:14.311729] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-04. [2025-09-26T20:34:14.454163] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-26T20:34:14.465623] [INFO ] [REMOTE ] OPFI: Full fetch complete (67647 records). [2025-09-26T20:34:14.465844] [DEBUG] [VALIDATOR ] OPFI: Validating primary data. [2025-09-26T20:34:14.882234] [DEBUG] [VALIDATOR ] OPFI: All expected trading days are present. [2025-09-26T20:34:14.882320] [DEBUG] [VALIDATOR ] OPFI: Primary data validation passed. [2025-09-26T20:34:14.883368] [INFO ] [MAIN ] OPFI: Fetched primary data is valid. [2025-09-26T20:34:14.883447] [DEBUG] [LOCAL ] OPFI: Saving primary data. [2025-09-26T20:34:14.884984] [DEBUG] [LOCAL ] OPFI: Trimmed 67647 records to 47258 (keeping 200 days of data) [2025-09-26T20:34:15.007585] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-26T20:34:15.126895] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-02. [2025-09-26T20:34:15.211235] [DEBUG] [LOCAL ] OPFI: Primary data saved (47258 records). [2025-09-26T20:34:15.211384] [INFO ] [MAIN ] OPFI: Full history saved. [2025-09-26T20:34:15.211485] [INFO ] [MAIN ] Update Progress: 1604/2371 symbols completed. OPFI took 33.2s. Estimated remaining: 1h 42m 26s. Rate: 7.5 symbols/min [2025-09-26T20:34:15.399478] [INFO ] [MAIN ] ORC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:34:15.457055] [DEBUG] [LOCAL ] ORC: Loaded 52702 existing records from primary storage. [2025-09-26T20:34:15.457235] [INFO ] [MAIN ] ORC: Loaded 52702 existing records. [2025-09-26T20:34:15.655890] [WARN ] [MAIN ] ORC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:34:15.656161] [INFO ] [MAIN ] ORC: Wiping existing primary data before full refresh. [2025-09-26T20:34:15.656215] [INFO ] [LOCAL ] ORC: Starting deletion of primary data. [2025-09-26T20:34:15.657588] [DEBUG] [LOCAL ] ORC: Deleted primary data file. [2025-09-26T20:34:15.657680] [INFO ] [MAIN ] ORC: Starting full primary refresh. [2025-09-26T20:34:15.917157] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-01. [2025-09-26T20:34:16.049704] [INFO ] [REMOTE ] ORC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:34:16.711731] [INFO ] [REMOTE ] ORC: Fetching primary data for 2024-12. [2025-09-26T20:34:16.743908] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-26T20:34:17.413414] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-26T20:34:17.512205] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-05. [2025-09-26T20:34:18.311701] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-02. [2025-09-26T20:34:18.374969] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-26T20:34:18.946052] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-26T20:34:19.111736] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-06. [2025-09-26T20:34:19.713164] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-26T20:34:19.911714] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-03. [2025-09-26T20:34:19.944544] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-26T20:34:20.711740] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-07. [2025-09-26T20:34:21.516929] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-03. [2025-09-26T20:34:21.529344] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-26T20:34:21.583700] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-26T20:34:22.311720] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-01. [2025-09-26T20:34:23.111713] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-08. [2025-09-26T20:34:23.268425] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-26T20:34:23.911724] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-04. [2025-09-26T20:34:23.997741] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-26T20:34:24.191117] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-26T20:34:24.711720] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-04. [2025-09-26T20:34:25.140144] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-26T20:34:25.511719] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-09. [2025-09-26T20:34:26.311724] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-02. [2025-09-26T20:34:26.431703] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-26T20:34:26.434146] [INFO ] [REMOTE ] OPY: Full fetch complete (10014 records). [2025-09-26T20:34:26.434220] [DEBUG] [VALIDATOR ] OPY: Validating primary data. [2025-09-26T20:34:26.634859] [WARN ] [VALIDATOR ] OPY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-26T20:34:26.635148] [FATAL] [MAIN ] OPY: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:34:26.635365] [WARN ] [MAIN ] OPY: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:34:26.635565] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-09-26T20:34:26.635700] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-09-26T20:34:26.635934] [INFO ] [LOCAL ] OPY: Starting deletion of derivative data. [2025-09-26T20:34:26.636005] [DEBUG] [LOCAL ] OPY: No derivative data file found to delete. [2025-09-26T20:34:26.636076] [INFO ] [MAIN ] Update Progress: 1605/2371 symbols completed. OPY took 22.1s. Estimated remaining: 1h 42m 19s. Rate: 7.5 symbols/min [2025-09-26T20:34:26.761186] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-26T20:34:26.859447] [INFO ] [MAIN ] ORCL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:34:26.859686] [DEBUG] [LOCAL ] ORCL: No existing data file found in primary storage. [2025-09-26T20:34:26.859743] [WARN ] [MAIN ] ORCL: No existing data found, performing full refresh instead. [2025-09-26T20:34:26.859958] [INFO ] [MAIN ] ORCL: Wiping existing primary data before full refresh. [2025-09-26T20:34:26.860014] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-09-26T20:34:26.860101] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-09-26T20:34:26.860164] [INFO ] [MAIN ] ORCL: Starting full primary refresh. [2025-09-26T20:34:27.122027] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-05. [2025-09-26T20:34:27.251054] [INFO ] [REMOTE ] ORCL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:34:27.911688] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-05. [2025-09-26T20:34:28.094736] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-26T20:34:28.549088] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-26T20:34:28.711732] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-06. [2025-09-26T20:34:29.487854] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-26T20:34:29.511682] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-06. [2025-09-26T20:34:29.631271] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-26T20:34:30.311748] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-03. [2025-09-26T20:34:31.111740] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2024-12. [2025-09-26T20:34:31.167395] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-26T20:34:31.911706] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-07. [2025-09-26T20:34:32.256462] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-26T20:34:32.304624] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-26T20:34:32.711748] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-04. [2025-09-26T20:34:33.511719] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-07. [2025-09-26T20:34:33.604813] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-26T20:34:34.311806] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-01. [2025-09-26T20:34:34.892272] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-26T20:34:34.987710] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-26T20:34:35.111739] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-05. [2025-09-26T20:34:35.290403] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-26T20:34:35.911805] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-08. [2025-09-26T20:34:36.711768] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-08. [2025-09-26T20:34:37.286018] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-26T20:34:37.511696] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-06. [2025-09-26T20:34:37.620943] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-26T20:34:37.860344] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-26T20:34:38.311754] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-02. [2025-09-26T20:34:39.111715] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-09. [2025-09-26T20:34:39.272162] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-26T20:34:39.571580] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-26T20:34:39.911725] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-07. [2025-09-26T20:34:40.733086] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-03. [2025-09-26T20:34:40.751966] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-26T20:34:40.762183] [INFO ] [REMOTE ] ORA: Full fetch complete (49254 records). [2025-09-26T20:34:40.762322] [DEBUG] [VALIDATOR ] ORA: Validating primary data. [2025-09-26T20:34:41.184024] [DEBUG] [VALIDATOR ] ORA: All expected trading days are present. [2025-09-26T20:34:41.184178] [DEBUG] [VALIDATOR ] ORA: Primary data validation passed. [2025-09-26T20:34:41.185084] [INFO ] [MAIN ] ORA: Fetched primary data is valid. [2025-09-26T20:34:41.185148] [DEBUG] [LOCAL ] ORA: Saving primary data. [2025-09-26T20:34:41.186220] [DEBUG] [LOCAL ] ORA: Trimmed 49254 records to 33001 (keeping 200 days of data) [2025-09-26T20:34:41.397686] [DEBUG] [LOCAL ] ORA: Primary data saved (33001 records). [2025-09-26T20:34:41.397839] [INFO ] [MAIN ] ORA: Full history saved. [2025-09-26T20:34:41.397931] [INFO ] [MAIN ] Update Progress: 1606/2371 symbols completed. ORA took 33.2s. Estimated remaining: 1h 42m 14s. Rate: 7.5 symbols/min [2025-09-26T20:34:41.516596] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-09. [2025-09-26T20:34:41.582212] [INFO ] [MAIN ] ORI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:34:41.582635] [DEBUG] [LOCAL ] ORI: No existing data file found in primary storage. [2025-09-26T20:34:41.582734] [WARN ] [MAIN ] ORI: No existing data found, performing full refresh instead. [2025-09-26T20:34:41.583035] [INFO ] [MAIN ] ORI: Wiping existing primary data before full refresh. [2025-09-26T20:34:41.583152] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-09-26T20:34:41.583283] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-09-26T20:34:41.583349] [INFO ] [MAIN ] ORI: Starting full primary refresh. [2025-09-26T20:34:42.021223] [INFO ] [REMOTE ] ORI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:34:42.028713] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-26T20:34:42.141860] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-26T20:34:42.311723] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-04. [2025-09-26T20:34:43.111714] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-08. [2025-09-26T20:34:43.219408] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-26T20:34:43.231703] [INFO ] [REMOTE ] OR: Full fetch complete (65191 records). [2025-09-26T20:34:43.231946] [DEBUG] [VALIDATOR ] OR: Validating primary data. [2025-09-26T20:34:43.466743] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-26T20:34:43.715408] [DEBUG] [VALIDATOR ] OR: All expected trading days are present. [2025-09-26T20:34:43.715510] [DEBUG] [VALIDATOR ] OR: Primary data validation passed. [2025-09-26T20:34:43.716742] [INFO ] [MAIN ] OR: Fetched primary data is valid. [2025-09-26T20:34:43.716832] [DEBUG] [LOCAL ] OR: Saving primary data. [2025-09-26T20:34:43.718585] [DEBUG] [LOCAL ] OR: Trimmed 65191 records to 46786 (keeping 200 days of data) [2025-09-26T20:34:43.916970] [INFO ] [REMOTE ] ORI: Fetching primary data for 2024-12. [2025-09-26T20:34:44.026218] [DEBUG] [LOCAL ] OR: Primary data saved (46786 records). [2025-09-26T20:34:44.026408] [INFO ] [MAIN ] OR: Full history saved. [2025-09-26T20:34:44.026530] [INFO ] [MAIN ] Update Progress: 1607/2371 symbols completed. OR took 38.4s. Estimated remaining: 1h 42m 4s. Rate: 7.5 symbols/min [2025-09-26T20:34:44.206399] [INFO ] [MAIN ] ORN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:34:44.237636] [DEBUG] [LOCAL ] ORN: Loaded 31831 existing records from primary storage. [2025-09-26T20:34:44.237807] [INFO ] [MAIN ] ORN: Loaded 31831 existing records. [2025-09-26T20:34:44.437167] [WARN ] [MAIN ] ORN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:34:44.437505] [INFO ] [MAIN ] ORN: Wiping existing primary data before full refresh. [2025-09-26T20:34:44.437563] [INFO ] [LOCAL ] ORN: Starting deletion of primary data. [2025-09-26T20:34:44.438269] [DEBUG] [LOCAL ] ORN: Deleted primary data file. [2025-09-26T20:34:44.438361] [INFO ] [MAIN ] ORN: Starting full primary refresh. [2025-09-26T20:34:44.720346] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-05. [2025-09-26T20:34:44.844530] [INFO ] [REMOTE ] ORN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:34:45.513127] [INFO ] [REMOTE ] ORN: Fetching primary data for 2024-12. [2025-09-26T20:34:45.536080] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-26T20:34:45.775048] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-26T20:34:45.916880] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-26T20:34:46.311746] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-06. [2025-09-26T20:34:47.043421] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-26T20:34:47.111718] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-09. [2025-09-26T20:34:47.229046] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-26T20:34:47.911737] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-07. [2025-09-26T20:34:48.711717] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-01. [2025-09-26T20:34:48.853116] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-26T20:34:49.159988] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-26T20:34:49.170178] [INFO ] [REMOTE ] ORC: Full fetch complete (75263 records). [2025-09-26T20:34:49.170313] [DEBUG] [VALIDATOR ] ORC: Validating primary data. [2025-09-26T20:34:49.521529] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-01. [2025-09-26T20:34:49.587448] [DEBUG] [VALIDATOR ] ORC: All expected trading days are present. [2025-09-26T20:34:49.587544] [DEBUG] [VALIDATOR ] ORC: Primary data validation passed. [2025-09-26T20:34:49.588706] [INFO ] [MAIN ] ORC: Fetched primary data is valid. [2025-09-26T20:34:49.588776] [DEBUG] [LOCAL ] ORC: Saving primary data. [2025-09-26T20:34:49.590363] [DEBUG] [LOCAL ] ORC: Trimmed 75263 records to 53083 (keeping 200 days of data) [2025-09-26T20:34:49.929041] [DEBUG] [LOCAL ] ORC: Primary data saved (53083 records). [2025-09-26T20:34:49.929226] [INFO ] [MAIN ] ORC: Full history saved. [2025-09-26T20:34:49.929405] [INFO ] [MAIN ] Update Progress: 1608/2371 symbols completed. ORC took 34.7s. Estimated remaining: 1h 41m 55s. Rate: 7.5 symbols/min [2025-09-26T20:34:50.123310] [INFO ] [MAIN ] OSCR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:34:50.156408] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-26T20:34:50.215925] [DEBUG] [LOCAL ] OSCR: Loaded 54112 existing records from primary storage. [2025-09-26T20:34:50.216106] [INFO ] [MAIN ] OSCR: Loaded 54112 existing records. [2025-09-26T20:34:50.320035] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-08. [2025-09-26T20:34:50.422821] [WARN ] [MAIN ] OSCR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:34:50.423207] [INFO ] [MAIN ] OSCR: Wiping existing primary data before full refresh. [2025-09-26T20:34:50.423267] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-09-26T20:34:50.424969] [DEBUG] [LOCAL ] OSCR: Deleted primary data file. [2025-09-26T20:34:50.425034] [INFO ] [MAIN ] OSCR: Starting full primary refresh. [2025-09-26T20:34:50.825152] [INFO ] [REMOTE ] OSCR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:34:50.844677] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-26T20:34:51.111696] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-02. [2025-09-26T20:34:51.280898] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-26T20:34:51.911718] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-02. [2025-09-26T20:34:52.455417] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-26T20:34:52.711755] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2024-12. [2025-09-26T20:34:53.482755] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-26T20:34:53.511694] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-03. [2025-09-26T20:34:54.311738] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-09. [2025-09-26T20:34:54.626999] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-26T20:34:55.093853] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-26T20:34:55.103810] [INFO ] [REMOTE ] ORCL: Full fetch complete (77142 records). [2025-09-26T20:34:55.104034] [DEBUG] [VALIDATOR ] ORCL: Validating primary data. [2025-09-26T20:34:55.105046] [FATAL] [VALIDATOR ] ORCL: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T20:34:55.105141] [FATAL] [MAIN ] ORCL: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:34:55.105212] [WARN ] [MAIN ] ORCL: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:34:55.105286] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-09-26T20:34:55.105357] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-09-26T20:34:55.105397] [INFO ] [LOCAL ] ORCL: Starting deletion of derivative data. [2025-09-26T20:34:55.105440] [DEBUG] [LOCAL ] ORCL: No derivative data file found to delete. [2025-09-26T20:34:55.105528] [INFO ] [MAIN ] Update Progress: 1609/2371 symbols completed. ORCL took 28.5s. Estimated remaining: 1h 41m 45s. Rate: 7.5 symbols/min [2025-09-26T20:34:55.117221] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-03. [2025-09-26T20:34:55.319864] [INFO ] [MAIN ] OSK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:34:55.323316] [DEBUG] [LOCAL ] OSK: No existing data file found in primary storage. [2025-09-26T20:34:55.323866] [WARN ] [MAIN ] OSK: No existing data found, performing full refresh instead. [2025-09-26T20:34:55.325215] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-26T20:34:55.325431] [INFO ] [MAIN ] OSK: Wiping existing primary data before full refresh. [2025-09-26T20:34:55.335464] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-09-26T20:34:55.336096] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-09-26T20:34:55.336165] [INFO ] [MAIN ] OSK: Starting full primary refresh. [2025-09-26T20:34:55.734710] [INFO ] [REMOTE ] OSK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:34:55.911721] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-01. [2025-09-26T20:34:56.676304] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-26T20:34:56.711683] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-04. [2025-09-26T20:34:57.511716] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-04. [2025-09-26T20:34:57.559120] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-26T20:34:58.079616] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-26T20:34:58.311716] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-05. [2025-09-26T20:34:59.111765] [INFO ] [REMOTE ] OSK: Fetching primary data for 2024-12. [2025-09-26T20:34:59.390176] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-26T20:34:59.778485] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T20:34:59.911699] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-06. [2025-09-26T20:35:00.711738] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-05. [2025-09-26T20:35:00.821162] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-26T20:35:01.269914] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-26T20:35:01.511719] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-01. [2025-09-26T20:35:02.311749] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-02. [2025-09-26T20:35:02.520821] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-26T20:35:03.116903] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-07. [2025-09-26T20:35:03.141080] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-26T20:35:03.911745] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-02. [2025-09-26T20:35:04.558413] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-26T20:35:04.676262] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-09-26T20:35:04.711727] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-08. [2025-09-26T20:35:05.511693] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-06. [2025-09-26T20:35:05.619414] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-26T20:35:06.220770] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-26T20:35:06.311732] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-09. [2025-09-26T20:35:07.097923] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-26T20:35:07.111659] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-07. [2025-09-26T20:35:07.911717] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-03. [2025-09-26T20:35:07.990909] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-26T20:35:07.997415] [INFO ] [REMOTE ] ORN: Full fetch complete (45746 records). [2025-09-26T20:35:07.997538] [DEBUG] [VALIDATOR ] ORN: Validating primary data. [2025-09-26T20:35:08.416417] [DEBUG] [VALIDATOR ] ORN: All expected trading days are present. [2025-09-26T20:35:08.416514] [DEBUG] [VALIDATOR ] ORN: Primary data validation passed. [2025-09-26T20:35:08.417414] [INFO ] [MAIN ] ORN: Fetched primary data is valid. [2025-09-26T20:35:08.417560] [DEBUG] [LOCAL ] ORN: Saving primary data. [2025-09-26T20:35:08.418856] [DEBUG] [LOCAL ] ORN: Trimmed 45746 records to 31979 (keeping 200 days of data) [2025-09-26T20:35:08.638569] [DEBUG] [LOCAL ] ORN: Primary data saved (31979 records). [2025-09-26T20:35:08.638854] [INFO ] [MAIN ] ORN: Full history saved. [2025-09-26T20:35:08.639023] [INFO ] [MAIN ] Update Progress: 1610/2371 symbols completed. ORN took 24.6s. Estimated remaining: 1h 41m 40s. Rate: 7.5 symbols/min [2025-09-26T20:35:08.714830] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-03. [2025-09-26T20:35:08.901706] [INFO ] [MAIN ] OTF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:35:08.902020] [DEBUG] [LOCAL ] OTF: No existing data file found in primary storage. [2025-09-26T20:35:08.902219] [WARN ] [MAIN ] OTF: No existing data found, performing full refresh instead. [2025-09-26T20:35:08.902661] [INFO ] [MAIN ] OTF: Wiping existing primary data before full refresh. [2025-09-26T20:35:08.902796] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-09-26T20:35:08.902908] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-09-26T20:35:08.903147] [INFO ] [MAIN ] OTF: Starting full primary refresh. [2025-09-26T20:35:09.057293] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-26T20:35:09.360599] [INFO ] [REMOTE ] OTF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:35:09.511801] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-08. [2025-09-26T20:35:09.623949] [DEBUG] [REMOTE ] ORI: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-09-26T20:35:09.624486] [WARN ] [REMOTE ] ORI: No data returned for month 2025-08 [2025-09-26T20:35:10.135968] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-26T20:35:10.311791] [INFO ] [REMOTE ] OTF: Fetching primary data for 2024-12. [2025-09-26T20:35:10.586139] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:35:10.586977] [WARN ] [REMOTE ] OTF: No data returned for month 2024-12 [2025-09-26T20:35:10.590978] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-26T20:35:11.111749] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-01. [2025-09-26T20:35:11.523806] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:35:11.524186] [WARN ] [REMOTE ] OTF: No data returned for month 2025-01 [2025-09-26T20:35:11.911718] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-09. [2025-09-26T20:35:12.711744] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-02. [2025-09-26T20:35:13.009416] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:35:13.009879] [WARN ] [REMOTE ] OTF: No data returned for month 2025-02 [2025-09-26T20:35:13.511732] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-03. [2025-09-26T20:35:13.598310] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-26T20:35:13.610320] [INFO ] [REMOTE ] ORI: Full fetch complete (63197 records). [2025-09-26T20:35:13.610576] [DEBUG] [VALIDATOR ] ORI: Validating primary data. [2025-09-26T20:35:13.770762] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:35:13.804077] [WARN ] [REMOTE ] OTF: No data returned for month 2025-03 [2025-09-26T20:35:13.825524] [WARN ] [VALIDATOR ] ORI: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-26T20:35:13.826831] [FATAL] [MAIN ] ORI: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:35:13.826937] [WARN ] [MAIN ] ORI: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:35:13.827012] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-09-26T20:35:13.827100] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-09-26T20:35:13.827160] [INFO ] [LOCAL ] ORI: Starting deletion of derivative data. [2025-09-26T20:35:13.827205] [DEBUG] [LOCAL ] ORI: No derivative data file found to delete. [2025-09-26T20:35:13.827295] [INFO ] [MAIN ] Update Progress: 1611/2371 symbols completed. ORI took 32.4s. Estimated remaining: 1h 41m 31s. Rate: 7.5 symbols/min [2025-09-26T20:35:14.006784] [INFO ] [MAIN ] OTIS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:35:14.060520] [DEBUG] [LOCAL ] OTIS: Loaded 53093 existing records from primary storage. [2025-09-26T20:35:14.060700] [INFO ] [MAIN ] OTIS: Loaded 53093 existing records. [2025-09-26T20:35:14.268836] [WARN ] [MAIN ] OTIS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:35:14.269196] [INFO ] [MAIN ] OTIS: Wiping existing primary data before full refresh. [2025-09-26T20:35:14.269314] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-09-26T20:35:14.270780] [DEBUG] [LOCAL ] OTIS: Deleted primary data file. [2025-09-26T20:35:14.270843] [INFO ] [MAIN ] OTIS: Starting full primary refresh. [2025-09-26T20:35:14.316873] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-04. [2025-09-26T20:35:14.675424] [INFO ] [REMOTE ] OTIS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:35:15.111725] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-04. [2025-09-26T20:35:15.408503] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:35:15.408877] [WARN ] [REMOTE ] OTF: No data returned for month 2025-04 [2025-09-26T20:35:15.911734] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-04. [2025-09-26T20:35:16.532628] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-26T20:35:16.711711] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-05. [2025-09-26T20:35:16.956474] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:35:16.956920] [WARN ] [REMOTE ] OTF: No data returned for month 2025-05 [2025-09-26T20:35:17.511724] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-05. [2025-09-26T20:35:17.852414] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-26T20:35:18.311738] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-06. [2025-09-26T20:35:19.111728] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2024-12. [2025-09-26T20:35:19.129122] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-26T20:35:19.902396] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-09-26T20:35:19.914945] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-07. [2025-09-26T20:35:20.711725] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-06. [2025-09-26T20:35:20.936035] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-26T20:35:20.954830] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-26T20:35:21.511728] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-08. [2025-09-26T20:35:22.311723] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-05. [2025-09-26T20:35:22.534325] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-26T20:35:23.111732] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-09. [2025-09-26T20:35:23.307860] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-09-26T20:35:23.808549] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-26T20:35:23.911732] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-01. [2025-09-26T20:35:24.513916] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-26T20:35:24.520934] [INFO ] [REMOTE ] OTF: Full fetch complete (9206 records). [2025-09-26T20:35:24.521080] [DEBUG] [VALIDATOR ] OTF: Validating primary data. [2025-09-26T20:35:24.716469] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-06. [2025-09-26T20:35:24.723197] [WARN ] [VALIDATOR ] OTF: Validation failed - insufficient historical data. Have 74 unique days, need 200 days [2025-09-26T20:35:24.724851] [FATAL] [MAIN ] OTF: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:35:24.724977] [WARN ] [MAIN ] OTF: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:35:24.725039] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-09-26T20:35:24.725286] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-09-26T20:35:24.725349] [INFO ] [LOCAL ] OTF: Starting deletion of derivative data. [2025-09-26T20:35:24.725395] [DEBUG] [LOCAL ] OTF: No derivative data file found to delete. [2025-09-26T20:35:24.725494] [INFO ] [MAIN ] Update Progress: 1612/2371 symbols completed. OTF took 16.1s. Estimated remaining: 1h 41m 24s. Rate: 7.5 symbols/min [2025-09-26T20:35:24.922622] [INFO ] [MAIN ] OUT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:35:24.971754] [DEBUG] [LOCAL ] OUT: Loaded 48342 existing records from primary storage. [2025-09-26T20:35:24.971912] [INFO ] [MAIN ] OUT: Loaded 48342 existing records. [2025-09-26T20:35:25.162002] [WARN ] [MAIN ] OUT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:35:25.162256] [INFO ] [MAIN ] OUT: Wiping existing primary data before full refresh. [2025-09-26T20:35:25.162303] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-09-26T20:35:25.163415] [DEBUG] [LOCAL ] OUT: Deleted primary data file. [2025-09-26T20:35:25.163477] [INFO ] [MAIN ] OUT: Starting full primary refresh. [2025-09-26T20:35:25.522149] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-07. [2025-09-26T20:35:25.571433] [INFO ] [REMOTE ] OUT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:35:25.819747] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-26T20:35:25.892760] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-26T20:35:26.311750] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-07. [2025-09-26T20:35:27.111725] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-02. [2025-09-26T20:35:27.863320] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-26T20:35:27.911709] [INFO ] [REMOTE ] OUT: Fetching primary data for 2024-12. [2025-09-26T20:35:27.986571] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-26T20:35:28.711757] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-08. [2025-09-26T20:35:28.927422] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-26T20:35:29.511731] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-08. [2025-09-26T20:35:29.774893] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-26T20:35:30.315690] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-03. [2025-09-26T20:35:30.328694] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-26T20:35:31.111758] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-09. [2025-09-26T20:35:31.874122] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-09-26T20:35:31.911691] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-09. [2025-09-26T20:35:32.336307] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-26T20:35:32.374926] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-26T20:35:32.383611] [INFO ] [REMOTE ] OSK: Full fetch complete (61451 records). [2025-09-26T20:35:32.383819] [DEBUG] [VALIDATOR ] OSK: Validating primary data. [2025-09-26T20:35:32.599335] [WARN ] [VALIDATOR ] OSK: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-26T20:35:32.600247] [FATAL] [MAIN ] OSK: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:35:32.600331] [WARN ] [MAIN ] OSK: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:35:32.600415] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-09-26T20:35:32.600493] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-09-26T20:35:32.600686] [INFO ] [LOCAL ] OSK: Starting deletion of derivative data. [2025-09-26T20:35:32.600758] [DEBUG] [LOCAL ] OSK: No derivative data file found to delete. [2025-09-26T20:35:32.600840] [INFO ] [MAIN ] Update Progress: 1613/2371 symbols completed. OSK took 37.5s. Estimated remaining: 1h 41m 16s. Rate: 7.5 symbols/min [2025-09-26T20:35:32.718029] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-04. [2025-09-26T20:35:32.797845] [INFO ] [MAIN ] OVV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:35:32.866955] [DEBUG] [LOCAL ] OVV: Loaded 53905 existing records from primary storage. [2025-09-26T20:35:32.867109] [INFO ] [MAIN ] OVV: Loaded 53905 existing records. [2025-09-26T20:35:33.057026] [WARN ] [MAIN ] OVV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:35:33.057384] [INFO ] [MAIN ] OVV: Wiping existing primary data before full refresh. [2025-09-26T20:35:33.057437] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-09-26T20:35:33.059711] [DEBUG] [LOCAL ] OVV: Deleted primary data file. [2025-09-26T20:35:33.059970] [INFO ] [MAIN ] OVV: Starting full primary refresh. [2025-09-26T20:35:33.475308] [INFO ] [REMOTE ] OVV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:35:33.511782] [INFO ] [REMOTE ] OVV: Fetching primary data for 2024-12. [2025-09-26T20:35:34.311737] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-01. [2025-09-26T20:35:34.483850] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-09-26T20:35:34.494927] [INFO ] [REMOTE ] OSCR: Full fetch complete (77489 records). [2025-09-26T20:35:34.495141] [DEBUG] [VALIDATOR ] OSCR: Validating primary data. [2025-09-26T20:35:34.960452] [DEBUG] [VALIDATOR ] OSCR: All expected trading days are present. [2025-09-26T20:35:34.960585] [DEBUG] [VALIDATOR ] OSCR: Primary data validation passed. [2025-09-26T20:35:34.961908] [INFO ] [MAIN ] OSCR: Fetched primary data is valid. [2025-09-26T20:35:34.961999] [DEBUG] [LOCAL ] OSCR: Saving primary data. [2025-09-26T20:35:34.995014] [DEBUG] [LOCAL ] OSCR: Trimmed 77489 records to 54502 (keeping 200 days of data) [2025-09-26T20:35:34.998252] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-26T20:35:35.112210] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-05. [2025-09-26T20:35:35.368788] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-26T20:35:35.406361] [DEBUG] [LOCAL ] OSCR: Primary data saved (54502 records). [2025-09-26T20:35:35.406518] [INFO ] [MAIN ] OSCR: Full history saved. [2025-09-26T20:35:35.406662] [INFO ] [MAIN ] Update Progress: 1614/2371 symbols completed. OSCR took 45.5s. Estimated remaining: 1h 41m 6s. Rate: 7.5 symbols/min [2025-09-26T20:35:35.622848] [INFO ] [MAIN ] OWL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:35:35.657038] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-26T20:35:35.716002] [DEBUG] [LOCAL ] OWL: Loaded 53945 existing records from primary storage. [2025-09-26T20:35:35.716165] [INFO ] [MAIN ] OWL: Loaded 53945 existing records. [2025-09-26T20:35:35.905793] [WARN ] [MAIN ] OWL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:35:35.906062] [INFO ] [MAIN ] OWL: Wiping existing primary data before full refresh. [2025-09-26T20:35:35.906110] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-09-26T20:35:35.907394] [DEBUG] [LOCAL ] OWL: Deleted primary data file. [2025-09-26T20:35:35.907462] [INFO ] [MAIN ] OWL: Starting full primary refresh. [2025-09-26T20:35:35.919484] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-01. [2025-09-26T20:35:36.298551] [INFO ] [REMOTE ] OWL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:35:36.711733] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-02. [2025-09-26T20:35:36.988444] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-26T20:35:37.511725] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-06. [2025-09-26T20:35:37.805116] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-26T20:35:38.311720] [INFO ] [REMOTE ] OWL: Fetching primary data for 2024-12. [2025-09-26T20:35:38.347756] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-26T20:35:39.111689] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-03. [2025-09-26T20:35:39.390829] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-26T20:35:39.911724] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-02. [2025-09-26T20:35:40.292742] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-26T20:35:40.711744] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-07. [2025-09-26T20:35:41.010857] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-26T20:35:41.511737] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-01. [2025-09-26T20:35:41.777059] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-26T20:35:42.311730] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-04. [2025-09-26T20:35:42.906599] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-26T20:35:43.111738] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-03. [2025-09-26T20:35:43.339265] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-26T20:35:43.911696] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-08. [2025-09-26T20:35:43.981053] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-26T20:35:44.711756] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-05. [2025-09-26T20:35:45.060060] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-26T20:35:45.511756] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-02. [2025-09-26T20:35:45.970493] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-26T20:35:46.138090] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-26T20:35:46.311741] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-09. [2025-09-26T20:35:47.111750] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-04. [2025-09-26T20:35:47.480691] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-26T20:35:47.911697] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-03. [2025-09-26T20:35:48.240511] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-26T20:35:48.252153] [INFO ] [REMOTE ] OTIS: Full fetch complete (75865 records). [2025-09-26T20:35:48.252340] [DEBUG] [VALIDATOR ] OTIS: Validating primary data. [2025-09-26T20:35:48.686623] [DEBUG] [VALIDATOR ] OTIS: All expected trading days are present. [2025-09-26T20:35:48.686767] [DEBUG] [VALIDATOR ] OTIS: Primary data validation passed. [2025-09-26T20:35:48.688032] [INFO ] [MAIN ] OTIS: Fetched primary data is valid. [2025-09-26T20:35:48.688128] [DEBUG] [LOCAL ] OTIS: Saving primary data. [2025-09-26T20:35:48.689782] [DEBUG] [LOCAL ] OTIS: Trimmed 75865 records to 53481 (keeping 200 days of data) [2025-09-26T20:35:48.751896] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-06. [2025-09-26T20:35:49.052377] [DEBUG] [LOCAL ] OTIS: Primary data saved (53481 records). [2025-09-26T20:35:49.052537] [INFO ] [MAIN ] OTIS: Full history saved. [2025-09-26T20:35:49.052692] [INFO ] [MAIN ] Update Progress: 1615/2371 symbols completed. OTIS took 35.2s. Estimated remaining: 1h 41m 0s. Rate: 7.5 symbols/min [2025-09-26T20:35:49.261520] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-26T20:35:49.302674] [INFO ] [MAIN ] OWLT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:35:49.313957] [DEBUG] [LOCAL ] OWLT: Loaded 9023 existing records from primary storage. [2025-09-26T20:35:49.314085] [INFO ] [MAIN ] OWLT: Loaded 9023 existing records. [2025-09-26T20:35:49.517269] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-05. [2025-09-26T20:35:49.542221] [WARN ] [MAIN ] OWLT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:35:49.542538] [INFO ] [MAIN ] OWLT: Wiping existing primary data before full refresh. [2025-09-26T20:35:49.542589] [INFO ] [LOCAL ] OWLT: Starting deletion of primary data. [2025-09-26T20:35:49.542935] [DEBUG] [LOCAL ] OWLT: Deleted primary data file. [2025-09-26T20:35:49.543010] [INFO ] [MAIN ] OWLT: Starting full primary refresh. [2025-09-26T20:35:49.932028] [INFO ] [REMOTE ] OWLT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:35:50.311730] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2024-12. [2025-09-26T20:35:50.471524] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-26T20:35:51.111683] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-07. [2025-09-26T20:35:51.217835] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-26T20:35:51.536075] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-26T20:35:51.911728] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-06. [2025-09-26T20:35:52.711738] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-01. [2025-09-26T20:35:52.837163] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-26T20:35:53.213801] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-03 (5.30 seconds). [2025-09-26T20:35:53.382577] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-26T20:35:53.511732] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-04. [2025-09-26T20:35:53.839411] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-26T20:35:54.311778] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-07. [2025-09-26T20:35:55.111703] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-02. [2025-09-26T20:35:55.262961] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-26T20:35:55.836121] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-26T20:35:55.911737] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-05. [2025-09-26T20:35:56.346397] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-26T20:35:56.711745] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-08. [2025-09-26T20:35:57.511748] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-08. [2025-09-26T20:35:57.784906] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-26T20:35:58.311712] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-03. [2025-09-26T20:35:58.355201] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-26T20:35:59.051551] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-26T20:35:59.111730] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-06. [2025-09-26T20:35:59.123292] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-26T20:35:59.911747] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-09. [2025-09-26T20:36:00.711791] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-04. [2025-09-26T20:36:01.098452] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-26T20:36:01.466579] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-26T20:36:01.511756] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-07. [2025-09-26T20:36:01.836928] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-26T20:36:01.848136] [INFO ] [REMOTE ] OVV: Full fetch complete (77313 records). [2025-09-26T20:36:01.848387] [DEBUG] [VALIDATOR ] OVV: Validating primary data. [2025-09-26T20:36:02.313618] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-09. [2025-09-26T20:36:02.314505] [DEBUG] [VALIDATOR ] OVV: All expected trading days are present. [2025-09-26T20:36:02.315734] [DEBUG] [VALIDATOR ] OVV: Primary data validation passed. [2025-09-26T20:36:02.318198] [INFO ] [MAIN ] OVV: Fetched primary data is valid. [2025-09-26T20:36:02.318450] [DEBUG] [LOCAL ] OVV: Saving primary data. [2025-09-26T20:36:02.322481] [DEBUG] [LOCAL ] OVV: Trimmed 77313 records to 54295 (keeping 200 days of data) [2025-09-26T20:36:02.698899] [DEBUG] [LOCAL ] OVV: Primary data saved (54295 records). [2025-09-26T20:36:02.699064] [INFO ] [MAIN ] OVV: Full history saved. [2025-09-26T20:36:02.699192] [INFO ] [MAIN ] Update Progress: 1616/2371 symbols completed. OVV took 30.1s. Estimated remaining: 1h 40m 55s. Rate: 7.5 symbols/min [2025-09-26T20:36:02.874807] [INFO ] [MAIN ] OXM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:36:02.875031] [DEBUG] [LOCAL ] OXM: No existing data file found in primary storage. [2025-09-26T20:36:02.875087] [WARN ] [MAIN ] OXM: No existing data found, performing full refresh instead. [2025-09-26T20:36:02.875243] [INFO ] [MAIN ] OXM: Wiping existing primary data before full refresh. [2025-09-26T20:36:02.875288] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-09-26T20:36:02.875331] [DEBUG] [LOCAL ] OXM: No primary data file found to delete. [2025-09-26T20:36:02.875365] [INFO ] [MAIN ] OXM: Starting full primary refresh. [2025-09-26T20:36:03.124668] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-05. [2025-09-26T20:36:03.256366] [INFO ] [REMOTE ] OXM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:36:03.596684] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-26T20:36:03.625934] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-26T20:36:03.911736] [INFO ] [REMOTE ] OXM: Fetching primary data for 2024-12. [2025-09-26T20:36:03.980632] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-26T20:36:03.989902] [INFO ] [REMOTE ] OUT: Full fetch complete (68974 records). [2025-09-26T20:36:03.990063] [DEBUG] [VALIDATOR ] OUT: Validating primary data. [2025-09-26T20:36:04.406941] [DEBUG] [VALIDATOR ] OUT: All expected trading days are present. [2025-09-26T20:36:04.407045] [DEBUG] [VALIDATOR ] OUT: Primary data validation passed. [2025-09-26T20:36:04.408197] [INFO ] [MAIN ] OUT: Fetched primary data is valid. [2025-09-26T20:36:04.408288] [DEBUG] [LOCAL ] OUT: Saving primary data. [2025-09-26T20:36:04.409849] [DEBUG] [LOCAL ] OUT: Trimmed 68974 records to 48630 (keeping 200 days of data) [2025-09-26T20:36:04.714959] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-08. [2025-09-26T20:36:04.733282] [DEBUG] [LOCAL ] OUT: Primary data saved (48630 records). [2025-09-26T20:36:04.733403] [INFO ] [MAIN ] OUT: Full history saved. [2025-09-26T20:36:04.733508] [INFO ] [MAIN ] Update Progress: 1617/2371 symbols completed. OUT took 40.0s. Estimated remaining: 1h 40m 44s. Rate: 7.5 symbols/min [2025-09-26T20:36:04.914400] [INFO ] [MAIN ] OXY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:36:04.914675] [DEBUG] [LOCAL ] OXY: No existing data file found in primary storage. [2025-09-26T20:36:04.914735] [WARN ] [MAIN ] OXY: No existing data found, performing full refresh instead. [2025-09-26T20:36:04.914931] [INFO ] [MAIN ] OXY: Wiping existing primary data before full refresh. [2025-09-26T20:36:04.914977] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-09-26T20:36:04.915019] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-09-26T20:36:04.915053] [INFO ] [MAIN ] OXY: Starting full primary refresh. [2025-09-26T20:36:05.294828] [INFO ] [REMOTE ] OXY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:36:05.511736] [INFO ] [REMOTE ] OXY: Fetching primary data for 2024-12. [2025-09-26T20:36:05.686373] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-26T20:36:06.311764] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-01. [2025-09-26T20:36:06.694288] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-26T20:36:07.111762] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-09. [2025-09-26T20:36:07.789404] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-26T20:36:07.911736] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-06. [2025-09-26T20:36:08.188716] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2024-12 (2.68 seconds). [2025-09-26T20:36:08.521154] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-26T20:36:08.531616] [INFO ] [REMOTE ] OWL: Full fetch complete (77528 records). [2025-09-26T20:36:08.531817] [DEBUG] [VALIDATOR ] OWL: Validating primary data. [2025-09-26T20:36:08.700508] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-26T20:36:08.716509] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-01. [2025-09-26T20:36:08.977187] [DEBUG] [VALIDATOR ] OWL: All expected trading days are present. [2025-09-26T20:36:08.977288] [DEBUG] [VALIDATOR ] OWL: Primary data validation passed. [2025-09-26T20:36:08.978344] [INFO ] [MAIN ] OWL: Fetched primary data is valid. [2025-09-26T20:36:08.978417] [DEBUG] [LOCAL ] OWL: Saving primary data. [2025-09-26T20:36:08.980125] [DEBUG] [LOCAL ] OWL: Trimmed 77528 records to 54335 (keeping 200 days of data) [2025-09-26T20:36:09.361635] [DEBUG] [LOCAL ] OWL: Primary data saved (54335 records). [2025-09-26T20:36:09.361816] [INFO ] [MAIN ] OWL: Full history saved. [2025-09-26T20:36:09.361918] [INFO ] [MAIN ] Update Progress: 1618/2371 symbols completed. OWL took 34.0s. Estimated remaining: 1h 40m 34s. Rate: 7.5 symbols/min [2025-09-26T20:36:09.516938] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-07. [2025-09-26T20:36:09.578483] [INFO ] [MAIN ] PAAS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:36:09.633919] [DEBUG] [LOCAL ] PAAS: Loaded 53993 existing records from primary storage. [2025-09-26T20:36:09.634214] [INFO ] [MAIN ] PAAS: Loaded 53993 existing records. [2025-09-26T20:36:09.821672] [WARN ] [MAIN ] PAAS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:36:09.821963] [INFO ] [MAIN ] PAAS: Wiping existing primary data before full refresh. [2025-09-26T20:36:09.822012] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-09-26T20:36:09.823248] [DEBUG] [LOCAL ] PAAS: Deleted primary data file. [2025-09-26T20:36:09.823311] [INFO ] [MAIN ] PAAS: Starting full primary refresh. [2025-09-26T20:36:10.204663] [INFO ] [REMOTE ] PAAS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:36:10.311745] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2024-12. [2025-09-26T20:36:10.428751] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-26T20:36:11.111733] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-08. [2025-09-26T20:36:11.321697] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-01 (2.61 seconds). [2025-09-26T20:36:11.911753] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-02. [2025-09-26T20:36:12.071750] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-26T20:36:12.670683] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-09-26T20:36:12.711711] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-01. [2025-09-26T20:36:13.181181] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-26T20:36:13.511751] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-03. [2025-09-26T20:36:14.311712] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-02. [2025-09-26T20:36:14.877869] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-26T20:36:15.045201] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-26T20:36:15.111705] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-04. [2025-09-26T20:36:15.911735] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-09. [2025-09-26T20:36:16.636352] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-09-26T20:36:16.711783] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-02. [2025-09-26T20:36:16.736392] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-26T20:36:16.741028] [INFO ] [REMOTE ] OWLT: Full fetch complete (11644 records). [2025-09-26T20:36:16.741175] [DEBUG] [VALIDATOR ] OWLT: Validating primary data. [2025-09-26T20:36:16.944083] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-26T20:36:17.175183] [DEBUG] [VALIDATOR ] OWLT: All expected trading days are present. [2025-09-26T20:36:17.175326] [DEBUG] [VALIDATOR ] OWLT: Primary data validation passed. [2025-09-26T20:36:17.175816] [INFO ] [MAIN ] OWLT: Fetched primary data is valid. [2025-09-26T20:36:17.175913] [DEBUG] [LOCAL ] OWLT: Saving primary data. [2025-09-26T20:36:17.177050] [DEBUG] [LOCAL ] OWLT: Trimmed 11644 records to 9099 (keeping 200 days of data) [2025-09-26T20:36:17.237173] [DEBUG] [LOCAL ] OWLT: Primary data saved (9099 records). [2025-09-26T20:36:17.237336] [INFO ] [MAIN ] OWLT: Full history saved. [2025-09-26T20:36:17.237570] [INFO ] [MAIN ] Update Progress: 1619/2371 symbols completed. OWLT took 28.2s. Estimated remaining: 1h 40m 26s. Rate: 7.5 symbols/min [2025-09-26T20:36:17.423816] [INFO ] [MAIN ] PAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:36:17.445552] [DEBUG] [LOCAL ] PAC: Loaded 11651 existing records from primary storage. [2025-09-26T20:36:17.445747] [INFO ] [MAIN ] PAC: Loaded 11651 existing records. [2025-09-26T20:36:17.516937] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-03. [2025-09-26T20:36:17.637056] [WARN ] [MAIN ] PAC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:36:17.637331] [INFO ] [MAIN ] PAC: Wiping existing primary data before full refresh. [2025-09-26T20:36:17.637391] [INFO ] [LOCAL ] PAC: Starting deletion of primary data. [2025-09-26T20:36:17.637953] [DEBUG] [LOCAL ] PAC: Deleted primary data file. [2025-09-26T20:36:17.638027] [INFO ] [MAIN ] PAC: Starting full primary refresh. [2025-09-26T20:36:18.018125] [INFO ] [REMOTE ] PAC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:36:18.311686] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-05. [2025-09-26T20:36:18.574173] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-26T20:36:19.111717] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-03. [2025-09-26T20:36:19.776226] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-26T20:36:19.911720] [INFO ] [REMOTE ] PAC: Fetching primary data for 2024-12. [2025-09-26T20:36:20.518425] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-03 (3.00 seconds). [2025-09-26T20:36:20.711704] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-06. [2025-09-26T20:36:21.152808] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-26T20:36:21.313839] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T20:36:21.511729] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-04. [2025-09-26T20:36:22.263302] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T20:36:22.311747] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-07. [2025-09-26T20:36:23.122078] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-04. [2025-09-26T20:36:23.144147] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-26T20:36:23.736017] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-26T20:36:23.911815] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-08. [2025-09-26T20:36:24.711748] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-05. [2025-09-26T20:36:25.245459] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-26T20:36:25.511730] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-01. [2025-09-26T20:36:25.854921] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-04 (2.73 seconds). [2025-09-26T20:36:26.311704] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-05. [2025-09-26T20:36:26.399049] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-26T20:36:26.978682] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-26T20:36:27.111756] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-02. [2025-09-26T20:36:27.784147] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-26T20:36:27.911734] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-09. [2025-09-26T20:36:28.468880] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-26T20:36:28.711739] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-06. [2025-09-26T20:36:29.362442] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-26T20:36:29.370902] [INFO ] [REMOTE ] OXM: Full fetch complete (46290 records). [2025-09-26T20:36:29.371006] [DEBUG] [VALIDATOR ] OXM: Validating primary data. [2025-09-26T20:36:29.521871] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-03. [2025-09-26T20:36:29.773146] [DEBUG] [VALIDATOR ] OXM: All expected trading days are present. [2025-09-26T20:36:29.773231] [DEBUG] [VALIDATOR ] OXM: Primary data validation passed. [2025-09-26T20:36:29.774098] [INFO ] [MAIN ] OXM: Fetched primary data is valid. [2025-09-26T20:36:29.774165] [DEBUG] [LOCAL ] OXM: Saving primary data. [2025-09-26T20:36:29.777634] [DEBUG] [LOCAL ] OXM: Trimmed 46290 records to 33928 (keeping 200 days of data) [2025-09-26T20:36:30.002071] [DEBUG] [LOCAL ] OXM: Primary data saved (33928 records). [2025-09-26T20:36:30.002243] [INFO ] [MAIN ] OXM: Full history saved. [2025-09-26T20:36:30.002397] [INFO ] [MAIN ] Update Progress: 1620/2371 symbols completed. OXM took 27.3s. Estimated remaining: 1h 40m 20s. Rate: 7.5 symbols/min [2025-09-26T20:36:30.181679] [INFO ] [MAIN ] PACK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:36:30.215432] [DEBUG] [LOCAL ] PACK: Loaded 32207 existing records from primary storage. [2025-09-26T20:36:30.215569] [INFO ] [MAIN ] PACK: Loaded 32207 existing records. [2025-09-26T20:36:30.320247] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-06. [2025-09-26T20:36:30.419005] [WARN ] [MAIN ] PACK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:36:30.419301] [INFO ] [MAIN ] PACK: Wiping existing primary data before full refresh. [2025-09-26T20:36:30.419363] [INFO ] [LOCAL ] PACK: Starting deletion of primary data. [2025-09-26T20:36:30.420265] [DEBUG] [LOCAL ] PACK: Deleted primary data file. [2025-09-26T20:36:30.420326] [INFO ] [MAIN ] PACK: Starting full primary refresh. [2025-09-26T20:36:30.542136] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-26T20:36:30.821807] [INFO ] [REMOTE ] PACK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:36:30.862032] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-26T20:36:31.111729] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-07. [2025-09-26T20:36:31.911720] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-04. [2025-09-26T20:36:32.711711] [INFO ] [REMOTE ] PACK: Fetching primary data for 2024-12. [2025-09-26T20:36:32.805585] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-09-26T20:36:33.034630] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-26T20:36:33.451607] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-26T20:36:33.511699] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-08. [2025-09-26T20:36:34.069575] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-26T20:36:34.311722] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-01. [2025-09-26T20:36:35.111727] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-05. [2025-09-26T20:36:35.638634] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-26T20:36:35.663541] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-26T20:36:35.803731] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-26T20:36:35.911745] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-02. [2025-09-26T20:36:36.711722] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-07. [2025-09-26T20:36:37.240483] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-26T20:36:37.511739] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-06. [2025-09-26T20:36:38.311724] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-09. [2025-09-26T20:36:38.511331] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-26T20:36:39.111703] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-07. [2025-09-26T20:36:39.305190] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-09-26T20:36:39.911725] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-03. [2025-09-26T20:36:40.051140] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-26T20:36:40.149246] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-26T20:36:40.162117] [INFO ] [REMOTE ] PAAS: Full fetch complete (77383 records). [2025-09-26T20:36:40.162323] [DEBUG] [VALIDATOR ] PAAS: Validating primary data. [2025-09-26T20:36:40.587586] [DEBUG] [VALIDATOR ] PAAS: All expected trading days are present. [2025-09-26T20:36:40.587736] [DEBUG] [VALIDATOR ] PAAS: Primary data validation passed. [2025-09-26T20:36:40.589197] [INFO ] [MAIN ] PAAS: Fetched primary data is valid. [2025-09-26T20:36:40.589279] [DEBUG] [LOCAL ] PAAS: Saving primary data. [2025-09-26T20:36:40.591208] [DEBUG] [LOCAL ] PAAS: Trimmed 77383 records to 54383 (keeping 200 days of data) [2025-09-26T20:36:40.711819] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-08. [2025-09-26T20:36:40.873578] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-26T20:36:40.997799] [DEBUG] [LOCAL ] PAAS: Primary data saved (54383 records). [2025-09-26T20:36:40.998038] [INFO ] [MAIN ] PAAS: Full history saved. [2025-09-26T20:36:40.998205] [INFO ] [MAIN ] Update Progress: 1621/2371 symbols completed. PAAS took 31.6s. Estimated remaining: 1h 40m 14s. Rate: 7.5 symbols/min [2025-09-26T20:36:41.186695] [INFO ] [MAIN ] PACS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:36:41.232774] [DEBUG] [LOCAL ] PACS: Loaded 34425 existing records from primary storage. [2025-09-26T20:36:41.232943] [INFO ] [MAIN ] PACS: Loaded 34425 existing records. [2025-09-26T20:36:41.423882] [WARN ] [MAIN ] PACS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:36:41.424292] [INFO ] [MAIN ] PACS: Wiping existing primary data before full refresh. [2025-09-26T20:36:41.424345] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-09-26T20:36:41.425296] [DEBUG] [LOCAL ] PACS: Deleted primary data file. [2025-09-26T20:36:41.425365] [INFO ] [MAIN ] PACS: Starting full primary refresh. [2025-09-26T20:36:41.516966] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-08. [2025-09-26T20:36:41.812338] [INFO ] [REMOTE ] PACS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:36:42.311756] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-04. [2025-09-26T20:36:42.363451] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-26T20:36:43.025324] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-26T20:36:43.111776] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-09. [2025-09-26T20:36:43.673207] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-26T20:36:43.911734] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-05. [2025-09-26T20:36:44.091146] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-26T20:36:44.093691] [INFO ] [REMOTE ] PAC: Full fetch complete (16392 records). [2025-09-26T20:36:44.093775] [DEBUG] [VALIDATOR ] PAC: Validating primary data. [2025-09-26T20:36:44.457917] [DEBUG] [VALIDATOR ] PAC: All expected trading days are present. [2025-09-26T20:36:44.458089] [DEBUG] [VALIDATOR ] PAC: Primary data validation passed. [2025-09-26T20:36:44.458683] [INFO ] [MAIN ] PAC: Fetched primary data is valid. [2025-09-26T20:36:44.458748] [DEBUG] [LOCAL ] PAC: Saving primary data. [2025-09-26T20:36:44.459380] [DEBUG] [LOCAL ] PAC: Trimmed 16392 records to 11725 (keeping 200 days of data) [2025-09-26T20:36:44.542123] [DEBUG] [LOCAL ] PAC: Primary data saved (11725 records). [2025-09-26T20:36:44.542310] [INFO ] [MAIN ] PAC: Full history saved. [2025-09-26T20:36:44.542431] [INFO ] [MAIN ] Update Progress: 1622/2371 symbols completed. PAC took 27.3s. Estimated remaining: 1h 40m 4s. Rate: 7.5 symbols/min [2025-09-26T20:36:44.714450] [INFO ] [REMOTE ] PACS: Fetching primary data for 2024-12. [2025-09-26T20:36:44.716615] [INFO ] [MAIN ] PAG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:36:44.747633] [DEBUG] [LOCAL ] PAG: Loaded 22087 existing records from primary storage. [2025-09-26T20:36:44.747879] [INFO ] [MAIN ] PAG: Loaded 22087 existing records. [2025-09-26T20:36:44.930920] [WARN ] [MAIN ] PAG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:36:44.931267] [INFO ] [MAIN ] PAG: Wiping existing primary data before full refresh. [2025-09-26T20:36:44.931320] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-09-26T20:36:44.932062] [DEBUG] [LOCAL ] PAG: Deleted primary data file. [2025-09-26T20:36:44.932126] [INFO ] [MAIN ] PAG: Starting full primary refresh. [2025-09-26T20:36:45.345011] [INFO ] [REMOTE ] PAG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:36:45.347903] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-26T20:36:45.511731] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-06. [2025-09-26T20:36:46.311765] [INFO ] [REMOTE ] PAG: Fetching primary data for 2024-12. [2025-09-26T20:36:46.429069] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-26T20:36:46.684970] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-26T20:36:47.085614] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-26T20:36:47.111671] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-09. [2025-09-26T20:36:47.911763] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-07. [2025-09-26T20:36:48.711801] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-01. [2025-09-26T20:36:49.255832] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-26T20:36:49.516919] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-08. [2025-09-26T20:36:49.538504] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-09-26T20:36:49.549751] [INFO ] [REMOTE ] OXY: Full fetch complete (77570 records). [2025-09-26T20:36:49.549936] [DEBUG] [VALIDATOR ] OXY: Validating primary data. [2025-09-26T20:36:49.754563] [WARN ] [VALIDATOR ] OXY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-26T20:36:49.755716] [FATAL] [MAIN ] OXY: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:36:49.755819] [WARN ] [MAIN ] OXY: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:36:49.755923] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-09-26T20:36:49.756035] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-09-26T20:36:49.756084] [INFO ] [LOCAL ] OXY: Starting deletion of derivative data. [2025-09-26T20:36:49.756126] [DEBUG] [LOCAL ] OXY: No derivative data file found to delete. [2025-09-26T20:36:49.756231] [INFO ] [MAIN ] Update Progress: 1623/2371 symbols completed. OXY took 45.0s. Estimated remaining: 1h 39m 54s. Rate: 7.5 symbols/min [2025-09-26T20:36:49.934901] [INFO ] [MAIN ] PAGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:36:50.000055] [DEBUG] [LOCAL ] PAGS: Loaded 53058 existing records from primary storage. [2025-09-26T20:36:50.000300] [INFO ] [MAIN ] PAGS: Loaded 53058 existing records. [2025-09-26T20:36:50.195926] [WARN ] [MAIN ] PAGS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:36:50.196522] [INFO ] [MAIN ] PAGS: Wiping existing primary data before full refresh. [2025-09-26T20:36:50.196773] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-09-26T20:36:50.206356] [DEBUG] [LOCAL ] PAGS: Deleted primary data file. [2025-09-26T20:36:50.219937] [INFO ] [MAIN ] PAGS: Starting full primary refresh. [2025-09-26T20:36:50.227619] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-26T20:36:50.313369] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-02. [2025-09-26T20:36:50.688871] [INFO ] [REMOTE ] PAGS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:36:51.100171] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-26T20:36:51.111664] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-09. [2025-09-26T20:36:51.329605] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-26T20:36:51.911762] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-01. [2025-09-26T20:36:52.494274] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-26T20:36:52.501725] [INFO ] [REMOTE ] PACK: Full fetch complete (43675 records). [2025-09-26T20:36:52.501864] [DEBUG] [VALIDATOR ] PACK: Validating primary data. [2025-09-26T20:36:52.720264] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-03. [2025-09-26T20:36:52.851042] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-26T20:36:52.919999] [DEBUG] [VALIDATOR ] PACK: All expected trading days are present. [2025-09-26T20:36:52.920108] [DEBUG] [VALIDATOR ] PACK: Primary data validation passed. [2025-09-26T20:36:52.921279] [INFO ] [MAIN ] PACK: Fetched primary data is valid. [2025-09-26T20:36:52.921348] [DEBUG] [LOCAL ] PACK: Saving primary data. [2025-09-26T20:36:52.922736] [DEBUG] [LOCAL ] PACK: Trimmed 43675 records to 32471 (keeping 200 days of data) [2025-09-26T20:36:53.134857] [DEBUG] [LOCAL ] PACK: Primary data saved (32471 records). [2025-09-26T20:36:53.135095] [INFO ] [MAIN ] PACK: Full history saved. [2025-09-26T20:36:53.135209] [INFO ] [MAIN ] Update Progress: 1624/2371 symbols completed. PACK took 23.1s. Estimated remaining: 1h 39m 44s. Rate: 7.5 symbols/min [2025-09-26T20:36:53.313488] [INFO ] [MAIN ] PAI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:36:53.318784] [DEBUG] [LOCAL ] PAI: Loaded 2741 existing records from primary storage. [2025-09-26T20:36:53.318890] [INFO ] [MAIN ] PAI: Loaded 2741 existing records. [2025-09-26T20:36:53.512076] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-02. [2025-09-26T20:36:53.516106] [WARN ] [MAIN ] PAI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:36:53.518490] [INFO ] [MAIN ] PAI: Wiping existing primary data before full refresh. [2025-09-26T20:36:53.518562] [INFO ] [LOCAL ] PAI: Starting deletion of primary data. [2025-09-26T20:36:53.518962] [DEBUG] [LOCAL ] PAI: Deleted primary data file. [2025-09-26T20:36:53.519052] [INFO ] [MAIN ] PAI: Starting full primary refresh. [2025-09-26T20:36:53.887615] [INFO ] [REMOTE ] PAI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:36:54.225075] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-26T20:36:54.311750] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-04. [2025-09-26T20:36:54.717491] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-26T20:36:55.111750] [INFO ] [REMOTE ] PAI: Fetching primary data for 2024-12. [2025-09-26T20:36:55.779570] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-26T20:36:55.911753] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2024-12. [2025-09-26T20:36:56.153210] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-26T20:36:56.711776] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-03. [2025-09-26T20:36:57.511691] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-01. [2025-09-26T20:36:57.919903] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-26T20:36:57.983508] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-26T20:36:57.994691] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-26T20:36:58.311745] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-02. [2025-09-26T20:36:58.924870] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-26T20:36:59.111774] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-01. [2025-09-26T20:36:59.911746] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-03. [2025-09-26T20:37:00.520511] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-26T20:37:00.711717] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-04. [2025-09-26T20:37:01.122608] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-26T20:37:01.298437] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-26T20:37:01.511726] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-05. [2025-09-26T20:37:02.052840] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-26T20:37:02.311726] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-05. [2025-09-26T20:37:03.111713] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-04. [2025-09-26T20:37:03.602902] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-26T20:37:03.911712] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-02. [2025-09-26T20:37:04.579119] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-26T20:37:04.711758] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-06. [2025-09-26T20:37:05.511730] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-05. [2025-09-26T20:37:05.761908] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-26T20:37:05.833879] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-26T20:37:06.311736] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-06. [2025-09-26T20:37:06.635741] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-26T20:37:06.723603] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-26T20:37:07.111734] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-03. [2025-09-26T20:37:07.911715] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-06. [2025-09-26T20:37:08.711689] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-07. [2025-09-26T20:37:08.910810] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-26T20:37:09.125518] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-26T20:37:09.245825] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-26T20:37:09.511723] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-07. [2025-09-26T20:37:10.311728] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-04. [2025-09-26T20:37:10.419466] [DEBUG] [REMOTE ] PAGS: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-09-26T20:37:10.419856] [WARN ] [REMOTE ] PAGS: No data returned for month 2025-04 [2025-09-26T20:37:10.786871] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-26T20:37:11.111733] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-07. [2025-09-26T20:37:11.911778] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-08. [2025-09-26T20:37:12.439954] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-26T20:37:12.576587] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-26T20:37:12.711737] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-08. [2025-09-26T20:37:13.511724] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-09. [2025-09-26T20:37:14.080621] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-26T20:37:14.160232] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-26T20:37:14.163233] [INFO ] [REMOTE ] PAI: Full fetch complete (4115 records). [2025-09-26T20:37:14.163372] [DEBUG] [VALIDATOR ] PAI: Validating primary data. [2025-09-26T20:37:14.317752] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-08. [2025-09-26T20:37:14.712250] [DEBUG] [VALIDATOR ] PAI: All expected trading days are present. [2025-09-26T20:37:14.712359] [DEBUG] [VALIDATOR ] PAI: Primary data validation passed. [2025-09-26T20:37:14.712543] [INFO ] [MAIN ] PAI: Fetched primary data is valid. [2025-09-26T20:37:14.712595] [DEBUG] [LOCAL ] PAI: Saving primary data. [2025-09-26T20:37:14.713165] [DEBUG] [LOCAL ] PAI: Trimmed 4115 records to 2758 (keeping 200 days of data) [2025-09-26T20:37:14.747857] [DEBUG] [LOCAL ] PAI: Primary data saved (2758 records). [2025-09-26T20:37:14.748064] [INFO ] [MAIN ] PAI: Full history saved. [2025-09-26T20:37:14.748296] [INFO ] [MAIN ] Update Progress: 1625/2371 symbols completed. PAI took 21.6s. Estimated remaining: 1h 39m 43s. Rate: 7.5 symbols/min [2025-09-26T20:37:15.049150] [INFO ] [MAIN ] PAII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:37:15.049352] [DEBUG] [LOCAL ] PAII: No existing data file found in primary storage. [2025-09-26T20:37:15.049409] [WARN ] [MAIN ] PAII: No existing data found, performing full refresh instead. [2025-09-26T20:37:15.049565] [INFO ] [MAIN ] PAII: Wiping existing primary data before full refresh. [2025-09-26T20:37:15.049610] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-09-26T20:37:15.049686] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-09-26T20:37:15.049739] [INFO ] [MAIN ] PAII: Starting full primary refresh. [2025-09-26T20:37:15.112460] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-09. [2025-09-26T20:37:15.458339] [INFO ] [REMOTE ] PAII: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:37:15.489283] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-26T20:37:15.911719] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-09. [2025-09-26T20:37:16.452475] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-26T20:37:16.460791] [INFO ] [REMOTE ] PACS: Full fetch complete (50729 records). [2025-09-26T20:37:16.460928] [DEBUG] [VALIDATOR ] PACS: Validating primary data. [2025-09-26T20:37:16.717296] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-05. [2025-09-26T20:37:16.864749] [DEBUG] [VALIDATOR ] PACS: All expected trading days are present. [2025-09-26T20:37:16.864883] [DEBUG] [VALIDATOR ] PACS: Primary data validation passed. [2025-09-26T20:37:16.865742] [INFO ] [MAIN ] PACS: Fetched primary data is valid. [2025-09-26T20:37:16.865809] [DEBUG] [LOCAL ] PACS: Saving primary data. [2025-09-26T20:37:16.867129] [DEBUG] [LOCAL ] PACS: Trimmed 50729 records to 34761 (keeping 200 days of data) [2025-09-26T20:37:17.009390] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-26T20:37:17.056211] [INFO ] [REMOTE ] PAG: Full fetch complete (30105 records). [2025-09-26T20:37:17.056686] [DEBUG] [VALIDATOR ] PAG: Validating primary data. [2025-09-26T20:37:17.281506] [DEBUG] [LOCAL ] PACS: Primary data saved (34761 records). [2025-09-26T20:37:17.309019] [INFO ] [MAIN ] PACS: Full history saved. [2025-09-26T20:37:17.327446] [INFO ] [MAIN ] Update Progress: 1626/2371 symbols completed. PACS took 36.3s. Estimated remaining: 1h 39m 32s. Rate: 7.5 symbols/min [2025-09-26T20:37:17.538718] [INFO ] [REMOTE ] PAII: Fetching primary data for 2024-12. [2025-09-26T20:37:17.695144] [DEBUG] [VALIDATOR ] PAG: All expected trading days are present. [2025-09-26T20:37:17.708343] [DEBUG] [VALIDATOR ] PAG: Primary data validation passed. [2025-09-26T20:37:17.709193] [INFO ] [MAIN ] PAG: Fetched primary data is valid. [2025-09-26T20:37:17.710527] [DEBUG] [LOCAL ] PAG: Saving primary data. [2025-09-26T20:37:17.748488] [INFO ] [MAIN ] PAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:37:17.749974] [DEBUG] [LOCAL ] PAG: Trimmed 30105 records to 22217 (keeping 200 days of data) [2025-09-26T20:37:17.903494] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:37:17.917441] [WARN ] [REMOTE ] PAII: No data returned for month 2024-12 [2025-09-26T20:37:17.921692] [DEBUG] [LOCAL ] PAM: Loaded 28151 existing records from primary storage. [2025-09-26T20:37:17.923718] [INFO ] [MAIN ] PAM: Loaded 28151 existing records. [2025-09-26T20:37:17.930501] [DEBUG] [LOCAL ] PAG: Primary data saved (22217 records). [2025-09-26T20:37:17.992051] [INFO ] [MAIN ] PAG: Full history saved. [2025-09-26T20:37:18.007169] [INFO ] [MAIN ] Update Progress: 1627/2371 symbols completed. PAG took 33.5s. Estimated remaining: 1h 39m 21s. Rate: 7.5 symbols/min [2025-09-26T20:37:18.286538] [WARN ] [MAIN ] PAM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:37:18.315968] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-01. [2025-09-26T20:37:18.319237] [INFO ] [MAIN ] PAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:37:18.319502] [INFO ] [MAIN ] PAM: Wiping existing primary data before full refresh. [2025-09-26T20:37:18.319814] [INFO ] [LOCAL ] PAM: Starting deletion of primary data. [2025-09-26T20:37:18.322093] [DEBUG] [LOCAL ] PAM: Deleted primary data file. [2025-09-26T20:37:18.322173] [INFO ] [MAIN ] PAM: Starting full primary refresh. [2025-09-26T20:37:18.535443] [DEBUG] [LOCAL ] PAR: Loaded 32920 existing records from primary storage. [2025-09-26T20:37:18.563192] [INFO ] [MAIN ] PAR: Loaded 32920 existing records. [2025-09-26T20:37:18.628087] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:37:18.710198] [WARN ] [REMOTE ] PAII: No data returned for month 2025-01 [2025-09-26T20:37:18.895360] [INFO ] [REMOTE ] PAM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:37:18.971212] [WARN ] [MAIN ] PAR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:37:18.971582] [INFO ] [MAIN ] PAR: Wiping existing primary data before full refresh. [2025-09-26T20:37:18.971767] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-09-26T20:37:18.984270] [DEBUG] [LOCAL ] PAR: Deleted primary data file. [2025-09-26T20:37:18.989520] [INFO ] [MAIN ] PAR: Starting full primary refresh. [2025-09-26T20:37:19.079108] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-26T20:37:19.113994] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-02. [2025-09-26T20:37:19.407119] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:37:19.415110] [INFO ] [REMOTE ] PAR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:37:19.415535] [WARN ] [REMOTE ] PAII: No data returned for month 2025-02 [2025-09-26T20:37:19.911674] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-06. [2025-09-26T20:37:20.711729] [INFO ] [REMOTE ] PAR: Fetching primary data for 2024-12. [2025-09-26T20:37:21.511758] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-03. [2025-09-26T20:37:21.793182] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:37:21.794291] [WARN ] [REMOTE ] PAII: No data returned for month 2025-03 [2025-09-26T20:37:21.795427] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-26T20:37:22.259304] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-26T20:37:22.311674] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-01. [2025-09-26T20:37:23.111712] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-07. [2025-09-26T20:37:23.748147] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-26T20:37:23.911739] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-02. [2025-09-26T20:37:24.711708] [INFO ] [REMOTE ] PAM: Fetching primary data for 2024-12. [2025-09-26T20:37:24.991578] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-26T20:37:25.315765] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-26T20:37:25.511720] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-03. [2025-09-26T20:37:26.207813] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-26T20:37:26.311717] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-01. [2025-09-26T20:37:26.912816] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-26T20:37:27.111755] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-04. [2025-09-26T20:37:27.686774] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-26T20:37:27.911712] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-08. [2025-09-26T20:37:28.164762] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-26T20:37:28.711783] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-02. [2025-09-26T20:37:29.501996] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-26T20:37:29.512829] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-04. [2025-09-26T20:37:29.665712] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-26T20:37:29.787836] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:37:29.788177] [WARN ] [REMOTE ] PAII: No data returned for month 2025-04 [2025-09-26T20:37:30.311721] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-03. [2025-09-26T20:37:31.111723] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-09. [2025-09-26T20:37:31.674694] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-26T20:37:31.911723] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-05. [2025-09-26T20:37:32.159981] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:37:32.160332] [WARN ] [REMOTE ] PAII: No data returned for month 2025-05 [2025-09-26T20:37:32.711714] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-05. [2025-09-26T20:37:33.060495] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-26T20:37:33.070984] [INFO ] [REMOTE ] PAGS: Full fetch complete (68271 records). [2025-09-26T20:37:33.071138] [DEBUG] [VALIDATOR ] PAGS: Validating primary data. [2025-09-26T20:37:33.285171] [WARN ] [VALIDATOR ] PAGS: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-26T20:37:33.286023] [FATAL] [MAIN ] PAGS: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:37:33.286103] [WARN ] [MAIN ] PAGS: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:37:33.286189] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-09-26T20:37:33.286290] [DEBUG] [LOCAL ] PAGS: No primary data file found to delete. [2025-09-26T20:37:33.286418] [INFO ] [LOCAL ] PAGS: Starting deletion of derivative data. [2025-09-26T20:37:33.286913] [DEBUG] [LOCAL ] PAGS: Deleted derivative data file. [2025-09-26T20:37:33.287046] [INFO ] [MAIN ] Update Progress: 1628/2371 symbols completed. PAGS took 43.5s. Estimated remaining: 1h 39m 16s. Rate: 7.5 symbols/min [2025-09-26T20:37:33.468957] [INFO ] [MAIN ] PARR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:37:33.513997] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-06. [2025-09-26T20:37:33.516868] [DEBUG] [LOCAL ] PARR: Loaded 48708 existing records from primary storage. [2025-09-26T20:37:33.516978] [INFO ] [MAIN ] PARR: Loaded 48708 existing records. [2025-09-26T20:37:33.704191] [WARN ] [MAIN ] PARR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:37:33.704458] [INFO ] [MAIN ] PARR: Wiping existing primary data before full refresh. [2025-09-26T20:37:33.704507] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-09-26T20:37:33.705880] [DEBUG] [LOCAL ] PARR: Deleted primary data file. [2025-09-26T20:37:33.705943] [INFO ] [MAIN ] PARR: Starting full primary refresh. [2025-09-26T20:37:33.820851] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:37:33.841621] [WARN ] [REMOTE ] PAII: No data returned for month 2025-06 [2025-09-26T20:37:34.097874] [INFO ] [REMOTE ] PARR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:37:34.180346] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T20:37:34.311726] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-06. [2025-09-26T20:37:35.111736] [INFO ] [REMOTE ] PARR: Fetching primary data for 2024-12. [2025-09-26T20:37:35.630930] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-26T20:37:35.911721] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-07. [2025-09-26T20:37:36.711697] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-04. [2025-09-26T20:37:36.820680] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-26T20:37:37.215512] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-26T20:37:37.511727] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-01. [2025-09-26T20:37:38.160538] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-26T20:37:38.311734] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-08. [2025-09-26T20:37:39.111746] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-07. [2025-09-26T20:37:39.164898] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-26T20:37:39.367402] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:37:39.367774] [WARN ] [REMOTE ] PAII: No data returned for month 2025-07 [2025-09-26T20:37:39.775052] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-26T20:37:39.911720] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-08. [2025-09-26T20:37:40.166866] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:37:40.167470] [WARN ] [REMOTE ] PAII: No data returned for month 2025-08 [2025-09-26T20:37:40.711738] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-09. [2025-09-26T20:37:41.511742] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-05. [2025-09-26T20:37:42.311720] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-02. [2025-09-26T20:37:42.361791] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T20:37:42.370800] [INFO ] [REMOTE ] PAR: Full fetch complete (47410 records). [2025-09-26T20:37:42.370917] [DEBUG] [VALIDATOR ] PAR: Validating primary data. [2025-09-26T20:37:42.824841] [DEBUG] [VALIDATOR ] PAR: All expected trading days are present. [2025-09-26T20:37:42.834917] [DEBUG] [VALIDATOR ] PAR: Primary data validation passed. [2025-09-26T20:37:42.835438] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-26T20:37:42.836571] [INFO ] [MAIN ] PAR: Fetched primary data is valid. [2025-09-26T20:37:42.836793] [DEBUG] [LOCAL ] PAR: Saving primary data. [2025-09-26T20:37:42.844182] [DEBUG] [LOCAL ] PAR: Trimmed 47410 records to 33188 (keeping 200 days of data) [2025-09-26T20:37:43.048849] [DEBUG] [LOCAL ] PAR: Primary data saved (33188 records). [2025-09-26T20:37:43.049053] [INFO ] [MAIN ] PAR: Full history saved. [2025-09-26T20:37:43.049211] [INFO ] [MAIN ] Update Progress: 1629/2371 symbols completed. PAR took 25.0s. Estimated remaining: 1h 39m 9s. Rate: 7.5 symbols/min [2025-09-26T20:37:43.116897] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-09. [2025-09-26T20:37:43.240212] [INFO ] [MAIN ] PATH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:37:43.301390] [DEBUG] [LOCAL ] PATH: Loaded 54067 existing records from primary storage. [2025-09-26T20:37:43.301540] [INFO ] [MAIN ] PATH: Loaded 54067 existing records. [2025-09-26T20:37:43.490600] [WARN ] [MAIN ] PATH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:37:43.490881] [INFO ] [MAIN ] PATH: Wiping existing primary data before full refresh. [2025-09-26T20:37:43.490942] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-09-26T20:37:43.492083] [DEBUG] [LOCAL ] PATH: Deleted primary data file. [2025-09-26T20:37:43.492143] [INFO ] [MAIN ] PATH: Starting full primary refresh. [2025-09-26T20:37:43.626173] [INFO ] [REMOTE ] PAII: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-26T20:37:43.653626] [INFO ] [REMOTE ] PAII: Full fetch complete (98 records). [2025-09-26T20:37:43.706183] [DEBUG] [VALIDATOR ] PAII: Validating primary data. [2025-09-26T20:37:43.917898] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-06. [2025-09-26T20:37:44.039316] [INFO ] [REMOTE ] PATH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:37:44.130852] [WARN ] [VALIDATOR ] PAII: Validation failed - insufficient historical data. Have 13 unique days, need 200 days [2025-09-26T20:37:44.147248] [FATAL] [MAIN ] PAII: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:37:44.148039] [WARN ] [MAIN ] PAII: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:37:44.149159] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-26T20:37:44.149251] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-09-26T20:37:44.158744] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-09-26T20:37:44.159110] [INFO ] [LOCAL ] PAII: Starting deletion of derivative data. [2025-09-26T20:37:44.159182] [DEBUG] [LOCAL ] PAII: No derivative data file found to delete. [2025-09-26T20:37:44.159313] [INFO ] [MAIN ] Update Progress: 1630/2371 symbols completed. PAII took 29.4s. Estimated remaining: 1h 38m 58s. Rate: 7.5 symbols/min [2025-09-26T20:37:44.336804] [INFO ] [MAIN ] PAXS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:37:44.361156] [DEBUG] [LOCAL ] PAXS: Loaded 21098 existing records from primary storage. [2025-09-26T20:37:44.361339] [INFO ] [MAIN ] PAXS: Loaded 21098 existing records. [2025-09-26T20:37:44.548554] [WARN ] [MAIN ] PAXS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:37:44.548820] [INFO ] [MAIN ] PAXS: Wiping existing primary data before full refresh. [2025-09-26T20:37:44.548870] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-09-26T20:37:44.549511] [DEBUG] [LOCAL ] PAXS: Deleted primary data file. [2025-09-26T20:37:44.549570] [INFO ] [MAIN ] PAXS: Starting full primary refresh. [2025-09-26T20:37:44.716888] [INFO ] [REMOTE ] PATH: Fetching primary data for 2024-12. [2025-09-26T20:37:44.947724] [INFO ] [REMOTE ] PAXS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:37:45.145627] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-26T20:37:45.511766] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-03. [2025-09-26T20:37:46.311713] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-07. [2025-09-26T20:37:47.123710] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2024-12. [2025-09-26T20:37:47.128852] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-09-26T20:37:47.180511] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-26T20:37:47.627203] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-26T20:37:47.911721] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-01. [2025-09-26T20:37:48.660593] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-26T20:37:48.711737] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-04. [2025-09-26T20:37:49.511738] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-01. [2025-09-26T20:37:50.188395] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-09-26T20:37:50.311697] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-02. [2025-09-26T20:37:50.615219] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-26T20:37:50.638222] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-26T20:37:51.111738] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-08. [2025-09-26T20:37:51.911690] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-02. [2025-09-26T20:37:52.265418] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-26T20:37:52.422431] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-26T20:37:52.711703] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-05. [2025-09-26T20:37:52.930802] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-26T20:37:53.511718] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-03. [2025-09-26T20:37:54.288700] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-26T20:37:54.311724] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-09. [2025-09-26T20:37:54.521974] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-26T20:37:55.111722] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-06. [2025-09-26T20:37:55.784827] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-26T20:37:55.792440] [INFO ] [REMOTE ] PAM: Full fetch complete (41931 records). [2025-09-26T20:37:55.792599] [DEBUG] [VALIDATOR ] PAM: Validating primary data. [2025-09-26T20:37:55.916816] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-03. [2025-09-26T20:37:56.194349] [DEBUG] [VALIDATOR ] PAM: All expected trading days are present. [2025-09-26T20:37:56.194454] [DEBUG] [VALIDATOR ] PAM: Primary data validation passed. [2025-09-26T20:37:56.195560] [INFO ] [MAIN ] PAM: Fetched primary data is valid. [2025-09-26T20:37:56.195627] [DEBUG] [LOCAL ] PAM: Saving primary data. [2025-09-26T20:37:56.196786] [DEBUG] [LOCAL ] PAM: Trimmed 41931 records to 28420 (keeping 200 days of data) [2025-09-26T20:37:56.373456] [DEBUG] [LOCAL ] PAM: Primary data saved (28420 records). [2025-09-26T20:37:56.373614] [INFO ] [MAIN ] PAM: Full history saved. [2025-09-26T20:37:56.373751] [INFO ] [MAIN ] Update Progress: 1631/2371 symbols completed. PAM took 39.0s. Estimated remaining: 1h 38m 51s. Rate: 7.5 symbols/min [2025-09-26T20:37:56.554038] [INFO ] [MAIN ] PAY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:37:56.594293] [DEBUG] [LOCAL ] PAY: Loaded 38647 existing records from primary storage. [2025-09-26T20:37:56.594450] [INFO ] [MAIN ] PAY: Loaded 38647 existing records. [2025-09-26T20:37:56.713209] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-04. [2025-09-26T20:37:56.788699] [WARN ] [MAIN ] PAY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:37:56.789250] [INFO ] [MAIN ] PAY: Wiping existing primary data before full refresh. [2025-09-26T20:37:56.789325] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-09-26T20:37:56.799176] [DEBUG] [LOCAL ] PAY: Deleted primary data file. [2025-09-26T20:37:56.815733] [INFO ] [MAIN ] PAY: Starting full primary refresh. [2025-09-26T20:37:56.886222] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-26T20:37:57.207325] [INFO ] [REMOTE ] PAY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:37:57.511701] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-07. [2025-09-26T20:37:57.878419] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-26T20:37:58.311748] [INFO ] [REMOTE ] PAY: Fetching primary data for 2024-12. [2025-09-26T20:37:58.545467] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-03 (2.63 seconds). [2025-09-26T20:37:59.111704] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-05. [2025-09-26T20:37:59.177421] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-26T20:37:59.579561] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-26T20:37:59.911740] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-08. [2025-09-26T20:38:00.296203] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-26T20:38:00.711741] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-01. [2025-09-26T20:38:01.511746] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-06. [2025-09-26T20:38:01.647058] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-26T20:38:02.279791] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T20:38:02.311685] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-04. [2025-09-26T20:38:02.795054] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-26T20:38:03.111721] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-07. [2025-09-26T20:38:03.911683] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-02. [2025-09-26T20:38:04.363842] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-26T20:38:04.570462] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-26T20:38:04.711757] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-08. [2025-09-26T20:38:04.830590] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-26T20:38:05.511683] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-09. [2025-09-26T20:38:05.910084] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-26T20:38:06.311731] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-05. [2025-09-26T20:38:07.111728] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-03. [2025-09-26T20:38:07.274840] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-26T20:38:07.284754] [INFO ] [REMOTE ] PARR: Full fetch complete (68724 records). [2025-09-26T20:38:07.284913] [DEBUG] [VALIDATOR ] PARR: Validating primary data. [2025-09-26T20:38:07.765809] [DEBUG] [VALIDATOR ] PARR: All expected trading days are present. [2025-09-26T20:38:07.765936] [DEBUG] [VALIDATOR ] PARR: Primary data validation passed. [2025-09-26T20:38:07.767183] [INFO ] [MAIN ] PARR: Fetched primary data is valid. [2025-09-26T20:38:07.767272] [DEBUG] [LOCAL ] PARR: Saving primary data. [2025-09-26T20:38:07.769009] [DEBUG] [LOCAL ] PARR: Trimmed 68724 records to 49062 (keeping 200 days of data) [2025-09-26T20:38:07.911760] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-09. [2025-09-26T20:38:08.199328] [DEBUG] [LOCAL ] PARR: Primary data saved (49062 records). [2025-09-26T20:38:08.199539] [INFO ] [MAIN ] PARR: Full history saved. [2025-09-26T20:38:08.199682] [INFO ] [MAIN ] Update Progress: 1632/2371 symbols completed. PARR took 34.9s. Estimated remaining: 1h 38m 45s. Rate: 7.5 symbols/min [2025-09-26T20:38:08.522123] [INFO ] [MAIN ] PAYC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:38:08.551927] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-26T20:38:08.599614] [DEBUG] [LOCAL ] PAYC: Loaded 36598 existing records from primary storage. [2025-09-26T20:38:08.599844] [INFO ] [MAIN ] PAYC: Loaded 36598 existing records. [2025-09-26T20:38:08.716864] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-04. [2025-09-26T20:38:08.872513] [WARN ] [MAIN ] PAYC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:38:08.888306] [INFO ] [MAIN ] PAYC: Wiping existing primary data before full refresh. [2025-09-26T20:38:08.888530] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-09-26T20:38:08.889922] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-26T20:38:08.898132] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-09-26T20:38:08.905430] [INFO ] [REMOTE ] PAXS: Full fetch complete (31093 records). [2025-09-26T20:38:08.905977] [DEBUG] [LOCAL ] PAYC: Deleted primary data file. [2025-09-26T20:38:08.917203] [DEBUG] [VALIDATOR ] PAXS: Validating primary data. [2025-09-26T20:38:08.917600] [INFO ] [MAIN ] PAYC: Starting full primary refresh. [2025-09-26T20:38:09.513863] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-06. [2025-09-26T20:38:09.741329] [DEBUG] [VALIDATOR ] PAXS: All expected trading days are present. [2025-09-26T20:38:09.741959] [DEBUG] [VALIDATOR ] PAXS: Primary data validation passed. [2025-09-26T20:38:09.746310] [INFO ] [MAIN ] PAXS: Fetched primary data is valid. [2025-09-26T20:38:09.746421] [DEBUG] [LOCAL ] PAXS: Saving primary data. [2025-09-26T20:38:09.745354] [INFO ] [REMOTE ] PAYC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:38:09.747919] [DEBUG] [LOCAL ] PAXS: Trimmed 31093 records to 21210 (keeping 200 days of data) [2025-09-26T20:38:09.881271] [DEBUG] [LOCAL ] PAXS: Primary data saved (21210 records). [2025-09-26T20:38:09.881402] [INFO ] [MAIN ] PAXS: Full history saved. [2025-09-26T20:38:09.881487] [INFO ] [MAIN ] Update Progress: 1633/2371 symbols completed. PAXS took 25.7s. Estimated remaining: 1h 38m 34s. Rate: 7.5 symbols/min [2025-09-26T20:38:10.072352] [INFO ] [MAIN ] PB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:38:10.118017] [DEBUG] [LOCAL ] PB: Loaded 41683 existing records from primary storage. [2025-09-26T20:38:10.118232] [INFO ] [MAIN ] PB: Loaded 41683 existing records. [2025-09-26T20:38:10.316059] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2024-12. [2025-09-26T20:38:10.339467] [WARN ] [MAIN ] PB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:38:10.345613] [INFO ] [MAIN ] PB: Wiping existing primary data before full refresh. [2025-09-26T20:38:10.345394] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-26T20:38:10.345740] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-09-26T20:38:10.354727] [DEBUG] [LOCAL ] PB: Deleted primary data file. [2025-09-26T20:38:10.354803] [INFO ] [MAIN ] PB: Starting full primary refresh. [2025-09-26T20:38:10.735633] [INFO ] [REMOTE ] PB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:38:11.111721] [INFO ] [REMOTE ] PB: Fetching primary data for 2024-12. [2025-09-26T20:38:11.215157] [DEBUG] [REMOTE ] PB: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-09-26T20:38:11.215499] [WARN ] [REMOTE ] PB: No data returned for month 2024-12 [2025-09-26T20:38:11.618340] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-26T20:38:11.692291] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-26T20:38:11.911729] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-05. [2025-09-26T20:38:12.711718] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-07. [2025-09-26T20:38:13.511719] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-01. [2025-09-26T20:38:13.550606] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-26T20:38:14.311724] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-01. [2025-09-26T20:38:14.980628] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-26T20:38:15.076258] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-26T20:38:15.111732] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-06. [2025-09-26T20:38:15.911722] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-08. [2025-09-26T20:38:16.055132] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-26T20:38:16.711701] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-02. [2025-09-26T20:38:16.898975] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-26T20:38:17.511728] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-07. [2025-09-26T20:38:18.237256] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-26T20:38:18.289421] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-09-26T20:38:18.311695] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-02. [2025-09-26T20:38:19.099813] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-26T20:38:19.111679] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-08. [2025-09-26T20:38:19.770779] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-26T20:38:19.911732] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-09. [2025-09-26T20:38:20.664695] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-26T20:38:20.711760] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-03. [2025-09-26T20:38:21.511725] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-03. [2025-09-26T20:38:22.141961] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-26T20:38:22.311742] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-04. [2025-09-26T20:38:22.396276] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-09-26T20:38:22.407856] [INFO ] [REMOTE ] PATH: Full fetch complete (77764 records). [2025-09-26T20:38:22.408036] [DEBUG] [VALIDATOR ] PATH: Validating primary data. [2025-09-26T20:38:22.854984] [DEBUG] [VALIDATOR ] PATH: All expected trading days are present. [2025-09-26T20:38:22.855081] [DEBUG] [VALIDATOR ] PATH: Primary data validation passed. [2025-09-26T20:38:22.856256] [INFO ] [MAIN ] PATH: Fetched primary data is valid. [2025-09-26T20:38:22.856329] [DEBUG] [LOCAL ] PATH: Saving primary data. [2025-09-26T20:38:22.858049] [DEBUG] [LOCAL ] PATH: Trimmed 77764 records to 54457 (keeping 200 days of data) [2025-09-26T20:38:23.111964] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-09. [2025-09-26T20:38:23.245325] [DEBUG] [LOCAL ] PATH: Primary data saved (54457 records). [2025-09-26T20:38:23.246286] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-26T20:38:23.246533] [INFO ] [MAIN ] PATH: Full history saved. [2025-09-26T20:38:23.255381] [INFO ] [MAIN ] Update Progress: 1634/2371 symbols completed. PATH took 40.2s. Estimated remaining: 1h 38m 29s. Rate: 7.5 symbols/min [2025-09-26T20:38:23.439188] [INFO ] [MAIN ] PBA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:38:23.489278] [DEBUG] [LOCAL ] PBA: Loaded 49297 existing records from primary storage. [2025-09-26T20:38:23.489452] [INFO ] [MAIN ] PBA: Loaded 49297 existing records. [2025-09-26T20:38:23.711195] [WARN ] [MAIN ] PBA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:38:23.711753] [INFO ] [MAIN ] PBA: Wiping existing primary data before full refresh. [2025-09-26T20:38:23.711829] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-09-26T20:38:23.713238] [DEBUG] [LOCAL ] PBA: Deleted primary data file. [2025-09-26T20:38:23.713331] [INFO ] [MAIN ] PBA: Starting full primary refresh. [2025-09-26T20:38:23.913770] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-04. [2025-09-26T20:38:24.144197] [INFO ] [REMOTE ] PBA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:38:24.175110] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-26T20:38:24.377490] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-26T20:38:24.387327] [INFO ] [REMOTE ] PAY: Full fetch complete (53265 records). [2025-09-26T20:38:24.387519] [DEBUG] [VALIDATOR ] PAY: Validating primary data. [2025-09-26T20:38:24.714985] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-05. [2025-09-26T20:38:24.815540] [DEBUG] [VALIDATOR ] PAY: All expected trading days are present. [2025-09-26T20:38:24.815638] [DEBUG] [VALIDATOR ] PAY: Primary data validation passed. [2025-09-26T20:38:24.816524] [INFO ] [MAIN ] PAY: Fetched primary data is valid. [2025-09-26T20:38:24.816575] [DEBUG] [LOCAL ] PAY: Saving primary data. [2025-09-26T20:38:24.818003] [DEBUG] [LOCAL ] PAY: Trimmed 53265 records to 38892 (keeping 200 days of data) [2025-09-26T20:38:25.088792] [DEBUG] [LOCAL ] PAY: Primary data saved (38892 records). [2025-09-26T20:38:25.091451] [INFO ] [MAIN ] PAY: Full history saved. [2025-09-26T20:38:25.091976] [INFO ] [MAIN ] Update Progress: 1635/2371 symbols completed. PAY took 28.7s. Estimated remaining: 1h 38m 18s. Rate: 7.5 symbols/min [2025-09-26T20:38:25.296671] [INFO ] [MAIN ] PBF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:38:25.362917] [DEBUG] [LOCAL ] PBF: Loaded 53478 existing records from primary storage. [2025-09-26T20:38:25.363093] [INFO ] [MAIN ] PBF: Loaded 53478 existing records. [2025-09-26T20:38:25.520004] [INFO ] [REMOTE ] PBA: Fetching primary data for 2024-12. [2025-09-26T20:38:25.570621] [WARN ] [MAIN ] PBF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:38:25.571671] [INFO ] [MAIN ] PBF: Wiping existing primary data before full refresh. [2025-09-26T20:38:25.571813] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-09-26T20:38:25.573820] [DEBUG] [LOCAL ] PBF: Deleted primary data file. [2025-09-26T20:38:25.573898] [INFO ] [MAIN ] PBF: Starting full primary refresh. [2025-09-26T20:38:25.724362] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-26T20:38:26.048520] [INFO ] [REMOTE ] PBF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:38:26.311734] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-05. [2025-09-26T20:38:26.378771] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-26T20:38:27.111766] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-06. [2025-09-26T20:38:27.378412] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-26T20:38:27.905189] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-26T20:38:27.913123] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-01. [2025-09-26T20:38:28.711740] [INFO ] [REMOTE ] PBF: Fetching primary data for 2024-12. [2025-09-26T20:38:28.752807] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-26T20:38:29.511758] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-07. [2025-09-26T20:38:29.736129] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-26T20:38:30.311738] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-06. [2025-09-26T20:38:30.752370] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-26T20:38:31.111696] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-01. [2025-09-26T20:38:31.196101] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-26T20:38:31.904279] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-26T20:38:31.911752] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-08. [2025-09-26T20:38:32.711710] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-07. [2025-09-26T20:38:32.969714] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-26T20:38:33.516926] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-02. [2025-09-26T20:38:33.530150] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-26T20:38:34.261534] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-26T20:38:34.311723] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-08. [2025-09-26T20:38:35.111770] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-09. [2025-09-26T20:38:35.235345] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-26T20:38:35.807622] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-26T20:38:35.911724] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-03. [2025-09-26T20:38:36.569603] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-26T20:38:36.579964] [INFO ] [REMOTE ] PB: Full fetch complete (54446 records). [2025-09-26T20:38:36.580128] [DEBUG] [VALIDATOR ] PB: Validating primary data. [2025-09-26T20:38:36.726560] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-02. [2025-09-26T20:38:36.786682] [WARN ] [VALIDATOR ] PB: Validation failed - insufficient historical data. Have 184 unique days, need 200 days [2025-09-26T20:38:36.787416] [FATAL] [MAIN ] PB: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:38:36.787505] [WARN ] [MAIN ] PB: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:38:36.787620] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-09-26T20:38:36.787737] [DEBUG] [LOCAL ] PB: No primary data file found to delete. [2025-09-26T20:38:36.787784] [INFO ] [LOCAL ] PB: Starting deletion of derivative data. [2025-09-26T20:38:36.788118] [DEBUG] [LOCAL ] PB: Deleted derivative data file. [2025-09-26T20:38:36.788260] [INFO ] [MAIN ] Update Progress: 1636/2371 symbols completed. PB took 26.9s. Estimated remaining: 1h 38m 12s. Rate: 7.5 symbols/min [2025-09-26T20:38:36.969122] [INFO ] [MAIN ] PBH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:38:37.015202] [DEBUG] [LOCAL ] PBH: Loaded 31888 existing records from primary storage. [2025-09-26T20:38:37.015477] [INFO ] [MAIN ] PBH: Loaded 31888 existing records. [2025-09-26T20:38:37.198607] [WARN ] [MAIN ] PBH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:38:37.198960] [INFO ] [MAIN ] PBH: Wiping existing primary data before full refresh. [2025-09-26T20:38:37.199017] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-09-26T20:38:37.200246] [DEBUG] [LOCAL ] PBH: Deleted primary data file. [2025-09-26T20:38:37.200307] [INFO ] [MAIN ] PBH: Starting full primary refresh. [2025-09-26T20:38:37.516827] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-09. [2025-09-26T20:38:37.579961] [INFO ] [REMOTE ] PBH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:38:37.725988] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-26T20:38:38.311683] [INFO ] [REMOTE ] PBH: Fetching primary data for 2024-12. [2025-09-26T20:38:38.574243] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-26T20:38:38.789860] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-26T20:38:38.798560] [INFO ] [REMOTE ] PAYC: Full fetch complete (52982 records). [2025-09-26T20:38:38.798762] [DEBUG] [VALIDATOR ] PAYC: Validating primary data. [2025-09-26T20:38:39.118068] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-03. [2025-09-26T20:38:39.218559] [DEBUG] [VALIDATOR ] PAYC: All expected trading days are present. [2025-09-26T20:38:39.218676] [DEBUG] [VALIDATOR ] PAYC: Primary data validation passed. [2025-09-26T20:38:39.219625] [INFO ] [MAIN ] PAYC: Fetched primary data is valid. [2025-09-26T20:38:39.219720] [DEBUG] [LOCAL ] PAYC: Saving primary data. [2025-09-26T20:38:39.222945] [DEBUG] [LOCAL ] PAYC: Trimmed 52982 records to 36903 (keeping 200 days of data) [2025-09-26T20:38:39.466226] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-26T20:38:39.502407] [DEBUG] [LOCAL ] PAYC: Primary data saved (36903 records). [2025-09-26T20:38:39.502561] [INFO ] [MAIN ] PAYC: Full history saved. [2025-09-26T20:38:39.502700] [INFO ] [MAIN ] Update Progress: 1637/2371 symbols completed. PAYC took 31.3s. Estimated remaining: 1h 38m 1s. Rate: 7.5 symbols/min [2025-09-26T20:38:39.911744] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-01. [2025-09-26T20:38:40.711703] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-04. [2025-09-26T20:38:40.957878] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-26T20:38:41.514673] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-04. [2025-09-26T20:38:41.517480] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-26T20:38:42.311758] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-02. [2025-09-26T20:38:42.711561] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-26T20:38:43.111695] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-05. [2025-09-26T20:38:43.514175] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-26T20:38:43.752278] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-26T20:38:43.911727] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-03. [2025-09-26T20:38:44.711729] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-05. [2025-09-26T20:38:44.935543] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-26T20:38:45.409585] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-26T20:38:45.511725] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-04. [2025-09-26T20:38:46.311703] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-06. [2025-09-26T20:38:46.789843] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-26T20:38:46.893046] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-26T20:38:47.111711] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-05. [2025-09-26T20:38:47.911718] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-06. [2025-09-26T20:38:48.140520] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-26T20:38:48.172915] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-26T20:38:48.711721] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-07. [2025-09-26T20:38:49.511747] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-06. [2025-09-26T20:38:49.755564] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-26T20:38:50.311733] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-07. [2025-09-26T20:38:50.492058] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-26T20:38:50.825360] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-26T20:38:51.111740] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-08. [2025-09-26T20:38:51.911700] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-07. [2025-09-26T20:38:52.181677] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-26T20:38:52.711718] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-08. [2025-09-26T20:38:52.884506] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-26T20:38:53.343227] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-26T20:38:53.511724] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-08. [2025-09-26T20:38:54.227951] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-26T20:38:54.311725] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-09. [2025-09-26T20:38:54.583242] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-26T20:38:55.111719] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-09. [2025-09-26T20:38:55.911715] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-09. [2025-09-26T20:38:56.008477] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-26T20:38:56.019223] [INFO ] [REMOTE ] PBA: Full fetch complete (71469 records). [2025-09-26T20:38:56.019419] [DEBUG] [VALIDATOR ] PBA: Validating primary data. [2025-09-26T20:38:56.440841] [DEBUG] [VALIDATOR ] PBA: All expected trading days are present. [2025-09-26T20:38:56.440972] [DEBUG] [VALIDATOR ] PBA: Primary data validation passed. [2025-09-26T20:38:56.442045] [INFO ] [MAIN ] PBA: Fetched primary data is valid. [2025-09-26T20:38:56.442146] [DEBUG] [LOCAL ] PBA: Saving primary data. [2025-09-26T20:38:56.444416] [DEBUG] [LOCAL ] PBA: Trimmed 71469 records to 49665 (keeping 200 days of data) [2025-09-26T20:38:56.699828] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-26T20:38:56.719289] [INFO ] [REMOTE ] PBH: Full fetch complete (43148 records). [2025-09-26T20:38:56.722848] [DEBUG] [VALIDATOR ] PBH: Validating primary data. [2025-09-26T20:38:57.204197] [DEBUG] [VALIDATOR ] PBH: All expected trading days are present. [2025-09-26T20:38:57.204520] [DEBUG] [VALIDATOR ] PBH: Primary data validation passed. [2025-09-26T20:38:57.205405] [INFO ] [MAIN ] PBH: Fetched primary data is valid. [2025-09-26T20:38:57.205842] [DEBUG] [LOCAL ] PBH: Saving primary data. [2025-09-26T20:38:57.209545] [DEBUG] [LOCAL ] PBH: Trimmed 43148 records to 32156 (keeping 200 days of data) [2025-09-26T20:38:57.223144] [DEBUG] [LOCAL ] PBA: Primary data saved (49665 records). [2025-09-26T20:38:57.281912] [INFO ] [MAIN ] PBA: Full history saved. [2025-09-26T20:38:57.308565] [INFO ] [MAIN ] Update Progress: 1638/2371 symbols completed. PBA took 34.1s. Estimated remaining: 1h 37m 58s. Rate: 7.5 symbols/min [2025-09-26T20:38:57.420837] [DEBUG] [LOCAL ] PBH: Primary data saved (32156 records). [2025-09-26T20:38:57.420986] [INFO ] [MAIN ] PBH: Full history saved. [2025-09-26T20:38:57.421076] [INFO ] [MAIN ] Update Progress: 1639/2371 symbols completed. PBH took 20.6s. Estimated remaining: 1h 37m 46s. Rate: 7.5 symbols/min [2025-09-26T20:38:57.779032] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-26T20:38:57.790827] [INFO ] [REMOTE ] PBF: Full fetch complete (76580 records). [2025-09-26T20:38:57.791019] [DEBUG] [VALIDATOR ] PBF: Validating primary data. [2025-09-26T20:38:58.203815] [DEBUG] [VALIDATOR ] PBF: All expected trading days are present. [2025-09-26T20:38:58.203895] [DEBUG] [VALIDATOR ] PBF: Primary data validation passed. [2025-09-26T20:38:58.204904] [INFO ] [MAIN ] PBF: Fetched primary data is valid. [2025-09-26T20:38:58.204969] [DEBUG] [LOCAL ] PBF: Saving primary data. [2025-09-26T20:38:58.210236] [DEBUG] [LOCAL ] PBF: Trimmed 76580 records to 53866 (keeping 200 days of data) [2025-09-26T20:38:58.565522] [DEBUG] [LOCAL ] PBF: Primary data saved (53866 records). [2025-09-26T20:38:58.565761] [INFO ] [MAIN ] PBF: Full history saved. [2025-09-26T20:38:58.565931] [INFO ] [MAIN ] Update Progress: 1640/2371 symbols completed. PBF took 33.5s. Estimated remaining: 1h 37m 35s. Rate: 7.5 symbols/min [2025-09-26T20:38:59.231408] [INFO ] [MAIN ] PBR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:38:59.271182] [INFO ] [MAIN ] PBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:38:59.322046] [INFO ] [MAIN ] PBT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:38:59.356150] [INFO ] [MAIN ] PCF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:38:59.382838] [DEBUG] [LOCAL ] PCF: Loaded 8669 existing records from primary storage. [2025-09-26T20:38:59.383205] [INFO ] [MAIN ] PCF: Loaded 8669 existing records. [2025-09-26T20:38:59.434587] [DEBUG] [LOCAL ] PBT: Loaded 17462 existing records from primary storage. [2025-09-26T20:38:59.465555] [INFO ] [MAIN ] PBT: Loaded 17462 existing records. [2025-09-26T20:38:59.777326] [DEBUG] [LOCAL ] PBR: Loaded 54103 existing records from primary storage. [2025-09-26T20:38:59.772054] [DEBUG] [LOCAL ] PBI: Loaded 50410 existing records from primary storage. [2025-09-26T20:38:59.828831] [INFO ] [MAIN ] PBI: Loaded 50410 existing records. [2025-09-26T20:38:59.842213] [WARN ] [MAIN ] PCF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:38:59.842412] [INFO ] [MAIN ] PBR: Loaded 54103 existing records. [2025-09-26T20:38:59.873152] [INFO ] [MAIN ] PCF: Wiping existing primary data before full refresh. [2025-09-26T20:38:59.878513] [INFO ] [LOCAL ] PCF: Starting deletion of primary data. [2025-09-26T20:38:59.972776] [WARN ] [MAIN ] PBT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:38:59.936989] [DEBUG] [LOCAL ] PCF: Deleted primary data file. [2025-09-26T20:39:00.050455] [INFO ] [MAIN ] PCF: Starting full primary refresh. [2025-09-26T20:39:00.078165] [INFO ] [MAIN ] PBT: Wiping existing primary data before full refresh. [2025-09-26T20:39:00.144248] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-09-26T20:39:00.308700] [DEBUG] [LOCAL ] PBT: Deleted primary data file. [2025-09-26T20:39:00.398111] [INFO ] [MAIN ] PBT: Starting full primary refresh. [2025-09-26T20:39:00.397246] [WARN ] [MAIN ] PBI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:39:00.455404] [INFO ] [MAIN ] PBI: Wiping existing primary data before full refresh. [2025-09-26T20:39:00.479601] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-09-26T20:39:00.569888] [DEBUG] [LOCAL ] PBI: Deleted primary data file. [2025-09-26T20:39:00.650591] [WARN ] [MAIN ] PBR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:39:00.656074] [INFO ] [MAIN ] PBI: Starting full primary refresh. [2025-09-26T20:39:00.731157] [INFO ] [MAIN ] PBR: Wiping existing primary data before full refresh. [2025-09-26T20:39:00.760877] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-09-26T20:39:00.823304] [DEBUG] [LOCAL ] PBR: Deleted primary data file. [2025-09-26T20:39:00.943444] [INFO ] [MAIN ] PBR: Starting full primary refresh. [2025-09-26T20:39:01.497497] [INFO ] [REMOTE ] PCF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:39:01.568011] [INFO ] [REMOTE ] PCF: Fetching primary data for 2024-12. [2025-09-26T20:39:02.162188] [INFO ] [REMOTE ] PBT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:39:02.188368] [INFO ] [REMOTE ] PBT: Fetching primary data for 2024-12. [2025-09-26T20:39:02.325270] [INFO ] [REMOTE ] PBR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:39:02.303524] [INFO ] [REMOTE ] PBI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:39:02.326012] [INFO ] [REMOTE ] PBR: Fetching primary data for 2024-12. [2025-09-26T20:39:02.327025] [INFO ] [REMOTE ] PBI: Fetching primary data for 2024-12. [2025-09-26T20:39:03.238737] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-26T20:39:03.242879] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-01. [2025-09-26T20:39:03.800540] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-26T20:39:03.805324] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-01. [2025-09-26T20:39:03.972963] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-26T20:39:03.983406] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-01. [2025-09-26T20:39:04.062490] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-26T20:39:04.065260] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-02. [2025-09-26T20:39:04.691199] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-09-26T20:39:04.703400] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-01. [2025-09-26T20:39:04.810107] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-26T20:39:04.814558] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-02. [2025-09-26T20:39:04.972534] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-26T20:39:04.977784] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-03. [2025-09-26T20:39:05.761702] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-26T20:39:05.772009] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-02. [2025-09-26T20:39:05.803037] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-26T20:39:06.017309] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-26T20:39:06.311732] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-04. [2025-09-26T20:39:06.929553] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-26T20:39:06.951225] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-26T20:39:07.111729] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-03. [2025-09-26T20:39:07.644890] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-26T20:39:07.911734] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-03. [2025-09-26T20:39:08.295520] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-26T20:39:08.711718] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-05. [2025-09-26T20:39:09.511760] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-04. [2025-09-26T20:39:09.599830] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-26T20:39:09.883222] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-26T20:39:10.311731] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-02. [2025-09-26T20:39:10.572781] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-26T20:39:11.111742] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-05. [2025-09-26T20:39:11.911725] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-04. [2025-09-26T20:39:12.166238] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-26T20:39:12.538223] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-26T20:39:12.711721] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-06. [2025-09-26T20:39:13.463124] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-26T20:39:13.511716] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-05. [2025-09-26T20:39:13.575769] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-26T20:39:14.311722] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-06. [2025-09-26T20:39:15.111689] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-07. [2025-09-26T20:39:15.257597] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-26T20:39:15.519913] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-26T20:39:15.879953] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-26T20:39:15.911695] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-08. [2025-09-26T20:39:16.711719] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-03. [2025-09-26T20:39:16.725372] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-26T20:39:17.511725] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-06. [2025-09-26T20:39:18.311712] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-09. [2025-09-26T20:39:18.858235] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-26T20:39:19.092151] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-26T20:39:19.111665] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-07. [2025-09-26T20:39:19.176371] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-26T20:39:19.184275] [INFO ] [REMOTE ] PCF: Full fetch complete (14272 records). [2025-09-26T20:39:19.184506] [DEBUG] [VALIDATOR ] PCF: Validating primary data. [2025-09-26T20:39:19.578481] [DEBUG] [VALIDATOR ] PCF: All expected trading days are present. [2025-09-26T20:39:19.578609] [DEBUG] [VALIDATOR ] PCF: Primary data validation passed. [2025-09-26T20:39:19.578966] [INFO ] [MAIN ] PCF: Fetched primary data is valid. [2025-09-26T20:39:19.579023] [DEBUG] [LOCAL ] PCF: Saving primary data. [2025-09-26T20:39:19.579522] [DEBUG] [LOCAL ] PCF: Trimmed 14272 records to 8720 (keeping 200 days of data) [2025-09-26T20:39:19.636453] [DEBUG] [LOCAL ] PCF: Primary data saved (8720 records). [2025-09-26T20:39:19.636602] [INFO ] [MAIN ] PCF: Full history saved. [2025-09-26T20:39:19.636724] [INFO ] [MAIN ] Update Progress: 1641/2371 symbols completed. PCF took 21.1s. Estimated remaining: 1h 37m 33s. Rate: 7.5 symbols/min [2025-09-26T20:39:19.813206] [INFO ] [MAIN ] PCG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:39:19.813437] [DEBUG] [LOCAL ] PCG: No existing data file found in primary storage. [2025-09-26T20:39:19.813494] [WARN ] [MAIN ] PCG: No existing data found, performing full refresh instead. [2025-09-26T20:39:19.813691] [INFO ] [MAIN ] PCG: Wiping existing primary data before full refresh. [2025-09-26T20:39:19.813745] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-09-26T20:39:19.813798] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-09-26T20:39:19.813836] [INFO ] [MAIN ] PCG: Starting full primary refresh. [2025-09-26T20:39:19.915713] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-07. [2025-09-26T20:39:20.212569] [INFO ] [REMOTE ] PCG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:39:20.224943] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-26T20:39:20.711746] [INFO ] [REMOTE ] PCG: Fetching primary data for 2024-12. [2025-09-26T20:39:21.511677] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-04. [2025-09-26T20:39:21.926774] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-26T20:39:22.311733] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-08. [2025-09-26T20:39:22.627157] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-26T20:39:23.111726] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-01. [2025-09-26T20:39:23.483266] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-26T20:39:23.585696] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-26T20:39:23.911725] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-08. [2025-09-26T20:39:24.711744] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-05. [2025-09-26T20:39:25.309359] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-09-26T20:39:25.388479] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-26T20:39:25.511710] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-02. [2025-09-26T20:39:26.311727] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-09. [2025-09-26T20:39:26.775715] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-26T20:39:27.111729] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-06. [2025-09-26T20:39:27.441478] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-26T20:39:27.749413] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-26T20:39:27.759563] [INFO ] [REMOTE ] PBI: Full fetch complete (71995 records). [2025-09-26T20:39:27.759772] [DEBUG] [VALIDATOR ] PBI: Validating primary data. [2025-09-26T20:39:27.918922] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-03. [2025-09-26T20:39:28.197490] [DEBUG] [VALIDATOR ] PBI: All expected trading days are present. [2025-09-26T20:39:28.197588] [DEBUG] [VALIDATOR ] PBI: Primary data validation passed. [2025-09-26T20:39:28.198726] [INFO ] [MAIN ] PBI: Fetched primary data is valid. [2025-09-26T20:39:28.198888] [DEBUG] [LOCAL ] PBI: Saving primary data. [2025-09-26T20:39:28.200476] [DEBUG] [LOCAL ] PBI: Trimmed 71995 records to 50788 (keeping 200 days of data) [2025-09-26T20:39:28.530693] [DEBUG] [LOCAL ] PBI: Primary data saved (50788 records). [2025-09-26T20:39:28.530839] [INFO ] [MAIN ] PBI: Full history saved. [2025-09-26T20:39:28.530931] [INFO ] [MAIN ] Update Progress: 1642/2371 symbols completed. PBI took 30.0s. Estimated remaining: 1h 37m 25s. Rate: 7.5 symbols/min [2025-09-26T20:39:28.706349] [INFO ] [MAIN ] PCM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:39:28.715051] [DEBUG] [LOCAL ] PCM: Loaded 6827 existing records from primary storage. [2025-09-26T20:39:28.715187] [INFO ] [MAIN ] PCM: Loaded 6827 existing records. [2025-09-26T20:39:28.711754] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-09. [2025-09-26T20:39:28.914560] [WARN ] [MAIN ] PCM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:39:28.914927] [INFO ] [MAIN ] PCM: Wiping existing primary data before full refresh. [2025-09-26T20:39:28.914985] [INFO ] [LOCAL ] PCM: Starting deletion of primary data. [2025-09-26T20:39:28.915342] [DEBUG] [LOCAL ] PCM: Deleted primary data file. [2025-09-26T20:39:28.915404] [INFO ] [MAIN ] PCM: Starting full primary refresh. [2025-09-26T20:39:29.311602] [INFO ] [REMOTE ] PCM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:39:29.341620] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-26T20:39:29.511704] [INFO ] [REMOTE ] PCM: Fetching primary data for 2024-12. [2025-09-26T20:39:29.746752] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-26T20:39:29.852424] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-26T20:39:29.857519] [INFO ] [REMOTE ] PBT: Full fetch complete (25327 records). [2025-09-26T20:39:29.857707] [DEBUG] [VALIDATOR ] PBT: Validating primary data. [2025-09-26T20:39:30.263771] [DEBUG] [VALIDATOR ] PBT: All expected trading days are present. [2025-09-26T20:39:30.263856] [DEBUG] [VALIDATOR ] PBT: Primary data validation passed. [2025-09-26T20:39:30.264390] [INFO ] [MAIN ] PBT: Fetched primary data is valid. [2025-09-26T20:39:30.264431] [DEBUG] [LOCAL ] PBT: Saving primary data. [2025-09-26T20:39:30.265214] [DEBUG] [LOCAL ] PBT: Trimmed 25327 records to 17533 (keeping 200 days of data) [2025-09-26T20:39:30.311896] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-07. [2025-09-26T20:39:30.379059] [DEBUG] [LOCAL ] PBT: Primary data saved (17533 records). [2025-09-26T20:39:30.379219] [INFO ] [MAIN ] PBT: Full history saved. [2025-09-26T20:39:30.379336] [INFO ] [MAIN ] Update Progress: 1643/2371 symbols completed. PBT took 31.8s. Estimated remaining: 1h 37m 14s. Rate: 7.5 symbols/min [2025-09-26T20:39:30.563677] [INFO ] [MAIN ] PCN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:39:30.590752] [DEBUG] [LOCAL ] PCN: Loaded 24500 existing records from primary storage. [2025-09-26T20:39:30.590932] [INFO ] [MAIN ] PCN: Loaded 24500 existing records. [2025-09-26T20:39:30.659736] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-26T20:39:30.794916] [WARN ] [MAIN ] PCN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:39:30.795244] [INFO ] [MAIN ] PCN: Wiping existing primary data before full refresh. [2025-09-26T20:39:30.795303] [INFO ] [LOCAL ] PCN: Starting deletion of primary data. [2025-09-26T20:39:30.796066] [DEBUG] [LOCAL ] PCN: Deleted primary data file. [2025-09-26T20:39:30.796127] [INFO ] [MAIN ] PCN: Starting full primary refresh. [2025-09-26T20:39:31.122117] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-01. [2025-09-26T20:39:31.249448] [INFO ] [REMOTE ] PCN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:39:31.911709] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-04. [2025-09-26T20:39:32.078922] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-26T20:39:32.400408] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-26T20:39:32.711727] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-02. [2025-09-26T20:39:33.496889] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-26T20:39:33.511711] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-03. [2025-09-26T20:39:33.893930] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-26T20:39:34.270801] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-26T20:39:34.311756] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-04. [2025-09-26T20:39:35.111687] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-05. [2025-09-26T20:39:35.334512] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-26T20:39:35.911728] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-08. [2025-09-26T20:39:36.711723] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-05. [2025-09-26T20:39:37.131760] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-26T20:39:37.463940] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-26T20:39:37.511716] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-06. [2025-09-26T20:39:38.127078] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-26T20:39:38.311728] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-09. [2025-09-26T20:39:38.452040] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-26T20:39:39.111753] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-06. [2025-09-26T20:39:39.911716] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-07. [2025-09-26T20:39:40.519016] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-26T20:39:40.530079] [INFO ] [REMOTE ] PBR: Full fetch complete (77776 records). [2025-09-26T20:39:40.530232] [DEBUG] [VALIDATOR ] PBR: Validating primary data. [2025-09-26T20:39:40.718171] [INFO ] [REMOTE ] PCN: Fetching primary data for 2024-12. [2025-09-26T20:39:40.730973] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-26T20:39:40.963284] [DEBUG] [VALIDATOR ] PBR: All expected trading days are present. [2025-09-26T20:39:40.963392] [DEBUG] [VALIDATOR ] PBR: Primary data validation passed. [2025-09-26T20:39:40.964607] [INFO ] [MAIN ] PBR: Fetched primary data is valid. [2025-09-26T20:39:40.964767] [DEBUG] [LOCAL ] PBR: Saving primary data. [2025-09-26T20:39:40.966619] [DEBUG] [LOCAL ] PBR: Trimmed 77776 records to 54492 (keeping 200 days of data) [2025-09-26T20:39:41.120795] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-26T20:39:41.365881] [DEBUG] [LOCAL ] PBR: Primary data saved (54492 records). [2025-09-26T20:39:41.366093] [INFO ] [MAIN ] PBR: Full history saved. [2025-09-26T20:39:41.366251] [INFO ] [MAIN ] Update Progress: 1644/2371 symbols completed. PBR took 42.8s. Estimated remaining: 1h 37m 8s. Rate: 7.5 symbols/min [2025-09-26T20:39:41.514692] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-08. [2025-09-26T20:39:41.548523] [INFO ] [MAIN ] PCOR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:39:41.598967] [DEBUG] [LOCAL ] PCOR: Loaded 48522 existing records from primary storage. [2025-09-26T20:39:41.599178] [INFO ] [MAIN ] PCOR: Loaded 48522 existing records. [2025-09-26T20:39:41.788361] [WARN ] [MAIN ] PCOR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:39:41.788688] [INFO ] [MAIN ] PCOR: Wiping existing primary data before full refresh. [2025-09-26T20:39:41.788764] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-09-26T20:39:41.789746] [DEBUG] [LOCAL ] PCOR: Deleted primary data file. [2025-09-26T20:39:41.789807] [INFO ] [MAIN ] PCOR: Starting full primary refresh. [2025-09-26T20:39:42.191254] [INFO ] [REMOTE ] PCOR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:39:42.263694] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-26T20:39:42.314702] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-01. [2025-09-26T20:39:42.315750] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-26T20:39:43.111729] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-09. [2025-09-26T20:39:43.464304] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-26T20:39:43.911717] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-07. [2025-09-26T20:39:44.021970] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-26T20:39:44.024503] [INFO ] [REMOTE ] PCM: Full fetch complete (10419 records). [2025-09-26T20:39:44.024615] [DEBUG] [VALIDATOR ] PCM: Validating primary data. [2025-09-26T20:39:44.422329] [DEBUG] [VALIDATOR ] PCM: All expected trading days are present. [2025-09-26T20:39:44.422530] [DEBUG] [VALIDATOR ] PCM: Primary data validation passed. [2025-09-26T20:39:44.422843] [INFO ] [MAIN ] PCM: Fetched primary data is valid. [2025-09-26T20:39:44.422908] [DEBUG] [LOCAL ] PCM: Saving primary data. [2025-09-26T20:39:44.423374] [DEBUG] [LOCAL ] PCM: Trimmed 10419 records to 6857 (keeping 200 days of data) [2025-09-26T20:39:44.465318] [DEBUG] [LOCAL ] PCM: Primary data saved (6857 records). [2025-09-26T20:39:44.465455] [INFO ] [MAIN ] PCM: Full history saved. [2025-09-26T20:39:44.465622] [INFO ] [MAIN ] Update Progress: 1645/2371 symbols completed. PCM took 15.9s. Estimated remaining: 1h 36m 57s. Rate: 7.5 symbols/min [2025-09-26T20:39:44.643847] [INFO ] [MAIN ] PCQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:39:44.657505] [DEBUG] [LOCAL ] PCQ: Loaded 12229 existing records from primary storage. [2025-09-26T20:39:44.657631] [INFO ] [MAIN ] PCQ: Loaded 12229 existing records. [2025-09-26T20:39:44.713457] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-02. [2025-09-26T20:39:44.854203] [WARN ] [MAIN ] PCQ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:39:44.854498] [INFO ] [MAIN ] PCQ: Wiping existing primary data before full refresh. [2025-09-26T20:39:44.854550] [INFO ] [LOCAL ] PCQ: Starting deletion of primary data. [2025-09-26T20:39:44.855390] [DEBUG] [LOCAL ] PCQ: Deleted primary data file. [2025-09-26T20:39:44.855455] [INFO ] [MAIN ] PCQ: Starting full primary refresh. [2025-09-26T20:39:45.242042] [INFO ] [REMOTE ] PCQ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:39:45.511780] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2024-12. [2025-09-26T20:39:45.921431] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-26T20:39:46.233462] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-26T20:39:46.311738] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-03. [2025-09-26T20:39:47.111895] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2024-12. [2025-09-26T20:39:47.432809] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-26T20:39:47.455395] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-26T20:39:47.829921] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-26T20:39:47.911715] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-01. [2025-09-26T20:39:48.711709] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-04. [2025-09-26T20:39:49.511706] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-08. [2025-09-26T20:39:49.623833] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-26T20:39:50.200609] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-26T20:39:50.311720] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-02. [2025-09-26T20:39:51.111709] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-05. [2025-09-26T20:39:51.445302] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-26T20:39:51.911699] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-09. [2025-09-26T20:39:52.051677] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-26T20:39:52.303840] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-26T20:39:52.711705] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-03. [2025-09-26T20:39:52.742422] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-26T20:39:52.752853] [INFO ] [REMOTE ] PCG: Full fetch complete (77345 records). [2025-09-26T20:39:52.752991] [DEBUG] [VALIDATOR ] PCG: Validating primary data. [2025-09-26T20:39:52.753850] [FATAL] [VALIDATOR ] PCG: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T20:39:52.753939] [FATAL] [MAIN ] PCG: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:39:52.753984] [WARN ] [MAIN ] PCG: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:39:52.754024] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-09-26T20:39:52.754127] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-09-26T20:39:52.754226] [INFO ] [LOCAL ] PCG: Starting deletion of derivative data. [2025-09-26T20:39:52.754291] [DEBUG] [LOCAL ] PCG: No derivative data file found to delete. [2025-09-26T20:39:52.754387] [INFO ] [MAIN ] Update Progress: 1646/2371 symbols completed. PCG took 33.1s. Estimated remaining: 1h 36m 50s. Rate: 7.5 symbols/min [2025-09-26T20:39:52.929916] [INFO ] [MAIN ] PD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:39:52.976366] [DEBUG] [LOCAL ] PD: Loaded 48235 existing records from primary storage. [2025-09-26T20:39:52.976513] [INFO ] [MAIN ] PD: Loaded 48235 existing records. [2025-09-26T20:39:53.175045] [WARN ] [MAIN ] PD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:39:53.175349] [INFO ] [MAIN ] PD: Wiping existing primary data before full refresh. [2025-09-26T20:39:53.175398] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-09-26T20:39:53.177387] [DEBUG] [LOCAL ] PD: Deleted primary data file. [2025-09-26T20:39:53.177463] [INFO ] [MAIN ] PD: Starting full primary refresh. [2025-09-26T20:39:53.518776] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-06. [2025-09-26T20:39:53.554610] [INFO ] [REMOTE ] PD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:39:54.311733] [INFO ] [REMOTE ] PD: Fetching primary data for 2024-12. [2025-09-26T20:39:54.415452] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-26T20:39:54.657270] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-26T20:39:55.111731] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-07. [2025-09-26T20:39:55.911717] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-01. [2025-09-26T20:39:56.180050] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-26T20:39:56.358627] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-26T20:39:56.528681] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-26T20:39:56.711736] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-02. [2025-09-26T20:39:57.511704] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-01. [2025-09-26T20:39:57.536525] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-26T20:39:58.311738] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-08. [2025-09-26T20:39:59.102368] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-26T20:39:59.111659] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-02. [2025-09-26T20:39:59.569520] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-26T20:39:59.911719] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-03. [2025-09-26T20:40:00.637622] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-26T20:40:00.711738] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-09. [2025-09-26T20:40:00.722729] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-26T20:40:01.511764] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-04. [2025-09-26T20:40:01.928313] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-26T20:40:01.934060] [INFO ] [REMOTE ] PCN: Full fetch complete (34032 records). [2025-09-26T20:40:01.934198] [DEBUG] [VALIDATOR ] PCN: Validating primary data. [2025-09-26T20:40:02.320182] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-03. [2025-09-26T20:40:02.362939] [DEBUG] [VALIDATOR ] PCN: All expected trading days are present. [2025-09-26T20:40:02.363005] [DEBUG] [VALIDATOR ] PCN: Primary data validation passed. [2025-09-26T20:40:02.363810] [INFO ] [MAIN ] PCN: Fetched primary data is valid. [2025-09-26T20:40:02.363884] [DEBUG] [LOCAL ] PCN: Saving primary data. [2025-09-26T20:40:02.365119] [DEBUG] [LOCAL ] PCN: Trimmed 34032 records to 24709 (keeping 200 days of data) [2025-09-26T20:40:02.520634] [DEBUG] [LOCAL ] PCN: Primary data saved (24709 records). [2025-09-26T20:40:02.520799] [INFO ] [MAIN ] PCN: Full history saved. [2025-09-26T20:40:02.520888] [INFO ] [MAIN ] Update Progress: 1647/2371 symbols completed. PCN took 32.1s. Estimated remaining: 1h 36m 42s. Rate: 7.5 symbols/min [2025-09-26T20:40:02.712809] [INFO ] [MAIN ] PDCC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:40:02.709171] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-26T20:40:02.713033] [DEBUG] [LOCAL ] PDCC: No existing data file found in primary storage. [2025-09-26T20:40:02.713141] [WARN ] [MAIN ] PDCC: No existing data found, performing full refresh instead. [2025-09-26T20:40:02.717562] [INFO ] [MAIN ] PDCC: Wiping existing primary data before full refresh. [2025-09-26T20:40:02.717629] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-09-26T20:40:02.717723] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-09-26T20:40:02.717780] [INFO ] [MAIN ] PDCC: Starting full primary refresh. [2025-09-26T20:40:03.117257] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-05. [2025-09-26T20:40:03.123630] [INFO ] [REMOTE ] PDCC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:40:03.911743] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-04. [2025-09-26T20:40:04.017062] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-26T20:40:04.213986] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-26T20:40:04.711736] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-06. [2025-09-26T20:40:05.511722] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-04. [2025-09-26T20:40:05.576575] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-26T20:40:05.911605] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-26T20:40:06.311728] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2024-12. [2025-09-26T20:40:06.737926] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-26T20:40:07.111715] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-01. [2025-09-26T20:40:07.227906] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T20:40:07.410572] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-09-26T20:40:07.911722] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-05. [2025-09-26T20:40:08.711726] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-05. [2025-09-26T20:40:09.511694] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-07. [2025-09-26T20:40:09.552439] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-26T20:40:10.312665] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-02. [2025-09-26T20:40:10.312567] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-26T20:40:10.377184] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-26T20:40:10.814183] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-26T20:40:11.111735] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-06. [2025-09-26T20:40:11.911718] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-06. [2025-09-26T20:40:12.615743] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-26T20:40:12.711799] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-08. [2025-09-26T20:40:13.464589] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T20:40:13.508440] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-26T20:40:13.512326] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-03. [2025-09-26T20:40:13.968273] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-26T20:40:14.311719] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-07. [2025-09-26T20:40:15.111726] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-04. [2025-09-26T20:40:15.623613] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-26T20:40:15.911723] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-07. [2025-09-26T20:40:15.992114] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-26T20:40:16.711721] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-05. [2025-09-26T20:40:17.104277] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-26T20:40:17.511727] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-08. [2025-09-26T20:40:17.677634] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-26T20:40:18.311715] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-09. [2025-09-26T20:40:19.111740] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-06. [2025-09-26T20:40:19.254688] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-26T20:40:19.276489] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-26T20:40:19.280340] [INFO ] [REMOTE ] PCQ: Full fetch complete (17531 records). [2025-09-26T20:40:19.280483] [DEBUG] [VALIDATOR ] PCQ: Validating primary data. [2025-09-26T20:40:19.569393] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-26T20:40:19.704944] [DEBUG] [VALIDATOR ] PCQ: All expected trading days are present. [2025-09-26T20:40:19.705078] [DEBUG] [VALIDATOR ] PCQ: Primary data validation passed. [2025-09-26T20:40:19.705585] [INFO ] [MAIN ] PCQ: Fetched primary data is valid. [2025-09-26T20:40:19.705690] [DEBUG] [LOCAL ] PCQ: Saving primary data. [2025-09-26T20:40:19.706509] [DEBUG] [LOCAL ] PCQ: Trimmed 17531 records to 12298 (keeping 200 days of data) [2025-09-26T20:40:19.786252] [DEBUG] [LOCAL ] PCQ: Primary data saved (12298 records). [2025-09-26T20:40:19.786404] [INFO ] [MAIN ] PCQ: Full history saved. [2025-09-26T20:40:19.786513] [INFO ] [MAIN ] Update Progress: 1648/2371 symbols completed. PCQ took 35.3s. Estimated remaining: 1h 36m 38s. Rate: 7.5 symbols/min [2025-09-26T20:40:19.916861] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-08. [2025-09-26T20:40:20.024704] [INFO ] [MAIN ] PDI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:40:20.077385] [DEBUG] [LOCAL ] PDI: Loaded 50558 existing records from primary storage. [2025-09-26T20:40:20.077560] [INFO ] [MAIN ] PDI: Loaded 50558 existing records. [2025-09-26T20:40:20.273819] [WARN ] [MAIN ] PDI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:40:20.274117] [INFO ] [MAIN ] PDI: Wiping existing primary data before full refresh. [2025-09-26T20:40:20.274165] [INFO ] [LOCAL ] PDI: Starting deletion of primary data. [2025-09-26T20:40:20.275699] [DEBUG] [LOCAL ] PDI: Deleted primary data file. [2025-09-26T20:40:20.275765] [INFO ] [MAIN ] PDI: Starting full primary refresh. [2025-09-26T20:40:20.685136] [INFO ] [REMOTE ] PDI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:40:20.711729] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-07. [2025-09-26T20:40:21.117847] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-26T20:40:21.511696] [INFO ] [REMOTE ] PDI: Fetching primary data for 2024-12. [2025-09-26T20:40:21.920502] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-26T20:40:22.311722] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-09. [2025-09-26T20:40:23.111717] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-08. [2025-09-26T20:40:23.488065] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-26T20:40:23.685425] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-26T20:40:23.911716] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-09. [2025-09-26T20:40:24.038428] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-26T20:40:24.049583] [INFO ] [REMOTE ] PD: Full fetch complete (67581 records). [2025-09-26T20:40:24.049786] [DEBUG] [VALIDATOR ] PD: Validating primary data. [2025-09-26T20:40:24.462096] [DEBUG] [VALIDATOR ] PD: All expected trading days are present. [2025-09-26T20:40:24.462195] [DEBUG] [VALIDATOR ] PD: Primary data validation passed. [2025-09-26T20:40:24.463199] [INFO ] [MAIN ] PD: Fetched primary data is valid. [2025-09-26T20:40:24.463273] [DEBUG] [LOCAL ] PD: Saving primary data. [2025-09-26T20:40:24.464816] [DEBUG] [LOCAL ] PD: Trimmed 67581 records to 48580 (keeping 200 days of data) [2025-09-26T20:40:24.728306] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-01. [2025-09-26T20:40:24.761955] [DEBUG] [LOCAL ] PD: Primary data saved (48580 records). [2025-09-26T20:40:24.762078] [INFO ] [MAIN ] PD: Full history saved. [2025-09-26T20:40:24.762169] [INFO ] [MAIN ] Update Progress: 1649/2371 symbols completed. PD took 32.0s. Estimated remaining: 1h 36m 29s. Rate: 7.5 symbols/min [2025-09-26T20:40:24.941875] [INFO ] [MAIN ] PDM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:40:24.978963] [DEBUG] [LOCAL ] PDM: Loaded 40139 existing records from primary storage. [2025-09-26T20:40:24.979136] [INFO ] [MAIN ] PDM: Loaded 40139 existing records. [2025-09-26T20:40:25.183459] [WARN ] [MAIN ] PDM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:40:25.183827] [INFO ] [MAIN ] PDM: Wiping existing primary data before full refresh. [2025-09-26T20:40:25.183896] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-09-26T20:40:25.184848] [DEBUG] [LOCAL ] PDM: Deleted primary data file. [2025-09-26T20:40:25.184944] [INFO ] [MAIN ] PDM: Starting full primary refresh. [2025-09-26T20:40:25.521628] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-09. [2025-09-26T20:40:25.568163] [INFO ] [REMOTE ] PDM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:40:25.615323] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-26T20:40:25.625757] [INFO ] [REMOTE ] PCOR: Full fetch complete (69631 records). [2025-09-26T20:40:25.625933] [DEBUG] [VALIDATOR ] PCOR: Validating primary data. [2025-09-26T20:40:25.949209] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-26T20:40:25.965926] [INFO ] [REMOTE ] PDCC: Full fetch complete (1345 records). [2025-09-26T20:40:25.971193] [DEBUG] [VALIDATOR ] PDCC: Validating primary data. [2025-09-26T20:40:26.143820] [DEBUG] [VALIDATOR ] PCOR: All expected trading days are present. [2025-09-26T20:40:26.165379] [DEBUG] [VALIDATOR ] PCOR: Primary data validation passed. [2025-09-26T20:40:26.171156] [INFO ] [MAIN ] PCOR: Fetched primary data is valid. [2025-09-26T20:40:26.177073] [DEBUG] [LOCAL ] PCOR: Saving primary data. [2025-09-26T20:40:26.256949] [WARN ] [VALIDATOR ] PDCC: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-26T20:40:26.257329] [FATAL] [MAIN ] PDCC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:40:26.257557] [WARN ] [MAIN ] PDCC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:40:26.257668] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-09-26T20:40:26.257771] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-09-26T20:40:26.257940] [INFO ] [LOCAL ] PDCC: Starting deletion of derivative data. [2025-09-26T20:40:26.257872] [DEBUG] [LOCAL ] PCOR: Trimmed 69631 records to 48849 (keeping 200 days of data) [2025-09-26T20:40:26.258341] [DEBUG] [LOCAL ] PDCC: No derivative data file found to delete. [2025-09-26T20:40:26.258430] [INFO ] [MAIN ] Update Progress: 1650/2371 symbols completed. PDCC took 23.7s. Estimated remaining: 1h 36m 18s. Rate: 7.5 symbols/min [2025-09-26T20:40:26.359170] [INFO ] [REMOTE ] PDM: Fetching primary data for 2024-12. [2025-09-26T20:40:26.542496] [INFO ] [MAIN ] PDO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:40:26.600931] [DEBUG] [LOCAL ] PDO: Loaded 31936 existing records from primary storage. [2025-09-26T20:40:26.602047] [INFO ] [MAIN ] PDO: Loaded 31936 existing records. [2025-09-26T20:40:26.907982] [WARN ] [MAIN ] PDO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:40:26.938258] [INFO ] [MAIN ] PDO: Wiping existing primary data before full refresh. [2025-09-26T20:40:26.941289] [INFO ] [LOCAL ] PDO: Starting deletion of primary data. [2025-09-26T20:40:26.941206] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-09-26T20:40:26.952628] [DEBUG] [LOCAL ] PDO: Deleted primary data file. [2025-09-26T20:40:26.954724] [INFO ] [MAIN ] PDO: Starting full primary refresh. [2025-09-26T20:40:27.112607] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-02. [2025-09-26T20:40:27.378619] [INFO ] [REMOTE ] PDO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:40:27.443013] [DEBUG] [LOCAL ] PCOR: Primary data saved (48849 records). [2025-09-26T20:40:27.443180] [INFO ] [MAIN ] PCOR: Full history saved. [2025-09-26T20:40:27.443272] [INFO ] [MAIN ] Update Progress: 1651/2371 symbols completed. PCOR took 46.1s. Estimated remaining: 1h 36m 7s. Rate: 7.5 symbols/min [2025-09-26T20:40:27.623308] [INFO ] [MAIN ] PDS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:40:27.644100] [DEBUG] [LOCAL ] PDS: Loaded 18211 existing records from primary storage. [2025-09-26T20:40:27.644241] [INFO ] [MAIN ] PDS: Loaded 18211 existing records. [2025-09-26T20:40:27.841941] [WARN ] [MAIN ] PDS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:40:27.842373] [INFO ] [MAIN ] PDS: Wiping existing primary data before full refresh. [2025-09-26T20:40:27.842463] [INFO ] [LOCAL ] PDS: Starting deletion of primary data. [2025-09-26T20:40:27.843140] [DEBUG] [LOCAL ] PDS: Deleted primary data file. [2025-09-26T20:40:27.843218] [INFO ] [MAIN ] PDS: Starting full primary refresh. [2025-09-26T20:40:27.917368] [INFO ] [REMOTE ] PDO: Fetching primary data for 2024-12. [2025-09-26T20:40:28.266523] [INFO ] [REMOTE ] PDS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:40:28.296031] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-26T20:40:28.711700] [INFO ] [REMOTE ] PDS: Fetching primary data for 2024-12. [2025-09-26T20:40:28.957079] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-26T20:40:29.337358] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-26T20:40:29.511724] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-03. [2025-09-26T20:40:29.721319] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-26T20:40:30.311716] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-01. [2025-09-26T20:40:31.111702] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-01. [2025-09-26T20:40:31.627711] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-26T20:40:31.663479] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-26T20:40:31.911718] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-04. [2025-09-26T20:40:32.558431] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-26T20:40:32.711742] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-02. [2025-09-26T20:40:33.511702] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-02. [2025-09-26T20:40:33.702368] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-26T20:40:33.963580] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-26T20:40:34.311751] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-01. [2025-09-26T20:40:35.025428] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-26T20:40:35.084735] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-26T20:40:35.111700] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-03. [2025-09-26T20:40:35.911723] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-03. [2025-09-26T20:40:36.705273] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-26T20:40:36.717040] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-05. [2025-09-26T20:40:37.414131] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-26T20:40:37.511722] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-02. [2025-09-26T20:40:38.311718] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-04. [2025-09-26T20:40:38.465972] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-26T20:40:38.515589] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-26T20:40:39.111725] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-04. [2025-09-26T20:40:39.835916] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T20:40:39.911688] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-05. [2025-09-26T20:40:40.590668] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-26T20:40:40.711719] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-06. [2025-09-26T20:40:41.411872] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-26T20:40:41.511725] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-05. [2025-09-26T20:40:42.024106] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-26T20:40:42.311718] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-03. [2025-09-26T20:40:43.016937] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-26T20:40:43.111735] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-07. [2025-09-26T20:40:43.426316] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-26T20:40:43.911721] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-06. [2025-09-26T20:40:44.711716] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-06. [2025-09-26T20:40:45.051470] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-26T20:40:45.092053] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-26T20:40:45.511724] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-08. [2025-09-26T20:40:46.278083] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-26T20:40:46.311673] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-07. [2025-09-26T20:40:47.111727] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-04. [2025-09-26T20:40:47.430531] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-26T20:40:47.844701] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-26T20:40:47.911695] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-09. [2025-09-26T20:40:48.424948] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-26T20:40:48.711716] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-05. [2025-09-26T20:40:49.406370] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-26T20:40:49.420588] [INFO ] [REMOTE ] PDI: Full fetch complete (73071 records). [2025-09-26T20:40:49.420811] [DEBUG] [VALIDATOR ] PDI: Validating primary data. [2025-09-26T20:40:49.516821] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-07. [2025-09-26T20:40:49.776229] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-26T20:40:49.867817] [DEBUG] [VALIDATOR ] PDI: All expected trading days are present. [2025-09-26T20:40:49.867913] [DEBUG] [VALIDATOR ] PDI: Primary data validation passed. [2025-09-26T20:40:49.869026] [INFO ] [MAIN ] PDI: Fetched primary data is valid. [2025-09-26T20:40:49.869129] [DEBUG] [LOCAL ] PDI: Saving primary data. [2025-09-26T20:40:49.870790] [DEBUG] [LOCAL ] PDI: Trimmed 73071 records to 50909 (keeping 200 days of data) [2025-09-26T20:40:50.213249] [DEBUG] [LOCAL ] PDI: Primary data saved (50909 records). [2025-09-26T20:40:50.213415] [INFO ] [MAIN ] PDI: Full history saved. [2025-09-26T20:40:50.213586] [INFO ] [MAIN ] Update Progress: 1652/2371 symbols completed. PDI took 30.4s. Estimated remaining: 1h 36m 6s. Rate: 7.5 symbols/min [2025-09-26T20:40:50.317559] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-06. [2025-09-26T20:40:50.396325] [INFO ] [MAIN ] PDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:40:50.415578] [DEBUG] [LOCAL ] PDT: Loaded 17362 existing records from primary storage. [2025-09-26T20:40:50.415730] [INFO ] [MAIN ] PDT: Loaded 17362 existing records. [2025-09-26T20:40:50.616929] [WARN ] [MAIN ] PDT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:40:50.617395] [INFO ] [MAIN ] PDT: Wiping existing primary data before full refresh. [2025-09-26T20:40:50.617625] [INFO ] [LOCAL ] PDT: Starting deletion of primary data. [2025-09-26T20:40:50.618291] [DEBUG] [LOCAL ] PDT: Deleted primary data file. [2025-09-26T20:40:50.618379] [INFO ] [MAIN ] PDT: Starting full primary refresh. [2025-09-26T20:40:50.796176] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-26T20:40:51.027854] [INFO ] [REMOTE ] PDT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:40:51.111684] [INFO ] [REMOTE ] PDT: Fetching primary data for 2024-12. [2025-09-26T20:40:51.436503] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-26T20:40:51.911727] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-08. [2025-09-26T20:40:52.473634] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-26T20:40:52.711738] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-01. [2025-09-26T20:40:53.276463] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-26T20:40:53.511723] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-09. [2025-09-26T20:40:53.669532] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-26T20:40:54.311681] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-07. [2025-09-26T20:40:54.779579] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-26T20:40:54.785902] [INFO ] [REMOTE ] PDO: Full fetch complete (47895 records). [2025-09-26T20:40:54.786013] [DEBUG] [VALIDATOR ] PDO: Validating primary data. [2025-09-26T20:40:55.116792] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-08. [2025-09-26T20:40:55.200157] [DEBUG] [VALIDATOR ] PDO: All expected trading days are present. [2025-09-26T20:40:55.200248] [DEBUG] [VALIDATOR ] PDO: Primary data validation passed. [2025-09-26T20:40:55.201225] [INFO ] [MAIN ] PDO: Fetched primary data is valid. [2025-09-26T20:40:55.201294] [DEBUG] [LOCAL ] PDO: Saving primary data. [2025-09-26T20:40:55.202560] [DEBUG] [LOCAL ] PDO: Trimmed 47895 records to 32146 (keeping 200 days of data) [2025-09-26T20:40:55.349047] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-26T20:40:55.447311] [DEBUG] [LOCAL ] PDO: Primary data saved (32146 records). [2025-09-26T20:40:55.447484] [INFO ] [MAIN ] PDO: Full history saved. [2025-09-26T20:40:55.447605] [INFO ] [MAIN ] Update Progress: 1653/2371 symbols completed. PDO took 29.2s. Estimated remaining: 1h 35m 56s. Rate: 7.5 symbols/min [2025-09-26T20:40:55.632897] [INFO ] [MAIN ] PDX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:40:55.652631] [DEBUG] [LOCAL ] PDX: Loaded 14398 existing records from primary storage. [2025-09-26T20:40:55.652814] [INFO ] [MAIN ] PDX: Loaded 14398 existing records. [2025-09-26T20:40:55.850705] [WARN ] [MAIN ] PDX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:40:55.851062] [INFO ] [MAIN ] PDX: Wiping existing primary data before full refresh. [2025-09-26T20:40:55.851133] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-09-26T20:40:55.851581] [DEBUG] [LOCAL ] PDX: Deleted primary data file. [2025-09-26T20:40:55.851673] [INFO ] [MAIN ] PDX: Starting full primary refresh. [2025-09-26T20:40:55.920625] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-02. [2025-09-26T20:40:56.236712] [INFO ] [REMOTE ] PDX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:40:56.695565] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-26T20:40:56.711687] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-09. [2025-09-26T20:40:56.972922] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-26T20:40:57.511725] [INFO ] [REMOTE ] PDX: Fetching primary data for 2024-12. [2025-09-26T20:40:58.117778] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-26T20:40:58.126086] [INFO ] [REMOTE ] PDM: Full fetch complete (57361 records). [2025-09-26T20:40:58.126238] [DEBUG] [VALIDATOR ] PDM: Validating primary data. [2025-09-26T20:40:58.321133] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-08. [2025-09-26T20:40:58.560173] [DEBUG] [VALIDATOR ] PDM: All expected trading days are present. [2025-09-26T20:40:58.560295] [DEBUG] [VALIDATOR ] PDM: Primary data validation passed. [2025-09-26T20:40:58.561282] [INFO ] [MAIN ] PDM: Fetched primary data is valid. [2025-09-26T20:40:58.561389] [DEBUG] [LOCAL ] PDM: Saving primary data. [2025-09-26T20:40:58.563461] [DEBUG] [LOCAL ] PDM: Trimmed 57361 records to 40354 (keeping 200 days of data) [2025-09-26T20:40:58.829630] [DEBUG] [LOCAL ] PDM: Primary data saved (40354 records). [2025-09-26T20:40:58.829921] [INFO ] [MAIN ] PDM: Full history saved. [2025-09-26T20:40:58.835363] [INFO ] [MAIN ] Update Progress: 1654/2371 symbols completed. PDM took 34.1s. Estimated remaining: 1h 35m 46s. Rate: 7.5 symbols/min [2025-09-26T20:40:58.891182] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-26T20:40:59.031121] [INFO ] [MAIN ] PEB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:40:59.092953] [DEBUG] [LOCAL ] PEB: Loaded 51087 existing records from primary storage. [2025-09-26T20:40:59.093135] [INFO ] [MAIN ] PEB: Loaded 51087 existing records. [2025-09-26T20:40:59.116918] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-03. [2025-09-26T20:40:59.285874] [WARN ] [MAIN ] PEB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:40:59.286332] [INFO ] [MAIN ] PEB: Wiping existing primary data before full refresh. [2025-09-26T20:40:59.295112] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-09-26T20:40:59.296240] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-26T20:40:59.297495] [DEBUG] [LOCAL ] PEB: Deleted primary data file. [2025-09-26T20:40:59.300098] [INFO ] [MAIN ] PEB: Starting full primary refresh. [2025-09-26T20:40:59.690144] [INFO ] [REMOTE ] PEB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:40:59.911722] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-09. [2025-09-26T20:41:00.371394] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-26T20:41:00.711754] [INFO ] [REMOTE ] PEB: Fetching primary data for 2024-12. [2025-09-26T20:41:00.811155] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-26T20:41:00.816548] [INFO ] [REMOTE ] PDS: Full fetch complete (25622 records). [2025-09-26T20:41:00.816697] [DEBUG] [VALIDATOR ] PDS: Validating primary data. [2025-09-26T20:41:01.216410] [DEBUG] [VALIDATOR ] PDS: All expected trading days are present. [2025-09-26T20:41:01.216502] [DEBUG] [VALIDATOR ] PDS: Primary data validation passed. [2025-09-26T20:41:01.217109] [INFO ] [MAIN ] PDS: Fetched primary data is valid. [2025-09-26T20:41:01.217174] [DEBUG] [LOCAL ] PDS: Saving primary data. [2025-09-26T20:41:01.218174] [DEBUG] [LOCAL ] PDS: Trimmed 25622 records to 18297 (keeping 200 days of data) [2025-09-26T20:41:01.345227] [DEBUG] [LOCAL ] PDS: Primary data saved (18297 records). [2025-09-26T20:41:01.345408] [INFO ] [MAIN ] PDS: Full history saved. [2025-09-26T20:41:01.345568] [INFO ] [MAIN ] Update Progress: 1655/2371 symbols completed. PDS took 33.9s. Estimated remaining: 1h 35m 36s. Rate: 7.5 symbols/min [2025-09-26T20:41:01.519063] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-04. [2025-09-26T20:41:01.556473] [INFO ] [MAIN ] PEG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:41:01.556699] [DEBUG] [LOCAL ] PEG: No existing data file found in primary storage. [2025-09-26T20:41:01.556758] [WARN ] [MAIN ] PEG: No existing data found, performing full refresh instead. [2025-09-26T20:41:01.557016] [INFO ] [MAIN ] PEG: Wiping existing primary data before full refresh. [2025-09-26T20:41:01.557070] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-09-26T20:41:01.557117] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-09-26T20:41:01.557152] [INFO ] [MAIN ] PEG: Starting full primary refresh. [2025-09-26T20:41:01.994185] [INFO ] [REMOTE ] PEG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:41:02.311734] [INFO ] [REMOTE ] PEG: Fetching primary data for 2024-12. [2025-09-26T20:41:02.398036] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-26T20:41:02.598160] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-26T20:41:03.111722] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-01. [2025-09-26T20:41:03.911712] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-01. [2025-09-26T20:41:04.270072] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-26T20:41:04.711777] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-05. [2025-09-26T20:41:04.765878] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-26T20:41:05.244201] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-26T20:41:05.511784] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-02. [2025-09-26T20:41:05.731343] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-26T20:41:06.311731] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-02. [2025-09-26T20:41:07.094378] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-26T20:41:07.111684] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-06. [2025-09-26T20:41:07.523907] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-26T20:41:07.911698] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-01. [2025-09-26T20:41:08.153847] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-26T20:41:08.711716] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-03. [2025-09-26T20:41:09.511706] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-03. [2025-09-26T20:41:09.687485] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-26T20:41:09.763765] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-26T20:41:10.311714] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-07. [2025-09-26T20:41:11.085205] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-26T20:41:11.111734] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-04. [2025-09-26T20:41:11.443154] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-26T20:41:11.911726] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-04. [2025-09-26T20:41:12.192758] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-26T20:41:12.711720] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-02. [2025-09-26T20:41:13.511708] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-05. [2025-09-26T20:41:13.739848] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-26T20:41:14.286663] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-26T20:41:14.311732] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-03. [2025-09-26T20:41:14.716157] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-26T20:41:15.111761] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-05. [2025-09-26T20:41:15.911713] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-08. [2025-09-26T20:41:16.170974] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-26T20:41:16.711691] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-04. [2025-09-26T20:41:16.908822] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-26T20:41:17.019022] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-26T20:41:17.511755] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-06. [2025-09-26T20:41:18.311726] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-09. [2025-09-26T20:41:18.455597] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-26T20:41:18.553775] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-26T20:41:19.111723] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-05. [2025-09-26T20:41:19.331834] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-26T20:41:19.335474] [INFO ] [REMOTE ] PDT: Full fetch complete (25111 records). [2025-09-26T20:41:19.335584] [DEBUG] [VALIDATOR ] PDT: Validating primary data. [2025-09-26T20:41:19.737776] [DEBUG] [VALIDATOR ] PDT: All expected trading days are present. [2025-09-26T20:41:19.737866] [DEBUG] [VALIDATOR ] PDT: Primary data validation passed. [2025-09-26T20:41:19.738390] [INFO ] [MAIN ] PDT: Fetched primary data is valid. [2025-09-26T20:41:19.738431] [DEBUG] [LOCAL ] PDT: Saving primary data. [2025-09-26T20:41:19.739156] [DEBUG] [LOCAL ] PDT: Trimmed 25111 records to 17549 (keeping 200 days of data) [2025-09-26T20:41:19.855361] [DEBUG] [LOCAL ] PDT: Primary data saved (17549 records). [2025-09-26T20:41:19.855537] [INFO ] [MAIN ] PDT: Full history saved. [2025-09-26T20:41:19.855662] [INFO ] [MAIN ] Update Progress: 1656/2371 symbols completed. PDT took 29.6s. Estimated remaining: 1h 35m 32s. Rate: 7.5 symbols/min [2025-09-26T20:41:19.922761] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-07. [2025-09-26T20:41:20.036268] [INFO ] [MAIN ] PEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:41:20.074407] [DEBUG] [LOCAL ] PEN: Loaded 30702 existing records from primary storage. [2025-09-26T20:41:20.074551] [INFO ] [MAIN ] PEN: Loaded 30702 existing records. [2025-09-26T20:41:20.266336] [WARN ] [MAIN ] PEN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:41:20.266605] [INFO ] [MAIN ] PEN: Wiping existing primary data before full refresh. [2025-09-26T20:41:20.266682] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-09-26T20:41:20.267481] [DEBUG] [LOCAL ] PEN: Deleted primary data file. [2025-09-26T20:41:20.267544] [INFO ] [MAIN ] PEN: Starting full primary refresh. [2025-09-26T20:41:20.668143] [INFO ] [REMOTE ] PEN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:41:20.711721] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-06. [2025-09-26T20:41:21.025414] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-26T20:41:21.048965] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-26T20:41:21.511721] [INFO ] [REMOTE ] PEN: Fetching primary data for 2024-12. [2025-09-26T20:41:22.311713] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-08. [2025-09-26T20:41:22.348589] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-26T20:41:22.689435] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-26T20:41:23.111698] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-01. [2025-09-26T20:41:23.151982] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-26T20:41:23.911717] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-07. [2025-09-26T20:41:24.462232] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-26T20:41:24.711737] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-02. [2025-09-26T20:41:25.239205] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-26T20:41:25.511732] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-09. [2025-09-26T20:41:26.181259] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-26T20:41:26.314308] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-03. [2025-09-26T20:41:26.316197] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-26T20:41:26.319771] [INFO ] [REMOTE ] PDX: Full fetch complete (24632 records). [2025-09-26T20:41:26.319870] [DEBUG] [VALIDATOR ] PDX: Validating primary data. [2025-09-26T20:41:26.704935] [DEBUG] [VALIDATOR ] PDX: All expected trading days are present. [2025-09-26T20:41:26.705020] [DEBUG] [VALIDATOR ] PDX: Primary data validation passed. [2025-09-26T20:41:26.705596] [INFO ] [MAIN ] PDX: Fetched primary data is valid. [2025-09-26T20:41:26.705636] [DEBUG] [LOCAL ] PDX: Saving primary data. [2025-09-26T20:41:26.706349] [DEBUG] [LOCAL ] PDX: Trimmed 24632 records to 14514 (keeping 200 days of data) [2025-09-26T20:41:26.805874] [DEBUG] [LOCAL ] PDX: Primary data saved (14514 records). [2025-09-26T20:41:26.806016] [INFO ] [MAIN ] PDX: Full history saved. [2025-09-26T20:41:26.806103] [INFO ] [MAIN ] Update Progress: 1657/2371 symbols completed. PDX took 31.4s. Estimated remaining: 1h 35m 24s. Rate: 7.5 symbols/min [2025-09-26T20:41:26.986181] [INFO ] [MAIN ] PEO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:41:26.999488] [DEBUG] [LOCAL ] PEO: Loaded 10897 existing records from primary storage. [2025-09-26T20:41:26.999638] [INFO ] [MAIN ] PEO: Loaded 10897 existing records. [2025-09-26T20:41:27.119447] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-06. [2025-09-26T20:41:27.232446] [WARN ] [MAIN ] PEO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:41:27.232851] [INFO ] [MAIN ] PEO: Wiping existing primary data before full refresh. [2025-09-26T20:41:27.232934] [INFO ] [LOCAL ] PEO: Starting deletion of primary data. [2025-09-26T20:41:27.233354] [DEBUG] [LOCAL ] PEO: Deleted primary data file. [2025-09-26T20:41:27.233416] [INFO ] [MAIN ] PEO: Starting full primary refresh. [2025-09-26T20:41:27.623679] [INFO ] [REMOTE ] PEO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:41:27.840087] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-26T20:41:27.911740] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-08. [2025-09-26T20:41:28.711709] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-04. [2025-09-26T20:41:28.818088] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-26T20:41:29.123096] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-26T20:41:29.511771] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-09. [2025-09-26T20:41:30.263860] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-26T20:41:30.311698] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-05. [2025-09-26T20:41:31.114875] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-07. [2025-09-26T20:41:31.120485] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-26T20:41:31.131213] [INFO ] [REMOTE ] PEB: Full fetch complete (72771 records). [2025-09-26T20:41:31.131410] [DEBUG] [VALIDATOR ] PEB: Validating primary data. [2025-09-26T20:41:31.557285] [DEBUG] [VALIDATOR ] PEB: All expected trading days are present. [2025-09-26T20:41:31.557597] [DEBUG] [VALIDATOR ] PEB: Primary data validation passed. [2025-09-26T20:41:31.558822] [INFO ] [MAIN ] PEB: Fetched primary data is valid. [2025-09-26T20:41:31.558950] [DEBUG] [LOCAL ] PEB: Saving primary data. [2025-09-26T20:41:31.560731] [DEBUG] [LOCAL ] PEB: Trimmed 72771 records to 51448 (keeping 200 days of data) [2025-09-26T20:41:31.715155] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-26T20:41:31.911857] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-06. [2025-09-26T20:41:31.924667] [DEBUG] [LOCAL ] PEB: Primary data saved (51448 records). [2025-09-26T20:41:31.924935] [INFO ] [MAIN ] PEB: Full history saved. [2025-09-26T20:41:31.925043] [INFO ] [MAIN ] Update Progress: 1658/2371 symbols completed. PEB took 33.1s. Estimated remaining: 1h 35m 15s. Rate: 7.5 symbols/min [2025-09-26T20:41:32.115476] [INFO ] [MAIN ] PERF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:41:32.131071] [DEBUG] [LOCAL ] PERF: Loaded 14123 existing records from primary storage. [2025-09-26T20:41:32.131194] [INFO ] [MAIN ] PERF: Loaded 14123 existing records. [2025-09-26T20:41:32.319629] [WARN ] [MAIN ] PERF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:41:32.319903] [INFO ] [MAIN ] PERF: Wiping existing primary data before full refresh. [2025-09-26T20:41:32.319952] [INFO ] [LOCAL ] PERF: Starting deletion of primary data. [2025-09-26T20:41:32.320350] [DEBUG] [LOCAL ] PERF: Deleted primary data file. [2025-09-26T20:41:32.320411] [INFO ] [MAIN ] PERF: Starting full primary refresh. [2025-09-26T20:41:32.709039] [INFO ] [REMOTE ] PERF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:41:32.711667] [INFO ] [REMOTE ] PERF: Fetching primary data for 2024-12. [2025-09-26T20:41:33.130281] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-26T20:41:33.131485] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-26T20:41:33.511758] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-08. [2025-09-26T20:41:33.849528] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-26T20:41:34.311747] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-07. [2025-09-26T20:41:35.111692] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-01. [2025-09-26T20:41:35.289502] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-26T20:41:35.710697] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-26T20:41:35.829610] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-26T20:41:35.911713] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-08. [2025-09-26T20:41:36.711697] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-09. [2025-09-26T20:41:37.169773] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-26T20:41:37.446800] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-26T20:41:37.459227] [INFO ] [REMOTE ] PEG: Full fetch complete (76288 records). [2025-09-26T20:41:37.459473] [DEBUG] [VALIDATOR ] PEG: Validating primary data. [2025-09-26T20:41:37.460602] [FATAL] [VALIDATOR ] PEG: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T20:41:37.460755] [FATAL] [MAIN ] PEG: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:41:37.460824] [WARN ] [MAIN ] PEG: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:41:37.460899] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-09-26T20:41:37.460976] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-09-26T20:41:37.461057] [INFO ] [LOCAL ] PEG: Starting deletion of derivative data. [2025-09-26T20:41:37.461144] [DEBUG] [LOCAL ] PEG: No derivative data file found to delete. [2025-09-26T20:41:37.461234] [INFO ] [MAIN ] Update Progress: 1659/2371 symbols completed. PEG took 36.1s. Estimated remaining: 1h 35m 6s. Rate: 7.5 symbols/min [2025-09-26T20:41:37.516920] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-09. [2025-09-26T20:41:37.658034] [INFO ] [MAIN ] PEW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:41:37.658225] [DEBUG] [LOCAL ] PEW: No existing data file found in primary storage. [2025-09-26T20:41:37.658263] [WARN ] [MAIN ] PEW: No existing data found, performing full refresh instead. [2025-09-26T20:41:37.658410] [INFO ] [MAIN ] PEW: Wiping existing primary data before full refresh. [2025-09-26T20:41:37.658453] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-09-26T20:41:37.658494] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-09-26T20:41:37.658526] [INFO ] [MAIN ] PEW: Starting full primary refresh. [2025-09-26T20:41:38.026706] [INFO ] [REMOTE ] PEW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:41:38.311722] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-02. [2025-09-26T20:41:38.888460] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-26T20:41:38.894160] [INFO ] [REMOTE ] PEN: Full fetch complete (44146 records). [2025-09-26T20:41:38.894298] [DEBUG] [VALIDATOR ] PEN: Validating primary data. [2025-09-26T20:41:39.121542] [INFO ] [REMOTE ] PEO: Fetching primary data for 2024-12. [2025-09-26T20:41:39.348253] [DEBUG] [VALIDATOR ] PEN: All expected trading days are present. [2025-09-26T20:41:39.348488] [DEBUG] [VALIDATOR ] PEN: Primary data validation passed. [2025-09-26T20:41:39.349583] [INFO ] [MAIN ] PEN: Fetched primary data is valid. [2025-09-26T20:41:39.349684] [DEBUG] [LOCAL ] PEN: Saving primary data. [2025-09-26T20:41:39.350980] [DEBUG] [LOCAL ] PEN: Trimmed 44146 records to 30842 (keeping 200 days of data) [2025-09-26T20:41:39.460999] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-26T20:41:39.564971] [DEBUG] [LOCAL ] PEN: Primary data saved (30842 records). [2025-09-26T20:41:39.565120] [INFO ] [MAIN ] PEN: Full history saved. [2025-09-26T20:41:39.565208] [INFO ] [MAIN ] Update Progress: 1660/2371 symbols completed. PEN took 19.7s. Estimated remaining: 1h 34m 55s. Rate: 7.5 symbols/min [2025-09-26T20:41:39.744721] [INFO ] [MAIN ] PFD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:41:39.752200] [DEBUG] [LOCAL ] PFD: Loaded 5163 existing records from primary storage. [2025-09-26T20:41:39.752395] [INFO ] [MAIN ] PFD: Loaded 5163 existing records. [2025-09-26T20:41:39.930387] [INFO ] [REMOTE ] PEW: Fetching primary data for 2024-12. [2025-09-26T20:41:39.945406] [WARN ] [MAIN ] PFD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:41:39.946487] [INFO ] [MAIN ] PFD: Wiping existing primary data before full refresh. [2025-09-26T20:41:39.946557] [INFO ] [LOCAL ] PFD: Starting deletion of primary data. [2025-09-26T20:41:39.946905] [DEBUG] [LOCAL ] PFD: Deleted primary data file. [2025-09-26T20:41:39.946983] [INFO ] [MAIN ] PFD: Starting full primary refresh. [2025-09-26T20:41:40.296581] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:41:40.306289] [WARN ] [REMOTE ] PEW: No data returned for month 2024-12 [2025-09-26T20:41:40.334934] [INFO ] [REMOTE ] PFD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:41:40.344603] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-26T20:41:40.711722] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-01. [2025-09-26T20:41:41.511727] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-01. [2025-09-26T20:41:41.773929] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:41:41.774517] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-26T20:41:41.778152] [WARN ] [REMOTE ] PEW: No data returned for month 2025-01 [2025-09-26T20:41:42.311748] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-02. [2025-09-26T20:41:42.569940] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:41:42.570289] [WARN ] [REMOTE ] PEW: No data returned for month 2025-02 [2025-09-26T20:41:43.111708] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-02. [2025-09-26T20:41:43.911752] [INFO ] [REMOTE ] PFD: Fetching primary data for 2024-12. [2025-09-26T20:41:43.934588] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-26T20:41:44.711724] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-03. [2025-09-26T20:41:44.836733] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-26T20:41:45.014727] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:41:45.015104] [WARN ] [REMOTE ] PEW: No data returned for month 2025-03 [2025-09-26T20:41:45.511749] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-03. [2025-09-26T20:41:46.311697] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-01. [2025-09-26T20:41:46.475586] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-26T20:41:46.963270] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-26T20:41:47.111719] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-04. [2025-09-26T20:41:47.911730] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-03. [2025-09-26T20:41:47.941121] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-26T20:41:48.497325] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-26T20:41:48.711747] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-04. [2025-09-26T20:41:49.511685] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-05. [2025-09-26T20:41:49.662554] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-26T20:41:50.311717] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-05. [2025-09-26T20:41:50.344077] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-26T20:41:51.111718] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-04. [2025-09-26T20:41:51.128150] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-26T20:41:51.364506] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:41:51.364912] [WARN ] [REMOTE ] PEW: No data returned for month 2025-04 [2025-09-26T20:41:51.911731] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-02. [2025-09-26T20:41:52.531745] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-26T20:41:52.711712] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-06. [2025-09-26T20:41:53.511683] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-05. [2025-09-26T20:41:53.792111] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:41:53.792448] [WARN ] [REMOTE ] PEW: No data returned for month 2025-05 [2025-09-26T20:41:53.905190] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-26T20:41:54.311730] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-06. [2025-09-26T20:41:54.573363] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:41:54.573850] [WARN ] [REMOTE ] PEW: No data returned for month 2025-06 [2025-09-26T20:41:55.111718] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-03. [2025-09-26T20:41:55.730906] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-26T20:41:55.911728] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-07. [2025-09-26T20:41:56.711703] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-07. [2025-09-26T20:41:57.517685] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-04. [2025-09-26T20:41:57.523222] [INFO ] [REMOTE ] PEW: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-26T20:41:57.840540] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-26T20:41:57.947455] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-26T20:41:58.311789] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-06. [2025-09-26T20:41:59.111732] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-08. [2025-09-26T20:41:59.133995] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-26T20:41:59.911722] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-07. [2025-09-26T20:42:00.711686] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-05. [2025-09-26T20:42:00.946137] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-26T20:42:01.082606] [INFO ] [REMOTE ] PEW: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-26T20:42:01.367130] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-26T20:42:01.511752] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-08. [2025-09-26T20:42:02.311711] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-09. [2025-09-26T20:42:02.437676] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-26T20:42:03.111727] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-09. [2025-09-26T20:42:03.859228] [INFO ] [REMOTE ] PEW: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-26T20:42:03.866789] [INFO ] [REMOTE ] PEW: Full fetch complete (16250 records). [2025-09-26T20:42:03.866935] [DEBUG] [VALIDATOR ] PEW: Validating primary data. [2025-09-26T20:42:03.919761] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-08. [2025-09-26T20:42:03.987574] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-26T20:42:04.012393] [INFO ] [REMOTE ] PEO: Full fetch complete (16421 records). [2025-09-26T20:42:04.037591] [DEBUG] [VALIDATOR ] PEO: Validating primary data. [2025-09-26T20:42:04.117992] [WARN ] [VALIDATOR ] PEW: Validation failed - insufficient historical data. Have 52 unique days, need 200 days [2025-09-26T20:42:04.145485] [FATAL] [MAIN ] PEW: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:42:04.171901] [WARN ] [MAIN ] PEW: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:42:04.195411] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-09-26T20:42:04.201340] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-09-26T20:42:04.201447] [INFO ] [LOCAL ] PEW: Starting deletion of derivative data. [2025-09-26T20:42:04.211877] [DEBUG] [LOCAL ] PEW: No derivative data file found to delete. [2025-09-26T20:42:04.217167] [INFO ] [MAIN ] Update Progress: 1661/2371 symbols completed. PEW took 26.8s. Estimated remaining: 1h 34m 54s. Rate: 7.5 symbols/min [2025-09-26T20:42:04.635850] [INFO ] [MAIN ] PFE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:42:04.656629] [DEBUG] [LOCAL ] PFE: No existing data file found in primary storage. [2025-09-26T20:42:04.673973] [WARN ] [MAIN ] PFE: No existing data found, performing full refresh instead. [2025-09-26T20:42:04.692916] [INFO ] [MAIN ] PFE: Wiping existing primary data before full refresh. [2025-09-26T20:42:04.694240] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-09-26T20:42:04.694720] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-09-26T20:42:04.695119] [INFO ] [MAIN ] PFE: Starting full primary refresh. [2025-09-26T20:42:04.719675] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-06. [2025-09-26T20:42:04.759434] [DEBUG] [VALIDATOR ] PEO: All expected trading days are present. [2025-09-26T20:42:04.765423] [DEBUG] [VALIDATOR ] PEO: Primary data validation passed. [2025-09-26T20:42:04.795933] [INFO ] [MAIN ] PEO: Fetched primary data is valid. [2025-09-26T20:42:04.814010] [DEBUG] [LOCAL ] PEO: Saving primary data. [2025-09-26T20:42:04.838867] [DEBUG] [LOCAL ] PEO: Trimmed 16421 records to 10999 (keeping 200 days of data) [2025-09-26T20:42:05.147860] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-26T20:42:05.214292] [INFO ] [REMOTE ] PFE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:42:05.226592] [DEBUG] [LOCAL ] PEO: Primary data saved (10999 records). [2025-09-26T20:42:05.226719] [INFO ] [MAIN ] PEO: Full history saved. [2025-09-26T20:42:05.226857] [INFO ] [MAIN ] Update Progress: 1662/2371 symbols completed. PEO took 38.4s. Estimated remaining: 1h 34m 43s. Rate: 7.5 symbols/min [2025-09-26T20:42:05.349049] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-26T20:42:05.422004] [INFO ] [MAIN ] PFGC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:42:05.477326] [DEBUG] [LOCAL ] PFGC: Loaded 47328 existing records from primary storage. [2025-09-26T20:42:05.477542] [INFO ] [MAIN ] PFGC: Loaded 47328 existing records. [2025-09-26T20:42:05.516798] [INFO ] [REMOTE ] PFE: Fetching primary data for 2024-12. [2025-09-26T20:42:05.675571] [WARN ] [MAIN ] PFGC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:42:05.675920] [INFO ] [MAIN ] PFGC: Wiping existing primary data before full refresh. [2025-09-26T20:42:05.675974] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-09-26T20:42:05.677379] [DEBUG] [LOCAL ] PFGC: Deleted primary data file. [2025-09-26T20:42:05.677441] [INFO ] [MAIN ] PFGC: Starting full primary refresh. [2025-09-26T20:42:06.047389] [INFO ] [REMOTE ] PFGC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:42:06.311722] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2024-12. [2025-09-26T20:42:07.111722] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-07. [2025-09-26T20:42:07.911699] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-09. [2025-09-26T20:42:07.964113] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-26T20:42:07.981172] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-26T20:42:08.239779] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2024-12 (2.72 seconds). [2025-09-26T20:42:08.711732] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-08. [2025-09-26T20:42:08.782246] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-26T20:42:08.785524] [INFO ] [REMOTE ] PERF: Full fetch complete (21875 records). [2025-09-26T20:42:08.785669] [DEBUG] [VALIDATOR ] PERF: Validating primary data. [2025-09-26T20:42:09.254206] [DEBUG] [VALIDATOR ] PERF: All expected trading days are present. [2025-09-26T20:42:09.254300] [DEBUG] [VALIDATOR ] PERF: Primary data validation passed. [2025-09-26T20:42:09.254858] [INFO ] [MAIN ] PERF: Fetched primary data is valid. [2025-09-26T20:42:09.254921] [DEBUG] [LOCAL ] PERF: Saving primary data. [2025-09-26T20:42:09.255538] [DEBUG] [LOCAL ] PERF: Trimmed 21875 records to 14231 (keeping 200 days of data) [2025-09-26T20:42:09.345869] [DEBUG] [LOCAL ] PERF: Primary data saved (14231 records). [2025-09-26T20:42:09.346071] [INFO ] [MAIN ] PERF: Full history saved. [2025-09-26T20:42:09.346196] [INFO ] [MAIN ] Update Progress: 1663/2371 symbols completed. PERF took 37.4s. Estimated remaining: 1h 34m 33s. Rate: 7.5 symbols/min [2025-09-26T20:42:09.462485] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-26T20:42:09.514907] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-01. [2025-09-26T20:42:09.542176] [INFO ] [MAIN ] PFH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:42:09.552303] [DEBUG] [LOCAL ] PFH: Loaded 6888 existing records from primary storage. [2025-09-26T20:42:09.552576] [INFO ] [MAIN ] PFH: Loaded 6888 existing records. [2025-09-26T20:42:09.745269] [WARN ] [MAIN ] PFH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:42:09.745527] [INFO ] [MAIN ] PFH: Wiping existing primary data before full refresh. [2025-09-26T20:42:09.745577] [INFO ] [LOCAL ] PFH: Starting deletion of primary data. [2025-09-26T20:42:09.746752] [DEBUG] [LOCAL ] PFH: Deleted primary data file. [2025-09-26T20:42:09.746815] [INFO ] [MAIN ] PFH: Starting full primary refresh. [2025-09-26T20:42:10.112882] [INFO ] [REMOTE ] PFH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:42:10.311731] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-01. [2025-09-26T20:42:11.118940] [INFO ] [REMOTE ] PFH: Fetching primary data for 2024-12. [2025-09-26T20:42:11.126193] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-26T20:42:11.911691] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-02. [2025-09-26T20:42:12.126353] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-26T20:42:12.578041] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-09-26T20:42:12.711726] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-09. [2025-09-26T20:42:13.515305] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-02. [2025-09-26T20:42:13.546353] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T20:42:13.543795] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-26T20:42:13.558780] [INFO ] [REMOTE ] PFD: Full fetch complete (7392 records). [2025-09-26T20:42:13.559221] [DEBUG] [VALIDATOR ] PFD: Validating primary data. [2025-09-26T20:42:13.938146] [DEBUG] [VALIDATOR ] PFD: All expected trading days are present. [2025-09-26T20:42:13.938229] [DEBUG] [VALIDATOR ] PFD: Primary data validation passed. [2025-09-26T20:42:13.938436] [INFO ] [MAIN ] PFD: Fetched primary data is valid. [2025-09-26T20:42:13.938477] [DEBUG] [LOCAL ] PFD: Saving primary data. [2025-09-26T20:42:13.938936] [DEBUG] [LOCAL ] PFD: Trimmed 7392 records to 5199 (keeping 200 days of data) [2025-09-26T20:42:13.972585] [DEBUG] [LOCAL ] PFD: Primary data saved (5199 records). [2025-09-26T20:42:13.972761] [INFO ] [MAIN ] PFD: Full history saved. [2025-09-26T20:42:13.972864] [INFO ] [MAIN ] Update Progress: 1664/2371 symbols completed. PFD took 34.4s. Estimated remaining: 1h 34m 24s. Rate: 7.5 symbols/min [2025-09-26T20:42:14.152025] [INFO ] [MAIN ] PFL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:42:14.168385] [DEBUG] [LOCAL ] PFL: Loaded 13885 existing records from primary storage. [2025-09-26T20:42:14.168584] [INFO ] [MAIN ] PFL: Loaded 13885 existing records. [2025-09-26T20:42:14.316928] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-01. [2025-09-26T20:42:14.359161] [WARN ] [MAIN ] PFL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:42:14.359465] [INFO ] [MAIN ] PFL: Wiping existing primary data before full refresh. [2025-09-26T20:42:14.359515] [INFO ] [LOCAL ] PFL: Starting deletion of primary data. [2025-09-26T20:42:14.360022] [DEBUG] [LOCAL ] PFL: Deleted primary data file. [2025-09-26T20:42:14.360083] [INFO ] [MAIN ] PFL: Starting full primary refresh. [2025-09-26T20:42:14.738023] [INFO ] [REMOTE ] PFL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:42:15.111688] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-03. [2025-09-26T20:42:15.190385] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-26T20:42:15.916888] [INFO ] [REMOTE ] PFL: Fetching primary data for 2024-12. [2025-09-26T20:42:15.930243] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-09-26T20:42:16.715032] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-03. [2025-09-26T20:42:16.722355] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-26T20:42:17.195703] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-26T20:42:17.511739] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-04. [2025-09-26T20:42:18.311712] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-02. [2025-09-26T20:42:19.111700] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-01. [2025-09-26T20:42:19.176940] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-26T20:42:19.225302] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-09-26T20:42:19.242189] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-26T20:42:19.911718] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-04. [2025-09-26T20:42:20.113162] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-26T20:42:20.711707] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-05. [2025-09-26T20:42:21.511737] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-02. [2025-09-26T20:42:22.311711] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-03. [2025-09-26T20:42:22.460976] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-26T20:42:22.460596] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-26T20:42:22.694297] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-04 (2.78 seconds). [2025-09-26T20:42:22.835660] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-26T20:42:23.111745] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-03. [2025-09-26T20:42:23.911727] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-05. [2025-09-26T20:42:24.081788] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-26T20:42:24.711748] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-04. [2025-09-26T20:42:25.511756] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-04. [2025-09-26T20:42:25.795683] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-26T20:42:25.989737] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-26T20:42:26.285989] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-26T20:42:26.311683] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-05. [2025-09-26T20:42:27.111720] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-06. [2025-09-26T20:42:27.139232] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-26T20:42:27.911749] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-06. [2025-09-26T20:42:28.711753] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-05. [2025-09-26T20:42:29.406886] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-09-26T20:42:29.516905] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-07. [2025-09-26T20:42:29.531256] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-26T20:42:29.796278] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-26T20:42:30.311740] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-06. [2025-09-26T20:42:31.111697] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-06. [2025-09-26T20:42:31.157804] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-26T20:42:31.911712] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-07. [2025-09-26T20:42:31.946204] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-26T20:42:32.234478] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-07 (2.72 seconds). [2025-09-26T20:42:32.711711] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-08. [2025-09-26T20:42:33.511699] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-07. [2025-09-26T20:42:33.667505] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-26T20:42:34.311732] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-08. [2025-09-26T20:42:34.416102] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-26T20:42:35.111714] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-07. [2025-09-26T20:42:35.472030] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-08 (2.76 seconds). [2025-09-26T20:42:35.899700] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-26T20:42:35.911662] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-08. [2025-09-26T20:42:35.953904] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-26T20:42:36.554950] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-26T20:42:36.711740] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-09. [2025-09-26T20:42:37.512548] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-08. [2025-09-26T20:42:37.516430] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-26T20:42:37.527478] [INFO ] [REMOTE ] PFE: Full fetch complete (77589 records). [2025-09-26T20:42:37.527715] [DEBUG] [VALIDATOR ] PFE: Validating primary data. [2025-09-26T20:42:37.528621] [FATAL] [VALIDATOR ] PFE: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T20:42:37.528775] [FATAL] [MAIN ] PFE: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:42:37.528842] [WARN ] [MAIN ] PFE: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:42:37.528933] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-09-26T20:42:37.529075] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-09-26T20:42:37.529144] [INFO ] [LOCAL ] PFE: Starting deletion of derivative data. [2025-09-26T20:42:37.529213] [DEBUG] [LOCAL ] PFE: No derivative data file found to delete. [2025-09-26T20:42:37.529297] [INFO ] [MAIN ] Update Progress: 1665/2371 symbols completed. PFE took 33.3s. Estimated remaining: 1h 34m 23s. Rate: 7.5 symbols/min [2025-09-26T20:42:37.722339] [INFO ] [MAIN ] PFLT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:42:37.776730] [DEBUG] [LOCAL ] PFLT: Loaded 43976 existing records from primary storage. [2025-09-26T20:42:37.776936] [INFO ] [MAIN ] PFLT: Loaded 43976 existing records. [2025-09-26T20:42:37.975076] [WARN ] [MAIN ] PFLT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:42:37.975350] [INFO ] [MAIN ] PFLT: Wiping existing primary data before full refresh. [2025-09-26T20:42:37.975399] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-09-26T20:42:37.977139] [DEBUG] [LOCAL ] PFLT: Deleted primary data file. [2025-09-26T20:42:37.977205] [INFO ] [MAIN ] PFLT: Starting full primary refresh. [2025-09-26T20:42:38.321298] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-09. [2025-09-26T20:42:38.365556] [INFO ] [REMOTE ] PFLT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:42:38.650786] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-26T20:42:39.111715] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-09. [2025-09-26T20:42:39.138012] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-26T20:42:39.139559] [INFO ] [REMOTE ] PFH: Full fetch complete (10633 records). [2025-09-26T20:42:39.139636] [DEBUG] [VALIDATOR ] PFH: Validating primary data. [2025-09-26T20:42:39.528255] [DEBUG] [VALIDATOR ] PFH: All expected trading days are present. [2025-09-26T20:42:39.528341] [DEBUG] [VALIDATOR ] PFH: Primary data validation passed. [2025-09-26T20:42:39.528619] [INFO ] [MAIN ] PFH: Fetched primary data is valid. [2025-09-26T20:42:39.528721] [DEBUG] [LOCAL ] PFH: Saving primary data. [2025-09-26T20:42:39.529767] [DEBUG] [LOCAL ] PFH: Trimmed 10633 records to 6911 (keeping 200 days of data) [2025-09-26T20:42:39.577330] [DEBUG] [LOCAL ] PFH: Primary data saved (6911 records). [2025-09-26T20:42:39.577526] [INFO ] [MAIN ] PFH: Full history saved. [2025-09-26T20:42:39.577676] [INFO ] [MAIN ] Update Progress: 1666/2371 symbols completed. PFH took 30.2s. Estimated remaining: 1h 34m 12s. Rate: 7.5 symbols/min [2025-09-26T20:42:39.752078] [INFO ] [MAIN ] PFN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:42:39.775319] [DEBUG] [LOCAL ] PFN: Loaded 21856 existing records from primary storage. [2025-09-26T20:42:39.775499] [INFO ] [MAIN ] PFN: Loaded 21856 existing records. [2025-09-26T20:42:39.917794] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2024-12. [2025-09-26T20:42:39.962964] [WARN ] [MAIN ] PFN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:42:39.963321] [INFO ] [MAIN ] PFN: Wiping existing primary data before full refresh. [2025-09-26T20:42:39.963374] [INFO ] [LOCAL ] PFN: Starting deletion of primary data. [2025-09-26T20:42:39.964391] [DEBUG] [LOCAL ] PFN: Deleted primary data file. [2025-09-26T20:42:39.964464] [INFO ] [MAIN ] PFN: Starting full primary refresh. [2025-09-26T20:42:40.330282] [INFO ] [REMOTE ] PFN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:42:40.711722] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-09. [2025-09-26T20:42:40.883793] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-26T20:42:40.894547] [INFO ] [REMOTE ] PFGC: Full fetch complete (67266 records). [2025-09-26T20:42:40.894779] [DEBUG] [VALIDATOR ] PFGC: Validating primary data. [2025-09-26T20:42:41.321903] [DEBUG] [VALIDATOR ] PFGC: All expected trading days are present. [2025-09-26T20:42:41.321990] [DEBUG] [VALIDATOR ] PFGC: Primary data validation passed. [2025-09-26T20:42:41.322993] [INFO ] [MAIN ] PFGC: Fetched primary data is valid. [2025-09-26T20:42:41.323058] [DEBUG] [LOCAL ] PFGC: Saving primary data. [2025-09-26T20:42:41.324476] [DEBUG] [LOCAL ] PFGC: Trimmed 67266 records to 47650 (keeping 200 days of data) [2025-09-26T20:42:41.514893] [INFO ] [REMOTE ] PFN: Fetching primary data for 2024-12. [2025-09-26T20:42:41.667197] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-26T20:42:41.692090] [DEBUG] [LOCAL ] PFGC: Primary data saved (47650 records). [2025-09-26T20:42:41.692264] [INFO ] [MAIN ] PFGC: Full history saved. [2025-09-26T20:42:41.692367] [INFO ] [MAIN ] Update Progress: 1667/2371 symbols completed. PFGC took 36.5s. Estimated remaining: 1h 34m 2s. Rate: 7.5 symbols/min [2025-09-26T20:42:41.816900] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-26T20:42:41.821623] [INFO ] [REMOTE ] PFL: Full fetch complete (20101 records). [2025-09-26T20:42:41.821762] [DEBUG] [VALIDATOR ] PFL: Validating primary data. [2025-09-26T20:42:41.999914] [INFO ] [MAIN ] PFO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:42:42.084134] [DEBUG] [LOCAL ] PFO: Loaded 5922 existing records from primary storage. [2025-09-26T20:42:42.092774] [INFO ] [MAIN ] PFO: Loaded 5922 existing records. [2025-09-26T20:42:42.313748] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-01. [2025-09-26T20:42:42.492507] [WARN ] [MAIN ] PFO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:42:42.500601] [INFO ] [MAIN ] PFO: Wiping existing primary data before full refresh. [2025-09-26T20:42:42.502049] [INFO ] [LOCAL ] PFO: Starting deletion of primary data. [2025-09-26T20:42:42.517951] [DEBUG] [LOCAL ] PFO: Deleted primary data file. [2025-09-26T20:42:42.529070] [DEBUG] [VALIDATOR ] PFL: All expected trading days are present. [2025-09-26T20:42:42.529185] [INFO ] [MAIN ] PFO: Starting full primary refresh. [2025-09-26T20:42:42.529319] [DEBUG] [VALIDATOR ] PFL: Primary data validation passed. [2025-09-26T20:42:42.535050] [INFO ] [MAIN ] PFL: Fetched primary data is valid. [2025-09-26T20:42:42.535133] [DEBUG] [LOCAL ] PFL: Saving primary data. [2025-09-26T20:42:42.611895] [DEBUG] [LOCAL ] PFL: Trimmed 20101 records to 13959 (keeping 200 days of data) [2025-09-26T20:42:42.980589] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-26T20:42:43.019139] [INFO ] [REMOTE ] PFO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:42:43.037489] [DEBUG] [LOCAL ] PFL: Primary data saved (13959 records). [2025-09-26T20:42:43.037697] [INFO ] [MAIN ] PFL: Full history saved. [2025-09-26T20:42:43.037854] [INFO ] [MAIN ] Update Progress: 1668/2371 symbols completed. PFL took 29.1s. Estimated remaining: 1h 33m 51s. Rate: 7.5 symbols/min [2025-09-26T20:42:43.116781] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-01. [2025-09-26T20:42:43.217786] [INFO ] [MAIN ] PFS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:42:43.255666] [DEBUG] [LOCAL ] PFS: Loaded 35929 existing records from primary storage. [2025-09-26T20:42:43.255819] [INFO ] [MAIN ] PFS: Loaded 35929 existing records. [2025-09-26T20:42:43.438633] [WARN ] [MAIN ] PFS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:42:43.438908] [INFO ] [MAIN ] PFS: Wiping existing primary data before full refresh. [2025-09-26T20:42:43.438959] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-09-26T20:42:43.440023] [DEBUG] [LOCAL ] PFS: Deleted primary data file. [2025-09-26T20:42:43.440085] [INFO ] [MAIN ] PFS: Starting full primary refresh. [2025-09-26T20:42:43.815239] [INFO ] [REMOTE ] PFS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:42:43.911705] [INFO ] [REMOTE ] PFS: Fetching primary data for 2024-12. [2025-09-26T20:42:44.124896] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-26T20:42:44.228760] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-26T20:42:44.711751] [INFO ] [REMOTE ] PFO: Fetching primary data for 2024-12. [2025-09-26T20:42:45.511730] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-02. [2025-09-26T20:42:45.633592] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-26T20:42:45.651381] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-26T20:42:46.311718] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-02. [2025-09-26T20:42:47.111698] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-01. [2025-09-26T20:42:47.185411] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-26T20:42:47.352142] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-26T20:42:47.911743] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-03. [2025-09-26T20:42:48.394161] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-26T20:42:48.711725] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-01. [2025-09-26T20:42:48.969282] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-26T20:42:49.366471] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-26T20:42:49.511728] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-02. [2025-09-26T20:42:50.311712] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-03. [2025-09-26T20:42:50.900691] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-26T20:42:51.111758] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-02. [2025-09-26T20:42:51.911754] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-03. [2025-09-26T20:42:51.925077] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-26T20:42:52.033209] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-26T20:42:52.711733] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-04. [2025-09-26T20:42:53.106492] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-26T20:42:53.511745] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-04. [2025-09-26T20:42:54.311728] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-04. [2025-09-26T20:42:54.581550] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-26T20:42:55.111737] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-03. [2025-09-26T20:42:55.217453] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-26T20:42:55.558208] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-26T20:42:55.714085] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-26T20:42:55.911729] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-05. [2025-09-26T20:42:56.711743] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-04. [2025-09-26T20:42:57.041320] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-26T20:42:57.334088] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-26T20:42:57.511743] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-05. [2025-09-26T20:42:58.261684] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-26T20:42:58.311718] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-06. [2025-09-26T20:42:58.910578] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-26T20:42:59.111729] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-07. [2025-09-26T20:42:59.847592] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-26T20:42:59.911716] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-08. [2025-09-26T20:43:00.711713] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-06. [2025-09-26T20:43:00.796512] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-26T20:43:01.511719] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-05. [2025-09-26T20:43:01.771481] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-26T20:43:02.311715] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-09. [2025-09-26T20:43:02.949601] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-26T20:43:03.111730] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-07. [2025-09-26T20:43:03.139522] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-26T20:43:03.142429] [INFO ] [REMOTE ] PFO: Full fetch complete (7871 records). [2025-09-26T20:43:03.142584] [DEBUG] [VALIDATOR ] PFO: Validating primary data. [2025-09-26T20:43:03.541019] [DEBUG] [VALIDATOR ] PFO: All expected trading days are present. [2025-09-26T20:43:03.541103] [DEBUG] [VALIDATOR ] PFO: Primary data validation passed. [2025-09-26T20:43:03.541348] [INFO ] [MAIN ] PFO: Fetched primary data is valid. [2025-09-26T20:43:03.541445] [DEBUG] [LOCAL ] PFO: Saving primary data. [2025-09-26T20:43:03.542038] [DEBUG] [LOCAL ] PFO: Trimmed 7871 records to 5948 (keeping 200 days of data) [2025-09-26T20:43:03.584573] [DEBUG] [LOCAL ] PFO: Primary data saved (5948 records). [2025-09-26T20:43:03.584745] [INFO ] [MAIN ] PFO: Full history saved. [2025-09-26T20:43:03.584995] [INFO ] [MAIN ] Update Progress: 1669/2371 symbols completed. PFO took 21.9s. Estimated remaining: 1h 33m 48s. Rate: 7.5 symbols/min [2025-09-26T20:43:03.764599] [INFO ] [MAIN ] PFSI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:43:03.814083] [DEBUG] [LOCAL ] PFSI: Loaded 29071 existing records from primary storage. [2025-09-26T20:43:03.814252] [INFO ] [MAIN ] PFSI: Loaded 29071 existing records. [2025-09-26T20:43:03.918609] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-06. [2025-09-26T20:43:04.007900] [WARN ] [MAIN ] PFSI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:43:04.008265] [INFO ] [MAIN ] PFSI: Wiping existing primary data before full refresh. [2025-09-26T20:43:04.008333] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-09-26T20:43:04.009398] [DEBUG] [LOCAL ] PFSI: Deleted primary data file. [2025-09-26T20:43:04.009474] [INFO ] [MAIN ] PFSI: Starting full primary refresh. [2025-09-26T20:43:04.395473] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-26T20:43:04.424203] [INFO ] [REMOTE ] PFSI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:43:04.711705] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-05. [2025-09-26T20:43:05.424181] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-26T20:43:05.511726] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2024-12. [2025-09-26T20:43:06.315713] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-08. [2025-09-26T20:43:06.321571] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-26T20:43:06.762898] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-26T20:43:07.111729] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-01. [2025-09-26T20:43:07.443463] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-26T20:43:07.911716] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-07. [2025-09-26T20:43:08.029969] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-26T20:43:08.711724] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-06. [2025-09-26T20:43:09.402708] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-26T20:43:09.511721] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-08. [2025-09-26T20:43:10.319507] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-09. [2025-09-26T20:43:10.344178] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-26T20:43:10.849262] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-26T20:43:11.111736] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-02. [2025-09-26T20:43:11.222049] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-26T20:43:11.226922] [INFO ] [REMOTE ] PFN: Full fetch complete (30737 records). [2025-09-26T20:43:11.227024] [DEBUG] [VALIDATOR ] PFN: Validating primary data. [2025-09-26T20:43:11.689456] [DEBUG] [VALIDATOR ] PFN: All expected trading days are present. [2025-09-26T20:43:11.689564] [DEBUG] [VALIDATOR ] PFN: Primary data validation passed. [2025-09-26T20:43:11.690354] [INFO ] [MAIN ] PFN: Fetched primary data is valid. [2025-09-26T20:43:11.690420] [DEBUG] [LOCAL ] PFN: Saving primary data. [2025-09-26T20:43:11.691498] [DEBUG] [LOCAL ] PFN: Trimmed 30737 records to 21992 (keeping 200 days of data) [2025-09-26T20:43:11.843585] [DEBUG] [LOCAL ] PFN: Primary data saved (21992 records). [2025-09-26T20:43:11.843769] [INFO ] [MAIN ] PFN: Full history saved. [2025-09-26T20:43:11.843902] [INFO ] [MAIN ] Update Progress: 1670/2371 symbols completed. PFN took 32.3s. Estimated remaining: 1h 33m 40s. Rate: 7.5 symbols/min [2025-09-26T20:43:11.916791] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-07. [2025-09-26T20:43:12.027736] [INFO ] [MAIN ] PG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:43:12.027945] [DEBUG] [LOCAL ] PG: No existing data file found in primary storage. [2025-09-26T20:43:12.028013] [WARN ] [MAIN ] PG: No existing data found, performing full refresh instead. [2025-09-26T20:43:12.028202] [INFO ] [MAIN ] PG: Wiping existing primary data before full refresh. [2025-09-26T20:43:12.028246] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-09-26T20:43:12.028289] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-09-26T20:43:12.028359] [INFO ] [MAIN ] PG: Starting full primary refresh. [2025-09-26T20:43:12.415717] [INFO ] [REMOTE ] PG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:43:12.433263] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-26T20:43:12.711733] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-03. [2025-09-26T20:43:13.516822] [INFO ] [REMOTE ] PG: Fetching primary data for 2024-12. [2025-09-26T20:43:13.531261] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-26T20:43:13.982169] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-26T20:43:14.104691] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-26T20:43:14.311740] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-04. [2025-09-26T20:43:15.111732] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-09. [2025-09-26T20:43:15.730774] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-26T20:43:15.911723] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-01. [2025-09-26T20:43:16.441374] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-26T20:43:16.449537] [INFO ] [REMOTE ] PFS: Full fetch complete (51637 records). [2025-09-26T20:43:16.449757] [DEBUG] [VALIDATOR ] PFS: Validating primary data. [2025-09-26T20:43:16.736626] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-05. [2025-09-26T20:43:16.920503] [DEBUG] [VALIDATOR ] PFS: All expected trading days are present. [2025-09-26T20:43:16.920612] [DEBUG] [VALIDATOR ] PFS: Primary data validation passed. [2025-09-26T20:43:16.921837] [INFO ] [MAIN ] PFS: Fetched primary data is valid. [2025-09-26T20:43:16.921931] [DEBUG] [LOCAL ] PFS: Saving primary data. [2025-09-26T20:43:16.923343] [DEBUG] [LOCAL ] PFS: Trimmed 51637 records to 36188 (keeping 200 days of data) [2025-09-26T20:43:17.049808] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-26T20:43:17.198193] [DEBUG] [LOCAL ] PFS: Primary data saved (36188 records). [2025-09-26T20:43:17.198344] [INFO ] [MAIN ] PFS: Full history saved. [2025-09-26T20:43:17.198449] [INFO ] [MAIN ] Update Progress: 1671/2371 symbols completed. PFS took 34.2s. Estimated remaining: 1h 33m 31s. Rate: 7.5 symbols/min [2025-09-26T20:43:17.385855] [INFO ] [MAIN ] PGP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:43:17.393145] [DEBUG] [LOCAL ] PGP: Loaded 5491 existing records from primary storage. [2025-09-26T20:43:17.393271] [INFO ] [MAIN ] PGP: Loaded 5491 existing records. [2025-09-26T20:43:17.516860] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-02. [2025-09-26T20:43:17.595261] [WARN ] [MAIN ] PGP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:43:17.595690] [INFO ] [MAIN ] PGP: Wiping existing primary data before full refresh. [2025-09-26T20:43:17.595784] [INFO ] [LOCAL ] PGP: Starting deletion of primary data. [2025-09-26T20:43:17.596180] [DEBUG] [LOCAL ] PGP: Deleted primary data file. [2025-09-26T20:43:17.596247] [INFO ] [MAIN ] PGP: Starting full primary refresh. [2025-09-26T20:43:18.016139] [INFO ] [REMOTE ] PGP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:43:18.050755] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-26T20:43:18.311721] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-06. [2025-09-26T20:43:18.517926] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-26T20:43:19.111687] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-08. [2025-09-26T20:43:19.186893] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-26T20:43:19.911741] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-07. [2025-09-26T20:43:20.711720] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-03. [2025-09-26T20:43:20.797714] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-26T20:43:21.403836] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-26T20:43:21.514026] [INFO ] [REMOTE ] PGP: Fetching primary data for 2024-12. [2025-09-26T20:43:21.520606] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-26T20:43:22.311737] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-09. [2025-09-26T20:43:22.429980] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-26T20:43:23.111749] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-08. [2025-09-26T20:43:23.911728] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-01. [2025-09-26T20:43:23.979618] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-26T20:43:23.988631] [INFO ] [REMOTE ] PFLT: Full fetch complete (63489 records). [2025-09-26T20:43:23.988854] [DEBUG] [VALIDATOR ] PFLT: Validating primary data. [2025-09-26T20:43:24.432132] [DEBUG] [VALIDATOR ] PFLT: All expected trading days are present. [2025-09-26T20:43:24.433466] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-26T20:43:24.433698] [DEBUG] [VALIDATOR ] PFLT: Primary data validation passed. [2025-09-26T20:43:24.440928] [INFO ] [MAIN ] PFLT: Fetched primary data is valid. [2025-09-26T20:43:24.441534] [DEBUG] [LOCAL ] PFLT: Saving primary data. [2025-09-26T20:43:24.443271] [DEBUG] [LOCAL ] PFLT: Trimmed 63489 records to 44333 (keeping 200 days of data) [2025-09-26T20:43:24.559156] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-26T20:43:24.711829] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-09. [2025-09-26T20:43:24.766410] [DEBUG] [LOCAL ] PFLT: Primary data saved (44333 records). [2025-09-26T20:43:24.766555] [INFO ] [MAIN ] PFLT: Full history saved. [2025-09-26T20:43:24.766684] [INFO ] [MAIN ] Update Progress: 1672/2371 symbols completed. PFLT took 47.2s. Estimated remaining: 1h 33m 23s. Rate: 7.5 symbols/min [2025-09-26T20:43:24.945178] [INFO ] [MAIN ] PGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:43:24.945408] [DEBUG] [LOCAL ] PGR: No existing data file found in primary storage. [2025-09-26T20:43:24.945467] [WARN ] [MAIN ] PGR: No existing data found, performing full refresh instead. [2025-09-26T20:43:24.945618] [INFO ] [MAIN ] PGR: Wiping existing primary data before full refresh. [2025-09-26T20:43:24.945692] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-09-26T20:43:24.945751] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-09-26T20:43:24.945786] [INFO ] [MAIN ] PGR: Starting full primary refresh. [2025-09-26T20:43:25.317608] [INFO ] [REMOTE ] PGR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:43:25.511729] [INFO ] [REMOTE ] PGR: Fetching primary data for 2024-12. [2025-09-26T20:43:26.163694] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-26T20:43:26.170283] [INFO ] [REMOTE ] PFSI: Full fetch complete (40759 records). [2025-09-26T20:43:26.170402] [DEBUG] [VALIDATOR ] PFSI: Validating primary data. [2025-09-26T20:43:26.316799] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-02. [2025-09-26T20:43:26.566820] [DEBUG] [VALIDATOR ] PFSI: All expected trading days are present. [2025-09-26T20:43:26.566937] [DEBUG] [VALIDATOR ] PFSI: Primary data validation passed. [2025-09-26T20:43:26.567786] [INFO ] [MAIN ] PFSI: Fetched primary data is valid. [2025-09-26T20:43:26.567892] [DEBUG] [LOCAL ] PFSI: Saving primary data. [2025-09-26T20:43:26.569248] [DEBUG] [LOCAL ] PFSI: Trimmed 40759 records to 29259 (keeping 200 days of data) [2025-09-26T20:43:26.768971] [DEBUG] [LOCAL ] PFSI: Primary data saved (29259 records). [2025-09-26T20:43:26.769115] [INFO ] [MAIN ] PFSI: Full history saved. [2025-09-26T20:43:26.769203] [INFO ] [MAIN ] Update Progress: 1673/2371 symbols completed. PFSI took 23.2s. Estimated remaining: 1h 33m 12s. Rate: 7.5 symbols/min [2025-09-26T20:43:26.950261] [INFO ] [MAIN ] PGRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:43:26.997502] [DEBUG] [LOCAL ] PGRE: Loaded 46830 existing records from primary storage. [2025-09-26T20:43:26.997694] [INFO ] [MAIN ] PGRE: Loaded 46830 existing records. [2025-09-26T20:43:27.115869] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-04. [2025-09-26T20:43:27.124966] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-26T20:43:27.225053] [WARN ] [MAIN ] PGRE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:43:27.225511] [INFO ] [MAIN ] PGRE: Wiping existing primary data before full refresh. [2025-09-26T20:43:27.225637] [INFO ] [LOCAL ] PGRE: Starting deletion of primary data. [2025-09-26T20:43:27.226704] [DEBUG] [LOCAL ] PGRE: Deleted primary data file. [2025-09-26T20:43:27.226767] [INFO ] [MAIN ] PGRE: Starting full primary refresh. [2025-09-26T20:43:27.609713] [INFO ] [REMOTE ] PGRE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:43:27.644196] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-26T20:43:27.911724] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-03. [2025-09-26T20:43:28.041108] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-26T20:43:28.616526] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-26T20:43:28.711724] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-04. [2025-09-26T20:43:29.459006] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-26T20:43:29.511730] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-01. [2025-09-26T20:43:30.311736] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-05. [2025-09-26T20:43:31.111689] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2024-12. [2025-09-26T20:43:31.220955] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-26T20:43:31.552530] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-26T20:43:31.911728] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-05. [2025-09-26T20:43:32.547718] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-26T20:43:32.564454] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-26T20:43:32.711710] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-02. [2025-09-26T20:43:33.511718] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-06. [2025-09-26T20:43:34.311690] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-06. [2025-09-26T20:43:34.373353] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-26T20:43:34.582895] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-26T20:43:35.058441] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-26T20:43:35.111744] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-07. [2025-09-26T20:43:35.863877] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-26T20:43:35.911731] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-08. [2025-09-26T20:43:36.711695] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-01. [2025-09-26T20:43:36.847371] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-26T20:43:37.511724] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-03. [2025-09-26T20:43:38.307393] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-26T20:43:38.318975] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-09. [2025-09-26T20:43:39.049421] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-26T20:43:39.051430] [INFO ] [REMOTE ] PGP: Full fetch complete (7805 records). [2025-09-26T20:43:39.051507] [DEBUG] [VALIDATOR ] PGP: Validating primary data. [2025-09-26T20:43:39.122229] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-07. [2025-09-26T20:43:39.462474] [DEBUG] [VALIDATOR ] PGP: All expected trading days are present. [2025-09-26T20:43:39.462600] [DEBUG] [VALIDATOR ] PGP: Primary data validation passed. [2025-09-26T20:43:39.462930] [INFO ] [MAIN ] PGP: Fetched primary data is valid. [2025-09-26T20:43:39.463004] [DEBUG] [LOCAL ] PGP: Saving primary data. [2025-09-26T20:43:39.463741] [DEBUG] [LOCAL ] PGP: Trimmed 7805 records to 5515 (keeping 200 days of data) [2025-09-26T20:43:39.523062] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-26T20:43:39.539286] [DEBUG] [LOCAL ] PGP: Primary data saved (5515 records). [2025-09-26T20:43:39.539395] [INFO ] [MAIN ] PGP: Full history saved. [2025-09-26T20:43:39.539475] [INFO ] [MAIN ] Update Progress: 1674/2371 symbols completed. PGP took 22.3s. Estimated remaining: 1h 33m 6s. Rate: 7.5 symbols/min [2025-09-26T20:43:39.717567] [INFO ] [MAIN ] PGZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:43:39.724909] [DEBUG] [LOCAL ] PGZ: Loaded 5409 existing records from primary storage. [2025-09-26T20:43:39.725019] [INFO ] [MAIN ] PGZ: Loaded 5409 existing records. [2025-09-26T20:43:39.913767] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-02. [2025-09-26T20:43:39.954514] [WARN ] [MAIN ] PGZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:43:39.956057] [INFO ] [MAIN ] PGZ: Wiping existing primary data before full refresh. [2025-09-26T20:43:39.956137] [INFO ] [LOCAL ] PGZ: Starting deletion of primary data. [2025-09-26T20:43:39.956521] [DEBUG] [LOCAL ] PGZ: Deleted primary data file. [2025-09-26T20:43:39.956602] [INFO ] [MAIN ] PGZ: Starting full primary refresh. [2025-09-26T20:43:40.377854] [INFO ] [REMOTE ] PGZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:43:40.429327] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-26T20:43:40.711701] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-08. [2025-09-26T20:43:40.947802] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-26T20:43:41.211095] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-26T20:43:41.511727] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2024-12. [2025-09-26T20:43:42.261793] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-26T20:43:42.311703] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-01. [2025-09-26T20:43:43.111707] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-03. [2025-09-26T20:43:43.178427] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-26T20:43:43.911726] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-04. [2025-09-26T20:43:44.685715] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-26T20:43:44.711677] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-09. [2025-09-26T20:43:45.511711] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-04. [2025-09-26T20:43:45.638949] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-26T20:43:45.651751] [INFO ] [REMOTE ] PG: Full fetch complete (77395 records). [2025-09-26T20:43:45.651930] [DEBUG] [VALIDATOR ] PG: Validating primary data. [2025-09-26T20:43:45.652879] [FATAL] [VALIDATOR ] PG: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T20:43:45.652979] [FATAL] [MAIN ] PG: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:43:45.653025] [WARN ] [MAIN ] PG: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:43:45.653105] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-09-26T20:43:45.653175] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-09-26T20:43:45.653214] [INFO ] [LOCAL ] PG: Starting deletion of derivative data. [2025-09-26T20:43:45.653263] [DEBUG] [LOCAL ] PG: No derivative data file found to delete. [2025-09-26T20:43:45.653329] [INFO ] [MAIN ] Update Progress: 1675/2371 symbols completed. PG took 33.8s. Estimated remaining: 1h 32m 57s. Rate: 7.5 symbols/min [2025-09-26T20:43:45.864423] [INFO ] [MAIN ] PH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:43:45.917333] [DEBUG] [LOCAL ] PH: Loaded 39003 existing records from primary storage. [2025-09-26T20:43:45.917474] [INFO ] [MAIN ] PH: Loaded 39003 existing records. [2025-09-26T20:43:46.135953] [WARN ] [MAIN ] PH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:43:46.136278] [INFO ] [MAIN ] PH: Wiping existing primary data before full refresh. [2025-09-26T20:43:46.136402] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-09-26T20:43:46.137687] [DEBUG] [LOCAL ] PH: Deleted primary data file. [2025-09-26T20:43:46.137752] [INFO ] [MAIN ] PH: Starting full primary refresh. [2025-09-26T20:43:46.317816] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-02. [2025-09-26T20:43:46.549397] [INFO ] [REMOTE ] PH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:43:46.582056] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-09-26T20:43:47.107313] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-26T20:43:47.111666] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-05. [2025-09-26T20:43:47.184481] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-26T20:43:47.911736] [INFO ] [REMOTE ] PH: Fetching primary data for 2024-12. [2025-09-26T20:43:48.711680] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-05. [2025-09-26T20:43:48.977361] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-26T20:43:49.450103] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-26T20:43:49.511707] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-03. [2025-09-26T20:43:50.165137] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-26T20:43:50.301706] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-26T20:43:50.311688] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-06. [2025-09-26T20:43:51.111718] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-06. [2025-09-26T20:43:51.911758] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-04. [2025-09-26T20:43:52.470504] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-26T20:43:52.552827] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-26T20:43:52.620192] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-26T20:43:52.711704] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-05. [2025-09-26T20:43:53.350786] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-26T20:43:53.511730] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-06. [2025-09-26T20:43:54.191377] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-26T20:43:54.311723] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-07. [2025-09-26T20:43:55.111712] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-07. [2025-09-26T20:43:55.829393] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-26T20:43:55.903111] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-26T20:43:55.913199] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-01. [2025-09-26T20:43:56.711721] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-08. [2025-09-26T20:43:57.511700] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-08. [2025-09-26T20:43:57.598872] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-26T20:43:58.257399] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-26T20:43:58.311716] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-02. [2025-09-26T20:43:58.492752] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-26T20:43:59.111726] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-07. [2025-09-26T20:43:59.911729] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-09. [2025-09-26T20:44:00.215523] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-26T20:44:00.620177] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-26T20:44:00.621906] [INFO ] [REMOTE ] PGZ: Full fetch complete (8971 records). [2025-09-26T20:44:00.621980] [DEBUG] [VALIDATOR ] PGZ: Validating primary data. [2025-09-26T20:44:00.721532] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-03. [2025-09-26T20:44:01.025900] [DEBUG] [VALIDATOR ] PGZ: All expected trading days are present. [2025-09-26T20:44:01.026080] [DEBUG] [VALIDATOR ] PGZ: Primary data validation passed. [2025-09-26T20:44:01.026425] [INFO ] [MAIN ] PGZ: Fetched primary data is valid. [2025-09-26T20:44:01.026565] [DEBUG] [LOCAL ] PGZ: Saving primary data. [2025-09-26T20:44:01.027464] [DEBUG] [LOCAL ] PGZ: Trimmed 8971 records to 5440 (keeping 200 days of data) [2025-09-26T20:44:01.062391] [DEBUG] [LOCAL ] PGZ: Primary data saved (5440 records). [2025-09-26T20:44:01.062566] [INFO ] [MAIN ] PGZ: Full history saved. [2025-09-26T20:44:01.062857] [INFO ] [MAIN ] Update Progress: 1676/2371 symbols completed. PGZ took 21.5s. Estimated remaining: 1h 32m 52s. Rate: 7.5 symbols/min [2025-09-26T20:44:01.286821] [INFO ] [MAIN ] PHD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:44:01.289513] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-26T20:44:01.312361] [DEBUG] [LOCAL ] PHD: Loaded 9913 existing records from primary storage. [2025-09-26T20:44:01.312496] [INFO ] [MAIN ] PHD: Loaded 9913 existing records. [2025-09-26T20:44:01.500308] [WARN ] [MAIN ] PHD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:44:01.500612] [INFO ] [MAIN ] PHD: Wiping existing primary data before full refresh. [2025-09-26T20:44:01.500692] [INFO ] [LOCAL ] PHD: Starting deletion of primary data. [2025-09-26T20:44:01.501096] [DEBUG] [LOCAL ] PHD: Deleted primary data file. [2025-09-26T20:44:01.501155] [INFO ] [MAIN ] PHD: Starting full primary refresh. [2025-09-26T20:44:01.516858] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-08. [2025-09-26T20:44:01.899378] [INFO ] [REMOTE ] PHD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:44:02.311710] [INFO ] [REMOTE ] PHD: Fetching primary data for 2024-12. [2025-09-26T20:44:02.361951] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-26T20:44:03.111730] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-04. [2025-09-26T20:44:03.350485] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-26T20:44:03.600539] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-26T20:44:03.911786] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-09. [2025-09-26T20:44:04.711698] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-01. [2025-09-26T20:44:04.824933] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-26T20:44:05.511685] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-09. [2025-09-26T20:44:05.609407] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-26T20:44:05.609768] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-26T20:44:05.623176] [INFO ] [REMOTE ] PGRE: Full fetch complete (63643 records). [2025-09-26T20:44:05.623365] [DEBUG] [VALIDATOR ] PGRE: Validating primary data. [2025-09-26T20:44:06.033901] [DEBUG] [VALIDATOR ] PGRE: All expected trading days are present. [2025-09-26T20:44:06.034004] [DEBUG] [VALIDATOR ] PGRE: Primary data validation passed. [2025-09-26T20:44:06.035051] [INFO ] [MAIN ] PGRE: Fetched primary data is valid. [2025-09-26T20:44:06.035124] [DEBUG] [LOCAL ] PGRE: Saving primary data. [2025-09-26T20:44:06.036605] [DEBUG] [LOCAL ] PGRE: Trimmed 63643 records to 47177 (keeping 200 days of data) [2025-09-26T20:44:06.315813] [DEBUG] [LOCAL ] PGRE: Primary data saved (47177 records). [2025-09-26T20:44:06.316399] [INFO ] [MAIN ] PGRE: Full history saved. [2025-09-26T20:44:06.315989] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-05. [2025-09-26T20:44:06.316629] [INFO ] [MAIN ] Update Progress: 1677/2371 symbols completed. PGRE took 39.5s. Estimated remaining: 1h 32m 43s. Rate: 7.5 symbols/min [2025-09-26T20:44:06.359494] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-26T20:44:06.370254] [INFO ] [REMOTE ] PGR: Full fetch complete (76223 records). [2025-09-26T20:44:06.370448] [DEBUG] [VALIDATOR ] PGR: Validating primary data. [2025-09-26T20:44:06.371373] [FATAL] [VALIDATOR ] PGR: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T20:44:06.371486] [FATAL] [MAIN ] PGR: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:44:06.371534] [WARN ] [MAIN ] PGR: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:44:06.371588] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-09-26T20:44:06.371715] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-09-26T20:44:06.371775] [INFO ] [LOCAL ] PGR: Starting deletion of derivative data. [2025-09-26T20:44:06.371845] [DEBUG] [LOCAL ] PGR: No derivative data file found to delete. [2025-09-26T20:44:06.371934] [INFO ] [MAIN ] Update Progress: 1678/2371 symbols completed. PGR took 41.6s. Estimated remaining: 1h 32m 32s. Rate: 7.5 symbols/min [2025-09-26T20:44:07.111730] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-02. [2025-09-26T20:44:07.884695] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-26T20:44:07.911679] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-03. [2025-09-26T20:44:08.054928] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-26T20:44:08.467024] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-26T20:44:08.711719] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-06. [2025-09-26T20:44:09.511724] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-04. [2025-09-26T20:44:10.186514] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-26T20:44:10.311724] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-07. [2025-09-26T20:44:10.352772] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-26T20:44:11.111745] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-05. [2025-09-26T20:44:11.737816] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-26T20:44:11.906090] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-26T20:44:11.911678] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-08. [2025-09-26T20:44:12.711733] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-06. [2025-09-26T20:44:13.484879] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-26T20:44:13.511744] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-07. [2025-09-26T20:44:13.635936] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-26T20:44:14.311769] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-09. [2025-09-26T20:44:14.369383] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-26T20:44:15.111735] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-08. [2025-09-26T20:44:15.228882] [DEBUG] [REMOTE ] PHD: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-09-26T20:44:15.229224] [WARN ] [REMOTE ] PHD: No data returned for month 2025-08 [2025-09-26T20:44:15.724367] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-26T20:44:15.730992] [INFO ] [REMOTE ] PH: Full fetch complete (56603 records). [2025-09-26T20:44:15.731123] [DEBUG] [VALIDATOR ] PH: Validating primary data. [2025-09-26T20:44:15.916807] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-09. [2025-09-26T20:44:16.143602] [DEBUG] [VALIDATOR ] PH: All expected trading days are present. [2025-09-26T20:44:16.143733] [DEBUG] [VALIDATOR ] PH: Primary data validation passed. [2025-09-26T20:44:16.144603] [INFO ] [MAIN ] PH: Fetched primary data is valid. [2025-09-26T20:44:16.144678] [DEBUG] [LOCAL ] PH: Saving primary data. [2025-09-26T20:44:16.146152] [DEBUG] [LOCAL ] PH: Trimmed 56603 records to 39166 (keeping 200 days of data) [2025-09-26T20:44:16.405704] [DEBUG] [LOCAL ] PH: Primary data saved (39166 records). [2025-09-26T20:44:16.405945] [INFO ] [MAIN ] PH: Full history saved. [2025-09-26T20:44:16.408068] [INFO ] [MAIN ] Update Progress: 1679/2371 symbols completed. PH took 30.8s. Estimated remaining: 1h 32m 25s. Rate: 7.5 symbols/min [2025-09-26T20:44:16.918369] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-26T20:44:16.922186] [INFO ] [REMOTE ] PHD: Full fetch complete (12774 records). [2025-09-26T20:44:16.922418] [DEBUG] [VALIDATOR ] PHD: Validating primary data. [2025-09-26T20:44:17.127733] [WARN ] [VALIDATOR ] PHD: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-26T20:44:17.128045] [FATAL] [MAIN ] PHD: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:44:17.128119] [WARN ] [MAIN ] PHD: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:44:17.128194] [INFO ] [LOCAL ] PHD: Starting deletion of primary data. [2025-09-26T20:44:17.128284] [DEBUG] [LOCAL ] PHD: No primary data file found to delete. [2025-09-26T20:44:17.128341] [INFO ] [LOCAL ] PHD: Starting deletion of derivative data. [2025-09-26T20:44:17.128862] [DEBUG] [LOCAL ] PHD: Deleted derivative data file. [2025-09-26T20:44:17.128979] [INFO ] [MAIN ] Update Progress: 1680/2371 symbols completed. PHD took 16.1s. Estimated remaining: 1h 32m 14s. Rate: 7.5 symbols/min [2025-09-26T20:44:17.935897] [INFO ] [MAIN ] PHK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:44:17.939986] [INFO ] [MAIN ] PHIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:44:17.934814] [INFO ] [MAIN ] PHG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:44:17.930567] [INFO ] [MAIN ] PHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:44:17.972683] [DEBUG] [LOCAL ] PHI: Loaded 15126 existing records from primary storage. [2025-09-26T20:44:17.972957] [INFO ] [MAIN ] PHI: Loaded 15126 existing records. [2025-09-26T20:44:18.053087] [DEBUG] [LOCAL ] PHK: Loaded 26530 existing records from primary storage. [2025-09-26T20:44:18.063138] [INFO ] [MAIN ] PHK: Loaded 26530 existing records. [2025-09-26T20:44:18.344925] [DEBUG] [LOCAL ] PHIN: Loaded 33373 existing records from primary storage. [2025-09-26T20:44:18.391450] [WARN ] [MAIN ] PHI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:44:18.388002] [INFO ] [MAIN ] PHIN: Loaded 33373 existing records. [2025-09-26T20:44:18.392262] [DEBUG] [LOCAL ] PHG: Loaded 46531 existing records from primary storage. [2025-09-26T20:44:18.402833] [INFO ] [MAIN ] PHG: Loaded 46531 existing records. [2025-09-26T20:44:18.479416] [INFO ] [MAIN ] PHI: Wiping existing primary data before full refresh. [2025-09-26T20:44:18.584736] [WARN ] [MAIN ] PHK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:44:18.579395] [INFO ] [LOCAL ] PHI: Starting deletion of primary data. [2025-09-26T20:44:18.621860] [INFO ] [MAIN ] PHK: Wiping existing primary data before full refresh. [2025-09-26T20:44:18.658209] [DEBUG] [LOCAL ] PHI: Deleted primary data file. [2025-09-26T20:44:18.683011] [INFO ] [MAIN ] PHI: Starting full primary refresh. [2025-09-26T20:44:18.658140] [INFO ] [LOCAL ] PHK: Starting deletion of primary data. [2025-09-26T20:44:18.818411] [DEBUG] [LOCAL ] PHK: Deleted primary data file. [2025-09-26T20:44:18.919444] [WARN ] [MAIN ] PHIN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:44:18.958089] [INFO ] [MAIN ] PHK: Starting full primary refresh. [2025-09-26T20:44:18.992407] [INFO ] [MAIN ] PHIN: Wiping existing primary data before full refresh. [2025-09-26T20:44:19.020500] [WARN ] [MAIN ] PHG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:44:19.013596] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-09-26T20:44:19.128623] [INFO ] [MAIN ] PHG: Wiping existing primary data before full refresh. [2025-09-26T20:44:19.134716] [DEBUG] [LOCAL ] PHIN: Deleted primary data file. [2025-09-26T20:44:19.193634] [INFO ] [MAIN ] PHIN: Starting full primary refresh. [2025-09-26T20:44:19.193560] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-09-26T20:44:19.282092] [DEBUG] [LOCAL ] PHG: Deleted primary data file. [2025-09-26T20:44:19.391424] [INFO ] [MAIN ] PHG: Starting full primary refresh. [2025-09-26T20:44:19.735698] [INFO ] [REMOTE ] PHI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:44:19.855343] [INFO ] [REMOTE ] PHI: Fetching primary data for 2024-12. [2025-09-26T20:44:20.253265] [INFO ] [REMOTE ] PHK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:44:20.271280] [INFO ] [REMOTE ] PHK: Fetching primary data for 2024-12. [2025-09-26T20:44:20.434739] [INFO ] [REMOTE ] PHIN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:44:20.455093] [INFO ] [REMOTE ] PHG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:44:20.455360] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2024-12. [2025-09-26T20:44:20.455696] [INFO ] [REMOTE ] PHG: Fetching primary data for 2024-12. [2025-09-26T20:44:21.066843] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-26T20:44:21.070473] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-01. [2025-09-26T20:44:21.802022] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-26T20:44:21.809993] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-01. [2025-09-26T20:44:21.887888] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-26T20:44:21.894185] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-01. [2025-09-26T20:44:22.052223] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-26T20:44:22.289791] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-26T20:44:22.311672] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-01. [2025-09-26T20:44:22.728093] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-26T20:44:23.114064] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-02. [2025-09-26T20:44:23.124351] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-26T20:44:23.558632] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-26T20:44:23.911733] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-02. [2025-09-26T20:44:24.220021] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-26T20:44:24.711734] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-02. [2025-09-26T20:44:25.511718] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-03. [2025-09-26T20:44:25.622409] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-26T20:44:26.023012] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-26T20:44:26.311747] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-03. [2025-09-26T20:44:26.960701] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-26T20:44:27.111737] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-02. [2025-09-26T20:44:27.708312] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-26T20:44:27.911699] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-03. [2025-09-26T20:44:28.060941] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-26T20:44:28.711720] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-04. [2025-09-26T20:44:29.159129] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-26T20:44:29.511771] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-04. [2025-09-26T20:44:30.311723] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-03. [2025-09-26T20:44:30.513256] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-26T20:44:30.852173] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-26T20:44:31.111729] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-04. [2025-09-26T20:44:31.288568] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-26T20:44:31.911732] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-05. [2025-09-26T20:44:32.711721] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-04. [2025-09-26T20:44:32.735414] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-26T20:44:33.520783] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-05. [2025-09-26T20:44:33.543612] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-26T20:44:33.771325] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-26T20:44:34.311761] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-05. [2025-09-26T20:44:34.754101] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-26T20:44:35.111732] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-06. [2025-09-26T20:44:35.377013] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-26T20:44:35.911720] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-06. [2025-09-26T20:44:36.208995] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-26T20:44:36.711768] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-06. [2025-09-26T20:44:37.511739] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-05. [2025-09-26T20:44:37.550406] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-26T20:44:37.692777] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-26T20:44:38.311747] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-07. [2025-09-26T20:44:38.942946] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-26T20:44:39.111731] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-07. [2025-09-26T20:44:39.478866] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-26T20:44:39.718052] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-26T20:44:39.911712] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-08. [2025-09-26T20:44:40.711756] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-07. [2025-09-26T20:44:41.031854] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-26T20:44:41.511739] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-06. [2025-09-26T20:44:42.311721] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-09. [2025-09-26T20:44:42.503582] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-26T20:44:42.564321] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-26T20:44:43.111723] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-07. [2025-09-26T20:44:43.364831] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-26T20:44:43.369281] [INFO ] [REMOTE ] PHI: Full fetch complete (20810 records). [2025-09-26T20:44:43.369368] [DEBUG] [VALIDATOR ] PHI: Validating primary data. [2025-09-26T20:44:43.765972] [DEBUG] [VALIDATOR ] PHI: All expected trading days are present. [2025-09-26T20:44:43.766085] [DEBUG] [VALIDATOR ] PHI: Primary data validation passed. [2025-09-26T20:44:43.766662] [INFO ] [MAIN ] PHI: Fetched primary data is valid. [2025-09-26T20:44:43.766739] [DEBUG] [LOCAL ] PHI: Saving primary data. [2025-09-26T20:44:43.767625] [DEBUG] [LOCAL ] PHI: Trimmed 20810 records to 15230 (keeping 200 days of data) [2025-09-26T20:44:43.874378] [DEBUG] [LOCAL ] PHI: Primary data saved (15230 records). [2025-09-26T20:44:43.874539] [INFO ] [MAIN ] PHI: Full history saved. [2025-09-26T20:44:43.874672] [INFO ] [MAIN ] Update Progress: 1681/2371 symbols completed. PHI took 26.7s. Estimated remaining: 1h 32m 13s. Rate: 7.5 symbols/min [2025-09-26T20:44:43.916871] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-08. [2025-09-26T20:44:44.063590] [INFO ] [MAIN ] PHM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:44:44.064730] [DEBUG] [LOCAL ] PHM: No existing data file found in primary storage. [2025-09-26T20:44:44.064783] [WARN ] [MAIN ] PHM: No existing data found, performing full refresh instead. [2025-09-26T20:44:44.064933] [INFO ] [MAIN ] PHM: Wiping existing primary data before full refresh. [2025-09-26T20:44:44.065018] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-09-26T20:44:44.065083] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-09-26T20:44:44.065120] [INFO ] [MAIN ] PHM: Starting full primary refresh. [2025-09-26T20:44:44.444532] [INFO ] [REMOTE ] PHM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:44:44.546022] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-26T20:44:44.711766] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-08. [2025-09-26T20:44:45.511694] [INFO ] [REMOTE ] PHM: Fetching primary data for 2024-12. [2025-09-26T20:44:45.752551] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-26T20:44:46.019508] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-26T20:44:46.311728] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-08. [2025-09-26T20:44:47.111711] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-09. [2025-09-26T20:44:47.497126] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-26T20:44:47.578838] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-26T20:44:47.911726] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-01. [2025-09-26T20:44:48.433678] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-26T20:44:48.440410] [INFO ] [REMOTE ] PHIN: Full fetch complete (48144 records). [2025-09-26T20:44:48.440526] [DEBUG] [VALIDATOR ] PHIN: Validating primary data. [2025-09-26T20:44:48.717985] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-09. [2025-09-26T20:44:48.858171] [DEBUG] [VALIDATOR ] PHIN: All expected trading days are present. [2025-09-26T20:44:48.858258] [DEBUG] [VALIDATOR ] PHIN: Primary data validation passed. [2025-09-26T20:44:48.859194] [INFO ] [MAIN ] PHIN: Fetched primary data is valid. [2025-09-26T20:44:48.859279] [DEBUG] [LOCAL ] PHIN: Saving primary data. [2025-09-26T20:44:48.860451] [DEBUG] [LOCAL ] PHIN: Trimmed 48144 records to 33541 (keeping 200 days of data) [2025-09-26T20:44:49.093184] [DEBUG] [LOCAL ] PHIN: Primary data saved (33541 records). [2025-09-26T20:44:49.093318] [INFO ] [MAIN ] PHIN: Full history saved. [2025-09-26T20:44:49.093424] [INFO ] [MAIN ] Update Progress: 1682/2371 symbols completed. PHIN took 32.0s. Estimated remaining: 1h 32m 4s. Rate: 7.5 symbols/min [2025-09-26T20:44:49.280927] [INFO ] [MAIN ] PHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:44:49.318965] [DEBUG] [LOCAL ] PHR: Loaded 37787 existing records from primary storage. [2025-09-26T20:44:49.319109] [INFO ] [MAIN ] PHR: Loaded 37787 existing records. [2025-09-26T20:44:49.512165] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-09. [2025-09-26T20:44:49.518344] [WARN ] [MAIN ] PHR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:44:49.519699] [INFO ] [MAIN ] PHR: Wiping existing primary data before full refresh. [2025-09-26T20:44:49.519856] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-09-26T20:44:49.520826] [DEBUG] [LOCAL ] PHR: Deleted primary data file. [2025-09-26T20:44:49.520890] [INFO ] [MAIN ] PHR: Starting full primary refresh. [2025-09-26T20:44:49.872374] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-26T20:44:49.975625] [INFO ] [REMOTE ] PHR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:44:49.992050] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-26T20:44:49.998074] [INFO ] [REMOTE ] PHK: Full fetch complete (39299 records). [2025-09-26T20:44:49.998176] [DEBUG] [VALIDATOR ] PHK: Validating primary data. [2025-09-26T20:44:50.316796] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-02. [2025-09-26T20:44:50.387911] [DEBUG] [VALIDATOR ] PHK: All expected trading days are present. [2025-09-26T20:44:50.387992] [DEBUG] [VALIDATOR ] PHK: Primary data validation passed. [2025-09-26T20:44:50.388761] [INFO ] [MAIN ] PHK: Fetched primary data is valid. [2025-09-26T20:44:50.389118] [DEBUG] [LOCAL ] PHK: Saving primary data. [2025-09-26T20:44:50.390204] [DEBUG] [LOCAL ] PHK: Trimmed 39299 records to 26792 (keeping 200 days of data) [2025-09-26T20:44:50.552772] [DEBUG] [LOCAL ] PHK: Primary data saved (26792 records). [2025-09-26T20:44:50.552909] [INFO ] [MAIN ] PHK: Full history saved. [2025-09-26T20:44:50.553011] [INFO ] [MAIN ] Update Progress: 1683/2371 symbols completed. PHK took 33.4s. Estimated remaining: 1h 31m 54s. Rate: 7.5 symbols/min [2025-09-26T20:44:50.734275] [INFO ] [MAIN ] PII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:44:50.783318] [DEBUG] [LOCAL ] PII: Loaded 49499 existing records from primary storage. [2025-09-26T20:44:50.783470] [INFO ] [MAIN ] PII: Loaded 49499 existing records. [2025-09-26T20:44:50.973174] [WARN ] [MAIN ] PII: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:44:50.973395] [INFO ] [MAIN ] PII: Wiping existing primary data before full refresh. [2025-09-26T20:44:50.973443] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-09-26T20:44:50.974525] [DEBUG] [LOCAL ] PII: Deleted primary data file. [2025-09-26T20:44:50.974586] [INFO ] [MAIN ] PII: Starting full primary refresh. [2025-09-26T20:44:51.127279] [INFO ] [REMOTE ] PHR: Fetching primary data for 2024-12. [2025-09-26T20:44:51.362527] [INFO ] [REMOTE ] PII: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:44:51.378371] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-26T20:44:51.388751] [INFO ] [REMOTE ] PHG: Full fetch complete (65741 records). [2025-09-26T20:44:51.388889] [DEBUG] [VALIDATOR ] PHG: Validating primary data. [2025-09-26T20:44:51.811863] [DEBUG] [VALIDATOR ] PHG: All expected trading days are present. [2025-09-26T20:44:51.812044] [DEBUG] [VALIDATOR ] PHG: Primary data validation passed. [2025-09-26T20:44:51.813152] [INFO ] [MAIN ] PHG: Fetched primary data is valid. [2025-09-26T20:44:51.813260] [DEBUG] [LOCAL ] PHG: Saving primary data. [2025-09-26T20:44:51.814784] [DEBUG] [LOCAL ] PHG: Trimmed 65741 records to 46835 (keeping 200 days of data) [2025-09-26T20:44:51.912783] [INFO ] [REMOTE ] PII: Fetching primary data for 2024-12. [2025-09-26T20:44:52.108728] [DEBUG] [LOCAL ] PHG: Primary data saved (46835 records). [2025-09-26T20:44:52.108926] [INFO ] [MAIN ] PHG: Full history saved. [2025-09-26T20:44:52.109037] [INFO ] [MAIN ] Update Progress: 1684/2371 symbols completed. PHG took 35.0s. Estimated remaining: 1h 31m 43s. Rate: 7.5 symbols/min [2025-09-26T20:44:52.234233] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-26T20:44:52.331540] [INFO ] [MAIN ] PIM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:44:52.338310] [DEBUG] [LOCAL ] PIM: Loaded 4785 existing records from primary storage. [2025-09-26T20:44:52.338423] [INFO ] [MAIN ] PIM: Loaded 4785 existing records. [2025-09-26T20:44:52.524043] [WARN ] [MAIN ] PIM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:44:52.524287] [INFO ] [MAIN ] PIM: Wiping existing primary data before full refresh. [2025-09-26T20:44:52.524335] [INFO ] [LOCAL ] PIM: Starting deletion of primary data. [2025-09-26T20:44:52.524594] [DEBUG] [LOCAL ] PIM: Deleted primary data file. [2025-09-26T20:44:52.524686] [INFO ] [MAIN ] PIM: Starting full primary refresh. [2025-09-26T20:44:52.717933] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-03. [2025-09-26T20:44:52.858520] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-26T20:44:52.930384] [INFO ] [REMOTE ] PIM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:44:53.457688] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-26T20:44:53.511723] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-01. [2025-09-26T20:44:54.311745] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-01. [2025-09-26T20:44:54.729372] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-26T20:44:55.109800] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-26T20:44:55.119436] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-04. [2025-09-26T20:44:55.381057] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-26T20:44:55.911739] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-02. [2025-09-26T20:44:56.711777] [INFO ] [REMOTE ] PIM: Fetching primary data for 2024-12. [2025-09-26T20:44:57.061373] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-26T20:44:57.156517] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-26T20:44:57.511729] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-05. [2025-09-26T20:44:57.575083] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-26T20:44:58.311717] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-02. [2025-09-26T20:44:59.111726] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-03. [2025-09-26T20:44:59.541007] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-26T20:44:59.911699] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-06. [2025-09-26T20:44:59.980083] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-26T20:45:00.699408] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-26T20:45:00.711673] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-04. [2025-09-26T20:45:01.320816] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-26T20:45:01.511749] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-01. [2025-09-26T20:45:02.210149] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-26T20:45:02.244576] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-26T20:45:02.311717] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-05. [2025-09-26T20:45:03.111718] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-07. [2025-09-26T20:45:03.911724] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-02. [2025-09-26T20:45:03.942685] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-26T20:45:04.644422] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-26T20:45:04.711714] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-03. [2025-09-26T20:45:05.029151] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-26T20:45:05.373338] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-26T20:45:05.511727] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-04. [2025-09-26T20:45:06.203609] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-26T20:45:06.311729] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-06. [2025-09-26T20:45:07.111711] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-05. [2025-09-26T20:45:07.773228] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-26T20:45:07.862147] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T20:45:07.911711] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-07. [2025-09-26T20:45:08.711723] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-06. [2025-09-26T20:45:09.348782] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-26T20:45:09.395822] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-26T20:45:09.511744] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-03. [2025-09-26T20:45:10.311674] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-08. [2025-09-26T20:45:11.111695] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-08. [2025-09-26T20:45:11.373844] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-26T20:45:11.775281] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-26T20:45:11.911725] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-04. [2025-09-26T20:45:12.711716] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-07. [2025-09-26T20:45:12.962689] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-26T20:45:13.387080] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-26T20:45:13.511747] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-08. [2025-09-26T20:45:13.730590] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-26T20:45:14.240718] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-26T20:45:14.311738] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-09. [2025-09-26T20:45:15.111725] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-09. [2025-09-26T20:45:15.174630] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-26T20:45:15.177050] [INFO ] [REMOTE ] PIM: Full fetch complete (6582 records). [2025-09-26T20:45:15.177134] [DEBUG] [VALIDATOR ] PIM: Validating primary data. [2025-09-26T20:45:15.564468] [DEBUG] [VALIDATOR ] PIM: All expected trading days are present. [2025-09-26T20:45:15.564548] [DEBUG] [VALIDATOR ] PIM: Primary data validation passed. [2025-09-26T20:45:15.564777] [INFO ] [MAIN ] PIM: Fetched primary data is valid. [2025-09-26T20:45:15.564843] [DEBUG] [LOCAL ] PIM: Saving primary data. [2025-09-26T20:45:15.565329] [DEBUG] [LOCAL ] PIM: Trimmed 6582 records to 4814 (keeping 200 days of data) [2025-09-26T20:45:15.593914] [DEBUG] [LOCAL ] PIM: Primary data saved (4814 records). [2025-09-26T20:45:15.594007] [INFO ] [MAIN ] PIM: Full history saved. [2025-09-26T20:45:15.594089] [INFO ] [MAIN ] Update Progress: 1685/2371 symbols completed. PIM took 23.5s. Estimated remaining: 1h 31m 41s. Rate: 7.5 symbols/min [2025-09-26T20:45:15.769378] [INFO ] [MAIN ] PINE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:45:15.788451] [DEBUG] [LOCAL ] PINE: Loaded 14283 existing records from primary storage. [2025-09-26T20:45:15.788587] [INFO ] [MAIN ] PINE: Loaded 14283 existing records. [2025-09-26T20:45:15.916860] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-05. [2025-09-26T20:45:15.981840] [WARN ] [MAIN ] PINE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:45:15.982190] [INFO ] [MAIN ] PINE: Wiping existing primary data before full refresh. [2025-09-26T20:45:15.982241] [INFO ] [LOCAL ] PINE: Starting deletion of primary data. [2025-09-26T20:45:15.982697] [DEBUG] [LOCAL ] PINE: Deleted primary data file. [2025-09-26T20:45:15.982771] [INFO ] [MAIN ] PINE: Starting full primary refresh. [2025-09-26T20:45:16.365446] [INFO ] [REMOTE ] PINE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:45:16.711730] [INFO ] [REMOTE ] PINE: Fetching primary data for 2024-12. [2025-09-26T20:45:16.835397] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T20:45:16.844706] [INFO ] [REMOTE ] PHR: Full fetch complete (52501 records). [2025-09-26T20:45:16.844838] [DEBUG] [VALIDATOR ] PHR: Validating primary data. [2025-09-26T20:45:17.256901] [DEBUG] [VALIDATOR ] PHR: All expected trading days are present. [2025-09-26T20:45:17.257030] [DEBUG] [VALIDATOR ] PHR: Primary data validation passed. [2025-09-26T20:45:17.258041] [INFO ] [MAIN ] PHR: Fetched primary data is valid. [2025-09-26T20:45:17.258129] [DEBUG] [LOCAL ] PHR: Saving primary data. [2025-09-26T20:45:17.259597] [DEBUG] [LOCAL ] PHR: Trimmed 52501 records to 38045 (keeping 200 days of data) [2025-09-26T20:45:17.397547] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-26T20:45:17.511964] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-06. [2025-09-26T20:45:17.544769] [DEBUG] [LOCAL ] PHR: Primary data saved (38045 records). [2025-09-26T20:45:17.544932] [INFO ] [MAIN ] PHR: Full history saved. [2025-09-26T20:45:17.545020] [INFO ] [MAIN ] Update Progress: 1686/2371 symbols completed. PHR took 28.5s. Estimated remaining: 1h 31m 31s. Rate: 7.5 symbols/min [2025-09-26T20:45:17.767967] [INFO ] [MAIN ] PINS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:45:17.779960] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-26T20:45:17.835780] [DEBUG] [LOCAL ] PINS: Loaded 54083 existing records from primary storage. [2025-09-26T20:45:17.835948] [INFO ] [MAIN ] PINS: Loaded 54083 existing records. [2025-09-26T20:45:18.022864] [WARN ] [MAIN ] PINS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:45:18.023103] [INFO ] [MAIN ] PINS: Wiping existing primary data before full refresh. [2025-09-26T20:45:18.023151] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-09-26T20:45:18.024312] [DEBUG] [LOCAL ] PINS: Deleted primary data file. [2025-09-26T20:45:18.024376] [INFO ] [MAIN ] PINS: Starting full primary refresh. [2025-09-26T20:45:18.317396] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-09. [2025-09-26T20:45:18.406107] [INFO ] [REMOTE ] PINS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:45:19.111747] [INFO ] [REMOTE ] PINS: Fetching primary data for 2024-12. [2025-09-26T20:45:19.315229] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-26T20:45:19.418565] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-26T20:45:19.428357] [INFO ] [REMOTE ] PHM: Full fetch complete (74693 records). [2025-09-26T20:45:19.428530] [DEBUG] [VALIDATOR ] PHM: Validating primary data. [2025-09-26T20:45:19.429370] [FATAL] [VALIDATOR ] PHM: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T20:45:19.429477] [FATAL] [MAIN ] PHM: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:45:19.429521] [WARN ] [MAIN ] PHM: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:45:19.429561] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-09-26T20:45:19.429663] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-09-26T20:45:19.429726] [INFO ] [LOCAL ] PHM: Starting deletion of derivative data. [2025-09-26T20:45:19.429785] [DEBUG] [LOCAL ] PHM: No derivative data file found to delete. [2025-09-26T20:45:19.429870] [INFO ] [MAIN ] Update Progress: 1687/2371 symbols completed. PHM took 35.6s. Estimated remaining: 1h 31m 20s. Rate: 7.5 symbols/min [2025-09-26T20:45:19.607682] [INFO ] [MAIN ] PIPR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:45:19.627237] [DEBUG] [LOCAL ] PIPR: Loaded 15270 existing records from primary storage. [2025-09-26T20:45:19.627378] [INFO ] [MAIN ] PIPR: Loaded 15270 existing records. [2025-09-26T20:45:19.821864] [WARN ] [MAIN ] PIPR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:45:19.822125] [INFO ] [MAIN ] PIPR: Wiping existing primary data before full refresh. [2025-09-26T20:45:19.822178] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-09-26T20:45:19.822759] [DEBUG] [LOCAL ] PIPR: Deleted primary data file. [2025-09-26T20:45:19.822824] [INFO ] [MAIN ] PIPR: Starting full primary refresh. [2025-09-26T20:45:19.921504] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-01. [2025-09-26T20:45:20.215363] [INFO ] [REMOTE ] PIPR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:45:20.711734] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-07. [2025-09-26T20:45:20.942104] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-26T20:45:21.083396] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-26T20:45:21.511719] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2024-12. [2025-09-26T20:45:22.311700] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-02. [2025-09-26T20:45:22.425522] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-26T20:45:22.459535] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-26T20:45:22.924141] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-26T20:45:23.111718] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-03. [2025-09-26T20:45:23.911754] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-01. [2025-09-26T20:45:24.060034] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-26T20:45:24.711722] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-01. [2025-09-26T20:45:24.842775] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-26T20:45:25.511771] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-02. [2025-09-26T20:45:26.311734] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-08. [2025-09-26T20:45:26.380942] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-26T20:45:26.524818] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-26T20:45:27.111761] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-02. [2025-09-26T20:45:27.911726] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-03. [2025-09-26T20:45:27.944462] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-26T20:45:28.711760] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-09. [2025-09-26T20:45:29.065519] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-26T20:45:29.066197] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-26T20:45:29.511762] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-04. [2025-09-26T20:45:30.311773] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-03. [2025-09-26T20:45:30.544110] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-26T20:45:30.554601] [INFO ] [REMOTE ] PII: Full fetch complete (71120 records). [2025-09-26T20:45:30.567763] [DEBUG] [VALIDATOR ] PII: Validating primary data. [2025-09-26T20:45:30.569960] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-26T20:45:31.027464] [DEBUG] [VALIDATOR ] PII: All expected trading days are present. [2025-09-26T20:45:31.027724] [DEBUG] [VALIDATOR ] PII: Primary data validation passed. [2025-09-26T20:45:31.030501] [INFO ] [MAIN ] PII: Fetched primary data is valid. [2025-09-26T20:45:31.030621] [DEBUG] [LOCAL ] PII: Saving primary data. [2025-09-26T20:45:31.038857] [DEBUG] [LOCAL ] PII: Trimmed 71120 records to 49815 (keeping 200 days of data) [2025-09-26T20:45:31.117962] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-04. [2025-09-26T20:45:31.379099] [DEBUG] [LOCAL ] PII: Primary data saved (49815 records). [2025-09-26T20:45:31.379377] [INFO ] [MAIN ] PII: Full history saved. [2025-09-26T20:45:31.379624] [INFO ] [MAIN ] Update Progress: 1688/2371 symbols completed. PII took 40.8s. Estimated remaining: 1h 31m 14s. Rate: 7.5 symbols/min [2025-09-26T20:45:31.562710] [INFO ] [MAIN ] PJT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:45:31.589308] [DEBUG] [LOCAL ] PJT: Loaded 22488 existing records from primary storage. [2025-09-26T20:45:31.589470] [INFO ] [MAIN ] PJT: Loaded 22488 existing records. [2025-09-26T20:45:31.784386] [WARN ] [MAIN ] PJT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:45:31.784738] [INFO ] [MAIN ] PJT: Wiping existing primary data before full refresh. [2025-09-26T20:45:31.784806] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-09-26T20:45:31.785502] [DEBUG] [LOCAL ] PJT: Deleted primary data file. [2025-09-26T20:45:31.785575] [INFO ] [MAIN ] PJT: Starting full primary refresh. [2025-09-26T20:45:31.915713] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-05. [2025-09-26T20:45:32.226861] [INFO ] [REMOTE ] PJT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:45:32.244264] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-26T20:45:32.386287] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-26T20:45:32.711733] [INFO ] [REMOTE ] PJT: Fetching primary data for 2024-12. [2025-09-26T20:45:33.043616] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-26T20:45:33.511788] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-05. [2025-09-26T20:45:33.820056] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-26T20:45:34.311725] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-06. [2025-09-26T20:45:34.443320] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-26T20:45:34.942480] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-26T20:45:35.111768] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-01. [2025-09-26T20:45:35.911689] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-07. [2025-09-26T20:45:36.305059] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-26T20:45:36.711721] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-04. [2025-09-26T20:45:37.049561] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-26T20:45:37.511754] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-06. [2025-09-26T20:45:38.311704] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-02. [2025-09-26T20:45:38.376689] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-26T20:45:38.955940] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-26T20:45:39.111796] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-07. [2025-09-26T20:45:39.618567] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-26T20:45:39.911752] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-08. [2025-09-26T20:45:40.404877] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-26T20:45:40.711711] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-08. [2025-09-26T20:45:40.930180] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-26T20:45:41.511713] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-09. [2025-09-26T20:45:41.641060] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-26T20:45:42.311739] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-05. [2025-09-26T20:45:42.666369] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-26T20:45:42.670159] [INFO ] [REMOTE ] PIPR: Full fetch complete (20401 records). [2025-09-26T20:45:42.670296] [DEBUG] [VALIDATOR ] PIPR: Validating primary data. [2025-09-26T20:45:43.065684] [DEBUG] [VALIDATOR ] PIPR: All expected trading days are present. [2025-09-26T20:45:43.066041] [DEBUG] [VALIDATOR ] PIPR: Primary data validation passed. [2025-09-26T20:45:43.067046] [INFO ] [MAIN ] PIPR: Fetched primary data is valid. [2025-09-26T20:45:43.067124] [DEBUG] [LOCAL ] PIPR: Saving primary data. [2025-09-26T20:45:43.068175] [DEBUG] [LOCAL ] PIPR: Trimmed 20401 records to 15331 (keeping 200 days of data) [2025-09-26T20:45:43.116535] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-03. [2025-09-26T20:45:43.182602] [DEBUG] [LOCAL ] PIPR: Primary data saved (15331 records). [2025-09-26T20:45:43.182864] [INFO ] [MAIN ] PIPR: Full history saved. [2025-09-26T20:45:43.183037] [INFO ] [MAIN ] Update Progress: 1689/2371 symbols completed. PIPR took 23.8s. Estimated remaining: 1h 31m 7s. Rate: 7.5 symbols/min [2025-09-26T20:45:43.367925] [INFO ] [MAIN ] PK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:45:43.441716] [DEBUG] [LOCAL ] PK: Loaded 53243 existing records from primary storage. [2025-09-26T20:45:43.441962] [INFO ] [MAIN ] PK: Loaded 53243 existing records. [2025-09-26T20:45:43.628594] [WARN ] [MAIN ] PK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:45:43.629030] [INFO ] [MAIN ] PK: Wiping existing primary data before full refresh. [2025-09-26T20:45:43.629092] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-09-26T20:45:43.630665] [DEBUG] [LOCAL ] PK: Deleted primary data file. [2025-09-26T20:45:43.630731] [INFO ] [MAIN ] PK: Starting full primary refresh. [2025-09-26T20:45:43.911772] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-09. [2025-09-26T20:45:44.014426] [INFO ] [REMOTE ] PK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:45:44.377906] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-26T20:45:44.492104] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-26T20:45:44.711746] [INFO ] [REMOTE ] PK: Fetching primary data for 2024-12. [2025-09-26T20:45:44.920072] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-26T20:45:44.924481] [INFO ] [REMOTE ] PINE: Full fetch complete (21056 records). [2025-09-26T20:45:44.924568] [DEBUG] [VALIDATOR ] PINE: Validating primary data. [2025-09-26T20:45:45.305029] [DEBUG] [VALIDATOR ] PINE: All expected trading days are present. [2025-09-26T20:45:45.305156] [DEBUG] [VALIDATOR ] PINE: Primary data validation passed. [2025-09-26T20:45:45.306009] [INFO ] [MAIN ] PINE: Fetched primary data is valid. [2025-09-26T20:45:45.306077] [DEBUG] [LOCAL ] PINE: Saving primary data. [2025-09-26T20:45:45.307084] [DEBUG] [LOCAL ] PINE: Trimmed 21056 records to 14365 (keeping 200 days of data) [2025-09-26T20:45:45.414740] [DEBUG] [LOCAL ] PINE: Primary data saved (14365 records). [2025-09-26T20:45:45.414904] [INFO ] [MAIN ] PINE: Full history saved. [2025-09-26T20:45:45.415001] [INFO ] [MAIN ] Update Progress: 1690/2371 symbols completed. PINE took 29.8s. Estimated remaining: 1h 30m 57s. Rate: 7.5 symbols/min [2025-09-26T20:45:45.516900] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-04. [2025-09-26T20:45:45.609286] [INFO ] [MAIN ] PKE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:45:45.626611] [DEBUG] [LOCAL ] PKE: Loaded 12677 existing records from primary storage. [2025-09-26T20:45:45.626795] [INFO ] [MAIN ] PKE: Loaded 12677 existing records. [2025-09-26T20:45:45.820788] [WARN ] [MAIN ] PKE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:45:45.821082] [INFO ] [MAIN ] PKE: Wiping existing primary data before full refresh. [2025-09-26T20:45:45.821146] [INFO ] [LOCAL ] PKE: Starting deletion of primary data. [2025-09-26T20:45:45.821537] [DEBUG] [LOCAL ] PKE: Deleted primary data file. [2025-09-26T20:45:45.821596] [INFO ] [MAIN ] PKE: Starting full primary refresh. [2025-09-26T20:45:46.209308] [INFO ] [REMOTE ] PKE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:45:46.311756] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-06. [2025-09-26T20:45:46.594274] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-26T20:45:46.941431] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-26T20:45:47.111763] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-05. [2025-09-26T20:45:47.911766] [INFO ] [REMOTE ] PKE: Fetching primary data for 2024-12. [2025-09-26T20:45:48.175219] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-26T20:45:48.350951] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-26T20:45:48.711753] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-06. [2025-09-26T20:45:49.069820] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-26T20:45:49.511772] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-01. [2025-09-26T20:45:49.764016] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-26T20:45:50.311763] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-07. [2025-09-26T20:45:50.536899] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-26T20:45:51.111796] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-02. [2025-09-26T20:45:51.911761] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-07. [2025-09-26T20:45:52.015639] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-26T20:45:52.309014] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-26T20:45:52.711737] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-08. [2025-09-26T20:45:52.770367] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-26T20:45:53.511759] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-01. [2025-09-26T20:45:54.311762] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-03. [2025-09-26T20:45:55.016144] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-26T20:45:55.111753] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-08. [2025-09-26T20:45:55.133186] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-26T20:45:55.318792] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-26T20:45:55.911756] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-04. [2025-09-26T20:45:56.399540] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-26T20:45:56.711752] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-02. [2025-09-26T20:45:57.152415] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-26T20:45:57.511762] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-05. [2025-09-26T20:45:58.311771] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-09. [2025-09-26T20:45:58.322393] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-26T20:45:58.542620] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-26T20:45:59.111727] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-06. [2025-09-26T20:45:59.911767] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-09. [2025-09-26T20:46:00.003520] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-26T20:46:00.346002] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-26T20:46:00.359377] [INFO ] [REMOTE ] PINS: Full fetch complete (77738 records). [2025-09-26T20:46:00.359735] [DEBUG] [VALIDATOR ] PINS: Validating primary data. [2025-09-26T20:46:00.725971] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-03. [2025-09-26T20:46:00.796537] [DEBUG] [VALIDATOR ] PINS: All expected trading days are present. [2025-09-26T20:46:00.796692] [DEBUG] [VALIDATOR ] PINS: Primary data validation passed. [2025-09-26T20:46:00.797911] [INFO ] [MAIN ] PINS: Fetched primary data is valid. [2025-09-26T20:46:00.797986] [DEBUG] [LOCAL ] PINS: Saving primary data. [2025-09-26T20:46:00.799759] [DEBUG] [LOCAL ] PINS: Trimmed 77738 records to 54473 (keeping 200 days of data) [2025-09-26T20:46:01.053922] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-26T20:46:01.061724] [INFO ] [REMOTE ] PJT: Full fetch complete (32057 records). [2025-09-26T20:46:01.062764] [DEBUG] [VALIDATOR ] PJT: Validating primary data. [2025-09-26T20:46:01.494762] [DEBUG] [VALIDATOR ] PJT: All expected trading days are present. [2025-09-26T20:46:01.494876] [DEBUG] [VALIDATOR ] PJT: Primary data validation passed. [2025-09-26T20:46:01.496086] [INFO ] [MAIN ] PJT: Fetched primary data is valid. [2025-09-26T20:46:01.496166] [DEBUG] [LOCAL ] PJT: Saving primary data. [2025-09-26T20:46:01.499991] [DEBUG] [LOCAL ] PJT: Trimmed 32057 records to 22579 (keeping 200 days of data) [2025-09-26T20:46:01.564279] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-07. [2025-09-26T20:46:01.744885] [DEBUG] [LOCAL ] PINS: Primary data saved (54473 records). [2025-09-26T20:46:01.745144] [INFO ] [MAIN ] PINS: Full history saved. [2025-09-26T20:46:01.749718] [INFO ] [MAIN ] Update Progress: 1691/2371 symbols completed. PINS took 44.2s. Estimated remaining: 1h 30m 52s. Rate: 7.5 symbols/min [2025-09-26T20:46:01.969510] [INFO ] [MAIN ] PKG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:46:01.969596] [DEBUG] [LOCAL ] PJT: Primary data saved (22579 records). [2025-09-26T20:46:01.970255] [INFO ] [MAIN ] PJT: Full history saved. [2025-09-26T20:46:01.970368] [INFO ] [MAIN ] Update Progress: 1692/2371 symbols completed. PJT took 30.6s. Estimated remaining: 1h 30m 41s. Rate: 7.5 symbols/min [2025-09-26T20:46:02.177714] [INFO ] [MAIN ] PKST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:46:02.223791] [DEBUG] [LOCAL ] PKST: Loaded 19342 existing records from primary storage. [2025-09-26T20:46:02.225865] [INFO ] [MAIN ] PKST: Loaded 19342 existing records. [2025-09-26T20:46:02.225724] [DEBUG] [LOCAL ] PKG: Loaded 39494 existing records from primary storage. [2025-09-26T20:46:02.300765] [INFO ] [MAIN ] PKG: Loaded 39494 existing records. [2025-09-26T20:46:02.569714] [WARN ] [MAIN ] PKST: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:46:02.586434] [INFO ] [MAIN ] PKST: Wiping existing primary data before full refresh. [2025-09-26T20:46:02.596875] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-09-26T20:46:02.626726] [DEBUG] [LOCAL ] PKST: Deleted primary data file. [2025-09-26T20:46:02.638374] [INFO ] [MAIN ] PKST: Starting full primary refresh. [2025-09-26T20:46:02.677865] [WARN ] [MAIN ] PKG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:46:02.707895] [INFO ] [MAIN ] PKG: Wiping existing primary data before full refresh. [2025-09-26T20:46:02.708163] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-09-26T20:46:02.730549] [DEBUG] [LOCAL ] PKG: Deleted primary data file. [2025-09-26T20:46:02.755071] [INFO ] [MAIN ] PKG: Starting full primary refresh. [2025-09-26T20:46:03.072924] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-26T20:46:03.197068] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-08. [2025-09-26T20:46:03.428752] [INFO ] [REMOTE ] PKST: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:46:03.480677] [INFO ] [REMOTE ] PKST: Fetching primary data for 2024-12. [2025-09-26T20:46:03.515043] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-03 (2.79 seconds). [2025-09-26T20:46:03.609210] [INFO ] [REMOTE ] PKG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:46:03.911726] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-04. [2025-09-26T20:46:04.408047] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-26T20:46:04.711757] [INFO ] [REMOTE ] PKG: Fetching primary data for 2024-12. [2025-09-26T20:46:04.789957] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-26T20:46:05.511731] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-09. [2025-09-26T20:46:05.593760] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-26T20:46:06.300061] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-26T20:46:06.311667] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-01. [2025-09-26T20:46:06.565785] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-26T20:46:06.569992] [INFO ] [REMOTE ] PKE: Full fetch complete (17045 records). [2025-09-26T20:46:06.570141] [DEBUG] [VALIDATOR ] PKE: Validating primary data. [2025-09-26T20:46:07.004233] [DEBUG] [VALIDATOR ] PKE: All expected trading days are present. [2025-09-26T20:46:07.004369] [DEBUG] [VALIDATOR ] PKE: Primary data validation passed. [2025-09-26T20:46:07.004862] [INFO ] [MAIN ] PKE: Fetched primary data is valid. [2025-09-26T20:46:07.004936] [DEBUG] [LOCAL ] PKE: Saving primary data. [2025-09-26T20:46:07.005675] [DEBUG] [LOCAL ] PKE: Trimmed 17045 records to 12775 (keeping 200 days of data) [2025-09-26T20:46:07.088955] [DEBUG] [LOCAL ] PKE: Primary data saved (12775 records). [2025-09-26T20:46:07.089108] [INFO ] [MAIN ] PKE: Full history saved. [2025-09-26T20:46:07.089197] [INFO ] [MAIN ] Update Progress: 1693/2371 symbols completed. PKE took 21.7s. Estimated remaining: 1h 30m 32s. Rate: 7.5 symbols/min [2025-09-26T20:46:07.121385] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-05. [2025-09-26T20:46:07.281002] [INFO ] [MAIN ] PKX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:46:07.311508] [DEBUG] [LOCAL ] PKX: Loaded 25041 existing records from primary storage. [2025-09-26T20:46:07.311679] [INFO ] [MAIN ] PKX: Loaded 25041 existing records. [2025-09-26T20:46:07.509624] [WARN ] [MAIN ] PKX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:46:07.509911] [INFO ] [MAIN ] PKX: Wiping existing primary data before full refresh. [2025-09-26T20:46:07.509962] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-09-26T20:46:07.510713] [DEBUG] [LOCAL ] PKX: Deleted primary data file. [2025-09-26T20:46:07.510777] [INFO ] [MAIN ] PKX: Starting full primary refresh. [2025-09-26T20:46:07.926170] [INFO ] [REMOTE ] PKX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:46:07.919883] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-01. [2025-09-26T20:46:08.075479] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-26T20:46:08.535302] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-26T20:46:08.711738] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-02. [2025-09-26T20:46:09.158731] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-26T20:46:09.511769] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-06. [2025-09-26T20:46:10.316871] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-02. [2025-09-26T20:46:10.342223] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T20:46:11.111745] [INFO ] [REMOTE ] PKX: Fetching primary data for 2024-12. [2025-09-26T20:46:11.401790] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-26T20:46:11.433679] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-26T20:46:11.911766] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-03. [2025-09-26T20:46:12.711769] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-07. [2025-09-26T20:46:12.970042] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-26T20:46:13.267605] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-26T20:46:13.511710] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-04. [2025-09-26T20:46:14.311739] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-03. [2025-09-26T20:46:14.575006] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-26T20:46:14.650262] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-26T20:46:15.111747] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-01. [2025-09-26T20:46:15.740182] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-26T20:46:15.911714] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-08. [2025-09-26T20:46:16.379438] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-26T20:46:16.711740] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-04. [2025-09-26T20:46:17.511709] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-05. [2025-09-26T20:46:17.594009] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-26T20:46:18.311700] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-09. [2025-09-26T20:46:18.408978] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-26T20:46:18.452298] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-26T20:46:19.111734] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-05. [2025-09-26T20:46:19.911709] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-02. [2025-09-26T20:46:20.169047] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-26T20:46:20.179687] [INFO ] [REMOTE ] PK: Full fetch complete (76368 records). [2025-09-26T20:46:20.179851] [DEBUG] [VALIDATOR ] PK: Validating primary data. [2025-09-26T20:46:20.645331] [DEBUG] [VALIDATOR ] PK: All expected trading days are present. [2025-09-26T20:46:20.645455] [DEBUG] [VALIDATOR ] PK: Primary data validation passed. [2025-09-26T20:46:20.646723] [INFO ] [MAIN ] PK: Fetched primary data is valid. [2025-09-26T20:46:20.646851] [DEBUG] [LOCAL ] PK: Saving primary data. [2025-09-26T20:46:20.650399] [DEBUG] [LOCAL ] PK: Trimmed 76368 records to 53626 (keeping 200 days of data) [2025-09-26T20:46:20.716729] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-06. [2025-09-26T20:46:20.791853] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-26T20:46:21.023559] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-26T20:46:21.074545] [DEBUG] [LOCAL ] PK: Primary data saved (53626 records). [2025-09-26T20:46:21.074725] [INFO ] [MAIN ] PK: Full history saved. [2025-09-26T20:46:21.074892] [INFO ] [MAIN ] Update Progress: 1694/2371 symbols completed. PK took 37.9s. Estimated remaining: 1h 30m 26s. Rate: 7.5 symbols/min [2025-09-26T20:46:21.265893] [INFO ] [MAIN ] PL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:46:21.322005] [DEBUG] [LOCAL ] PL: Loaded 53504 existing records from primary storage. [2025-09-26T20:46:21.322169] [INFO ] [MAIN ] PL: Loaded 53504 existing records. [2025-09-26T20:46:21.520766] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-06. [2025-09-26T20:46:21.528369] [WARN ] [MAIN ] PL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:46:21.529594] [INFO ] [MAIN ] PL: Wiping existing primary data before full refresh. [2025-09-26T20:46:21.529693] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-09-26T20:46:21.530760] [DEBUG] [LOCAL ] PL: Deleted primary data file. [2025-09-26T20:46:21.530839] [INFO ] [MAIN ] PL: Starting full primary refresh. [2025-09-26T20:46:21.927042] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-26T20:46:21.981002] [INFO ] [REMOTE ] PL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:46:22.311738] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-07. [2025-09-26T20:46:23.092959] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-26T20:46:23.111721] [INFO ] [REMOTE ] PL: Fetching primary data for 2024-12. [2025-09-26T20:46:23.325636] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-26T20:46:23.911744] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-03. [2025-09-26T20:46:24.711732] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-08. [2025-09-26T20:46:25.453534] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T20:46:25.504871] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-09-26T20:46:25.516100] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-07. [2025-09-26T20:46:25.859556] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-26T20:46:26.311752] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-04. [2025-09-26T20:46:27.111713] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-09. [2025-09-26T20:46:27.261121] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-26T20:46:27.347041] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-26T20:46:27.911715] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-01. [2025-09-26T20:46:28.155830] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-26T20:46:28.160402] [INFO ] [REMOTE ] PKST: Full fetch complete (29608 records). [2025-09-26T20:46:28.160555] [DEBUG] [VALIDATOR ] PKST: Validating primary data. [2025-09-26T20:46:28.601389] [DEBUG] [VALIDATOR ] PKST: All expected trading days are present. [2025-09-26T20:46:28.601486] [DEBUG] [VALIDATOR ] PKST: Primary data validation passed. [2025-09-26T20:46:28.602113] [INFO ] [MAIN ] PKST: Fetched primary data is valid. [2025-09-26T20:46:28.602177] [DEBUG] [LOCAL ] PKST: Saving primary data. [2025-09-26T20:46:28.603124] [DEBUG] [LOCAL ] PKST: Trimmed 29608 records to 19461 (keeping 200 days of data) [2025-09-26T20:46:28.711938] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-08. [2025-09-26T20:46:28.734952] [DEBUG] [LOCAL ] PKST: Primary data saved (19461 records). [2025-09-26T20:46:28.735130] [INFO ] [MAIN ] PKST: Full history saved. [2025-09-26T20:46:28.735230] [INFO ] [MAIN ] Update Progress: 1695/2371 symbols completed. PKST took 26.8s. Estimated remaining: 1h 30m 18s. Rate: 7.5 symbols/min [2025-09-26T20:46:28.918979] [INFO ] [MAIN ] PLD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:46:28.985313] [DEBUG] [LOCAL ] PLD: Loaded 53850 existing records from primary storage. [2025-09-26T20:46:28.985716] [INFO ] [MAIN ] PLD: Loaded 53850 existing records. [2025-09-26T20:46:29.226378] [WARN ] [MAIN ] PLD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:46:29.226674] [INFO ] [MAIN ] PLD: Wiping existing primary data before full refresh. [2025-09-26T20:46:29.226736] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-09-26T20:46:29.228008] [DEBUG] [LOCAL ] PLD: Deleted primary data file. [2025-09-26T20:46:29.228070] [INFO ] [MAIN ] PLD: Starting full primary refresh. [2025-09-26T20:46:29.519842] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-05. [2025-09-26T20:46:29.617372] [INFO ] [REMOTE ] PLD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:46:30.052933] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-26T20:46:30.315953] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-02. [2025-09-26T20:46:30.321312] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-26T20:46:30.429497] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-26T20:46:31.111745] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-06. [2025-09-26T20:46:31.911722] [INFO ] [REMOTE ] PLD: Fetching primary data for 2024-12. [2025-09-26T20:46:32.352997] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-26T20:46:32.639770] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-09-26T20:46:32.711733] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-07. [2025-09-26T20:46:33.511700] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-03. [2025-09-26T20:46:33.755168] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-26T20:46:34.059800] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-26T20:46:34.311735] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-08. [2025-09-26T20:46:35.111731] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-09. [2025-09-26T20:46:35.541226] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-26T20:46:35.770052] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-26T20:46:35.911727] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-09. [2025-09-26T20:46:36.666950] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-26T20:46:36.674969] [INFO ] [REMOTE ] PKG: Full fetch complete (57572 records). [2025-09-26T20:46:36.675131] [DEBUG] [VALIDATOR ] PKG: Validating primary data. [2025-09-26T20:46:36.716876] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-01. [2025-09-26T20:46:37.117666] [DEBUG] [VALIDATOR ] PKG: All expected trading days are present. [2025-09-26T20:46:37.117770] [DEBUG] [VALIDATOR ] PKG: Primary data validation passed. [2025-09-26T20:46:37.118850] [INFO ] [MAIN ] PKG: Fetched primary data is valid. [2025-09-26T20:46:37.118924] [DEBUG] [LOCAL ] PKG: Saving primary data. [2025-09-26T20:46:37.120420] [DEBUG] [LOCAL ] PKG: Trimmed 57572 records to 39785 (keeping 200 days of data) [2025-09-26T20:46:37.372272] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-26T20:46:37.379033] [INFO ] [REMOTE ] PKX: Full fetch complete (37547 records). [2025-09-26T20:46:37.379761] [DEBUG] [VALIDATOR ] PKX: Validating primary data. [2025-09-26T20:46:37.517175] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-04. [2025-09-26T20:46:37.636859] [DEBUG] [LOCAL ] PKG: Primary data saved (39785 records). [2025-09-26T20:46:37.651368] [INFO ] [MAIN ] PKG: Full history saved. [2025-09-26T20:46:37.651606] [INFO ] [MAIN ] Update Progress: 1696/2371 symbols completed. PKG took 35.9s. Estimated remaining: 1h 30m 11s. Rate: 7.5 symbols/min [2025-09-26T20:46:38.107595] [INFO ] [MAIN ] PLNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:46:38.148710] [DEBUG] [VALIDATOR ] PKX: All expected trading days are present. [2025-09-26T20:46:38.148831] [DEBUG] [VALIDATOR ] PKX: Primary data validation passed. [2025-09-26T20:46:38.150049] [INFO ] [MAIN ] PKX: Fetched primary data is valid. [2025-09-26T20:46:38.150272] [DEBUG] [LOCAL ] PKX: Saving primary data. [2025-09-26T20:46:38.152180] [DEBUG] [LOCAL ] PKX: Trimmed 37547 records to 25141 (keeping 200 days of data) [2025-09-26T20:46:38.330857] [DEBUG] [LOCAL ] PLNT: Loaded 48791 existing records from primary storage. [2025-09-26T20:46:38.331412] [INFO ] [MAIN ] PLNT: Loaded 48791 existing records. [2025-09-26T20:46:38.548238] [WARN ] [MAIN ] PLNT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:46:38.565124] [INFO ] [MAIN ] PLNT: Wiping existing primary data before full refresh. [2025-09-26T20:46:38.575341] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-09-26T20:46:38.578005] [DEBUG] [LOCAL ] PLNT: Deleted primary data file. [2025-09-26T20:46:38.578445] [INFO ] [MAIN ] PLNT: Starting full primary refresh. [2025-09-26T20:46:38.741985] [DEBUG] [LOCAL ] PKX: Primary data saved (25141 records). [2025-09-26T20:46:38.763119] [INFO ] [MAIN ] PKX: Full history saved. [2025-09-26T20:46:38.800041] [INFO ] [MAIN ] Update Progress: 1697/2371 symbols completed. PKX took 31.7s. Estimated remaining: 1h 29m 60s. Rate: 7.5 symbols/min [2025-09-26T20:46:39.154147] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-09-26T20:46:39.205567] [INFO ] [REMOTE ] PLNT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:46:39.236234] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-02. [2025-09-26T20:46:39.265349] [INFO ] [MAIN ] PLOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:46:39.267113] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2024-12. [2025-09-26T20:46:39.291056] [DEBUG] [LOCAL ] PLOW: Loaded 20661 existing records from primary storage. [2025-09-26T20:46:39.291210] [INFO ] [MAIN ] PLOW: Loaded 20661 existing records. [2025-09-26T20:46:39.485742] [WARN ] [MAIN ] PLOW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:46:39.486318] [INFO ] [MAIN ] PLOW: Wiping existing primary data before full refresh. [2025-09-26T20:46:39.486435] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-09-26T20:46:39.487098] [DEBUG] [LOCAL ] PLOW: Deleted primary data file. [2025-09-26T20:46:39.487222] [INFO ] [MAIN ] PLOW: Starting full primary refresh. [2025-09-26T20:46:39.634006] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-26T20:46:39.914914] [INFO ] [REMOTE ] PLOW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:46:39.914984] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-05. [2025-09-26T20:46:40.712024] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2024-12. [2025-09-26T20:46:40.715769] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-26T20:46:41.006346] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-26T20:46:41.511733] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-01. [2025-09-26T20:46:41.943902] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-26T20:46:42.014447] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-26T20:46:42.311737] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-01. [2025-09-26T20:46:43.111696] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-06. [2025-09-26T20:46:43.210731] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-26T20:46:43.477314] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-26T20:46:43.911724] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-03. [2025-09-26T20:46:44.711759] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-02. [2025-09-26T20:46:45.148991] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-26T20:46:45.511707] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-02. [2025-09-26T20:46:45.907531] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-26T20:46:46.311779] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-07. [2025-09-26T20:46:46.519678] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-26T20:46:46.549021] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-26T20:46:47.111729] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-03. [2025-09-26T20:46:47.911714] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-04. [2025-09-26T20:46:48.131181] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-26T20:46:48.646507] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-26T20:46:48.711720] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-04. [2025-09-26T20:46:49.511703] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-03. [2025-09-26T20:46:49.985963] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-26T20:46:50.063413] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-26T20:46:50.311727] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-05. [2025-09-26T20:46:51.111727] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-05. [2025-09-26T20:46:51.203395] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-26T20:46:51.911717] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-08. [2025-09-26T20:46:52.245227] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-26T20:46:52.271365] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-26T20:46:52.711733] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-06. [2025-09-26T20:46:53.511725] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-04. [2025-09-26T20:46:53.743821] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-26T20:46:54.129273] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-26T20:46:54.311742] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-07. [2025-09-26T20:46:55.111720] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-09. [2025-09-26T20:46:55.423960] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-26T20:46:55.492285] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-26T20:46:55.911720] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-05. [2025-09-26T20:46:56.711715] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-06. [2025-09-26T20:46:57.511704] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-08. [2025-09-26T20:46:57.656793] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-26T20:46:57.741414] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-09-26T20:46:57.752320] [INFO ] [REMOTE ] PL: Full fetch complete (76947 records). [2025-09-26T20:46:57.752509] [DEBUG] [VALIDATOR ] PL: Validating primary data. [2025-09-26T20:46:58.173904] [DEBUG] [VALIDATOR ] PL: All expected trading days are present. [2025-09-26T20:46:58.174003] [DEBUG] [VALIDATOR ] PL: Primary data validation passed. [2025-09-26T20:46:58.175040] [INFO ] [MAIN ] PL: Fetched primary data is valid. [2025-09-26T20:46:58.175107] [DEBUG] [LOCAL ] PL: Saving primary data. [2025-09-26T20:46:58.176777] [DEBUG] [LOCAL ] PL: Trimmed 76947 records to 53894 (keeping 200 days of data) [2025-09-26T20:46:58.343231] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-06. [2025-09-26T20:46:58.508257] [DEBUG] [LOCAL ] PL: Primary data saved (53894 records). [2025-09-26T20:46:58.508447] [INFO ] [MAIN ] PL: Full history saved. [2025-09-26T20:46:58.508573] [INFO ] [MAIN ] Update Progress: 1698/2371 symbols completed. PL took 37.4s. Estimated remaining: 1h 29m 56s. Rate: 7.5 symbols/min [2025-09-26T20:46:58.729216] [INFO ] [MAIN ] PLYM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:46:58.730917] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-26T20:46:58.774784] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-26T20:46:58.820713] [DEBUG] [LOCAL ] PLYM: Loaded 33657 existing records from primary storage. [2025-09-26T20:46:58.820927] [INFO ] [MAIN ] PLYM: Loaded 33657 existing records. [2025-09-26T20:46:59.030936] [WARN ] [MAIN ] PLYM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:46:59.031245] [INFO ] [MAIN ] PLYM: Wiping existing primary data before full refresh. [2025-09-26T20:46:59.031295] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-09-26T20:46:59.032161] [DEBUG] [LOCAL ] PLYM: Deleted primary data file. [2025-09-26T20:46:59.032224] [INFO ] [MAIN ] PLYM: Starting full primary refresh. [2025-09-26T20:46:59.117921] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-07. [2025-09-26T20:46:59.433800] [INFO ] [REMOTE ] PLYM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:46:59.797627] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-26T20:46:59.911719] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-09. [2025-09-26T20:47:00.711730] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2024-12. [2025-09-26T20:47:00.945976] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-26T20:47:00.949450] [INFO ] [REMOTE ] PLOW: Full fetch complete (28831 records). [2025-09-26T20:47:00.949531] [DEBUG] [VALIDATOR ] PLOW: Validating primary data. [2025-09-26T20:47:01.351340] [DEBUG] [VALIDATOR ] PLOW: All expected trading days are present. [2025-09-26T20:47:01.351508] [DEBUG] [VALIDATOR ] PLOW: Primary data validation passed. [2025-09-26T20:47:01.352224] [INFO ] [MAIN ] PLOW: Fetched primary data is valid. [2025-09-26T20:47:01.352352] [DEBUG] [LOCAL ] PLOW: Saving primary data. [2025-09-26T20:47:01.353526] [DEBUG] [LOCAL ] PLOW: Trimmed 28831 records to 20792 (keeping 200 days of data) [2025-09-26T20:47:01.484513] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-09-26T20:47:01.511770] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-07. [2025-09-26T20:47:01.545535] [DEBUG] [LOCAL ] PLOW: Primary data saved (20792 records). [2025-09-26T20:47:01.545722] [INFO ] [MAIN ] PLOW: Full history saved. [2025-09-26T20:47:01.545857] [INFO ] [MAIN ] Update Progress: 1699/2371 symbols completed. PLOW took 22.7s. Estimated remaining: 1h 29m 46s. Rate: 7.5 symbols/min [2025-09-26T20:47:01.736061] [INFO ] [MAIN ] PM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:47:01.736336] [DEBUG] [LOCAL ] PM: No existing data file found in primary storage. [2025-09-26T20:47:01.736393] [WARN ] [MAIN ] PM: No existing data found, performing full refresh instead. [2025-09-26T20:47:01.736540] [INFO ] [MAIN ] PM: Wiping existing primary data before full refresh. [2025-09-26T20:47:01.736585] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-09-26T20:47:01.736630] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-09-26T20:47:01.736706] [INFO ] [MAIN ] PM: Starting full primary refresh. [2025-09-26T20:47:02.135205] [INFO ] [REMOTE ] PM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:47:02.156694] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-26T20:47:02.311746] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-01. [2025-09-26T20:47:03.111711] [INFO ] [REMOTE ] PM: Fetching primary data for 2024-12. [2025-09-26T20:47:03.272632] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-26T20:47:03.590086] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-26T20:47:03.911704] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-08. [2025-09-26T20:47:04.054001] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-26T20:47:04.711722] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-02. [2025-09-26T20:47:05.511692] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-08. [2025-09-26T20:47:05.633554] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-26T20:47:06.110241] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-26T20:47:06.311735] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-09. [2025-09-26T20:47:07.116861] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-03. [2025-09-26T20:47:07.131663] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-26T20:47:07.141708] [INFO ] [REMOTE ] PLNT: Full fetch complete (70257 records). [2025-09-26T20:47:07.141851] [DEBUG] [VALIDATOR ] PLNT: Validating primary data. [2025-09-26T20:47:07.561875] [DEBUG] [VALIDATOR ] PLNT: All expected trading days are present. [2025-09-26T20:47:07.562107] [DEBUG] [VALIDATOR ] PLNT: Primary data validation passed. [2025-09-26T20:47:07.563290] [INFO ] [MAIN ] PLNT: Fetched primary data is valid. [2025-09-26T20:47:07.563451] [DEBUG] [LOCAL ] PLNT: Saving primary data. [2025-09-26T20:47:07.582202] [DEBUG] [LOCAL ] PLNT: Trimmed 70257 records to 49144 (keeping 200 days of data) [2025-09-26T20:47:07.599981] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-26T20:47:07.913115] [DEBUG] [LOCAL ] PLNT: Primary data saved (49144 records). [2025-09-26T20:47:07.913242] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-09. [2025-09-26T20:47:07.914684] [INFO ] [MAIN ] PLNT: Full history saved. [2025-09-26T20:47:07.914841] [INFO ] [MAIN ] Update Progress: 1700/2371 symbols completed. PLNT took 30.2s. Estimated remaining: 1h 29m 38s. Rate: 7.5 symbols/min [2025-09-26T20:47:08.095051] [INFO ] [MAIN ] PML: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:47:08.115847] [DEBUG] [LOCAL ] PML: Loaded 20794 existing records from primary storage. [2025-09-26T20:47:08.116019] [INFO ] [MAIN ] PML: Loaded 20794 existing records. [2025-09-26T20:47:08.309522] [WARN ] [MAIN ] PML: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:47:08.310084] [INFO ] [MAIN ] PML: Wiping existing primary data before full refresh. [2025-09-26T20:47:08.310154] [INFO ] [LOCAL ] PML: Starting deletion of primary data. [2025-09-26T20:47:08.310815] [DEBUG] [LOCAL ] PML: Deleted primary data file. [2025-09-26T20:47:08.310880] [INFO ] [MAIN ] PML: Starting full primary refresh. [2025-09-26T20:47:08.718792] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-01. [2025-09-26T20:47:08.725776] [INFO ] [REMOTE ] PML: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:47:08.753166] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-26T20:47:09.511802] [INFO ] [REMOTE ] PML: Fetching primary data for 2024-12. [2025-09-26T20:47:09.610126] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-26T20:47:09.711251] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-26T20:47:09.724170] [INFO ] [REMOTE ] PLD: Full fetch complete (77390 records). [2025-09-26T20:47:09.724420] [DEBUG] [VALIDATOR ] PLD: Validating primary data. [2025-09-26T20:47:10.138771] [DEBUG] [VALIDATOR ] PLD: All expected trading days are present. [2025-09-26T20:47:10.138891] [DEBUG] [VALIDATOR ] PLD: Primary data validation passed. [2025-09-26T20:47:10.140256] [INFO ] [MAIN ] PLD: Fetched primary data is valid. [2025-09-26T20:47:10.140350] [DEBUG] [LOCAL ] PLD: Saving primary data. [2025-09-26T20:47:10.142536] [DEBUG] [LOCAL ] PLD: Trimmed 77390 records to 54226 (keeping 200 days of data) [2025-09-26T20:47:10.345352] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-04. [2025-09-26T20:47:10.526586] [DEBUG] [LOCAL ] PLD: Primary data saved (54226 records). [2025-09-26T20:47:10.526870] [INFO ] [MAIN ] PLD: Full history saved. [2025-09-26T20:47:10.527054] [INFO ] [MAIN ] Update Progress: 1701/2371 symbols completed. PLD took 41.8s. Estimated remaining: 1h 29m 28s. Rate: 7.5 symbols/min [2025-09-26T20:47:10.707163] [INFO ] [MAIN ] PMM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:47:10.720009] [DEBUG] [LOCAL ] PMM: Loaded 10692 existing records from primary storage. [2025-09-26T20:47:10.720201] [INFO ] [MAIN ] PMM: Loaded 10692 existing records. [2025-09-26T20:47:10.914890] [WARN ] [MAIN ] PMM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:47:10.915495] [INFO ] [MAIN ] PMM: Wiping existing primary data before full refresh. [2025-09-26T20:47:10.915619] [INFO ] [LOCAL ] PMM: Starting deletion of primary data. [2025-09-26T20:47:10.921430] [DEBUG] [LOCAL ] PMM: Deleted primary data file. [2025-09-26T20:47:10.921532] [INFO ] [MAIN ] PMM: Starting full primary refresh. [2025-09-26T20:47:11.015162] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-26T20:47:11.114344] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-01. [2025-09-26T20:47:11.313636] [INFO ] [REMOTE ] PMM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:47:11.824916] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-26T20:47:11.911758] [INFO ] [REMOTE ] PMM: Fetching primary data for 2024-12. [2025-09-26T20:47:12.295621] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-26T20:47:12.711734] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-02. [2025-09-26T20:47:12.919565] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-26T20:47:13.511691] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-01. [2025-09-26T20:47:13.745278] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-26T20:47:14.311753] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-05. [2025-09-26T20:47:14.491013] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-26T20:47:15.111759] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-03. [2025-09-26T20:47:15.654500] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-26T20:47:15.794935] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-26T20:47:15.911756] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-04. [2025-09-26T20:47:16.711739] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-02. [2025-09-26T20:47:17.511747] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-06. [2025-09-26T20:47:17.782847] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-26T20:47:18.267588] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-26T20:47:18.311741] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-02. [2025-09-26T20:47:18.721379] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-26T20:47:19.111699] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-05. [2025-09-26T20:47:19.145056] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-26T20:47:19.911736] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-03. [2025-09-26T20:47:20.108013] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-26T20:47:20.711697] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-06. [2025-09-26T20:47:20.847475] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-26T20:47:21.511746] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-03. [2025-09-26T20:47:21.776997] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-26T20:47:22.311691] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-07. [2025-09-26T20:47:22.535887] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-26T20:47:23.111736] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-04. [2025-09-26T20:47:23.703758] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-26T20:47:23.911751] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-08. [2025-09-26T20:47:24.113287] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-26T20:47:24.711766] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-05. [2025-09-26T20:47:25.467228] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-26T20:47:25.511694] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-07. [2025-09-26T20:47:25.554628] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-26T20:47:26.311711] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-06. [2025-09-26T20:47:26.521689] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-26T20:47:27.102278] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-26T20:47:27.111675] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-07. [2025-09-26T20:47:27.911715] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-04. [2025-09-26T20:47:27.938463] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-26T20:47:28.711706] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-09. [2025-09-26T20:47:28.871163] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-26T20:47:29.511738] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-05. [2025-09-26T20:47:30.294733] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-26T20:47:30.304946] [INFO ] [REMOTE ] PLYM: Full fetch complete (46788 records). [2025-09-26T20:47:30.305128] [DEBUG] [VALIDATOR ] PLYM: Validating primary data. [2025-09-26T20:47:30.318588] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-08. [2025-09-26T20:47:30.691255] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-26T20:47:30.794184] [DEBUG] [VALIDATOR ] PLYM: All expected trading days are present. [2025-09-26T20:47:30.794270] [DEBUG] [VALIDATOR ] PLYM: Primary data validation passed. [2025-09-26T20:47:30.795173] [INFO ] [MAIN ] PLYM: Fetched primary data is valid. [2025-09-26T20:47:30.795239] [DEBUG] [LOCAL ] PLYM: Saving primary data. [2025-09-26T20:47:30.796388] [DEBUG] [LOCAL ] PLYM: Trimmed 46788 records to 33884 (keeping 200 days of data) [2025-09-26T20:47:31.013308] [DEBUG] [LOCAL ] PLYM: Primary data saved (33884 records). [2025-09-26T20:47:31.013460] [INFO ] [MAIN ] PLYM: Full history saved. [2025-09-26T20:47:31.013565] [INFO ] [MAIN ] Update Progress: 1702/2371 symbols completed. PLYM took 32.5s. Estimated remaining: 1h 29m 25s. Rate: 7.5 symbols/min [2025-09-26T20:47:31.116857] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-08. [2025-09-26T20:47:31.193407] [INFO ] [MAIN ] PMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:47:31.207295] [DEBUG] [LOCAL ] PMO: Loaded 10470 existing records from primary storage. [2025-09-26T20:47:31.207431] [INFO ] [MAIN ] PMO: Loaded 10470 existing records. [2025-09-26T20:47:31.411624] [WARN ] [MAIN ] PMO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:47:31.412174] [INFO ] [MAIN ] PMO: Wiping existing primary data before full refresh. [2025-09-26T20:47:31.412329] [INFO ] [LOCAL ] PMO: Starting deletion of primary data. [2025-09-26T20:47:31.412834] [DEBUG] [LOCAL ] PMO: Deleted primary data file. [2025-09-26T20:47:31.412898] [INFO ] [MAIN ] PMO: Starting full primary refresh. [2025-09-26T20:47:31.721865] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-26T20:47:31.853839] [INFO ] [REMOTE ] PMO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:47:31.911722] [INFO ] [REMOTE ] PMO: Fetching primary data for 2024-12. [2025-09-26T20:47:31.983355] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-26T20:47:32.711721] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-09. [2025-09-26T20:47:33.208626] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-26T20:47:33.511722] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-01. [2025-09-26T20:47:33.704516] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-26T20:47:33.710712] [INFO ] [REMOTE ] PML: Full fetch complete (29798 records). [2025-09-26T20:47:33.710817] [DEBUG] [VALIDATOR ] PML: Validating primary data. [2025-09-26T20:47:34.125002] [DEBUG] [VALIDATOR ] PML: All expected trading days are present. [2025-09-26T20:47:34.125157] [DEBUG] [VALIDATOR ] PML: Primary data validation passed. [2025-09-26T20:47:34.125875] [INFO ] [MAIN ] PML: Fetched primary data is valid. [2025-09-26T20:47:34.125943] [DEBUG] [LOCAL ] PML: Saving primary data. [2025-09-26T20:47:34.126780] [DEBUG] [LOCAL ] PML: Trimmed 29798 records to 20999 (keeping 200 days of data) [2025-09-26T20:47:34.257108] [DEBUG] [LOCAL ] PML: Primary data saved (20999 records). [2025-09-26T20:47:34.257234] [INFO ] [MAIN ] PML: Full history saved. [2025-09-26T20:47:34.257333] [INFO ] [MAIN ] Update Progress: 1703/2371 symbols completed. PML took 26.3s. Estimated remaining: 1h 29m 15s. Rate: 7.5 symbols/min [2025-09-26T20:47:34.323060] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-09. [2025-09-26T20:47:34.440673] [INFO ] [MAIN ] PMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:47:34.502456] [DEBUG] [LOCAL ] PMT: Loaded 40570 existing records from primary storage. [2025-09-26T20:47:34.502794] [INFO ] [MAIN ] PMT: Loaded 40570 existing records. [2025-09-26T20:47:34.636241] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-26T20:47:34.719674] [WARN ] [MAIN ] PMT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:47:34.720220] [INFO ] [MAIN ] PMT: Wiping existing primary data before full refresh. [2025-09-26T20:47:34.720290] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-09-26T20:47:34.721410] [DEBUG] [LOCAL ] PMT: Deleted primary data file. [2025-09-26T20:47:34.721492] [INFO ] [MAIN ] PMT: Starting full primary refresh. [2025-09-26T20:47:35.014079] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-26T20:47:35.043010] [INFO ] [REMOTE ] PMM: Full fetch complete (18256 records). [2025-09-26T20:47:35.053764] [DEBUG] [VALIDATOR ] PMM: Validating primary data. [2025-09-26T20:47:35.122039] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-02. [2025-09-26T20:47:35.190254] [INFO ] [REMOTE ] PMT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:47:35.597866] [DEBUG] [VALIDATOR ] PMM: All expected trading days are present. [2025-09-26T20:47:35.598009] [DEBUG] [VALIDATOR ] PMM: Primary data validation passed. [2025-09-26T20:47:35.598460] [INFO ] [MAIN ] PMM: Fetched primary data is valid. [2025-09-26T20:47:35.598522] [DEBUG] [LOCAL ] PMM: Saving primary data. [2025-09-26T20:47:35.600020] [DEBUG] [LOCAL ] PMM: Trimmed 18256 records to 10760 (keeping 200 days of data) [2025-09-26T20:47:35.669765] [DEBUG] [LOCAL ] PMM: Primary data saved (10760 records). [2025-09-26T20:47:35.669912] [INFO ] [MAIN ] PMM: Full history saved. [2025-09-26T20:47:35.670058] [INFO ] [MAIN ] Update Progress: 1704/2371 symbols completed. PMM took 25.1s. Estimated remaining: 1h 29m 4s. Rate: 7.5 symbols/min [2025-09-26T20:47:35.853668] [INFO ] [MAIN ] PMTU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:47:35.853872] [DEBUG] [LOCAL ] PMTU: No existing data file found in primary storage. [2025-09-26T20:47:35.853992] [WARN ] [MAIN ] PMTU: No existing data found, performing full refresh instead. [2025-09-26T20:47:35.854110] [INFO ] [MAIN ] PMTU: Wiping existing primary data before full refresh. [2025-09-26T20:47:35.854149] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-09-26T20:47:35.854190] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-09-26T20:47:35.854223] [INFO ] [MAIN ] PMTU: Starting full primary refresh. [2025-09-26T20:47:35.913789] [INFO ] [REMOTE ] PMT: Fetching primary data for 2024-12. [2025-09-26T20:47:36.174969] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-26T20:47:36.259306] [INFO ] [REMOTE ] PMTU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:47:36.711720] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-06. [2025-09-26T20:47:37.434749] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-26T20:47:37.511725] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-03. [2025-09-26T20:47:37.625925] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-26T20:47:38.311722] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2024-12. [2025-09-26T20:47:38.480730] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-26T20:47:38.821209] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-26T20:47:39.111720] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-01. [2025-09-26T20:47:39.911720] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-01. [2025-09-26T20:47:40.318136] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-26T20:47:40.684925] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T20:47:40.711673] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-02. [2025-09-26T20:47:41.511728] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-07. [2025-09-26T20:47:42.194018] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-26T20:47:42.317292] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-02. [2025-09-26T20:47:42.323799] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-26T20:47:42.807519] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-26T20:47:43.111732] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-03. [2025-09-26T20:47:43.911720] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-08. [2025-09-26T20:47:44.652998] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T20:47:44.711717] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-03. [2025-09-26T20:47:44.822423] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-26T20:47:45.095367] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-26T20:47:45.511721] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-09. [2025-09-26T20:47:46.311707] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-04. [2025-09-26T20:47:46.350183] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-26T20:47:46.361455] [INFO ] [REMOTE ] PM: Full fetch complete (77312 records). [2025-09-26T20:47:46.361698] [DEBUG] [VALIDATOR ] PM: Validating primary data. [2025-09-26T20:47:46.362751] [FATAL] [VALIDATOR ] PM: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T20:47:46.362854] [FATAL] [MAIN ] PM: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:47:46.362899] [WARN ] [MAIN ] PM: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:47:46.362948] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-09-26T20:47:46.363033] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-09-26T20:47:46.363072] [INFO ] [LOCAL ] PM: Starting deletion of derivative data. [2025-09-26T20:47:46.363131] [DEBUG] [LOCAL ] PM: No derivative data file found to delete. [2025-09-26T20:47:46.363230] [INFO ] [MAIN ] Update Progress: 1705/2371 symbols completed. PM took 44.8s. Estimated remaining: 1h 28m 57s. Rate: 7.5 symbols/min [2025-09-26T20:47:46.539437] [INFO ] [MAIN ] PMTV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:47:46.539613] [DEBUG] [LOCAL ] PMTV: No existing data file found in primary storage. [2025-09-26T20:47:46.539710] [WARN ] [MAIN ] PMTV: No existing data found, performing full refresh instead. [2025-09-26T20:47:46.539860] [INFO ] [MAIN ] PMTV: Wiping existing primary data before full refresh. [2025-09-26T20:47:46.539903] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-09-26T20:47:46.539945] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-09-26T20:47:46.539976] [INFO ] [MAIN ] PMTV: Starting full primary refresh. [2025-09-26T20:47:46.928019] [INFO ] [REMOTE ] PMTV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:47:47.111716] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-04. [2025-09-26T20:47:47.367362] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-26T20:47:47.911721] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-05. [2025-09-26T20:47:48.711707] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2024-12. [2025-09-26T20:47:48.727084] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-26T20:47:48.973932] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-26T20:47:48.974497] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:47:48.984601] [WARN ] [REMOTE ] PMTV: No data returned for month 2024-12 [2025-09-26T20:47:49.511726] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-05. [2025-09-26T20:47:50.311718] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-04. [2025-09-26T20:47:50.844160] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-26T20:47:51.076157] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-26T20:47:51.111710] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-06. [2025-09-26T20:47:51.911708] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-06. [2025-09-26T20:47:51.982119] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-26T20:47:52.711722] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-07. [2025-09-26T20:47:53.396618] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-26T20:47:53.492277] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-26T20:47:53.511696] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-07. [2025-09-26T20:47:54.311715] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-05. [2025-09-26T20:47:54.718012] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-26T20:47:55.111709] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-08. [2025-09-26T20:47:55.157139] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-26T20:47:55.911728] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-06. [2025-09-26T20:47:55.931886] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-26T20:47:56.289072] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-26T20:47:56.711751] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-09. [2025-09-26T20:47:57.511722] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-07. [2025-09-26T20:47:57.707075] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-26T20:47:57.709502] [INFO ] [REMOTE ] PMO: Full fetch complete (17415 records). [2025-09-26T20:47:57.709577] [DEBUG] [VALIDATOR ] PMO: Validating primary data. [2025-09-26T20:47:57.994070] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-26T20:47:58.119771] [DEBUG] [VALIDATOR ] PMO: All expected trading days are present. [2025-09-26T20:47:58.119868] [DEBUG] [VALIDATOR ] PMO: Primary data validation passed. [2025-09-26T20:47:58.120341] [INFO ] [MAIN ] PMO: Fetched primary data is valid. [2025-09-26T20:47:58.120406] [DEBUG] [LOCAL ] PMO: Saving primary data. [2025-09-26T20:47:58.121199] [DEBUG] [LOCAL ] PMO: Trimmed 17415 records to 10547 (keeping 200 days of data) [2025-09-26T20:47:58.200926] [DEBUG] [LOCAL ] PMO: Primary data saved (10547 records). [2025-09-26T20:47:58.201091] [INFO ] [MAIN ] PMO: Full history saved. [2025-09-26T20:47:58.201262] [INFO ] [MAIN ] Update Progress: 1706/2371 symbols completed. PMO took 27.2s. Estimated remaining: 1h 28m 51s. Rate: 7.5 symbols/min [2025-09-26T20:47:58.316874] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-08. [2025-09-26T20:47:58.387681] [INFO ] [MAIN ] PMTW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:47:58.388245] [DEBUG] [LOCAL ] PMTW: No existing data file found in primary storage. [2025-09-26T20:47:58.388306] [WARN ] [MAIN ] PMTW: No existing data found, performing full refresh instead. [2025-09-26T20:47:58.388475] [INFO ] [MAIN ] PMTW: Wiping existing primary data before full refresh. [2025-09-26T20:47:58.388521] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-09-26T20:47:58.388566] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-09-26T20:47:58.388601] [INFO ] [MAIN ] PMTW: Starting full primary refresh. [2025-09-26T20:47:58.771290] [INFO ] [REMOTE ] PMTW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:47:58.777452] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-26T20:47:59.111854] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-01. [2025-09-26T20:47:59.370216] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:47:59.370611] [WARN ] [REMOTE ] PMTV: No data returned for month 2025-01 [2025-09-26T20:47:59.911745] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-02. [2025-09-26T20:48:00.711736] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-08. [2025-09-26T20:48:00.753200] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-26T20:48:01.511836] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-09. [2025-09-26T20:48:01.940057] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-26T20:48:01.940972] [INFO ] [REMOTE ] PMTU: Full fetch complete (1236 records). [2025-09-26T20:48:01.941044] [DEBUG] [VALIDATOR ] PMTU: Validating primary data. [2025-09-26T20:48:02.140074] [WARN ] [VALIDATOR ] PMTU: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-26T20:48:02.140523] [FATAL] [MAIN ] PMTU: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:48:02.140695] [WARN ] [MAIN ] PMTU: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:48:02.140799] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-09-26T20:48:02.141090] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-09-26T20:48:02.141242] [INFO ] [LOCAL ] PMTU: Starting deletion of derivative data. [2025-09-26T20:48:02.141331] [DEBUG] [LOCAL ] PMTU: No derivative data file found to delete. [2025-09-26T20:48:02.141424] [INFO ] [MAIN ] Update Progress: 1707/2371 symbols completed. PMTU took 26.5s. Estimated remaining: 1h 28m 41s. Rate: 7.5 symbols/min [2025-09-26T20:48:02.319773] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-03. [2025-09-26T20:48:02.340401] [INFO ] [MAIN ] PNC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:48:02.341848] [DEBUG] [LOCAL ] PNC: No existing data file found in primary storage. [2025-09-26T20:48:02.341948] [WARN ] [MAIN ] PNC: No existing data found, performing full refresh instead. [2025-09-26T20:48:02.366157] [INFO ] [MAIN ] PNC: Wiping existing primary data before full refresh. [2025-09-26T20:48:02.367195] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-09-26T20:48:02.368416] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-26T20:48:02.377054] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-09-26T20:48:02.377568] [INFO ] [MAIN ] PNC: Starting full primary refresh. [2025-09-26T20:48:02.762155] [INFO ] [REMOTE ] PNC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:48:02.972217] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-26T20:48:03.111735] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-09. [2025-09-26T20:48:03.911720] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2024-12. [2025-09-26T20:48:04.196045] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:48:04.196398] [WARN ] [REMOTE ] PMTW: No data returned for month 2024-12 [2025-09-26T20:48:04.646881] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-26T20:48:04.659562] [INFO ] [REMOTE ] PMT: Full fetch complete (58183 records). [2025-09-26T20:48:04.659811] [DEBUG] [VALIDATOR ] PMT: Validating primary data. [2025-09-26T20:48:04.716882] [INFO ] [REMOTE ] PNC: Fetching primary data for 2024-12. [2025-09-26T20:48:05.069794] [DEBUG] [VALIDATOR ] PMT: All expected trading days are present. [2025-09-26T20:48:05.069905] [DEBUG] [VALIDATOR ] PMT: Primary data validation passed. [2025-09-26T20:48:05.070811] [INFO ] [MAIN ] PMT: Fetched primary data is valid. [2025-09-26T20:48:05.070877] [DEBUG] [LOCAL ] PMT: Saving primary data. [2025-09-26T20:48:05.072166] [DEBUG] [LOCAL ] PMT: Trimmed 58183 records to 40798 (keeping 200 days of data) [2025-09-26T20:48:05.339816] [DEBUG] [LOCAL ] PMT: Primary data saved (40798 records). [2025-09-26T20:48:05.339949] [INFO ] [MAIN ] PMT: Full history saved. [2025-09-26T20:48:05.340050] [INFO ] [MAIN ] Update Progress: 1708/2371 symbols completed. PMT took 31.1s. Estimated remaining: 1h 28m 31s. Rate: 7.5 symbols/min [2025-09-26T20:48:05.518175] [INFO ] [MAIN ] PNI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:48:05.518285] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-01. [2025-09-26T20:48:05.528894] [DEBUG] [LOCAL ] PNI: Loaded 6775 existing records from primary storage. [2025-09-26T20:48:05.529034] [INFO ] [MAIN ] PNI: Loaded 6775 existing records. [2025-09-26T20:48:05.721598] [WARN ] [MAIN ] PNI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:48:05.721900] [INFO ] [MAIN ] PNI: Wiping existing primary data before full refresh. [2025-09-26T20:48:05.721955] [INFO ] [LOCAL ] PNI: Starting deletion of primary data. [2025-09-26T20:48:05.722380] [DEBUG] [LOCAL ] PNI: Deleted primary data file. [2025-09-26T20:48:05.722440] [INFO ] [MAIN ] PNI: Starting full primary refresh. [2025-09-26T20:48:05.838712] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:48:05.854587] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-01 [2025-09-26T20:48:06.098800] [INFO ] [REMOTE ] PNI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:48:06.311706] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-02. [2025-09-26T20:48:06.540599] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-26T20:48:06.578321] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:48:06.578706] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-02 [2025-09-26T20:48:07.111768] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-04. [2025-09-26T20:48:07.866368] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-26T20:48:07.911711] [INFO ] [REMOTE ] PNI: Fetching primary data for 2024-12. [2025-09-26T20:48:08.711718] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-05. [2025-09-26T20:48:08.968487] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-26T20:48:09.349008] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-26T20:48:09.511743] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-06. [2025-09-26T20:48:10.161142] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-26T20:48:10.311724] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-01. [2025-09-26T20:48:11.111720] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-07. [2025-09-26T20:48:11.729109] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-26T20:48:11.911719] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-03. [2025-09-26T20:48:12.162083] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:48:12.162424] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-03 [2025-09-26T20:48:12.404742] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-26T20:48:12.711726] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-02. [2025-09-26T20:48:13.511721] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-08. [2025-09-26T20:48:14.211397] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-26T20:48:14.311705] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-01. [2025-09-26T20:48:14.409299] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-26T20:48:15.111721] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-09. [2025-09-26T20:48:15.132046] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-26T20:48:15.668369] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-26T20:48:15.669855] [INFO ] [REMOTE ] PMTV: Full fetch complete (6158 records). [2025-09-26T20:48:15.669932] [DEBUG] [VALIDATOR ] PMTV: Validating primary data. [2025-09-26T20:48:15.866713] [WARN ] [VALIDATOR ] PMTV: Validation failed - insufficient historical data. Have 155 unique days, need 200 days [2025-09-26T20:48:15.866968] [FATAL] [MAIN ] PMTV: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:48:15.867040] [WARN ] [MAIN ] PMTV: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:48:15.867114] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-09-26T20:48:15.867182] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-09-26T20:48:15.867222] [INFO ] [LOCAL ] PMTV: Starting deletion of derivative data. [2025-09-26T20:48:15.867265] [DEBUG] [LOCAL ] PMTV: No derivative data file found to delete. [2025-09-26T20:48:15.867327] [INFO ] [MAIN ] Update Progress: 1709/2371 symbols completed. PMTV took 29.5s. Estimated remaining: 1h 28m 24s. Rate: 7.5 symbols/min [2025-09-26T20:48:15.916784] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-02. [2025-09-26T20:48:16.052291] [INFO ] [MAIN ] PNNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:48:16.095441] [DEBUG] [LOCAL ] PNNT: Loaded 33086 existing records from primary storage. [2025-09-26T20:48:16.095609] [INFO ] [MAIN ] PNNT: Loaded 33086 existing records. [2025-09-26T20:48:16.288142] [WARN ] [MAIN ] PNNT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:48:16.288434] [INFO ] [MAIN ] PNNT: Wiping existing primary data before full refresh. [2025-09-26T20:48:16.288489] [INFO ] [LOCAL ] PNNT: Starting deletion of primary data. [2025-09-26T20:48:16.289297] [DEBUG] [LOCAL ] PNNT: Deleted primary data file. [2025-09-26T20:48:16.289361] [INFO ] [MAIN ] PNNT: Starting full primary refresh. [2025-09-26T20:48:16.692039] [INFO ] [REMOTE ] PNNT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:48:16.711679] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-03. [2025-09-26T20:48:16.785446] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-26T20:48:17.511714] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-04. [2025-09-26T20:48:17.778597] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:48:17.779018] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-04 [2025-09-26T20:48:18.311711] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2024-12. [2025-09-26T20:48:18.560745] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-26T20:48:19.111723] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-03. [2025-09-26T20:48:19.412290] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-26T20:48:19.767675] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-26T20:48:19.911735] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-04. [2025-09-26T20:48:20.711719] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-05. [2025-09-26T20:48:20.969132] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:48:20.969464] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-05 [2025-09-26T20:48:21.511704] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-01. [2025-09-26T20:48:21.940576] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-26T20:48:22.311727] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-04. [2025-09-26T20:48:22.996957] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-26T20:48:23.111973] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-02. [2025-09-26T20:48:23.112922] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-26T20:48:23.911730] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-06. [2025-09-26T20:48:24.548614] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-26T20:48:24.700678] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-26T20:48:24.711701] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-07. [2025-09-26T20:48:25.467627] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-26T20:48:25.511719] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-05. [2025-09-26T20:48:26.271202] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-26T20:48:26.311726] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-08. [2025-09-26T20:48:27.013671] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-26T20:48:27.111734] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-09. [2025-09-26T20:48:27.640799] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-26T20:48:27.642280] [INFO ] [REMOTE ] PMTW: Full fetch complete (3702 records). [2025-09-26T20:48:27.642362] [DEBUG] [VALIDATOR ] PMTW: Validating primary data. [2025-09-26T20:48:27.837000] [WARN ] [VALIDATOR ] PMTW: Validation failed - insufficient historical data. Have 74 unique days, need 200 days [2025-09-26T20:48:27.837256] [FATAL] [MAIN ] PMTW: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:48:27.837330] [WARN ] [MAIN ] PMTW: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:48:27.837403] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-09-26T20:48:27.837470] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-09-26T20:48:27.837578] [INFO ] [LOCAL ] PMTW: Starting deletion of derivative data. [2025-09-26T20:48:27.837665] [DEBUG] [LOCAL ] PMTW: No derivative data file found to delete. [2025-09-26T20:48:27.837748] [INFO ] [MAIN ] Update Progress: 1710/2371 symbols completed. PMTW took 29.6s. Estimated remaining: 1h 28m 18s. Rate: 7.5 symbols/min [2025-09-26T20:48:27.916850] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-03. [2025-09-26T20:48:28.024329] [INFO ] [MAIN ] PNR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:48:28.024519] [DEBUG] [LOCAL ] PNR: No existing data file found in primary storage. [2025-09-26T20:48:28.024577] [WARN ] [MAIN ] PNR: No existing data found, performing full refresh instead. [2025-09-26T20:48:28.024750] [INFO ] [MAIN ] PNR: Wiping existing primary data before full refresh. [2025-09-26T20:48:28.024802] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-09-26T20:48:28.024848] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-09-26T20:48:28.024887] [INFO ] [MAIN ] PNR: Starting full primary refresh. [2025-09-26T20:48:28.390914] [INFO ] [REMOTE ] PNR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:48:28.711745] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-06. [2025-09-26T20:48:29.333879] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-26T20:48:29.356443] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-26T20:48:29.511734] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-07. [2025-09-26T20:48:30.195619] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-26T20:48:30.311724] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-05. [2025-09-26T20:48:31.111751] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-04. [2025-09-26T20:48:31.911735] [INFO ] [REMOTE ] PNR: Fetching primary data for 2024-12. [2025-09-26T20:48:32.149328] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-26T20:48:32.541800] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-26T20:48:32.711713] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-06. [2025-09-26T20:48:33.511705] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-08. [2025-09-26T20:48:33.628592] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-26T20:48:34.236972] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-26T20:48:34.311723] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-01. [2025-09-26T20:48:34.360897] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-26T20:48:35.111741] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-05. [2025-09-26T20:48:35.895930] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-26T20:48:35.911666] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-02. [2025-09-26T20:48:36.546852] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-26T20:48:36.711741] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-07. [2025-09-26T20:48:37.511716] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-09. [2025-09-26T20:48:37.567982] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-26T20:48:38.311743] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-06. [2025-09-26T20:48:38.342059] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-26T20:48:38.344426] [INFO ] [REMOTE ] PNI: Full fetch complete (9903 records). [2025-09-26T20:48:38.344524] [DEBUG] [VALIDATOR ] PNI: Validating primary data. [2025-09-26T20:48:38.785179] [DEBUG] [VALIDATOR ] PNI: All expected trading days are present. [2025-09-26T20:48:38.785328] [DEBUG] [VALIDATOR ] PNI: Primary data validation passed. [2025-09-26T20:48:38.785706] [INFO ] [MAIN ] PNI: Fetched primary data is valid. [2025-09-26T20:48:38.785847] [DEBUG] [LOCAL ] PNI: Saving primary data. [2025-09-26T20:48:38.786690] [DEBUG] [LOCAL ] PNI: Trimmed 9903 records to 6782 (keeping 200 days of data) [2025-09-26T20:48:38.860246] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-26T20:48:38.883839] [DEBUG] [LOCAL ] PNI: Primary data saved (6782 records). [2025-09-26T20:48:38.883997] [INFO ] [MAIN ] PNI: Full history saved. [2025-09-26T20:48:38.884094] [INFO ] [MAIN ] Update Progress: 1711/2371 symbols completed. PNI took 33.5s. Estimated remaining: 1h 28m 11s. Rate: 7.5 symbols/min [2025-09-26T20:48:39.072108] [INFO ] [MAIN ] PNW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:48:39.120269] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-08. [2025-09-26T20:48:39.124754] [DEBUG] [LOCAL ] PNW: Loaded 46164 existing records from primary storage. [2025-09-26T20:48:39.124937] [INFO ] [MAIN ] PNW: Loaded 46164 existing records. [2025-09-26T20:48:39.325066] [WARN ] [MAIN ] PNW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:48:39.325338] [INFO ] [MAIN ] PNW: Wiping existing primary data before full refresh. [2025-09-26T20:48:39.325386] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-09-26T20:48:39.326477] [DEBUG] [LOCAL ] PNW: Deleted primary data file. [2025-09-26T20:48:39.326539] [INFO ] [MAIN ] PNW: Starting full primary refresh. [2025-09-26T20:48:39.708967] [INFO ] [REMOTE ] PNW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:48:39.727728] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-26T20:48:39.911738] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-07. [2025-09-26T20:48:40.711690] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-03. [2025-09-26T20:48:40.989965] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-26T20:48:41.407066] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-26T20:48:41.511735] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-08. [2025-09-26T20:48:42.311717] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-09. [2025-09-26T20:48:42.550817] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-26T20:48:42.681613] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-26T20:48:42.691832] [INFO ] [REMOTE ] PNC: Full fetch complete (75172 records). [2025-09-26T20:48:42.692065] [DEBUG] [VALIDATOR ] PNC: Validating primary data. [2025-09-26T20:48:42.695378] [FATAL] [VALIDATOR ] PNC: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T20:48:42.695514] [FATAL] [MAIN ] PNC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:48:42.695564] [WARN ] [MAIN ] PNC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:48:42.695633] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-09-26T20:48:42.695748] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-09-26T20:48:42.695791] [INFO ] [LOCAL ] PNC: Starting deletion of derivative data. [2025-09-26T20:48:42.695856] [DEBUG] [LOCAL ] PNC: No derivative data file found to delete. [2025-09-26T20:48:42.695994] [INFO ] [MAIN ] Update Progress: 1712/2371 symbols completed. PNC took 40.6s. Estimated remaining: 1h 28m 1s. Rate: 7.5 symbols/min [2025-09-26T20:48:42.880458] [INFO ] [MAIN ] POR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:48:42.937990] [DEBUG] [LOCAL ] POR: Loaded 47392 existing records from primary storage. [2025-09-26T20:48:42.957425] [INFO ] [MAIN ] POR: Loaded 47392 existing records. [2025-09-26T20:48:43.006484] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-26T20:48:43.122772] [INFO ] [REMOTE ] PNW: Fetching primary data for 2024-12. [2025-09-26T20:48:43.168132] [WARN ] [MAIN ] POR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:48:43.168402] [INFO ] [MAIN ] POR: Wiping existing primary data before full refresh. [2025-09-26T20:48:43.168457] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-09-26T20:48:43.169715] [DEBUG] [LOCAL ] POR: Deleted primary data file. [2025-09-26T20:48:43.169783] [INFO ] [MAIN ] POR: Starting full primary refresh. [2025-09-26T20:48:43.543741] [INFO ] [REMOTE ] POR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:48:43.911730] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-09. [2025-09-26T20:48:44.711718] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-04. [2025-09-26T20:48:44.956060] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-26T20:48:45.314403] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-26T20:48:45.321495] [INFO ] [REMOTE ] PNNT: Full fetch complete (47176 records). [2025-09-26T20:48:45.321681] [DEBUG] [VALIDATOR ] PNNT: Validating primary data. [2025-09-26T20:48:45.514683] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-01. [2025-09-26T20:48:45.737544] [DEBUG] [VALIDATOR ] PNNT: All expected trading days are present. [2025-09-26T20:48:45.737633] [DEBUG] [VALIDATOR ] PNNT: Primary data validation passed. [2025-09-26T20:48:45.738687] [INFO ] [MAIN ] PNNT: Fetched primary data is valid. [2025-09-26T20:48:45.738769] [DEBUG] [LOCAL ] PNNT: Saving primary data. [2025-09-26T20:48:45.740086] [DEBUG] [LOCAL ] PNNT: Trimmed 47176 records to 33337 (keeping 200 days of data) [2025-09-26T20:48:45.958234] [DEBUG] [LOCAL ] PNNT: Primary data saved (33337 records). [2025-09-26T20:48:45.958501] [INFO ] [MAIN ] PNNT: Full history saved. [2025-09-26T20:48:45.958612] [INFO ] [MAIN ] Update Progress: 1713/2371 symbols completed. PNNT took 30.1s. Estimated remaining: 1h 27m 51s. Rate: 7.5 symbols/min [2025-09-26T20:48:46.154208] [INFO ] [MAIN ] POST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:48:46.196730] [DEBUG] [LOCAL ] POST: Loaded 39228 existing records from primary storage. [2025-09-26T20:48:46.196919] [INFO ] [MAIN ] POST: Loaded 39228 existing records. [2025-09-26T20:48:46.316858] [INFO ] [REMOTE ] POR: Fetching primary data for 2024-12. [2025-09-26T20:48:46.388275] [WARN ] [MAIN ] POST: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:48:46.388674] [INFO ] [MAIN ] POST: Wiping existing primary data before full refresh. [2025-09-26T20:48:46.388736] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-09-26T20:48:46.389725] [DEBUG] [LOCAL ] POST: Deleted primary data file. [2025-09-26T20:48:46.389786] [INFO ] [MAIN ] POST: Starting full primary refresh. [2025-09-26T20:48:46.819731] [INFO ] [REMOTE ] POST: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:48:46.857468] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-26T20:48:47.036528] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-26T20:48:47.111753] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-05. [2025-09-26T20:48:47.911742] [INFO ] [REMOTE ] POST: Fetching primary data for 2024-12. [2025-09-26T20:48:48.043454] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-26T20:48:48.711755] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-01. [2025-09-26T20:48:48.878238] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-26T20:48:48.988059] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-26T20:48:49.511793] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-02. [2025-09-26T20:48:50.311710] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-01. [2025-09-26T20:48:50.358298] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-26T20:48:51.060447] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-26T20:48:51.111688] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-03. [2025-09-26T20:48:51.805366] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-26T20:48:51.911768] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-06. [2025-09-26T20:48:52.711739] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-02. [2025-09-26T20:48:52.780046] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-26T20:48:53.520873] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-02. [2025-09-26T20:48:53.526504] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-26T20:48:54.291619] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-26T20:48:54.311718] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-04. [2025-09-26T20:48:54.782279] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-26T20:48:55.111718] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-07. [2025-09-26T20:48:55.750980] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-26T20:48:55.911718] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-03. [2025-09-26T20:48:56.711727] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-03. [2025-09-26T20:48:56.974490] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-26T20:48:57.511727] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-05. [2025-09-26T20:48:57.639722] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-26T20:48:58.311736] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-04. [2025-09-26T20:48:58.347028] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-26T20:48:59.111691] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-08. [2025-09-26T20:48:59.169432] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-26T20:48:59.911706] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-04. [2025-09-26T20:49:00.113792] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-26T20:49:00.702579] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-26T20:49:00.712326] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-06. [2025-09-26T20:49:01.519941] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-09. [2025-09-26T20:49:01.526673] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-26T20:49:02.317140] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-05. [2025-09-26T20:49:02.332804] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-26T20:49:02.363347] [INFO ] [REMOTE ] PNR: Full fetch complete (68935 records). [2025-09-26T20:49:02.378736] [DEBUG] [VALIDATOR ] PNR: Validating primary data. [2025-09-26T20:49:02.380216] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-26T20:49:02.390242] [FATAL] [VALIDATOR ] PNR: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T20:49:02.390784] [FATAL] [MAIN ] PNR: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:49:02.390964] [WARN ] [MAIN ] PNR: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:49:02.391055] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-09-26T20:49:02.391453] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-09-26T20:49:02.391514] [INFO ] [LOCAL ] PNR: Starting deletion of derivative data. [2025-09-26T20:49:02.391574] [DEBUG] [LOCAL ] PNR: No derivative data file found to delete. [2025-09-26T20:49:02.391691] [INFO ] [MAIN ] Update Progress: 1714/2371 symbols completed. PNR took 34.6s. Estimated remaining: 1h 27m 46s. Rate: 7.5 symbols/min [2025-09-26T20:49:02.583237] [INFO ] [MAIN ] PPG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:49:02.654963] [DEBUG] [LOCAL ] PPG: Loaded 51078 existing records from primary storage. [2025-09-26T20:49:02.655115] [INFO ] [MAIN ] PPG: Loaded 51078 existing records. [2025-09-26T20:49:02.842282] [WARN ] [MAIN ] PPG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:49:02.842579] [INFO ] [MAIN ] PPG: Wiping existing primary data before full refresh. [2025-09-26T20:49:02.842661] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-09-26T20:49:02.844139] [DEBUG] [LOCAL ] PPG: Deleted primary data file. [2025-09-26T20:49:02.844208] [INFO ] [MAIN ] PPG: Starting full primary refresh. [2025-09-26T20:49:03.116946] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-07. [2025-09-26T20:49:03.219663] [INFO ] [REMOTE ] PPG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:49:03.911690] [INFO ] [REMOTE ] PPG: Fetching primary data for 2024-12. [2025-09-26T20:49:04.126279] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-26T20:49:04.711725] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-06. [2025-09-26T20:49:04.915020] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-26T20:49:05.511737] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-08. [2025-09-26T20:49:05.908993] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-26T20:49:06.014381] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-26T20:49:06.311766] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-01. [2025-09-26T20:49:07.111740] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-07. [2025-09-26T20:49:07.227427] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-26T20:49:07.911746] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-09. [2025-09-26T20:49:08.294618] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-26T20:49:08.711707] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-02. [2025-09-26T20:49:08.795172] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-26T20:49:09.070964] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-26T20:49:09.079930] [INFO ] [REMOTE ] PNW: Full fetch complete (66112 records). [2025-09-26T20:49:09.080130] [DEBUG] [VALIDATOR ] PNW: Validating primary data. [2025-09-26T20:49:09.480897] [DEBUG] [VALIDATOR ] PNW: All expected trading days are present. [2025-09-26T20:49:09.481000] [DEBUG] [VALIDATOR ] PNW: Primary data validation passed. [2025-09-26T20:49:09.481961] [INFO ] [MAIN ] PNW: Fetched primary data is valid. [2025-09-26T20:49:09.482040] [DEBUG] [LOCAL ] PNW: Saving primary data. [2025-09-26T20:49:09.483488] [DEBUG] [LOCAL ] PNW: Trimmed 66112 records to 46531 (keeping 200 days of data) [2025-09-26T20:49:09.539255] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-05. [2025-09-26T20:49:09.800454] [DEBUG] [LOCAL ] PNW: Primary data saved (46531 records). [2025-09-26T20:49:09.800673] [INFO ] [MAIN ] PNW: Full history saved. [2025-09-26T20:49:09.800835] [INFO ] [MAIN ] Update Progress: 1715/2371 symbols completed. PNW took 30.9s. Estimated remaining: 1h 27m 38s. Rate: 7.5 symbols/min [2025-09-26T20:49:10.010781] [INFO ] [MAIN ] PPL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:49:10.011020] [DEBUG] [LOCAL ] PPL: No existing data file found in primary storage. [2025-09-26T20:49:10.011077] [WARN ] [MAIN ] PPL: No existing data found, performing full refresh instead. [2025-09-26T20:49:10.011227] [INFO ] [MAIN ] PPL: Wiping existing primary data before full refresh. [2025-09-26T20:49:10.011271] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-09-26T20:49:10.011314] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-09-26T20:49:10.011347] [INFO ] [MAIN ] PPL: Starting full primary refresh. [2025-09-26T20:49:10.316139] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-08. [2025-09-26T20:49:10.442361] [INFO ] [REMOTE ] PPL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:49:10.604682] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-26T20:49:11.111693] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-03. [2025-09-26T20:49:11.215769] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-26T20:49:11.911790] [INFO ] [REMOTE ] PPL: Fetching primary data for 2024-12. [2025-09-26T20:49:11.953849] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-26T20:49:12.711719] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-09. [2025-09-26T20:49:13.156251] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-26T20:49:13.287862] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-26T20:49:13.511729] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-04. [2025-09-26T20:49:14.311686] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-06. [2025-09-26T20:49:14.411699] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-26T20:49:14.420454] [INFO ] [REMOTE ] POST: Full fetch complete (55855 records). [2025-09-26T20:49:14.420671] [DEBUG] [VALIDATOR ] POST: Validating primary data. [2025-09-26T20:49:14.840434] [DEBUG] [VALIDATOR ] POST: All expected trading days are present. [2025-09-26T20:49:14.840531] [DEBUG] [VALIDATOR ] POST: Primary data validation passed. [2025-09-26T20:49:14.841520] [INFO ] [MAIN ] POST: Fetched primary data is valid. [2025-09-26T20:49:14.841589] [DEBUG] [LOCAL ] POST: Saving primary data. [2025-09-26T20:49:14.843018] [DEBUG] [LOCAL ] POST: Trimmed 55855 records to 39494 (keeping 200 days of data) [2025-09-26T20:49:15.095167] [DEBUG] [LOCAL ] POST: Primary data saved (39494 records). [2025-09-26T20:49:15.095497] [INFO ] [MAIN ] POST: Full history saved. [2025-09-26T20:49:15.095677] [INFO ] [MAIN ] Update Progress: 1716/2371 symbols completed. POST took 29.1s. Estimated remaining: 1h 27m 29s. Rate: 7.5 symbols/min [2025-09-26T20:49:15.129334] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-01. [2025-09-26T20:49:15.277776] [INFO ] [MAIN ] PPT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:49:15.300804] [DEBUG] [LOCAL ] PPT: Loaded 20177 existing records from primary storage. [2025-09-26T20:49:15.301048] [INFO ] [MAIN ] PPT: Loaded 20177 existing records. [2025-09-26T20:49:15.519829] [WARN ] [MAIN ] PPT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:49:15.520527] [INFO ] [MAIN ] PPT: Wiping existing primary data before full refresh. [2025-09-26T20:49:15.520734] [INFO ] [LOCAL ] PPT: Starting deletion of primary data. [2025-09-26T20:49:15.521519] [DEBUG] [LOCAL ] PPT: Deleted primary data file. [2025-09-26T20:49:15.521625] [INFO ] [MAIN ] PPT: Starting full primary refresh. [2025-09-26T20:49:15.820221] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-26T20:49:15.912761] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-05. [2025-09-26T20:49:15.994039] [INFO ] [REMOTE ] PPT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:49:16.030700] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-26T20:49:16.711695] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-07. [2025-09-26T20:49:17.065672] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-26T20:49:17.511732] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-02. [2025-09-26T20:49:17.623102] [DEBUG] [REMOTE ] PPL: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-26T20:49:17.623443] [WARN ] [REMOTE ] PPL: No data returned for month 2025-02 [2025-09-26T20:49:17.828864] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-26T20:49:18.311714] [INFO ] [REMOTE ] PPT: Fetching primary data for 2024-12. [2025-09-26T20:49:18.520902] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-26T20:49:19.111691] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-06. [2025-09-26T20:49:19.511963] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-26T20:49:19.911732] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-03. [2025-09-26T20:49:20.711710] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-08. [2025-09-26T20:49:20.924941] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-26T20:49:21.511732] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-01. [2025-09-26T20:49:21.892350] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-26T20:49:22.183509] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-26T20:49:22.311736] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-02. [2025-09-26T20:49:22.471267] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-26T20:49:23.111724] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-09. [2025-09-26T20:49:23.389892] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-26T20:49:23.911715] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-04. [2025-09-26T20:49:24.711727] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-07. [2025-09-26T20:49:24.841472] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-26T20:49:24.850764] [INFO ] [REMOTE ] POR: Full fetch complete (68211 records). [2025-09-26T20:49:24.850965] [DEBUG] [VALIDATOR ] POR: Validating primary data. [2025-09-26T20:49:25.267637] [DEBUG] [VALIDATOR ] POR: All expected trading days are present. [2025-09-26T20:49:25.267748] [DEBUG] [VALIDATOR ] POR: Primary data validation passed. [2025-09-26T20:49:25.268698] [INFO ] [MAIN ] POR: Fetched primary data is valid. [2025-09-26T20:49:25.268773] [DEBUG] [LOCAL ] POR: Saving primary data. [2025-09-26T20:49:25.270133] [DEBUG] [LOCAL ] POR: Trimmed 68211 records to 47706 (keeping 200 days of data) [2025-09-26T20:49:25.511890] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-03. [2025-09-26T20:49:25.577710] [DEBUG] [LOCAL ] POR: Primary data saved (47706 records). [2025-09-26T20:49:25.577879] [INFO ] [MAIN ] POR: Full history saved. [2025-09-26T20:49:25.578027] [INFO ] [MAIN ] Update Progress: 1717/2371 symbols completed. POR took 42.9s. Estimated remaining: 1h 27m 22s. Rate: 7.5 symbols/min [2025-09-26T20:49:25.851785] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-26T20:49:26.311735] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-05. [2025-09-26T20:49:26.640190] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-26T20:49:26.710238] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-26T20:49:27.111735] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-04. [2025-09-26T20:49:27.911763] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-08. [2025-09-26T20:49:28.278236] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-26T20:49:28.302970] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-26T20:49:28.711735] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-05. [2025-09-26T20:49:29.511687] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-06. [2025-09-26T20:49:29.782716] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-26T20:49:29.829067] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-26T20:49:30.311836] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-09. [2025-09-26T20:49:31.111825] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-06. [2025-09-26T20:49:31.432358] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-26T20:49:31.911705] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-07. [2025-09-26T20:49:32.087747] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-26T20:49:32.098552] [INFO ] [REMOTE ] PPG: Full fetch complete (73774 records). [2025-09-26T20:49:32.098821] [DEBUG] [VALIDATOR ] PPG: Validating primary data. [2025-09-26T20:49:32.456842] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-26T20:49:32.558011] [DEBUG] [VALIDATOR ] PPG: All expected trading days are present. [2025-09-26T20:49:32.558101] [DEBUG] [VALIDATOR ] PPG: Primary data validation passed. [2025-09-26T20:49:32.559099] [INFO ] [MAIN ] PPG: Fetched primary data is valid. [2025-09-26T20:49:32.559185] [DEBUG] [LOCAL ] PPG: Saving primary data. [2025-09-26T20:49:32.560768] [DEBUG] [LOCAL ] PPG: Trimmed 73774 records to 51455 (keeping 200 days of data) [2025-09-26T20:49:32.752949] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-07. [2025-09-26T20:49:32.904411] [DEBUG] [LOCAL ] PPG: Primary data saved (51455 records). [2025-09-26T20:49:32.904557] [INFO ] [MAIN ] PPG: Full history saved. [2025-09-26T20:49:32.904664] [INFO ] [MAIN ] Update Progress: 1718/2371 symbols completed. PPG took 30.5s. Estimated remaining: 1h 27m 14s. Rate: 7.5 symbols/min [2025-09-26T20:49:33.929237] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-26T20:49:33.941311] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-08. [2025-09-26T20:49:33.967471] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-26T20:49:34.311733] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-08. [2025-09-26T20:49:35.264152] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-26T20:49:35.268484] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-09. [2025-09-26T20:49:35.493862] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-26T20:49:35.911746] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-09. [2025-09-26T20:49:36.265635] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-26T20:49:36.270174] [INFO ] [REMOTE ] PPT: Full fetch complete (29241 records). [2025-09-26T20:49:36.270276] [DEBUG] [VALIDATOR ] PPT: Validating primary data. [2025-09-26T20:49:36.682194] [DEBUG] [VALIDATOR ] PPT: All expected trading days are present. [2025-09-26T20:49:36.682351] [DEBUG] [VALIDATOR ] PPT: Primary data validation passed. [2025-09-26T20:49:36.683453] [INFO ] [MAIN ] PPT: Fetched primary data is valid. [2025-09-26T20:49:36.683639] [DEBUG] [LOCAL ] PPT: Saving primary data. [2025-09-26T20:49:36.686942] [DEBUG] [LOCAL ] PPT: Trimmed 29241 records to 20342 (keeping 200 days of data) [2025-09-26T20:49:36.828866] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-26T20:49:36.852187] [DEBUG] [LOCAL ] PPT: Primary data saved (20342 records). [2025-09-26T20:49:36.857697] [INFO ] [MAIN ] PPT: Full history saved. [2025-09-26T20:49:36.858144] [INFO ] [MAIN ] Update Progress: 1719/2371 symbols completed. PPT took 21.8s. Estimated remaining: 1h 27m 4s. Rate: 7.5 symbols/min [2025-09-26T20:49:36.859030] [INFO ] [REMOTE ] PPL: Full fetch complete (69632 records). [2025-09-26T20:49:36.859270] [DEBUG] [VALIDATOR ] PPL: Validating primary data. [2025-09-26T20:49:36.860727] [FATAL] [VALIDATOR ] PPL: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T20:49:36.860898] [FATAL] [MAIN ] PPL: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:49:36.860990] [WARN ] [MAIN ] PPL: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:49:36.861090] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-09-26T20:49:36.861215] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-09-26T20:49:36.861313] [INFO ] [LOCAL ] PPL: Starting deletion of derivative data. [2025-09-26T20:49:36.861437] [DEBUG] [LOCAL ] PPL: No derivative data file found to delete. [2025-09-26T20:49:36.861562] [INFO ] [MAIN ] Update Progress: 1720/2371 symbols completed. PPL took 27.1s. Estimated remaining: 1h 26m 53s. Rate: 7.5 symbols/min [2025-09-26T20:49:37.601561] [INFO ] [MAIN ] PRCS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:49:37.609945] [INFO ] [MAIN ] PR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:49:37.610564] [DEBUG] [LOCAL ] PRCS: No existing data file found in primary storage. [2025-09-26T20:49:37.600671] [INFO ] [MAIN ] PRA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:49:37.610774] [WARN ] [MAIN ] PRCS: No existing data found, performing full refresh instead. [2025-09-26T20:49:37.661848] [INFO ] [MAIN ] PRCS: Wiping existing primary data before full refresh. [2025-09-26T20:49:37.662075] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-09-26T20:49:37.662156] [DEBUG] [LOCAL ] PRCS: No primary data file found to delete. [2025-09-26T20:49:37.662442] [INFO ] [MAIN ] PRCS: Starting full primary refresh. [2025-09-26T20:49:37.722287] [INFO ] [MAIN ] PRG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:49:37.997156] [DEBUG] [LOCAL ] PRA: Loaded 35061 existing records from primary storage. [2025-09-26T20:49:38.042120] [INFO ] [MAIN ] PRA: Loaded 35061 existing records. [2025-09-26T20:49:38.048167] [DEBUG] [LOCAL ] PR: Loaded 53999 existing records from primary storage. [2025-09-26T20:49:38.067254] [INFO ] [MAIN ] PR: Loaded 53999 existing records. [2025-09-26T20:49:38.158552] [DEBUG] [LOCAL ] PRG: Loaded 30222 existing records from primary storage. [2025-09-26T20:49:38.305631] [INFO ] [MAIN ] PRG: Loaded 30222 existing records. [2025-09-26T20:49:38.383178] [INFO ] [REMOTE ] PRCS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:49:38.461931] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2024-12. [2025-09-26T20:49:38.707100] [WARN ] [MAIN ] PR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:49:38.701873] [WARN ] [MAIN ] PRA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:49:38.779594] [WARN ] [MAIN ] PRG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:49:38.756294] [INFO ] [MAIN ] PR: Wiping existing primary data before full refresh. [2025-09-26T20:49:38.779980] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-09-26T20:49:38.779905] [INFO ] [MAIN ] PRA: Wiping existing primary data before full refresh. [2025-09-26T20:49:38.780083] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-09-26T20:49:38.780338] [INFO ] [MAIN ] PRG: Wiping existing primary data before full refresh. [2025-09-26T20:49:38.780407] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-09-26T20:49:38.781157] [DEBUG] [LOCAL ] PRG: Deleted primary data file. [2025-09-26T20:49:38.781240] [INFO ] [MAIN ] PRG: Starting full primary refresh. [2025-09-26T20:49:38.781286] [DEBUG] [LOCAL ] PRA: Deleted primary data file. [2025-09-26T20:49:38.781419] [INFO ] [MAIN ] PRA: Starting full primary refresh. [2025-09-26T20:49:38.794045] [DEBUG] [LOCAL ] PR: Deleted primary data file. [2025-09-26T20:49:38.854729] [INFO ] [MAIN ] PR: Starting full primary refresh. [2025-09-26T20:49:39.298536] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-26T20:49:39.342023] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-01. [2025-09-26T20:49:39.928989] [INFO ] [REMOTE ] PRG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:49:40.013942] [INFO ] [REMOTE ] PR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:49:40.024112] [INFO ] [REMOTE ] PRA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:49:40.007148] [INFO ] [REMOTE ] PRG: Fetching primary data for 2024-12. [2025-09-26T20:49:40.025339] [INFO ] [REMOTE ] PR: Fetching primary data for 2024-12. [2025-09-26T20:49:40.024934] [INFO ] [REMOTE ] PRA: Fetching primary data for 2024-12. [2025-09-26T20:49:40.225818] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-26T20:49:40.711737] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-02. [2025-09-26T20:49:41.157024] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-26T20:49:41.267142] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-26T20:49:41.523535] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-01. [2025-09-26T20:49:41.530989] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-26T20:49:41.587857] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-26T20:49:42.311705] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-03. [2025-09-26T20:49:42.607280] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-26T20:49:42.918250] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-26T20:49:43.111720] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-01. [2025-09-26T20:49:43.911722] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-02. [2025-09-26T20:49:44.711805] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-04. [2025-09-26T20:49:44.993359] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-26T20:49:45.024840] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-26T20:49:45.122961] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-26T20:49:45.511761] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-03. [2025-09-26T20:49:46.311753] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-05. [2025-09-26T20:49:46.948179] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-26T20:49:47.111744] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-01. [2025-09-26T20:49:47.147160] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-26T20:49:47.911738] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-04. [2025-09-26T20:49:48.314071] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-26T20:49:48.711754] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-06. [2025-09-26T20:49:49.065976] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-26T20:49:49.234882] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-26T20:49:49.511752] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-02. [2025-09-26T20:49:50.311751] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-05. [2025-09-26T20:49:50.864258] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-26T20:49:51.111746] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-07. [2025-09-26T20:49:51.855285] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-26T20:49:51.880710] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-26T20:49:51.911686] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-06. [2025-09-26T20:49:52.711724] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-03. [2025-09-26T20:49:53.237778] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-26T20:49:53.511722] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-02. [2025-09-26T20:49:54.134198] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-26T20:49:54.311722] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-07. [2025-09-26T20:49:55.111752] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-08. [2025-09-26T20:49:55.259792] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-26T20:49:55.622564] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-26T20:49:55.808073] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-26T20:49:55.911737] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-08. [2025-09-26T20:49:56.711769] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-04. [2025-09-26T20:49:57.304417] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-26T20:49:57.511761] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-09. [2025-09-26T20:49:58.224874] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-26T20:49:58.311688] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-03. [2025-09-26T20:49:58.671151] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-26T20:49:58.677138] [INFO ] [REMOTE ] PRA: Full fetch complete (43459 records). [2025-09-26T20:49:58.677288] [DEBUG] [VALIDATOR ] PRA: Validating primary data. [2025-09-26T20:49:59.071061] [DEBUG] [VALIDATOR ] PRA: All expected trading days are present. [2025-09-26T20:49:59.071190] [DEBUG] [VALIDATOR ] PRA: Primary data validation passed. [2025-09-26T20:49:59.072486] [INFO ] [MAIN ] PRA: Fetched primary data is valid. [2025-09-26T20:49:59.072554] [DEBUG] [LOCAL ] PRA: Saving primary data. [2025-09-26T20:49:59.074334] [DEBUG] [LOCAL ] PRA: Trimmed 43459 records to 35243 (keeping 200 days of data) [2025-09-26T20:49:59.124093] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-09. [2025-09-26T20:49:59.302847] [DEBUG] [LOCAL ] PRA: Primary data saved (35243 records). [2025-09-26T20:49:59.303118] [INFO ] [MAIN ] PRA: Full history saved. [2025-09-26T20:49:59.303251] [INFO ] [MAIN ] Update Progress: 1721/2371 symbols completed. PRA took 22.4s. Estimated remaining: 1h 26m 51s. Rate: 7.5 symbols/min [2025-09-26T20:49:59.487126] [INFO ] [MAIN ] PRGO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:49:59.539020] [DEBUG] [LOCAL ] PRGO: Loaded 47266 existing records from primary storage. [2025-09-26T20:49:59.539177] [INFO ] [MAIN ] PRGO: Loaded 47266 existing records. [2025-09-26T20:49:59.708050] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-26T20:49:59.720000] [INFO ] [REMOTE ] PRCS: Full fetch complete (3804 records). [2025-09-26T20:49:59.727005] [DEBUG] [VALIDATOR ] PRCS: Validating primary data. [2025-09-26T20:49:59.794421] [WARN ] [MAIN ] PRGO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:49:59.851522] [INFO ] [MAIN ] PRGO: Wiping existing primary data before full refresh. [2025-09-26T20:49:59.870473] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-09-26T20:49:59.893206] [DEBUG] [LOCAL ] PRGO: Deleted primary data file. [2025-09-26T20:49:59.917454] [INFO ] [MAIN ] PRGO: Starting full primary refresh. [2025-09-26T20:49:59.922728] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-05. [2025-09-26T20:50:00.016047] [WARN ] [VALIDATOR ] PRCS: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-26T20:50:00.064580] [FATAL] [MAIN ] PRCS: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:50:00.085695] [WARN ] [MAIN ] PRCS: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:50:00.101947] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-09-26T20:50:00.139402] [DEBUG] [LOCAL ] PRCS: No primary data file found to delete. [2025-09-26T20:50:00.183533] [INFO ] [LOCAL ] PRCS: Starting deletion of derivative data. [2025-09-26T20:50:00.212591] [DEBUG] [LOCAL ] PRCS: No derivative data file found to delete. [2025-09-26T20:50:00.231099] [INFO ] [MAIN ] Update Progress: 1722/2371 symbols completed. PRCS took 23.4s. Estimated remaining: 1h 26m 40s. Rate: 7.5 symbols/min [2025-09-26T20:50:00.501136] [INFO ] [REMOTE ] PRGO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:50:00.608238] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-26T20:50:00.658768] [INFO ] [MAIN ] PRH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:50:00.668954] [DEBUG] [LOCAL ] PRH: Loaded 4885 existing records from primary storage. [2025-09-26T20:50:00.669146] [INFO ] [MAIN ] PRH: Loaded 4885 existing records. [2025-09-26T20:50:00.716991] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-04. [2025-09-26T20:50:00.865895] [WARN ] [MAIN ] PRH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:50:00.866177] [INFO ] [MAIN ] PRH: Wiping existing primary data before full refresh. [2025-09-26T20:50:00.866228] [INFO ] [LOCAL ] PRH: Starting deletion of primary data. [2025-09-26T20:50:00.866569] [DEBUG] [LOCAL ] PRH: Deleted primary data file. [2025-09-26T20:50:00.866630] [INFO ] [MAIN ] PRH: Starting full primary refresh. [2025-09-26T20:50:01.279021] [INFO ] [REMOTE ] PRH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:50:01.515700] [INFO ] [REMOTE ] PRH: Fetching primary data for 2024-12. [2025-09-26T20:50:01.519693] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-26T20:50:02.311711] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2024-12. [2025-09-26T20:50:02.351768] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-26T20:50:02.723513] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-26T20:50:03.111734] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-05. [2025-09-26T20:50:03.911708] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-01. [2025-09-26T20:50:04.208307] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-26T20:50:04.604935] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-26T20:50:04.711698] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-01. [2025-09-26T20:50:05.193246] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-26T20:50:05.511752] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-02. [2025-09-26T20:50:06.311719] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-06. [2025-09-26T20:50:06.446852] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-26T20:50:06.482085] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-26T20:50:07.111728] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-03. [2025-09-26T20:50:07.773807] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-26T20:50:07.911692] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-02. [2025-09-26T20:50:08.166620] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-26T20:50:08.711727] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-04. [2025-09-26T20:50:09.489159] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-26T20:50:09.511678] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-05. [2025-09-26T20:50:09.675860] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-26T20:50:10.311702] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-07. [2025-09-26T20:50:10.348023] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-26T20:50:11.111765] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-03. [2025-09-26T20:50:11.911682] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-06. [2025-09-26T20:50:12.227298] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-26T20:50:12.648000] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-26T20:50:12.711724] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-07. [2025-09-26T20:50:12.958279] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-26T20:50:13.438354] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-26T20:50:13.511750] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-08. [2025-09-26T20:50:14.188282] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-26T20:50:14.311754] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-09. [2025-09-26T20:50:14.848196] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-26T20:50:14.849919] [INFO ] [REMOTE ] PRH: Full fetch complete (7634 records). [2025-09-26T20:50:14.850022] [DEBUG] [VALIDATOR ] PRH: Validating primary data. [2025-09-26T20:50:15.119779] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-04. [2025-09-26T20:50:15.259235] [DEBUG] [VALIDATOR ] PRH: All expected trading days are present. [2025-09-26T20:50:15.259336] [DEBUG] [VALIDATOR ] PRH: Primary data validation passed. [2025-09-26T20:50:15.259565] [INFO ] [MAIN ] PRH: Fetched primary data is valid. [2025-09-26T20:50:15.259690] [DEBUG] [LOCAL ] PRH: Saving primary data. [2025-09-26T20:50:15.260314] [DEBUG] [LOCAL ] PRH: Trimmed 7634 records to 4908 (keeping 200 days of data) [2025-09-26T20:50:15.296348] [DEBUG] [LOCAL ] PRH: Primary data saved (4908 records). [2025-09-26T20:50:15.296495] [INFO ] [MAIN ] PRH: Full history saved. [2025-09-26T20:50:15.296756] [INFO ] [MAIN ] Update Progress: 1723/2371 symbols completed. PRH took 15.1s. Estimated remaining: 1h 26m 35s. Rate: 7.5 symbols/min [2025-09-26T20:50:15.472509] [INFO ] [MAIN ] PRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:50:15.497993] [DEBUG] [LOCAL ] PRI: Loaded 18543 existing records from primary storage. [2025-09-26T20:50:15.498155] [INFO ] [MAIN ] PRI: Loaded 18543 existing records. [2025-09-26T20:50:15.681594] [WARN ] [MAIN ] PRI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:50:15.681887] [INFO ] [MAIN ] PRI: Wiping existing primary data before full refresh. [2025-09-26T20:50:15.681935] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-09-26T20:50:15.682599] [DEBUG] [LOCAL ] PRI: Deleted primary data file. [2025-09-26T20:50:15.682712] [INFO ] [MAIN ] PRI: Starting full primary refresh. [2025-09-26T20:50:15.918630] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-08. [2025-09-26T20:50:16.065510] [INFO ] [REMOTE ] PRI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:50:16.711707] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-06. [2025-09-26T20:50:17.099845] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-26T20:50:17.511693] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-05. [2025-09-26T20:50:17.908398] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-26T20:50:17.966637] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-26T20:50:18.311737] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-07. [2025-09-26T20:50:19.009824] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-26T20:50:19.111725] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-06. [2025-09-26T20:50:19.615099] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-26T20:50:19.911718] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-09. [2025-09-26T20:50:20.723108] [INFO ] [REMOTE ] PRI: Fetching primary data for 2024-12. [2025-09-26T20:50:20.744378] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-26T20:50:21.511831] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-07. [2025-09-26T20:50:21.515161] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-26T20:50:21.526615] [INFO ] [REMOTE ] PR: Full fetch complete (77594 records). [2025-09-26T20:50:21.526850] [DEBUG] [VALIDATOR ] PR: Validating primary data. [2025-09-26T20:50:21.972152] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-26T20:50:22.003941] [DEBUG] [VALIDATOR ] PR: All expected trading days are present. [2025-09-26T20:50:22.004908] [DEBUG] [VALIDATOR ] PR: Primary data validation passed. [2025-09-26T20:50:22.006143] [INFO ] [MAIN ] PR: Fetched primary data is valid. [2025-09-26T20:50:22.006211] [DEBUG] [LOCAL ] PR: Saving primary data. [2025-09-26T20:50:22.008796] [DEBUG] [LOCAL ] PR: Trimmed 77594 records to 54389 (keeping 200 days of data) [2025-09-26T20:50:22.339214] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-08. [2025-09-26T20:50:22.397433] [DEBUG] [LOCAL ] PR: Primary data saved (54389 records). [2025-09-26T20:50:22.397663] [INFO ] [MAIN ] PR: Full history saved. [2025-09-26T20:50:22.397846] [INFO ] [MAIN ] Update Progress: 1724/2371 symbols completed. PR took 45.5s. Estimated remaining: 1h 26m 26s. Rate: 7.5 symbols/min [2025-09-26T20:50:22.593587] [INFO ] [MAIN ] PRIM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:50:22.637894] [DEBUG] [LOCAL ] PRIM: Loaded 44756 existing records from primary storage. [2025-09-26T20:50:22.638046] [INFO ] [MAIN ] PRIM: Loaded 44756 existing records. [2025-09-26T20:50:22.893473] [WARN ] [MAIN ] PRIM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:50:22.893827] [INFO ] [MAIN ] PRIM: Wiping existing primary data before full refresh. [2025-09-26T20:50:22.893881] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-09-26T20:50:22.894975] [DEBUG] [LOCAL ] PRIM: Deleted primary data file. [2025-09-26T20:50:22.895037] [INFO ] [MAIN ] PRIM: Starting full primary refresh. [2025-09-26T20:50:23.116852] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-01. [2025-09-26T20:50:23.322210] [INFO ] [REMOTE ] PRIM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:50:23.327543] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-26T20:50:23.698778] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-26T20:50:23.911728] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-08. [2025-09-26T20:50:24.298873] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-26T20:50:24.711727] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2024-12. [2025-09-26T20:50:25.511714] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-09. [2025-09-26T20:50:25.671986] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-26T20:50:26.311738] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-09. [2025-09-26T20:50:26.367716] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-26T20:50:26.755872] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-26T20:50:26.761629] [INFO ] [REMOTE ] PRG: Full fetch complete (44079 records). [2025-09-26T20:50:26.761863] [DEBUG] [VALIDATOR ] PRG: Validating primary data. [2025-09-26T20:50:27.116990] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-01. [2025-09-26T20:50:27.238628] [DEBUG] [VALIDATOR ] PRG: All expected trading days are present. [2025-09-26T20:50:27.238754] [DEBUG] [VALIDATOR ] PRG: Primary data validation passed. [2025-09-26T20:50:27.239581] [INFO ] [MAIN ] PRG: Fetched primary data is valid. [2025-09-26T20:50:27.239667] [DEBUG] [LOCAL ] PRG: Saving primary data. [2025-09-26T20:50:27.242365] [DEBUG] [LOCAL ] PRG: Trimmed 44079 records to 30420 (keeping 200 days of data) [2025-09-26T20:50:27.450710] [DEBUG] [LOCAL ] PRG: Primary data saved (30420 records). [2025-09-26T20:50:27.450868] [INFO ] [MAIN ] PRG: Full history saved. [2025-09-26T20:50:27.451014] [INFO ] [MAIN ] Update Progress: 1725/2371 symbols completed. PRG took 50.6s. Estimated remaining: 1h 26m 17s. Rate: 7.5 symbols/min [2025-09-26T20:50:27.640376] [INFO ] [MAIN ] PRKS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:50:27.694754] [DEBUG] [LOCAL ] PRKS: Loaded 42999 existing records from primary storage. [2025-09-26T20:50:27.694906] [INFO ] [MAIN ] PRKS: Loaded 42999 existing records. [2025-09-26T20:50:27.895337] [WARN ] [MAIN ] PRKS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:50:27.896131] [INFO ] [MAIN ] PRKS: Wiping existing primary data before full refresh. [2025-09-26T20:50:27.896303] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-09-26T20:50:27.897272] [DEBUG] [LOCAL ] PRKS: Deleted primary data file. [2025-09-26T20:50:27.897339] [INFO ] [MAIN ] PRKS: Starting full primary refresh. [2025-09-26T20:50:27.937114] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-02. [2025-09-26T20:50:28.050804] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-26T20:50:28.105700] [INFO ] [REMOTE ] PRGO: Full fetch complete (68415 records). [2025-09-26T20:50:28.114810] [DEBUG] [VALIDATOR ] PRGO: Validating primary data. [2025-09-26T20:50:28.588488] [INFO ] [REMOTE ] PRKS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:50:28.721862] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2024-12. [2025-09-26T20:50:28.809806] [DEBUG] [VALIDATOR ] PRGO: All expected trading days are present. [2025-09-26T20:50:28.809945] [DEBUG] [VALIDATOR ] PRGO: Primary data validation passed. [2025-09-26T20:50:28.811045] [INFO ] [MAIN ] PRGO: Fetched primary data is valid. [2025-09-26T20:50:28.811177] [DEBUG] [LOCAL ] PRGO: Saving primary data. [2025-09-26T20:50:28.821567] [DEBUG] [LOCAL ] PRGO: Trimmed 68415 records to 47634 (keeping 200 days of data) [2025-09-26T20:50:28.838020] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-26T20:50:29.115184] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-26T20:50:29.190695] [DEBUG] [LOCAL ] PRGO: Primary data saved (47634 records). [2025-09-26T20:50:29.190861] [INFO ] [MAIN ] PRGO: Full history saved. [2025-09-26T20:50:29.190970] [INFO ] [MAIN ] Update Progress: 1726/2371 symbols completed. PRGO took 29.9s. Estimated remaining: 1h 26m 7s. Rate: 7.5 symbols/min [2025-09-26T20:50:29.376078] [INFO ] [MAIN ] PRLB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:50:29.399768] [DEBUG] [LOCAL ] PRLB: Loaded 20788 existing records from primary storage. [2025-09-26T20:50:29.399927] [INFO ] [MAIN ] PRLB: Loaded 20788 existing records. [2025-09-26T20:50:29.511839] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-03. [2025-09-26T20:50:29.600222] [WARN ] [MAIN ] PRLB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:50:29.600503] [INFO ] [MAIN ] PRLB: Wiping existing primary data before full refresh. [2025-09-26T20:50:29.600554] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-09-26T20:50:29.601152] [DEBUG] [LOCAL ] PRLB: Deleted primary data file. [2025-09-26T20:50:29.601215] [INFO ] [MAIN ] PRLB: Starting full primary refresh. [2025-09-26T20:50:29.977089] [INFO ] [REMOTE ] PRLB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:50:30.313959] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-02. [2025-09-26T20:50:30.316439] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-26T20:50:30.770197] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-26T20:50:31.111723] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-01. [2025-09-26T20:50:31.897159] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-26T20:50:31.911721] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2024-12. [2025-09-26T20:50:32.711704] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-04. [2025-09-26T20:50:32.799428] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-26T20:50:33.132386] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-26T20:50:33.511758] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-03. [2025-09-26T20:50:34.078674] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-26T20:50:34.311725] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-05. [2025-09-26T20:50:35.111728] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-02. [2025-09-26T20:50:35.173380] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-26T20:50:35.389861] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-26T20:50:35.911732] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-06. [2025-09-26T20:50:36.356185] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-26T20:50:36.711724] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-03. [2025-09-26T20:50:37.195581] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-26T20:50:37.511830] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-01. [2025-09-26T20:50:38.215682] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-26T20:50:38.311770] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-04. [2025-09-26T20:50:38.711846] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-26T20:50:39.111762] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-02. [2025-09-26T20:50:39.916914] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-07. [2025-09-26T20:50:39.932325] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-26T20:50:40.381285] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-26T20:50:40.711739] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-04. [2025-09-26T20:50:40.996387] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-26T20:50:41.511738] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-05. [2025-09-26T20:50:42.318778] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-03. [2025-09-26T20:50:42.336259] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-26T20:50:42.810324] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-26T20:50:43.111715] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-06. [2025-09-26T20:50:43.398722] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-26T20:50:43.911717] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-08. [2025-09-26T20:50:44.726712] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-05. [2025-09-26T20:50:44.759637] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-26T20:50:44.938308] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-26T20:50:45.511781] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-09. [2025-09-26T20:50:46.276730] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-26T20:50:46.311685] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-06. [2025-09-26T20:50:46.584198] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-26T20:50:46.588275] [INFO ] [REMOTE ] PRI: Full fetch complete (25727 records). [2025-09-26T20:50:46.588384] [DEBUG] [VALIDATOR ] PRI: Validating primary data. [2025-09-26T20:50:47.005067] [DEBUG] [VALIDATOR ] PRI: All expected trading days are present. [2025-09-26T20:50:47.005171] [DEBUG] [VALIDATOR ] PRI: Primary data validation passed. [2025-09-26T20:50:47.005818] [INFO ] [MAIN ] PRI: Fetched primary data is valid. [2025-09-26T20:50:47.005884] [DEBUG] [LOCAL ] PRI: Saving primary data. [2025-09-26T20:50:47.006773] [DEBUG] [LOCAL ] PRI: Trimmed 25727 records to 18636 (keeping 200 days of data) [2025-09-26T20:50:47.119172] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-07. [2025-09-26T20:50:47.152478] [DEBUG] [LOCAL ] PRI: Primary data saved (18636 records). [2025-09-26T20:50:47.152730] [INFO ] [MAIN ] PRI: Full history saved. [2025-09-26T20:50:47.152927] [INFO ] [MAIN ] Update Progress: 1727/2371 symbols completed. PRI took 31.9s. Estimated remaining: 1h 26m 2s. Rate: 7.5 symbols/min [2025-09-26T20:50:47.337906] [INFO ] [MAIN ] PRM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:50:47.390125] [DEBUG] [LOCAL ] PRM: Loaded 44963 existing records from primary storage. [2025-09-26T20:50:47.390306] [INFO ] [MAIN ] PRM: Loaded 44963 existing records. [2025-09-26T20:50:47.590623] [WARN ] [MAIN ] PRM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:50:47.591364] [INFO ] [MAIN ] PRM: Wiping existing primary data before full refresh. [2025-09-26T20:50:47.591566] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-09-26T20:50:47.607926] [DEBUG] [LOCAL ] PRM: Deleted primary data file. [2025-09-26T20:50:47.613288] [INFO ] [MAIN ] PRM: Starting full primary refresh. [2025-09-26T20:50:47.691401] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-26T20:50:47.916930] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-07. [2025-09-26T20:50:48.026216] [INFO ] [REMOTE ] PRM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:50:48.711730] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-04. [2025-09-26T20:50:48.923143] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-26T20:50:49.511808] [INFO ] [REMOTE ] PRM: Fetching primary data for 2024-12. [2025-09-26T20:50:49.594962] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-26T20:50:49.948607] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-26T20:50:50.311725] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-05. [2025-09-26T20:50:50.802308] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-26T20:50:51.111765] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-08. [2025-09-26T20:50:51.474560] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-26T20:50:51.911804] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-06. [2025-09-26T20:50:52.711711] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-08. [2025-09-26T20:50:52.855077] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-26T20:50:53.056090] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-26T20:50:53.511766] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-01. [2025-09-26T20:50:54.321520] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-09. [2025-09-26T20:50:54.327870] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-26T20:50:55.027526] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-26T20:50:55.111728] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-02. [2025-09-26T20:50:55.911770] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-09. [2025-09-26T20:50:56.048422] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-26T20:50:56.057819] [INFO ] [REMOTE ] PRIM: Full fetch complete (63308 records). [2025-09-26T20:50:56.057981] [DEBUG] [VALIDATOR ] PRIM: Validating primary data. [2025-09-26T20:50:56.516444] [DEBUG] [VALIDATOR ] PRIM: All expected trading days are present. [2025-09-26T20:50:56.516730] [DEBUG] [VALIDATOR ] PRIM: Primary data validation passed. [2025-09-26T20:50:56.518093] [INFO ] [MAIN ] PRIM: Fetched primary data is valid. [2025-09-26T20:50:56.518191] [DEBUG] [LOCAL ] PRIM: Saving primary data. [2025-09-26T20:50:56.519964] [DEBUG] [LOCAL ] PRIM: Trimmed 63308 records to 45072 (keeping 200 days of data) [2025-09-26T20:50:56.646775] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-26T20:50:56.748747] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-03. [2025-09-26T20:50:56.861573] [DEBUG] [LOCAL ] PRIM: Primary data saved (45072 records). [2025-09-26T20:50:56.861792] [INFO ] [MAIN ] PRIM: Full history saved. [2025-09-26T20:50:56.861959] [INFO ] [MAIN ] Update Progress: 1728/2371 symbols completed. PRIM took 34.5s. Estimated remaining: 1h 25m 55s. Rate: 7.5 symbols/min [2025-09-26T20:50:57.050170] [INFO ] [MAIN ] PRMB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:50:57.104389] [DEBUG] [LOCAL ] PRMB: Loaded 53544 existing records from primary storage. [2025-09-26T20:50:57.104600] [INFO ] [MAIN ] PRMB: Loaded 53544 existing records. [2025-09-26T20:50:57.291613] [WARN ] [MAIN ] PRMB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:50:57.291939] [INFO ] [MAIN ] PRMB: Wiping existing primary data before full refresh. [2025-09-26T20:50:57.291990] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-09-26T20:50:57.293240] [DEBUG] [LOCAL ] PRMB: Deleted primary data file. [2025-09-26T20:50:57.293305] [INFO ] [MAIN ] PRMB: Starting full primary refresh. [2025-09-26T20:50:57.524297] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-07. [2025-09-26T20:50:57.693746] [INFO ] [REMOTE ] PRMB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:50:57.722060] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-26T20:50:57.732059] [INFO ] [REMOTE ] PRKS: Full fetch complete (61142 records). [2025-09-26T20:50:57.732311] [DEBUG] [VALIDATOR ] PRKS: Validating primary data. [2025-09-26T20:50:58.171395] [DEBUG] [VALIDATOR ] PRKS: All expected trading days are present. [2025-09-26T20:50:58.171517] [DEBUG] [VALIDATOR ] PRKS: Primary data validation passed. [2025-09-26T20:50:58.172610] [INFO ] [MAIN ] PRKS: Fetched primary data is valid. [2025-09-26T20:50:58.173128] [DEBUG] [LOCAL ] PRKS: Saving primary data. [2025-09-26T20:50:58.174594] [DEBUG] [LOCAL ] PRKS: Trimmed 61142 records to 43308 (keeping 200 days of data) [2025-09-26T20:50:58.297375] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T20:50:58.311777] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2024-12. [2025-09-26T20:50:58.491359] [DEBUG] [LOCAL ] PRKS: Primary data saved (43308 records). [2025-09-26T20:50:58.491516] [INFO ] [MAIN ] PRKS: Full history saved. [2025-09-26T20:50:58.491662] [INFO ] [MAIN ] Update Progress: 1729/2371 symbols completed. PRKS took 31.0s. Estimated remaining: 1h 25m 45s. Rate: 7.5 symbols/min [2025-09-26T20:50:58.698298] [INFO ] [MAIN ] PRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:50:58.738294] [DEBUG] [LOCAL ] PRO: Loaded 38081 existing records from primary storage. [2025-09-26T20:50:58.738521] [INFO ] [MAIN ] PRO: Loaded 38081 existing records. [2025-09-26T20:50:58.868088] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-26T20:50:58.960867] [WARN ] [MAIN ] PRO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:50:58.961144] [INFO ] [MAIN ] PRO: Wiping existing primary data before full refresh. [2025-09-26T20:50:58.961195] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-09-26T20:50:58.962190] [DEBUG] [LOCAL ] PRO: Deleted primary data file. [2025-09-26T20:50:58.962286] [INFO ] [MAIN ] PRO: Starting full primary refresh. [2025-09-26T20:50:59.117189] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-04. [2025-09-26T20:50:59.346630] [INFO ] [REMOTE ] PRO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:50:59.911764] [INFO ] [REMOTE ] PRO: Fetching primary data for 2024-12. [2025-09-26T20:50:59.975865] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-26T20:51:00.711712] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-08. [2025-09-26T20:51:00.797730] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-26T20:51:01.382377] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-26T20:51:01.511743] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-01. [2025-09-26T20:51:01.885574] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-26T20:51:02.311773] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-09. [2025-09-26T20:51:03.113153] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-01. [2025-09-26T20:51:03.116815] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-26T20:51:03.427178] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-26T20:51:03.431607] [INFO ] [REMOTE ] PRLB: Full fetch complete (30911 records). [2025-09-26T20:51:03.431837] [DEBUG] [VALIDATOR ] PRLB: Validating primary data. [2025-09-26T20:51:03.876152] [DEBUG] [VALIDATOR ] PRLB: All expected trading days are present. [2025-09-26T20:51:03.876260] [DEBUG] [VALIDATOR ] PRLB: Primary data validation passed. [2025-09-26T20:51:03.877024] [INFO ] [MAIN ] PRLB: Fetched primary data is valid. [2025-09-26T20:51:03.877089] [DEBUG] [LOCAL ] PRLB: Saving primary data. [2025-09-26T20:51:03.878096] [DEBUG] [LOCAL ] PRLB: Trimmed 30911 records to 20919 (keeping 200 days of data) [2025-09-26T20:51:03.931072] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-02. [2025-09-26T20:51:04.014779] [DEBUG] [LOCAL ] PRLB: Primary data saved (20919 records). [2025-09-26T20:51:04.014916] [INFO ] [MAIN ] PRLB: Full history saved. [2025-09-26T20:51:04.015019] [INFO ] [MAIN ] Update Progress: 1730/2371 symbols completed. PRLB took 34.8s. Estimated remaining: 1h 25m 36s. Rate: 7.5 symbols/min [2025-09-26T20:51:04.209912] [INFO ] [MAIN ] PRSU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:51:04.210244] [DEBUG] [LOCAL ] PRSU: No existing data file found in primary storage. [2025-09-26T20:51:04.210301] [WARN ] [MAIN ] PRSU: No existing data found, performing full refresh instead. [2025-09-26T20:51:04.210502] [INFO ] [MAIN ] PRSU: Wiping existing primary data before full refresh. [2025-09-26T20:51:04.210556] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-09-26T20:51:04.210601] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-09-26T20:51:04.210634] [INFO ] [MAIN ] PRSU: Starting full primary refresh. [2025-09-26T20:51:04.617161] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-26T20:51:04.636409] [INFO ] [REMOTE ] PRSU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:51:04.711730] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2024-12. [2025-09-26T20:51:04.964594] [DEBUG] [REMOTE ] PRSU: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T20:51:04.964969] [WARN ] [REMOTE ] PRSU: No data returned for month 2024-12 [2025-09-26T20:51:05.511731] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-02. [2025-09-26T20:51:05.699349] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-26T20:51:06.311762] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-05. [2025-09-26T20:51:06.879073] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-26T20:51:07.111750] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-03. [2025-09-26T20:51:07.792048] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-26T20:51:07.911726] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-01. [2025-09-26T20:51:08.711738] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-03. [2025-09-26T20:51:09.036806] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-26T20:51:09.146745] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-26T20:51:09.511739] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-02. [2025-09-26T20:51:10.153152] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-26T20:51:10.311731] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-06. [2025-09-26T20:51:10.739450] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-26T20:51:11.111743] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-04. [2025-09-26T20:51:11.496742] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-26T20:51:11.911728] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-07. [2025-09-26T20:51:12.711733] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-03. [2025-09-26T20:51:13.070626] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-26T20:51:13.511697] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-05. [2025-09-26T20:51:13.579368] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-26T20:51:14.053585] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-26T20:51:14.311733] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-04. [2025-09-26T20:51:15.111706] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-08. [2025-09-26T20:51:15.502688] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-26T20:51:15.801205] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-26T20:51:15.911730] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-04. [2025-09-26T20:51:16.326962] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-26T20:51:16.711731] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-09. [2025-09-26T20:51:16.807706] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-26T20:51:17.511784] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-05. [2025-09-26T20:51:18.319809] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-05. [2025-09-26T20:51:18.336551] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-26T20:51:18.351687] [INFO ] [REMOTE ] PRM: Full fetch complete (64476 records). [2025-09-26T20:51:18.351911] [DEBUG] [VALIDATOR ] PRM: Validating primary data. [2025-09-26T20:51:18.776519] [DEBUG] [VALIDATOR ] PRM: All expected trading days are present. [2025-09-26T20:51:18.776796] [DEBUG] [VALIDATOR ] PRM: Primary data validation passed. [2025-09-26T20:51:18.778062] [INFO ] [MAIN ] PRM: Fetched primary data is valid. [2025-09-26T20:51:18.778138] [DEBUG] [LOCAL ] PRM: Saving primary data. [2025-09-26T20:51:18.779682] [DEBUG] [LOCAL ] PRM: Trimmed 64476 records to 45298 (keeping 200 days of data) [2025-09-26T20:51:19.021906] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-26T20:51:19.093169] [DEBUG] [LOCAL ] PRM: Primary data saved (45298 records). [2025-09-26T20:51:19.093330] [INFO ] [MAIN ] PRM: Full history saved. [2025-09-26T20:51:19.093456] [INFO ] [MAIN ] Update Progress: 1731/2371 symbols completed. PRM took 31.9s. Estimated remaining: 1h 25m 30s. Rate: 7.5 symbols/min [2025-09-26T20:51:19.116927] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-06. [2025-09-26T20:51:19.305193] [INFO ] [MAIN ] PRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:51:19.326120] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-26T20:51:19.336404] [DEBUG] [LOCAL ] PRT: Loaded 5372 existing records from primary storage. [2025-09-26T20:51:19.336553] [INFO ] [MAIN ] PRT: Loaded 5372 existing records. [2025-09-26T20:51:19.529909] [WARN ] [MAIN ] PRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:51:19.530245] [INFO ] [MAIN ] PRT: Wiping existing primary data before full refresh. [2025-09-26T20:51:19.530320] [INFO ] [LOCAL ] PRT: Starting deletion of primary data. [2025-09-26T20:51:19.530706] [DEBUG] [LOCAL ] PRT: Deleted primary data file. [2025-09-26T20:51:19.530769] [INFO ] [MAIN ] PRT: Starting full primary refresh. [2025-09-26T20:51:19.917135] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-06. [2025-09-26T20:51:19.948210] [INFO ] [REMOTE ] PRT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:51:20.711731] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-06. [2025-09-26T20:51:21.142241] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-26T20:51:21.468338] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T20:51:21.511732] [INFO ] [REMOTE ] PRT: Fetching primary data for 2024-12. [2025-09-26T20:51:21.902864] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-26T20:51:22.311689] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-07. [2025-09-26T20:51:22.351151] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-26T20:51:23.111721] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-01. [2025-09-26T20:51:23.521258] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-26T20:51:23.911717] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-07. [2025-09-26T20:51:23.934547] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-26T20:51:24.711731] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-02. [2025-09-26T20:51:25.511699] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-07. [2025-09-26T20:51:25.526518] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-26T20:51:25.593463] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-26T20:51:26.311742] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-03. [2025-09-26T20:51:27.113125] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-08. [2025-09-26T20:51:27.116594] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-26T20:51:27.372776] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-26T20:51:27.911759] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-08. [2025-09-26T20:51:28.673427] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-26T20:51:28.711704] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-09. [2025-09-26T20:51:29.491506] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-26T20:51:29.511684] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-09. [2025-09-26T20:51:29.925314] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-26T20:51:29.934306] [INFO ] [REMOTE ] PRO: Full fetch complete (51547 records). [2025-09-26T20:51:29.934481] [DEBUG] [VALIDATOR ] PRO: Validating primary data. [2025-09-26T20:51:30.330352] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-08. [2025-09-26T20:51:30.351748] [DEBUG] [VALIDATOR ] PRO: All expected trading days are present. [2025-09-26T20:51:30.351895] [DEBUG] [VALIDATOR ] PRO: Primary data validation passed. [2025-09-26T20:51:30.353065] [INFO ] [MAIN ] PRO: Fetched primary data is valid. [2025-09-26T20:51:30.353289] [DEBUG] [LOCAL ] PRO: Saving primary data. [2025-09-26T20:51:30.354826] [DEBUG] [LOCAL ] PRO: Trimmed 51547 records to 38444 (keeping 200 days of data) [2025-09-26T20:51:30.588044] [DEBUG] [LOCAL ] PRO: Primary data saved (38444 records). [2025-09-26T20:51:30.588208] [INFO ] [MAIN ] PRO: Full history saved. [2025-09-26T20:51:30.588314] [INFO ] [MAIN ] Update Progress: 1732/2371 symbols completed. PRO took 32.1s. Estimated remaining: 1h 25m 24s. Rate: 7.5 symbols/min [2025-09-26T20:51:30.763528] [INFO ] [MAIN ] PRU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:51:30.824047] [DEBUG] [LOCAL ] PRU: Loaded 51835 existing records from primary storage. [2025-09-26T20:51:30.824208] [INFO ] [MAIN ] PRU: Loaded 51835 existing records. [2025-09-26T20:51:31.028146] [WARN ] [MAIN ] PRU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:51:31.028520] [INFO ] [MAIN ] PRU: Wiping existing primary data before full refresh. [2025-09-26T20:51:31.028711] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-09-26T20:51:31.039688] [DEBUG] [LOCAL ] PRU: Deleted primary data file. [2025-09-26T20:51:31.056099] [INFO ] [MAIN ] PRU: Starting full primary refresh. [2025-09-26T20:51:31.124422] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-26T20:51:31.135485] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-04. [2025-09-26T20:51:31.184164] [INFO ] [REMOTE ] PRMB: Full fetch complete (76074 records). [2025-09-26T20:51:31.217260] [DEBUG] [VALIDATOR ] PRMB: Validating primary data. [2025-09-26T20:51:31.864638] [INFO ] [REMOTE ] PRU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:51:31.860044] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-26T20:51:31.916855] [INFO ] [REMOTE ] PRU: Fetching primary data for 2024-12. [2025-09-26T20:51:31.945112] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-26T20:51:32.059789] [DEBUG] [VALIDATOR ] PRMB: All expected trading days are present. [2025-09-26T20:51:32.059892] [DEBUG] [VALIDATOR ] PRMB: Primary data validation passed. [2025-09-26T20:51:32.061251] [INFO ] [MAIN ] PRMB: Fetched primary data is valid. [2025-09-26T20:51:32.061321] [DEBUG] [LOCAL ] PRMB: Saving primary data. [2025-09-26T20:51:32.063145] [DEBUG] [LOCAL ] PRMB: Trimmed 76074 records to 53928 (keeping 200 days of data) [2025-09-26T20:51:32.430891] [DEBUG] [LOCAL ] PRMB: Primary data saved (53928 records). [2025-09-26T20:51:32.431066] [INFO ] [MAIN ] PRMB: Full history saved. [2025-09-26T20:51:32.431175] [INFO ] [MAIN ] Update Progress: 1733/2371 symbols completed. PRMB took 35.6s. Estimated remaining: 1h 25m 13s. Rate: 7.5 symbols/min [2025-09-26T20:51:32.618850] [INFO ] [MAIN ] PRVS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:51:32.619072] [DEBUG] [LOCAL ] PRVS: No existing data file found in primary storage. [2025-09-26T20:51:32.619142] [WARN ] [MAIN ] PRVS: No existing data found, performing full refresh instead. [2025-09-26T20:51:32.619301] [INFO ] [MAIN ] PRVS: Wiping existing primary data before full refresh. [2025-09-26T20:51:32.619377] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-09-26T20:51:32.619478] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-09-26T20:51:32.619557] [INFO ] [MAIN ] PRVS: Starting full primary refresh. [2025-09-26T20:51:32.716949] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-05. [2025-09-26T20:51:33.017329] [INFO ] [REMOTE ] PRVS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:51:33.511763] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-09. [2025-09-26T20:51:33.620375] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-26T20:51:33.624013] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-26T20:51:34.311796] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-01. [2025-09-26T20:51:34.695882] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-26T20:51:34.700381] [INFO ] [REMOTE ] PRSU: Full fetch complete (32154 records). [2025-09-26T20:51:34.700505] [DEBUG] [VALIDATOR ] PRSU: Validating primary data. [2025-09-26T20:51:34.903480] [WARN ] [VALIDATOR ] PRSU: Validation failed - insufficient historical data. Have 184 unique days, need 200 days [2025-09-26T20:51:34.904030] [FATAL] [MAIN ] PRSU: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:51:34.904107] [WARN ] [MAIN ] PRSU: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:51:34.904202] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-09-26T20:51:34.904305] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-09-26T20:51:34.904403] [INFO ] [LOCAL ] PRSU: Starting deletion of derivative data. [2025-09-26T20:51:34.904489] [DEBUG] [LOCAL ] PRSU: No derivative data file found to delete. [2025-09-26T20:51:34.904579] [INFO ] [MAIN ] Update Progress: 1734/2371 symbols completed. PRSU took 30.9s. Estimated remaining: 1h 25m 3s. Rate: 7.5 symbols/min [2025-09-26T20:51:35.084374] [INFO ] [MAIN ] PSA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:51:35.115242] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2024-12. [2025-09-26T20:51:35.134009] [DEBUG] [LOCAL ] PSA: Loaded 42130 existing records from primary storage. [2025-09-26T20:51:35.134166] [INFO ] [MAIN ] PSA: Loaded 42130 existing records. [2025-09-26T20:51:35.320625] [WARN ] [MAIN ] PSA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:51:35.320909] [INFO ] [MAIN ] PSA: Wiping existing primary data before full refresh. [2025-09-26T20:51:35.320961] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-09-26T20:51:35.322009] [DEBUG] [LOCAL ] PSA: Deleted primary data file. [2025-09-26T20:51:35.322073] [INFO ] [MAIN ] PSA: Starting full primary refresh. [2025-09-26T20:51:35.612774] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-26T20:51:35.708477] [INFO ] [REMOTE ] PSA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:51:35.911757] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-06. [2025-09-26T20:51:36.052150] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-26T20:51:36.568426] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-26T20:51:36.711741] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-02. [2025-09-26T20:51:37.511727] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-01. [2025-09-26T20:51:37.979414] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-26T20:51:38.311723] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-07. [2025-09-26T20:51:38.459347] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-26T20:51:38.861484] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-26T20:51:39.111718] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-08. [2025-09-26T20:51:39.836539] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-26T20:51:39.911722] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-02. [2025-09-26T20:51:40.294926] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-26T20:51:40.711709] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-03. [2025-09-26T20:51:41.511786] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-03. [2025-09-26T20:51:41.971615] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-26T20:51:42.311706] [INFO ] [REMOTE ] PSA: Fetching primary data for 2024-12. [2025-09-26T20:51:42.687666] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-26T20:51:43.111730] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-09. [2025-09-26T20:51:43.806077] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-26T20:51:43.807928] [INFO ] [REMOTE ] PRT: Full fetch complete (9129 records). [2025-09-26T20:51:43.808017] [DEBUG] [VALIDATOR ] PRT: Validating primary data. [2025-09-26T20:51:43.914427] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-04. [2025-09-26T20:51:44.007431] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-26T20:51:44.229605] [DEBUG] [VALIDATOR ] PRT: All expected trading days are present. [2025-09-26T20:51:44.229728] [DEBUG] [VALIDATOR ] PRT: Primary data validation passed. [2025-09-26T20:51:44.229980] [INFO ] [MAIN ] PRT: Fetched primary data is valid. [2025-09-26T20:51:44.230040] [DEBUG] [LOCAL ] PRT: Saving primary data. [2025-09-26T20:51:44.230497] [DEBUG] [LOCAL ] PRT: Trimmed 9129 records to 5402 (keeping 200 days of data) [2025-09-26T20:51:44.263699] [DEBUG] [LOCAL ] PRT: Primary data saved (5402 records). [2025-09-26T20:51:44.263825] [INFO ] [MAIN ] PRT: Full history saved. [2025-09-26T20:51:44.263963] [INFO ] [MAIN ] Update Progress: 1735/2371 symbols completed. PRT took 25.2s. Estimated remaining: 1h 24m 56s. Rate: 7.5 symbols/min [2025-09-26T20:51:44.449196] [INFO ] [MAIN ] PSBD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:51:44.452071] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-26T20:51:44.462306] [DEBUG] [LOCAL ] PSBD: Loaded 7064 existing records from primary storage. [2025-09-26T20:51:44.462437] [INFO ] [MAIN ] PSBD: Loaded 7064 existing records. [2025-09-26T20:51:44.654979] [WARN ] [MAIN ] PSBD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:51:44.655258] [INFO ] [MAIN ] PSBD: Wiping existing primary data before full refresh. [2025-09-26T20:51:44.655308] [INFO ] [LOCAL ] PSBD: Starting deletion of primary data. [2025-09-26T20:51:44.655822] [DEBUG] [LOCAL ] PSBD: Deleted primary data file. [2025-09-26T20:51:44.655883] [INFO ] [MAIN ] PSBD: Starting full primary refresh. [2025-09-26T20:51:44.718981] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-01. [2025-09-26T20:51:45.022509] [INFO ] [REMOTE ] PSBD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:51:45.511735] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-05. [2025-09-26T20:51:45.903411] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-26T20:51:46.320504] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2024-12. [2025-09-26T20:51:46.325595] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-26T20:51:47.111470] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-26T20:51:47.113270] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-01. [2025-09-26T20:51:47.730160] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-26T20:51:47.911718] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-04. [2025-09-26T20:51:48.711731] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-02. [2025-09-26T20:51:49.511730] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-02. [2025-09-26T20:51:50.042356] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-26T20:51:50.049998] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-26T20:51:50.097450] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-26T20:51:50.311718] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-05. [2025-09-26T20:51:51.111724] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-03. [2025-09-26T20:51:51.911725] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-03. [2025-09-26T20:51:52.288582] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-26T20:51:52.711716] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-06. [2025-09-26T20:51:52.771812] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-26T20:51:52.799269] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-26T20:51:53.100555] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-26T20:51:53.511735] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-06. [2025-09-26T20:51:54.311714] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-04. [2025-09-26T20:51:55.088928] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-26T20:51:55.111692] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-05. [2025-09-26T20:51:55.360574] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-26T20:51:55.626997] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-26T20:51:55.911729] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-06. [2025-09-26T20:51:56.694407] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-26T20:51:56.711679] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-07. [2025-09-26T20:51:57.486017] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-26T20:51:57.511687] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-04. [2025-09-26T20:51:58.311751] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-08. [2025-09-26T20:51:59.110511] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-26T20:51:59.112723] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-07. [2025-09-26T20:51:59.375379] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-26T20:51:59.911715] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-05. [2025-09-26T20:52:00.711704] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-07. [2025-09-26T20:52:00.933072] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-26T20:52:01.121582] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-26T20:52:01.511737] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-09. [2025-09-26T20:52:01.884086] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-26T20:52:02.311695] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-08. [2025-09-26T20:52:02.346357] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-26T20:52:02.348567] [INFO ] [REMOTE ] PSBD: Full fetch complete (9329 records). [2025-09-26T20:52:02.348675] [DEBUG] [VALIDATOR ] PSBD: Validating primary data. [2025-09-26T20:52:02.732945] [DEBUG] [VALIDATOR ] PSBD: All expected trading days are present. [2025-09-26T20:52:02.733096] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-26T20:52:02.733167] [DEBUG] [VALIDATOR ] PSBD: Primary data validation passed. [2025-09-26T20:52:02.734522] [INFO ] [MAIN ] PSBD: Fetched primary data is valid. [2025-09-26T20:52:02.734591] [DEBUG] [LOCAL ] PSBD: Saving primary data. [2025-09-26T20:52:02.735070] [DEBUG] [LOCAL ] PSBD: Trimmed 9329 records to 7130 (keeping 200 days of data) [2025-09-26T20:52:02.780833] [DEBUG] [LOCAL ] PSBD: Primary data saved (7130 records). [2025-09-26T20:52:02.780966] [INFO ] [MAIN ] PSBD: Full history saved. [2025-09-26T20:52:02.781090] [INFO ] [MAIN ] Update Progress: 1736/2371 symbols completed. PSBD took 18.5s. Estimated remaining: 1h 24m 52s. Rate: 7.5 symbols/min [2025-09-26T20:52:02.985509] [INFO ] [MAIN ] PSF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:52:02.997899] [DEBUG] [LOCAL ] PSF: Loaded 6828 existing records from primary storage. [2025-09-26T20:52:02.998036] [INFO ] [MAIN ] PSF: Loaded 6828 existing records. [2025-09-26T20:52:03.116860] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-09. [2025-09-26T20:52:03.192063] [WARN ] [MAIN ] PSF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:52:03.192306] [INFO ] [MAIN ] PSF: Wiping existing primary data before full refresh. [2025-09-26T20:52:03.192355] [INFO ] [LOCAL ] PSF: Starting deletion of primary data. [2025-09-26T20:52:03.192610] [DEBUG] [LOCAL ] PSF: Deleted primary data file. [2025-09-26T20:52:03.192728] [INFO ] [MAIN ] PSF: Starting full primary refresh. [2025-09-26T20:52:03.566075] [INFO ] [REMOTE ] PSF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:52:03.577755] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-26T20:52:03.578824] [INFO ] [REMOTE ] PRVS: Full fetch complete (1271 records). [2025-09-26T20:52:03.578908] [DEBUG] [VALIDATOR ] PRVS: Validating primary data. [2025-09-26T20:52:03.776456] [WARN ] [VALIDATOR ] PRVS: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-09-26T20:52:03.776662] [FATAL] [MAIN ] PRVS: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:52:03.776724] [WARN ] [MAIN ] PRVS: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:52:03.776797] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-09-26T20:52:03.776891] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-09-26T20:52:03.776940] [INFO ] [LOCAL ] PRVS: Starting deletion of derivative data. [2025-09-26T20:52:03.776983] [DEBUG] [LOCAL ] PRVS: No derivative data file found to delete. [2025-09-26T20:52:03.777081] [INFO ] [MAIN ] Update Progress: 1737/2371 symbols completed. PRVS took 31.3s. Estimated remaining: 1h 24m 41s. Rate: 7.5 symbols/min [2025-09-26T20:52:03.922960] [INFO ] [REMOTE ] PSF: Fetching primary data for 2024-12. [2025-09-26T20:52:03.957064] [INFO ] [MAIN ] PSFE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:52:03.989800] [DEBUG] [LOCAL ] PSFE: Loaded 30563 existing records from primary storage. [2025-09-26T20:52:03.989945] [INFO ] [MAIN ] PSFE: Loaded 30563 existing records. [2025-09-26T20:52:04.171897] [WARN ] [MAIN ] PSFE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:52:04.172171] [INFO ] [MAIN ] PSFE: Wiping existing primary data before full refresh. [2025-09-26T20:52:04.172221] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-09-26T20:52:04.172942] [DEBUG] [LOCAL ] PSFE: Deleted primary data file. [2025-09-26T20:52:04.173005] [INFO ] [MAIN ] PSFE: Starting full primary refresh. [2025-09-26T20:52:04.554533] [INFO ] [REMOTE ] PSFE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:52:04.711697] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-08. [2025-09-26T20:52:04.946297] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-26T20:52:05.511727] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2024-12. [2025-09-26T20:52:06.311730] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-06. [2025-09-26T20:52:06.586822] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-26T20:52:06.775818] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-26T20:52:07.111724] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-01. [2025-09-26T20:52:07.879602] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-26T20:52:07.881348] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-26T20:52:07.911710] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-02. [2025-09-26T20:52:08.547231] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-26T20:52:08.711726] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-07. [2025-09-26T20:52:09.511739] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-03. [2025-09-26T20:52:10.198719] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-26T20:52:10.311704] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-04. [2025-09-26T20:52:10.464069] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-26T20:52:11.065717] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-26T20:52:11.111687] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-05. [2025-09-26T20:52:11.911718] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-09. [2025-09-26T20:52:11.939233] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-26T20:52:12.711729] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-01. [2025-09-26T20:52:13.511687] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-06. [2025-09-26T20:52:13.786310] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-26T20:52:13.797376] [INFO ] [REMOTE ] PRU: Full fetch complete (74289 records). [2025-09-26T20:52:13.797616] [DEBUG] [VALIDATOR ] PRU: Validating primary data. [2025-09-26T20:52:13.986309] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-26T20:52:14.163288] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-26T20:52:14.324954] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-08. [2025-09-26T20:52:14.354128] [DEBUG] [VALIDATOR ] PRU: All expected trading days are present. [2025-09-26T20:52:14.354218] [DEBUG] [VALIDATOR ] PRU: Primary data validation passed. [2025-09-26T20:52:14.356534] [INFO ] [MAIN ] PRU: Fetched primary data is valid. [2025-09-26T20:52:14.356800] [DEBUG] [LOCAL ] PRU: Saving primary data. [2025-09-26T20:52:14.360278] [DEBUG] [LOCAL ] PRU: Trimmed 74289 records to 52204 (keeping 200 days of data) [2025-09-26T20:52:14.720511] [DEBUG] [LOCAL ] PRU: Primary data saved (52204 records). [2025-09-26T20:52:14.720753] [INFO ] [MAIN ] PRU: Full history saved. [2025-09-26T20:52:14.723438] [INFO ] [MAIN ] Update Progress: 1738/2371 symbols completed. PRU took 44.1s. Estimated remaining: 1h 24m 34s. Rate: 7.5 symbols/min [2025-09-26T20:52:14.920948] [INFO ] [MAIN ] PSN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:52:14.984171] [DEBUG] [LOCAL ] PSN: Loaded 46526 existing records from primary storage. [2025-09-26T20:52:14.984458] [INFO ] [MAIN ] PSN: Loaded 46526 existing records. [2025-09-26T20:52:15.126464] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-07. [2025-09-26T20:52:15.169862] [WARN ] [MAIN ] PSN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:52:15.170191] [INFO ] [MAIN ] PSN: Wiping existing primary data before full refresh. [2025-09-26T20:52:15.170253] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-09-26T20:52:15.171442] [DEBUG] [LOCAL ] PSN: Deleted primary data file. [2025-09-26T20:52:15.171516] [INFO ] [MAIN ] PSN: Starting full primary refresh. [2025-09-26T20:52:15.537048] [INFO ] [REMOTE ] PSN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:52:15.911719] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-02. [2025-09-26T20:52:15.966806] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-26T20:52:16.011052] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-26T20:52:16.711766] [INFO ] [REMOTE ] PSN: Fetching primary data for 2024-12. [2025-09-26T20:52:17.313041] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-26T20:52:17.511724] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-03. [2025-09-26T20:52:18.311733] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-09. [2025-09-26T20:52:18.383638] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-26T20:52:18.796374] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-26T20:52:19.111740] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-01. [2025-09-26T20:52:19.882105] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-26T20:52:19.893318] [INFO ] [REMOTE ] PSA: Full fetch complete (59226 records). [2025-09-26T20:52:19.893513] [DEBUG] [VALIDATOR ] PSA: Validating primary data. [2025-09-26T20:52:19.917001] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-04. [2025-09-26T20:52:20.323261] [DEBUG] [VALIDATOR ] PSA: All expected trading days are present. [2025-09-26T20:52:20.323623] [DEBUG] [VALIDATOR ] PSA: Primary data validation passed. [2025-09-26T20:52:20.325209] [INFO ] [MAIN ] PSA: Fetched primary data is valid. [2025-09-26T20:52:20.325276] [DEBUG] [LOCAL ] PSA: Saving primary data. [2025-09-26T20:52:20.326987] [DEBUG] [LOCAL ] PSA: Trimmed 59226 records to 42474 (keeping 200 days of data) [2025-09-26T20:52:20.665557] [DEBUG] [LOCAL ] PSA: Primary data saved (42474 records). [2025-09-26T20:52:20.677446] [INFO ] [MAIN ] PSA: Full history saved. [2025-09-26T20:52:20.677629] [INFO ] [MAIN ] Update Progress: 1739/2371 symbols completed. PSA took 45.8s. Estimated remaining: 1h 24m 25s. Rate: 7.5 symbols/min [2025-09-26T20:52:20.713158] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-08. [2025-09-26T20:52:20.715364] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-26T20:52:20.883509] [INFO ] [MAIN ] PSO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:52:20.942294] [DEBUG] [LOCAL ] PSO: Loaded 37577 existing records from primary storage. [2025-09-26T20:52:20.942515] [INFO ] [MAIN ] PSO: Loaded 37577 existing records. [2025-09-26T20:52:21.151251] [WARN ] [MAIN ] PSO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:52:21.151667] [INFO ] [MAIN ] PSO: Wiping existing primary data before full refresh. [2025-09-26T20:52:21.151732] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-09-26T20:52:21.153101] [DEBUG] [LOCAL ] PSO: Deleted primary data file. [2025-09-26T20:52:21.153171] [INFO ] [MAIN ] PSO: Starting full primary refresh. [2025-09-26T20:52:21.475700] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-26T20:52:21.514900] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-02. [2025-09-26T20:52:21.559523] [INFO ] [REMOTE ] PSO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:52:21.569809] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-26T20:52:22.311722] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-09. [2025-09-26T20:52:23.088280] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-26T20:52:23.088519] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-26T20:52:23.100580] [INFO ] [REMOTE ] PSF: Full fetch complete (9764 records). [2025-09-26T20:52:23.100719] [DEBUG] [VALIDATOR ] PSF: Validating primary data. [2025-09-26T20:52:23.116867] [INFO ] [REMOTE ] PSO: Fetching primary data for 2024-12. [2025-09-26T20:52:23.498930] [DEBUG] [VALIDATOR ] PSF: All expected trading days are present. [2025-09-26T20:52:23.499036] [DEBUG] [VALIDATOR ] PSF: Primary data validation passed. [2025-09-26T20:52:23.499364] [INFO ] [MAIN ] PSF: Fetched primary data is valid. [2025-09-26T20:52:23.499406] [DEBUG] [LOCAL ] PSF: Saving primary data. [2025-09-26T20:52:23.499926] [DEBUG] [LOCAL ] PSF: Trimmed 9764 records to 6990 (keeping 200 days of data) [2025-09-26T20:52:23.550322] [DEBUG] [LOCAL ] PSF: Primary data saved (6990 records). [2025-09-26T20:52:23.550472] [INFO ] [MAIN ] PSF: Full history saved. [2025-09-26T20:52:23.550604] [INFO ] [MAIN ] Update Progress: 1740/2371 symbols completed. PSF took 20.8s. Estimated remaining: 1h 24m 15s. Rate: 7.5 symbols/min [2025-09-26T20:52:23.736909] [INFO ] [MAIN ] PSQH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:52:23.788970] [DEBUG] [LOCAL ] PSQH: Loaded 35131 existing records from primary storage. [2025-09-26T20:52:23.789137] [INFO ] [MAIN ] PSQH: Loaded 35131 existing records. [2025-09-26T20:52:23.916860] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-03. [2025-09-26T20:52:23.991392] [WARN ] [MAIN ] PSQH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:52:23.991718] [INFO ] [MAIN ] PSQH: Wiping existing primary data before full refresh. [2025-09-26T20:52:23.991790] [INFO ] [LOCAL ] PSQH: Starting deletion of primary data. [2025-09-26T20:52:23.992567] [DEBUG] [LOCAL ] PSQH: Deleted primary data file. [2025-09-26T20:52:23.992629] [INFO ] [MAIN ] PSQH: Starting full primary refresh. [2025-09-26T20:52:24.409633] [INFO ] [REMOTE ] PSQH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:52:24.427298] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-26T20:52:24.711734] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-05. [2025-09-26T20:52:25.511731] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2024-12. [2025-09-26T20:52:25.636800] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-26T20:52:26.311700] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-01. [2025-09-26T20:52:26.337268] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-26T20:52:27.111717] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-06. [2025-09-26T20:52:27.633031] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-26T20:52:27.745396] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-26T20:52:27.911695] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-02. [2025-09-26T20:52:28.609421] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-26T20:52:28.711674] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-07. [2025-09-26T20:52:28.985089] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-26T20:52:29.511714] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-03. [2025-09-26T20:52:30.177099] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-26T20:52:30.311720] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-01. [2025-09-26T20:52:30.726051] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-26T20:52:31.111717] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-04. [2025-09-26T20:52:31.917865] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-04. [2025-09-26T20:52:31.937170] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-26T20:52:32.661568] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-26T20:52:32.711727] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-08. [2025-09-26T20:52:33.511729] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-05. [2025-09-26T20:52:33.730947] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-26T20:52:33.847038] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-26T20:52:34.311745] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-05. [2025-09-26T20:52:34.992448] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-26T20:52:35.111704] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-02. [2025-09-26T20:52:35.911724] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-06. [2025-09-26T20:52:36.087893] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-26T20:52:36.711765] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-06. [2025-09-26T20:52:36.745287] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T20:52:37.456371] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-26T20:52:37.511731] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-07. [2025-09-26T20:52:38.311717] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-09. [2025-09-26T20:52:38.429985] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-26T20:52:39.092997] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-26T20:52:39.111679] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-08. [2025-09-26T20:52:39.488605] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-26T20:52:39.494846] [INFO ] [REMOTE ] PSFE: Full fetch complete (43106 records). [2025-09-26T20:52:39.495016] [DEBUG] [VALIDATOR ] PSFE: Validating primary data. [2025-09-26T20:52:39.897209] [DEBUG] [VALIDATOR ] PSFE: All expected trading days are present. [2025-09-26T20:52:39.897295] [DEBUG] [VALIDATOR ] PSFE: Primary data validation passed. [2025-09-26T20:52:39.898067] [INFO ] [MAIN ] PSFE: Fetched primary data is valid. [2025-09-26T20:52:39.898132] [DEBUG] [LOCAL ] PSFE: Saving primary data. [2025-09-26T20:52:39.899192] [DEBUG] [LOCAL ] PSFE: Trimmed 43106 records to 30702 (keeping 200 days of data) [2025-09-26T20:52:39.911695] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-03. [2025-09-26T20:52:40.095682] [DEBUG] [LOCAL ] PSFE: Primary data saved (30702 records). [2025-09-26T20:52:40.095835] [INFO ] [MAIN ] PSFE: Full history saved. [2025-09-26T20:52:40.095944] [INFO ] [MAIN ] Update Progress: 1741/2371 symbols completed. PSFE took 36.3s. Estimated remaining: 1h 24m 11s. Rate: 7.5 symbols/min [2025-09-26T20:52:40.283703] [INFO ] [MAIN ] PSTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:52:40.340678] [DEBUG] [LOCAL ] PSTG: Loaded 53237 existing records from primary storage. [2025-09-26T20:52:40.340928] [INFO ] [MAIN ] PSTG: Loaded 53237 existing records. [2025-09-26T20:52:40.472914] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-26T20:52:40.563365] [WARN ] [MAIN ] PSTG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:52:40.563701] [INFO ] [MAIN ] PSTG: Wiping existing primary data before full refresh. [2025-09-26T20:52:40.563761] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-09-26T20:52:40.564967] [DEBUG] [LOCAL ] PSTG: Deleted primary data file. [2025-09-26T20:52:40.565030] [INFO ] [MAIN ] PSTG: Starting full primary refresh. [2025-09-26T20:52:40.716900] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-07. [2025-09-26T20:52:40.949518] [INFO ] [REMOTE ] PSTG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:52:41.414811] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-26T20:52:41.511721] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-09. [2025-09-26T20:52:42.312635] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2024-12. [2025-09-26T20:52:42.312561] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-26T20:52:42.874887] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-26T20:52:42.886387] [INFO ] [REMOTE ] PSO: Full fetch complete (51765 records). [2025-09-26T20:52:42.886690] [DEBUG] [VALIDATOR ] PSO: Validating primary data. [2025-09-26T20:52:43.118592] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-08. [2025-09-26T20:52:43.467205] [DEBUG] [VALIDATOR ] PSO: All expected trading days are present. [2025-09-26T20:52:43.467361] [DEBUG] [VALIDATOR ] PSO: Primary data validation passed. [2025-09-26T20:52:43.469163] [INFO ] [MAIN ] PSO: Fetched primary data is valid. [2025-09-26T20:52:43.469279] [DEBUG] [LOCAL ] PSO: Saving primary data. [2025-09-26T20:52:43.471595] [DEBUG] [LOCAL ] PSO: Trimmed 51765 records to 37751 (keeping 200 days of data) [2025-09-26T20:52:43.764134] [DEBUG] [LOCAL ] PSO: Primary data saved (37751 records). [2025-09-26T20:52:43.764318] [INFO ] [MAIN ] PSO: Full history saved. [2025-09-26T20:52:43.764448] [INFO ] [MAIN ] Update Progress: 1742/2371 symbols completed. PSO took 23.1s. Estimated remaining: 1h 24m 1s. Rate: 7.5 symbols/min [2025-09-26T20:52:43.916922] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-04. [2025-09-26T20:52:43.979353] [INFO ] [MAIN ] PSTL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:52:44.004619] [DEBUG] [LOCAL ] PSTL: Loaded 20493 existing records from primary storage. [2025-09-26T20:52:44.004802] [INFO ] [MAIN ] PSTL: Loaded 20493 existing records. [2025-09-26T20:52:44.266456] [WARN ] [MAIN ] PSTL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:52:44.267065] [INFO ] [MAIN ] PSTL: Wiping existing primary data before full refresh. [2025-09-26T20:52:44.267173] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-09-26T20:52:44.267939] [DEBUG] [LOCAL ] PSTL: Deleted primary data file. [2025-09-26T20:52:44.268017] [INFO ] [MAIN ] PSTL: Starting full primary refresh. [2025-09-26T20:52:44.429786] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-26T20:52:44.712734] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-01. [2025-09-26T20:52:44.727115] [INFO ] [REMOTE ] PSTL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:52:44.753224] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-26T20:52:45.511728] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-09. [2025-09-26T20:52:45.598463] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-26T20:52:46.311725] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2024-12. [2025-09-26T20:52:46.771053] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-26T20:52:46.808126] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-26T20:52:46.818891] [INFO ] [REMOTE ] PSN: Full fetch complete (66829 records). [2025-09-26T20:52:46.819016] [DEBUG] [VALIDATOR ] PSN: Validating primary data. [2025-09-26T20:52:47.117304] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-02. [2025-09-26T20:52:47.244214] [DEBUG] [VALIDATOR ] PSN: All expected trading days are present. [2025-09-26T20:52:47.244381] [DEBUG] [VALIDATOR ] PSN: Primary data validation passed. [2025-09-26T20:52:47.245512] [INFO ] [MAIN ] PSN: Fetched primary data is valid. [2025-09-26T20:52:47.245582] [DEBUG] [LOCAL ] PSN: Saving primary data. [2025-09-26T20:52:47.247129] [DEBUG] [LOCAL ] PSN: Trimmed 66829 records to 46808 (keeping 200 days of data) [2025-09-26T20:52:47.502729] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-26T20:52:47.567221] [DEBUG] [LOCAL ] PSN: Primary data saved (46808 records). [2025-09-26T20:52:47.567372] [INFO ] [MAIN ] PSN: Full history saved. [2025-09-26T20:52:47.567461] [INFO ] [MAIN ] Update Progress: 1743/2371 symbols completed. PSN took 32.8s. Estimated remaining: 1h 23m 51s. Rate: 7.5 symbols/min [2025-09-26T20:52:47.751122] [INFO ] [MAIN ] PSX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:52:47.814911] [DEBUG] [LOCAL ] PSX: Loaded 53522 existing records from primary storage. [2025-09-26T20:52:47.815071] [INFO ] [MAIN ] PSX: Loaded 53522 existing records. [2025-09-26T20:52:47.919136] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-05. [2025-09-26T20:52:48.025341] [WARN ] [MAIN ] PSX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:52:48.025635] [INFO ] [MAIN ] PSX: Wiping existing primary data before full refresh. [2025-09-26T20:52:48.025719] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-09-26T20:52:48.027064] [DEBUG] [LOCAL ] PSX: Deleted primary data file. [2025-09-26T20:52:48.027128] [INFO ] [MAIN ] PSX: Starting full primary refresh. [2025-09-26T20:52:48.425359] [INFO ] [REMOTE ] PSX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:52:48.711705] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-01. [2025-09-26T20:52:48.911630] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-26T20:52:49.519128] [INFO ] [REMOTE ] PSX: Fetching primary data for 2024-12. [2025-09-26T20:52:49.535851] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-26T20:52:49.740539] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-26T20:52:50.311732] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-03. [2025-09-26T20:52:51.111726] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-06. [2025-09-26T20:52:51.271500] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-26T20:52:51.911694] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-02. [2025-09-26T20:52:52.103549] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-26T20:52:52.536142] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-26T20:52:52.711720] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-07. [2025-09-26T20:52:53.181679] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-26T20:52:53.511724] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-01. [2025-09-26T20:52:54.144064] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-26T20:52:54.311734] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-04. [2025-09-26T20:52:55.111731] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-08. [2025-09-26T20:52:55.475530] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-26T20:52:55.911738] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-02. [2025-09-26T20:52:56.208474] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-26T20:52:56.580575] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-26T20:52:56.711741] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-09. [2025-09-26T20:52:57.511725] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-03. [2025-09-26T20:52:57.624281] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-26T20:52:58.311734] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-03. [2025-09-26T20:52:58.522729] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-26T20:52:58.531625] [INFO ] [REMOTE ] PSQH: Full fetch complete (53768 records). [2025-09-26T20:52:58.531802] [DEBUG] [VALIDATOR ] PSQH: Validating primary data. [2025-09-26T20:52:58.870937] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-26T20:52:58.985327] [DEBUG] [VALIDATOR ] PSQH: All expected trading days are present. [2025-09-26T20:52:58.985460] [DEBUG] [VALIDATOR ] PSQH: Primary data validation passed. [2025-09-26T20:52:58.986714] [INFO ] [MAIN ] PSQH: Fetched primary data is valid. [2025-09-26T20:52:58.986802] [DEBUG] [LOCAL ] PSQH: Saving primary data. [2025-09-26T20:52:58.988549] [DEBUG] [LOCAL ] PSQH: Trimmed 53768 records to 35426 (keeping 200 days of data) [2025-09-26T20:52:59.115155] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-05. [2025-09-26T20:52:59.207135] [DEBUG] [LOCAL ] PSQH: Primary data saved (35426 records). [2025-09-26T20:52:59.207351] [INFO ] [MAIN ] PSQH: Full history saved. [2025-09-26T20:52:59.207469] [INFO ] [MAIN ] Update Progress: 1744/2371 symbols completed. PSQH took 35.7s. Estimated remaining: 1h 23m 45s. Rate: 7.5 symbols/min [2025-09-26T20:52:59.391187] [INFO ] [MAIN ] PTA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:52:59.409263] [DEBUG] [LOCAL ] PTA: Loaded 15182 existing records from primary storage. [2025-09-26T20:52:59.409429] [INFO ] [MAIN ] PTA: Loaded 15182 existing records. [2025-09-26T20:52:59.599174] [WARN ] [MAIN ] PTA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:52:59.599447] [INFO ] [MAIN ] PTA: Wiping existing primary data before full refresh. [2025-09-26T20:52:59.599498] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-09-26T20:52:59.600081] [DEBUG] [LOCAL ] PTA: Deleted primary data file. [2025-09-26T20:52:59.600144] [INFO ] [MAIN ] PTA: Starting full primary refresh. [2025-09-26T20:52:59.915773] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-04. [2025-09-26T20:53:00.042515] [INFO ] [REMOTE ] PTA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:53:00.218968] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-26T20:53:00.711708] [INFO ] [REMOTE ] PTA: Fetching primary data for 2024-12. [2025-09-26T20:53:01.087547] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-26T20:53:01.216212] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-26T20:53:01.511703] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-05. [2025-09-26T20:53:01.929564] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-26T20:53:02.311764] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-04. [2025-09-26T20:53:02.364353] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-26T20:53:03.111740] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-06. [2025-09-26T20:53:03.911722] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-06. [2025-09-26T20:53:04.446317] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-26T20:53:04.670060] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-26T20:53:04.711739] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-07. [2025-09-26T20:53:04.868762] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-26T20:53:05.511688] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-01. [2025-09-26T20:53:05.856775] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-26T20:53:06.311721] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-08. [2025-09-26T20:53:06.644781] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-26T20:53:07.111710] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-07. [2025-09-26T20:53:07.326179] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-26T20:53:07.911730] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-09. [2025-09-26T20:53:08.711689] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-05. [2025-09-26T20:53:09.086910] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-26T20:53:09.112738] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-26T20:53:09.117284] [INFO ] [REMOTE ] PSTL: Full fetch complete (29616 records). [2025-09-26T20:53:09.117429] [DEBUG] [VALIDATOR ] PSTL: Validating primary data. [2025-09-26T20:53:09.518330] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-02. [2025-09-26T20:53:09.520485] [DEBUG] [VALIDATOR ] PSTL: All expected trading days are present. [2025-09-26T20:53:09.521340] [DEBUG] [VALIDATOR ] PSTL: Primary data validation passed. [2025-09-26T20:53:09.521990] [INFO ] [MAIN ] PSTL: Fetched primary data is valid. [2025-09-26T20:53:09.522053] [DEBUG] [LOCAL ] PSTL: Saving primary data. [2025-09-26T20:53:09.522996] [DEBUG] [LOCAL ] PSTL: Trimmed 29616 records to 20585 (keeping 200 days of data) [2025-09-26T20:53:09.655858] [DEBUG] [LOCAL ] PSTL: Primary data saved (20585 records). [2025-09-26T20:53:09.656020] [INFO ] [MAIN ] PSTL: Full history saved. [2025-09-26T20:53:09.656140] [INFO ] [MAIN ] Update Progress: 1745/2371 symbols completed. PSTL took 25.9s. Estimated remaining: 1h 23m 38s. Rate: 7.5 symbols/min [2025-09-26T20:53:09.845023] [INFO ] [MAIN ] PTY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:53:09.888033] [DEBUG] [LOCAL ] PTY: Loaded 37653 existing records from primary storage. [2025-09-26T20:53:09.888219] [INFO ] [MAIN ] PTY: Loaded 37653 existing records. [2025-09-26T20:53:10.092423] [WARN ] [MAIN ] PTY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:53:10.092703] [INFO ] [MAIN ] PTY: Wiping existing primary data before full refresh. [2025-09-26T20:53:10.092760] [INFO ] [LOCAL ] PTY: Starting deletion of primary data. [2025-09-26T20:53:10.093674] [DEBUG] [LOCAL ] PTY: Deleted primary data file. [2025-09-26T20:53:10.093737] [INFO ] [MAIN ] PTY: Starting full primary refresh. [2025-09-26T20:53:10.329880] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-08. [2025-09-26T20:53:10.504850] [INFO ] [REMOTE ] PTY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:53:10.515049] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-26T20:53:10.739756] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-26T20:53:11.111725] [INFO ] [REMOTE ] PTY: Fetching primary data for 2024-12. [2025-09-26T20:53:11.911718] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-03. [2025-09-26T20:53:12.452192] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-26T20:53:12.625761] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-26T20:53:12.711700] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-09. [2025-09-26T20:53:12.946365] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-26T20:53:13.511748] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-06. [2025-09-26T20:53:14.311726] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-04. [2025-09-26T20:53:14.511401] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-26T20:53:14.521884] [INFO ] [REMOTE ] PSTG: Full fetch complete (76543 records). [2025-09-26T20:53:14.522032] [DEBUG] [VALIDATOR ] PSTG: Validating primary data. [2025-09-26T20:53:14.954324] [DEBUG] [VALIDATOR ] PSTG: All expected trading days are present. [2025-09-26T20:53:14.954506] [DEBUG] [VALIDATOR ] PSTG: Primary data validation passed. [2025-09-26T20:53:14.956127] [INFO ] [MAIN ] PSTG: Fetched primary data is valid. [2025-09-26T20:53:14.956248] [DEBUG] [LOCAL ] PSTG: Saving primary data. [2025-09-26T20:53:14.958063] [DEBUG] [LOCAL ] PSTG: Trimmed 76543 records to 53626 (keeping 200 days of data) [2025-09-26T20:53:15.135296] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-01. [2025-09-26T20:53:15.355735] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-26T20:53:15.385367] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-26T20:53:15.404122] [DEBUG] [LOCAL ] PSTG: Primary data saved (53626 records). [2025-09-26T20:53:15.404303] [INFO ] [MAIN ] PSTG: Full history saved. [2025-09-26T20:53:15.404394] [INFO ] [MAIN ] Update Progress: 1746/2371 symbols completed. PSTG took 35.3s. Estimated remaining: 1h 23m 29s. Rate: 7.5 symbols/min [2025-09-26T20:53:15.608865] [INFO ] [MAIN ] PUK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:53:15.655330] [DEBUG] [LOCAL ] PUK: Loaded 45251 existing records from primary storage. [2025-09-26T20:53:15.655478] [INFO ] [MAIN ] PUK: Loaded 45251 existing records. [2025-09-26T20:53:15.848200] [WARN ] [MAIN ] PUK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:53:15.848556] [INFO ] [MAIN ] PUK: Wiping existing primary data before full refresh. [2025-09-26T20:53:15.848627] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-09-26T20:53:15.849633] [DEBUG] [LOCAL ] PUK: Deleted primary data file. [2025-09-26T20:53:15.849736] [INFO ] [MAIN ] PUK: Starting full primary refresh. [2025-09-26T20:53:15.916942] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-07. [2025-09-26T20:53:16.230915] [INFO ] [REMOTE ] PUK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:53:16.468565] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-26T20:53:16.711725] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-02. [2025-09-26T20:53:17.511739] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-05. [2025-09-26T20:53:17.968880] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-26T20:53:18.081223] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-26T20:53:18.113823] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-26T20:53:18.311723] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-08. [2025-09-26T20:53:19.111715] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-06. [2025-09-26T20:53:19.911721] [INFO ] [REMOTE ] PUK: Fetching primary data for 2024-12. [2025-09-26T20:53:20.016546] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-26T20:53:20.186491] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-26T20:53:20.711728] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-03. [2025-09-26T20:53:21.520391] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-07. [2025-09-26T20:53:21.539090] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-26T20:53:22.151255] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-26T20:53:22.311737] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-04. [2025-09-26T20:53:22.498063] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-26T20:53:23.111730] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-09. [2025-09-26T20:53:23.911713] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-01. [2025-09-26T20:53:24.015709] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-26T20:53:24.711749] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-08. [2025-09-26T20:53:24.892445] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-26T20:53:24.903067] [INFO ] [REMOTE ] PSX: Full fetch complete (77055 records). [2025-09-26T20:53:24.903215] [DEBUG] [VALIDATOR ] PSX: Validating primary data. [2025-09-26T20:53:25.355343] [DEBUG] [VALIDATOR ] PSX: All expected trading days are present. [2025-09-26T20:53:25.355535] [DEBUG] [VALIDATOR ] PSX: Primary data validation passed. [2025-09-26T20:53:25.356625] [INFO ] [MAIN ] PSX: Fetched primary data is valid. [2025-09-26T20:53:25.356730] [DEBUG] [LOCAL ] PSX: Saving primary data. [2025-09-26T20:53:25.358405] [DEBUG] [LOCAL ] PSX: Trimmed 77055 records to 53912 (keeping 200 days of data) [2025-09-26T20:53:25.514538] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-05. [2025-09-26T20:53:25.520076] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-26T20:53:25.754353] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-26T20:53:25.787500] [DEBUG] [LOCAL ] PSX: Primary data saved (53912 records). [2025-09-26T20:53:25.787704] [INFO ] [MAIN ] PSX: Full history saved. [2025-09-26T20:53:25.790337] [INFO ] [MAIN ] Update Progress: 1747/2371 symbols completed. PSX took 38.2s. Estimated remaining: 1h 23m 22s. Rate: 7.5 symbols/min [2025-09-26T20:53:25.982977] [INFO ] [MAIN ] PUMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:53:26.043801] [DEBUG] [LOCAL ] PUMP: Loaded 49796 existing records from primary storage. [2025-09-26T20:53:26.044017] [INFO ] [MAIN ] PUMP: Loaded 49796 existing records. [2025-09-26T20:53:26.233886] [WARN ] [MAIN ] PUMP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:53:26.234291] [INFO ] [MAIN ] PUMP: Wiping existing primary data before full refresh. [2025-09-26T20:53:26.234351] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-09-26T20:53:26.235503] [DEBUG] [LOCAL ] PUMP: Deleted primary data file. [2025-09-26T20:53:26.235567] [INFO ] [MAIN ] PUMP: Starting full primary refresh. [2025-09-26T20:53:26.318800] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-02. [2025-09-26T20:53:26.616974] [INFO ] [REMOTE ] PUMP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:53:26.749807] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-26T20:53:27.111741] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-09. [2025-09-26T20:53:27.578505] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-26T20:53:27.911689] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-06. [2025-09-26T20:53:28.107884] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-26T20:53:28.111365] [INFO ] [REMOTE ] PTA: Full fetch complete (23493 records). [2025-09-26T20:53:28.111446] [DEBUG] [VALIDATOR ] PTA: Validating primary data. [2025-09-26T20:53:28.488832] [DEBUG] [VALIDATOR ] PTA: All expected trading days are present. [2025-09-26T20:53:28.488923] [DEBUG] [VALIDATOR ] PTA: Primary data validation passed. [2025-09-26T20:53:28.489461] [INFO ] [MAIN ] PTA: Fetched primary data is valid. [2025-09-26T20:53:28.489521] [DEBUG] [LOCAL ] PTA: Saving primary data. [2025-09-26T20:53:28.490229] [DEBUG] [LOCAL ] PTA: Trimmed 23493 records to 15299 (keeping 200 days of data) [2025-09-26T20:53:28.589074] [DEBUG] [LOCAL ] PTA: Primary data saved (15299 records). [2025-09-26T20:53:28.589228] [INFO ] [MAIN ] PTA: Full history saved. [2025-09-26T20:53:28.589316] [INFO ] [MAIN ] Update Progress: 1748/2371 symbols completed. PTA took 29.4s. Estimated remaining: 1h 23m 12s. Rate: 7.5 symbols/min [2025-09-26T20:53:28.716877] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2024-12. [2025-09-26T20:53:28.779623] [INFO ] [MAIN ] PVH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:53:28.831412] [DEBUG] [LOCAL ] PVH: Loaded 50819 existing records from primary storage. [2025-09-26T20:53:28.831633] [INFO ] [MAIN ] PVH: Loaded 50819 existing records. [2025-09-26T20:53:29.030617] [WARN ] [MAIN ] PVH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:53:29.031016] [INFO ] [MAIN ] PVH: Wiping existing primary data before full refresh. [2025-09-26T20:53:29.031106] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-09-26T20:53:29.032906] [DEBUG] [LOCAL ] PVH: Deleted primary data file. [2025-09-26T20:53:29.032980] [INFO ] [MAIN ] PVH: Starting full primary refresh. [2025-09-26T20:53:29.471024] [INFO ] [REMOTE ] PVH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:53:29.473457] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-26T20:53:29.511718] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-07. [2025-09-26T20:53:30.311701] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-03. [2025-09-26T20:53:30.514286] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T20:53:30.617450] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-26T20:53:31.111730] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-01. [2025-09-26T20:53:31.911723] [INFO ] [REMOTE ] PVH: Fetching primary data for 2024-12. [2025-09-26T20:53:32.025428] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-26T20:53:32.711743] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-04. [2025-09-26T20:53:32.863962] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-26T20:53:33.245421] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-26T20:53:33.511724] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-01. [2025-09-26T20:53:34.311692] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-02. [2025-09-26T20:53:34.498457] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-26T20:53:35.111731] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-08. [2025-09-26T20:53:35.190623] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-26T20:53:35.892089] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-26T20:53:35.911705] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-05. [2025-09-26T20:53:36.249954] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-26T20:53:36.711763] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-02. [2025-09-26T20:53:37.464054] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-26T20:53:37.511720] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-06. [2025-09-26T20:53:38.261379] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-26T20:53:38.311679] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-09. [2025-09-26T20:53:39.111711] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-03. [2025-09-26T20:53:39.141056] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-26T20:53:39.767551] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-26T20:53:39.775705] [INFO ] [REMOTE ] PTY: Full fetch complete (53797 records). [2025-09-26T20:53:39.775891] [DEBUG] [VALIDATOR ] PTY: Validating primary data. [2025-09-26T20:53:39.916873] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-03. [2025-09-26T20:53:40.199091] [DEBUG] [VALIDATOR ] PTY: All expected trading days are present. [2025-09-26T20:53:40.199175] [DEBUG] [VALIDATOR ] PTY: Primary data validation passed. [2025-09-26T20:53:40.200112] [INFO ] [MAIN ] PTY: Fetched primary data is valid. [2025-09-26T20:53:40.200180] [DEBUG] [LOCAL ] PTY: Saving primary data. [2025-09-26T20:53:40.201600] [DEBUG] [LOCAL ] PTY: Trimmed 53797 records to 37902 (keeping 200 days of data) [2025-09-26T20:53:40.344232] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-26T20:53:40.492964] [DEBUG] [LOCAL ] PTY: Primary data saved (37902 records). [2025-09-26T20:53:40.493131] [INFO ] [MAIN ] PTY: Full history saved. [2025-09-26T20:53:40.493260] [INFO ] [MAIN ] Update Progress: 1749/2371 symbols completed. PTY took 30.8s. Estimated remaining: 1h 23m 5s. Rate: 7.5 symbols/min [2025-09-26T20:53:40.670519] [INFO ] [MAIN ] PVL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:53:40.677069] [DEBUG] [LOCAL ] PVL: Loaded 4785 existing records from primary storage. [2025-09-26T20:53:40.677204] [INFO ] [MAIN ] PVL: Loaded 4785 existing records. [2025-09-26T20:53:40.716808] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-04. [2025-09-26T20:53:40.868929] [WARN ] [MAIN ] PVL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:53:40.869204] [INFO ] [MAIN ] PVL: Wiping existing primary data before full refresh. [2025-09-26T20:53:40.869262] [INFO ] [LOCAL ] PVL: Starting deletion of primary data. [2025-09-26T20:53:40.869527] [DEBUG] [LOCAL ] PVL: Deleted primary data file. [2025-09-26T20:53:40.869599] [INFO ] [MAIN ] PVL: Starting full primary refresh. [2025-09-26T20:53:41.241158] [INFO ] [REMOTE ] PVL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:53:41.511705] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-07. [2025-09-26T20:53:41.982846] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-26T20:53:42.311767] [INFO ] [REMOTE ] PVL: Fetching primary data for 2024-12. [2025-09-26T20:53:42.448730] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-26T20:53:43.111722] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-05. [2025-09-26T20:53:43.131785] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-26T20:53:43.318107] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-26T20:53:43.911724] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-04. [2025-09-26T20:53:44.239779] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-26T20:53:44.711717] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-01. [2025-09-26T20:53:45.372915] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-26T20:53:45.511726] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-08. [2025-09-26T20:53:45.718527] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-26T20:53:46.311728] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-05. [2025-09-26T20:53:47.111703] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-06. [2025-09-26T20:53:47.172453] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-26T20:53:47.911731] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-09. [2025-09-26T20:53:48.198217] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-26T20:53:48.711701] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-06. [2025-09-26T20:53:48.825224] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-26T20:53:49.222602] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-26T20:53:49.231665] [INFO ] [REMOTE ] PUK: Full fetch complete (65163 records). [2025-09-26T20:53:49.231832] [DEBUG] [VALIDATOR ] PUK: Validating primary data. [2025-09-26T20:53:49.516883] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-02. [2025-09-26T20:53:49.641968] [DEBUG] [VALIDATOR ] PUK: All expected trading days are present. [2025-09-26T20:53:49.642055] [DEBUG] [VALIDATOR ] PUK: Primary data validation passed. [2025-09-26T20:53:49.642998] [INFO ] [MAIN ] PUK: Fetched primary data is valid. [2025-09-26T20:53:49.643079] [DEBUG] [LOCAL ] PUK: Saving primary data. [2025-09-26T20:53:49.644453] [DEBUG] [LOCAL ] PUK: Trimmed 65163 records to 45565 (keeping 200 days of data) [2025-09-26T20:53:49.958070] [DEBUG] [LOCAL ] PUK: Primary data saved (45565 records). [2025-09-26T20:53:49.958218] [INFO ] [MAIN ] PUK: Full history saved. [2025-09-26T20:53:49.958336] [INFO ] [MAIN ] Update Progress: 1750/2371 symbols completed. PUK took 34.6s. Estimated remaining: 1h 22m 58s. Rate: 7.5 symbols/min [2025-09-26T20:53:50.149346] [INFO ] [MAIN ] PWR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:53:50.196279] [DEBUG] [LOCAL ] PWR: Loaded 47713 existing records from primary storage. [2025-09-26T20:53:50.196431] [INFO ] [MAIN ] PWR: Loaded 47713 existing records. [2025-09-26T20:53:50.280807] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-26T20:53:50.319147] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-07. [2025-09-26T20:53:50.415315] [WARN ] [MAIN ] PWR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:53:50.415794] [INFO ] [MAIN ] PWR: Wiping existing primary data before full refresh. [2025-09-26T20:53:50.415908] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-09-26T20:53:50.417252] [DEBUG] [LOCAL ] PWR: Deleted primary data file. [2025-09-26T20:53:50.417323] [INFO ] [MAIN ] PWR: Starting full primary refresh. [2025-09-26T20:53:50.780490] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-26T20:53:50.874153] [INFO ] [REMOTE ] PWR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:53:51.111728] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-07. [2025-09-26T20:53:51.911700] [INFO ] [REMOTE ] PWR: Fetching primary data for 2024-12. [2025-09-26T20:53:52.104589] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-26T20:53:52.711686] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-03. [2025-09-26T20:53:52.794867] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-26T20:53:53.380851] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-26T20:53:53.511700] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-08. [2025-09-26T20:53:53.547727] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-26T20:53:54.311725] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-04. [2025-09-26T20:53:54.994637] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-26T20:53:55.111695] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-08. [2025-09-26T20:53:55.288575] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-26T20:53:55.911719] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-05. [2025-09-26T20:53:56.577732] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-26T20:53:56.711737] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-06. [2025-09-26T20:53:56.937405] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-26T20:53:57.440621] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-26T20:53:57.511742] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-09. [2025-09-26T20:53:58.311715] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-01. [2025-09-26T20:53:59.111716] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-09. [2025-09-26T20:53:59.168822] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-26T20:53:59.178502] [INFO ] [REMOTE ] PVH: Full fetch complete (70692 records). [2025-09-26T20:53:59.178664] [DEBUG] [VALIDATOR ] PVH: Validating primary data. [2025-09-26T20:53:59.580801] [DEBUG] [VALIDATOR ] PVH: All expected trading days are present. [2025-09-26T20:53:59.580900] [DEBUG] [VALIDATOR ] PVH: Primary data validation passed. [2025-09-26T20:53:59.581937] [INFO ] [MAIN ] PVH: Fetched primary data is valid. [2025-09-26T20:53:59.582014] [DEBUG] [LOCAL ] PVH: Saving primary data. [2025-09-26T20:53:59.583702] [DEBUG] [LOCAL ] PVH: Trimmed 70692 records to 51137 (keeping 200 days of data) [2025-09-26T20:53:59.911253] [DEBUG] [LOCAL ] PVH: Primary data saved (51137 records). [2025-09-26T20:53:59.911405] [INFO ] [MAIN ] PVH: Full history saved. [2025-09-26T20:53:59.911498] [INFO ] [MAIN ] Update Progress: 1751/2371 symbols completed. PVH took 31.3s. Estimated remaining: 1h 22m 50s. Rate: 7.5 symbols/min [2025-09-26T20:53:59.911714] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-07. [2025-09-26T20:54:00.096236] [INFO ] [MAIN ] PX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:54:00.127423] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-26T20:54:00.163426] [DEBUG] [LOCAL ] PX: Loaded 34911 existing records from primary storage. [2025-09-26T20:54:00.163563] [INFO ] [MAIN ] PX: Loaded 34911 existing records. [2025-09-26T20:54:00.358000] [WARN ] [MAIN ] PX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:54:00.358491] [INFO ] [MAIN ] PX: Wiping existing primary data before full refresh. [2025-09-26T20:54:00.358624] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-09-26T20:54:00.368577] [DEBUG] [LOCAL ] PX: Deleted primary data file. [2025-09-26T20:54:00.368726] [INFO ] [MAIN ] PX: Starting full primary refresh. [2025-09-26T20:54:00.495549] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-26T20:54:00.538095] [INFO ] [REMOTE ] PUMP: Full fetch complete (71789 records). [2025-09-26T20:54:00.562213] [DEBUG] [VALIDATOR ] PUMP: Validating primary data. [2025-09-26T20:54:00.721141] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-02. [2025-09-26T20:54:00.789565] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-26T20:54:01.118487] [INFO ] [REMOTE ] PX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:54:01.249716] [DEBUG] [VALIDATOR ] PUMP: All expected trading days are present. [2025-09-26T20:54:01.249808] [DEBUG] [VALIDATOR ] PUMP: Primary data validation passed. [2025-09-26T20:54:01.250945] [INFO ] [MAIN ] PUMP: Fetched primary data is valid. [2025-09-26T20:54:01.251010] [DEBUG] [LOCAL ] PUMP: Saving primary data. [2025-09-26T20:54:01.252419] [DEBUG] [LOCAL ] PUMP: Trimmed 71789 records to 50160 (keeping 200 days of data) [2025-09-26T20:54:01.522556] [INFO ] [REMOTE ] PX: Fetching primary data for 2024-12. [2025-09-26T20:54:01.562066] [DEBUG] [LOCAL ] PUMP: Primary data saved (50160 records). [2025-09-26T20:54:01.562219] [INFO ] [MAIN ] PUMP: Full history saved. [2025-09-26T20:54:01.562316] [INFO ] [MAIN ] Update Progress: 1752/2371 symbols completed. PUMP took 35.8s. Estimated remaining: 1h 22m 40s. Rate: 7.5 symbols/min [2025-09-26T20:54:01.738591] [INFO ] [MAIN ] QBTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:54:01.739030] [DEBUG] [LOCAL ] QBTS: No existing data file found in primary storage. [2025-09-26T20:54:01.739072] [WARN ] [MAIN ] QBTS: No existing data found, performing full refresh instead. [2025-09-26T20:54:01.739176] [INFO ] [MAIN ] QBTS: Wiping existing primary data before full refresh. [2025-09-26T20:54:01.739215] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-09-26T20:54:01.739255] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-09-26T20:54:01.739287] [INFO ] [MAIN ] QBTS: Starting full primary refresh. [2025-09-26T20:54:02.097026] [INFO ] [REMOTE ] QBTS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:54:02.311786] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-08. [2025-09-26T20:54:02.700973] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-26T20:54:02.929613] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-26T20:54:03.111699] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-09. [2025-09-26T20:54:03.225417] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-26T20:54:03.809565] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-26T20:54:03.811532] [INFO ] [REMOTE ] PVL: Full fetch complete (7565 records). [2025-09-26T20:54:03.811617] [DEBUG] [VALIDATOR ] PVL: Validating primary data. [2025-09-26T20:54:03.916934] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-01. [2025-09-26T20:54:04.196334] [DEBUG] [VALIDATOR ] PVL: All expected trading days are present. [2025-09-26T20:54:04.196417] [DEBUG] [VALIDATOR ] PVL: Primary data validation passed. [2025-09-26T20:54:04.196629] [INFO ] [MAIN ] PVL: Fetched primary data is valid. [2025-09-26T20:54:04.196707] [DEBUG] [LOCAL ] PVL: Saving primary data. [2025-09-26T20:54:04.197160] [DEBUG] [LOCAL ] PVL: Trimmed 7565 records to 4819 (keeping 200 days of data) [2025-09-26T20:54:04.226331] [DEBUG] [LOCAL ] PVL: Primary data saved (4819 records). [2025-09-26T20:54:04.226457] [INFO ] [MAIN ] PVL: Full history saved. [2025-09-26T20:54:04.226547] [INFO ] [MAIN ] Update Progress: 1753/2371 symbols completed. PVL took 23.7s. Estimated remaining: 1h 22m 30s. Rate: 7.5 symbols/min [2025-09-26T20:54:04.402816] [INFO ] [MAIN ] QD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:54:04.431828] [DEBUG] [LOCAL ] QD: Loaded 28263 existing records from primary storage. [2025-09-26T20:54:04.431973] [INFO ] [MAIN ] QD: Loaded 28263 existing records. [2025-09-26T20:54:04.615773] [WARN ] [MAIN ] QD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:54:04.616072] [INFO ] [MAIN ] QD: Wiping existing primary data before full refresh. [2025-09-26T20:54:04.616132] [INFO ] [LOCAL ] QD: Starting deletion of primary data. [2025-09-26T20:54:04.616936] [DEBUG] [LOCAL ] QD: Deleted primary data file. [2025-09-26T20:54:04.617003] [INFO ] [MAIN ] QD: Starting full primary refresh. [2025-09-26T20:54:04.721358] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-03. [2025-09-26T20:54:04.996181] [INFO ] [REMOTE ] QD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:54:05.337832] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-26T20:54:05.511759] [INFO ] [REMOTE ] QD: Fetching primary data for 2024-12. [2025-09-26T20:54:06.311731] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2024-12. [2025-09-26T20:54:06.487289] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-26T20:54:06.536163] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-26T20:54:07.111723] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-04. [2025-09-26T20:54:07.911768] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-02. [2025-09-26T20:54:08.711712] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-01. [2025-09-26T20:54:08.913608] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-26T20:54:09.089783] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2024-12 (2.78 seconds). [2025-09-26T20:54:09.353966] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-26T20:54:09.511736] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-03. [2025-09-26T20:54:09.786023] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-26T20:54:10.311752] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-01. [2025-09-26T20:54:10.875918] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-26T20:54:11.111717] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-02. [2025-09-26T20:54:11.911721] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-05. [2025-09-26T20:54:12.188855] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-26T20:54:12.711697] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-03. [2025-09-26T20:54:12.908528] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-09-26T20:54:13.346824] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-26T20:54:13.511725] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-04. [2025-09-26T20:54:13.663483] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-26T20:54:14.311785] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-06. [2025-09-26T20:54:14.549398] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-26T20:54:15.111732] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-05. [2025-09-26T20:54:15.911735] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-04. [2025-09-26T20:54:16.073009] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-26T20:54:16.649991] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-26T20:54:16.711737] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-06. [2025-09-26T20:54:17.231478] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-26T20:54:17.511751] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-05. [2025-09-26T20:54:18.125340] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-26T20:54:18.312377] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-02. [2025-09-26T20:54:18.316692] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-26T20:54:19.111745] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-07. [2025-09-26T20:54:19.911741] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-06. [2025-09-26T20:54:20.563237] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-26T20:54:20.711710] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-08. [2025-09-26T20:54:20.902284] [DEBUG] [REMOTE ] PX: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-09-26T20:54:20.902837] [WARN ] [REMOTE ] PX: No data returned for month 2025-08 [2025-09-26T20:54:20.957430] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-02 (2.65 seconds). [2025-09-26T20:54:21.011023] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-26T20:54:21.511744] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-03. [2025-09-26T20:54:22.311838] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-07. [2025-09-26T20:54:23.111723] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-07. [2025-09-26T20:54:23.642397] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-26T20:54:23.911711] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-09. [2025-09-26T20:54:23.952600] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-09-26T20:54:24.711717] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-04. [2025-09-26T20:54:25.059666] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-26T20:54:25.189256] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-26T20:54:25.197429] [INFO ] [REMOTE ] PX: Full fetch complete (46156 records). [2025-09-26T20:54:25.197584] [DEBUG] [VALIDATOR ] PX: Validating primary data. [2025-09-26T20:54:25.445369] [WARN ] [VALIDATOR ] PX: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-26T20:54:25.445956] [FATAL] [MAIN ] PX: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:54:25.446033] [WARN ] [MAIN ] PX: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:54:25.446103] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-09-26T20:54:25.446189] [DEBUG] [LOCAL ] PX: No primary data file found to delete. [2025-09-26T20:54:25.446262] [INFO ] [LOCAL ] PX: Starting deletion of derivative data. [2025-09-26T20:54:25.446880] [DEBUG] [LOCAL ] PX: Deleted derivative data file. [2025-09-26T20:54:25.447002] [INFO ] [MAIN ] Update Progress: 1754/2371 symbols completed. PX took 25.5s. Estimated remaining: 1h 22m 27s. Rate: 7.5 symbols/min [2025-09-26T20:54:25.517531] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-08. [2025-09-26T20:54:25.632100] [INFO ] [MAIN ] QGEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:54:25.686500] [DEBUG] [LOCAL ] QGEN: Loaded 49526 existing records from primary storage. [2025-09-26T20:54:25.686978] [INFO ] [MAIN ] QGEN: Loaded 49526 existing records. [2025-09-26T20:54:25.876705] [WARN ] [MAIN ] QGEN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:54:25.877082] [INFO ] [MAIN ] QGEN: Wiping existing primary data before full refresh. [2025-09-26T20:54:25.877141] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-09-26T20:54:25.878520] [DEBUG] [LOCAL ] QGEN: Deleted primary data file. [2025-09-26T20:54:25.878594] [INFO ] [MAIN ] QGEN: Starting full primary refresh. [2025-09-26T20:54:26.260159] [INFO ] [REMOTE ] QGEN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:54:26.311699] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2024-12. [2025-09-26T20:54:26.983048] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-26T20:54:27.111713] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-09. [2025-09-26T20:54:27.348624] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-09-26T20:54:27.911702] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-05. [2025-09-26T20:54:27.978515] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-26T20:54:28.391602] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-26T20:54:28.398536] [INFO ] [REMOTE ] QD: Full fetch complete (40672 records). [2025-09-26T20:54:28.398777] [DEBUG] [VALIDATOR ] QD: Validating primary data. [2025-09-26T20:54:28.716949] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-08. [2025-09-26T20:54:28.912308] [DEBUG] [VALIDATOR ] QD: All expected trading days are present. [2025-09-26T20:54:28.912412] [DEBUG] [VALIDATOR ] QD: Primary data validation passed. [2025-09-26T20:54:28.914689] [INFO ] [MAIN ] QD: Fetched primary data is valid. [2025-09-26T20:54:28.914838] [DEBUG] [LOCAL ] QD: Saving primary data. [2025-09-26T20:54:28.921763] [DEBUG] [LOCAL ] QD: Trimmed 40672 records to 28475 (keeping 200 days of data) [2025-09-26T20:54:29.118639] [DEBUG] [LOCAL ] QD: Primary data saved (28475 records). [2025-09-26T20:54:29.118876] [INFO ] [MAIN ] QD: Full history saved. [2025-09-26T20:54:29.119210] [INFO ] [MAIN ] Update Progress: 1755/2371 symbols completed. QD took 24.9s. Estimated remaining: 1h 22m 17s. Rate: 7.5 symbols/min [2025-09-26T20:54:29.402783] [INFO ] [MAIN ] QS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:54:29.510932] [DEBUG] [LOCAL ] QS: Loaded 54132 existing records from primary storage. [2025-09-26T20:54:29.511207] [INFO ] [MAIN ] QS: Loaded 54132 existing records. [2025-09-26T20:54:29.516874] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-01. [2025-09-26T20:54:29.806008] [WARN ] [MAIN ] QS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:54:29.806396] [INFO ] [MAIN ] QS: Wiping existing primary data before full refresh. [2025-09-26T20:54:29.806474] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-09-26T20:54:29.807680] [DEBUG] [LOCAL ] QS: Deleted primary data file. [2025-09-26T20:54:29.807814] [INFO ] [MAIN ] QS: Starting full primary refresh. [2025-09-26T20:54:30.242618] [INFO ] [REMOTE ] QS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:54:30.311704] [INFO ] [REMOTE ] QS: Fetching primary data for 2024-12. [2025-09-26T20:54:30.465280] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-26T20:54:30.816996] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-05 (2.91 seconds). [2025-09-26T20:54:30.858478] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-26T20:54:31.111723] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-02. [2025-09-26T20:54:31.911736] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-06. [2025-09-26T20:54:32.711712] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-09. [2025-09-26T20:54:32.850573] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-26T20:54:32.926106] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2024-12 (2.61 seconds). [2025-09-26T20:54:33.511723] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-01. [2025-09-26T20:54:34.311734] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-03. [2025-09-26T20:54:34.460417] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-26T20:54:34.473309] [INFO ] [REMOTE ] PWR: Full fetch complete (69054 records). [2025-09-26T20:54:34.473527] [DEBUG] [VALIDATOR ] PWR: Validating primary data. [2025-09-26T20:54:34.675168] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-06 (2.76 seconds). [2025-09-26T20:54:34.953253] [DEBUG] [VALIDATOR ] PWR: All expected trading days are present. [2025-09-26T20:54:34.953348] [DEBUG] [VALIDATOR ] PWR: Primary data validation passed. [2025-09-26T20:54:34.954330] [INFO ] [MAIN ] PWR: Fetched primary data is valid. [2025-09-26T20:54:34.954401] [DEBUG] [LOCAL ] PWR: Saving primary data. [2025-09-26T20:54:34.955929] [DEBUG] [LOCAL ] PWR: Trimmed 69054 records to 48047 (keeping 200 days of data) [2025-09-26T20:54:35.161313] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-07. [2025-09-26T20:54:35.295476] [DEBUG] [LOCAL ] PWR: Primary data saved (48047 records). [2025-09-26T20:54:35.295627] [INFO ] [MAIN ] PWR: Full history saved. [2025-09-26T20:54:35.295774] [INFO ] [MAIN ] Update Progress: 1756/2371 symbols completed. PWR took 45.3s. Estimated remaining: 1h 22m 8s. Rate: 7.5 symbols/min [2025-09-26T20:54:35.478729] [INFO ] [MAIN ] QSR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:54:35.530287] [DEBUG] [LOCAL ] QSR: Loaded 52792 existing records from primary storage. [2025-09-26T20:54:35.530437] [INFO ] [MAIN ] QSR: Loaded 52792 existing records. [2025-09-26T20:54:35.731624] [WARN ] [MAIN ] QSR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:54:35.731886] [INFO ] [MAIN ] QSR: Wiping existing primary data before full refresh. [2025-09-26T20:54:35.731933] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-09-26T20:54:35.733213] [DEBUG] [LOCAL ] QSR: Deleted primary data file. [2025-09-26T20:54:35.733277] [INFO ] [MAIN ] QSR: Starting full primary refresh. [2025-09-26T20:54:36.154143] [INFO ] [REMOTE ] QSR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:54:36.154926] [INFO ] [REMOTE ] QSR: Fetching primary data for 2024-12. [2025-09-26T20:54:36.188576] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-26T20:54:36.234536] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-01 (2.72 seconds). [2025-09-26T20:54:36.711738] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-02. [2025-09-26T20:54:37.511695] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-04. [2025-09-26T20:54:37.818360] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-07 (2.66 seconds). [2025-09-26T20:54:37.952431] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T20:54:38.311732] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-01. [2025-09-26T20:54:39.028401] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T20:54:39.069521] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-09-26T20:54:39.111709] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-05. [2025-09-26T20:54:39.911733] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-03. [2025-09-26T20:54:40.029277] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-26T20:54:40.711694] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-08. [2025-09-26T20:54:40.951415] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-26T20:54:41.511755] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-02. [2025-09-26T20:54:42.204226] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-09-26T20:54:42.311701] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-06. [2025-09-26T20:54:43.111237] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-26T20:54:43.120951] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-04. [2025-09-26T20:54:43.222841] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-09-26T20:54:43.906722] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-26T20:54:43.916213] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-09. [2025-09-26T20:54:44.716801] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-07. [2025-09-26T20:54:44.732440] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-26T20:54:44.744710] [INFO ] [REMOTE ] QBTS: Full fetch complete (77533 records). [2025-09-26T20:54:44.744880] [DEBUG] [VALIDATOR ] QBTS: Validating primary data. [2025-09-26T20:54:44.745944] [FATAL] [VALIDATOR ] QBTS: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T20:54:44.746050] [FATAL] [MAIN ] QBTS: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:54:44.746112] [WARN ] [MAIN ] QBTS: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:54:44.746199] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-09-26T20:54:44.746284] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-09-26T20:54:44.746330] [INFO ] [LOCAL ] QBTS: Starting deletion of derivative data. [2025-09-26T20:54:44.746397] [DEBUG] [LOCAL ] QBTS: No derivative data file found to delete. [2025-09-26T20:54:44.746496] [INFO ] [MAIN ] Update Progress: 1757/2371 symbols completed. QBTS took 43.2s. Estimated remaining: 1h 22m 1s. Rate: 7.5 symbols/min [2025-09-26T20:54:45.471000] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-26T20:54:45.511724] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-03. [2025-09-26T20:54:46.311703] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-05. [2025-09-26T20:54:46.581524] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-26T20:54:47.111717] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-08. [2025-09-26T20:54:47.354895] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-26T20:54:47.911736] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-04. [2025-09-26T20:54:48.236313] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-26T20:54:48.711701] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-06. [2025-09-26T20:54:48.752033] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-26T20:54:49.511704] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-09. [2025-09-26T20:54:49.658070] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-26T20:54:50.311725] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-05. [2025-09-26T20:54:50.685727] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-26T20:54:51.111744] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-07. [2025-09-26T20:54:51.243169] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-26T20:54:51.254128] [INFO ] [REMOTE ] QGEN: Full fetch complete (70103 records). [2025-09-26T20:54:51.254282] [DEBUG] [VALIDATOR ] QGEN: Validating primary data. [2025-09-26T20:54:51.721424] [DEBUG] [VALIDATOR ] QGEN: All expected trading days are present. [2025-09-26T20:54:51.721521] [DEBUG] [VALIDATOR ] QGEN: Primary data validation passed. [2025-09-26T20:54:51.722631] [INFO ] [MAIN ] QGEN: Fetched primary data is valid. [2025-09-26T20:54:51.722747] [DEBUG] [LOCAL ] QGEN: Saving primary data. [2025-09-26T20:54:51.727285] [DEBUG] [LOCAL ] QGEN: Trimmed 70103 records to 49874 (keeping 200 days of data) [2025-09-26T20:54:52.099527] [DEBUG] [LOCAL ] QGEN: Primary data saved (49874 records). [2025-09-26T20:54:52.099720] [INFO ] [MAIN ] QGEN: Full history saved. [2025-09-26T20:54:52.099863] [INFO ] [MAIN ] Update Progress: 1758/2371 symbols completed. QGEN took 26.7s. Estimated remaining: 1h 21m 53s. Rate: 7.5 symbols/min [2025-09-26T20:54:52.133308] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-26T20:54:52.144753] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-06. [2025-09-26T20:54:53.945063] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-07 (2.83 seconds). [2025-09-26T20:54:53.959579] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-08. [2025-09-26T20:54:54.195156] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-26T20:54:54.206130] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-07. [2025-09-26T20:54:55.946919] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-26T20:54:55.958439] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-08. [2025-09-26T20:54:56.209885] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-26T20:54:56.221484] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-09. [2025-09-26T20:54:57.654134] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-26T20:54:57.665550] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-09. [2025-09-26T20:54:58.474720] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-26T20:54:58.485216] [INFO ] [REMOTE ] QS: Full fetch complete (77883 records). [2025-09-26T20:54:58.485378] [DEBUG] [VALIDATOR ] QS: Validating primary data. [2025-09-26T20:54:58.898318] [DEBUG] [VALIDATOR ] QS: All expected trading days are present. [2025-09-26T20:54:58.898404] [DEBUG] [VALIDATOR ] QS: Primary data validation passed. [2025-09-26T20:54:58.899446] [INFO ] [MAIN ] QS: Fetched primary data is valid. [2025-09-26T20:54:58.899512] [DEBUG] [LOCAL ] QS: Saving primary data. [2025-09-26T20:54:58.902773] [DEBUG] [LOCAL ] QS: Trimmed 77883 records to 54522 (keeping 200 days of data) [2025-09-26T20:54:59.240531] [DEBUG] [LOCAL ] QS: Primary data saved (54522 records). [2025-09-26T20:54:59.240748] [INFO ] [MAIN ] QS: Full history saved. [2025-09-26T20:54:59.240870] [INFO ] [MAIN ] Update Progress: 1759/2371 symbols completed. QS took 30.1s. Estimated remaining: 1h 21m 44s. Rate: 7.5 symbols/min [2025-09-26T20:54:59.381136] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T20:54:59.391335] [INFO ] [REMOTE ] QSR: Full fetch complete (75827 records). [2025-09-26T20:54:59.391486] [DEBUG] [VALIDATOR ] QSR: Validating primary data. [2025-09-26T20:54:59.806145] [DEBUG] [VALIDATOR ] QSR: All expected trading days are present. [2025-09-26T20:54:59.806241] [DEBUG] [VALIDATOR ] QSR: Primary data validation passed. [2025-09-26T20:54:59.807402] [INFO ] [MAIN ] QSR: Fetched primary data is valid. [2025-09-26T20:54:59.807471] [DEBUG] [LOCAL ] QSR: Saving primary data. [2025-09-26T20:54:59.809109] [DEBUG] [LOCAL ] QSR: Trimmed 75827 records to 53178 (keeping 200 days of data) [2025-09-26T20:55:00.150866] [DEBUG] [LOCAL ] QSR: Primary data saved (53178 records). [2025-09-26T20:55:00.151066] [INFO ] [MAIN ] QSR: Full history saved. [2025-09-26T20:55:00.151179] [INFO ] [MAIN ] Update Progress: 1760/2371 symbols completed. QSR took 24.9s. Estimated remaining: 1h 21m 34s. Rate: 7.5 symbols/min [2025-09-26T20:55:00.724204] [INFO ] [MAIN ] QTWO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:55:00.805177] [INFO ] [MAIN ] QVCD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:55:00.888709] [INFO ] [MAIN ] QUAD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:55:00.916578] [INFO ] [MAIN ] QVCC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:55:00.920360] [DEBUG] [LOCAL ] QVCD: Loaded 4519 existing records from primary storage. [2025-09-26T20:55:00.922068] [INFO ] [MAIN ] QVCD: Loaded 4519 existing records. [2025-09-26T20:55:01.037505] [DEBUG] [LOCAL ] QVCC: Loaded 8949 existing records from primary storage. [2025-09-26T20:55:01.065871] [INFO ] [MAIN ] QVCC: Loaded 8949 existing records. [2025-09-26T20:55:01.202169] [DEBUG] [LOCAL ] QUAD: Loaded 23833 existing records from primary storage. [2025-09-26T20:55:01.233301] [INFO ] [MAIN ] QUAD: Loaded 23833 existing records. [2025-09-26T20:55:01.337868] [WARN ] [MAIN ] QVCD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:55:01.353339] [INFO ] [MAIN ] QVCD: Wiping existing primary data before full refresh. [2025-09-26T20:55:01.366551] [DEBUG] [LOCAL ] QTWO: Loaded 39406 existing records from primary storage. [2025-09-26T20:55:01.394365] [INFO ] [LOCAL ] QVCD: Starting deletion of primary data. [2025-09-26T20:55:01.411855] [INFO ] [MAIN ] QTWO: Loaded 39406 existing records. [2025-09-26T20:55:01.438859] [DEBUG] [LOCAL ] QVCD: Deleted primary data file. [2025-09-26T20:55:01.468751] [INFO ] [MAIN ] QVCD: Starting full primary refresh. [2025-09-26T20:55:01.735921] [WARN ] [MAIN ] QVCC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:55:01.872910] [INFO ] [MAIN ] QVCC: Wiping existing primary data before full refresh. [2025-09-26T20:55:01.970950] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-09-26T20:55:01.950357] [WARN ] [MAIN ] QUAD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:55:02.067635] [INFO ] [MAIN ] QUAD: Wiping existing primary data before full refresh. [2025-09-26T20:55:02.048735] [DEBUG] [LOCAL ] QVCC: Deleted primary data file. [2025-09-26T20:55:02.067784] [WARN ] [MAIN ] QTWO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:55:02.094692] [INFO ] [MAIN ] QTWO: Wiping existing primary data before full refresh. [2025-09-26T20:55:02.089227] [INFO ] [LOCAL ] QUAD: Starting deletion of primary data. [2025-09-26T20:55:02.100427] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-09-26T20:55:02.110923] [INFO ] [MAIN ] QVCC: Starting full primary refresh. [2025-09-26T20:55:02.105634] [DEBUG] [LOCAL ] QUAD: Deleted primary data file. [2025-09-26T20:55:02.160317] [DEBUG] [LOCAL ] QTWO: Deleted primary data file. [2025-09-26T20:55:02.195681] [INFO ] [MAIN ] QTWO: Starting full primary refresh. [2025-09-26T20:55:02.185158] [INFO ] [MAIN ] QUAD: Starting full primary refresh. [2025-09-26T20:55:02.631978] [INFO ] [REMOTE ] QVCD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:55:02.723009] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2024-12. [2025-09-26T20:55:03.408426] [INFO ] [REMOTE ] QTWO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:55:03.440579] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2024-12. [2025-09-26T20:55:03.440318] [INFO ] [REMOTE ] QVCC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:55:03.440888] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2024-12. [2025-09-26T20:55:03.466754] [INFO ] [REMOTE ] QUAD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:55:03.467100] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2024-12. [2025-09-26T20:55:04.025317] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-26T20:55:04.027230] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-01. [2025-09-26T20:55:04.264860] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-26T20:55:04.267481] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-01. [2025-09-26T20:55:04.430058] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-26T20:55:04.436333] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-01. [2025-09-26T20:55:04.698943] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-26T20:55:04.700392] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-02. [2025-09-26T20:55:04.925261] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-26T20:55:04.927283] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-02. [2025-09-26T20:55:04.977098] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-26T20:55:04.985660] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-01. [2025-09-26T20:55:05.229105] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-26T20:55:05.230450] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-03. [2025-09-26T20:55:05.538103] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-26T20:55:05.540512] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-03. [2025-09-26T20:55:05.569359] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-26T20:55:06.029555] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-26T20:55:06.311700] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-04. [2025-09-26T20:55:06.397917] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-26T20:55:06.424600] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-26T20:55:06.947579] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-26T20:55:07.111715] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-04. [2025-09-26T20:55:07.906047] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-26T20:55:07.911660] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-05. [2025-09-26T20:55:08.711754] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-02. [2025-09-26T20:55:08.770505] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-26T20:55:09.511760] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-05. [2025-09-26T20:55:10.038480] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-26T20:55:10.311698] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-02. [2025-09-26T20:55:10.371066] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-26T20:55:11.111724] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-06. [2025-09-26T20:55:11.774940] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-26T20:55:11.890051] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-26T20:55:11.911669] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-07. [2025-09-26T20:55:12.690054] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-26T20:55:12.711672] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-06. [2025-09-26T20:55:13.316992] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-26T20:55:13.511759] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-03. [2025-09-26T20:55:14.311738] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-03. [2025-09-26T20:55:14.679299] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-26T20:55:15.111719] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-07. [2025-09-26T20:55:15.734727] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-26T20:55:15.911723] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-04. [2025-09-26T20:55:16.000619] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-26T20:55:16.711720] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-04. [2025-09-26T20:55:17.243166] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-26T20:55:17.511729] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-08. [2025-09-26T20:55:18.069562] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-26T20:55:18.070393] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-26T20:55:18.311742] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-09. [2025-09-26T20:55:18.823602] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-26T20:55:18.824960] [INFO ] [REMOTE ] QVCD: Full fetch complete (6134 records). [2025-09-26T20:55:18.825033] [DEBUG] [VALIDATOR ] QVCD: Validating primary data. [2025-09-26T20:55:19.116826] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-08. [2025-09-26T20:55:19.235013] [DEBUG] [VALIDATOR ] QVCD: All expected trading days are present. [2025-09-26T20:55:19.235105] [DEBUG] [VALIDATOR ] QVCD: Primary data validation passed. [2025-09-26T20:55:19.235299] [INFO ] [MAIN ] QVCD: Fetched primary data is valid. [2025-09-26T20:55:19.235341] [DEBUG] [LOCAL ] QVCD: Saving primary data. [2025-09-26T20:55:19.235775] [DEBUG] [LOCAL ] QVCD: Trimmed 6134 records to 4542 (keeping 200 days of data) [2025-09-26T20:55:19.264298] [DEBUG] [LOCAL ] QVCD: Primary data saved (4542 records). [2025-09-26T20:55:19.264411] [INFO ] [MAIN ] QVCD: Full history saved. [2025-09-26T20:55:19.264506] [INFO ] [MAIN ] Update Progress: 1761/2371 symbols completed. QVCD took 19.1s. Estimated remaining: 1h 21m 30s. Rate: 7.5 symbols/min [2025-09-26T20:55:19.445201] [INFO ] [MAIN ] QXO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:55:19.500286] [DEBUG] [LOCAL ] QXO: Loaded 53574 existing records from primary storage. [2025-09-26T20:55:19.500437] [INFO ] [MAIN ] QXO: Loaded 53574 existing records. [2025-09-26T20:55:19.698918] [WARN ] [MAIN ] QXO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:55:19.699281] [INFO ] [MAIN ] QXO: Wiping existing primary data before full refresh. [2025-09-26T20:55:19.699340] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-09-26T20:55:19.700444] [DEBUG] [LOCAL ] QXO: Deleted primary data file. [2025-09-26T20:55:19.700508] [INFO ] [MAIN ] QXO: Starting full primary refresh. [2025-09-26T20:55:19.919543] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-05. [2025-09-26T20:55:20.037184] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-26T20:55:20.094046] [INFO ] [REMOTE ] QXO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:55:20.711723] [INFO ] [REMOTE ] QXO: Fetching primary data for 2024-12. [2025-09-26T20:55:21.483475] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-26T20:55:21.511727] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-09. [2025-09-26T20:55:22.293719] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-26T20:55:22.295854] [INFO ] [REMOTE ] QVCC: Full fetch complete (11976 records). [2025-09-26T20:55:22.295931] [DEBUG] [VALIDATOR ] QVCC: Validating primary data. [2025-09-26T20:55:22.316892] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-05. [2025-09-26T20:55:22.729414] [DEBUG] [VALIDATOR ] QVCC: All expected trading days are present. [2025-09-26T20:55:22.731555] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-26T20:55:22.731776] [DEBUG] [VALIDATOR ] QVCC: Primary data validation passed. [2025-09-26T20:55:22.742889] [INFO ] [MAIN ] QVCC: Fetched primary data is valid. [2025-09-26T20:55:22.742958] [DEBUG] [LOCAL ] QVCC: Saving primary data. [2025-09-26T20:55:22.743569] [DEBUG] [LOCAL ] QVCC: Trimmed 11976 records to 9018 (keeping 200 days of data) [2025-09-26T20:55:22.801769] [DEBUG] [LOCAL ] QVCC: Primary data saved (9018 records). [2025-09-26T20:55:22.801907] [INFO ] [MAIN ] QVCC: Full history saved. [2025-09-26T20:55:22.802018] [INFO ] [MAIN ] Update Progress: 1762/2371 symbols completed. QVCC took 22.6s. Estimated remaining: 1h 21m 20s. Rate: 7.5 symbols/min [2025-09-26T20:55:23.030022] [INFO ] [MAIN ] R: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:55:23.061467] [DEBUG] [LOCAL ] R: Loaded 29533 existing records from primary storage. [2025-09-26T20:55:23.061600] [INFO ] [MAIN ] R: Loaded 29533 existing records. [2025-09-26T20:55:23.121854] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-06. [2025-09-26T20:55:23.262827] [WARN ] [MAIN ] R: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:55:23.263070] [INFO ] [MAIN ] R: Wiping existing primary data before full refresh. [2025-09-26T20:55:23.263120] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-09-26T20:55:23.263852] [DEBUG] [LOCAL ] R: Deleted primary data file. [2025-09-26T20:55:23.263913] [INFO ] [MAIN ] R: Starting full primary refresh. [2025-09-26T20:55:23.650841] [INFO ] [REMOTE ] R: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:55:23.746750] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-26T20:55:23.911726] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-01. [2025-09-26T20:55:24.659154] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-26T20:55:24.711705] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-06. [2025-09-26T20:55:25.523703] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-07. [2025-09-26T20:55:25.547675] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-26T20:55:25.791730] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-26T20:55:26.311726] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-07. [2025-09-26T20:55:27.068905] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-26T20:55:27.111719] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-08. [2025-09-26T20:55:27.416260] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-26T20:55:27.911732] [INFO ] [REMOTE ] R: Fetching primary data for 2024-12. [2025-09-26T20:55:28.723704] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-08. [2025-09-26T20:55:28.726913] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-26T20:55:29.088118] [INFO ] [REMOTE ] R: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-26T20:55:29.511749] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-02. [2025-09-26T20:55:30.036740] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-26T20:55:30.311773] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-09. [2025-09-26T20:55:31.115324] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-09. [2025-09-26T20:55:31.123072] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-26T20:55:31.911742] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-03. [2025-09-26T20:55:31.969887] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-26T20:55:31.979630] [INFO ] [REMOTE ] QTWO: Full fetch complete (57274 records). [2025-09-26T20:55:31.979854] [DEBUG] [VALIDATOR ] QTWO: Validating primary data. [2025-09-26T20:55:32.343191] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-26T20:55:32.399515] [INFO ] [REMOTE ] QUAD: Full fetch complete (34587 records). [2025-09-26T20:55:32.402254] [DEBUG] [VALIDATOR ] QUAD: Validating primary data. [2025-09-26T20:55:32.457828] [DEBUG] [VALIDATOR ] QTWO: All expected trading days are present. [2025-09-26T20:55:32.483424] [DEBUG] [VALIDATOR ] QTWO: Primary data validation passed. [2025-09-26T20:55:32.505712] [INFO ] [MAIN ] QTWO: Fetched primary data is valid. [2025-09-26T20:55:32.522730] [DEBUG] [LOCAL ] QTWO: Saving primary data. [2025-09-26T20:55:32.546480] [DEBUG] [LOCAL ] QTWO: Trimmed 57274 records to 39754 (keeping 200 days of data) [2025-09-26T20:55:32.712830] [INFO ] [REMOTE ] R: Fetching primary data for 2025-01. [2025-09-26T20:55:33.083686] [DEBUG] [VALIDATOR ] QUAD: All expected trading days are present. [2025-09-26T20:55:33.088630] [DEBUG] [VALIDATOR ] QUAD: Primary data validation passed. [2025-09-26T20:55:33.090109] [INFO ] [MAIN ] QUAD: Fetched primary data is valid. [2025-09-26T20:55:33.090859] [DEBUG] [LOCAL ] QUAD: Saving primary data. [2025-09-26T20:55:33.096072] [DEBUG] [LOCAL ] QUAD: Trimmed 34587 records to 23938 (keeping 200 days of data) [2025-09-26T20:55:33.206757] [DEBUG] [LOCAL ] QTWO: Primary data saved (39754 records). [2025-09-26T20:55:33.231760] [INFO ] [MAIN ] QTWO: Full history saved. [2025-09-26T20:55:33.234579] [INFO ] [MAIN ] Update Progress: 1763/2371 symbols completed. QTWO took 33.1s. Estimated remaining: 1h 21m 13s. Rate: 7.5 symbols/min [2025-09-26T20:55:33.320466] [DEBUG] [LOCAL ] QUAD: Primary data saved (23938 records). [2025-09-26T20:55:33.342718] [INFO ] [MAIN ] QUAD: Full history saved. [2025-09-26T20:55:33.342971] [INFO ] [MAIN ] Update Progress: 1764/2371 symbols completed. QUAD took 33.2s. Estimated remaining: 1h 21m 2s. Rate: 7.5 symbols/min [2025-09-26T20:55:33.574706] [INFO ] [MAIN ] RA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:55:33.655305] [INFO ] [MAIN ] RACE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:55:33.696531] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-26T20:55:33.718495] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-04. [2025-09-26T20:55:33.720631] [DEBUG] [LOCAL ] RA: Loaded 21803 existing records from primary storage. [2025-09-26T20:55:33.720815] [INFO ] [MAIN ] RA: Loaded 21803 existing records. [2025-09-26T20:55:33.941386] [DEBUG] [LOCAL ] RACE: Loaded 33135 existing records from primary storage. [2025-09-26T20:55:33.949981] [INFO ] [MAIN ] RACE: Loaded 33135 existing records. [2025-09-26T20:55:33.949859] [WARN ] [MAIN ] RA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:55:34.021951] [INFO ] [MAIN ] RA: Wiping existing primary data before full refresh. [2025-09-26T20:55:34.040382] [INFO ] [LOCAL ] RA: Starting deletion of primary data. [2025-09-26T20:55:34.061414] [DEBUG] [LOCAL ] RA: Deleted primary data file. [2025-09-26T20:55:34.065879] [INFO ] [MAIN ] RA: Starting full primary refresh. [2025-09-26T20:55:34.229273] [WARN ] [MAIN ] RACE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:55:34.257864] [INFO ] [MAIN ] RACE: Wiping existing primary data before full refresh. [2025-09-26T20:55:34.292199] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-09-26T20:55:34.351420] [DEBUG] [LOCAL ] RACE: Deleted primary data file. [2025-09-26T20:55:34.355343] [INFO ] [MAIN ] RACE: Starting full primary refresh. [2025-09-26T20:55:34.364402] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-26T20:55:34.431549] [INFO ] [REMOTE ] R: Fetching primary data for 2025-02. [2025-09-26T20:55:34.773570] [INFO ] [REMOTE ] RA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:55:34.992925] [INFO ] [REMOTE ] RACE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:55:35.111734] [INFO ] [REMOTE ] RACE: Fetching primary data for 2024-12. [2025-09-26T20:55:35.619911] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-26T20:55:35.655458] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-26T20:55:35.911746] [INFO ] [REMOTE ] R: Fetching primary data for 2025-03. [2025-09-26T20:55:36.115225] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-26T20:55:36.711765] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-01. [2025-09-26T20:55:37.111720] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-26T20:55:37.511767] [INFO ] [REMOTE ] RA: Fetching primary data for 2024-12. [2025-09-26T20:55:38.188725] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-26T20:55:38.311737] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-02. [2025-09-26T20:55:38.938795] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-26T20:55:39.111770] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-05. [2025-09-26T20:55:39.558853] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-26T20:55:39.911746] [INFO ] [REMOTE ] R: Fetching primary data for 2025-04. [2025-09-26T20:55:40.711754] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-03. [2025-09-26T20:55:41.119892] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-26T20:55:41.177035] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-26T20:55:41.511725] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-06. [2025-09-26T20:55:42.222616] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-26T20:55:42.311704] [INFO ] [REMOTE ] R: Fetching primary data for 2025-05. [2025-09-26T20:55:43.111715] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-01. [2025-09-26T20:55:43.630519] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-26T20:55:43.719556] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-26T20:55:43.911765] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-07. [2025-09-26T20:55:44.239868] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-26T20:55:44.711760] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-04. [2025-09-26T20:55:45.511706] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-02. [2025-09-26T20:55:45.946251] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-26T20:55:46.312160] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-08. [2025-09-26T20:55:46.383604] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-26T20:55:46.707509] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-26T20:55:47.111751] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-03. [2025-09-26T20:55:47.911730] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-05. [2025-09-26T20:55:48.255487] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-26T20:55:48.269907] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-26T20:55:48.711759] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-04. [2025-09-26T20:55:49.406140] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T20:55:49.511702] [INFO ] [REMOTE ] R: Fetching primary data for 2025-06. [2025-09-26T20:55:49.530196] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-26T20:55:50.311737] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-09. [2025-09-26T20:55:50.609632] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-26T20:55:51.111771] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-05. [2025-09-26T20:55:51.911738] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-06. [2025-09-26T20:55:52.255157] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-26T20:55:52.275899] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-26T20:55:52.280169] [INFO ] [REMOTE ] QXO: Full fetch complete (75499 records). [2025-09-26T20:55:52.280666] [DEBUG] [VALIDATOR ] QXO: Validating primary data. [2025-09-26T20:55:52.705505] [DEBUG] [VALIDATOR ] QXO: All expected trading days are present. [2025-09-26T20:55:52.705638] [DEBUG] [VALIDATOR ] QXO: Primary data validation passed. [2025-09-26T20:55:52.707257] [INFO ] [MAIN ] QXO: Fetched primary data is valid. [2025-09-26T20:55:52.707341] [DEBUG] [LOCAL ] QXO: Saving primary data. [2025-09-26T20:55:52.709665] [DEBUG] [LOCAL ] QXO: Trimmed 75499 records to 53964 (keeping 200 days of data) [2025-09-26T20:55:52.711717] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-06. [2025-09-26T20:55:53.067468] [DEBUG] [LOCAL ] QXO: Primary data saved (53964 records). [2025-09-26T20:55:53.067676] [INFO ] [MAIN ] QXO: Full history saved. [2025-09-26T20:55:53.067800] [INFO ] [MAIN ] Update Progress: 1765/2371 symbols completed. QXO took 33.8s. Estimated remaining: 1h 20m 58s. Rate: 7.5 symbols/min [2025-09-26T20:55:53.247337] [INFO ] [MAIN ] RAMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:55:53.285429] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-26T20:55:53.304001] [DEBUG] [LOCAL ] RAMP: Loaded 37942 existing records from primary storage. [2025-09-26T20:55:53.304165] [INFO ] [MAIN ] RAMP: Loaded 37942 existing records. [2025-09-26T20:55:53.508173] [WARN ] [MAIN ] RAMP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:55:53.508514] [INFO ] [MAIN ] RAMP: Wiping existing primary data before full refresh. [2025-09-26T20:55:53.508565] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-09-26T20:55:53.509503] [DEBUG] [LOCAL ] RAMP: Deleted primary data file. [2025-09-26T20:55:53.509567] [INFO ] [MAIN ] RAMP: Starting full primary refresh. [2025-09-26T20:55:53.521634] [INFO ] [REMOTE ] R: Fetching primary data for 2025-07. [2025-09-26T20:55:53.972521] [INFO ] [REMOTE ] RAMP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:55:53.992806] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-26T20:55:54.311752] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-07. [2025-09-26T20:55:55.111727] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-07. [2025-09-26T20:55:55.189905] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-26T20:55:55.642533] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-26T20:55:55.911762] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-08. [2025-09-26T20:55:56.568860] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-26T20:55:56.711721] [INFO ] [REMOTE ] R: Fetching primary data for 2025-08. [2025-09-26T20:55:56.993538] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-26T20:55:57.511741] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-08. [2025-09-26T20:55:57.954216] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-26T20:55:58.311727] [INFO ] [REMOTE ] R: Fetching primary data for 2025-09. [2025-09-26T20:55:59.117418] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2024-12. [2025-09-26T20:55:59.133248] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-26T20:55:59.439588] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-26T20:55:59.444745] [INFO ] [REMOTE ] R: Full fetch complete (42050 records). [2025-09-26T20:55:59.444956] [DEBUG] [VALIDATOR ] R: Validating primary data. [2025-09-26T20:55:59.852181] [DEBUG] [VALIDATOR ] R: All expected trading days are present. [2025-09-26T20:55:59.852271] [DEBUG] [VALIDATOR ] R: Primary data validation passed. [2025-09-26T20:55:59.853127] [INFO ] [MAIN ] R: Fetched primary data is valid. [2025-09-26T20:55:59.853196] [DEBUG] [LOCAL ] R: Saving primary data. [2025-09-26T20:55:59.854275] [DEBUG] [LOCAL ] R: Trimmed 42050 records to 29775 (keeping 200 days of data) [2025-09-26T20:55:59.916809] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-09. [2025-09-26T20:56:00.054510] [DEBUG] [LOCAL ] R: Primary data saved (29775 records). [2025-09-26T20:56:00.054685] [INFO ] [MAIN ] R: Full history saved. [2025-09-26T20:56:00.054809] [INFO ] [MAIN ] Update Progress: 1766/2371 symbols completed. R took 37.3s. Estimated remaining: 1h 20m 50s. Rate: 7.5 symbols/min [2025-09-26T20:56:00.238433] [INFO ] [MAIN ] RBA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:56:00.289565] [DEBUG] [LOCAL ] RBA: Loaded 46238 existing records from primary storage. [2025-09-26T20:56:00.289832] [INFO ] [MAIN ] RBA: Loaded 46238 existing records. [2025-09-26T20:56:00.489000] [WARN ] [MAIN ] RBA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:56:00.510594] [INFO ] [MAIN ] RBA: Wiping existing primary data before full refresh. [2025-09-26T20:56:00.511443] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-09-26T20:56:00.513032] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T20:56:00.521615] [DEBUG] [LOCAL ] RBA: Deleted primary data file. [2025-09-26T20:56:00.521749] [INFO ] [MAIN ] RBA: Starting full primary refresh. [2025-09-26T20:56:00.717590] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-09. [2025-09-26T20:56:00.947458] [INFO ] [REMOTE ] RBA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:56:01.455859] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-26T20:56:01.462528] [INFO ] [REMOTE ] RACE: Full fetch complete (47552 records). [2025-09-26T20:56:01.462724] [DEBUG] [VALIDATOR ] RACE: Validating primary data. [2025-09-26T20:56:01.517001] [INFO ] [REMOTE ] RBA: Fetching primary data for 2024-12. [2025-09-26T20:56:01.922375] [DEBUG] [VALIDATOR ] RACE: All expected trading days are present. [2025-09-26T20:56:01.922503] [DEBUG] [VALIDATOR ] RACE: Primary data validation passed. [2025-09-26T20:56:01.923458] [INFO ] [MAIN ] RACE: Fetched primary data is valid. [2025-09-26T20:56:01.923533] [DEBUG] [LOCAL ] RACE: Saving primary data. [2025-09-26T20:56:01.924752] [DEBUG] [LOCAL ] RACE: Trimmed 47552 records to 33300 (keeping 200 days of data) [2025-09-26T20:56:02.032552] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-26T20:56:02.041608] [INFO ] [REMOTE ] RA: Full fetch complete (32005 records). [2025-09-26T20:56:02.043724] [DEBUG] [VALIDATOR ] RA: Validating primary data. [2025-09-26T20:56:02.317220] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-01. [2025-09-26T20:56:02.576020] [DEBUG] [VALIDATOR ] RA: All expected trading days are present. [2025-09-26T20:56:02.577361] [DEBUG] [VALIDATOR ] RA: Primary data validation passed. [2025-09-26T20:56:02.578545] [INFO ] [MAIN ] RA: Fetched primary data is valid. [2025-09-26T20:56:02.578625] [DEBUG] [LOCAL ] RA: Saving primary data. [2025-09-26T20:56:02.584087] [DEBUG] [LOCAL ] RA: Trimmed 32005 records to 22045 (keeping 200 days of data) [2025-09-26T20:56:02.715176] [DEBUG] [LOCAL ] RACE: Primary data saved (33300 records). [2025-09-26T20:56:02.715909] [INFO ] [MAIN ] RACE: Full history saved. [2025-09-26T20:56:02.716683] [INFO ] [MAIN ] Update Progress: 1767/2371 symbols completed. RACE took 29.4s. Estimated remaining: 1h 20m 40s. Rate: 7.5 symbols/min [2025-09-26T20:56:02.884060] [DEBUG] [LOCAL ] RA: Primary data saved (22045 records). [2025-09-26T20:56:02.894513] [INFO ] [MAIN ] RA: Full history saved. [2025-09-26T20:56:02.894701] [INFO ] [MAIN ] Update Progress: 1768/2371 symbols completed. RA took 29.7s. Estimated remaining: 1h 20m 29s. Rate: 7.5 symbols/min [2025-09-26T20:56:03.020262] [INFO ] [MAIN ] RBC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:56:03.137599] [INFO ] [MAIN ] RBLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:56:03.151627] [DEBUG] [LOCAL ] RBC: Loaded 15246 existing records from primary storage. [2025-09-26T20:56:03.152043] [INFO ] [MAIN ] RBC: Loaded 15246 existing records. [2025-09-26T20:56:03.288928] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-26T20:56:03.314102] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-01. [2025-09-26T20:56:03.407722] [WARN ] [MAIN ] RBC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:56:03.408777] [INFO ] [MAIN ] RBC: Wiping existing primary data before full refresh. [2025-09-26T20:56:03.408849] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-09-26T20:56:03.423067] [DEBUG] [LOCAL ] RBC: Deleted primary data file. [2025-09-26T20:56:03.425199] [INFO ] [MAIN ] RBC: Starting full primary refresh. [2025-09-26T20:56:03.488756] [DEBUG] [LOCAL ] RBLX: Loaded 54107 existing records from primary storage. [2025-09-26T20:56:03.498031] [INFO ] [MAIN ] RBLX: Loaded 54107 existing records. [2025-09-26T20:56:04.045892] [WARN ] [MAIN ] RBLX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:56:04.077429] [INFO ] [MAIN ] RBLX: Wiping existing primary data before full refresh. [2025-09-26T20:56:04.081742] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-09-26T20:56:04.081299] [INFO ] [REMOTE ] RBC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:56:04.082293] [INFO ] [REMOTE ] RBC: Fetching primary data for 2024-12. [2025-09-26T20:56:04.083609] [DEBUG] [LOCAL ] RBLX: Deleted primary data file. [2025-09-26T20:56:04.083869] [INFO ] [MAIN ] RBLX: Starting full primary refresh. [2025-09-26T20:56:04.197343] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-26T20:56:04.504926] [INFO ] [REMOTE ] RBLX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:56:04.711761] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2024-12. [2025-09-26T20:56:04.986193] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-26T20:56:05.511721] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-02. [2025-09-26T20:56:05.620243] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-26T20:56:06.311744] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-01. [2025-09-26T20:56:07.097327] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-09-26T20:56:07.111676] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-01. [2025-09-26T20:56:07.140517] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T20:56:07.293416] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-26T20:56:07.911730] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-03. [2025-09-26T20:56:08.711748] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-02. [2025-09-26T20:56:09.301037] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-26T20:56:09.402853] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-26T20:56:09.511754] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-02. [2025-09-26T20:56:09.856433] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-26T20:56:10.311723] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-02. [2025-09-26T20:56:11.111691] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-04. [2025-09-26T20:56:11.316631] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-26T20:56:11.836318] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-09-26T20:56:11.911708] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-03. [2025-09-26T20:56:12.711752] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-03. [2025-09-26T20:56:12.873894] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-26T20:56:12.963876] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-26T20:56:13.511792] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-04. [2025-09-26T20:56:14.311727] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-03. [2025-09-26T20:56:14.491241] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-26T20:56:14.675277] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-26T20:56:15.111751] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-05. [2025-09-26T20:56:15.911718] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-05. [2025-09-26T20:56:15.959248] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-26T20:56:16.711758] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-04. [2025-09-26T20:56:16.979700] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-26T20:56:16.980717] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-26T20:56:17.511720] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-06. [2025-09-26T20:56:18.311765] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-06. [2025-09-26T20:56:18.398918] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-26T20:56:18.432719] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-26T20:56:19.111748] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-05. [2025-09-26T20:56:19.911684] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-04. [2025-09-26T20:56:20.003456] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-26T20:56:20.711756] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-07. [2025-09-26T20:56:21.188737] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-26T20:56:21.351223] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-26T20:56:21.400691] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-26T20:56:21.511725] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-08. [2025-09-26T20:56:22.311740] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-07. [2025-09-26T20:56:22.445534] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-26T20:56:23.111725] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-05. [2025-09-26T20:56:23.879944] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-26T20:56:23.911707] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-06. [2025-09-26T20:56:24.651430] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-26T20:56:24.711736] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-09. [2025-09-26T20:56:25.511713] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-06. [2025-09-26T20:56:25.680557] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-26T20:56:25.683755] [INFO ] [REMOTE ] RBC: Full fetch complete (21921 records). [2025-09-26T20:56:25.683840] [DEBUG] [VALIDATOR ] RBC: Validating primary data. [2025-09-26T20:56:26.083951] [DEBUG] [VALIDATOR ] RBC: All expected trading days are present. [2025-09-26T20:56:26.084062] [DEBUG] [VALIDATOR ] RBC: Primary data validation passed. [2025-09-26T20:56:26.084578] [INFO ] [MAIN ] RBC: Fetched primary data is valid. [2025-09-26T20:56:26.084706] [DEBUG] [LOCAL ] RBC: Saving primary data. [2025-09-26T20:56:26.085674] [DEBUG] [LOCAL ] RBC: Trimmed 21921 records to 15326 (keeping 200 days of data) [2025-09-26T20:56:26.187705] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-26T20:56:26.225969] [DEBUG] [LOCAL ] RBC: Primary data saved (15326 records). [2025-09-26T20:56:26.226134] [INFO ] [MAIN ] RBC: Full history saved. [2025-09-26T20:56:26.226230] [INFO ] [MAIN ] Update Progress: 1769/2371 symbols completed. RBC took 23.5s. Estimated remaining: 1h 20m 27s. Rate: 7.5 symbols/min [2025-09-26T20:56:26.316956] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-07. [2025-09-26T20:56:26.421584] [INFO ] [MAIN ] RBOT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:56:26.429164] [DEBUG] [LOCAL ] RBOT: Loaded 5178 existing records from primary storage. [2025-09-26T20:56:26.429290] [INFO ] [MAIN ] RBOT: Loaded 5178 existing records. [2025-09-26T20:56:26.620639] [WARN ] [MAIN ] RBOT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:56:26.621068] [INFO ] [MAIN ] RBOT: Wiping existing primary data before full refresh. [2025-09-26T20:56:26.621272] [INFO ] [LOCAL ] RBOT: Starting deletion of primary data. [2025-09-26T20:56:26.621704] [DEBUG] [LOCAL ] RBOT: Deleted primary data file. [2025-09-26T20:56:26.621784] [INFO ] [MAIN ] RBOT: Starting full primary refresh. [2025-09-26T20:56:26.808725] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-26T20:56:27.052206] [INFO ] [REMOTE ] RBOT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:56:27.111718] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-07. [2025-09-26T20:56:27.911725] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-08. [2025-09-26T20:56:28.531598] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-26T20:56:28.643809] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-26T20:56:28.711717] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-08. [2025-09-26T20:56:29.419589] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-26T20:56:29.511710] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-08. [2025-09-26T20:56:30.311752] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-09. [2025-09-26T20:56:30.968672] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-26T20:56:31.037063] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-26T20:56:31.111689] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-09. [2025-09-26T20:56:31.441370] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-26T20:56:31.455682] [INFO ] [REMOTE ] RBA: Full fetch complete (65515 records). [2025-09-26T20:56:31.456147] [DEBUG] [VALIDATOR ] RBA: Validating primary data. [2025-09-26T20:56:31.863991] [DEBUG] [VALIDATOR ] RBA: All expected trading days are present. [2025-09-26T20:56:31.864126] [DEBUG] [VALIDATOR ] RBA: Primary data validation passed. [2025-09-26T20:56:31.865222] [INFO ] [MAIN ] RBA: Fetched primary data is valid. [2025-09-26T20:56:31.865289] [DEBUG] [LOCAL ] RBA: Saving primary data. [2025-09-26T20:56:31.866878] [DEBUG] [LOCAL ] RBA: Trimmed 65515 records to 46598 (keeping 200 days of data) [2025-09-26T20:56:31.925841] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2024-12. [2025-09-26T20:56:32.182433] [DEBUG] [LOCAL ] RBA: Primary data saved (46598 records). [2025-09-26T20:56:32.182586] [INFO ] [MAIN ] RBA: Full history saved. [2025-09-26T20:56:32.182701] [INFO ] [MAIN ] Update Progress: 1770/2371 symbols completed. RBA took 32.1s. Estimated remaining: 1h 20m 18s. Rate: 7.5 symbols/min [2025-09-26T20:56:32.394367] [INFO ] [MAIN ] RBRK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:56:32.469796] [DEBUG] [LOCAL ] RBRK: Loaded 53507 existing records from primary storage. [2025-09-26T20:56:32.470060] [INFO ] [MAIN ] RBRK: Loaded 53507 existing records. [2025-09-26T20:56:32.652772] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-26T20:56:32.706302] [WARN ] [MAIN ] RBRK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:56:32.706132] [INFO ] [REMOTE ] RAMP: Full fetch complete (53242 records). [2025-09-26T20:56:32.707509] [DEBUG] [VALIDATOR ] RAMP: Validating primary data. [2025-09-26T20:56:32.707359] [INFO ] [MAIN ] RBRK: Wiping existing primary data before full refresh. [2025-09-26T20:56:32.707979] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-09-26T20:56:32.715059] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-09. [2025-09-26T20:56:32.714918] [DEBUG] [LOCAL ] RBRK: Deleted primary data file. [2025-09-26T20:56:32.755224] [INFO ] [MAIN ] RBRK: Starting full primary refresh. [2025-09-26T20:56:32.888970] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-26T20:56:33.515732] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-01. [2025-09-26T20:56:33.523066] [DEBUG] [VALIDATOR ] RAMP: All expected trading days are present. [2025-09-26T20:56:33.530026] [DEBUG] [VALIDATOR ] RAMP: Primary data validation passed. [2025-09-26T20:56:33.536353] [INFO ] [MAIN ] RAMP: Fetched primary data is valid. [2025-09-26T20:56:33.563992] [DEBUG] [LOCAL ] RAMP: Saving primary data. [2025-09-26T20:56:33.582080] [INFO ] [REMOTE ] RBRK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:56:33.583883] [DEBUG] [LOCAL ] RAMP: Trimmed 53242 records to 38208 (keeping 200 days of data) [2025-09-26T20:56:33.835704] [DEBUG] [LOCAL ] RAMP: Primary data saved (38208 records). [2025-09-26T20:56:33.835897] [INFO ] [MAIN ] RAMP: Full history saved. [2025-09-26T20:56:33.836097] [INFO ] [MAIN ] Update Progress: 1771/2371 symbols completed. RAMP took 40.8s. Estimated remaining: 1h 20m 8s. Rate: 7.5 symbols/min [2025-09-26T20:56:34.065722] [INFO ] [MAIN ] RC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:56:34.111163] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-26T20:56:34.137516] [DEBUG] [LOCAL ] RC: Loaded 49317 existing records from primary storage. [2025-09-26T20:56:34.137746] [INFO ] [MAIN ] RC: Loaded 49317 existing records. [2025-09-26T20:56:34.325872] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-02. [2025-09-26T20:56:34.394448] [WARN ] [MAIN ] RC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:56:34.394838] [INFO ] [MAIN ] RC: Wiping existing primary data before full refresh. [2025-09-26T20:56:34.394910] [INFO ] [LOCAL ] RC: Starting deletion of primary data. [2025-09-26T20:56:34.396215] [DEBUG] [LOCAL ] RC: Deleted primary data file. [2025-09-26T20:56:34.396303] [INFO ] [MAIN ] RC: Starting full primary refresh. [2025-09-26T20:56:34.937461] [INFO ] [REMOTE ] RC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:56:35.096150] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-09-26T20:56:35.108382] [INFO ] [REMOTE ] RBLX: Full fetch complete (77779 records). [2025-09-26T20:56:35.108538] [DEBUG] [VALIDATOR ] RBLX: Validating primary data. [2025-09-26T20:56:35.121311] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2024-12. [2025-09-26T20:56:35.234776] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-26T20:56:35.553099] [DEBUG] [VALIDATOR ] RBLX: All expected trading days are present. [2025-09-26T20:56:35.553191] [DEBUG] [VALIDATOR ] RBLX: Primary data validation passed. [2025-09-26T20:56:35.554245] [INFO ] [MAIN ] RBLX: Fetched primary data is valid. [2025-09-26T20:56:35.554315] [DEBUG] [LOCAL ] RBLX: Saving primary data. [2025-09-26T20:56:35.556592] [DEBUG] [LOCAL ] RBLX: Trimmed 77779 records to 54496 (keeping 200 days of data) [2025-09-26T20:56:35.911790] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-03. [2025-09-26T20:56:35.917388] [DEBUG] [LOCAL ] RBLX: Primary data saved (54496 records). [2025-09-26T20:56:35.917493] [INFO ] [MAIN ] RBLX: Full history saved. [2025-09-26T20:56:35.917620] [INFO ] [MAIN ] Update Progress: 1772/2371 symbols completed. RBLX took 33.0s. Estimated remaining: 1h 19m 58s. Rate: 7.5 symbols/min [2025-09-26T20:56:36.098721] [INFO ] [MAIN ] RCB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:56:36.098915] [DEBUG] [LOCAL ] RCB: No existing data file found in primary storage. [2025-09-26T20:56:36.098971] [WARN ] [MAIN ] RCB: No existing data found, performing full refresh instead. [2025-09-26T20:56:36.099149] [INFO ] [MAIN ] RCB: Wiping existing primary data before full refresh. [2025-09-26T20:56:36.099196] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-09-26T20:56:36.099239] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-09-26T20:56:36.099273] [INFO ] [MAIN ] RCB: Starting full primary refresh. [2025-09-26T20:56:36.469949] [INFO ] [REMOTE ] RCB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:56:36.619024] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-26T20:56:36.711692] [INFO ] [REMOTE ] RC: Fetching primary data for 2024-12. [2025-09-26T20:56:36.920967] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T20:56:37.511719] [INFO ] [REMOTE ] RCB: Fetching primary data for 2024-12. [2025-09-26T20:56:38.101293] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-26T20:56:38.311701] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-01. [2025-09-26T20:56:38.491538] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-26T20:56:39.111723] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-04. [2025-09-26T20:56:39.792860] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-26T20:56:39.911717] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-05. [2025-09-26T20:56:40.125077] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-26T20:56:40.525588] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-26T20:56:40.711708] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-02. [2025-09-26T20:56:41.511709] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-01. [2025-09-26T20:56:42.311695] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-01. [2025-09-26T20:56:42.475918] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-26T20:56:42.825473] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-26T20:56:43.086546] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T20:56:43.111685] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-02. [2025-09-26T20:56:43.769024] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-26T20:56:43.911721] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-03. [2025-09-26T20:56:44.711717] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-02. [2025-09-26T20:56:45.511708] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-03. [2025-09-26T20:56:45.986258] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-26T20:56:46.311724] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-06. [2025-09-26T20:56:46.421696] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-26T20:56:46.448397] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-26T20:56:46.855895] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-26T20:56:47.111734] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-07. [2025-09-26T20:56:47.903257] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-26T20:56:47.911638] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-08. [2025-09-26T20:56:48.711743] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-03. [2025-09-26T20:56:48.719148] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-26T20:56:49.511728] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-09. [2025-09-26T20:56:50.314753] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-04. [2025-09-26T20:56:50.316235] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-26T20:56:50.319738] [INFO ] [REMOTE ] RBOT: Full fetch complete (8553 records). [2025-09-26T20:56:50.319834] [DEBUG] [VALIDATOR ] RBOT: Validating primary data. [2025-09-26T20:56:50.728991] [DEBUG] [VALIDATOR ] RBOT: All expected trading days are present. [2025-09-26T20:56:50.743492] [DEBUG] [VALIDATOR ] RBOT: Primary data validation passed. [2025-09-26T20:56:50.744146] [INFO ] [MAIN ] RBOT: Fetched primary data is valid. [2025-09-26T20:56:50.744598] [DEBUG] [LOCAL ] RBOT: Saving primary data. [2025-09-26T20:56:50.750917] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-26T20:56:50.762489] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-26T20:56:50.762621] [DEBUG] [LOCAL ] RBOT: Trimmed 8553 records to 5223 (keeping 200 days of data) [2025-09-26T20:56:50.800928] [DEBUG] [LOCAL ] RBOT: Primary data saved (5223 records). [2025-09-26T20:56:50.801086] [INFO ] [MAIN ] RBOT: Full history saved. [2025-09-26T20:56:50.801211] [INFO ] [MAIN ] Update Progress: 1773/2371 symbols completed. RBOT took 24.6s. Estimated remaining: 1h 19m 52s. Rate: 7.5 symbols/min [2025-09-26T20:56:50.980794] [INFO ] [MAIN ] RCD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:56:50.980986] [DEBUG] [LOCAL ] RCD: No existing data file found in primary storage. [2025-09-26T20:56:50.981026] [WARN ] [MAIN ] RCD: No existing data found, performing full refresh instead. [2025-09-26T20:56:50.981179] [INFO ] [MAIN ] RCD: Wiping existing primary data before full refresh. [2025-09-26T20:56:50.981222] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-09-26T20:56:50.981265] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-09-26T20:56:50.981301] [INFO ] [MAIN ] RCD: Starting full primary refresh. [2025-09-26T20:56:51.116827] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-04. [2025-09-26T20:56:51.365869] [INFO ] [REMOTE ] RCD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:56:51.911730] [INFO ] [REMOTE ] RCD: Fetching primary data for 2024-12. [2025-09-26T20:56:52.623536] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-26T20:56:52.711743] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-01. [2025-09-26T20:56:52.946195] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-26T20:56:53.440671] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-26T20:56:53.511672] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-02. [2025-09-26T20:56:53.995286] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-26T20:56:54.311746] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-04. [2025-09-26T20:56:55.111719] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-03. [2025-09-26T20:56:55.840773] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-26T20:56:55.911686] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-04. [2025-09-26T20:56:56.536172] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-26T20:56:56.654201] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-26T20:56:56.711675] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-05. [2025-09-26T20:56:57.511736] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-05. [2025-09-26T20:56:58.093330] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-26T20:56:58.311714] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-05. [2025-09-26T20:56:58.355597] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-26T20:56:59.111717] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-05. [2025-09-26T20:56:59.708626] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-26T20:56:59.911718] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-06. [2025-09-26T20:57:00.326784] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-26T20:57:00.711719] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-06. [2025-09-26T20:57:01.330123] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-26T20:57:01.511713] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-06. [2025-09-26T20:57:01.553960] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-26T20:57:02.311751] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-07. [2025-09-26T20:57:02.918584] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-26T20:57:03.111687] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-06. [2025-09-26T20:57:03.533596] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-26T20:57:03.723309] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-26T20:57:03.911726] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-07. [2025-09-26T20:57:04.711718] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-07. [2025-09-26T20:57:05.511731] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-07. [2025-09-26T20:57:05.971264] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-26T20:57:06.040708] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-26T20:57:06.069544] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-26T20:57:06.311735] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-08. [2025-09-26T20:57:07.111741] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-08. [2025-09-26T20:57:07.911709] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-08. [2025-09-26T20:57:08.207446] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-26T20:57:08.717804] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-08. [2025-09-26T20:57:08.724158] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-26T20:57:08.755698] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-26T20:57:09.176354] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-26T20:57:09.511734] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-09. [2025-09-26T20:57:10.311734] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-09. [2025-09-26T20:57:10.933540] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-26T20:57:10.934949] [INFO ] [REMOTE ] RCD: Full fetch complete (6867 records). [2025-09-26T20:57:10.935040] [DEBUG] [VALIDATOR ] RCD: Validating primary data. [2025-09-26T20:57:11.116785] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-09. [2025-09-26T20:57:11.124597] [WARN ] [VALIDATOR ] RCD: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-26T20:57:11.125952] [FATAL] [MAIN ] RCD: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:57:11.126046] [WARN ] [MAIN ] RCD: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:57:11.126136] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-09-26T20:57:11.126222] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-09-26T20:57:11.126263] [INFO ] [LOCAL ] RCD: Starting deletion of derivative data. [2025-09-26T20:57:11.126323] [DEBUG] [LOCAL ] RCD: No derivative data file found to delete. [2025-09-26T20:57:11.126432] [INFO ] [MAIN ] Update Progress: 1774/2371 symbols completed. RCD took 20.3s. Estimated remaining: 1h 19m 48s. Rate: 7.5 symbols/min [2025-09-26T20:57:11.319422] [INFO ] [MAIN ] RCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:57:11.387827] [DEBUG] [LOCAL ] RCI: Loaded 49060 existing records from primary storage. [2025-09-26T20:57:11.388000] [INFO ] [MAIN ] RCI: Loaded 49060 existing records. [2025-09-26T20:57:11.561511] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-26T20:57:11.587405] [INFO ] [REMOTE ] RCB: Full fetch complete (3747 records). [2025-09-26T20:57:11.587566] [DEBUG] [VALIDATOR ] RCB: Validating primary data. [2025-09-26T20:57:11.586133] [WARN ] [MAIN ] RCI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:57:11.626330] [INFO ] [MAIN ] RCI: Wiping existing primary data before full refresh. [2025-09-26T20:57:11.654705] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-09-26T20:57:11.692730] [DEBUG] [LOCAL ] RCI: Deleted primary data file. [2025-09-26T20:57:11.702296] [INFO ] [MAIN ] RCI: Starting full primary refresh. [2025-09-26T20:57:11.921227] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-09. [2025-09-26T20:57:11.928867] [WARN ] [VALIDATOR ] RCB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-26T20:57:11.917142] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-09-26T20:57:11.930698] [FATAL] [MAIN ] RCB: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:57:11.962021] [WARN ] [MAIN ] RCB: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:57:11.999974] [INFO ] [REMOTE ] RBRK: Full fetch complete (76522 records). [2025-09-26T20:57:12.006199] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-09-26T20:57:12.016135] [DEBUG] [VALIDATOR ] RBRK: Validating primary data. [2025-09-26T20:57:12.042951] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-09-26T20:57:12.052715] [INFO ] [LOCAL ] RCB: Starting deletion of derivative data. [2025-09-26T20:57:12.190186] [DEBUG] [LOCAL ] RCB: No derivative data file found to delete. [2025-09-26T20:57:12.205938] [INFO ] [MAIN ] Update Progress: 1775/2371 symbols completed. RCB took 36.3s. Estimated remaining: 1h 19m 38s. Rate: 7.5 symbols/min [2025-09-26T20:57:12.508079] [INFO ] [REMOTE ] RCI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:57:12.732638] [INFO ] [REMOTE ] RCI: Fetching primary data for 2024-12. [2025-09-26T20:57:12.742139] [INFO ] [MAIN ] RCL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:57:12.783073] [DEBUG] [LOCAL ] RCL: No existing data file found in primary storage. [2025-09-26T20:57:12.783289] [WARN ] [MAIN ] RCL: No existing data found, performing full refresh instead. [2025-09-26T20:57:12.783998] [INFO ] [MAIN ] RCL: Wiping existing primary data before full refresh. [2025-09-26T20:57:12.784079] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-09-26T20:57:12.784178] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-09-26T20:57:12.846686] [INFO ] [MAIN ] RCL: Starting full primary refresh. [2025-09-26T20:57:12.952990] [DEBUG] [VALIDATOR ] RBRK: All expected trading days are present. [2025-09-26T20:57:12.968321] [DEBUG] [VALIDATOR ] RBRK: Primary data validation passed. [2025-09-26T20:57:12.976390] [INFO ] [MAIN ] RBRK: Fetched primary data is valid. [2025-09-26T20:57:12.981616] [DEBUG] [LOCAL ] RBRK: Saving primary data. [2025-09-26T20:57:13.057992] [DEBUG] [LOCAL ] RBRK: Trimmed 76522 records to 53892 (keeping 200 days of data) [2025-09-26T20:57:13.384428] [INFO ] [REMOTE ] RCL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:57:13.516811] [INFO ] [REMOTE ] RCL: Fetching primary data for 2024-12. [2025-09-26T20:57:13.537831] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-26T20:57:13.550865] [INFO ] [REMOTE ] RC: Full fetch complete (70831 records). [2025-09-26T20:57:13.551522] [DEBUG] [VALIDATOR ] RC: Validating primary data. [2025-09-26T20:57:13.999554] [DEBUG] [VALIDATOR ] RC: All expected trading days are present. [2025-09-26T20:57:14.000002] [DEBUG] [VALIDATOR ] RC: Primary data validation passed. [2025-09-26T20:57:14.001318] [INFO ] [MAIN ] RC: Fetched primary data is valid. [2025-09-26T20:57:14.001904] [DEBUG] [LOCAL ] RC: Saving primary data. [2025-09-26T20:57:14.009024] [DEBUG] [LOCAL ] RC: Trimmed 70831 records to 49676 (keeping 200 days of data) [2025-09-26T20:57:14.369508] [DEBUG] [LOCAL ] RC: Primary data saved (49676 records). [2025-09-26T20:57:14.370577] [INFO ] [MAIN ] RC: Full history saved. [2025-09-26T20:57:14.370993] [INFO ] [MAIN ] Update Progress: 1776/2371 symbols completed. RC took 40.5s. Estimated remaining: 1h 19m 28s. Rate: 7.5 symbols/min [2025-09-26T20:57:14.543555] [DEBUG] [LOCAL ] RBRK: Primary data saved (53892 records). [2025-09-26T20:57:14.543832] [INFO ] [MAIN ] RBRK: Full history saved. [2025-09-26T20:57:14.552518] [INFO ] [MAIN ] Update Progress: 1777/2371 symbols completed. RBRK took 42.4s. Estimated remaining: 1h 19m 17s. Rate: 7.5 symbols/min [2025-09-26T20:57:14.570118] [INFO ] [MAIN ] RCS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:57:14.744069] [DEBUG] [LOCAL ] RCS: Loaded 11526 existing records from primary storage. [2025-09-26T20:57:14.751133] [INFO ] [MAIN ] RCS: Loaded 11526 existing records. [2025-09-26T20:57:14.786685] [INFO ] [MAIN ] RCUS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:57:14.885852] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-26T20:57:14.934159] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-01. [2025-09-26T20:57:15.030141] [WARN ] [MAIN ] RCS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:57:15.041604] [INFO ] [MAIN ] RCS: Wiping existing primary data before full refresh. [2025-09-26T20:57:15.041703] [INFO ] [LOCAL ] RCS: Starting deletion of primary data. [2025-09-26T20:57:15.042109] [DEBUG] [LOCAL ] RCS: Deleted primary data file. [2025-09-26T20:57:15.042173] [INFO ] [MAIN ] RCS: Starting full primary refresh. [2025-09-26T20:57:15.172892] [DEBUG] [LOCAL ] RCUS: Loaded 42949 existing records from primary storage. [2025-09-26T20:57:15.193864] [INFO ] [MAIN ] RCUS: Loaded 42949 existing records. [2025-09-26T20:57:15.583283] [WARN ] [MAIN ] RCUS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:57:15.666288] [INFO ] [REMOTE ] RCS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:57:15.666735] [INFO ] [MAIN ] RCUS: Wiping existing primary data before full refresh. [2025-09-26T20:57:15.667088] [INFO ] [REMOTE ] RCS: Fetching primary data for 2024-12. [2025-09-26T20:57:15.667176] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-09-26T20:57:15.669346] [DEBUG] [LOCAL ] RCUS: Deleted primary data file. [2025-09-26T20:57:15.669438] [INFO ] [MAIN ] RCUS: Starting full primary refresh. [2025-09-26T20:57:15.816252] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-26T20:57:15.941692] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-01. [2025-09-26T20:57:16.098757] [INFO ] [REMOTE ] RCUS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:57:16.699508] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-26T20:57:16.711639] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-02. [2025-09-26T20:57:17.011444] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-26T20:57:17.511750] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2024-12. [2025-09-26T20:57:18.099810] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-26T20:57:18.311718] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-01. [2025-09-26T20:57:18.432898] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-26T20:57:19.055934] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-26T20:57:19.111706] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-01. [2025-09-26T20:57:19.368537] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-26T20:57:19.911740] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-03. [2025-09-26T20:57:20.564828] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-26T20:57:20.711734] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-02. [2025-09-26T20:57:21.511706] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-02. [2025-09-26T20:57:21.712168] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-26T20:57:22.311722] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-02. [2025-09-26T20:57:22.513322] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-26T20:57:22.994920] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-26T20:57:23.111712] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-03. [2025-09-26T20:57:23.217464] [DEBUG] [REMOTE ] RCL: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-09-26T20:57:23.217854] [WARN ] [REMOTE ] RCL: No data returned for month 2025-03 [2025-09-26T20:57:23.284528] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-26T20:57:23.911725] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-04. [2025-09-26T20:57:24.711786] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-03. [2025-09-26T20:57:25.511682] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-04. [2025-09-26T20:57:25.606586] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-26T20:57:25.606291] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-26T20:57:26.311779] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-03. [2025-09-26T20:57:27.111753] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-04. [2025-09-26T20:57:27.753375] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-26T20:57:27.913788] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-05. [2025-09-26T20:57:27.913625] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-26T20:57:28.079879] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-26T20:57:28.711726] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-05. [2025-09-26T20:57:29.511751] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-05. [2025-09-26T20:57:29.929895] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-26T20:57:30.257903] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-26T20:57:30.301105] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-26T20:57:30.311669] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-06. [2025-09-26T20:57:31.111748] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-06. [2025-09-26T20:57:31.163014] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-26T20:57:31.911725] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-06. [2025-09-26T20:57:32.711699] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-07. [2025-09-26T20:57:32.828250] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-26T20:57:33.511741] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-04. [2025-09-26T20:57:33.557823] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-26T20:57:33.965209] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-26T20:57:34.311739] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-07. [2025-09-26T20:57:34.878204] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-26T20:57:35.111716] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-08. [2025-09-26T20:57:35.911711] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-05. [2025-09-26T20:57:35.938273] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-26T20:57:36.086229] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-26T20:57:36.711716] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-09. [2025-09-26T20:57:37.511700] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-08. [2025-09-26T20:57:37.522489] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-26T20:57:37.525437] [INFO ] [REMOTE ] RCS: Full fetch complete (19137 records). [2025-09-26T20:57:37.525519] [DEBUG] [VALIDATOR ] RCS: Validating primary data. [2025-09-26T20:57:37.743362] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-26T20:57:37.986693] [DEBUG] [VALIDATOR ] RCS: All expected trading days are present. [2025-09-26T20:57:37.986786] [DEBUG] [VALIDATOR ] RCS: Primary data validation passed. [2025-09-26T20:57:37.987323] [INFO ] [MAIN ] RCS: Fetched primary data is valid. [2025-09-26T20:57:37.987384] [DEBUG] [LOCAL ] RCS: Saving primary data. [2025-09-26T20:57:37.988107] [DEBUG] [LOCAL ] RCS: Trimmed 19137 records to 11593 (keeping 200 days of data) [2025-09-26T20:57:38.060068] [DEBUG] [LOCAL ] RCS: Primary data saved (11593 records). [2025-09-26T20:57:38.060253] [INFO ] [MAIN ] RCS: Full history saved. [2025-09-26T20:57:38.060362] [INFO ] [MAIN ] Update Progress: 1778/2371 symbols completed. RCS took 23.7s. Estimated remaining: 1h 19m 14s. Rate: 7.5 symbols/min [2025-09-26T20:57:38.248471] [INFO ] [MAIN ] RDDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:57:38.248669] [DEBUG] [LOCAL ] RDDT: No existing data file found in primary storage. [2025-09-26T20:57:38.248727] [WARN ] [MAIN ] RDDT: No existing data found, performing full refresh instead. [2025-09-26T20:57:38.248890] [INFO ] [MAIN ] RDDT: Wiping existing primary data before full refresh. [2025-09-26T20:57:38.248934] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-09-26T20:57:38.248977] [DEBUG] [LOCAL ] RDDT: No primary data file found to delete. [2025-09-26T20:57:38.249009] [INFO ] [MAIN ] RDDT: Starting full primary refresh. [2025-09-26T20:57:38.319801] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-06. [2025-09-26T20:57:38.687009] [INFO ] [REMOTE ] RDDT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:57:39.111692] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-07. [2025-09-26T20:57:39.657221] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-26T20:57:39.784031] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-26T20:57:39.911718] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2024-12. [2025-09-26T20:57:40.670246] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-26T20:57:40.711677] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-08. [2025-09-26T20:57:41.511721] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-09. [2025-09-26T20:57:42.319823] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-07. [2025-09-26T20:57:42.323263] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-26T20:57:42.335325] [INFO ] [REMOTE ] RCL: Full fetch complete (66910 records). [2025-09-26T20:57:42.335483] [DEBUG] [VALIDATOR ] RCL: Validating primary data. [2025-09-26T20:57:42.337233] [FATAL] [VALIDATOR ] RCL: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T20:57:42.337328] [FATAL] [MAIN ] RCL: Fetched primary data is invalid. Refusing to save it. [2025-09-26T20:57:42.337375] [WARN ] [MAIN ] RCL: Deleting existing primary and derivative data due to validation failure. [2025-09-26T20:57:42.337445] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-09-26T20:57:42.337515] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-09-26T20:57:42.337555] [INFO ] [LOCAL ] RCL: Starting deletion of derivative data. [2025-09-26T20:57:42.337600] [DEBUG] [LOCAL ] RCL: No derivative data file found to delete. [2025-09-26T20:57:42.337694] [INFO ] [MAIN ] Update Progress: 1779/2371 symbols completed. RCL took 30.1s. Estimated remaining: 1h 19m 5s. Rate: 7.5 symbols/min [2025-09-26T20:57:42.526397] [INFO ] [MAIN ] RDN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:57:42.555867] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-26T20:57:42.597708] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2024-12 (2.69 seconds). [2025-09-26T20:57:42.650528] [DEBUG] [LOCAL ] RDN: Loaded 45605 existing records from primary storage. [2025-09-26T20:57:42.650723] [INFO ] [MAIN ] RDN: Loaded 45605 existing records. [2025-09-26T20:57:42.839605] [WARN ] [MAIN ] RDN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:57:42.839877] [INFO ] [MAIN ] RDN: Wiping existing primary data before full refresh. [2025-09-26T20:57:42.839928] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-09-26T20:57:42.840999] [DEBUG] [LOCAL ] RDN: Deleted primary data file. [2025-09-26T20:57:42.841061] [INFO ] [MAIN ] RDN: Starting full primary refresh. [2025-09-26T20:57:43.120900] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-09. [2025-09-26T20:57:43.233946] [INFO ] [REMOTE ] RDN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:57:43.816580] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-26T20:57:43.911725] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-01. [2025-09-26T20:57:44.368408] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-26T20:57:44.377712] [INFO ] [REMOTE ] RCI: Full fetch complete (70511 records). [2025-09-26T20:57:44.377849] [DEBUG] [VALIDATOR ] RCI: Validating primary data. [2025-09-26T20:57:44.716822] [INFO ] [REMOTE ] RDN: Fetching primary data for 2024-12. [2025-09-26T20:57:44.821716] [DEBUG] [VALIDATOR ] RCI: All expected trading days are present. [2025-09-26T20:57:44.821806] [DEBUG] [VALIDATOR ] RCI: Primary data validation passed. [2025-09-26T20:57:44.822888] [INFO ] [MAIN ] RCI: Fetched primary data is valid. [2025-09-26T20:57:44.822955] [DEBUG] [LOCAL ] RCI: Saving primary data. [2025-09-26T20:57:44.826992] [DEBUG] [LOCAL ] RCI: Trimmed 70511 records to 49383 (keeping 200 days of data) [2025-09-26T20:57:45.153689] [DEBUG] [LOCAL ] RCI: Primary data saved (49383 records). [2025-09-26T20:57:45.153887] [INFO ] [MAIN ] RCI: Full history saved. [2025-09-26T20:57:45.153998] [INFO ] [MAIN ] Update Progress: 1780/2371 symbols completed. RCI took 34.0s. Estimated remaining: 1h 18m 55s. Rate: 7.5 symbols/min [2025-09-26T20:57:45.339271] [INFO ] [MAIN ] RDW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:57:45.395309] [DEBUG] [LOCAL ] RDW: Loaded 52404 existing records from primary storage. [2025-09-26T20:57:45.395485] [INFO ] [MAIN ] RDW: Loaded 52404 existing records. [2025-09-26T20:57:45.516899] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-08. [2025-09-26T20:57:45.587951] [WARN ] [MAIN ] RDW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:57:45.588621] [INFO ] [MAIN ] RDW: Wiping existing primary data before full refresh. [2025-09-26T20:57:45.588709] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-09-26T20:57:45.589955] [DEBUG] [LOCAL ] RDW: Deleted primary data file. [2025-09-26T20:57:45.590019] [INFO ] [MAIN ] RDW: Starting full primary refresh. [2025-09-26T20:57:45.976135] [INFO ] [REMOTE ] RDW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:57:46.026142] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-26T20:57:46.198772] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-26T20:57:46.311716] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-02. [2025-09-26T20:57:46.776428] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-26T20:57:47.111719] [INFO ] [REMOTE ] RDW: Fetching primary data for 2024-12. [2025-09-26T20:57:47.911704] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-01. [2025-09-26T20:57:48.711736] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-09. [2025-09-26T20:57:48.830307] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-02 (2.52 seconds). [2025-09-26T20:57:49.069072] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-26T20:57:49.110516] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-26T20:57:49.511731] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-03. [2025-09-26T20:57:50.164295] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-26T20:57:50.172345] [INFO ] [REMOTE ] RCUS: Full fetch complete (60198 records). [2025-09-26T20:57:50.172496] [DEBUG] [VALIDATOR ] RCUS: Validating primary data. [2025-09-26T20:57:50.320707] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-01. [2025-09-26T20:57:50.577929] [DEBUG] [VALIDATOR ] RCUS: All expected trading days are present. [2025-09-26T20:57:50.578025] [DEBUG] [VALIDATOR ] RCUS: Primary data validation passed. [2025-09-26T20:57:50.578995] [INFO ] [MAIN ] RCUS: Fetched primary data is valid. [2025-09-26T20:57:50.579067] [DEBUG] [LOCAL ] RCUS: Saving primary data. [2025-09-26T20:57:50.580506] [DEBUG] [LOCAL ] RCUS: Trimmed 60198 records to 43206 (keeping 200 days of data) [2025-09-26T20:57:50.837617] [DEBUG] [LOCAL ] RCUS: Primary data saved (43206 records). [2025-09-26T20:57:50.837802] [INFO ] [MAIN ] RCUS: Full history saved. [2025-09-26T20:57:50.837944] [INFO ] [MAIN ] Update Progress: 1781/2371 symbols completed. RCUS took 36.3s. Estimated remaining: 1h 18m 47s. Rate: 7.5 symbols/min [2025-09-26T20:57:51.038252] [INFO ] [MAIN ] RDY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:57:51.090272] [DEBUG] [LOCAL ] RDY: Loaded 47087 existing records from primary storage. [2025-09-26T20:57:51.090425] [INFO ] [MAIN ] RDY: Loaded 47087 existing records. [2025-09-26T20:57:51.130374] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-02. [2025-09-26T20:57:51.290221] [WARN ] [MAIN ] RDY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:57:51.290508] [INFO ] [MAIN ] RDY: Wiping existing primary data before full refresh. [2025-09-26T20:57:51.290565] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-09-26T20:57:51.291808] [DEBUG] [LOCAL ] RDY: Deleted primary data file. [2025-09-26T20:57:51.291872] [INFO ] [MAIN ] RDY: Starting full primary refresh. [2025-09-26T20:57:51.674709] [INFO ] [REMOTE ] RDY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:57:51.911728] [INFO ] [REMOTE ] RDY: Fetching primary data for 2024-12. [2025-09-26T20:57:52.140672] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-03 (2.63 seconds). [2025-09-26T20:57:52.298680] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-26T20:57:52.386357] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-26T20:57:52.711733] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-03. [2025-09-26T20:57:53.511711] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-02. [2025-09-26T20:57:53.685403] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-26T20:57:54.311739] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-01. [2025-09-26T20:57:54.422582] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-26T20:57:55.111736] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-04. [2025-09-26T20:57:55.452307] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-26T20:57:55.911721] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-04. [2025-09-26T20:57:56.071247] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-26T20:57:56.711792] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-03. [2025-09-26T20:57:56.771977] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-26T20:57:57.511759] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-05. [2025-09-26T20:57:58.311706] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-02. [2025-09-26T20:57:58.361629] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-26T20:57:58.455317] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-26T20:57:59.111711] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-04. [2025-09-26T20:57:59.150968] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-26T20:57:59.655411] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-26T20:57:59.911760] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-03. [2025-09-26T20:58:00.711830] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-05. [2025-09-26T20:58:01.013919] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-26T20:58:01.511710] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-06. [2025-09-26T20:58:01.777431] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-26T20:58:02.311768] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-04. [2025-09-26T20:58:02.963995] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-26T20:58:03.111725] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-05. [2025-09-26T20:58:03.187925] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-09-26T20:58:03.911735] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-06. [2025-09-26T20:58:04.437121] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-26T20:58:04.711793] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-05. [2025-09-26T20:58:05.075922] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-26T20:58:05.511765] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-06. [2025-09-26T20:58:05.822936] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-26T20:58:06.243473] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-26T20:58:06.311706] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-06. [2025-09-26T20:58:07.111764] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-07. [2025-09-26T20:58:07.623697] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-26T20:58:07.911719] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-07. [2025-09-26T20:58:08.155012] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-26T20:58:08.711750] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-07. [2025-09-26T20:58:09.262876] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-26T20:58:09.511808] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-07. [2025-09-26T20:58:10.312371] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-26T20:58:10.312626] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-08. [2025-09-26T20:58:10.410073] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-09-26T20:58:11.111780] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-08. [2025-09-26T20:58:11.257777] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-26T20:58:11.911789] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-08. [2025-09-26T20:58:12.655172] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-26T20:58:12.711738] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-09. [2025-09-26T20:58:12.789552] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-09-26T20:58:13.505953] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-26T20:58:13.515145] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-08. [2025-09-26T20:58:14.297621] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-26T20:58:14.308271] [INFO ] [REMOTE ] RDN: Full fetch complete (65974 records). [2025-09-26T20:58:14.308607] [DEBUG] [VALIDATOR ] RDN: Validating primary data. [2025-09-26T20:58:14.316989] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-09. [2025-09-26T20:58:14.763766] [DEBUG] [VALIDATOR ] RDN: All expected trading days are present. [2025-09-26T20:58:14.763918] [DEBUG] [VALIDATOR ] RDN: Primary data validation passed. [2025-09-26T20:58:14.765218] [INFO ] [MAIN ] RDN: Fetched primary data is valid. [2025-09-26T20:58:14.765313] [DEBUG] [LOCAL ] RDN: Saving primary data. [2025-09-26T20:58:14.767261] [DEBUG] [LOCAL ] RDN: Trimmed 65974 records to 45976 (keeping 200 days of data) [2025-09-26T20:58:15.069115] [DEBUG] [LOCAL ] RDN: Primary data saved (45976 records). [2025-09-26T20:58:15.069321] [INFO ] [MAIN ] RDN: Full history saved. [2025-09-26T20:58:15.069466] [INFO ] [MAIN ] Update Progress: 1782/2371 symbols completed. RDN took 32.7s. Estimated remaining: 1h 18m 44s. Rate: 7.5 symbols/min [2025-09-26T20:58:15.128910] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-09. [2025-09-26T20:58:15.252233] [INFO ] [MAIN ] RELX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:58:15.304028] [DEBUG] [LOCAL ] RELX: Loaded 48211 existing records from primary storage. [2025-09-26T20:58:15.304253] [INFO ] [MAIN ] RELX: Loaded 48211 existing records. [2025-09-26T20:58:15.490489] [WARN ] [MAIN ] RELX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:58:15.490871] [INFO ] [MAIN ] RELX: Wiping existing primary data before full refresh. [2025-09-26T20:58:15.490952] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-09-26T20:58:15.492357] [DEBUG] [LOCAL ] RELX: Deleted primary data file. [2025-09-26T20:58:15.492421] [INFO ] [MAIN ] RELX: Starting full primary refresh. [2025-09-26T20:58:15.891792] [INFO ] [REMOTE ] RELX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:58:15.911690] [INFO ] [REMOTE ] RELX: Fetching primary data for 2024-12. [2025-09-26T20:58:16.071220] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-09-26T20:58:16.719972] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-09. [2025-09-26T20:58:16.739914] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-26T20:58:16.749777] [INFO ] [REMOTE ] RDY: Full fetch complete (69014 records). [2025-09-26T20:58:16.750004] [DEBUG] [VALIDATOR ] RDY: Validating primary data. [2025-09-26T20:58:17.186911] [DEBUG] [VALIDATOR ] RDY: All expected trading days are present. [2025-09-26T20:58:17.187126] [DEBUG] [VALIDATOR ] RDY: Primary data validation passed. [2025-09-26T20:58:17.189101] [INFO ] [MAIN ] RDY: Fetched primary data is valid. [2025-09-26T20:58:17.189177] [DEBUG] [LOCAL ] RDY: Saving primary data. [2025-09-26T20:58:17.191377] [DEBUG] [LOCAL ] RDY: Trimmed 69014 records to 47418 (keeping 200 days of data) [2025-09-26T20:58:17.525860] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-09 (3.21 seconds). [2025-09-26T20:58:17.553055] [INFO ] [REMOTE ] RDDT: Full fetch complete (77890 records). [2025-09-26T20:58:17.553965] [DEBUG] [VALIDATOR ] RDDT: Validating primary data. [2025-09-26T20:58:17.685089] [DEBUG] [LOCAL ] RDY: Primary data saved (47418 records). [2025-09-26T20:58:17.725008] [INFO ] [MAIN ] RDY: Full history saved. [2025-09-26T20:58:17.845809] [INFO ] [MAIN ] Update Progress: 1783/2371 symbols completed. RDY took 27.0s. Estimated remaining: 1h 18m 34s. Rate: 7.5 symbols/min [2025-09-26T20:58:17.892630] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-26T20:58:17.999138] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-01. [2025-09-26T20:58:18.268199] [INFO ] [MAIN ] RERE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:58:18.272423] [DEBUG] [VALIDATOR ] RDDT: All expected trading days are present. [2025-09-26T20:58:18.273121] [DEBUG] [VALIDATOR ] RDDT: Primary data validation passed. [2025-09-26T20:58:18.274401] [INFO ] [MAIN ] RDDT: Fetched primary data is valid. [2025-09-26T20:58:18.274498] [DEBUG] [LOCAL ] RDDT: Saving primary data. [2025-09-26T20:58:18.278205] [DEBUG] [LOCAL ] RDDT: Trimmed 77890 records to 54563 (keeping 200 days of data) [2025-09-26T20:58:18.414958] [DEBUG] [LOCAL ] RERE: Loaded 41364 existing records from primary storage. [2025-09-26T20:58:18.416340] [INFO ] [MAIN ] RERE: Loaded 41364 existing records. [2025-09-26T20:58:18.631268] [WARN ] [MAIN ] RERE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:58:18.633096] [INFO ] [MAIN ] RERE: Wiping existing primary data before full refresh. [2025-09-26T20:58:18.633459] [INFO ] [LOCAL ] RERE: Starting deletion of primary data. [2025-09-26T20:58:18.635778] [DEBUG] [LOCAL ] RERE: Deleted primary data file. [2025-09-26T20:58:18.635880] [INFO ] [MAIN ] RERE: Starting full primary refresh. [2025-09-26T20:58:19.065153] [INFO ] [REMOTE ] RERE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:58:19.066729] [INFO ] [REMOTE ] RERE: Fetching primary data for 2024-12. [2025-09-26T20:58:19.349789] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-09-26T20:58:19.369421] [INFO ] [REMOTE ] RDW: Full fetch complete (74556 records). [2025-09-26T20:58:19.370313] [DEBUG] [VALIDATOR ] RDW: Validating primary data. [2025-09-26T20:58:19.448067] [DEBUG] [LOCAL ] RDDT: Primary data saved (54563 records). [2025-09-26T20:58:19.472225] [INFO ] [MAIN ] RDDT: Full history saved. [2025-09-26T20:58:19.505971] [INFO ] [MAIN ] Update Progress: 1784/2371 symbols completed. RDDT took 41.4s. Estimated remaining: 1h 18m 24s. Rate: 7.5 symbols/min [2025-09-26T20:58:20.006802] [INFO ] [MAIN ] RES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:58:20.143458] [DEBUG] [VALIDATOR ] RDW: All expected trading days are present. [2025-09-26T20:58:20.145859] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-26T20:58:20.144463] [DEBUG] [VALIDATOR ] RDW: Primary data validation passed. [2025-09-26T20:58:20.148212] [INFO ] [MAIN ] RDW: Fetched primary data is valid. [2025-09-26T20:58:20.148527] [DEBUG] [LOCAL ] RDW: Saving primary data. [2025-09-26T20:58:20.159742] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-02. [2025-09-26T20:58:20.161760] [DEBUG] [LOCAL ] RDW: Trimmed 74556 records to 52794 (keeping 200 days of data) [2025-09-26T20:58:20.322713] [DEBUG] [LOCAL ] RES: Loaded 47879 existing records from primary storage. [2025-09-26T20:58:20.323958] [INFO ] [MAIN ] RES: Loaded 47879 existing records. [2025-09-26T20:58:20.654041] [WARN ] [MAIN ] RES: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:58:20.654622] [INFO ] [MAIN ] RES: Wiping existing primary data before full refresh. [2025-09-26T20:58:20.654738] [INFO ] [LOCAL ] RES: Starting deletion of primary data. [2025-09-26T20:58:20.734113] [DEBUG] [LOCAL ] RES: Deleted primary data file. [2025-09-26T20:58:20.766225] [INFO ] [MAIN ] RES: Starting full primary refresh. [2025-09-26T20:58:20.845337] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-26T20:58:20.887611] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-01. [2025-09-26T20:58:21.437199] [INFO ] [REMOTE ] RES: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:58:21.439417] [INFO ] [REMOTE ] RES: Fetching primary data for 2024-12. [2025-09-26T20:58:21.545347] [DEBUG] [LOCAL ] RDW: Primary data saved (52794 records). [2025-09-26T20:58:21.547699] [INFO ] [MAIN ] RDW: Full history saved. [2025-09-26T20:58:21.547833] [INFO ] [MAIN ] Update Progress: 1785/2371 symbols completed. RDW took 36.4s. Estimated remaining: 1h 18m 14s. Rate: 7.5 symbols/min [2025-09-26T20:58:21.751262] [INFO ] [MAIN ] REVG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:58:21.777917] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-26T20:58:21.787575] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-03. [2025-09-26T20:58:21.829321] [DEBUG] [LOCAL ] REVG: Loaded 41220 existing records from primary storage. [2025-09-26T20:58:21.829477] [INFO ] [MAIN ] REVG: Loaded 41220 existing records. [2025-09-26T20:58:22.025161] [WARN ] [MAIN ] REVG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:58:22.025723] [INFO ] [MAIN ] REVG: Wiping existing primary data before full refresh. [2025-09-26T20:58:22.025810] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-09-26T20:58:22.032201] [DEBUG] [LOCAL ] REVG: Deleted primary data file. [2025-09-26T20:58:22.045314] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-26T20:58:22.044362] [INFO ] [MAIN ] REVG: Starting full primary refresh. [2025-09-26T20:58:22.319368] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-02. [2025-09-26T20:58:22.438532] [INFO ] [REMOTE ] REVG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:58:22.750751] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-26T20:58:22.899208] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-26T20:58:23.111736] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-01. [2025-09-26T20:58:23.649458] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-26T20:58:23.911733] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-03. [2025-09-26T20:58:24.711727] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-04. [2025-09-26T20:58:24.848989] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-26T20:58:24.965618] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-26T20:58:25.511744] [INFO ] [REMOTE ] REVG: Fetching primary data for 2024-12. [2025-09-26T20:58:26.311712] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-02. [2025-09-26T20:58:26.342916] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-26T20:58:27.111740] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-05. [2025-09-26T20:58:27.162883] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-26T20:58:27.911735] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-01. [2025-09-26T20:58:27.950743] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-26T20:58:28.711754] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-04. [2025-09-26T20:58:28.850794] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-26T20:58:29.357883] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-26T20:58:29.511723] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-02. [2025-09-26T20:58:29.950520] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-26T20:58:30.311724] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-06. [2025-09-26T20:58:30.984049] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-26T20:58:31.111721] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-03. [2025-09-26T20:58:31.911734] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-03. [2025-09-26T20:58:31.983949] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-26T20:58:32.711693] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-05. [2025-09-26T20:58:32.884193] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-26T20:58:33.511741] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-04. [2025-09-26T20:58:33.553959] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-26T20:58:34.121085] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-26T20:58:34.311733] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-07. [2025-09-26T20:58:35.111711] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-04. [2025-09-26T20:58:35.341431] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-26T20:58:35.911698] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-06. [2025-09-26T20:58:36.153858] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-26T20:58:36.589249] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-26T20:58:36.711706] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-05. [2025-09-26T20:58:37.240209] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-26T20:58:37.511714] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-05. [2025-09-26T20:58:38.299324] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-26T20:58:38.311677] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-06. [2025-09-26T20:58:39.111716] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-08. [2025-09-26T20:58:39.201548] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-26T20:58:39.842595] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-26T20:58:39.911735] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-07. [2025-09-26T20:58:40.711730] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-06. [2025-09-26T20:58:41.017243] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-26T20:58:41.465987] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-26T20:58:41.511686] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-08. [2025-09-26T20:58:42.317571] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-09. [2025-09-26T20:58:42.323604] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-26T20:58:42.977770] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-26T20:58:43.111758] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-09. [2025-09-26T20:58:43.911705] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-07. [2025-09-26T20:58:44.093993] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-26T20:58:44.103997] [INFO ] [REMOTE ] RELX: Full fetch complete (67108 records). [2025-09-26T20:58:44.104157] [DEBUG] [VALIDATOR ] RELX: Validating primary data. [2025-09-26T20:58:44.513038] [DEBUG] [VALIDATOR ] RELX: All expected trading days are present. [2025-09-26T20:58:44.513161] [DEBUG] [VALIDATOR ] RELX: Primary data validation passed. [2025-09-26T20:58:44.514496] [INFO ] [MAIN ] RELX: Fetched primary data is valid. [2025-09-26T20:58:44.514567] [DEBUG] [LOCAL ] RELX: Saving primary data. [2025-09-26T20:58:44.516419] [DEBUG] [LOCAL ] RELX: Trimmed 67108 records to 48567 (keeping 200 days of data) [2025-09-26T20:58:44.719118] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-07. [2025-09-26T20:58:44.864125] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-26T20:58:44.876016] [INFO ] [REMOTE ] REVG: Full fetch complete (58356 records). [2025-09-26T20:58:44.887469] [DEBUG] [LOCAL ] RELX: Primary data saved (48567 records). [2025-09-26T20:58:44.887796] [INFO ] [MAIN ] RELX: Full history saved. [2025-09-26T20:58:44.887998] [INFO ] [MAIN ] Update Progress: 1786/2371 symbols completed. RELX took 29.8s. Estimated remaining: 1h 18m 11s. Rate: 7.5 symbols/min [2025-09-26T20:58:44.893749] [DEBUG] [VALIDATOR ] REVG: Validating primary data. [2025-09-26T20:58:45.262371] [INFO ] [MAIN ] REX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:58:45.426928] [DEBUG] [LOCAL ] REX: Loaded 14094 existing records from primary storage. [2025-09-26T20:58:45.450103] [INFO ] [MAIN ] REX: Loaded 14094 existing records. [2025-09-26T20:58:45.555789] [DEBUG] [VALIDATOR ] REVG: All expected trading days are present. [2025-09-26T20:58:45.588695] [DEBUG] [VALIDATOR ] REVG: Primary data validation passed. [2025-09-26T20:58:45.609510] [INFO ] [MAIN ] REVG: Fetched primary data is valid. [2025-09-26T20:58:45.620716] [DEBUG] [LOCAL ] REVG: Saving primary data. [2025-09-26T20:58:45.694638] [WARN ] [MAIN ] REX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:58:45.695522] [INFO ] [MAIN ] REX: Wiping existing primary data before full refresh. [2025-09-26T20:58:45.695612] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-09-26T20:58:45.695794] [DEBUG] [LOCAL ] REVG: Trimmed 58356 records to 41461 (keeping 200 days of data) [2025-09-26T20:58:45.696233] [DEBUG] [LOCAL ] REX: Deleted primary data file. [2025-09-26T20:58:45.697013] [INFO ] [MAIN ] REX: Starting full primary refresh. [2025-09-26T20:58:45.929133] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-26T20:58:45.998900] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-08. [2025-09-26T20:58:46.266489] [INFO ] [REMOTE ] REX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:58:46.349983] [INFO ] [REMOTE ] REX: Fetching primary data for 2024-12. [2025-09-26T20:58:46.419371] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-26T20:58:46.474190] [DEBUG] [LOCAL ] REVG: Primary data saved (41461 records). [2025-09-26T20:58:46.474374] [INFO ] [MAIN ] REVG: Full history saved. [2025-09-26T20:58:46.474490] [INFO ] [MAIN ] Update Progress: 1787/2371 symbols completed. REVG took 24.9s. Estimated remaining: 1h 18m 1s. Rate: 7.5 symbols/min [2025-09-26T20:58:46.651907] [INFO ] [MAIN ] REXR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:58:46.715546] [DEBUG] [LOCAL ] REXR: Loaded 52467 existing records from primary storage. [2025-09-26T20:58:46.715835] [INFO ] [MAIN ] REXR: Loaded 52467 existing records. [2025-09-26T20:58:46.987204] [WARN ] [MAIN ] REXR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:58:46.987516] [INFO ] [MAIN ] REXR: Wiping existing primary data before full refresh. [2025-09-26T20:58:46.987574] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-09-26T20:58:46.988982] [DEBUG] [LOCAL ] REXR: Deleted primary data file. [2025-09-26T20:58:46.989200] [INFO ] [MAIN ] REXR: Starting full primary refresh. [2025-09-26T20:58:47.117947] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-08. [2025-09-26T20:58:47.415024] [INFO ] [REMOTE ] REXR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:58:47.541007] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-26T20:58:47.620885] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-26T20:58:47.911752] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-01. [2025-09-26T20:58:48.711784] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-09. [2025-09-26T20:58:48.841977] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-26T20:58:48.994181] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-26T20:58:49.511784] [INFO ] [REMOTE ] REXR: Fetching primary data for 2024-12. [2025-09-26T20:58:50.200732] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-26T20:58:50.210903] [INFO ] [REMOTE ] RES: Full fetch complete (69013 records). [2025-09-26T20:58:50.211155] [DEBUG] [VALIDATOR ] RES: Validating primary data. [2025-09-26T20:58:50.316277] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-09. [2025-09-26T20:58:50.622506] [DEBUG] [VALIDATOR ] RES: All expected trading days are present. [2025-09-26T20:58:50.622631] [DEBUG] [VALIDATOR ] RES: Primary data validation passed. [2025-09-26T20:58:50.624535] [INFO ] [MAIN ] RES: Fetched primary data is valid. [2025-09-26T20:58:50.624609] [DEBUG] [LOCAL ] RES: Saving primary data. [2025-09-26T20:58:50.626706] [DEBUG] [LOCAL ] RES: Trimmed 69013 records to 48190 (keeping 200 days of data) [2025-09-26T20:58:50.953170] [DEBUG] [LOCAL ] RES: Primary data saved (48190 records). [2025-09-26T20:58:50.953541] [INFO ] [MAIN ] RES: Full history saved. [2025-09-26T20:58:50.954057] [INFO ] [MAIN ] Update Progress: 1788/2371 symbols completed. RES took 31.4s. Estimated remaining: 1h 17m 52s. Rate: 7.5 symbols/min [2025-09-26T20:58:51.123497] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-02. [2025-09-26T20:58:51.162730] [INFO ] [MAIN ] REZI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:58:51.238830] [DEBUG] [LOCAL ] REZI: Loaded 47235 existing records from primary storage. [2025-09-26T20:58:51.239078] [INFO ] [MAIN ] REZI: Loaded 47235 existing records. [2025-09-26T20:58:51.434238] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-26T20:58:51.495203] [WARN ] [MAIN ] REZI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:58:51.497876] [INFO ] [MAIN ] REZI: Wiping existing primary data before full refresh. [2025-09-26T20:58:51.497939] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-09-26T20:58:51.499129] [DEBUG] [LOCAL ] REZI: Deleted primary data file. [2025-09-26T20:58:51.499203] [INFO ] [MAIN ] REZI: Starting full primary refresh. [2025-09-26T20:58:51.912525] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-01. [2025-09-26T20:58:51.912059] [INFO ] [REMOTE ] REZI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:58:51.949550] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-26T20:58:51.965439] [INFO ] [REMOTE ] RERE: Full fetch complete (57463 records). [2025-09-26T20:58:51.965665] [DEBUG] [VALIDATOR ] RERE: Validating primary data. [2025-09-26T20:58:52.310251] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-26T20:58:52.412549] [DEBUG] [VALIDATOR ] RERE: All expected trading days are present. [2025-09-26T20:58:52.412664] [DEBUG] [VALIDATOR ] RERE: Primary data validation passed. [2025-09-26T20:58:52.413632] [INFO ] [MAIN ] RERE: Fetched primary data is valid. [2025-09-26T20:58:52.413728] [DEBUG] [LOCAL ] RERE: Saving primary data. [2025-09-26T20:58:52.415150] [DEBUG] [LOCAL ] RERE: Trimmed 57463 records to 41690 (keeping 200 days of data) [2025-09-26T20:58:52.657472] [DEBUG] [LOCAL ] RERE: Primary data saved (41690 records). [2025-09-26T20:58:52.657610] [INFO ] [MAIN ] RERE: Full history saved. [2025-09-26T20:58:52.657744] [INFO ] [MAIN ] Update Progress: 1789/2371 symbols completed. RERE took 34.8s. Estimated remaining: 1h 17m 42s. Rate: 7.5 symbols/min [2025-09-26T20:58:52.723957] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-03. [2025-09-26T20:58:52.838943] [INFO ] [MAIN ] RF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:58:52.902510] [DEBUG] [LOCAL ] RF: Loaded 54020 existing records from primary storage. [2025-09-26T20:58:52.902711] [INFO ] [MAIN ] RF: Loaded 54020 existing records. [2025-09-26T20:58:53.091178] [WARN ] [MAIN ] RF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:58:53.091454] [INFO ] [MAIN ] RF: Wiping existing primary data before full refresh. [2025-09-26T20:58:53.091503] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-09-26T20:58:53.092791] [DEBUG] [LOCAL ] RF: Deleted primary data file. [2025-09-26T20:58:53.092855] [INFO ] [MAIN ] RF: Starting full primary refresh. [2025-09-26T20:58:53.479359] [INFO ] [REMOTE ] RF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:58:53.512371] [INFO ] [REMOTE ] RF: Fetching primary data for 2024-12. [2025-09-26T20:58:53.512267] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-26T20:58:53.756496] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-26T20:58:54.311728] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-04. [2025-09-26T20:58:55.111695] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-02. [2025-09-26T20:58:55.324717] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-26T20:58:55.480244] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-26T20:58:55.911734] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-01. [2025-09-26T20:58:56.666541] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-26T20:58:56.711687] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-03. [2025-09-26T20:58:57.511698] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-05. [2025-09-26T20:58:57.702833] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-26T20:58:58.311691] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-02. [2025-09-26T20:58:58.522693] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-26T20:58:58.543513] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-26T20:58:59.111715] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-06. [2025-09-26T20:58:59.911710] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-04. [2025-09-26T20:59:00.184814] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-26T20:59:00.203747] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-26T20:59:00.711721] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-07. [2025-09-26T20:59:01.414371] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-26T20:59:01.511702] [INFO ] [REMOTE ] REZI: Fetching primary data for 2024-12. [2025-09-26T20:59:01.650931] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-26T20:59:02.311747] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-03. [2025-09-26T20:59:03.074372] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-26T20:59:03.111669] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-01. [2025-09-26T20:59:03.624452] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-26T20:59:03.911716] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-08. [2025-09-26T20:59:04.528466] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-26T20:59:04.711749] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-02. [2025-09-26T20:59:04.784101] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-26T20:59:05.511736] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-09. [2025-09-26T20:59:06.264393] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-26T20:59:06.311695] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-03. [2025-09-26T20:59:06.323881] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-26T20:59:06.327959] [INFO ] [REMOTE ] REX: Full fetch complete (21046 records). [2025-09-26T20:59:06.328048] [DEBUG] [VALIDATOR ] REX: Validating primary data. [2025-09-26T20:59:06.721905] [DEBUG] [VALIDATOR ] REX: All expected trading days are present. [2025-09-26T20:59:06.722009] [DEBUG] [VALIDATOR ] REX: Primary data validation passed. [2025-09-26T20:59:06.722488] [INFO ] [MAIN ] REX: Fetched primary data is valid. [2025-09-26T20:59:06.722530] [DEBUG] [LOCAL ] REX: Saving primary data. [2025-09-26T20:59:06.723191] [DEBUG] [LOCAL ] REX: Trimmed 21046 records to 14221 (keeping 200 days of data) [2025-09-26T20:59:06.824794] [DEBUG] [LOCAL ] REX: Primary data saved (14221 records). [2025-09-26T20:59:06.824947] [INFO ] [MAIN ] REX: Full history saved. [2025-09-26T20:59:06.825071] [INFO ] [MAIN ] Update Progress: 1790/2371 symbols completed. REX took 21.9s. Estimated remaining: 1h 17m 36s. Rate: 7.5 symbols/min [2025-09-26T20:59:07.006193] [INFO ] [MAIN ] RFI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:59:07.018498] [DEBUG] [LOCAL ] RFI: Loaded 10508 existing records from primary storage. [2025-09-26T20:59:07.018723] [INFO ] [MAIN ] RFI: Loaded 10508 existing records. [2025-09-26T20:59:07.117511] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-04. [2025-09-26T20:59:07.215119] [WARN ] [MAIN ] RFI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:59:07.215371] [INFO ] [MAIN ] RFI: Wiping existing primary data before full refresh. [2025-09-26T20:59:07.215454] [INFO ] [LOCAL ] RFI: Starting deletion of primary data. [2025-09-26T20:59:07.216019] [DEBUG] [LOCAL ] RFI: Deleted primary data file. [2025-09-26T20:59:07.216082] [INFO ] [MAIN ] RFI: Starting full primary refresh. [2025-09-26T20:59:07.604088] [INFO ] [REMOTE ] RFI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:59:07.911748] [INFO ] [REMOTE ] RFI: Fetching primary data for 2024-12. [2025-09-26T20:59:08.009830] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-26T20:59:08.711756] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-04. [2025-09-26T20:59:09.083712] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-26T20:59:09.242686] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-26T20:59:09.511734] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-05. [2025-09-26T20:59:10.311734] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-01. [2025-09-26T20:59:10.363410] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-26T20:59:11.111703] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-05. [2025-09-26T20:59:11.191436] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-26T20:59:11.230665] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-26T20:59:11.911715] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-06. [2025-09-26T20:59:12.711756] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-02. [2025-09-26T20:59:13.219105] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-26T20:59:13.511722] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-05. [2025-09-26T20:59:13.550212] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-26T20:59:13.730313] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-26T20:59:14.311722] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-07. [2025-09-26T20:59:15.054766] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-26T20:59:15.111763] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-06. [2025-09-26T20:59:15.911691] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-06. [2025-09-26T20:59:16.095125] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-26T20:59:16.699253] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-26T20:59:16.711638] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-07. [2025-09-26T20:59:17.511721] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-08. [2025-09-26T20:59:17.756767] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-26T20:59:18.320138] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-03. [2025-09-26T20:59:18.339760] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-26T20:59:19.111696] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-08. [2025-09-26T20:59:19.182238] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-26T20:59:19.309537] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-26T20:59:19.911730] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-04. [2025-09-26T20:59:20.711716] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-09. [2025-09-26T20:59:20.837622] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-26T20:59:20.896205] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-26T20:59:21.511770] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-09. [2025-09-26T20:59:22.311730] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-05. [2025-09-26T20:59:22.369515] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-26T20:59:22.379958] [INFO ] [REMOTE ] REXR: Full fetch complete (75112 records). [2025-09-26T20:59:22.380100] [DEBUG] [VALIDATOR ] REXR: Validating primary data. [2025-09-26T20:59:22.890017] [DEBUG] [VALIDATOR ] REXR: All expected trading days are present. [2025-09-26T20:59:22.890252] [DEBUG] [VALIDATOR ] REXR: Primary data validation passed. [2025-09-26T20:59:22.891867] [INFO ] [MAIN ] REXR: Fetched primary data is valid. [2025-09-26T20:59:22.891949] [DEBUG] [LOCAL ] REXR: Saving primary data. [2025-09-26T20:59:22.894097] [DEBUG] [LOCAL ] REXR: Trimmed 75112 records to 52852 (keeping 200 days of data) [2025-09-26T20:59:23.136590] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-07. [2025-09-26T20:59:23.269487] [DEBUG] [LOCAL ] REXR: Primary data saved (52852 records). [2025-09-26T20:59:23.269817] [INFO ] [MAIN ] REXR: Full history saved. [2025-09-26T20:59:23.270252] [INFO ] [MAIN ] Update Progress: 1791/2371 symbols completed. REXR took 36.8s. Estimated remaining: 1h 17m 30s. Rate: 7.5 symbols/min [2025-09-26T20:59:23.427355] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-26T20:59:23.431015] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-26T20:59:23.492706] [INFO ] [REMOTE ] REZI: Full fetch complete (65775 records). [2025-09-26T20:59:23.501892] [DEBUG] [VALIDATOR ] REZI: Validating primary data. [2025-09-26T20:59:23.519854] [INFO ] [MAIN ] RFL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:59:23.662722] [DEBUG] [LOCAL ] RFL: Loaded 11000 existing records from primary storage. [2025-09-26T20:59:23.685879] [INFO ] [MAIN ] RFL: Loaded 11000 existing records. [2025-09-26T20:59:23.914312] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-06. [2025-09-26T20:59:24.154775] [DEBUG] [VALIDATOR ] REZI: All expected trading days are present. [2025-09-26T20:59:24.154592] [WARN ] [MAIN ] RFL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:59:24.154997] [DEBUG] [VALIDATOR ] REZI: Primary data validation passed. [2025-09-26T20:59:24.157406] [INFO ] [MAIN ] RFL: Wiping existing primary data before full refresh. [2025-09-26T20:59:24.157153] [INFO ] [MAIN ] REZI: Fetched primary data is valid. [2025-09-26T20:59:24.157572] [DEBUG] [LOCAL ] REZI: Saving primary data. [2025-09-26T20:59:24.157715] [INFO ] [LOCAL ] RFL: Starting deletion of primary data. [2025-09-26T20:59:24.158410] [DEBUG] [LOCAL ] RFL: Deleted primary data file. [2025-09-26T20:59:24.158473] [INFO ] [MAIN ] RFL: Starting full primary refresh. [2025-09-26T20:59:24.268935] [DEBUG] [LOCAL ] REZI: Trimmed 65775 records to 47576 (keeping 200 days of data) [2025-09-26T20:59:24.677240] [INFO ] [REMOTE ] RFL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:59:24.739711] [INFO ] [REMOTE ] RFL: Fetching primary data for 2024-12. [2025-09-26T20:59:24.805729] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-26T20:59:24.879796] [DEBUG] [LOCAL ] REZI: Primary data saved (47576 records). [2025-09-26T20:59:24.879971] [INFO ] [MAIN ] REZI: Full history saved. [2025-09-26T20:59:24.881006] [INFO ] [MAIN ] Update Progress: 1792/2371 symbols completed. REZI took 33.9s. Estimated remaining: 1h 17m 20s. Rate: 7.5 symbols/min [2025-09-26T20:59:25.069630] [INFO ] [MAIN ] RFM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:59:25.077766] [DEBUG] [LOCAL ] RFM: Loaded 4168 existing records from primary storage. [2025-09-26T20:59:25.077905] [INFO ] [MAIN ] RFM: Loaded 4168 existing records. [2025-09-26T20:59:25.277550] [WARN ] [MAIN ] RFM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:59:25.278578] [INFO ] [MAIN ] RFM: Wiping existing primary data before full refresh. [2025-09-26T20:59:25.278681] [INFO ] [LOCAL ] RFM: Starting deletion of primary data. [2025-09-26T20:59:25.279061] [DEBUG] [LOCAL ] RFM: Deleted primary data file. [2025-09-26T20:59:25.279128] [INFO ] [MAIN ] RFM: Starting full primary refresh. [2025-09-26T20:59:25.436778] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-26T20:59:25.516966] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-07. [2025-09-26T20:59:25.561064] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-26T20:59:25.737875] [INFO ] [REMOTE ] RFM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:59:26.311716] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-01. [2025-09-26T20:59:26.479872] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-26T20:59:26.941385] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-26T20:59:27.111740] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-02. [2025-09-26T20:59:27.685285] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-26T20:59:27.911709] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-08. [2025-09-26T20:59:28.711724] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-08. [2025-09-26T20:59:28.756578] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-26T20:59:29.511743] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-03. [2025-09-26T20:59:30.117570] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-26T20:59:30.311728] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-09. [2025-09-26T20:59:30.710209] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-26T20:59:31.111724] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-09. [2025-09-26T20:59:31.133543] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-26T20:59:31.136799] [INFO ] [REMOTE ] RFI: Full fetch complete (15759 records). [2025-09-26T20:59:31.136940] [DEBUG] [VALIDATOR ] RFI: Validating primary data. [2025-09-26T20:59:31.521257] [DEBUG] [VALIDATOR ] RFI: All expected trading days are present. [2025-09-26T20:59:31.521343] [DEBUG] [VALIDATOR ] RFI: Primary data validation passed. [2025-09-26T20:59:31.521750] [INFO ] [MAIN ] RFI: Fetched primary data is valid. [2025-09-26T20:59:31.521812] [DEBUG] [LOCAL ] RFI: Saving primary data. [2025-09-26T20:59:31.522410] [DEBUG] [LOCAL ] RFI: Trimmed 15759 records to 10550 (keeping 200 days of data) [2025-09-26T20:59:31.591350] [DEBUG] [LOCAL ] RFI: Primary data saved (10550 records). [2025-09-26T20:59:31.591511] [INFO ] [MAIN ] RFI: Full history saved. [2025-09-26T20:59:31.591608] [INFO ] [MAIN ] Update Progress: 1793/2371 symbols completed. RFI took 24.8s. Estimated remaining: 1h 17m 12s. Rate: 7.5 symbols/min [2025-09-26T20:59:31.777427] [INFO ] [MAIN ] RFMZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:59:31.788626] [DEBUG] [LOCAL ] RFMZ: Loaded 8769 existing records from primary storage. [2025-09-26T20:59:31.788793] [INFO ] [MAIN ] RFMZ: Loaded 8769 existing records. [2025-09-26T20:59:31.916802] [INFO ] [REMOTE ] RFM: Fetching primary data for 2024-12. [2025-09-26T20:59:31.991228] [WARN ] [MAIN ] RFMZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:59:31.991570] [INFO ] [MAIN ] RFMZ: Wiping existing primary data before full refresh. [2025-09-26T20:59:31.991659] [INFO ] [LOCAL ] RFMZ: Starting deletion of primary data. [2025-09-26T20:59:31.992043] [DEBUG] [LOCAL ] RFMZ: Deleted primary data file. [2025-09-26T20:59:31.992101] [INFO ] [MAIN ] RFMZ: Starting full primary refresh. [2025-09-26T20:59:32.372446] [INFO ] [REMOTE ] RFMZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:59:32.711761] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-04. [2025-09-26T20:59:32.965815] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-26T20:59:32.977249] [INFO ] [REMOTE ] RF: Full fetch complete (77626 records). [2025-09-26T20:59:32.977474] [DEBUG] [VALIDATOR ] RF: Validating primary data. [2025-09-26T20:59:33.125940] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-26T20:59:33.533814] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-01. [2025-09-26T20:59:33.580906] [DEBUG] [VALIDATOR ] RF: All expected trading days are present. [2025-09-26T20:59:33.581098] [DEBUG] [VALIDATOR ] RF: Primary data validation passed. [2025-09-26T20:59:33.582936] [INFO ] [MAIN ] RF: Fetched primary data is valid. [2025-09-26T20:59:33.583138] [DEBUG] [LOCAL ] RF: Saving primary data. [2025-09-26T20:59:33.587409] [DEBUG] [LOCAL ] RF: Trimmed 77626 records to 54410 (keeping 200 days of data) [2025-09-26T20:59:33.711168] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-26T20:59:33.992291] [DEBUG] [LOCAL ] RF: Primary data saved (54410 records). [2025-09-26T20:59:33.992496] [INFO ] [MAIN ] RF: Full history saved. [2025-09-26T20:59:33.992705] [INFO ] [MAIN ] Update Progress: 1794/2371 symbols completed. RF took 41.3s. Estimated remaining: 1h 17m 2s. Rate: 7.5 symbols/min [2025-09-26T20:59:34.187224] [INFO ] [MAIN ] RGA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:59:34.216292] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-26T20:59:34.230522] [DEBUG] [LOCAL ] RGA: Loaded 30376 existing records from primary storage. [2025-09-26T20:59:34.230721] [INFO ] [MAIN ] RGA: Loaded 30376 existing records. [2025-09-26T20:59:34.316865] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2024-12. [2025-09-26T20:59:34.426418] [WARN ] [MAIN ] RGA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:59:34.426729] [INFO ] [MAIN ] RGA: Wiping existing primary data before full refresh. [2025-09-26T20:59:34.426788] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-09-26T20:59:34.427702] [DEBUG] [LOCAL ] RGA: Deleted primary data file. [2025-09-26T20:59:34.427770] [INFO ] [MAIN ] RGA: Starting full primary refresh. [2025-09-26T20:59:34.906063] [INFO ] [REMOTE ] RGA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:59:35.111739] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-02. [2025-09-26T20:59:35.529752] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-26T20:59:35.630096] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-26T20:59:35.911703] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-05. [2025-09-26T20:59:36.711768] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-03. [2025-09-26T20:59:36.797839] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-26T20:59:37.308414] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-26T20:59:37.511728] [INFO ] [REMOTE ] RGA: Fetching primary data for 2024-12. [2025-09-26T20:59:38.311722] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-06. [2025-09-26T20:59:39.016949] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-26T20:59:39.111745] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-04. [2025-09-26T20:59:39.457329] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-26T20:59:39.810547] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-26T20:59:39.911721] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-05. [2025-09-26T20:59:40.502110] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-26T20:59:40.711722] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-06. [2025-09-26T20:59:41.315128] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-26T20:59:41.511737] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-07. [2025-09-26T20:59:42.130206] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-26T20:59:42.311719] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-08. [2025-09-26T20:59:42.925276] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-26T20:59:43.111718] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-01. [2025-09-26T20:59:43.876477] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-26T20:59:43.911674] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-01. [2025-09-26T20:59:44.711734] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-07. [2025-09-26T20:59:45.336059] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-26T20:59:45.511712] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-09. [2025-09-26T20:59:45.617239] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-26T20:59:46.242781] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-26T20:59:46.244514] [INFO ] [REMOTE ] RFM: Full fetch complete (5916 records). [2025-09-26T20:59:46.244612] [DEBUG] [VALIDATOR ] RFM: Validating primary data. [2025-09-26T20:59:46.316940] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-08. [2025-09-26T20:59:46.655803] [DEBUG] [VALIDATOR ] RFM: All expected trading days are present. [2025-09-26T20:59:46.655893] [DEBUG] [VALIDATOR ] RFM: Primary data validation passed. [2025-09-26T20:59:46.656191] [INFO ] [MAIN ] RFM: Fetched primary data is valid. [2025-09-26T20:59:46.656261] [DEBUG] [LOCAL ] RFM: Saving primary data. [2025-09-26T20:59:46.656795] [DEBUG] [LOCAL ] RFM: Trimmed 5916 records to 4196 (keeping 200 days of data) [2025-09-26T20:59:46.684661] [DEBUG] [LOCAL ] RFM: Primary data saved (4196 records). [2025-09-26T20:59:46.684758] [INFO ] [MAIN ] RFM: Full history saved. [2025-09-26T20:59:46.684842] [INFO ] [MAIN ] Update Progress: 1795/2371 symbols completed. RFM took 21.8s. Estimated remaining: 1h 16m 56s. Rate: 7.5 symbols/min [2025-09-26T20:59:46.862369] [INFO ] [MAIN ] RGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:59:46.887907] [DEBUG] [LOCAL ] RGR: Loaded 20534 existing records from primary storage. [2025-09-26T20:59:46.888112] [INFO ] [MAIN ] RGR: Loaded 20534 existing records. [2025-09-26T20:59:47.094923] [WARN ] [MAIN ] RGR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:59:47.095273] [INFO ] [MAIN ] RGR: Wiping existing primary data before full refresh. [2025-09-26T20:59:47.095331] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-09-26T20:59:47.095877] [DEBUG] [LOCAL ] RGR: Deleted primary data file. [2025-09-26T20:59:47.095940] [INFO ] [MAIN ] RGR: Starting full primary refresh. [2025-09-26T20:59:47.118614] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-02. [2025-09-26T20:59:47.300924] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-26T20:59:47.512591] [INFO ] [REMOTE ] RGR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:59:47.911724] [INFO ] [REMOTE ] RGR: Fetching primary data for 2024-12. [2025-09-26T20:59:47.929562] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-26T20:59:48.711745] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-03. [2025-09-26T20:59:49.071471] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-26T20:59:49.473515] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-26T20:59:49.511682] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-04. [2025-09-26T20:59:50.311743] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-01. [2025-09-26T20:59:50.375923] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-26T20:59:51.111767] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-05. [2025-09-26T20:59:51.371062] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-26T20:59:51.893617] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-26T20:59:51.911684] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-06. [2025-09-26T20:59:52.692518] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-26T20:59:52.711713] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-07. [2025-09-26T20:59:53.499941] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-26T20:59:53.511698] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-08. [2025-09-26T20:59:54.196131] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-26T20:59:54.311717] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-02. [2025-09-26T20:59:55.111731] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-09. [2025-09-26T20:59:55.439399] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-26T20:59:55.611107] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-26T20:59:55.613729] [INFO ] [REMOTE ] RFMZ: Full fetch complete (12839 records). [2025-09-26T20:59:55.613805] [DEBUG] [VALIDATOR ] RFMZ: Validating primary data. [2025-09-26T20:59:55.916971] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-02. [2025-09-26T20:59:55.998322] [DEBUG] [VALIDATOR ] RFMZ: All expected trading days are present. [2025-09-26T20:59:55.998421] [DEBUG] [VALIDATOR ] RFMZ: Primary data validation passed. [2025-09-26T20:59:55.998848] [INFO ] [MAIN ] RFMZ: Fetched primary data is valid. [2025-09-26T20:59:55.998914] [DEBUG] [LOCAL ] RFMZ: Saving primary data. [2025-09-26T20:59:55.999429] [DEBUG] [LOCAL ] RFMZ: Trimmed 12839 records to 8822 (keeping 200 days of data) [2025-09-26T20:59:56.061857] [DEBUG] [LOCAL ] RFMZ: Primary data saved (8822 records). [2025-09-26T20:59:56.062012] [INFO ] [MAIN ] RFMZ: Full history saved. [2025-09-26T20:59:56.062116] [INFO ] [MAIN ] Update Progress: 1796/2371 symbols completed. RFMZ took 24.5s. Estimated remaining: 1h 16m 48s. Rate: 7.5 symbols/min [2025-09-26T20:59:56.236180] [INFO ] [MAIN ] RGT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T20:59:56.241882] [DEBUG] [LOCAL ] RGT: Loaded 2869 existing records from primary storage. [2025-09-26T20:59:56.241985] [INFO ] [MAIN ] RGT: Loaded 2869 existing records. [2025-09-26T20:59:56.424165] [WARN ] [MAIN ] RGT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T20:59:56.424439] [INFO ] [MAIN ] RGT: Wiping existing primary data before full refresh. [2025-09-26T20:59:56.424491] [INFO ] [LOCAL ] RGT: Starting deletion of primary data. [2025-09-26T20:59:56.424869] [DEBUG] [LOCAL ] RGT: Deleted primary data file. [2025-09-26T20:59:56.424933] [INFO ] [MAIN ] RGT: Starting full primary refresh. [2025-09-26T20:59:56.715023] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-09. [2025-09-26T20:59:56.820112] [INFO ] [REMOTE ] RGT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T20:59:57.511721] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-03. [2025-09-26T20:59:57.660972] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-26T20:59:57.767269] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-26T20:59:57.771438] [INFO ] [REMOTE ] RFL: Full fetch complete (12841 records). [2025-09-26T20:59:57.771515] [DEBUG] [VALIDATOR ] RFL: Validating primary data. [2025-09-26T20:59:58.135534] [DEBUG] [VALIDATOR ] RFL: All expected trading days are present. [2025-09-26T20:59:58.135637] [DEBUG] [VALIDATOR ] RFL: Primary data validation passed. [2025-09-26T20:59:58.136121] [INFO ] [MAIN ] RFL: Fetched primary data is valid. [2025-09-26T20:59:58.136167] [DEBUG] [LOCAL ] RFL: Saving primary data. [2025-09-26T20:59:58.136749] [DEBUG] [LOCAL ] RFL: Trimmed 12841 records to 11051 (keeping 200 days of data) [2025-09-26T20:59:58.208664] [DEBUG] [LOCAL ] RFL: Primary data saved (11051 records). [2025-09-26T20:59:58.208902] [INFO ] [MAIN ] RFL: Full history saved. [2025-09-26T20:59:58.209045] [INFO ] [MAIN ] Update Progress: 1797/2371 symbols completed. RFL took 34.9s. Estimated remaining: 1h 16m 38s. Rate: 7.5 symbols/min [2025-09-26T20:59:58.311739] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-03. [2025-09-26T20:59:58.600267] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-26T20:59:59.111753] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-04. [2025-09-26T20:59:59.903557] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-26T20:59:59.911577] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-04. [2025-09-26T21:00:00.302484] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-26T21:00:00.711746] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-05. [2025-09-26T21:00:01.476939] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-26T21:00:01.511797] [INFO ] [REMOTE ] RGT: Fetching primary data for 2024-12. [2025-09-26T21:00:02.298538] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-26T21:00:02.311666] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-06. [2025-09-26T21:00:02.345324] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-26T21:00:03.111754] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-05. [2025-09-26T21:00:03.689610] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-26T21:00:03.911740] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-07. [2025-09-26T21:00:04.709880] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-26T21:00:04.716772] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-01. [2025-09-26T21:00:05.196892] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-26T21:00:05.274185] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-26T21:00:05.511785] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-06. [2025-09-26T21:00:06.311724] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-02. [2025-09-26T21:00:06.876550] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-26T21:00:07.105844] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-26T21:00:07.111699] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-03. [2025-09-26T21:00:07.712705] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-26T21:00:07.911719] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-08. [2025-09-26T21:00:08.711764] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-04. [2025-09-26T21:00:09.065627] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-26T21:00:09.333699] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-26T21:00:09.511721] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-09. [2025-09-26T21:00:10.311785] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-07. [2025-09-26T21:00:10.721987] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-26T21:00:10.727010] [INFO ] [REMOTE ] RGR: Full fetch complete (28576 records). [2025-09-26T21:00:10.727121] [DEBUG] [VALIDATOR ] RGR: Validating primary data. [2025-09-26T21:00:11.126374] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-05. [2025-09-26T21:00:11.128560] [DEBUG] [VALIDATOR ] RGR: All expected trading days are present. [2025-09-26T21:00:11.128746] [DEBUG] [VALIDATOR ] RGR: Primary data validation passed. [2025-09-26T21:00:11.130841] [INFO ] [MAIN ] RGR: Fetched primary data is valid. [2025-09-26T21:00:11.130917] [DEBUG] [LOCAL ] RGR: Saving primary data. [2025-09-26T21:00:11.131949] [DEBUG] [LOCAL ] RGR: Trimmed 28576 records to 20706 (keeping 200 days of data) [2025-09-26T21:00:11.278673] [DEBUG] [LOCAL ] RGR: Primary data saved (20706 records). [2025-09-26T21:00:11.278870] [INFO ] [MAIN ] RGR: Full history saved. [2025-09-26T21:00:11.278974] [INFO ] [MAIN ] Update Progress: 1798/2371 symbols completed. RGR took 24.6s. Estimated remaining: 1h 16m 32s. Rate: 7.5 symbols/min [2025-09-26T21:00:11.746891] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-26T21:00:11.864228] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-26T21:00:11.911730] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-08. [2025-09-26T21:00:12.711765] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-06. [2025-09-26T21:00:13.290441] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-26T21:00:13.369965] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-26T21:00:13.511756] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-07. [2025-09-26T21:00:13.885187] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-26T21:00:14.311772] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-08. [2025-09-26T21:00:14.808342] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-26T21:00:15.111756] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-09. [2025-09-26T21:00:15.676962] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-26T21:00:15.678213] [INFO ] [REMOTE ] RGT: Full fetch complete (4164 records). [2025-09-26T21:00:15.678301] [DEBUG] [VALIDATOR ] RGT: Validating primary data. [2025-09-26T21:00:15.922733] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-09. [2025-09-26T21:00:16.071667] [DEBUG] [VALIDATOR ] RGT: All expected trading days are present. [2025-09-26T21:00:16.071828] [DEBUG] [VALIDATOR ] RGT: Primary data validation passed. [2025-09-26T21:00:16.072079] [INFO ] [MAIN ] RGT: Fetched primary data is valid. [2025-09-26T21:00:16.072185] [DEBUG] [LOCAL ] RGT: Saving primary data. [2025-09-26T21:00:16.073166] [DEBUG] [LOCAL ] RGT: Trimmed 4164 records to 2885 (keeping 200 days of data) [2025-09-26T21:00:16.102880] [DEBUG] [LOCAL ] RGT: Primary data saved (2885 records). [2025-09-26T21:00:16.103103] [INFO ] [MAIN ] RGT: Full history saved. [2025-09-26T21:00:16.103284] [INFO ] [MAIN ] Update Progress: 1799/2371 symbols completed. RGT took 20.0s. Estimated remaining: 1h 16m 23s. Rate: 7.5 symbols/min [2025-09-26T21:00:17.451678] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-26T21:00:17.458327] [INFO ] [REMOTE ] RGA: Full fetch complete (45655 records). [2025-09-26T21:00:17.458469] [DEBUG] [VALIDATOR ] RGA: Validating primary data. [2025-09-26T21:00:17.870135] [DEBUG] [VALIDATOR ] RGA: All expected trading days are present. [2025-09-26T21:00:17.870243] [DEBUG] [VALIDATOR ] RGA: Primary data validation passed. [2025-09-26T21:00:17.871523] [INFO ] [MAIN ] RGA: Fetched primary data is valid. [2025-09-26T21:00:17.871592] [DEBUG] [LOCAL ] RGA: Saving primary data. [2025-09-26T21:00:17.873024] [DEBUG] [LOCAL ] RGA: Trimmed 45655 records to 30535 (keeping 200 days of data) [2025-09-26T21:00:18.078457] [DEBUG] [LOCAL ] RGA: Primary data saved (30535 records). [2025-09-26T21:00:18.078709] [INFO ] [MAIN ] RGA: Full history saved. [2025-09-26T21:00:18.078885] [INFO ] [MAIN ] Update Progress: 1800/2371 symbols completed. RGA took 44.1s. Estimated remaining: 1h 16m 13s. Rate: 7.5 symbols/min [2025-09-26T21:00:18.692863] [INFO ] [MAIN ] RHP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:00:18.777189] [INFO ] [MAIN ] RHLD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:00:18.845861] [INFO ] [MAIN ] RH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:00:18.851276] [DEBUG] [LOCAL ] RHLD: No existing data file found in primary storage. [2025-09-26T21:00:18.852244] [WARN ] [MAIN ] RHLD: No existing data found, performing full refresh instead. [2025-09-26T21:00:18.853335] [INFO ] [MAIN ] RHLD: Wiping existing primary data before full refresh. [2025-09-26T21:00:18.853464] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-09-26T21:00:18.853677] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-09-26T21:00:18.853738] [INFO ] [MAIN ] RHLD: Starting full primary refresh. [2025-09-26T21:00:18.900526] [INFO ] [MAIN ] RHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:00:19.207941] [DEBUG] [LOCAL ] RHP: Loaded 42046 existing records from primary storage. [2025-09-26T21:00:19.233949] [INFO ] [MAIN ] RHP: Loaded 42046 existing records. [2025-09-26T21:00:19.300415] [DEBUG] [LOCAL ] RH: Loaded 47979 existing records from primary storage. [2025-09-26T21:00:19.340990] [DEBUG] [LOCAL ] RHI: Loaded 49628 existing records from primary storage. [2025-09-26T21:00:19.362604] [INFO ] [MAIN ] RH: Loaded 47979 existing records. [2025-09-26T21:00:19.368008] [INFO ] [MAIN ] RHI: Loaded 49628 existing records. [2025-09-26T21:00:19.537989] [INFO ] [REMOTE ] RHLD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:00:19.660468] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2024-12. [2025-09-26T21:00:19.969794] [WARN ] [MAIN ] RHI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:00:20.003502] [WARN ] [MAIN ] RHP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:00:20.018508] [INFO ] [MAIN ] RHI: Wiping existing primary data before full refresh. [2025-09-26T21:00:20.019157] [INFO ] [MAIN ] RHP: Wiping existing primary data before full refresh. [2025-09-26T21:00:20.038829] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-09-26T21:00:20.042618] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-09-26T21:00:20.043125] [WARN ] [MAIN ] RH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:00:20.043396] [INFO ] [MAIN ] RH: Wiping existing primary data before full refresh. [2025-09-26T21:00:20.043449] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-09-26T21:00:20.044402] [DEBUG] [LOCAL ] RHP: Deleted primary data file. [2025-09-26T21:00:20.044573] [INFO ] [MAIN ] RHP: Starting full primary refresh. [2025-09-26T21:00:20.050914] [DEBUG] [LOCAL ] RHI: Deleted primary data file. [2025-09-26T21:00:20.050990] [DEBUG] [LOCAL ] RH: Deleted primary data file. [2025-09-26T21:00:20.063874] [INFO ] [MAIN ] RH: Starting full primary refresh. [2025-09-26T21:00:20.063952] [INFO ] [MAIN ] RHI: Starting full primary refresh. [2025-09-26T21:00:20.267295] [DEBUG] [REMOTE ] RHLD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:00:20.383267] [WARN ] [REMOTE ] RHLD: No data returned for month 2024-12 [2025-09-26T21:00:20.383877] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2025-01. [2025-09-26T21:00:20.746926] [DEBUG] [REMOTE ] RHLD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:00:20.847357] [WARN ] [REMOTE ] RHLD: No data returned for month 2025-01 [2025-09-26T21:00:20.941027] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2025-02. [2025-09-26T21:00:21.153416] [INFO ] [REMOTE ] RHI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:00:21.199242] [INFO ] [REMOTE ] RHI: Fetching primary data for 2024-12. [2025-09-26T21:00:21.211155] [INFO ] [REMOTE ] RH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:00:21.243144] [INFO ] [REMOTE ] RH: Fetching primary data for 2024-12. [2025-09-26T21:00:21.292766] [INFO ] [REMOTE ] RHP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:00:21.293475] [INFO ] [REMOTE ] RHP: Fetching primary data for 2024-12. [2025-09-26T21:00:21.535107] [INFO ] [REMOTE ] RHLD: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-26T21:00:21.536447] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2025-03. [2025-09-26T21:00:22.684389] [INFO ] [REMOTE ] RHLD: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-26T21:00:22.693213] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2025-04. [2025-09-26T21:00:22.872219] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-26T21:00:22.921631] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-26T21:00:23.105962] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-26T21:00:23.116156] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-01. [2025-09-26T21:00:23.626134] [INFO ] [REMOTE ] RHLD: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-26T21:00:23.911719] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2025-05. [2025-09-26T21:00:24.250455] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-26T21:00:24.497221] [INFO ] [REMOTE ] RHLD: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-26T21:00:24.711728] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2025-06. [2025-09-26T21:00:25.512553] [INFO ] [REMOTE ] RHLD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-26T21:00:25.512078] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-01. [2025-09-26T21:00:26.311791] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-01. [2025-09-26T21:00:27.116957] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-02. [2025-09-26T21:00:27.132228] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-26T21:00:27.911724] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-02. [2025-09-26T21:00:28.033030] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-26T21:00:28.611156] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-26T21:00:28.711740] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2025-07. [2025-09-26T21:00:29.413433] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-26T21:00:29.511733] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-02. [2025-09-26T21:00:29.571681] [INFO ] [REMOTE ] RHLD: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-26T21:00:30.311799] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-03. [2025-09-26T21:00:30.967509] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-26T21:00:31.111746] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-03. [2025-09-26T21:00:31.911711] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2025-08. [2025-09-26T21:00:32.124192] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-26T21:00:32.701320] [INFO ] [REMOTE ] RHLD: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-26T21:00:32.711678] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2025-09. [2025-09-26T21:00:32.967637] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-26T21:00:33.511748] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-03. [2025-09-26T21:00:33.592628] [INFO ] [REMOTE ] RHLD: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-26T21:00:33.595097] [INFO ] [REMOTE ] RHLD: Full fetch complete (11675 records). [2025-09-26T21:00:33.595279] [DEBUG] [VALIDATOR ] RHLD: Validating primary data. [2025-09-26T21:00:33.791203] [WARN ] [VALIDATOR ] RHLD: Validation failed - insufficient historical data. Have 146 unique days, need 200 days [2025-09-26T21:00:33.791488] [FATAL] [MAIN ] RHLD: Fetched primary data is invalid. Refusing to save it. [2025-09-26T21:00:33.791560] [WARN ] [MAIN ] RHLD: Deleting existing primary and derivative data due to validation failure. [2025-09-26T21:00:33.791737] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-09-26T21:00:33.791840] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-09-26T21:00:33.791898] [INFO ] [LOCAL ] RHLD: Starting deletion of derivative data. [2025-09-26T21:00:33.791945] [DEBUG] [LOCAL ] RHLD: No derivative data file found to delete. [2025-09-26T21:00:33.792050] [INFO ] [MAIN ] Update Progress: 1801/2371 symbols completed. RHLD took 15.7s. Estimated remaining: 1h 16m 7s. Rate: 7.5 symbols/min [2025-09-26T21:00:33.986618] [INFO ] [MAIN ] RIG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:00:34.055528] [DEBUG] [LOCAL ] RIG: Loaded 54059 existing records from primary storage. [2025-09-26T21:00:34.055735] [INFO ] [MAIN ] RIG: Loaded 54059 existing records. [2025-09-26T21:00:34.261070] [WARN ] [MAIN ] RIG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:00:34.261361] [INFO ] [MAIN ] RIG: Wiping existing primary data before full refresh. [2025-09-26T21:00:34.261429] [INFO ] [LOCAL ] RIG: Starting deletion of primary data. [2025-09-26T21:00:34.262824] [DEBUG] [LOCAL ] RIG: Deleted primary data file. [2025-09-26T21:00:34.262924] [INFO ] [MAIN ] RIG: Starting full primary refresh. [2025-09-26T21:00:34.317068] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-04. [2025-09-26T21:00:34.668486] [INFO ] [REMOTE ] RIG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:00:35.111768] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-04. [2025-09-26T21:00:35.404775] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-26T21:00:35.911722] [INFO ] [REMOTE ] RIG: Fetching primary data for 2024-12. [2025-09-26T21:00:36.622105] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-26T21:00:36.706905] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T21:00:36.716386] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-05. [2025-09-26T21:00:37.511897] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-04. [2025-09-26T21:00:37.881239] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-26T21:00:38.113034] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-26T21:00:38.311749] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-06. [2025-09-26T21:00:39.111711] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-05. [2025-09-26T21:00:39.362613] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-26T21:00:39.911702] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-01. [2025-09-26T21:00:40.096764] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-26T21:00:40.711715] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-05. [2025-09-26T21:00:40.850974] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-26T21:00:41.511744] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-07. [2025-09-26T21:00:42.031320] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-26T21:00:42.311717] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-06. [2025-09-26T21:00:42.385400] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-26T21:00:43.111726] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-06. [2025-09-26T21:00:43.425236] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-26T21:00:43.572790] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-26T21:00:43.911723] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-08. [2025-09-26T21:00:44.651813] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-26T21:00:44.711711] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-02. [2025-09-26T21:00:45.511781] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-07. [2025-09-26T21:00:45.644272] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-26T21:00:46.311699] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-07. [2025-09-26T21:00:46.577297] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-26T21:00:47.111718] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-03. [2025-09-26T21:00:47.296611] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-26T21:00:47.914571] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-26T21:00:47.914916] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-08. [2025-09-26T21:00:48.711714] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-09. [2025-09-26T21:00:49.075777] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-26T21:00:49.511738] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-08. [2025-09-26T21:00:49.705847] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-26T21:00:50.311779] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-09. [2025-09-26T21:00:50.594283] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-26T21:00:50.603844] [INFO ] [REMOTE ] RH: Full fetch complete (65731 records). [2025-09-26T21:00:50.603994] [DEBUG] [VALIDATOR ] RH: Validating primary data. [2025-09-26T21:00:51.048980] [DEBUG] [VALIDATOR ] RH: All expected trading days are present. [2025-09-26T21:00:51.049126] [DEBUG] [VALIDATOR ] RH: Primary data validation passed. [2025-09-26T21:00:51.050241] [INFO ] [MAIN ] RH: Fetched primary data is valid. [2025-09-26T21:00:51.050316] [DEBUG] [LOCAL ] RH: Saving primary data. [2025-09-26T21:00:51.051911] [DEBUG] [LOCAL ] RH: Trimmed 65731 records to 48340 (keeping 200 days of data) [2025-09-26T21:00:51.134306] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-04. [2025-09-26T21:00:51.183427] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-26T21:00:51.414261] [DEBUG] [LOCAL ] RH: Primary data saved (48340 records). [2025-09-26T21:00:51.414434] [INFO ] [MAIN ] RH: Full history saved. [2025-09-26T21:00:51.414550] [INFO ] [MAIN ] Update Progress: 1802/2371 symbols completed. RH took 33.3s. Estimated remaining: 1h 16m 2s. Rate: 7.5 symbols/min [2025-09-26T21:00:51.601103] [INFO ] [MAIN ] RIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:00:51.656905] [DEBUG] [LOCAL ] RIO: Loaded 53783 existing records from primary storage. [2025-09-26T21:00:51.657099] [INFO ] [MAIN ] RIO: Loaded 53783 existing records. [2025-09-26T21:00:51.850902] [WARN ] [MAIN ] RIO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:00:51.851187] [INFO ] [MAIN ] RIO: Wiping existing primary data before full refresh. [2025-09-26T21:00:51.851239] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-09-26T21:00:51.852459] [DEBUG] [LOCAL ] RIO: Deleted primary data file. [2025-09-26T21:00:51.852533] [INFO ] [MAIN ] RIO: Starting full primary refresh. [2025-09-26T21:00:51.916381] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-09. [2025-09-26T21:00:52.272784] [INFO ] [REMOTE ] RIO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:00:52.279916] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-26T21:00:52.291586] [INFO ] [REMOTE ] RHI: Full fetch complete (69897 records). [2025-09-26T21:00:52.291874] [DEBUG] [VALIDATOR ] RHI: Validating primary data. [2025-09-26T21:00:52.713506] [INFO ] [REMOTE ] RIO: Fetching primary data for 2024-12. [2025-09-26T21:00:52.714227] [DEBUG] [VALIDATOR ] RHI: All expected trading days are present. [2025-09-26T21:00:52.715090] [DEBUG] [VALIDATOR ] RHI: Primary data validation passed. [2025-09-26T21:00:52.716168] [INFO ] [MAIN ] RHI: Fetched primary data is valid. [2025-09-26T21:00:52.716233] [DEBUG] [LOCAL ] RHI: Saving primary data. [2025-09-26T21:00:52.717957] [DEBUG] [LOCAL ] RHI: Trimmed 69897 records to 49995 (keeping 200 days of data) [2025-09-26T21:00:53.081808] [DEBUG] [LOCAL ] RHI: Primary data saved (49995 records). [2025-09-26T21:00:53.081993] [INFO ] [MAIN ] RHI: Full history saved. [2025-09-26T21:00:53.082097] [INFO ] [MAIN ] Update Progress: 1803/2371 symbols completed. RHI took 35.0s. Estimated remaining: 1h 15m 52s. Rate: 7.5 symbols/min [2025-09-26T21:00:53.274792] [INFO ] [MAIN ] RITM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:00:53.333675] [DEBUG] [LOCAL ] RITM: Loaded 53206 existing records from primary storage. [2025-09-26T21:00:53.333844] [INFO ] [MAIN ] RITM: Loaded 53206 existing records. [2025-09-26T21:00:53.482584] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-26T21:00:53.582873] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-05. [2025-09-26T21:00:53.591074] [WARN ] [MAIN ] RITM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:00:53.591911] [INFO ] [MAIN ] RITM: Wiping existing primary data before full refresh. [2025-09-26T21:00:53.593200] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-09-26T21:00:53.594296] [DEBUG] [LOCAL ] RITM: Deleted primary data file. [2025-09-26T21:00:53.594372] [INFO ] [MAIN ] RITM: Starting full primary refresh. [2025-09-26T21:00:53.749269] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-26T21:00:53.803504] [INFO ] [REMOTE ] RHP: Full fetch complete (58072 records). [2025-09-26T21:00:53.814478] [DEBUG] [VALIDATOR ] RHP: Validating primary data. [2025-09-26T21:00:54.226380] [INFO ] [REMOTE ] RITM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:00:54.326963] [INFO ] [REMOTE ] RITM: Fetching primary data for 2024-12. [2025-09-26T21:00:54.480829] [DEBUG] [VALIDATOR ] RHP: All expected trading days are present. [2025-09-26T21:00:54.480957] [DEBUG] [VALIDATOR ] RHP: Primary data validation passed. [2025-09-26T21:00:54.482140] [INFO ] [MAIN ] RHP: Fetched primary data is valid. [2025-09-26T21:00:54.482267] [DEBUG] [LOCAL ] RHP: Saving primary data. [2025-09-26T21:00:54.483896] [DEBUG] [LOCAL ] RHP: Trimmed 58072 records to 42305 (keeping 200 days of data) [2025-09-26T21:00:54.637005] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-26T21:00:54.803362] [DEBUG] [LOCAL ] RHP: Primary data saved (42305 records). [2025-09-26T21:00:54.803505] [INFO ] [MAIN ] RHP: Full history saved. [2025-09-26T21:00:54.803610] [INFO ] [MAIN ] Update Progress: 1804/2371 symbols completed. RHP took 36.7s. Estimated remaining: 1h 15m 42s. Rate: 7.5 symbols/min [2025-09-26T21:00:54.978756] [INFO ] [MAIN ] RIV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:00:54.995161] [DEBUG] [LOCAL ] RIV: Loaded 12070 existing records from primary storage. [2025-09-26T21:00:54.995331] [INFO ] [MAIN ] RIV: Loaded 12070 existing records. [2025-09-26T21:00:55.116819] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-01. [2025-09-26T21:00:55.184478] [WARN ] [MAIN ] RIV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:00:55.185216] [INFO ] [MAIN ] RIV: Wiping existing primary data before full refresh. [2025-09-26T21:00:55.185350] [INFO ] [LOCAL ] RIV: Starting deletion of primary data. [2025-09-26T21:00:55.185920] [DEBUG] [LOCAL ] RIV: Deleted primary data file. [2025-09-26T21:00:55.185983] [INFO ] [MAIN ] RIV: Starting full primary refresh. [2025-09-26T21:00:55.571558] [INFO ] [REMOTE ] RIV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:00:55.664933] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-26T21:00:55.911729] [INFO ] [REMOTE ] RIV: Fetching primary data for 2024-12. [2025-09-26T21:00:56.013062] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-26T21:00:56.711717] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-01. [2025-09-26T21:00:57.072834] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-26T21:00:57.259285] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-26T21:00:57.512230] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-02. [2025-09-26T21:00:58.311750] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-01. [2025-09-26T21:00:58.459511] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-26T21:00:59.111716] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-02. [2025-09-26T21:00:59.165228] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-26T21:00:59.362171] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-26T21:00:59.911778] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-02. [2025-09-26T21:01:00.711774] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-03. [2025-09-26T21:01:00.778624] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-26T21:01:01.121122] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-26T21:01:01.511757] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-03. [2025-09-26T21:01:02.311741] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-06. [2025-09-26T21:01:02.965761] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-26T21:01:03.111730] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-03. [2025-09-26T21:01:03.458729] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-26T21:01:03.911762] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-04. [2025-09-26T21:01:04.236727] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-26T21:01:04.239796] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-26T21:01:04.711777] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-04. [2025-09-26T21:01:05.511770] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-07. [2025-09-26T21:01:05.652632] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-26T21:01:06.030506] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-26T21:01:06.311759] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-05. [2025-09-26T21:01:07.111783] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-04. [2025-09-26T21:01:07.161902] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-26T21:01:07.350575] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-26T21:01:07.911755] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-05. [2025-09-26T21:01:08.711789] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-08. [2025-09-26T21:01:09.410160] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-26T21:01:09.511730] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-06. [2025-09-26T21:01:09.958296] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-26T21:01:10.295381] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-26T21:01:10.311692] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-07. [2025-09-26T21:01:10.568799] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-26T21:01:11.111711] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-06. [2025-09-26T21:01:11.264474] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-26T21:01:11.911742] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-09. [2025-09-26T21:01:12.711703] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-05. [2025-09-26T21:01:12.978124] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-26T21:01:13.511813] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-08. [2025-09-26T21:01:13.605823] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-26T21:01:13.619141] [INFO ] [REMOTE ] RIG: Full fetch complete (77706 records). [2025-09-26T21:01:13.619344] [DEBUG] [VALIDATOR ] RIG: Validating primary data. [2025-09-26T21:01:14.042742] [DEBUG] [VALIDATOR ] RIG: All expected trading days are present. [2025-09-26T21:01:14.042839] [DEBUG] [VALIDATOR ] RIG: Primary data validation passed. [2025-09-26T21:01:14.044017] [INFO ] [MAIN ] RIG: Fetched primary data is valid. [2025-09-26T21:01:14.044121] [DEBUG] [LOCAL ] RIG: Saving primary data. [2025-09-26T21:01:14.045786] [DEBUG] [LOCAL ] RIG: Trimmed 77706 records to 54449 (keeping 200 days of data) [2025-09-26T21:01:14.339559] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-07. [2025-09-26T21:01:14.406562] [DEBUG] [LOCAL ] RIG: Primary data saved (54449 records). [2025-09-26T21:01:14.407171] [INFO ] [MAIN ] RIG: Full history saved. [2025-09-26T21:01:14.407529] [INFO ] [MAIN ] Update Progress: 1805/2371 symbols completed. RIG took 40.6s. Estimated remaining: 1h 15m 38s. Rate: 7.5 symbols/min [2025-09-26T21:01:14.514541] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-26T21:01:14.614794] [INFO ] [MAIN ] RJF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:01:14.652994] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-26T21:01:14.717167] [DEBUG] [LOCAL ] RJF: Loaded 47455 existing records from primary storage. [2025-09-26T21:01:14.717570] [INFO ] [MAIN ] RJF: Loaded 47455 existing records. [2025-09-26T21:01:14.901603] [WARN ] [MAIN ] RJF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:01:14.902067] [INFO ] [MAIN ] RJF: Wiping existing primary data before full refresh. [2025-09-26T21:01:14.902122] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-09-26T21:01:14.904019] [DEBUG] [LOCAL ] RJF: Deleted primary data file. [2025-09-26T21:01:14.904132] [INFO ] [MAIN ] RJF: Starting full primary refresh. [2025-09-26T21:01:15.121725] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-09. [2025-09-26T21:01:15.287937] [INFO ] [REMOTE ] RJF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:01:15.911747] [INFO ] [REMOTE ] RJF: Fetching primary data for 2024-12. [2025-09-26T21:01:16.353719] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-26T21:01:16.358851] [INFO ] [REMOTE ] RIV: Full fetch complete (17375 records). [2025-09-26T21:01:16.358984] [DEBUG] [VALIDATOR ] RIV: Validating primary data. [2025-09-26T21:01:16.594360] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-26T21:01:16.712346] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-08. [2025-09-26T21:01:16.823783] [DEBUG] [VALIDATOR ] RIV: All expected trading days are present. [2025-09-26T21:01:16.823882] [DEBUG] [VALIDATOR ] RIV: Primary data validation passed. [2025-09-26T21:01:16.824397] [INFO ] [MAIN ] RIV: Fetched primary data is valid. [2025-09-26T21:01:16.824471] [DEBUG] [LOCAL ] RIV: Saving primary data. [2025-09-26T21:01:16.825177] [DEBUG] [LOCAL ] RIV: Trimmed 17375 records to 12193 (keeping 200 days of data) [2025-09-26T21:01:16.918361] [DEBUG] [LOCAL ] RIV: Primary data saved (12193 records). [2025-09-26T21:01:16.918538] [INFO ] [MAIN ] RIV: Full history saved. [2025-09-26T21:01:16.918742] [INFO ] [MAIN ] Update Progress: 1806/2371 symbols completed. RIV took 22.1s. Estimated remaining: 1h 15m 28s. Rate: 7.5 symbols/min [2025-09-26T21:01:17.100829] [INFO ] [MAIN ] RKT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:01:17.183231] [DEBUG] [LOCAL ] RKT: Loaded 54111 existing records from primary storage. [2025-09-26T21:01:17.183425] [INFO ] [MAIN ] RKT: Loaded 54111 existing records. [2025-09-26T21:01:17.382910] [WARN ] [MAIN ] RKT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:01:17.383400] [INFO ] [MAIN ] RKT: Wiping existing primary data before full refresh. [2025-09-26T21:01:17.383626] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-09-26T21:01:17.385210] [DEBUG] [LOCAL ] RKT: Deleted primary data file. [2025-09-26T21:01:17.411234] [INFO ] [MAIN ] RKT: Starting full primary refresh. [2025-09-26T21:01:17.478442] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-26T21:01:17.526751] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-06. [2025-09-26T21:01:17.818522] [INFO ] [REMOTE ] RKT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:01:18.311747] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-01. [2025-09-26T21:01:18.737054] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-26T21:01:19.111778] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-09. [2025-09-26T21:01:19.817190] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-26T21:01:19.911719] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-07. [2025-09-26T21:01:20.197874] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-26T21:01:20.711736] [INFO ] [REMOTE ] RKT: Fetching primary data for 2024-12. [2025-09-26T21:01:21.064811] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-26T21:01:21.075584] [INFO ] [REMOTE ] RITM: Full fetch complete (76553 records). [2025-09-26T21:01:21.075798] [DEBUG] [VALIDATOR ] RITM: Validating primary data. [2025-09-26T21:01:21.511488] [DEBUG] [VALIDATOR ] RITM: All expected trading days are present. [2025-09-26T21:01:21.511576] [DEBUG] [VALIDATOR ] RITM: Primary data validation passed. [2025-09-26T21:01:21.512784] [INFO ] [MAIN ] RITM: Fetched primary data is valid. [2025-09-26T21:01:21.512899] [DEBUG] [LOCAL ] RITM: Saving primary data. [2025-09-26T21:01:21.513184] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-02. [2025-09-26T21:01:21.515616] [DEBUG] [LOCAL ] RITM: Trimmed 76553 records to 53589 (keeping 200 days of data) [2025-09-26T21:01:21.891168] [DEBUG] [LOCAL ] RITM: Primary data saved (53589 records). [2025-09-26T21:01:21.891369] [INFO ] [MAIN ] RITM: Full history saved. [2025-09-26T21:01:21.891540] [INFO ] [MAIN ] Update Progress: 1807/2371 symbols completed. RITM took 28.8s. Estimated remaining: 1h 15m 19s. Rate: 7.5 symbols/min [2025-09-26T21:01:22.082025] [INFO ] [MAIN ] RL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:01:22.128802] [DEBUG] [LOCAL ] RL: Loaded 41765 existing records from primary storage. [2025-09-26T21:01:22.129024] [INFO ] [MAIN ] RL: Loaded 41765 existing records. [2025-09-26T21:01:22.301814] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-26T21:01:22.393763] [WARN ] [MAIN ] RL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:01:22.394694] [INFO ] [MAIN ] RL: Wiping existing primary data before full refresh. [2025-09-26T21:01:22.394786] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-09-26T21:01:22.395963] [DEBUG] [LOCAL ] RL: Deleted primary data file. [2025-09-26T21:01:22.396074] [INFO ] [MAIN ] RL: Starting full primary refresh. [2025-09-26T21:01:22.395890] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-08. [2025-09-26T21:01:22.817953] [INFO ] [REMOTE ] RL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:01:22.856442] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-26T21:01:23.111695] [INFO ] [REMOTE ] RL: Fetching primary data for 2024-12. [2025-09-26T21:01:23.301089] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-26T21:01:23.911724] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-03. [2025-09-26T21:01:24.694989] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-26T21:01:24.712409] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-01. [2025-09-26T21:01:24.745783] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-26T21:01:25.511693] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-09. [2025-09-26T21:01:25.619368] [DEBUG] [REMOTE ] RIO: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-09-26T21:01:25.619765] [WARN ] [REMOTE ] RIO: No data returned for month 2025-09 [2025-09-26T21:01:25.619879] [INFO ] [REMOTE ] RIO: Full fetch complete (69996 records). [2025-09-26T21:01:25.619959] [DEBUG] [VALIDATOR ] RIO: Validating primary data. [2025-09-26T21:01:25.621243] [FATAL] [VALIDATOR ] RIO: Data is stale - most recent date (2025-08-29) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T21:01:25.621376] [FATAL] [MAIN ] RIO: Fetched primary data is invalid. Refusing to save it. [2025-09-26T21:01:25.621474] [WARN ] [MAIN ] RIO: Deleting existing primary and derivative data due to validation failure. [2025-09-26T21:01:25.621568] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-09-26T21:01:25.621691] [DEBUG] [LOCAL ] RIO: No primary data file found to delete. [2025-09-26T21:01:25.621822] [INFO ] [LOCAL ] RIO: Starting deletion of derivative data. [2025-09-26T21:01:25.622414] [DEBUG] [LOCAL ] RIO: Deleted derivative data file. [2025-09-26T21:01:25.622527] [INFO ] [MAIN ] Update Progress: 1808/2371 symbols completed. RIO took 34.2s. Estimated remaining: 1h 15m 10s. Rate: 7.5 symbols/min [2025-09-26T21:01:25.813204] [INFO ] [MAIN ] RLI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:01:25.849552] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-26T21:01:25.898567] [DEBUG] [LOCAL ] RLI: Loaded 33549 existing records from primary storage. [2025-09-26T21:01:25.898839] [INFO ] [MAIN ] RLI: Loaded 33549 existing records. [2025-09-26T21:01:26.092422] [WARN ] [MAIN ] RLI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:01:26.092761] [INFO ] [MAIN ] RLI: Wiping existing primary data before full refresh. [2025-09-26T21:01:26.092820] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-09-26T21:01:26.093634] [DEBUG] [LOCAL ] RLI: Deleted primary data file. [2025-09-26T21:01:26.093740] [INFO ] [MAIN ] RLI: Starting full primary refresh. [2025-09-26T21:01:26.316878] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-01. [2025-09-26T21:01:26.485781] [INFO ] [REMOTE ] RLI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:01:26.704108] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-26T21:01:27.111728] [INFO ] [REMOTE ] RLI: Fetching primary data for 2024-12. [2025-09-26T21:01:27.911698] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-02. [2025-09-26T21:01:28.166064] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-26T21:01:28.186554] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-26T21:01:28.711732] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-04. [2025-09-26T21:01:29.511773] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-01. [2025-09-26T21:01:29.649071] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-26T21:01:30.311727] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-03. [2025-09-26T21:01:30.632457] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-26T21:01:30.687984] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-26T21:01:31.111748] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-02. [2025-09-26T21:01:31.911718] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-02. [2025-09-26T21:01:32.292991] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-26T21:01:32.711742] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-05. [2025-09-26T21:01:32.828132] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-26T21:01:33.252596] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-26T21:01:33.511746] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-03. [2025-09-26T21:01:34.319688] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-03. [2025-09-26T21:01:34.326894] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-26T21:01:35.111759] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-06. [2025-09-26T21:01:35.373748] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-26T21:01:35.725039] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-26T21:01:35.911724] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-04. [2025-09-26T21:01:36.623135] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-26T21:01:36.711741] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-04. [2025-09-26T21:01:37.516884] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-04. [2025-09-26T21:01:37.534737] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-26T21:01:38.311734] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-07. [2025-09-26T21:01:38.874518] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-26T21:01:39.111724] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-05. [2025-09-26T21:01:39.307831] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-26T21:01:39.806142] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-26T21:01:39.911736] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-08. [2025-09-26T21:01:40.518932] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-26T21:01:40.711754] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-05. [2025-09-26T21:01:41.511710] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-05. [2025-09-26T21:01:41.646181] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-26T21:01:42.040057] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-26T21:01:42.311735] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-06. [2025-09-26T21:01:43.111740] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-06. [2025-09-26T21:01:43.623306] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-26T21:01:43.911712] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-09. [2025-09-26T21:01:43.986328] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-26T21:01:44.461185] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-26T21:01:44.711751] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-06. [2025-09-26T21:01:45.511747] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-07. [2025-09-26T21:01:45.631729] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T21:01:45.641407] [INFO ] [REMOTE ] RJF: Full fetch complete (68404 records). [2025-09-26T21:01:45.641592] [DEBUG] [VALIDATOR ] RJF: Validating primary data. [2025-09-26T21:01:46.067366] [DEBUG] [VALIDATOR ] RJF: All expected trading days are present. [2025-09-26T21:01:46.067490] [DEBUG] [VALIDATOR ] RJF: Primary data validation passed. [2025-09-26T21:01:46.068483] [INFO ] [MAIN ] RJF: Fetched primary data is valid. [2025-09-26T21:01:46.068556] [DEBUG] [LOCAL ] RJF: Saving primary data. [2025-09-26T21:01:46.072287] [DEBUG] [LOCAL ] RJF: Trimmed 68404 records to 47804 (keeping 200 days of data) [2025-09-26T21:01:46.315733] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-07. [2025-09-26T21:01:46.380792] [DEBUG] [LOCAL ] RJF: Primary data saved (47804 records). [2025-09-26T21:01:46.380940] [INFO ] [MAIN ] RJF: Full history saved. [2025-09-26T21:01:46.381057] [INFO ] [MAIN ] Update Progress: 1809/2371 symbols completed. RJF took 32.0s. Estimated remaining: 1h 15m 6s. Rate: 7.5 symbols/min [2025-09-26T21:01:46.576755] [INFO ] [MAIN ] RLJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:01:46.628779] [DEBUG] [LOCAL ] RLJ: Loaded 48574 existing records from primary storage. [2025-09-26T21:01:46.628999] [INFO ] [MAIN ] RLJ: Loaded 48574 existing records. [2025-09-26T21:01:46.881709] [WARN ] [MAIN ] RLJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:01:46.883618] [INFO ] [MAIN ] RLJ: Wiping existing primary data before full refresh. [2025-09-26T21:01:46.886307] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-26T21:01:46.886564] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-09-26T21:01:46.900767] [DEBUG] [LOCAL ] RLJ: Deleted primary data file. [2025-09-26T21:01:46.900879] [INFO ] [MAIN ] RLJ: Starting full primary refresh. [2025-09-26T21:01:47.120011] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-07. [2025-09-26T21:01:47.177065] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-26T21:01:47.370754] [INFO ] [REMOTE ] RLJ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:01:47.825026] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-26T21:01:47.911732] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-08. [2025-09-26T21:01:48.711760] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-08. [2025-09-26T21:01:49.385792] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-26T21:01:49.511724] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2024-12. [2025-09-26T21:01:49.561911] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-26T21:01:50.047022] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-26T21:01:50.311753] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-09. [2025-09-26T21:01:51.111699] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-09. [2025-09-26T21:01:51.155858] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-26T21:01:51.700733] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-26T21:01:51.709805] [INFO ] [REMOTE ] RLI: Full fetch complete (46482 records). [2025-09-26T21:01:51.709990] [DEBUG] [VALIDATOR ] RLI: Validating primary data. [2025-09-26T21:01:51.915709] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-08. [2025-09-26T21:01:52.127414] [DEBUG] [VALIDATOR ] RLI: All expected trading days are present. [2025-09-26T21:01:52.127507] [DEBUG] [VALIDATOR ] RLI: Primary data validation passed. [2025-09-26T21:01:52.128339] [INFO ] [MAIN ] RLI: Fetched primary data is valid. [2025-09-26T21:01:52.128402] [DEBUG] [LOCAL ] RLI: Saving primary data. [2025-09-26T21:01:52.129712] [DEBUG] [LOCAL ] RLI: Trimmed 46482 records to 33794 (keeping 200 days of data) [2025-09-26T21:01:52.365982] [DEBUG] [LOCAL ] RLI: Primary data saved (33794 records). [2025-09-26T21:01:52.366213] [INFO ] [MAIN ] RLI: Full history saved. [2025-09-26T21:01:52.366325] [INFO ] [MAIN ] Update Progress: 1810/2371 symbols completed. RLI took 26.7s. Estimated remaining: 1h 14m 57s. Rate: 7.5 symbols/min [2025-09-26T21:01:52.558063] [INFO ] [MAIN ] RLTY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:01:52.572822] [DEBUG] [LOCAL ] RLTY: Loaded 11174 existing records from primary storage. [2025-09-26T21:01:52.572989] [INFO ] [MAIN ] RLTY: Loaded 11174 existing records. [2025-09-26T21:01:52.721597] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-01. [2025-09-26T21:01:52.785486] [WARN ] [MAIN ] RLTY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:01:52.786243] [INFO ] [MAIN ] RLTY: Wiping existing primary data before full refresh. [2025-09-26T21:01:52.786415] [INFO ] [LOCAL ] RLTY: Starting deletion of primary data. [2025-09-26T21:01:52.786870] [DEBUG] [LOCAL ] RLTY: Deleted primary data file. [2025-09-26T21:01:52.786961] [INFO ] [MAIN ] RLTY: Starting full primary refresh. [2025-09-26T21:01:52.891729] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-26T21:01:52.943589] [INFO ] [REMOTE ] RL: Full fetch complete (59858 records). [2025-09-26T21:01:52.959319] [DEBUG] [VALIDATOR ] RL: Validating primary data. [2025-09-26T21:01:53.467825] [INFO ] [REMOTE ] RLTY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:01:53.538879] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2024-12. [2025-09-26T21:01:53.693398] [DEBUG] [VALIDATOR ] RL: All expected trading days are present. [2025-09-26T21:01:53.693508] [DEBUG] [VALIDATOR ] RL: Primary data validation passed. [2025-09-26T21:01:53.694557] [INFO ] [MAIN ] RL: Fetched primary data is valid. [2025-09-26T21:01:53.694680] [DEBUG] [LOCAL ] RL: Saving primary data. [2025-09-26T21:01:53.696406] [DEBUG] [LOCAL ] RL: Trimmed 59858 records to 41998 (keeping 200 days of data) [2025-09-26T21:01:53.980741] [DEBUG] [LOCAL ] RL: Primary data saved (41998 records). [2025-09-26T21:01:53.980888] [INFO ] [MAIN ] RL: Full history saved. [2025-09-26T21:01:53.980983] [INFO ] [MAIN ] Update Progress: 1811/2371 symbols completed. RL took 32.1s. Estimated remaining: 1h 14m 47s. Rate: 7.5 symbols/min [2025-09-26T21:01:54.174866] [INFO ] [MAIN ] RLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:01:54.224230] [DEBUG] [LOCAL ] RLX: Loaded 48602 existing records from primary storage. [2025-09-26T21:01:54.224392] [INFO ] [MAIN ] RLX: Loaded 48602 existing records. [2025-09-26T21:01:54.424241] [WARN ] [MAIN ] RLX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:01:54.424778] [INFO ] [MAIN ] RLX: Wiping existing primary data before full refresh. [2025-09-26T21:01:54.424886] [INFO ] [LOCAL ] RLX: Starting deletion of primary data. [2025-09-26T21:01:54.440011] [DEBUG] [LOCAL ] RLX: Deleted primary data file. [2025-09-26T21:01:54.481194] [INFO ] [MAIN ] RLX: Starting full primary refresh. [2025-09-26T21:01:54.483401] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-26T21:01:54.551486] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-02. [2025-09-26T21:01:54.582247] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-08 (2.67 seconds). [2025-09-26T21:01:54.635502] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-26T21:01:54.939776] [INFO ] [REMOTE ] RLX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:01:55.111737] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-09. [2025-09-26T21:01:55.911724] [INFO ] [REMOTE ] RLX: Fetching primary data for 2024-12. [2025-09-26T21:01:56.263709] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-26T21:01:56.711775] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-01. [2025-09-26T21:01:57.350961] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-26T21:01:57.362516] [INFO ] [REMOTE ] RKT: Full fetch complete (77363 records). [2025-09-26T21:01:57.362751] [DEBUG] [VALIDATOR ] RKT: Validating primary data. [2025-09-26T21:01:57.518697] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-03. [2025-09-26T21:01:57.758067] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-26T21:01:57.828181] [DEBUG] [VALIDATOR ] RKT: All expected trading days are present. [2025-09-26T21:01:57.828313] [DEBUG] [VALIDATOR ] RKT: Primary data validation passed. [2025-09-26T21:01:57.829625] [INFO ] [MAIN ] RKT: Fetched primary data is valid. [2025-09-26T21:01:57.829853] [DEBUG] [LOCAL ] RKT: Saving primary data. [2025-09-26T21:01:57.848092] [DEBUG] [LOCAL ] RKT: Trimmed 77363 records to 54501 (keeping 200 days of data) [2025-09-26T21:01:57.866342] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-26T21:01:58.219635] [DEBUG] [LOCAL ] RKT: Primary data saved (54501 records). [2025-09-26T21:01:58.219870] [INFO ] [MAIN ] RKT: Full history saved. [2025-09-26T21:01:58.219980] [INFO ] [MAIN ] Update Progress: 1812/2371 symbols completed. RKT took 41.3s. Estimated remaining: 1h 14m 38s. Rate: 7.5 symbols/min [2025-09-26T21:01:58.321492] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-01. [2025-09-26T21:01:58.398772] [INFO ] [MAIN ] RM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:01:58.409582] [DEBUG] [LOCAL ] RM: Loaded 7695 existing records from primary storage. [2025-09-26T21:01:58.409788] [INFO ] [MAIN ] RM: Loaded 7695 existing records. [2025-09-26T21:01:58.604150] [WARN ] [MAIN ] RM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:01:58.604619] [INFO ] [MAIN ] RM: Wiping existing primary data before full refresh. [2025-09-26T21:01:58.604706] [INFO ] [LOCAL ] RM: Starting deletion of primary data. [2025-09-26T21:01:58.605244] [DEBUG] [LOCAL ] RM: Deleted primary data file. [2025-09-26T21:01:58.605305] [INFO ] [MAIN ] RM: Starting full primary refresh. [2025-09-26T21:01:59.000029] [INFO ] [REMOTE ] RM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:01:59.111775] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-02. [2025-09-26T21:01:59.374257] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-26T21:01:59.911728] [INFO ] [REMOTE ] RM: Fetching primary data for 2024-12. [2025-09-26T21:02:00.115835] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-26T21:02:00.171325] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-26T21:02:00.657494] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-26T21:02:00.711817] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-02. [2025-09-26T21:02:01.511791] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-03. [2025-09-26T21:02:02.311792] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-04. [2025-09-26T21:02:02.465318] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-26T21:02:02.593894] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-26T21:02:03.111765] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-03. [2025-09-26T21:02:03.911731] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-04. [2025-09-26T21:02:04.043897] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-26T21:02:04.542079] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-26T21:02:04.711747] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-05. [2025-09-26T21:02:04.915827] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-26T21:02:05.511743] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-04. [2025-09-26T21:02:05.547318] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-26T21:02:06.311731] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-01. [2025-09-26T21:02:07.111738] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-05. [2025-09-26T21:02:07.196380] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-26T21:02:07.339574] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-26T21:02:07.911734] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-06. [2025-09-26T21:02:08.711737] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-02. [2025-09-26T21:02:08.734698] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-26T21:02:09.032082] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-26T21:02:09.511715] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-06. [2025-09-26T21:02:09.729574] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-26T21:02:10.311809] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-03. [2025-09-26T21:02:11.111717] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-05. [2025-09-26T21:02:11.127945] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-26T21:02:11.301232] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-26T21:02:11.911769] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-07. [2025-09-26T21:02:12.711780] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-04. [2025-09-26T21:02:12.852422] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-26T21:02:13.471948] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-26T21:02:13.490157] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-26T21:02:13.511718] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-08. [2025-09-26T21:02:14.311767] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-05. [2025-09-26T21:02:15.111740] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-06. [2025-09-26T21:02:15.231800] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-26T21:02:15.380599] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-26T21:02:15.911734] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-07. [2025-09-26T21:02:16.711725] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-09. [2025-09-26T21:02:16.862570] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-26T21:02:16.902079] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-26T21:02:17.511733] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-08. [2025-09-26T21:02:18.272788] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-26T21:02:18.282099] [INFO ] [REMOTE ] RLJ: Full fetch complete (69196 records). [2025-09-26T21:02:18.282263] [DEBUG] [VALIDATOR ] RLJ: Validating primary data. [2025-09-26T21:02:18.317146] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-07. [2025-09-26T21:02:18.398111] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-26T21:02:18.747852] [DEBUG] [VALIDATOR ] RLJ: All expected trading days are present. [2025-09-26T21:02:18.747955] [DEBUG] [VALIDATOR ] RLJ: Primary data validation passed. [2025-09-26T21:02:18.748988] [INFO ] [MAIN ] RLJ: Fetched primary data is valid. [2025-09-26T21:02:18.749071] [DEBUG] [LOCAL ] RLJ: Saving primary data. [2025-09-26T21:02:18.750746] [DEBUG] [LOCAL ] RLJ: Trimmed 69196 records to 48922 (keeping 200 days of data) [2025-09-26T21:02:19.061799] [DEBUG] [LOCAL ] RLJ: Primary data saved (48922 records). [2025-09-26T21:02:19.062616] [INFO ] [MAIN ] RLJ: Full history saved. [2025-09-26T21:02:19.063018] [INFO ] [MAIN ] Update Progress: 1813/2371 symbols completed. RLJ took 32.7s. Estimated remaining: 1h 14m 34s. Rate: 7.5 symbols/min [2025-09-26T21:02:19.116880] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-09. [2025-09-26T21:02:19.271379] [INFO ] [MAIN ] RMAX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:02:19.296085] [DEBUG] [LOCAL ] RMAX: Loaded 21993 existing records from primary storage. [2025-09-26T21:02:19.296254] [INFO ] [MAIN ] RMAX: Loaded 21993 existing records. [2025-09-26T21:02:19.540112] [WARN ] [MAIN ] RMAX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:02:19.540513] [INFO ] [MAIN ] RMAX: Wiping existing primary data before full refresh. [2025-09-26T21:02:19.540616] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-09-26T21:02:19.541290] [DEBUG] [LOCAL ] RMAX: Deleted primary data file. [2025-09-26T21:02:19.541355] [INFO ] [MAIN ] RMAX: Starting full primary refresh. [2025-09-26T21:02:19.925424] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-06. [2025-09-26T21:02:19.972003] [INFO ] [REMOTE ] RMAX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:02:20.038891] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-26T21:02:20.042310] [INFO ] [REMOTE ] RLTY: Full fetch complete (18176 records). [2025-09-26T21:02:20.042422] [DEBUG] [VALIDATOR ] RLTY: Validating primary data. [2025-09-26T21:02:20.448949] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-26T21:02:20.554053] [DEBUG] [VALIDATOR ] RLTY: All expected trading days are present. [2025-09-26T21:02:20.554152] [DEBUG] [VALIDATOR ] RLTY: Primary data validation passed. [2025-09-26T21:02:20.554596] [INFO ] [MAIN ] RLTY: Fetched primary data is valid. [2025-09-26T21:02:20.554664] [DEBUG] [LOCAL ] RLTY: Saving primary data. [2025-09-26T21:02:20.555446] [DEBUG] [LOCAL ] RLTY: Trimmed 18176 records to 11255 (keeping 200 days of data) [2025-09-26T21:02:20.641013] [DEBUG] [LOCAL ] RLTY: Primary data saved (11255 records). [2025-09-26T21:02:20.641175] [INFO ] [MAIN ] RLTY: Full history saved. [2025-09-26T21:02:20.641274] [INFO ] [MAIN ] Update Progress: 1814/2371 symbols completed. RLTY took 28.3s. Estimated remaining: 1h 14m 24s. Rate: 7.5 symbols/min [2025-09-26T21:02:20.715099] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-08. [2025-09-26T21:02:20.773846] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-26T21:02:20.857209] [INFO ] [MAIN ] RMD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:02:20.905209] [DEBUG] [LOCAL ] RMD: Loaded 42571 existing records from primary storage. [2025-09-26T21:02:20.905400] [INFO ] [MAIN ] RMD: Loaded 42571 existing records. [2025-09-26T21:02:21.135380] [WARN ] [MAIN ] RMD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:02:21.135741] [INFO ] [MAIN ] RMD: Wiping existing primary data before full refresh. [2025-09-26T21:02:21.135812] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-09-26T21:02:21.137364] [DEBUG] [LOCAL ] RMD: Deleted primary data file. [2025-09-26T21:02:21.137433] [INFO ] [MAIN ] RMD: Starting full primary refresh. [2025-09-26T21:02:21.520969] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2024-12. [2025-09-26T21:02:21.571946] [INFO ] [REMOTE ] RMD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:02:22.311698] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-07. [2025-09-26T21:02:22.359716] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-26T21:02:22.626059] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-26T21:02:23.111717] [INFO ] [REMOTE ] RMD: Fetching primary data for 2024-12. [2025-09-26T21:02:23.163287] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-26T21:02:23.911716] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-01. [2025-09-26T21:02:24.531551] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-26T21:02:24.711725] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-08. [2025-09-26T21:02:25.047104] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-26T21:02:25.511742] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-02. [2025-09-26T21:02:25.573968] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-26T21:02:26.311743] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-01. [2025-09-26T21:02:26.479961] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-26T21:02:27.111750] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-03. [2025-09-26T21:02:27.895154] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-26T21:02:27.911670] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-02. [2025-09-26T21:02:27.944324] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-26T21:02:28.711751] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-04. [2025-09-26T21:02:29.511736] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-09. [2025-09-26T21:02:29.594618] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-26T21:02:29.636563] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-26T21:02:30.311779] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-09. [2025-09-26T21:02:30.964739] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-26T21:02:30.974866] [INFO ] [REMOTE ] RLX: Full fetch complete (70355 records). [2025-09-26T21:02:30.975020] [DEBUG] [VALIDATOR ] RLX: Validating primary data. [2025-09-26T21:02:31.116414] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-03. [2025-09-26T21:02:31.148501] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-26T21:02:31.253206] [INFO ] [REMOTE ] RM: Full fetch complete (11559 records). [2025-09-26T21:02:31.295571] [DEBUG] [VALIDATOR ] RM: Validating primary data. [2025-09-26T21:02:31.620670] [DEBUG] [VALIDATOR ] RLX: All expected trading days are present. [2025-09-26T21:02:31.636180] [DEBUG] [VALIDATOR ] RLX: Primary data validation passed. [2025-09-26T21:02:31.672948] [INFO ] [MAIN ] RLX: Fetched primary data is valid. [2025-09-26T21:02:31.675501] [DEBUG] [LOCAL ] RLX: Saving primary data. [2025-09-26T21:02:31.819235] [DEBUG] [LOCAL ] RLX: Trimmed 70355 records to 48987 (keeping 200 days of data) [2025-09-26T21:02:31.926870] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-05. [2025-09-26T21:02:32.002985] [DEBUG] [VALIDATOR ] RM: All expected trading days are present. [2025-09-26T21:02:32.016691] [DEBUG] [VALIDATOR ] RM: Primary data validation passed. [2025-09-26T21:02:32.020708] [INFO ] [MAIN ] RM: Fetched primary data is valid. [2025-09-26T21:02:32.021033] [DEBUG] [LOCAL ] RM: Saving primary data. [2025-09-26T21:02:32.023007] [DEBUG] [LOCAL ] RM: Trimmed 11559 records to 7734 (keeping 200 days of data) [2025-09-26T21:02:32.094031] [DEBUG] [LOCAL ] RM: Primary data saved (7734 records). [2025-09-26T21:02:32.094186] [INFO ] [MAIN ] RM: Full history saved. [2025-09-26T21:02:32.094296] [INFO ] [MAIN ] Update Progress: 1815/2371 symbols completed. RM took 33.9s. Estimated remaining: 1h 14m 17s. Rate: 7.5 symbols/min [2025-09-26T21:02:32.418259] [INFO ] [MAIN ] RMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:02:32.479418] [DEBUG] [LOCAL ] RMI: Loaded 4702 existing records from primary storage. [2025-09-26T21:02:32.480766] [INFO ] [MAIN ] RMI: Loaded 4702 existing records. [2025-09-26T21:02:32.548097] [DEBUG] [LOCAL ] RLX: Primary data saved (48987 records). [2025-09-26T21:02:32.571776] [INFO ] [MAIN ] RLX: Full history saved. [2025-09-26T21:02:32.577199] [INFO ] [MAIN ] Update Progress: 1816/2371 symbols completed. RLX took 38.6s. Estimated remaining: 1h 14m 7s. Rate: 7.5 symbols/min [2025-09-26T21:02:32.808106] [WARN ] [MAIN ] RMI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:02:32.853480] [INFO ] [MAIN ] RMI: Wiping existing primary data before full refresh. [2025-09-26T21:02:32.887275] [INFO ] [MAIN ] RMM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:02:32.885623] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-09-26T21:02:32.888267] [DEBUG] [LOCAL ] RMI: Deleted primary data file. [2025-09-26T21:02:32.888456] [INFO ] [MAIN ] RMI: Starting full primary refresh. [2025-09-26T21:02:33.038974] [DEBUG] [LOCAL ] RMM: Loaded 10537 existing records from primary storage. [2025-09-26T21:02:33.097611] [INFO ] [MAIN ] RMM: Loaded 10537 existing records. [2025-09-26T21:02:33.261368] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-26T21:02:33.328396] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-06. [2025-09-26T21:02:33.622307] [WARN ] [MAIN ] RMM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:02:33.636014] [INFO ] [MAIN ] RMM: Wiping existing primary data before full refresh. [2025-09-26T21:02:33.642544] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-09-26T21:02:33.642257] [INFO ] [REMOTE ] RMI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:02:33.643240] [INFO ] [REMOTE ] RMI: Fetching primary data for 2024-12. [2025-09-26T21:02:33.635857] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-09-26T21:02:33.643310] [DEBUG] [LOCAL ] RMM: Deleted primary data file. [2025-09-26T21:02:33.654281] [INFO ] [MAIN ] RMM: Starting full primary refresh. [2025-09-26T21:02:34.073453] [INFO ] [REMOTE ] RMM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:02:34.311803] [INFO ] [REMOTE ] RMM: Fetching primary data for 2024-12. [2025-09-26T21:02:34.353788] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-26T21:02:34.596555] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-26T21:02:34.846864] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-26T21:02:35.111782] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-01. [2025-09-26T21:02:35.771511] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-26T21:02:35.911779] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-02. [2025-09-26T21:02:36.406445] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-26T21:02:36.711796] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-04. [2025-09-26T21:02:37.511762] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-03. [2025-09-26T21:02:38.234441] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-26T21:02:38.311709] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-01. [2025-09-26T21:02:38.563585] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-26T21:02:39.095591] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-26T21:02:39.111735] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-07. [2025-09-26T21:02:39.911727] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-02. [2025-09-26T21:02:40.235862] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-26T21:02:40.711749] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-05. [2025-09-26T21:02:40.744159] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-26T21:02:41.511756] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-03. [2025-09-26T21:02:42.300357] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-26T21:02:42.311723] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-08. [2025-09-26T21:02:42.418831] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-26T21:02:43.111731] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-06. [2025-09-26T21:02:43.208298] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-26T21:02:43.911744] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-04. [2025-09-26T21:02:44.562755] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-26T21:02:44.569247] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-26T21:02:44.711769] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-04. [2025-09-26T21:02:45.511757] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-07. [2025-09-26T21:02:45.578068] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-26T21:02:46.311739] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-05. [2025-09-26T21:02:47.054608] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-26T21:02:47.091805] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-26T21:02:47.111667] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-08. [2025-09-26T21:02:47.911731] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-05. [2025-09-26T21:02:48.666238] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-26T21:02:48.711699] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-06. [2025-09-26T21:02:48.796420] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-26T21:02:49.226758] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-26T21:02:49.511729] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-09. [2025-09-26T21:02:50.311779] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-09. [2025-09-26T21:02:50.582556] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-26T21:02:50.587807] [INFO ] [REMOTE ] RMAX: Full fetch complete (29702 records). [2025-09-26T21:02:50.588034] [DEBUG] [VALIDATOR ] RMAX: Validating primary data. [2025-09-26T21:02:50.992601] [DEBUG] [VALIDATOR ] RMAX: All expected trading days are present. [2025-09-26T21:02:50.992722] [DEBUG] [VALIDATOR ] RMAX: Primary data validation passed. [2025-09-26T21:02:50.993428] [INFO ] [MAIN ] RMAX: Fetched primary data is valid. [2025-09-26T21:02:50.993500] [DEBUG] [LOCAL ] RMAX: Saving primary data. [2025-09-26T21:02:50.994446] [DEBUG] [LOCAL ] RMAX: Trimmed 29702 records to 22121 (keeping 200 days of data) [2025-09-26T21:02:51.112504] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-07. [2025-09-26T21:02:51.134602] [DEBUG] [LOCAL ] RMAX: Primary data saved (22121 records). [2025-09-26T21:02:51.134777] [INFO ] [MAIN ] RMAX: Full history saved. [2025-09-26T21:02:51.134888] [INFO ] [MAIN ] Update Progress: 1817/2371 symbols completed. RMAX took 32.1s. Estimated remaining: 1h 14m 2s. Rate: 7.5 symbols/min [2025-09-26T21:02:51.325627] [INFO ] [MAIN ] RMMZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:02:51.333458] [DEBUG] [LOCAL ] RMMZ: Loaded 4858 existing records from primary storage. [2025-09-26T21:02:51.333589] [INFO ] [MAIN ] RMMZ: Loaded 4858 existing records. [2025-09-26T21:02:51.587927] [WARN ] [MAIN ] RMMZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:02:51.588636] [INFO ] [MAIN ] RMMZ: Wiping existing primary data before full refresh. [2025-09-26T21:02:51.588742] [INFO ] [LOCAL ] RMMZ: Starting deletion of primary data. [2025-09-26T21:02:51.589186] [DEBUG] [LOCAL ] RMMZ: Deleted primary data file. [2025-09-26T21:02:51.589257] [INFO ] [MAIN ] RMMZ: Starting full primary refresh. [2025-09-26T21:02:51.885673] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-26T21:02:51.922899] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-06. [2025-09-26T21:02:52.014867] [INFO ] [REMOTE ] RMMZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:02:52.039023] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-26T21:02:52.047098] [INFO ] [REMOTE ] RMD: Full fetch complete (61063 records). [2025-09-26T21:02:52.047223] [DEBUG] [VALIDATOR ] RMD: Validating primary data. [2025-09-26T21:02:52.463225] [DEBUG] [VALIDATOR ] RMD: All expected trading days are present. [2025-09-26T21:02:52.463327] [DEBUG] [VALIDATOR ] RMD: Primary data validation passed. [2025-09-26T21:02:52.465194] [INFO ] [MAIN ] RMD: Fetched primary data is valid. [2025-09-26T21:02:52.465264] [DEBUG] [LOCAL ] RMD: Saving primary data. [2025-09-26T21:02:52.466826] [DEBUG] [LOCAL ] RMD: Trimmed 61063 records to 42855 (keeping 200 days of data) [2025-09-26T21:02:52.712077] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2024-12. [2025-09-26T21:02:52.745232] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-26T21:02:52.771399] [DEBUG] [LOCAL ] RMD: Primary data saved (42855 records). [2025-09-26T21:02:52.771565] [INFO ] [MAIN ] RMD: Full history saved. [2025-09-26T21:02:52.771701] [INFO ] [MAIN ] Update Progress: 1818/2371 symbols completed. RMD took 32.1s. Estimated remaining: 1h 13m 52s. Rate: 7.5 symbols/min [2025-09-26T21:02:52.953455] [INFO ] [MAIN ] RMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:02:52.972936] [DEBUG] [LOCAL ] RMT: Loaded 17611 existing records from primary storage. [2025-09-26T21:02:52.973115] [INFO ] [MAIN ] RMT: Loaded 17611 existing records. [2025-09-26T21:02:53.180977] [WARN ] [MAIN ] RMT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:02:53.181244] [INFO ] [MAIN ] RMT: Wiping existing primary data before full refresh. [2025-09-26T21:02:53.181294] [INFO ] [LOCAL ] RMT: Starting deletion of primary data. [2025-09-26T21:02:53.182073] [DEBUG] [LOCAL ] RMT: Deleted primary data file. [2025-09-26T21:02:53.182144] [INFO ] [MAIN ] RMT: Starting full primary refresh. [2025-09-26T21:02:53.309689] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-26T21:02:53.523440] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-01. [2025-09-26T21:02:53.570156] [INFO ] [REMOTE ] RMT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:02:54.258958] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-26T21:02:54.311734] [INFO ] [REMOTE ] RMT: Fetching primary data for 2024-12. [2025-09-26T21:02:55.111700] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-02. [2025-09-26T21:02:55.433479] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-26T21:02:55.679076] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-26T21:02:55.911726] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-01. [2025-09-26T21:02:56.711695] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-08. [2025-09-26T21:02:56.954928] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-26T21:02:57.460603] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-26T21:02:57.511704] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-09. [2025-09-26T21:02:58.159066] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-26T21:02:58.160999] [INFO ] [REMOTE ] RMI: Full fetch complete (6330 records). [2025-09-26T21:02:58.161075] [DEBUG] [VALIDATOR ] RMI: Validating primary data. [2025-09-26T21:02:58.316859] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-03. [2025-09-26T21:02:58.550171] [DEBUG] [VALIDATOR ] RMI: All expected trading days are present. [2025-09-26T21:02:58.550254] [DEBUG] [VALIDATOR ] RMI: Primary data validation passed. [2025-09-26T21:02:58.550429] [INFO ] [MAIN ] RMI: Fetched primary data is valid. [2025-09-26T21:02:58.550469] [DEBUG] [LOCAL ] RMI: Saving primary data. [2025-09-26T21:02:58.550911] [DEBUG] [LOCAL ] RMI: Trimmed 6330 records to 4716 (keeping 200 days of data) [2025-09-26T21:02:58.580746] [DEBUG] [LOCAL ] RMI: Primary data saved (4716 records). [2025-09-26T21:02:58.580877] [INFO ] [MAIN ] RMI: Full history saved. [2025-09-26T21:02:58.580973] [INFO ] [MAIN ] Update Progress: 1819/2371 symbols completed. RMI took 26.5s. Estimated remaining: 1h 13m 43s. Rate: 7.5 symbols/min [2025-09-26T21:02:58.754688] [INFO ] [MAIN ] RNG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:02:58.801340] [DEBUG] [LOCAL ] RNG: Loaded 48491 existing records from primary storage. [2025-09-26T21:02:58.801493] [INFO ] [MAIN ] RNG: Loaded 48491 existing records. [2025-09-26T21:02:59.003148] [WARN ] [MAIN ] RNG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:02:59.003487] [INFO ] [MAIN ] RNG: Wiping existing primary data before full refresh. [2025-09-26T21:02:59.003546] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-09-26T21:02:59.004606] [DEBUG] [LOCAL ] RNG: Deleted primary data file. [2025-09-26T21:02:59.004745] [INFO ] [MAIN ] RNG: Starting full primary refresh. [2025-09-26T21:02:59.107433] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-26T21:02:59.118897] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-07. [2025-09-26T21:02:59.392196] [INFO ] [REMOTE ] RNG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:02:59.911736] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-04. [2025-09-26T21:02:59.983210] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-26T21:03:00.626638] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-26T21:03:00.711712] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-08. [2025-09-26T21:03:01.511698] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-05. [2025-09-26T21:03:01.594265] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-26T21:03:02.130198] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-26T21:03:02.311740] [INFO ] [REMOTE ] RNG: Fetching primary data for 2024-12. [2025-09-26T21:03:03.111740] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-09. [2025-09-26T21:03:03.911724] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-02. [2025-09-26T21:03:03.944943] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-26T21:03:03.980910] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-26T21:03:03.984198] [INFO ] [REMOTE ] RMM: Full fetch complete (15001 records). [2025-09-26T21:03:03.984276] [DEBUG] [VALIDATOR ] RMM: Validating primary data. [2025-09-26T21:03:04.380905] [DEBUG] [VALIDATOR ] RMM: All expected trading days are present. [2025-09-26T21:03:04.381064] [DEBUG] [VALIDATOR ] RMM: Primary data validation passed. [2025-09-26T21:03:04.381472] [INFO ] [MAIN ] RMM: Fetched primary data is valid. [2025-09-26T21:03:04.381518] [DEBUG] [LOCAL ] RMM: Saving primary data. [2025-09-26T21:03:04.382219] [DEBUG] [LOCAL ] RMM: Trimmed 15001 records to 10624 (keeping 200 days of data) [2025-09-26T21:03:04.454484] [DEBUG] [LOCAL ] RMM: Primary data saved (10624 records). [2025-09-26T21:03:04.454668] [INFO ] [MAIN ] RMM: Full history saved. [2025-09-26T21:03:04.454785] [INFO ] [MAIN ] Update Progress: 1820/2371 symbols completed. RMM took 31.9s. Estimated remaining: 1h 13m 34s. Rate: 7.5 symbols/min [2025-09-26T21:03:04.631713] [INFO ] [MAIN ] RNGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:03:04.654490] [DEBUG] [LOCAL ] RNGR: Loaded 20559 existing records from primary storage. [2025-09-26T21:03:04.654669] [INFO ] [MAIN ] RNGR: Loaded 20559 existing records. [2025-09-26T21:03:04.721262] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-06. [2025-09-26T21:03:04.854954] [WARN ] [MAIN ] RNGR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:03:04.855351] [INFO ] [MAIN ] RNGR: Wiping existing primary data before full refresh. [2025-09-26T21:03:04.855454] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-09-26T21:03:04.856044] [DEBUG] [LOCAL ] RNGR: Deleted primary data file. [2025-09-26T21:03:04.856105] [INFO ] [MAIN ] RNGR: Starting full primary refresh. [2025-09-26T21:03:05.027270] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-26T21:03:05.308583] [INFO ] [REMOTE ] RNGR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:03:05.459207] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-26T21:03:05.511708] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-07. [2025-09-26T21:03:06.254770] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-26T21:03:06.311734] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2024-12. [2025-09-26T21:03:07.111730] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-03. [2025-09-26T21:03:07.416592] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-26T21:03:07.911717] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-08. [2025-09-26T21:03:08.302375] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-26T21:03:08.711743] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-01. [2025-09-26T21:03:08.727145] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-26T21:03:09.511731] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-04. [2025-09-26T21:03:10.311738] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-09. [2025-09-26T21:03:10.431522] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-26T21:03:10.469387] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-26T21:03:11.008224] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-26T21:03:11.010317] [INFO ] [REMOTE ] RMMZ: Full fetch complete (7123 records). [2025-09-26T21:03:11.010442] [DEBUG] [VALIDATOR ] RMMZ: Validating primary data. [2025-09-26T21:03:11.116895] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-02. [2025-09-26T21:03:11.403247] [DEBUG] [VALIDATOR ] RMMZ: All expected trading days are present. [2025-09-26T21:03:11.403336] [DEBUG] [VALIDATOR ] RMMZ: Primary data validation passed. [2025-09-26T21:03:11.403540] [INFO ] [MAIN ] RMMZ: Fetched primary data is valid. [2025-09-26T21:03:11.403637] [DEBUG] [LOCAL ] RMMZ: Saving primary data. [2025-09-26T21:03:11.404148] [DEBUG] [LOCAL ] RMMZ: Trimmed 7123 records to 4875 (keeping 200 days of data) [2025-09-26T21:03:11.436499] [DEBUG] [LOCAL ] RMMZ: Primary data saved (4875 records). [2025-09-26T21:03:11.436670] [INFO ] [MAIN ] RMMZ: Full history saved. [2025-09-26T21:03:11.436905] [INFO ] [MAIN ] Update Progress: 1821/2371 symbols completed. RMMZ took 20.3s. Estimated remaining: 1h 13m 26s. Rate: 7.5 symbols/min [2025-09-26T21:03:11.618213] [INFO ] [MAIN ] RNP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:03:11.641429] [DEBUG] [LOCAL ] RNP: Loaded 15850 existing records from primary storage. [2025-09-26T21:03:11.641588] [INFO ] [MAIN ] RNP: Loaded 15850 existing records. [2025-09-26T21:03:11.848908] [WARN ] [MAIN ] RNP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:03:11.849293] [INFO ] [MAIN ] RNP: Wiping existing primary data before full refresh. [2025-09-26T21:03:11.849399] [INFO ] [LOCAL ] RNP: Starting deletion of primary data. [2025-09-26T21:03:11.850518] [DEBUG] [LOCAL ] RNP: Deleted primary data file. [2025-09-26T21:03:11.850598] [INFO ] [MAIN ] RNP: Starting full primary refresh. [2025-09-26T21:03:11.916963] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-05. [2025-09-26T21:03:12.257815] [INFO ] [REMOTE ] RNP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:03:12.711702] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-01. [2025-09-26T21:03:12.754878] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-26T21:03:13.054851] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-26T21:03:13.511731] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-03. [2025-09-26T21:03:13.849583] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-26T21:03:14.311735] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-06. [2025-09-26T21:03:15.111713] [INFO ] [REMOTE ] RNP: Fetching primary data for 2024-12. [2025-09-26T21:03:15.363778] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-26T21:03:15.385623] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-26T21:03:15.911725] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-02. [2025-09-26T21:03:16.466596] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-26T21:03:16.711737] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-04. [2025-09-26T21:03:16.930800] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-26T21:03:17.511733] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-07. [2025-09-26T21:03:18.311729] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-03. [2025-09-26T21:03:18.502258] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-26T21:03:18.627883] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-26T21:03:19.111748] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-08. [2025-09-26T21:03:19.394428] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-26T21:03:19.775722] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-26T21:03:19.911722] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-05. [2025-09-26T21:03:20.711715] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-01. [2025-09-26T21:03:21.511688] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-09. [2025-09-26T21:03:21.687050] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-26T21:03:21.719285] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-26T21:03:22.311721] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-04. [2025-09-26T21:03:22.502901] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-26T21:03:22.508342] [INFO ] [REMOTE ] RMT: Full fetch complete (25501 records). [2025-09-26T21:03:22.508478] [DEBUG] [VALIDATOR ] RMT: Validating primary data. [2025-09-26T21:03:22.897956] [DEBUG] [VALIDATOR ] RMT: All expected trading days are present. [2025-09-26T21:03:22.898063] [DEBUG] [VALIDATOR ] RMT: Primary data validation passed. [2025-09-26T21:03:22.898625] [INFO ] [MAIN ] RMT: Fetched primary data is valid. [2025-09-26T21:03:22.898704] [DEBUG] [LOCAL ] RMT: Saving primary data. [2025-09-26T21:03:22.900410] [DEBUG] [LOCAL ] RMT: Trimmed 25501 records to 17682 (keeping 200 days of data) [2025-09-26T21:03:23.018061] [DEBUG] [LOCAL ] RMT: Primary data saved (17682 records). [2025-09-26T21:03:23.018222] [INFO ] [MAIN ] RMT: Full history saved. [2025-09-26T21:03:23.018431] [INFO ] [MAIN ] Update Progress: 1822/2371 symbols completed. RMT took 30.2s. Estimated remaining: 1h 13m 19s. Rate: 7.5 symbols/min [2025-09-26T21:03:23.116825] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-02. [2025-09-26T21:03:23.232179] [INFO ] [MAIN ] RNR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:03:23.290228] [DEBUG] [LOCAL ] RNR: Loaded 34424 existing records from primary storage. [2025-09-26T21:03:23.290382] [INFO ] [MAIN ] RNR: Loaded 34424 existing records. [2025-09-26T21:03:23.463741] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-26T21:03:23.585496] [WARN ] [MAIN ] RNR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:03:23.585812] [INFO ] [MAIN ] RNR: Wiping existing primary data before full refresh. [2025-09-26T21:03:23.585894] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-09-26T21:03:23.587067] [DEBUG] [LOCAL ] RNR: Deleted primary data file. [2025-09-26T21:03:23.587133] [INFO ] [MAIN ] RNR: Starting full primary refresh. [2025-09-26T21:03:23.920397] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-06. [2025-09-26T21:03:24.060078] [INFO ] [REMOTE ] RNR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:03:24.328323] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-26T21:03:24.711790] [INFO ] [REMOTE ] RNR: Fetching primary data for 2024-12. [2025-09-26T21:03:25.511715] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-03. [2025-09-26T21:03:25.658383] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-26T21:03:26.281847] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-26T21:03:26.311699] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-01. [2025-09-26T21:03:26.539116] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-26T21:03:27.111720] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-07. [2025-09-26T21:03:27.916867] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-05. [2025-09-26T21:03:27.927751] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-26T21:03:28.711703] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-02. [2025-09-26T21:03:28.900917] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-26T21:03:29.026413] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-26T21:03:29.511789] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-08. [2025-09-26T21:03:29.917619] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-26T21:03:30.311727] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-04. [2025-09-26T21:03:31.111694] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-03. [2025-09-26T21:03:31.285342] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-26T21:03:31.400814] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-26T21:03:31.911732] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-05. [2025-09-26T21:03:32.517103] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-26T21:03:32.711731] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-06. [2025-09-26T21:03:32.920003] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-26T21:03:33.511738] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-06. [2025-09-26T21:03:34.031546] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-26T21:03:34.311730] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-04. [2025-09-26T21:03:34.600945] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-26T21:03:35.111722] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-07. [2025-09-26T21:03:35.911701] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-09. [2025-09-26T21:03:35.962425] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-26T21:03:36.310611] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-26T21:03:36.711718] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-05. [2025-09-26T21:03:37.511705] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-08. [2025-09-26T21:03:37.844090] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-26T21:03:37.854035] [INFO ] [REMOTE ] RNG: Full fetch complete (69482 records). [2025-09-26T21:03:37.854253] [DEBUG] [VALIDATOR ] RNG: Validating primary data. [2025-09-26T21:03:38.311030] [DEBUG] [VALIDATOR ] RNG: All expected trading days are present. [2025-09-26T21:03:38.311190] [DEBUG] [VALIDATOR ] RNG: Primary data validation passed. [2025-09-26T21:03:38.312480] [INFO ] [MAIN ] RNG: Fetched primary data is valid. [2025-09-26T21:03:38.312561] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-07. [2025-09-26T21:03:38.312912] [DEBUG] [LOCAL ] RNG: Saving primary data. [2025-09-26T21:03:38.339705] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-26T21:03:38.349136] [DEBUG] [LOCAL ] RNG: Trimmed 69482 records to 48830 (keeping 200 days of data) [2025-09-26T21:03:38.662230] [DEBUG] [LOCAL ] RNG: Primary data saved (48830 records). [2025-09-26T21:03:38.662387] [INFO ] [MAIN ] RNG: Full history saved. [2025-09-26T21:03:38.662511] [INFO ] [MAIN ] Update Progress: 1823/2371 symbols completed. RNG took 40.1s. Estimated remaining: 1h 13m 13s. Rate: 7.5 symbols/min [2025-09-26T21:03:38.807688] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-26T21:03:38.889686] [INFO ] [MAIN ] RNST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:03:38.946435] [DEBUG] [LOCAL ] RNST: Loaded 37407 existing records from primary storage. [2025-09-26T21:03:38.946582] [INFO ] [MAIN ] RNST: Loaded 37407 existing records. [2025-09-26T21:03:39.112446] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-09. [2025-09-26T21:03:39.142613] [WARN ] [MAIN ] RNST: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:03:39.142944] [INFO ] [MAIN ] RNST: Wiping existing primary data before full refresh. [2025-09-26T21:03:39.142998] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-09-26T21:03:39.143854] [DEBUG] [LOCAL ] RNST: Deleted primary data file. [2025-09-26T21:03:39.143914] [INFO ] [MAIN ] RNST: Starting full primary refresh. [2025-09-26T21:03:39.519040] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-26T21:03:39.541592] [INFO ] [REMOTE ] RNST: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:03:39.911679] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-06. [2025-09-26T21:03:40.273917] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-26T21:03:40.278455] [INFO ] [REMOTE ] RNGR: Full fetch complete (28281 records). [2025-09-26T21:03:40.278565] [DEBUG] [VALIDATOR ] RNGR: Validating primary data. [2025-09-26T21:03:40.685937] [DEBUG] [VALIDATOR ] RNGR: All expected trading days are present. [2025-09-26T21:03:40.686065] [DEBUG] [VALIDATOR ] RNGR: Primary data validation passed. [2025-09-26T21:03:40.686823] [INFO ] [MAIN ] RNGR: Fetched primary data is valid. [2025-09-26T21:03:40.686921] [DEBUG] [LOCAL ] RNGR: Saving primary data. [2025-09-26T21:03:40.688264] [DEBUG] [LOCAL ] RNGR: Trimmed 28281 records to 20653 (keeping 200 days of data) [2025-09-26T21:03:40.745547] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-08. [2025-09-26T21:03:40.830274] [DEBUG] [LOCAL ] RNGR: Primary data saved (20653 records). [2025-09-26T21:03:40.830425] [INFO ] [MAIN ] RNGR: Full history saved. [2025-09-26T21:03:40.830522] [INFO ] [MAIN ] Update Progress: 1824/2371 symbols completed. RNGR took 36.4s. Estimated remaining: 1h 13m 4s. Rate: 7.5 symbols/min [2025-09-26T21:03:41.020501] [INFO ] [MAIN ] ROG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:03:41.044942] [DEBUG] [LOCAL ] ROG: Loaded 23271 existing records from primary storage. [2025-09-26T21:03:41.045094] [INFO ] [MAIN ] ROG: Loaded 23271 existing records. [2025-09-26T21:03:41.240620] [WARN ] [MAIN ] ROG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:03:41.241039] [INFO ] [MAIN ] ROG: Wiping existing primary data before full refresh. [2025-09-26T21:03:41.241227] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-09-26T21:03:41.241932] [DEBUG] [LOCAL ] ROG: Deleted primary data file. [2025-09-26T21:03:41.242038] [INFO ] [MAIN ] ROG: Starting full primary refresh. [2025-09-26T21:03:41.433457] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-26T21:03:41.516817] [INFO ] [REMOTE ] RNST: Fetching primary data for 2024-12. [2025-09-26T21:03:41.705594] [INFO ] [REMOTE ] ROG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:03:41.834054] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-26T21:03:42.311753] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-09. [2025-09-26T21:03:42.819992] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-26T21:03:43.111734] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-07. [2025-09-26T21:03:43.335085] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-26T21:03:43.338307] [INFO ] [REMOTE ] RNP: Full fetch complete (23339 records). [2025-09-26T21:03:43.338445] [DEBUG] [VALIDATOR ] RNP: Validating primary data. [2025-09-26T21:03:43.733268] [DEBUG] [VALIDATOR ] RNP: All expected trading days are present. [2025-09-26T21:03:43.733415] [DEBUG] [VALIDATOR ] RNP: Primary data validation passed. [2025-09-26T21:03:43.733989] [INFO ] [MAIN ] RNP: Fetched primary data is valid. [2025-09-26T21:03:43.734055] [DEBUG] [LOCAL ] RNP: Saving primary data. [2025-09-26T21:03:43.735100] [DEBUG] [LOCAL ] RNP: Trimmed 23339 records to 15940 (keeping 200 days of data) [2025-09-26T21:03:43.845569] [DEBUG] [LOCAL ] RNP: Primary data saved (15940 records). [2025-09-26T21:03:43.845755] [INFO ] [MAIN ] RNP: Full history saved. [2025-09-26T21:03:43.845882] [INFO ] [MAIN ] Update Progress: 1825/2371 symbols completed. RNP took 32.4s. Estimated remaining: 1h 12m 54s. Rate: 7.5 symbols/min [2025-09-26T21:03:43.916936] [INFO ] [REMOTE ] ROG: Fetching primary data for 2024-12. [2025-09-26T21:03:44.026354] [INFO ] [MAIN ] ROK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:03:44.083701] [DEBUG] [LOCAL ] ROK: Loaded 44258 existing records from primary storage. [2025-09-26T21:03:44.083862] [INFO ] [MAIN ] ROK: Loaded 44258 existing records. [2025-09-26T21:03:44.277741] [WARN ] [MAIN ] ROK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:03:44.278078] [INFO ] [MAIN ] ROK: Wiping existing primary data before full refresh. [2025-09-26T21:03:44.278136] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-09-26T21:03:44.279281] [DEBUG] [LOCAL ] ROK: Deleted primary data file. [2025-09-26T21:03:44.279343] [INFO ] [MAIN ] ROK: Starting full primary refresh. [2025-09-26T21:03:44.689088] [INFO ] [REMOTE ] ROK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:03:44.714262] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-01. [2025-09-26T21:03:44.717329] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-26T21:03:45.098978] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-26T21:03:45.511746] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-01. [2025-09-26T21:03:45.994785] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-26T21:03:46.311701] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-08. [2025-09-26T21:03:46.514310] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-26T21:03:47.111727] [INFO ] [REMOTE ] ROK: Fetching primary data for 2024-12. [2025-09-26T21:03:47.629777] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-26T21:03:47.911728] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-09. [2025-09-26T21:03:48.711689] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-02. [2025-09-26T21:03:48.808838] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-26T21:03:49.123141] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-26T21:03:49.129274] [INFO ] [REMOTE ] RNR: Full fetch complete (51119 records). [2025-09-26T21:03:49.129410] [DEBUG] [VALIDATOR ] RNR: Validating primary data. [2025-09-26T21:03:49.512162] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-01. [2025-09-26T21:03:49.557488] [DEBUG] [VALIDATOR ] RNR: All expected trading days are present. [2025-09-26T21:03:49.569195] [DEBUG] [VALIDATOR ] RNR: Primary data validation passed. [2025-09-26T21:03:49.570285] [INFO ] [MAIN ] RNR: Fetched primary data is valid. [2025-09-26T21:03:49.571791] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-26T21:03:49.571208] [DEBUG] [LOCAL ] RNR: Saving primary data. [2025-09-26T21:03:49.578533] [DEBUG] [LOCAL ] RNR: Trimmed 51119 records to 34623 (keeping 200 days of data) [2025-09-26T21:03:49.832028] [DEBUG] [LOCAL ] RNR: Primary data saved (34623 records). [2025-09-26T21:03:49.832254] [INFO ] [MAIN ] RNR: Full history saved. [2025-09-26T21:03:49.832433] [INFO ] [MAIN ] Update Progress: 1826/2371 symbols completed. RNR took 26.8s. Estimated remaining: 1h 12m 46s. Rate: 7.5 symbols/min [2025-09-26T21:03:50.017726] [INFO ] [MAIN ] ROL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:03:50.068387] [DEBUG] [LOCAL ] ROL: Loaded 50649 existing records from primary storage. [2025-09-26T21:03:50.068543] [INFO ] [MAIN ] ROL: Loaded 50649 existing records. [2025-09-26T21:03:50.272157] [WARN ] [MAIN ] ROL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:03:50.272480] [INFO ] [MAIN ] ROL: Wiping existing primary data before full refresh. [2025-09-26T21:03:50.272529] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-09-26T21:03:50.273733] [DEBUG] [LOCAL ] ROL: Deleted primary data file. [2025-09-26T21:03:50.273795] [INFO ] [MAIN ] ROL: Starting full primary refresh. [2025-09-26T21:03:50.316952] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-02. [2025-09-26T21:03:50.662197] [INFO ] [REMOTE ] ROL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:03:51.111741] [INFO ] [REMOTE ] ROL: Fetching primary data for 2024-12. [2025-09-26T21:03:51.341793] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-26T21:03:51.809344] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-26T21:03:51.911715] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-03. [2025-09-26T21:03:52.711768] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-02. [2025-09-26T21:03:52.855952] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-26T21:03:53.149779] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-26T21:03:53.511745] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-04. [2025-09-26T21:03:54.311745] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-03. [2025-09-26T21:03:54.369906] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-26T21:03:55.038977] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-26T21:03:55.111730] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-01. [2025-09-26T21:03:55.880329] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-26T21:03:55.911684] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-04. [2025-09-26T21:03:56.711700] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-05. [2025-09-26T21:03:56.861566] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-26T21:03:57.511702] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-03. [2025-09-26T21:03:57.611735] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-26T21:03:57.901500] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-26T21:03:58.311720] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-02. [2025-09-26T21:03:59.111724] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-06. [2025-09-26T21:03:59.172107] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-26T21:03:59.911732] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-05. [2025-09-26T21:04:00.130509] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-26T21:04:00.152505] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-26T21:04:00.711722] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-07. [2025-09-26T21:04:01.441819] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-26T21:04:01.511720] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-03. [2025-09-26T21:04:01.948301] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-26T21:04:02.311742] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-04. [2025-09-26T21:04:03.111736] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-06. [2025-09-26T21:04:03.433507] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-26T21:04:03.911725] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-04. [2025-09-26T21:04:04.165924] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-26T21:04:04.225854] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-26T21:04:04.711737] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-07. [2025-09-26T21:04:05.511779] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-08. [2025-09-26T21:04:05.893252] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-26T21:04:06.317789] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-05. [2025-09-26T21:04:06.322206] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-26T21:04:06.357338] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-26T21:04:07.111726] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-05. [2025-09-26T21:04:07.911733] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-09. [2025-09-26T21:04:08.426060] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-26T21:04:08.711733] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-08. [2025-09-26T21:04:08.854371] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-26T21:04:08.963594] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-26T21:04:08.967834] [INFO ] [REMOTE ] ROG: Full fetch complete (30691 records). [2025-09-26T21:04:08.967948] [DEBUG] [VALIDATOR ] ROG: Validating primary data. [2025-09-26T21:04:09.366357] [DEBUG] [VALIDATOR ] ROG: All expected trading days are present. [2025-09-26T21:04:09.366525] [DEBUG] [VALIDATOR ] ROG: Primary data validation passed. [2025-09-26T21:04:09.367267] [INFO ] [MAIN ] ROG: Fetched primary data is valid. [2025-09-26T21:04:09.367352] [DEBUG] [LOCAL ] ROG: Saving primary data. [2025-09-26T21:04:09.368608] [DEBUG] [LOCAL ] ROG: Trimmed 30691 records to 23367 (keeping 200 days of data) [2025-09-26T21:04:09.513713] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-06. [2025-09-26T21:04:09.525782] [DEBUG] [LOCAL ] ROG: Primary data saved (23367 records). [2025-09-26T21:04:09.525938] [INFO ] [MAIN ] ROG: Full history saved. [2025-09-26T21:04:09.526062] [INFO ] [MAIN ] Update Progress: 1827/2371 symbols completed. ROG took 28.7s. Estimated remaining: 1h 12m 41s. Rate: 7.5 symbols/min [2025-09-26T21:04:09.713771] [INFO ] [MAIN ] RPM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:04:09.763028] [DEBUG] [LOCAL ] RPM: Loaded 41430 existing records from primary storage. [2025-09-26T21:04:09.763180] [INFO ] [MAIN ] RPM: Loaded 41430 existing records. [2025-09-26T21:04:09.959836] [WARN ] [MAIN ] RPM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:04:09.960429] [INFO ] [MAIN ] RPM: Wiping existing primary data before full refresh. [2025-09-26T21:04:09.960496] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-09-26T21:04:09.961713] [DEBUG] [LOCAL ] RPM: Deleted primary data file. [2025-09-26T21:04:09.961779] [INFO ] [MAIN ] RPM: Starting full primary refresh. [2025-09-26T21:04:10.322365] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-06. [2025-09-26T21:04:10.389145] [INFO ] [REMOTE ] RPM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:04:10.394636] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-26T21:04:11.111738] [INFO ] [REMOTE ] RPM: Fetching primary data for 2024-12. [2025-09-26T21:04:11.390413] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-26T21:04:11.911704] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-07. [2025-09-26T21:04:12.112919] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-26T21:04:12.607120] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-26T21:04:12.711727] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-01. [2025-09-26T21:04:13.511733] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-07. [2025-09-26T21:04:13.574933] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-26T21:04:14.221935] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-26T21:04:14.311720] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-02. [2025-09-26T21:04:15.111728] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-09. [2025-09-26T21:04:15.282908] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-26T21:04:15.911692] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-08. [2025-09-26T21:04:15.997806] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-26T21:04:16.497786] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-26T21:04:16.505809] [INFO ] [REMOTE ] RNST: Full fetch complete (52997 records). [2025-09-26T21:04:16.505995] [DEBUG] [VALIDATOR ] RNST: Validating primary data. [2025-09-26T21:04:16.719745] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-08. [2025-09-26T21:04:17.018260] [DEBUG] [VALIDATOR ] RNST: All expected trading days are present. [2025-09-26T21:04:17.018425] [DEBUG] [VALIDATOR ] RNST: Primary data validation passed. [2025-09-26T21:04:17.020114] [INFO ] [MAIN ] RNST: Fetched primary data is valid. [2025-09-26T21:04:17.020234] [DEBUG] [LOCAL ] RNST: Saving primary data. [2025-09-26T21:04:17.022173] [DEBUG] [LOCAL ] RNST: Trimmed 52997 records to 37619 (keeping 200 days of data) [2025-09-26T21:04:17.391964] [DEBUG] [LOCAL ] RNST: Primary data saved (37619 records). [2025-09-26T21:04:17.392249] [INFO ] [MAIN ] RNST: Full history saved. [2025-09-26T21:04:17.392499] [INFO ] [MAIN ] Update Progress: 1828/2371 symbols completed. RNST took 38.7s. Estimated remaining: 1h 12m 33s. Rate: 7.5 symbols/min [2025-09-26T21:04:17.517059] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-03. [2025-09-26T21:04:17.673447] [INFO ] [MAIN ] RPT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:04:17.720233] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-26T21:04:17.747519] [DEBUG] [LOCAL ] RPT: Loaded 19668 existing records from primary storage. [2025-09-26T21:04:17.747700] [INFO ] [MAIN ] RPT: Loaded 19668 existing records. [2025-09-26T21:04:17.983837] [WARN ] [MAIN ] RPT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:04:17.984128] [INFO ] [MAIN ] RPT: Wiping existing primary data before full refresh. [2025-09-26T21:04:17.984180] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-09-26T21:04:17.984686] [DEBUG] [LOCAL ] RPT: Deleted primary data file. [2025-09-26T21:04:17.984765] [INFO ] [MAIN ] RPT: Starting full primary refresh. [2025-09-26T21:04:18.317053] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-09. [2025-09-26T21:04:18.410472] [INFO ] [REMOTE ] RPT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:04:18.641444] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-26T21:04:18.795387] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-26T21:04:19.111750] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-09. [2025-09-26T21:04:19.911725] [INFO ] [REMOTE ] RPT: Fetching primary data for 2024-12. [2025-09-26T21:04:19.977799] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-26T21:04:19.986016] [INFO ] [REMOTE ] ROK: Full fetch complete (63373 records). [2025-09-26T21:04:19.986178] [DEBUG] [VALIDATOR ] ROK: Validating primary data. [2025-09-26T21:04:20.422522] [DEBUG] [VALIDATOR ] ROK: All expected trading days are present. [2025-09-26T21:04:20.422661] [DEBUG] [VALIDATOR ] ROK: Primary data validation passed. [2025-09-26T21:04:20.423746] [INFO ] [MAIN ] ROK: Fetched primary data is valid. [2025-09-26T21:04:20.423842] [DEBUG] [LOCAL ] ROK: Saving primary data. [2025-09-26T21:04:20.425593] [DEBUG] [LOCAL ] ROK: Trimmed 63373 records to 44522 (keeping 200 days of data) [2025-09-26T21:04:20.714208] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-04. [2025-09-26T21:04:20.733935] [DEBUG] [LOCAL ] ROK: Primary data saved (44522 records). [2025-09-26T21:04:20.734106] [INFO ] [MAIN ] ROK: Full history saved. [2025-09-26T21:04:20.735874] [INFO ] [MAIN ] Update Progress: 1829/2371 symbols completed. ROK took 36.9s. Estimated remaining: 1h 12m 24s. Rate: 7.5 symbols/min [2025-09-26T21:04:20.946085] [INFO ] [MAIN ] RQI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:04:20.983983] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-26T21:04:21.006241] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-26T21:04:21.013229] [INFO ] [REMOTE ] ROL: Full fetch complete (72694 records). [2025-09-26T21:04:21.013604] [DEBUG] [VALIDATOR ] ROL: Validating primary data. [2025-09-26T21:04:21.240683] [DEBUG] [LOCAL ] RQI: Loaded 29374 existing records from primary storage. [2025-09-26T21:04:21.285322] [INFO ] [MAIN ] RQI: Loaded 29374 existing records. [2025-09-26T21:04:21.512347] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-01. [2025-09-26T21:04:21.714424] [WARN ] [MAIN ] RQI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:04:21.739783] [INFO ] [MAIN ] RQI: Wiping existing primary data before full refresh. [2025-09-26T21:04:21.740166] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-09-26T21:04:21.740002] [DEBUG] [VALIDATOR ] ROL: All expected trading days are present. [2025-09-26T21:04:21.740374] [DEBUG] [VALIDATOR ] ROL: Primary data validation passed. [2025-09-26T21:04:21.741898] [DEBUG] [LOCAL ] RQI: Deleted primary data file. [2025-09-26T21:04:21.742003] [INFO ] [MAIN ] RQI: Starting full primary refresh. [2025-09-26T21:04:21.741835] [INFO ] [MAIN ] ROL: Fetched primary data is valid. [2025-09-26T21:04:21.778416] [DEBUG] [LOCAL ] ROL: Saving primary data. [2025-09-26T21:04:21.861391] [DEBUG] [LOCAL ] ROL: Trimmed 72694 records to 51031 (keeping 200 days of data) [2025-09-26T21:04:22.396100] [INFO ] [REMOTE ] RQI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:04:22.400125] [INFO ] [REMOTE ] RQI: Fetching primary data for 2024-12. [2025-09-26T21:04:22.519968] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-26T21:04:22.545994] [DEBUG] [LOCAL ] ROL: Primary data saved (51031 records). [2025-09-26T21:04:22.546179] [INFO ] [MAIN ] ROL: Full history saved. [2025-09-26T21:04:22.546306] [INFO ] [MAIN ] Update Progress: 1830/2371 symbols completed. ROL took 32.7s. Estimated remaining: 1h 12m 14s. Rate: 7.5 symbols/min [2025-09-26T21:04:22.700524] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-26T21:04:22.760696] [INFO ] [MAIN ] RRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:04:22.822463] [DEBUG] [LOCAL ] RRC: Loaded 53166 existing records from primary storage. [2025-09-26T21:04:22.822662] [INFO ] [MAIN ] RRC: Loaded 53166 existing records. [2025-09-26T21:04:23.030926] [WARN ] [MAIN ] RRC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:04:23.031211] [INFO ] [MAIN ] RRC: Wiping existing primary data before full refresh. [2025-09-26T21:04:23.031263] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-09-26T21:04:23.032619] [DEBUG] [LOCAL ] RRC: Deleted primary data file. [2025-09-26T21:04:23.032711] [INFO ] [MAIN ] RRC: Starting full primary refresh. [2025-09-26T21:04:23.118199] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-02. [2025-09-26T21:04:23.430791] [INFO ] [REMOTE ] RRC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:04:23.911725] [INFO ] [REMOTE ] RRC: Fetching primary data for 2024-12. [2025-09-26T21:04:24.013096] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-26T21:04:24.237736] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-26T21:04:24.711743] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-01. [2025-09-26T21:04:25.511719] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-05. [2025-09-26T21:04:25.740269] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-26T21:04:26.152377] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-26T21:04:26.311719] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-02. [2025-09-26T21:04:27.111718] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-01. [2025-09-26T21:04:27.217628] [DEBUG] [REMOTE ] RRC: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-26T21:04:27.218258] [WARN ] [REMOTE ] RRC: No data returned for month 2025-01 [2025-09-26T21:04:27.261553] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-26T21:04:27.533510] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-26T21:04:27.911730] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-03. [2025-09-26T21:04:28.711762] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-02. [2025-09-26T21:04:29.043936] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-26T21:04:29.511747] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-06. [2025-09-26T21:04:30.311736] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-04. [2025-09-26T21:04:30.498026] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-26T21:04:31.041990] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-26T21:04:31.111724] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-03. [2025-09-26T21:04:31.377922] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-26T21:04:31.911725] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-03. [2025-09-26T21:04:32.711724] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-07. [2025-09-26T21:04:33.113551] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-26T21:04:33.414413] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-26T21:04:33.511738] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-04. [2025-09-26T21:04:34.311731] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-04. [2025-09-26T21:04:34.427774] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-26T21:04:35.111715] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-08. [2025-09-26T21:04:35.437057] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-26T21:04:35.726172] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-26T21:04:35.911714] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-05. [2025-09-26T21:04:36.315699] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-26T21:04:36.561613] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-26T21:04:36.711728] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-05. [2025-09-26T21:04:37.511742] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-06. [2025-09-26T21:04:38.311699] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-05. [2025-09-26T21:04:38.700664] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-26T21:04:38.715509] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-26T21:04:39.111717] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-09. [2025-09-26T21:04:39.556036] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-26T21:04:39.911726] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-06. [2025-09-26T21:04:40.690175] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-26T21:04:40.698483] [INFO ] [REMOTE ] RPM: Full fetch complete (58924 records). [2025-09-26T21:04:40.698715] [DEBUG] [VALIDATOR ] RPM: Validating primary data. [2025-09-26T21:04:40.722127] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-06. [2025-09-26T21:04:41.102459] [DEBUG] [VALIDATOR ] RPM: All expected trading days are present. [2025-09-26T21:04:41.102558] [DEBUG] [VALIDATOR ] RPM: Primary data validation passed. [2025-09-26T21:04:41.103488] [INFO ] [MAIN ] RPM: Fetched primary data is valid. [2025-09-26T21:04:41.103555] [DEBUG] [LOCAL ] RPM: Saving primary data. [2025-09-26T21:04:41.104990] [DEBUG] [LOCAL ] RPM: Trimmed 58924 records to 41763 (keeping 200 days of data) [2025-09-26T21:04:41.376881] [DEBUG] [LOCAL ] RPM: Primary data saved (41763 records). [2025-09-26T21:04:41.377031] [INFO ] [MAIN ] RPM: Full history saved. [2025-09-26T21:04:41.377122] [INFO ] [MAIN ] Update Progress: 1831/2371 symbols completed. RPM took 31.9s. Estimated remaining: 1h 12m 9s. Rate: 7.5 symbols/min [2025-09-26T21:04:41.516821] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-07. [2025-09-26T21:04:41.564982] [INFO ] [MAIN ] RRX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:04:41.607851] [DEBUG] [LOCAL ] RRX: Loaded 41433 existing records from primary storage. [2025-09-26T21:04:41.608094] [INFO ] [MAIN ] RRX: Loaded 41433 existing records. [2025-09-26T21:04:41.810424] [WARN ] [MAIN ] RRX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:04:41.810745] [INFO ] [MAIN ] RRX: Wiping existing primary data before full refresh. [2025-09-26T21:04:41.810803] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-09-26T21:04:41.811769] [DEBUG] [LOCAL ] RRX: Deleted primary data file. [2025-09-26T21:04:41.811847] [INFO ] [MAIN ] RRX: Starting full primary refresh. [2025-09-26T21:04:42.231982] [INFO ] [REMOTE ] RRX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:04:42.232911] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-26T21:04:42.311751] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-07. [2025-09-26T21:04:42.575266] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-26T21:04:43.111704] [INFO ] [REMOTE ] RRX: Fetching primary data for 2024-12. [2025-09-26T21:04:43.156252] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-06 (3.24 seconds). [2025-09-26T21:04:43.575119] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-26T21:04:43.911728] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-08. [2025-09-26T21:04:44.623096] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-26T21:04:44.711760] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-07. [2025-09-26T21:04:45.064827] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-26T21:04:45.511724] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-09. [2025-09-26T21:04:46.311712] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-01. [2025-09-26T21:04:46.610865] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-26T21:04:46.744155] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-26T21:04:46.747833] [INFO ] [REMOTE ] RPT: Full fetch complete (28578 records). [2025-09-26T21:04:46.748086] [DEBUG] [VALIDATOR ] RPT: Validating primary data. [2025-09-26T21:04:47.116801] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-08. [2025-09-26T21:04:47.154207] [DEBUG] [VALIDATOR ] RPT: All expected trading days are present. [2025-09-26T21:04:47.154288] [DEBUG] [VALIDATOR ] RPT: Primary data validation passed. [2025-09-26T21:04:47.154914] [INFO ] [MAIN ] RPT: Fetched primary data is valid. [2025-09-26T21:04:47.154984] [DEBUG] [LOCAL ] RPT: Saving primary data. [2025-09-26T21:04:47.155848] [DEBUG] [LOCAL ] RPT: Trimmed 28578 records to 19767 (keeping 200 days of data) [2025-09-26T21:04:47.273961] [DEBUG] [LOCAL ] RPT: Primary data saved (19767 records). [2025-09-26T21:04:47.274120] [INFO ] [MAIN ] RPT: Full history saved. [2025-09-26T21:04:47.274214] [INFO ] [MAIN ] Update Progress: 1832/2371 symbols completed. RPT took 29.9s. Estimated remaining: 1h 12m 0s. Rate: 7.5 symbols/min [2025-09-26T21:04:47.451153] [INFO ] [MAIN ] RS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:04:47.478100] [DEBUG] [LOCAL ] RS: Loaded 25703 existing records from primary storage. [2025-09-26T21:04:47.478246] [INFO ] [MAIN ] RS: Loaded 25703 existing records. [2025-09-26T21:04:47.674768] [WARN ] [MAIN ] RS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:04:47.675380] [INFO ] [MAIN ] RS: Wiping existing primary data before full refresh. [2025-09-26T21:04:47.675454] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-09-26T21:04:47.676177] [DEBUG] [LOCAL ] RS: Deleted primary data file. [2025-09-26T21:04:47.676239] [INFO ] [MAIN ] RS: Starting full primary refresh. [2025-09-26T21:04:47.914086] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-08. [2025-09-26T21:04:48.065919] [INFO ] [REMOTE ] RS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:04:48.086765] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-26T21:04:48.657022] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-26T21:04:48.711677] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-09. [2025-09-26T21:04:49.511722] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-02. [2025-09-26T21:04:50.009149] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-26T21:04:50.138967] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-26T21:04:50.145668] [INFO ] [REMOTE ] RQI: Full fetch complete (43335 records). [2025-09-26T21:04:50.145782] [DEBUG] [VALIDATOR ] RQI: Validating primary data. [2025-09-26T21:04:50.314686] [INFO ] [REMOTE ] RS: Fetching primary data for 2024-12. [2025-09-26T21:04:50.563612] [DEBUG] [VALIDATOR ] RQI: All expected trading days are present. [2025-09-26T21:04:50.563752] [DEBUG] [VALIDATOR ] RQI: Primary data validation passed. [2025-09-26T21:04:50.564680] [INFO ] [MAIN ] RQI: Fetched primary data is valid. [2025-09-26T21:04:50.564770] [DEBUG] [LOCAL ] RQI: Saving primary data. [2025-09-26T21:04:50.566097] [DEBUG] [LOCAL ] RQI: Trimmed 43335 records to 29573 (keeping 200 days of data) [2025-09-26T21:04:50.773133] [DEBUG] [LOCAL ] RQI: Primary data saved (29573 records). [2025-09-26T21:04:50.773302] [INFO ] [MAIN ] RQI: Full history saved. [2025-09-26T21:04:50.773404] [INFO ] [MAIN ] Update Progress: 1833/2371 symbols completed. RQI took 30.0s. Estimated remaining: 1h 11m 51s. Rate: 7.5 symbols/min [2025-09-26T21:04:50.959797] [INFO ] [MAIN ] RSF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:04:50.968594] [DEBUG] [LOCAL ] RSF: Loaded 4145 existing records from primary storage. [2025-09-26T21:04:50.968766] [INFO ] [MAIN ] RSF: Loaded 4145 existing records. [2025-09-26T21:04:51.113084] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-09. [2025-09-26T21:04:51.175296] [WARN ] [MAIN ] RSF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:04:51.175991] [INFO ] [MAIN ] RSF: Wiping existing primary data before full refresh. [2025-09-26T21:04:51.176112] [INFO ] [LOCAL ] RSF: Starting deletion of primary data. [2025-09-26T21:04:51.176537] [DEBUG] [LOCAL ] RSF: Deleted primary data file. [2025-09-26T21:04:51.176620] [INFO ] [MAIN ] RSF: Starting full primary refresh. [2025-09-26T21:04:51.310291] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-26T21:04:51.595620] [INFO ] [REMOTE ] RSF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:04:51.892745] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-26T21:04:51.911675] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-01. [2025-09-26T21:04:52.711709] [INFO ] [REMOTE ] RSF: Fetching primary data for 2024-12. [2025-09-26T21:04:52.982489] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-26T21:04:52.993865] [INFO ] [REMOTE ] RRC: Full fetch complete (68607 records). [2025-09-26T21:04:52.994039] [DEBUG] [VALIDATOR ] RRC: Validating primary data. [2025-09-26T21:04:53.205846] [WARN ] [VALIDATOR ] RRC: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-26T21:04:53.206670] [FATAL] [MAIN ] RRC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T21:04:53.206804] [WARN ] [MAIN ] RRC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T21:04:53.206944] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-09-26T21:04:53.207030] [DEBUG] [LOCAL ] RRC: No primary data file found to delete. [2025-09-26T21:04:53.207083] [INFO ] [LOCAL ] RRC: Starting deletion of derivative data. [2025-09-26T21:04:53.207496] [DEBUG] [LOCAL ] RRC: Deleted derivative data file. [2025-09-26T21:04:53.207618] [INFO ] [MAIN ] Update Progress: 1834/2371 symbols completed. RRC took 30.7s. Estimated remaining: 1h 11m 41s. Rate: 7.5 symbols/min [2025-09-26T21:04:53.395945] [INFO ] [MAIN ] RSG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:04:53.415760] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-26T21:04:53.435794] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-26T21:04:53.488865] [DEBUG] [LOCAL ] RSG: Loaded 47849 existing records from primary storage. [2025-09-26T21:04:53.489064] [INFO ] [MAIN ] RSG: Loaded 47849 existing records. [2025-09-26T21:04:53.516867] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-02. [2025-09-26T21:04:53.727922] [WARN ] [MAIN ] RSG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:04:53.728205] [INFO ] [MAIN ] RSG: Wiping existing primary data before full refresh. [2025-09-26T21:04:53.728255] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-09-26T21:04:53.729518] [DEBUG] [LOCAL ] RSG: Deleted primary data file. [2025-09-26T21:04:53.729583] [INFO ] [MAIN ] RSG: Starting full primary refresh. [2025-09-26T21:04:54.116252] [INFO ] [REMOTE ] RSG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:04:54.311737] [INFO ] [REMOTE ] RSG: Fetching primary data for 2024-12. [2025-09-26T21:04:55.102367] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-26T21:04:55.111670] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-03. [2025-09-26T21:04:55.911710] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-01. [2025-09-26T21:04:56.002560] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-26T21:04:56.519306] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-26T21:04:56.655445] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T21:04:56.711745] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-02. [2025-09-26T21:04:57.240296] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-26T21:04:57.511720] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-04. [2025-09-26T21:04:58.311714] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-03. [2025-09-26T21:04:58.920375] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-26T21:04:59.111736] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-01. [2025-09-26T21:04:59.911710] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-05. [2025-09-26T21:05:00.168585] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-26T21:05:00.711711] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-03. [2025-09-26T21:05:00.945706] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-26T21:05:01.070666] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-26T21:05:01.221000] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-26T21:05:01.511728] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-06. [2025-09-26T21:05:02.311732] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-04. [2025-09-26T21:05:02.855519] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-26T21:05:02.939351] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-26T21:05:03.111718] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-02. [2025-09-26T21:05:03.911726] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-05. [2025-09-26T21:05:04.597215] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-26T21:05:04.711720] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-06. [2025-09-26T21:05:04.799847] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-26T21:05:05.387448] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-26T21:05:05.511686] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-03. [2025-09-26T21:05:06.311752] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-07. [2025-09-26T21:05:07.030748] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-26T21:05:07.111696] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-08. [2025-09-26T21:05:07.494387] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-26T21:05:07.760822] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-26T21:05:07.911722] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-04. [2025-09-26T21:05:08.711728] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-09. [2025-09-26T21:05:09.229388] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-26T21:05:09.230713] [INFO ] [REMOTE ] RSF: Full fetch complete (5582 records). [2025-09-26T21:05:09.230790] [DEBUG] [VALIDATOR ] RSF: Validating primary data. [2025-09-26T21:05:09.513052] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-04. [2025-09-26T21:05:09.643760] [DEBUG] [VALIDATOR ] RSF: All expected trading days are present. [2025-09-26T21:05:09.643876] [DEBUG] [VALIDATOR ] RSF: Primary data validation passed. [2025-09-26T21:05:09.644089] [INFO ] [MAIN ] RSF: Fetched primary data is valid. [2025-09-26T21:05:09.644282] [DEBUG] [LOCAL ] RSF: Saving primary data. [2025-09-26T21:05:09.644987] [DEBUG] [LOCAL ] RSF: Trimmed 5582 records to 4192 (keeping 200 days of data) [2025-09-26T21:05:09.702419] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-26T21:05:09.715001] [DEBUG] [LOCAL ] RSF: Primary data saved (4192 records). [2025-09-26T21:05:09.715563] [INFO ] [MAIN ] RSF: Full history saved. [2025-09-26T21:05:09.715726] [INFO ] [MAIN ] Update Progress: 1835/2371 symbols completed. RSF took 18.9s. Estimated remaining: 1h 11m 36s. Rate: 7.5 symbols/min [2025-09-26T21:05:09.910429] [INFO ] [MAIN ] RSI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:05:09.970456] [DEBUG] [LOCAL ] RSI: Loaded 47388 existing records from primary storage. [2025-09-26T21:05:09.970697] [INFO ] [MAIN ] RSI: Loaded 47388 existing records. [2025-09-26T21:05:10.193830] [WARN ] [MAIN ] RSI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:05:10.194118] [INFO ] [MAIN ] RSI: Wiping existing primary data before full refresh. [2025-09-26T21:05:10.194179] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-09-26T21:05:10.195401] [DEBUG] [LOCAL ] RSI: Deleted primary data file. [2025-09-26T21:05:10.195470] [INFO ] [MAIN ] RSI: Starting full primary refresh. [2025-09-26T21:05:10.316965] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-05. [2025-09-26T21:05:10.810915] [INFO ] [REMOTE ] RSI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:05:11.111763] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-07. [2025-09-26T21:05:11.497389] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-26T21:05:11.911749] [INFO ] [REMOTE ] RSI: Fetching primary data for 2024-12. [2025-09-26T21:05:12.118710] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-26T21:05:12.558381] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-26T21:05:12.711709] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-08. [2025-09-26T21:05:13.511704] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-05. [2025-09-26T21:05:13.578254] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-26T21:05:14.085781] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-26T21:05:14.311735] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-01. [2025-09-26T21:05:15.111730] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-09. [2025-09-26T21:05:15.351550] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-26T21:05:15.911735] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-06. [2025-09-26T21:05:16.099008] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-26T21:05:16.282491] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-26T21:05:16.288179] [INFO ] [REMOTE ] RS: Full fetch complete (39419 records). [2025-09-26T21:05:16.288485] [DEBUG] [VALIDATOR ] RS: Validating primary data. [2025-09-26T21:05:16.682848] [DEBUG] [VALIDATOR ] RS: All expected trading days are present. [2025-09-26T21:05:16.683016] [DEBUG] [VALIDATOR ] RS: Primary data validation passed. [2025-09-26T21:05:16.684036] [INFO ] [MAIN ] RS: Fetched primary data is valid. [2025-09-26T21:05:16.684103] [DEBUG] [LOCAL ] RS: Saving primary data. [2025-09-26T21:05:16.685232] [DEBUG] [LOCAL ] RS: Trimmed 39419 records to 25864 (keeping 200 days of data) [2025-09-26T21:05:16.744524] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-06. [2025-09-26T21:05:16.872330] [DEBUG] [LOCAL ] RS: Primary data saved (25864 records). [2025-09-26T21:05:16.872500] [INFO ] [MAIN ] RS: Full history saved. [2025-09-26T21:05:16.872600] [INFO ] [MAIN ] Update Progress: 1836/2371 symbols completed. RS took 29.6s. Estimated remaining: 1h 11m 28s. Rate: 7.5 symbols/min [2025-09-26T21:05:17.057521] [INFO ] [MAIN ] RSKD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:05:17.103172] [DEBUG] [LOCAL ] RSKD: Loaded 34089 existing records from primary storage. [2025-09-26T21:05:17.103379] [INFO ] [MAIN ] RSKD: Loaded 34089 existing records. [2025-09-26T21:05:17.290142] [WARN ] [MAIN ] RSKD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:05:17.290459] [INFO ] [MAIN ] RSKD: Wiping existing primary data before full refresh. [2025-09-26T21:05:17.290511] [INFO ] [LOCAL ] RSKD: Starting deletion of primary data. [2025-09-26T21:05:17.291438] [DEBUG] [LOCAL ] RSKD: Deleted primary data file. [2025-09-26T21:05:17.291502] [INFO ] [MAIN ] RSKD: Starting full primary refresh. [2025-09-26T21:05:17.518135] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-02. [2025-09-26T21:05:17.724688] [INFO ] [REMOTE ] RSKD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:05:17.764228] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-26T21:05:18.316897] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2024-12. [2025-09-26T21:05:18.336096] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-26T21:05:19.111717] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-07. [2025-09-26T21:05:19.150503] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T21:05:19.255739] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-26T21:05:19.911719] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-07. [2025-09-26T21:05:20.536745] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-26T21:05:20.711815] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-03. [2025-09-26T21:05:21.511720] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-01. [2025-09-26T21:05:21.690592] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-26T21:05:22.311725] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-08. [2025-09-26T21:05:22.626630] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-26T21:05:22.865085] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-26T21:05:23.111723] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-08. [2025-09-26T21:05:23.525874] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-26T21:05:23.911734] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-02. [2025-09-26T21:05:24.651822] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-26T21:05:24.711774] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-04. [2025-09-26T21:05:25.231202] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-26T21:05:25.511722] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-09. [2025-09-26T21:05:26.311770] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-09. [2025-09-26T21:05:26.397963] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-26T21:05:27.058468] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-26T21:05:27.068273] [INFO ] [REMOTE ] RRX: Full fetch complete (58088 records). [2025-09-26T21:05:27.068455] [DEBUG] [VALIDATOR ] RRX: Validating primary data. [2025-09-26T21:05:27.116875] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-05. [2025-09-26T21:05:27.500174] [DEBUG] [VALIDATOR ] RRX: All expected trading days are present. [2025-09-26T21:05:27.500572] [DEBUG] [VALIDATOR ] RRX: Primary data validation passed. [2025-09-26T21:05:27.501751] [INFO ] [MAIN ] RRX: Fetched primary data is valid. [2025-09-26T21:05:27.501875] [DEBUG] [LOCAL ] RRX: Saving primary data. [2025-09-26T21:05:27.506902] [DEBUG] [LOCAL ] RRX: Trimmed 58088 records to 41752 (keeping 200 days of data) [2025-09-26T21:05:27.660385] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-26T21:05:27.673866] [INFO ] [REMOTE ] RSG: Full fetch complete (67976 records). [2025-09-26T21:05:27.674708] [DEBUG] [VALIDATOR ] RSG: Validating primary data. [2025-09-26T21:05:27.934531] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-03. [2025-09-26T21:05:28.189742] [DEBUG] [VALIDATOR ] RSG: All expected trading days are present. [2025-09-26T21:05:28.190367] [DEBUG] [VALIDATOR ] RSG: Primary data validation passed. [2025-09-26T21:05:28.191969] [INFO ] [MAIN ] RSG: Fetched primary data is valid. [2025-09-26T21:05:28.192053] [DEBUG] [LOCAL ] RSG: Saving primary data. [2025-09-26T21:05:28.196686] [DEBUG] [LOCAL ] RSG: Trimmed 67976 records to 48173 (keeping 200 days of data) [2025-09-26T21:05:28.472478] [DEBUG] [LOCAL ] RRX: Primary data saved (41752 records). [2025-09-26T21:05:28.473161] [INFO ] [MAIN ] RRX: Full history saved. [2025-09-26T21:05:28.473552] [INFO ] [MAIN ] Update Progress: 1837/2371 symbols completed. RRX took 47.1s. Estimated remaining: 1h 11m 21s. Rate: 7.5 symbols/min [2025-09-26T21:05:28.702097] [DEBUG] [LOCAL ] RSG: Primary data saved (48173 records). [2025-09-26T21:05:28.702271] [INFO ] [MAIN ] RSG: Full history saved. [2025-09-26T21:05:28.702384] [INFO ] [MAIN ] Update Progress: 1838/2371 symbols completed. RSG took 35.5s. Estimated remaining: 1h 11m 10s. Rate: 7.5 symbols/min [2025-09-26T21:05:29.072139] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-26T21:05:29.082320] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-06. [2025-09-26T21:05:29.432388] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-26T21:05:29.511756] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-04. [2025-09-26T21:05:30.656574] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-26T21:05:30.672616] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-07. [2025-09-26T21:05:30.926334] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-26T21:05:31.111757] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-05. [2025-09-26T21:05:32.134957] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-26T21:05:32.145670] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-08. [2025-09-26T21:05:32.204062] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-26T21:05:32.711761] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-06. [2025-09-26T21:05:33.683351] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-26T21:05:33.695474] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-09. [2025-09-26T21:05:34.089603] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-26T21:05:34.311739] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-07. [2025-09-26T21:05:35.378043] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-26T21:05:35.388634] [INFO ] [REMOTE ] RSI: Full fetch complete (69399 records). [2025-09-26T21:05:35.388892] [DEBUG] [VALIDATOR ] RSI: Validating primary data. [2025-09-26T21:05:35.696593] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-26T21:05:35.771462] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-08. [2025-09-26T21:05:35.875070] [DEBUG] [VALIDATOR ] RSI: All expected trading days are present. [2025-09-26T21:05:35.875171] [DEBUG] [VALIDATOR ] RSI: Primary data validation passed. [2025-09-26T21:05:35.876173] [INFO ] [MAIN ] RSI: Fetched primary data is valid. [2025-09-26T21:05:35.876242] [DEBUG] [LOCAL ] RSI: Saving primary data. [2025-09-26T21:05:35.877939] [DEBUG] [LOCAL ] RSI: Trimmed 69399 records to 47695 (keeping 200 days of data) [2025-09-26T21:05:36.192998] [DEBUG] [LOCAL ] RSI: Primary data saved (47695 records). [2025-09-26T21:05:36.193167] [INFO ] [MAIN ] RSI: Full history saved. [2025-09-26T21:05:36.193280] [INFO ] [MAIN ] Update Progress: 1839/2371 symbols completed. RSI took 26.5s. Estimated remaining: 1h 11m 2s. Rate: 7.5 symbols/min [2025-09-26T21:05:37.295073] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-26T21:05:37.303292] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-09. [2025-09-26T21:05:38.621154] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-26T21:05:38.628144] [INFO ] [REMOTE ] RSKD: Full fetch complete (48294 records). [2025-09-26T21:05:38.628321] [DEBUG] [VALIDATOR ] RSKD: Validating primary data. [2025-09-26T21:05:39.041103] [DEBUG] [VALIDATOR ] RSKD: All expected trading days are present. [2025-09-26T21:05:39.041194] [DEBUG] [VALIDATOR ] RSKD: Primary data validation passed. [2025-09-26T21:05:39.042044] [INFO ] [MAIN ] RSKD: Fetched primary data is valid. [2025-09-26T21:05:39.042111] [DEBUG] [LOCAL ] RSKD: Saving primary data. [2025-09-26T21:05:39.043305] [DEBUG] [LOCAL ] RSKD: Trimmed 48294 records to 34254 (keeping 200 days of data) [2025-09-26T21:05:39.259861] [DEBUG] [LOCAL ] RSKD: Primary data saved (34254 records). [2025-09-26T21:05:39.260066] [INFO ] [MAIN ] RSKD: Full history saved. [2025-09-26T21:05:39.260200] [INFO ] [MAIN ] Update Progress: 1840/2371 symbols completed. RSKD took 22.4s. Estimated remaining: 1h 10m 53s. Rate: 7.5 symbols/min [2025-09-26T21:05:39.970484] [INFO ] [MAIN ] RTO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:05:39.999500] [INFO ] [MAIN ] RTX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:05:40.034894] [INFO ] [MAIN ] RVLV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:05:40.053840] [INFO ] [MAIN ] RVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:05:40.106260] [DEBUG] [LOCAL ] RVT: Loaded 27248 existing records from primary storage. [2025-09-26T21:05:40.106709] [INFO ] [MAIN ] RVT: Loaded 27248 existing records. [2025-09-26T21:05:40.268461] [DEBUG] [LOCAL ] RTO: Loaded 40564 existing records from primary storage. [2025-09-26T21:05:40.325256] [INFO ] [MAIN ] RTO: Loaded 40564 existing records. [2025-09-26T21:05:40.354811] [DEBUG] [LOCAL ] RVLV: Loaded 48170 existing records from primary storage. [2025-09-26T21:05:40.355736] [INFO ] [MAIN ] RVLV: Loaded 48170 existing records. [2025-09-26T21:05:40.450721] [WARN ] [MAIN ] RVT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:05:40.467997] [DEBUG] [LOCAL ] RTX: Loaded 54098 existing records from primary storage. [2025-09-26T21:05:40.488861] [INFO ] [MAIN ] RVT: Wiping existing primary data before full refresh. [2025-09-26T21:05:40.500107] [INFO ] [LOCAL ] RVT: Starting deletion of primary data. [2025-09-26T21:05:40.552392] [DEBUG] [LOCAL ] RVT: Deleted primary data file. [2025-09-26T21:05:40.563070] [INFO ] [MAIN ] RVT: Starting full primary refresh. [2025-09-26T21:05:40.520000] [INFO ] [MAIN ] RTX: Loaded 54098 existing records. [2025-09-26T21:05:40.996320] [WARN ] [MAIN ] RTO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:05:41.087829] [INFO ] [MAIN ] RTO: Wiping existing primary data before full refresh. [2025-09-26T21:05:41.098918] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-09-26T21:05:41.099085] [WARN ] [MAIN ] RVLV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:05:41.145809] [DEBUG] [LOCAL ] RTO: Deleted primary data file. [2025-09-26T21:05:41.161248] [INFO ] [MAIN ] RTO: Starting full primary refresh. [2025-09-26T21:05:41.200411] [INFO ] [MAIN ] RVLV: Wiping existing primary data before full refresh. [2025-09-26T21:05:41.239316] [WARN ] [MAIN ] RTX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:05:41.262133] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-09-26T21:05:41.286546] [INFO ] [MAIN ] RTX: Wiping existing primary data before full refresh. [2025-09-26T21:05:41.293588] [DEBUG] [LOCAL ] RVLV: Deleted primary data file. [2025-09-26T21:05:41.350883] [INFO ] [MAIN ] RVLV: Starting full primary refresh. [2025-09-26T21:05:41.332475] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-09-26T21:05:41.394806] [DEBUG] [LOCAL ] RTX: Deleted primary data file. [2025-09-26T21:05:41.457152] [INFO ] [MAIN ] RTX: Starting full primary refresh. [2025-09-26T21:05:41.805208] [INFO ] [REMOTE ] RVT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:05:41.875250] [INFO ] [REMOTE ] RVT: Fetching primary data for 2024-12. [2025-09-26T21:05:42.483011] [INFO ] [REMOTE ] RTO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:05:42.528235] [INFO ] [REMOTE ] RVLV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:05:42.542627] [INFO ] [REMOTE ] RTO: Fetching primary data for 2024-12. [2025-09-26T21:05:42.547156] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2024-12. [2025-09-26T21:05:42.627326] [INFO ] [REMOTE ] RTX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:05:42.627638] [INFO ] [REMOTE ] RTX: Fetching primary data for 2024-12. [2025-09-26T21:05:43.478828] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-26T21:05:43.490287] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-01. [2025-09-26T21:05:43.693068] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-26T21:05:43.700193] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-01. [2025-09-26T21:05:43.996721] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-26T21:05:44.007004] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-01. [2025-09-26T21:05:44.139973] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-26T21:05:44.148637] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-01. [2025-09-26T21:05:44.341063] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-26T21:05:44.352734] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-02. [2025-09-26T21:05:45.182597] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-26T21:05:45.189747] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-02. [2025-09-26T21:05:45.271263] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-26T21:05:45.282563] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-03. [2025-09-26T21:05:45.349300] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-26T21:05:45.392923] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-26T21:05:45.511728] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-02. [2025-09-26T21:05:46.097409] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-26T21:05:46.194971] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-26T21:05:46.311724] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-04. [2025-09-26T21:05:46.940603] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-26T21:05:47.111728] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-03. [2025-09-26T21:05:47.231709] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-26T21:05:47.911728] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-02. [2025-09-26T21:05:48.490505] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-26T21:05:48.711729] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-04. [2025-09-26T21:05:49.511737] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-03. [2025-09-26T21:05:49.637533] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-26T21:05:50.057454] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-26T21:05:50.311773] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-03. [2025-09-26T21:05:51.111724] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-05. [2025-09-26T21:05:51.238459] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-26T21:05:51.911725] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-05. [2025-09-26T21:05:52.128752] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-26T21:05:52.584985] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T21:05:52.711710] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-04. [2025-09-26T21:05:52.774703] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-26T21:05:53.511757] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-06. [2025-09-26T21:05:54.311733] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-06. [2025-09-26T21:05:54.528066] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-26T21:05:54.682259] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-26T21:05:54.871426] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-26T21:05:55.111764] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-07. [2025-09-26T21:05:55.911706] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-07. [2025-09-26T21:05:56.051797] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-26T21:05:56.711783] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-08. [2025-09-26T21:05:57.282322] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-26T21:05:57.511734] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-08. [2025-09-26T21:05:57.649826] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-26T21:05:58.311736] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-09. [2025-09-26T21:05:58.814928] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-26T21:05:59.111724] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-04. [2025-09-26T21:05:59.199469] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-26T21:05:59.210900] [INFO ] [REMOTE ] RTX: Full fetch complete (77734 records). [2025-09-26T21:05:59.211101] [DEBUG] [VALIDATOR ] RTX: Validating primary data. [2025-09-26T21:05:59.632863] [DEBUG] [VALIDATOR ] RTX: All expected trading days are present. [2025-09-26T21:05:59.632975] [DEBUG] [VALIDATOR ] RTX: Primary data validation passed. [2025-09-26T21:05:59.634063] [INFO ] [MAIN ] RTX: Fetched primary data is valid. [2025-09-26T21:05:59.634133] [DEBUG] [LOCAL ] RTX: Saving primary data. [2025-09-26T21:05:59.637157] [DEBUG] [LOCAL ] RTX: Trimmed 77734 records to 54488 (keeping 200 days of data) [2025-09-26T21:05:59.911956] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-09. [2025-09-26T21:06:00.022412] [DEBUG] [LOCAL ] RTX: Primary data saved (54488 records). [2025-09-26T21:06:00.022605] [INFO ] [MAIN ] RTX: Full history saved. [2025-09-26T21:06:00.022768] [INFO ] [MAIN ] Update Progress: 1841/2371 symbols completed. RTX took 20.8s. Estimated remaining: 1h 10m 48s. Rate: 7.5 symbols/min [2025-09-26T21:06:00.203158] [INFO ] [MAIN ] RVTY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:06:00.249266] [DEBUG] [LOCAL ] RVTY: Loaded 47880 existing records from primary storage. [2025-09-26T21:06:00.249445] [INFO ] [MAIN ] RVTY: Loaded 47880 existing records. [2025-09-26T21:06:00.435372] [WARN ] [MAIN ] RVTY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:06:00.435633] [INFO ] [MAIN ] RVTY: Wiping existing primary data before full refresh. [2025-09-26T21:06:00.435720] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-09-26T21:06:00.436903] [DEBUG] [LOCAL ] RVTY: Deleted primary data file. [2025-09-26T21:06:00.436967] [INFO ] [MAIN ] RVTY: Starting full primary refresh. [2025-09-26T21:06:00.716025] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-05. [2025-09-26T21:06:00.822703] [INFO ] [REMOTE ] RVTY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:06:01.050953] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-26T21:06:01.279422] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-26T21:06:01.285620] [INFO ] [REMOTE ] RVT: Full fetch complete (40005 records). [2025-09-26T21:06:01.285868] [DEBUG] [VALIDATOR ] RVT: Validating primary data. [2025-09-26T21:06:01.516941] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-05. [2025-09-26T21:06:01.725188] [DEBUG] [VALIDATOR ] RVT: All expected trading days are present. [2025-09-26T21:06:01.725326] [DEBUG] [VALIDATOR ] RVT: Primary data validation passed. [2025-09-26T21:06:01.726463] [INFO ] [MAIN ] RVT: Fetched primary data is valid. [2025-09-26T21:06:01.726533] [DEBUG] [LOCAL ] RVT: Saving primary data. [2025-09-26T21:06:01.727829] [DEBUG] [LOCAL ] RVT: Trimmed 40005 records to 27362 (keeping 200 days of data) [2025-09-26T21:06:01.926551] [DEBUG] [LOCAL ] RVT: Primary data saved (27362 records). [2025-09-26T21:06:01.926739] [INFO ] [MAIN ] RVT: Full history saved. [2025-09-26T21:06:01.926908] [INFO ] [MAIN ] Update Progress: 1842/2371 symbols completed. RVT took 22.7s. Estimated remaining: 1h 10m 39s. Rate: 7.5 symbols/min [2025-09-26T21:06:02.117931] [INFO ] [MAIN ] RWT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:06:02.169388] [DEBUG] [LOCAL ] RWT: Loaded 41085 existing records from primary storage. [2025-09-26T21:06:02.169552] [INFO ] [MAIN ] RWT: Loaded 41085 existing records. [2025-09-26T21:06:02.321299] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2024-12. [2025-09-26T21:06:02.375891] [WARN ] [MAIN ] RWT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:06:02.376941] [INFO ] [MAIN ] RWT: Wiping existing primary data before full refresh. [2025-09-26T21:06:02.377230] [INFO ] [LOCAL ] RWT: Starting deletion of primary data. [2025-09-26T21:06:02.386047] [DEBUG] [LOCAL ] RWT: Deleted primary data file. [2025-09-26T21:06:02.401579] [INFO ] [MAIN ] RWT: Starting full primary refresh. [2025-09-26T21:06:02.408985] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-26T21:06:02.818362] [INFO ] [REMOTE ] RWT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:06:03.111763] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-06. [2025-09-26T21:06:03.364591] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-26T21:06:03.911726] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-06. [2025-09-26T21:06:04.009593] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-26T21:06:04.668402] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-26T21:06:04.711680] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-07. [2025-09-26T21:06:05.511727] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-01. [2025-09-26T21:06:05.565620] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-26T21:06:06.265818] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-26T21:06:06.311711] [INFO ] [REMOTE ] RWT: Fetching primary data for 2024-12. [2025-09-26T21:06:06.891776] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-26T21:06:07.111736] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-02. [2025-09-26T21:06:07.911736] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-07. [2025-09-26T21:06:07.986144] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-26T21:06:08.711705] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-01. [2025-09-26T21:06:08.746857] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-26T21:06:09.516842] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-08. [2025-09-26T21:06:09.531924] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-26T21:06:10.311706] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-03. [2025-09-26T21:06:10.436221] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-26T21:06:11.111702] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-08. [2025-09-26T21:06:11.221480] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-26T21:06:11.911727] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-09. [2025-09-26T21:06:12.293494] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-26T21:06:12.711726] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-02. [2025-09-26T21:06:12.747782] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-26T21:06:13.511718] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-09. [2025-09-26T21:06:13.648025] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-26T21:06:13.656303] [INFO ] [REMOTE ] RTO: Full fetch complete (58410 records). [2025-09-26T21:06:13.656445] [DEBUG] [VALIDATOR ] RTO: Validating primary data. [2025-09-26T21:06:14.093551] [DEBUG] [VALIDATOR ] RTO: All expected trading days are present. [2025-09-26T21:06:14.093721] [DEBUG] [VALIDATOR ] RTO: Primary data validation passed. [2025-09-26T21:06:14.094771] [INFO ] [MAIN ] RTO: Fetched primary data is valid. [2025-09-26T21:06:14.094942] [DEBUG] [LOCAL ] RTO: Saving primary data. [2025-09-26T21:06:14.096570] [DEBUG] [LOCAL ] RTO: Trimmed 58410 records to 40847 (keeping 200 days of data) [2025-09-26T21:06:14.252633] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-26T21:06:14.324969] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-04. [2025-09-26T21:06:14.410709] [DEBUG] [LOCAL ] RTO: Primary data saved (40847 records). [2025-09-26T21:06:14.410883] [INFO ] [MAIN ] RTO: Full history saved. [2025-09-26T21:06:14.411046] [INFO ] [MAIN ] Update Progress: 1843/2371 symbols completed. RTO took 35.1s. Estimated remaining: 1h 10m 32s. Rate: 7.5 symbols/min [2025-09-26T21:06:14.595594] [INFO ] [MAIN ] RWTN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:06:14.595887] [DEBUG] [LOCAL ] RWTN: No existing data file found in primary storage. [2025-09-26T21:06:14.595946] [WARN ] [MAIN ] RWTN: No existing data found, performing full refresh instead. [2025-09-26T21:06:14.596097] [INFO ] [MAIN ] RWTN: Wiping existing primary data before full refresh. [2025-09-26T21:06:14.596142] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-09-26T21:06:14.596190] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-09-26T21:06:14.596225] [INFO ] [MAIN ] RWTN: Starting full primary refresh. [2025-09-26T21:06:15.034041] [INFO ] [REMOTE ] RWTN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:06:15.116859] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-03. [2025-09-26T21:06:15.135390] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-26T21:06:15.146378] [INFO ] [REMOTE ] RVLV: Full fetch complete (68722 records). [2025-09-26T21:06:15.146559] [DEBUG] [VALIDATOR ] RVLV: Validating primary data. [2025-09-26T21:06:15.592324] [DEBUG] [VALIDATOR ] RVLV: All expected trading days are present. [2025-09-26T21:06:15.592441] [DEBUG] [VALIDATOR ] RVLV: Primary data validation passed. [2025-09-26T21:06:15.593591] [INFO ] [MAIN ] RVLV: Fetched primary data is valid. [2025-09-26T21:06:15.593688] [DEBUG] [LOCAL ] RVLV: Saving primary data. [2025-09-26T21:06:15.595372] [DEBUG] [LOCAL ] RVLV: Trimmed 68722 records to 48453 (keeping 200 days of data) [2025-09-26T21:06:15.905121] [DEBUG] [LOCAL ] RVLV: Primary data saved (48453 records). [2025-09-26T21:06:15.905361] [INFO ] [MAIN ] RVLV: Full history saved. [2025-09-26T21:06:15.905486] [INFO ] [MAIN ] Update Progress: 1844/2371 symbols completed. RVLV took 36.6s. Estimated remaining: 1h 10m 22s. Rate: 7.5 symbols/min [2025-09-26T21:06:15.940554] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2024-12. [2025-09-26T21:06:16.095725] [INFO ] [MAIN ] RWTO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:06:16.096039] [DEBUG] [LOCAL ] RWTO: No existing data file found in primary storage. [2025-09-26T21:06:16.096148] [WARN ] [MAIN ] RWTO: No existing data found, performing full refresh instead. [2025-09-26T21:06:16.096510] [INFO ] [MAIN ] RWTO: Wiping existing primary data before full refresh. [2025-09-26T21:06:16.096615] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-09-26T21:06:16.096807] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-09-26T21:06:16.097015] [INFO ] [MAIN ] RWTO: Starting full primary refresh. [2025-09-26T21:06:16.415362] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-26T21:06:16.576803] [INFO ] [REMOTE ] RWTO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:06:16.616393] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-26T21:06:16.717935] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-01. [2025-09-26T21:06:16.723733] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-26T21:06:17.363904] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-26T21:06:17.511715] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-04. [2025-09-26T21:06:18.311757] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-02. [2025-09-26T21:06:18.806961] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-26T21:06:19.111699] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-05. [2025-09-26T21:06:19.213961] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-26T21:06:19.911743] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-05. [2025-09-26T21:06:20.711772] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-03. [2025-09-26T21:06:20.975562] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-26T21:06:21.217986] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-26T21:06:21.501446] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-26T21:06:21.511671] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-06. [2025-09-26T21:06:22.311747] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2024-12. [2025-09-26T21:06:22.822916] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-26T21:06:23.109294] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-26T21:06:23.117313] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-06. [2025-09-26T21:06:23.911746] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-07. [2025-09-26T21:06:24.711746] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-01. [2025-09-26T21:06:24.768530] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-26T21:06:25.361205] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-26T21:06:25.502891] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-26T21:06:25.511845] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-02. [2025-09-26T21:06:26.144223] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-26T21:06:26.311750] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-07. [2025-09-26T21:06:27.111768] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-08. [2025-09-26T21:06:27.911740] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-03. [2025-09-26T21:06:28.140443] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-26T21:06:28.431878] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-26T21:06:28.711746] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-04. [2025-09-26T21:06:28.834123] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-26T21:06:29.384995] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-26T21:06:29.511745] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-09. [2025-09-26T21:06:30.311741] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-05. [2025-09-26T21:06:30.813136] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-26T21:06:31.111731] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-08. [2025-09-26T21:06:31.229452] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T21:06:31.238874] [INFO ] [REMOTE ] RWT: Full fetch complete (58765 records). [2025-09-26T21:06:31.239080] [DEBUG] [VALIDATOR ] RWT: Validating primary data. [2025-09-26T21:06:31.664537] [DEBUG] [VALIDATOR ] RWT: All expected trading days are present. [2025-09-26T21:06:31.664622] [DEBUG] [VALIDATOR ] RWT: Primary data validation passed. [2025-09-26T21:06:31.665542] [INFO ] [MAIN ] RWT: Fetched primary data is valid. [2025-09-26T21:06:31.665598] [DEBUG] [LOCAL ] RWT: Saving primary data. [2025-09-26T21:06:31.667012] [DEBUG] [LOCAL ] RWT: Trimmed 58765 records to 41352 (keeping 200 days of data) [2025-09-26T21:06:31.912532] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-06. [2025-09-26T21:06:31.914589] [DEBUG] [LOCAL ] RWT: Primary data saved (41352 records). [2025-09-26T21:06:31.914708] [INFO ] [MAIN ] RWT: Full history saved. [2025-09-26T21:06:31.914864] [INFO ] [MAIN ] Update Progress: 1845/2371 symbols completed. RWT took 30.0s. Estimated remaining: 1h 10m 16s. Rate: 7.5 symbols/min [2025-09-26T21:06:32.125759] [INFO ] [MAIN ] RWTP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:06:32.126008] [DEBUG] [LOCAL ] RWTP: No existing data file found in primary storage. [2025-09-26T21:06:32.126066] [WARN ] [MAIN ] RWTP: No existing data found, performing full refresh instead. [2025-09-26T21:06:32.126243] [INFO ] [MAIN ] RWTP: Wiping existing primary data before full refresh. [2025-09-26T21:06:32.126296] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-09-26T21:06:32.126367] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-09-26T21:06:32.126404] [INFO ] [MAIN ] RWTP: Starting full primary refresh. [2025-09-26T21:06:32.454523] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-26T21:06:32.511693] [INFO ] [REMOTE ] RWTP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:06:32.711734] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-07. [2025-09-26T21:06:33.100550] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-26T21:06:33.361117] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-26T21:06:33.511728] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-08. [2025-09-26T21:06:34.154940] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-26T21:06:34.311723] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-04. [2025-09-26T21:06:34.857381] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-26T21:06:35.111724] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-05. [2025-09-26T21:06:35.597575] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-26T21:06:35.911727] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-06. [2025-09-26T21:06:36.298072] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-26T21:06:36.711766] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-09. [2025-09-26T21:06:37.361619] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-26T21:06:37.363925] [INFO ] [REMOTE ] RWTO: Full fetch complete (4801 records). [2025-09-26T21:06:37.364019] [DEBUG] [VALIDATOR ] RWTO: Validating primary data. [2025-09-26T21:06:37.520451] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-07. [2025-09-26T21:06:37.562425] [WARN ] [VALIDATOR ] RWTO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-26T21:06:37.563191] [FATAL] [MAIN ] RWTO: Fetched primary data is invalid. Refusing to save it. [2025-09-26T21:06:37.563311] [WARN ] [MAIN ] RWTO: Deleting existing primary and derivative data due to validation failure. [2025-09-26T21:06:37.563372] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-09-26T21:06:37.563446] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-09-26T21:06:37.563488] [INFO ] [LOCAL ] RWTO: Starting deletion of derivative data. [2025-09-26T21:06:37.563551] [DEBUG] [LOCAL ] RWTO: No derivative data file found to delete. [2025-09-26T21:06:37.563789] [INFO ] [MAIN ] Update Progress: 1846/2371 symbols completed. RWTO took 21.7s. Estimated remaining: 1h 10m 8s. Rate: 7.5 symbols/min [2025-09-26T21:06:37.750901] [INFO ] [MAIN ] RXO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:06:37.799090] [DEBUG] [LOCAL ] RXO: Loaded 48150 existing records from primary storage. [2025-09-26T21:06:37.799240] [INFO ] [MAIN ] RXO: Loaded 48150 existing records. [2025-09-26T21:06:38.000538] [WARN ] [MAIN ] RXO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:06:38.001233] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-26T21:06:38.002516] [INFO ] [MAIN ] RXO: Wiping existing primary data before full refresh. [2025-09-26T21:06:38.002574] [INFO ] [LOCAL ] RXO: Starting deletion of primary data. [2025-09-26T21:06:38.003697] [DEBUG] [LOCAL ] RXO: Deleted primary data file. [2025-09-26T21:06:38.003759] [INFO ] [MAIN ] RXO: Starting full primary refresh. [2025-09-26T21:06:38.316845] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2024-12. [2025-09-26T21:06:38.406126] [INFO ] [REMOTE ] RXO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:06:38.628599] [DEBUG] [REMOTE ] RWTP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:06:38.629017] [WARN ] [REMOTE ] RWTP: No data returned for month 2024-12 [2025-09-26T21:06:39.111736] [INFO ] [REMOTE ] RXO: Fetching primary data for 2024-12. [2025-09-26T21:06:39.911748] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-09. [2025-09-26T21:06:40.711694] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-01. [2025-09-26T21:06:40.805243] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-26T21:06:41.331057] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-26T21:06:41.477703] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-26T21:06:41.487486] [INFO ] [REMOTE ] RVTY: Full fetch complete (66460 records). [2025-09-26T21:06:41.487705] [DEBUG] [VALIDATOR ] RVTY: Validating primary data. [2025-09-26T21:06:41.520335] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-02. [2025-09-26T21:06:41.926768] [DEBUG] [VALIDATOR ] RVTY: All expected trading days are present. [2025-09-26T21:06:41.926998] [DEBUG] [VALIDATOR ] RVTY: Primary data validation passed. [2025-09-26T21:06:41.928189] [INFO ] [MAIN ] RVTY: Fetched primary data is valid. [2025-09-26T21:06:41.928356] [DEBUG] [LOCAL ] RVTY: Saving primary data. [2025-09-26T21:06:41.930035] [DEBUG] [LOCAL ] RVTY: Trimmed 66460 records to 48199 (keeping 200 days of data) [2025-09-26T21:06:42.248570] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-26T21:06:42.258180] [DEBUG] [LOCAL ] RVTY: Primary data saved (48199 records). [2025-09-26T21:06:42.258342] [INFO ] [MAIN ] RVTY: Full history saved. [2025-09-26T21:06:42.258453] [INFO ] [MAIN ] Update Progress: 1847/2371 symbols completed. RVTY took 42.2s. Estimated remaining: 1h 9m 59s. Rate: 7.5 symbols/min [2025-09-26T21:06:42.316793] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-03. [2025-09-26T21:06:42.452116] [INFO ] [MAIN ] RY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:06:42.507046] [DEBUG] [LOCAL ] RY: Loaded 48274 existing records from primary storage. [2025-09-26T21:06:42.507295] [INFO ] [MAIN ] RY: Loaded 48274 existing records. [2025-09-26T21:06:42.722869] [WARN ] [MAIN ] RY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:06:42.723218] [INFO ] [MAIN ] RY: Wiping existing primary data before full refresh. [2025-09-26T21:06:42.723279] [INFO ] [LOCAL ] RY: Starting deletion of primary data. [2025-09-26T21:06:42.724692] [DEBUG] [LOCAL ] RY: Deleted primary data file. [2025-09-26T21:06:42.724755] [INFO ] [MAIN ] RY: Starting full primary refresh. [2025-09-26T21:06:43.003318] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-26T21:06:43.114962] [INFO ] [REMOTE ] RY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:06:43.115116] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-01. [2025-09-26T21:06:43.911742] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-08. [2025-09-26T21:06:44.525219] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-26T21:06:44.708733] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-26T21:06:44.717711] [INFO ] [REMOTE ] RY: Fetching primary data for 2024-12. [2025-09-26T21:06:45.511745] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-02. [2025-09-26T21:06:46.311696] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-04. [2025-09-26T21:06:46.587126] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-26T21:06:46.923935] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-26T21:06:47.020905] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-26T21:06:47.111733] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-03. [2025-09-26T21:06:47.911719] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-01. [2025-09-26T21:06:48.674533] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-26T21:06:48.711687] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-05. [2025-09-26T21:06:49.231952] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-26T21:06:49.507541] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-26T21:06:49.518376] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-09. [2025-09-26T21:06:50.021375] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-26T21:06:50.022790] [INFO ] [REMOTE ] RWTN: Full fetch complete (3130 records). [2025-09-26T21:06:50.022880] [DEBUG] [VALIDATOR ] RWTN: Validating primary data. [2025-09-26T21:06:50.227870] [WARN ] [VALIDATOR ] RWTN: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-26T21:06:50.228135] [FATAL] [MAIN ] RWTN: Fetched primary data is invalid. Refusing to save it. [2025-09-26T21:06:50.228259] [WARN ] [MAIN ] RWTN: Deleting existing primary and derivative data due to validation failure. [2025-09-26T21:06:50.228338] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-09-26T21:06:50.228420] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-09-26T21:06:50.228488] [INFO ] [LOCAL ] RWTN: Starting deletion of derivative data. [2025-09-26T21:06:50.228564] [DEBUG] [LOCAL ] RWTN: No derivative data file found to delete. [2025-09-26T21:06:50.228677] [INFO ] [MAIN ] Update Progress: 1848/2371 symbols completed. RWTN took 35.8s. Estimated remaining: 1h 9m 51s. Rate: 7.5 symbols/min [2025-09-26T21:06:50.316804] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-02. [2025-09-26T21:06:50.439196] [INFO ] [MAIN ] RYAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:06:50.475308] [DEBUG] [LOCAL ] RYAM: Loaded 35428 existing records from primary storage. [2025-09-26T21:06:50.475458] [INFO ] [MAIN ] RYAM: Loaded 35428 existing records. [2025-09-26T21:06:50.668830] [WARN ] [MAIN ] RYAM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:06:50.669085] [INFO ] [MAIN ] RYAM: Wiping existing primary data before full refresh. [2025-09-26T21:06:50.669131] [INFO ] [LOCAL ] RYAM: Starting deletion of primary data. [2025-09-26T21:06:50.670305] [DEBUG] [LOCAL ] RYAM: Deleted primary data file. [2025-09-26T21:06:50.670366] [INFO ] [MAIN ] RYAM: Starting full primary refresh. [2025-09-26T21:06:51.097025] [INFO ] [REMOTE ] RYAM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:06:51.111712] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2024-12. [2025-09-26T21:06:51.911683] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-04. [2025-09-26T21:06:52.016321] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-26T21:06:52.109119] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-26T21:06:52.711727] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-06. [2025-09-26T21:06:53.054866] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-26T21:06:53.317282] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-26T21:06:53.511726] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-05. [2025-09-26T21:06:54.311763] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-03. [2025-09-26T21:06:55.111690] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-01. [2025-09-26T21:06:55.208865] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-26T21:06:55.911687] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-06. [2025-09-26T21:06:56.107547] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-26T21:06:56.315320] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-26T21:06:56.711733] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-04. [2025-09-26T21:06:57.413202] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-26T21:06:57.511720] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-02. [2025-09-26T21:06:58.311719] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-07. [2025-09-26T21:06:58.614063] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-26T21:06:58.719509] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-26T21:06:59.111738] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-07. [2025-09-26T21:06:59.675034] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-26T21:06:59.911702] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-03. [2025-09-26T21:07:00.222426] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-26T21:07:00.711722] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-08. [2025-09-26T21:07:01.218693] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-26T21:07:01.428132] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-26T21:07:01.511703] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-08. [2025-09-26T21:07:02.311725] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-09. [2025-09-26T21:07:02.931991] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-26T21:07:02.933611] [INFO ] [REMOTE ] RWTP: Full fetch complete (4482 records). [2025-09-26T21:07:02.933728] [DEBUG] [VALIDATOR ] RWTP: Validating primary data. [2025-09-26T21:07:03.112352] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-05. [2025-09-26T21:07:03.143358] [WARN ] [VALIDATOR ] RWTP: Validation failed - insufficient historical data. Have 166 unique days, need 200 days [2025-09-26T21:07:03.144537] [FATAL] [MAIN ] RWTP: Fetched primary data is invalid. Refusing to save it. [2025-09-26T21:07:03.144829] [WARN ] [MAIN ] RWTP: Deleting existing primary and derivative data due to validation failure. [2025-09-26T21:07:03.144915] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-09-26T21:07:03.145090] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-09-26T21:07:03.145185] [INFO ] [LOCAL ] RWTP: Starting deletion of derivative data. [2025-09-26T21:07:03.145282] [DEBUG] [LOCAL ] RWTP: No derivative data file found to delete. [2025-09-26T21:07:03.145570] [INFO ] [MAIN ] Update Progress: 1849/2371 symbols completed. RWTP took 31.2s. Estimated remaining: 1h 9m 44s. Rate: 7.5 symbols/min [2025-09-26T21:07:03.339801] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-26T21:07:03.377411] [INFO ] [MAIN ] RYAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:07:03.421343] [DEBUG] [LOCAL ] RYAN: Loaded 44574 existing records from primary storage. [2025-09-26T21:07:03.421489] [INFO ] [MAIN ] RYAN: Loaded 44574 existing records. [2025-09-26T21:07:03.605120] [WARN ] [MAIN ] RYAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:07:03.605359] [INFO ] [MAIN ] RYAN: Wiping existing primary data before full refresh. [2025-09-26T21:07:03.605408] [INFO ] [LOCAL ] RYAN: Starting deletion of primary data. [2025-09-26T21:07:03.606579] [DEBUG] [LOCAL ] RYAN: Deleted primary data file. [2025-09-26T21:07:03.606670] [INFO ] [MAIN ] RYAN: Starting full primary refresh. [2025-09-26T21:07:03.916894] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-04. [2025-09-26T21:07:03.986501] [INFO ] [REMOTE ] RYAN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:07:04.711741] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-09. [2025-09-26T21:07:04.975162] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-26T21:07:05.009962] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-26T21:07:05.511722] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-05. [2025-09-26T21:07:06.045082] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-26T21:07:06.055421] [INFO ] [REMOTE ] RXO: Full fetch complete (68182 records). [2025-09-26T21:07:06.055584] [DEBUG] [VALIDATOR ] RXO: Validating primary data. [2025-09-26T21:07:06.322938] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-06. [2025-09-26T21:07:06.464033] [DEBUG] [VALIDATOR ] RXO: All expected trading days are present. [2025-09-26T21:07:06.464138] [DEBUG] [VALIDATOR ] RXO: Primary data validation passed. [2025-09-26T21:07:06.465246] [INFO ] [MAIN ] RXO: Fetched primary data is valid. [2025-09-26T21:07:06.465317] [DEBUG] [LOCAL ] RXO: Saving primary data. [2025-09-26T21:07:06.466936] [DEBUG] [LOCAL ] RXO: Trimmed 68182 records to 48520 (keeping 200 days of data) [2025-09-26T21:07:06.781622] [DEBUG] [LOCAL ] RXO: Primary data saved (48520 records). [2025-09-26T21:07:06.781894] [INFO ] [MAIN ] RXO: Full history saved. [2025-09-26T21:07:06.782051] [INFO ] [MAIN ] Update Progress: 1850/2371 symbols completed. RXO took 29.2s. Estimated remaining: 1h 9m 35s. Rate: 7.5 symbols/min [2025-09-26T21:07:06.958980] [INFO ] [MAIN ] RYI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:07:06.982694] [DEBUG] [LOCAL ] RYI: Loaded 21726 existing records from primary storage. [2025-09-26T21:07:06.982884] [INFO ] [MAIN ] RYI: Loaded 21726 existing records. [2025-09-26T21:07:07.114584] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2024-12. [2025-09-26T21:07:07.176750] [WARN ] [MAIN ] RYI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:07:07.177593] [INFO ] [MAIN ] RYI: Wiping existing primary data before full refresh. [2025-09-26T21:07:07.177714] [INFO ] [LOCAL ] RYI: Starting deletion of primary data. [2025-09-26T21:07:07.206450] [DEBUG] [LOCAL ] RYI: Deleted primary data file. [2025-09-26T21:07:07.206554] [INFO ] [MAIN ] RYI: Starting full primary refresh. [2025-09-26T21:07:07.208108] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-26T21:07:07.592068] [INFO ] [REMOTE ] RYI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:07:07.911762] [INFO ] [REMOTE ] RYI: Fetching primary data for 2024-12. [2025-09-26T21:07:08.122181] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-26T21:07:08.704057] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-26T21:07:08.712567] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-07. [2025-09-26T21:07:09.024623] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-26T21:07:09.511724] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-06. [2025-09-26T21:07:10.311733] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-01. [2025-09-26T21:07:10.373448] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-26T21:07:10.835183] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-26T21:07:11.111681] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-01. [2025-09-26T21:07:11.511145] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-26T21:07:11.911692] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-08. [2025-09-26T21:07:12.672783] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-26T21:07:12.711741] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-02. [2025-09-26T21:07:13.513772] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-02. [2025-09-26T21:07:13.517252] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-26T21:07:13.988147] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-26T21:07:14.311758] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-09. [2025-09-26T21:07:14.658279] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-26T21:07:15.111776] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-07. [2025-09-26T21:07:15.911737] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-03. [2025-09-26T21:07:15.997959] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-26T21:07:16.009065] [INFO ] [REMOTE ] RY: Full fetch complete (68577 records). [2025-09-26T21:07:16.009292] [DEBUG] [VALIDATOR ] RY: Validating primary data. [2025-09-26T21:07:16.633552] [DEBUG] [VALIDATOR ] RY: All expected trading days are present. [2025-09-26T21:07:16.633839] [DEBUG] [VALIDATOR ] RY: Primary data validation passed. [2025-09-26T21:07:16.638621] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-26T21:07:16.636339] [INFO ] [MAIN ] RY: Fetched primary data is valid. [2025-09-26T21:07:16.647287] [DEBUG] [LOCAL ] RY: Saving primary data. [2025-09-26T21:07:16.649616] [DEBUG] [LOCAL ] RY: Trimmed 68577 records to 48606 (keeping 200 days of data) [2025-09-26T21:07:16.719475] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-03. [2025-09-26T21:07:17.043163] [DEBUG] [LOCAL ] RY: Primary data saved (48606 records). [2025-09-26T21:07:17.043337] [INFO ] [MAIN ] RY: Full history saved. [2025-09-26T21:07:17.043460] [INFO ] [MAIN ] Update Progress: 1851/2371 symbols completed. RY took 34.8s. Estimated remaining: 1h 9m 27s. Rate: 7.5 symbols/min [2025-09-26T21:07:17.257669] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-26T21:07:17.286811] [INFO ] [MAIN ] RYN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:07:17.341994] [DEBUG] [LOCAL ] RYN: Loaded 45996 existing records from primary storage. [2025-09-26T21:07:17.342179] [INFO ] [MAIN ] RYN: Loaded 45996 existing records. [2025-09-26T21:07:17.514004] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-08. [2025-09-26T21:07:17.546504] [WARN ] [MAIN ] RYN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:07:17.546851] [INFO ] [MAIN ] RYN: Wiping existing primary data before full refresh. [2025-09-26T21:07:17.546917] [INFO ] [LOCAL ] RYN: Starting deletion of primary data. [2025-09-26T21:07:17.547986] [DEBUG] [LOCAL ] RYN: Deleted primary data file. [2025-09-26T21:07:17.548059] [INFO ] [MAIN ] RYN: Starting full primary refresh. [2025-09-26T21:07:17.978560] [INFO ] [REMOTE ] RYN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:07:18.311695] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-04. [2025-09-26T21:07:18.487320] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-26T21:07:18.981540] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-26T21:07:19.111743] [INFO ] [REMOTE ] RYN: Fetching primary data for 2024-12. [2025-09-26T21:07:19.487680] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-26T21:07:19.911732] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-09. [2025-09-26T21:07:20.420219] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-26T21:07:20.711754] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-01. [2025-09-26T21:07:21.511888] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-04. [2025-09-26T21:07:21.517675] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-26T21:07:21.527056] [INFO ] [REMOTE ] RYAM: Full fetch complete (48932 records). [2025-09-26T21:07:21.527244] [DEBUG] [VALIDATOR ] RYAM: Validating primary data. [2025-09-26T21:07:22.031004] [DEBUG] [VALIDATOR ] RYAM: All expected trading days are present. [2025-09-26T21:07:22.031190] [DEBUG] [VALIDATOR ] RYAM: Primary data validation passed. [2025-09-26T21:07:22.032144] [INFO ] [MAIN ] RYAM: Fetched primary data is valid. [2025-09-26T21:07:22.032260] [DEBUG] [LOCAL ] RYAM: Saving primary data. [2025-09-26T21:07:22.033789] [DEBUG] [LOCAL ] RYAM: Trimmed 48932 records to 35709 (keeping 200 days of data) [2025-09-26T21:07:22.145024] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-26T21:07:22.277988] [DEBUG] [LOCAL ] RYAM: Primary data saved (35709 records). [2025-09-26T21:07:22.278162] [INFO ] [MAIN ] RYAM: Full history saved. [2025-09-26T21:07:22.278279] [INFO ] [MAIN ] Update Progress: 1852/2371 symbols completed. RYAM took 32.0s. Estimated remaining: 1h 9m 19s. Rate: 7.5 symbols/min [2025-09-26T21:07:22.316871] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-05. [2025-09-26T21:07:22.465326] [INFO ] [MAIN ] RZB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:07:22.473212] [DEBUG] [LOCAL ] RZB: Loaded 6274 existing records from primary storage. [2025-09-26T21:07:22.473311] [INFO ] [MAIN ] RZB: Loaded 6274 existing records. [2025-09-26T21:07:22.668548] [WARN ] [MAIN ] RZB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:07:22.668904] [INFO ] [MAIN ] RZB: Wiping existing primary data before full refresh. [2025-09-26T21:07:22.668965] [INFO ] [LOCAL ] RZB: Starting deletion of primary data. [2025-09-26T21:07:22.669314] [DEBUG] [LOCAL ] RZB: Deleted primary data file. [2025-09-26T21:07:22.669382] [INFO ] [MAIN ] RZB: Starting full primary refresh. [2025-09-26T21:07:23.062833] [INFO ] [REMOTE ] RZB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:07:23.111706] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-02. [2025-09-26T21:07:23.392736] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-26T21:07:23.415449] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-26T21:07:23.911730] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-05. [2025-09-26T21:07:24.510976] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-26T21:07:24.711751] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-06. [2025-09-26T21:07:25.496341] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-26T21:07:25.511678] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-06. [2025-09-26T21:07:25.762512] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-26T21:07:26.311740] [INFO ] [REMOTE ] RZB: Fetching primary data for 2024-12. [2025-09-26T21:07:27.078079] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-26T21:07:27.104833] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-26T21:07:27.111662] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-01. [2025-09-26T21:07:27.742912] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-26T21:07:27.911736] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-07. [2025-09-26T21:07:28.711737] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-07. [2025-09-26T21:07:29.516866] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-02. [2025-09-26T21:07:29.540970] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-26T21:07:29.925341] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-26T21:07:30.169185] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-26T21:07:30.311732] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-08. [2025-09-26T21:07:31.111694] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-03. [2025-09-26T21:07:31.513506] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-26T21:07:31.891461] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-26T21:07:31.911662] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-04. [2025-09-26T21:07:32.524956] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-26T21:07:32.711695] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-09. [2025-09-26T21:07:33.511722] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-03. [2025-09-26T21:07:33.878840] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-26T21:07:33.884469] [INFO ] [REMOTE ] RYI: Full fetch complete (32377 records). [2025-09-26T21:07:33.884579] [DEBUG] [VALIDATOR ] RYI: Validating primary data. [2025-09-26T21:07:34.264936] [DEBUG] [VALIDATOR ] RYI: All expected trading days are present. [2025-09-26T21:07:34.265063] [DEBUG] [VALIDATOR ] RYI: Primary data validation passed. [2025-09-26T21:07:34.266492] [INFO ] [MAIN ] RYI: Fetched primary data is valid. [2025-09-26T21:07:34.266565] [DEBUG] [LOCAL ] RYI: Saving primary data. [2025-09-26T21:07:34.268010] [DEBUG] [LOCAL ] RYI: Trimmed 32377 records to 21835 (keeping 200 days of data) [2025-09-26T21:07:34.338464] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-05. [2025-09-26T21:07:34.432304] [DEBUG] [LOCAL ] RYI: Primary data saved (21835 records). [2025-09-26T21:07:34.432490] [INFO ] [MAIN ] RYI: Full history saved. [2025-09-26T21:07:34.432594] [INFO ] [MAIN ] Update Progress: 1853/2371 symbols completed. RYI took 27.7s. Estimated remaining: 1h 9m 12s. Rate: 7.5 symbols/min [2025-09-26T21:07:34.636973] [INFO ] [MAIN ] RZC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:07:34.651235] [DEBUG] [LOCAL ] RZC: Loaded 6805 existing records from primary storage. [2025-09-26T21:07:34.651415] [INFO ] [MAIN ] RZC: Loaded 6805 existing records. [2025-09-26T21:07:34.839604] [WARN ] [MAIN ] RZC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:07:34.840447] [INFO ] [MAIN ] RZC: Wiping existing primary data before full refresh. [2025-09-26T21:07:34.840535] [INFO ] [LOCAL ] RZC: Starting deletion of primary data. [2025-09-26T21:07:34.841127] [DEBUG] [LOCAL ] RZC: Deleted primary data file. [2025-09-26T21:07:34.841233] [INFO ] [MAIN ] RZC: Starting full primary refresh. [2025-09-26T21:07:35.050504] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-26T21:07:35.114775] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-08. [2025-09-26T21:07:35.241410] [INFO ] [REMOTE ] RZC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:07:35.278869] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-26T21:07:35.911763] [INFO ] [REMOTE ] RZC: Fetching primary data for 2024-12. [2025-09-26T21:07:36.515961] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-26T21:07:36.658954] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-26T21:07:36.711732] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-06. [2025-09-26T21:07:37.511738] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-09. [2025-09-26T21:07:37.731816] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-26T21:07:38.311781] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-01. [2025-09-26T21:07:39.008746] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-26T21:07:39.120065] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-02. [2025-09-26T21:07:39.140000] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-26T21:07:39.153751] [INFO ] [REMOTE ] RYAN: Full fetch complete (63815 records). [2025-09-26T21:07:39.153906] [DEBUG] [VALIDATOR ] RYAN: Validating primary data. [2025-09-26T21:07:39.554704] [DEBUG] [VALIDATOR ] RYAN: All expected trading days are present. [2025-09-26T21:07:39.554844] [DEBUG] [VALIDATOR ] RYAN: Primary data validation passed. [2025-09-26T21:07:39.555901] [INFO ] [MAIN ] RYAN: Fetched primary data is valid. [2025-09-26T21:07:39.555995] [DEBUG] [LOCAL ] RYAN: Saving primary data. [2025-09-26T21:07:39.557639] [DEBUG] [LOCAL ] RYAN: Trimmed 63815 records to 44960 (keeping 200 days of data) [2025-09-26T21:07:39.851224] [DEBUG] [LOCAL ] RYAN: Primary data saved (44960 records). [2025-09-26T21:07:39.851372] [INFO ] [MAIN ] RYAN: Full history saved. [2025-09-26T21:07:39.851550] [INFO ] [MAIN ] Update Progress: 1854/2371 symbols completed. RYAN took 36.7s. Estimated remaining: 1h 9m 3s. Rate: 7.5 symbols/min [2025-09-26T21:07:39.916909] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-07. [2025-09-26T21:07:40.034525] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-26T21:07:40.037681] [INFO ] [MAIN ] S: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:07:40.099765] [DEBUG] [LOCAL ] S: Loaded 53928 existing records from primary storage. [2025-09-26T21:07:40.099953] [INFO ] [MAIN ] S: Loaded 53928 existing records. [2025-09-26T21:07:40.286989] [WARN ] [MAIN ] S: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:07:40.288381] [INFO ] [MAIN ] S: Wiping existing primary data before full refresh. [2025-09-26T21:07:40.288437] [INFO ] [LOCAL ] S: Starting deletion of primary data. [2025-09-26T21:07:40.290092] [DEBUG] [LOCAL ] S: Deleted primary data file. [2025-09-26T21:07:40.290151] [INFO ] [MAIN ] S: Starting full primary refresh. [2025-09-26T21:07:40.582354] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-26T21:07:40.662062] [INFO ] [REMOTE ] S: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:07:40.711672] [INFO ] [REMOTE ] S: Fetching primary data for 2024-12. [2025-09-26T21:07:41.511737] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-08. [2025-09-26T21:07:42.194803] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-26T21:07:42.311693] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-03. [2025-09-26T21:07:42.804311] [INFO ] [REMOTE ] S: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-26T21:07:43.107098] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-26T21:07:43.111689] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-04. [2025-09-26T21:07:43.875867] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-26T21:07:43.911684] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-05. [2025-09-26T21:07:44.664315] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-26T21:07:44.711771] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-04. [2025-09-26T21:07:45.511778] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-06. [2025-09-26T21:07:46.232753] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-26T21:07:46.311700] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-09. [2025-09-26T21:07:46.487547] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-26T21:07:46.696792] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-26T21:07:46.698353] [INFO ] [REMOTE ] RZB: Full fetch complete (8699 records). [2025-09-26T21:07:46.698428] [DEBUG] [VALIDATOR ] RZB: Validating primary data. [2025-09-26T21:07:47.088692] [DEBUG] [VALIDATOR ] RZB: All expected trading days are present. [2025-09-26T21:07:47.088795] [DEBUG] [VALIDATOR ] RZB: Primary data validation passed. [2025-09-26T21:07:47.089025] [INFO ] [MAIN ] RZB: Fetched primary data is valid. [2025-09-26T21:07:47.089064] [DEBUG] [LOCAL ] RZB: Saving primary data. [2025-09-26T21:07:47.089554] [DEBUG] [LOCAL ] RZB: Trimmed 8699 records to 6291 (keeping 200 days of data) [2025-09-26T21:07:47.115197] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-07. [2025-09-26T21:07:47.140663] [DEBUG] [LOCAL ] RZB: Primary data saved (6291 records). [2025-09-26T21:07:47.141233] [INFO ] [MAIN ] RZB: Full history saved. [2025-09-26T21:07:47.141397] [INFO ] [MAIN ] Update Progress: 1855/2371 symbols completed. RZB took 24.9s. Estimated remaining: 1h 8m 55s. Rate: 7.5 symbols/min [2025-09-26T21:07:47.323370] [INFO ] [MAIN ] SA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:07:47.384879] [DEBUG] [LOCAL ] SA: Loaded 43469 existing records from primary storage. [2025-09-26T21:07:47.385136] [INFO ] [MAIN ] SA: Loaded 43469 existing records. [2025-09-26T21:07:47.575508] [WARN ] [MAIN ] SA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:07:47.576009] [INFO ] [MAIN ] SA: Wiping existing primary data before full refresh. [2025-09-26T21:07:47.576120] [INFO ] [LOCAL ] SA: Starting deletion of primary data. [2025-09-26T21:07:47.577394] [DEBUG] [LOCAL ] SA: Deleted primary data file. [2025-09-26T21:07:47.577462] [INFO ] [MAIN ] SA: Starting full primary refresh. [2025-09-26T21:07:47.691063] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-26T21:07:47.916916] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-05. [2025-09-26T21:07:47.987746] [INFO ] [REMOTE ] SA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:07:48.711763] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-08. [2025-09-26T21:07:49.511779] [INFO ] [REMOTE ] SA: Fetching primary data for 2024-12. [2025-09-26T21:07:49.606239] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-26T21:07:49.637108] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-26T21:07:50.311755] [INFO ] [REMOTE ] S: Fetching primary data for 2025-01. [2025-09-26T21:07:51.008069] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-26T21:07:51.111750] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-06. [2025-09-26T21:07:51.911711] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-01. [2025-09-26T21:07:52.293254] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-26T21:07:52.353506] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-26T21:07:52.711751] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-09. [2025-09-26T21:07:53.395220] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-26T21:07:53.398146] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-26T21:07:53.409597] [INFO ] [REMOTE ] RZC: Full fetch complete (9852 records). [2025-09-26T21:07:53.410544] [DEBUG] [VALIDATOR ] RZC: Validating primary data. [2025-09-26T21:07:53.516894] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-02. [2025-09-26T21:07:53.855469] [DEBUG] [VALIDATOR ] RZC: All expected trading days are present. [2025-09-26T21:07:53.855606] [DEBUG] [VALIDATOR ] RZC: Primary data validation passed. [2025-09-26T21:07:53.855923] [INFO ] [MAIN ] RZC: Fetched primary data is valid. [2025-09-26T21:07:53.855986] [DEBUG] [LOCAL ] RZC: Saving primary data. [2025-09-26T21:07:53.856549] [DEBUG] [LOCAL ] RZC: Trimmed 9852 records to 6838 (keeping 200 days of data) [2025-09-26T21:07:53.899980] [DEBUG] [LOCAL ] RZC: Primary data saved (6838 records). [2025-09-26T21:07:53.900111] [INFO ] [MAIN ] RZC: Full history saved. [2025-09-26T21:07:53.900231] [INFO ] [MAIN ] Update Progress: 1856/2371 symbols completed. RZC took 19.5s. Estimated remaining: 1h 8m 46s. Rate: 7.5 symbols/min [2025-09-26T21:07:54.077635] [INFO ] [MAIN ] SABA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:07:54.089605] [DEBUG] [LOCAL ] SABA: Loaded 9248 existing records from primary storage. [2025-09-26T21:07:54.089759] [INFO ] [MAIN ] SABA: Loaded 9248 existing records. [2025-09-26T21:07:54.274543] [WARN ] [MAIN ] SABA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:07:54.274838] [INFO ] [MAIN ] SABA: Wiping existing primary data before full refresh. [2025-09-26T21:07:54.274926] [INFO ] [LOCAL ] SABA: Starting deletion of primary data. [2025-09-26T21:07:54.275294] [DEBUG] [LOCAL ] SABA: Deleted primary data file. [2025-09-26T21:07:54.275355] [INFO ] [MAIN ] SABA: Starting full primary refresh. [2025-09-26T21:07:54.320790] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-07. [2025-09-26T21:07:54.655267] [INFO ] [REMOTE ] SABA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:07:55.111729] [INFO ] [REMOTE ] SABA: Fetching primary data for 2024-12. [2025-09-26T21:07:55.152258] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-26T21:07:55.911710] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-03. [2025-09-26T21:07:56.099243] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-26T21:07:56.273032] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-26T21:07:56.711763] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-08. [2025-09-26T21:07:57.346191] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-26T21:07:57.511738] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-01. [2025-09-26T21:07:58.311747] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-04. [2025-09-26T21:07:58.420302] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-26T21:07:58.551869] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-26T21:07:59.111732] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-02. [2025-09-26T21:07:59.911732] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-09. [2025-09-26T21:07:59.992093] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-26T21:08:00.031317] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-26T21:08:00.711729] [INFO ] [REMOTE ] S: Fetching primary data for 2025-02. [2025-09-26T21:08:01.338399] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-26T21:08:01.349550] [INFO ] [REMOTE ] RYN: Full fetch complete (64755 records). [2025-09-26T21:08:01.349756] [DEBUG] [VALIDATOR ] RYN: Validating primary data. [2025-09-26T21:08:01.516813] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-05. [2025-09-26T21:08:01.775539] [DEBUG] [VALIDATOR ] RYN: All expected trading days are present. [2025-09-26T21:08:01.775638] [DEBUG] [VALIDATOR ] RYN: Primary data validation passed. [2025-09-26T21:08:01.776766] [INFO ] [MAIN ] RYN: Fetched primary data is valid. [2025-09-26T21:08:01.776858] [DEBUG] [LOCAL ] RYN: Saving primary data. [2025-09-26T21:08:01.779720] [DEBUG] [LOCAL ] RYN: Trimmed 64755 records to 46335 (keeping 200 days of data) [2025-09-26T21:08:02.092715] [DEBUG] [LOCAL ] RYN: Primary data saved (46335 records). [2025-09-26T21:08:02.092864] [INFO ] [MAIN ] RYN: Full history saved. [2025-09-26T21:08:02.093043] [INFO ] [MAIN ] Update Progress: 1857/2371 symbols completed. RYN took 45.0s. Estimated remaining: 1h 8m 38s. Rate: 7.5 symbols/min [2025-09-26T21:08:02.297387] [INFO ] [MAIN ] SAFE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:08:02.311714] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-03. [2025-09-26T21:08:02.345282] [DEBUG] [LOCAL ] SAFE: Loaded 30617 existing records from primary storage. [2025-09-26T21:08:02.345499] [INFO ] [MAIN ] SAFE: Loaded 30617 existing records. [2025-09-26T21:08:02.563680] [WARN ] [MAIN ] SAFE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:08:02.564255] [INFO ] [MAIN ] SAFE: Wiping existing primary data before full refresh. [2025-09-26T21:08:02.564350] [INFO ] [LOCAL ] SAFE: Starting deletion of primary data. [2025-09-26T21:08:02.565382] [DEBUG] [LOCAL ] SAFE: Deleted primary data file. [2025-09-26T21:08:02.565462] [INFO ] [MAIN ] SAFE: Starting full primary refresh. [2025-09-26T21:08:02.715638] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-26T21:08:02.935431] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-26T21:08:03.016972] [INFO ] [REMOTE ] SAFE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:08:03.111691] [INFO ] [REMOTE ] S: Fetching primary data for 2025-03. [2025-09-26T21:08:03.211088] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-26T21:08:03.911714] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-06. [2025-09-26T21:08:04.711707] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2024-12. [2025-09-26T21:08:05.010345] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-26T21:08:05.473294] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-26T21:08:05.511721] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-04. [2025-09-26T21:08:06.154634] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-26T21:08:06.311720] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-07. [2025-09-26T21:08:06.588310] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-26T21:08:07.111728] [INFO ] [REMOTE ] S: Fetching primary data for 2025-04. [2025-09-26T21:08:07.911727] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-05. [2025-09-26T21:08:07.954448] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-26T21:08:08.711721] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-01. [2025-09-26T21:08:08.791580] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-26T21:08:09.258685] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-26T21:08:09.511761] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-06. [2025-09-26T21:08:09.847281] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-26T21:08:10.311728] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-02. [2025-09-26T21:08:10.352107] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-26T21:08:11.111708] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-07. [2025-09-26T21:08:11.576916] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-26T21:08:11.899583] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-26T21:08:11.911677] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-08. [2025-09-26T21:08:12.711719] [INFO ] [REMOTE ] S: Fetching primary data for 2025-05. [2025-09-26T21:08:12.824947] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-26T21:08:13.511755] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-09. [2025-09-26T21:08:14.311749] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-08. [2025-09-26T21:08:14.326936] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-26T21:08:14.331686] [INFO ] [REMOTE ] SABA: Full fetch complete (15453 records). [2025-09-26T21:08:14.331919] [DEBUG] [VALIDATOR ] SABA: Validating primary data. [2025-09-26T21:08:14.758432] [DEBUG] [VALIDATOR ] SABA: All expected trading days are present. [2025-09-26T21:08:14.758769] [DEBUG] [VALIDATOR ] SABA: Primary data validation passed. [2025-09-26T21:08:14.759334] [INFO ] [MAIN ] SABA: Fetched primary data is valid. [2025-09-26T21:08:14.759425] [DEBUG] [LOCAL ] SABA: Saving primary data. [2025-09-26T21:08:14.760562] [DEBUG] [LOCAL ] SABA: Trimmed 15453 records to 9306 (keeping 200 days of data) [2025-09-26T21:08:14.846507] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-26T21:08:14.872579] [DEBUG] [LOCAL ] SABA: Primary data saved (9306 records). [2025-09-26T21:08:14.872782] [INFO ] [MAIN ] SABA: Full history saved. [2025-09-26T21:08:14.872895] [INFO ] [MAIN ] Update Progress: 1858/2371 symbols completed. SABA took 21.0s. Estimated remaining: 1h 8m 32s. Rate: 7.5 symbols/min [2025-09-26T21:08:15.053073] [INFO ] [MAIN ] SAH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:08:15.078077] [DEBUG] [LOCAL ] SAH: Loaded 22254 existing records from primary storage. [2025-09-26T21:08:15.078234] [INFO ] [MAIN ] SAH: Loaded 22254 existing records. [2025-09-26T21:08:15.116911] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-03. [2025-09-26T21:08:15.276931] [WARN ] [MAIN ] SAH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:08:15.277367] [INFO ] [MAIN ] SAH: Wiping existing primary data before full refresh. [2025-09-26T21:08:15.277427] [INFO ] [LOCAL ] SAH: Starting deletion of primary data. [2025-09-26T21:08:15.278179] [DEBUG] [LOCAL ] SAH: Deleted primary data file. [2025-09-26T21:08:15.278243] [INFO ] [MAIN ] SAH: Starting full primary refresh. [2025-09-26T21:08:15.639978] [INFO ] [REMOTE ] SAH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:08:15.911774] [INFO ] [REMOTE ] SAH: Fetching primary data for 2024-12. [2025-09-26T21:08:16.110865] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-26T21:08:16.494243] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-26T21:08:16.537716] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-26T21:08:16.711802] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-01. [2025-09-26T21:08:17.511796] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-04. [2025-09-26T21:08:17.779119] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-26T21:08:18.311767] [INFO ] [REMOTE ] S: Fetching primary data for 2025-06. [2025-09-26T21:08:18.890018] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-26T21:08:19.111722] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-05. [2025-09-26T21:08:19.911739] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-02. [2025-09-26T21:08:20.354921] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-26T21:08:20.439832] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-26T21:08:20.711718] [INFO ] [REMOTE ] S: Fetching primary data for 2025-07. [2025-09-26T21:08:20.909797] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-26T21:08:21.511745] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-03. [2025-09-26T21:08:22.311720] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-09. [2025-09-26T21:08:22.725992] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-26T21:08:22.873164] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-26T21:08:23.111741] [INFO ] [REMOTE ] S: Fetching primary data for 2025-08. [2025-09-26T21:08:23.716297] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-26T21:08:23.726790] [INFO ] [REMOTE ] SA: Full fetch complete (62088 records). [2025-09-26T21:08:23.727040] [DEBUG] [VALIDATOR ] SA: Validating primary data. [2025-09-26T21:08:23.920587] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-06. [2025-09-26T21:08:24.162161] [DEBUG] [VALIDATOR ] SA: All expected trading days are present. [2025-09-26T21:08:24.162297] [DEBUG] [VALIDATOR ] SA: Primary data validation passed. [2025-09-26T21:08:24.163584] [INFO ] [MAIN ] SA: Fetched primary data is valid. [2025-09-26T21:08:24.163683] [DEBUG] [LOCAL ] SA: Saving primary data. [2025-09-26T21:08:24.165307] [DEBUG] [LOCAL ] SA: Trimmed 62088 records to 43820 (keeping 200 days of data) [2025-09-26T21:08:24.443738] [DEBUG] [LOCAL ] SA: Primary data saved (43820 records). [2025-09-26T21:08:24.443911] [INFO ] [MAIN ] SA: Full history saved. [2025-09-26T21:08:24.444041] [INFO ] [MAIN ] Update Progress: 1859/2371 symbols completed. SA took 37.3s. Estimated remaining: 1h 8m 24s. Rate: 7.5 symbols/min [2025-09-26T21:08:24.635913] [INFO ] [MAIN ] SAJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:08:24.636108] [DEBUG] [LOCAL ] SAJ: No existing data file found in primary storage. [2025-09-26T21:08:24.636148] [WARN ] [MAIN ] SAJ: No existing data found, performing full refresh instead. [2025-09-26T21:08:24.636320] [INFO ] [MAIN ] SAJ: Wiping existing primary data before full refresh. [2025-09-26T21:08:24.636365] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-09-26T21:08:24.636407] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-09-26T21:08:24.636442] [INFO ] [MAIN ] SAJ: Starting full primary refresh. [2025-09-26T21:08:24.720171] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-04. [2025-09-26T21:08:25.065790] [INFO ] [REMOTE ] SAJ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:08:25.179595] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-26T21:08:25.231328] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-26T21:08:25.511729] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-07. [2025-09-26T21:08:26.049953] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-26T21:08:26.311721] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2024-12. [2025-09-26T21:08:26.710409] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-26T21:08:26.894587] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-26T21:08:27.111751] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-01. [2025-09-26T21:08:27.523072] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-26T21:08:27.911760] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-08. [2025-09-26T21:08:28.711776] [INFO ] [REMOTE ] S: Fetching primary data for 2025-09. [2025-09-26T21:08:29.335601] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-26T21:08:29.511729] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-02. [2025-09-26T21:08:29.884356] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-26T21:08:30.311737] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-05. [2025-09-26T21:08:30.810718] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-26T21:08:30.821980] [INFO ] [REMOTE ] S: Full fetch complete (77546 records). [2025-09-26T21:08:30.822181] [DEBUG] [VALIDATOR ] S: Validating primary data. [2025-09-26T21:08:31.116852] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-09. [2025-09-26T21:08:31.241780] [DEBUG] [VALIDATOR ] S: All expected trading days are present. [2025-09-26T21:08:31.241950] [DEBUG] [VALIDATOR ] S: Primary data validation passed. [2025-09-26T21:08:31.243319] [INFO ] [MAIN ] S: Fetched primary data is valid. [2025-09-26T21:08:31.243399] [DEBUG] [LOCAL ] S: Saving primary data. [2025-09-26T21:08:31.246977] [DEBUG] [LOCAL ] S: Trimmed 77546 records to 54315 (keeping 200 days of data) [2025-09-26T21:08:31.490754] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-26T21:08:31.625360] [DEBUG] [LOCAL ] S: Primary data saved (54315 records). [2025-09-26T21:08:31.625529] [INFO ] [MAIN ] S: Full history saved. [2025-09-26T21:08:31.625688] [INFO ] [MAIN ] Update Progress: 1860/2371 symbols completed. S took 51.8s. Estimated remaining: 1h 8m 16s. Rate: 7.5 symbols/min [2025-09-26T21:08:31.852161] [INFO ] [MAIN ] SAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:08:31.875247] [DEBUG] [LOCAL ] SAM: Loaded 21650 existing records from primary storage. [2025-09-26T21:08:31.875450] [INFO ] [MAIN ] SAM: Loaded 21650 existing records. [2025-09-26T21:08:31.916890] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-06. [2025-09-26T21:08:32.116003] [WARN ] [MAIN ] SAM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:08:32.116411] [INFO ] [MAIN ] SAM: Wiping existing primary data before full refresh. [2025-09-26T21:08:32.116471] [INFO ] [LOCAL ] SAM: Starting deletion of primary data. [2025-09-26T21:08:32.117132] [DEBUG] [LOCAL ] SAM: Deleted primary data file. [2025-09-26T21:08:32.117209] [INFO ] [MAIN ] SAM: Starting full primary refresh. [2025-09-26T21:08:32.563346] [INFO ] [REMOTE ] SAM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:08:32.582428] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-26T21:08:32.589237] [INFO ] [REMOTE ] SAFE: Full fetch complete (45050 records). [2025-09-26T21:08:32.589399] [DEBUG] [VALIDATOR ] SAFE: Validating primary data. [2025-09-26T21:08:32.716874] [INFO ] [REMOTE ] SAM: Fetching primary data for 2024-12. [2025-09-26T21:08:32.992425] [DEBUG] [VALIDATOR ] SAFE: All expected trading days are present. [2025-09-26T21:08:32.992529] [DEBUG] [VALIDATOR ] SAFE: Primary data validation passed. [2025-09-26T21:08:32.993706] [INFO ] [MAIN ] SAFE: Fetched primary data is valid. [2025-09-26T21:08:32.993792] [DEBUG] [LOCAL ] SAFE: Saving primary data. [2025-09-26T21:08:32.994942] [DEBUG] [LOCAL ] SAFE: Trimmed 45050 records to 30819 (keeping 200 days of data) [2025-09-26T21:08:33.181799] [DEBUG] [LOCAL ] SAFE: Primary data saved (30819 records). [2025-09-26T21:08:33.181959] [INFO ] [MAIN ] SAFE: Full history saved. [2025-09-26T21:08:33.182142] [INFO ] [MAIN ] Update Progress: 1861/2371 symbols completed. SAFE took 31.1s. Estimated remaining: 1h 8m 6s. Rate: 7.5 symbols/min [2025-09-26T21:08:33.363240] [INFO ] [MAIN ] SAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:08:33.377215] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-26T21:08:33.452163] [DEBUG] [LOCAL ] SAN: Loaded 53398 existing records from primary storage. [2025-09-26T21:08:33.452378] [INFO ] [MAIN ] SAN: Loaded 53398 existing records. [2025-09-26T21:08:33.529409] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-07. [2025-09-26T21:08:33.657822] [WARN ] [MAIN ] SAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:08:33.658329] [INFO ] [MAIN ] SAN: Wiping existing primary data before full refresh. [2025-09-26T21:08:33.658424] [INFO ] [LOCAL ] SAN: Starting deletion of primary data. [2025-09-26T21:08:33.659515] [DEBUG] [LOCAL ] SAN: Deleted primary data file. [2025-09-26T21:08:33.659682] [INFO ] [MAIN ] SAN: Starting full primary refresh. [2025-09-26T21:08:33.836500] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-26T21:08:34.047478] [INFO ] [REMOTE ] SAN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:08:34.311725] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-01. [2025-09-26T21:08:34.823672] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-26T21:08:35.111714] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-08. [2025-09-26T21:08:35.538193] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-26T21:08:35.911694] [INFO ] [REMOTE ] SAN: Fetching primary data for 2024-12. [2025-09-26T21:08:36.214853] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-26T21:08:36.711778] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-03. [2025-09-26T21:08:37.094114] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-26T21:08:37.511727] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-09. [2025-09-26T21:08:37.554810] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-26T21:08:38.311693] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-04. [2025-09-26T21:08:38.535514] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-26T21:08:38.539425] [INFO ] [REMOTE ] SAH: Full fetch complete (30383 records). [2025-09-26T21:08:38.539518] [DEBUG] [VALIDATOR ] SAH: Validating primary data. [2025-09-26T21:08:38.691312] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-26T21:08:38.947734] [DEBUG] [VALIDATOR ] SAH: All expected trading days are present. [2025-09-26T21:08:38.947842] [DEBUG] [VALIDATOR ] SAH: Primary data validation passed. [2025-09-26T21:08:38.948509] [INFO ] [MAIN ] SAH: Fetched primary data is valid. [2025-09-26T21:08:38.948584] [DEBUG] [LOCAL ] SAH: Saving primary data. [2025-09-26T21:08:38.949463] [DEBUG] [LOCAL ] SAH: Trimmed 30383 records to 22368 (keeping 200 days of data) [2025-09-26T21:08:39.092004] [DEBUG] [LOCAL ] SAH: Primary data saved (22368 records). [2025-09-26T21:08:39.092153] [INFO ] [MAIN ] SAH: Full history saved. [2025-09-26T21:08:39.092279] [INFO ] [MAIN ] Update Progress: 1862/2371 symbols completed. SAH took 24.2s. Estimated remaining: 1h 7m 57s. Rate: 7.5 symbols/min [2025-09-26T21:08:39.116808] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-02. [2025-09-26T21:08:39.280957] [INFO ] [MAIN ] SAND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:08:39.338304] [DEBUG] [LOCAL ] SAND: Loaded 52153 existing records from primary storage. [2025-09-26T21:08:39.338465] [INFO ] [MAIN ] SAND: Loaded 52153 existing records. [2025-09-26T21:08:39.531500] [WARN ] [MAIN ] SAND: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:08:39.531774] [INFO ] [MAIN ] SAND: Wiping existing primary data before full refresh. [2025-09-26T21:08:39.531848] [INFO ] [LOCAL ] SAND: Starting deletion of primary data. [2025-09-26T21:08:39.533066] [DEBUG] [LOCAL ] SAND: Deleted primary data file. [2025-09-26T21:08:39.533130] [INFO ] [MAIN ] SAND: Starting full primary refresh. [2025-09-26T21:08:39.915020] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-05. [2025-09-26T21:08:39.922073] [INFO ] [REMOTE ] SAND: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:08:40.280369] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-26T21:08:40.297561] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-26T21:08:40.711734] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-01. [2025-09-26T21:08:41.511725] [INFO ] [REMOTE ] SAND: Fetching primary data for 2024-12. [2025-09-26T21:08:42.311701] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-06. [2025-09-26T21:08:42.502633] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-26T21:08:42.695163] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-26T21:08:43.112565] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-26T21:08:43.112668] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-02. [2025-09-26T21:08:43.911730] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-03. [2025-09-26T21:08:44.711698] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-01. [2025-09-26T21:08:45.057406] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-26T21:08:45.089852] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-26T21:08:45.511735] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-03. [2025-09-26T21:08:46.311742] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-04. [2025-09-26T21:08:46.491942] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-26T21:08:47.111750] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-02. [2025-09-26T21:08:47.617515] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-26T21:08:47.671847] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-26T21:08:47.911728] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-04. [2025-09-26T21:08:48.711736] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-05. [2025-09-26T21:08:48.972410] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-26T21:08:49.511732] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-07. [2025-09-26T21:08:49.858907] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-26T21:08:49.894009] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-26T21:08:49.915254] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-26T21:08:50.311750] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-08. [2025-09-26T21:08:50.749990] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-26T21:08:51.111732] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-06. [2025-09-26T21:08:51.911697] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-05. [2025-09-26T21:08:52.287583] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-26T21:08:52.711730] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-03. [2025-09-26T21:08:53.511719] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-09. [2025-09-26T21:08:53.829636] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-26T21:08:53.895683] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-26T21:08:53.896559] [INFO ] [REMOTE ] SAJ: Full fetch complete (924 records). [2025-09-26T21:08:53.896634] [DEBUG] [VALIDATOR ] SAJ: Validating primary data. [2025-09-26T21:08:53.897146] [FATAL] [VALIDATOR ] SAJ: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T21:08:53.897231] [FATAL] [MAIN ] SAJ: Fetched primary data is invalid. Refusing to save it. [2025-09-26T21:08:53.897300] [WARN ] [MAIN ] SAJ: Deleting existing primary and derivative data due to validation failure. [2025-09-26T21:08:53.897373] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-09-26T21:08:53.897443] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-09-26T21:08:53.897481] [INFO ] [LOCAL ] SAJ: Starting deletion of derivative data. [2025-09-26T21:08:53.897538] [DEBUG] [LOCAL ] SAJ: No derivative data file found to delete. [2025-09-26T21:08:53.897671] [INFO ] [MAIN ] Update Progress: 1863/2371 symbols completed. SAJ took 29.5s. Estimated remaining: 1h 7m 51s. Rate: 7.5 symbols/min [2025-09-26T21:08:54.080913] [INFO ] [MAIN ] SAP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:08:54.131232] [DEBUG] [LOCAL ] SAP: Loaded 50440 existing records from primary storage. [2025-09-26T21:08:54.131425] [INFO ] [MAIN ] SAP: Loaded 50440 existing records. [2025-09-26T21:08:54.323842] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-07. [2025-09-26T21:08:54.331017] [WARN ] [MAIN ] SAP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:08:54.332361] [INFO ] [MAIN ] SAP: Wiping existing primary data before full refresh. [2025-09-26T21:08:54.332446] [INFO ] [LOCAL ] SAP: Starting deletion of primary data. [2025-09-26T21:08:54.333991] [DEBUG] [LOCAL ] SAP: Deleted primary data file. [2025-09-26T21:08:54.334065] [INFO ] [MAIN ] SAP: Starting full primary refresh. [2025-09-26T21:08:54.712018] [INFO ] [REMOTE ] SAP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:08:54.746307] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-26T21:08:55.111734] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-06. [2025-09-26T21:08:55.403996] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-26T21:08:55.911721] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-04. [2025-09-26T21:08:56.711770] [INFO ] [REMOTE ] SAP: Fetching primary data for 2024-12. [2025-09-26T21:08:57.229283] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-26T21:08:57.511734] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-08. [2025-09-26T21:08:57.845966] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-26T21:08:58.311712] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-05. [2025-09-26T21:08:58.515424] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T21:08:58.751463] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-26T21:08:59.111745] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-07. [2025-09-26T21:08:59.911719] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-09. [2025-09-26T21:08:59.998445] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-26T21:09:00.711742] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-06. [2025-09-26T21:09:01.138724] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-26T21:09:01.144183] [INFO ] [REMOTE ] SAM: Full fetch complete (30409 records). [2025-09-26T21:09:01.144322] [DEBUG] [VALIDATOR ] SAM: Validating primary data. [2025-09-26T21:09:01.444433] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-26T21:09:01.518602] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-01. [2025-09-26T21:09:01.649615] [DEBUG] [VALIDATOR ] SAM: All expected trading days are present. [2025-09-26T21:09:01.649760] [DEBUG] [VALIDATOR ] SAM: Primary data validation passed. [2025-09-26T21:09:01.650504] [INFO ] [MAIN ] SAM: Fetched primary data is valid. [2025-09-26T21:09:01.650568] [DEBUG] [LOCAL ] SAM: Saving primary data. [2025-09-26T21:09:01.651692] [DEBUG] [LOCAL ] SAM: Trimmed 30409 records to 21766 (keeping 200 days of data) [2025-09-26T21:09:01.815488] [DEBUG] [LOCAL ] SAM: Primary data saved (21766 records). [2025-09-26T21:09:01.815638] [INFO ] [MAIN ] SAM: Full history saved. [2025-09-26T21:09:01.815794] [INFO ] [MAIN ] Update Progress: 1864/2371 symbols completed. SAM took 30.2s. Estimated remaining: 1h 7m 43s. Rate: 7.5 symbols/min [2025-09-26T21:09:02.047186] [INFO ] [MAIN ] SAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:09:02.073372] [DEBUG] [LOCAL ] SAR: Loaded 16248 existing records from primary storage. [2025-09-26T21:09:02.073567] [INFO ] [MAIN ] SAR: Loaded 16248 existing records. [2025-09-26T21:09:02.319821] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-08. [2025-09-26T21:09:02.391163] [WARN ] [MAIN ] SAR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:09:02.419561] [INFO ] [MAIN ] SAR: Wiping existing primary data before full refresh. [2025-09-26T21:09:02.440705] [INFO ] [LOCAL ] SAR: Starting deletion of primary data. [2025-09-26T21:09:02.445232] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-26T21:09:02.445364] [DEBUG] [LOCAL ] SAR: Deleted primary data file. [2025-09-26T21:09:02.476475] [INFO ] [MAIN ] SAR: Starting full primary refresh. [2025-09-26T21:09:03.001074] [INFO ] [REMOTE ] SAR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:09:03.111737] [INFO ] [REMOTE ] SAR: Fetching primary data for 2024-12. [2025-09-26T21:09:03.498929] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-26T21:09:03.911703] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-07. [2025-09-26T21:09:04.066726] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-26T21:09:04.384814] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-26T21:09:04.711734] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-09. [2025-09-26T21:09:05.511715] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-01. [2025-09-26T21:09:05.818970] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-26T21:09:06.138069] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-26T21:09:06.311695] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-02. [2025-09-26T21:09:06.665676] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-26T21:09:06.676353] [INFO ] [REMOTE ] SAN: Full fetch complete (76192 records). [2025-09-26T21:09:06.676503] [DEBUG] [VALIDATOR ] SAN: Validating primary data. [2025-09-26T21:09:07.095082] [DEBUG] [VALIDATOR ] SAN: All expected trading days are present. [2025-09-26T21:09:07.095169] [DEBUG] [VALIDATOR ] SAN: Primary data validation passed. [2025-09-26T21:09:07.096190] [INFO ] [MAIN ] SAN: Fetched primary data is valid. [2025-09-26T21:09:07.096261] [DEBUG] [LOCAL ] SAN: Saving primary data. [2025-09-26T21:09:07.098098] [DEBUG] [LOCAL ] SAN: Trimmed 76192 records to 53774 (keeping 200 days of data) [2025-09-26T21:09:07.151029] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-02. [2025-09-26T21:09:07.425862] [DEBUG] [LOCAL ] SAN: Primary data saved (53774 records). [2025-09-26T21:09:07.426033] [INFO ] [MAIN ] SAN: Full history saved. [2025-09-26T21:09:07.426166] [INFO ] [MAIN ] Update Progress: 1865/2371 symbols completed. SAN took 34.2s. Estimated remaining: 1h 7m 35s. Rate: 7.5 symbols/min [2025-09-26T21:09:07.599025] [INFO ] [MAIN ] SARO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:09:07.645072] [DEBUG] [LOCAL ] SARO: Loaded 49097 existing records from primary storage. [2025-09-26T21:09:07.645244] [INFO ] [MAIN ] SARO: Loaded 49097 existing records. [2025-09-26T21:09:07.879749] [WARN ] [MAIN ] SARO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:09:07.880009] [INFO ] [MAIN ] SARO: Wiping existing primary data before full refresh. [2025-09-26T21:09:07.880060] [INFO ] [LOCAL ] SARO: Starting deletion of primary data. [2025-09-26T21:09:07.881018] [DEBUG] [LOCAL ] SARO: Deleted primary data file. [2025-09-26T21:09:07.881080] [INFO ] [MAIN ] SARO: Starting full primary refresh. [2025-09-26T21:09:07.917541] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-08. [2025-09-26T21:09:08.274913] [INFO ] [REMOTE ] SARO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:09:08.286855] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-26T21:09:08.317238] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-26T21:09:08.711738] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-03. [2025-09-26T21:09:09.511688] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-03. [2025-09-26T21:09:09.628223] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-26T21:09:10.311713] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-09. [2025-09-26T21:09:10.609464] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-26T21:09:10.874845] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-26T21:09:11.111729] [INFO ] [REMOTE ] SARO: Fetching primary data for 2024-12. [2025-09-26T21:09:11.911723] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-04. [2025-09-26T21:09:12.124526] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-26T21:09:12.134790] [INFO ] [REMOTE ] SAND: Full fetch complete (74361 records). [2025-09-26T21:09:12.134960] [DEBUG] [VALIDATOR ] SAND: Validating primary data. [2025-09-26T21:09:12.579155] [DEBUG] [VALIDATOR ] SAND: All expected trading days are present. [2025-09-26T21:09:12.579322] [DEBUG] [VALIDATOR ] SAND: Primary data validation passed. [2025-09-26T21:09:12.580745] [INFO ] [MAIN ] SAND: Fetched primary data is valid. [2025-09-26T21:09:12.580834] [DEBUG] [LOCAL ] SAND: Saving primary data. [2025-09-26T21:09:12.582639] [DEBUG] [LOCAL ] SAND: Trimmed 74361 records to 52527 (keeping 200 days of data) [2025-09-26T21:09:12.713501] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-04. [2025-09-26T21:09:12.851563] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-26T21:09:12.960580] [DEBUG] [LOCAL ] SAND: Primary data saved (52527 records). [2025-09-26T21:09:12.960769] [INFO ] [MAIN ] SAND: Full history saved. [2025-09-26T21:09:12.960883] [INFO ] [MAIN ] Update Progress: 1866/2371 symbols completed. SAND took 33.9s. Estimated remaining: 1h 7m 26s. Rate: 7.5 symbols/min [2025-09-26T21:09:13.131970] [INFO ] [MAIN ] SAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:09:13.132171] [DEBUG] [LOCAL ] SAT: No existing data file found in primary storage. [2025-09-26T21:09:13.132226] [WARN ] [MAIN ] SAT: No existing data found, performing full refresh instead. [2025-09-26T21:09:13.132379] [INFO ] [MAIN ] SAT: Wiping existing primary data before full refresh. [2025-09-26T21:09:13.132423] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-09-26T21:09:13.132466] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-09-26T21:09:13.132502] [INFO ] [MAIN ] SAT: Starting full primary refresh. [2025-09-26T21:09:13.512829] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-01. [2025-09-26T21:09:13.512729] [INFO ] [REMOTE ] SAT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:09:13.892863] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-26T21:09:14.131415] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-26T21:09:14.311739] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-05. [2025-09-26T21:09:15.092371] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-26T21:09:15.111664] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-02. [2025-09-26T21:09:15.911734] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-05. [2025-09-26T21:09:16.465710] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-26T21:09:16.711730] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-06. [2025-09-26T21:09:16.759283] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-26T21:09:16.780966] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-26T21:09:17.511741] [INFO ] [REMOTE ] SAT: Fetching primary data for 2024-12. [2025-09-26T21:09:18.027525] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-26T21:09:18.311704] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-01. [2025-09-26T21:09:18.696688] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-26T21:09:18.708924] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-26T21:09:19.111748] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-02. [2025-09-26T21:09:19.522633] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-26T21:09:19.911737] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-07. [2025-09-26T21:09:20.711744] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-03. [2025-09-26T21:09:21.238529] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-26T21:09:21.511771] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-03. [2025-09-26T21:09:21.827628] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-26T21:09:22.311736] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-08. [2025-09-26T21:09:23.111723] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-06. [2025-09-26T21:09:23.275615] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-26T21:09:23.911702] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-04. [2025-09-26T21:09:24.228769] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-26T21:09:24.379061] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-26T21:09:24.396130] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-26T21:09:24.711745] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-04. [2025-09-26T21:09:25.511749] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-05. [2025-09-26T21:09:25.984182] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-26T21:09:26.311708] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-09. [2025-09-26T21:09:26.432844] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T21:09:27.111719] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-06. [2025-09-26T21:09:27.512454] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-26T21:09:27.911725] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-07. [2025-09-26T21:09:28.401251] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-26T21:09:28.411616] [INFO ] [REMOTE ] SAP: Full fetch complete (71728 records). [2025-09-26T21:09:28.411827] [DEBUG] [VALIDATOR ] SAP: Validating primary data. [2025-09-26T21:09:28.716921] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-05. [2025-09-26T21:09:28.845670] [DEBUG] [VALIDATOR ] SAP: All expected trading days are present. [2025-09-26T21:09:28.845787] [DEBUG] [VALIDATOR ] SAP: Primary data validation passed. [2025-09-26T21:09:28.846969] [INFO ] [MAIN ] SAP: Fetched primary data is valid. [2025-09-26T21:09:28.847039] [DEBUG] [LOCAL ] SAP: Saving primary data. [2025-09-26T21:09:28.848899] [DEBUG] [LOCAL ] SAP: Trimmed 71728 records to 50800 (keeping 200 days of data) [2025-09-26T21:09:29.093182] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-26T21:09:29.207467] [DEBUG] [LOCAL ] SAP: Primary data saved (50800 records). [2025-09-26T21:09:29.207662] [INFO ] [MAIN ] SAP: Full history saved. [2025-09-26T21:09:29.207797] [INFO ] [MAIN ] Update Progress: 1867/2371 symbols completed. SAP took 35.3s. Estimated remaining: 1h 7m 20s. Rate: 7.5 symbols/min [2025-09-26T21:09:29.394502] [INFO ] [MAIN ] SAY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:09:29.394720] [DEBUG] [LOCAL ] SAY: No existing data file found in primary storage. [2025-09-26T21:09:29.394778] [WARN ] [MAIN ] SAY: No existing data found, performing full refresh instead. [2025-09-26T21:09:29.394941] [INFO ] [MAIN ] SAY: Wiping existing primary data before full refresh. [2025-09-26T21:09:29.395001] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-09-26T21:09:29.395083] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-09-26T21:09:29.395140] [INFO ] [MAIN ] SAY: Starting full primary refresh. [2025-09-26T21:09:29.516886] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-07. [2025-09-26T21:09:29.798567] [INFO ] [REMOTE ] SAY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:09:29.949513] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-26T21:09:30.311705] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-08. [2025-09-26T21:09:30.488333] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-26T21:09:30.757582] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-26T21:09:31.111768] [INFO ] [REMOTE ] SAY: Fetching primary data for 2024-12. [2025-09-26T21:09:31.613849] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-26T21:09:31.911729] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-06. [2025-09-26T21:09:32.711722] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-01. [2025-09-26T21:09:33.100386] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-26T21:09:33.511702] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-08. [2025-09-26T21:09:33.541788] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-26T21:09:34.311694] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-07. [2025-09-26T21:09:34.644426] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-26T21:09:35.111714] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-09. [2025-09-26T21:09:35.501159] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-26T21:09:35.502060] [INFO ] [REMOTE ] SAT: Full fetch complete (1599 records). [2025-09-26T21:09:35.502177] [DEBUG] [VALIDATOR ] SAT: Validating primary data. [2025-09-26T21:09:35.688213] [WARN ] [VALIDATOR ] SAT: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-26T21:09:35.688400] [FATAL] [MAIN ] SAT: Fetched primary data is invalid. Refusing to save it. [2025-09-26T21:09:35.688479] [WARN ] [MAIN ] SAT: Deleting existing primary and derivative data due to validation failure. [2025-09-26T21:09:35.688551] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-09-26T21:09:35.688617] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-09-26T21:09:35.688694] [INFO ] [LOCAL ] SAT: Starting deletion of derivative data. [2025-09-26T21:09:35.688776] [DEBUG] [LOCAL ] SAT: No derivative data file found to delete. [2025-09-26T21:09:35.688872] [INFO ] [MAIN ] Update Progress: 1868/2371 symbols completed. SAT took 22.7s. Estimated remaining: 1h 7m 12s. Rate: 7.5 symbols/min [2025-09-26T21:09:35.875997] [INFO ] [MAIN ] SAZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:09:35.876484] [DEBUG] [LOCAL ] SAZ: No existing data file found in primary storage. [2025-09-26T21:09:35.876675] [WARN ] [MAIN ] SAZ: No existing data found, performing full refresh instead. [2025-09-26T21:09:35.876971] [INFO ] [MAIN ] SAZ: Wiping existing primary data before full refresh. [2025-09-26T21:09:35.877025] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-09-26T21:09:35.877070] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-09-26T21:09:35.877104] [INFO ] [MAIN ] SAZ: Starting full primary refresh. [2025-09-26T21:09:35.916853] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-02. [2025-09-26T21:09:36.112069] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-26T21:09:36.329448] [INFO ] [REMOTE ] SAZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:09:36.381187] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-26T21:09:36.711736] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-08. [2025-09-26T21:09:37.511733] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2024-12. [2025-09-26T21:09:37.899819] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-26T21:09:38.317921] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-03. [2025-09-26T21:09:38.322154] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-26T21:09:38.721898] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-26T21:09:39.111732] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-09. [2025-09-26T21:09:39.911724] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-01. [2025-09-26T21:09:40.311383] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-26T21:09:40.606080] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-26T21:09:40.616171] [INFO ] [REMOTE ] SARO: Full fetch complete (69067 records). [2025-09-26T21:09:40.616386] [DEBUG] [VALIDATOR ] SARO: Validating primary data. [2025-09-26T21:09:40.716918] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-04. [2025-09-26T21:09:41.046678] [DEBUG] [VALIDATOR ] SARO: All expected trading days are present. [2025-09-26T21:09:41.046896] [DEBUG] [VALIDATOR ] SARO: Primary data validation passed. [2025-09-26T21:09:41.048354] [INFO ] [MAIN ] SARO: Fetched primary data is valid. [2025-09-26T21:09:41.048424] [DEBUG] [LOCAL ] SARO: Saving primary data. [2025-09-26T21:09:41.051082] [DEBUG] [LOCAL ] SARO: Trimmed 69067 records to 49425 (keeping 200 days of data) [2025-09-26T21:09:41.149929] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-26T21:09:41.377127] [DEBUG] [LOCAL ] SARO: Primary data saved (49425 records). [2025-09-26T21:09:41.377336] [INFO ] [MAIN ] SARO: Full history saved. [2025-09-26T21:09:41.377446] [INFO ] [MAIN ] Update Progress: 1869/2371 symbols completed. SARO took 34.0s. Estimated remaining: 1h 7m 3s. Rate: 7.5 symbols/min [2025-09-26T21:09:41.520029] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-05. [2025-09-26T21:09:41.553871] [INFO ] [MAIN ] SB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:09:41.595484] [DEBUG] [LOCAL ] SB: Loaded 33516 existing records from primary storage. [2025-09-26T21:09:41.595711] [INFO ] [MAIN ] SB: Loaded 33516 existing records. [2025-09-26T21:09:41.804286] [WARN ] [MAIN ] SB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:09:41.805249] [INFO ] [MAIN ] SB: Wiping existing primary data before full refresh. [2025-09-26T21:09:41.805341] [INFO ] [LOCAL ] SB: Starting deletion of primary data. [2025-09-26T21:09:41.806473] [DEBUG] [LOCAL ] SB: Deleted primary data file. [2025-09-26T21:09:41.806612] [INFO ] [MAIN ] SB: Starting full primary refresh. [2025-09-26T21:09:42.087736] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-26T21:09:42.204775] [INFO ] [REMOTE ] SB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:09:42.311735] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-06. [2025-09-26T21:09:42.718980] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-26T21:09:43.111724] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-09. [2025-09-26T21:09:43.911736] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-02. [2025-09-26T21:09:44.192365] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-26T21:09:44.198317] [INFO ] [REMOTE ] SAR: Full fetch complete (22485 records). [2025-09-26T21:09:44.198433] [DEBUG] [VALIDATOR ] SAR: Validating primary data. [2025-09-26T21:09:44.398565] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-26T21:09:44.615092] [DEBUG] [VALIDATOR ] SAR: All expected trading days are present. [2025-09-26T21:09:44.615215] [DEBUG] [VALIDATOR ] SAR: Primary data validation passed. [2025-09-26T21:09:44.615794] [INFO ] [MAIN ] SAR: Fetched primary data is valid. [2025-09-26T21:09:44.615860] [DEBUG] [LOCAL ] SAR: Saving primary data. [2025-09-26T21:09:44.617555] [DEBUG] [LOCAL ] SAR: Trimmed 22485 records to 16382 (keeping 200 days of data) [2025-09-26T21:09:44.711822] [INFO ] [REMOTE ] SB: Fetching primary data for 2024-12. [2025-09-26T21:09:44.735252] [DEBUG] [LOCAL ] SAR: Primary data saved (16382 records). [2025-09-26T21:09:44.735433] [INFO ] [MAIN ] SAR: Full history saved. [2025-09-26T21:09:44.735671] [INFO ] [MAIN ] Update Progress: 1870/2371 symbols completed. SAR took 42.9s. Estimated remaining: 1h 6m 54s. Rate: 7.5 symbols/min [2025-09-26T21:09:44.909026] [INFO ] [MAIN ] SBDS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:09:44.909241] [DEBUG] [LOCAL ] SBDS: No existing data file found in primary storage. [2025-09-26T21:09:44.909298] [WARN ] [MAIN ] SBDS: No existing data found, performing full refresh instead. [2025-09-26T21:09:44.909465] [INFO ] [MAIN ] SBDS: Wiping existing primary data before full refresh. [2025-09-26T21:09:44.909511] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-09-26T21:09:44.909554] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-09-26T21:09:44.909588] [INFO ] [MAIN ] SBDS: Starting full primary refresh. [2025-09-26T21:09:45.284105] [INFO ] [REMOTE ] SBDS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:09:45.511763] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-07. [2025-09-26T21:09:45.908105] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-26T21:09:46.263350] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-26T21:09:46.311712] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-01. [2025-09-26T21:09:47.111745] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-03. [2025-09-26T21:09:47.431969] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-26T21:09:47.689145] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-26T21:09:47.911728] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2024-12. [2025-09-26T21:09:48.170839] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:09:48.171200] [WARN ] [REMOTE ] SBDS: No data returned for month 2024-12 [2025-09-26T21:09:48.711771] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-08. [2025-09-26T21:09:49.173851] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-26T21:09:49.511727] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-01. [2025-09-26T21:09:49.774878] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:09:49.775232] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-01 [2025-09-26T21:09:50.311759] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-04. [2025-09-26T21:09:50.757029] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-26T21:09:51.111729] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-02. [2025-09-26T21:09:51.911727] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-02. [2025-09-26T21:09:52.154196] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:09:52.154545] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-02 [2025-09-26T21:09:52.578482] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-26T21:09:52.711719] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-03. [2025-09-26T21:09:53.511818] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-05. [2025-09-26T21:09:54.241392] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-26T21:09:54.267752] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-26T21:09:54.311731] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-04. [2025-09-26T21:09:55.111781] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-06. [2025-09-26T21:09:55.698442] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-26T21:09:55.916894] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-09. [2025-09-26T21:09:55.937502] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-26T21:09:56.326747] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-26T21:09:56.327772] [INFO ] [REMOTE ] SAY: Full fetch complete (1412 records). [2025-09-26T21:09:56.327846] [DEBUG] [VALIDATOR ] SAY: Validating primary data. [2025-09-26T21:09:56.522390] [WARN ] [VALIDATOR ] SAY: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-09-26T21:09:56.522668] [FATAL] [MAIN ] SAY: Fetched primary data is invalid. Refusing to save it. [2025-09-26T21:09:56.522756] [WARN ] [MAIN ] SAY: Deleting existing primary and derivative data due to validation failure. [2025-09-26T21:09:56.522835] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-09-26T21:09:56.522921] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-09-26T21:09:56.522978] [INFO ] [LOCAL ] SAY: Starting deletion of derivative data. [2025-09-26T21:09:56.523025] [DEBUG] [LOCAL ] SAY: No derivative data file found to delete. [2025-09-26T21:09:56.523111] [INFO ] [MAIN ] Update Progress: 1871/2371 symbols completed. SAY took 27.3s. Estimated remaining: 1h 6m 47s. Rate: 7.5 symbols/min [2025-09-26T21:09:56.714499] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-03. [2025-09-26T21:09:56.714390] [INFO ] [MAIN ] SBH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:09:56.792625] [DEBUG] [LOCAL ] SBH: Loaded 50195 existing records from primary storage. [2025-09-26T21:09:56.792831] [INFO ] [MAIN ] SBH: Loaded 50195 existing records. [2025-09-26T21:09:56.989093] [WARN ] [MAIN ] SBH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:09:56.989458] [INFO ] [MAIN ] SBH: Wiping existing primary data before full refresh. [2025-09-26T21:09:56.989515] [INFO ] [LOCAL ] SBH: Starting deletion of primary data. [2025-09-26T21:09:56.990846] [DEBUG] [LOCAL ] SBH: Deleted primary data file. [2025-09-26T21:09:56.990911] [INFO ] [MAIN ] SBH: Starting full primary refresh. [2025-09-26T21:09:57.141090] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:09:57.160007] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-03 [2025-09-26T21:09:57.426136] [INFO ] [REMOTE ] SBH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:09:57.511738] [INFO ] [REMOTE ] SBH: Fetching primary data for 2024-12. [2025-09-26T21:09:58.311724] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-04. [2025-09-26T21:09:58.594981] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:09:58.595368] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-04 [2025-09-26T21:09:59.111694] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-05. [2025-09-26T21:09:59.150611] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-26T21:09:59.911738] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-05. [2025-09-26T21:10:00.181813] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:10:00.182175] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-05 [2025-09-26T21:10:00.474325] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-26T21:10:00.711717] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-07. [2025-09-26T21:10:01.110189] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-26T21:10:01.511709] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-01. [2025-09-26T21:10:02.311736] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-06. [2025-09-26T21:10:02.582474] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:10:02.582866] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-06 [2025-09-26T21:10:03.116140] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-07. [2025-09-26T21:10:03.125042] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-26T21:10:03.592068] [INFO ] [REMOTE ] SBDS: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-26T21:10:03.911731] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-08. [2025-09-26T21:10:04.322167] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-26T21:10:04.711728] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-09. [2025-09-26T21:10:05.111054] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-26T21:10:05.111946] [INFO ] [REMOTE ] SAZ: Full fetch complete (1809 records). [2025-09-26T21:10:05.112019] [DEBUG] [VALIDATOR ] SAZ: Validating primary data. [2025-09-26T21:10:05.318499] [WARN ] [VALIDATOR ] SAZ: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-26T21:10:05.318734] [FATAL] [MAIN ] SAZ: Fetched primary data is invalid. Refusing to save it. [2025-09-26T21:10:05.318806] [WARN ] [MAIN ] SAZ: Deleting existing primary and derivative data due to validation failure. [2025-09-26T21:10:05.318879] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-09-26T21:10:05.318998] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-09-26T21:10:05.319084] [INFO ] [LOCAL ] SAZ: Starting deletion of derivative data. [2025-09-26T21:10:05.319190] [DEBUG] [LOCAL ] SAZ: No derivative data file found to delete. [2025-09-26T21:10:05.319295] [INFO ] [MAIN ] Update Progress: 1872/2371 symbols completed. SAZ took 29.6s. Estimated remaining: 1h 6m 39s. Rate: 7.5 symbols/min [2025-09-26T21:10:05.516997] [INFO ] [MAIN ] SBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:10:05.517066] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-02. [2025-09-26T21:10:05.536180] [DEBUG] [LOCAL ] SBI: Loaded 7807 existing records from primary storage. [2025-09-26T21:10:05.536309] [INFO ] [MAIN ] SBI: Loaded 7807 existing records. [2025-09-26T21:10:05.743364] [WARN ] [MAIN ] SBI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:10:05.743677] [INFO ] [MAIN ] SBI: Wiping existing primary data before full refresh. [2025-09-26T21:10:05.743741] [INFO ] [LOCAL ] SBI: Starting deletion of primary data. [2025-09-26T21:10:05.744081] [DEBUG] [LOCAL ] SBI: Deleted primary data file. [2025-09-26T21:10:05.744144] [INFO ] [MAIN ] SBI: Starting full primary refresh. [2025-09-26T21:10:06.148233] [INFO ] [REMOTE ] SBI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:10:06.311756] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-08. [2025-09-26T21:10:07.111761] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-06. [2025-09-26T21:10:07.216031] [INFO ] [REMOTE ] SBDS: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-26T21:10:07.249946] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-26T21:10:07.911733] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-03. [2025-09-26T21:10:08.497761] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-26T21:10:08.711730] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-09. [2025-09-26T21:10:09.314891] [INFO ] [REMOTE ] SBDS: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-26T21:10:09.316535] [INFO ] [REMOTE ] SBDS: Full fetch complete (1146 records). [2025-09-26T21:10:09.316627] [DEBUG] [VALIDATOR ] SBDS: Validating primary data. [2025-09-26T21:10:09.516281] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-07. [2025-09-26T21:10:09.525244] [WARN ] [VALIDATOR ] SBDS: Validation failed - insufficient historical data. Have 46 unique days, need 200 days [2025-09-26T21:10:09.527229] [FATAL] [MAIN ] SBDS: Fetched primary data is invalid. Refusing to save it. [2025-09-26T21:10:09.527321] [WARN ] [MAIN ] SBDS: Deleting existing primary and derivative data due to validation failure. [2025-09-26T21:10:09.527427] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-09-26T21:10:09.527549] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-09-26T21:10:09.527617] [INFO ] [LOCAL ] SBDS: Starting deletion of derivative data. [2025-09-26T21:10:09.527714] [DEBUG] [LOCAL ] SBDS: No derivative data file found to delete. [2025-09-26T21:10:09.527803] [INFO ] [MAIN ] Update Progress: 1873/2371 symbols completed. SBDS took 24.8s. Estimated remaining: 1h 6m 30s. Rate: 7.5 symbols/min [2025-09-26T21:10:09.721878] [INFO ] [MAIN ] SBR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:10:09.760549] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-26T21:10:09.776761] [DEBUG] [LOCAL ] SBR: Loaded 7250 existing records from primary storage. [2025-09-26T21:10:09.777009] [INFO ] [MAIN ] SBR: Loaded 7250 existing records. [2025-09-26T21:10:09.993670] [WARN ] [MAIN ] SBR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:10:09.993980] [INFO ] [MAIN ] SBR: Wiping existing primary data before full refresh. [2025-09-26T21:10:09.994036] [INFO ] [LOCAL ] SBR: Starting deletion of primary data. [2025-09-26T21:10:09.994390] [DEBUG] [LOCAL ] SBR: Deleted primary data file. [2025-09-26T21:10:09.994452] [INFO ] [MAIN ] SBR: Starting full primary refresh. [2025-09-26T21:10:10.316900] [INFO ] [REMOTE ] SBI: Fetching primary data for 2024-12. [2025-09-26T21:10:10.380551] [INFO ] [REMOTE ] SBR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:10:11.117890] [INFO ] [REMOTE ] SBR: Fetching primary data for 2024-12. [2025-09-26T21:10:11.133678] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-26T21:10:11.428311] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-26T21:10:11.911751] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-04. [2025-09-26T21:10:12.243303] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-26T21:10:12.711771] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-01. [2025-09-26T21:10:13.511701] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-01. [2025-09-26T21:10:13.583142] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-26T21:10:13.645765] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-26T21:10:14.035164] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-26T21:10:14.311739] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-02. [2025-09-26T21:10:15.111772] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-02. [2025-09-26T21:10:15.125135] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-26T21:10:15.848637] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-26T21:10:15.911731] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-03. [2025-09-26T21:10:16.711743] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-05. [2025-09-26T21:10:16.731042] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-26T21:10:17.511769] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-03. [2025-09-26T21:10:18.311735] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-04. [2025-09-26T21:10:18.367193] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-26T21:10:18.399470] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-26T21:10:18.883388] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-26T21:10:19.111723] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-05. [2025-09-26T21:10:19.911724] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-08. [2025-09-26T21:10:20.011357] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-26T21:10:20.711731] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-06. [2025-09-26T21:10:21.119045] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-26T21:10:21.511751] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-04. [2025-09-26T21:10:22.202548] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-26T21:10:22.311763] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-06. [2025-09-26T21:10:22.353372] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-26T21:10:23.070760] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-26T21:10:23.111688] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-09. [2025-09-26T21:10:23.911711] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-05. [2025-09-26T21:10:24.275813] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-26T21:10:24.285857] [INFO ] [REMOTE ] SB: Full fetch complete (50370 records). [2025-09-26T21:10:24.286131] [DEBUG] [VALIDATOR ] SB: Validating primary data. [2025-09-26T21:10:24.614142] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-26T21:10:24.714498] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-06. [2025-09-26T21:10:24.715883] [DEBUG] [VALIDATOR ] SB: All expected trading days are present. [2025-09-26T21:10:24.715950] [DEBUG] [VALIDATOR ] SB: Primary data validation passed. [2025-09-26T21:10:24.716933] [INFO ] [MAIN ] SB: Fetched primary data is valid. [2025-09-26T21:10:24.717119] [DEBUG] [LOCAL ] SB: Saving primary data. [2025-09-26T21:10:24.719304] [DEBUG] [LOCAL ] SB: Trimmed 50370 records to 33735 (keeping 200 days of data) [2025-09-26T21:10:24.933754] [DEBUG] [LOCAL ] SB: Primary data saved (33735 records). [2025-09-26T21:10:24.933912] [INFO ] [MAIN ] SB: Full history saved. [2025-09-26T21:10:24.934029] [INFO ] [MAIN ] Update Progress: 1874/2371 symbols completed. SB took 43.6s. Estimated remaining: 1h 6m 24s. Rate: 7.5 symbols/min [2025-09-26T21:10:25.122514] [INFO ] [MAIN ] SBS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:10:25.189035] [DEBUG] [LOCAL ] SBS: Loaded 49864 existing records from primary storage. [2025-09-26T21:10:25.189192] [INFO ] [MAIN ] SBS: Loaded 49864 existing records. [2025-09-26T21:10:25.378050] [WARN ] [MAIN ] SBS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:10:25.378314] [INFO ] [MAIN ] SBS: Wiping existing primary data before full refresh. [2025-09-26T21:10:25.378364] [INFO ] [LOCAL ] SBS: Starting deletion of primary data. [2025-09-26T21:10:25.379404] [DEBUG] [LOCAL ] SBS: Deleted primary data file. [2025-09-26T21:10:25.379468] [INFO ] [MAIN ] SBS: Starting full primary refresh. [2025-09-26T21:10:25.517012] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-07. [2025-09-26T21:10:25.659385] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-26T21:10:25.770315] [INFO ] [REMOTE ] SBS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:10:26.311732] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-07. [2025-09-26T21:10:27.103086] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-26T21:10:27.111669] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-08. [2025-09-26T21:10:27.342247] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-26T21:10:27.873394] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-26T21:10:27.911695] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-09. [2025-09-26T21:10:28.689432] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-26T21:10:28.691795] [INFO ] [REMOTE ] SBI: Full fetch complete (10681 records). [2025-09-26T21:10:28.691869] [DEBUG] [VALIDATOR ] SBI: Validating primary data. [2025-09-26T21:10:28.716947] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-07. [2025-09-26T21:10:29.099898] [DEBUG] [VALIDATOR ] SBI: All expected trading days are present. [2025-09-26T21:10:29.100062] [DEBUG] [VALIDATOR ] SBI: Primary data validation passed. [2025-09-26T21:10:29.100465] [INFO ] [MAIN ] SBI: Fetched primary data is valid. [2025-09-26T21:10:29.100524] [DEBUG] [LOCAL ] SBI: Saving primary data. [2025-09-26T21:10:29.101431] [DEBUG] [LOCAL ] SBI: Trimmed 10681 records to 7848 (keeping 200 days of data) [2025-09-26T21:10:29.155273] [DEBUG] [LOCAL ] SBI: Primary data saved (7848 records). [2025-09-26T21:10:29.155425] [INFO ] [MAIN ] SBI: Full history saved. [2025-09-26T21:10:29.155540] [INFO ] [MAIN ] Update Progress: 1875/2371 symbols completed. SBI took 23.8s. Estimated remaining: 1h 6m 15s. Rate: 7.5 symbols/min [2025-09-26T21:10:29.356931] [INFO ] [MAIN ] SBSI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:10:29.375321] [DEBUG] [LOCAL ] SBSI: Loaded 14872 existing records from primary storage. [2025-09-26T21:10:29.375512] [INFO ] [MAIN ] SBSI: Loaded 14872 existing records. [2025-09-26T21:10:29.515386] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-26T21:10:29.515537] [INFO ] [REMOTE ] SBS: Fetching primary data for 2024-12. [2025-09-26T21:10:29.599620] [WARN ] [MAIN ] SBSI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:10:29.600056] [INFO ] [MAIN ] SBSI: Wiping existing primary data before full refresh. [2025-09-26T21:10:29.600119] [INFO ] [LOCAL ] SBSI: Starting deletion of primary data. [2025-09-26T21:10:29.600686] [DEBUG] [LOCAL ] SBSI: Deleted primary data file. [2025-09-26T21:10:29.600749] [INFO ] [MAIN ] SBSI: Starting full primary refresh. [2025-09-26T21:10:30.039827] [INFO ] [REMOTE ] SBSI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:10:30.311744] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2024-12. [2025-09-26T21:10:31.101456] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-26T21:10:31.111815] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-01. [2025-09-26T21:10:31.365055] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-26T21:10:31.911722] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-01. [2025-09-26T21:10:32.711727] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-08. [2025-09-26T21:10:32.930697] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-26T21:10:32.932973] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-26T21:10:33.511762] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-02. [2025-09-26T21:10:34.311745] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-08. [2025-09-26T21:10:34.409099] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-26T21:10:35.020221] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-26T21:10:35.111706] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-09. [2025-09-26T21:10:35.167946] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-26T21:10:35.911730] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-03. [2025-09-26T21:10:36.711728] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-09. [2025-09-26T21:10:36.909617] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-26T21:10:36.919908] [INFO ] [REMOTE ] SBH: Full fetch complete (72804 records). [2025-09-26T21:10:36.920109] [DEBUG] [VALIDATOR ] SBH: Validating primary data. [2025-09-26T21:10:37.368512] [DEBUG] [VALIDATOR ] SBH: All expected trading days are present. [2025-09-26T21:10:37.368742] [DEBUG] [VALIDATOR ] SBH: Primary data validation passed. [2025-09-26T21:10:37.369841] [INFO ] [MAIN ] SBH: Fetched primary data is valid. [2025-09-26T21:10:37.369910] [DEBUG] [LOCAL ] SBH: Saving primary data. [2025-09-26T21:10:37.371467] [DEBUG] [LOCAL ] SBH: Trimmed 72804 records to 50565 (keeping 200 days of data) [2025-09-26T21:10:37.550152] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-02. [2025-09-26T21:10:37.648095] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-26T21:10:37.709151] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-26T21:10:37.728059] [INFO ] [REMOTE ] SBR: Full fetch complete (11055 records). [2025-09-26T21:10:37.728845] [DEBUG] [VALIDATOR ] SBR: Validating primary data. [2025-09-26T21:10:38.163776] [DEBUG] [LOCAL ] SBH: Primary data saved (50565 records). [2025-09-26T21:10:38.164077] [DEBUG] [VALIDATOR ] SBR: All expected trading days are present. [2025-09-26T21:10:38.164219] [INFO ] [MAIN ] SBH: Full history saved. [2025-09-26T21:10:38.164468] [INFO ] [MAIN ] Update Progress: 1876/2371 symbols completed. SBH took 41.6s. Estimated remaining: 1h 6m 7s. Rate: 7.5 symbols/min [2025-09-26T21:10:38.164321] [DEBUG] [VALIDATOR ] SBR: Primary data validation passed. [2025-09-26T21:10:38.165343] [INFO ] [MAIN ] SBR: Fetched primary data is valid. [2025-09-26T21:10:38.165432] [DEBUG] [LOCAL ] SBR: Saving primary data. [2025-09-26T21:10:38.230246] [DEBUG] [LOCAL ] SBR: Trimmed 11055 records to 7350 (keeping 200 days of data) [2025-09-26T21:10:38.326387] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-04. [2025-09-26T21:10:38.403429] [INFO ] [MAIN ] SBSW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:10:38.417783] [DEBUG] [LOCAL ] SBR: Primary data saved (7350 records). [2025-09-26T21:10:38.417944] [INFO ] [MAIN ] SBR: Full history saved. [2025-09-26T21:10:38.418047] [INFO ] [MAIN ] Update Progress: 1877/2371 symbols completed. SBR took 28.9s. Estimated remaining: 1h 5m 57s. Rate: 7.5 symbols/min [2025-09-26T21:10:38.461304] [DEBUG] [LOCAL ] SBSW: Loaded 53355 existing records from primary storage. [2025-09-26T21:10:38.461466] [INFO ] [MAIN ] SBSW: Loaded 53355 existing records. [2025-09-26T21:10:38.615704] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-26T21:10:38.676491] [WARN ] [MAIN ] SBSW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:10:38.676771] [INFO ] [MAIN ] SBSW: Wiping existing primary data before full refresh. [2025-09-26T21:10:38.676844] [INFO ] [LOCAL ] SBSW: Starting deletion of primary data. [2025-09-26T21:10:38.678011] [DEBUG] [LOCAL ] SBSW: Deleted primary data file. [2025-09-26T21:10:38.678076] [INFO ] [MAIN ] SBSW: Starting full primary refresh. [2025-09-26T21:10:39.083311] [INFO ] [REMOTE ] SBSW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:10:39.111733] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2024-12. [2025-09-26T21:10:39.911719] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-03. [2025-09-26T21:10:40.003348] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-26T21:10:40.711729] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-05. [2025-09-26T21:10:40.832166] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-26T21:10:40.904325] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-26T21:10:41.511792] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-04. [2025-09-26T21:10:42.311748] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-01. [2025-09-26T21:10:42.547929] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-26T21:10:42.589034] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-26T21:10:43.111731] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-06. [2025-09-26T21:10:43.911742] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-05. [2025-09-26T21:10:44.360889] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-26T21:10:44.711713] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-02. [2025-09-26T21:10:44.795730] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-26T21:10:44.826530] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-26T21:10:45.511764] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-06. [2025-09-26T21:10:46.311707] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-07. [2025-09-26T21:10:46.429851] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-26T21:10:46.605888] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-26T21:10:47.111745] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-07. [2025-09-26T21:10:47.700593] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-26T21:10:47.911717] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-08. [2025-09-26T21:10:48.201422] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-26T21:10:48.711733] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-08. [2025-09-26T21:10:49.415705] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-26T21:10:49.511732] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-03. [2025-09-26T21:10:49.689217] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-26T21:10:50.311712] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-09. [2025-09-26T21:10:51.111714] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-09. [2025-09-26T21:10:51.265734] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-26T21:10:51.269472] [INFO ] [REMOTE ] SBSI: Full fetch complete (21217 records). [2025-09-26T21:10:51.269571] [DEBUG] [VALIDATOR ] SBSI: Validating primary data. [2025-09-26T21:10:51.674349] [DEBUG] [VALIDATOR ] SBSI: All expected trading days are present. [2025-09-26T21:10:51.686039] [DEBUG] [VALIDATOR ] SBSI: Primary data validation passed. [2025-09-26T21:10:51.692018] [INFO ] [MAIN ] SBSI: Fetched primary data is valid. [2025-09-26T21:10:51.692116] [DEBUG] [LOCAL ] SBSI: Saving primary data. [2025-09-26T21:10:51.708817] [DEBUG] [LOCAL ] SBSI: Trimmed 21217 records to 14974 (keeping 200 days of data) [2025-09-26T21:10:51.708614] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-26T21:10:51.822917] [DEBUG] [LOCAL ] SBSI: Primary data saved (14974 records). [2025-09-26T21:10:51.823091] [INFO ] [MAIN ] SBSI: Full history saved. [2025-09-26T21:10:51.823205] [INFO ] [MAIN ] Update Progress: 1878/2371 symbols completed. SBSI took 22.7s. Estimated remaining: 1h 5m 50s. Rate: 7.5 symbols/min [2025-09-26T21:10:51.911755] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-04. [2025-09-26T21:10:52.337618] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-26T21:10:52.347713] [INFO ] [REMOTE ] SBS: Full fetch complete (70106 records). [2025-09-26T21:10:52.347892] [DEBUG] [VALIDATOR ] SBS: Validating primary data. [2025-09-26T21:10:52.784486] [DEBUG] [VALIDATOR ] SBS: All expected trading days are present. [2025-09-26T21:10:52.784595] [DEBUG] [VALIDATOR ] SBS: Primary data validation passed. [2025-09-26T21:10:52.786181] [INFO ] [MAIN ] SBS: Fetched primary data is valid. [2025-09-26T21:10:52.786274] [DEBUG] [LOCAL ] SBS: Saving primary data. [2025-09-26T21:10:52.788041] [DEBUG] [LOCAL ] SBS: Trimmed 70106 records to 50166 (keeping 200 days of data) [2025-09-26T21:10:53.087333] [DEBUG] [LOCAL ] SBS: Primary data saved (50166 records). [2025-09-26T21:10:53.087483] [INFO ] [MAIN ] SBS: Full history saved. [2025-09-26T21:10:53.087713] [INFO ] [MAIN ] Update Progress: 1879/2371 symbols completed. SBS took 28.2s. Estimated remaining: 1h 5m 41s. Rate: 7.5 symbols/min [2025-09-26T21:10:53.765348] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-26T21:10:53.777250] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-05. [2025-09-26T21:10:55.562924] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-26T21:10:55.574817] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-06. [2025-09-26T21:10:57.430099] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-26T21:10:57.441827] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-07. [2025-09-26T21:10:59.697039] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-26T21:10:59.715452] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-08. [2025-09-26T21:11:01.762246] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-26T21:11:01.774188] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-09. [2025-09-26T21:11:03.914142] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-26T21:11:03.925811] [INFO ] [REMOTE ] SBSW: Full fetch complete (76498 records). [2025-09-26T21:11:03.926009] [DEBUG] [VALIDATOR ] SBSW: Validating primary data. [2025-09-26T21:11:04.338530] [DEBUG] [VALIDATOR ] SBSW: All expected trading days are present. [2025-09-26T21:11:04.338619] [DEBUG] [VALIDATOR ] SBSW: Primary data validation passed. [2025-09-26T21:11:04.339665] [INFO ] [MAIN ] SBSW: Fetched primary data is valid. [2025-09-26T21:11:04.339789] [DEBUG] [LOCAL ] SBSW: Saving primary data. [2025-09-26T21:11:04.341376] [DEBUG] [LOCAL ] SBSW: Trimmed 76498 records to 53745 (keeping 200 days of data) [2025-09-26T21:11:04.682499] [DEBUG] [LOCAL ] SBSW: Primary data saved (53745 records). [2025-09-26T21:11:04.682696] [INFO ] [MAIN ] SBSW: Full history saved. [2025-09-26T21:11:04.682832] [INFO ] [MAIN ] Update Progress: 1880/2371 symbols completed. SBSW took 26.5s. Estimated remaining: 1h 5m 34s. Rate: 7.5 symbols/min [2025-09-26T21:11:05.465779] [INFO ] [MAIN ] SCD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:11:05.522428] [INFO ] [MAIN ] SBXD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:11:05.515462] [INFO ] [MAIN ] SCHW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:11:05.534468] [DEBUG] [LOCAL ] SBXD: No existing data file found in primary storage. [2025-09-26T21:11:05.535188] [WARN ] [MAIN ] SBXD: No existing data found, performing full refresh instead. [2025-09-26T21:11:05.536913] [INFO ] [MAIN ] SBXD: Wiping existing primary data before full refresh. [2025-09-26T21:11:05.537015] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-09-26T21:11:05.537443] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-09-26T21:11:05.549964] [INFO ] [MAIN ] SBXD: Starting full primary refresh. [2025-09-26T21:11:05.579638] [INFO ] [MAIN ] SCCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:11:05.675047] [DEBUG] [LOCAL ] SCD: Loaded 12668 existing records from primary storage. [2025-09-26T21:11:05.698537] [INFO ] [MAIN ] SCD: Loaded 12668 existing records. [2025-09-26T21:11:06.064078] [DEBUG] [LOCAL ] SCHW: Loaded 54075 existing records from primary storage. [2025-09-26T21:11:06.083739] [INFO ] [MAIN ] SCHW: Loaded 54075 existing records. [2025-09-26T21:11:06.288390] [DEBUG] [LOCAL ] SCCO: Loaded 49775 existing records from primary storage. [2025-09-26T21:11:06.332912] [INFO ] [REMOTE ] SBXD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:11:06.346048] [INFO ] [MAIN ] SCCO: Loaded 49775 existing records. [2025-09-26T21:11:06.354861] [WARN ] [MAIN ] SCD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:11:06.364988] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2024-12. [2025-09-26T21:11:06.397438] [INFO ] [MAIN ] SCD: Wiping existing primary data before full refresh. [2025-09-26T21:11:06.469084] [INFO ] [LOCAL ] SCD: Starting deletion of primary data. [2025-09-26T21:11:06.577941] [DEBUG] [LOCAL ] SCD: Deleted primary data file. [2025-09-26T21:11:06.633822] [INFO ] [MAIN ] SCD: Starting full primary refresh. [2025-09-26T21:11:06.708605] [WARN ] [MAIN ] SCHW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:11:06.794747] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-26T21:11:06.883078] [INFO ] [MAIN ] SCHW: Wiping existing primary data before full refresh. [2025-09-26T21:11:06.903597] [INFO ] [LOCAL ] SCHW: Starting deletion of primary data. [2025-09-26T21:11:06.908082] [WARN ] [MAIN ] SCCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:11:06.894949] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-01. [2025-09-26T21:11:06.931482] [DEBUG] [LOCAL ] SCHW: Deleted primary data file. [2025-09-26T21:11:06.961802] [INFO ] [MAIN ] SCCO: Wiping existing primary data before full refresh. [2025-09-26T21:11:06.961968] [INFO ] [MAIN ] SCHW: Starting full primary refresh. [2025-09-26T21:11:06.964108] [INFO ] [LOCAL ] SCCO: Starting deletion of primary data. [2025-09-26T21:11:06.991278] [DEBUG] [LOCAL ] SCCO: Deleted primary data file. [2025-09-26T21:11:07.011759] [INFO ] [MAIN ] SCCO: Starting full primary refresh. [2025-09-26T21:11:07.357752] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-26T21:11:07.463459] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-02. [2025-09-26T21:11:08.031683] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-26T21:11:08.090224] [INFO ] [REMOTE ] SCD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:11:08.101078] [INFO ] [REMOTE ] SCD: Fetching primary data for 2024-12. [2025-09-26T21:11:08.089497] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-03. [2025-09-26T21:11:08.196097] [INFO ] [REMOTE ] SCHW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:11:08.196617] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2024-12. [2025-09-26T21:11:08.286476] [INFO ] [REMOTE ] SCCO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:11:08.286851] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2024-12. [2025-09-26T21:11:08.515209] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-26T21:11:08.516538] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-04. [2025-09-26T21:11:08.816328] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-26T21:11:08.817368] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-05. [2025-09-26T21:11:09.157297] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-26T21:11:09.168785] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-01. [2025-09-26T21:11:09.208944] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-26T21:11:09.209976] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-06. [2025-09-26T21:11:09.272761] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-26T21:11:09.275012] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-01. [2025-09-26T21:11:09.875952] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-26T21:11:09.879242] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-02. [2025-09-26T21:11:09.922426] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-26T21:11:09.931821] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-01. [2025-09-26T21:11:10.019703] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-26T21:11:10.030800] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-02. [2025-09-26T21:11:10.039833] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-26T21:11:10.042988] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-07. [2025-09-26T21:11:10.347108] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-26T21:11:10.349375] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-03. [2025-09-26T21:11:10.667244] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-26T21:11:10.668993] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-08. [2025-09-26T21:11:10.917950] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-26T21:11:11.111733] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-03. [2025-09-26T21:11:11.198937] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-26T21:11:11.472449] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-26T21:11:11.522312] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-26T21:11:11.837543] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-26T21:11:11.911725] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-04. [2025-09-26T21:11:12.711781] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-09. [2025-09-26T21:11:12.869074] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-26T21:11:13.094622] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-26T21:11:13.095534] [INFO ] [REMOTE ] SBXD: Full fetch complete (3078 records). [2025-09-26T21:11:13.095612] [DEBUG] [VALIDATOR ] SBXD: Validating primary data. [2025-09-26T21:11:13.096131] [FATAL] [VALIDATOR ] SBXD: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T21:11:13.096317] [FATAL] [MAIN ] SBXD: Fetched primary data is invalid. Refusing to save it. [2025-09-26T21:11:13.096389] [WARN ] [MAIN ] SBXD: Deleting existing primary and derivative data due to validation failure. [2025-09-26T21:11:13.096461] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-09-26T21:11:13.096844] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-09-26T21:11:13.097160] [INFO ] [LOCAL ] SBXD: Starting deletion of derivative data. [2025-09-26T21:11:13.097259] [DEBUG] [LOCAL ] SBXD: No derivative data file found to delete. [2025-09-26T21:11:13.097440] [INFO ] [MAIN ] Update Progress: 1881/2371 symbols completed. SBXD took 8.4s. Estimated remaining: 1h 5m 26s. Rate: 7.5 symbols/min [2025-09-26T21:11:13.298995] [INFO ] [MAIN ] SCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:11:13.371089] [DEBUG] [LOCAL ] SCI: Loaded 46946 existing records from primary storage. [2025-09-26T21:11:13.371283] [INFO ] [MAIN ] SCI: Loaded 46946 existing records. [2025-09-26T21:11:13.516977] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-04. [2025-09-26T21:11:13.624587] [WARN ] [MAIN ] SCI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:11:13.624890] [INFO ] [MAIN ] SCI: Wiping existing primary data before full refresh. [2025-09-26T21:11:13.624940] [INFO ] [LOCAL ] SCI: Starting deletion of primary data. [2025-09-26T21:11:13.626107] [DEBUG] [LOCAL ] SCI: Deleted primary data file. [2025-09-26T21:11:13.626171] [INFO ] [MAIN ] SCI: Starting full primary refresh. [2025-09-26T21:11:14.014562] [INFO ] [REMOTE ] SCI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:11:14.311731] [INFO ] [REMOTE ] SCI: Fetching primary data for 2024-12. [2025-09-26T21:11:14.452619] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-26T21:11:15.111773] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-05. [2025-09-26T21:11:15.911719] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-05. [2025-09-26T21:11:15.984801] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-26T21:11:16.073586] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-26T21:11:16.391110] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-26T21:11:16.711730] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-02. [2025-09-26T21:11:17.511782] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-06. [2025-09-26T21:11:18.311706] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-06. [2025-09-26T21:11:18.444796] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-26T21:11:18.460737] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-26T21:11:19.111743] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-01. [2025-09-26T21:11:19.311004] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-26T21:11:19.911736] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-07. [2025-09-26T21:11:20.711704] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-07. [2025-09-26T21:11:20.746919] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-26T21:11:20.819276] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-26T21:11:21.511746] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-08. [2025-09-26T21:11:21.548568] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-26T21:11:22.311783] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-02. [2025-09-26T21:11:22.434361] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-26T21:11:23.111724] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-09. [2025-09-26T21:11:23.844770] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-26T21:11:23.918445] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-08. [2025-09-26T21:11:23.938632] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-26T21:11:23.949821] [INFO ] [REMOTE ] SCHW: Full fetch complete (77703 records). [2025-09-26T21:11:23.950006] [DEBUG] [VALIDATOR ] SCHW: Validating primary data. [2025-09-26T21:11:24.363006] [DEBUG] [VALIDATOR ] SCHW: All expected trading days are present. [2025-09-26T21:11:24.363119] [DEBUG] [VALIDATOR ] SCHW: Primary data validation passed. [2025-09-26T21:11:24.364190] [INFO ] [MAIN ] SCHW: Fetched primary data is valid. [2025-09-26T21:11:24.364286] [DEBUG] [LOCAL ] SCHW: Saving primary data. [2025-09-26T21:11:24.366095] [DEBUG] [LOCAL ] SCHW: Trimmed 77703 records to 54465 (keeping 200 days of data) [2025-09-26T21:11:24.715302] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-03. [2025-09-26T21:11:24.747382] [DEBUG] [LOCAL ] SCHW: Primary data saved (54465 records). [2025-09-26T21:11:24.747563] [INFO ] [MAIN ] SCHW: Full history saved. [2025-09-26T21:11:24.747704] [INFO ] [MAIN ] Update Progress: 1882/2371 symbols completed. SCHW took 20.1s. Estimated remaining: 1h 5m 19s. Rate: 7.5 symbols/min [2025-09-26T21:11:24.926319] [INFO ] [MAIN ] SCL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:11:24.945862] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-26T21:11:24.957045] [DEBUG] [LOCAL ] SCL: Loaded 15001 existing records from primary storage. [2025-09-26T21:11:24.957206] [INFO ] [MAIN ] SCL: Loaded 15001 existing records. [2025-09-26T21:11:25.150669] [WARN ] [MAIN ] SCL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:11:25.151045] [INFO ] [MAIN ] SCL: Wiping existing primary data before full refresh. [2025-09-26T21:11:25.151101] [INFO ] [LOCAL ] SCL: Starting deletion of primary data. [2025-09-26T21:11:25.151546] [DEBUG] [LOCAL ] SCL: Deleted primary data file. [2025-09-26T21:11:25.151608] [INFO ] [MAIN ] SCL: Starting full primary refresh. [2025-09-26T21:11:25.527613] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-09. [2025-09-26T21:11:25.533522] [INFO ] [REMOTE ] SCL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:11:26.311723] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-03. [2025-09-26T21:11:26.345762] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-26T21:11:26.348833] [INFO ] [REMOTE ] SCD: Full fetch complete (16303 records). [2025-09-26T21:11:26.348913] [DEBUG] [VALIDATOR ] SCD: Validating primary data. [2025-09-26T21:11:26.659149] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-26T21:11:26.814714] [DEBUG] [VALIDATOR ] SCD: All expected trading days are present. [2025-09-26T21:11:26.814818] [DEBUG] [VALIDATOR ] SCD: Primary data validation passed. [2025-09-26T21:11:26.815224] [INFO ] [MAIN ] SCD: Fetched primary data is valid. [2025-09-26T21:11:26.815271] [DEBUG] [LOCAL ] SCD: Saving primary data. [2025-09-26T21:11:26.815998] [DEBUG] [LOCAL ] SCD: Trimmed 16303 records to 12749 (keeping 200 days of data) [2025-09-26T21:11:26.900960] [DEBUG] [LOCAL ] SCD: Primary data saved (12749 records). [2025-09-26T21:11:26.901152] [INFO ] [MAIN ] SCD: Full history saved. [2025-09-26T21:11:26.901272] [INFO ] [MAIN ] Update Progress: 1883/2371 symbols completed. SCD took 22.2s. Estimated remaining: 1h 5m 9s. Rate: 7.5 symbols/min [2025-09-26T21:11:27.089368] [INFO ] [MAIN ] SCM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:11:27.113244] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-04. [2025-09-26T21:11:27.114230] [DEBUG] [LOCAL ] SCM: Loaded 19974 existing records from primary storage. [2025-09-26T21:11:27.115256] [INFO ] [MAIN ] SCM: Loaded 19974 existing records. [2025-09-26T21:11:27.303145] [WARN ] [MAIN ] SCM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:11:27.303485] [INFO ] [MAIN ] SCM: Wiping existing primary data before full refresh. [2025-09-26T21:11:27.303549] [INFO ] [LOCAL ] SCM: Starting deletion of primary data. [2025-09-26T21:11:27.304174] [DEBUG] [LOCAL ] SCM: Deleted primary data file. [2025-09-26T21:11:27.304245] [INFO ] [MAIN ] SCM: Starting full primary refresh. [2025-09-26T21:11:27.687570] [INFO ] [REMOTE ] SCM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:11:27.879790] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-26T21:11:27.911722] [INFO ] [REMOTE ] SCL: Fetching primary data for 2024-12. [2025-09-26T21:11:28.674912] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-26T21:11:28.711674] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-05. [2025-09-26T21:11:28.775549] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-26T21:11:29.511754] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-01. [2025-09-26T21:11:30.311766] [INFO ] [REMOTE ] SCM: Fetching primary data for 2024-12. [2025-09-26T21:11:30.443220] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-26T21:11:30.588873] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-26T21:11:31.111725] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-06. [2025-09-26T21:11:31.347293] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-26T21:11:31.911741] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-02. [2025-09-26T21:11:32.673460] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-26T21:11:32.711732] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-04. [2025-09-26T21:11:32.918744] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-26T21:11:33.511753] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-03. [2025-09-26T21:11:34.311728] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-07. [2025-09-26T21:11:34.515714] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-26T21:11:34.593495] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-26T21:11:35.111760] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-04. [2025-09-26T21:11:35.920777] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-01. [2025-09-26T21:11:35.927325] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-26T21:11:36.155840] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-26T21:11:36.683751] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-26T21:11:36.711704] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-02. [2025-09-26T21:11:37.511740] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-08. [2025-09-26T21:11:37.747162] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-26T21:11:38.311713] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-05. [2025-09-26T21:11:39.111743] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-03. [2025-09-26T21:11:39.164992] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-26T21:11:39.911702] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-05. [2025-09-26T21:11:40.237852] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-26T21:11:40.366534] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-26T21:11:40.565123] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-26T21:11:40.711721] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-06. [2025-09-26T21:11:41.511735] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-09. [2025-09-26T21:11:42.311700] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-06. [2025-09-26T21:11:42.489126] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-26T21:11:42.763161] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-26T21:11:42.772028] [INFO ] [REMOTE ] SCI: Full fetch complete (67218 records). [2025-09-26T21:11:42.772206] [DEBUG] [VALIDATOR ] SCI: Validating primary data. [2025-09-26T21:11:43.116798] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-04. [2025-09-26T21:11:43.214820] [DEBUG] [VALIDATOR ] SCI: All expected trading days are present. [2025-09-26T21:11:43.215038] [DEBUG] [VALIDATOR ] SCI: Primary data validation passed. [2025-09-26T21:11:43.223354] [INFO ] [MAIN ] SCI: Fetched primary data is valid. [2025-09-26T21:11:43.224127] [DEBUG] [LOCAL ] SCI: Saving primary data. [2025-09-26T21:11:43.224577] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-26T21:11:43.229117] [DEBUG] [LOCAL ] SCI: Trimmed 67218 records to 47257 (keeping 200 days of data) [2025-09-26T21:11:43.559395] [DEBUG] [LOCAL ] SCI: Primary data saved (47257 records). [2025-09-26T21:11:43.559589] [INFO ] [MAIN ] SCI: Full history saved. [2025-09-26T21:11:43.559723] [INFO ] [MAIN ] Update Progress: 1884/2371 symbols completed. SCI took 30.5s. Estimated remaining: 1h 5m 3s. Rate: 7.5 symbols/min [2025-09-26T21:11:43.737445] [INFO ] [MAIN ] SCS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:11:43.784159] [DEBUG] [LOCAL ] SCS: Loaded 43480 existing records from primary storage. [2025-09-26T21:11:43.784377] [INFO ] [MAIN ] SCS: Loaded 43480 existing records. [2025-09-26T21:11:43.916901] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-07. [2025-09-26T21:11:43.986193] [WARN ] [MAIN ] SCS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:11:43.986567] [INFO ] [MAIN ] SCS: Wiping existing primary data before full refresh. [2025-09-26T21:11:43.986676] [INFO ] [LOCAL ] SCS: Starting deletion of primary data. [2025-09-26T21:11:43.987709] [DEBUG] [LOCAL ] SCS: Deleted primary data file. [2025-09-26T21:11:43.987772] [INFO ] [MAIN ] SCS: Starting full primary refresh. [2025-09-26T21:11:44.366707] [INFO ] [REMOTE ] SCS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:11:44.385326] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-26T21:11:44.711725] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-05. [2025-09-26T21:11:45.511714] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-07. [2025-09-26T21:11:45.740237] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-26T21:11:45.782567] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-26T21:11:46.311799] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-06. [2025-09-26T21:11:46.402794] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-26T21:11:47.111735] [INFO ] [REMOTE ] SCS: Fetching primary data for 2024-12. [2025-09-26T21:11:47.353352] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-26T21:11:47.911754] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-08. [2025-09-26T21:11:48.589275] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-26T21:11:48.711761] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-08. [2025-09-26T21:11:49.517844] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-07. [2025-09-26T21:11:49.524119] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-26T21:11:49.565125] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-26T21:11:50.311758] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-01. [2025-09-26T21:11:50.688811] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-26T21:11:51.111713] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-09. [2025-09-26T21:11:51.353238] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-26T21:11:51.911709] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-02. [2025-09-26T21:11:52.160774] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-26T21:11:52.166670] [INFO ] [REMOTE ] SCL: Full fetch complete (21162 records). [2025-09-26T21:11:52.166975] [DEBUG] [VALIDATOR ] SCL: Validating primary data. [2025-09-26T21:11:52.547900] [DEBUG] [VALIDATOR ] SCL: All expected trading days are present. [2025-09-26T21:11:52.548012] [DEBUG] [VALIDATOR ] SCL: Primary data validation passed. [2025-09-26T21:11:52.548838] [INFO ] [MAIN ] SCL: Fetched primary data is valid. [2025-09-26T21:11:52.548906] [DEBUG] [LOCAL ] SCL: Saving primary data. [2025-09-26T21:11:52.549826] [DEBUG] [LOCAL ] SCL: Trimmed 21162 records to 15113 (keeping 200 days of data) [2025-09-26T21:11:52.651477] [DEBUG] [LOCAL ] SCL: Primary data saved (15113 records). [2025-09-26T21:11:52.651710] [INFO ] [MAIN ] SCL: Full history saved. [2025-09-26T21:11:52.651833] [INFO ] [MAIN ] Update Progress: 1885/2371 symbols completed. SCL took 27.9s. Estimated remaining: 1h 4m 56s. Rate: 7.5 symbols/min [2025-09-26T21:11:52.719504] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-09. [2025-09-26T21:11:52.847550] [INFO ] [MAIN ] SD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:11:52.879412] [DEBUG] [LOCAL ] SD: Loaded 29168 existing records from primary storage. [2025-09-26T21:11:52.879572] [INFO ] [MAIN ] SD: Loaded 29168 existing records. [2025-09-26T21:11:53.070522] [WARN ] [MAIN ] SD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:11:53.070867] [INFO ] [MAIN ] SD: Wiping existing primary data before full refresh. [2025-09-26T21:11:53.070915] [INFO ] [LOCAL ] SD: Starting deletion of primary data. [2025-09-26T21:11:53.071963] [DEBUG] [LOCAL ] SD: Deleted primary data file. [2025-09-26T21:11:53.072026] [INFO ] [MAIN ] SD: Starting full primary refresh. [2025-09-26T21:11:53.476473] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-26T21:11:53.483794] [INFO ] [REMOTE ] SD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:11:53.511682] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-03. [2025-09-26T21:11:54.311753] [INFO ] [REMOTE ] SD: Fetching primary data for 2024-12. [2025-09-26T21:11:54.763567] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-26T21:11:54.776685] [INFO ] [REMOTE ] SCCO: Full fetch complete (70819 records). [2025-09-26T21:11:54.777029] [DEBUG] [VALIDATOR ] SCCO: Validating primary data. [2025-09-26T21:11:55.130495] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-08. [2025-09-26T21:11:55.316589] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-26T21:11:55.329905] [DEBUG] [VALIDATOR ] SCCO: All expected trading days are present. [2025-09-26T21:11:55.330816] [DEBUG] [VALIDATOR ] SCCO: Primary data validation passed. [2025-09-26T21:11:55.332856] [INFO ] [MAIN ] SCCO: Fetched primary data is valid. [2025-09-26T21:11:55.332991] [DEBUG] [LOCAL ] SCCO: Saving primary data. [2025-09-26T21:11:55.339865] [DEBUG] [LOCAL ] SCCO: Trimmed 70819 records to 50148 (keeping 200 days of data) [2025-09-26T21:11:55.712300] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T21:11:55.745553] [DEBUG] [LOCAL ] SCCO: Primary data saved (50148 records). [2025-09-26T21:11:55.745822] [INFO ] [MAIN ] SCCO: Full history saved. [2025-09-26T21:11:55.746141] [INFO ] [MAIN ] Update Progress: 1886/2371 symbols completed. SCCO took 51.1s. Estimated remaining: 1h 4m 46s. Rate: 7.5 symbols/min [2025-09-26T21:11:55.927054] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-04. [2025-09-26T21:11:55.930947] [INFO ] [MAIN ] SDHC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:11:55.950493] [DEBUG] [LOCAL ] SDHC: Loaded 10574 existing records from primary storage. [2025-09-26T21:11:55.950850] [INFO ] [MAIN ] SDHC: Loaded 10574 existing records. [2025-09-26T21:11:56.145935] [WARN ] [MAIN ] SDHC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:11:56.146228] [INFO ] [MAIN ] SDHC: Wiping existing primary data before full refresh. [2025-09-26T21:11:56.146277] [INFO ] [LOCAL ] SDHC: Starting deletion of primary data. [2025-09-26T21:11:56.146821] [DEBUG] [LOCAL ] SDHC: Deleted primary data file. [2025-09-26T21:11:56.146895] [INFO ] [MAIN ] SDHC: Starting full primary refresh. [2025-09-26T21:11:56.524639] [INFO ] [REMOTE ] SDHC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:11:56.538537] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-26T21:11:56.711728] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-01. [2025-09-26T21:11:57.517264] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2024-12. [2025-09-26T21:11:57.536629] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-26T21:11:58.046957] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-26T21:11:58.311708] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-09. [2025-09-26T21:11:58.503508] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-26T21:11:59.111738] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-05. [2025-09-26T21:11:59.431456] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-26T21:11:59.437060] [INFO ] [REMOTE ] SCM: Full fetch complete (28464 records). [2025-09-26T21:11:59.437213] [DEBUG] [VALIDATOR ] SCM: Validating primary data. [2025-09-26T21:11:59.871955] [DEBUG] [VALIDATOR ] SCM: All expected trading days are present. [2025-09-26T21:11:59.872061] [DEBUG] [VALIDATOR ] SCM: Primary data validation passed. [2025-09-26T21:11:59.872837] [INFO ] [MAIN ] SCM: Fetched primary data is valid. [2025-09-26T21:11:59.872908] [DEBUG] [LOCAL ] SCM: Saving primary data. [2025-09-26T21:11:59.874033] [DEBUG] [LOCAL ] SCM: Trimmed 28464 records to 20163 (keeping 200 days of data) [2025-09-26T21:11:59.953746] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-02. [2025-09-26T21:12:00.053822] [DEBUG] [LOCAL ] SCM: Primary data saved (20163 records). [2025-09-26T21:12:00.054200] [INFO ] [MAIN ] SCM: Full history saved. [2025-09-26T21:12:00.054358] [INFO ] [MAIN ] Update Progress: 1887/2371 symbols completed. SCM took 33.2s. Estimated remaining: 1h 4m 37s. Rate: 7.5 symbols/min [2025-09-26T21:12:00.355462] [INFO ] [MAIN ] SDHY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:12:00.379710] [DEBUG] [LOCAL ] SDHY: Loaded 10653 existing records from primary storage. [2025-09-26T21:12:00.379903] [INFO ] [MAIN ] SDHY: Loaded 10653 existing records. [2025-09-26T21:12:00.561696] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-26T21:12:00.700273] [WARN ] [MAIN ] SDHY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:12:00.700736] [INFO ] [MAIN ] SDHY: Wiping existing primary data before full refresh. [2025-09-26T21:12:00.700794] [INFO ] [LOCAL ] SDHY: Starting deletion of primary data. [2025-09-26T21:12:00.701519] [DEBUG] [LOCAL ] SDHY: Deleted primary data file. [2025-09-26T21:12:00.701585] [INFO ] [MAIN ] SDHY: Starting full primary refresh. [2025-09-26T21:12:00.716913] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-01. [2025-09-26T21:12:01.155244] [INFO ] [REMOTE ] SDHY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:12:01.256142] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-26T21:12:01.511794] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-03. [2025-09-26T21:12:01.927942] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-26T21:12:02.311727] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-02. [2025-09-26T21:12:02.865307] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-26T21:12:03.111734] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2024-12. [2025-09-26T21:12:03.193975] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-26T21:12:03.911696] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-06. [2025-09-26T21:12:04.231986] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-26T21:12:04.711748] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-01. [2025-09-26T21:12:05.511695] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-03. [2025-09-26T21:12:05.617020] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-26T21:12:05.656242] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-26T21:12:06.311743] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-02. [2025-09-26T21:12:06.514046] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-26T21:12:07.111749] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-04. [2025-09-26T21:12:07.140023] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-26T21:12:07.911707] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-03. [2025-09-26T21:12:07.959096] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-26T21:12:08.477217] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-26T21:12:08.711733] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-07. [2025-09-26T21:12:09.511737] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-04. [2025-09-26T21:12:10.311760] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-04. [2025-09-26T21:12:10.387511] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-26T21:12:10.900713] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-26T21:12:11.111729] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-05. [2025-09-26T21:12:11.373736] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-26T21:12:11.911734] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-08. [2025-09-26T21:12:12.447890] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-26T21:12:12.711750] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-05. [2025-09-26T21:12:13.476047] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-26T21:12:13.511707] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-05. [2025-09-26T21:12:13.599989] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-26T21:12:14.311886] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-06. [2025-09-26T21:12:14.314942] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-26T21:12:15.111691] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-09. [2025-09-26T21:12:15.189239] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-26T21:12:15.911740] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-07. [2025-09-26T21:12:16.711691] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-06. [2025-09-26T21:12:16.797935] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-26T21:12:16.887869] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-26T21:12:16.897742] [INFO ] [REMOTE ] SCS: Full fetch complete (60287 records). [2025-09-26T21:12:16.897914] [DEBUG] [VALIDATOR ] SCS: Validating primary data. [2025-09-26T21:12:17.322721] [DEBUG] [VALIDATOR ] SCS: All expected trading days are present. [2025-09-26T21:12:17.322816] [DEBUG] [VALIDATOR ] SCS: Primary data validation passed. [2025-09-26T21:12:17.323890] [INFO ] [MAIN ] SCS: Fetched primary data is valid. [2025-09-26T21:12:17.323961] [DEBUG] [LOCAL ] SCS: Saving primary data. [2025-09-26T21:12:17.326592] [DEBUG] [LOCAL ] SCS: Trimmed 60287 records to 43834 (keeping 200 days of data) [2025-09-26T21:12:17.525021] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-08. [2025-09-26T21:12:17.629231] [DEBUG] [LOCAL ] SCS: Primary data saved (43834 records). [2025-09-26T21:12:17.629382] [INFO ] [MAIN ] SCS: Full history saved. [2025-09-26T21:12:17.629538] [INFO ] [MAIN ] Update Progress: 1888/2371 symbols completed. SCS took 34.1s. Estimated remaining: 1h 4m 32s. Rate: 7.5 symbols/min [2025-09-26T21:12:17.866200] [INFO ] [MAIN ] SDRL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:12:17.914595] [DEBUG] [LOCAL ] SDRL: Loaded 42248 existing records from primary storage. [2025-09-26T21:12:17.914775] [INFO ] [MAIN ] SDRL: Loaded 42248 existing records. [2025-09-26T21:12:18.112610] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-26T21:12:18.155192] [WARN ] [MAIN ] SDRL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:12:18.155681] [INFO ] [MAIN ] SDRL: Wiping existing primary data before full refresh. [2025-09-26T21:12:18.156060] [INFO ] [LOCAL ] SDRL: Starting deletion of primary data. [2025-09-26T21:12:18.157264] [DEBUG] [LOCAL ] SDRL: Deleted primary data file. [2025-09-26T21:12:18.157478] [INFO ] [MAIN ] SDRL: Starting full primary refresh. [2025-09-26T21:12:18.320028] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-07. [2025-09-26T21:12:18.443790] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-26T21:12:18.565404] [INFO ] [REMOTE ] SDRL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:12:19.111722] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-09. [2025-09-26T21:12:19.728327] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-26T21:12:19.911767] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-06. [2025-09-26T21:12:19.950859] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-26T21:12:19.955161] [INFO ] [REMOTE ] SDHY: Full fetch complete (15937 records). [2025-09-26T21:12:19.955278] [DEBUG] [VALIDATOR ] SDHY: Validating primary data. [2025-09-26T21:12:20.341441] [DEBUG] [VALIDATOR ] SDHY: All expected trading days are present. [2025-09-26T21:12:20.341545] [DEBUG] [VALIDATOR ] SDHY: Primary data validation passed. [2025-09-26T21:12:20.342051] [INFO ] [MAIN ] SDHY: Fetched primary data is valid. [2025-09-26T21:12:20.342118] [DEBUG] [LOCAL ] SDHY: Saving primary data. [2025-09-26T21:12:20.342752] [DEBUG] [LOCAL ] SDHY: Trimmed 15937 records to 10710 (keeping 200 days of data) [2025-09-26T21:12:20.421335] [DEBUG] [LOCAL ] SDHY: Primary data saved (10710 records). [2025-09-26T21:12:20.421558] [INFO ] [MAIN ] SDHY: Full history saved. [2025-09-26T21:12:20.421721] [INFO ] [MAIN ] Update Progress: 1889/2371 symbols completed. SDHY took 20.4s. Estimated remaining: 1h 4m 22s. Rate: 7.5 symbols/min [2025-09-26T21:12:20.592692] [INFO ] [MAIN ] SE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:12:20.592940] [DEBUG] [LOCAL ] SE: No existing data file found in primary storage. [2025-09-26T21:12:20.592979] [WARN ] [MAIN ] SE: No existing data found, performing full refresh instead. [2025-09-26T21:12:20.593141] [INFO ] [MAIN ] SE: Wiping existing primary data before full refresh. [2025-09-26T21:12:20.593185] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-09-26T21:12:20.593227] [DEBUG] [LOCAL ] SE: No primary data file found to delete. [2025-09-26T21:12:20.593262] [INFO ] [MAIN ] SE: Starting full primary refresh. [2025-09-26T21:12:20.716876] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2024-12. [2025-09-26T21:12:20.964129] [INFO ] [REMOTE ] SE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:12:20.981889] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-26T21:12:21.511746] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-07. [2025-09-26T21:12:22.316020] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-08. [2025-09-26T21:12:22.319743] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-26T21:12:22.377070] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-26T21:12:23.111727] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-01. [2025-09-26T21:12:23.681461] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-26T21:12:23.911738] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-09. [2025-09-26T21:12:24.643891] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-26T21:12:24.711719] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-08. [2025-09-26T21:12:25.111392] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-26T21:12:25.118306] [INFO ] [REMOTE ] SD: Full fetch complete (41061 records). [2025-09-26T21:12:25.118407] [DEBUG] [VALIDATOR ] SD: Validating primary data. [2025-09-26T21:12:25.514397] [INFO ] [REMOTE ] SE: Fetching primary data for 2024-12. [2025-09-26T21:12:25.532138] [DEBUG] [VALIDATOR ] SD: All expected trading days are present. [2025-09-26T21:12:25.539197] [DEBUG] [VALIDATOR ] SD: Primary data validation passed. [2025-09-26T21:12:25.542592] [INFO ] [MAIN ] SD: Fetched primary data is valid. [2025-09-26T21:12:25.543410] [DEBUG] [LOCAL ] SD: Saving primary data. [2025-09-26T21:12:25.543893] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-26T21:12:25.548897] [DEBUG] [LOCAL ] SD: Trimmed 41061 records to 29368 (keeping 200 days of data) [2025-09-26T21:12:25.741196] [DEBUG] [LOCAL ] SD: Primary data saved (29368 records). [2025-09-26T21:12:25.741426] [INFO ] [MAIN ] SD: Full history saved. [2025-09-26T21:12:25.741560] [INFO ] [MAIN ] Update Progress: 1890/2371 symbols completed. SD took 33.1s. Estimated remaining: 1h 4m 14s. Rate: 7.5 symbols/min [2025-09-26T21:12:25.916111] [INFO ] [MAIN ] SEE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:12:25.963747] [DEBUG] [LOCAL ] SEE: Loaded 48710 existing records from primary storage. [2025-09-26T21:12:25.963946] [INFO ] [MAIN ] SEE: Loaded 48710 existing records. [2025-09-26T21:12:26.144832] [WARN ] [MAIN ] SEE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:12:26.145153] [INFO ] [MAIN ] SEE: Wiping existing primary data before full refresh. [2025-09-26T21:12:26.145203] [INFO ] [LOCAL ] SEE: Starting deletion of primary data. [2025-09-26T21:12:26.146315] [DEBUG] [LOCAL ] SEE: Deleted primary data file. [2025-09-26T21:12:26.146381] [INFO ] [MAIN ] SEE: Starting full primary refresh. [2025-09-26T21:12:26.314730] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-09. [2025-09-26T21:12:26.541257] [INFO ] [REMOTE ] SEE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:12:27.111723] [INFO ] [REMOTE ] SEE: Fetching primary data for 2024-12. [2025-09-26T21:12:27.257808] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-26T21:12:27.260780] [INFO ] [REMOTE ] SDHC: Full fetch complete (17128 records). [2025-09-26T21:12:27.260860] [DEBUG] [VALIDATOR ] SDHC: Validating primary data. [2025-09-26T21:12:27.667961] [DEBUG] [VALIDATOR ] SDHC: All expected trading days are present. [2025-09-26T21:12:27.668078] [DEBUG] [VALIDATOR ] SDHC: Primary data validation passed. [2025-09-26T21:12:27.668526] [INFO ] [MAIN ] SDHC: Fetched primary data is valid. [2025-09-26T21:12:27.668664] [DEBUG] [LOCAL ] SDHC: Saving primary data. [2025-09-26T21:12:27.669845] [DEBUG] [LOCAL ] SDHC: Trimmed 17128 records to 10686 (keeping 200 days of data) [2025-09-26T21:12:27.753520] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-26T21:12:27.780136] [DEBUG] [LOCAL ] SDHC: Primary data saved (10686 records). [2025-09-26T21:12:27.780292] [INFO ] [MAIN ] SDHC: Full history saved. [2025-09-26T21:12:27.780398] [INFO ] [MAIN ] Update Progress: 1891/2371 symbols completed. SDHC took 32.0s. Estimated remaining: 1h 4m 4s. Rate: 7.5 symbols/min [2025-09-26T21:12:27.927335] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-01. [2025-09-26T21:12:27.962917] [INFO ] [MAIN ] SEG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:12:27.979034] [DEBUG] [LOCAL ] SEG: Loaded 13814 existing records from primary storage. [2025-09-26T21:12:27.979167] [INFO ] [MAIN ] SEG: Loaded 13814 existing records. [2025-09-26T21:12:28.180445] [WARN ] [MAIN ] SEG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:12:28.180770] [INFO ] [MAIN ] SEG: Wiping existing primary data before full refresh. [2025-09-26T21:12:28.180823] [INFO ] [LOCAL ] SEG: Starting deletion of primary data. [2025-09-26T21:12:28.181190] [DEBUG] [LOCAL ] SEG: Deleted primary data file. [2025-09-26T21:12:28.181251] [INFO ] [MAIN ] SEG: Starting full primary refresh. [2025-09-26T21:12:28.558349] [INFO ] [REMOTE ] SEG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:12:28.711700] [INFO ] [REMOTE ] SEG: Fetching primary data for 2024-12. [2025-09-26T21:12:28.898357] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-26T21:12:29.511740] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-01. [2025-09-26T21:12:29.531371] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-26T21:12:29.927089] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-26T21:12:30.311784] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-01. [2025-09-26T21:12:31.111699] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-02. [2025-09-26T21:12:31.211628] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-26T21:12:31.231295] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-26T21:12:31.911730] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-02. [2025-09-26T21:12:32.711728] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-02. [2025-09-26T21:12:33.084689] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-26T21:12:33.339219] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-26T21:12:33.511751] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-03. [2025-09-26T21:12:33.629622] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-26T21:12:34.311722] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-02. [2025-09-26T21:12:34.587724] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-26T21:12:35.111709] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-03. [2025-09-26T21:12:35.911707] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-03. [2025-09-26T21:12:36.003748] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-26T21:12:36.711706] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-04. [2025-09-26T21:12:36.784226] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-26T21:12:37.511734] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-03. [2025-09-26T21:12:37.695445] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-26T21:12:38.057475] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-26T21:12:38.311746] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-05. [2025-09-26T21:12:39.111720] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-04. [2025-09-26T21:12:39.285572] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-26T21:12:39.356163] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-26T21:12:39.911724] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-04. [2025-09-26T21:12:40.711751] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-06. [2025-09-26T21:12:40.771766] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-26T21:12:41.511703] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-05. [2025-09-26T21:12:41.557669] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-26T21:12:42.063087] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-26T21:12:42.311739] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-05. [2025-09-26T21:12:43.067451] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-26T21:12:43.111740] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-07. [2025-09-26T21:12:43.911697] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-04. [2025-09-26T21:12:44.070565] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-26T21:12:44.303410] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-26T21:12:44.711744] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-06. [2025-09-26T21:12:45.511711] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-06. [2025-09-26T21:12:45.806694] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-26T21:12:46.076708] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-26T21:12:46.311743] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-08. [2025-09-26T21:12:47.111684] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-07. [2025-09-26T21:12:47.264330] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-26T21:12:47.373591] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-26T21:12:47.911723] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-05. [2025-09-26T21:12:48.613964] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-26T21:12:48.711720] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-07. [2025-09-26T21:12:49.511694] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-09. [2025-09-26T21:12:49.626327] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-26T21:12:50.309486] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-26T21:12:50.312497] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-06. [2025-09-26T21:12:50.312957] [INFO ] [REMOTE ] SEG: Full fetch complete (19787 records). [2025-09-26T21:12:50.314056] [DEBUG] [VALIDATOR ] SEG: Validating primary data. [2025-09-26T21:12:50.745947] [DEBUG] [VALIDATOR ] SEG: All expected trading days are present. [2025-09-26T21:12:50.746101] [DEBUG] [VALIDATOR ] SEG: Primary data validation passed. [2025-09-26T21:12:50.746801] [INFO ] [MAIN ] SEG: Fetched primary data is valid. [2025-09-26T21:12:50.747325] [DEBUG] [LOCAL ] SEG: Saving primary data. [2025-09-26T21:12:50.748362] [DEBUG] [LOCAL ] SEG: Trimmed 19787 records to 13887 (keeping 200 days of data) [2025-09-26T21:12:50.849270] [DEBUG] [LOCAL ] SEG: Primary data saved (13887 records). [2025-09-26T21:12:50.849548] [INFO ] [MAIN ] SEG: Full history saved. [2025-09-26T21:12:50.849711] [INFO ] [MAIN ] Update Progress: 1892/2371 symbols completed. SEG took 23.1s. Estimated remaining: 1h 4m 0s. Rate: 7.5 symbols/min [2025-09-26T21:12:51.035252] [INFO ] [MAIN ] SEI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:12:51.078556] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-09-26T21:12:51.121431] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-08. [2025-09-26T21:12:51.146281] [DEBUG] [LOCAL ] SEI: Loaded 50031 existing records from primary storage. [2025-09-26T21:12:51.146448] [INFO ] [MAIN ] SEI: Loaded 50031 existing records. [2025-09-26T21:12:51.344042] [WARN ] [MAIN ] SEI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:12:51.344349] [INFO ] [MAIN ] SEI: Wiping existing primary data before full refresh. [2025-09-26T21:12:51.344402] [INFO ] [LOCAL ] SEI: Starting deletion of primary data. [2025-09-26T21:12:51.345762] [DEBUG] [LOCAL ] SEI: Deleted primary data file. [2025-09-26T21:12:51.345828] [INFO ] [MAIN ] SEI: Starting full primary refresh. [2025-09-26T21:12:51.741677] [INFO ] [REMOTE ] SEI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:12:51.907622] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-26T21:12:51.916554] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-08. [2025-09-26T21:12:52.716869] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-07. [2025-09-26T21:12:52.736265] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-26T21:12:53.511785] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-09. [2025-09-26T21:12:53.797593] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-26T21:12:54.311732] [INFO ] [REMOTE ] SEI: Fetching primary data for 2024-12. [2025-09-26T21:12:54.361465] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-26T21:12:55.106414] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-26T21:12:55.113902] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-09. [2025-09-26T21:12:55.115839] [INFO ] [REMOTE ] SDRL: Full fetch complete (61751 records). [2025-09-26T21:12:55.115944] [DEBUG] [VALIDATOR ] SDRL: Validating primary data. [2025-09-26T21:12:55.523665] [DEBUG] [VALIDATOR ] SDRL: All expected trading days are present. [2025-09-26T21:12:55.523762] [DEBUG] [VALIDATOR ] SDRL: Primary data validation passed. [2025-09-26T21:12:55.524790] [INFO ] [MAIN ] SDRL: Fetched primary data is valid. [2025-09-26T21:12:55.524857] [DEBUG] [LOCAL ] SDRL: Saving primary data. [2025-09-26T21:12:55.526615] [DEBUG] [LOCAL ] SDRL: Trimmed 61751 records to 42459 (keeping 200 days of data) [2025-09-26T21:12:55.789794] [DEBUG] [LOCAL ] SDRL: Primary data saved (42459 records). [2025-09-26T21:12:55.789936] [INFO ] [MAIN ] SDRL: Full history saved. [2025-09-26T21:12:55.790040] [INFO ] [MAIN ] Update Progress: 1893/2371 symbols completed. SDRL took 38.2s. Estimated remaining: 1h 3m 51s. Rate: 7.5 symbols/min [2025-09-26T21:12:55.914272] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-08. [2025-09-26T21:12:55.982124] [INFO ] [MAIN ] SEM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:12:56.018251] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-26T21:12:56.059027] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-26T21:12:56.069713] [INFO ] [REMOTE ] SE: Full fetch complete (76677 records). [2025-09-26T21:12:56.069908] [DEBUG] [VALIDATOR ] SE: Validating primary data. [2025-09-26T21:12:56.070904] [FATAL] [VALIDATOR ] SE: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T21:12:56.081701] [FATAL] [MAIN ] SE: Fetched primary data is invalid. Refusing to save it. [2025-09-26T21:12:56.081780] [WARN ] [MAIN ] SE: Deleting existing primary and derivative data due to validation failure. [2025-09-26T21:12:56.081857] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-09-26T21:12:56.081937] [DEBUG] [LOCAL ] SE: No primary data file found to delete. [2025-09-26T21:12:56.081996] [INFO ] [LOCAL ] SE: Starting deletion of derivative data. [2025-09-26T21:12:56.082065] [DEBUG] [LOCAL ] SE: No derivative data file found to delete. [2025-09-26T21:12:56.082198] [INFO ] [MAIN ] Update Progress: 1894/2371 symbols completed. SE took 35.7s. Estimated remaining: 1h 3m 41s. Rate: 7.5 symbols/min [2025-09-26T21:12:56.205237] [DEBUG] [LOCAL ] SEM: Loaded 43243 existing records from primary storage. [2025-09-26T21:12:56.216018] [INFO ] [MAIN ] SEM: Loaded 43243 existing records. [2025-09-26T21:12:56.392094] [INFO ] [MAIN ] SEMR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:12:56.475970] [WARN ] [MAIN ] SEM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:12:56.476256] [INFO ] [MAIN ] SEM: Wiping existing primary data before full refresh. [2025-09-26T21:12:56.476320] [INFO ] [LOCAL ] SEM: Starting deletion of primary data. [2025-09-26T21:12:56.477359] [DEBUG] [LOCAL ] SEM: Deleted primary data file. [2025-09-26T21:12:56.477425] [INFO ] [MAIN ] SEM: Starting full primary refresh. [2025-09-26T21:12:56.693062] [DEBUG] [LOCAL ] SEMR: Loaded 41879 existing records from primary storage. [2025-09-26T21:12:56.703937] [INFO ] [MAIN ] SEMR: Loaded 41879 existing records. [2025-09-26T21:12:56.721601] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-01. [2025-09-26T21:12:57.102684] [INFO ] [REMOTE ] SEM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:12:57.088403] [WARN ] [MAIN ] SEMR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:12:57.103262] [INFO ] [MAIN ] SEMR: Wiping existing primary data before full refresh. [2025-09-26T21:12:57.103323] [INFO ] [LOCAL ] SEMR: Starting deletion of primary data. [2025-09-26T21:12:57.104254] [DEBUG] [LOCAL ] SEMR: Deleted primary data file. [2025-09-26T21:12:57.104317] [INFO ] [MAIN ] SEMR: Starting full primary refresh. [2025-09-26T21:12:57.480335] [INFO ] [REMOTE ] SEMR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:12:57.511691] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2024-12. [2025-09-26T21:12:57.753027] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-26T21:12:58.311744] [INFO ] [REMOTE ] SEM: Fetching primary data for 2024-12. [2025-09-26T21:12:58.786056] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-26T21:12:59.027318] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-26T21:12:59.111736] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-02. [2025-09-26T21:12:59.911710] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-09. [2025-09-26T21:12:59.988752] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-26T21:13:00.718794] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-01. [2025-09-26T21:13:00.737422] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T21:13:01.511735] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-01. [2025-09-26T21:13:01.560629] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T21:13:01.570178] [INFO ] [REMOTE ] SEE: Full fetch complete (69597 records). [2025-09-26T21:13:01.570312] [DEBUG] [VALIDATOR ] SEE: Validating primary data. [2025-09-26T21:13:02.014323] [DEBUG] [VALIDATOR ] SEE: All expected trading days are present. [2025-09-26T21:13:02.014429] [DEBUG] [VALIDATOR ] SEE: Primary data validation passed. [2025-09-26T21:13:02.015576] [INFO ] [MAIN ] SEE: Fetched primary data is valid. [2025-09-26T21:13:02.015700] [DEBUG] [LOCAL ] SEE: Saving primary data. [2025-09-26T21:13:02.017539] [DEBUG] [LOCAL ] SEE: Trimmed 69597 records to 49069 (keeping 200 days of data) [2025-09-26T21:13:02.322831] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-03. [2025-09-26T21:13:02.342696] [DEBUG] [LOCAL ] SEE: Primary data saved (49069 records). [2025-09-26T21:13:02.343406] [INFO ] [MAIN ] SEE: Full history saved. [2025-09-26T21:13:02.343546] [INFO ] [MAIN ] Update Progress: 1895/2371 symbols completed. SEE took 36.6s. Estimated remaining: 1h 3m 33s. Rate: 7.5 symbols/min [2025-09-26T21:13:02.534753] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-26T21:13:02.575625] [INFO ] [MAIN ] SES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:13:02.634854] [DEBUG] [LOCAL ] SES: Loaded 51942 existing records from primary storage. [2025-09-26T21:13:02.635020] [INFO ] [MAIN ] SES: Loaded 51942 existing records. [2025-09-26T21:13:02.832735] [WARN ] [MAIN ] SES: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:13:02.833045] [INFO ] [MAIN ] SES: Wiping existing primary data before full refresh. [2025-09-26T21:13:02.833100] [INFO ] [LOCAL ] SES: Starting deletion of primary data. [2025-09-26T21:13:02.834166] [DEBUG] [LOCAL ] SES: Deleted primary data file. [2025-09-26T21:13:02.834228] [INFO ] [MAIN ] SES: Starting full primary refresh. [2025-09-26T21:13:03.122384] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-02. [2025-09-26T21:13:03.256247] [INFO ] [REMOTE ] SES: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:13:03.320079] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-26T21:13:03.911726] [INFO ] [REMOTE ] SES: Fetching primary data for 2024-12. [2025-09-26T21:13:04.201299] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-26T21:13:04.612232] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-26T21:13:04.711731] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-04. [2025-09-26T21:13:05.515423] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-03. [2025-09-26T21:13:05.518402] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-26T21:13:06.261860] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-26T21:13:06.311688] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-01. [2025-09-26T21:13:07.111694] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-02. [2025-09-26T21:13:07.148198] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-26T21:13:07.911740] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-04. [2025-09-26T21:13:08.649697] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-26T21:13:08.711754] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-03. [2025-09-26T21:13:09.056058] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-01 (2.74 seconds). [2025-09-26T21:13:09.517435] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-02. [2025-09-26T21:13:09.522931] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-26T21:13:10.030715] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-26T21:13:10.311760] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-05. [2025-09-26T21:13:11.111744] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-05. [2025-09-26T21:13:11.792833] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-26T21:13:11.917719] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-06. [2025-09-26T21:13:11.931431] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-09-26T21:13:12.711764] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-03. [2025-09-26T21:13:12.866445] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-26T21:13:13.060868] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-26T21:13:13.511741] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-07. [2025-09-26T21:13:14.311758] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-04. [2025-09-26T21:13:14.892045] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-26T21:13:15.123358] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-04. [2025-09-26T21:13:15.125860] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-26T21:13:15.895192] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-26T21:13:15.911678] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-06. [2025-09-26T21:13:16.711743] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-05. [2025-09-26T21:13:17.511729] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-08. [2025-09-26T21:13:17.580599] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-26T21:13:17.686721] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-04 (2.56 seconds). [2025-09-26T21:13:18.311713] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-05. [2025-09-26T21:13:18.441265] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-26T21:13:18.792046] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-26T21:13:19.111719] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-09. [2025-09-26T21:13:19.911739] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-07. [2025-09-26T21:13:20.592125] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-26T21:13:20.625219] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-26T21:13:20.635151] [INFO ] [REMOTE ] SEMR: Full fetch complete (59024 records). [2025-09-26T21:13:20.635348] [DEBUG] [VALIDATOR ] SEMR: Validating primary data. [2025-09-26T21:13:20.718609] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-06. [2025-09-26T21:13:21.059729] [DEBUG] [VALIDATOR ] SEMR: All expected trading days are present. [2025-09-26T21:13:21.059833] [DEBUG] [VALIDATOR ] SEMR: Primary data validation passed. [2025-09-26T21:13:21.061049] [INFO ] [MAIN ] SEMR: Fetched primary data is valid. [2025-09-26T21:13:21.061137] [DEBUG] [LOCAL ] SEMR: Saving primary data. [2025-09-26T21:13:21.062783] [DEBUG] [LOCAL ] SEMR: Trimmed 59024 records to 42184 (keeping 200 days of data) [2025-09-26T21:13:21.313763] [DEBUG] [LOCAL ] SEMR: Primary data saved (42184 records). [2025-09-26T21:13:21.313916] [INFO ] [MAIN ] SEMR: Full history saved. [2025-09-26T21:13:21.314016] [INFO ] [MAIN ] Update Progress: 1896/2371 symbols completed. SEMR took 25.2s. Estimated remaining: 1h 3m 28s. Rate: 7.5 symbols/min [2025-09-26T21:13:21.498970] [INFO ] [MAIN ] SF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:13:21.511783] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-06. [2025-09-26T21:13:21.563948] [DEBUG] [LOCAL ] SF: Loaded 42020 existing records from primary storage. [2025-09-26T21:13:21.564156] [INFO ] [MAIN ] SF: Loaded 42020 existing records. [2025-09-26T21:13:21.760117] [WARN ] [MAIN ] SF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:13:21.760863] [INFO ] [MAIN ] SF: Wiping existing primary data before full refresh. [2025-09-26T21:13:21.761137] [INFO ] [LOCAL ] SF: Starting deletion of primary data. [2025-09-26T21:13:21.772383] [DEBUG] [LOCAL ] SF: Deleted primary data file. [2025-09-26T21:13:21.791785] [INFO ] [MAIN ] SF: Starting full primary refresh. [2025-09-26T21:13:21.842939] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-26T21:13:22.194586] [INFO ] [REMOTE ] SF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:13:22.311713] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-08. [2025-09-26T21:13:22.807674] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-26T21:13:23.055559] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-26T21:13:23.111748] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-07. [2025-09-26T21:13:23.911751] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-07. [2025-09-26T21:13:24.154315] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-26T21:13:24.711782] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-09. [2025-09-26T21:13:25.468483] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-26T21:13:25.511898] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-08. [2025-09-26T21:13:25.515882] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-26T21:13:26.311766] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-08. [2025-09-26T21:13:26.368160] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-26T21:13:26.380774] [INFO ] [REMOTE ] SEI: Full fetch complete (69729 records). [2025-09-26T21:13:26.381018] [DEBUG] [VALIDATOR ] SEI: Validating primary data. [2025-09-26T21:13:26.801524] [DEBUG] [VALIDATOR ] SEI: All expected trading days are present. [2025-09-26T21:13:26.801797] [DEBUG] [VALIDATOR ] SEI: Primary data validation passed. [2025-09-26T21:13:26.803482] [INFO ] [MAIN ] SEI: Fetched primary data is valid. [2025-09-26T21:13:26.803566] [DEBUG] [LOCAL ] SEI: Saving primary data. [2025-09-26T21:13:26.805620] [DEBUG] [LOCAL ] SEI: Trimmed 69729 records to 50411 (keeping 200 days of data) [2025-09-26T21:13:27.080858] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-26T21:13:27.111784] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-09. [2025-09-26T21:13:27.197497] [DEBUG] [LOCAL ] SEI: Primary data saved (50411 records). [2025-09-26T21:13:27.197734] [INFO ] [MAIN ] SEI: Full history saved. [2025-09-26T21:13:27.197891] [INFO ] [MAIN ] Update Progress: 1897/2371 symbols completed. SEI took 36.3s. Estimated remaining: 1h 3m 19s. Rate: 7.5 symbols/min [2025-09-26T21:13:27.374445] [INFO ] [MAIN ] SFB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:13:27.381725] [DEBUG] [LOCAL ] SFB: Loaded 4020 existing records from primary storage. [2025-09-26T21:13:27.381863] [INFO ] [MAIN ] SFB: Loaded 4020 existing records. [2025-09-26T21:13:27.559928] [WARN ] [MAIN ] SFB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:13:27.560253] [INFO ] [MAIN ] SFB: Wiping existing primary data before full refresh. [2025-09-26T21:13:27.560305] [INFO ] [LOCAL ] SFB: Starting deletion of primary data. [2025-09-26T21:13:27.560752] [DEBUG] [LOCAL ] SFB: Deleted primary data file. [2025-09-26T21:13:27.560815] [INFO ] [MAIN ] SFB: Starting full primary refresh. [2025-09-26T21:13:27.926165] [INFO ] [REMOTE ] SF: Fetching primary data for 2024-12. [2025-09-26T21:13:27.931386] [INFO ] [REMOTE ] SFB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:13:28.286595] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-26T21:13:28.692037] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-26T21:13:28.700282] [INFO ] [REMOTE ] SEM: Full fetch complete (61610 records). [2025-09-26T21:13:28.700507] [DEBUG] [VALIDATOR ] SEM: Validating primary data. [2025-09-26T21:13:28.717073] [INFO ] [REMOTE ] SFB: Fetching primary data for 2024-12. [2025-09-26T21:13:29.145149] [DEBUG] [VALIDATOR ] SEM: All expected trading days are present. [2025-09-26T21:13:29.145284] [DEBUG] [VALIDATOR ] SEM: Primary data validation passed. [2025-09-26T21:13:29.146544] [INFO ] [MAIN ] SEM: Fetched primary data is valid. [2025-09-26T21:13:29.146741] [DEBUG] [LOCAL ] SEM: Saving primary data. [2025-09-26T21:13:29.148995] [DEBUG] [LOCAL ] SEM: Trimmed 61610 records to 43533 (keeping 200 days of data) [2025-09-26T21:13:29.174299] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-26T21:13:29.410204] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-26T21:13:29.474462] [DEBUG] [LOCAL ] SEM: Primary data saved (43533 records). [2025-09-26T21:13:29.474670] [INFO ] [MAIN ] SEM: Full history saved. [2025-09-26T21:13:29.474800] [INFO ] [MAIN ] Update Progress: 1898/2371 symbols completed. SEM took 33.7s. Estimated remaining: 1h 3m 10s. Rate: 7.5 symbols/min [2025-09-26T21:13:29.517000] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-09. [2025-09-26T21:13:29.677054] [INFO ] [MAIN ] SFBS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:13:29.703423] [DEBUG] [LOCAL ] SFBS: Loaded 21381 existing records from primary storage. [2025-09-26T21:13:29.703670] [INFO ] [MAIN ] SFBS: Loaded 21381 existing records. [2025-09-26T21:13:29.896458] [WARN ] [MAIN ] SFBS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:13:29.896775] [INFO ] [MAIN ] SFBS: Wiping existing primary data before full refresh. [2025-09-26T21:13:29.896860] [INFO ] [LOCAL ] SFBS: Starting deletion of primary data. [2025-09-26T21:13:29.897608] [DEBUG] [LOCAL ] SFBS: Deleted primary data file. [2025-09-26T21:13:29.897715] [INFO ] [MAIN ] SFBS: Starting full primary refresh. [2025-09-26T21:13:30.285344] [INFO ] [REMOTE ] SFBS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:13:30.311686] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2024-12. [2025-09-26T21:13:30.425122] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-26T21:13:30.439220] [INFO ] [REMOTE ] SES: Full fetch complete (74848 records). [2025-09-26T21:13:30.439463] [DEBUG] [VALIDATOR ] SES: Validating primary data. [2025-09-26T21:13:30.853973] [DEBUG] [VALIDATOR ] SES: All expected trading days are present. [2025-09-26T21:13:30.854089] [DEBUG] [VALIDATOR ] SES: Primary data validation passed. [2025-09-26T21:13:30.855609] [INFO ] [MAIN ] SES: Fetched primary data is valid. [2025-09-26T21:13:30.855705] [DEBUG] [LOCAL ] SES: Saving primary data. [2025-09-26T21:13:30.857767] [DEBUG] [LOCAL ] SES: Trimmed 74848 records to 52331 (keeping 200 days of data) [2025-09-26T21:13:31.103614] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-26T21:13:31.111832] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-01. [2025-09-26T21:13:31.223734] [DEBUG] [LOCAL ] SES: Primary data saved (52331 records). [2025-09-26T21:13:31.223945] [INFO ] [MAIN ] SES: Full history saved. [2025-09-26T21:13:31.224054] [INFO ] [MAIN ] Update Progress: 1899/2371 symbols completed. SES took 28.9s. Estimated remaining: 1h 3m 0s. Rate: 7.5 symbols/min [2025-09-26T21:13:31.416800] [INFO ] [MAIN ] SFL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:13:31.461152] [DEBUG] [LOCAL ] SFL: Loaded 45665 existing records from primary storage. [2025-09-26T21:13:31.461373] [INFO ] [MAIN ] SFL: Loaded 45665 existing records. [2025-09-26T21:13:31.644821] [WARN ] [MAIN ] SFL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:13:31.645191] [INFO ] [MAIN ] SFL: Wiping existing primary data before full refresh. [2025-09-26T21:13:31.645247] [INFO ] [LOCAL ] SFL: Starting deletion of primary data. [2025-09-26T21:13:31.646707] [DEBUG] [LOCAL ] SFL: Deleted primary data file. [2025-09-26T21:13:31.646769] [INFO ] [MAIN ] SFL: Starting full primary refresh. [2025-09-26T21:13:31.840514] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-26T21:13:31.916861] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-02. [2025-09-26T21:13:32.037947] [INFO ] [REMOTE ] SFL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:13:32.470712] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-26T21:13:32.711741] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-03. [2025-09-26T21:13:33.371257] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-26T21:13:33.511752] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-01. [2025-09-26T21:13:34.311754] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-01. [2025-09-26T21:13:35.111764] [INFO ] [REMOTE ] SFL: Fetching primary data for 2024-12. [2025-09-26T21:13:35.351807] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-26T21:13:35.374630] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-26T21:13:35.911756] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-04. [2025-09-26T21:13:36.610131] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-26T21:13:36.713214] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-02. [2025-09-26T21:13:36.717856] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-26T21:13:37.511715] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-02. [2025-09-26T21:13:37.717606] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-26T21:13:38.311745] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-01. [2025-09-26T21:13:39.061528] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-26T21:13:39.111715] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-03. [2025-09-26T21:13:39.573500] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-26T21:13:39.911752] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-03. [2025-09-26T21:13:40.262818] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-26T21:13:40.711761] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-04. [2025-09-26T21:13:41.302931] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-26T21:13:41.511745] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-05. [2025-09-26T21:13:42.077597] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-26T21:13:42.087353] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-26T21:13:42.311750] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-06. [2025-09-26T21:13:42.939074] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-26T21:13:43.111746] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-02. [2025-09-26T21:13:43.911718] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-04. [2025-09-26T21:13:44.716852] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-07. [2025-09-26T21:13:44.745166] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T21:13:45.409668] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-26T21:13:45.511768] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-03. [2025-09-26T21:13:45.763922] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-26T21:13:46.311797] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-05. [2025-09-26T21:13:47.111696] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-08. [2025-09-26T21:13:47.190620] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-26T21:13:47.682264] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-26T21:13:47.911720] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-05. [2025-09-26T21:13:47.954846] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-26T21:13:48.711735] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-09. [2025-09-26T21:13:49.163466] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-26T21:13:49.235733] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-26T21:13:49.237020] [INFO ] [REMOTE ] SFB: Full fetch complete (5740 records). [2025-09-26T21:13:49.237101] [DEBUG] [VALIDATOR ] SFB: Validating primary data. [2025-09-26T21:13:49.516869] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-06. [2025-09-26T21:13:49.628381] [DEBUG] [VALIDATOR ] SFB: All expected trading days are present. [2025-09-26T21:13:49.628464] [DEBUG] [VALIDATOR ] SFB: Primary data validation passed. [2025-09-26T21:13:49.628630] [INFO ] [MAIN ] SFB: Fetched primary data is valid. [2025-09-26T21:13:49.628746] [DEBUG] [LOCAL ] SFB: Saving primary data. [2025-09-26T21:13:49.629175] [DEBUG] [LOCAL ] SFB: Trimmed 5740 records to 4046 (keeping 200 days of data) [2025-09-26T21:13:49.654264] [DEBUG] [LOCAL ] SFB: Primary data saved (4046 records). [2025-09-26T21:13:49.654389] [INFO ] [MAIN ] SFB: Full history saved. [2025-09-26T21:13:49.654484] [INFO ] [MAIN ] Update Progress: 1900/2371 symbols completed. SFB took 22.5s. Estimated remaining: 1h 2m 55s. Rate: 7.5 symbols/min [2025-09-26T21:13:49.826059] [INFO ] [MAIN ] SG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:13:49.881814] [DEBUG] [LOCAL ] SG: Loaded 53838 existing records from primary storage. [2025-09-26T21:13:49.881970] [INFO ] [MAIN ] SG: Loaded 53838 existing records. [2025-09-26T21:13:50.064665] [WARN ] [MAIN ] SG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:13:50.064930] [INFO ] [MAIN ] SG: Wiping existing primary data before full refresh. [2025-09-26T21:13:50.064981] [INFO ] [LOCAL ] SG: Starting deletion of primary data. [2025-09-26T21:13:50.066407] [DEBUG] [LOCAL ] SG: Deleted primary data file. [2025-09-26T21:13:50.066473] [INFO ] [MAIN ] SG: Starting full primary refresh. [2025-09-26T21:13:50.317348] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-04. [2025-09-26T21:13:50.450233] [INFO ] [REMOTE ] SG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:13:50.700521] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-26T21:13:51.111722] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-06. [2025-09-26T21:13:51.911696] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-07. [2025-09-26T21:13:52.317368] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-26T21:13:52.711701] [INFO ] [REMOTE ] SG: Fetching primary data for 2024-12. [2025-09-26T21:13:52.754835] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-26T21:13:53.097560] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-26T21:13:53.511727] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-05. [2025-09-26T21:13:54.311881] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-07. [2025-09-26T21:13:54.757930] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-26T21:13:54.998914] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T21:13:55.111736] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-01. [2025-09-26T21:13:55.657891] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-26T21:13:55.911755] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-08. [2025-09-26T21:13:56.711765] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-08. [2025-09-26T21:13:56.876141] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-26T21:13:57.331286] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-26T21:13:57.485594] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-26T21:13:57.511678] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-06. [2025-09-26T21:13:58.311756] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-02. [2025-09-26T21:13:59.082583] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-26T21:13:59.111693] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-07. [2025-09-26T21:13:59.911720] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-09. [2025-09-26T21:14:00.189164] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-26T21:14:00.711706] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-09. [2025-09-26T21:14:00.780377] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-26T21:14:00.836889] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-26T21:14:00.841424] [INFO ] [REMOTE ] SFBS: Full fetch complete (30239 records). [2025-09-26T21:14:00.841554] [DEBUG] [VALIDATOR ] SFBS: Validating primary data. [2025-09-26T21:14:01.250897] [DEBUG] [VALIDATOR ] SFBS: All expected trading days are present. [2025-09-26T21:14:01.251054] [DEBUG] [VALIDATOR ] SFBS: Primary data validation passed. [2025-09-26T21:14:01.251838] [INFO ] [MAIN ] SFBS: Fetched primary data is valid. [2025-09-26T21:14:01.251926] [DEBUG] [LOCAL ] SFBS: Saving primary data. [2025-09-26T21:14:01.253035] [DEBUG] [LOCAL ] SFBS: Trimmed 30239 records to 21483 (keeping 200 days of data) [2025-09-26T21:14:01.391317] [DEBUG] [LOCAL ] SFBS: Primary data saved (21483 records). [2025-09-26T21:14:01.391464] [INFO ] [MAIN ] SFBS: Full history saved. [2025-09-26T21:14:01.391586] [INFO ] [MAIN ] Update Progress: 1901/2371 symbols completed. SFBS took 31.9s. Estimated remaining: 1h 2m 47s. Rate: 7.5 symbols/min [2025-09-26T21:14:01.516841] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-08. [2025-09-26T21:14:01.586041] [INFO ] [MAIN ] SGHC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:14:01.633880] [DEBUG] [LOCAL ] SGHC: Loaded 46069 existing records from primary storage. [2025-09-26T21:14:01.634036] [INFO ] [MAIN ] SGHC: Loaded 46069 existing records. [2025-09-26T21:14:01.827096] [WARN ] [MAIN ] SGHC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:14:01.827411] [INFO ] [MAIN ] SGHC: Wiping existing primary data before full refresh. [2025-09-26T21:14:01.827465] [INFO ] [LOCAL ] SGHC: Starting deletion of primary data. [2025-09-26T21:14:01.828785] [DEBUG] [LOCAL ] SGHC: Deleted primary data file. [2025-09-26T21:14:01.828876] [INFO ] [MAIN ] SGHC: Starting full primary refresh. [2025-09-26T21:14:02.298011] [INFO ] [REMOTE ] SGHC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:14:02.316328] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-03. [2025-09-26T21:14:02.321254] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-26T21:14:02.329616] [INFO ] [REMOTE ] SF: Full fetch complete (59655 records). [2025-09-26T21:14:02.329764] [DEBUG] [VALIDATOR ] SF: Validating primary data. [2025-09-26T21:14:02.763070] [DEBUG] [VALIDATOR ] SF: All expected trading days are present. [2025-09-26T21:14:02.763166] [DEBUG] [VALIDATOR ] SF: Primary data validation passed. [2025-09-26T21:14:02.764132] [INFO ] [MAIN ] SF: Fetched primary data is valid. [2025-09-26T21:14:02.764206] [DEBUG] [LOCAL ] SF: Saving primary data. [2025-09-26T21:14:02.765757] [DEBUG] [LOCAL ] SF: Trimmed 59655 records to 42360 (keeping 200 days of data) [2025-09-26T21:14:03.059382] [DEBUG] [LOCAL ] SF: Primary data saved (42360 records). [2025-09-26T21:14:03.059533] [INFO ] [MAIN ] SF: Full history saved. [2025-09-26T21:14:03.059677] [INFO ] [MAIN ] Update Progress: 1902/2371 symbols completed. SF took 41.7s. Estimated remaining: 1h 2m 38s. Rate: 7.5 symbols/min [2025-09-26T21:14:03.113001] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2024-12. [2025-09-26T21:14:03.271923] [INFO ] [MAIN ] SGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:14:03.272238] [DEBUG] [LOCAL ] SGI: No existing data file found in primary storage. [2025-09-26T21:14:03.272390] [WARN ] [MAIN ] SGI: No existing data found, performing full refresh instead. [2025-09-26T21:14:03.272804] [INFO ] [MAIN ] SGI: Wiping existing primary data before full refresh. [2025-09-26T21:14:03.272925] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-09-26T21:14:03.273039] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-09-26T21:14:03.273189] [INFO ] [MAIN ] SGI: Starting full primary refresh. [2025-09-26T21:14:03.419047] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-26T21:14:03.701496] [INFO ] [REMOTE ] SGI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:14:03.911729] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-09. [2025-09-26T21:14:04.169745] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-26T21:14:04.675560] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-26T21:14:04.711677] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-01. [2025-09-26T21:14:05.283181] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-26T21:14:05.292886] [INFO ] [REMOTE ] SFL: Full fetch complete (65534 records). [2025-09-26T21:14:05.293071] [DEBUG] [VALIDATOR ] SFL: Validating primary data. [2025-09-26T21:14:05.521138] [INFO ] [REMOTE ] SGI: Fetching primary data for 2024-12. [2025-09-26T21:14:05.721704] [DEBUG] [VALIDATOR ] SFL: All expected trading days are present. [2025-09-26T21:14:05.721807] [DEBUG] [VALIDATOR ] SFL: Primary data validation passed. [2025-09-26T21:14:05.722858] [INFO ] [MAIN ] SFL: Fetched primary data is valid. [2025-09-26T21:14:05.722928] [DEBUG] [LOCAL ] SFL: Saving primary data. [2025-09-26T21:14:05.724458] [DEBUG] [LOCAL ] SFL: Trimmed 65534 records to 46026 (keeping 200 days of data) [2025-09-26T21:14:05.864519] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-26T21:14:05.863794] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:14:05.875301] [WARN ] [REMOTE ] SGI: No data returned for month 2024-12 [2025-09-26T21:14:06.051967] [DEBUG] [LOCAL ] SFL: Primary data saved (46026 records). [2025-09-26T21:14:06.052163] [INFO ] [MAIN ] SFL: Full history saved. [2025-09-26T21:14:06.052269] [INFO ] [MAIN ] Update Progress: 1903/2371 symbols completed. SFL took 34.8s. Estimated remaining: 1h 2m 29s. Rate: 7.5 symbols/min [2025-09-26T21:14:06.276046] [INFO ] [MAIN ] SGU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:14:06.286323] [DEBUG] [LOCAL ] SGU: Loaded 6706 existing records from primary storage. [2025-09-26T21:14:06.286428] [INFO ] [MAIN ] SGU: Loaded 6706 existing records. [2025-09-26T21:14:06.319841] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-04. [2025-09-26T21:14:06.489278] [WARN ] [MAIN ] SGU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:14:06.489541] [INFO ] [MAIN ] SGU: Wiping existing primary data before full refresh. [2025-09-26T21:14:06.489593] [INFO ] [LOCAL ] SGU: Starting deletion of primary data. [2025-09-26T21:14:06.489965] [DEBUG] [LOCAL ] SGU: Deleted primary data file. [2025-09-26T21:14:06.490032] [INFO ] [MAIN ] SGU: Starting full primary refresh. [2025-09-26T21:14:06.877714] [INFO ] [REMOTE ] SGU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:14:07.111779] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-02. [2025-09-26T21:14:07.911713] [INFO ] [REMOTE ] SGU: Fetching primary data for 2024-12. [2025-09-26T21:14:08.343208] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-26T21:14:08.630793] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-26T21:14:08.722562] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-01. [2025-09-26T21:14:08.728354] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-26T21:14:09.426082] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-26T21:14:09.511774] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-01. [2025-09-26T21:14:09.784321] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:14:09.784758] [WARN ] [REMOTE ] SGI: No data returned for month 2025-01 [2025-09-26T21:14:10.311756] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-03. [2025-09-26T21:14:11.111750] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-02. [2025-09-26T21:14:11.780277] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-26T21:14:11.911737] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-05. [2025-09-26T21:14:12.384503] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-26T21:14:12.711744] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-03. [2025-09-26T21:14:13.511752] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-02. [2025-09-26T21:14:13.783598] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-26T21:14:14.165255] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-26T21:14:14.311731] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-04. [2025-09-26T21:14:14.413486] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-26T21:14:15.111788] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-03. [2025-09-26T21:14:15.852811] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-26T21:14:15.911694] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-04. [2025-09-26T21:14:15.961618] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-26T21:14:16.711757] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-05. [2025-09-26T21:14:17.511712] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-04. [2025-09-26T21:14:17.961613] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-26T21:14:18.311765] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-05. [2025-09-26T21:14:18.349434] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-26T21:14:18.546532] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-26T21:14:19.111723] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-06. [2025-09-26T21:14:19.911767] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-06. [2025-09-26T21:14:20.231522] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-26T21:14:20.711779] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-06. [2025-09-26T21:14:21.190673] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-26T21:14:21.524036] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-05. [2025-09-26T21:14:21.550713] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-26T21:14:22.297250] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-26T21:14:22.311685] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-06. [2025-09-26T21:14:22.537262] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-26T21:14:22.842188] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-26T21:14:23.111746] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-07. [2025-09-26T21:14:23.911761] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-07. [2025-09-26T21:14:24.711715] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-07. [2025-09-26T21:14:24.981302] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-26T21:14:25.511716] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-07. [2025-09-26T21:14:25.558705] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-26T21:14:25.676786] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-26T21:14:26.311765] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-08. [2025-09-26T21:14:27.111778] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-08. [2025-09-26T21:14:27.795100] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-26T21:14:27.847460] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-26T21:14:27.909158] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-26T21:14:27.911807] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-09. [2025-09-26T21:14:28.711701] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-09. [2025-09-26T21:14:28.796704] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-26T21:14:28.799098] [INFO ] [REMOTE ] SGU: Full fetch complete (8968 records). [2025-09-26T21:14:28.799176] [DEBUG] [VALIDATOR ] SGU: Validating primary data. [2025-09-26T21:14:29.204672] [DEBUG] [VALIDATOR ] SGU: All expected trading days are present. [2025-09-26T21:14:29.204805] [DEBUG] [VALIDATOR ] SGU: Primary data validation passed. [2025-09-26T21:14:29.205378] [INFO ] [MAIN ] SGU: Fetched primary data is valid. [2025-09-26T21:14:29.205479] [DEBUG] [LOCAL ] SGU: Saving primary data. [2025-09-26T21:14:29.209209] [DEBUG] [LOCAL ] SGU: Trimmed 8968 records to 6765 (keeping 200 days of data) [2025-09-26T21:14:29.259870] [DEBUG] [LOCAL ] SGU: Primary data saved (6765 records). [2025-09-26T21:14:29.260032] [INFO ] [MAIN ] SGU: Full history saved. [2025-09-26T21:14:29.260350] [INFO ] [MAIN ] Update Progress: 1904/2371 symbols completed. SGU took 23.2s. Estimated remaining: 1h 2m 24s. Rate: 7.5 symbols/min [2025-09-26T21:14:29.441166] [INFO ] [MAIN ] SHAK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:14:29.500376] [DEBUG] [LOCAL ] SHAK: Loaded 49485 existing records from primary storage. [2025-09-26T21:14:29.500545] [INFO ] [MAIN ] SHAK: Loaded 49485 existing records. [2025-09-26T21:14:29.522222] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-08. [2025-09-26T21:14:29.697500] [WARN ] [MAIN ] SHAK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:14:29.697834] [INFO ] [MAIN ] SHAK: Wiping existing primary data before full refresh. [2025-09-26T21:14:29.697889] [INFO ] [LOCAL ] SHAK: Starting deletion of primary data. [2025-09-26T21:14:29.699152] [DEBUG] [LOCAL ] SHAK: Deleted primary data file. [2025-09-26T21:14:29.699228] [INFO ] [MAIN ] SHAK: Starting full primary refresh. [2025-09-26T21:14:30.071778] [INFO ] [REMOTE ] SHAK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:14:30.311731] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-08. [2025-09-26T21:14:30.576703] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-26T21:14:30.591445] [INFO ] [REMOTE ] SGHC: Full fetch complete (63418 records). [2025-09-26T21:14:30.591664] [DEBUG] [VALIDATOR ] SGHC: Validating primary data. [2025-09-26T21:14:31.010856] [DEBUG] [VALIDATOR ] SGHC: All expected trading days are present. [2025-09-26T21:14:31.011247] [DEBUG] [VALIDATOR ] SGHC: Primary data validation passed. [2025-09-26T21:14:31.012473] [INFO ] [MAIN ] SGHC: Fetched primary data is valid. [2025-09-26T21:14:31.012571] [DEBUG] [LOCAL ] SGHC: Saving primary data. [2025-09-26T21:14:31.014497] [DEBUG] [LOCAL ] SGHC: Trimmed 63418 records to 46435 (keeping 200 days of data) [2025-09-26T21:14:31.111829] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2024-12. [2025-09-26T21:14:31.325886] [DEBUG] [LOCAL ] SGHC: Primary data saved (46435 records). [2025-09-26T21:14:31.326068] [INFO ] [MAIN ] SGHC: Full history saved. [2025-09-26T21:14:31.326212] [INFO ] [MAIN ] Update Progress: 1905/2371 symbols completed. SGHC took 29.9s. Estimated remaining: 1h 2m 15s. Rate: 7.5 symbols/min [2025-09-26T21:14:31.518354] [INFO ] [MAIN ] SHCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:14:31.558724] [DEBUG] [LOCAL ] SHCO: Loaded 26175 existing records from primary storage. [2025-09-26T21:14:31.558898] [INFO ] [MAIN ] SHCO: Loaded 26175 existing records. [2025-09-26T21:14:31.851082] [WARN ] [MAIN ] SHCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:14:31.855266] [INFO ] [MAIN ] SHCO: Wiping existing primary data before full refresh. [2025-09-26T21:14:31.855345] [INFO ] [LOCAL ] SHCO: Starting deletion of primary data. [2025-09-26T21:14:31.859545] [DEBUG] [LOCAL ] SHCO: Deleted primary data file. [2025-09-26T21:14:31.859447] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-26T21:14:31.859858] [INFO ] [MAIN ] SHCO: Starting full primary refresh. [2025-09-26T21:14:31.925333] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-09. [2025-09-26T21:14:32.266957] [INFO ] [REMOTE ] SHCO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:14:32.309008] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-26T21:14:32.429980] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-26T21:14:32.711729] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-09. [2025-09-26T21:14:33.511757] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-01. [2025-09-26T21:14:34.173815] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-26T21:14:34.186391] [INFO ] [REMOTE ] SG: Full fetch complete (77263 records). [2025-09-26T21:14:34.186568] [DEBUG] [VALIDATOR ] SG: Validating primary data. [2025-09-26T21:14:34.312772] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2024-12. [2025-09-26T21:14:34.664485] [DEBUG] [VALIDATOR ] SG: All expected trading days are present. [2025-09-26T21:14:34.664786] [DEBUG] [VALIDATOR ] SG: Primary data validation passed. [2025-09-26T21:14:34.666013] [INFO ] [MAIN ] SG: Fetched primary data is valid. [2025-09-26T21:14:34.666111] [DEBUG] [LOCAL ] SG: Saving primary data. [2025-09-26T21:14:34.668947] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-26T21:14:34.679691] [INFO ] [REMOTE ] SGI: Full fetch complete (58249 records). [2025-09-26T21:14:34.680080] [DEBUG] [VALIDATOR ] SGI: Validating primary data. [2025-09-26T21:14:34.679956] [DEBUG] [LOCAL ] SG: Trimmed 77263 records to 54227 (keeping 200 days of data) [2025-09-26T21:14:35.027265] [WARN ] [VALIDATOR ] SGI: Validation failed - insufficient historical data. Have 154 unique days, need 200 days [2025-09-26T21:14:35.032027] [FATAL] [MAIN ] SGI: Fetched primary data is invalid. Refusing to save it. [2025-09-26T21:14:35.032192] [WARN ] [MAIN ] SGI: Deleting existing primary and derivative data due to validation failure. [2025-09-26T21:14:35.032284] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-09-26T21:14:35.032376] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-09-26T21:14:35.032418] [INFO ] [LOCAL ] SGI: Starting deletion of derivative data. [2025-09-26T21:14:35.032576] [DEBUG] [LOCAL ] SGI: No derivative data file found to delete. [2025-09-26T21:14:35.032717] [INFO ] [MAIN ] Update Progress: 1906/2371 symbols completed. SGI took 32.0s. Estimated remaining: 1h 2m 6s. Rate: 7.5 symbols/min [2025-09-26T21:14:35.320452] [INFO ] [MAIN ] SHEL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:14:35.364956] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-26T21:14:35.377303] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-02. [2025-09-26T21:14:35.397617] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-26T21:14:35.519394] [DEBUG] [LOCAL ] SHEL: Loaded 54061 existing records from primary storage. [2025-09-26T21:14:35.520516] [INFO ] [MAIN ] SHEL: Loaded 54061 existing records. [2025-09-26T21:14:35.741341] [WARN ] [MAIN ] SHEL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:14:35.742940] [INFO ] [MAIN ] SHEL: Wiping existing primary data before full refresh. [2025-09-26T21:14:35.743330] [INFO ] [LOCAL ] SHEL: Starting deletion of primary data. [2025-09-26T21:14:35.745588] [DEBUG] [LOCAL ] SHEL: Deleted primary data file. [2025-09-26T21:14:35.746263] [INFO ] [MAIN ] SHEL: Starting full primary refresh. [2025-09-26T21:14:35.844922] [DEBUG] [LOCAL ] SG: Primary data saved (54227 records). [2025-09-26T21:14:35.859299] [INFO ] [MAIN ] SG: Full history saved. [2025-09-26T21:14:35.872114] [INFO ] [MAIN ] Update Progress: 1907/2371 symbols completed. SG took 46.2s. Estimated remaining: 1h 1m 56s. Rate: 7.5 symbols/min [2025-09-26T21:14:35.912029] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-01. [2025-09-26T21:14:36.347973] [INFO ] [MAIN ] SHG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:14:36.381572] [INFO ] [REMOTE ] SHEL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:14:36.417179] [DEBUG] [LOCAL ] SHG: Loaded 27160 existing records from primary storage. [2025-09-26T21:14:36.417338] [INFO ] [MAIN ] SHG: Loaded 27160 existing records. [2025-09-26T21:14:36.609836] [WARN ] [MAIN ] SHG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:14:36.610100] [INFO ] [MAIN ] SHG: Wiping existing primary data before full refresh. [2025-09-26T21:14:36.610150] [INFO ] [LOCAL ] SHG: Starting deletion of primary data. [2025-09-26T21:14:36.610829] [DEBUG] [LOCAL ] SHG: Deleted primary data file. [2025-09-26T21:14:36.610910] [INFO ] [MAIN ] SHG: Starting full primary refresh. [2025-09-26T21:14:36.718082] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2024-12. [2025-09-26T21:14:37.013276] [INFO ] [REMOTE ] SHG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:14:37.213545] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-26T21:14:37.257429] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-26T21:14:37.511729] [INFO ] [REMOTE ] SHG: Fetching primary data for 2024-12. [2025-09-26T21:14:38.311740] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-02. [2025-09-26T21:14:38.939967] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-26T21:14:39.030271] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-26T21:14:39.058703] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-26T21:14:39.111732] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-03. [2025-09-26T21:14:39.911739] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-01. [2025-09-26T21:14:40.560250] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-26T21:14:40.711727] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-04. [2025-09-26T21:14:41.511736] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-03. [2025-09-26T21:14:41.915588] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-26T21:14:42.101025] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-26T21:14:42.311743] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-02. [2025-09-26T21:14:43.111705] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-05. [2025-09-26T21:14:43.278043] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-26T21:14:43.911703] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-01. [2025-09-26T21:14:44.291384] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-26T21:14:44.466968] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-26T21:14:44.711733] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-06. [2025-09-26T21:14:45.327691] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-26T21:14:45.511727] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-03. [2025-09-26T21:14:45.663981] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-26T21:14:46.311732] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-02. [2025-09-26T21:14:47.111729] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-04. [2025-09-26T21:14:47.656827] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-26T21:14:47.735205] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-26T21:14:47.911701] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-07. [2025-09-26T21:14:48.711739] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-03. [2025-09-26T21:14:48.820264] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-26T21:14:49.117483] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-26T21:14:49.511730] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-04. [2025-09-26T21:14:50.159418] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-26T21:14:50.311747] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-05. [2025-09-26T21:14:51.111731] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-04. [2025-09-26T21:14:51.638301] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-26T21:14:51.911702] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-08. [2025-09-26T21:14:52.023105] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-26T21:14:52.510396] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-26T21:14:52.711722] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-05. [2025-09-26T21:14:53.263002] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-26T21:14:53.511740] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-05. [2025-09-26T21:14:54.279913] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-26T21:14:54.311716] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-09. [2025-09-26T21:14:55.111713] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-06. [2025-09-26T21:14:55.644359] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-26T21:14:55.650738] [INFO ] [REMOTE ] SHCO: Full fetch complete (37543 records). [2025-09-26T21:14:55.650936] [DEBUG] [VALIDATOR ] SHCO: Validating primary data. [2025-09-26T21:14:55.918168] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-06. [2025-09-26T21:14:56.064721] [DEBUG] [VALIDATOR ] SHCO: All expected trading days are present. [2025-09-26T21:14:56.064829] [DEBUG] [VALIDATOR ] SHCO: Primary data validation passed. [2025-09-26T21:14:56.065588] [INFO ] [MAIN ] SHCO: Fetched primary data is valid. [2025-09-26T21:14:56.065725] [DEBUG] [LOCAL ] SHCO: Saving primary data. [2025-09-26T21:14:56.066722] [DEBUG] [LOCAL ] SHCO: Trimmed 37543 records to 26427 (keeping 200 days of data) [2025-09-26T21:14:56.182635] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-09-26T21:14:56.264440] [DEBUG] [LOCAL ] SHCO: Primary data saved (26427 records). [2025-09-26T21:14:56.264583] [INFO ] [MAIN ] SHCO: Full history saved. [2025-09-26T21:14:56.264700] [INFO ] [MAIN ] Update Progress: 1908/2371 symbols completed. SHCO took 24.9s. Estimated remaining: 1h 1m 51s. Rate: 7.5 symbols/min [2025-09-26T21:14:56.443968] [INFO ] [MAIN ] SHO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:14:56.487350] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-26T21:14:56.529861] [DEBUG] [LOCAL ] SHO: Loaded 50179 existing records from primary storage. [2025-09-26T21:14:56.530013] [INFO ] [MAIN ] SHO: Loaded 50179 existing records. [2025-09-26T21:14:56.711989] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-07. [2025-09-26T21:14:56.712177] [WARN ] [MAIN ] SHO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:14:56.713393] [INFO ] [MAIN ] SHO: Wiping existing primary data before full refresh. [2025-09-26T21:14:56.713462] [INFO ] [LOCAL ] SHO: Starting deletion of primary data. [2025-09-26T21:14:56.714520] [DEBUG] [LOCAL ] SHO: Deleted primary data file. [2025-09-26T21:14:56.714588] [INFO ] [MAIN ] SHO: Starting full primary refresh. [2025-09-26T21:14:57.119403] [INFO ] [REMOTE ] SHO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:14:57.212350] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-26T21:14:57.511749] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-06. [2025-09-26T21:14:58.311795] [INFO ] [REMOTE ] SHO: Fetching primary data for 2024-12. [2025-09-26T21:14:58.635674] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-26T21:14:59.111699] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-08. [2025-09-26T21:14:59.361633] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-26T21:14:59.443057] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-26T21:14:59.911731] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-01. [2025-09-26T21:15:00.711685] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-07. [2025-09-26T21:15:00.882728] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-26T21:15:01.511724] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-09. [2025-09-26T21:15:01.635876] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-26T21:15:02.311757] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-02. [2025-09-26T21:15:02.865734] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-26T21:15:03.111756] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-08. [2025-09-26T21:15:03.427522] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-26T21:15:03.438309] [INFO ] [REMOTE ] SHAK: Full fetch complete (70148 records). [2025-09-26T21:15:03.438509] [DEBUG] [VALIDATOR ] SHAK: Validating primary data. [2025-09-26T21:15:03.892238] [DEBUG] [VALIDATOR ] SHAK: All expected trading days are present. [2025-09-26T21:15:03.892428] [DEBUG] [VALIDATOR ] SHAK: Primary data validation passed. [2025-09-26T21:15:03.893666] [INFO ] [MAIN ] SHAK: Fetched primary data is valid. [2025-09-26T21:15:03.893771] [DEBUG] [LOCAL ] SHAK: Saving primary data. [2025-09-26T21:15:03.895575] [DEBUG] [LOCAL ] SHAK: Trimmed 70148 records to 49831 (keeping 200 days of data) [2025-09-26T21:15:03.949505] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-07. [2025-09-26T21:15:04.052614] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-26T21:15:04.250123] [DEBUG] [LOCAL ] SHAK: Primary data saved (49831 records). [2025-09-26T21:15:04.250290] [INFO ] [MAIN ] SHAK: Full history saved. [2025-09-26T21:15:04.250392] [INFO ] [MAIN ] Update Progress: 1909/2371 symbols completed. SHAK took 35.0s. Estimated remaining: 1h 1m 43s. Rate: 7.5 symbols/min [2025-09-26T21:15:04.436291] [INFO ] [MAIN ] SHOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:15:04.442278] [DEBUG] [LOCAL ] SHOC: Loaded 3735 existing records from primary storage. [2025-09-26T21:15:04.442394] [INFO ] [MAIN ] SHOC: Loaded 3735 existing records. [2025-09-26T21:15:04.642341] [WARN ] [MAIN ] SHOC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:15:04.642684] [INFO ] [MAIN ] SHOC: Wiping existing primary data before full refresh. [2025-09-26T21:15:04.642745] [INFO ] [LOCAL ] SHOC: Starting deletion of primary data. [2025-09-26T21:15:04.642990] [DEBUG] [LOCAL ] SHOC: Deleted primary data file. [2025-09-26T21:15:04.643052] [INFO ] [MAIN ] SHOC: Starting full primary refresh. [2025-09-26T21:15:04.717754] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-03. [2025-09-26T21:15:05.028235] [INFO ] [REMOTE ] SHOC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:15:05.245576] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-26T21:15:05.500258] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-26T21:15:05.511663] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-08. [2025-09-26T21:15:06.082963] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-26T21:15:06.311754] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2024-12. [2025-09-26T21:15:06.739997] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-26T21:15:07.111752] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-09. [2025-09-26T21:15:07.201305] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-26T21:15:07.911737] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-04. [2025-09-26T21:15:08.711774] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-01. [2025-09-26T21:15:09.341672] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-26T21:15:09.353194] [INFO ] [REMOTE ] SHEL: Full fetch complete (77690 records). [2025-09-26T21:15:09.353392] [DEBUG] [VALIDATOR ] SHEL: Validating primary data. [2025-09-26T21:15:09.470931] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-26T21:15:09.518371] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-02. [2025-09-26T21:15:09.798040] [DEBUG] [VALIDATOR ] SHEL: All expected trading days are present. [2025-09-26T21:15:09.798161] [DEBUG] [VALIDATOR ] SHEL: Primary data validation passed. [2025-09-26T21:15:09.799384] [INFO ] [MAIN ] SHEL: Fetched primary data is valid. [2025-09-26T21:15:09.799527] [DEBUG] [LOCAL ] SHEL: Saving primary data. [2025-09-26T21:15:09.812420] [DEBUG] [LOCAL ] SHEL: Trimmed 77690 records to 54451 (keeping 200 days of data) [2025-09-26T21:15:09.832921] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-26T21:15:10.204365] [DEBUG] [LOCAL ] SHEL: Primary data saved (54451 records). [2025-09-26T21:15:10.204592] [INFO ] [MAIN ] SHEL: Full history saved. [2025-09-26T21:15:10.204750] [INFO ] [MAIN ] Update Progress: 1910/2371 symbols completed. SHEL took 35.2s. Estimated remaining: 1h 1m 35s. Rate: 7.5 symbols/min [2025-09-26T21:15:10.314207] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-05. [2025-09-26T21:15:10.349091] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-26T21:15:10.406548] [INFO ] [MAIN ] SHW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:15:10.457919] [DEBUG] [LOCAL ] SHW: Loaded 50823 existing records from primary storage. [2025-09-26T21:15:10.458074] [INFO ] [MAIN ] SHW: Loaded 50823 existing records. [2025-09-26T21:15:10.649061] [WARN ] [MAIN ] SHW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:15:10.649334] [INFO ] [MAIN ] SHW: Wiping existing primary data before full refresh. [2025-09-26T21:15:10.649385] [INFO ] [LOCAL ] SHW: Starting deletion of primary data. [2025-09-26T21:15:10.650710] [DEBUG] [LOCAL ] SHW: Deleted primary data file. [2025-09-26T21:15:10.650775] [INFO ] [MAIN ] SHW: Starting full primary refresh. [2025-09-26T21:15:11.035202] [INFO ] [REMOTE ] SHW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:15:11.111680] [INFO ] [REMOTE ] SHW: Fetching primary data for 2024-12. [2025-09-26T21:15:11.911731] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-03. [2025-09-26T21:15:12.023373] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-26T21:15:12.584843] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-26T21:15:12.711971] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-09. [2025-09-26T21:15:12.715159] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-26T21:15:13.511753] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-06. [2025-09-26T21:15:13.902712] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-26T21:15:13.908806] [INFO ] [REMOTE ] SHG: Full fetch complete (41367 records). [2025-09-26T21:15:13.908938] [DEBUG] [VALIDATOR ] SHG: Validating primary data. [2025-09-26T21:15:14.320182] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-04. [2025-09-26T21:15:14.331914] [DEBUG] [VALIDATOR ] SHG: All expected trading days are present. [2025-09-26T21:15:14.332002] [DEBUG] [VALIDATOR ] SHG: Primary data validation passed. [2025-09-26T21:15:14.333064] [INFO ] [MAIN ] SHG: Fetched primary data is valid. [2025-09-26T21:15:14.333193] [DEBUG] [LOCAL ] SHG: Saving primary data. [2025-09-26T21:15:14.334545] [DEBUG] [LOCAL ] SHG: Trimmed 41367 records to 27307 (keeping 200 days of data) [2025-09-26T21:15:14.524322] [DEBUG] [LOCAL ] SHG: Primary data saved (27307 records). [2025-09-26T21:15:14.524478] [INFO ] [MAIN ] SHG: Full history saved. [2025-09-26T21:15:14.524579] [INFO ] [MAIN ] Update Progress: 1911/2371 symbols completed. SHG took 38.7s. Estimated remaining: 1h 1m 26s. Rate: 7.5 symbols/min [2025-09-26T21:15:14.717290] [INFO ] [MAIN ] SI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:15:14.717755] [DEBUG] [LOCAL ] SI: No existing data file found in primary storage. [2025-09-26T21:15:14.717830] [WARN ] [MAIN ] SI: No existing data found, performing full refresh instead. [2025-09-26T21:15:14.718144] [INFO ] [MAIN ] SI: Wiping existing primary data before full refresh. [2025-09-26T21:15:14.718200] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-09-26T21:15:14.718246] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-09-26T21:15:14.718280] [INFO ] [MAIN ] SI: Starting full primary refresh. [2025-09-26T21:15:15.044577] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-26T21:15:15.126440] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-01. [2025-09-26T21:15:15.133292] [INFO ] [REMOTE ] SI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:15:15.163434] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-26T21:15:15.911732] [INFO ] [REMOTE ] SI: Fetching primary data for 2024-12. [2025-09-26T21:15:16.199538] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:15:16.199966] [WARN ] [REMOTE ] SI: No data returned for month 2024-12 [2025-09-26T21:15:16.711697] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-05. [2025-09-26T21:15:16.905681] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-26T21:15:17.255888] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-26T21:15:17.511748] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-02. [2025-09-26T21:15:18.311766] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-07. [2025-09-26T21:15:19.111809] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-06. [2025-09-26T21:15:19.423085] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-26T21:15:19.494036] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-26T21:15:19.921229] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-07. [2025-09-26T21:15:19.927859] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-26T21:15:20.664562] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-26T21:15:20.711764] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-08. [2025-09-26T21:15:21.511743] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-08. [2025-09-26T21:15:22.112827] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-26T21:15:22.315365] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-09. [2025-09-26T21:15:22.321613] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-26T21:15:22.898727] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-26T21:15:22.900078] [INFO ] [REMOTE ] SHOC: Full fetch complete (7410 records). [2025-09-26T21:15:22.900161] [DEBUG] [VALIDATOR ] SHOC: Validating primary data. [2025-09-26T21:15:23.119690] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-03. [2025-09-26T21:15:23.292791] [DEBUG] [VALIDATOR ] SHOC: All expected trading days are present. [2025-09-26T21:15:23.292891] [DEBUG] [VALIDATOR ] SHOC: Primary data validation passed. [2025-09-26T21:15:23.293122] [INFO ] [MAIN ] SHOC: Fetched primary data is valid. [2025-09-26T21:15:23.293165] [DEBUG] [LOCAL ] SHOC: Saving primary data. [2025-09-26T21:15:23.293846] [DEBUG] [LOCAL ] SHOC: Trimmed 7410 records to 3747 (keeping 200 days of data) [2025-09-26T21:15:23.318578] [DEBUG] [LOCAL ] SHOC: Primary data saved (3747 records). [2025-09-26T21:15:23.318803] [INFO ] [MAIN ] SHOC: Full history saved. [2025-09-26T21:15:23.318910] [INFO ] [MAIN ] Update Progress: 1912/2371 symbols completed. SHOC took 19.1s. Estimated remaining: 1h 1m 18s. Rate: 7.5 symbols/min [2025-09-26T21:15:23.504803] [INFO ] [MAIN ] SID: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:15:23.549332] [DEBUG] [LOCAL ] SID: Loaded 42519 existing records from primary storage. [2025-09-26T21:15:23.549492] [INFO ] [MAIN ] SID: Loaded 42519 existing records. [2025-09-26T21:15:23.750381] [WARN ] [MAIN ] SID: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:15:23.750726] [INFO ] [MAIN ] SID: Wiping existing primary data before full refresh. [2025-09-26T21:15:23.750800] [INFO ] [LOCAL ] SID: Starting deletion of primary data. [2025-09-26T21:15:23.751694] [DEBUG] [LOCAL ] SID: Deleted primary data file. [2025-09-26T21:15:23.751759] [INFO ] [MAIN ] SID: Starting full primary refresh. [2025-09-26T21:15:23.916854] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-09. [2025-09-26T21:15:24.197298] [INFO ] [REMOTE ] SID: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:15:24.711724] [INFO ] [REMOTE ] SID: Fetching primary data for 2024-12. [2025-09-26T21:15:25.065690] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-26T21:15:25.511721] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-04. [2025-09-26T21:15:25.628010] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-26T21:15:25.638677] [INFO ] [REMOTE ] SHO: Full fetch complete (71116 records). [2025-09-26T21:15:25.638875] [DEBUG] [VALIDATOR ] SHO: Validating primary data. [2025-09-26T21:15:26.090309] [DEBUG] [VALIDATOR ] SHO: All expected trading days are present. [2025-09-26T21:15:26.090581] [DEBUG] [VALIDATOR ] SHO: Primary data validation passed. [2025-09-26T21:15:26.092329] [INFO ] [MAIN ] SHO: Fetched primary data is valid. [2025-09-26T21:15:26.093798] [DEBUG] [LOCAL ] SHO: Saving primary data. [2025-09-26T21:15:26.093710] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-26T21:15:26.105247] [DEBUG] [LOCAL ] SHO: Trimmed 71116 records to 50552 (keeping 200 days of data) [2025-09-26T21:15:26.317636] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-01. [2025-09-26T21:15:26.423422] [DEBUG] [LOCAL ] SHO: Primary data saved (50552 records). [2025-09-26T21:15:26.423595] [INFO ] [MAIN ] SHO: Full history saved. [2025-09-26T21:15:26.423742] [INFO ] [MAIN ] Update Progress: 1913/2371 symbols completed. SHO took 30.2s. Estimated remaining: 1h 1m 9s. Rate: 7.5 symbols/min [2025-09-26T21:15:26.606191] [INFO ] [MAIN ] SIG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:15:26.656392] [DEBUG] [LOCAL ] SIG: Loaded 46847 existing records from primary storage. [2025-09-26T21:15:26.656602] [INFO ] [MAIN ] SIG: Loaded 46847 existing records. [2025-09-26T21:15:26.842432] [WARN ] [MAIN ] SIG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:15:26.842868] [INFO ] [MAIN ] SIG: Wiping existing primary data before full refresh. [2025-09-26T21:15:26.842976] [INFO ] [LOCAL ] SIG: Starting deletion of primary data. [2025-09-26T21:15:26.844100] [DEBUG] [LOCAL ] SIG: Deleted primary data file. [2025-09-26T21:15:26.844169] [INFO ] [MAIN ] SIG: Starting full primary refresh. [2025-09-26T21:15:27.114048] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-01. [2025-09-26T21:15:27.227068] [INFO ] [REMOTE ] SIG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:15:27.442850] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:15:27.443410] [WARN ] [REMOTE ] SI: No data returned for month 2025-01 [2025-09-26T21:15:27.507036] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-26T21:15:27.857269] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-26T21:15:27.911738] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-05. [2025-09-26T21:15:28.711736] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-02. [2025-09-26T21:15:29.511740] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-02. [2025-09-26T21:15:29.765543] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:15:29.765994] [WARN ] [REMOTE ] SI: No data returned for month 2025-02 [2025-09-26T21:15:29.831249] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-26T21:15:30.168611] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-26T21:15:30.311772] [INFO ] [REMOTE ] SIG: Fetching primary data for 2024-12. [2025-09-26T21:15:31.111720] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-03. [2025-09-26T21:15:31.373522] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:15:31.373934] [WARN ] [REMOTE ] SI: No data returned for month 2025-03 [2025-09-26T21:15:31.911702] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-06. [2025-09-26T21:15:32.088887] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-26T21:15:32.711753] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-01. [2025-09-26T21:15:33.511730] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-03. [2025-09-26T21:15:33.671954] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-26T21:15:34.311743] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-04. [2025-09-26T21:15:34.440418] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-26T21:15:34.574572] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:15:34.575069] [WARN ] [REMOTE ] SI: No data returned for month 2025-04 [2025-09-26T21:15:34.691524] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-26T21:15:35.111748] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-02. [2025-09-26T21:15:35.911732] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-07. [2025-09-26T21:15:36.687476] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-26T21:15:36.711670] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-05. [2025-09-26T21:15:36.959065] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:15:36.959475] [WARN ] [REMOTE ] SI: No data returned for month 2025-05 [2025-09-26T21:15:37.511725] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-04. [2025-09-26T21:15:37.640442] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-26T21:15:38.311727] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-06. [2025-09-26T21:15:38.741229] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:15:38.741666] [WARN ] [REMOTE ] SI: No data returned for month 2025-06 [2025-09-26T21:15:38.933672] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-26T21:15:39.111725] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-05. [2025-09-26T21:15:39.911728] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-08. [2025-09-26T21:15:40.719368] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-03. [2025-09-26T21:15:40.726394] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-26T21:15:40.775535] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-26T21:15:41.511735] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-09. [2025-09-26T21:15:42.311746] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-06. [2025-09-26T21:15:42.599727] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-26T21:15:43.111733] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-07. [2025-09-26T21:15:43.367064] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-26T21:15:43.378311] [INFO ] [REMOTE ] SHW: Full fetch complete (73019 records). [2025-09-26T21:15:43.378513] [DEBUG] [VALIDATOR ] SHW: Validating primary data. [2025-09-26T21:15:43.626082] [INFO ] [REMOTE ] SI: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-26T21:15:43.756760] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-26T21:15:43.866345] [DEBUG] [VALIDATOR ] SHW: All expected trading days are present. [2025-09-26T21:15:43.866434] [DEBUG] [VALIDATOR ] SHW: Primary data validation passed. [2025-09-26T21:15:43.867672] [INFO ] [MAIN ] SHW: Fetched primary data is valid. [2025-09-26T21:15:43.867751] [DEBUG] [LOCAL ] SHW: Saving primary data. [2025-09-26T21:15:43.869396] [DEBUG] [LOCAL ] SHW: Trimmed 73019 records to 51174 (keeping 200 days of data) [2025-09-26T21:15:43.928374] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-08. [2025-09-26T21:15:44.203026] [DEBUG] [LOCAL ] SHW: Primary data saved (51174 records). [2025-09-26T21:15:44.203217] [INFO ] [MAIN ] SHW: Full history saved. [2025-09-26T21:15:44.203361] [INFO ] [MAIN ] Update Progress: 1914/2371 symbols completed. SHW took 34.0s. Estimated remaining: 1h 1m 3s. Rate: 7.5 symbols/min [2025-09-26T21:15:44.389001] [INFO ] [MAIN ] SII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:15:44.419513] [DEBUG] [LOCAL ] SII: Loaded 23425 existing records from primary storage. [2025-09-26T21:15:44.419692] [INFO ] [MAIN ] SII: Loaded 23425 existing records. [2025-09-26T21:15:44.606113] [WARN ] [MAIN ] SII: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:15:44.606470] [INFO ] [MAIN ] SII: Wiping existing primary data before full refresh. [2025-09-26T21:15:44.606540] [INFO ] [LOCAL ] SII: Starting deletion of primary data. [2025-09-26T21:15:44.607239] [DEBUG] [LOCAL ] SII: Deleted primary data file. [2025-09-26T21:15:44.607313] [INFO ] [MAIN ] SII: Starting full primary refresh. [2025-09-26T21:15:44.715151] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-04. [2025-09-26T21:15:45.001008] [INFO ] [REMOTE ] SII: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:15:45.100383] [INFO ] [REMOTE ] SI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-26T21:15:45.511729] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-07. [2025-09-26T21:15:46.311728] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-09. [2025-09-26T21:15:46.500347] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-26T21:15:47.111731] [INFO ] [REMOTE ] SII: Fetching primary data for 2024-12. [2025-09-26T21:15:47.178380] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-26T21:15:47.417871] [INFO ] [REMOTE ] SI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-26T21:15:47.422100] [INFO ] [REMOTE ] SI: Full fetch complete (5998 records). [2025-09-26T21:15:47.422191] [DEBUG] [VALIDATOR ] SI: Validating primary data. [2025-09-26T21:15:47.613919] [WARN ] [VALIDATOR ] SI: Validation failed - insufficient historical data. Have 41 unique days, need 200 days [2025-09-26T21:15:47.614342] [FATAL] [MAIN ] SI: Fetched primary data is invalid. Refusing to save it. [2025-09-26T21:15:47.614411] [WARN ] [MAIN ] SI: Deleting existing primary and derivative data due to validation failure. [2025-09-26T21:15:47.614482] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-09-26T21:15:47.614565] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-09-26T21:15:47.614624] [INFO ] [LOCAL ] SI: Starting deletion of derivative data. [2025-09-26T21:15:47.614720] [DEBUG] [LOCAL ] SI: No derivative data file found to delete. [2025-09-26T21:15:47.614823] [INFO ] [MAIN ] Update Progress: 1915/2371 symbols completed. SI took 33.1s. Estimated remaining: 1h 0m 54s. Rate: 7.5 symbols/min [2025-09-26T21:15:47.815443] [INFO ] [MAIN ] SILA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:15:47.849374] [DEBUG] [LOCAL ] SILA: Loaded 31516 existing records from primary storage. [2025-09-26T21:15:47.849598] [INFO ] [MAIN ] SILA: Loaded 31516 existing records. [2025-09-26T21:15:47.914636] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-05. [2025-09-26T21:15:48.051820] [WARN ] [MAIN ] SILA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:15:48.052236] [INFO ] [MAIN ] SILA: Wiping existing primary data before full refresh. [2025-09-26T21:15:48.052327] [INFO ] [LOCAL ] SILA: Starting deletion of primary data. [2025-09-26T21:15:48.053611] [DEBUG] [LOCAL ] SILA: Deleted primary data file. [2025-09-26T21:15:48.053703] [INFO ] [MAIN ] SILA: Starting full primary refresh. [2025-09-26T21:15:48.382971] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-26T21:15:48.459239] [INFO ] [REMOTE ] SILA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:15:48.711747] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-08. [2025-09-26T21:15:49.511734] [INFO ] [REMOTE ] SILA: Fetching primary data for 2024-12. [2025-09-26T21:15:49.727916] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-26T21:15:50.257820] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-26T21:15:50.311699] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-06. [2025-09-26T21:15:50.946579] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-26T21:15:51.111751] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-09. [2025-09-26T21:15:51.911749] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-01. [2025-09-26T21:15:52.029151] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-26T21:15:52.513094] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-26T21:15:52.522400] [INFO ] [REMOTE ] SID: Full fetch complete (60799 records). [2025-09-26T21:15:52.522597] [DEBUG] [VALIDATOR ] SID: Validating primary data. [2025-09-26T21:15:52.712715] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-01. [2025-09-26T21:15:52.992456] [DEBUG] [VALIDATOR ] SID: All expected trading days are present. [2025-09-26T21:15:52.992563] [DEBUG] [VALIDATOR ] SID: Primary data validation passed. [2025-09-26T21:15:52.993690] [INFO ] [MAIN ] SID: Fetched primary data is valid. [2025-09-26T21:15:52.993760] [DEBUG] [LOCAL ] SID: Saving primary data. [2025-09-26T21:15:52.995411] [DEBUG] [LOCAL ] SID: Trimmed 60799 records to 42834 (keeping 200 days of data) [2025-09-26T21:15:53.253228] [DEBUG] [LOCAL ] SID: Primary data saved (42834 records). [2025-09-26T21:15:53.253373] [INFO ] [MAIN ] SID: Full history saved. [2025-09-26T21:15:53.253472] [INFO ] [MAIN ] Update Progress: 1916/2371 symbols completed. SID took 29.9s. Estimated remaining: 1h 0m 45s. Rate: 7.5 symbols/min [2025-09-26T21:15:53.388312] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-26T21:15:53.471516] [INFO ] [MAIN ] SITC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:15:53.516936] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-02. [2025-09-26T21:15:53.520499] [DEBUG] [LOCAL ] SITC: Loaded 41936 existing records from primary storage. [2025-09-26T21:15:53.520786] [INFO ] [MAIN ] SITC: Loaded 41936 existing records. [2025-09-26T21:15:53.744665] [WARN ] [MAIN ] SITC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:15:53.755132] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-26T21:15:53.755296] [INFO ] [MAIN ] SITC: Wiping existing primary data before full refresh. [2025-09-26T21:15:53.758563] [INFO ] [LOCAL ] SITC: Starting deletion of primary data. [2025-09-26T21:15:53.760470] [DEBUG] [LOCAL ] SITC: Deleted primary data file. [2025-09-26T21:15:53.760545] [INFO ] [MAIN ] SITC: Starting full primary refresh. [2025-09-26T21:15:54.147066] [INFO ] [REMOTE ] SITC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:15:54.311730] [INFO ] [REMOTE ] SITC: Fetching primary data for 2024-12. [2025-09-26T21:15:54.592380] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-26T21:15:55.111740] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-03. [2025-09-26T21:15:55.917041] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-02. [2025-09-26T21:15:55.931522] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-26T21:15:56.496930] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-26T21:15:56.711757] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-07. [2025-09-26T21:15:56.893847] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-26T21:15:57.511753] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-03. [2025-09-26T21:15:58.311726] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-04. [2025-09-26T21:15:58.343287] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-26T21:15:58.628303] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-26T21:15:59.111749] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-08. [2025-09-26T21:15:59.324030] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-26T21:15:59.911749] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-05. [2025-09-26T21:16:00.711707] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-01. [2025-09-26T21:16:00.880325] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-26T21:16:01.255816] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-26T21:16:01.511815] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-06. [2025-09-26T21:16:02.186593] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-26T21:16:02.311759] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-02. [2025-09-26T21:16:02.872239] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-26T21:16:03.111736] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-07. [2025-09-26T21:16:03.691155] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-26T21:16:03.911754] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-04. [2025-09-26T21:16:04.532447] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-26T21:16:04.711782] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-03. [2025-09-26T21:16:05.320393] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-26T21:16:05.511795] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-05. [2025-09-26T21:16:06.217282] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-26T21:16:06.311689] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-04. [2025-09-26T21:16:06.686892] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-26T21:16:07.111739] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-06. [2025-09-26T21:16:07.911703] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-09. [2025-09-26T21:16:07.960552] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-26T21:16:08.180461] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-26T21:16:08.711776] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-07. [2025-09-26T21:16:09.511695] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-08. [2025-09-26T21:16:09.575422] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-26T21:16:09.585018] [INFO ] [REMOTE ] SIG: Full fetch complete (68105 records). [2025-09-26T21:16:09.585228] [DEBUG] [VALIDATOR ] SIG: Validating primary data. [2025-09-26T21:16:09.982338] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-26T21:16:10.036285] [DEBUG] [VALIDATOR ] SIG: All expected trading days are present. [2025-09-26T21:16:10.036402] [DEBUG] [VALIDATOR ] SIG: Primary data validation passed. [2025-09-26T21:16:10.042036] [INFO ] [MAIN ] SIG: Fetched primary data is valid. [2025-09-26T21:16:10.042428] [DEBUG] [LOCAL ] SIG: Saving primary data. [2025-09-26T21:16:10.045032] [DEBUG] [LOCAL ] SIG: Trimmed 68105 records to 47111 (keeping 200 days of data) [2025-09-26T21:16:10.315684] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-08. [2025-09-26T21:16:10.347284] [DEBUG] [LOCAL ] SIG: Primary data saved (47111 records). [2025-09-26T21:16:10.347486] [INFO ] [MAIN ] SIG: Full history saved. [2025-09-26T21:16:10.347613] [INFO ] [MAIN ] Update Progress: 1917/2371 symbols completed. SIG took 43.9s. Estimated remaining: 1h 0m 39s. Rate: 7.5 symbols/min [2025-09-26T21:16:10.816231] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-26T21:16:11.111691] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-05. [2025-09-26T21:16:11.455854] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-26T21:16:11.911750] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-09. [2025-09-26T21:16:12.643312] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-26T21:16:12.711743] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-09. [2025-09-26T21:16:13.072349] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-26T21:16:13.078233] [INFO ] [REMOTE ] SILA: Full fetch complete (45101 records). [2025-09-26T21:16:13.078490] [DEBUG] [VALIDATOR ] SILA: Validating primary data. [2025-09-26T21:16:13.492371] [DEBUG] [VALIDATOR ] SILA: All expected trading days are present. [2025-09-26T21:16:13.492536] [DEBUG] [VALIDATOR ] SILA: Primary data validation passed. [2025-09-26T21:16:13.494453] [INFO ] [MAIN ] SILA: Fetched primary data is valid. [2025-09-26T21:16:13.494556] [DEBUG] [LOCAL ] SILA: Saving primary data. [2025-09-26T21:16:13.496319] [DEBUG] [LOCAL ] SILA: Trimmed 45101 records to 31635 (keeping 200 days of data) [2025-09-26T21:16:13.559952] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-06. [2025-09-26T21:16:13.731536] [DEBUG] [LOCAL ] SILA: Primary data saved (31635 records). [2025-09-26T21:16:13.731777] [INFO ] [MAIN ] SILA: Full history saved. [2025-09-26T21:16:13.731919] [INFO ] [MAIN ] Update Progress: 1918/2371 symbols completed. SILA took 26.1s. Estimated remaining: 1h 0m 30s. Rate: 7.5 symbols/min [2025-09-26T21:16:13.802903] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-26T21:16:13.808722] [INFO ] [REMOTE ] SII: Full fetch complete (29966 records). [2025-09-26T21:16:13.808945] [DEBUG] [VALIDATOR ] SII: Validating primary data. [2025-09-26T21:16:14.215761] [DEBUG] [VALIDATOR ] SII: All expected trading days are present. [2025-09-26T21:16:14.215890] [DEBUG] [VALIDATOR ] SII: Primary data validation passed. [2025-09-26T21:16:14.216952] [INFO ] [MAIN ] SII: Fetched primary data is valid. [2025-09-26T21:16:14.217027] [DEBUG] [LOCAL ] SII: Saving primary data. [2025-09-26T21:16:14.218114] [DEBUG] [LOCAL ] SII: Trimmed 29966 records to 23644 (keeping 200 days of data) [2025-09-26T21:16:14.368031] [DEBUG] [LOCAL ] SII: Primary data saved (23644 records). [2025-09-26T21:16:14.368212] [INFO ] [MAIN ] SII: Full history saved. [2025-09-26T21:16:14.368329] [INFO ] [MAIN ] Update Progress: 1919/2371 symbols completed. SII took 30.2s. Estimated remaining: 1h 0m 21s. Rate: 7.5 symbols/min [2025-09-26T21:16:15.198139] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-26T21:16:15.207709] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-07. [2025-09-26T21:16:16.743752] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-26T21:16:16.753639] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-08. [2025-09-26T21:16:18.384891] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-26T21:16:18.394303] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-09. [2025-09-26T21:16:19.941703] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-26T21:16:19.951174] [INFO ] [REMOTE ] SITC: Full fetch complete (61044 records). [2025-09-26T21:16:19.951357] [DEBUG] [VALIDATOR ] SITC: Validating primary data. [2025-09-26T21:16:20.382380] [DEBUG] [VALIDATOR ] SITC: All expected trading days are present. [2025-09-26T21:16:20.382482] [DEBUG] [VALIDATOR ] SITC: Primary data validation passed. [2025-09-26T21:16:20.383461] [INFO ] [MAIN ] SITC: Fetched primary data is valid. [2025-09-26T21:16:20.383533] [DEBUG] [LOCAL ] SITC: Saving primary data. [2025-09-26T21:16:20.385033] [DEBUG] [LOCAL ] SITC: Trimmed 61044 records to 42233 (keeping 200 days of data) [2025-09-26T21:16:20.657337] [DEBUG] [LOCAL ] SITC: Primary data saved (42233 records). [2025-09-26T21:16:20.657479] [INFO ] [MAIN ] SITC: Full history saved. [2025-09-26T21:16:20.657587] [INFO ] [MAIN ] Update Progress: 1920/2371 symbols completed. SITC took 27.4s. Estimated remaining: 1h 0m 12s. Rate: 7.5 symbols/min [2025-09-26T21:16:21.245348] [INFO ] [MAIN ] SITE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:16:21.454789] [INFO ] [MAIN ] SJT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:16:21.452960] [INFO ] [MAIN ] SKE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:16:21.485712] [INFO ] [MAIN ] SJM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:16:21.543917] [DEBUG] [LOCAL ] SJT: Loaded 22312 existing records from primary storage. [2025-09-26T21:16:21.562213] [INFO ] [MAIN ] SJT: Loaded 22312 existing records. [2025-09-26T21:16:21.594546] [DEBUG] [LOCAL ] SITE: Loaded 35314 existing records from primary storage. [2025-09-26T21:16:21.600920] [INFO ] [MAIN ] SITE: Loaded 35314 existing records. [2025-09-26T21:16:21.718114] [DEBUG] [LOCAL ] SKE: Loaded 35919 existing records from primary storage. [2025-09-26T21:16:21.753431] [INFO ] [MAIN ] SKE: Loaded 35919 existing records. [2025-09-26T21:16:22.066216] [DEBUG] [LOCAL ] SJM: Loaded 50513 existing records from primary storage. [2025-09-26T21:16:22.073747] [INFO ] [MAIN ] SJM: Loaded 50513 existing records. [2025-09-26T21:16:22.283999] [WARN ] [MAIN ] SITE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:16:22.224026] [WARN ] [MAIN ] SJT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:16:22.323701] [INFO ] [MAIN ] SITE: Wiping existing primary data before full refresh. [2025-09-26T21:16:22.389369] [WARN ] [MAIN ] SKE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:16:22.389950] [INFO ] [MAIN ] SJT: Wiping existing primary data before full refresh. [2025-09-26T21:16:22.389863] [INFO ] [LOCAL ] SITE: Starting deletion of primary data. [2025-09-26T21:16:22.397940] [INFO ] [LOCAL ] SJT: Starting deletion of primary data. [2025-09-26T21:16:22.402707] [INFO ] [MAIN ] SKE: Wiping existing primary data before full refresh. [2025-09-26T21:16:22.402865] [INFO ] [LOCAL ] SKE: Starting deletion of primary data. [2025-09-26T21:16:22.419022] [DEBUG] [LOCAL ] SJT: Deleted primary data file. [2025-09-26T21:16:22.408634] [DEBUG] [LOCAL ] SITE: Deleted primary data file. [2025-09-26T21:16:22.419199] [INFO ] [MAIN ] SJT: Starting full primary refresh. [2025-09-26T21:16:22.454186] [INFO ] [MAIN ] SITE: Starting full primary refresh. [2025-09-26T21:16:22.448530] [DEBUG] [LOCAL ] SKE: Deleted primary data file. [2025-09-26T21:16:22.472226] [INFO ] [MAIN ] SKE: Starting full primary refresh. [2025-09-26T21:16:22.614680] [WARN ] [MAIN ] SJM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:16:22.707298] [INFO ] [MAIN ] SJM: Wiping existing primary data before full refresh. [2025-09-26T21:16:22.779216] [INFO ] [LOCAL ] SJM: Starting deletion of primary data. [2025-09-26T21:16:22.874238] [DEBUG] [LOCAL ] SJM: Deleted primary data file. [2025-09-26T21:16:22.879589] [INFO ] [MAIN ] SJM: Starting full primary refresh. [2025-09-26T21:16:23.846000] [INFO ] [REMOTE ] SITE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:16:23.949045] [INFO ] [REMOTE ] SITE: Fetching primary data for 2024-12. [2025-09-26T21:16:24.030923] [INFO ] [REMOTE ] SJT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:16:24.041878] [INFO ] [REMOTE ] SJT: Fetching primary data for 2024-12. [2025-09-26T21:16:24.145583] [INFO ] [REMOTE ] SKE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:16:24.151804] [INFO ] [REMOTE ] SKE: Fetching primary data for 2024-12. [2025-09-26T21:16:24.230519] [INFO ] [REMOTE ] SJM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:16:24.230887] [INFO ] [REMOTE ] SJM: Fetching primary data for 2024-12. [2025-09-26T21:16:25.268762] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-26T21:16:25.275338] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-01. [2025-09-26T21:16:25.359089] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-26T21:16:25.366020] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-01. [2025-09-26T21:16:25.439306] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-26T21:16:25.447256] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-01. [2025-09-26T21:16:25.483603] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-26T21:16:25.493874] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-01. [2025-09-26T21:16:26.327573] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-26T21:16:26.332615] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-02. [2025-09-26T21:16:26.773171] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-26T21:16:26.797156] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-02. [2025-09-26T21:16:26.799734] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-26T21:16:26.806700] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-02. [2025-09-26T21:16:27.030784] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-26T21:16:27.036191] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-03. [2025-09-26T21:16:27.290396] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-26T21:16:27.300730] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-02. [2025-09-26T21:16:27.918386] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-26T21:16:27.926146] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-03. [2025-09-26T21:16:28.102626] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-26T21:16:28.108554] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-04. [2025-09-26T21:16:28.282868] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-26T21:16:28.725856] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-03. [2025-09-26T21:16:28.729078] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-26T21:16:29.269096] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-26T21:16:29.304933] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-26T21:16:29.511723] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-05. [2025-09-26T21:16:29.775709] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-26T21:16:30.311749] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-03. [2025-09-26T21:16:30.853176] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-26T21:16:31.111709] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-04. [2025-09-26T21:16:31.863621] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T21:16:31.911750] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-04. [2025-09-26T21:16:32.711769] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-04. [2025-09-26T21:16:32.812179] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-26T21:16:33.384836] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-26T21:16:33.511785] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-05. [2025-09-26T21:16:34.311802] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-06. [2025-09-26T21:16:34.399700] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-26T21:16:35.021812] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-26T21:16:35.111749] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-05. [2025-09-26T21:16:35.469544] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-26T21:16:35.911748] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-05. [2025-09-26T21:16:36.711729] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-06. [2025-09-26T21:16:36.878688] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-26T21:16:37.403250] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T21:16:37.511719] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-06. [2025-09-26T21:16:37.895958] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-26T21:16:38.311811] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-07. [2025-09-26T21:16:38.991484] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-26T21:16:39.111743] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-07. [2025-09-26T21:16:39.434139] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-26T21:16:39.911926] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-06. [2025-09-26T21:16:40.711729] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-07. [2025-09-26T21:16:40.778467] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-26T21:16:41.197929] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-26T21:16:41.511755] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-08. [2025-09-26T21:16:41.896553] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-26T21:16:42.311747] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-07. [2025-09-26T21:16:43.002151] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-26T21:16:43.111739] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-09. [2025-09-26T21:16:43.911744] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-08. [2025-09-26T21:16:44.195206] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-26T21:16:44.236319] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-26T21:16:44.245029] [INFO ] [REMOTE ] SITE: Full fetch complete (49330 records). [2025-09-26T21:16:44.245251] [DEBUG] [VALIDATOR ] SITE: Validating primary data. [2025-09-26T21:16:44.717020] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-08. [2025-09-26T21:16:44.885922] [DEBUG] [VALIDATOR ] SITE: All expected trading days are present. [2025-09-26T21:16:44.886063] [DEBUG] [VALIDATOR ] SITE: Primary data validation passed. [2025-09-26T21:16:44.887748] [INFO ] [MAIN ] SITE: Fetched primary data is valid. [2025-09-26T21:16:44.887956] [DEBUG] [LOCAL ] SITE: Saving primary data. [2025-09-26T21:16:44.889899] [DEBUG] [LOCAL ] SITE: Trimmed 49330 records to 35513 (keeping 200 days of data) [2025-09-26T21:16:45.164580] [DEBUG] [LOCAL ] SITE: Primary data saved (35513 records). [2025-09-26T21:16:45.164782] [INFO ] [MAIN ] SITE: Full history saved. [2025-09-26T21:16:45.165045] [INFO ] [MAIN ] Update Progress: 1921/2371 symbols completed. SITE took 24.5s. Estimated remaining: 1h 0m 8s. Rate: 7.5 symbols/min [2025-09-26T21:16:45.372748] [INFO ] [MAIN ] SKIL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:16:45.387544] [DEBUG] [LOCAL ] SKIL: Loaded 6368 existing records from primary storage. [2025-09-26T21:16:45.387709] [INFO ] [MAIN ] SKIL: Loaded 6368 existing records. [2025-09-26T21:16:45.517983] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-08. [2025-09-26T21:16:45.591984] [WARN ] [MAIN ] SKIL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:16:45.592977] [INFO ] [MAIN ] SKIL: Wiping existing primary data before full refresh. [2025-09-26T21:16:45.624944] [INFO ] [LOCAL ] SKIL: Starting deletion of primary data. [2025-09-26T21:16:45.627113] [DEBUG] [LOCAL ] SKIL: Deleted primary data file. [2025-09-26T21:16:45.627039] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-26T21:16:45.627352] [INFO ] [MAIN ] SKIL: Starting full primary refresh. [2025-09-26T21:16:46.070334] [INFO ] [REMOTE ] SKIL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:16:46.311698] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-09. [2025-09-26T21:16:46.510292] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-26T21:16:46.774353] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-26T21:16:47.111721] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-09. [2025-09-26T21:16:47.683679] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-26T21:16:47.694635] [INFO ] [REMOTE ] SKE: Full fetch complete (50399 records). [2025-09-26T21:16:47.694835] [DEBUG] [VALIDATOR ] SKE: Validating primary data. [2025-09-26T21:16:47.918712] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2024-12. [2025-09-26T21:16:48.103820] [DEBUG] [VALIDATOR ] SKE: All expected trading days are present. [2025-09-26T21:16:48.103918] [DEBUG] [VALIDATOR ] SKE: Primary data validation passed. [2025-09-26T21:16:48.104796] [INFO ] [MAIN ] SKE: Fetched primary data is valid. [2025-09-26T21:16:48.104864] [DEBUG] [LOCAL ] SKE: Saving primary data. [2025-09-26T21:16:48.111901] [DEBUG] [LOCAL ] SKE: Trimmed 50399 records to 36252 (keeping 200 days of data) [2025-09-26T21:16:48.336538] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-26T21:16:48.345485] [INFO ] [REMOTE ] SJT: Full fetch complete (32215 records). [2025-09-26T21:16:48.346202] [DEBUG] [VALIDATOR ] SJT: Validating primary data. [2025-09-26T21:16:48.712543] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-09. [2025-09-26T21:16:48.754894] [DEBUG] [LOCAL ] SKE: Primary data saved (36252 records). [2025-09-26T21:16:48.760998] [INFO ] [MAIN ] SKE: Full history saved. [2025-09-26T21:16:48.792799] [INFO ] [MAIN ] Update Progress: 1922/2371 symbols completed. SKE took 28.1s. Estimated remaining: 59m 59s. Rate: 7.5 symbols/min [2025-09-26T21:16:48.795412] [DEBUG] [VALIDATOR ] SJT: All expected trading days are present. [2025-09-26T21:16:48.795594] [DEBUG] [VALIDATOR ] SJT: Primary data validation passed. [2025-09-26T21:16:48.801724] [INFO ] [MAIN ] SJT: Fetched primary data is valid. [2025-09-26T21:16:48.851000] [DEBUG] [LOCAL ] SJT: Saving primary data. [2025-09-26T21:16:48.895868] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-26T21:16:48.924755] [DEBUG] [LOCAL ] SJT: Trimmed 32215 records to 22419 (keeping 200 days of data) [2025-09-26T21:16:49.052714] [INFO ] [MAIN ] SKLZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:16:49.105790] [DEBUG] [LOCAL ] SKLZ: Loaded 12038 existing records from primary storage. [2025-09-26T21:16:49.107211] [INFO ] [MAIN ] SKLZ: Loaded 12038 existing records. [2025-09-26T21:16:49.330820] [WARN ] [MAIN ] SKLZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:16:49.336433] [INFO ] [MAIN ] SKLZ: Wiping existing primary data before full refresh. [2025-09-26T21:16:49.336886] [INFO ] [LOCAL ] SKLZ: Starting deletion of primary data. [2025-09-26T21:16:49.339132] [DEBUG] [LOCAL ] SKLZ: Deleted primary data file. [2025-09-26T21:16:49.339518] [INFO ] [MAIN ] SKLZ: Starting full primary refresh. [2025-09-26T21:16:49.385180] [DEBUG] [LOCAL ] SJT: Primary data saved (22419 records). [2025-09-26T21:16:49.413465] [INFO ] [MAIN ] SJT: Full history saved. [2025-09-26T21:16:49.424882] [INFO ] [MAIN ] Update Progress: 1923/2371 symbols completed. SJT took 28.8s. Estimated remaining: 59m 49s. Rate: 7.5 symbols/min [2025-09-26T21:16:49.525947] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-01. [2025-09-26T21:16:49.838180] [INFO ] [MAIN ] SKM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:16:49.937106] [INFO ] [REMOTE ] SKLZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:16:49.972943] [DEBUG] [LOCAL ] SKM: Loaded 35350 existing records from primary storage. [2025-09-26T21:16:49.973087] [INFO ] [MAIN ] SKM: Loaded 35350 existing records. [2025-09-26T21:16:50.167829] [WARN ] [MAIN ] SKM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:16:50.168102] [INFO ] [MAIN ] SKM: Wiping existing primary data before full refresh. [2025-09-26T21:16:50.168154] [INFO ] [LOCAL ] SKM: Starting deletion of primary data. [2025-09-26T21:16:50.168937] [DEBUG] [LOCAL ] SKM: Deleted primary data file. [2025-09-26T21:16:50.169002] [INFO ] [MAIN ] SKM: Starting full primary refresh. [2025-09-26T21:16:50.322899] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2024-12. [2025-09-26T21:16:50.464698] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-26T21:16:50.570754] [INFO ] [REMOTE ] SKM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:16:50.600545] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-26T21:16:50.612562] [INFO ] [REMOTE ] SJM: Full fetch complete (72062 records). [2025-09-26T21:16:50.612755] [DEBUG] [VALIDATOR ] SJM: Validating primary data. [2025-09-26T21:16:51.030464] [DEBUG] [VALIDATOR ] SJM: All expected trading days are present. [2025-09-26T21:16:51.030564] [DEBUG] [VALIDATOR ] SJM: Primary data validation passed. [2025-09-26T21:16:51.031607] [INFO ] [MAIN ] SJM: Fetched primary data is valid. [2025-09-26T21:16:51.031700] [DEBUG] [LOCAL ] SJM: Saving primary data. [2025-09-26T21:16:51.033419] [DEBUG] [LOCAL ] SJM: Trimmed 72062 records to 50877 (keeping 200 days of data) [2025-09-26T21:16:51.113315] [INFO ] [REMOTE ] SKM: Fetching primary data for 2024-12. [2025-09-26T21:16:51.385099] [DEBUG] [LOCAL ] SJM: Primary data saved (50877 records). [2025-09-26T21:16:51.385265] [INFO ] [MAIN ] SJM: Full history saved. [2025-09-26T21:16:51.385387] [INFO ] [MAIN ] Update Progress: 1924/2371 symbols completed. SJM took 30.7s. Estimated remaining: 59m 40s. Rate: 7.5 symbols/min [2025-09-26T21:16:51.582780] [INFO ] [MAIN ] SKT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:16:51.602476] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-26T21:16:51.655725] [DEBUG] [LOCAL ] SKT: Loaded 42940 existing records from primary storage. [2025-09-26T21:16:51.655887] [INFO ] [MAIN ] SKT: Loaded 42940 existing records. [2025-09-26T21:16:51.849987] [WARN ] [MAIN ] SKT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:16:51.850299] [INFO ] [MAIN ] SKT: Wiping existing primary data before full refresh. [2025-09-26T21:16:51.850364] [INFO ] [LOCAL ] SKT: Starting deletion of primary data. [2025-09-26T21:16:51.851245] [DEBUG] [LOCAL ] SKT: Deleted primary data file. [2025-09-26T21:16:51.851309] [INFO ] [MAIN ] SKT: Starting full primary refresh. [2025-09-26T21:16:51.918999] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-02. [2025-09-26T21:16:52.232336] [INFO ] [REMOTE ] SKT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:16:52.352067] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-26T21:16:52.711738] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-01. [2025-09-26T21:16:52.780758] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-26T21:16:53.511705] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-03. [2025-09-26T21:16:53.746730] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-26T21:16:54.291883] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-26T21:16:54.311717] [INFO ] [REMOTE ] SKT: Fetching primary data for 2024-12. [2025-09-26T21:16:55.111724] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-04. [2025-09-26T21:16:55.801488] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-26T21:16:55.860245] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-26T21:16:55.911726] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-01. [2025-09-26T21:16:56.711738] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-01. [2025-09-26T21:16:57.169481] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-26T21:16:57.511715] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-02. [2025-09-26T21:16:58.292385] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-26T21:16:58.311706] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-02. [2025-09-26T21:16:58.429992] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-26T21:16:59.111710] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-02. [2025-09-26T21:16:59.481176] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-26T21:16:59.911722] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-03. [2025-09-26T21:17:00.499459] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-26T21:17:00.711746] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-03. [2025-09-26T21:17:01.511719] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-05. [2025-09-26T21:17:01.719867] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-26T21:17:01.772426] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-26T21:17:02.125355] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-26T21:17:02.311723] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-04. [2025-09-26T21:17:03.111708] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-06. [2025-09-26T21:17:03.898105] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-26T21:17:03.911675] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-05. [2025-09-26T21:17:03.959940] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-26T21:17:04.711729] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-07. [2025-09-26T21:17:05.337365] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-26T21:17:05.364125] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-26T21:17:05.511725] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-06. [2025-09-26T21:17:06.311748] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-08. [2025-09-26T21:17:06.937511] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-26T21:17:07.033259] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-26T21:17:07.111716] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-04. [2025-09-26T21:17:07.911736] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-07. [2025-09-26T21:17:08.019836] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-26T21:17:08.711763] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-05. [2025-09-26T21:17:09.401778] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-26T21:17:09.512150] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-03. [2025-09-26T21:17:09.515772] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-26T21:17:10.311754] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-08. [2025-09-26T21:17:11.111993] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-09. [2025-09-26T21:17:11.114671] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-26T21:17:11.184393] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-26T21:17:11.883674] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-26T21:17:11.885729] [INFO ] [REMOTE ] SKIL: Full fetch complete (10105 records). [2025-09-26T21:17:11.885806] [DEBUG] [VALIDATOR ] SKIL: Validating primary data. [2025-09-26T21:17:11.919009] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-04. [2025-09-26T21:17:12.339412] [DEBUG] [VALIDATOR ] SKIL: All expected trading days are present. [2025-09-26T21:17:12.339516] [DEBUG] [VALIDATOR ] SKIL: Primary data validation passed. [2025-09-26T21:17:12.339806] [INFO ] [MAIN ] SKIL: Fetched primary data is valid. [2025-09-26T21:17:12.339868] [DEBUG] [LOCAL ] SKIL: Saving primary data. [2025-09-26T21:17:12.340334] [DEBUG] [LOCAL ] SKIL: Trimmed 10105 records to 6395 (keeping 200 days of data) [2025-09-26T21:17:12.379134] [DEBUG] [LOCAL ] SKIL: Primary data saved (6395 records). [2025-09-26T21:17:12.379268] [INFO ] [MAIN ] SKIL: Full history saved. [2025-09-26T21:17:12.379358] [INFO ] [MAIN ] Update Progress: 1925/2371 symbols completed. SKIL took 27.2s. Estimated remaining: 59m 35s. Rate: 7.5 symbols/min [2025-09-26T21:17:12.560569] [INFO ] [MAIN ] SKY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:17:12.613236] [DEBUG] [LOCAL ] SKY: Loaded 38035 existing records from primary storage. [2025-09-26T21:17:12.613395] [INFO ] [MAIN ] SKY: Loaded 38035 existing records. [2025-09-26T21:17:12.716848] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-06. [2025-09-26T21:17:12.799918] [WARN ] [MAIN ] SKY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:17:12.800218] [INFO ] [MAIN ] SKY: Wiping existing primary data before full refresh. [2025-09-26T21:17:12.800286] [INFO ] [LOCAL ] SKY: Starting deletion of primary data. [2025-09-26T21:17:12.801187] [DEBUG] [LOCAL ] SKY: Deleted primary data file. [2025-09-26T21:17:12.801254] [INFO ] [MAIN ] SKY: Starting full primary refresh. [2025-09-26T21:17:13.176368] [INFO ] [REMOTE ] SKY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:17:13.511695] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-09. [2025-09-26T21:17:13.571038] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-26T21:17:13.680250] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-26T21:17:14.311734] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-07. [2025-09-26T21:17:14.440536] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-26T21:17:14.448228] [INFO ] [REMOTE ] SKM: Full fetch complete (47971 records). [2025-09-26T21:17:14.448427] [DEBUG] [VALIDATOR ] SKM: Validating primary data. [2025-09-26T21:17:14.848291] [DEBUG] [VALIDATOR ] SKM: All expected trading days are present. [2025-09-26T21:17:14.848377] [DEBUG] [VALIDATOR ] SKM: Primary data validation passed. [2025-09-26T21:17:14.849279] [INFO ] [MAIN ] SKM: Fetched primary data is valid. [2025-09-26T21:17:14.849343] [DEBUG] [LOCAL ] SKM: Saving primary data. [2025-09-26T21:17:14.851272] [DEBUG] [LOCAL ] SKM: Trimmed 47971 records to 35557 (keeping 200 days of data) [2025-09-26T21:17:15.086991] [DEBUG] [LOCAL ] SKM: Primary data saved (35557 records). [2025-09-26T21:17:15.087222] [INFO ] [MAIN ] SKM: Full history saved. [2025-09-26T21:17:15.087363] [INFO ] [MAIN ] Update Progress: 1926/2371 symbols completed. SKM took 25.7s. Estimated remaining: 59m 26s. Rate: 7.5 symbols/min [2025-09-26T21:17:15.123131] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-05. [2025-09-26T21:17:15.292621] [INFO ] [MAIN ] SKYH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:17:15.303983] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-26T21:17:15.327172] [DEBUG] [LOCAL ] SKYH: Loaded 16732 existing records from primary storage. [2025-09-26T21:17:15.327313] [INFO ] [MAIN ] SKYH: Loaded 16732 existing records. [2025-09-26T21:17:15.524910] [WARN ] [MAIN ] SKYH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:17:15.525182] [INFO ] [MAIN ] SKYH: Wiping existing primary data before full refresh. [2025-09-26T21:17:15.525234] [INFO ] [LOCAL ] SKYH: Starting deletion of primary data. [2025-09-26T21:17:15.525812] [DEBUG] [LOCAL ] SKYH: Deleted primary data file. [2025-09-26T21:17:15.525875] [INFO ] [MAIN ] SKYH: Starting full primary refresh. [2025-09-26T21:17:15.917174] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-08. [2025-09-26T21:17:15.922245] [INFO ] [REMOTE ] SKYH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:17:16.681289] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-26T21:17:16.711682] [INFO ] [REMOTE ] SKY: Fetching primary data for 2024-12. [2025-09-26T21:17:16.912578] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-26T21:17:17.511732] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-06. [2025-09-26T21:17:18.311705] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2024-12. [2025-09-26T21:17:18.347458] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-26T21:17:19.054043] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-26T21:17:19.111689] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-01. [2025-09-26T21:17:19.342704] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-26T21:17:19.911734] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-01. [2025-09-26T21:17:20.593922] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-26T21:17:20.711689] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-02. [2025-09-26T21:17:20.841909] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-26T21:17:21.511769] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-07. [2025-09-26T21:17:22.222046] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-26T21:17:22.311739] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-09. [2025-09-26T21:17:23.035478] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-26T21:17:23.111722] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-03. [2025-09-26T21:17:23.236906] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-26T21:17:23.239743] [INFO ] [REMOTE ] SKLZ: Full fetch complete (18944 records). [2025-09-26T21:17:23.239823] [DEBUG] [VALIDATOR ] SKLZ: Validating primary data. [2025-09-26T21:17:23.654768] [DEBUG] [VALIDATOR ] SKLZ: All expected trading days are present. [2025-09-26T21:17:23.654971] [DEBUG] [VALIDATOR ] SKLZ: Primary data validation passed. [2025-09-26T21:17:23.655411] [INFO ] [MAIN ] SKLZ: Fetched primary data is valid. [2025-09-26T21:17:23.655453] [DEBUG] [LOCAL ] SKLZ: Saving primary data. [2025-09-26T21:17:23.656077] [DEBUG] [LOCAL ] SKLZ: Trimmed 18944 records to 12122 (keeping 200 days of data) [2025-09-26T21:17:23.728788] [DEBUG] [LOCAL ] SKLZ: Primary data saved (12122 records). [2025-09-26T21:17:23.728945] [INFO ] [MAIN ] SKLZ: Full history saved. [2025-09-26T21:17:23.729040] [INFO ] [MAIN ] Update Progress: 1927/2371 symbols completed. SKLZ took 34.9s. Estimated remaining: 59m 18s. Rate: 7.5 symbols/min [2025-09-26T21:17:23.916150] [INFO ] [MAIN ] SLB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:17:23.916217] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-08. [2025-09-26T21:17:23.977100] [DEBUG] [LOCAL ] SLB: Loaded 54087 existing records from primary storage. [2025-09-26T21:17:23.977280] [INFO ] [MAIN ] SLB: Loaded 54087 existing records. [2025-09-26T21:17:24.178293] [WARN ] [MAIN ] SLB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:17:24.178733] [INFO ] [MAIN ] SLB: Wiping existing primary data before full refresh. [2025-09-26T21:17:24.178815] [INFO ] [LOCAL ] SLB: Starting deletion of primary data. [2025-09-26T21:17:24.180423] [DEBUG] [LOCAL ] SLB: Deleted primary data file. [2025-09-26T21:17:24.180502] [INFO ] [MAIN ] SLB: Starting full primary refresh. [2025-09-26T21:17:24.576672] [INFO ] [REMOTE ] SLB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:17:24.596754] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-26T21:17:24.711715] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-04. [2025-09-26T21:17:25.458052] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-26T21:17:25.511740] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-09. [2025-09-26T21:17:26.130749] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-26T21:17:26.311742] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-02. [2025-09-26T21:17:26.961298] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-26T21:17:26.970466] [INFO ] [REMOTE ] SKT: Full fetch complete (60163 records). [2025-09-26T21:17:26.970774] [DEBUG] [VALIDATOR ] SKT: Validating primary data. [2025-09-26T21:17:27.103115] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-26T21:17:27.113689] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-05. [2025-09-26T21:17:27.415972] [DEBUG] [VALIDATOR ] SKT: All expected trading days are present. [2025-09-26T21:17:27.416066] [DEBUG] [VALIDATOR ] SKT: Primary data validation passed. [2025-09-26T21:17:27.417174] [INFO ] [MAIN ] SKT: Fetched primary data is valid. [2025-09-26T21:17:27.417244] [DEBUG] [LOCAL ] SKT: Saving primary data. [2025-09-26T21:17:27.418814] [DEBUG] [LOCAL ] SKT: Trimmed 60163 records to 43227 (keeping 200 days of data) [2025-09-26T21:17:27.692933] [DEBUG] [LOCAL ] SKT: Primary data saved (43227 records). [2025-09-26T21:17:27.693118] [INFO ] [MAIN ] SKT: Full history saved. [2025-09-26T21:17:27.693225] [INFO ] [MAIN ] Update Progress: 1928/2371 symbols completed. SKT took 36.3s. Estimated remaining: 59m 9s. Rate: 7.5 symbols/min [2025-09-26T21:17:27.865480] [INFO ] [MAIN ] SLF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:17:27.903388] [DEBUG] [LOCAL ] SLF: Loaded 39211 existing records from primary storage. [2025-09-26T21:17:27.903558] [INFO ] [MAIN ] SLF: Loaded 39211 existing records. [2025-09-26T21:17:27.916850] [INFO ] [REMOTE ] SLB: Fetching primary data for 2024-12. [2025-09-26T21:17:28.097898] [WARN ] [MAIN ] SLF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:17:28.098169] [INFO ] [MAIN ] SLF: Wiping existing primary data before full refresh. [2025-09-26T21:17:28.098221] [INFO ] [LOCAL ] SLF: Starting deletion of primary data. [2025-09-26T21:17:28.099251] [DEBUG] [LOCAL ] SLF: Deleted primary data file. [2025-09-26T21:17:28.099313] [INFO ] [MAIN ] SLF: Starting full primary refresh. [2025-09-26T21:17:28.475063] [INFO ] [REMOTE ] SLF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:17:28.711737] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-03. [2025-09-26T21:17:28.748105] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-26T21:17:29.511772] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-06. [2025-09-26T21:17:29.781794] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-26T21:17:29.970888] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-26T21:17:30.311737] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-04. [2025-09-26T21:17:31.111692] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-01. [2025-09-26T21:17:31.152084] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-26T21:17:31.476617] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-26T21:17:31.911727] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-07. [2025-09-26T21:17:32.711718] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-05. [2025-09-26T21:17:33.228008] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-26T21:17:33.290351] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-26T21:17:33.511708] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-08. [2025-09-26T21:17:33.798494] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-26T21:17:34.311736] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-02. [2025-09-26T21:17:34.907788] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-26T21:17:35.111725] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-06. [2025-09-26T21:17:35.911699] [INFO ] [REMOTE ] SLF: Fetching primary data for 2024-12. [2025-09-26T21:17:36.073847] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-26T21:17:36.158729] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-26T21:17:36.711747] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-07. [2025-09-26T21:17:37.408168] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-26T21:17:37.511770] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-09. [2025-09-26T21:17:37.793366] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-26T21:17:38.311740] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-03. [2025-09-26T21:17:38.986414] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-26T21:17:38.994818] [INFO ] [REMOTE ] SKY: Full fetch complete (55066 records). [2025-09-26T21:17:38.994952] [DEBUG] [VALIDATOR ] SKY: Validating primary data. [2025-09-26T21:17:39.116833] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-08. [2025-09-26T21:17:39.422936] [DEBUG] [VALIDATOR ] SKY: All expected trading days are present. [2025-09-26T21:17:39.423027] [DEBUG] [VALIDATOR ] SKY: Primary data validation passed. [2025-09-26T21:17:39.423935] [INFO ] [MAIN ] SKY: Fetched primary data is valid. [2025-09-26T21:17:39.424004] [DEBUG] [LOCAL ] SKY: Saving primary data. [2025-09-26T21:17:39.425403] [DEBUG] [LOCAL ] SKY: Trimmed 55066 records to 38305 (keeping 200 days of data) [2025-09-26T21:17:39.664070] [DEBUG] [LOCAL ] SKY: Primary data saved (38305 records). [2025-09-26T21:17:39.664239] [INFO ] [MAIN ] SKY: Full history saved. [2025-09-26T21:17:39.664362] [INFO ] [MAIN ] Update Progress: 1929/2371 symbols completed. SKY took 27.3s. Estimated remaining: 59m 2s. Rate: 7.5 symbols/min [2025-09-26T21:17:39.860873] [INFO ] [MAIN ] SLG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:17:39.906877] [DEBUG] [LOCAL ] SLG: Loaded 45836 existing records from primary storage. [2025-09-26T21:17:39.907034] [INFO ] [MAIN ] SLG: Loaded 45836 existing records. [2025-09-26T21:17:39.941875] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-01. [2025-09-26T21:17:40.107350] [WARN ] [MAIN ] SLG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:17:40.107597] [INFO ] [MAIN ] SLG: Wiping existing primary data before full refresh. [2025-09-26T21:17:40.107672] [INFO ] [LOCAL ] SLG: Starting deletion of primary data. [2025-09-26T21:17:40.108974] [DEBUG] [LOCAL ] SLG: Deleted primary data file. [2025-09-26T21:17:40.109038] [INFO ] [MAIN ] SLG: Starting full primary refresh. [2025-09-26T21:17:40.237324] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-26T21:17:40.531482] [INFO ] [REMOTE ] SLG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:17:40.567767] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-26T21:17:40.711722] [INFO ] [REMOTE ] SLG: Fetching primary data for 2024-12. [2025-09-26T21:17:41.511721] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-09. [2025-09-26T21:17:41.533272] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-26T21:17:42.082952] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-26T21:17:42.147791] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-26T21:17:42.151312] [INFO ] [REMOTE ] SKYH: Full fetch complete (22665 records). [2025-09-26T21:17:42.151688] [DEBUG] [VALIDATOR ] SKYH: Validating primary data. [2025-09-26T21:17:42.314814] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-02. [2025-09-26T21:17:42.562350] [DEBUG] [VALIDATOR ] SKYH: All expected trading days are present. [2025-09-26T21:17:42.562456] [DEBUG] [VALIDATOR ] SKYH: Primary data validation passed. [2025-09-26T21:17:42.563135] [INFO ] [MAIN ] SKYH: Fetched primary data is valid. [2025-09-26T21:17:42.563212] [DEBUG] [LOCAL ] SKYH: Saving primary data. [2025-09-26T21:17:42.564005] [DEBUG] [LOCAL ] SKYH: Trimmed 22665 records to 16851 (keeping 200 days of data) [2025-09-26T21:17:42.669911] [DEBUG] [LOCAL ] SKYH: Primary data saved (16851 records). [2025-09-26T21:17:42.670073] [INFO ] [MAIN ] SKYH: Full history saved. [2025-09-26T21:17:42.670206] [INFO ] [MAIN ] Update Progress: 1930/2371 symbols completed. SKYH took 27.6s. Estimated remaining: 58m 52s. Rate: 7.5 symbols/min [2025-09-26T21:17:42.859215] [INFO ] [MAIN ] SLGN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:17:42.907581] [DEBUG] [LOCAL ] SLGN: Loaded 40698 existing records from primary storage. [2025-09-26T21:17:42.907762] [INFO ] [MAIN ] SLGN: Loaded 40698 existing records. [2025-09-26T21:17:43.116902] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-04. [2025-09-26T21:17:43.162373] [WARN ] [MAIN ] SLGN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:17:43.162815] [INFO ] [MAIN ] SLGN: Wiping existing primary data before full refresh. [2025-09-26T21:17:43.162891] [INFO ] [LOCAL ] SLGN: Starting deletion of primary data. [2025-09-26T21:17:43.164084] [DEBUG] [LOCAL ] SLGN: Deleted primary data file. [2025-09-26T21:17:43.164148] [INFO ] [MAIN ] SLGN: Starting full primary refresh. [2025-09-26T21:17:43.545054] [INFO ] [REMOTE ] SLGN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:17:43.813913] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-26T21:17:43.911697] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-03. [2025-09-26T21:17:44.711730] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-01. [2025-09-26T21:17:45.403334] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-26T21:17:45.439922] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-26T21:17:45.511718] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-04. [2025-09-26T21:17:45.980679] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-26T21:17:46.311719] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-05. [2025-09-26T21:17:47.025464] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-26T21:17:47.111748] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-05. [2025-09-26T21:17:47.911746] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2024-12. [2025-09-26T21:17:48.175381] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-26T21:17:48.493802] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-26T21:17:48.711714] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-02. [2025-09-26T21:17:49.429944] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-26T21:17:49.511724] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-06. [2025-09-26T21:17:50.177772] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-26T21:17:50.311739] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-01. [2025-09-26T21:17:51.111726] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-06. [2025-09-26T21:17:51.697577] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-26T21:17:51.815521] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-26T21:17:51.911724] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-03. [2025-09-26T21:17:52.280601] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-26T21:17:52.711724] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-07. [2025-09-26T21:17:53.511715] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-02. [2025-09-26T21:17:53.610590] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-26T21:17:54.210427] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-26T21:17:54.311728] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-08. [2025-09-26T21:17:54.684837] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-26T21:17:55.111743] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-04. [2025-09-26T21:17:55.909462] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-26T21:17:55.917720] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-07. [2025-09-26T21:17:56.711739] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-09. [2025-09-26T21:17:56.825019] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-26T21:17:57.511731] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-03. [2025-09-26T21:17:57.974962] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-26T21:17:58.158555] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-26T21:17:58.166135] [INFO ] [REMOTE ] SLF: Full fetch complete (56425 records). [2025-09-26T21:17:58.166284] [DEBUG] [VALIDATOR ] SLF: Validating primary data. [2025-09-26T21:17:58.316859] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-05. [2025-09-26T21:17:58.612416] [DEBUG] [VALIDATOR ] SLF: All expected trading days are present. [2025-09-26T21:17:58.612519] [DEBUG] [VALIDATOR ] SLF: Primary data validation passed. [2025-09-26T21:17:58.613535] [INFO ] [MAIN ] SLF: Fetched primary data is valid. [2025-09-26T21:17:58.613604] [DEBUG] [LOCAL ] SLF: Saving primary data. [2025-09-26T21:17:58.615008] [DEBUG] [LOCAL ] SLF: Trimmed 56425 records to 39426 (keeping 200 days of data) [2025-09-26T21:17:58.862776] [DEBUG] [LOCAL ] SLF: Primary data saved (39426 records). [2025-09-26T21:17:58.862940] [INFO ] [MAIN ] SLF: Full history saved. [2025-09-26T21:17:58.863079] [INFO ] [MAIN ] Update Progress: 1931/2371 symbols completed. SLF took 31.2s. Estimated remaining: 58m 46s. Rate: 7.5 symbols/min [2025-09-26T21:17:59.046921] [INFO ] [MAIN ] SLNZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:17:59.047186] [DEBUG] [LOCAL ] SLNZ: No existing data file found in primary storage. [2025-09-26T21:17:59.047243] [WARN ] [MAIN ] SLNZ: No existing data found, performing full refresh instead. [2025-09-26T21:17:59.047473] [INFO ] [MAIN ] SLNZ: Wiping existing primary data before full refresh. [2025-09-26T21:17:59.047531] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-09-26T21:17:59.047577] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-09-26T21:17:59.047612] [INFO ] [MAIN ] SLNZ: Starting full primary refresh. [2025-09-26T21:17:59.112536] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-08. [2025-09-26T21:17:59.451739] [INFO ] [REMOTE ] SLNZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:17:59.479410] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-26T21:17:59.911732] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2024-12. [2025-09-26T21:18:00.005120] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-26T21:18:00.058494] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-26T21:18:00.474556] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-26T21:18:00.711725] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-09. [2025-09-26T21:18:01.511745] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-04. [2025-09-26T21:18:02.311721] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-01. [2025-09-26T21:18:02.695576] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-26T21:18:02.901828] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-26T21:18:02.912938] [INFO ] [REMOTE ] SLB: Full fetch complete (77740 records). [2025-09-26T21:18:02.913091] [DEBUG] [VALIDATOR ] SLB: Validating primary data. [2025-09-26T21:18:03.115718] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-02. [2025-09-26T21:18:03.387136] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-26T21:18:03.391297] [DEBUG] [VALIDATOR ] SLB: All expected trading days are present. [2025-09-26T21:18:03.399715] [DEBUG] [VALIDATOR ] SLB: Primary data validation passed. [2025-09-26T21:18:03.402015] [INFO ] [MAIN ] SLB: Fetched primary data is valid. [2025-09-26T21:18:03.402602] [DEBUG] [LOCAL ] SLB: Saving primary data. [2025-09-26T21:18:03.404346] [DEBUG] [LOCAL ] SLB: Trimmed 77740 records to 54477 (keeping 200 days of data) [2025-09-26T21:18:03.641148] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-26T21:18:03.779747] [DEBUG] [LOCAL ] SLB: Primary data saved (54477 records). [2025-09-26T21:18:03.779921] [INFO ] [MAIN ] SLB: Full history saved. [2025-09-26T21:18:03.780030] [INFO ] [MAIN ] Update Progress: 1932/2371 symbols completed. SLB took 40.1s. Estimated remaining: 58m 38s. Rate: 7.5 symbols/min [2025-09-26T21:18:03.926176] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-03. [2025-09-26T21:18:03.962171] [INFO ] [MAIN ] SLQT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:18:04.006193] [DEBUG] [LOCAL ] SLQT: Loaded 44097 existing records from primary storage. [2025-09-26T21:18:04.006347] [INFO ] [MAIN ] SLQT: Loaded 44097 existing records. [2025-09-26T21:18:04.191170] [WARN ] [MAIN ] SLQT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:18:04.191408] [INFO ] [MAIN ] SLQT: Wiping existing primary data before full refresh. [2025-09-26T21:18:04.191456] [INFO ] [LOCAL ] SLQT: Starting deletion of primary data. [2025-09-26T21:18:04.192371] [DEBUG] [LOCAL ] SLQT: Deleted primary data file. [2025-09-26T21:18:04.192433] [INFO ] [MAIN ] SLQT: Starting full primary refresh. [2025-09-26T21:18:04.532189] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-26T21:18:04.570091] [INFO ] [REMOTE ] SLQT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:18:04.711742] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-04. [2025-09-26T21:18:05.178138] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-26T21:18:05.511742] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-06. [2025-09-26T21:18:06.311741] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2024-12. [2025-09-26T21:18:07.111711] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-05. [2025-09-26T21:18:07.151816] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-26T21:18:07.812709] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-26T21:18:07.911705] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-05. [2025-09-26T21:18:08.370982] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-26T21:18:08.711763] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-06. [2025-09-26T21:18:08.878123] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-26T21:18:09.118046] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-26T21:18:09.511763] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-07. [2025-09-26T21:18:09.883356] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-26T21:18:10.311740] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-08. [2025-09-26T21:18:10.699833] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-26T21:18:11.111754] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-07. [2025-09-26T21:18:11.911742] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-01. [2025-09-26T21:18:12.711706] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-06. [2025-09-26T21:18:13.063845] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-26T21:18:13.114826] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-26T21:18:13.511728] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-02. [2025-09-26T21:18:14.046221] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-26T21:18:14.311718] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-09. [2025-09-26T21:18:14.694933] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-26T21:18:14.695783] [INFO ] [REMOTE ] SLNZ: Full fetch complete (1060 records). [2025-09-26T21:18:14.695923] [DEBUG] [VALIDATOR ] SLNZ: Validating primary data. [2025-09-26T21:18:14.905373] [WARN ] [VALIDATOR ] SLNZ: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-26T21:18:14.905687] [FATAL] [MAIN ] SLNZ: Fetched primary data is invalid. Refusing to save it. [2025-09-26T21:18:14.905762] [WARN ] [MAIN ] SLNZ: Deleting existing primary and derivative data due to validation failure. [2025-09-26T21:18:14.905880] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-09-26T21:18:14.905993] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-09-26T21:18:14.906051] [INFO ] [LOCAL ] SLNZ: Starting deletion of derivative data. [2025-09-26T21:18:14.906113] [DEBUG] [LOCAL ] SLNZ: No derivative data file found to delete. [2025-09-26T21:18:14.906204] [INFO ] [MAIN ] Update Progress: 1933/2371 symbols completed. SLNZ took 16.0s. Estimated remaining: 58m 30s. Rate: 7.5 symbols/min [2025-09-26T21:18:15.103775] [INFO ] [MAIN ] SLVM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:18:15.111725] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-07. [2025-09-26T21:18:15.135907] [DEBUG] [LOCAL ] SLVM: Loaded 28188 existing records from primary storage. [2025-09-26T21:18:15.136065] [INFO ] [MAIN ] SLVM: Loaded 28188 existing records. [2025-09-26T21:18:15.383891] [WARN ] [MAIN ] SLVM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:18:15.387387] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-26T21:18:15.387673] [INFO ] [MAIN ] SLVM: Wiping existing primary data before full refresh. [2025-09-26T21:18:15.387923] [INFO ] [LOCAL ] SLVM: Starting deletion of primary data. [2025-09-26T21:18:15.398038] [DEBUG] [LOCAL ] SLVM: Deleted primary data file. [2025-09-26T21:18:15.398137] [INFO ] [MAIN ] SLVM: Starting full primary refresh. [2025-09-26T21:18:15.794277] [INFO ] [REMOTE ] SLVM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:18:15.911745] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-03. [2025-09-26T21:18:16.667716] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-26T21:18:16.711702] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-08. [2025-09-26T21:18:17.187683] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-26T21:18:17.511745] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-08. [2025-09-26T21:18:18.240926] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-26T21:18:18.311716] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-09. [2025-09-26T21:18:19.111715] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-04. [2025-09-26T21:18:19.290438] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-26T21:18:19.561385] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-26T21:18:19.571329] [INFO ] [REMOTE ] SLGN: Full fetch complete (58273 records). [2025-09-26T21:18:19.571526] [DEBUG] [VALIDATOR ] SLGN: Validating primary data. [2025-09-26T21:18:19.912994] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-09. [2025-09-26T21:18:20.013148] [DEBUG] [VALIDATOR ] SLGN: All expected trading days are present. [2025-09-26T21:18:20.013243] [DEBUG] [VALIDATOR ] SLGN: Primary data validation passed. [2025-09-26T21:18:20.014295] [INFO ] [MAIN ] SLGN: Fetched primary data is valid. [2025-09-26T21:18:20.014380] [DEBUG] [LOCAL ] SLGN: Saving primary data. [2025-09-26T21:18:20.015894] [DEBUG] [LOCAL ] SLGN: Trimmed 58273 records to 41039 (keeping 200 days of data) [2025-09-26T21:18:20.276669] [DEBUG] [LOCAL ] SLGN: Primary data saved (41039 records). [2025-09-26T21:18:20.276843] [INFO ] [MAIN ] SLGN: Full history saved. [2025-09-26T21:18:20.277018] [INFO ] [MAIN ] Update Progress: 1934/2371 symbols completed. SLGN took 37.6s. Estimated remaining: 58m 22s. Rate: 7.5 symbols/min [2025-09-26T21:18:20.458758] [INFO ] [MAIN ] SM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:18:20.510887] [DEBUG] [LOCAL ] SM: Loaded 52692 existing records from primary storage. [2025-09-26T21:18:20.511061] [INFO ] [MAIN ] SM: Loaded 52692 existing records. [2025-09-26T21:18:20.699918] [WARN ] [MAIN ] SM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:18:20.700353] [INFO ] [MAIN ] SM: Wiping existing primary data before full refresh. [2025-09-26T21:18:20.700533] [INFO ] [LOCAL ] SM: Starting deletion of primary data. [2025-09-26T21:18:20.710786] [DEBUG] [LOCAL ] SM: Deleted primary data file. [2025-09-26T21:18:20.715980] [INFO ] [MAIN ] SM: Starting full primary refresh. [2025-09-26T21:18:20.722832] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2024-12. [2025-09-26T21:18:20.842487] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-26T21:18:21.128187] [INFO ] [REMOTE ] SM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:18:21.478147] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-26T21:18:21.487553] [INFO ] [REMOTE ] SLG: Full fetch complete (65254 records). [2025-09-26T21:18:21.487752] [DEBUG] [VALIDATOR ] SLG: Validating primary data. [2025-09-26T21:18:21.521817] [INFO ] [REMOTE ] SM: Fetching primary data for 2024-12. [2025-09-26T21:18:21.904801] [DEBUG] [VALIDATOR ] SLG: All expected trading days are present. [2025-09-26T21:18:21.904910] [DEBUG] [VALIDATOR ] SLG: Primary data validation passed. [2025-09-26T21:18:21.905914] [INFO ] [MAIN ] SLG: Fetched primary data is valid. [2025-09-26T21:18:21.905982] [DEBUG] [LOCAL ] SLG: Saving primary data. [2025-09-26T21:18:21.907486] [DEBUG] [LOCAL ] SLG: Trimmed 65254 records to 46130 (keeping 200 days of data) [2025-09-26T21:18:22.180572] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-26T21:18:22.233462] [DEBUG] [LOCAL ] SLG: Primary data saved (46130 records). [2025-09-26T21:18:22.233634] [INFO ] [MAIN ] SLG: Full history saved. [2025-09-26T21:18:22.233776] [INFO ] [MAIN ] Update Progress: 1935/2371 symbols completed. SLG took 42.6s. Estimated remaining: 58m 12s. Rate: 7.5 symbols/min [2025-09-26T21:18:22.319509] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-05. [2025-09-26T21:18:22.422972] [INFO ] [MAIN ] SMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:18:22.423179] [DEBUG] [LOCAL ] SMA: No existing data file found in primary storage. [2025-09-26T21:18:22.423236] [WARN ] [MAIN ] SMA: No existing data found, performing full refresh instead. [2025-09-26T21:18:22.423392] [INFO ] [MAIN ] SMA: Wiping existing primary data before full refresh. [2025-09-26T21:18:22.423438] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-09-26T21:18:22.423483] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-09-26T21:18:22.423517] [INFO ] [MAIN ] SMA: Starting full primary refresh. [2025-09-26T21:18:22.812783] [INFO ] [REMOTE ] SMA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:18:23.111693] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-01. [2025-09-26T21:18:23.359208] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-26T21:18:23.911779] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-01. [2025-09-26T21:18:24.022093] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-26T21:18:24.289215] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-26T21:18:24.711730] [INFO ] [REMOTE ] SMA: Fetching primary data for 2024-12. [2025-09-26T21:18:24.978040] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:18:24.978393] [WARN ] [REMOTE ] SMA: No data returned for month 2024-12 [2025-09-26T21:18:25.511708] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-06. [2025-09-26T21:18:25.595457] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-26T21:18:26.311736] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-02. [2025-09-26T21:18:27.006092] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-26T21:18:27.111715] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-02. [2025-09-26T21:18:27.911720] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-01. [2025-09-26T21:18:28.129289] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-26T21:18:28.176338] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:18:28.176710] [WARN ] [REMOTE ] SMA: No data returned for month 2025-01 [2025-09-26T21:18:28.447054] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-26T21:18:28.711745] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-07. [2025-09-26T21:18:29.511727] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-03. [2025-09-26T21:18:30.247594] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-26T21:18:30.311733] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-02. [2025-09-26T21:18:30.571378] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:18:30.571857] [WARN ] [REMOTE ] SMA: No data returned for month 2025-02 [2025-09-26T21:18:31.002583] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-26T21:18:31.111727] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-08. [2025-09-26T21:18:31.911721] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-03. [2025-09-26T21:18:32.711725] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-04. [2025-09-26T21:18:32.875457] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-26T21:18:33.511722] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-03. [2025-09-26T21:18:33.765961] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:18:33.766337] [WARN ] [REMOTE ] SMA: No data returned for month 2025-03 [2025-09-26T21:18:33.830973] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-26T21:18:34.066710] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-26T21:18:34.311721] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-04. [2025-09-26T21:18:35.111763] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-05. [2025-09-26T21:18:35.911720] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-09. [2025-09-26T21:18:36.202777] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-26T21:18:36.467012] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-26T21:18:36.711729] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-06. [2025-09-26T21:18:37.458520] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-26T21:18:37.466501] [INFO ] [REMOTE ] SLQT: Full fetch complete (63511 records). [2025-09-26T21:18:37.466623] [DEBUG] [VALIDATOR ] SLQT: Validating primary data. [2025-09-26T21:18:37.516542] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-04. [2025-09-26T21:18:37.905414] [DEBUG] [VALIDATOR ] SLQT: All expected trading days are present. [2025-09-26T21:18:37.905557] [DEBUG] [VALIDATOR ] SLQT: Primary data validation passed. [2025-09-26T21:18:37.906899] [INFO ] [MAIN ] SLQT: Fetched primary data is valid. [2025-09-26T21:18:37.907056] [DEBUG] [LOCAL ] SLQT: Saving primary data. [2025-09-26T21:18:37.924439] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-26T21:18:37.929972] [DEBUG] [LOCAL ] SLQT: Trimmed 63511 records to 44370 (keeping 200 days of data) [2025-09-26T21:18:38.205377] [DEBUG] [LOCAL ] SLQT: Primary data saved (44370 records). [2025-09-26T21:18:38.205542] [INFO ] [MAIN ] SLQT: Full history saved. [2025-09-26T21:18:38.205676] [INFO ] [MAIN ] Update Progress: 1936/2371 symbols completed. SLQT took 34.4s. Estimated remaining: 58m 6s. Rate: 7.5 symbols/min [2025-09-26T21:18:38.313430] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-07. [2025-09-26T21:18:38.391275] [INFO ] [MAIN ] SMBK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:18:38.401570] [DEBUG] [LOCAL ] SMBK: Loaded 8297 existing records from primary storage. [2025-09-26T21:18:38.401726] [INFO ] [MAIN ] SMBK: Loaded 8297 existing records. [2025-09-26T21:18:38.589442] [WARN ] [MAIN ] SMBK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:18:38.589793] [INFO ] [MAIN ] SMBK: Wiping existing primary data before full refresh. [2025-09-26T21:18:38.589852] [INFO ] [LOCAL ] SMBK: Starting deletion of primary data. [2025-09-26T21:18:38.590274] [DEBUG] [LOCAL ] SMBK: Deleted primary data file. [2025-09-26T21:18:38.590334] [INFO ] [MAIN ] SMBK: Starting full primary refresh. [2025-09-26T21:18:39.023833] [INFO ] [REMOTE ] SMBK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:18:39.045390] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-26T21:18:39.111712] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-05. [2025-09-26T21:18:39.656134] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-26T21:18:39.911725] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2024-12. [2025-09-26T21:18:40.711722] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-05. [2025-09-26T21:18:40.753040] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-26T21:18:40.964137] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-26T21:18:41.511728] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-08. [2025-09-26T21:18:42.027514] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-26T21:18:42.311721] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-06. [2025-09-26T21:18:42.554846] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-26T21:18:43.111747] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-01. [2025-09-26T21:18:43.911692] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-06. [2025-09-26T21:18:43.970580] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-26T21:18:44.061378] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-26T21:18:44.711717] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-07. [2025-09-26T21:18:45.387303] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-26T21:18:45.511738] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-09. [2025-09-26T21:18:46.311741] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-07. [2025-09-26T21:18:46.656191] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-26T21:18:46.746431] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-26T21:18:46.755267] [INFO ] [REMOTE ] SLVM: Full fetch complete (39585 records). [2025-09-26T21:18:46.755537] [DEBUG] [VALIDATOR ] SLVM: Validating primary data. [2025-09-26T21:18:47.116950] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-08. [2025-09-26T21:18:47.175639] [DEBUG] [VALIDATOR ] SLVM: All expected trading days are present. [2025-09-26T21:18:47.175773] [DEBUG] [VALIDATOR ] SLVM: Primary data validation passed. [2025-09-26T21:18:47.176684] [INFO ] [MAIN ] SLVM: Fetched primary data is valid. [2025-09-26T21:18:47.176861] [DEBUG] [LOCAL ] SLVM: Saving primary data. [2025-09-26T21:18:47.178405] [DEBUG] [LOCAL ] SLVM: Trimmed 39585 records to 28332 (keeping 200 days of data) [2025-09-26T21:18:47.354500] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-26T21:18:47.421220] [DEBUG] [LOCAL ] SLVM: Primary data saved (28332 records). [2025-09-26T21:18:47.421377] [INFO ] [MAIN ] SLVM: Full history saved. [2025-09-26T21:18:47.421637] [INFO ] [MAIN ] Update Progress: 1937/2371 symbols completed. SLVM took 32.5s. Estimated remaining: 57m 58s. Rate: 7.5 symbols/min [2025-09-26T21:18:47.604936] [INFO ] [MAIN ] SMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:18:47.620862] [DEBUG] [LOCAL ] SMC: Loaded 11564 existing records from primary storage. [2025-09-26T21:18:47.620995] [INFO ] [MAIN ] SMC: Loaded 11564 existing records. [2025-09-26T21:18:47.815792] [WARN ] [MAIN ] SMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:18:47.816359] [INFO ] [MAIN ] SMC: Wiping existing primary data before full refresh. [2025-09-26T21:18:47.816452] [INFO ] [LOCAL ] SMC: Starting deletion of primary data. [2025-09-26T21:18:47.817044] [DEBUG] [LOCAL ] SMC: Deleted primary data file. [2025-09-26T21:18:47.817162] [INFO ] [MAIN ] SMC: Starting full primary refresh. [2025-09-26T21:18:47.917523] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-02. [2025-09-26T21:18:48.203259] [INFO ] [REMOTE ] SMC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:18:48.631475] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-26T21:18:48.711740] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-03. [2025-09-26T21:18:49.023422] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-26T21:18:49.511788] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-09. [2025-09-26T21:18:49.628843] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-26T21:18:50.311725] [INFO ] [REMOTE ] SMC: Fetching primary data for 2024-12. [2025-09-26T21:18:51.111720] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-04. [2025-09-26T21:18:51.160598] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T21:18:51.171408] [INFO ] [REMOTE ] SM: Full fetch complete (75234 records). [2025-09-26T21:18:51.171563] [DEBUG] [VALIDATOR ] SM: Validating primary data. [2025-09-26T21:18:51.325570] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-26T21:18:51.617941] [DEBUG] [VALIDATOR ] SM: All expected trading days are present. [2025-09-26T21:18:51.618023] [DEBUG] [VALIDATOR ] SM: Primary data validation passed. [2025-09-26T21:18:51.619133] [INFO ] [MAIN ] SM: Fetched primary data is valid. [2025-09-26T21:18:51.619227] [DEBUG] [LOCAL ] SM: Saving primary data. [2025-09-26T21:18:51.620910] [DEBUG] [LOCAL ] SM: Trimmed 75234 records to 53080 (keeping 200 days of data) [2025-09-26T21:18:51.934868] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-08. [2025-09-26T21:18:51.989878] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-26T21:18:52.003149] [DEBUG] [LOCAL ] SM: Primary data saved (53080 records). [2025-09-26T21:18:52.003318] [INFO ] [MAIN ] SM: Full history saved. [2025-09-26T21:18:52.003497] [INFO ] [MAIN ] Update Progress: 1938/2371 symbols completed. SM took 31.7s. Estimated remaining: 57m 50s. Rate: 7.5 symbols/min [2025-09-26T21:18:52.186274] [INFO ] [MAIN ] SMFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:18:52.240363] [DEBUG] [LOCAL ] SMFG: Loaded 48429 existing records from primary storage. [2025-09-26T21:18:52.240540] [INFO ] [MAIN ] SMFG: Loaded 48429 existing records. [2025-09-26T21:18:52.484921] [WARN ] [MAIN ] SMFG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:18:52.485207] [INFO ] [MAIN ] SMFG: Wiping existing primary data before full refresh. [2025-09-26T21:18:52.485256] [INFO ] [LOCAL ] SMFG: Starting deletion of primary data. [2025-09-26T21:18:52.486410] [DEBUG] [LOCAL ] SMFG: Deleted primary data file. [2025-09-26T21:18:52.486472] [INFO ] [MAIN ] SMFG: Starting full primary refresh. [2025-09-26T21:18:52.716946] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-01. [2025-09-26T21:18:52.875101] [INFO ] [REMOTE ] SMFG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:18:53.319511] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-26T21:18:53.511696] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-09. [2025-09-26T21:18:53.593286] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-26T21:18:54.311727] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-02. [2025-09-26T21:18:54.792165] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-26T21:18:54.799243] [INFO ] [REMOTE ] SMA: Full fetch complete (29965 records). [2025-09-26T21:18:54.799371] [DEBUG] [VALIDATOR ] SMA: Validating primary data. [2025-09-26T21:18:54.997409] [WARN ] [VALIDATOR ] SMA: Validation failed - insufficient historical data. Have 123 unique days, need 200 days [2025-09-26T21:18:54.998014] [FATAL] [MAIN ] SMA: Fetched primary data is invalid. Refusing to save it. [2025-09-26T21:18:54.998159] [WARN ] [MAIN ] SMA: Deleting existing primary and derivative data due to validation failure. [2025-09-26T21:18:54.998251] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-09-26T21:18:54.998339] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-09-26T21:18:54.998382] [INFO ] [LOCAL ] SMA: Starting deletion of derivative data. [2025-09-26T21:18:54.998424] [DEBUG] [LOCAL ] SMA: No derivative data file found to delete. [2025-09-26T21:18:54.998490] [INFO ] [MAIN ] Update Progress: 1939/2371 symbols completed. SMA took 32.8s. Estimated remaining: 57m 40s. Rate: 7.5 symbols/min [2025-09-26T21:18:55.116868] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2024-12. [2025-09-26T21:18:55.219368] [INFO ] [MAIN ] SMG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:18:55.228574] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-26T21:18:55.289995] [DEBUG] [LOCAL ] SMG: Loaded 44209 existing records from primary storage. [2025-09-26T21:18:55.290149] [INFO ] [MAIN ] SMG: Loaded 44209 existing records. [2025-09-26T21:18:55.482358] [WARN ] [MAIN ] SMG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:18:55.482722] [INFO ] [MAIN ] SMG: Wiping existing primary data before full refresh. [2025-09-26T21:18:55.482843] [INFO ] [LOCAL ] SMG: Starting deletion of primary data. [2025-09-26T21:18:55.484151] [DEBUG] [LOCAL ] SMG: Deleted primary data file. [2025-09-26T21:18:55.484213] [INFO ] [MAIN ] SMG: Starting full primary refresh. [2025-09-26T21:18:55.841913] [INFO ] [REMOTE ] SMG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:18:55.911695] [INFO ] [REMOTE ] SMG: Fetching primary data for 2024-12. [2025-09-26T21:18:56.711744] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-05. [2025-09-26T21:18:56.845454] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-26T21:18:57.053070] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-26T21:18:57.511753] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-01. [2025-09-26T21:18:57.534025] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-26T21:18:58.311790] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-06. [2025-09-26T21:18:59.111694] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-03. [2025-09-26T21:18:59.197424] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-26T21:18:59.203374] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-26T21:18:59.911714] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-02. [2025-09-26T21:18:59.993661] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-26T21:19:00.711755] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-01. [2025-09-26T21:19:01.511738] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-07. [2025-09-26T21:19:01.649441] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-26T21:19:01.778869] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-26T21:19:02.143251] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-26T21:19:02.311840] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-03. [2025-09-26T21:19:03.111745] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-08. [2025-09-26T21:19:03.911749] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-04. [2025-09-26T21:19:03.997176] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-26T21:19:04.005921] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-26T21:19:04.711715] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-02. [2025-09-26T21:19:04.945204] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-26T21:19:05.511755] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-04. [2025-09-26T21:19:06.030957] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-26T21:19:06.311762] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-09. [2025-09-26T21:19:07.074457] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-26T21:19:07.076570] [INFO ] [REMOTE ] SMBK: Full fetch complete (11781 records). [2025-09-26T21:19:07.076678] [DEBUG] [VALIDATOR ] SMBK: Validating primary data. [2025-09-26T21:19:07.116937] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-05. [2025-09-26T21:19:07.509788] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-26T21:19:07.530719] [DEBUG] [VALIDATOR ] SMBK: All expected trading days are present. [2025-09-26T21:19:07.531014] [DEBUG] [VALIDATOR ] SMBK: Primary data validation passed. [2025-09-26T21:19:07.531407] [INFO ] [MAIN ] SMBK: Fetched primary data is valid. [2025-09-26T21:19:07.531488] [DEBUG] [LOCAL ] SMBK: Saving primary data. [2025-09-26T21:19:07.533616] [DEBUG] [LOCAL ] SMBK: Trimmed 11781 records to 8332 (keeping 200 days of data) [2025-09-26T21:19:07.595250] [DEBUG] [LOCAL ] SMBK: Primary data saved (8332 records). [2025-09-26T21:19:07.595424] [INFO ] [MAIN ] SMBK: Full history saved. [2025-09-26T21:19:07.595570] [INFO ] [MAIN ] Update Progress: 1940/2371 symbols completed. SMBK took 29.4s. Estimated remaining: 57m 33s. Rate: 7.5 symbols/min [2025-09-26T21:19:07.779532] [INFO ] [MAIN ] SMHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:19:07.796363] [DEBUG] [LOCAL ] SMHI: Loaded 13854 existing records from primary storage. [2025-09-26T21:19:07.796515] [INFO ] [MAIN ] SMHI: Loaded 13854 existing records. [2025-09-26T21:19:07.916933] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-03. [2025-09-26T21:19:07.994384] [WARN ] [MAIN ] SMHI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:19:07.995242] [INFO ] [MAIN ] SMHI: Wiping existing primary data before full refresh. [2025-09-26T21:19:07.995314] [INFO ] [LOCAL ] SMHI: Starting deletion of primary data. [2025-09-26T21:19:07.995719] [DEBUG] [LOCAL ] SMHI: Deleted primary data file. [2025-09-26T21:19:07.995782] [INFO ] [MAIN ] SMHI: Starting full primary refresh. [2025-09-26T21:19:08.108142] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-26T21:19:08.394938] [INFO ] [REMOTE ] SMHI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:19:08.711760] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-05. [2025-09-26T21:19:09.511708] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2024-12. [2025-09-26T21:19:09.768043] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-26T21:19:10.311750] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-04. [2025-09-26T21:19:10.532021] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-26T21:19:10.876544] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-26T21:19:11.111761] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-06. [2025-09-26T21:19:11.911740] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-06. [2025-09-26T21:19:11.994904] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-26T21:19:12.452893] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-26T21:19:12.711795] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-05. [2025-09-26T21:19:13.511735] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-07. [2025-09-26T21:19:13.566421] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-26T21:19:14.311772] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-07. [2025-09-26T21:19:14.394529] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-26T21:19:14.539552] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-26T21:19:15.111772] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-06. [2025-09-26T21:19:15.911751] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-08. [2025-09-26T21:19:16.082585] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-26T21:19:16.525741] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-26T21:19:16.711780] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-08. [2025-09-26T21:19:16.836252] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-26T21:19:17.511823] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-07. [2025-09-26T21:19:18.311720] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-09. [2025-09-26T21:19:18.468606] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-26T21:19:18.834910] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-26T21:19:18.837734] [INFO ] [REMOTE ] SMC: Full fetch complete (16664 records). [2025-09-26T21:19:18.837827] [DEBUG] [VALIDATOR ] SMC: Validating primary data. [2025-09-26T21:19:19.118937] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-01. [2025-09-26T21:19:19.264272] [DEBUG] [VALIDATOR ] SMC: All expected trading days are present. [2025-09-26T21:19:19.264391] [DEBUG] [VALIDATOR ] SMC: Primary data validation passed. [2025-09-26T21:19:19.264917] [INFO ] [MAIN ] SMC: Fetched primary data is valid. [2025-09-26T21:19:19.265170] [DEBUG] [LOCAL ] SMC: Saving primary data. [2025-09-26T21:19:19.266098] [DEBUG] [LOCAL ] SMC: Trimmed 16664 records to 11630 (keeping 200 days of data) [2025-09-26T21:19:19.364448] [DEBUG] [LOCAL ] SMC: Primary data saved (11630 records). [2025-09-26T21:19:19.367369] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-26T21:19:19.367634] [INFO ] [MAIN ] SMC: Full history saved. [2025-09-26T21:19:19.367970] [INFO ] [MAIN ] Update Progress: 1941/2371 symbols completed. SMC took 31.9s. Estimated remaining: 57m 26s. Rate: 7.5 symbols/min [2025-09-26T21:19:19.560990] [INFO ] [MAIN ] SMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:19:19.585813] [DEBUG] [LOCAL ] SMP: Loaded 19897 existing records from primary storage. [2025-09-26T21:19:19.586039] [INFO ] [MAIN ] SMP: Loaded 19897 existing records. [2025-09-26T21:19:19.787297] [WARN ] [MAIN ] SMP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:19:19.787614] [INFO ] [MAIN ] SMP: Wiping existing primary data before full refresh. [2025-09-26T21:19:19.787710] [INFO ] [LOCAL ] SMP: Starting deletion of primary data. [2025-09-26T21:19:19.788470] [DEBUG] [LOCAL ] SMP: Deleted primary data file. [2025-09-26T21:19:19.788534] [INFO ] [MAIN ] SMP: Starting full primary refresh. [2025-09-26T21:19:19.916896] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-09. [2025-09-26T21:19:20.192928] [INFO ] [REMOTE ] SMP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:19:20.333334] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-26T21:19:20.711766] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-02. [2025-09-26T21:19:21.511772] [INFO ] [REMOTE ] SMP: Fetching primary data for 2024-12. [2025-09-26T21:19:21.742927] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-26T21:19:21.752481] [INFO ] [REMOTE ] SMFG: Full fetch complete (68894 records). [2025-09-26T21:19:21.752783] [DEBUG] [VALIDATOR ] SMFG: Validating primary data. [2025-09-26T21:19:21.876092] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-26T21:19:22.185090] [DEBUG] [VALIDATOR ] SMFG: All expected trading days are present. [2025-09-26T21:19:22.185198] [DEBUG] [VALIDATOR ] SMFG: Primary data validation passed. [2025-09-26T21:19:22.186527] [INFO ] [MAIN ] SMFG: Fetched primary data is valid. [2025-09-26T21:19:22.186597] [DEBUG] [LOCAL ] SMFG: Saving primary data. [2025-09-26T21:19:22.188517] [DEBUG] [LOCAL ] SMFG: Trimmed 68894 records to 48771 (keeping 200 days of data) [2025-09-26T21:19:22.311898] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-03. [2025-09-26T21:19:22.457377] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-26T21:19:22.531983] [DEBUG] [LOCAL ] SMFG: Primary data saved (48771 records). [2025-09-26T21:19:22.532208] [INFO ] [MAIN ] SMFG: Full history saved. [2025-09-26T21:19:22.532330] [INFO ] [MAIN ] Update Progress: 1942/2371 symbols completed. SMFG took 30.5s. Estimated remaining: 57m 17s. Rate: 7.5 symbols/min [2025-09-26T21:19:22.705014] [INFO ] [MAIN ] SMR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:19:22.705404] [DEBUG] [LOCAL ] SMR: No existing data file found in primary storage. [2025-09-26T21:19:22.705459] [WARN ] [MAIN ] SMR: No existing data found, performing full refresh instead. [2025-09-26T21:19:22.705622] [INFO ] [MAIN ] SMR: Wiping existing primary data before full refresh. [2025-09-26T21:19:22.705701] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-09-26T21:19:22.705759] [DEBUG] [LOCAL ] SMR: No primary data file found to delete. [2025-09-26T21:19:22.705794] [INFO ] [MAIN ] SMR: Starting full primary refresh. [2025-09-26T21:19:23.092999] [INFO ] [REMOTE ] SMR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:19:23.111689] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-01. [2025-09-26T21:19:23.389862] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-26T21:19:23.763772] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-26T21:19:23.911745] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-02. [2025-09-26T21:19:24.711724] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-08. [2025-09-26T21:19:24.972206] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-26T21:19:25.511747] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-03. [2025-09-26T21:19:26.297953] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-26T21:19:26.311688] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-04. [2025-09-26T21:19:26.700338] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-26T21:19:27.111862] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-09. [2025-09-26T21:19:27.383106] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-26T21:19:27.911730] [INFO ] [REMOTE ] SMR: Fetching primary data for 2024-12. [2025-09-26T21:19:28.701564] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-26T21:19:28.711896] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-05. [2025-09-26T21:19:28.713632] [INFO ] [REMOTE ] SMG: Full fetch complete (62696 records). [2025-09-26T21:19:28.713785] [DEBUG] [VALIDATOR ] SMG: Validating primary data. [2025-09-26T21:19:29.113689] [DEBUG] [VALIDATOR ] SMG: All expected trading days are present. [2025-09-26T21:19:29.113829] [DEBUG] [VALIDATOR ] SMG: Primary data validation passed. [2025-09-26T21:19:29.115143] [INFO ] [MAIN ] SMG: Fetched primary data is valid. [2025-09-26T21:19:29.115242] [DEBUG] [LOCAL ] SMG: Saving primary data. [2025-09-26T21:19:29.117334] [DEBUG] [LOCAL ] SMG: Trimmed 62696 records to 44546 (keeping 200 days of data) [2025-09-26T21:19:29.431230] [DEBUG] [LOCAL ] SMG: Primary data saved (44546 records). [2025-09-26T21:19:29.431448] [INFO ] [MAIN ] SMG: Full history saved. [2025-09-26T21:19:29.431609] [INFO ] [MAIN ] Update Progress: 1943/2371 symbols completed. SMG took 34.4s. Estimated remaining: 57m 9s. Rate: 7.5 symbols/min [2025-09-26T21:19:29.512919] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-04. [2025-09-26T21:19:29.619328] [INFO ] [MAIN ] SMRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:19:29.668219] [DEBUG] [LOCAL ] SMRT: Loaded 44436 existing records from primary storage. [2025-09-26T21:19:29.668472] [INFO ] [MAIN ] SMRT: Loaded 44436 existing records. [2025-09-26T21:19:29.792599] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-26T21:19:29.877188] [WARN ] [MAIN ] SMRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:19:29.877563] [INFO ] [MAIN ] SMRT: Wiping existing primary data before full refresh. [2025-09-26T21:19:29.877699] [INFO ] [LOCAL ] SMRT: Starting deletion of primary data. [2025-09-26T21:19:29.878841] [DEBUG] [LOCAL ] SMRT: Deleted primary data file. [2025-09-26T21:19:29.878903] [INFO ] [MAIN ] SMRT: Starting full primary refresh. [2025-09-26T21:19:30.250559] [INFO ] [REMOTE ] SMRT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:19:30.311683] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2024-12. [2025-09-26T21:19:30.676838] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2024-12 (2.77 seconds). [2025-09-26T21:19:30.777582] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-26T21:19:31.111728] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-01. [2025-09-26T21:19:31.745498] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-26T21:19:31.911733] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-05. [2025-09-26T21:19:32.711786] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-01. [2025-09-26T21:19:33.039372] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-26T21:19:33.511700] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-06. [2025-09-26T21:19:33.631849] [DEBUG] [REMOTE ] SMHI: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-09-26T21:19:33.646247] [WARN ] [REMOTE ] SMHI: No data returned for month 2025-06 [2025-09-26T21:19:33.649049] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-09-26T21:19:33.710580] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-26T21:19:34.311809] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-07. [2025-09-26T21:19:35.111749] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-06. [2025-09-26T21:19:35.200291] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-26T21:19:35.911714] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-02. [2025-09-26T21:19:36.112916] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-26T21:19:36.711732] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-07. [2025-09-26T21:19:37.426672] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-26T21:19:37.511760] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-03. [2025-09-26T21:19:37.776861] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-26T21:19:38.311750] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-08. [2025-09-26T21:19:38.715282] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-26T21:19:39.111730] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-02. [2025-09-26T21:19:39.267412] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-26T21:19:39.911768] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-04. [2025-09-26T21:19:40.711752] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-08. [2025-09-26T21:19:41.464591] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-09-26T21:19:41.511675] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-03. [2025-09-26T21:19:41.598327] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-26T21:19:41.967585] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-26T21:19:42.311775] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-09. [2025-09-26T21:19:43.040340] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-26T21:19:43.045330] [INFO ] [REMOTE ] SMP: Full fetch complete (26155 records). [2025-09-26T21:19:43.045537] [DEBUG] [VALIDATOR ] SMP: Validating primary data. [2025-09-26T21:19:43.116895] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-09. [2025-09-26T21:19:43.522779] [DEBUG] [VALIDATOR ] SMP: All expected trading days are present. [2025-09-26T21:19:43.522871] [DEBUG] [VALIDATOR ] SMP: Primary data validation passed. [2025-09-26T21:19:43.523450] [INFO ] [MAIN ] SMP: Fetched primary data is valid. [2025-09-26T21:19:43.523511] [DEBUG] [LOCAL ] SMP: Saving primary data. [2025-09-26T21:19:43.524318] [DEBUG] [LOCAL ] SMP: Trimmed 26155 records to 19999 (keeping 200 days of data) [2025-09-26T21:19:43.660020] [DEBUG] [LOCAL ] SMP: Primary data saved (19999 records). [2025-09-26T21:19:43.660204] [INFO ] [MAIN ] SMP: Full history saved. [2025-09-26T21:19:43.660327] [INFO ] [MAIN ] Update Progress: 1944/2371 symbols completed. SMP took 24.3s. Estimated remaining: 57m 2s. Rate: 7.5 symbols/min [2025-09-26T21:19:43.841836] [INFO ] [MAIN ] SMWB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:19:43.881137] [DEBUG] [LOCAL ] SMWB: Loaded 32959 existing records from primary storage. [2025-09-26T21:19:43.881290] [INFO ] [MAIN ] SMWB: Loaded 32959 existing records. [2025-09-26T21:19:43.924998] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-05. [2025-09-26T21:19:44.084696] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-26T21:19:44.085108] [WARN ] [MAIN ] SMWB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:19:44.088920] [INFO ] [REMOTE ] SMHI: Full fetch complete (21913 records). [2025-09-26T21:19:44.089249] [DEBUG] [VALIDATOR ] SMHI: Validating primary data. [2025-09-26T21:19:44.089844] [INFO ] [MAIN ] SMWB: Wiping existing primary data before full refresh. [2025-09-26T21:19:44.112220] [INFO ] [LOCAL ] SMWB: Starting deletion of primary data. [2025-09-26T21:19:44.158737] [DEBUG] [LOCAL ] SMWB: Deleted primary data file. [2025-09-26T21:19:44.164345] [INFO ] [MAIN ] SMWB: Starting full primary refresh. [2025-09-26T21:19:44.345355] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-03 (2.83 seconds). [2025-09-26T21:19:44.550734] [WARN ] [VALIDATOR ] SMHI: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-26T21:19:44.607576] [FATAL] [MAIN ] SMHI: Fetched primary data is invalid. Refusing to save it. [2025-09-26T21:19:44.635836] [WARN ] [MAIN ] SMHI: Deleting existing primary and derivative data due to validation failure. [2025-09-26T21:19:44.647291] [INFO ] [LOCAL ] SMHI: Starting deletion of primary data. [2025-09-26T21:19:44.668788] [DEBUG] [LOCAL ] SMHI: No primary data file found to delete. [2025-09-26T21:19:44.671887] [INFO ] [LOCAL ] SMHI: Starting deletion of derivative data. [2025-09-26T21:19:44.673329] [DEBUG] [LOCAL ] SMHI: Deleted derivative data file. [2025-09-26T21:19:44.673535] [INFO ] [MAIN ] Update Progress: 1945/2371 symbols completed. SMHI took 37.1s. Estimated remaining: 56m 53s. Rate: 7.5 symbols/min [2025-09-26T21:19:44.718050] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-04. [2025-09-26T21:19:44.916013] [INFO ] [REMOTE ] SMWB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:19:44.969064] [INFO ] [MAIN ] SN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:19:45.034427] [DEBUG] [LOCAL ] SN: Loaded 50150 existing records from primary storage. [2025-09-26T21:19:45.034634] [INFO ] [MAIN ] SN: Loaded 50150 existing records. [2025-09-26T21:19:45.225209] [WARN ] [MAIN ] SN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:19:45.225541] [INFO ] [MAIN ] SN: Wiping existing primary data before full refresh. [2025-09-26T21:19:45.225615] [INFO ] [LOCAL ] SN: Starting deletion of primary data. [2025-09-26T21:19:45.226959] [DEBUG] [LOCAL ] SN: Deleted primary data file. [2025-09-26T21:19:45.227050] [INFO ] [MAIN ] SN: Starting full primary refresh. [2025-09-26T21:19:45.513141] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2024-12. [2025-09-26T21:19:45.618170] [INFO ] [REMOTE ] SN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:19:45.649703] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-26T21:19:46.311720] [INFO ] [REMOTE ] SN: Fetching primary data for 2024-12. [2025-09-26T21:19:47.078900] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-26T21:19:47.111709] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-06. [2025-09-26T21:19:47.319917] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-09-26T21:19:47.920090] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-01. [2025-09-26T21:19:47.927090] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-26T21:19:48.742820] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-05. [2025-09-26T21:19:48.766311] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-26T21:19:49.408274] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-26T21:19:49.511759] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-07. [2025-09-26T21:19:50.311753] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-01. [2025-09-26T21:19:51.075323] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-26T21:19:51.111722] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-08. [2025-09-26T21:19:51.483846] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-05 (2.74 seconds). [2025-09-26T21:19:51.545504] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-26T21:19:51.911726] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-02. [2025-09-26T21:19:52.711706] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-02. [2025-09-26T21:19:52.899934] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-26T21:19:53.511714] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-09. [2025-09-26T21:19:53.658776] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-26T21:19:54.248971] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-26T21:19:54.311744] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-06. [2025-09-26T21:19:54.486321] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-26T21:19:54.493987] [INFO ] [REMOTE ] SMRT: Full fetch complete (62022 records). [2025-09-26T21:19:54.494119] [DEBUG] [VALIDATOR ] SMRT: Validating primary data. [2025-09-26T21:19:54.914749] [DEBUG] [VALIDATOR ] SMRT: All expected trading days are present. [2025-09-26T21:19:54.914872] [DEBUG] [VALIDATOR ] SMRT: Primary data validation passed. [2025-09-26T21:19:54.915953] [INFO ] [MAIN ] SMRT: Fetched primary data is valid. [2025-09-26T21:19:54.916034] [DEBUG] [LOCAL ] SMRT: Saving primary data. [2025-09-26T21:19:54.917672] [DEBUG] [LOCAL ] SMRT: Trimmed 62022 records to 44707 (keeping 200 days of data) [2025-09-26T21:19:55.114671] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-03. [2025-09-26T21:19:55.183355] [DEBUG] [LOCAL ] SMRT: Primary data saved (44707 records). [2025-09-26T21:19:55.183526] [INFO ] [MAIN ] SMRT: Full history saved. [2025-09-26T21:19:55.183633] [INFO ] [MAIN ] Update Progress: 1946/2371 symbols completed. SMRT took 25.8s. Estimated remaining: 56m 45s. Rate: 7.5 symbols/min [2025-09-26T21:19:55.368540] [INFO ] [MAIN ] SNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:19:55.396391] [DEBUG] [LOCAL ] SNA: Loaded 26478 existing records from primary storage. [2025-09-26T21:19:55.396575] [INFO ] [MAIN ] SNA: Loaded 26478 existing records. [2025-09-26T21:19:55.594040] [WARN ] [MAIN ] SNA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:19:55.594367] [INFO ] [MAIN ] SNA: Wiping existing primary data before full refresh. [2025-09-26T21:19:55.594436] [INFO ] [LOCAL ] SNA: Starting deletion of primary data. [2025-09-26T21:19:55.595343] [DEBUG] [LOCAL ] SNA: Deleted primary data file. [2025-09-26T21:19:55.595405] [INFO ] [MAIN ] SNA: Starting full primary refresh. [2025-09-26T21:19:55.916891] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-03. [2025-09-26T21:19:55.972845] [INFO ] [REMOTE ] SNA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:19:56.510501] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-26T21:19:56.711696] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-04. [2025-09-26T21:19:56.794212] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-09-26T21:19:57.458094] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T21:19:57.511750] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-04. [2025-09-26T21:19:58.138752] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-26T21:19:58.311724] [INFO ] [REMOTE ] SNA: Fetching primary data for 2024-12. [2025-09-26T21:19:59.111715] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-07. [2025-09-26T21:19:59.379028] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-26T21:19:59.449309] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-26T21:19:59.911748] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-01. [2025-09-26T21:20:00.711716] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-05. [2025-09-26T21:20:01.348144] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-26T21:20:01.511721] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-05. [2025-09-26T21:20:01.814050] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-09-26T21:20:02.213871] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-26T21:20:02.311743] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-08. [2025-09-26T21:20:03.111737] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-06. [2025-09-26T21:20:03.450500] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-26T21:20:03.911729] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-06. [2025-09-26T21:20:04.151997] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-26T21:20:04.711757] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-07. [2025-09-26T21:20:05.219326] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-08 (2.91 seconds). [2025-09-26T21:20:05.511686] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-02. [2025-09-26T21:20:05.555843] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-26T21:20:06.236338] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-26T21:20:06.311700] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-08. [2025-09-26T21:20:06.897603] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-26T21:20:07.111750] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-09. [2025-09-26T21:20:07.669701] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-26T21:20:07.908793] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-26T21:20:07.917635] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-03. [2025-09-26T21:20:07.920024] [INFO ] [REMOTE ] SMR: Full fetch complete (77584 records). [2025-09-26T21:20:07.920249] [DEBUG] [VALIDATOR ] SMR: Validating primary data. [2025-09-26T21:20:07.921341] [FATAL] [VALIDATOR ] SMR: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T21:20:07.921435] [FATAL] [MAIN ] SMR: Fetched primary data is invalid. Refusing to save it. [2025-09-26T21:20:07.921479] [WARN ] [MAIN ] SMR: Deleting existing primary and derivative data due to validation failure. [2025-09-26T21:20:07.921519] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-09-26T21:20:07.921576] [DEBUG] [LOCAL ] SMR: No primary data file found to delete. [2025-09-26T21:20:07.921612] [INFO ] [LOCAL ] SMR: Starting deletion of derivative data. [2025-09-26T21:20:07.921693] [DEBUG] [LOCAL ] SMR: No derivative data file found to delete. [2025-09-26T21:20:07.921793] [INFO ] [MAIN ] Update Progress: 1947/2371 symbols completed. SMR took 45.4s. Estimated remaining: 56m 38s. Rate: 7.5 symbols/min [2025-09-26T21:20:08.100378] [INFO ] [MAIN ] SNAP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:20:08.153117] [DEBUG] [LOCAL ] SNAP: Loaded 54186 existing records from primary storage. [2025-09-26T21:20:08.153267] [INFO ] [MAIN ] SNAP: Loaded 54186 existing records. [2025-09-26T21:20:08.337562] [WARN ] [MAIN ] SNAP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:20:08.337911] [INFO ] [MAIN ] SNAP: Wiping existing primary data before full refresh. [2025-09-26T21:20:08.337966] [INFO ] [LOCAL ] SNAP: Starting deletion of primary data. [2025-09-26T21:20:08.339430] [DEBUG] [LOCAL ] SNAP: Deleted primary data file. [2025-09-26T21:20:08.339497] [INFO ] [MAIN ] SNAP: Starting full primary refresh. [2025-09-26T21:20:08.720290] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-07. [2025-09-26T21:20:08.738248] [INFO ] [REMOTE ] SNAP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:20:09.444404] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-26T21:20:09.511717] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2024-12. [2025-09-26T21:20:10.311715] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-09. [2025-09-26T21:20:10.566915] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-26T21:20:11.111672] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-08. [2025-09-26T21:20:11.517471] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-26T21:20:11.526832] [INFO ] [REMOTE ] SMWB: Full fetch complete (49912 records). [2025-09-26T21:20:11.527098] [DEBUG] [VALIDATOR ] SMWB: Validating primary data. [2025-09-26T21:20:11.923499] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-04. [2025-09-26T21:20:11.981318] [DEBUG] [VALIDATOR ] SMWB: All expected trading days are present. [2025-09-26T21:20:11.981546] [DEBUG] [VALIDATOR ] SMWB: Primary data validation passed. [2025-09-26T21:20:11.982671] [INFO ] [MAIN ] SMWB: Fetched primary data is valid. [2025-09-26T21:20:11.983004] [DEBUG] [LOCAL ] SMWB: Saving primary data. [2025-09-26T21:20:11.984541] [DEBUG] [LOCAL ] SMWB: Trimmed 49912 records to 33137 (keeping 200 days of data) [2025-09-26T21:20:12.201619] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2024-12 (2.69 seconds). [2025-09-26T21:20:12.238215] [DEBUG] [LOCAL ] SMWB: Primary data saved (33137 records). [2025-09-26T21:20:12.239363] [INFO ] [MAIN ] SMWB: Full history saved. [2025-09-26T21:20:12.239507] [INFO ] [MAIN ] Update Progress: 1948/2371 symbols completed. SMWB took 28.6s. Estimated remaining: 56m 29s. Rate: 7.5 symbols/min [2025-09-26T21:20:12.422041] [INFO ] [MAIN ] SNDA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:20:12.428964] [DEBUG] [LOCAL ] SNDA: Loaded 4711 existing records from primary storage. [2025-09-26T21:20:12.429101] [INFO ] [MAIN ] SNDA: Loaded 4711 existing records. [2025-09-26T21:20:12.620865] [WARN ] [MAIN ] SNDA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:20:12.621145] [INFO ] [MAIN ] SNDA: Wiping existing primary data before full refresh. [2025-09-26T21:20:12.621196] [INFO ] [LOCAL ] SNDA: Starting deletion of primary data. [2025-09-26T21:20:12.621512] [DEBUG] [LOCAL ] SNDA: Deleted primary data file. [2025-09-26T21:20:12.621574] [INFO ] [MAIN ] SNDA: Starting full primary refresh. [2025-09-26T21:20:12.718167] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-01. [2025-09-26T21:20:13.011062] [INFO ] [REMOTE ] SNDA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:20:13.043111] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-26T21:20:13.511753] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-09. [2025-09-26T21:20:13.733936] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-26T21:20:14.311743] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-05. [2025-09-26T21:20:14.975169] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-26T21:20:15.111749] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2024-12. [2025-09-26T21:20:15.201357] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-26T21:20:15.212209] [INFO ] [REMOTE ] SN: Full fetch complete (70812 records). [2025-09-26T21:20:15.212517] [DEBUG] [VALIDATOR ] SN: Validating primary data. [2025-09-26T21:20:15.693801] [DEBUG] [VALIDATOR ] SN: All expected trading days are present. [2025-09-26T21:20:15.693943] [DEBUG] [VALIDATOR ] SN: Primary data validation passed. [2025-09-26T21:20:15.695176] [INFO ] [MAIN ] SN: Fetched primary data is valid. [2025-09-26T21:20:15.695394] [DEBUG] [LOCAL ] SN: Saving primary data. [2025-09-26T21:20:15.713883] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-26T21:20:15.720418] [DEBUG] [LOCAL ] SN: Trimmed 70812 records to 50487 (keeping 200 days of data) [2025-09-26T21:20:15.917598] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-02. [2025-09-26T21:20:16.044773] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-26T21:20:16.071102] [DEBUG] [LOCAL ] SN: Primary data saved (50487 records). [2025-09-26T21:20:16.071298] [INFO ] [MAIN ] SN: Full history saved. [2025-09-26T21:20:16.071407] [INFO ] [MAIN ] Update Progress: 1949/2371 symbols completed. SN took 31.4s. Estimated remaining: 56m 21s. Rate: 7.5 symbols/min [2025-09-26T21:20:16.260222] [INFO ] [MAIN ] SNDR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:20:16.302547] [DEBUG] [LOCAL ] SNDR: Loaded 41031 existing records from primary storage. [2025-09-26T21:20:16.302796] [INFO ] [MAIN ] SNDR: Loaded 41031 existing records. [2025-09-26T21:20:16.511610] [WARN ] [MAIN ] SNDR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:20:16.511906] [INFO ] [MAIN ] SNDR: Wiping existing primary data before full refresh. [2025-09-26T21:20:16.511957] [INFO ] [LOCAL ] SNDR: Starting deletion of primary data. [2025-09-26T21:20:16.513117] [DEBUG] [LOCAL ] SNDR: Deleted primary data file. [2025-09-26T21:20:16.513184] [INFO ] [MAIN ] SNDR: Starting full primary refresh. [2025-09-26T21:20:16.717316] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-06. [2025-09-26T21:20:16.913191] [INFO ] [REMOTE ] SNDR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:20:17.511733] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2024-12. [2025-09-26T21:20:17.943873] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-26T21:20:18.249051] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-09-26T21:20:18.311744] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-07. [2025-09-26T21:20:19.111697] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-01. [2025-09-26T21:20:19.177396] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-26T21:20:19.256682] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-26T21:20:19.911785] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-03. [2025-09-26T21:20:19.953685] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-26T21:20:20.711734] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-08. [2025-09-26T21:20:21.267102] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-26T21:20:21.511743] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-02. [2025-09-26T21:20:22.113791] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-26T21:20:22.131829] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-26T21:20:22.311743] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-03. [2025-09-26T21:20:23.035325] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-26T21:20:23.111729] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-04. [2025-09-26T21:20:23.911724] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-01. [2025-09-26T21:20:24.711717] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-09. [2025-09-26T21:20:25.477370] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T21:20:25.511756] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-04. [2025-09-26T21:20:25.699540] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-09-26T21:20:25.801356] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-26T21:20:25.807220] [INFO ] [REMOTE ] SNA: Full fetch complete (39016 records). [2025-09-26T21:20:25.807420] [DEBUG] [VALIDATOR ] SNA: Validating primary data. [2025-09-26T21:20:26.230190] [DEBUG] [VALIDATOR ] SNA: All expected trading days are present. [2025-09-26T21:20:26.230353] [DEBUG] [VALIDATOR ] SNA: Primary data validation passed. [2025-09-26T21:20:26.231271] [INFO ] [MAIN ] SNA: Fetched primary data is valid. [2025-09-26T21:20:26.231357] [DEBUG] [LOCAL ] SNA: Saving primary data. [2025-09-26T21:20:26.232461] [DEBUG] [LOCAL ] SNA: Trimmed 39016 records to 26608 (keeping 200 days of data) [2025-09-26T21:20:26.333318] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-26T21:20:26.333622] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-02. [2025-09-26T21:20:26.422494] [DEBUG] [LOCAL ] SNA: Primary data saved (26608 records). [2025-09-26T21:20:26.422672] [INFO ] [MAIN ] SNA: Full history saved. [2025-09-26T21:20:26.422788] [INFO ] [MAIN ] Update Progress: 1950/2371 symbols completed. SNA took 31.2s. Estimated remaining: 56m 13s. Rate: 7.5 symbols/min [2025-09-26T21:20:26.602992] [INFO ] [MAIN ] SNN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:20:26.646471] [DEBUG] [LOCAL ] SNN: Loaded 44731 existing records from primary storage. [2025-09-26T21:20:26.646625] [INFO ] [MAIN ] SNN: Loaded 44731 existing records. [2025-09-26T21:20:26.840977] [WARN ] [MAIN ] SNN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:20:26.841319] [INFO ] [MAIN ] SNN: Wiping existing primary data before full refresh. [2025-09-26T21:20:26.841429] [INFO ] [LOCAL ] SNN: Starting deletion of primary data. [2025-09-26T21:20:26.842331] [DEBUG] [LOCAL ] SNN: Deleted primary data file. [2025-09-26T21:20:26.842403] [INFO ] [MAIN ] SNN: Starting full primary refresh. [2025-09-26T21:20:27.116893] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-05. [2025-09-26T21:20:27.227213] [INFO ] [REMOTE ] SNN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:20:27.796098] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-26T21:20:27.911730] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-05. [2025-09-26T21:20:28.711713] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-03. [2025-09-26T21:20:28.739366] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-26T21:20:29.511748] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-06. [2025-09-26T21:20:29.615898] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-26T21:20:30.207516] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-26T21:20:30.242003] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-26T21:20:30.311711] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-07. [2025-09-26T21:20:30.948919] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-26T21:20:31.111720] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-04. [2025-09-26T21:20:31.911729] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-06. [2025-09-26T21:20:32.711688] [INFO ] [REMOTE ] SNN: Fetching primary data for 2024-12. [2025-09-26T21:20:32.978697] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-26T21:20:33.511740] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-08. [2025-09-26T21:20:34.122252] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-26T21:20:34.219571] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-09-26T21:20:34.298701] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-26T21:20:34.311662] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-01. [2025-09-26T21:20:34.418929] [DEBUG] [REMOTE ] SNN: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-26T21:20:34.419363] [WARN ] [REMOTE ] SNN: No data returned for month 2025-01 [2025-09-26T21:20:35.111757] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-05. [2025-09-26T21:20:35.911714] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-09. [2025-09-26T21:20:36.562255] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-26T21:20:36.564852] [INFO ] [REMOTE ] SNDA: Full fetch complete (8420 records). [2025-09-26T21:20:36.565097] [DEBUG] [VALIDATOR ] SNDA: Validating primary data. [2025-09-26T21:20:36.716218] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-07. [2025-09-26T21:20:37.015185] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-26T21:20:37.024390] [DEBUG] [VALIDATOR ] SNDA: All expected trading days are present. [2025-09-26T21:20:37.033105] [DEBUG] [VALIDATOR ] SNDA: Primary data validation passed. [2025-09-26T21:20:37.033794] [INFO ] [MAIN ] SNDA: Fetched primary data is valid. [2025-09-26T21:20:37.034029] [DEBUG] [LOCAL ] SNDA: Saving primary data. [2025-09-26T21:20:37.035166] [DEBUG] [LOCAL ] SNDA: Trimmed 8420 records to 4732 (keeping 200 days of data) [2025-09-26T21:20:37.064154] [DEBUG] [LOCAL ] SNDA: Primary data saved (4732 records). [2025-09-26T21:20:37.064308] [INFO ] [MAIN ] SNDA: Full history saved. [2025-09-26T21:20:37.064419] [INFO ] [MAIN ] Update Progress: 1951/2371 symbols completed. SNDA took 24.8s. Estimated remaining: 56m 6s. Rate: 7.5 symbols/min [2025-09-26T21:20:37.248290] [INFO ] [MAIN ] SNOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:20:37.248492] [DEBUG] [LOCAL ] SNOW: No existing data file found in primary storage. [2025-09-26T21:20:37.248535] [WARN ] [MAIN ] SNOW: No existing data found, performing full refresh instead. [2025-09-26T21:20:37.248727] [INFO ] [MAIN ] SNOW: Wiping existing primary data before full refresh. [2025-09-26T21:20:37.248779] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-09-26T21:20:37.248823] [DEBUG] [LOCAL ] SNOW: No primary data file found to delete. [2025-09-26T21:20:37.248861] [INFO ] [MAIN ] SNOW: Starting full primary refresh. [2025-09-26T21:20:37.516992] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-02. [2025-09-26T21:20:37.631773] [INFO ] [REMOTE ] SNOW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:20:38.311772] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2024-12. [2025-09-26T21:20:39.098679] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-26T21:20:39.112322] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-06. [2025-09-26T21:20:39.243254] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-26T21:20:39.911752] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-03. [2025-09-26T21:20:40.587994] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-26T21:20:40.711749] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-08. [2025-09-26T21:20:40.766582] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-09-26T21:20:41.511700] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-01. [2025-09-26T21:20:41.591276] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-26T21:20:42.311732] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-07. [2025-09-26T21:20:43.111736] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-04. [2025-09-26T21:20:43.343627] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-09-26T21:20:43.426913] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-26T21:20:43.818740] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-09-26T21:20:43.911733] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-02. [2025-09-26T21:20:44.711687] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-09. [2025-09-26T21:20:44.799181] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-26T21:20:45.511734] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-05. [2025-09-26T21:20:46.311698] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-08. [2025-09-26T21:20:46.381662] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-09-26T21:20:46.914722] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-26T21:20:46.926898] [INFO ] [REMOTE ] SNAP: Full fetch complete (77933 records). [2025-09-26T21:20:46.927073] [DEBUG] [VALIDATOR ] SNAP: Validating primary data. [2025-09-26T21:20:47.118045] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-03. [2025-09-26T21:20:47.288347] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-26T21:20:47.404075] [DEBUG] [VALIDATOR ] SNAP: All expected trading days are present. [2025-09-26T21:20:47.404194] [DEBUG] [VALIDATOR ] SNAP: Primary data validation passed. [2025-09-26T21:20:47.405313] [INFO ] [MAIN ] SNAP: Fetched primary data is valid. [2025-09-26T21:20:47.405398] [DEBUG] [LOCAL ] SNAP: Saving primary data. [2025-09-26T21:20:47.407674] [DEBUG] [LOCAL ] SNAP: Trimmed 77933 records to 54576 (keeping 200 days of data) [2025-09-26T21:20:47.532078] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-26T21:20:47.795492] [DEBUG] [LOCAL ] SNAP: Primary data saved (54576 records). [2025-09-26T21:20:47.795671] [INFO ] [MAIN ] SNAP: Full history saved. [2025-09-26T21:20:47.795797] [INFO ] [MAIN ] Update Progress: 1952/2371 symbols completed. SNAP took 39.9s. Estimated remaining: 55m 58s. Rate: 7.5 symbols/min [2025-09-26T21:20:47.916854] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-09. [2025-09-26T21:20:48.032222] [INFO ] [MAIN ] SNV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:20:48.084534] [DEBUG] [LOCAL ] SNV: Loaded 49296 existing records from primary storage. [2025-09-26T21:20:48.084743] [INFO ] [MAIN ] SNV: Loaded 49296 existing records. [2025-09-26T21:20:48.271114] [WARN ] [MAIN ] SNV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:20:48.271397] [INFO ] [MAIN ] SNV: Wiping existing primary data before full refresh. [2025-09-26T21:20:48.271448] [INFO ] [LOCAL ] SNV: Starting deletion of primary data. [2025-09-26T21:20:48.272611] [DEBUG] [LOCAL ] SNV: Deleted primary data file. [2025-09-26T21:20:48.272702] [INFO ] [MAIN ] SNV: Starting full primary refresh. [2025-09-26T21:20:48.661509] [INFO ] [REMOTE ] SNV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:20:48.711757] [INFO ] [REMOTE ] SNV: Fetching primary data for 2024-12. [2025-09-26T21:20:49.366838] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-26T21:20:49.492530] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-26T21:20:49.501244] [INFO ] [REMOTE ] SNDR: Full fetch complete (58990 records). [2025-09-26T21:20:49.501426] [DEBUG] [VALIDATOR ] SNDR: Validating primary data. [2025-09-26T21:20:49.516902] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-06. [2025-09-26T21:20:49.962253] [DEBUG] [VALIDATOR ] SNDR: All expected trading days are present. [2025-09-26T21:20:49.962441] [DEBUG] [VALIDATOR ] SNDR: Primary data validation passed. [2025-09-26T21:20:49.963617] [INFO ] [MAIN ] SNDR: Fetched primary data is valid. [2025-09-26T21:20:49.963732] [DEBUG] [LOCAL ] SNDR: Saving primary data. [2025-09-26T21:20:49.965583] [DEBUG] [LOCAL ] SNDR: Trimmed 58990 records to 41368 (keeping 200 days of data) [2025-09-26T21:20:50.251762] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-26T21:20:50.305184] [DEBUG] [LOCAL ] SNDR: Primary data saved (41368 records). [2025-09-26T21:20:50.305420] [INFO ] [MAIN ] SNDR: Full history saved. [2025-09-26T21:20:50.305819] [INFO ] [MAIN ] Update Progress: 1953/2371 symbols completed. SNDR took 34.2s. Estimated remaining: 55m 49s. Rate: 7.5 symbols/min [2025-09-26T21:20:50.316669] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-01. [2025-09-26T21:20:50.507412] [INFO ] [MAIN ] SNX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:20:50.568177] [DEBUG] [LOCAL ] SNX: Loaded 40172 existing records from primary storage. [2025-09-26T21:20:50.568334] [INFO ] [MAIN ] SNX: Loaded 40172 existing records. [2025-09-26T21:20:50.759482] [WARN ] [MAIN ] SNX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:20:50.759814] [INFO ] [MAIN ] SNX: Wiping existing primary data before full refresh. [2025-09-26T21:20:50.759885] [INFO ] [LOCAL ] SNX: Starting deletion of primary data. [2025-09-26T21:20:50.761183] [DEBUG] [LOCAL ] SNX: Deleted primary data file. [2025-09-26T21:20:50.761261] [INFO ] [MAIN ] SNX: Starting full primary refresh. [2025-09-26T21:20:51.123109] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-04. [2025-09-26T21:20:51.170256] [INFO ] [REMOTE ] SNX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:20:51.204178] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-26T21:20:51.911735] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-07. [2025-09-26T21:20:52.104357] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-26T21:20:52.711740] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-02. [2025-09-26T21:20:53.525677] [INFO ] [REMOTE ] SNX: Fetching primary data for 2024-12. [2025-09-26T21:20:53.529989] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-09-26T21:20:53.654280] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-26T21:20:54.303908] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-26T21:20:54.314226] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-08. [2025-09-26T21:20:54.650040] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-26T21:20:55.111805] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-01. [2025-09-26T21:20:55.911718] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-05. [2025-09-26T21:20:56.143661] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-26T21:20:56.711707] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-09. [2025-09-26T21:20:56.884075] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-26T21:20:57.511764] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-02. [2025-09-26T21:20:58.311734] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-03. [2025-09-26T21:20:58.339939] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-26T21:20:58.352302] [INFO ] [REMOTE ] SNN: Full fetch complete (56949 records). [2025-09-26T21:20:58.352469] [DEBUG] [VALIDATOR ] SNN: Validating primary data. [2025-09-26T21:20:58.562411] [WARN ] [VALIDATOR ] SNN: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-26T21:20:58.563788] [FATAL] [MAIN ] SNN: Fetched primary data is invalid. Refusing to save it. [2025-09-26T21:20:58.564355] [WARN ] [MAIN ] SNN: Deleting existing primary and derivative data due to validation failure. [2025-09-26T21:20:58.564454] [INFO ] [LOCAL ] SNN: Starting deletion of primary data. [2025-09-26T21:20:58.595064] [DEBUG] [LOCAL ] SNN: No primary data file found to delete. [2025-09-26T21:20:58.598690] [INFO ] [LOCAL ] SNN: Starting deletion of derivative data. [2025-09-26T21:20:58.599832] [DEBUG] [LOCAL ] SNN: Deleted derivative data file. [2025-09-26T21:20:58.601613] [INFO ] [MAIN ] Update Progress: 1954/2371 symbols completed. SNN took 32.2s. Estimated remaining: 55m 41s. Rate: 7.5 symbols/min [2025-09-26T21:20:58.601257] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-05 (2.69 seconds). [2025-09-26T21:20:58.832783] [INFO ] [MAIN ] SO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:20:58.835940] [DEBUG] [LOCAL ] SO: No existing data file found in primary storage. [2025-09-26T21:20:58.837823] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-26T21:20:58.836351] [WARN ] [MAIN ] SO: No existing data found, performing full refresh instead. [2025-09-26T21:20:58.845374] [INFO ] [MAIN ] SO: Wiping existing primary data before full refresh. [2025-09-26T21:20:58.845838] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-09-26T21:20:58.845910] [DEBUG] [LOCAL ] SO: No primary data file found to delete. [2025-09-26T21:20:58.845947] [INFO ] [MAIN ] SO: Starting full primary refresh. [2025-09-26T21:20:59.117026] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-03. [2025-09-26T21:20:59.227391] [INFO ] [REMOTE ] SO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:20:59.911713] [INFO ] [REMOTE ] SO: Fetching primary data for 2024-12. [2025-09-26T21:21:00.039364] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-26T21:21:00.711784] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-04. [2025-09-26T21:21:01.008880] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-26T21:21:01.511781] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-06. [2025-09-26T21:21:01.762327] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-26T21:21:01.992707] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-26T21:21:02.311777] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-01. [2025-09-26T21:21:03.111776] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-05. [2025-09-26T21:21:03.892308] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-09-26T21:21:03.911672] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-07. [2025-09-26T21:21:04.060171] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-26T21:21:04.247710] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-26T21:21:04.711722] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-06. [2025-09-26T21:21:05.511796] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-04. [2025-09-26T21:21:06.119389] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-26T21:21:06.307388] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-26T21:21:06.316380] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-08. [2025-09-26T21:21:07.111761] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-02. [2025-09-26T21:21:07.321870] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-26T21:21:07.911768] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-05. [2025-09-26T21:21:08.711723] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-07. [2025-09-26T21:21:08.813853] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-09-26T21:21:08.908954] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-26T21:21:09.344313] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-26T21:21:09.511728] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-03. [2025-09-26T21:21:10.311744] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-06. [2025-09-26T21:21:10.525321] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-26T21:21:11.111721] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-08. [2025-09-26T21:21:11.390979] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-26T21:21:11.849607] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-26T21:21:11.911727] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-09. [2025-09-26T21:21:12.699056] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-26T21:21:12.711670] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-09. [2025-09-26T21:21:13.511724] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-04. [2025-09-26T21:21:14.101919] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-26T21:21:14.113105] [INFO ] [REMOTE ] SNOW: Full fetch complete (77650 records). [2025-09-26T21:21:14.113287] [DEBUG] [VALIDATOR ] SNOW: Validating primary data. [2025-09-26T21:21:14.353090] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-07. [2025-09-26T21:21:14.440195] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-26T21:21:14.509991] [INFO ] [REMOTE ] SNV: Full fetch complete (71120 records). [2025-09-26T21:21:14.510616] [DEBUG] [VALIDATOR ] SNV: Validating primary data. [2025-09-26T21:21:14.754812] [DEBUG] [VALIDATOR ] SNOW: All expected trading days are present. [2025-09-26T21:21:14.754955] [DEBUG] [VALIDATOR ] SNOW: Primary data validation passed. [2025-09-26T21:21:14.756139] [INFO ] [MAIN ] SNOW: Fetched primary data is valid. [2025-09-26T21:21:14.756268] [DEBUG] [LOCAL ] SNOW: Saving primary data. [2025-09-26T21:21:14.841075] [DEBUG] [LOCAL ] SNOW: Trimmed 77650 records to 54371 (keeping 200 days of data) [2025-09-26T21:21:15.186708] [DEBUG] [VALIDATOR ] SNV: All expected trading days are present. [2025-09-26T21:21:15.188117] [DEBUG] [VALIDATOR ] SNV: Primary data validation passed. [2025-09-26T21:21:15.190235] [INFO ] [MAIN ] SNV: Fetched primary data is valid. [2025-09-26T21:21:15.191120] [DEBUG] [LOCAL ] SNV: Saving primary data. [2025-09-26T21:21:15.196090] [DEBUG] [LOCAL ] SNV: Trimmed 71120 records to 49633 (keeping 200 days of data) [2025-09-26T21:21:15.352575] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-26T21:21:15.371355] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-05. [2025-09-26T21:21:15.796388] [DEBUG] [LOCAL ] SNOW: Primary data saved (54371 records). [2025-09-26T21:21:15.797542] [INFO ] [MAIN ] SNOW: Full history saved. [2025-09-26T21:21:15.798022] [INFO ] [MAIN ] Update Progress: 1955/2371 symbols completed. SNOW took 38.7s. Estimated remaining: 55m 35s. Rate: 7.5 symbols/min [2025-09-26T21:21:16.004419] [INFO ] [MAIN ] SOBO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:21:16.080240] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-26T21:21:16.090854] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-08. [2025-09-26T21:21:16.133568] [DEBUG] [LOCAL ] SOBO: Loaded 39894 existing records from primary storage. [2025-09-26T21:21:16.134704] [INFO ] [MAIN ] SOBO: Loaded 39894 existing records. [2025-09-26T21:21:16.196736] [DEBUG] [LOCAL ] SNV: Primary data saved (49633 records). [2025-09-26T21:21:16.211389] [INFO ] [MAIN ] SNV: Full history saved. [2025-09-26T21:21:16.217742] [INFO ] [MAIN ] Update Progress: 1956/2371 symbols completed. SNV took 28.4s. Estimated remaining: 55m 25s. Rate: 7.5 symbols/min [2025-09-26T21:21:16.493302] [WARN ] [MAIN ] SOBO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:21:16.522405] [INFO ] [MAIN ] SOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:21:16.522742] [INFO ] [MAIN ] SOBO: Wiping existing primary data before full refresh. [2025-09-26T21:21:16.522857] [INFO ] [LOCAL ] SOBO: Starting deletion of primary data. [2025-09-26T21:21:16.524039] [DEBUG] [LOCAL ] SOBO: Deleted primary data file. [2025-09-26T21:21:16.524103] [INFO ] [MAIN ] SOBO: Starting full primary refresh. [2025-09-26T21:21:16.880545] [DEBUG] [LOCAL ] SOC: Loaded 50651 existing records from primary storage. [2025-09-26T21:21:16.880875] [INFO ] [MAIN ] SOC: Loaded 50651 existing records. [2025-09-26T21:21:17.041874] [INFO ] [REMOTE ] SOBO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:21:17.078623] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2024-12. [2025-09-26T21:21:17.172795] [WARN ] [MAIN ] SOC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:21:17.173570] [INFO ] [MAIN ] SOC: Wiping existing primary data before full refresh. [2025-09-26T21:21:17.173677] [INFO ] [LOCAL ] SOC: Starting deletion of primary data. [2025-09-26T21:21:17.174789] [DEBUG] [LOCAL ] SOC: Deleted primary data file. [2025-09-26T21:21:17.174892] [INFO ] [MAIN ] SOC: Starting full primary refresh. [2025-09-26T21:21:17.531810] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-26T21:21:17.591431] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-06. [2025-09-26T21:21:17.626706] [INFO ] [REMOTE ] SOC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:21:17.651582] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-26T21:21:18.311701] [INFO ] [REMOTE ] SOC: Fetching primary data for 2024-12. [2025-09-26T21:21:18.652127] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-26T21:21:19.111678] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-01. [2025-09-26T21:21:19.316916] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-26T21:21:19.809192] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-26T21:21:19.911740] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-01. [2025-09-26T21:21:20.433918] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-26T21:21:20.711748] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-09. [2025-09-26T21:21:21.259124] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-26T21:21:21.511726] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-02. [2025-09-26T21:21:22.311768] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-02. [2025-09-26T21:21:22.804679] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-26T21:21:23.111732] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-03. [2025-09-26T21:21:23.449055] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-09 (2.74 seconds). [2025-09-26T21:21:23.457881] [INFO ] [REMOTE ] SNX: Full fetch complete (56939 records). [2025-09-26T21:21:23.458054] [DEBUG] [VALIDATOR ] SNX: Validating primary data. [2025-09-26T21:21:23.915168] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-07. [2025-09-26T21:21:23.915530] [DEBUG] [VALIDATOR ] SNX: All expected trading days are present. [2025-09-26T21:21:23.916892] [DEBUG] [VALIDATOR ] SNX: Primary data validation passed. [2025-09-26T21:21:23.918091] [INFO ] [MAIN ] SNX: Fetched primary data is valid. [2025-09-26T21:21:23.918440] [DEBUG] [LOCAL ] SNX: Saving primary data. [2025-09-26T21:21:23.920469] [DEBUG] [LOCAL ] SNX: Trimmed 56939 records to 40540 (keeping 200 days of data) [2025-09-26T21:21:24.060939] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-26T21:21:24.236955] [DEBUG] [LOCAL ] SNX: Primary data saved (40540 records). [2025-09-26T21:21:24.237107] [INFO ] [MAIN ] SNX: Full history saved. [2025-09-26T21:21:24.237203] [INFO ] [MAIN ] Update Progress: 1957/2371 symbols completed. SNX took 33.9s. Estimated remaining: 55m 17s. Rate: 7.5 symbols/min [2025-09-26T21:21:24.602013] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-26T21:21:24.711726] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-03. [2025-09-26T21:21:25.511775] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-04. [2025-09-26T21:21:25.963318] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-26T21:21:26.311709] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-08. [2025-09-26T21:21:26.411383] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-26T21:21:27.026741] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-26T21:21:27.111718] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-04. [2025-09-26T21:21:27.911729] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-05. [2025-09-26T21:21:28.220129] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-26T21:21:28.711749] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-09. [2025-09-26T21:21:28.891689] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-26T21:21:29.446712] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-26T21:21:29.511741] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-06. [2025-09-26T21:21:30.172639] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-26T21:21:30.183140] [INFO ] [REMOTE ] SO: Full fetch complete (77586 records). [2025-09-26T21:21:30.183292] [DEBUG] [VALIDATOR ] SO: Validating primary data. [2025-09-26T21:21:30.316897] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-05. [2025-09-26T21:21:30.624090] [DEBUG] [VALIDATOR ] SO: All expected trading days are present. [2025-09-26T21:21:30.624256] [DEBUG] [VALIDATOR ] SO: Primary data validation passed. [2025-09-26T21:21:30.625619] [INFO ] [MAIN ] SO: Fetched primary data is valid. [2025-09-26T21:21:30.625821] [DEBUG] [LOCAL ] SO: Saving primary data. [2025-09-26T21:21:30.628119] [DEBUG] [LOCAL ] SO: Trimmed 77586 records to 54383 (keeping 200 days of data) [2025-09-26T21:21:30.779632] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-26T21:21:31.053705] [DEBUG] [LOCAL ] SO: Primary data saved (54383 records). [2025-09-26T21:21:31.053878] [INFO ] [MAIN ] SO: Full history saved. [2025-09-26T21:21:31.053979] [INFO ] [MAIN ] Update Progress: 1958/2371 symbols completed. SO took 32.5s. Estimated remaining: 55m 9s. Rate: 7.5 symbols/min [2025-09-26T21:21:31.111738] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-07. [2025-09-26T21:21:32.011962] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-26T21:21:32.023783] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-06. [2025-09-26T21:21:32.084393] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-26T21:21:32.711740] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-08. [2025-09-26T21:21:33.804308] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-26T21:21:33.815062] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-07. [2025-09-26T21:21:34.160755] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-26T21:21:34.311760] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-09. [2025-09-26T21:21:35.613883] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-26T21:21:35.625818] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-08. [2025-09-26T21:21:35.775116] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-26T21:21:35.783434] [INFO ] [REMOTE ] SOBO: Full fetch complete (58546 records). [2025-09-26T21:21:35.783599] [DEBUG] [VALIDATOR ] SOBO: Validating primary data. [2025-09-26T21:21:36.199562] [DEBUG] [VALIDATOR ] SOBO: All expected trading days are present. [2025-09-26T21:21:36.199668] [DEBUG] [VALIDATOR ] SOBO: Primary data validation passed. [2025-09-26T21:21:36.200589] [INFO ] [MAIN ] SOBO: Fetched primary data is valid. [2025-09-26T21:21:36.200635] [DEBUG] [LOCAL ] SOBO: Saving primary data. [2025-09-26T21:21:36.201937] [DEBUG] [LOCAL ] SOBO: Trimmed 58546 records to 40211 (keeping 200 days of data) [2025-09-26T21:21:36.454465] [DEBUG] [LOCAL ] SOBO: Primary data saved (40211 records). [2025-09-26T21:21:36.454601] [INFO ] [MAIN ] SOBO: Full history saved. [2025-09-26T21:21:36.454709] [INFO ] [MAIN ] Update Progress: 1959/2371 symbols completed. SOBO took 20.7s. Estimated remaining: 55m 0s. Rate: 7.5 symbols/min [2025-09-26T21:21:36.989872] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-26T21:21:37.000991] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-09. [2025-09-26T21:21:38.762677] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-26T21:21:38.773891] [INFO ] [REMOTE ] SOC: Full fetch complete (71362 records). [2025-09-26T21:21:38.774070] [DEBUG] [VALIDATOR ] SOC: Validating primary data. [2025-09-26T21:21:39.182473] [DEBUG] [VALIDATOR ] SOC: All expected trading days are present. [2025-09-26T21:21:39.182560] [DEBUG] [VALIDATOR ] SOC: Primary data validation passed. [2025-09-26T21:21:39.183578] [INFO ] [MAIN ] SOC: Fetched primary data is valid. [2025-09-26T21:21:39.183665] [DEBUG] [LOCAL ] SOC: Saving primary data. [2025-09-26T21:21:39.185208] [DEBUG] [LOCAL ] SOC: Trimmed 71362 records to 51041 (keeping 200 days of data) [2025-09-26T21:21:39.504062] [DEBUG] [LOCAL ] SOC: Primary data saved (51041 records). [2025-09-26T21:21:39.504269] [INFO ] [MAIN ] SOC: Full history saved. [2025-09-26T21:21:39.504394] [INFO ] [MAIN ] Update Progress: 1960/2371 symbols completed. SOC took 23.3s. Estimated remaining: 54m 51s. Rate: 7.5 symbols/min [2025-09-26T21:21:40.126827] [INFO ] [MAIN ] SOJC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:21:40.238192] [INFO ] [MAIN ] SOJE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:21:40.317455] [INFO ] [MAIN ] SOJF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:21:40.311291] [INFO ] [MAIN ] SOJD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:21:40.320039] [DEBUG] [LOCAL ] SOJF: No existing data file found in primary storage. [2025-09-26T21:21:40.320473] [WARN ] [MAIN ] SOJF: No existing data found, performing full refresh instead. [2025-09-26T21:21:40.320988] [INFO ] [MAIN ] SOJF: Wiping existing primary data before full refresh. [2025-09-26T21:21:40.325380] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-09-26T21:21:40.325279] [DEBUG] [LOCAL ] SOJC: Loaded 5090 existing records from primary storage. [2025-09-26T21:21:40.325743] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-09-26T21:21:40.325869] [INFO ] [MAIN ] SOJF: Starting full primary refresh. [2025-09-26T21:21:40.325991] [INFO ] [MAIN ] SOJC: Loaded 5090 existing records. [2025-09-26T21:21:40.448272] [DEBUG] [LOCAL ] SOJE: Loaded 9346 existing records from primary storage. [2025-09-26T21:21:40.540570] [DEBUG] [LOCAL ] SOJD: Loaded 13059 existing records from primary storage. [2025-09-26T21:21:40.562534] [INFO ] [MAIN ] SOJD: Loaded 13059 existing records. [2025-09-26T21:21:40.534597] [INFO ] [MAIN ] SOJE: Loaded 9346 existing records. [2025-09-26T21:21:41.084000] [WARN ] [MAIN ] SOJC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:21:41.191899] [INFO ] [MAIN ] SOJC: Wiping existing primary data before full refresh. [2025-09-26T21:21:41.218736] [INFO ] [LOCAL ] SOJC: Starting deletion of primary data. [2025-09-26T21:21:41.250668] [WARN ] [MAIN ] SOJD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:21:41.251904] [INFO ] [MAIN ] SOJD: Wiping existing primary data before full refresh. [2025-09-26T21:21:41.267541] [INFO ] [LOCAL ] SOJD: Starting deletion of primary data. [2025-09-26T21:21:41.272807] [DEBUG] [LOCAL ] SOJC: Deleted primary data file. [2025-09-26T21:21:41.288766] [DEBUG] [LOCAL ] SOJD: Deleted primary data file. [2025-09-26T21:21:41.308107] [INFO ] [MAIN ] SOJC: Starting full primary refresh. [2025-09-26T21:21:41.313519] [INFO ] [MAIN ] SOJD: Starting full primary refresh. [2025-09-26T21:21:41.415215] [INFO ] [REMOTE ] SOJF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:21:41.488985] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2024-12. [2025-09-26T21:21:41.493634] [WARN ] [MAIN ] SOJE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:21:41.597111] [INFO ] [MAIN ] SOJE: Wiping existing primary data before full refresh. [2025-09-26T21:21:41.615395] [INFO ] [LOCAL ] SOJE: Starting deletion of primary data. [2025-09-26T21:21:41.649014] [DEBUG] [LOCAL ] SOJE: Deleted primary data file. [2025-09-26T21:21:41.654399] [INFO ] [MAIN ] SOJE: Starting full primary refresh. [2025-09-26T21:21:41.756184] [DEBUG] [REMOTE ] SOJF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:21:41.831397] [WARN ] [REMOTE ] SOJF: No data returned for month 2024-12 [2025-09-26T21:21:41.888875] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-01. [2025-09-26T21:21:42.563216] [INFO ] [REMOTE ] SOJD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:21:42.620495] [INFO ] [REMOTE ] SOJC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:21:42.627594] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2024-12. [2025-09-26T21:21:42.621424] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2024-12. [2025-09-26T21:21:42.712000] [INFO ] [REMOTE ] SOJE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:21:42.712399] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2024-12. [2025-09-26T21:21:43.156340] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-26T21:21:43.160867] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-02. [2025-09-26T21:21:43.502994] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-26T21:21:43.505842] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-01. [2025-09-26T21:21:43.711255] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-26T21:21:43.716296] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-01. [2025-09-26T21:21:43.795341] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-26T21:21:43.802477] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-01. [2025-09-26T21:21:43.946559] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-26T21:21:43.949200] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-02. [2025-09-26T21:21:43.957998] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-26T21:21:44.216313] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-26T21:21:44.467682] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-26T21:21:44.524169] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-26T21:21:44.711747] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-03. [2025-09-26T21:21:45.487382] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-26T21:21:45.511672] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-02. [2025-09-26T21:21:46.311755] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-04. [2025-09-26T21:21:46.414700] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-26T21:21:46.995585] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-26T21:21:47.111736] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-02. [2025-09-26T21:21:47.839217] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-26T21:21:47.911725] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-03. [2025-09-26T21:21:48.711761] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-03. [2025-09-26T21:21:48.817386] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-26T21:21:49.511749] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-05. [2025-09-26T21:21:50.101570] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-26T21:21:50.311871] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-06. [2025-09-26T21:21:51.058162] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-26T21:21:51.111721] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-07. [2025-09-26T21:21:51.872970] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-26T21:21:51.911722] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-08. [2025-09-26T21:21:52.548783] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-26T21:21:52.711732] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-03. [2025-09-26T21:21:52.861188] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-03 (4.15 seconds). [2025-09-26T21:21:53.395381] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-26T21:21:53.511731] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-04. [2025-09-26T21:21:54.311729] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-09. [2025-09-26T21:21:54.512008] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-26T21:21:54.961581] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-26T21:21:54.964050] [INFO ] [REMOTE ] SOJF: Full fetch complete (13245 records). [2025-09-26T21:21:54.964126] [DEBUG] [VALIDATOR ] SOJF: Validating primary data. [2025-09-26T21:21:55.122461] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-04. [2025-09-26T21:21:55.182334] [WARN ] [VALIDATOR ] SOJF: Validation failed - insufficient historical data. Have 175 unique days, need 200 days [2025-09-26T21:21:55.182789] [FATAL] [MAIN ] SOJF: Fetched primary data is invalid. Refusing to save it. [2025-09-26T21:21:55.182866] [WARN ] [MAIN ] SOJF: Deleting existing primary and derivative data due to validation failure. [2025-09-26T21:21:55.182945] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-09-26T21:21:55.183052] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-09-26T21:21:55.183110] [INFO ] [LOCAL ] SOJF: Starting deletion of derivative data. [2025-09-26T21:21:55.183157] [DEBUG] [LOCAL ] SOJF: No derivative data file found to delete. [2025-09-26T21:21:55.183238] [INFO ] [MAIN ] Update Progress: 1961/2371 symbols completed. SOJF took 15.7s. Estimated remaining: 54m 45s. Rate: 7.5 symbols/min [2025-09-26T21:21:55.378738] [INFO ] [MAIN ] SOL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:21:55.396121] [DEBUG] [LOCAL ] SOL: Loaded 13615 existing records from primary storage. [2025-09-26T21:21:55.396275] [INFO ] [MAIN ] SOL: Loaded 13615 existing records. [2025-09-26T21:21:55.591074] [WARN ] [MAIN ] SOL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:21:55.591456] [INFO ] [MAIN ] SOL: Wiping existing primary data before full refresh. [2025-09-26T21:21:55.591509] [INFO ] [LOCAL ] SOL: Starting deletion of primary data. [2025-09-26T21:21:55.592009] [DEBUG] [LOCAL ] SOL: Deleted primary data file. [2025-09-26T21:21:55.592118] [INFO ] [MAIN ] SOL: Starting full primary refresh. [2025-09-26T21:21:55.916861] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-05. [2025-09-26T21:21:55.987935] [INFO ] [REMOTE ] SOL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:21:56.127313] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-26T21:21:56.711720] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-04. [2025-09-26T21:21:56.885827] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-26T21:21:57.373768] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-26T21:21:57.511747] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-06. [2025-09-26T21:21:58.311700] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-05. [2025-09-26T21:21:58.399179] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-26T21:21:59.098103] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-26T21:21:59.111658] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-06. [2025-09-26T21:21:59.911742] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-05. [2025-09-26T21:21:59.912280] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-26T21:22:00.640309] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-26T21:22:00.711734] [INFO ] [REMOTE ] SOL: Fetching primary data for 2024-12. [2025-09-26T21:22:01.511744] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-06. [2025-09-26T21:22:01.916141] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-26T21:22:02.146556] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-26T21:22:02.311745] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-07. [2025-09-26T21:22:02.932982] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-26T21:22:03.111724] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-01. [2025-09-26T21:22:03.911740] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-07. [2025-09-26T21:22:04.349702] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-26T21:22:04.711735] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-07. [2025-09-26T21:22:04.776533] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-26T21:22:05.218733] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-26T21:22:05.511730] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-08. [2025-09-26T21:22:06.314008] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-02. [2025-09-26T21:22:06.317626] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-26T21:22:07.111719] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-08. [2025-09-26T21:22:07.223912] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-26T21:22:07.851615] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-26T21:22:07.911703] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-09. [2025-09-26T21:22:08.594566] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-26T21:22:08.596739] [INFO ] [REMOTE ] SOJE: Full fetch complete (14486 records). [2025-09-26T21:22:08.596846] [DEBUG] [VALIDATOR ] SOJE: Validating primary data. [2025-09-26T21:22:08.711887] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-09. [2025-09-26T21:22:08.997220] [DEBUG] [VALIDATOR ] SOJE: All expected trading days are present. [2025-09-26T21:22:08.997355] [DEBUG] [VALIDATOR ] SOJE: Primary data validation passed. [2025-09-26T21:22:08.997739] [INFO ] [MAIN ] SOJE: Fetched primary data is valid. [2025-09-26T21:22:08.997801] [DEBUG] [LOCAL ] SOJE: Saving primary data. [2025-09-26T21:22:08.998361] [DEBUG] [LOCAL ] SOJE: Trimmed 14486 records to 9408 (keeping 200 days of data) [2025-09-26T21:22:09.060962] [DEBUG] [LOCAL ] SOJE: Primary data saved (9408 records). [2025-09-26T21:22:09.061118] [INFO ] [MAIN ] SOJE: Full history saved. [2025-09-26T21:22:09.061216] [INFO ] [MAIN ] Update Progress: 1962/2371 symbols completed. SOJE took 29.6s. Estimated remaining: 54m 38s. Rate: 7.5 symbols/min [2025-09-26T21:22:09.252583] [INFO ] [MAIN ] SOLV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:22:09.295894] [DEBUG] [LOCAL ] SOLV: Loaded 44431 existing records from primary storage. [2025-09-26T21:22:09.296047] [INFO ] [MAIN ] SOLV: Loaded 44431 existing records. [2025-09-26T21:22:09.489196] [WARN ] [MAIN ] SOLV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:22:09.489454] [INFO ] [MAIN ] SOLV: Wiping existing primary data before full refresh. [2025-09-26T21:22:09.489504] [INFO ] [LOCAL ] SOLV: Starting deletion of primary data. [2025-09-26T21:22:09.490429] [DEBUG] [LOCAL ] SOLV: Deleted primary data file. [2025-09-26T21:22:09.490491] [INFO ] [MAIN ] SOLV: Starting full primary refresh. [2025-09-26T21:22:09.521483] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-08. [2025-09-26T21:22:09.631774] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-26T21:22:09.658715] [INFO ] [REMOTE ] SOJD: Full fetch complete (20107 records). [2025-09-26T21:22:09.673183] [DEBUG] [VALIDATOR ] SOJD: Validating primary data. [2025-09-26T21:22:10.127146] [INFO ] [REMOTE ] SOLV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:22:10.308548] [DEBUG] [VALIDATOR ] SOJD: All expected trading days are present. [2025-09-26T21:22:10.308670] [DEBUG] [VALIDATOR ] SOJD: Primary data validation passed. [2025-09-26T21:22:10.309139] [INFO ] [MAIN ] SOJD: Fetched primary data is valid. [2025-09-26T21:22:10.309186] [DEBUG] [LOCAL ] SOJD: Saving primary data. [2025-09-26T21:22:10.310118] [DEBUG] [LOCAL ] SOJD: Trimmed 20107 records to 13180 (keeping 200 days of data) [2025-09-26T21:22:10.311721] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2024-12. [2025-09-26T21:22:10.375284] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-26T21:22:10.405958] [DEBUG] [LOCAL ] SOJD: Primary data saved (13180 records). [2025-09-26T21:22:10.406149] [INFO ] [MAIN ] SOJD: Full history saved. [2025-09-26T21:22:10.406258] [INFO ] [MAIN ] Update Progress: 1963/2371 symbols completed. SOJD took 30.9s. Estimated remaining: 54m 29s. Rate: 7.5 symbols/min [2025-09-26T21:22:10.610781] [INFO ] [MAIN ] SON: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:22:10.665148] [DEBUG] [LOCAL ] SON: Loaded 43244 existing records from primary storage. [2025-09-26T21:22:10.665364] [INFO ] [MAIN ] SON: Loaded 43244 existing records. [2025-09-26T21:22:10.851751] [WARN ] [MAIN ] SON: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:22:10.852057] [INFO ] [MAIN ] SON: Wiping existing primary data before full refresh. [2025-09-26T21:22:10.852105] [INFO ] [LOCAL ] SON: Starting deletion of primary data. [2025-09-26T21:22:10.853042] [DEBUG] [LOCAL ] SON: Deleted primary data file. [2025-09-26T21:22:10.853106] [INFO ] [MAIN ] SON: Starting full primary refresh. [2025-09-26T21:22:11.116914] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-03. [2025-09-26T21:22:11.230261] [INFO ] [REMOTE ] SON: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:22:11.896448] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-26T21:22:11.911662] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-01. [2025-09-26T21:22:11.943435] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-26T21:22:12.711731] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-09. [2025-09-26T21:22:13.315432] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-26T21:22:13.317291] [INFO ] [REMOTE ] SOJC: Full fetch complete (7854 records). [2025-09-26T21:22:13.317396] [DEBUG] [VALIDATOR ] SOJC: Validating primary data. [2025-09-26T21:22:13.522716] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-04. [2025-09-26T21:22:13.728664] [DEBUG] [VALIDATOR ] SOJC: All expected trading days are present. [2025-09-26T21:22:13.728835] [DEBUG] [VALIDATOR ] SOJC: Primary data validation passed. [2025-09-26T21:22:13.729101] [INFO ] [MAIN ] SOJC: Fetched primary data is valid. [2025-09-26T21:22:13.729191] [DEBUG] [LOCAL ] SOJC: Saving primary data. [2025-09-26T21:22:13.737949] [DEBUG] [LOCAL ] SOJC: Trimmed 7854 records to 5120 (keeping 200 days of data) [2025-09-26T21:22:13.754843] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-26T21:22:13.797431] [DEBUG] [LOCAL ] SOJC: Primary data saved (5120 records). [2025-09-26T21:22:13.797563] [INFO ] [MAIN ] SOJC: Full history saved. [2025-09-26T21:22:13.797686] [INFO ] [MAIN ] Update Progress: 1964/2371 symbols completed. SOJC took 34.3s. Estimated remaining: 54m 20s. Rate: 7.5 symbols/min [2025-09-26T21:22:13.978628] [INFO ] [MAIN ] SONY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:22:14.048616] [DEBUG] [LOCAL ] SONY: Loaded 53747 existing records from primary storage. [2025-09-26T21:22:14.048874] [INFO ] [MAIN ] SONY: Loaded 53747 existing records. [2025-09-26T21:22:14.258178] [WARN ] [MAIN ] SONY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:22:14.258462] [INFO ] [MAIN ] SONY: Wiping existing primary data before full refresh. [2025-09-26T21:22:14.258547] [INFO ] [LOCAL ] SONY: Starting deletion of primary data. [2025-09-26T21:22:14.259894] [DEBUG] [LOCAL ] SONY: Deleted primary data file. [2025-09-26T21:22:14.259957] [INFO ] [MAIN ] SONY: Starting full primary refresh. [2025-09-26T21:22:14.320616] [INFO ] [REMOTE ] SON: Fetching primary data for 2024-12. [2025-09-26T21:22:14.587892] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-26T21:22:14.675338] [INFO ] [REMOTE ] SONY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:22:15.111738] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-02. [2025-09-26T21:22:15.904031] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-26T21:22:15.912228] [INFO ] [REMOTE ] SONY: Fetching primary data for 2024-12. [2025-09-26T21:22:16.711698] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-05. [2025-09-26T21:22:16.743219] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T21:22:17.511685] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-01. [2025-09-26T21:22:17.604779] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-26T21:22:18.311735] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-03. [2025-09-26T21:22:18.788932] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-26T21:22:18.880920] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2024-12 (2.97 seconds). [2025-09-26T21:22:19.111790] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-02. [2025-09-26T21:22:19.907791] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-26T21:22:19.916884] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-06. [2025-09-26T21:22:20.686025] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-26T21:22:20.711682] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-03. [2025-09-26T21:22:20.997817] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-26T21:22:21.511736] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-04. [2025-09-26T21:22:22.143780] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-26T21:22:22.311727] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-07. [2025-09-26T21:22:23.116879] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-01. [2025-09-26T21:22:23.132263] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-26T21:22:23.250250] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-26T21:22:23.911725] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-04. [2025-09-26T21:22:24.711712] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-08. [2025-09-26T21:22:25.271259] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-26T21:22:25.483080] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-26T21:22:25.511724] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-02. [2025-09-26T21:22:25.614688] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-26T21:22:26.311731] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-05. [2025-09-26T21:22:27.111725] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-05. [2025-09-26T21:22:27.446902] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-26T21:22:27.824832] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-26T21:22:27.911740] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-09. [2025-09-26T21:22:28.566584] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-26T21:22:28.711732] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-06. [2025-09-26T21:22:28.738158] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-26T21:22:28.741240] [INFO ] [REMOTE ] SOL: Full fetch complete (21726 records). [2025-09-26T21:22:28.741322] [DEBUG] [VALIDATOR ] SOL: Validating primary data. [2025-09-26T21:22:29.185171] [DEBUG] [VALIDATOR ] SOL: All expected trading days are present. [2025-09-26T21:22:29.185270] [DEBUG] [VALIDATOR ] SOL: Primary data validation passed. [2025-09-26T21:22:29.185832] [INFO ] [MAIN ] SOL: Fetched primary data is valid. [2025-09-26T21:22:29.185898] [DEBUG] [LOCAL ] SOL: Saving primary data. [2025-09-26T21:22:29.186749] [DEBUG] [LOCAL ] SOL: Trimmed 21726 records to 13694 (keeping 200 days of data) [2025-09-26T21:22:29.278522] [DEBUG] [LOCAL ] SOL: Primary data saved (13694 records). [2025-09-26T21:22:29.278753] [INFO ] [MAIN ] SOL: Full history saved. [2025-09-26T21:22:29.278926] [INFO ] [MAIN ] Update Progress: 1965/2371 symbols completed. SOL took 34.1s. Estimated remaining: 54m 13s. Rate: 7.5 symbols/min [2025-09-26T21:22:29.498107] [INFO ] [MAIN ] SOR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:22:29.504106] [DEBUG] [LOCAL ] SOR: Loaded 2934 existing records from primary storage. [2025-09-26T21:22:29.504211] [INFO ] [MAIN ] SOR: Loaded 2934 existing records. [2025-09-26T21:22:29.516882] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-03. [2025-09-26T21:22:29.740510] [WARN ] [MAIN ] SOR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:22:29.740839] [INFO ] [MAIN ] SOR: Wiping existing primary data before full refresh. [2025-09-26T21:22:29.740898] [INFO ] [LOCAL ] SOR: Starting deletion of primary data. [2025-09-26T21:22:29.741211] [DEBUG] [LOCAL ] SOR: Deleted primary data file. [2025-09-26T21:22:29.741274] [INFO ] [MAIN ] SOR: Starting full primary refresh. [2025-09-26T21:22:30.153363] [INFO ] [REMOTE ] SOR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:22:30.196222] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-26T21:22:30.311733] [INFO ] [REMOTE ] SOR: Fetching primary data for 2024-12. [2025-09-26T21:22:30.915388] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-26T21:22:31.111715] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-07. [2025-09-26T21:22:31.595489] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-26T21:22:31.911714] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-01. [2025-09-26T21:22:32.568980] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-26T21:22:32.599044] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-26T21:22:32.711724] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-02. [2025-09-26T21:22:33.200284] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-26T21:22:33.511758] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-08. [2025-09-26T21:22:34.311842] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-03. [2025-09-26T21:22:34.319027] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-26T21:22:34.816458] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-26T21:22:35.111713] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-04. [2025-09-26T21:22:35.463222] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-26T21:22:35.911720] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-04. [2025-09-26T21:22:36.711750] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-09. [2025-09-26T21:22:37.511709] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-05. [2025-09-26T21:22:37.906711] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-26T21:22:38.000212] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-26T21:22:38.311716] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-05. [2025-09-26T21:22:38.347717] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-26T21:22:38.357261] [INFO ] [REMOTE ] SOLV: Full fetch complete (63195 records). [2025-09-26T21:22:38.357469] [DEBUG] [VALIDATOR ] SOLV: Validating primary data. [2025-09-26T21:22:38.790820] [DEBUG] [VALIDATOR ] SOLV: All expected trading days are present. [2025-09-26T21:22:38.790924] [DEBUG] [VALIDATOR ] SOLV: Primary data validation passed. [2025-09-26T21:22:38.792053] [INFO ] [MAIN ] SOLV: Fetched primary data is valid. [2025-09-26T21:22:38.792135] [DEBUG] [LOCAL ] SOLV: Saving primary data. [2025-09-26T21:22:38.793737] [DEBUG] [LOCAL ] SOLV: Trimmed 63195 records to 44791 (keeping 200 days of data) [2025-09-26T21:22:39.078678] [DEBUG] [LOCAL ] SOLV: Primary data saved (44791 records). [2025-09-26T21:22:39.078847] [INFO ] [MAIN ] SOLV: Full history saved. [2025-09-26T21:22:39.079001] [INFO ] [MAIN ] Update Progress: 1966/2371 symbols completed. SOLV took 30.0s. Estimated remaining: 54m 6s. Rate: 7.5 symbols/min [2025-09-26T21:22:39.116850] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-06. [2025-09-26T21:22:39.266365] [INFO ] [MAIN ] SOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:22:39.277127] [DEBUG] [LOCAL ] SOS: Loaded 8154 existing records from primary storage. [2025-09-26T21:22:39.277273] [INFO ] [MAIN ] SOS: Loaded 8154 existing records. [2025-09-26T21:22:39.471530] [WARN ] [MAIN ] SOS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:22:39.471976] [INFO ] [MAIN ] SOS: Wiping existing primary data before full refresh. [2025-09-26T21:22:39.472362] [INFO ] [LOCAL ] SOS: Starting deletion of primary data. [2025-09-26T21:22:39.472879] [DEBUG] [LOCAL ] SOS: Deleted primary data file. [2025-09-26T21:22:39.472996] [INFO ] [MAIN ] SOS: Starting full primary refresh. [2025-09-26T21:22:39.849520] [INFO ] [REMOTE ] SOS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:22:39.911701] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-06. [2025-09-26T21:22:39.931102] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-26T21:22:40.475504] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-26T21:22:40.711771] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-06. [2025-09-26T21:22:41.404081] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-26T21:22:41.511769] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-07. [2025-09-26T21:22:42.311738] [INFO ] [REMOTE ] SOS: Fetching primary data for 2024-12. [2025-09-26T21:22:42.560832] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-26T21:22:43.111723] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-07. [2025-09-26T21:22:43.199781] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-26T21:22:43.403606] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-26T21:22:43.580552] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-26T21:22:43.911746] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-07. [2025-09-26T21:22:44.711745] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-08. [2025-09-26T21:22:45.511734] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-08. [2025-09-26T21:22:45.994089] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-26T21:22:46.020807] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-26T21:22:46.316880] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-08. [2025-09-26T21:22:46.332249] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-26T21:22:47.111745] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-09. [2025-09-26T21:22:47.911717] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-01. [2025-09-26T21:22:48.383669] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-26T21:22:48.556742] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-26T21:22:48.711738] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-09. [2025-09-26T21:22:48.945611] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-26T21:22:48.954688] [INFO ] [REMOTE ] SON: Full fetch complete (62268 records). [2025-09-26T21:22:48.954858] [DEBUG] [VALIDATOR ] SON: Validating primary data. [2025-09-26T21:22:49.363244] [DEBUG] [VALIDATOR ] SON: All expected trading days are present. [2025-09-26T21:22:49.363335] [DEBUG] [VALIDATOR ] SON: Primary data validation passed. [2025-09-26T21:22:49.364268] [INFO ] [MAIN ] SON: Fetched primary data is valid. [2025-09-26T21:22:49.364333] [DEBUG] [LOCAL ] SON: Saving primary data. [2025-09-26T21:22:49.365865] [DEBUG] [LOCAL ] SON: Trimmed 62268 records to 43596 (keeping 200 days of data) [2025-09-26T21:22:49.544013] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-09. [2025-09-26T21:22:49.641114] [DEBUG] [LOCAL ] SON: Primary data saved (43596 records). [2025-09-26T21:22:49.641259] [INFO ] [MAIN ] SON: Full history saved. [2025-09-26T21:22:49.641397] [INFO ] [MAIN ] Update Progress: 1967/2371 symbols completed. SON took 39.2s. Estimated remaining: 53m 58s. Rate: 7.5 symbols/min [2025-09-26T21:22:49.822566] [INFO ] [MAIN ] SPB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:22:49.857782] [DEBUG] [LOCAL ] SPB: Loaded 34467 existing records from primary storage. [2025-09-26T21:22:49.857982] [INFO ] [MAIN ] SPB: Loaded 34467 existing records. [2025-09-26T21:22:50.057092] [WARN ] [MAIN ] SPB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:22:50.057370] [INFO ] [MAIN ] SPB: Wiping existing primary data before full refresh. [2025-09-26T21:22:50.057427] [INFO ] [LOCAL ] SPB: Starting deletion of primary data. [2025-09-26T21:22:50.058198] [DEBUG] [LOCAL ] SPB: Deleted primary data file. [2025-09-26T21:22:50.058272] [INFO ] [MAIN ] SPB: Starting full primary refresh. [2025-09-26T21:22:50.178077] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-26T21:22:50.220386] [INFO ] [REMOTE ] SOR: Full fetch complete (4361 records). [2025-09-26T21:22:50.234970] [DEBUG] [VALIDATOR ] SOR: Validating primary data. [2025-09-26T21:22:50.318769] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-02. [2025-09-26T21:22:50.680763] [INFO ] [REMOTE ] SPB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:22:50.844307] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-26T21:22:50.904622] [DEBUG] [VALIDATOR ] SOR: All expected trading days are present. [2025-09-26T21:22:50.904775] [DEBUG] [VALIDATOR ] SOR: Primary data validation passed. [2025-09-26T21:22:50.905098] [INFO ] [MAIN ] SOR: Fetched primary data is valid. [2025-09-26T21:22:50.905173] [DEBUG] [LOCAL ] SOR: Saving primary data. [2025-09-26T21:22:50.957140] [DEBUG] [LOCAL ] SOR: Trimmed 4361 records to 2947 (keeping 200 days of data) [2025-09-26T21:22:50.989007] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-26T21:22:51.006065] [INFO ] [REMOTE ] SONY: Full fetch complete (77229 records). [2025-09-26T21:22:51.008575] [DEBUG] [VALIDATOR ] SONY: Validating primary data. [2025-09-26T21:22:51.059949] [DEBUG] [LOCAL ] SOR: Primary data saved (2947 records). [2025-09-26T21:22:51.088627] [INFO ] [MAIN ] SOR: Full history saved. [2025-09-26T21:22:51.100293] [INFO ] [MAIN ] Update Progress: 1968/2371 symbols completed. SOR took 21.8s. Estimated remaining: 53m 49s. Rate: 7.5 symbols/min [2025-09-26T21:22:51.112526] [INFO ] [REMOTE ] SPB: Fetching primary data for 2024-12. [2025-09-26T21:22:51.553570] [INFO ] [MAIN ] SPCE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:22:51.674358] [DEBUG] [VALIDATOR ] SONY: All expected trading days are present. [2025-09-26T21:22:51.674575] [DEBUG] [VALIDATOR ] SONY: Primary data validation passed. [2025-09-26T21:22:51.686730] [INFO ] [MAIN ] SONY: Fetched primary data is valid. [2025-09-26T21:22:51.687035] [DEBUG] [LOCAL ] SONY: Saving primary data. [2025-09-26T21:22:51.689334] [DEBUG] [LOCAL ] SONY: Trimmed 77229 records to 54136 (keeping 200 days of data) [2025-09-26T21:22:51.787882] [DEBUG] [LOCAL ] SPCE: Loaded 50249 existing records from primary storage. [2025-09-26T21:22:51.820751] [INFO ] [MAIN ] SPCE: Loaded 50249 existing records. [2025-09-26T21:22:51.912734] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-03. [2025-09-26T21:22:52.146454] [WARN ] [MAIN ] SPCE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:22:52.149183] [INFO ] [MAIN ] SPCE: Wiping existing primary data before full refresh. [2025-09-26T21:22:52.149837] [INFO ] [LOCAL ] SPCE: Starting deletion of primary data. [2025-09-26T21:22:52.151420] [DEBUG] [LOCAL ] SPCE: Deleted primary data file. [2025-09-26T21:22:52.151797] [INFO ] [MAIN ] SPCE: Starting full primary refresh. [2025-09-26T21:22:52.565399] [INFO ] [REMOTE ] SPCE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:22:52.678139] [DEBUG] [LOCAL ] SONY: Primary data saved (54136 records). [2025-09-26T21:22:52.678351] [INFO ] [MAIN ] SONY: Full history saved. [2025-09-26T21:22:52.678464] [INFO ] [MAIN ] Update Progress: 1969/2371 symbols completed. SONY took 38.9s. Estimated remaining: 53m 40s. Rate: 7.5 symbols/min [2025-09-26T21:22:52.716926] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2024-12. [2025-09-26T21:22:52.875876] [INFO ] [MAIN ] SPE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:22:52.884568] [DEBUG] [LOCAL ] SPE: Loaded 6414 existing records from primary storage. [2025-09-26T21:22:52.884743] [INFO ] [MAIN ] SPE: Loaded 6414 existing records. [2025-09-26T21:22:53.078598] [WARN ] [MAIN ] SPE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:22:53.078923] [INFO ] [MAIN ] SPE: Wiping existing primary data before full refresh. [2025-09-26T21:22:53.078975] [INFO ] [LOCAL ] SPE: Starting deletion of primary data. [2025-09-26T21:22:53.079254] [DEBUG] [LOCAL ] SPE: Deleted primary data file. [2025-09-26T21:22:53.079314] [INFO ] [MAIN ] SPE: Starting full primary refresh. [2025-09-26T21:22:53.455859] [INFO ] [REMOTE ] SPE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:22:53.511748] [INFO ] [REMOTE ] SPE: Fetching primary data for 2024-12. [2025-09-26T21:23:05.174781] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-03 (13.26 seconds). [2025-09-26T21:23:05.176233] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-04. [2025-09-26T21:23:05.773928] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-26T21:23:05.775472] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-05. [2025-09-26T21:23:05.799991] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2024-12 (14.69 seconds). [2025-09-26T21:23:05.806249] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-01. [2025-09-26T21:23:05.930904] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2024-12 (12.42 seconds). [2025-09-26T21:23:05.933172] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-01. [2025-09-26T21:23:06.956258] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-26T21:23:06.963710] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-02. [2025-09-26T21:23:08.068854] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2024-12 (15.35 seconds). [2025-09-26T21:23:08.080297] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-01. [2025-09-26T21:23:08.184707] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-09-26T21:23:08.186973] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-02. [2025-09-26T21:23:08.290267] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-26T21:23:08.297584] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-03. [2025-09-26T21:23:08.616714] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-05 (2.84 seconds). [2025-09-26T21:23:08.618974] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-06. [2025-09-26T21:23:08.996242] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-26T21:23:08.999629] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-03. [2025-09-26T21:23:09.156703] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-26T21:23:09.158099] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-07. [2025-09-26T21:23:09.477526] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-26T21:23:09.484685] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-04. [2025-09-26T21:23:09.743043] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-26T21:23:09.745272] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-04. [2025-09-26T21:23:10.021903] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-26T21:23:10.033987] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-02. [2025-09-26T21:23:10.048487] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-26T21:23:10.054499] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-08. [2025-09-26T21:23:10.550286] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-26T21:23:10.552799] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-05. [2025-09-26T21:23:11.081609] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-26T21:23:11.085684] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-09. [2025-09-26T21:23:11.129724] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-26T21:23:11.139909] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-05. [2025-09-26T21:23:11.171241] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-26T21:23:11.173217] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-06. [2025-09-26T21:23:11.800756] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-26T21:23:11.804510] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-07. [2025-09-26T21:23:11.842547] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-26T21:23:11.853152] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-03. [2025-09-26T21:23:12.229615] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-26T21:23:12.232417] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-08. [2025-09-26T21:23:12.270344] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-26T21:23:12.283202] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-06. [2025-09-26T21:23:12.284581] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-26T21:23:12.290715] [INFO ] [REMOTE ] SOS: Full fetch complete (10845 records). [2025-09-26T21:23:12.290882] [DEBUG] [VALIDATOR ] SOS: Validating primary data. [2025-09-26T21:23:12.712533] [DEBUG] [VALIDATOR ] SOS: All expected trading days are present. [2025-09-26T21:23:12.712636] [DEBUG] [VALIDATOR ] SOS: Primary data validation passed. [2025-09-26T21:23:12.713035] [INFO ] [MAIN ] SOS: Fetched primary data is valid. [2025-09-26T21:23:12.713080] [DEBUG] [LOCAL ] SOS: Saving primary data. [2025-09-26T21:23:12.713601] [DEBUG] [LOCAL ] SOS: Trimmed 10845 records to 8266 (keeping 200 days of data) [2025-09-26T21:23:12.764741] [DEBUG] [LOCAL ] SOS: Primary data saved (8266 records). [2025-09-26T21:23:12.764910] [INFO ] [MAIN ] SOS: Full history saved. [2025-09-26T21:23:12.765015] [INFO ] [MAIN ] Update Progress: 1970/2371 symbols completed. SOS took 33.7s. Estimated remaining: 53m 34s. Rate: 7.5 symbols/min [2025-09-26T21:23:12.939925] [INFO ] [MAIN ] SPG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:23:12.947216] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-26T21:23:12.949966] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-09. [2025-09-26T21:23:13.022353] [DEBUG] [LOCAL ] SPG: Loaded 50772 existing records from primary storage. [2025-09-26T21:23:13.022566] [INFO ] [MAIN ] SPG: Loaded 50772 existing records. [2025-09-26T21:23:13.213379] [WARN ] [MAIN ] SPG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:23:13.214108] [INFO ] [MAIN ] SPG: Wiping existing primary data before full refresh. [2025-09-26T21:23:13.214165] [INFO ] [LOCAL ] SPG: Starting deletion of primary data. [2025-09-26T21:23:13.215911] [DEBUG] [LOCAL ] SPG: Deleted primary data file. [2025-09-26T21:23:13.215973] [INFO ] [MAIN ] SPG: Starting full primary refresh. [2025-09-26T21:23:13.603812] [INFO ] [REMOTE ] SPG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:23:13.604318] [INFO ] [REMOTE ] SPG: Fetching primary data for 2024-12. [2025-09-26T21:23:13.735349] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-26T21:23:13.737620] [INFO ] [REMOTE ] SPE: Full fetch complete (10155 records). [2025-09-26T21:23:13.737809] [DEBUG] [VALIDATOR ] SPE: Validating primary data. [2025-09-26T21:23:14.065117] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-26T21:23:14.211762] [DEBUG] [VALIDATOR ] SPE: All expected trading days are present. [2025-09-26T21:23:14.212114] [DEBUG] [VALIDATOR ] SPE: Primary data validation passed. [2025-09-26T21:23:14.213063] [INFO ] [MAIN ] SPE: Fetched primary data is valid. [2025-09-26T21:23:14.214926] [DEBUG] [LOCAL ] SPE: Saving primary data. [2025-09-26T21:23:14.214810] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-09-26T21:23:14.227248] [DEBUG] [LOCAL ] SPE: Trimmed 10155 records to 6441 (keeping 200 days of data) [2025-09-26T21:23:14.268981] [DEBUG] [LOCAL ] SPE: Primary data saved (6441 records). [2025-09-26T21:23:14.269125] [INFO ] [MAIN ] SPE: Full history saved. [2025-09-26T21:23:14.269225] [INFO ] [MAIN ] Update Progress: 1971/2371 symbols completed. SPE took 21.6s. Estimated remaining: 53m 25s. Rate: 7.5 symbols/min [2025-09-26T21:23:14.316839] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-04. [2025-09-26T21:23:14.462417] [INFO ] [MAIN ] SPGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:23:14.548946] [DEBUG] [LOCAL ] SPGI: Loaded 46194 existing records from primary storage. [2025-09-26T21:23:14.549315] [INFO ] [MAIN ] SPGI: Loaded 46194 existing records. [2025-09-26T21:23:14.749732] [WARN ] [MAIN ] SPGI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:23:14.750377] [INFO ] [MAIN ] SPGI: Wiping existing primary data before full refresh. [2025-09-26T21:23:14.750442] [INFO ] [LOCAL ] SPGI: Starting deletion of primary data. [2025-09-26T21:23:14.751911] [DEBUG] [LOCAL ] SPGI: Deleted primary data file. [2025-09-26T21:23:14.751987] [INFO ] [MAIN ] SPGI: Starting full primary refresh. [2025-09-26T21:23:15.135889] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-07. [2025-09-26T21:23:15.141715] [INFO ] [REMOTE ] SPGI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:23:15.182796] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-26T21:23:15.911727] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-01. [2025-09-26T21:23:16.283818] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-26T21:23:16.711714] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-05. [2025-09-26T21:23:16.937994] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-26T21:23:17.511706] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-08. [2025-09-26T21:23:17.689616] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-26T21:23:18.311699] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2024-12. [2025-09-26T21:23:18.727031] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-26T21:23:18.922736] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-26T21:23:19.111716] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-09. [2025-09-26T21:23:19.787298] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-26T21:23:19.911733] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-02. [2025-09-26T21:23:20.369725] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-26T21:23:20.380478] [INFO ] [REMOTE ] SPB: Full fetch complete (47476 records). [2025-09-26T21:23:20.380735] [DEBUG] [VALIDATOR ] SPB: Validating primary data. [2025-09-26T21:23:20.721053] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-01. [2025-09-26T21:23:20.816159] [DEBUG] [VALIDATOR ] SPB: All expected trading days are present. [2025-09-26T21:23:20.816267] [DEBUG] [VALIDATOR ] SPB: Primary data validation passed. [2025-09-26T21:23:20.817238] [INFO ] [MAIN ] SPB: Fetched primary data is valid. [2025-09-26T21:23:20.817396] [DEBUG] [LOCAL ] SPB: Saving primary data. [2025-09-26T21:23:20.818810] [DEBUG] [LOCAL ] SPB: Trimmed 47476 records to 34677 (keeping 200 days of data) [2025-09-26T21:23:21.040832] [DEBUG] [LOCAL ] SPB: Primary data saved (34677 records). [2025-09-26T21:23:21.040977] [INFO ] [MAIN ] SPB: Full history saved. [2025-09-26T21:23:21.041108] [INFO ] [MAIN ] Update Progress: 1972/2371 symbols completed. SPB took 31.4s. Estimated remaining: 53m 16s. Rate: 7.5 symbols/min [2025-09-26T21:23:21.225258] [INFO ] [MAIN ] SPH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:23:21.250330] [DEBUG] [LOCAL ] SPH: Loaded 18140 existing records from primary storage. [2025-09-26T21:23:21.250462] [INFO ] [MAIN ] SPH: Loaded 18140 existing records. [2025-09-26T21:23:21.437174] [WARN ] [MAIN ] SPH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:23:21.437541] [INFO ] [MAIN ] SPH: Wiping existing primary data before full refresh. [2025-09-26T21:23:21.437595] [INFO ] [LOCAL ] SPH: Starting deletion of primary data. [2025-09-26T21:23:21.438689] [DEBUG] [LOCAL ] SPH: Deleted primary data file. [2025-09-26T21:23:21.438750] [INFO ] [MAIN ] SPH: Starting full primary refresh. [2025-09-26T21:23:21.512778] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-06. [2025-09-26T21:23:21.850497] [INFO ] [REMOTE ] SPH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:23:21.868124] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-26T21:23:22.152696] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-26T21:23:22.311728] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-02. [2025-09-26T21:23:23.111715] [INFO ] [REMOTE ] SPH: Fetching primary data for 2024-12. [2025-09-26T21:23:23.719959] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-26T21:23:23.911729] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-07. [2025-09-26T21:23:24.064285] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-26T21:23:24.164611] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-26T21:23:24.711716] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-03. [2025-09-26T21:23:25.511722] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-01. [2025-09-26T21:23:25.964581] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-26T21:23:26.311690] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-03. [2025-09-26T21:23:26.578997] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-26T21:23:26.637787] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-26T21:23:27.111727] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-04. [2025-09-26T21:23:27.911696] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-08. [2025-09-26T21:23:28.330075] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-26T21:23:28.711748] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-04. [2025-09-26T21:23:29.025180] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-26T21:23:29.511741] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-02. [2025-09-26T21:23:30.101297] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-26T21:23:30.311714] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-09. [2025-09-26T21:23:30.656611] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-26T21:23:30.731803] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-26T21:23:31.111747] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-05. [2025-09-26T21:23:31.911753] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-03. [2025-09-26T21:23:32.343469] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-26T21:23:32.356007] [INFO ] [REMOTE ] SPCE: Full fetch complete (72277 records). [2025-09-26T21:23:32.356182] [DEBUG] [VALIDATOR ] SPCE: Validating primary data. [2025-09-26T21:23:32.713727] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-05. [2025-09-26T21:23:32.805024] [DEBUG] [VALIDATOR ] SPCE: All expected trading days are present. [2025-09-26T21:23:32.805526] [DEBUG] [VALIDATOR ] SPCE: Primary data validation passed. [2025-09-26T21:23:32.806809] [INFO ] [MAIN ] SPCE: Fetched primary data is valid. [2025-09-26T21:23:32.806947] [DEBUG] [LOCAL ] SPCE: Saving primary data. [2025-09-26T21:23:32.809171] [DEBUG] [LOCAL ] SPCE: Trimmed 72277 records to 50615 (keeping 200 days of data) [2025-09-26T21:23:32.836258] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-26T21:23:33.169849] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-26T21:23:33.188270] [DEBUG] [LOCAL ] SPCE: Primary data saved (50615 records). [2025-09-26T21:23:33.188437] [INFO ] [MAIN ] SPCE: Full history saved. [2025-09-26T21:23:33.188576] [INFO ] [MAIN ] Update Progress: 1973/2371 symbols completed. SPCE took 42.1s. Estimated remaining: 53m 9s. Rate: 7.5 symbols/min [2025-09-26T21:23:33.382572] [INFO ] [MAIN ] SPHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:23:33.432123] [DEBUG] [LOCAL ] SPHR: Loaded 40404 existing records from primary storage. [2025-09-26T21:23:33.432284] [INFO ] [MAIN ] SPHR: Loaded 40404 existing records. [2025-09-26T21:23:33.517341] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-04. [2025-09-26T21:23:33.657867] [WARN ] [MAIN ] SPHR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:23:33.658185] [INFO ] [MAIN ] SPHR: Wiping existing primary data before full refresh. [2025-09-26T21:23:33.658267] [INFO ] [LOCAL ] SPHR: Starting deletion of primary data. [2025-09-26T21:23:33.659426] [DEBUG] [LOCAL ] SPHR: Deleted primary data file. [2025-09-26T21:23:33.659497] [INFO ] [MAIN ] SPHR: Starting full primary refresh. [2025-09-26T21:23:34.163177] [INFO ] [REMOTE ] SPHR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:23:34.311759] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2024-12. [2025-09-26T21:23:34.571210] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-26T21:23:35.090336] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-26T21:23:35.111677] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-06. [2025-09-26T21:23:35.732242] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-26T21:23:35.911703] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-01. [2025-09-26T21:23:36.711767] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-06. [2025-09-26T21:23:36.915362] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-26T21:23:36.993926] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-26T21:23:37.511751] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-07. [2025-09-26T21:23:38.311717] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-02. [2025-09-26T21:23:38.380337] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-26T21:23:39.111752] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-05. [2025-09-26T21:23:39.301384] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-26T21:23:39.720875] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-26T21:23:39.911700] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-03. [2025-09-26T21:23:40.197976] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-26T21:23:40.711776] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-07. [2025-09-26T21:23:41.428803] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-26T21:23:41.511754] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-08. [2025-09-26T21:23:42.311711] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-06. [2025-09-26T21:23:42.491069] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-26T21:23:43.111709] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-08. [2025-09-26T21:23:43.356733] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-26T21:23:43.472331] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-26T21:23:43.911744] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-09. [2025-09-26T21:23:44.626379] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-26T21:23:44.711698] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-09. [2025-09-26T21:23:45.511698] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-07. [2025-09-26T21:23:45.904371] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-26T21:23:45.914458] [INFO ] [REMOTE ] SPG: Full fetch complete (72052 records). [2025-09-26T21:23:45.914637] [DEBUG] [VALIDATOR ] SPG: Validating primary data. [2025-09-26T21:23:46.318937] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-04. [2025-09-26T21:23:46.337614] [DEBUG] [VALIDATOR ] SPG: All expected trading days are present. [2025-09-26T21:23:46.338692] [DEBUG] [VALIDATOR ] SPG: Primary data validation passed. [2025-09-26T21:23:46.340048] [INFO ] [MAIN ] SPG: Fetched primary data is valid. [2025-09-26T21:23:46.340339] [DEBUG] [LOCAL ] SPG: Saving primary data. [2025-09-26T21:23:46.342152] [DEBUG] [LOCAL ] SPG: Trimmed 72052 records to 51134 (keeping 200 days of data) [2025-09-26T21:23:46.663750] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-26T21:23:46.672457] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-26T21:23:46.686279] [INFO ] [REMOTE ] SPGI: Full fetch complete (66648 records). [2025-09-26T21:23:46.687706] [DEBUG] [VALIDATOR ] SPGI: Validating primary data. [2025-09-26T21:23:47.115983] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-08. [2025-09-26T21:23:47.211935] [DEBUG] [VALIDATOR ] SPGI: All expected trading days are present. [2025-09-26T21:23:47.212682] [DEBUG] [VALIDATOR ] SPGI: Primary data validation passed. [2025-09-26T21:23:47.214025] [INFO ] [MAIN ] SPGI: Fetched primary data is valid. [2025-09-26T21:23:47.214398] [DEBUG] [LOCAL ] SPGI: Saving primary data. [2025-09-26T21:23:47.219239] [DEBUG] [LOCAL ] SPGI: Trimmed 66648 records to 46562 (keeping 200 days of data) [2025-09-26T21:23:47.221877] [DEBUG] [LOCAL ] SPG: Primary data saved (51134 records). [2025-09-26T21:23:47.222403] [INFO ] [MAIN ] SPG: Full history saved. [2025-09-26T21:23:47.225202] [INFO ] [MAIN ] Update Progress: 1974/2371 symbols completed. SPG took 34.5s. Estimated remaining: 53m 2s. Rate: 7.5 symbols/min [2025-09-26T21:23:47.551025] [INFO ] [MAIN ] SPIR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:23:47.712421] [DEBUG] [LOCAL ] SPIR: Loaded 37679 existing records from primary storage. [2025-09-26T21:23:47.713117] [INFO ] [MAIN ] SPIR: Loaded 37679 existing records. [2025-09-26T21:23:47.971025] [WARN ] [MAIN ] SPIR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:23:47.973168] [INFO ] [MAIN ] SPIR: Wiping existing primary data before full refresh. [2025-09-26T21:23:47.976076] [INFO ] [LOCAL ] SPIR: Starting deletion of primary data. [2025-09-26T21:23:47.979730] [DEBUG] [LOCAL ] SPIR: Deleted primary data file. [2025-09-26T21:23:47.980074] [INFO ] [MAIN ] SPIR: Starting full primary refresh. [2025-09-26T21:23:48.165456] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-26T21:23:48.185142] [DEBUG] [LOCAL ] SPGI: Primary data saved (46562 records). [2025-09-26T21:23:48.207933] [INFO ] [MAIN ] SPGI: Full history saved. [2025-09-26T21:23:48.208238] [INFO ] [MAIN ] Update Progress: 1975/2371 symbols completed. SPGI took 33.9s. Estimated remaining: 52m 53s. Rate: 7.5 symbols/min [2025-09-26T21:23:48.224525] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-05. [2025-09-26T21:23:48.254191] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-26T21:23:48.653900] [INFO ] [MAIN ] SPMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:23:48.689919] [INFO ] [REMOTE ] SPIR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:23:48.696278] [DEBUG] [LOCAL ] SPMC: Loaded 5577 existing records from primary storage. [2025-09-26T21:23:48.696444] [INFO ] [MAIN ] SPMC: Loaded 5577 existing records. [2025-09-26T21:23:48.717904] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-09. [2025-09-26T21:23:48.895023] [WARN ] [MAIN ] SPMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:23:48.895383] [INFO ] [MAIN ] SPMC: Wiping existing primary data before full refresh. [2025-09-26T21:23:48.895459] [INFO ] [LOCAL ] SPMC: Starting deletion of primary data. [2025-09-26T21:23:48.895852] [DEBUG] [LOCAL ] SPMC: Deleted primary data file. [2025-09-26T21:23:48.895917] [INFO ] [MAIN ] SPMC: Starting full primary refresh. [2025-09-26T21:23:49.286918] [INFO ] [REMOTE ] SPMC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:23:49.511733] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2024-12. [2025-09-26T21:23:49.784308] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-26T21:23:49.794405] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-26T21:23:49.807406] [INFO ] [REMOTE ] SPH: Full fetch complete (28459 records). [2025-09-26T21:23:49.807719] [DEBUG] [VALIDATOR ] SPH: Validating primary data. [2025-09-26T21:23:50.208159] [DEBUG] [VALIDATOR ] SPH: All expected trading days are present. [2025-09-26T21:23:50.208267] [DEBUG] [VALIDATOR ] SPH: Primary data validation passed. [2025-09-26T21:23:50.209090] [INFO ] [MAIN ] SPH: Fetched primary data is valid. [2025-09-26T21:23:50.209157] [DEBUG] [LOCAL ] SPH: Saving primary data. [2025-09-26T21:23:50.210095] [DEBUG] [LOCAL ] SPH: Trimmed 28459 records to 18213 (keeping 200 days of data) [2025-09-26T21:23:50.311763] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2024-12. [2025-09-26T21:23:50.339662] [DEBUG] [LOCAL ] SPH: Primary data saved (18213 records). [2025-09-26T21:23:50.339978] [INFO ] [MAIN ] SPH: Full history saved. [2025-09-26T21:23:50.340279] [INFO ] [MAIN ] Update Progress: 1976/2371 symbols completed. SPH took 29.3s. Estimated remaining: 52m 44s. Rate: 7.5 symbols/min [2025-09-26T21:23:50.541021] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-26T21:23:50.545518] [INFO ] [MAIN ] SPME: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:23:50.552706] [DEBUG] [LOCAL ] SPME: No existing data file found in primary storage. [2025-09-26T21:23:50.552789] [WARN ] [MAIN ] SPME: No existing data found, performing full refresh instead. [2025-09-26T21:23:50.552975] [INFO ] [MAIN ] SPME: Wiping existing primary data before full refresh. [2025-09-26T21:23:50.553028] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-09-26T21:23:50.553093] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-09-26T21:23:50.553166] [INFO ] [MAIN ] SPME: Starting full primary refresh. [2025-09-26T21:23:50.939997] [INFO ] [REMOTE ] SPME: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:23:51.014194] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-26T21:23:51.111724] [INFO ] [REMOTE ] SPME: Fetching primary data for 2024-12. [2025-09-26T21:23:51.310357] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:23:51.310765] [WARN ] [REMOTE ] SPME: No data returned for month 2024-12 [2025-09-26T21:23:51.911736] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-06. [2025-09-26T21:23:52.711739] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-01. [2025-09-26T21:23:52.905518] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:23:52.905922] [WARN ] [REMOTE ] SPME: No data returned for month 2025-01 [2025-09-26T21:23:53.296112] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-26T21:23:53.511766] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-02. [2025-09-26T21:23:53.702479] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:23:53.702884] [WARN ] [REMOTE ] SPME: No data returned for month 2025-02 [2025-09-26T21:23:54.311724] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-07. [2025-09-26T21:23:55.111754] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-01. [2025-09-26T21:23:55.677666] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-26T21:23:55.911722] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-03. [2025-09-26T21:23:55.959014] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-26T21:23:56.111946] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:23:56.112305] [WARN ] [REMOTE ] SPME: No data returned for month 2025-03 [2025-09-26T21:23:56.711715] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-08. [2025-09-26T21:23:57.511765] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-02. [2025-09-26T21:23:58.207962] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-26T21:23:58.240375] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-26T21:23:58.311725] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-03. [2025-09-26T21:23:59.030758] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-26T21:23:59.111737] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-09. [2025-09-26T21:23:59.911726] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-04. [2025-09-26T21:24:00.111142] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:24:00.111491] [WARN ] [REMOTE ] SPME: No data returned for month 2025-04 [2025-09-26T21:24:00.711703] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-05. [2025-09-26T21:24:00.933468] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:24:00.933867] [WARN ] [REMOTE ] SPME: No data returned for month 2025-05 [2025-09-26T21:24:00.960963] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-26T21:24:00.970590] [INFO ] [REMOTE ] SPHR: Full fetch complete (57579 records). [2025-09-26T21:24:00.970810] [DEBUG] [VALIDATOR ] SPHR: Validating primary data. [2025-09-26T21:24:01.399183] [DEBUG] [VALIDATOR ] SPHR: All expected trading days are present. [2025-09-26T21:24:01.399279] [DEBUG] [VALIDATOR ] SPHR: Primary data validation passed. [2025-09-26T21:24:01.400171] [INFO ] [MAIN ] SPHR: Fetched primary data is valid. [2025-09-26T21:24:01.400236] [DEBUG] [LOCAL ] SPHR: Saving primary data. [2025-09-26T21:24:01.401570] [DEBUG] [LOCAL ] SPHR: Trimmed 57579 records to 40745 (keeping 200 days of data) [2025-09-26T21:24:01.511733] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-06. [2025-09-26T21:24:01.640697] [DEBUG] [LOCAL ] SPHR: Primary data saved (40745 records). [2025-09-26T21:24:01.640836] [INFO ] [MAIN ] SPHR: Full history saved. [2025-09-26T21:24:01.640952] [INFO ] [MAIN ] Update Progress: 1977/2371 symbols completed. SPHR took 28.5s. Estimated remaining: 52m 36s. Rate: 7.5 symbols/min [2025-09-26T21:24:01.799156] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:24:01.824943] [WARN ] [REMOTE ] SPME: No data returned for month 2025-06 [2025-09-26T21:24:01.828924] [INFO ] [MAIN ] SPNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:24:01.871718] [DEBUG] [LOCAL ] SPNT: Loaded 35119 existing records from primary storage. [2025-09-26T21:24:01.871910] [INFO ] [MAIN ] SPNT: Loaded 35119 existing records. [2025-09-26T21:24:02.064726] [WARN ] [MAIN ] SPNT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:24:02.065004] [INFO ] [MAIN ] SPNT: Wiping existing primary data before full refresh. [2025-09-26T21:24:02.065057] [INFO ] [LOCAL ] SPNT: Starting deletion of primary data. [2025-09-26T21:24:02.065910] [DEBUG] [LOCAL ] SPNT: Deleted primary data file. [2025-09-26T21:24:02.065973] [INFO ] [MAIN ] SPNT: Starting full primary refresh. [2025-09-26T21:24:02.316869] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-04. [2025-09-26T21:24:02.457408] [INFO ] [REMOTE ] SPNT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:24:03.111719] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2024-12. [2025-09-26T21:24:03.126583] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-26T21:24:03.911728] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-01. [2025-09-26T21:24:04.488976] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-26T21:24:04.711717] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-01. [2025-09-26T21:24:05.269388] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-26T21:24:05.511726] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-07. [2025-09-26T21:24:05.637487] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-26T21:24:05.943937] [INFO ] [REMOTE ] SPME: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-26T21:24:06.311716] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-08. [2025-09-26T21:24:06.724331] [INFO ] [REMOTE ] SPME: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-26T21:24:07.111726] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-02. [2025-09-26T21:24:07.911716] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-02. [2025-09-26T21:24:08.711703] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-05. [2025-09-26T21:24:08.798799] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-26T21:24:09.252365] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-26T21:24:09.376111] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-26T21:24:09.511729] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-06. [2025-09-26T21:24:10.115495] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-26T21:24:10.311722] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-07. [2025-09-26T21:24:10.905630] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-26T21:24:11.111723] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-03. [2025-09-26T21:24:11.911711] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-09. [2025-09-26T21:24:12.258143] [INFO ] [REMOTE ] SPME: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-26T21:24:12.259088] [INFO ] [REMOTE ] SPME: Full fetch complete (665 records). [2025-09-26T21:24:12.259189] [DEBUG] [VALIDATOR ] SPME: Validating primary data. [2025-09-26T21:24:12.481988] [WARN ] [VALIDATOR ] SPME: Validation failed - insufficient historical data. Have 50 unique days, need 200 days [2025-09-26T21:24:12.482224] [FATAL] [MAIN ] SPME: Fetched primary data is invalid. Refusing to save it. [2025-09-26T21:24:12.482297] [WARN ] [MAIN ] SPME: Deleting existing primary and derivative data due to validation failure. [2025-09-26T21:24:12.482375] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-09-26T21:24:12.482459] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-09-26T21:24:12.482517] [INFO ] [LOCAL ] SPME: Starting deletion of derivative data. [2025-09-26T21:24:12.482578] [DEBUG] [LOCAL ] SPME: No derivative data file found to delete. [2025-09-26T21:24:12.482686] [INFO ] [MAIN ] Update Progress: 1978/2371 symbols completed. SPME took 22.1s. Estimated remaining: 52m 29s. Rate: 7.5 symbols/min [2025-09-26T21:24:12.677615] [INFO ] [MAIN ] SPOT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:24:12.704169] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-26T21:24:12.713202] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-08. [2025-09-26T21:24:12.773202] [DEBUG] [LOCAL ] SPOT: Loaded 51178 existing records from primary storage. [2025-09-26T21:24:12.773363] [INFO ] [MAIN ] SPOT: Loaded 51178 existing records. [2025-09-26T21:24:12.980662] [WARN ] [MAIN ] SPOT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:24:12.980974] [INFO ] [MAIN ] SPOT: Wiping existing primary data before full refresh. [2025-09-26T21:24:12.981036] [INFO ] [LOCAL ] SPOT: Starting deletion of primary data. [2025-09-26T21:24:12.982489] [DEBUG] [LOCAL ] SPOT: Deleted primary data file. [2025-09-26T21:24:12.982585] [INFO ] [MAIN ] SPOT: Starting full primary refresh. [2025-09-26T21:24:13.372490] [INFO ] [REMOTE ] SPOT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:24:13.378056] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-26T21:24:13.511717] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2024-12. [2025-09-26T21:24:14.311735] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-09. [2025-09-26T21:24:14.900445] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-26T21:24:14.901976] [INFO ] [REMOTE ] SPMC: Full fetch complete (8164 records). [2025-09-26T21:24:14.902067] [DEBUG] [VALIDATOR ] SPMC: Validating primary data. [2025-09-26T21:24:15.117698] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-04. [2025-09-26T21:24:15.306622] [DEBUG] [VALIDATOR ] SPMC: All expected trading days are present. [2025-09-26T21:24:15.306772] [DEBUG] [VALIDATOR ] SPMC: Primary data validation passed. [2025-09-26T21:24:15.307004] [INFO ] [MAIN ] SPMC: Fetched primary data is valid. [2025-09-26T21:24:15.307046] [DEBUG] [LOCAL ] SPMC: Saving primary data. [2025-09-26T21:24:15.307490] [DEBUG] [LOCAL ] SPMC: Trimmed 8164 records to 5613 (keeping 200 days of data) [2025-09-26T21:24:15.343457] [DEBUG] [LOCAL ] SPMC: Primary data saved (5613 records). [2025-09-26T21:24:15.343602] [INFO ] [MAIN ] SPMC: Full history saved. [2025-09-26T21:24:15.343753] [INFO ] [MAIN ] Update Progress: 1979/2371 symbols completed. SPMC took 27.1s. Estimated remaining: 52m 20s. Rate: 7.5 symbols/min [2025-09-26T21:24:15.530354] [INFO ] [MAIN ] SPR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:24:15.574555] [DEBUG] [LOCAL ] SPR: Loaded 41539 existing records from primary storage. [2025-09-26T21:24:15.574732] [INFO ] [MAIN ] SPR: Loaded 41539 existing records. [2025-09-26T21:24:15.769720] [WARN ] [MAIN ] SPR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:24:15.770277] [INFO ] [MAIN ] SPR: Wiping existing primary data before full refresh. [2025-09-26T21:24:15.770434] [INFO ] [LOCAL ] SPR: Starting deletion of primary data. [2025-09-26T21:24:15.781291] [DEBUG] [LOCAL ] SPR: Deleted primary data file. [2025-09-26T21:24:15.788666] [INFO ] [MAIN ] SPR: Starting full primary refresh. [2025-09-26T21:24:15.847862] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-09-26T21:24:15.917781] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-03. [2025-09-26T21:24:16.184154] [INFO ] [REMOTE ] SPR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:24:16.711721] [INFO ] [REMOTE ] SPR: Fetching primary data for 2024-12. [2025-09-26T21:24:16.931393] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-26T21:24:17.401534] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-26T21:24:17.511747] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-05. [2025-09-26T21:24:18.275173] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-26T21:24:18.311688] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-01. [2025-09-26T21:24:18.950822] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-26T21:24:19.111722] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-04. [2025-09-26T21:24:19.561818] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-26T21:24:19.911722] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-06. [2025-09-26T21:24:20.544018] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-26T21:24:20.711739] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-05. [2025-09-26T21:24:21.457331] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T21:24:21.511719] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-02. [2025-09-26T21:24:22.186615] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T21:24:22.311716] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-01. [2025-09-26T21:24:22.936007] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-26T21:24:23.111722] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-06. [2025-09-26T21:24:23.911719] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-03. [2025-09-26T21:24:24.479763] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-26T21:24:24.530010] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-09-26T21:24:24.711735] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-02. [2025-09-26T21:24:25.511696] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-07. [2025-09-26T21:24:25.678302] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-26T21:24:26.311745] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-07. [2025-09-26T21:24:27.001873] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-26T21:24:27.062422] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-26T21:24:27.111777] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-03. [2025-09-26T21:24:27.805393] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-26T21:24:27.911741] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-04. [2025-09-26T21:24:28.711726] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-08. [2025-09-26T21:24:29.511719] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-08. [2025-09-26T21:24:29.571062] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-09-26T21:24:29.618914] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-26T21:24:30.296550] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-26T21:24:30.311660] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-09. [2025-09-26T21:24:30.948214] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-26T21:24:31.111709] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-09. [2025-09-26T21:24:31.720107] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-26T21:24:31.727551] [INFO ] [REMOTE ] SPIR: Full fetch complete (52417 records). [2025-09-26T21:24:31.727738] [DEBUG] [VALIDATOR ] SPIR: Validating primary data. [2025-09-26T21:24:31.927184] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-05. [2025-09-26T21:24:32.161386] [DEBUG] [VALIDATOR ] SPIR: All expected trading days are present. [2025-09-26T21:24:32.161543] [DEBUG] [VALIDATOR ] SPIR: Primary data validation passed. [2025-09-26T21:24:32.162634] [INFO ] [MAIN ] SPIR: Fetched primary data is valid. [2025-09-26T21:24:32.162734] [DEBUG] [LOCAL ] SPIR: Saving primary data. [2025-09-26T21:24:32.164066] [DEBUG] [LOCAL ] SPIR: Trimmed 52417 records to 37871 (keeping 200 days of data) [2025-09-26T21:24:32.410702] [DEBUG] [LOCAL ] SPIR: Primary data saved (37871 records). [2025-09-26T21:24:32.410871] [INFO ] [MAIN ] SPIR: Full history saved. [2025-09-26T21:24:32.410989] [INFO ] [MAIN ] Update Progress: 1980/2371 symbols completed. SPIR took 45.2s. Estimated remaining: 52m 14s. Rate: 7.5 symbols/min [2025-09-26T21:24:32.601172] [INFO ] [MAIN ] SPRU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:24:32.623593] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-26T21:24:32.634785] [INFO ] [REMOTE ] SPNT: Full fetch complete (48915 records). [2025-09-26T21:24:32.634955] [DEBUG] [VALIDATOR ] SPNT: Validating primary data. [2025-09-26T21:24:32.687339] [DEBUG] [LOCAL ] SPRU: Loaded 8554 existing records from primary storage. [2025-09-26T21:24:32.723488] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-04. [2025-09-26T21:24:32.723683] [INFO ] [MAIN ] SPRU: Loaded 8554 existing records. [2025-09-26T21:24:33.120390] [WARN ] [MAIN ] SPRU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:24:33.164121] [INFO ] [MAIN ] SPRU: Wiping existing primary data before full refresh. [2025-09-26T21:24:33.177189] [INFO ] [LOCAL ] SPRU: Starting deletion of primary data. [2025-09-26T21:24:33.183085] [DEBUG] [LOCAL ] SPRU: Deleted primary data file. [2025-09-26T21:24:33.198694] [INFO ] [MAIN ] SPRU: Starting full primary refresh. [2025-09-26T21:24:33.358333] [DEBUG] [VALIDATOR ] SPNT: All expected trading days are present. [2025-09-26T21:24:33.376669] [DEBUG] [VALIDATOR ] SPNT: Primary data validation passed. [2025-09-26T21:24:33.388213] [INFO ] [MAIN ] SPNT: Fetched primary data is valid. [2025-09-26T21:24:33.393608] [DEBUG] [LOCAL ] SPNT: Saving primary data. [2025-09-26T21:24:33.451829] [DEBUG] [LOCAL ] SPNT: Trimmed 48915 records to 35342 (keeping 200 days of data) [2025-09-26T21:24:33.857268] [INFO ] [REMOTE ] SPRU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:24:33.873190] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2024-12. [2025-09-26T21:24:33.879384] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-26T21:24:34.005266] [DEBUG] [LOCAL ] SPNT: Primary data saved (35342 records). [2025-09-26T21:24:34.005430] [INFO ] [MAIN ] SPNT: Full history saved. [2025-09-26T21:24:34.005521] [INFO ] [MAIN ] Update Progress: 1981/2371 symbols completed. SPNT took 32.4s. Estimated remaining: 52m 5s. Rate: 7.5 symbols/min [2025-09-26T21:24:34.182786] [INFO ] [MAIN ] SPXC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:24:34.208122] [DEBUG] [LOCAL ] SPXC: Loaded 23521 existing records from primary storage. [2025-09-26T21:24:34.208271] [INFO ] [MAIN ] SPXC: Loaded 23521 existing records. [2025-09-26T21:24:34.319484] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-06. [2025-09-26T21:24:34.420558] [WARN ] [MAIN ] SPXC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:24:34.420831] [INFO ] [MAIN ] SPXC: Wiping existing primary data before full refresh. [2025-09-26T21:24:34.420882] [INFO ] [LOCAL ] SPXC: Starting deletion of primary data. [2025-09-26T21:24:34.421633] [DEBUG] [LOCAL ] SPXC: Deleted primary data file. [2025-09-26T21:24:34.421744] [INFO ] [MAIN ] SPXC: Starting full primary refresh. [2025-09-26T21:24:34.799811] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-26T21:24:34.867768] [INFO ] [REMOTE ] SPXC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:24:35.111740] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-01. [2025-09-26T21:24:35.326990] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-09-26T21:24:35.726151] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-26T21:24:35.858077] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-26T21:24:35.911728] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-07. [2025-09-26T21:24:36.711748] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-02. [2025-09-26T21:24:37.266911] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-26T21:24:37.442974] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-26T21:24:37.511724] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-03. [2025-09-26T21:24:38.094901] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-26T21:24:38.311727] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-05. [2025-09-26T21:24:39.111728] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-04. [2025-09-26T21:24:39.828850] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-26T21:24:39.911739] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2024-12. [2025-09-26T21:24:40.654915] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-09-26T21:24:40.700568] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-26T21:24:40.711638] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-01. [2025-09-26T21:24:41.511761] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-05. [2025-09-26T21:24:41.938314] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-26T21:24:42.001078] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-26T21:24:42.311713] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-06. [2025-09-26T21:24:43.111722] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-02. [2025-09-26T21:24:43.911695] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-06. [2025-09-26T21:24:44.313151] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-26T21:24:44.478275] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-26T21:24:44.586124] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-26T21:24:44.711732] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-08. [2025-09-26T21:24:45.511730] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-03. [2025-09-26T21:24:46.216305] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-26T21:24:46.311723] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-07. [2025-09-26T21:24:46.334408] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-26T21:24:47.111727] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-09. [2025-09-26T21:24:47.911726] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-07. [2025-09-26T21:24:48.554021] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-26T21:24:48.562607] [INFO ] [REMOTE ] SPR: Full fetch complete (60066 records). [2025-09-26T21:24:48.562808] [DEBUG] [VALIDATOR ] SPR: Validating primary data. [2025-09-26T21:24:48.719114] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-04. [2025-09-26T21:24:48.851139] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-26T21:24:49.028429] [DEBUG] [VALIDATOR ] SPR: All expected trading days are present. [2025-09-26T21:24:49.028639] [DEBUG] [VALIDATOR ] SPR: Primary data validation passed. [2025-09-26T21:24:49.029786] [INFO ] [MAIN ] SPR: Fetched primary data is valid. [2025-09-26T21:24:49.029882] [DEBUG] [LOCAL ] SPR: Saving primary data. [2025-09-26T21:24:49.033088] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-07 (2.72 seconds). [2025-09-26T21:24:49.046338] [DEBUG] [LOCAL ] SPR: Trimmed 60066 records to 41867 (keeping 200 days of data) [2025-09-26T21:24:49.307363] [DEBUG] [LOCAL ] SPR: Primary data saved (41867 records). [2025-09-26T21:24:49.307507] [INFO ] [MAIN ] SPR: Full history saved. [2025-09-26T21:24:49.307597] [INFO ] [MAIN ] Update Progress: 1982/2371 symbols completed. SPR took 34.0s. Estimated remaining: 51m 58s. Rate: 7.5 symbols/min [2025-09-26T21:24:49.482479] [INFO ] [MAIN ] SPXX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:24:49.493185] [DEBUG] [LOCAL ] SPXX: Loaded 9037 existing records from primary storage. [2025-09-26T21:24:49.493365] [INFO ] [MAIN ] SPXX: Loaded 9037 existing records. [2025-09-26T21:24:49.516909] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-08. [2025-09-26T21:24:49.687803] [WARN ] [MAIN ] SPXX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:24:49.688084] [INFO ] [MAIN ] SPXX: Wiping existing primary data before full refresh. [2025-09-26T21:24:49.688134] [INFO ] [LOCAL ] SPXX: Starting deletion of primary data. [2025-09-26T21:24:49.688547] [DEBUG] [LOCAL ] SPXX: Deleted primary data file. [2025-09-26T21:24:49.688609] [INFO ] [MAIN ] SPXX: Starting full primary refresh. [2025-09-26T21:24:50.072618] [INFO ] [REMOTE ] SPXX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:24:50.089686] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-26T21:24:50.311727] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-08. [2025-09-26T21:24:50.724828] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-26T21:24:51.111718] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-05. [2025-09-26T21:24:51.911687] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-09. [2025-09-26T21:24:52.152368] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-26T21:24:52.430847] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-26T21:24:52.711698] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2024-12. [2025-09-26T21:24:52.729908] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-26T21:24:52.732603] [INFO ] [REMOTE ] SPRU: Full fetch complete (11337 records). [2025-09-26T21:24:52.732708] [DEBUG] [VALIDATOR ] SPRU: Validating primary data. [2025-09-26T21:24:53.120910] [DEBUG] [VALIDATOR ] SPRU: All expected trading days are present. [2025-09-26T21:24:53.121001] [DEBUG] [VALIDATOR ] SPRU: Primary data validation passed. [2025-09-26T21:24:53.121336] [INFO ] [MAIN ] SPRU: Fetched primary data is valid. [2025-09-26T21:24:53.121397] [DEBUG] [LOCAL ] SPRU: Saving primary data. [2025-09-26T21:24:53.121946] [DEBUG] [LOCAL ] SPRU: Trimmed 11337 records to 8714 (keeping 200 days of data) [2025-09-26T21:24:53.171047] [DEBUG] [LOCAL ] SPRU: Primary data saved (8714 records). [2025-09-26T21:24:53.171226] [INFO ] [MAIN ] SPRU: Full history saved. [2025-09-26T21:24:53.171367] [INFO ] [MAIN ] Update Progress: 1983/2371 symbols completed. SPRU took 20.8s. Estimated remaining: 51m 49s. Rate: 7.5 symbols/min [2025-09-26T21:24:53.353701] [INFO ] [MAIN ] SQM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:24:53.412637] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-26T21:24:53.412394] [DEBUG] [LOCAL ] SQM: Loaded 48895 existing records from primary storage. [2025-09-26T21:24:53.412892] [INFO ] [MAIN ] SQM: Loaded 48895 existing records. [2025-09-26T21:24:53.519419] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-06. [2025-09-26T21:24:53.606126] [WARN ] [MAIN ] SQM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:24:53.606376] [INFO ] [MAIN ] SQM: Wiping existing primary data before full refresh. [2025-09-26T21:24:53.606456] [INFO ] [LOCAL ] SQM: Starting deletion of primary data. [2025-09-26T21:24:53.607621] [DEBUG] [LOCAL ] SQM: Deleted primary data file. [2025-09-26T21:24:53.607705] [INFO ] [MAIN ] SQM: Starting full primary refresh. [2025-09-26T21:24:54.025544] [INFO ] [REMOTE ] SQM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:24:54.311711] [INFO ] [REMOTE ] SQM: Fetching primary data for 2024-12. [2025-09-26T21:24:54.609177] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-26T21:24:55.111721] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-09. [2025-09-26T21:24:55.911729] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-07. [2025-09-26T21:24:55.980816] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-26T21:24:56.711968] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-01. [2025-09-26T21:24:57.155605] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-26T21:24:57.227610] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-26T21:24:57.237265] [INFO ] [REMOTE ] SPOT: Full fetch complete (73875 records). [2025-09-26T21:24:57.237425] [DEBUG] [VALIDATOR ] SPOT: Validating primary data. [2025-09-26T21:24:57.515683] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-08. [2025-09-26T21:24:57.523528] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-26T21:24:57.677460] [DEBUG] [VALIDATOR ] SPOT: All expected trading days are present. [2025-09-26T21:24:57.677569] [DEBUG] [VALIDATOR ] SPOT: Primary data validation passed. [2025-09-26T21:24:57.678725] [INFO ] [MAIN ] SPOT: Fetched primary data is valid. [2025-09-26T21:24:57.678848] [DEBUG] [LOCAL ] SPOT: Saving primary data. [2025-09-26T21:24:57.680509] [DEBUG] [LOCAL ] SPOT: Trimmed 73875 records to 51481 (keeping 200 days of data) [2025-09-26T21:24:58.008506] [DEBUG] [LOCAL ] SPOT: Primary data saved (51481 records). [2025-09-26T21:24:58.008678] [INFO ] [MAIN ] SPOT: Full history saved. [2025-09-26T21:24:58.008846] [INFO ] [MAIN ] Update Progress: 1984/2371 symbols completed. SPOT took 45.5s. Estimated remaining: 51m 40s. Rate: 7.5 symbols/min [2025-09-26T21:24:58.196802] [INFO ] [MAIN ] SQNS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:24:58.224781] [DEBUG] [LOCAL ] SQNS: Loaded 26181 existing records from primary storage. [2025-09-26T21:24:58.224952] [INFO ] [MAIN ] SQNS: Loaded 26181 existing records. [2025-09-26T21:24:58.320689] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-01. [2025-09-26T21:24:58.415563] [WARN ] [MAIN ] SQNS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:24:58.415872] [INFO ] [MAIN ] SQNS: Wiping existing primary data before full refresh. [2025-09-26T21:24:58.415922] [INFO ] [LOCAL ] SQNS: Starting deletion of primary data. [2025-09-26T21:24:58.416512] [DEBUG] [LOCAL ] SQNS: Deleted primary data file. [2025-09-26T21:24:58.416574] [INFO ] [MAIN ] SQNS: Starting full primary refresh. [2025-09-26T21:24:58.800957] [INFO ] [REMOTE ] SQNS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:24:58.887295] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-26T21:24:59.111748] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2024-12. [2025-09-26T21:24:59.911702] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-02. [2025-09-26T21:24:59.947596] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-26T21:25:00.070867] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-26T21:25:00.682309] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-26T21:25:00.711749] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-01. [2025-09-26T21:25:01.511685] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-03. [2025-09-26T21:25:01.744619] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-26T21:25:02.206296] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-26T21:25:02.311728] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-02. [2025-09-26T21:25:03.111733] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-09. [2025-09-26T21:25:03.151782] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-26T21:25:03.911684] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-03. [2025-09-26T21:25:04.255782] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-26T21:25:04.260694] [INFO ] [REMOTE ] SPXC: Full fetch complete (33936 records). [2025-09-26T21:25:04.260827] [DEBUG] [VALIDATOR ] SPXC: Validating primary data. [2025-09-26T21:25:04.671481] [DEBUG] [VALIDATOR ] SPXC: All expected trading days are present. [2025-09-26T21:25:04.679013] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-26T21:25:04.678752] [DEBUG] [VALIDATOR ] SPXC: Primary data validation passed. [2025-09-26T21:25:04.682721] [INFO ] [MAIN ] SPXC: Fetched primary data is valid. [2025-09-26T21:25:04.682803] [DEBUG] [LOCAL ] SPXC: Saving primary data. [2025-09-26T21:25:04.683607] [DEBUG] [LOCAL ] SPXC: Trimmed 33936 records to 23666 (keeping 200 days of data) [2025-09-26T21:25:04.734769] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-04. [2025-09-26T21:25:04.834661] [DEBUG] [LOCAL ] SPXC: Primary data saved (23666 records). [2025-09-26T21:25:04.834814] [INFO ] [MAIN ] SPXC: Full history saved. [2025-09-26T21:25:04.834939] [INFO ] [MAIN ] Update Progress: 1985/2371 symbols completed. SPXC took 30.8s. Estimated remaining: 51m 32s. Rate: 7.5 symbols/min [2025-09-26T21:25:05.022947] [INFO ] [MAIN ] SR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:25:05.061953] [DEBUG] [LOCAL ] SR: Loaded 33151 existing records from primary storage. [2025-09-26T21:25:05.062098] [INFO ] [MAIN ] SR: Loaded 33151 existing records. [2025-09-26T21:25:05.277759] [WARN ] [MAIN ] SR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:25:05.278186] [INFO ] [MAIN ] SR: Wiping existing primary data before full refresh. [2025-09-26T21:25:05.278275] [INFO ] [LOCAL ] SR: Starting deletion of primary data. [2025-09-26T21:25:05.279432] [DEBUG] [LOCAL ] SR: Deleted primary data file. [2025-09-26T21:25:05.279527] [INFO ] [MAIN ] SR: Starting full primary refresh. [2025-09-26T21:25:05.512098] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-04. [2025-09-26T21:25:05.603291] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-26T21:25:05.670626] [INFO ] [REMOTE ] SR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:25:06.311688] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-02. [2025-09-26T21:25:06.548279] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-26T21:25:07.111745] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-05. [2025-09-26T21:25:07.823437] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-26T21:25:07.839143] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-26T21:25:07.911727] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-05. [2025-09-26T21:25:08.612238] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-26T21:25:08.711720] [INFO ] [REMOTE ] SR: Fetching primary data for 2024-12. [2025-09-26T21:25:09.511720] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-03. [2025-09-26T21:25:10.011513] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-26T21:25:10.311719] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-01. [2025-09-26T21:25:11.111704] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-06. [2025-09-26T21:25:11.307702] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-26T21:25:11.362396] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-26T21:25:11.911710] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-04. [2025-09-26T21:25:12.189692] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-26T21:25:12.711718] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-02. [2025-09-26T21:25:13.517981] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-06. [2025-09-26T21:25:13.537885] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-26T21:25:14.050737] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-26T21:25:14.311755] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-07. [2025-09-26T21:25:14.323061] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-26T21:25:15.111731] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-03. [2025-09-26T21:25:15.911753] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-07. [2025-09-26T21:25:16.554077] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-26T21:25:16.592461] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-26T21:25:16.714544] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-04. [2025-09-26T21:25:16.715585] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-26T21:25:17.511726] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-05. [2025-09-26T21:25:18.237950] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T21:25:18.311710] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-08. [2025-09-26T21:25:19.096400] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-26T21:25:19.117756] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-09. [2025-09-26T21:25:19.132752] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-26T21:25:19.911794] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-08. [2025-09-26T21:25:20.155777] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-26T21:25:20.159026] [INFO ] [REMOTE ] SPXX: Full fetch complete (12542 records). [2025-09-26T21:25:20.159142] [DEBUG] [VALIDATOR ] SPXX: Validating primary data. [2025-09-26T21:25:20.599723] [DEBUG] [VALIDATOR ] SPXX: All expected trading days are present. [2025-09-26T21:25:20.599819] [DEBUG] [VALIDATOR ] SPXX: Primary data validation passed. [2025-09-26T21:25:20.600147] [INFO ] [MAIN ] SPXX: Fetched primary data is valid. [2025-09-26T21:25:20.600189] [DEBUG] [LOCAL ] SPXX: Saving primary data. [2025-09-26T21:25:20.600898] [DEBUG] [LOCAL ] SPXX: Trimmed 12542 records to 9166 (keeping 200 days of data) [2025-09-26T21:25:20.665129] [DEBUG] [LOCAL ] SPXX: Primary data saved (9166 records). [2025-09-26T21:25:20.665296] [INFO ] [MAIN ] SPXX: Full history saved. [2025-09-26T21:25:20.665396] [INFO ] [MAIN ] Update Progress: 1986/2371 symbols completed. SPXX took 31.4s. Estimated remaining: 51m 26s. Rate: 7.5 symbols/min [2025-09-26T21:25:20.716907] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-05. [2025-09-26T21:25:20.884772] [INFO ] [MAIN ] SRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:25:20.943123] [DEBUG] [LOCAL ] SRE: Loaded 53815 existing records from primary storage. [2025-09-26T21:25:20.943283] [INFO ] [MAIN ] SRE: Loaded 53815 existing records. [2025-09-26T21:25:21.141728] [WARN ] [MAIN ] SRE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:25:21.142005] [INFO ] [MAIN ] SRE: Wiping existing primary data before full refresh. [2025-09-26T21:25:21.142056] [INFO ] [LOCAL ] SRE: Starting deletion of primary data. [2025-09-26T21:25:21.143535] [DEBUG] [LOCAL ] SRE: Deleted primary data file. [2025-09-26T21:25:21.143600] [INFO ] [MAIN ] SRE: Starting full primary refresh. [2025-09-26T21:25:21.530723] [INFO ] [REMOTE ] SRE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:25:21.524209] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-06. [2025-09-26T21:25:21.933950] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-26T21:25:22.311696] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-09. [2025-09-26T21:25:22.406133] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-26T21:25:23.111717] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-06. [2025-09-26T21:25:23.284043] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-26T21:25:23.571136] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-26T21:25:23.578926] [INFO ] [REMOTE ] SQNS: Full fetch complete (31868 records). [2025-09-26T21:25:23.579063] [DEBUG] [VALIDATOR ] SQNS: Validating primary data. [2025-09-26T21:25:23.916877] [INFO ] [REMOTE ] SRE: Fetching primary data for 2024-12. [2025-09-26T21:25:23.985667] [DEBUG] [VALIDATOR ] SQNS: All expected trading days are present. [2025-09-26T21:25:23.985761] [DEBUG] [VALIDATOR ] SQNS: Primary data validation passed. [2025-09-26T21:25:23.986566] [INFO ] [MAIN ] SQNS: Fetched primary data is valid. [2025-09-26T21:25:23.986670] [DEBUG] [LOCAL ] SQNS: Saving primary data. [2025-09-26T21:25:23.987893] [DEBUG] [LOCAL ] SQNS: Trimmed 31868 records to 26307 (keeping 200 days of data) [2025-09-26T21:25:24.141801] [DEBUG] [LOCAL ] SQNS: Primary data saved (26307 records). [2025-09-26T21:25:24.141945] [INFO ] [MAIN ] SQNS: Full history saved. [2025-09-26T21:25:24.142057] [INFO ] [MAIN ] Update Progress: 1987/2371 symbols completed. SQNS took 26.1s. Estimated remaining: 51m 17s. Rate: 7.5 symbols/min [2025-09-26T21:25:24.322549] [INFO ] [MAIN ] SREA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:25:24.334741] [DEBUG] [LOCAL ] SREA: Loaded 10476 existing records from primary storage. [2025-09-26T21:25:24.334888] [INFO ] [MAIN ] SREA: Loaded 10476 existing records. [2025-09-26T21:25:24.536822] [WARN ] [MAIN ] SREA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:25:24.555127] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-26T21:25:24.554487] [INFO ] [MAIN ] SREA: Wiping existing primary data before full refresh. [2025-09-26T21:25:24.561227] [INFO ] [LOCAL ] SREA: Starting deletion of primary data. [2025-09-26T21:25:24.562294] [DEBUG] [LOCAL ] SREA: Deleted primary data file. [2025-09-26T21:25:24.562362] [INFO ] [MAIN ] SREA: Starting full primary refresh. [2025-09-26T21:25:24.722134] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-07. [2025-09-26T21:25:24.970730] [INFO ] [REMOTE ] SREA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:25:25.511715] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-07. [2025-09-26T21:25:25.781126] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-26T21:25:26.311695] [INFO ] [REMOTE ] SREA: Fetching primary data for 2024-12. [2025-09-26T21:25:26.553030] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-26T21:25:26.595180] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-26T21:25:27.111700] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-01. [2025-09-26T21:25:27.252497] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-26T21:25:27.911717] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-08. [2025-09-26T21:25:28.711705] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-08. [2025-09-26T21:25:28.896718] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-26T21:25:29.511761] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-02. [2025-09-26T21:25:29.735780] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-26T21:25:30.157558] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-26T21:25:30.311769] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-09. [2025-09-26T21:25:31.111731] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-09. [2025-09-26T21:25:31.168118] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-26T21:25:31.911702] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-03. [2025-09-26T21:25:32.151964] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-26T21:25:32.161805] [INFO ] [REMOTE ] SQM: Full fetch complete (68931 records). [2025-09-26T21:25:32.161969] [DEBUG] [VALIDATOR ] SQM: Validating primary data. [2025-09-26T21:25:32.664059] [DEBUG] [VALIDATOR ] SQM: All expected trading days are present. [2025-09-26T21:25:32.663886] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-26T21:25:32.664337] [DEBUG] [VALIDATOR ] SQM: Primary data validation passed. [2025-09-26T21:25:32.672616] [INFO ] [MAIN ] SQM: Fetched primary data is valid. [2025-09-26T21:25:32.672984] [DEBUG] [LOCAL ] SQM: Saving primary data. [2025-09-26T21:25:32.674082] [INFO ] [REMOTE ] SR: Full fetch complete (46145 records). [2025-09-26T21:25:32.674176] [DEBUG] [VALIDATOR ] SR: Validating primary data. [2025-09-26T21:25:32.722077] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-01. [2025-09-26T21:25:32.769756] [DEBUG] [LOCAL ] SQM: Trimmed 68931 records to 49278 (keeping 200 days of data) [2025-09-26T21:25:33.222312] [DEBUG] [VALIDATOR ] SR: All expected trading days are present. [2025-09-26T21:25:33.222424] [DEBUG] [VALIDATOR ] SR: Primary data validation passed. [2025-09-26T21:25:33.223930] [INFO ] [MAIN ] SR: Fetched primary data is valid. [2025-09-26T21:25:33.224855] [DEBUG] [LOCAL ] SR: Saving primary data. [2025-09-26T21:25:33.241147] [DEBUG] [LOCAL ] SR: Trimmed 46145 records to 33411 (keeping 200 days of data) [2025-09-26T21:25:33.642059] [DEBUG] [LOCAL ] SR: Primary data saved (33411 records). [2025-09-26T21:25:33.644230] [INFO ] [MAIN ] SR: Full history saved. [2025-09-26T21:25:33.644843] [INFO ] [MAIN ] Update Progress: 1988/2371 symbols completed. SR took 28.8s. Estimated remaining: 51m 9s. Rate: 7.5 symbols/min [2025-09-26T21:25:33.896926] [INFO ] [MAIN ] SRFM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:25:33.902100] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-26T21:25:33.910980] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-26T21:25:33.911519] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-02. [2025-09-26T21:25:33.927258] [DEBUG] [LOCAL ] SQM: Primary data saved (49278 records). [2025-09-26T21:25:33.928004] [INFO ] [MAIN ] SQM: Full history saved. [2025-09-26T21:25:33.928213] [INFO ] [MAIN ] Update Progress: 1989/2371 symbols completed. SQM took 40.8s. Estimated remaining: 50m 60s. Rate: 7.5 symbols/min [2025-09-26T21:25:34.141540] [DEBUG] [LOCAL ] SRFM: Loaded 36106 existing records from primary storage. [2025-09-26T21:25:34.143699] [INFO ] [MAIN ] SRG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:25:34.144015] [INFO ] [MAIN ] SRFM: Loaded 36106 existing records. [2025-09-26T21:25:34.321874] [DEBUG] [LOCAL ] SRG: Loaded 15726 existing records from primary storage. [2025-09-26T21:25:34.321043] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-04. [2025-09-26T21:25:34.335327] [INFO ] [MAIN ] SRG: Loaded 15726 existing records. [2025-09-26T21:25:34.377088] [WARN ] [MAIN ] SRFM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:25:34.443800] [INFO ] [MAIN ] SRFM: Wiping existing primary data before full refresh. [2025-09-26T21:25:34.461259] [INFO ] [LOCAL ] SRFM: Starting deletion of primary data. [2025-09-26T21:25:34.479368] [DEBUG] [LOCAL ] SRFM: Deleted primary data file. [2025-09-26T21:25:34.495030] [INFO ] [MAIN ] SRFM: Starting full primary refresh. [2025-09-26T21:25:34.614569] [WARN ] [MAIN ] SRG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:25:34.657214] [INFO ] [MAIN ] SRG: Wiping existing primary data before full refresh. [2025-09-26T21:25:34.678928] [INFO ] [LOCAL ] SRG: Starting deletion of primary data. [2025-09-26T21:25:34.687971] [DEBUG] [LOCAL ] SRG: Deleted primary data file. [2025-09-26T21:25:34.703622] [INFO ] [MAIN ] SRG: Starting full primary refresh. [2025-09-26T21:25:35.006189] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-26T21:25:35.117964] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-03. [2025-09-26T21:25:35.342937] [INFO ] [REMOTE ] SRFM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:25:35.470814] [INFO ] [REMOTE ] SRG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:25:35.911729] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2024-12. [2025-09-26T21:25:36.002897] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-26T21:25:36.411691] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-26T21:25:36.711740] [INFO ] [REMOTE ] SRG: Fetching primary data for 2024-12. [2025-09-26T21:25:36.823033] [DEBUG] [REMOTE ] SRG: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-09-26T21:25:36.823383] [WARN ] [REMOTE ] SRG: No data returned for month 2024-12 [2025-09-26T21:25:37.511721] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-04. [2025-09-26T21:25:37.637808] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-26T21:25:38.311715] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-05. [2025-09-26T21:25:38.328044] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-26T21:25:39.111748] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-01. [2025-09-26T21:25:39.911720] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-01. [2025-09-26T21:25:40.193700] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-26T21:25:40.244737] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-26T21:25:40.711695] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-05. [2025-09-26T21:25:40.953376] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-26T21:25:41.511741] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-02. [2025-09-26T21:25:41.632507] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-26T21:25:42.311739] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-02. [2025-09-26T21:25:42.493724] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-26T21:25:43.111788] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-06. [2025-09-26T21:25:43.326065] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-26T21:25:43.911746] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-06. [2025-09-26T21:25:44.632482] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-26T21:25:44.711701] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-07. [2025-09-26T21:25:44.884095] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-26T21:25:45.511448] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-26T21:25:45.512846] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-07. [2025-09-26T21:25:46.311741] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-03. [2025-09-26T21:25:47.111697] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-03. [2025-09-26T21:25:47.459535] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-26T21:25:47.531576] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-26T21:25:47.677556] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-26T21:25:47.911727] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-08. [2025-09-26T21:25:48.711746] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-04. [2025-09-26T21:25:49.511696] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-08. [2025-09-26T21:25:49.688070] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-26T21:25:49.953942] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-26T21:25:50.264472] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-26T21:25:50.311726] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-09. [2025-09-26T21:25:51.111757] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-09. [2025-09-26T21:25:51.837741] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-26T21:25:51.840882] [INFO ] [REMOTE ] SREA: Full fetch complete (15958 records). [2025-09-26T21:25:51.840958] [DEBUG] [VALIDATOR ] SREA: Validating primary data. [2025-09-26T21:25:51.915552] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-05. [2025-09-26T21:25:52.280289] [DEBUG] [VALIDATOR ] SREA: All expected trading days are present. [2025-09-26T21:25:52.305086] [DEBUG] [VALIDATOR ] SREA: Primary data validation passed. [2025-09-26T21:25:52.308607] [INFO ] [MAIN ] SREA: Fetched primary data is valid. [2025-09-26T21:25:52.308797] [DEBUG] [LOCAL ] SREA: Saving primary data. [2025-09-26T21:25:52.311122] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-26T21:25:52.322345] [DEBUG] [LOCAL ] SREA: Trimmed 15958 records to 10561 (keeping 200 days of data) [2025-09-26T21:25:52.323295] [INFO ] [REMOTE ] SRE: Full fetch complete (77290 records). [2025-09-26T21:25:52.323462] [DEBUG] [VALIDATOR ] SRE: Validating primary data. [2025-09-26T21:25:52.722853] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-04. [2025-09-26T21:25:52.726942] [DEBUG] [LOCAL ] SREA: Primary data saved (10561 records). [2025-09-26T21:25:52.732304] [INFO ] [MAIN ] SREA: Full history saved. [2025-09-26T21:25:52.732507] [INFO ] [MAIN ] Update Progress: 1990/2371 symbols completed. SREA took 28.6s. Estimated remaining: 50m 54s. Rate: 7.5 symbols/min [2025-09-26T21:25:52.963512] [DEBUG] [VALIDATOR ] SRE: All expected trading days are present. [2025-09-26T21:25:52.963839] [DEBUG] [VALIDATOR ] SRE: Primary data validation passed. [2025-09-26T21:25:52.965101] [INFO ] [MAIN ] SRE: Fetched primary data is valid. [2025-09-26T21:25:52.965244] [DEBUG] [LOCAL ] SRE: Saving primary data. [2025-09-26T21:25:53.043502] [INFO ] [MAIN ] SRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:25:53.049554] [DEBUG] [LOCAL ] SRE: Trimmed 77290 records to 54202 (keeping 200 days of data) [2025-09-26T21:25:53.061743] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-26T21:25:53.219371] [DEBUG] [LOCAL ] SRI: Loaded 27654 existing records from primary storage. [2025-09-26T21:25:53.220611] [INFO ] [MAIN ] SRI: Loaded 27654 existing records. [2025-09-26T21:25:53.516540] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-06. [2025-09-26T21:25:53.525013] [WARN ] [MAIN ] SRI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:25:53.527523] [INFO ] [MAIN ] SRI: Wiping existing primary data before full refresh. [2025-09-26T21:25:53.527931] [INFO ] [LOCAL ] SRI: Starting deletion of primary data. [2025-09-26T21:25:53.529683] [DEBUG] [LOCAL ] SRI: Deleted primary data file. [2025-09-26T21:25:53.529984] [INFO ] [MAIN ] SRI: Starting full primary refresh. [2025-09-26T21:25:53.930757] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-26T21:25:53.986681] [INFO ] [REMOTE ] SRI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:25:54.085804] [DEBUG] [LOCAL ] SRE: Primary data saved (54202 records). [2025-09-26T21:25:54.085953] [INFO ] [MAIN ] SRE: Full history saved. [2025-09-26T21:25:54.086043] [INFO ] [MAIN ] Update Progress: 1991/2371 symbols completed. SRE took 33.4s. Estimated remaining: 50m 44s. Rate: 7.5 symbols/min [2025-09-26T21:25:54.267507] [INFO ] [MAIN ] SRL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:25:54.267700] [DEBUG] [LOCAL ] SRL: No existing data file found in primary storage. [2025-09-26T21:25:54.267752] [WARN ] [MAIN ] SRL: No existing data found, performing full refresh instead. [2025-09-26T21:25:54.267899] [INFO ] [MAIN ] SRL: Wiping existing primary data before full refresh. [2025-09-26T21:25:54.267942] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-09-26T21:25:54.267984] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-09-26T21:25:54.268016] [INFO ] [MAIN ] SRL: Starting full primary refresh. [2025-09-26T21:25:54.316944] [INFO ] [REMOTE ] SRI: Fetching primary data for 2024-12. [2025-09-26T21:25:54.643251] [INFO ] [REMOTE ] SRL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:25:55.111717] [INFO ] [REMOTE ] SRL: Fetching primary data for 2024-12. [2025-09-26T21:25:55.319573] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-26T21:25:55.602957] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-26T21:25:55.777731] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-26T21:25:55.911734] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-01. [2025-09-26T21:25:56.711745] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-01. [2025-09-26T21:25:57.086900] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-26T21:25:57.306621] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-26T21:25:57.511722] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-07. [2025-09-26T21:25:58.311737] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-05. [2025-09-26T21:25:59.111714] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-02. [2025-09-26T21:25:59.288937] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-26T21:25:59.911711] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-02. [2025-09-26T21:26:00.154473] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-09-26T21:26:00.406792] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-26T21:26:00.545438] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-26T21:26:00.711723] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-03. [2025-09-26T21:26:01.074427] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-26T21:26:01.511750] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-04. [2025-09-26T21:26:01.881995] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-26T21:26:02.311743] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-05. [2025-09-26T21:26:02.758796] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-26T21:26:03.111734] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-03. [2025-09-26T21:26:03.911718] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-06. [2025-09-26T21:26:04.295206] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-26T21:26:04.513901] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-26T21:26:04.711725] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-08. [2025-09-26T21:26:05.511715] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-07. [2025-09-26T21:26:05.936287] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-26T21:26:06.311723] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-04. [2025-09-26T21:26:06.886173] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-26T21:26:07.111702] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-09. [2025-09-26T21:26:07.561116] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-26T21:26:07.911725] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-06. [2025-09-26T21:26:08.711739] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-08. [2025-09-26T21:26:08.758099] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-26T21:26:09.063183] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-26T21:26:09.164941] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-26T21:26:09.174668] [INFO ] [REMOTE ] SRFM: Full fetch complete (49154 records). [2025-09-26T21:26:09.174805] [DEBUG] [VALIDATOR ] SRFM: Validating primary data. [2025-09-26T21:26:09.516882] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-07. [2025-09-26T21:26:09.653497] [DEBUG] [VALIDATOR ] SRFM: All expected trading days are present. [2025-09-26T21:26:09.653591] [DEBUG] [VALIDATOR ] SRFM: Primary data validation passed. [2025-09-26T21:26:09.654674] [INFO ] [MAIN ] SRFM: Fetched primary data is valid. [2025-09-26T21:26:09.654745] [DEBUG] [LOCAL ] SRFM: Saving primary data. [2025-09-26T21:26:09.656031] [DEBUG] [LOCAL ] SRFM: Trimmed 49154 records to 36431 (keeping 200 days of data) [2025-09-26T21:26:09.874313] [DEBUG] [LOCAL ] SRFM: Primary data saved (36431 records). [2025-09-26T21:26:09.874464] [INFO ] [MAIN ] SRFM: Full history saved. [2025-09-26T21:26:09.874557] [INFO ] [MAIN ] Update Progress: 1992/2371 symbols completed. SRFM took 36.2s. Estimated remaining: 50m 38s. Rate: 7.5 symbols/min [2025-09-26T21:26:10.055980] [INFO ] [MAIN ] SRV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:26:10.067919] [DEBUG] [LOCAL ] SRV: Loaded 7583 existing records from primary storage. [2025-09-26T21:26:10.068066] [INFO ] [MAIN ] SRV: Loaded 7583 existing records. [2025-09-26T21:26:10.255894] [WARN ] [MAIN ] SRV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:26:10.256385] [INFO ] [MAIN ] SRV: Wiping existing primary data before full refresh. [2025-09-26T21:26:10.256437] [INFO ] [LOCAL ] SRV: Starting deletion of primary data. [2025-09-26T21:26:10.256825] [DEBUG] [LOCAL ] SRV: Deleted primary data file. [2025-09-26T21:26:10.256887] [INFO ] [MAIN ] SRV: Starting full primary refresh. [2025-09-26T21:26:10.322730] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-05. [2025-09-26T21:26:10.591621] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-26T21:26:10.650125] [INFO ] [REMOTE ] SRV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:26:11.111726] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-09. [2025-09-26T21:26:11.714378] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-26T21:26:11.715625] [INFO ] [REMOTE ] SRL: Full fetch complete (1966 records). [2025-09-26T21:26:11.715831] [DEBUG] [VALIDATOR ] SRL: Validating primary data. [2025-09-26T21:26:11.801721] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-26T21:26:11.925406] [INFO ] [REMOTE ] SRV: Fetching primary data for 2024-12. [2025-09-26T21:26:11.973732] [WARN ] [VALIDATOR ] SRL: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-26T21:26:11.973970] [FATAL] [MAIN ] SRL: Fetched primary data is invalid. Refusing to save it. [2025-09-26T21:26:11.974040] [WARN ] [MAIN ] SRL: Deleting existing primary and derivative data due to validation failure. [2025-09-26T21:26:11.974115] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-09-26T21:26:11.974183] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-09-26T21:26:11.974223] [INFO ] [LOCAL ] SRL: Starting deletion of derivative data. [2025-09-26T21:26:11.974284] [DEBUG] [LOCAL ] SRL: No derivative data file found to delete. [2025-09-26T21:26:11.974371] [INFO ] [MAIN ] Update Progress: 1993/2371 symbols completed. SRL took 17.9s. Estimated remaining: 50m 29s. Rate: 7.5 symbols/min [2025-09-26T21:26:12.152021] [INFO ] [MAIN ] SSB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:26:12.200484] [DEBUG] [LOCAL ] SSB: Loaded 43106 existing records from primary storage. [2025-09-26T21:26:12.200632] [INFO ] [MAIN ] SSB: Loaded 43106 existing records. [2025-09-26T21:26:12.395685] [WARN ] [MAIN ] SSB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:26:12.395977] [INFO ] [MAIN ] SSB: Wiping existing primary data before full refresh. [2025-09-26T21:26:12.396031] [INFO ] [LOCAL ] SSB: Starting deletion of primary data. [2025-09-26T21:26:12.397235] [DEBUG] [LOCAL ] SSB: Deleted primary data file. [2025-09-26T21:26:12.397297] [INFO ] [MAIN ] SSB: Starting full primary refresh. [2025-09-26T21:26:12.716884] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-06. [2025-09-26T21:26:12.778310] [INFO ] [REMOTE ] SSB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:26:12.826606] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-26T21:26:13.511744] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-08. [2025-09-26T21:26:13.992201] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-26T21:26:14.311700] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-07. [2025-09-26T21:26:14.541280] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-26T21:26:15.111738] [INFO ] [REMOTE ] SSB: Fetching primary data for 2024-12. [2025-09-26T21:26:15.670268] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-26T21:26:15.911740] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-08. [2025-09-26T21:26:16.711709] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-01. [2025-09-26T21:26:16.756167] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-26T21:26:16.831253] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-26T21:26:17.493083] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-26T21:26:17.511659] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-02. [2025-09-26T21:26:18.254360] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-26T21:26:18.311724] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-09. [2025-09-26T21:26:19.111718] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-01. [2025-09-26T21:26:19.297446] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-26T21:26:19.301422] [INFO ] [REMOTE ] SRG: Full fetch complete (21908 records). [2025-09-26T21:26:19.301501] [DEBUG] [VALIDATOR ] SRG: Validating primary data. [2025-09-26T21:26:19.495306] [WARN ] [VALIDATOR ] SRG: Validation failed - insufficient historical data. Have 184 unique days, need 200 days [2025-09-26T21:26:19.495701] [FATAL] [MAIN ] SRG: Fetched primary data is invalid. Refusing to save it. [2025-09-26T21:26:19.495775] [WARN ] [MAIN ] SRG: Deleting existing primary and derivative data due to validation failure. [2025-09-26T21:26:19.495848] [INFO ] [LOCAL ] SRG: Starting deletion of primary data. [2025-09-26T21:26:19.495919] [DEBUG] [LOCAL ] SRG: No primary data file found to delete. [2025-09-26T21:26:19.495958] [INFO ] [LOCAL ] SRG: Starting deletion of derivative data. [2025-09-26T21:26:19.496431] [DEBUG] [LOCAL ] SRG: Deleted derivative data file. [2025-09-26T21:26:19.496533] [INFO ] [MAIN ] Update Progress: 1994/2371 symbols completed. SRG took 45.6s. Estimated remaining: 50m 21s. Rate: 7.5 symbols/min [2025-09-26T21:26:19.677319] [INFO ] [MAIN ] SSD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:26:19.702489] [DEBUG] [LOCAL ] SSD: Loaded 22447 existing records from primary storage. [2025-09-26T21:26:19.702696] [INFO ] [MAIN ] SSD: Loaded 22447 existing records. [2025-09-26T21:26:19.892246] [WARN ] [MAIN ] SSD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:26:19.892533] [INFO ] [MAIN ] SSD: Wiping existing primary data before full refresh. [2025-09-26T21:26:19.892587] [INFO ] [LOCAL ] SSD: Starting deletion of primary data. [2025-09-26T21:26:19.893177] [DEBUG] [LOCAL ] SSD: Deleted primary data file. [2025-09-26T21:26:19.893237] [INFO ] [MAIN ] SSD: Starting full primary refresh. [2025-09-26T21:26:19.916883] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-09. [2025-09-26T21:26:20.286119] [INFO ] [REMOTE ] SSD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:26:20.711682] [INFO ] [REMOTE ] SSD: Fetching primary data for 2024-12. [2025-09-26T21:26:20.751769] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-26T21:26:21.113563] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-26T21:26:21.118341] [INFO ] [REMOTE ] SRI: Full fetch complete (41610 records). [2025-09-26T21:26:21.118443] [DEBUG] [VALIDATOR ] SRI: Validating primary data. [2025-09-26T21:26:21.516017] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-03. [2025-09-26T21:26:21.517389] [DEBUG] [VALIDATOR ] SRI: All expected trading days are present. [2025-09-26T21:26:21.517448] [DEBUG] [VALIDATOR ] SRI: Primary data validation passed. [2025-09-26T21:26:21.518260] [INFO ] [MAIN ] SRI: Fetched primary data is valid. [2025-09-26T21:26:21.518432] [DEBUG] [LOCAL ] SRI: Saving primary data. [2025-09-26T21:26:21.520070] [DEBUG] [LOCAL ] SRI: Trimmed 41610 records to 27810 (keeping 200 days of data) [2025-09-26T21:26:21.691662] [DEBUG] [LOCAL ] SRI: Primary data saved (27810 records). [2025-09-26T21:26:21.691812] [INFO ] [MAIN ] SRI: Full history saved. [2025-09-26T21:26:21.691934] [INFO ] [MAIN ] Update Progress: 1995/2371 symbols completed. SRI took 29.0s. Estimated remaining: 50m 12s. Rate: 7.5 symbols/min [2025-09-26T21:26:21.876582] [INFO ] [MAIN ] SSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:26:21.903913] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-26T21:26:21.936388] [DEBUG] [LOCAL ] SSL: Loaded 41545 existing records from primary storage. [2025-09-26T21:26:21.936538] [INFO ] [MAIN ] SSL: Loaded 41545 existing records. [2025-09-26T21:26:22.135949] [WARN ] [MAIN ] SSL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:26:22.136228] [INFO ] [MAIN ] SSL: Wiping existing primary data before full refresh. [2025-09-26T21:26:22.136281] [INFO ] [LOCAL ] SSL: Starting deletion of primary data. [2025-09-26T21:26:22.137429] [DEBUG] [LOCAL ] SSL: Deleted primary data file. [2025-09-26T21:26:22.137494] [INFO ] [MAIN ] SSL: Starting full primary refresh. [2025-09-26T21:26:22.275414] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-26T21:26:22.316823] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-02. [2025-09-26T21:26:22.538138] [INFO ] [REMOTE ] SSL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:26:23.111729] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-04. [2025-09-26T21:26:23.856394] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-26T21:26:23.900086] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-26T21:26:23.911668] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-05. [2025-09-26T21:26:24.644211] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-26T21:26:24.711769] [INFO ] [REMOTE ] SSL: Fetching primary data for 2024-12. [2025-09-26T21:26:25.511747] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-01. [2025-09-26T21:26:26.245014] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-26T21:26:26.311693] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-06. [2025-09-26T21:26:26.667152] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-26T21:26:27.084763] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-26T21:26:27.111675] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-07. [2025-09-26T21:26:27.853858] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-26T21:26:27.911675] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-08. [2025-09-26T21:26:28.708147] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-26T21:26:28.711735] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-01. [2025-09-26T21:26:29.511723] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-03. [2025-09-26T21:26:30.311693] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-02. [2025-09-26T21:26:30.374772] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-26T21:26:31.111696] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-09. [2025-09-26T21:26:31.146218] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-26T21:26:31.440462] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-26T21:26:31.892312] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-26T21:26:31.894229] [INFO ] [REMOTE ] SRV: Full fetch complete (11554 records). [2025-09-26T21:26:31.894411] [DEBUG] [VALIDATOR ] SRV: Validating primary data. [2025-09-26T21:26:31.917136] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-04. [2025-09-26T21:26:32.284921] [DEBUG] [VALIDATOR ] SRV: All expected trading days are present. [2025-09-26T21:26:32.285025] [DEBUG] [VALIDATOR ] SRV: Primary data validation passed. [2025-09-26T21:26:32.285343] [INFO ] [MAIN ] SRV: Fetched primary data is valid. [2025-09-26T21:26:32.285425] [DEBUG] [LOCAL ] SRV: Saving primary data. [2025-09-26T21:26:32.285965] [DEBUG] [LOCAL ] SRV: Trimmed 11554 records to 7631 (keeping 200 days of data) [2025-09-26T21:26:32.334926] [DEBUG] [LOCAL ] SRV: Primary data saved (7631 records). [2025-09-26T21:26:32.335045] [INFO ] [MAIN ] SRV: Full history saved. [2025-09-26T21:26:32.335150] [INFO ] [MAIN ] Update Progress: 1996/2371 symbols completed. SRV took 22.5s. Estimated remaining: 50m 4s. Rate: 7.5 symbols/min [2025-09-26T21:26:32.511264] [INFO ] [MAIN ] SST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:26:32.524710] [DEBUG] [LOCAL ] SST: Loaded 12151 existing records from primary storage. [2025-09-26T21:26:32.524835] [INFO ] [MAIN ] SST: Loaded 12151 existing records. [2025-09-26T21:26:32.709837] [WARN ] [MAIN ] SST: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:26:32.710093] [INFO ] [MAIN ] SST: Wiping existing primary data before full refresh. [2025-09-26T21:26:32.710140] [INFO ] [LOCAL ] SST: Starting deletion of primary data. [2025-09-26T21:26:32.710563] [DEBUG] [LOCAL ] SST: Deleted primary data file. [2025-09-26T21:26:32.710628] [INFO ] [MAIN ] SST: Starting full primary refresh. [2025-09-26T21:26:32.722307] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-03. [2025-09-26T21:26:33.107877] [INFO ] [REMOTE ] SST: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:26:33.511785] [INFO ] [REMOTE ] SST: Fetching primary data for 2024-12. [2025-09-26T21:26:33.727699] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-26T21:26:33.932202] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-26T21:26:34.110751] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-26T21:26:34.311741] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-01. [2025-09-26T21:26:35.111738] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-04. [2025-09-26T21:26:35.544748] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-26T21:26:35.911720] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-02. [2025-09-26T21:26:35.999595] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-26T21:26:36.711735] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-05. [2025-09-26T21:26:37.414037] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-26T21:26:37.478677] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-26T21:26:37.511693] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-03. [2025-09-26T21:26:38.311710] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-05. [2025-09-26T21:26:39.079934] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-26T21:26:39.111686] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-06. [2025-09-26T21:26:39.911723] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-04. [2025-09-26T21:26:40.049598] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-26T21:26:40.402126] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-26T21:26:40.711730] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-07. [2025-09-26T21:26:41.511751] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-06. [2025-09-26T21:26:41.545871] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-26T21:26:41.893476] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-26T21:26:42.311746] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-08. [2025-09-26T21:26:43.034759] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-26T21:26:43.111723] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-05. [2025-09-26T21:26:43.821237] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-26T21:26:43.911725] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-07. [2025-09-26T21:26:44.694234] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-26T21:26:44.711681] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-06. [2025-09-26T21:26:45.246695] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-26T21:26:45.511727] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-09. [2025-09-26T21:26:46.311726] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-08. [2025-09-26T21:26:46.352808] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-26T21:26:46.655935] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-26T21:26:46.661290] [INFO ] [REMOTE ] SSD: Full fetch complete (32337 records). [2025-09-26T21:26:46.661396] [DEBUG] [VALIDATOR ] SSD: Validating primary data. [2025-09-26T21:26:47.069021] [DEBUG] [VALIDATOR ] SSD: All expected trading days are present. [2025-09-26T21:26:47.069110] [DEBUG] [VALIDATOR ] SSD: Primary data validation passed. [2025-09-26T21:26:47.069797] [INFO ] [MAIN ] SSD: Fetched primary data is valid. [2025-09-26T21:26:47.069860] [DEBUG] [LOCAL ] SSD: Saving primary data. [2025-09-26T21:26:47.070625] [DEBUG] [LOCAL ] SSD: Trimmed 32337 records to 22631 (keeping 200 days of data) [2025-09-26T21:26:47.128691] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-07. [2025-09-26T21:26:47.223777] [DEBUG] [LOCAL ] SSD: Primary data saved (22631 records). [2025-09-26T21:26:47.223920] [INFO ] [MAIN ] SSD: Full history saved. [2025-09-26T21:26:47.224051] [INFO ] [MAIN ] Update Progress: 1997/2371 symbols completed. SSD took 27.7s. Estimated remaining: 49m 57s. Rate: 7.5 symbols/min [2025-09-26T21:26:47.913023] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-02. [2025-09-26T21:26:47.915744] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-26T21:26:48.711709] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-09. [2025-09-26T21:26:48.769693] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-26T21:26:48.800220] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-26T21:26:49.511737] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-03. [2025-09-26T21:26:50.304870] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-26T21:26:50.313808] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-08. [2025-09-26T21:26:50.316137] [INFO ] [REMOTE ] SSB: Full fetch complete (61078 records). [2025-09-26T21:26:50.316576] [DEBUG] [VALIDATOR ] SSB: Validating primary data. [2025-09-26T21:26:50.464766] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-26T21:26:50.757759] [DEBUG] [VALIDATOR ] SSB: All expected trading days are present. [2025-09-26T21:26:50.757854] [DEBUG] [VALIDATOR ] SSB: Primary data validation passed. [2025-09-26T21:26:50.758798] [INFO ] [MAIN ] SSB: Fetched primary data is valid. [2025-09-26T21:26:50.758863] [DEBUG] [LOCAL ] SSB: Saving primary data. [2025-09-26T21:26:50.760329] [DEBUG] [LOCAL ] SSB: Trimmed 61078 records to 43377 (keeping 200 days of data) [2025-09-26T21:26:51.046421] [DEBUG] [LOCAL ] SSB: Primary data saved (43377 records). [2025-09-26T21:26:51.046593] [INFO ] [MAIN ] SSB: Full history saved. [2025-09-26T21:26:51.047749] [INFO ] [MAIN ] Update Progress: 1998/2371 symbols completed. SSB took 39.1s. Estimated remaining: 49m 48s. Rate: 7.5 symbols/min [2025-09-26T21:26:51.111687] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-04. [2025-09-26T21:26:52.008177] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-26T21:26:52.027129] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-09. [2025-09-26T21:26:52.026691] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-26T21:26:52.711759] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-05. [2025-09-26T21:26:53.540866] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-26T21:26:53.544085] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-06. [2025-09-26T21:26:53.660048] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-26T21:26:53.668972] [INFO ] [REMOTE ] SSL: Full fetch complete (60257 records). [2025-09-26T21:26:53.669141] [DEBUG] [VALIDATOR ] SSL: Validating primary data. [2025-09-26T21:26:54.072972] [DEBUG] [VALIDATOR ] SSL: All expected trading days are present. [2025-09-26T21:26:54.073067] [DEBUG] [VALIDATOR ] SSL: Primary data validation passed. [2025-09-26T21:26:54.074000] [INFO ] [MAIN ] SSL: Fetched primary data is valid. [2025-09-26T21:26:54.074064] [DEBUG] [LOCAL ] SSL: Saving primary data. [2025-09-26T21:26:54.075529] [DEBUG] [LOCAL ] SSL: Trimmed 60257 records to 41830 (keeping 200 days of data) [2025-09-26T21:26:54.319213] [DEBUG] [LOCAL ] SSL: Primary data saved (41830 records). [2025-09-26T21:26:54.319379] [INFO ] [MAIN ] SSL: Full history saved. [2025-09-26T21:26:54.319498] [INFO ] [MAIN ] Update Progress: 1999/2371 symbols completed. SSL took 32.6s. Estimated remaining: 49m 40s. Rate: 7.5 symbols/min [2025-09-26T21:26:54.383374] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-26T21:26:54.388710] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-07. [2025-09-26T21:26:55.272617] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-26T21:26:55.276367] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-08. [2025-09-26T21:26:56.060482] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-26T21:26:56.063874] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-09. [2025-09-26T21:26:56.716361] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-26T21:26:56.718378] [INFO ] [REMOTE ] SST: Full fetch complete (18998 records). [2025-09-26T21:26:56.718455] [DEBUG] [VALIDATOR ] SST: Validating primary data. [2025-09-26T21:26:57.108253] [DEBUG] [VALIDATOR ] SST: All expected trading days are present. [2025-09-26T21:26:57.108388] [DEBUG] [VALIDATOR ] SST: Primary data validation passed. [2025-09-26T21:26:57.108874] [INFO ] [MAIN ] SST: Fetched primary data is valid. [2025-09-26T21:26:57.108937] [DEBUG] [LOCAL ] SST: Saving primary data. [2025-09-26T21:26:57.109511] [DEBUG] [LOCAL ] SST: Trimmed 18998 records to 12166 (keeping 200 days of data) [2025-09-26T21:26:57.180586] [DEBUG] [LOCAL ] SST: Primary data saved (12166 records). [2025-09-26T21:26:57.180750] [INFO ] [MAIN ] SST: Full history saved. [2025-09-26T21:26:57.180846] [INFO ] [MAIN ] Update Progress: 2000/2371 symbols completed. SST took 24.8s. Estimated remaining: 49m 31s. Rate: 7.5 symbols/min [2025-09-26T21:26:57.807587] [INFO ] [MAIN ] STC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:26:57.793976] [INFO ] [MAIN ] STAG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:26:57.902878] [INFO ] [MAIN ] SSTK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:26:57.930221] [INFO ] [MAIN ] ST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:26:57.949490] [DEBUG] [LOCAL ] STC: Loaded 17792 existing records from primary storage. [2025-09-26T21:26:57.958621] [INFO ] [MAIN ] STC: Loaded 17792 existing records. [2025-09-26T21:26:58.100384] [DEBUG] [LOCAL ] SSTK: Loaded 26638 existing records from primary storage. [2025-09-26T21:26:58.143624] [INFO ] [MAIN ] SSTK: Loaded 26638 existing records. [2025-09-26T21:26:58.237258] [WARN ] [MAIN ] STC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:26:58.290806] [INFO ] [MAIN ] STC: Wiping existing primary data before full refresh. [2025-09-26T21:26:58.291554] [DEBUG] [LOCAL ] STAG: Loaded 50416 existing records from primary storage. [2025-09-26T21:26:58.302785] [INFO ] [LOCAL ] STC: Starting deletion of primary data. [2025-09-26T21:26:58.308020] [INFO ] [MAIN ] STAG: Loaded 50416 existing records. [2025-09-26T21:26:58.302632] [DEBUG] [LOCAL ] ST: Loaded 50150 existing records from primary storage. [2025-09-26T21:26:58.326905] [DEBUG] [LOCAL ] STC: Deleted primary data file. [2025-09-26T21:26:58.335878] [INFO ] [MAIN ] ST: Loaded 50150 existing records. [2025-09-26T21:26:58.342260] [INFO ] [MAIN ] STC: Starting full primary refresh. [2025-09-26T21:26:58.675283] [WARN ] [MAIN ] SSTK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:26:58.772388] [INFO ] [MAIN ] SSTK: Wiping existing primary data before full refresh. [2025-09-26T21:26:58.798564] [INFO ] [LOCAL ] SSTK: Starting deletion of primary data. [2025-09-26T21:26:58.835721] [DEBUG] [LOCAL ] SSTK: Deleted primary data file. [2025-09-26T21:26:58.887860] [INFO ] [MAIN ] SSTK: Starting full primary refresh. [2025-09-26T21:26:59.084704] [WARN ] [MAIN ] STAG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:26:59.141783] [INFO ] [MAIN ] STAG: Wiping existing primary data before full refresh. [2025-09-26T21:26:59.180463] [INFO ] [LOCAL ] STAG: Starting deletion of primary data. [2025-09-26T21:26:59.289941] [WARN ] [MAIN ] ST: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:26:59.327447] [INFO ] [MAIN ] ST: Wiping existing primary data before full refresh. [2025-09-26T21:26:59.275668] [DEBUG] [LOCAL ] STAG: Deleted primary data file. [2025-09-26T21:26:59.336923] [INFO ] [LOCAL ] ST: Starting deletion of primary data. [2025-09-26T21:26:59.337024] [INFO ] [MAIN ] STAG: Starting full primary refresh. [2025-09-26T21:26:59.372883] [DEBUG] [LOCAL ] ST: Deleted primary data file. [2025-09-26T21:26:59.373065] [INFO ] [MAIN ] ST: Starting full primary refresh. [2025-09-26T21:26:59.606014] [INFO ] [REMOTE ] STC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:26:59.638689] [INFO ] [REMOTE ] STC: Fetching primary data for 2024-12. [2025-09-26T21:27:00.318859] [INFO ] [REMOTE ] SSTK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:27:00.350597] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2024-12. [2025-09-26T21:27:00.542969] [INFO ] [REMOTE ] STAG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:27:00.565174] [INFO ] [REMOTE ] STAG: Fetching primary data for 2024-12. [2025-09-26T21:27:00.591025] [INFO ] [REMOTE ] ST: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:27:00.591447] [INFO ] [REMOTE ] ST: Fetching primary data for 2024-12. [2025-09-26T21:27:01.271470] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-26T21:27:01.275675] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-01. [2025-09-26T21:27:01.826858] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-26T21:27:01.833413] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-01. [2025-09-26T21:27:02.230686] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-26T21:27:02.241534] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-01. [2025-09-26T21:27:02.336069] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-26T21:27:02.347438] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-01. [2025-09-26T21:27:03.296823] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-26T21:27:03.305922] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-02. [2025-09-26T21:27:03.426561] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-26T21:27:03.906442] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-26T21:27:03.916337] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-02. [2025-09-26T21:27:04.720184] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-02. [2025-09-26T21:27:04.722975] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-26T21:27:05.309723] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-26T21:27:05.511748] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-03. [2025-09-26T21:27:05.558914] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-01 (4.28 seconds). [2025-09-26T21:27:06.025558] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-26T21:27:06.311734] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-02. [2025-09-26T21:27:07.111826] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-03. [2025-09-26T21:27:07.247627] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-26T21:27:07.327529] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-26T21:27:07.911763] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-03. [2025-09-26T21:27:08.711765] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-04. [2025-09-26T21:27:08.919487] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-26T21:27:09.416161] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-26T21:27:09.511679] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-04. [2025-09-26T21:27:10.311766] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-03. [2025-09-26T21:27:10.452389] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-26T21:27:11.111807] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-05. [2025-09-26T21:27:11.356319] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-26T21:27:11.639844] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-26T21:27:11.911734] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-04. [2025-09-26T21:27:12.711733] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-05. [2025-09-26T21:27:12.867191] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-26T21:27:12.892455] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-26T21:27:13.511741] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-05. [2025-09-26T21:27:14.311757] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-04. [2025-09-26T21:27:14.511440] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-26T21:27:14.571078] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-26T21:27:15.111737] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-06. [2025-09-26T21:27:15.688554] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-26T21:27:15.911729] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-06. [2025-09-26T21:27:16.182630] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-26T21:27:16.711762] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-06. [2025-09-26T21:27:17.511731] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-07. [2025-09-26T21:27:17.552968] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-26T21:27:17.936192] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-26T21:27:18.311737] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-07. [2025-09-26T21:27:18.345142] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-26T21:27:19.111724] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-07. [2025-09-26T21:27:19.911734] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-05. [2025-09-26T21:27:20.135524] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-26T21:27:20.711733] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-08. [2025-09-26T21:27:20.896422] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-26T21:27:21.157368] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-26T21:27:21.511751] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-08. [2025-09-26T21:27:21.672476] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-26T21:27:22.311740] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-06. [2025-09-26T21:27:23.111762] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-09. [2025-09-26T21:27:23.208324] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-26T21:27:23.436297] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-26T21:27:23.911709] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-08. [2025-09-26T21:27:24.142613] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-26T21:27:24.146461] [INFO ] [REMOTE ] STC: Full fetch complete (26156 records). [2025-09-26T21:27:24.146557] [DEBUG] [VALIDATOR ] STC: Validating primary data. [2025-09-26T21:27:24.533292] [DEBUG] [VALIDATOR ] STC: All expected trading days are present. [2025-09-26T21:27:24.533384] [DEBUG] [VALIDATOR ] STC: Primary data validation passed. [2025-09-26T21:27:24.534023] [INFO ] [MAIN ] STC: Fetched primary data is valid. [2025-09-26T21:27:24.534316] [DEBUG] [LOCAL ] STC: Saving primary data. [2025-09-26T21:27:24.535103] [DEBUG] [LOCAL ] STC: Trimmed 26156 records to 17878 (keeping 200 days of data) [2025-09-26T21:27:24.652287] [DEBUG] [LOCAL ] STC: Primary data saved (17878 records). [2025-09-26T21:27:24.652431] [INFO ] [MAIN ] STC: Full history saved. [2025-09-26T21:27:24.652540] [INFO ] [MAIN ] Update Progress: 2001/2371 symbols completed. STC took 27.5s. Estimated remaining: 49m 26s. Rate: 7.5 symbols/min [2025-09-26T21:27:24.717683] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-09. [2025-09-26T21:27:24.829116] [INFO ] [MAIN ] STE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:27:24.869091] [DEBUG] [LOCAL ] STE: Loaded 35635 existing records from primary storage. [2025-09-26T21:27:24.869230] [INFO ] [MAIN ] STE: Loaded 35635 existing records. [2025-09-26T21:27:25.053062] [WARN ] [MAIN ] STE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:27:25.053321] [INFO ] [MAIN ] STE: Wiping existing primary data before full refresh. [2025-09-26T21:27:25.053390] [INFO ] [LOCAL ] STE: Starting deletion of primary data. [2025-09-26T21:27:25.054367] [DEBUG] [LOCAL ] STE: Deleted primary data file. [2025-09-26T21:27:25.054428] [INFO ] [MAIN ] STE: Starting full primary refresh. [2025-09-26T21:27:25.471315] [INFO ] [REMOTE ] STE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:27:25.511699] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-07. [2025-09-26T21:27:25.939899] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-26T21:27:26.311734] [INFO ] [REMOTE ] STE: Fetching primary data for 2024-12. [2025-09-26T21:27:26.539485] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-26T21:27:26.551498] [INFO ] [REMOTE ] ST: Full fetch complete (71938 records). [2025-09-26T21:27:26.551743] [DEBUG] [VALIDATOR ] ST: Validating primary data. [2025-09-26T21:27:26.797194] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-26T21:27:27.116392] [DEBUG] [VALIDATOR ] ST: All expected trading days are present. [2025-09-26T21:27:27.115951] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-09. [2025-09-26T21:27:27.118213] [DEBUG] [VALIDATOR ] ST: Primary data validation passed. [2025-09-26T21:27:27.120031] [INFO ] [MAIN ] ST: Fetched primary data is valid. [2025-09-26T21:27:27.120302] [DEBUG] [LOCAL ] ST: Saving primary data. [2025-09-26T21:27:27.122714] [DEBUG] [LOCAL ] ST: Trimmed 71938 records to 50505 (keeping 200 days of data) [2025-09-26T21:27:27.486696] [DEBUG] [LOCAL ] ST: Primary data saved (50505 records). [2025-09-26T21:27:27.486895] [INFO ] [MAIN ] ST: Full history saved. [2025-09-26T21:27:27.486996] [INFO ] [MAIN ] Update Progress: 2002/2371 symbols completed. ST took 30.3s. Estimated remaining: 49m 17s. Rate: 7.5 symbols/min [2025-09-26T21:27:27.692663] [INFO ] [MAIN ] STEL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:27:27.718080] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-26T21:27:27.744366] [DEBUG] [LOCAL ] STEL: Loaded 23712 existing records from primary storage. [2025-09-26T21:27:27.744510] [INFO ] [MAIN ] STEL: Loaded 23712 existing records. [2025-09-26T21:27:27.936862] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-08. [2025-09-26T21:27:27.942895] [WARN ] [MAIN ] STEL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:27:27.943176] [INFO ] [MAIN ] STEL: Wiping existing primary data before full refresh. [2025-09-26T21:27:27.943234] [INFO ] [LOCAL ] STEL: Starting deletion of primary data. [2025-09-26T21:27:27.944513] [DEBUG] [LOCAL ] STEL: Deleted primary data file. [2025-09-26T21:27:27.944580] [INFO ] [MAIN ] STEL: Starting full primary refresh. [2025-09-26T21:27:28.327039] [INFO ] [REMOTE ] STEL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:27:28.711704] [INFO ] [REMOTE ] STEL: Fetching primary data for 2024-12. [2025-09-26T21:27:28.762048] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T21:27:28.771812] [INFO ] [REMOTE ] STAG: Full fetch complete (71933 records). [2025-09-26T21:27:28.771957] [DEBUG] [VALIDATOR ] STAG: Validating primary data. [2025-09-26T21:27:29.186687] [DEBUG] [VALIDATOR ] STAG: All expected trading days are present. [2025-09-26T21:27:29.186836] [DEBUG] [VALIDATOR ] STAG: Primary data validation passed. [2025-09-26T21:27:29.188201] [INFO ] [MAIN ] STAG: Fetched primary data is valid. [2025-09-26T21:27:29.188275] [DEBUG] [LOCAL ] STAG: Saving primary data. [2025-09-26T21:27:29.189980] [DEBUG] [LOCAL ] STAG: Trimmed 71933 records to 50799 (keeping 200 days of data) [2025-09-26T21:27:29.302392] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-26T21:27:29.516713] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-09. [2025-09-26T21:27:29.540491] [DEBUG] [LOCAL ] STAG: Primary data saved (50799 records). [2025-09-26T21:27:29.540673] [INFO ] [MAIN ] STAG: Full history saved. [2025-09-26T21:27:29.540803] [INFO ] [MAIN ] Update Progress: 2003/2371 symbols completed. STAG took 32.4s. Estimated remaining: 49m 8s. Rate: 7.5 symbols/min [2025-09-26T21:27:29.733278] [INFO ] [MAIN ] STEM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:27:29.774337] [DEBUG] [LOCAL ] STEM: Loaded 40148 existing records from primary storage. [2025-09-26T21:27:29.774494] [INFO ] [MAIN ] STEM: Loaded 40148 existing records. [2025-09-26T21:27:29.908074] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-26T21:27:29.989529] [WARN ] [MAIN ] STEM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:27:29.989833] [INFO ] [MAIN ] STEM: Wiping existing primary data before full refresh. [2025-09-26T21:27:29.989886] [INFO ] [LOCAL ] STEM: Starting deletion of primary data. [2025-09-26T21:27:29.990671] [DEBUG] [LOCAL ] STEM: Deleted primary data file. [2025-09-26T21:27:29.990735] [INFO ] [MAIN ] STEM: Starting full primary refresh. [2025-09-26T21:27:30.316830] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-01. [2025-09-26T21:27:30.382856] [INFO ] [REMOTE ] STEM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:27:30.668207] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-26T21:27:30.673324] [INFO ] [REMOTE ] SSTK: Full fetch complete (42032 records). [2025-09-26T21:27:30.673473] [DEBUG] [VALIDATOR ] SSTK: Validating primary data. [2025-09-26T21:27:31.083426] [DEBUG] [VALIDATOR ] SSTK: All expected trading days are present. [2025-09-26T21:27:31.083507] [DEBUG] [VALIDATOR ] SSTK: Primary data validation passed. [2025-09-26T21:27:31.084299] [INFO ] [MAIN ] SSTK: Fetched primary data is valid. [2025-09-26T21:27:31.084363] [DEBUG] [LOCAL ] SSTK: Saving primary data. [2025-09-26T21:27:31.085341] [DEBUG] [LOCAL ] SSTK: Trimmed 42032 records to 26762 (keeping 200 days of data) [2025-09-26T21:27:31.148283] [INFO ] [REMOTE ] STEM: Fetching primary data for 2024-12. [2025-09-26T21:27:31.274710] [DEBUG] [LOCAL ] SSTK: Primary data saved (26762 records). [2025-09-26T21:27:31.274943] [INFO ] [MAIN ] SSTK: Full history saved. [2025-09-26T21:27:31.275087] [INFO ] [MAIN ] Update Progress: 2004/2371 symbols completed. SSTK took 34.1s. Estimated remaining: 48m 59s. Rate: 7.5 symbols/min [2025-09-26T21:27:31.478262] [INFO ] [MAIN ] STEW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:27:31.500708] [DEBUG] [LOCAL ] STEW: Loaded 16254 existing records from primary storage. [2025-09-26T21:27:31.500877] [INFO ] [MAIN ] STEW: Loaded 16254 existing records. [2025-09-26T21:27:31.702761] [WARN ] [MAIN ] STEW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:27:31.703017] [INFO ] [MAIN ] STEW: Wiping existing primary data before full refresh. [2025-09-26T21:27:31.703067] [INFO ] [LOCAL ] STEW: Starting deletion of primary data. [2025-09-26T21:27:31.703533] [DEBUG] [LOCAL ] STEW: Deleted primary data file. [2025-09-26T21:27:31.703602] [INFO ] [MAIN ] STEW: Starting full primary refresh. [2025-09-26T21:27:31.917552] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-01. [2025-09-26T21:27:32.088826] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-26T21:27:32.138542] [INFO ] [REMOTE ] STEW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:27:32.711696] [INFO ] [REMOTE ] STEW: Fetching primary data for 2024-12. [2025-09-26T21:27:32.934401] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-26T21:27:33.252885] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-26T21:27:33.511698] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-02. [2025-09-26T21:27:33.696860] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-26T21:27:34.311720] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-02. [2025-09-26T21:27:34.585602] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-26T21:27:35.111728] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-01. [2025-09-26T21:27:35.483852] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-26T21:27:35.911728] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-01. [2025-09-26T21:27:36.711715] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-03. [2025-09-26T21:27:36.764159] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-26T21:27:37.168283] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-26T21:27:37.511743] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-02. [2025-09-26T21:27:37.946220] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-26T21:27:38.012333] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-26T21:27:38.311725] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-02. [2025-09-26T21:27:39.111736] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-03. [2025-09-26T21:27:39.911738] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-03. [2025-09-26T21:27:40.146837] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-26T21:27:40.623983] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-26T21:27:40.652274] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T21:27:40.711759] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-04. [2025-09-26T21:27:41.511802] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-04. [2025-09-26T21:27:42.311701] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-04. [2025-09-26T21:27:42.382008] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-26T21:27:42.441700] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-26T21:27:43.111725] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-05. [2025-09-26T21:27:43.627000] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-26T21:27:43.911768] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-05. [2025-09-26T21:27:44.625375] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-26T21:27:44.711741] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-03. [2025-09-26T21:27:44.837284] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-26T21:27:45.511738] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-05. [2025-09-26T21:27:46.311714] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-06. [2025-09-26T21:27:46.489764] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-26T21:27:46.534532] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-26T21:27:47.111693] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-06. [2025-09-26T21:27:47.461571] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-26T21:27:47.911734] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-07. [2025-09-26T21:27:48.066018] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-26T21:27:48.711762] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-04. [2025-09-26T21:27:49.074158] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-26T21:27:49.511793] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-08. [2025-09-26T21:27:50.311707] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-06. [2025-09-26T21:27:50.414044] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-26T21:27:50.634174] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-26T21:27:51.111748] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-05. [2025-09-26T21:27:51.802755] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-26T21:27:51.911752] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-07. [2025-09-26T21:27:52.711702] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-09. [2025-09-26T21:27:52.925458] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-26T21:27:53.495197] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-26T21:27:53.511674] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-06. [2025-09-26T21:27:53.687856] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-26T21:27:53.693768] [INFO ] [REMOTE ] STEL: Full fetch complete (32190 records). [2025-09-26T21:27:53.694001] [DEBUG] [VALIDATOR ] STEL: Validating primary data. [2025-09-26T21:27:54.079869] [DEBUG] [VALIDATOR ] STEL: All expected trading days are present. [2025-09-26T21:27:54.079979] [DEBUG] [VALIDATOR ] STEL: Primary data validation passed. [2025-09-26T21:27:54.081263] [INFO ] [MAIN ] STEL: Fetched primary data is valid. [2025-09-26T21:27:54.081329] [DEBUG] [LOCAL ] STEL: Saving primary data. [2025-09-26T21:27:54.082369] [DEBUG] [LOCAL ] STEL: Trimmed 32190 records to 23823 (keeping 200 days of data) [2025-09-26T21:27:54.246955] [DEBUG] [LOCAL ] STEL: Primary data saved (23823 records). [2025-09-26T21:27:54.247145] [INFO ] [MAIN ] STEL: Full history saved. [2025-09-26T21:27:54.247256] [INFO ] [MAIN ] Update Progress: 2005/2371 symbols completed. STEL took 26.8s. Estimated remaining: 48m 54s. Rate: 7.5 symbols/min [2025-09-26T21:27:54.318611] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-07. [2025-09-26T21:27:54.437411] [INFO ] [MAIN ] STG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:27:54.437625] [DEBUG] [LOCAL ] STG: No existing data file found in primary storage. [2025-09-26T21:27:54.437701] [WARN ] [MAIN ] STG: No existing data found, performing full refresh instead. [2025-09-26T21:27:54.437857] [INFO ] [MAIN ] STG: Wiping existing primary data before full refresh. [2025-09-26T21:27:54.437902] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-09-26T21:27:54.437947] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-09-26T21:27:54.437980] [INFO ] [MAIN ] STG: Starting full primary refresh. [2025-09-26T21:27:54.826879] [INFO ] [REMOTE ] STG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:27:55.111714] [INFO ] [REMOTE ] STG: Fetching primary data for 2024-12. [2025-09-26T21:27:55.247907] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-26T21:27:55.304634] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-26T21:27:55.448094] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-26T21:27:55.911751] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-08. [2025-09-26T21:27:56.711824] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-07. [2025-09-26T21:27:57.511706] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-08. [2025-09-26T21:27:57.574465] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-26T21:27:58.311767] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-01. [2025-09-26T21:27:58.362454] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-26T21:27:58.393180] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-26T21:27:58.788703] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-26T21:27:59.111761] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-02. [2025-09-26T21:27:59.438904] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-26T21:27:59.911759] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-09. [2025-09-26T21:28:00.711696] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-03. [2025-09-26T21:28:00.781859] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-26T21:28:00.784822] [INFO ] [REMOTE ] STEW: Full fetch complete (21870 records). [2025-09-26T21:28:00.784910] [DEBUG] [VALIDATOR ] STEW: Validating primary data. [2025-09-26T21:28:01.143557] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-26T21:28:01.258537] [DEBUG] [VALIDATOR ] STEW: All expected trading days are present. [2025-09-26T21:28:01.258673] [DEBUG] [VALIDATOR ] STEW: Primary data validation passed. [2025-09-26T21:28:01.259968] [INFO ] [MAIN ] STEW: Fetched primary data is valid. [2025-09-26T21:28:01.260034] [DEBUG] [LOCAL ] STEW: Saving primary data. [2025-09-26T21:28:01.261253] [DEBUG] [LOCAL ] STEW: Trimmed 21870 records to 16354 (keeping 200 days of data) [2025-09-26T21:28:01.374884] [DEBUG] [LOCAL ] STEW: Primary data saved (16354 records). [2025-09-26T21:28:01.375078] [INFO ] [MAIN ] STEW: Full history saved. [2025-09-26T21:28:01.375270] [INFO ] [MAIN ] Update Progress: 2006/2371 symbols completed. STEW took 30.1s. Estimated remaining: 48m 46s. Rate: 7.5 symbols/min [2025-09-26T21:28:01.523418] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-04. [2025-09-26T21:28:01.558152] [INFO ] [MAIN ] STK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:28:01.573080] [DEBUG] [LOCAL ] STK: Loaded 9500 existing records from primary storage. [2025-09-26T21:28:01.573239] [INFO ] [MAIN ] STK: Loaded 9500 existing records. [2025-09-26T21:28:01.753945] [WARN ] [MAIN ] STK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:28:01.754320] [INFO ] [MAIN ] STK: Wiping existing primary data before full refresh. [2025-09-26T21:28:01.754372] [INFO ] [LOCAL ] STK: Starting deletion of primary data. [2025-09-26T21:28:01.754847] [DEBUG] [LOCAL ] STK: Deleted primary data file. [2025-09-26T21:28:01.754909] [INFO ] [MAIN ] STK: Starting full primary refresh. [2025-09-26T21:28:01.910665] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-26T21:28:02.141602] [INFO ] [REMOTE ] STK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:28:02.311771] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-05. [2025-09-26T21:28:02.667665] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-26T21:28:03.111759] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-09. [2025-09-26T21:28:03.911800] [INFO ] [REMOTE ] STK: Fetching primary data for 2024-12. [2025-09-26T21:28:04.565168] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-26T21:28:04.575490] [INFO ] [REMOTE ] STE: Full fetch complete (50572 records). [2025-09-26T21:28:04.575829] [DEBUG] [VALIDATOR ] STE: Validating primary data. [2025-09-26T21:28:04.716982] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-08. [2025-09-26T21:28:04.813919] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-26T21:28:05.016895] [DEBUG] [VALIDATOR ] STE: All expected trading days are present. [2025-09-26T21:28:05.017008] [DEBUG] [VALIDATOR ] STE: Primary data validation passed. [2025-09-26T21:28:05.018518] [INFO ] [MAIN ] STE: Fetched primary data is valid. [2025-09-26T21:28:05.018665] [DEBUG] [LOCAL ] STE: Saving primary data. [2025-09-26T21:28:05.022340] [DEBUG] [LOCAL ] STE: Trimmed 50572 records to 35822 (keeping 200 days of data) [2025-09-26T21:28:05.283240] [DEBUG] [LOCAL ] STE: Primary data saved (35822 records). [2025-09-26T21:28:05.283754] [INFO ] [MAIN ] STE: Full history saved. [2025-09-26T21:28:05.283919] [INFO ] [MAIN ] Update Progress: 2007/2371 symbols completed. STE took 40.6s. Estimated remaining: 48m 37s. Rate: 7.5 symbols/min [2025-09-26T21:28:05.471232] [INFO ] [MAIN ] STLA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:28:05.514050] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-01. [2025-09-26T21:28:05.540042] [DEBUG] [LOCAL ] STLA: Loaded 53932 existing records from primary storage. [2025-09-26T21:28:05.540260] [INFO ] [MAIN ] STLA: Loaded 53932 existing records. [2025-09-26T21:28:05.732850] [WARN ] [MAIN ] STLA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:28:05.733278] [INFO ] [MAIN ] STLA: Wiping existing primary data before full refresh. [2025-09-26T21:28:05.733371] [INFO ] [LOCAL ] STLA: Starting deletion of primary data. [2025-09-26T21:28:05.734990] [DEBUG] [LOCAL ] STLA: Deleted primary data file. [2025-09-26T21:28:05.735076] [INFO ] [MAIN ] STLA: Starting full primary refresh. [2025-09-26T21:28:06.154917] [INFO ] [REMOTE ] STLA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:28:06.227244] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-26T21:28:06.311949] [INFO ] [REMOTE ] STLA: Fetching primary data for 2024-12. [2025-09-26T21:28:06.312354] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-26T21:28:07.111751] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-02. [2025-09-26T21:28:07.911713] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-06. [2025-09-26T21:28:07.980803] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-26T21:28:08.487088] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-26T21:28:08.509905] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-26T21:28:08.711765] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-03. [2025-09-26T21:28:09.511756] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-07. [2025-09-26T21:28:09.544780] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-26T21:28:10.267295] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-26T21:28:10.311728] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-04. [2025-09-26T21:28:11.111776] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-09. [2025-09-26T21:28:11.200118] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-26T21:28:11.911748] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-05. [2025-09-26T21:28:12.505216] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-26T21:28:12.514179] [INFO ] [REMOTE ] STEM: Full fetch complete (62573 records). [2025-09-26T21:28:12.514376] [DEBUG] [VALIDATOR ] STEM: Validating primary data. [2025-09-26T21:28:12.711944] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-08. [2025-09-26T21:28:12.855349] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-26T21:28:12.951919] [DEBUG] [VALIDATOR ] STEM: All expected trading days are present. [2025-09-26T21:28:12.952023] [DEBUG] [VALIDATOR ] STEM: Primary data validation passed. [2025-09-26T21:28:12.953098] [INFO ] [MAIN ] STEM: Fetched primary data is valid. [2025-09-26T21:28:12.953170] [DEBUG] [LOCAL ] STEM: Saving primary data. [2025-09-26T21:28:12.955407] [DEBUG] [LOCAL ] STEM: Trimmed 62573 records to 40374 (keeping 200 days of data) [2025-09-26T21:28:13.220973] [DEBUG] [LOCAL ] STEM: Primary data saved (40374 records). [2025-09-26T21:28:13.221159] [INFO ] [MAIN ] STEM: Full history saved. [2025-09-26T21:28:13.221292] [INFO ] [MAIN ] Update Progress: 2008/2371 symbols completed. STEM took 43.7s. Estimated remaining: 48m 29s. Rate: 7.5 symbols/min [2025-09-26T21:28:13.309133] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-26T21:28:13.410475] [INFO ] [MAIN ] STM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:28:13.473416] [DEBUG] [LOCAL ] STM: Loaded 53974 existing records from primary storage. [2025-09-26T21:28:13.473601] [INFO ] [MAIN ] STM: Loaded 53974 existing records. [2025-09-26T21:28:13.517031] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-09. [2025-09-26T21:28:13.722664] [WARN ] [MAIN ] STM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:28:13.722988] [INFO ] [MAIN ] STM: Wiping existing primary data before full refresh. [2025-09-26T21:28:13.723070] [INFO ] [LOCAL ] STM: Starting deletion of primary data. [2025-09-26T21:28:13.724427] [DEBUG] [LOCAL ] STM: Deleted primary data file. [2025-09-26T21:28:13.724499] [INFO ] [MAIN ] STM: Starting full primary refresh. [2025-09-26T21:28:14.030185] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-26T21:28:14.042200] [INFO ] [REMOTE ] STG: Full fetch complete (2496 records). [2025-09-26T21:28:14.047505] [DEBUG] [VALIDATOR ] STG: Validating primary data. [2025-09-26T21:28:14.241934] [INFO ] [REMOTE ] STM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:28:14.320683] [INFO ] [REMOTE ] STM: Fetching primary data for 2024-12. [2025-09-26T21:28:14.328568] [WARN ] [VALIDATOR ] STG: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-26T21:28:14.330305] [FATAL] [MAIN ] STG: Fetched primary data is invalid. Refusing to save it. [2025-09-26T21:28:14.330383] [WARN ] [MAIN ] STG: Deleting existing primary and derivative data due to validation failure. [2025-09-26T21:28:14.330449] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-09-26T21:28:14.330516] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-09-26T21:28:14.330554] [INFO ] [LOCAL ] STG: Starting deletion of derivative data. [2025-09-26T21:28:14.330613] [DEBUG] [LOCAL ] STG: No derivative data file found to delete. [2025-09-26T21:28:14.330759] [INFO ] [MAIN ] Update Progress: 2009/2371 symbols completed. STG took 20.1s. Estimated remaining: 48m 19s. Rate: 7.5 symbols/min [2025-09-26T21:28:14.522436] [INFO ] [MAIN ] STN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:28:14.555488] [DEBUG] [LOCAL ] STN: Loaded 23298 existing records from primary storage. [2025-09-26T21:28:14.555699] [INFO ] [MAIN ] STN: Loaded 23298 existing records. [2025-09-26T21:28:14.754914] [WARN ] [MAIN ] STN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:28:14.755177] [INFO ] [MAIN ] STN: Wiping existing primary data before full refresh. [2025-09-26T21:28:14.755228] [INFO ] [LOCAL ] STN: Starting deletion of primary data. [2025-09-26T21:28:14.756036] [DEBUG] [LOCAL ] STN: Deleted primary data file. [2025-09-26T21:28:14.756099] [INFO ] [MAIN ] STN: Starting full primary refresh. [2025-09-26T21:28:15.120576] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-01. [2025-09-26T21:28:15.148709] [INFO ] [REMOTE ] STN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:28:15.911759] [INFO ] [REMOTE ] STN: Fetching primary data for 2024-12. [2025-09-26T21:28:16.509373] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-26T21:28:16.711764] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-01. [2025-09-26T21:28:16.865174] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-26T21:28:17.272181] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-26T21:28:17.511745] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-01. [2025-09-26T21:28:18.311703] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-02. [2025-09-26T21:28:18.646890] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-26T21:28:18.673146] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-26T21:28:19.111762] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-02. [2025-09-26T21:28:19.911762] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-02. [2025-09-26T21:28:20.410191] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-26T21:28:20.711722] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-03. [2025-09-26T21:28:21.078418] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-26T21:28:21.125176] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-26T21:28:21.511737] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-03. [2025-09-26T21:28:22.311737] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-06. [2025-09-26T21:28:23.090785] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-26T21:28:23.111679] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-07. [2025-09-26T21:28:23.249221] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-09-26T21:28:23.403773] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-26T21:28:23.908562] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-26T21:28:23.911637] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-08. [2025-09-26T21:28:24.685789] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-26T21:28:24.711666] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-09. [2025-09-26T21:28:25.496330] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-26T21:28:25.500441] [INFO ] [REMOTE ] STK: Full fetch complete (14101 records). [2025-09-26T21:28:25.500541] [DEBUG] [VALIDATOR ] STK: Validating primary data. [2025-09-26T21:28:25.516878] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-03. [2025-09-26T21:28:25.905314] [DEBUG] [VALIDATOR ] STK: All expected trading days are present. [2025-09-26T21:28:25.905432] [DEBUG] [VALIDATOR ] STK: Primary data validation passed. [2025-09-26T21:28:25.905855] [INFO ] [MAIN ] STK: Fetched primary data is valid. [2025-09-26T21:28:25.905932] [DEBUG] [LOCAL ] STK: Saving primary data. [2025-09-26T21:28:25.906782] [DEBUG] [LOCAL ] STK: Trimmed 14101 records to 9550 (keeping 200 days of data) [2025-09-26T21:28:25.973437] [DEBUG] [LOCAL ] STK: Primary data saved (9550 records). [2025-09-26T21:28:25.973598] [INFO ] [MAIN ] STK: Full history saved. [2025-09-26T21:28:25.973827] [INFO ] [MAIN ] Update Progress: 2010/2371 symbols completed. STK took 24.6s. Estimated remaining: 48m 12s. Rate: 7.5 symbols/min [2025-09-26T21:28:26.159543] [INFO ] [MAIN ] STNG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:28:26.210269] [DEBUG] [LOCAL ] STNG: Loaded 44319 existing records from primary storage. [2025-09-26T21:28:26.211194] [INFO ] [MAIN ] STNG: Loaded 44319 existing records. [2025-09-26T21:28:26.316983] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-04. [2025-09-26T21:28:26.404426] [WARN ] [MAIN ] STNG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:28:26.404782] [INFO ] [MAIN ] STNG: Wiping existing primary data before full refresh. [2025-09-26T21:28:26.404836] [INFO ] [LOCAL ] STNG: Starting deletion of primary data. [2025-09-26T21:28:26.405984] [DEBUG] [LOCAL ] STNG: Deleted primary data file. [2025-09-26T21:28:26.406045] [INFO ] [MAIN ] STNG: Starting full primary refresh. [2025-09-26T21:28:26.765286] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-26T21:28:26.814298] [INFO ] [REMOTE ] STNG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:28:27.111738] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-04. [2025-09-26T21:28:27.911728] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-04. [2025-09-26T21:28:28.423240] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-26T21:28:28.711782] [INFO ] [REMOTE ] STNG: Fetching primary data for 2024-12. [2025-09-26T21:28:29.205025] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-26T21:28:29.327616] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-26T21:28:29.511756] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-05. [2025-09-26T21:28:29.836760] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-26T21:28:30.311757] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-01. [2025-09-26T21:28:31.111719] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-05. [2025-09-26T21:28:31.562461] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-26T21:28:31.911715] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-06. [2025-09-26T21:28:32.030092] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-26T21:28:32.357786] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-26T21:28:32.711802] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-06. [2025-09-26T21:28:33.511711] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-05. [2025-09-26T21:28:33.826228] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-26T21:28:33.851516] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-26T21:28:34.311736] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-07. [2025-09-26T21:28:35.111750] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-02. [2025-09-26T21:28:35.507032] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-26T21:28:35.911712] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-06. [2025-09-26T21:28:36.410503] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-26T21:28:36.664247] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-26T21:28:36.711712] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-07. [2025-09-26T21:28:37.511696] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-08. [2025-09-26T21:28:37.771797] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-26T21:28:37.791348] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-26T21:28:38.311733] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-08. [2025-09-26T21:28:39.111737] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-03. [2025-09-26T21:28:39.264674] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-26T21:28:39.293537] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-26T21:28:39.911721] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-09. [2025-09-26T21:28:40.711763] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-09. [2025-09-26T21:28:40.908916] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-26T21:28:41.058140] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-26T21:28:41.063477] [INFO ] [REMOTE ] STN: Full fetch complete (32417 records). [2025-09-26T21:28:41.063616] [DEBUG] [VALIDATOR ] STN: Validating primary data. [2025-09-26T21:28:41.456846] [DEBUG] [VALIDATOR ] STN: All expected trading days are present. [2025-09-26T21:28:41.456951] [DEBUG] [VALIDATOR ] STN: Primary data validation passed. [2025-09-26T21:28:41.457664] [INFO ] [MAIN ] STN: Fetched primary data is valid. [2025-09-26T21:28:41.457729] [DEBUG] [LOCAL ] STN: Saving primary data. [2025-09-26T21:28:41.459112] [DEBUG] [LOCAL ] STN: Trimmed 32417 records to 23436 (keeping 200 days of data) [2025-09-26T21:28:41.516679] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-04. [2025-09-26T21:28:41.631803] [DEBUG] [LOCAL ] STN: Primary data saved (23436 records). [2025-09-26T21:28:41.631959] [INFO ] [MAIN ] STN: Full history saved. [2025-09-26T21:28:41.632055] [INFO ] [MAIN ] Update Progress: 2011/2371 symbols completed. STN took 27.3s. Estimated remaining: 48m 5s. Rate: 7.5 symbols/min [2025-09-26T21:28:41.813563] [INFO ] [MAIN ] STRV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:28:41.826540] [DEBUG] [LOCAL ] STRV: Loaded 11659 existing records from primary storage. [2025-09-26T21:28:41.826683] [INFO ] [MAIN ] STRV: Loaded 11659 existing records. [2025-09-26T21:28:42.010324] [WARN ] [MAIN ] STRV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:28:42.010615] [INFO ] [MAIN ] STRV: Wiping existing primary data before full refresh. [2025-09-26T21:28:42.010696] [INFO ] [LOCAL ] STRV: Starting deletion of primary data. [2025-09-26T21:28:42.011142] [DEBUG] [LOCAL ] STRV: Deleted primary data file. [2025-09-26T21:28:42.011201] [INFO ] [MAIN ] STRV: Starting full primary refresh. [2025-09-26T21:28:42.316742] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-07. [2025-09-26T21:28:42.380900] [INFO ] [REMOTE ] STRV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:28:42.499219] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-26T21:28:42.510063] [INFO ] [REMOTE ] STM: Full fetch complete (77526 records). [2025-09-26T21:28:42.510234] [DEBUG] [VALIDATOR ] STM: Validating primary data. [2025-09-26T21:28:42.942703] [DEBUG] [VALIDATOR ] STM: All expected trading days are present. [2025-09-26T21:28:42.942829] [DEBUG] [VALIDATOR ] STM: Primary data validation passed. [2025-09-26T21:28:42.944046] [INFO ] [MAIN ] STM: Fetched primary data is valid. [2025-09-26T21:28:42.944112] [DEBUG] [LOCAL ] STM: Saving primary data. [2025-09-26T21:28:42.945848] [DEBUG] [LOCAL ] STM: Trimmed 77526 records to 54362 (keeping 200 days of data) [2025-09-26T21:28:43.127978] [INFO ] [REMOTE ] STRV: Fetching primary data for 2024-12. [2025-09-26T21:28:43.294614] [DEBUG] [LOCAL ] STM: Primary data saved (54362 records). [2025-09-26T21:28:43.294801] [INFO ] [MAIN ] STM: Full history saved. [2025-09-26T21:28:43.294921] [INFO ] [MAIN ] Update Progress: 2012/2371 symbols completed. STM took 30.1s. Estimated remaining: 47m 56s. Rate: 7.5 symbols/min [2025-09-26T21:28:43.493358] [INFO ] [MAIN ] STT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:28:43.540112] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-26T21:28:43.586983] [DEBUG] [LOCAL ] STT: Loaded 51441 existing records from primary storage. [2025-09-26T21:28:43.587138] [INFO ] [MAIN ] STT: Loaded 51441 existing records. [2025-09-26T21:28:43.779502] [WARN ] [MAIN ] STT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:28:43.779820] [INFO ] [MAIN ] STT: Wiping existing primary data before full refresh. [2025-09-26T21:28:43.779872] [INFO ] [LOCAL ] STT: Starting deletion of primary data. [2025-09-26T21:28:43.780970] [DEBUG] [LOCAL ] STT: Deleted primary data file. [2025-09-26T21:28:43.781031] [INFO ] [MAIN ] STT: Starting full primary refresh. [2025-09-26T21:28:43.914119] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-05. [2025-09-26T21:28:44.080961] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-26T21:28:44.180464] [INFO ] [REMOTE ] STT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:28:44.592514] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-26T21:28:44.711744] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-08. [2025-09-26T21:28:45.516826] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-01. [2025-09-26T21:28:45.529501] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-26T21:28:46.311696] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-06. [2025-09-26T21:28:46.515264] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-26T21:28:46.801898] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-26T21:28:47.111712] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-02. [2025-09-26T21:28:47.892810] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-26T21:28:47.914685] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-07. [2025-09-26T21:28:47.917958] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-26T21:28:48.711746] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-03. [2025-09-26T21:28:49.511723] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-09. [2025-09-26T21:28:49.575020] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-26T21:28:49.691054] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-26T21:28:50.311754] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-08. [2025-09-26T21:28:51.111713] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-04. [2025-09-26T21:28:51.742130] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-26T21:28:51.752732] [INFO ] [REMOTE ] STLA: Full fetch complete (77533 records). [2025-09-26T21:28:51.752896] [DEBUG] [VALIDATOR ] STLA: Validating primary data. [2025-09-26T21:28:51.913387] [INFO ] [REMOTE ] STT: Fetching primary data for 2024-12. [2025-09-26T21:28:52.187723] [DEBUG] [VALIDATOR ] STLA: All expected trading days are present. [2025-09-26T21:28:52.214296] [DEBUG] [VALIDATOR ] STLA: Primary data validation passed. [2025-09-26T21:28:52.215605] [INFO ] [MAIN ] STLA: Fetched primary data is valid. [2025-09-26T21:28:52.221844] [DEBUG] [LOCAL ] STLA: Saving primary data. [2025-09-26T21:28:52.223388] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-26T21:28:52.239129] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-26T21:28:52.245333] [DEBUG] [LOCAL ] STLA: Trimmed 77533 records to 54322 (keeping 200 days of data) [2025-09-26T21:28:52.579240] [DEBUG] [LOCAL ] STLA: Primary data saved (54322 records). [2025-09-26T21:28:52.579419] [INFO ] [MAIN ] STLA: Full history saved. [2025-09-26T21:28:52.579546] [INFO ] [MAIN ] Update Progress: 2013/2371 symbols completed. STLA took 47.3s. Estimated remaining: 47m 49s. Rate: 7.5 symbols/min [2025-09-26T21:28:52.716926] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-09. [2025-09-26T21:28:52.763051] [INFO ] [MAIN ] STUB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:28:52.763301] [DEBUG] [LOCAL ] STUB: No existing data file found in primary storage. [2025-09-26T21:28:52.763339] [WARN ] [MAIN ] STUB: No existing data found, performing full refresh instead. [2025-09-26T21:28:52.763500] [INFO ] [MAIN ] STUB: Wiping existing primary data before full refresh. [2025-09-26T21:28:52.763550] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-09-26T21:28:52.763592] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-09-26T21:28:52.763626] [INFO ] [MAIN ] STUB: Starting full primary refresh. [2025-09-26T21:28:53.129334] [INFO ] [REMOTE ] STUB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:28:53.511722] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-05. [2025-09-26T21:28:53.710093] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T21:28:54.311768] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-01. [2025-09-26T21:28:54.379578] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-26T21:28:54.398988] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-26T21:28:54.398299] [INFO ] [REMOTE ] STNG: Full fetch complete (64377 records). [2025-09-26T21:28:54.399193] [DEBUG] [VALIDATOR ] STNG: Validating primary data. [2025-09-26T21:28:54.833612] [DEBUG] [VALIDATOR ] STNG: All expected trading days are present. [2025-09-26T21:28:54.833772] [DEBUG] [VALIDATOR ] STNG: Primary data validation passed. [2025-09-26T21:28:54.834782] [INFO ] [MAIN ] STNG: Fetched primary data is valid. [2025-09-26T21:28:54.834847] [DEBUG] [LOCAL ] STNG: Saving primary data. [2025-09-26T21:28:54.836286] [DEBUG] [LOCAL ] STNG: Trimmed 64377 records to 44620 (keeping 200 days of data) [2025-09-26T21:28:55.116681] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-06. [2025-09-26T21:28:55.126326] [DEBUG] [LOCAL ] STNG: Primary data saved (44620 records). [2025-09-26T21:28:55.126413] [INFO ] [MAIN ] STNG: Full history saved. [2025-09-26T21:28:55.126499] [INFO ] [MAIN ] Update Progress: 2014/2371 symbols completed. STNG took 29.2s. Estimated remaining: 47m 40s. Rate: 7.5 symbols/min [2025-09-26T21:28:55.303394] [INFO ] [MAIN ] STVN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:28:55.330810] [DEBUG] [LOCAL ] STVN: Loaded 26453 existing records from primary storage. [2025-09-26T21:28:55.330974] [INFO ] [MAIN ] STVN: Loaded 26453 existing records. [2025-09-26T21:28:55.532334] [WARN ] [MAIN ] STVN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:28:55.532705] [INFO ] [MAIN ] STVN: Wiping existing primary data before full refresh. [2025-09-26T21:28:55.532762] [INFO ] [LOCAL ] STVN: Starting deletion of primary data. [2025-09-26T21:28:55.533406] [DEBUG] [LOCAL ] STVN: Deleted primary data file. [2025-09-26T21:28:55.533467] [INFO ] [MAIN ] STVN: Starting full primary refresh. [2025-09-26T21:28:55.917548] [INFO ] [REMOTE ] STUB: Fetching primary data for 2024-12. [2025-09-26T21:28:55.921541] [INFO ] [REMOTE ] STVN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:28:56.047101] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-26T21:28:56.150806] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-26T21:28:56.328795] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:28:56.329396] [WARN ] [REMOTE ] STUB: No data returned for month 2024-12 [2025-09-26T21:28:56.711756] [INFO ] [REMOTE ] STVN: Fetching primary data for 2024-12. [2025-09-26T21:28:57.511727] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-02. [2025-09-26T21:28:57.980055] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-26T21:28:58.311789] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-07. [2025-09-26T21:28:59.111742] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-01. [2025-09-26T21:28:59.169492] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-26T21:28:59.311717] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:28:59.312375] [WARN ] [REMOTE ] STUB: No data returned for month 2025-01 [2025-09-26T21:28:59.402461] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-26T21:28:59.911750] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-02. [2025-09-26T21:29:00.118216] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:29:00.118699] [WARN ] [REMOTE ] STUB: No data returned for month 2025-02 [2025-09-26T21:29:00.711754] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-03. [2025-09-26T21:29:01.511743] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-01. [2025-09-26T21:29:02.311712] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-08. [2025-09-26T21:29:02.551571] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-26T21:29:02.764743] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-26T21:29:03.050245] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-26T21:29:03.111683] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-04. [2025-09-26T21:29:03.911745] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-02. [2025-09-26T21:29:04.711704] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-03. [2025-09-26T21:29:04.919144] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:29:04.919596] [WARN ] [REMOTE ] STUB: No data returned for month 2025-03 [2025-09-26T21:29:05.009713] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-26T21:29:05.101181] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-26T21:29:05.511730] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-09. [2025-09-26T21:29:06.311696] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-05. [2025-09-26T21:29:06.454976] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-26T21:29:06.457700] [INFO ] [REMOTE ] STRV: Full fetch complete (18558 records). [2025-09-26T21:29:06.458051] [DEBUG] [VALIDATOR ] STRV: Validating primary data. [2025-09-26T21:29:06.861422] [DEBUG] [VALIDATOR ] STRV: All expected trading days are present. [2025-09-26T21:29:06.861555] [DEBUG] [VALIDATOR ] STRV: Primary data validation passed. [2025-09-26T21:29:06.862269] [INFO ] [MAIN ] STRV: Fetched primary data is valid. [2025-09-26T21:29:06.862353] [DEBUG] [LOCAL ] STRV: Saving primary data. [2025-09-26T21:29:06.863109] [DEBUG] [LOCAL ] STRV: Trimmed 18558 records to 11754 (keeping 200 days of data) [2025-09-26T21:29:06.940354] [DEBUG] [LOCAL ] STRV: Primary data saved (11754 records). [2025-09-26T21:29:06.940568] [INFO ] [MAIN ] STRV: Full history saved. [2025-09-26T21:29:06.940713] [INFO ] [MAIN ] Update Progress: 2015/2371 symbols completed. STRV took 25.3s. Estimated remaining: 47m 32s. Rate: 7.5 symbols/min [2025-09-26T21:29:07.113119] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-04. [2025-09-26T21:29:07.127114] [INFO ] [MAIN ] STWD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:29:07.194418] [DEBUG] [LOCAL ] STWD: Loaded 52269 existing records from primary storage. [2025-09-26T21:29:07.194718] [INFO ] [MAIN ] STWD: Loaded 52269 existing records. [2025-09-26T21:29:07.355409] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:29:07.372142] [WARN ] [REMOTE ] STUB: No data returned for month 2025-04 [2025-09-26T21:29:07.397113] [WARN ] [MAIN ] STWD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:29:07.397432] [INFO ] [MAIN ] STWD: Wiping existing primary data before full refresh. [2025-09-26T21:29:07.397578] [INFO ] [LOCAL ] STWD: Starting deletion of primary data. [2025-09-26T21:29:07.399049] [DEBUG] [LOCAL ] STWD: Deleted primary data file. [2025-09-26T21:29:07.399118] [INFO ] [MAIN ] STWD: Starting full primary refresh. [2025-09-26T21:29:07.854339] [INFO ] [REMOTE ] STWD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:29:07.911739] [INFO ] [REMOTE ] STWD: Fetching primary data for 2024-12. [2025-09-26T21:29:08.229255] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-26T21:29:08.711762] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-05. [2025-09-26T21:29:08.917021] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:29:08.917533] [WARN ] [REMOTE ] STUB: No data returned for month 2025-05 [2025-09-26T21:29:09.511720] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-06. [2025-09-26T21:29:09.687039] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-26T21:29:09.726018] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:29:09.726323] [WARN ] [REMOTE ] STUB: No data returned for month 2025-06 [2025-09-26T21:29:10.311714] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-03. [2025-09-26T21:29:11.111765] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-06. [2025-09-26T21:29:11.508076] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-26T21:29:11.911765] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-04. [2025-09-26T21:29:12.711705] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-01. [2025-09-26T21:29:12.903591] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-26T21:29:13.143872] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-26T21:29:13.511758] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-07. [2025-09-26T21:29:13.753849] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:29:13.754245] [WARN ] [REMOTE ] STUB: No data returned for month 2025-07 [2025-09-26T21:29:14.311726] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-07. [2025-09-26T21:29:14.351904] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-26T21:29:15.111728] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-08. [2025-09-26T21:29:15.314805] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:29:15.315227] [WARN ] [REMOTE ] STUB: No data returned for month 2025-08 [2025-09-26T21:29:15.911741] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-09. [2025-09-26T21:29:16.228163] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-26T21:29:16.711681] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-08. [2025-09-26T21:29:17.117202] [INFO ] [REMOTE ] STUB: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-26T21:29:17.121715] [INFO ] [REMOTE ] STUB: Full fetch complete (2946 records). [2025-09-26T21:29:17.121794] [DEBUG] [VALIDATOR ] STUB: Validating primary data. [2025-09-26T21:29:17.315095] [WARN ] [VALIDATOR ] STUB: Validation failed - insufficient historical data. Have 8 unique days, need 200 days [2025-09-26T21:29:17.315318] [FATAL] [MAIN ] STUB: Fetched primary data is invalid. Refusing to save it. [2025-09-26T21:29:17.315393] [WARN ] [MAIN ] STUB: Deleting existing primary and derivative data due to validation failure. [2025-09-26T21:29:17.315507] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-09-26T21:29:17.315675] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-09-26T21:29:17.315737] [INFO ] [LOCAL ] STUB: Starting deletion of derivative data. [2025-09-26T21:29:17.315798] [DEBUG] [LOCAL ] STUB: No derivative data file found to delete. [2025-09-26T21:29:17.315895] [INFO ] [MAIN ] Update Progress: 2016/2371 symbols completed. STUB took 24.7s. Estimated remaining: 47m 25s. Rate: 7.5 symbols/min [2025-09-26T21:29:17.501627] [INFO ] [MAIN ] STXD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:29:17.506067] [DEBUG] [LOCAL ] STXD: Loaded 1335 existing records from primary storage. [2025-09-26T21:29:17.506204] [INFO ] [MAIN ] STXD: Loaded 1335 existing records. [2025-09-26T21:29:17.518341] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-02. [2025-09-26T21:29:17.702143] [WARN ] [MAIN ] STXD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:29:17.702404] [INFO ] [MAIN ] STXD: Wiping existing primary data before full refresh. [2025-09-26T21:29:17.702455] [INFO ] [LOCAL ] STXD: Starting deletion of primary data. [2025-09-26T21:29:17.702842] [DEBUG] [LOCAL ] STXD: Deleted primary data file. [2025-09-26T21:29:17.702911] [INFO ] [MAIN ] STXD: Starting full primary refresh. [2025-09-26T21:29:18.097215] [INFO ] [REMOTE ] STXD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:29:18.311708] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-05. [2025-09-26T21:29:18.428217] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-26T21:29:19.111698] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-09. [2025-09-26T21:29:19.296588] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-26T21:29:19.352104] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-26T21:29:19.911718] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-03. [2025-09-26T21:29:20.711721] [INFO ] [REMOTE ] STXD: Fetching primary data for 2024-12. [2025-09-26T21:29:20.852001] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-26T21:29:20.862168] [INFO ] [REMOTE ] STT: Full fetch complete (74500 records). [2025-09-26T21:29:20.862331] [DEBUG] [VALIDATOR ] STT: Validating primary data. [2025-09-26T21:29:21.297938] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-26T21:29:21.301803] [DEBUG] [VALIDATOR ] STT: All expected trading days are present. [2025-09-26T21:29:21.303394] [DEBUG] [VALIDATOR ] STT: Primary data validation passed. [2025-09-26T21:29:21.304590] [INFO ] [MAIN ] STT: Fetched primary data is valid. [2025-09-26T21:29:21.304683] [DEBUG] [LOCAL ] STT: Saving primary data. [2025-09-26T21:29:21.306221] [DEBUG] [LOCAL ] STT: Trimmed 74500 records to 51793 (keeping 200 days of data) [2025-09-26T21:29:21.534009] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-06. [2025-09-26T21:29:21.657510] [DEBUG] [LOCAL ] STT: Primary data saved (51793 records). [2025-09-26T21:29:21.657692] [INFO ] [MAIN ] STT: Full history saved. [2025-09-26T21:29:21.657812] [INFO ] [MAIN ] Update Progress: 2017/2371 symbols completed. STT took 38.4s. Estimated remaining: 47m 16s. Rate: 7.5 symbols/min [2025-09-26T21:29:21.852037] [INFO ] [MAIN ] STXE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:29:21.896437] [DEBUG] [LOCAL ] STXE: Loaded 2216 existing records from primary storage. [2025-09-26T21:29:21.896184] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-26T21:29:21.907053] [INFO ] [MAIN ] STXE: Loaded 2216 existing records. [2025-09-26T21:29:22.100044] [WARN ] [MAIN ] STXE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:29:22.100302] [INFO ] [MAIN ] STXE: Wiping existing primary data before full refresh. [2025-09-26T21:29:22.100353] [INFO ] [LOCAL ] STXE: Starting deletion of primary data. [2025-09-26T21:29:22.100630] [DEBUG] [LOCAL ] STXE: Deleted primary data file. [2025-09-26T21:29:22.100723] [INFO ] [MAIN ] STXE: Starting full primary refresh. [2025-09-26T21:29:22.316870] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-04. [2025-09-26T21:29:22.483129] [INFO ] [REMOTE ] STXE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:29:22.814915] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-26T21:29:23.111734] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-01. [2025-09-26T21:29:23.557227] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-26T21:29:23.911693] [INFO ] [REMOTE ] STXE: Fetching primary data for 2024-12. [2025-09-26T21:29:24.189099] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-26T21:29:24.436282] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-26T21:29:24.711738] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-07. [2025-09-26T21:29:25.511707] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-01. [2025-09-26T21:29:25.864414] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-26T21:29:26.059219] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-26T21:29:26.311741] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-02. [2025-09-26T21:29:26.795417] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-26T21:29:27.111731] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-08. [2025-09-26T21:29:27.911740] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-05. [2025-09-26T21:29:28.353834] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-26T21:29:28.711725] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-09. [2025-09-26T21:29:29.511739] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-02. [2025-09-26T21:29:29.648493] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-26T21:29:29.964001] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-26T21:29:29.967019] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-26T21:29:29.973466] [INFO ] [REMOTE ] STVN: Full fetch complete (39435 records). [2025-09-26T21:29:29.973673] [DEBUG] [VALIDATOR ] STVN: Validating primary data. [2025-09-26T21:29:30.316818] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-06. [2025-09-26T21:29:30.394950] [DEBUG] [VALIDATOR ] STVN: All expected trading days are present. [2025-09-26T21:29:30.395038] [DEBUG] [VALIDATOR ] STVN: Primary data validation passed. [2025-09-26T21:29:30.395807] [INFO ] [MAIN ] STVN: Fetched primary data is valid. [2025-09-26T21:29:30.395871] [DEBUG] [LOCAL ] STVN: Saving primary data. [2025-09-26T21:29:30.396965] [DEBUG] [LOCAL ] STVN: Trimmed 39435 records to 26677 (keeping 200 days of data) [2025-09-26T21:29:30.573244] [DEBUG] [LOCAL ] STVN: Primary data saved (26677 records). [2025-09-26T21:29:30.573408] [INFO ] [MAIN ] STVN: Full history saved. [2025-09-26T21:29:30.573506] [INFO ] [MAIN ] Update Progress: 2018/2371 symbols completed. STVN took 35.4s. Estimated remaining: 47m 8s. Rate: 7.5 symbols/min [2025-09-26T21:29:30.774873] [INFO ] [MAIN ] STXG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:29:30.781209] [DEBUG] [LOCAL ] STXG: Loaded 2599 existing records from primary storage. [2025-09-26T21:29:30.781382] [INFO ] [MAIN ] STXG: Loaded 2599 existing records. [2025-09-26T21:29:30.989176] [WARN ] [MAIN ] STXG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:29:30.989449] [INFO ] [MAIN ] STXG: Wiping existing primary data before full refresh. [2025-09-26T21:29:30.989496] [INFO ] [LOCAL ] STXG: Starting deletion of primary data. [2025-09-26T21:29:30.989756] [DEBUG] [LOCAL ] STXG: Deleted primary data file. [2025-09-26T21:29:30.989816] [INFO ] [MAIN ] STXG: Starting full primary refresh. [2025-09-26T21:29:31.120410] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-03. [2025-09-26T21:29:31.368771] [INFO ] [REMOTE ] STXG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:29:31.793482] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-26T21:29:31.911742] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-03. [2025-09-26T21:29:32.052975] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-26T21:29:32.358989] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-26T21:29:32.711790] [INFO ] [REMOTE ] STXG: Fetching primary data for 2024-12. [2025-09-26T21:29:33.294227] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-26T21:29:33.511732] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-01. [2025-09-26T21:29:33.860530] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-26T21:29:34.311756] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-04. [2025-09-26T21:29:34.879747] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-26T21:29:35.111723] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-02. [2025-09-26T21:29:35.684829] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-26T21:29:35.911728] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-04. [2025-09-26T21:29:36.439684] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-26T21:29:36.711777] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-03. [2025-09-26T21:29:37.259397] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-26T21:29:37.511756] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-05. [2025-09-26T21:29:37.932707] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-26T21:29:38.311749] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-05. [2025-09-26T21:29:38.745143] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-26T21:29:39.111717] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-06. [2025-09-26T21:29:39.438906] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-26T21:29:39.911729] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-07. [2025-09-26T21:29:40.711818] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-04. [2025-09-26T21:29:41.374357] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-26T21:29:41.511743] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-05. [2025-09-26T21:29:41.747086] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-26T21:29:41.984040] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-26T21:29:42.311725] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-06. [2025-09-26T21:29:42.847365] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-26T21:29:43.111718] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-07. [2025-09-26T21:29:43.492098] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-26T21:29:43.911739] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-08. [2025-09-26T21:29:44.711735] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-06. [2025-09-26T21:29:45.163225] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-26T21:29:45.511716] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-07. [2025-09-26T21:29:45.574861] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-26T21:29:46.185281] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-26T21:29:46.311755] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-09. [2025-09-26T21:29:47.111743] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-08. [2025-09-26T21:29:47.602433] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-26T21:29:47.911737] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-07. [2025-09-26T21:29:48.076863] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-26T21:29:48.087417] [INFO ] [REMOTE ] STWD: Full fetch complete (75017 records). [2025-09-26T21:29:48.087631] [DEBUG] [VALIDATOR ] STWD: Validating primary data. [2025-09-26T21:29:48.406117] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-26T21:29:48.519531] [DEBUG] [VALIDATOR ] STWD: All expected trading days are present. [2025-09-26T21:29:48.519630] [DEBUG] [VALIDATOR ] STWD: Primary data validation passed. [2025-09-26T21:29:48.520823] [INFO ] [MAIN ] STWD: Fetched primary data is valid. [2025-09-26T21:29:48.520909] [DEBUG] [LOCAL ] STWD: Saving primary data. [2025-09-26T21:29:48.522534] [DEBUG] [LOCAL ] STWD: Trimmed 75017 records to 52643 (keeping 200 days of data) [2025-09-26T21:29:48.719481] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-08. [2025-09-26T21:29:48.867698] [DEBUG] [LOCAL ] STWD: Primary data saved (52643 records). [2025-09-26T21:29:48.867871] [INFO ] [MAIN ] STWD: Full history saved. [2025-09-26T21:29:48.867967] [INFO ] [MAIN ] Update Progress: 2019/2371 symbols completed. STWD took 41.9s. Estimated remaining: 47m 2s. Rate: 7.5 symbols/min [2025-09-26T21:29:49.055625] [INFO ] [MAIN ] STXK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:29:49.059540] [DEBUG] [LOCAL ] STXK: Loaded 1527 existing records from primary storage. [2025-09-26T21:29:49.059621] [INFO ] [MAIN ] STXK: Loaded 1527 existing records. [2025-09-26T21:29:49.135070] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-26T21:29:49.253519] [WARN ] [MAIN ] STXK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:29:49.253914] [INFO ] [MAIN ] STXK: Wiping existing primary data before full refresh. [2025-09-26T21:29:49.253973] [INFO ] [LOCAL ] STXK: Starting deletion of primary data. [2025-09-26T21:29:49.254178] [DEBUG] [LOCAL ] STXK: Deleted primary data file. [2025-09-26T21:29:49.254238] [INFO ] [MAIN ] STXK: Starting full primary refresh. [2025-09-26T21:29:49.516906] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-09. [2025-09-26T21:29:49.634748] [INFO ] [REMOTE ] STXK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:29:49.922731] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-26T21:29:49.923845] [INFO ] [REMOTE ] STXG: Full fetch complete (4178 records). [2025-09-26T21:29:49.923918] [DEBUG] [VALIDATOR ] STXG: Validating primary data. [2025-09-26T21:29:50.315226] [DEBUG] [VALIDATOR ] STXG: All expected trading days are present. [2025-09-26T21:29:50.314858] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-09. [2025-09-26T21:29:50.315445] [DEBUG] [VALIDATOR ] STXG: Primary data validation passed. [2025-09-26T21:29:50.316786] [INFO ] [MAIN ] STXG: Fetched primary data is valid. [2025-09-26T21:29:50.316855] [DEBUG] [LOCAL ] STXG: Saving primary data. [2025-09-26T21:29:50.317388] [DEBUG] [LOCAL ] STXG: Trimmed 4178 records to 2612 (keeping 200 days of data) [2025-09-26T21:29:50.334691] [DEBUG] [LOCAL ] STXG: Primary data saved (2612 records). [2025-09-26T21:29:50.335323] [INFO ] [MAIN ] STXG: Full history saved. [2025-09-26T21:29:50.335475] [INFO ] [MAIN ] Update Progress: 2020/2371 symbols completed. STXG took 19.8s. Estimated remaining: 46m 53s. Rate: 7.5 symbols/min [2025-09-26T21:29:50.524793] [INFO ] [MAIN ] STXM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:29:50.525040] [DEBUG] [LOCAL ] STXM: No existing data file found in primary storage. [2025-09-26T21:29:50.525094] [WARN ] [MAIN ] STXM: No existing data found, performing full refresh instead. [2025-09-26T21:29:50.525295] [INFO ] [MAIN ] STXM: Wiping existing primary data before full refresh. [2025-09-26T21:29:50.525353] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-09-26T21:29:50.525399] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-09-26T21:29:50.525442] [INFO ] [MAIN ] STXM: Starting full primary refresh. [2025-09-26T21:29:50.723487] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-26T21:29:50.758276] [INFO ] [REMOTE ] STXD: Full fetch complete (2064 records). [2025-09-26T21:29:50.808267] [DEBUG] [VALIDATOR ] STXD: Validating primary data. [2025-09-26T21:29:51.110565] [INFO ] [REMOTE ] STXM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:29:51.127114] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-08. [2025-09-26T21:29:51.344058] [DEBUG] [VALIDATOR ] STXD: All expected trading days are present. [2025-09-26T21:29:51.344142] [DEBUG] [VALIDATOR ] STXD: Primary data validation passed. [2025-09-26T21:29:51.344261] [INFO ] [MAIN ] STXD: Fetched primary data is valid. [2025-09-26T21:29:51.344301] [DEBUG] [LOCAL ] STXD: Saving primary data. [2025-09-26T21:29:51.344664] [DEBUG] [LOCAL ] STXD: Trimmed 2064 records to 1341 (keeping 200 days of data) [2025-09-26T21:29:51.353859] [DEBUG] [LOCAL ] STXD: Primary data saved (1341 records). [2025-09-26T21:29:51.353923] [INFO ] [MAIN ] STXD: Full history saved. [2025-09-26T21:29:51.354000] [INFO ] [MAIN ] Update Progress: 2021/2371 symbols completed. STXD took 34.0s. Estimated remaining: 46m 44s. Rate: 7.5 symbols/min [2025-09-26T21:29:51.536635] [INFO ] [MAIN ] STXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:29:51.541685] [DEBUG] [LOCAL ] STXT: Loaded 2574 existing records from primary storage. [2025-09-26T21:29:51.541807] [INFO ] [MAIN ] STXT: Loaded 2574 existing records. [2025-09-26T21:29:51.662392] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-26T21:29:51.743401] [WARN ] [MAIN ] STXT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:29:51.743729] [INFO ] [MAIN ] STXT: Wiping existing primary data before full refresh. [2025-09-26T21:29:51.743788] [INFO ] [LOCAL ] STXT: Starting deletion of primary data. [2025-09-26T21:29:51.744037] [DEBUG] [LOCAL ] STXT: Deleted primary data file. [2025-09-26T21:29:51.744100] [INFO ] [MAIN ] STXT: Starting full primary refresh. [2025-09-26T21:29:51.916841] [INFO ] [REMOTE ] STXK: Fetching primary data for 2024-12. [2025-09-26T21:29:52.154837] [INFO ] [REMOTE ] STXT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:29:52.641200] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-26T21:29:52.711727] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-01. [2025-09-26T21:29:53.507868] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-26T21:29:53.511664] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-02. [2025-09-26T21:29:54.016125] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-26T21:29:54.311731] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-03. [2025-09-26T21:29:54.821869] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-26T21:29:55.111726] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-09. [2025-09-26T21:29:55.780390] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-26T21:29:55.781576] [INFO ] [REMOTE ] STXE: Full fetch complete (3698 records). [2025-09-26T21:29:55.781727] [DEBUG] [VALIDATOR ] STXE: Validating primary data. [2025-09-26T21:29:55.916872] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-04. [2025-09-26T21:29:56.222880] [DEBUG] [VALIDATOR ] STXE: All expected trading days are present. [2025-09-26T21:29:56.222983] [DEBUG] [VALIDATOR ] STXE: Primary data validation passed. [2025-09-26T21:29:56.223152] [INFO ] [MAIN ] STXE: Fetched primary data is valid. [2025-09-26T21:29:56.223190] [DEBUG] [LOCAL ] STXE: Saving primary data. [2025-09-26T21:29:56.223565] [DEBUG] [LOCAL ] STXE: Trimmed 3698 records to 2234 (keeping 200 days of data) [2025-09-26T21:29:56.237973] [DEBUG] [LOCAL ] STXE: Primary data saved (2234 records). [2025-09-26T21:29:56.238035] [INFO ] [MAIN ] STXE: Full history saved. [2025-09-26T21:29:56.238131] [INFO ] [MAIN ] Update Progress: 2022/2371 symbols completed. STXE took 34.6s. Estimated remaining: 46m 35s. Rate: 7.5 symbols/min [2025-09-26T21:29:56.414837] [INFO ] [MAIN ] STXV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:29:56.418768] [DEBUG] [LOCAL ] STXV: Loaded 1645 existing records from primary storage. [2025-09-26T21:29:56.418853] [INFO ] [MAIN ] STXV: Loaded 1645 existing records. [2025-09-26T21:29:56.527740] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-26T21:29:56.606949] [WARN ] [MAIN ] STXV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:29:56.607229] [INFO ] [MAIN ] STXV: Wiping existing primary data before full refresh. [2025-09-26T21:29:56.607279] [INFO ] [LOCAL ] STXV: Starting deletion of primary data. [2025-09-26T21:29:56.607511] [DEBUG] [LOCAL ] STXV: Deleted primary data file. [2025-09-26T21:29:56.607575] [INFO ] [MAIN ] STXV: Starting full primary refresh. [2025-09-26T21:29:56.716898] [INFO ] [REMOTE ] STXM: Fetching primary data for 2024-12. [2025-09-26T21:29:56.967117] [INFO ] [REMOTE ] STXV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:29:57.142569] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-26T21:29:57.511740] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-01. [2025-09-26T21:29:57.935962] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-26T21:29:58.311729] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-05. [2025-09-26T21:29:58.751723] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-26T21:29:59.111725] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-06. [2025-09-26T21:29:59.539199] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-26T21:29:59.911745] [INFO ] [REMOTE ] STXV: Fetching primary data for 2024-12. [2025-09-26T21:30:00.392028] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-26T21:30:00.711733] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-01. [2025-09-26T21:30:01.357359] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-26T21:30:01.511731] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-02. [2025-09-26T21:30:01.972285] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-26T21:30:02.311734] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-03. [2025-09-26T21:30:02.787233] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-26T21:30:03.111736] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-04. [2025-09-26T21:30:03.594873] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-26T21:30:03.911723] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-07. [2025-09-26T21:30:04.250234] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-26T21:30:04.711730] [INFO ] [REMOTE ] STXT: Fetching primary data for 2024-12. [2025-09-26T21:30:05.423682] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-26T21:30:05.511725] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-02. [2025-09-26T21:30:05.955080] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-26T21:30:06.311742] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-08. [2025-09-26T21:30:06.817233] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-26T21:30:07.111728] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-09. [2025-09-26T21:30:07.458412] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-26T21:30:07.459397] [INFO ] [REMOTE ] STXK: Full fetch complete (2423 records). [2025-09-26T21:30:07.459470] [DEBUG] [VALIDATOR ] STXK: Validating primary data. [2025-09-26T21:30:07.850405] [DEBUG] [VALIDATOR ] STXK: All expected trading days are present. [2025-09-26T21:30:07.850588] [DEBUG] [VALIDATOR ] STXK: Primary data validation passed. [2025-09-26T21:30:07.850759] [INFO ] [MAIN ] STXK: Fetched primary data is valid. [2025-09-26T21:30:07.850823] [DEBUG] [LOCAL ] STXK: Saving primary data. [2025-09-26T21:30:07.851256] [DEBUG] [LOCAL ] STXK: Trimmed 2423 records to 1535 (keeping 200 days of data) [2025-09-26T21:30:07.862412] [DEBUG] [LOCAL ] STXK: Primary data saved (1535 records). [2025-09-26T21:30:07.862495] [INFO ] [MAIN ] STXK: Full history saved. [2025-09-26T21:30:07.862599] [INFO ] [MAIN ] Update Progress: 2023/2371 symbols completed. STXK took 19.0s. Estimated remaining: 46m 28s. Rate: 7.5 symbols/min [2025-09-26T21:30:07.916860] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-03. [2025-09-26T21:30:08.070705] [INFO ] [MAIN ] STZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:30:08.135999] [DEBUG] [LOCAL ] STZ: Loaded 52652 existing records from primary storage. [2025-09-26T21:30:08.136204] [INFO ] [MAIN ] STZ: Loaded 52652 existing records. [2025-09-26T21:30:08.325015] [WARN ] [MAIN ] STZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:30:08.325360] [INFO ] [MAIN ] STZ: Wiping existing primary data before full refresh. [2025-09-26T21:30:08.325412] [INFO ] [LOCAL ] STZ: Starting deletion of primary data. [2025-09-26T21:30:08.327136] [DEBUG] [LOCAL ] STZ: Deleted primary data file. [2025-09-26T21:30:08.327203] [INFO ] [MAIN ] STZ: Starting full primary refresh. [2025-09-26T21:30:08.396219] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-26T21:30:08.716895] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-05. [2025-09-26T21:30:08.796558] [INFO ] [REMOTE ] STZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:30:09.276175] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-26T21:30:09.511712] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-06. [2025-09-26T21:30:09.977841] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-26T21:30:10.311726] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-01. [2025-09-26T21:30:10.936815] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-26T21:30:11.111757] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-02. [2025-09-26T21:30:11.701116] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-26T21:30:11.911720] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-04. [2025-09-26T21:30:12.360747] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-26T21:30:12.711721] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-03. [2025-09-26T21:30:13.265294] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-26T21:30:13.511748] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-05. [2025-09-26T21:30:14.028765] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-26T21:30:14.311760] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-06. [2025-09-26T21:30:14.640852] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-26T21:30:15.111735] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-04. [2025-09-26T21:30:15.594312] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-26T21:30:15.911764] [INFO ] [REMOTE ] STZ: Fetching primary data for 2024-12. [2025-09-26T21:30:16.711758] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-07. [2025-09-26T21:30:17.042214] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-26T21:30:17.511732] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-07. [2025-09-26T21:30:17.786583] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-26T21:30:17.969449] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-26T21:30:18.311758] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-08. [2025-09-26T21:30:18.749664] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-26T21:30:19.111729] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-08. [2025-09-26T21:30:19.465624] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-26T21:30:19.911726] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-09. [2025-09-26T21:30:20.335730] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-26T21:30:20.337027] [INFO ] [REMOTE ] STXV: Full fetch complete (2612 records). [2025-09-26T21:30:20.337223] [DEBUG] [VALIDATOR ] STXV: Validating primary data. [2025-09-26T21:30:20.722045] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-09. [2025-09-26T21:30:20.730772] [DEBUG] [VALIDATOR ] STXV: All expected trading days are present. [2025-09-26T21:30:20.730870] [DEBUG] [VALIDATOR ] STXV: Primary data validation passed. [2025-09-26T21:30:20.731006] [INFO ] [MAIN ] STXV: Fetched primary data is valid. [2025-09-26T21:30:20.731110] [DEBUG] [LOCAL ] STXV: Saving primary data. [2025-09-26T21:30:20.731753] [DEBUG] [LOCAL ] STXV: Trimmed 2612 records to 1648 (keeping 200 days of data) [2025-09-26T21:30:20.745759] [DEBUG] [LOCAL ] STXV: Primary data saved (1648 records). [2025-09-26T21:30:20.745910] [INFO ] [MAIN ] STXV: Full history saved. [2025-09-26T21:30:20.746111] [INFO ] [MAIN ] Update Progress: 2024/2371 symbols completed. STXV took 24.5s. Estimated remaining: 46m 20s. Rate: 7.5 symbols/min [2025-09-26T21:30:20.939058] [INFO ] [MAIN ] SU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:30:21.015334] [DEBUG] [LOCAL ] SU: Loaded 53845 existing records from primary storage. [2025-09-26T21:30:21.015522] [INFO ] [MAIN ] SU: Loaded 53845 existing records. [2025-09-26T21:30:21.105401] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-26T21:30:21.135714] [INFO ] [REMOTE ] STXM: Full fetch complete (1431 records). [2025-09-26T21:30:21.139813] [DEBUG] [VALIDATOR ] STXM: Validating primary data. [2025-09-26T21:30:21.353257] [WARN ] [MAIN ] SU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:30:21.394619] [INFO ] [MAIN ] SU: Wiping existing primary data before full refresh. [2025-09-26T21:30:21.405814] [INFO ] [LOCAL ] SU: Starting deletion of primary data. [2025-09-26T21:30:21.441269] [WARN ] [VALIDATOR ] STXM: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-26T21:30:21.441737] [FATAL] [MAIN ] STXM: Fetched primary data is invalid. Refusing to save it. [2025-09-26T21:30:21.441875] [WARN ] [MAIN ] STXM: Deleting existing primary and derivative data due to validation failure. [2025-09-26T21:30:21.441955] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-09-26T21:30:21.442036] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-09-26T21:30:21.442136] [INFO ] [LOCAL ] STXM: Starting deletion of derivative data. [2025-09-26T21:30:21.442253] [DEBUG] [LOCAL ] STXM: No derivative data file found to delete. [2025-09-26T21:30:21.442392] [INFO ] [MAIN ] Update Progress: 2025/2371 symbols completed. STXM took 31.1s. Estimated remaining: 46m 11s. Rate: 7.5 symbols/min [2025-09-26T21:30:21.447983] [DEBUG] [LOCAL ] SU: Deleted primary data file. [2025-09-26T21:30:21.491874] [INFO ] [MAIN ] SU: Starting full primary refresh. [2025-09-26T21:30:21.520789] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-05. [2025-09-26T21:30:21.769564] [INFO ] [MAIN ] SUI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:30:22.084278] [INFO ] [REMOTE ] SU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:30:22.105593] [DEBUG] [LOCAL ] SUI: Loaded 42259 existing records from primary storage. [2025-09-26T21:30:22.105783] [INFO ] [MAIN ] SUI: Loaded 42259 existing records. [2025-09-26T21:30:22.231252] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-26T21:30:22.316543] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-01. [2025-09-26T21:30:22.399957] [WARN ] [MAIN ] SUI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:30:22.401180] [INFO ] [MAIN ] SUI: Wiping existing primary data before full refresh. [2025-09-26T21:30:22.401358] [INFO ] [LOCAL ] SUI: Starting deletion of primary data. [2025-09-26T21:30:22.402758] [DEBUG] [LOCAL ] SUI: Deleted primary data file. [2025-09-26T21:30:22.402826] [INFO ] [MAIN ] SUI: Starting full primary refresh. [2025-09-26T21:30:22.827575] [INFO ] [REMOTE ] SUI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:30:23.111746] [INFO ] [REMOTE ] SUI: Fetching primary data for 2024-12. [2025-09-26T21:30:23.911750] [INFO ] [REMOTE ] SU: Fetching primary data for 2024-12. [2025-09-26T21:30:24.403791] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-26T21:30:24.711791] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-06. [2025-09-26T21:30:24.763187] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-26T21:30:25.433211] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-26T21:30:25.511716] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-07. [2025-09-26T21:30:25.714411] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T21:30:26.061791] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-26T21:30:26.311749] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-08. [2025-09-26T21:30:26.801474] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-26T21:30:27.111783] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-01. [2025-09-26T21:30:27.911751] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-09. [2025-09-26T21:30:28.361151] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-26T21:30:28.362311] [INFO ] [REMOTE ] STXT: Full fetch complete (3999 records). [2025-09-26T21:30:28.362425] [DEBUG] [VALIDATOR ] STXT: Validating primary data. [2025-09-26T21:30:28.711802] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-01. [2025-09-26T21:30:28.820347] [DEBUG] [VALIDATOR ] STXT: All expected trading days are present. [2025-09-26T21:30:28.820506] [DEBUG] [VALIDATOR ] STXT: Primary data validation passed. [2025-09-26T21:30:28.820724] [INFO ] [MAIN ] STXT: Fetched primary data is valid. [2025-09-26T21:30:28.820843] [DEBUG] [LOCAL ] STXT: Saving primary data. [2025-09-26T21:30:28.843986] [DEBUG] [LOCAL ] STXT: Trimmed 3999 records to 2592 (keeping 200 days of data) [2025-09-26T21:30:28.849691] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-26T21:30:28.876601] [DEBUG] [LOCAL ] STXT: Primary data saved (2592 records). [2025-09-26T21:30:28.876826] [INFO ] [MAIN ] STXT: Full history saved. [2025-09-26T21:30:28.876961] [INFO ] [MAIN ] Update Progress: 2026/2371 symbols completed. STXT took 37.5s. Estimated remaining: 46m 3s. Rate: 7.5 symbols/min [2025-09-26T21:30:29.059282] [INFO ] [MAIN ] SUN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:30:29.119591] [DEBUG] [LOCAL ] SUN: Loaded 37657 existing records from primary storage. [2025-09-26T21:30:29.119779] [INFO ] [MAIN ] SUN: Loaded 37657 existing records. [2025-09-26T21:30:29.315130] [WARN ] [MAIN ] SUN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:30:29.315462] [INFO ] [MAIN ] SUN: Wiping existing primary data before full refresh. [2025-09-26T21:30:29.315530] [INFO ] [LOCAL ] SUN: Starting deletion of primary data. [2025-09-26T21:30:29.316314] [DEBUG] [LOCAL ] SUN: Deleted primary data file. [2025-09-26T21:30:29.316378] [INFO ] [MAIN ] SUN: Starting full primary refresh. [2025-09-26T21:30:29.520616] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-02. [2025-09-26T21:30:29.726213] [INFO ] [REMOTE ] SUN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:30:30.311753] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-02. [2025-09-26T21:30:30.471503] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-26T21:30:31.111735] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-02. [2025-09-26T21:30:31.239911] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-26T21:30:31.911791] [INFO ] [REMOTE ] SUN: Fetching primary data for 2024-12. [2025-09-26T21:30:32.584004] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-09-26T21:30:32.711716] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-03. [2025-09-26T21:30:32.996241] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-26T21:30:33.359604] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-26T21:30:33.511728] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-01. [2025-09-26T21:30:34.311962] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-03. [2025-09-26T21:30:34.843852] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-26T21:30:34.966180] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-26T21:30:35.111718] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-04. [2025-09-26T21:30:35.911720] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-02. [2025-09-26T21:30:35.975046] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-26T21:30:36.711753] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-03. [2025-09-26T21:30:37.081683] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-26T21:30:37.141900] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-26T21:30:37.511733] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-04. [2025-09-26T21:30:38.311720] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-03. [2025-09-26T21:30:38.726493] [DEBUG] [REMOTE ] SUN: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-09-26T21:30:38.726956] [WARN ] [REMOTE ] SUN: No data returned for month 2025-03 [2025-09-26T21:30:38.767802] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-26T21:30:39.111731] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-04. [2025-09-26T21:30:39.166882] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-26T21:30:39.911726] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-04. [2025-09-26T21:30:40.574906] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-26T21:30:40.711726] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-05. [2025-09-26T21:30:41.511730] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-05. [2025-09-26T21:30:41.733495] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-26T21:30:42.311701] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-05. [2025-09-26T21:30:42.677173] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-26T21:30:43.117091] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-06. [2025-09-26T21:30:43.134417] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-26T21:30:43.911720] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-06. [2025-09-26T21:30:44.063361] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-26T21:30:44.711766] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-06. [2025-09-26T21:30:45.180137] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-26T21:30:45.377447] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-26T21:30:45.511732] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-07. [2025-09-26T21:30:46.150385] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-26T21:30:46.311721] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-07. [2025-09-26T21:30:47.029909] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-26T21:30:47.111744] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-08. [2025-09-26T21:30:47.911712] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-07. [2025-09-26T21:30:48.306879] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-26T21:30:48.633296] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-26T21:30:48.711731] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-05. [2025-09-26T21:30:49.511738] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-08. [2025-09-26T21:30:49.560954] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-26T21:30:50.311732] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-09. [2025-09-26T21:30:50.638937] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-26T21:30:51.111781] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-06. [2025-09-26T21:30:51.775195] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-26T21:30:51.783051] [INFO ] [REMOTE ] SUN: Full fetch complete (49418 records). [2025-09-26T21:30:51.783330] [DEBUG] [VALIDATOR ] SUN: Validating primary data. [2025-09-26T21:30:51.933306] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-08. [2025-09-26T21:30:51.999860] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-09-26T21:30:52.046349] [WARN ] [VALIDATOR ] SUN: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-26T21:30:52.047149] [FATAL] [MAIN ] SUN: Fetched primary data is invalid. Refusing to save it. [2025-09-26T21:30:52.047602] [WARN ] [MAIN ] SUN: Deleting existing primary and derivative data due to validation failure. [2025-09-26T21:30:52.047900] [INFO ] [LOCAL ] SUN: Starting deletion of primary data. [2025-09-26T21:30:52.047981] [DEBUG] [LOCAL ] SUN: No primary data file found to delete. [2025-09-26T21:30:52.048050] [INFO ] [LOCAL ] SUN: Starting deletion of derivative data. [2025-09-26T21:30:52.048709] [DEBUG] [LOCAL ] SUN: Deleted derivative data file. [2025-09-26T21:30:52.048822] [INFO ] [MAIN ] Update Progress: 2027/2371 symbols completed. SUN took 23.2s. Estimated remaining: 45m 58s. Rate: 7.5 symbols/min [2025-09-26T21:30:52.231243] [INFO ] [MAIN ] SUPV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:30:52.280314] [DEBUG] [LOCAL ] SUPV: Loaded 47575 existing records from primary storage. [2025-09-26T21:30:52.280464] [INFO ] [MAIN ] SUPV: Loaded 47575 existing records. [2025-09-26T21:30:52.467436] [WARN ] [MAIN ] SUPV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:30:52.467743] [INFO ] [MAIN ] SUPV: Wiping existing primary data before full refresh. [2025-09-26T21:30:52.467801] [INFO ] [LOCAL ] SUPV: Starting deletion of primary data. [2025-09-26T21:30:52.468770] [DEBUG] [LOCAL ] SUPV: Deleted primary data file. [2025-09-26T21:30:52.468832] [INFO ] [MAIN ] SUPV: Starting full primary refresh. [2025-09-26T21:30:52.718867] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-09. [2025-09-26T21:30:52.836911] [INFO ] [REMOTE ] SUPV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:30:52.889403] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-26T21:30:53.187917] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-26T21:30:53.511751] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2024-12. [2025-09-26T21:30:54.311738] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-07. [2025-09-26T21:30:55.111740] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-09. [2025-09-26T21:30:55.214004] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-09-26T21:30:55.225313] [INFO ] [REMOTE ] STZ: Full fetch complete (75790 records). [2025-09-26T21:30:55.240598] [DEBUG] [VALIDATOR ] STZ: Validating primary data. [2025-09-26T21:30:55.293955] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-26T21:30:55.685851] [DEBUG] [VALIDATOR ] STZ: All expected trading days are present. [2025-09-26T21:30:55.685953] [DEBUG] [VALIDATOR ] STZ: Primary data validation passed. [2025-09-26T21:30:55.687106] [INFO ] [MAIN ] STZ: Fetched primary data is valid. [2025-09-26T21:30:55.687175] [DEBUG] [LOCAL ] STZ: Saving primary data. [2025-09-26T21:30:55.690626] [DEBUG] [LOCAL ] STZ: Trimmed 75790 records to 53035 (keeping 200 days of data) [2025-09-26T21:30:55.925681] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-01. [2025-09-26T21:30:56.055297] [DEBUG] [LOCAL ] STZ: Primary data saved (53035 records). [2025-09-26T21:30:56.055511] [INFO ] [MAIN ] STZ: Full history saved. [2025-09-26T21:30:56.055695] [INFO ] [MAIN ] Update Progress: 2028/2371 symbols completed. STZ took 48.2s. Estimated remaining: 45m 49s. Rate: 7.5 symbols/min [2025-09-26T21:30:56.238072] [INFO ] [MAIN ] SUZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:30:56.299421] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-26T21:30:56.328045] [DEBUG] [LOCAL ] SUZ: Loaded 46114 existing records from primary storage. [2025-09-26T21:30:56.328221] [INFO ] [MAIN ] SUZ: Loaded 46114 existing records. [2025-09-26T21:30:56.534088] [WARN ] [MAIN ] SUZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:30:56.534405] [INFO ] [MAIN ] SUZ: Wiping existing primary data before full refresh. [2025-09-26T21:30:56.534515] [INFO ] [LOCAL ] SUZ: Starting deletion of primary data. [2025-09-26T21:30:56.535567] [DEBUG] [LOCAL ] SUZ: Deleted primary data file. [2025-09-26T21:30:56.535633] [INFO ] [MAIN ] SUZ: Starting full primary refresh. [2025-09-26T21:30:56.718254] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-08. [2025-09-26T21:30:56.888701] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-26T21:30:56.957566] [INFO ] [REMOTE ] SUI: Full fetch complete (61001 records). [2025-09-26T21:30:56.979455] [INFO ] [REMOTE ] SUZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:30:56.979601] [DEBUG] [VALIDATOR ] SUI: Validating primary data. [2025-09-26T21:30:57.396776] [DEBUG] [VALIDATOR ] SUI: All expected trading days are present. [2025-09-26T21:30:57.396955] [DEBUG] [VALIDATOR ] SUI: Primary data validation passed. [2025-09-26T21:30:57.397952] [INFO ] [MAIN ] SUI: Fetched primary data is valid. [2025-09-26T21:30:57.398020] [DEBUG] [LOCAL ] SUI: Saving primary data. [2025-09-26T21:30:57.399369] [DEBUG] [LOCAL ] SUI: Trimmed 61001 records to 42505 (keeping 200 days of data) [2025-09-26T21:30:57.518770] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2024-12. [2025-09-26T21:30:57.693259] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-26T21:30:57.725797] [DEBUG] [LOCAL ] SUI: Primary data saved (42505 records). [2025-09-26T21:30:57.725952] [INFO ] [MAIN ] SUI: Full history saved. [2025-09-26T21:30:57.726053] [INFO ] [MAIN ] Update Progress: 2029/2371 symbols completed. SUI took 36.3s. Estimated remaining: 45m 40s. Rate: 7.5 symbols/min [2025-09-26T21:30:57.924900] [INFO ] [MAIN ] SVV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:30:57.974716] [DEBUG] [LOCAL ] SVV: Loaded 39864 existing records from primary storage. [2025-09-26T21:30:57.974918] [INFO ] [MAIN ] SVV: Loaded 39864 existing records. [2025-09-26T21:30:58.170967] [WARN ] [MAIN ] SVV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:30:58.171244] [INFO ] [MAIN ] SVV: Wiping existing primary data before full refresh. [2025-09-26T21:30:58.171301] [INFO ] [LOCAL ] SVV: Starting deletion of primary data. [2025-09-26T21:30:58.172123] [DEBUG] [LOCAL ] SVV: Deleted primary data file. [2025-09-26T21:30:58.172184] [INFO ] [MAIN ] SVV: Starting full primary refresh. [2025-09-26T21:30:58.322183] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-02. [2025-09-26T21:30:58.560252] [INFO ] [REMOTE ] SVV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:30:58.701549] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-26T21:30:59.111746] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-09. [2025-09-26T21:30:59.264077] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-26T21:30:59.911711] [INFO ] [REMOTE ] SVV: Fetching primary data for 2024-12. [2025-09-26T21:31:00.021208] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-26T21:31:00.711737] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-03. [2025-09-26T21:31:01.145099] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-26T21:31:01.157995] [INFO ] [REMOTE ] SU: Full fetch complete (77396 records). [2025-09-26T21:31:01.158208] [DEBUG] [VALIDATOR ] SU: Validating primary data. [2025-09-26T21:31:01.519843] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-01. [2025-09-26T21:31:01.537886] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-26T21:31:01.665040] [DEBUG] [VALIDATOR ] SU: All expected trading days are present. [2025-09-26T21:31:01.665135] [DEBUG] [VALIDATOR ] SU: Primary data validation passed. [2025-09-26T21:31:01.666206] [INFO ] [MAIN ] SU: Fetched primary data is valid. [2025-09-26T21:31:01.666273] [DEBUG] [LOCAL ] SU: Saving primary data. [2025-09-26T21:31:01.669585] [DEBUG] [LOCAL ] SU: Trimmed 77396 records to 54234 (keeping 200 days of data) [2025-09-26T21:31:01.962700] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-26T21:31:02.073479] [DEBUG] [LOCAL ] SU: Primary data saved (54234 records). [2025-09-26T21:31:02.073638] [INFO ] [MAIN ] SU: Full history saved. [2025-09-26T21:31:02.073797] [INFO ] [MAIN ] Update Progress: 2030/2371 symbols completed. SU took 41.3s. Estimated remaining: 45m 31s. Rate: 7.5 symbols/min [2025-09-26T21:31:02.282195] [INFO ] [MAIN ] SW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:31:02.315861] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-01. [2025-09-26T21:31:02.341716] [DEBUG] [LOCAL ] SW: Loaded 53551 existing records from primary storage. [2025-09-26T21:31:02.341908] [INFO ] [MAIN ] SW: Loaded 53551 existing records. [2025-09-26T21:31:02.591492] [WARN ] [MAIN ] SW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:31:02.591834] [INFO ] [MAIN ] SW: Wiping existing primary data before full refresh. [2025-09-26T21:31:02.591907] [INFO ] [LOCAL ] SW: Starting deletion of primary data. [2025-09-26T21:31:02.593327] [DEBUG] [LOCAL ] SW: Deleted primary data file. [2025-09-26T21:31:02.593399] [INFO ] [MAIN ] SW: Starting full primary refresh. [2025-09-26T21:31:03.041850] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-26T21:31:03.047988] [INFO ] [REMOTE ] SW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:31:03.111738] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-02. [2025-09-26T21:31:03.742980] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-26T21:31:03.911731] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-04. [2025-09-26T21:31:04.691980] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-26T21:31:04.711696] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-03. [2025-09-26T21:31:05.511721] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-02. [2025-09-26T21:31:05.714233] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-26T21:31:06.297524] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-26T21:31:06.311661] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-04. [2025-09-26T21:31:06.808683] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-26T21:31:07.111749] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-03. [2025-09-26T21:31:07.911693] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-05. [2025-09-26T21:31:08.028818] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T21:31:08.593041] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-26T21:31:08.711744] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-04. [2025-09-26T21:31:09.494066] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-26T21:31:09.511682] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-06. [2025-09-26T21:31:10.311204] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T21:31:10.319904] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-05. [2025-09-26T21:31:11.111697] [INFO ] [REMOTE ] SW: Fetching primary data for 2024-12. [2025-09-26T21:31:11.157786] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-26T21:31:11.911728] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-07. [2025-09-26T21:31:12.047131] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-26T21:31:12.711699] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-06. [2025-09-26T21:31:13.021712] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-26T21:31:13.511745] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-01. [2025-09-26T21:31:13.605629] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-26T21:31:14.304399] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-26T21:31:14.313603] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-08. [2025-09-26T21:31:15.111746] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-05. [2025-09-26T21:31:15.329058] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-26T21:31:15.911727] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-07. [2025-09-26T21:31:16.000235] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-26T21:31:16.624271] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-26T21:31:16.711738] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-02. [2025-09-26T21:31:17.511696] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-06. [2025-09-26T21:31:17.657529] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-26T21:31:18.311701] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-08. [2025-09-26T21:31:18.423067] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-26T21:31:18.478105] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-26T21:31:19.111723] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-03. [2025-09-26T21:31:19.807790] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-26T21:31:19.911728] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-09. [2025-09-26T21:31:20.711951] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-09. [2025-09-26T21:31:21.027249] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-26T21:31:21.517508] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-04. [2025-09-26T21:31:21.532261] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-26T21:31:21.547614] [INFO ] [REMOTE ] SUPV: Full fetch complete (68274 records). [2025-09-26T21:31:21.547934] [DEBUG] [VALIDATOR ] SUPV: Validating primary data. [2025-09-26T21:31:21.981841] [DEBUG] [VALIDATOR ] SUPV: All expected trading days are present. [2025-09-26T21:31:21.981973] [DEBUG] [VALIDATOR ] SUPV: Primary data validation passed. [2025-09-26T21:31:21.983756] [INFO ] [MAIN ] SUPV: Fetched primary data is valid. [2025-09-26T21:31:21.983857] [DEBUG] [LOCAL ] SUPV: Saving primary data. [2025-09-26T21:31:22.009527] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-26T21:31:22.009756] [DEBUG] [LOCAL ] SUPV: Trimmed 68274 records to 47961 (keeping 200 days of data) [2025-09-26T21:31:22.019632] [INFO ] [REMOTE ] SUZ: Full fetch complete (66963 records). [2025-09-26T21:31:22.020148] [DEBUG] [VALIDATOR ] SUZ: Validating primary data. [2025-09-26T21:31:22.322040] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-07. [2025-09-26T21:31:22.630170] [DEBUG] [VALIDATOR ] SUZ: All expected trading days are present. [2025-09-26T21:31:22.630358] [DEBUG] [VALIDATOR ] SUZ: Primary data validation passed. [2025-09-26T21:31:22.631736] [INFO ] [MAIN ] SUZ: Fetched primary data is valid. [2025-09-26T21:31:22.631844] [DEBUG] [LOCAL ] SUZ: Saving primary data. [2025-09-26T21:31:22.717564] [DEBUG] [LOCAL ] SUZ: Trimmed 66963 records to 46428 (keeping 200 days of data) [2025-09-26T21:31:23.008992] [DEBUG] [LOCAL ] SUZ: Primary data saved (46428 records). [2025-09-26T21:31:23.010427] [INFO ] [MAIN ] SUZ: Full history saved. [2025-09-26T21:31:23.010923] [INFO ] [MAIN ] Update Progress: 2031/2371 symbols completed. SUZ took 27.0s. Estimated remaining: 45m 25s. Rate: 7.5 symbols/min [2025-09-26T21:31:23.215483] [INFO ] [MAIN ] SWK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:31:23.279236] [DEBUG] [LOCAL ] SUPV: Primary data saved (47961 records). [2025-09-26T21:31:23.294548] [INFO ] [MAIN ] SUPV: Full history saved. [2025-09-26T21:31:23.294865] [INFO ] [MAIN ] Update Progress: 2032/2371 symbols completed. SUPV took 31.2s. Estimated remaining: 45m 16s. Rate: 7.5 symbols/min [2025-09-26T21:31:23.430692] [DEBUG] [LOCAL ] SWK: Loaded 52803 existing records from primary storage. [2025-09-26T21:31:23.436497] [INFO ] [MAIN ] SWK: Loaded 52803 existing records. [2025-09-26T21:31:23.564425] [INFO ] [MAIN ] SWX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:31:23.823326] [WARN ] [MAIN ] SWK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:31:23.839470] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-26T21:31:23.840699] [DEBUG] [LOCAL ] SWX: Loaded 31496 existing records from primary storage. [2025-09-26T21:31:23.856875] [INFO ] [MAIN ] SWK: Wiping existing primary data before full refresh. [2025-09-26T21:31:23.857668] [INFO ] [LOCAL ] SWK: Starting deletion of primary data. [2025-09-26T21:31:23.857557] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-05. [2025-09-26T21:31:23.857150] [INFO ] [MAIN ] SWX: Loaded 31496 existing records. [2025-09-26T21:31:23.865334] [DEBUG] [LOCAL ] SWK: Deleted primary data file. [2025-09-26T21:31:23.873330] [INFO ] [MAIN ] SWK: Starting full primary refresh. [2025-09-26T21:31:24.406880] [WARN ] [MAIN ] SWX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:31:24.417934] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-26T21:31:24.428713] [INFO ] [MAIN ] SWX: Wiping existing primary data before full refresh. [2025-09-26T21:31:24.458261] [INFO ] [LOCAL ] SWX: Starting deletion of primary data. [2025-09-26T21:31:24.481214] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-08. [2025-09-26T21:31:24.481308] [DEBUG] [LOCAL ] SWX: Deleted primary data file. [2025-09-26T21:31:24.527514] [INFO ] [MAIN ] SWX: Starting full primary refresh. [2025-09-26T21:31:24.549745] [INFO ] [REMOTE ] SWK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:31:24.714442] [INFO ] [REMOTE ] SWK: Fetching primary data for 2024-12. [2025-09-26T21:31:24.959051] [INFO ] [REMOTE ] SWX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:31:25.511764] [INFO ] [REMOTE ] SWX: Fetching primary data for 2024-12. [2025-09-26T21:31:25.598309] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-26T21:31:26.071783] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-26T21:31:26.311705] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-09. [2025-09-26T21:31:26.750513] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-26T21:31:26.801842] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-26T21:31:27.111730] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-01. [2025-09-26T21:31:27.869056] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-26T21:31:27.879173] [INFO ] [REMOTE ] SVV: Full fetch complete (56041 records). [2025-09-26T21:31:27.879354] [DEBUG] [VALIDATOR ] SVV: Validating primary data. [2025-09-26T21:31:27.916901] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-06. [2025-09-26T21:31:28.331521] [DEBUG] [VALIDATOR ] SVV: All expected trading days are present. [2025-09-26T21:31:28.331717] [DEBUG] [VALIDATOR ] SVV: Primary data validation passed. [2025-09-26T21:31:28.332622] [INFO ] [MAIN ] SVV: Fetched primary data is valid. [2025-09-26T21:31:28.332715] [DEBUG] [LOCAL ] SVV: Saving primary data. [2025-09-26T21:31:28.334069] [DEBUG] [LOCAL ] SVV: Trimmed 56041 records to 40221 (keeping 200 days of data) [2025-09-26T21:31:28.579909] [DEBUG] [LOCAL ] SVV: Primary data saved (40221 records). [2025-09-26T21:31:28.580202] [INFO ] [MAIN ] SVV: Full history saved. [2025-09-26T21:31:28.580437] [INFO ] [MAIN ] Update Progress: 2033/2371 symbols completed. SVV took 30.9s. Estimated remaining: 45m 8s. Rate: 7.5 symbols/min [2025-09-26T21:31:28.716868] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-01. [2025-09-26T21:31:28.780914] [INFO ] [MAIN ] SWZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:31:28.791159] [DEBUG] [LOCAL ] SWZ: Loaded 6042 existing records from primary storage. [2025-09-26T21:31:28.791791] [INFO ] [MAIN ] SWZ: Loaded 6042 existing records. [2025-09-26T21:31:28.991819] [WARN ] [MAIN ] SWZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:31:28.992349] [INFO ] [MAIN ] SWZ: Wiping existing primary data before full refresh. [2025-09-26T21:31:28.992441] [INFO ] [LOCAL ] SWZ: Starting deletion of primary data. [2025-09-26T21:31:28.993105] [DEBUG] [LOCAL ] SWZ: Deleted primary data file. [2025-09-26T21:31:28.993174] [INFO ] [MAIN ] SWZ: Starting full primary refresh. [2025-09-26T21:31:29.203730] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-26T21:31:29.505676] [INFO ] [REMOTE ] SWZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:31:29.511683] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2024-12. [2025-09-26T21:31:29.744851] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-26T21:31:30.079443] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-26T21:31:30.129056] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-26T21:31:30.311709] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-01. [2025-09-26T21:31:30.912552] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-26T21:31:31.111757] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-02. [2025-09-26T21:31:31.911738] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-02. [2025-09-26T21:31:32.492021] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-26T21:31:32.656405] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-26T21:31:32.711758] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-02. [2025-09-26T21:31:33.511728] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-03. [2025-09-26T21:31:34.311706] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-03. [2025-09-26T21:31:34.353288] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-26T21:31:34.435071] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-26T21:31:35.111720] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-04. [2025-09-26T21:31:35.158276] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-26T21:31:35.911739] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-04. [2025-09-26T21:31:36.500111] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-26T21:31:36.711727] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-07. [2025-09-26T21:31:36.726730] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-26T21:31:37.511733] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-05. [2025-09-26T21:31:38.311734] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-03. [2025-09-26T21:31:38.962494] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-26T21:31:39.111750] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-06. [2025-09-26T21:31:39.853366] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-07 (3.14 seconds). [2025-09-26T21:31:39.911727] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-05. [2025-09-26T21:31:40.180547] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-26T21:31:40.494394] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-26T21:31:40.546132] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-26T21:31:40.711748] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-06. [2025-09-26T21:31:41.330719] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-26T21:31:41.511742] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-07. [2025-09-26T21:31:42.157169] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-26T21:31:42.311742] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-08. [2025-09-26T21:31:43.098260] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-26T21:31:43.111711] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-09. [2025-09-26T21:31:43.739287] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-26T21:31:43.740755] [INFO ] [REMOTE ] SWZ: Full fetch complete (8104 records). [2025-09-26T21:31:43.740838] [DEBUG] [VALIDATOR ] SWZ: Validating primary data. [2025-09-26T21:31:43.912934] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-07. [2025-09-26T21:31:44.134482] [DEBUG] [VALIDATOR ] SWZ: All expected trading days are present. [2025-09-26T21:31:44.134575] [DEBUG] [VALIDATOR ] SWZ: Primary data validation passed. [2025-09-26T21:31:44.134836] [INFO ] [MAIN ] SWZ: Fetched primary data is valid. [2025-09-26T21:31:44.134904] [DEBUG] [LOCAL ] SWZ: Saving primary data. [2025-09-26T21:31:44.135412] [DEBUG] [LOCAL ] SWZ: Trimmed 8104 records to 6074 (keeping 200 days of data) [2025-09-26T21:31:44.171810] [DEBUG] [LOCAL ] SWZ: Primary data saved (6074 records). [2025-09-26T21:31:44.171972] [INFO ] [MAIN ] SWZ: Full history saved. [2025-09-26T21:31:44.172071] [INFO ] [MAIN ] Update Progress: 2034/2371 symbols completed. SWZ took 15.6s. Estimated remaining: 45m 1s. Rate: 7.5 symbols/min [2025-09-26T21:31:44.351525] [INFO ] [MAIN ] SXC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:31:44.399612] [DEBUG] [LOCAL ] SXC: Loaded 41877 existing records from primary storage. [2025-09-26T21:31:44.399813] [INFO ] [MAIN ] SXC: Loaded 41877 existing records. [2025-09-26T21:31:44.586247] [WARN ] [MAIN ] SXC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:31:44.586535] [INFO ] [MAIN ] SXC: Wiping existing primary data before full refresh. [2025-09-26T21:31:44.586595] [INFO ] [LOCAL ] SXC: Starting deletion of primary data. [2025-09-26T21:31:44.587590] [DEBUG] [LOCAL ] SXC: Deleted primary data file. [2025-09-26T21:31:44.587690] [INFO ] [MAIN ] SXC: Starting full primary refresh. [2025-09-26T21:31:44.716891] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-08. [2025-09-26T21:31:44.983194] [INFO ] [REMOTE ] SXC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:31:45.474107] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-26T21:31:45.511743] [INFO ] [REMOTE ] SXC: Fetching primary data for 2024-12. [2025-09-26T21:31:46.311751] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-04. [2025-09-26T21:31:46.854527] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-26T21:31:46.889585] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-26T21:31:47.111724] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-01. [2025-09-26T21:31:47.911709] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-08. [2025-09-26T21:31:47.973448] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-26T21:31:48.684511] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T21:31:48.711678] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-09. [2025-09-26T21:31:48.829215] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-26T21:31:49.511747] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-02. [2025-09-26T21:31:50.311693] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-09. [2025-09-26T21:31:50.523966] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-26T21:31:50.535498] [INFO ] [REMOTE ] SW: Full fetch complete (76753 records). [2025-09-26T21:31:50.535694] [DEBUG] [VALIDATOR ] SW: Validating primary data. [2025-09-26T21:31:51.003762] [DEBUG] [VALIDATOR ] SW: All expected trading days are present. [2025-09-26T21:31:51.003956] [DEBUG] [VALIDATOR ] SW: Primary data validation passed. [2025-09-26T21:31:51.005337] [INFO ] [MAIN ] SW: Fetched primary data is valid. [2025-09-26T21:31:51.005571] [DEBUG] [LOCAL ] SW: Saving primary data. [2025-09-26T21:31:51.032292] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-26T21:31:51.030740] [DEBUG] [LOCAL ] SW: Trimmed 76753 records to 53939 (keeping 200 days of data) [2025-09-26T21:31:51.132139] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-05. [2025-09-26T21:31:51.391278] [DEBUG] [LOCAL ] SW: Primary data saved (53939 records). [2025-09-26T21:31:51.391454] [INFO ] [MAIN ] SW: Full history saved. [2025-09-26T21:31:51.391549] [INFO ] [MAIN ] Update Progress: 2035/2371 symbols completed. SW took 49.3s. Estimated remaining: 44m 53s. Rate: 7.5 symbols/min [2025-09-26T21:31:51.581165] [INFO ] [MAIN ] SXI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:31:51.595268] [DEBUG] [LOCAL ] SXI: Loaded 11616 existing records from primary storage. [2025-09-26T21:31:51.595419] [INFO ] [MAIN ] SXI: Loaded 11616 existing records. [2025-09-26T21:31:51.818076] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-26T21:31:51.825483] [WARN ] [MAIN ] SXI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:31:51.832014] [INFO ] [MAIN ] SXI: Wiping existing primary data before full refresh. [2025-09-26T21:31:51.832431] [INFO ] [LOCAL ] SXI: Starting deletion of primary data. [2025-09-26T21:31:51.832848] [INFO ] [REMOTE ] SWX: Full fetch complete (43868 records). [2025-09-26T21:31:51.832967] [DEBUG] [VALIDATOR ] SWX: Validating primary data. [2025-09-26T21:31:51.833213] [DEBUG] [LOCAL ] SXI: Deleted primary data file. [2025-09-26T21:31:51.879017] [INFO ] [MAIN ] SXI: Starting full primary refresh. [2025-09-26T21:31:51.914678] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-03. [2025-09-26T21:31:52.589808] [DEBUG] [VALIDATOR ] SWX: All expected trading days are present. [2025-09-26T21:31:52.590155] [DEBUG] [VALIDATOR ] SWX: Primary data validation passed. [2025-09-26T21:31:52.591728] [INFO ] [MAIN ] SWX: Fetched primary data is valid. [2025-09-26T21:31:52.597358] [DEBUG] [LOCAL ] SWX: Saving primary data. [2025-09-26T21:31:52.658883] [DEBUG] [LOCAL ] SWX: Trimmed 43868 records to 31735 (keeping 200 days of data) [2025-09-26T21:31:52.681993] [INFO ] [REMOTE ] SXI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:31:52.748802] [INFO ] [REMOTE ] SXI: Fetching primary data for 2024-12. [2025-09-26T21:31:52.930913] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-26T21:31:52.951195] [DEBUG] [LOCAL ] SWX: Primary data saved (31735 records). [2025-09-26T21:31:52.951410] [INFO ] [MAIN ] SWX: Full history saved. [2025-09-26T21:31:52.951516] [INFO ] [MAIN ] Update Progress: 2036/2371 symbols completed. SWX took 29.7s. Estimated remaining: 44m 44s. Rate: 7.5 symbols/min [2025-09-26T21:31:53.143981] [INFO ] [MAIN ] SXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:31:53.186318] [DEBUG] [LOCAL ] SXT: Loaded 29329 existing records from primary storage. [2025-09-26T21:31:53.186528] [INFO ] [MAIN ] SXT: Loaded 29329 existing records. [2025-09-26T21:31:53.386683] [WARN ] [MAIN ] SXT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:31:53.387121] [INFO ] [MAIN ] SXT: Wiping existing primary data before full refresh. [2025-09-26T21:31:53.387197] [INFO ] [LOCAL ] SXT: Starting deletion of primary data. [2025-09-26T21:31:53.388146] [DEBUG] [LOCAL ] SXT: Deleted primary data file. [2025-09-26T21:31:53.388210] [INFO ] [MAIN ] SXT: Starting full primary refresh. [2025-09-26T21:31:53.498280] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-26T21:31:53.512291] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-01. [2025-09-26T21:31:53.805375] [INFO ] [REMOTE ] SXT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:31:53.826558] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-26T21:31:54.311892] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-04. [2025-09-26T21:31:54.348926] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-26T21:31:55.111736] [INFO ] [REMOTE ] SXT: Fetching primary data for 2024-12. [2025-09-26T21:31:55.911723] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-02. [2025-09-26T21:31:55.971610] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-26T21:31:56.118317] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-26T21:31:56.711701] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-06. [2025-09-26T21:31:56.754334] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-26T21:31:57.511743] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-03. [2025-09-26T21:31:58.311685] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-05. [2025-09-26T21:31:58.346189] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-26T21:31:58.552745] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-26T21:31:59.111724] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-01. [2025-09-26T21:31:59.841632] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-26T21:31:59.911718] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-04. [2025-09-26T21:32:00.218397] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-26T21:32:00.711739] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-07. [2025-09-26T21:32:00.983911] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-26T21:32:01.511750] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-06. [2025-09-26T21:32:02.311717] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-02. [2025-09-26T21:32:02.980727] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-26T21:32:03.017313] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-26T21:32:03.111707] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-05. [2025-09-26T21:32:03.514114] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-26T21:32:03.911721] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-08. [2025-09-26T21:32:04.012738] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-26T21:32:04.711772] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-06. [2025-09-26T21:32:04.776314] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-26T21:32:05.511770] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-03. [2025-09-26T21:32:05.629249] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-26T21:32:06.311724] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-07. [2025-09-26T21:32:06.815192] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-26T21:32:07.012311] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-26T21:32:07.111730] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-08. [2025-09-26T21:32:07.911705] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-09. [2025-09-26T21:32:08.057583] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-26T21:32:08.711770] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-09. [2025-09-26T21:32:09.511706] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-04. [2025-09-26T21:32:09.552010] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-26T21:32:09.555204] [INFO ] [REMOTE ] SXI: Full fetch complete (14669 records). [2025-09-26T21:32:09.555382] [DEBUG] [VALIDATOR ] SXI: Validating primary data. [2025-09-26T21:32:09.693127] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-26T21:32:09.730354] [INFO ] [REMOTE ] SWK: Full fetch complete (75357 records). [2025-09-26T21:32:09.760230] [DEBUG] [VALIDATOR ] SWK: Validating primary data. [2025-09-26T21:32:10.255274] [DEBUG] [VALIDATOR ] SXI: All expected trading days are present. [2025-09-26T21:32:10.260602] [DEBUG] [VALIDATOR ] SXI: Primary data validation passed. [2025-09-26T21:32:10.309091] [INFO ] [MAIN ] SXI: Fetched primary data is valid. [2025-09-26T21:32:10.320399] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-07. [2025-09-26T21:32:10.330678] [DEBUG] [LOCAL ] SXI: Saving primary data. [2025-09-26T21:32:10.394309] [DEBUG] [LOCAL ] SXI: Trimmed 14669 records to 11685 (keeping 200 days of data) [2025-09-26T21:32:10.543749] [DEBUG] [VALIDATOR ] SWK: All expected trading days are present. [2025-09-26T21:32:10.552141] [DEBUG] [VALIDATOR ] SWK: Primary data validation passed. [2025-09-26T21:32:10.571927] [INFO ] [MAIN ] SWK: Fetched primary data is valid. [2025-09-26T21:32:10.573551] [DEBUG] [LOCAL ] SWK: Saving primary data. [2025-09-26T21:32:10.579310] [DEBUG] [LOCAL ] SWK: Trimmed 75357 records to 53178 (keeping 200 days of data) [2025-09-26T21:32:10.735010] [DEBUG] [LOCAL ] SXI: Primary data saved (11685 records). [2025-09-26T21:32:10.735802] [INFO ] [MAIN ] SXI: Full history saved. [2025-09-26T21:32:10.736087] [INFO ] [MAIN ] Update Progress: 2037/2371 symbols completed. SXI took 19.3s. Estimated remaining: 44m 37s. Rate: 7.5 symbols/min [2025-09-26T21:32:10.787215] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-26T21:32:11.083442] [DEBUG] [LOCAL ] SWK: Primary data saved (53178 records). [2025-09-26T21:32:11.083740] [INFO ] [MAIN ] SWK: Full history saved. [2025-09-26T21:32:11.083901] [INFO ] [MAIN ] Update Progress: 2038/2371 symbols completed. SWK took 48.1s. Estimated remaining: 44m 28s. Rate: 7.5 symbols/min [2025-09-26T21:32:11.111779] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-05. [2025-09-26T21:32:11.969103] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-26T21:32:11.979781] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-08. [2025-09-26T21:32:12.521364] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-26T21:32:12.711769] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-06. [2025-09-26T21:32:13.412494] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-26T21:32:13.511770] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-09. [2025-09-26T21:32:13.955243] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-26T21:32:14.311722] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-07. [2025-09-26T21:32:14.920094] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-26T21:32:14.929055] [INFO ] [REMOTE ] SXC: Full fetch complete (61196 records). [2025-09-26T21:32:14.929225] [DEBUG] [VALIDATOR ] SXC: Validating primary data. [2025-09-26T21:32:15.363863] [DEBUG] [VALIDATOR ] SXC: All expected trading days are present. [2025-09-26T21:32:15.363956] [DEBUG] [VALIDATOR ] SXC: Primary data validation passed. [2025-09-26T21:32:15.365020] [INFO ] [MAIN ] SXC: Fetched primary data is valid. [2025-09-26T21:32:15.365091] [DEBUG] [LOCAL ] SXC: Saving primary data. [2025-09-26T21:32:15.366489] [DEBUG] [LOCAL ] SXC: Trimmed 61196 records to 42142 (keeping 200 days of data) [2025-09-26T21:32:15.636911] [DEBUG] [LOCAL ] SXC: Primary data saved (42142 records). [2025-09-26T21:32:15.637054] [INFO ] [MAIN ] SXC: Full history saved. [2025-09-26T21:32:15.637210] [INFO ] [MAIN ] Update Progress: 2039/2371 symbols completed. SXC took 31.5s. Estimated remaining: 44m 19s. Rate: 7.5 symbols/min [2025-09-26T21:32:15.914496] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-26T21:32:15.922288] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-08. [2025-09-26T21:32:17.146342] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-26T21:32:17.152974] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-09. [2025-09-26T21:32:18.455854] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-26T21:32:18.462361] [INFO ] [REMOTE ] SXT: Full fetch complete (38036 records). [2025-09-26T21:32:18.462479] [DEBUG] [VALIDATOR ] SXT: Validating primary data. [2025-09-26T21:32:18.887791] [DEBUG] [VALIDATOR ] SXT: All expected trading days are present. [2025-09-26T21:32:18.887894] [DEBUG] [VALIDATOR ] SXT: Primary data validation passed. [2025-09-26T21:32:18.888675] [INFO ] [MAIN ] SXT: Fetched primary data is valid. [2025-09-26T21:32:18.888741] [DEBUG] [LOCAL ] SXT: Saving primary data. [2025-09-26T21:32:18.889744] [DEBUG] [LOCAL ] SXT: Trimmed 38036 records to 29557 (keeping 200 days of data) [2025-09-26T21:32:19.085521] [DEBUG] [LOCAL ] SXT: Primary data saved (29557 records). [2025-09-26T21:32:19.085702] [INFO ] [MAIN ] SXT: Full history saved. [2025-09-26T21:32:19.085831] [INFO ] [MAIN ] Update Progress: 2040/2371 symbols completed. SXT took 26.1s. Estimated remaining: 44m 11s. Rate: 7.5 symbols/min [2025-09-26T21:32:19.701064] [INFO ] [MAIN ] SYK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:32:19.761637] [INFO ] [MAIN ] SYY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:32:19.844938] [INFO ] [MAIN ] SYF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:32:19.868394] [INFO ] [MAIN ] T: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:32:19.951516] [DEBUG] [LOCAL ] SYF: Loaded 53840 existing records from primary storage. [2025-09-26T21:32:19.967515] [INFO ] [MAIN ] SYF: Loaded 53840 existing records. [2025-09-26T21:32:20.043347] [DEBUG] [LOCAL ] T: Loaded 54188 existing records from primary storage. [2025-09-26T21:32:20.055346] [DEBUG] [LOCAL ] SYK: Loaded 47405 existing records from primary storage. [2025-09-26T21:32:20.061828] [INFO ] [MAIN ] SYK: Loaded 47405 existing records. [2025-09-26T21:32:20.060860] [INFO ] [MAIN ] T: Loaded 54188 existing records. [2025-09-26T21:32:20.309631] [DEBUG] [LOCAL ] SYY: Loaded 53623 existing records from primary storage. [2025-09-26T21:32:20.346769] [INFO ] [MAIN ] SYY: Loaded 53623 existing records. [2025-09-26T21:32:20.508783] [WARN ] [MAIN ] SYF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:32:20.630949] [INFO ] [MAIN ] SYF: Wiping existing primary data before full refresh. [2025-09-26T21:32:20.709748] [INFO ] [LOCAL ] SYF: Starting deletion of primary data. [2025-09-26T21:32:20.764936] [WARN ] [MAIN ] T: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:32:20.765239] [INFO ] [MAIN ] T: Wiping existing primary data before full refresh. [2025-09-26T21:32:20.764770] [WARN ] [MAIN ] SYK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:32:20.765462] [INFO ] [MAIN ] SYK: Wiping existing primary data before full refresh. [2025-09-26T21:32:20.765535] [INFO ] [LOCAL ] T: Starting deletion of primary data. [2025-09-26T21:32:20.765625] [INFO ] [LOCAL ] SYK: Starting deletion of primary data. [2025-09-26T21:32:20.771579] [DEBUG] [LOCAL ] SYK: Deleted primary data file. [2025-09-26T21:32:20.776800] [DEBUG] [LOCAL ] SYF: Deleted primary data file. [2025-09-26T21:32:20.792228] [DEBUG] [LOCAL ] T: Deleted primary data file. [2025-09-26T21:32:20.820438] [INFO ] [MAIN ] T: Starting full primary refresh. [2025-09-26T21:32:20.820582] [INFO ] [MAIN ] SYK: Starting full primary refresh. [2025-09-26T21:32:20.816920] [INFO ] [MAIN ] SYF: Starting full primary refresh. [2025-09-26T21:32:20.953572] [WARN ] [MAIN ] SYY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:32:21.155070] [INFO ] [MAIN ] SYY: Wiping existing primary data before full refresh. [2025-09-26T21:32:21.199246] [INFO ] [LOCAL ] SYY: Starting deletion of primary data. [2025-09-26T21:32:21.395620] [DEBUG] [LOCAL ] SYY: Deleted primary data file. [2025-09-26T21:32:21.554565] [INFO ] [MAIN ] SYY: Starting full primary refresh. [2025-09-26T21:32:22.119179] [INFO ] [REMOTE ] T: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:32:22.195242] [INFO ] [REMOTE ] SYK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:32:22.206365] [INFO ] [REMOTE ] T: Fetching primary data for 2024-12. [2025-09-26T21:32:22.225726] [INFO ] [REMOTE ] SYF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:32:22.226236] [INFO ] [REMOTE ] SYK: Fetching primary data for 2024-12. [2025-09-26T21:32:22.227627] [INFO ] [REMOTE ] SYF: Fetching primary data for 2024-12. [2025-09-26T21:32:22.489456] [INFO ] [REMOTE ] SYY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:32:22.489882] [INFO ] [REMOTE ] SYY: Fetching primary data for 2024-12. [2025-09-26T21:32:24.060825] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-26T21:32:24.070966] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-01. [2025-09-26T21:32:24.206197] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-26T21:32:24.217895] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-01. [2025-09-26T21:32:24.301976] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-26T21:32:24.312793] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-01. [2025-09-26T21:32:24.816036] [INFO ] [REMOTE ] T: Incremental fetch complete for 2024-12 (2.61 seconds). [2025-09-26T21:32:24.827795] [INFO ] [REMOTE ] T: Fetching primary data for 2025-01. [2025-09-26T21:32:25.970537] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-26T21:32:25.982045] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-02. [2025-09-26T21:32:26.109971] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-26T21:32:26.120930] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-02. [2025-09-26T21:32:26.160557] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-26T21:32:26.172151] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-02. [2025-09-26T21:32:26.941776] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-26T21:32:26.959081] [INFO ] [REMOTE ] T: Fetching primary data for 2025-02. [2025-09-26T21:32:27.438171] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-26T21:32:27.450004] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-03. [2025-09-26T21:32:27.623018] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-26T21:32:27.633021] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-03. [2025-09-26T21:32:27.944852] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-26T21:32:27.955937] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-03. [2025-09-26T21:32:29.111117] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-26T21:32:29.122698] [INFO ] [REMOTE ] T: Fetching primary data for 2025-03. [2025-09-26T21:32:29.202761] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-26T21:32:29.359714] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-26T21:32:29.434808] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-26T21:32:29.511776] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-04. [2025-09-26T21:32:30.311702] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-04. [2025-09-26T21:32:31.111742] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-04. [2025-09-26T21:32:31.413505] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-26T21:32:31.486120] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-09-26T21:32:31.911719] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-05. [2025-09-26T21:32:32.055314] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-26T21:32:32.711692] [INFO ] [REMOTE ] T: Fetching primary data for 2025-04. [2025-09-26T21:32:33.263125] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-26T21:32:33.511754] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-05. [2025-09-26T21:32:33.896839] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-26T21:32:34.311782] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-06. [2025-09-26T21:32:34.905540] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-26T21:32:35.111731] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-05. [2025-09-26T21:32:35.205597] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-26T21:32:35.911742] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-06. [2025-09-26T21:32:36.275681] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-26T21:32:36.711748] [INFO ] [REMOTE ] T: Fetching primary data for 2025-05. [2025-09-26T21:32:37.008022] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-26T21:32:37.511751] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-07. [2025-09-26T21:32:37.684483] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-26T21:32:38.311717] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-06. [2025-09-26T21:32:39.111735] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-07. [2025-09-26T21:32:39.211552] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-26T21:32:39.288963] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-26T21:32:39.505898] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-26T21:32:39.911742] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-08. [2025-09-26T21:32:40.711729] [INFO ] [REMOTE ] T: Fetching primary data for 2025-06. [2025-09-26T21:32:40.908013] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-26T21:32:41.511755] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-08. [2025-09-26T21:32:42.279463] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-26T21:32:42.311743] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-07. [2025-09-26T21:32:42.962411] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-26T21:32:43.111728] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-09. [2025-09-26T21:32:43.653116] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-26T21:32:43.911724] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-09. [2025-09-26T21:32:44.175395] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-26T21:32:44.216898] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-26T21:32:44.226392] [INFO ] [REMOTE ] SYK: Full fetch complete (68740 records). [2025-09-26T21:32:44.226702] [DEBUG] [VALIDATOR ] SYK: Validating primary data. [2025-09-26T21:32:44.656503] [DEBUG] [VALIDATOR ] SYK: All expected trading days are present. [2025-09-26T21:32:44.656840] [DEBUG] [VALIDATOR ] SYK: Primary data validation passed. [2025-09-26T21:32:44.657969] [INFO ] [MAIN ] SYK: Fetched primary data is valid. [2025-09-26T21:32:44.658089] [DEBUG] [LOCAL ] SYK: Saving primary data. [2025-09-26T21:32:44.659773] [DEBUG] [LOCAL ] SYK: Trimmed 68740 records to 47699 (keeping 200 days of data) [2025-09-26T21:32:44.723923] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-08. [2025-09-26T21:32:44.954003] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-26T21:32:44.967336] [INFO ] [REMOTE ] SYF: Full fetch complete (77326 records). [2025-09-26T21:32:44.971006] [DEBUG] [VALIDATOR ] SYF: Validating primary data. [2025-09-26T21:32:45.339861] [DEBUG] [LOCAL ] SYK: Primary data saved (47699 records). [2025-09-26T21:32:45.351998] [INFO ] [MAIN ] SYK: Full history saved. [2025-09-26T21:32:45.352577] [INFO ] [MAIN ] Update Progress: 2041/2371 symbols completed. SYK took 26.2s. Estimated remaining: 44m 6s. Rate: 7.5 symbols/min [2025-09-26T21:32:45.532136] [INFO ] [REMOTE ] T: Fetching primary data for 2025-07. [2025-09-26T21:32:45.614478] [DEBUG] [VALIDATOR ] SYF: All expected trading days are present. [2025-09-26T21:32:45.619132] [DEBUG] [VALIDATOR ] SYF: Primary data validation passed. [2025-09-26T21:32:45.620449] [INFO ] [MAIN ] SYF: Fetched primary data is valid. [2025-09-26T21:32:45.620918] [DEBUG] [LOCAL ] SYF: Saving primary data. [2025-09-26T21:32:45.678491] [DEBUG] [LOCAL ] SYF: Trimmed 77326 records to 54222 (keeping 200 days of data) [2025-09-26T21:32:45.699136] [INFO ] [MAIN ] TAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:32:45.857079] [DEBUG] [LOCAL ] TAC: Loaded 43179 existing records from primary storage. [2025-09-26T21:32:45.865484] [INFO ] [MAIN ] TAC: Loaded 43179 existing records. [2025-09-26T21:32:46.166129] [WARN ] [MAIN ] TAC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:32:46.171330] [INFO ] [MAIN ] TAC: Wiping existing primary data before full refresh. [2025-09-26T21:32:46.171677] [INFO ] [LOCAL ] TAC: Starting deletion of primary data. [2025-09-26T21:32:46.173879] [DEBUG] [LOCAL ] TAC: Deleted primary data file. [2025-09-26T21:32:46.174492] [INFO ] [MAIN ] TAC: Starting full primary refresh. [2025-09-26T21:32:46.760827] [INFO ] [REMOTE ] TAC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:32:46.763874] [INFO ] [REMOTE ] TAC: Fetching primary data for 2024-12. [2025-09-26T21:32:46.774407] [DEBUG] [LOCAL ] SYF: Primary data saved (54222 records). [2025-09-26T21:32:46.775141] [INFO ] [MAIN ] SYF: Full history saved. [2025-09-26T21:32:46.775316] [INFO ] [MAIN ] Update Progress: 2042/2371 symbols completed. SYF took 27.7s. Estimated remaining: 43m 56s. Rate: 7.5 symbols/min [2025-09-26T21:32:46.920475] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-26T21:32:47.002012] [INFO ] [MAIN ] TAK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:32:47.062234] [DEBUG] [LOCAL ] TAK: Loaded 50211 existing records from primary storage. [2025-09-26T21:32:47.062389] [INFO ] [MAIN ] TAK: Loaded 50211 existing records. [2025-09-26T21:32:47.120610] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-09. [2025-09-26T21:32:47.253914] [WARN ] [MAIN ] TAK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:32:47.254224] [INFO ] [MAIN ] TAK: Wiping existing primary data before full refresh. [2025-09-26T21:32:47.254286] [INFO ] [LOCAL ] TAK: Starting deletion of primary data. [2025-09-26T21:32:47.255223] [DEBUG] [LOCAL ] TAK: Deleted primary data file. [2025-09-26T21:32:47.255285] [INFO ] [MAIN ] TAK: Starting full primary refresh. [2025-09-26T21:32:47.632667] [INFO ] [REMOTE ] TAK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:32:47.911693] [INFO ] [REMOTE ] TAK: Fetching primary data for 2024-12. [2025-09-26T21:32:48.102047] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-09-26T21:32:48.355413] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-26T21:32:48.711701] [INFO ] [REMOTE ] T: Fetching primary data for 2025-08. [2025-09-26T21:32:48.895684] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-26T21:32:48.906389] [INFO ] [REMOTE ] SYY: Full fetch complete (76969 records). [2025-09-26T21:32:48.906557] [DEBUG] [VALIDATOR ] SYY: Validating primary data. [2025-09-26T21:32:49.366749] [DEBUG] [VALIDATOR ] SYY: All expected trading days are present. [2025-09-26T21:32:49.366968] [DEBUG] [VALIDATOR ] SYY: Primary data validation passed. [2025-09-26T21:32:49.368208] [INFO ] [MAIN ] SYY: Fetched primary data is valid. [2025-09-26T21:32:49.368332] [DEBUG] [LOCAL ] SYY: Saving primary data. [2025-09-26T21:32:49.370144] [DEBUG] [LOCAL ] SYY: Trimmed 76969 records to 54009 (keeping 200 days of data) [2025-09-26T21:32:49.516884] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-01. [2025-09-26T21:32:49.523515] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-26T21:32:49.754329] [DEBUG] [LOCAL ] SYY: Primary data saved (54009 records). [2025-09-26T21:32:49.754492] [INFO ] [MAIN ] SYY: Full history saved. [2025-09-26T21:32:49.754601] [INFO ] [MAIN ] Update Progress: 2043/2371 symbols completed. SYY took 30.7s. Estimated remaining: 43m 48s. Rate: 7.5 symbols/min [2025-09-26T21:32:49.934136] [INFO ] [MAIN ] TAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:32:49.993447] [DEBUG] [LOCAL ] TAL: Loaded 52439 existing records from primary storage. [2025-09-26T21:32:49.993633] [INFO ] [MAIN ] TAL: Loaded 52439 existing records. [2025-09-26T21:32:50.207714] [WARN ] [MAIN ] TAL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:32:50.207987] [INFO ] [MAIN ] TAL: Wiping existing primary data before full refresh. [2025-09-26T21:32:50.208051] [INFO ] [LOCAL ] TAL: Starting deletion of primary data. [2025-09-26T21:32:50.209041] [DEBUG] [LOCAL ] TAL: Deleted primary data file. [2025-09-26T21:32:50.209103] [INFO ] [MAIN ] TAL: Starting full primary refresh. [2025-09-26T21:32:50.322467] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-01. [2025-09-26T21:32:50.617361] [INFO ] [REMOTE ] TAL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:32:51.111702] [INFO ] [REMOTE ] TAL: Fetching primary data for 2024-12. [2025-09-26T21:32:51.212830] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-09-26T21:32:51.301487] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-26T21:32:51.911693] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-02. [2025-09-26T21:32:52.082374] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-26T21:32:52.711699] [INFO ] [REMOTE ] T: Fetching primary data for 2025-09. [2025-09-26T21:32:52.914735] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T21:32:53.228569] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-26T21:32:53.511735] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-01. [2025-09-26T21:32:53.639553] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-26T21:32:53.650709] [INFO ] [REMOTE ] T: Full fetch complete (77935 records). [2025-09-26T21:32:53.650886] [DEBUG] [VALIDATOR ] T: Validating primary data. [2025-09-26T21:32:54.087385] [DEBUG] [VALIDATOR ] T: All expected trading days are present. [2025-09-26T21:32:54.087475] [DEBUG] [VALIDATOR ] T: Primary data validation passed. [2025-09-26T21:32:54.088724] [INFO ] [MAIN ] T: Fetched primary data is valid. [2025-09-26T21:32:54.088795] [DEBUG] [LOCAL ] T: Saving primary data. [2025-09-26T21:32:54.090519] [DEBUG] [LOCAL ] T: Trimmed 77935 records to 54578 (keeping 200 days of data) [2025-09-26T21:32:54.323727] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-03. [2025-09-26T21:32:54.470311] [DEBUG] [LOCAL ] T: Primary data saved (54578 records). [2025-09-26T21:32:54.470517] [INFO ] [MAIN ] T: Full history saved. [2025-09-26T21:32:54.470692] [INFO ] [MAIN ] Update Progress: 2044/2371 symbols completed. T took 35.4s. Estimated remaining: 43m 39s. Rate: 7.5 symbols/min [2025-09-26T21:32:54.716467] [INFO ] [MAIN ] TALO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:32:54.777869] [DEBUG] [LOCAL ] TALO: Loaded 51193 existing records from primary storage. [2025-09-26T21:32:54.778040] [INFO ] [MAIN ] TALO: Loaded 51193 existing records. [2025-09-26T21:32:54.993709] [WARN ] [MAIN ] TALO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:32:54.993997] [INFO ] [MAIN ] TALO: Wiping existing primary data before full refresh. [2025-09-26T21:32:54.994050] [INFO ] [LOCAL ] TALO: Starting deletion of primary data. [2025-09-26T21:32:54.995145] [DEBUG] [LOCAL ] TALO: Deleted primary data file. [2025-09-26T21:32:54.995210] [INFO ] [MAIN ] TALO: Starting full primary refresh. [2025-09-26T21:32:55.116907] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-02. [2025-09-26T21:32:55.426663] [INFO ] [REMOTE ] TALO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:32:55.459893] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-26T21:32:55.549007] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-26T21:32:55.911740] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-04. [2025-09-26T21:32:56.497095] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-26T21:32:56.711730] [INFO ] [REMOTE ] TALO: Fetching primary data for 2024-12. [2025-09-26T21:32:57.486980] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-26T21:32:57.511681] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-05. [2025-09-26T21:32:58.311702] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-02. [2025-09-26T21:32:58.508926] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T21:32:58.696867] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-26T21:32:59.111738] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-03. [2025-09-26T21:32:59.911693] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-06. [2025-09-26T21:33:00.100234] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-26T21:33:00.711719] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-01. [2025-09-26T21:33:00.787835] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-26T21:33:01.511771] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-03. [2025-09-26T21:33:01.642411] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-26T21:33:02.311755] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-07. [2025-09-26T21:33:02.818638] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-26T21:33:03.111759] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-02. [2025-09-26T21:33:03.385148] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-26T21:33:03.799503] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-26T21:33:03.911760] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-04. [2025-09-26T21:33:04.520555] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-26T21:33:04.711757] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-04. [2025-09-26T21:33:05.511759] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-08. [2025-09-26T21:33:05.794872] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-26T21:33:06.311699] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-03. [2025-09-26T21:33:06.465621] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-26T21:33:07.117117] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-05. [2025-09-26T21:33:07.134386] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-26T21:33:07.911741] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-09. [2025-09-26T21:33:08.036662] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-26T21:33:08.711696] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-05. [2025-09-26T21:33:08.835364] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-26T21:33:09.371344] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-26T21:33:09.379911] [INFO ] [REMOTE ] TAC: Full fetch complete (64088 records). [2025-09-26T21:33:09.380072] [DEBUG] [VALIDATOR ] TAC: Validating primary data. [2025-09-26T21:33:09.516818] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-04. [2025-09-26T21:33:09.801257] [DEBUG] [VALIDATOR ] TAC: All expected trading days are present. [2025-09-26T21:33:09.801348] [DEBUG] [VALIDATOR ] TAC: Primary data validation passed. [2025-09-26T21:33:09.802325] [INFO ] [MAIN ] TAC: Fetched primary data is valid. [2025-09-26T21:33:09.802391] [DEBUG] [LOCAL ] TAC: Saving primary data. [2025-09-26T21:33:09.804768] [DEBUG] [LOCAL ] TAC: Trimmed 64088 records to 43441 (keeping 200 days of data) [2025-09-26T21:33:10.078855] [DEBUG] [LOCAL ] TAC: Primary data saved (43441 records). [2025-09-26T21:33:10.078998] [INFO ] [MAIN ] TAC: Full history saved. [2025-09-26T21:33:10.079087] [INFO ] [MAIN ] Update Progress: 2045/2371 symbols completed. TAC took 24.7s. Estimated remaining: 43m 32s. Rate: 7.5 symbols/min [2025-09-26T21:33:10.263975] [INFO ] [MAIN ] TAP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:33:10.316109] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-06. [2025-09-26T21:33:10.318521] [DEBUG] [LOCAL ] TAP: Loaded 53263 existing records from primary storage. [2025-09-26T21:33:10.318732] [INFO ] [MAIN ] TAP: Loaded 53263 existing records. [2025-09-26T21:33:10.519575] [WARN ] [MAIN ] TAP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:33:10.519904] [INFO ] [MAIN ] TAP: Wiping existing primary data before full refresh. [2025-09-26T21:33:10.519989] [INFO ] [LOCAL ] TAP: Starting deletion of primary data. [2025-09-26T21:33:10.521243] [DEBUG] [LOCAL ] TAP: Deleted primary data file. [2025-09-26T21:33:10.521329] [INFO ] [MAIN ] TAP: Starting full primary refresh. [2025-09-26T21:33:10.945137] [INFO ] [REMOTE ] TAP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:33:10.968933] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-26T21:33:11.016930] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-26T21:33:11.111753] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-05. [2025-09-26T21:33:11.911707] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-06. [2025-09-26T21:33:12.029914] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-26T21:33:12.711745] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-07. [2025-09-26T21:33:12.836351] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-26T21:33:13.511697] [INFO ] [REMOTE ] TAP: Fetching primary data for 2024-12. [2025-09-26T21:33:13.661825] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-26T21:33:14.155982] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-26T21:33:14.311705] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-07. [2025-09-26T21:33:15.111727] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-08. [2025-09-26T21:33:15.408072] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-26T21:33:15.911734] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-01. [2025-09-26T21:33:16.297828] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-26T21:33:16.711729] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-08. [2025-09-26T21:33:16.952897] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-26T21:33:17.292950] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-26T21:33:17.511731] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-09. [2025-09-26T21:33:18.311698] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-02. [2025-09-26T21:33:18.511033] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-26T21:33:19.091686] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-26T21:33:19.101922] [INFO ] [REMOTE ] TAK: Full fetch complete (71529 records). [2025-09-26T21:33:19.102097] [DEBUG] [VALIDATOR ] TAK: Validating primary data. [2025-09-26T21:33:19.116820] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-09. [2025-09-26T21:33:19.563361] [DEBUG] [VALIDATOR ] TAK: All expected trading days are present. [2025-09-26T21:33:19.563514] [DEBUG] [VALIDATOR ] TAK: Primary data validation passed. [2025-09-26T21:33:19.564921] [INFO ] [MAIN ] TAK: Fetched primary data is valid. [2025-09-26T21:33:19.565015] [DEBUG] [LOCAL ] TAK: Saving primary data. [2025-09-26T21:33:19.568898] [DEBUG] [LOCAL ] TAK: Trimmed 71529 records to 50538 (keeping 200 days of data) [2025-09-26T21:33:19.909184] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-26T21:33:19.915124] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-06. [2025-09-26T21:33:19.933035] [DEBUG] [LOCAL ] TAK: Primary data saved (50538 records). [2025-09-26T21:33:19.933264] [INFO ] [MAIN ] TAK: Full history saved. [2025-09-26T21:33:19.933792] [INFO ] [MAIN ] Update Progress: 2046/2371 symbols completed. TAK took 33.2s. Estimated remaining: 43m 25s. Rate: 7.5 symbols/min [2025-09-26T21:33:20.119749] [INFO ] [MAIN ] TBB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:33:20.134510] [DEBUG] [LOCAL ] TBB: Loaded 11782 existing records from primary storage. [2025-09-26T21:33:20.134669] [INFO ] [MAIN ] TBB: Loaded 11782 existing records. [2025-09-26T21:33:20.330469] [WARN ] [MAIN ] TBB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:33:20.330822] [INFO ] [MAIN ] TBB: Wiping existing primary data before full refresh. [2025-09-26T21:33:20.330877] [INFO ] [LOCAL ] TBB: Starting deletion of primary data. [2025-09-26T21:33:20.331299] [DEBUG] [LOCAL ] TBB: Deleted primary data file. [2025-09-26T21:33:20.331363] [INFO ] [MAIN ] TBB: Starting full primary refresh. [2025-09-26T21:33:20.727926] [INFO ] [REMOTE ] TBB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:33:20.720691] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-03. [2025-09-26T21:33:20.830365] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-26T21:33:20.841059] [INFO ] [REMOTE ] TAL: Full fetch complete (75611 records). [2025-09-26T21:33:20.841236] [DEBUG] [VALIDATOR ] TAL: Validating primary data. [2025-09-26T21:33:21.280866] [DEBUG] [VALIDATOR ] TAL: All expected trading days are present. [2025-09-26T21:33:21.281139] [DEBUG] [VALIDATOR ] TAL: Primary data validation passed. [2025-09-26T21:33:21.282508] [INFO ] [MAIN ] TAL: Fetched primary data is valid. [2025-09-26T21:33:21.282597] [DEBUG] [LOCAL ] TAL: Saving primary data. [2025-09-26T21:33:21.295521] [DEBUG] [LOCAL ] TAL: Trimmed 75611 records to 52783 (keeping 200 days of data) [2025-09-26T21:33:21.316002] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-26T21:33:21.514049] [INFO ] [REMOTE ] TBB: Fetching primary data for 2024-12. [2025-09-26T21:33:21.666577] [DEBUG] [LOCAL ] TAL: Primary data saved (52783 records). [2025-09-26T21:33:21.666790] [INFO ] [MAIN ] TAL: Full history saved. [2025-09-26T21:33:21.666925] [INFO ] [MAIN ] Update Progress: 2047/2371 symbols completed. TAL took 31.9s. Estimated remaining: 43m 16s. Rate: 7.5 symbols/min [2025-09-26T21:33:21.851611] [INFO ] [MAIN ] TBBB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:33:21.887895] [DEBUG] [LOCAL ] TBBB: Loaded 35967 existing records from primary storage. [2025-09-26T21:33:21.888046] [INFO ] [MAIN ] TBBB: Loaded 35967 existing records. [2025-09-26T21:33:22.079566] [WARN ] [MAIN ] TBBB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:33:22.079893] [INFO ] [MAIN ] TBBB: Wiping existing primary data before full refresh. [2025-09-26T21:33:22.079945] [INFO ] [LOCAL ] TBBB: Starting deletion of primary data. [2025-09-26T21:33:22.080827] [DEBUG] [LOCAL ] TBBB: Deleted primary data file. [2025-09-26T21:33:22.080890] [INFO ] [MAIN ] TBBB: Starting full primary refresh. [2025-09-26T21:33:22.323010] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-07. [2025-09-26T21:33:22.472391] [INFO ] [REMOTE ] TBBB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:33:22.582184] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-26T21:33:22.817465] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-26T21:33:23.111722] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-01. [2025-09-26T21:33:23.911684] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-04. [2025-09-26T21:33:24.107461] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-26T21:33:24.114515] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-26T21:33:24.711732] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2024-12. [2025-09-26T21:33:25.511726] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-02. [2025-09-26T21:33:25.809461] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-26T21:33:26.085935] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-26T21:33:26.099782] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-26T21:33:26.311704] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-03. [2025-09-26T21:33:27.111710] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-05. [2025-09-26T21:33:27.155025] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-26T21:33:27.911729] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-01. [2025-09-26T21:33:28.711763] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-04. [2025-09-26T21:33:29.054426] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-26T21:33:29.092505] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-26T21:33:29.310038] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-26T21:33:29.511736] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-02. [2025-09-26T21:33:30.311720] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-06. [2025-09-26T21:33:31.112734] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-08. [2025-09-26T21:33:31.118760] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-26T21:33:31.911725] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-03. [2025-09-26T21:33:32.258977] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-26T21:33:32.711730] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-05. [2025-09-26T21:33:32.819051] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-26T21:33:33.286486] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-26T21:33:33.333478] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-26T21:33:33.511746] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-07. [2025-09-26T21:33:34.311717] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-06. [2025-09-26T21:33:35.096596] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-26T21:33:35.111709] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-09. [2025-09-26T21:33:35.361626] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-26T21:33:35.911725] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-04. [2025-09-26T21:33:36.346894] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-26T21:33:36.362371] [INFO ] [REMOTE ] TALO: Full fetch complete (73304 records). [2025-09-26T21:33:36.362696] [DEBUG] [VALIDATOR ] TALO: Validating primary data. [2025-09-26T21:33:36.713858] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-07. [2025-09-26T21:33:36.823855] [DEBUG] [VALIDATOR ] TALO: All expected trading days are present. [2025-09-26T21:33:36.823961] [DEBUG] [VALIDATOR ] TALO: Primary data validation passed. [2025-09-26T21:33:36.825137] [INFO ] [MAIN ] TALO: Fetched primary data is valid. [2025-09-26T21:33:36.825207] [DEBUG] [LOCAL ] TALO: Saving primary data. [2025-09-26T21:33:36.827006] [DEBUG] [LOCAL ] TALO: Trimmed 73304 records to 51575 (keeping 200 days of data) [2025-09-26T21:33:37.148696] [DEBUG] [LOCAL ] TALO: Primary data saved (51575 records). [2025-09-26T21:33:37.148929] [INFO ] [MAIN ] TALO: Full history saved. [2025-09-26T21:33:37.149103] [INFO ] [MAIN ] Update Progress: 2048/2371 symbols completed. TALO took 42.7s. Estimated remaining: 43m 9s. Rate: 7.5 symbols/min [2025-09-26T21:33:37.342785] [INFO ] [MAIN ] TBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:33:37.368007] [DEBUG] [LOCAL ] TBI: Loaded 22787 existing records from primary storage. [2025-09-26T21:33:37.368173] [INFO ] [MAIN ] TBI: Loaded 22787 existing records. [2025-09-26T21:33:37.524442] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-08. [2025-09-26T21:33:37.581058] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-26T21:33:37.608946] [WARN ] [MAIN ] TBI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:33:37.616634] [INFO ] [MAIN ] TBI: Wiping existing primary data before full refresh. [2025-09-26T21:33:37.617365] [INFO ] [LOCAL ] TBI: Starting deletion of primary data. [2025-09-26T21:33:37.618008] [DEBUG] [LOCAL ] TBI: Deleted primary data file. [2025-09-26T21:33:37.618073] [INFO ] [MAIN ] TBI: Starting full primary refresh. [2025-09-26T21:33:37.761921] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-26T21:33:38.042897] [INFO ] [REMOTE ] TBI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:33:38.075789] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-26T21:33:38.311706] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-09. [2025-09-26T21:33:39.111721] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-05. [2025-09-26T21:33:39.911737] [INFO ] [REMOTE ] TBI: Fetching primary data for 2024-12. [2025-09-26T21:33:40.244839] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-26T21:33:40.255426] [INFO ] [REMOTE ] TAP: Full fetch complete (76151 records). [2025-09-26T21:33:40.255590] [DEBUG] [VALIDATOR ] TAP: Validating primary data. [2025-09-26T21:33:40.696606] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-26T21:33:40.729566] [DEBUG] [VALIDATOR ] TAP: All expected trading days are present. [2025-09-26T21:33:40.717979] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-08. [2025-09-26T21:33:40.729887] [DEBUG] [VALIDATOR ] TAP: Primary data validation passed. [2025-09-26T21:33:40.732782] [INFO ] [MAIN ] TAP: Fetched primary data is valid. [2025-09-26T21:33:40.733371] [DEBUG] [LOCAL ] TAP: Saving primary data. [2025-09-26T21:33:40.735665] [DEBUG] [LOCAL ] TAP: Trimmed 76151 records to 53648 (keeping 200 days of data) [2025-09-26T21:33:41.086459] [DEBUG] [LOCAL ] TAP: Primary data saved (53648 records). [2025-09-26T21:33:41.086759] [INFO ] [MAIN ] TAP: Full history saved. [2025-09-26T21:33:41.086974] [INFO ] [MAIN ] Update Progress: 2049/2371 symbols completed. TAP took 31.0s. Estimated remaining: 43m 0s. Rate: 7.5 symbols/min [2025-09-26T21:33:41.215084] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-26T21:33:41.296624] [INFO ] [MAIN ] TBLU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:33:41.296848] [DEBUG] [LOCAL ] TBLU: No existing data file found in primary storage. [2025-09-26T21:33:41.296903] [WARN ] [MAIN ] TBLU: No existing data found, performing full refresh instead. [2025-09-26T21:33:41.297059] [INFO ] [MAIN ] TBLU: Wiping existing primary data before full refresh. [2025-09-26T21:33:41.297115] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-09-26T21:33:41.297184] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-09-26T21:33:41.297220] [INFO ] [MAIN ] TBLU: Starting full primary refresh. [2025-09-26T21:33:41.520696] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-01. [2025-09-26T21:33:41.648685] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-26T21:33:41.712856] [INFO ] [REMOTE ] TBLU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:33:42.311710] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-06. [2025-09-26T21:33:42.647476] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-26T21:33:43.111731] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2024-12. [2025-09-26T21:33:43.446167] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-26T21:33:43.673782] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-26T21:33:43.911737] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-09. [2025-09-26T21:33:44.684778] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-26T21:33:44.687492] [INFO ] [REMOTE ] TBB: Full fetch complete (17906 records). [2025-09-26T21:33:44.687629] [DEBUG] [VALIDATOR ] TBB: Validating primary data. [2025-09-26T21:33:44.720280] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-02. [2025-09-26T21:33:45.093532] [DEBUG] [VALIDATOR ] TBB: All expected trading days are present. [2025-09-26T21:33:45.093626] [DEBUG] [VALIDATOR ] TBB: Primary data validation passed. [2025-09-26T21:33:45.094079] [INFO ] [MAIN ] TBB: Fetched primary data is valid. [2025-09-26T21:33:45.094130] [DEBUG] [LOCAL ] TBB: Saving primary data. [2025-09-26T21:33:45.094806] [DEBUG] [LOCAL ] TBB: Trimmed 17906 records to 11828 (keeping 200 days of data) [2025-09-26T21:33:45.172241] [DEBUG] [LOCAL ] TBB: Primary data saved (11828 records). [2025-09-26T21:33:45.172396] [INFO ] [MAIN ] TBB: Full history saved. [2025-09-26T21:33:45.172516] [INFO ] [MAIN ] Update Progress: 2050/2371 symbols completed. TBB took 25.2s. Estimated remaining: 42m 51s. Rate: 7.5 symbols/min [2025-09-26T21:33:45.354726] [INFO ] [MAIN ] TBN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:33:45.360012] [DEBUG] [LOCAL ] TBN: Loaded 3020 existing records from primary storage. [2025-09-26T21:33:45.360104] [INFO ] [MAIN ] TBN: Loaded 3020 existing records. [2025-09-26T21:33:45.519175] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-07. [2025-09-26T21:33:45.553581] [WARN ] [MAIN ] TBN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:33:45.555106] [INFO ] [MAIN ] TBN: Wiping existing primary data before full refresh. [2025-09-26T21:33:45.555239] [INFO ] [LOCAL ] TBN: Starting deletion of primary data. [2025-09-26T21:33:45.555608] [DEBUG] [LOCAL ] TBN: Deleted primary data file. [2025-09-26T21:33:45.555703] [INFO ] [MAIN ] TBN: Starting full primary refresh. [2025-09-26T21:33:45.970783] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-26T21:33:45.976815] [INFO ] [REMOTE ] TBN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:33:46.311785] [INFO ] [REMOTE ] TBN: Fetching primary data for 2024-12. [2025-09-26T21:33:46.813399] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-26T21:33:47.093382] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-26T21:33:47.111669] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-08. [2025-09-26T21:33:47.911733] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-03. [2025-09-26T21:33:48.470802] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-26T21:33:48.711734] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-01. [2025-09-26T21:33:48.955735] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-26T21:33:49.050778] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-26T21:33:49.511747] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-04. [2025-09-26T21:33:50.311719] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-09. [2025-09-26T21:33:50.650624] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-26T21:33:51.111739] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-02. [2025-09-26T21:33:51.451814] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-26T21:33:51.701922] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-26T21:33:51.708484] [INFO ] [REMOTE ] TBBB: Full fetch complete (51263 records). [2025-09-26T21:33:51.708589] [DEBUG] [VALIDATOR ] TBBB: Validating primary data. [2025-09-26T21:33:51.921620] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-03. [2025-09-26T21:33:52.112833] [DEBUG] [VALIDATOR ] TBBB: All expected trading days are present. [2025-09-26T21:33:52.112921] [DEBUG] [VALIDATOR ] TBBB: Primary data validation passed. [2025-09-26T21:33:52.113792] [INFO ] [MAIN ] TBBB: Fetched primary data is valid. [2025-09-26T21:33:52.113858] [DEBUG] [LOCAL ] TBBB: Saving primary data. [2025-09-26T21:33:52.115004] [DEBUG] [LOCAL ] TBBB: Trimmed 51263 records to 36262 (keeping 200 days of data) [2025-09-26T21:33:52.336927] [DEBUG] [LOCAL ] TBBB: Primary data saved (36262 records). [2025-09-26T21:33:52.337076] [INFO ] [MAIN ] TBBB: Full history saved. [2025-09-26T21:33:52.337165] [INFO ] [MAIN ] Update Progress: 2051/2371 symbols completed. TBBB took 30.7s. Estimated remaining: 42m 43s. Rate: 7.5 symbols/min [2025-09-26T21:33:52.419852] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-26T21:33:52.520178] [INFO ] [MAIN ] TCAI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:33:52.520383] [DEBUG] [LOCAL ] TCAI: No existing data file found in primary storage. [2025-09-26T21:33:52.520440] [WARN ] [MAIN ] TCAI: No existing data found, performing full refresh instead. [2025-09-26T21:33:52.520588] [INFO ] [MAIN ] TCAI: Wiping existing primary data before full refresh. [2025-09-26T21:33:52.520631] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-09-26T21:33:52.520723] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-09-26T21:33:52.520766] [INFO ] [MAIN ] TCAI: Starting full primary refresh. [2025-09-26T21:33:52.716873] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-05. [2025-09-26T21:33:52.900137] [INFO ] [REMOTE ] TCAI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:33:53.511731] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-01. [2025-09-26T21:33:54.237074] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-26T21:33:54.268638] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-26T21:33:54.311740] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2024-12. [2025-09-26T21:33:54.505868] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:33:54.506226] [WARN ] [REMOTE ] TCAI: No data returned for month 2024-12 [2025-09-26T21:33:55.111740] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-04. [2025-09-26T21:33:55.440366] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-26T21:33:55.911716] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-02. [2025-09-26T21:33:56.506283] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-26T21:33:56.711726] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-05. [2025-09-26T21:33:57.054580] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-26T21:33:57.511735] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-06. [2025-09-26T21:33:58.311714] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-03. [2025-09-26T21:33:58.513710] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-26T21:33:58.857284] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-26T21:33:59.111752] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-07. [2025-09-26T21:33:59.911689] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-01. [2025-09-26T21:34:00.108611] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:34:00.109049] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-01 [2025-09-26T21:34:00.228112] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-26T21:34:00.711747] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-04. [2025-09-26T21:34:01.150759] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-26T21:34:01.511737] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-06. [2025-09-26T21:34:02.057779] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-26T21:34:02.311732] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-07. [2025-09-26T21:34:02.658669] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-26T21:34:03.111727] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-08. [2025-09-26T21:34:03.911734] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-05. [2025-09-26T21:34:04.163845] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-26T21:34:04.363216] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-26T21:34:04.711725] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-06. [2025-09-26T21:34:05.265221] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-26T21:34:05.511753] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-09. [2025-09-26T21:34:06.311754] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-02. [2025-09-26T21:34:06.517455] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:34:06.517867] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-02 [2025-09-26T21:34:06.646623] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-26T21:34:06.650770] [INFO ] [REMOTE ] TBI: Full fetch complete (31759 records). [2025-09-26T21:34:06.650867] [DEBUG] [VALIDATOR ] TBI: Validating primary data. [2025-09-26T21:34:07.059139] [DEBUG] [VALIDATOR ] TBI: All expected trading days are present. [2025-09-26T21:34:07.059223] [DEBUG] [VALIDATOR ] TBI: Primary data validation passed. [2025-09-26T21:34:07.059910] [INFO ] [MAIN ] TBI: Fetched primary data is valid. [2025-09-26T21:34:07.059975] [DEBUG] [LOCAL ] TBI: Saving primary data. [2025-09-26T21:34:07.060796] [DEBUG] [LOCAL ] TBI: Trimmed 31759 records to 22937 (keeping 200 days of data) [2025-09-26T21:34:07.113292] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-03. [2025-09-26T21:34:07.191596] [DEBUG] [LOCAL ] TBI: Primary data saved (22937 records). [2025-09-26T21:34:07.191767] [INFO ] [MAIN ] TBI: Full history saved. [2025-09-26T21:34:07.191865] [INFO ] [MAIN ] Update Progress: 2052/2371 symbols completed. TBI took 30.0s. Estimated remaining: 42m 36s. Rate: 7.5 symbols/min [2025-09-26T21:34:07.350776] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:34:07.379447] [INFO ] [MAIN ] TD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:34:07.375214] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-03 [2025-09-26T21:34:07.432364] [DEBUG] [LOCAL ] TD: Loaded 52650 existing records from primary storage. [2025-09-26T21:34:07.432546] [INFO ] [MAIN ] TD: Loaded 52650 existing records. [2025-09-26T21:34:07.634008] [WARN ] [MAIN ] TD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:34:07.634324] [INFO ] [MAIN ] TD: Wiping existing primary data before full refresh. [2025-09-26T21:34:07.634431] [INFO ] [LOCAL ] TD: Starting deletion of primary data. [2025-09-26T21:34:07.636000] [DEBUG] [LOCAL ] TD: Deleted primary data file. [2025-09-26T21:34:07.636089] [INFO ] [MAIN ] TD: Starting full primary refresh. [2025-09-26T21:34:07.916813] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-04. [2025-09-26T21:34:08.026416] [INFO ] [REMOTE ] TD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:34:08.188580] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:34:08.189029] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-04 [2025-09-26T21:34:08.711758] [INFO ] [REMOTE ] TD: Fetching primary data for 2024-12. [2025-09-26T21:34:09.511728] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-05. [2025-09-26T21:34:09.713545] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:34:09.713993] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-05 [2025-09-26T21:34:10.311723] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-06. [2025-09-26T21:34:10.509829] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:34:10.510173] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-06 [2025-09-26T21:34:10.655502] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-26T21:34:11.111773] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-08. [2025-09-26T21:34:11.461808] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-26T21:34:11.911765] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-07. [2025-09-26T21:34:12.114942] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:34:12.115469] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-07 [2025-09-26T21:34:12.711775] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-09. [2025-09-26T21:34:13.053060] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-26T21:34:13.053876] [INFO ] [REMOTE ] TBLU: Full fetch complete (1172 records). [2025-09-26T21:34:13.053963] [DEBUG] [VALIDATOR ] TBLU: Validating primary data. [2025-09-26T21:34:13.264820] [WARN ] [VALIDATOR ] TBLU: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-26T21:34:13.265202] [FATAL] [MAIN ] TBLU: Fetched primary data is invalid. Refusing to save it. [2025-09-26T21:34:13.265312] [WARN ] [MAIN ] TBLU: Deleting existing primary and derivative data due to validation failure. [2025-09-26T21:34:13.265418] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-09-26T21:34:13.265540] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-09-26T21:34:13.265624] [INFO ] [LOCAL ] TBLU: Starting deletion of derivative data. [2025-09-26T21:34:13.265764] [DEBUG] [LOCAL ] TBLU: No derivative data file found to delete. [2025-09-26T21:34:13.265862] [INFO ] [MAIN ] Update Progress: 2053/2371 symbols completed. TBLU took 32.2s. Estimated remaining: 42m 28s. Rate: 7.5 symbols/min [2025-09-26T21:34:13.466576] [INFO ] [MAIN ] TDC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:34:13.512221] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-01. [2025-09-26T21:34:13.514502] [DEBUG] [LOCAL ] TDC: Loaded 47186 existing records from primary storage. [2025-09-26T21:34:13.514602] [INFO ] [MAIN ] TDC: Loaded 47186 existing records. [2025-09-26T21:34:13.779290] [WARN ] [MAIN ] TDC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:34:13.779564] [INFO ] [MAIN ] TDC: Wiping existing primary data before full refresh. [2025-09-26T21:34:13.779614] [INFO ] [LOCAL ] TDC: Starting deletion of primary data. [2025-09-26T21:34:13.780866] [DEBUG] [LOCAL ] TDC: Deleted primary data file. [2025-09-26T21:34:13.780928] [INFO ] [MAIN ] TDC: Starting full primary refresh. [2025-09-26T21:34:14.164425] [INFO ] [REMOTE ] TDC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:34:14.311728] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-08. [2025-09-26T21:34:14.920779] [INFO ] [REMOTE ] TCAI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-26T21:34:15.111716] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-07. [2025-09-26T21:34:15.427507] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-26T21:34:15.460807] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-26T21:34:15.911777] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-09. [2025-09-26T21:34:16.483146] [INFO ] [REMOTE ] TCAI: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-26T21:34:16.485524] [INFO ] [REMOTE ] TCAI: Full fetch complete (1065 records). [2025-09-26T21:34:16.485629] [DEBUG] [VALIDATOR ] TCAI: Validating primary data. [2025-09-26T21:34:16.717083] [INFO ] [REMOTE ] TDC: Fetching primary data for 2024-12. [2025-09-26T21:34:16.789750] [WARN ] [VALIDATOR ] TCAI: Validation failed - insufficient historical data. Have 38 unique days, need 200 days [2025-09-26T21:34:16.790080] [FATAL] [MAIN ] TCAI: Fetched primary data is invalid. Refusing to save it. [2025-09-26T21:34:16.790167] [WARN ] [MAIN ] TCAI: Deleting existing primary and derivative data due to validation failure. [2025-09-26T21:34:16.790252] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-09-26T21:34:16.790362] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-09-26T21:34:16.790436] [INFO ] [LOCAL ] TCAI: Starting deletion of derivative data. [2025-09-26T21:34:16.790511] [DEBUG] [LOCAL ] TCAI: No derivative data file found to delete. [2025-09-26T21:34:16.790666] [INFO ] [MAIN ] Update Progress: 2054/2371 symbols completed. TCAI took 24.5s. Estimated remaining: 42m 19s. Rate: 7.5 symbols/min [2025-09-26T21:34:17.027398] [INFO ] [MAIN ] TDF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:34:17.041182] [DEBUG] [LOCAL ] TDF: Loaded 6536 existing records from primary storage. [2025-09-26T21:34:17.041351] [INFO ] [MAIN ] TDF: Loaded 6536 existing records. [2025-09-26T21:34:17.249270] [WARN ] [MAIN ] TDF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:34:17.249558] [INFO ] [MAIN ] TDF: Wiping existing primary data before full refresh. [2025-09-26T21:34:17.249638] [INFO ] [LOCAL ] TDF: Starting deletion of primary data. [2025-09-26T21:34:17.250051] [DEBUG] [LOCAL ] TDF: Deleted primary data file. [2025-09-26T21:34:17.250125] [INFO ] [MAIN ] TDF: Starting full primary refresh. [2025-09-26T21:34:17.519737] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-02. [2025-09-26T21:34:17.635339] [INFO ] [REMOTE ] TDF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:34:18.274006] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-26T21:34:18.311721] [INFO ] [REMOTE ] TDF: Fetching primary data for 2024-12. [2025-09-26T21:34:18.766549] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-26T21:34:19.111783] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-08. [2025-09-26T21:34:19.150672] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-26T21:34:19.644075] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-26T21:34:19.911749] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-01. [2025-09-26T21:34:20.711736] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-01. [2025-09-26T21:34:21.454910] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-26T21:34:21.511703] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-02. [2025-09-26T21:34:21.526401] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-26T21:34:22.311736] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-02. [2025-09-26T21:34:23.111743] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-09. [2025-09-26T21:34:23.181729] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-26T21:34:23.255991] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-26T21:34:23.710344] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-26T21:34:23.712172] [INFO ] [REMOTE ] TBN: Full fetch complete (4856 records). [2025-09-26T21:34:23.712246] [DEBUG] [VALIDATOR ] TBN: Validating primary data. [2025-09-26T21:34:23.916886] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-03. [2025-09-26T21:34:24.093106] [DEBUG] [VALIDATOR ] TBN: All expected trading days are present. [2025-09-26T21:34:24.093189] [DEBUG] [VALIDATOR ] TBN: Primary data validation passed. [2025-09-26T21:34:24.093356] [INFO ] [MAIN ] TBN: Fetched primary data is valid. [2025-09-26T21:34:24.093414] [DEBUG] [LOCAL ] TBN: Saving primary data. [2025-09-26T21:34:24.093873] [DEBUG] [LOCAL ] TBN: Trimmed 4856 records to 3044 (keeping 200 days of data) [2025-09-26T21:34:24.112223] [DEBUG] [LOCAL ] TBN: Primary data saved (3044 records). [2025-09-26T21:34:24.112339] [INFO ] [MAIN ] TBN: Full history saved. [2025-09-26T21:34:24.112426] [INFO ] [MAIN ] Update Progress: 2055/2371 symbols completed. TBN took 38.9s. Estimated remaining: 42m 11s. Rate: 7.5 symbols/min [2025-09-26T21:34:24.298845] [INFO ] [MAIN ] TDG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:34:24.326135] [DEBUG] [LOCAL ] TDG: Loaded 22191 existing records from primary storage. [2025-09-26T21:34:24.326282] [INFO ] [MAIN ] TDG: Loaded 22191 existing records. [2025-09-26T21:34:24.525505] [WARN ] [MAIN ] TDG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:34:24.525793] [INFO ] [MAIN ] TDG: Wiping existing primary data before full refresh. [2025-09-26T21:34:24.525851] [INFO ] [LOCAL ] TDG: Starting deletion of primary data. [2025-09-26T21:34:24.526479] [DEBUG] [LOCAL ] TDG: Deleted primary data file. [2025-09-26T21:34:24.526540] [INFO ] [MAIN ] TDG: Starting full primary refresh. [2025-09-26T21:34:24.714504] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-03. [2025-09-26T21:34:24.820499] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-26T21:34:24.924993] [INFO ] [REMOTE ] TDG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:34:25.511750] [INFO ] [REMOTE ] TDG: Fetching primary data for 2024-12. [2025-09-26T21:34:26.311747] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-03. [2025-09-26T21:34:26.668239] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-26T21:34:26.725880] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-26T21:34:27.111745] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-01. [2025-09-26T21:34:27.858163] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T21:34:27.911721] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-04. [2025-09-26T21:34:28.249349] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-26T21:34:28.711757] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-04. [2025-09-26T21:34:29.450708] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-26T21:34:29.511710] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-05. [2025-09-26T21:34:29.705683] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-26T21:34:30.223637] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-26T21:34:30.311728] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-05. [2025-09-26T21:34:31.111724] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-06. [2025-09-26T21:34:31.760187] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-26T21:34:31.916617] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-02. [2025-09-26T21:34:31.922476] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-26T21:34:32.711690] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-06. [2025-09-26T21:34:33.111040] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-26T21:34:33.511742] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-07. [2025-09-26T21:34:34.099591] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-26T21:34:34.242766] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-26T21:34:34.311722] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-08. [2025-09-26T21:34:34.777352] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-26T21:34:35.111726] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-04. [2025-09-26T21:34:35.911720] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-09. [2025-09-26T21:34:36.717428] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-03. [2025-09-26T21:34:36.720440] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-26T21:34:36.723329] [INFO ] [REMOTE ] TDF: Full fetch complete (10618 records). [2025-09-26T21:34:36.723675] [DEBUG] [VALIDATOR ] TDF: Validating primary data. [2025-09-26T21:34:37.135681] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-26T21:34:37.174516] [DEBUG] [VALIDATOR ] TDF: All expected trading days are present. [2025-09-26T21:34:37.174628] [DEBUG] [VALIDATOR ] TDF: Primary data validation passed. [2025-09-26T21:34:37.175412] [INFO ] [MAIN ] TDF: Fetched primary data is valid. [2025-09-26T21:34:37.175466] [DEBUG] [LOCAL ] TDF: Saving primary data. [2025-09-26T21:34:37.176030] [DEBUG] [LOCAL ] TDF: Trimmed 10618 records to 6595 (keeping 200 days of data) [2025-09-26T21:34:37.218451] [DEBUG] [LOCAL ] TDF: Primary data saved (6595 records). [2025-09-26T21:34:37.218601] [INFO ] [MAIN ] TDF: Full history saved. [2025-09-26T21:34:37.218720] [INFO ] [MAIN ] Update Progress: 2056/2371 symbols completed. TDF took 20.4s. Estimated remaining: 42m 4s. Rate: 7.5 symbols/min [2025-09-26T21:34:37.404471] [INFO ] [MAIN ] TDOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:34:37.473467] [DEBUG] [LOCAL ] TDOC: Loaded 53735 existing records from primary storage. [2025-09-26T21:34:37.473631] [INFO ] [MAIN ] TDOC: Loaded 53735 existing records. [2025-09-26T21:34:37.520330] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-05. [2025-09-26T21:34:37.682826] [WARN ] [MAIN ] TDOC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:34:37.683095] [INFO ] [MAIN ] TDOC: Wiping existing primary data before full refresh. [2025-09-26T21:34:37.683149] [INFO ] [LOCAL ] TDOC: Starting deletion of primary data. [2025-09-26T21:34:37.684426] [DEBUG] [LOCAL ] TDOC: Deleted primary data file. [2025-09-26T21:34:37.684489] [INFO ] [MAIN ] TDOC: Starting full primary refresh. [2025-09-26T21:34:38.059314] [INFO ] [REMOTE ] TDOC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:34:38.074088] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-26T21:34:38.311749] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2024-12. [2025-09-26T21:34:39.111743] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-04. [2025-09-26T21:34:39.444523] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-26T21:34:39.911749] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-06. [2025-09-26T21:34:40.434833] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-26T21:34:40.535206] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-26T21:34:40.711736] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-01. [2025-09-26T21:34:41.511698] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-07. [2025-09-26T21:34:41.690242] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-26T21:34:42.311700] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-07. [2025-09-26T21:34:42.679074] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-26T21:34:43.111698] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-02. [2025-09-26T21:34:43.227539] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-26T21:34:43.868987] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-26T21:34:43.911680] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-08. [2025-09-26T21:34:44.711735] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-05. [2025-09-26T21:34:45.444396] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-09-26T21:34:45.511883] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-08. [2025-09-26T21:34:45.863068] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-26T21:34:45.891594] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-26T21:34:46.311738] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-03. [2025-09-26T21:34:47.111735] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-09. [2025-09-26T21:34:47.226260] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-26T21:34:47.911738] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-09. [2025-09-26T21:34:48.374037] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-26T21:34:48.711744] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-06. [2025-09-26T21:34:48.790627] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-26T21:34:48.802454] [INFO ] [REMOTE ] TD: Full fetch complete (75784 records). [2025-09-26T21:34:48.802604] [DEBUG] [VALIDATOR ] TD: Validating primary data. [2025-09-26T21:34:49.256304] [DEBUG] [VALIDATOR ] TD: All expected trading days are present. [2025-09-26T21:34:49.256452] [DEBUG] [VALIDATOR ] TD: Primary data validation passed. [2025-09-26T21:34:49.257865] [INFO ] [MAIN ] TD: Fetched primary data is valid. [2025-09-26T21:34:49.257974] [DEBUG] [LOCAL ] TD: Saving primary data. [2025-09-26T21:34:49.269714] [DEBUG] [LOCAL ] TD: Trimmed 75784 records to 53036 (keeping 200 days of data) [2025-09-26T21:34:49.511759] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-04. [2025-09-26T21:34:49.563316] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T21:34:49.580049] [INFO ] [REMOTE ] TDC: Full fetch complete (66787 records). [2025-09-26T21:34:49.581222] [DEBUG] [VALIDATOR ] TDC: Validating primary data. [2025-09-26T21:34:49.973585] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-26T21:34:50.121240] [DEBUG] [LOCAL ] TD: Primary data saved (53036 records). [2025-09-26T21:34:50.138137] [DEBUG] [VALIDATOR ] TDC: All expected trading days are present. [2025-09-26T21:34:50.138503] [DEBUG] [VALIDATOR ] TDC: Primary data validation passed. [2025-09-26T21:34:50.138359] [INFO ] [MAIN ] TD: Full history saved. [2025-09-26T21:34:50.139768] [INFO ] [MAIN ] TDC: Fetched primary data is valid. [2025-09-26T21:34:50.139872] [DEBUG] [LOCAL ] TDC: Saving primary data. [2025-09-26T21:34:50.140188] [INFO ] [MAIN ] Update Progress: 2057/2371 symbols completed. TD took 42.9s. Estimated remaining: 41m 57s. Rate: 7.5 symbols/min [2025-09-26T21:34:50.253840] [DEBUG] [LOCAL ] TDC: Trimmed 66787 records to 47501 (keeping 200 days of data) [2025-09-26T21:34:50.333015] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-07. [2025-09-26T21:34:50.428328] [INFO ] [MAIN ] TDS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:34:50.488489] [DEBUG] [LOCAL ] TDS: Loaded 43081 existing records from primary storage. [2025-09-26T21:34:50.491584] [INFO ] [MAIN ] TDS: Loaded 43081 existing records. [2025-09-26T21:34:50.789920] [WARN ] [MAIN ] TDS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:34:50.793676] [INFO ] [MAIN ] TDS: Wiping existing primary data before full refresh. [2025-09-26T21:34:50.794041] [INFO ] [LOCAL ] TDS: Starting deletion of primary data. [2025-09-26T21:34:50.796015] [DEBUG] [LOCAL ] TDS: Deleted primary data file. [2025-09-26T21:34:50.796404] [INFO ] [MAIN ] TDS: Starting full primary refresh. [2025-09-26T21:34:51.293806] [INFO ] [REMOTE ] TDS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:34:51.312285] [INFO ] [REMOTE ] TDS: Fetching primary data for 2024-12. [2025-09-26T21:34:51.324810] [DEBUG] [LOCAL ] TDC: Primary data saved (47501 records). [2025-09-26T21:34:51.324927] [INFO ] [MAIN ] TDC: Full history saved. [2025-09-26T21:34:51.325058] [INFO ] [MAIN ] Update Progress: 2058/2371 symbols completed. TDC took 38.1s. Estimated remaining: 41m 48s. Rate: 7.5 symbols/min [2025-09-26T21:34:51.517353] [INFO ] [MAIN ] TDW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:34:51.533773] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-26T21:34:51.605819] [DEBUG] [LOCAL ] TDW: Loaded 45760 existing records from primary storage. [2025-09-26T21:34:51.606089] [INFO ] [MAIN ] TDW: Loaded 45760 existing records. [2025-09-26T21:34:51.857329] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-26T21:34:51.861731] [WARN ] [MAIN ] TDW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:34:51.873596] [INFO ] [MAIN ] TDW: Wiping existing primary data before full refresh. [2025-09-26T21:34:51.873716] [INFO ] [LOCAL ] TDW: Starting deletion of primary data. [2025-09-26T21:34:51.875156] [DEBUG] [LOCAL ] TDW: Deleted primary data file. [2025-09-26T21:34:51.875237] [INFO ] [MAIN ] TDW: Starting full primary refresh. [2025-09-26T21:34:51.916823] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-05. [2025-09-26T21:34:52.258250] [INFO ] [REMOTE ] TDW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:34:52.711739] [INFO ] [REMOTE ] TDW: Fetching primary data for 2024-12. [2025-09-26T21:34:53.009564] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-26T21:34:53.363666] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-26T21:34:53.511722] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-01. [2025-09-26T21:34:54.311739] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-06. [2025-09-26T21:34:54.416821] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-26T21:34:55.046718] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-26T21:34:55.111700] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-02. [2025-09-26T21:34:55.911717] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-01. [2025-09-26T21:34:56.197955] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-26T21:34:56.481143] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-26T21:34:56.711732] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-07. [2025-09-26T21:34:57.511723] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-03. [2025-09-26T21:34:57.859788] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-26T21:34:58.311733] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-08. [2025-09-26T21:34:58.943593] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-26T21:34:59.111746] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-08. [2025-09-26T21:34:59.168322] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-26T21:34:59.616243] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-26T21:34:59.911737] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-04. [2025-09-26T21:35:00.711710] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-02. [2025-09-26T21:35:01.204444] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-26T21:35:01.291293] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-26T21:35:01.511734] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-05. [2025-09-26T21:35:02.304666] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-26T21:35:02.313921] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-09. [2025-09-26T21:35:03.111735] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-03. [2025-09-26T21:35:03.237461] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-26T21:35:03.911725] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-09. [2025-09-26T21:35:04.304917] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-26T21:35:04.316739] [INFO ] [REMOTE ] TDOC: Full fetch complete (77273 records). [2025-09-26T21:35:04.316918] [DEBUG] [VALIDATOR ] TDOC: Validating primary data. [2025-09-26T21:35:04.675565] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-26T21:35:04.713234] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-06. [2025-09-26T21:35:04.726347] [INFO ] [REMOTE ] TDG: Full fetch complete (32059 records). [2025-09-26T21:35:04.732576] [DEBUG] [VALIDATOR ] TDG: Validating primary data. [2025-09-26T21:35:04.834314] [DEBUG] [VALIDATOR ] TDOC: All expected trading days are present. [2025-09-26T21:35:04.855041] [DEBUG] [VALIDATOR ] TDOC: Primary data validation passed. [2025-09-26T21:35:04.870784] [INFO ] [MAIN ] TDOC: Fetched primary data is valid. [2025-09-26T21:35:04.878103] [DEBUG] [LOCAL ] TDOC: Saving primary data. [2025-09-26T21:35:04.934983] [DEBUG] [LOCAL ] TDOC: Trimmed 77273 records to 54125 (keeping 200 days of data) [2025-09-26T21:35:05.297766] [DEBUG] [VALIDATOR ] TDG: All expected trading days are present. [2025-09-26T21:35:05.298600] [DEBUG] [VALIDATOR ] TDG: Primary data validation passed. [2025-09-26T21:35:05.300318] [INFO ] [MAIN ] TDG: Fetched primary data is valid. [2025-09-26T21:35:05.300418] [DEBUG] [LOCAL ] TDG: Saving primary data. [2025-09-26T21:35:05.388410] [DEBUG] [LOCAL ] TDG: Trimmed 32059 records to 22314 (keeping 200 days of data) [2025-09-26T21:35:05.391180] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-26T21:35:05.518383] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-04. [2025-09-26T21:35:05.781777] [DEBUG] [LOCAL ] TDG: Primary data saved (22314 records). [2025-09-26T21:35:05.783372] [INFO ] [MAIN ] TDG: Full history saved. [2025-09-26T21:35:05.783915] [INFO ] [MAIN ] Update Progress: 2059/2371 symbols completed. TDG took 41.7s. Estimated remaining: 41m 41s. Rate: 7.5 symbols/min [2025-09-26T21:35:05.974000] [INFO ] [MAIN ] TDY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:35:06.013329] [DEBUG] [LOCAL ] TDOC: Primary data saved (54125 records). [2025-09-26T21:35:06.013602] [INFO ] [MAIN ] TDOC: Full history saved. [2025-09-26T21:35:06.014027] [DEBUG] [LOCAL ] TDY: Loaded 22795 existing records from primary storage. [2025-09-26T21:35:06.014297] [INFO ] [MAIN ] Update Progress: 2060/2371 symbols completed. TDOC took 28.8s. Estimated remaining: 41m 31s. Rate: 7.5 symbols/min [2025-09-26T21:35:06.014437] [INFO ] [MAIN ] TDY: Loaded 22795 existing records. [2025-09-26T21:35:06.322287] [WARN ] [MAIN ] TDY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:35:06.322858] [INFO ] [MAIN ] TDY: Wiping existing primary data before full refresh. [2025-09-26T21:35:06.322934] [INFO ] [LOCAL ] TDY: Starting deletion of primary data. [2025-09-26T21:35:06.329048] [DEBUG] [LOCAL ] TDY: Deleted primary data file. [2025-09-26T21:35:06.339668] [INFO ] [MAIN ] TDY: Starting full primary refresh. [2025-09-26T21:35:06.465915] [INFO ] [MAIN ] TE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:35:06.498805] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-26T21:35:06.511207] [DEBUG] [LOCAL ] TE: No existing data file found in primary storage. [2025-09-26T21:35:06.521597] [WARN ] [MAIN ] TE: No existing data found, performing full refresh instead. [2025-09-26T21:35:06.549977] [INFO ] [MAIN ] TE: Wiping existing primary data before full refresh. [2025-09-26T21:35:06.550325] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-09-26T21:35:06.551226] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-07. [2025-09-26T21:35:06.552327] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-09-26T21:35:06.557957] [INFO ] [MAIN ] TE: Starting full primary refresh. [2025-09-26T21:35:07.159620] [INFO ] [REMOTE ] TDY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:35:07.169049] [INFO ] [REMOTE ] TDY: Fetching primary data for 2024-12. [2025-09-26T21:35:07.258904] [INFO ] [REMOTE ] TE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:35:07.291887] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-26T21:35:07.703395] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-26T21:35:07.911736] [INFO ] [REMOTE ] TE: Fetching primary data for 2024-12. [2025-09-26T21:35:08.112851] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:35:08.113190] [WARN ] [REMOTE ] TE: No data returned for month 2024-12 [2025-09-26T21:35:08.372815] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-26T21:35:08.711779] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-08. [2025-09-26T21:35:09.511755] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-01. [2025-09-26T21:35:09.721776] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:35:09.722407] [WARN ] [REMOTE ] TE: No data returned for month 2025-01 [2025-09-26T21:35:10.311734] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-02. [2025-09-26T21:35:10.426435] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-26T21:35:10.524878] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:35:10.525352] [WARN ] [REMOTE ] TE: No data returned for month 2025-02 [2025-09-26T21:35:11.111742] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-01. [2025-09-26T21:35:11.911723] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-09. [2025-09-26T21:35:12.374592] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-26T21:35:12.711732] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-02. [2025-09-26T21:35:13.274529] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-26T21:35:13.283337] [INFO ] [REMOTE ] TDS: Full fetch complete (61563 records). [2025-09-26T21:35:13.283517] [DEBUG] [VALIDATOR ] TDS: Validating primary data. [2025-09-26T21:35:13.523193] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-03. [2025-09-26T21:35:13.719561] [DEBUG] [VALIDATOR ] TDS: All expected trading days are present. [2025-09-26T21:35:13.719876] [DEBUG] [VALIDATOR ] TDS: Primary data validation passed. [2025-09-26T21:35:13.720885] [INFO ] [MAIN ] TDS: Fetched primary data is valid. [2025-09-26T21:35:13.720953] [DEBUG] [LOCAL ] TDS: Saving primary data. [2025-09-26T21:35:13.722425] [DEBUG] [LOCAL ] TDS: Trimmed 61563 records to 43435 (keeping 200 days of data) [2025-09-26T21:35:13.990511] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-26T21:35:14.059326] [DEBUG] [LOCAL ] TDS: Primary data saved (43435 records). [2025-09-26T21:35:14.059466] [INFO ] [MAIN ] TDS: Full history saved. [2025-09-26T21:35:14.059578] [INFO ] [MAIN ] Update Progress: 2061/2371 symbols completed. TDS took 23.9s. Estimated remaining: 41m 23s. Rate: 7.5 symbols/min [2025-09-26T21:35:14.234636] [INFO ] [MAIN ] TEAF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:35:14.246220] [DEBUG] [LOCAL ] TEAF: Loaded 7487 existing records from primary storage. [2025-09-26T21:35:14.246339] [INFO ] [MAIN ] TEAF: Loaded 7487 existing records. [2025-09-26T21:35:14.316898] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-05. [2025-09-26T21:35:14.442530] [WARN ] [MAIN ] TEAF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:35:14.442828] [INFO ] [MAIN ] TEAF: Wiping existing primary data before full refresh. [2025-09-26T21:35:14.442881] [INFO ] [LOCAL ] TEAF: Starting deletion of primary data. [2025-09-26T21:35:14.443288] [DEBUG] [LOCAL ] TEAF: Deleted primary data file. [2025-09-26T21:35:14.443382] [INFO ] [MAIN ] TEAF: Starting full primary refresh. [2025-09-26T21:35:14.836423] [INFO ] [REMOTE ] TEAF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:35:15.111738] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2024-12. [2025-09-26T21:35:15.409573] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-26T21:35:15.892414] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-26T21:35:15.911675] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-01. [2025-09-26T21:35:16.145631] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-26T21:35:16.507177] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-26T21:35:16.711740] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-04. [2025-09-26T21:35:17.511746] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-03. [2025-09-26T21:35:18.316841] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-06. [2025-09-26T21:35:18.335193] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-26T21:35:18.691120] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-26T21:35:19.111724] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-04. [2025-09-26T21:35:19.911724] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-05. [2025-09-26T21:35:20.038226] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-26T21:35:20.407744] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-26T21:35:20.711743] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-05. [2025-09-26T21:35:21.466084] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-26T21:35:21.511759] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-07. [2025-09-26T21:35:21.544502] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-26T21:35:22.311739] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-06. [2025-09-26T21:35:23.111706] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-06. [2025-09-26T21:35:23.283806] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-26T21:35:23.911700] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-08. [2025-09-26T21:35:24.040466] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-26T21:35:24.222375] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-26T21:35:24.711763] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-07. [2025-09-26T21:35:25.511744] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-07. [2025-09-26T21:35:25.640161] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-26T21:35:26.286818] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-26T21:35:26.311681] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-09. [2025-09-26T21:35:26.888287] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-26T21:35:27.111732] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-02. [2025-09-26T21:35:27.692087] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-26T21:35:27.882799] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-26T21:35:27.891250] [INFO ] [REMOTE ] TDW: Full fetch complete (67187 records). [2025-09-26T21:35:27.891389] [DEBUG] [VALIDATOR ] TDW: Validating primary data. [2025-09-26T21:35:27.916989] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-08. [2025-09-26T21:35:28.316375] [DEBUG] [VALIDATOR ] TDW: All expected trading days are present. [2025-09-26T21:35:28.316480] [DEBUG] [VALIDATOR ] TDW: Primary data validation passed. [2025-09-26T21:35:28.317538] [INFO ] [MAIN ] TDW: Fetched primary data is valid. [2025-09-26T21:35:28.317606] [DEBUG] [LOCAL ] TDW: Saving primary data. [2025-09-26T21:35:28.319180] [DEBUG] [LOCAL ] TDW: Trimmed 67187 records to 46091 (keeping 200 days of data) [2025-09-26T21:35:28.602117] [DEBUG] [LOCAL ] TDW: Primary data saved (46091 records). [2025-09-26T21:35:28.602311] [INFO ] [MAIN ] TDW: Full history saved. [2025-09-26T21:35:28.602506] [INFO ] [MAIN ] Update Progress: 2062/2371 symbols completed. TDW took 37.3s. Estimated remaining: 41m 16s. Rate: 7.5 symbols/min [2025-09-26T21:35:28.716954] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-08. [2025-09-26T21:35:28.812738] [INFO ] [MAIN ] TECK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:35:28.869457] [DEBUG] [LOCAL ] TECK: Loaded 53826 existing records from primary storage. [2025-09-26T21:35:28.869712] [INFO ] [MAIN ] TECK: Loaded 53826 existing records. [2025-09-26T21:35:29.087398] [WARN ] [MAIN ] TECK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:35:29.087742] [INFO ] [MAIN ] TECK: Wiping existing primary data before full refresh. [2025-09-26T21:35:29.087801] [INFO ] [LOCAL ] TECK: Starting deletion of primary data. [2025-09-26T21:35:29.089287] [DEBUG] [LOCAL ] TECK: Deleted primary data file. [2025-09-26T21:35:29.089353] [INFO ] [MAIN ] TECK: Starting full primary refresh. [2025-09-26T21:35:29.499516] [INFO ] [REMOTE ] TECK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:35:29.511717] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-03. [2025-09-26T21:35:29.722186] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-26T21:35:29.780810] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-26T21:35:30.311806] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-26T21:35:30.311919] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-09. [2025-09-26T21:35:31.111769] [INFO ] [REMOTE ] TECK: Fetching primary data for 2024-12. [2025-09-26T21:35:31.359847] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-26T21:35:31.364489] [INFO ] [REMOTE ] TDY: Full fetch complete (32381 records). [2025-09-26T21:35:31.364677] [DEBUG] [VALIDATOR ] TDY: Validating primary data. [2025-09-26T21:35:31.750050] [DEBUG] [VALIDATOR ] TDY: All expected trading days are present. [2025-09-26T21:35:31.750159] [DEBUG] [VALIDATOR ] TDY: Primary data validation passed. [2025-09-26T21:35:31.751091] [INFO ] [MAIN ] TDY: Fetched primary data is valid. [2025-09-26T21:35:31.751156] [DEBUG] [LOCAL ] TDY: Saving primary data. [2025-09-26T21:35:31.752222] [DEBUG] [LOCAL ] TDY: Trimmed 32381 records to 22979 (keeping 200 days of data) [2025-09-26T21:35:31.898864] [DEBUG] [LOCAL ] TDY: Primary data saved (22979 records). [2025-09-26T21:35:31.899042] [INFO ] [MAIN ] TDY: Full history saved. [2025-09-26T21:35:31.899170] [INFO ] [MAIN ] Update Progress: 2063/2371 symbols completed. TDY took 26.1s. Estimated remaining: 41m 8s. Rate: 7.5 symbols/min [2025-09-26T21:35:31.920920] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-04. [2025-09-26T21:35:32.082381] [INFO ] [MAIN ] TEF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:35:32.131854] [DEBUG] [LOCAL ] TEF: Loaded 37632 existing records from primary storage. [2025-09-26T21:35:32.132039] [INFO ] [MAIN ] TEF: Loaded 37632 existing records. [2025-09-26T21:35:32.325208] [WARN ] [MAIN ] TEF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:35:32.325489] [INFO ] [MAIN ] TEF: Wiping existing primary data before full refresh. [2025-09-26T21:35:32.325540] [INFO ] [LOCAL ] TEF: Starting deletion of primary data. [2025-09-26T21:35:32.326449] [DEBUG] [LOCAL ] TEF: Deleted primary data file. [2025-09-26T21:35:32.326511] [INFO ] [MAIN ] TEF: Starting full primary refresh. [2025-09-26T21:35:32.718330] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-09. [2025-09-26T21:35:32.725246] [INFO ] [REMOTE ] TEF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:35:32.837765] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-26T21:35:32.930317] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-26T21:35:33.511745] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-01. [2025-09-26T21:35:34.311776] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-05. [2025-09-26T21:35:34.476274] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-26T21:35:34.486132] [INFO ] [REMOTE ] TE: Full fetch complete (47418 records). [2025-09-26T21:35:34.486303] [DEBUG] [VALIDATOR ] TE: Validating primary data. [2025-09-26T21:35:34.688729] [WARN ] [VALIDATOR ] TE: Validation failed - insufficient historical data. Have 145 unique days, need 200 days [2025-09-26T21:35:34.689383] [FATAL] [MAIN ] TE: Fetched primary data is invalid. Refusing to save it. [2025-09-26T21:35:34.689463] [WARN ] [MAIN ] TE: Deleting existing primary and derivative data due to validation failure. [2025-09-26T21:35:34.689539] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-09-26T21:35:34.689635] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-09-26T21:35:34.689723] [INFO ] [LOCAL ] TE: Starting deletion of derivative data. [2025-09-26T21:35:34.689789] [DEBUG] [LOCAL ] TE: No derivative data file found to delete. [2025-09-26T21:35:34.689891] [INFO ] [MAIN ] Update Progress: 2064/2371 symbols completed. TE took 28.7s. Estimated remaining: 40m 59s. Rate: 7.5 symbols/min [2025-09-26T21:35:34.867998] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-26T21:35:34.888708] [INFO ] [MAIN ] TEI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:35:34.913067] [DEBUG] [LOCAL ] TEI: Loaded 20713 existing records from primary storage. [2025-09-26T21:35:34.913212] [INFO ] [MAIN ] TEI: Loaded 20713 existing records. [2025-09-26T21:35:35.110674] [WARN ] [MAIN ] TEI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:35:35.111205] [INFO ] [MAIN ] TEI: Wiping existing primary data before full refresh. [2025-09-26T21:35:35.111380] [INFO ] [LOCAL ] TEI: Starting deletion of primary data. [2025-09-26T21:35:35.111684] [INFO ] [REMOTE ] TEF: Fetching primary data for 2024-12. [2025-09-26T21:35:35.112973] [DEBUG] [LOCAL ] TEI: Deleted primary data file. [2025-09-26T21:35:35.113121] [INFO ] [MAIN ] TEI: Starting full primary refresh. [2025-09-26T21:35:35.508830] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-26T21:35:35.554303] [INFO ] [REMOTE ] TEI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:35:35.911720] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-02. [2025-09-26T21:35:36.720600] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-06. [2025-09-26T21:35:36.725869] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-26T21:35:37.511895] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-01. [2025-09-26T21:35:37.512830] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-26T21:35:37.634343] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-26T21:35:38.311740] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-03. [2025-09-26T21:35:39.081212] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T21:35:39.111686] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-02. [2025-09-26T21:35:39.911740] [INFO ] [REMOTE ] TEI: Fetching primary data for 2024-12. [2025-09-26T21:35:40.113358] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-26T21:35:40.601165] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-26T21:35:40.711749] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-04. [2025-09-26T21:35:40.925780] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-26T21:35:41.511734] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-03. [2025-09-26T21:35:42.311713] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-07. [2025-09-26T21:35:42.522347] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-26T21:35:43.044422] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-26T21:35:43.116811] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-01. [2025-09-26T21:35:43.132297] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-26T21:35:43.911738] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-08. [2025-09-26T21:35:44.208216] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-26T21:35:44.334826] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-26T21:35:44.711756] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-04. [2025-09-26T21:35:45.511721] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-02. [2025-09-26T21:35:46.269850] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-26T21:35:46.311685] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-05. [2025-09-26T21:35:46.329786] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-26T21:35:47.111736] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-05. [2025-09-26T21:35:47.861893] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-26T21:35:47.911744] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-03. [2025-09-26T21:35:48.711905] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-09. [2025-09-26T21:35:48.949402] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-26T21:35:49.111019] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-26T21:35:49.489164] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-26T21:35:49.491417] [INFO ] [REMOTE ] TEAF: Full fetch complete (9926 records). [2025-09-26T21:35:49.491511] [DEBUG] [VALIDATOR ] TEAF: Validating primary data. [2025-09-26T21:35:49.516825] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-06. [2025-09-26T21:35:49.874280] [DEBUG] [VALIDATOR ] TEAF: All expected trading days are present. [2025-09-26T21:35:49.874365] [DEBUG] [VALIDATOR ] TEAF: Primary data validation passed. [2025-09-26T21:35:49.874619] [INFO ] [MAIN ] TEAF: Fetched primary data is valid. [2025-09-26T21:35:49.874694] [DEBUG] [LOCAL ] TEAF: Saving primary data. [2025-09-26T21:35:49.875213] [DEBUG] [LOCAL ] TEAF: Trimmed 9926 records to 7529 (keeping 200 days of data) [2025-09-26T21:35:49.923556] [DEBUG] [LOCAL ] TEAF: Primary data saved (7529 records). [2025-09-26T21:35:49.923776] [INFO ] [MAIN ] TEAF: Full history saved. [2025-09-26T21:35:49.923878] [INFO ] [MAIN ] Update Progress: 2065/2371 symbols completed. TEAF took 35.9s. Estimated remaining: 40m 52s. Rate: 7.5 symbols/min [2025-09-26T21:35:50.117607] [INFO ] [MAIN ] TEL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:35:50.181046] [DEBUG] [LOCAL ] TEL: Loaded 51528 existing records from primary storage. [2025-09-26T21:35:50.181235] [INFO ] [MAIN ] TEL: Loaded 51528 existing records. [2025-09-26T21:35:50.316887] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-04. [2025-09-26T21:35:50.383922] [WARN ] [MAIN ] TEL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:35:50.384241] [INFO ] [MAIN ] TEL: Wiping existing primary data before full refresh. [2025-09-26T21:35:50.384301] [INFO ] [LOCAL ] TEL: Starting deletion of primary data. [2025-09-26T21:35:50.385838] [DEBUG] [LOCAL ] TEL: Deleted primary data file. [2025-09-26T21:35:50.385903] [INFO ] [MAIN ] TEL: Starting full primary refresh. [2025-09-26T21:35:50.774344] [INFO ] [REMOTE ] TEL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:35:51.111704] [INFO ] [REMOTE ] TEL: Fetching primary data for 2024-12. [2025-09-26T21:35:51.291867] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-26T21:35:51.442935] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-26T21:35:51.911739] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-05. [2025-09-26T21:35:52.711717] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-06. [2025-09-26T21:35:52.862847] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-26T21:35:52.992353] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-26T21:35:53.511728] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-07. [2025-09-26T21:35:54.124303] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-26T21:35:54.311721] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-07. [2025-09-26T21:35:55.111717] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-06. [2025-09-26T21:35:55.262709] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-26T21:35:55.784596] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-26T21:35:55.911732] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-08. [2025-09-26T21:35:56.318815] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-26T21:35:56.711721] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-08. [2025-09-26T21:35:57.355312] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-26T21:35:57.511730] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-01. [2025-09-26T21:35:58.311741] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-07. [2025-09-26T21:35:58.452441] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-26T21:35:59.115322] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-09. [2025-09-26T21:35:59.119905] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-26T21:35:59.415999] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-26T21:35:59.911732] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-09. [2025-09-26T21:36:00.716810] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-08. [2025-09-26T21:36:00.728728] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-26T21:36:00.737504] [INFO ] [REMOTE ] TEF: Full fetch complete (54647 records). [2025-09-26T21:36:00.737757] [DEBUG] [VALIDATOR ] TEF: Validating primary data. [2025-09-26T21:36:01.154151] [DEBUG] [VALIDATOR ] TEF: All expected trading days are present. [2025-09-26T21:36:01.154594] [DEBUG] [VALIDATOR ] TEF: Primary data validation passed. [2025-09-26T21:36:01.155906] [INFO ] [MAIN ] TEF: Fetched primary data is valid. [2025-09-26T21:36:01.155995] [DEBUG] [LOCAL ] TEF: Saving primary data. [2025-09-26T21:36:01.158799] [DEBUG] [LOCAL ] TEF: Trimmed 54647 records to 37944 (keeping 200 days of data) [2025-09-26T21:36:01.390791] [DEBUG] [LOCAL ] TEF: Primary data saved (37944 records). [2025-09-26T21:36:01.391032] [INFO ] [MAIN ] TEF: Full history saved. [2025-09-26T21:36:01.391210] [INFO ] [MAIN ] Update Progress: 2066/2371 symbols completed. TEF took 29.5s. Estimated remaining: 40m 44s. Rate: 7.5 symbols/min [2025-09-26T21:36:01.512427] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-02. [2025-09-26T21:36:01.593776] [INFO ] [MAIN ] TEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:36:01.628710] [DEBUG] [LOCAL ] TEN: Loaded 31215 existing records from primary storage. [2025-09-26T21:36:01.628862] [INFO ] [MAIN ] TEN: Loaded 31215 existing records. [2025-09-26T21:36:01.828431] [WARN ] [MAIN ] TEN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:36:01.829105] [INFO ] [MAIN ] TEN: Wiping existing primary data before full refresh. [2025-09-26T21:36:01.829189] [INFO ] [LOCAL ] TEN: Starting deletion of primary data. [2025-09-26T21:36:01.845254] [DEBUG] [LOCAL ] TEN: Deleted primary data file. [2025-09-26T21:36:01.867788] [INFO ] [MAIN ] TEN: Starting full primary refresh. [2025-09-26T21:36:01.937165] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-26T21:36:02.023187] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-26T21:36:02.050441] [INFO ] [REMOTE ] TECK: Full fetch complete (77306 records). [2025-09-26T21:36:02.070727] [DEBUG] [VALIDATOR ] TECK: Validating primary data. [2025-09-26T21:36:02.316846] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-09. [2025-09-26T21:36:02.530767] [INFO ] [REMOTE ] TEN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:36:02.818163] [DEBUG] [VALIDATOR ] TECK: All expected trading days are present. [2025-09-26T21:36:02.818292] [DEBUG] [VALIDATOR ] TECK: Primary data validation passed. [2025-09-26T21:36:02.819484] [INFO ] [MAIN ] TECK: Fetched primary data is valid. [2025-09-26T21:36:02.819560] [DEBUG] [LOCAL ] TECK: Saving primary data. [2025-09-26T21:36:02.821517] [DEBUG] [LOCAL ] TECK: Trimmed 77306 records to 54216 (keeping 200 days of data) [2025-09-26T21:36:03.113007] [INFO ] [REMOTE ] TEN: Fetching primary data for 2024-12. [2025-09-26T21:36:03.154670] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-26T21:36:03.279172] [DEBUG] [LOCAL ] TECK: Primary data saved (54216 records). [2025-09-26T21:36:03.279389] [INFO ] [MAIN ] TECK: Full history saved. [2025-09-26T21:36:03.279528] [INFO ] [MAIN ] Update Progress: 2067/2371 symbols completed. TECK took 34.7s. Estimated remaining: 40m 36s. Rate: 7.5 symbols/min [2025-09-26T21:36:03.560625] [INFO ] [MAIN ] TEO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:36:03.569187] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-26T21:36:03.576951] [INFO ] [REMOTE ] TEI: Full fetch complete (30081 records). [2025-09-26T21:36:03.577175] [DEBUG] [VALIDATOR ] TEI: Validating primary data. [2025-09-26T21:36:03.758678] [DEBUG] [LOCAL ] TEO: Loaded 22136 existing records from primary storage. [2025-09-26T21:36:03.765160] [INFO ] [MAIN ] TEO: Loaded 22136 existing records. [2025-09-26T21:36:03.945701] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-03. [2025-09-26T21:36:04.187274] [WARN ] [MAIN ] TEO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:36:04.238231] [INFO ] [MAIN ] TEO: Wiping existing primary data before full refresh. [2025-09-26T21:36:04.269487] [INFO ] [LOCAL ] TEO: Starting deletion of primary data. [2025-09-26T21:36:04.323338] [DEBUG] [LOCAL ] TEO: Deleted primary data file. [2025-09-26T21:36:04.337921] [DEBUG] [VALIDATOR ] TEI: All expected trading days are present. [2025-09-26T21:36:04.338074] [INFO ] [MAIN ] TEO: Starting full primary refresh. [2025-09-26T21:36:04.343349] [DEBUG] [VALIDATOR ] TEI: Primary data validation passed. [2025-09-26T21:36:04.356977] [INFO ] [MAIN ] TEI: Fetched primary data is valid. [2025-09-26T21:36:04.392754] [DEBUG] [LOCAL ] TEI: Saving primary data. [2025-09-26T21:36:04.458294] [DEBUG] [LOCAL ] TEI: Trimmed 30081 records to 20910 (keeping 200 days of data) [2025-09-26T21:36:04.618289] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-26T21:36:04.718698] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-01. [2025-09-26T21:36:04.757377] [DEBUG] [LOCAL ] TEI: Primary data saved (20910 records). [2025-09-26T21:36:04.776802] [INFO ] [MAIN ] TEI: Full history saved. [2025-09-26T21:36:04.783715] [INFO ] [MAIN ] Update Progress: 2068/2371 symbols completed. TEI took 30.1s. Estimated remaining: 40m 27s. Rate: 7.5 symbols/min [2025-09-26T21:36:05.096890] [INFO ] [REMOTE ] TEO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:36:05.147374] [INFO ] [MAIN ] TEVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:36:05.205072] [DEBUG] [LOCAL ] TEVA: Loaded 54023 existing records from primary storage. [2025-09-26T21:36:05.205219] [INFO ] [MAIN ] TEVA: Loaded 54023 existing records. [2025-09-26T21:36:05.393274] [WARN ] [MAIN ] TEVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:36:05.393520] [INFO ] [MAIN ] TEVA: Wiping existing primary data before full refresh. [2025-09-26T21:36:05.393569] [INFO ] [LOCAL ] TEVA: Starting deletion of primary data. [2025-09-26T21:36:05.394817] [DEBUG] [LOCAL ] TEVA: Deleted primary data file. [2025-09-26T21:36:05.394880] [INFO ] [MAIN ] TEVA: Starting full primary refresh. [2025-09-26T21:36:05.516824] [INFO ] [REMOTE ] TEO: Fetching primary data for 2024-12. [2025-09-26T21:36:05.784432] [INFO ] [REMOTE ] TEVA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:36:05.892427] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-26T21:36:06.020981] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-26T21:36:06.311728] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-04. [2025-09-26T21:36:06.399860] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-26T21:36:07.111763] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2024-12. [2025-09-26T21:36:07.911726] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-02. [2025-09-26T21:36:08.349752] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-26T21:36:08.711693] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-01. [2025-09-26T21:36:09.078468] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-26T21:36:09.153431] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-26T21:36:09.511736] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-05. [2025-09-26T21:36:10.030362] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-26T21:36:10.311729] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-02. [2025-09-26T21:36:11.111708] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-03. [2025-09-26T21:36:11.355962] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-26T21:36:11.455713] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-26T21:36:11.911721] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-01. [2025-09-26T21:36:12.534049] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-26T21:36:12.711723] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-04. [2025-09-26T21:36:13.511737] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-03. [2025-09-26T21:36:13.830923] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-26T21:36:14.233841] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T21:36:14.295795] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-26T21:36:14.311699] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-04. [2025-09-26T21:36:15.111733] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-06. [2025-09-26T21:36:15.243909] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-26T21:36:15.911737] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-02. [2025-09-26T21:36:16.631854] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-26T21:36:16.711720] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-07. [2025-09-26T21:36:17.511691] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-05. [2025-09-26T21:36:18.005251] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-26T21:36:18.311706] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-03. [2025-09-26T21:36:18.669882] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-26T21:36:18.699387] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-26T21:36:19.111728] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-06. [2025-09-26T21:36:19.868280] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-26T21:36:19.911732] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-08. [2025-09-26T21:36:20.444820] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-26T21:36:20.711729] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-04. [2025-09-26T21:36:21.243709] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-26T21:36:21.511737] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-07. [2025-09-26T21:36:22.311713] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-09. [2025-09-26T21:36:22.508016] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-26T21:36:22.929010] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-26T21:36:23.098260] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-26T21:36:23.108123] [INFO ] [REMOTE ] TEL: Full fetch complete (73408 records). [2025-09-26T21:36:23.108294] [DEBUG] [VALIDATOR ] TEL: Validating primary data. [2025-09-26T21:36:23.120676] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-05. [2025-09-26T21:36:23.537966] [DEBUG] [VALIDATOR ] TEL: All expected trading days are present. [2025-09-26T21:36:23.538079] [DEBUG] [VALIDATOR ] TEL: Primary data validation passed. [2025-09-26T21:36:23.539254] [INFO ] [MAIN ] TEL: Fetched primary data is valid. [2025-09-26T21:36:23.539350] [DEBUG] [LOCAL ] TEL: Saving primary data. [2025-09-26T21:36:23.541036] [DEBUG] [LOCAL ] TEL: Trimmed 73408 records to 51898 (keeping 200 days of data) [2025-09-26T21:36:23.876714] [DEBUG] [LOCAL ] TEL: Primary data saved (51898 records). [2025-09-26T21:36:23.876868] [INFO ] [MAIN ] TEL: Full history saved. [2025-09-26T21:36:23.876990] [INFO ] [MAIN ] Update Progress: 2069/2371 symbols completed. TEL took 34.0s. Estimated remaining: 40m 20s. Rate: 7.5 symbols/min [2025-09-26T21:36:23.916962] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-08. [2025-09-26T21:36:24.069396] [INFO ] [MAIN ] TEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:36:24.117323] [DEBUG] [LOCAL ] TEX: Loaded 44916 existing records from primary storage. [2025-09-26T21:36:24.117487] [INFO ] [MAIN ] TEX: Loaded 44916 existing records. [2025-09-26T21:36:24.311739] [WARN ] [MAIN ] TEX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:36:24.312058] [INFO ] [MAIN ] TEX: Wiping existing primary data before full refresh. [2025-09-26T21:36:24.312115] [INFO ] [LOCAL ] TEX: Starting deletion of primary data. [2025-09-26T21:36:24.318436] [DEBUG] [LOCAL ] TEX: Deleted primary data file. [2025-09-26T21:36:24.325937] [INFO ] [MAIN ] TEX: Starting full primary refresh. [2025-09-26T21:36:24.399913] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-26T21:36:24.705821] [INFO ] [REMOTE ] TEX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:36:24.711677] [INFO ] [REMOTE ] TEX: Fetching primary data for 2024-12. [2025-09-26T21:36:25.251161] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-26T21:36:25.511723] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-06. [2025-09-26T21:36:26.311704] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-09. [2025-09-26T21:36:26.367311] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-26T21:36:26.527482] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-26T21:36:27.111729] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-07. [2025-09-26T21:36:27.762134] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-26T21:36:27.769085] [INFO ] [REMOTE ] TEN: Full fetch complete (44575 records). [2025-09-26T21:36:27.769203] [DEBUG] [VALIDATOR ] TEN: Validating primary data. [2025-09-26T21:36:27.919869] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-01. [2025-09-26T21:36:28.181393] [DEBUG] [VALIDATOR ] TEN: All expected trading days are present. [2025-09-26T21:36:28.181561] [DEBUG] [VALIDATOR ] TEN: Primary data validation passed. [2025-09-26T21:36:28.182639] [INFO ] [MAIN ] TEN: Fetched primary data is valid. [2025-09-26T21:36:28.182800] [DEBUG] [LOCAL ] TEN: Saving primary data. [2025-09-26T21:36:28.197425] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-26T21:36:28.203399] [DEBUG] [LOCAL ] TEN: Trimmed 44575 records to 31383 (keeping 200 days of data) [2025-09-26T21:36:28.396441] [DEBUG] [LOCAL ] TEN: Primary data saved (31383 records). [2025-09-26T21:36:28.396591] [INFO ] [MAIN ] TEN: Full history saved. [2025-09-26T21:36:28.396719] [INFO ] [MAIN ] Update Progress: 2070/2371 symbols completed. TEN took 27.0s. Estimated remaining: 40m 12s. Rate: 7.5 symbols/min [2025-09-26T21:36:28.577636] [INFO ] [MAIN ] TFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:36:28.630877] [DEBUG] [LOCAL ] TFC: Loaded 54057 existing records from primary storage. [2025-09-26T21:36:28.631037] [INFO ] [MAIN ] TFC: Loaded 54057 existing records. [2025-09-26T21:36:28.716882] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-08. [2025-09-26T21:36:28.823585] [WARN ] [MAIN ] TFC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:36:28.823884] [INFO ] [MAIN ] TFC: Wiping existing primary data before full refresh. [2025-09-26T21:36:28.823934] [INFO ] [LOCAL ] TFC: Starting deletion of primary data. [2025-09-26T21:36:28.825121] [DEBUG] [LOCAL ] TFC: Deleted primary data file. [2025-09-26T21:36:28.825184] [INFO ] [MAIN ] TFC: Starting full primary refresh. [2025-09-26T21:36:29.200087] [INFO ] [REMOTE ] TFC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:36:29.511734] [INFO ] [REMOTE ] TFC: Fetching primary data for 2024-12. [2025-09-26T21:36:29.751087] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-26T21:36:29.834399] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-26T21:36:30.311750] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-09. [2025-09-26T21:36:31.111688] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-02. [2025-09-26T21:36:31.232755] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-26T21:36:31.506892] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-26T21:36:31.515870] [INFO ] [REMOTE ] TEO: Full fetch complete (32871 records). [2025-09-26T21:36:31.516058] [DEBUG] [VALIDATOR ] TEO: Validating primary data. [2025-09-26T21:36:31.906200] [DEBUG] [VALIDATOR ] TEO: All expected trading days are present. [2025-09-26T21:36:31.906281] [DEBUG] [VALIDATOR ] TEO: Primary data validation passed. [2025-09-26T21:36:31.907047] [INFO ] [MAIN ] TEO: Fetched primary data is valid. [2025-09-26T21:36:31.907111] [DEBUG] [LOCAL ] TEO: Saving primary data. [2025-09-26T21:36:31.908006] [DEBUG] [LOCAL ] TEO: Trimmed 32871 records to 22345 (keeping 200 days of data) [2025-09-26T21:36:31.911708] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-05. [2025-09-26T21:36:32.045322] [DEBUG] [LOCAL ] TEO: Primary data saved (22345 records). [2025-09-26T21:36:32.045471] [INFO ] [MAIN ] TEO: Full history saved. [2025-09-26T21:36:32.045608] [INFO ] [MAIN ] Update Progress: 2071/2371 symbols completed. TEO took 28.8s. Estimated remaining: 40m 3s. Rate: 7.5 symbols/min [2025-09-26T21:36:32.221472] [INFO ] [MAIN ] TFII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:36:32.254768] [DEBUG] [LOCAL ] TFII: Loaded 34506 existing records from primary storage. [2025-09-26T21:36:32.254907] [INFO ] [MAIN ] TFII: Loaded 34506 existing records. [2025-09-26T21:36:32.439956] [WARN ] [MAIN ] TFII: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:36:32.440328] [INFO ] [MAIN ] TFII: Wiping existing primary data before full refresh. [2025-09-26T21:36:32.440387] [INFO ] [LOCAL ] TFII: Starting deletion of primary data. [2025-09-26T21:36:32.441390] [DEBUG] [LOCAL ] TFII: Deleted primary data file. [2025-09-26T21:36:32.441451] [INFO ] [MAIN ] TFII: Starting full primary refresh. [2025-09-26T21:36:32.721071] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-01. [2025-09-26T21:36:32.802333] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-26T21:36:32.853276] [INFO ] [REMOTE ] TFII: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:36:33.511756] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-03. [2025-09-26T21:36:33.938968] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-26T21:36:34.311723] [INFO ] [REMOTE ] TFII: Fetching primary data for 2024-12. [2025-09-26T21:36:34.528720] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-26T21:36:35.111698] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-02. [2025-09-26T21:36:35.187614] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-26T21:36:35.249302] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-26T21:36:35.911719] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-04. [2025-09-26T21:36:36.578126] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-26T21:36:36.711725] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-06. [2025-09-26T21:36:37.188729] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-26T21:36:37.511722] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-01. [2025-09-26T21:36:38.311712] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-05. [2025-09-26T21:36:38.784787] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-26T21:36:38.853783] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-26T21:36:39.111756] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-02. [2025-09-26T21:36:39.851365] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-26T21:36:39.911712] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-06. [2025-09-26T21:36:40.328708] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-26T21:36:40.711724] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-03. [2025-09-26T21:36:41.453605] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-26T21:36:41.511705] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-03. [2025-09-26T21:36:42.291016] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-26T21:36:42.311672] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-07. [2025-09-26T21:36:43.111710] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-07. [2025-09-26T21:36:43.499417] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-26T21:36:43.916821] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-04. [2025-09-26T21:36:43.934822] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-26T21:36:44.711729] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-04. [2025-09-26T21:36:45.269447] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-26T21:36:45.511734] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-08. [2025-09-26T21:36:46.003891] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-26T21:36:46.050809] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-26T21:36:46.311783] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-05. [2025-09-26T21:36:47.111711] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-05. [2025-09-26T21:36:47.159029] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-26T21:36:47.776019] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-26T21:36:47.911756] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-06. [2025-09-26T21:36:48.711763] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-09. [2025-09-26T21:36:48.935633] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-26T21:36:49.300321] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-26T21:36:49.511735] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-07. [2025-09-26T21:36:50.164814] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-26T21:36:50.173764] [INFO ] [REMOTE ] TEX: Full fetch complete (64749 records). [2025-09-26T21:36:50.173906] [DEBUG] [VALIDATOR ] TEX: Validating primary data. [2025-09-26T21:36:50.319175] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-08. [2025-09-26T21:36:50.592922] [DEBUG] [VALIDATOR ] TEX: All expected trading days are present. [2025-09-26T21:36:50.593068] [DEBUG] [VALIDATOR ] TEX: Primary data validation passed. [2025-09-26T21:36:50.594099] [INFO ] [MAIN ] TEX: Fetched primary data is valid. [2025-09-26T21:36:50.594165] [DEBUG] [LOCAL ] TEX: Saving primary data. [2025-09-26T21:36:50.595579] [DEBUG] [LOCAL ] TEX: Trimmed 64749 records to 45170 (keeping 200 days of data) [2025-09-26T21:36:50.838268] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-26T21:36:50.909507] [DEBUG] [LOCAL ] TEX: Primary data saved (45170 records). [2025-09-26T21:36:50.909702] [INFO ] [MAIN ] TEX: Full history saved. [2025-09-26T21:36:50.909815] [INFO ] [MAIN ] Update Progress: 2072/2371 symbols completed. TEX took 27.0s. Estimated remaining: 39m 57s. Rate: 7.5 symbols/min [2025-09-26T21:36:51.091196] [INFO ] [MAIN ] TFIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:36:51.114371] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-06. [2025-09-26T21:36:51.115057] [DEBUG] [LOCAL ] TFIN: Loaded 23741 existing records from primary storage. [2025-09-26T21:36:51.116254] [INFO ] [MAIN ] TFIN: Loaded 23741 existing records. [2025-09-26T21:36:51.308222] [WARN ] [MAIN ] TFIN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:36:51.308479] [INFO ] [MAIN ] TFIN: Wiping existing primary data before full refresh. [2025-09-26T21:36:51.308530] [INFO ] [LOCAL ] TFIN: Starting deletion of primary data. [2025-09-26T21:36:51.309233] [DEBUG] [LOCAL ] TFIN: Deleted primary data file. [2025-09-26T21:36:51.309306] [INFO ] [MAIN ] TFIN: Starting full primary refresh. [2025-09-26T21:36:51.691978] [INFO ] [REMOTE ] TFIN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:36:51.911692] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-08. [2025-09-26T21:36:52.139811] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-26T21:36:52.711710] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-09. [2025-09-26T21:36:53.011522] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-26T21:36:53.045427] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-26T21:36:53.511738] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2024-12. [2025-09-26T21:36:54.311789] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-07. [2025-09-26T21:36:54.357161] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-26T21:36:55.012111] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-09-26T21:36:55.023888] [INFO ] [REMOTE ] TEVA: Full fetch complete (77684 records). [2025-09-26T21:36:55.024067] [DEBUG] [VALIDATOR ] TEVA: Validating primary data. [2025-09-26T21:36:55.116836] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-01. [2025-09-26T21:36:55.461319] [DEBUG] [VALIDATOR ] TEVA: All expected trading days are present. [2025-09-26T21:36:55.461406] [DEBUG] [VALIDATOR ] TEVA: Primary data validation passed. [2025-09-26T21:36:55.462497] [INFO ] [MAIN ] TEVA: Fetched primary data is valid. [2025-09-26T21:36:55.462566] [DEBUG] [LOCAL ] TEVA: Saving primary data. [2025-09-26T21:36:55.464348] [DEBUG] [LOCAL ] TEVA: Trimmed 77684 records to 54413 (keeping 200 days of data) [2025-09-26T21:36:55.829421] [DEBUG] [LOCAL ] TEVA: Primary data saved (54413 records). [2025-09-26T21:36:55.829722] [INFO ] [MAIN ] TEVA: Full history saved. [2025-09-26T21:36:55.829842] [INFO ] [MAIN ] Update Progress: 2073/2371 symbols completed. TEVA took 51.0s. Estimated remaining: 39m 48s. Rate: 7.5 symbols/min [2025-09-26T21:36:55.919803] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-09. [2025-09-26T21:36:56.022003] [INFO ] [MAIN ] TFPM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:36:56.068427] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-26T21:36:56.069750] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-26T21:36:56.123119] [DEBUG] [LOCAL ] TFPM: Loaded 37671 existing records from primary storage. [2025-09-26T21:36:56.123266] [INFO ] [MAIN ] TFPM: Loaded 37671 existing records. [2025-09-26T21:36:56.321394] [WARN ] [MAIN ] TFPM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:36:56.321756] [INFO ] [MAIN ] TFPM: Wiping existing primary data before full refresh. [2025-09-26T21:36:56.321814] [INFO ] [LOCAL ] TFPM: Starting deletion of primary data. [2025-09-26T21:36:56.322749] [DEBUG] [LOCAL ] TFPM: Deleted primary data file. [2025-09-26T21:36:56.322833] [INFO ] [MAIN ] TFPM: Starting full primary refresh. [2025-09-26T21:36:56.716966] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-02. [2025-09-26T21:36:56.823060] [INFO ] [REMOTE ] TFPM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:36:57.246529] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-26T21:36:57.260014] [INFO ] [REMOTE ] TFII: Full fetch complete (47732 records). [2025-09-26T21:36:57.260306] [DEBUG] [VALIDATOR ] TFII: Validating primary data. [2025-09-26T21:36:57.529209] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-08. [2025-09-26T21:36:57.797970] [DEBUG] [VALIDATOR ] TFII: All expected trading days are present. [2025-09-26T21:36:57.798196] [DEBUG] [VALIDATOR ] TFII: Primary data validation passed. [2025-09-26T21:36:57.799209] [INFO ] [MAIN ] TFII: Fetched primary data is valid. [2025-09-26T21:36:57.799336] [DEBUG] [LOCAL ] TFII: Saving primary data. [2025-09-26T21:36:57.801812] [DEBUG] [LOCAL ] TFII: Trimmed 47732 records to 34733 (keeping 200 days of data) [2025-09-26T21:36:57.949810] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-26T21:36:58.065832] [DEBUG] [LOCAL ] TFII: Primary data saved (34733 records). [2025-09-26T21:36:58.066001] [INFO ] [MAIN ] TFII: Full history saved. [2025-09-26T21:36:58.066186] [INFO ] [MAIN ] Update Progress: 2074/2371 symbols completed. TFII took 26.0s. Estimated remaining: 39m 39s. Rate: 7.5 symbols/min [2025-09-26T21:36:58.273401] [INFO ] [MAIN ] TFX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:36:58.320721] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-03. [2025-09-26T21:36:58.324445] [DEBUG] [LOCAL ] TFX: Loaded 37634 existing records from primary storage. [2025-09-26T21:36:58.324614] [INFO ] [MAIN ] TFX: Loaded 37634 existing records. [2025-09-26T21:36:58.523341] [WARN ] [MAIN ] TFX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:36:58.523726] [INFO ] [MAIN ] TFX: Wiping existing primary data before full refresh. [2025-09-26T21:36:58.523784] [INFO ] [LOCAL ] TFX: Starting deletion of primary data. [2025-09-26T21:36:58.525325] [DEBUG] [LOCAL ] TFX: Deleted primary data file. [2025-09-26T21:36:58.525401] [INFO ] [MAIN ] TFX: Starting full primary refresh. [2025-09-26T21:36:58.892162] [INFO ] [REMOTE ] TFX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:36:59.111706] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2024-12. [2025-09-26T21:36:59.550797] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-26T21:36:59.558039] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-26T21:36:59.911730] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-04. [2025-09-26T21:37:00.082352] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-26T21:37:00.711721] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-09. [2025-09-26T21:37:01.385467] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-26T21:37:01.496600] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-26T21:37:01.507805] [INFO ] [REMOTE ] TFC: Full fetch complete (77670 records). [2025-09-26T21:37:01.507962] [DEBUG] [VALIDATOR ] TFC: Validating primary data. [2025-09-26T21:37:01.520194] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-05. [2025-09-26T21:37:01.944139] [DEBUG] [VALIDATOR ] TFC: All expected trading days are present. [2025-09-26T21:37:01.944240] [DEBUG] [VALIDATOR ] TFC: Primary data validation passed. [2025-09-26T21:37:01.945638] [INFO ] [MAIN ] TFC: Fetched primary data is valid. [2025-09-26T21:37:01.945733] [DEBUG] [LOCAL ] TFC: Saving primary data. [2025-09-26T21:37:01.948829] [DEBUG] [LOCAL ] TFC: Trimmed 77670 records to 54447 (keeping 200 days of data) [2025-09-26T21:37:02.311905] [INFO ] [REMOTE ] TFX: Fetching primary data for 2024-12. [2025-09-26T21:37:02.319697] [DEBUG] [LOCAL ] TFC: Primary data saved (54447 records). [2025-09-26T21:37:02.319874] [INFO ] [MAIN ] TFC: Full history saved. [2025-09-26T21:37:02.320036] [INFO ] [MAIN ] Update Progress: 2075/2371 symbols completed. TFC took 33.9s. Estimated remaining: 39m 31s. Rate: 7.5 symbols/min [2025-09-26T21:37:02.505371] [INFO ] [MAIN ] TG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:37:02.520124] [DEBUG] [LOCAL ] TG: Loaded 10546 existing records from primary storage. [2025-09-26T21:37:02.520260] [INFO ] [MAIN ] TG: Loaded 10546 existing records. [2025-09-26T21:37:02.711521] [WARN ] [MAIN ] TG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:37:02.711807] [INFO ] [MAIN ] TG: Wiping existing primary data before full refresh. [2025-09-26T21:37:02.711869] [INFO ] [LOCAL ] TG: Starting deletion of primary data. [2025-09-26T21:37:02.712226] [DEBUG] [LOCAL ] TG: Deleted primary data file. [2025-09-26T21:37:02.712286] [INFO ] [MAIN ] TG: Starting full primary refresh. [2025-09-26T21:37:03.033168] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-26T21:37:03.116890] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-06. [2025-09-26T21:37:03.131255] [INFO ] [REMOTE ] TG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:37:03.699194] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-26T21:37:03.911726] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-01. [2025-09-26T21:37:04.319683] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-26T21:37:04.711767] [INFO ] [REMOTE ] TG: Fetching primary data for 2024-12. [2025-09-26T21:37:05.511058] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-26T21:37:05.518425] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-07. [2025-09-26T21:37:05.689084] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-26T21:37:06.311747] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-02. [2025-09-26T21:37:06.741824] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-26T21:37:07.111763] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-08. [2025-09-26T21:37:07.897627] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-26T21:37:07.911674] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-03. [2025-09-26T21:37:08.177587] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-26T21:37:08.711722] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-09. [2025-09-26T21:37:09.511737] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-01. [2025-09-26T21:37:09.845750] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-26T21:37:09.881074] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-26T21:37:09.885953] [INFO ] [REMOTE ] TFIN: Full fetch complete (31058 records). [2025-09-26T21:37:09.886056] [DEBUG] [VALIDATOR ] TFIN: Validating primary data. [2025-09-26T21:37:10.286501] [DEBUG] [VALIDATOR ] TFIN: All expected trading days are present. [2025-09-26T21:37:10.286592] [DEBUG] [VALIDATOR ] TFIN: Primary data validation passed. [2025-09-26T21:37:10.287353] [INFO ] [MAIN ] TFIN: Fetched primary data is valid. [2025-09-26T21:37:10.287418] [DEBUG] [LOCAL ] TFIN: Saving primary data. [2025-09-26T21:37:10.289026] [DEBUG] [LOCAL ] TFIN: Trimmed 31058 records to 23896 (keeping 200 days of data) [2025-09-26T21:37:10.354735] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-26T21:37:10.353096] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-04. [2025-09-26T21:37:10.466861] [DEBUG] [LOCAL ] TFIN: Primary data saved (23896 records). [2025-09-26T21:37:10.467027] [INFO ] [MAIN ] TFIN: Full history saved. [2025-09-26T21:37:10.467151] [INFO ] [MAIN ] Update Progress: 2076/2371 symbols completed. TFIN took 19.6s. Estimated remaining: 39m 23s. Rate: 7.5 symbols/min [2025-09-26T21:37:10.659685] [INFO ] [MAIN ] TGE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:37:10.659882] [DEBUG] [LOCAL ] TGE: No existing data file found in primary storage. [2025-09-26T21:37:10.659920] [WARN ] [MAIN ] TGE: No existing data found, performing full refresh instead. [2025-09-26T21:37:10.660072] [INFO ] [MAIN ] TGE: Wiping existing primary data before full refresh. [2025-09-26T21:37:10.660115] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-09-26T21:37:10.660156] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-09-26T21:37:10.660189] [INFO ] [MAIN ] TGE: Starting full primary refresh. [2025-09-26T21:37:11.043829] [INFO ] [REMOTE ] TGE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:37:11.111713] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-01. [2025-09-26T21:37:11.911701] [INFO ] [REMOTE ] TGE: Fetching primary data for 2024-12. [2025-09-26T21:37:12.047497] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-26T21:37:12.157482] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:37:12.157885] [WARN ] [REMOTE ] TGE: No data returned for month 2024-12 [2025-09-26T21:37:12.333166] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-26T21:37:12.711721] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-02. [2025-09-26T21:37:13.511724] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-05. [2025-09-26T21:37:13.941310] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-26T21:37:14.311762] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-02. [2025-09-26T21:37:15.047784] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-26T21:37:15.061224] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-26T21:37:15.111748] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-01. [2025-09-26T21:37:15.363837] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:37:15.364173] [WARN ] [REMOTE ] TGE: No data returned for month 2025-01 [2025-09-26T21:37:15.911724] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-03. [2025-09-26T21:37:16.711722] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-06. [2025-09-26T21:37:16.784060] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-26T21:37:17.511718] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-03. [2025-09-26T21:37:18.070036] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-26T21:37:18.311707] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-07. [2025-09-26T21:37:18.767882] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-26T21:37:19.111734] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-04. [2025-09-26T21:37:19.879422] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-26T21:37:19.911696] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-04. [2025-09-26T21:37:20.000113] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-26T21:37:20.711731] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-02. [2025-09-26T21:37:20.947751] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:37:20.948093] [WARN ] [REMOTE ] TGE: No data returned for month 2025-02 [2025-09-26T21:37:21.481501] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-26T21:37:21.511701] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-08. [2025-09-26T21:37:22.311744] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-05. [2025-09-26T21:37:22.968190] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-26T21:37:23.086846] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-26T21:37:23.111720] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-09. [2025-09-26T21:37:23.911728] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-05. [2025-09-26T21:37:24.507836] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-26T21:37:24.515882] [INFO ] [REMOTE ] TFX: Full fetch complete (54306 records). [2025-09-26T21:37:24.516015] [DEBUG] [VALIDATOR ] TFX: Validating primary data. [2025-09-26T21:37:24.717688] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-06. [2025-09-26T21:37:24.915164] [DEBUG] [VALIDATOR ] TFX: All expected trading days are present. [2025-09-26T21:37:24.915338] [DEBUG] [VALIDATOR ] TFX: Primary data validation passed. [2025-09-26T21:37:24.916311] [INFO ] [MAIN ] TFX: Fetched primary data is valid. [2025-09-26T21:37:24.916377] [DEBUG] [LOCAL ] TFX: Saving primary data. [2025-09-26T21:37:24.917784] [DEBUG] [LOCAL ] TFX: Trimmed 54306 records to 37936 (keeping 200 days of data) [2025-09-26T21:37:25.169274] [DEBUG] [LOCAL ] TFX: Primary data saved (37936 records). [2025-09-26T21:37:25.169436] [INFO ] [MAIN ] TFX: Full history saved. [2025-09-26T21:37:25.169552] [INFO ] [MAIN ] Update Progress: 2077/2371 symbols completed. TFX took 27.1s. Estimated remaining: 39m 16s. Rate: 7.5 symbols/min [2025-09-26T21:37:25.408392] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-26T21:37:25.511732] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-06. [2025-09-26T21:37:25.537866] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-26T21:37:26.311779] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-03. [2025-09-26T21:37:26.522751] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:37:26.523091] [WARN ] [REMOTE ] TGE: No data returned for month 2025-03 [2025-09-26T21:37:27.039500] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-26T21:37:27.111727] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-04. [2025-09-26T21:37:27.315745] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:37:27.316128] [WARN ] [REMOTE ] TGE: No data returned for month 2025-04 [2025-09-26T21:37:27.911725] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-07. [2025-09-26T21:37:28.711739] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-07. [2025-09-26T21:37:29.422981] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-26T21:37:29.505159] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-26T21:37:29.511668] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-08. [2025-09-26T21:37:30.311724] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-05. [2025-09-26T21:37:30.337359] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-26T21:37:30.521589] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:37:30.522008] [WARN ] [REMOTE ] TGE: No data returned for month 2025-05 [2025-09-26T21:37:31.111715] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-06. [2025-09-26T21:37:31.911724] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-08. [2025-09-26T21:37:32.433515] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-26T21:37:32.711766] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-09. [2025-09-26T21:37:33.501601] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-26T21:37:33.504516] [INFO ] [REMOTE ] TG: Full fetch complete (15159 records). [2025-09-26T21:37:33.504604] [DEBUG] [VALIDATOR ] TG: Validating primary data. [2025-09-26T21:37:33.519951] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-07. [2025-09-26T21:37:33.775047] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-26T21:37:34.012829] [DEBUG] [VALIDATOR ] TG: All expected trading days are present. [2025-09-26T21:37:34.012929] [DEBUG] [VALIDATOR ] TG: Primary data validation passed. [2025-09-26T21:37:34.013344] [INFO ] [MAIN ] TG: Fetched primary data is valid. [2025-09-26T21:37:34.013388] [DEBUG] [LOCAL ] TG: Saving primary data. [2025-09-26T21:37:34.013988] [DEBUG] [LOCAL ] TG: Trimmed 15159 records to 10581 (keeping 200 days of data) [2025-09-26T21:37:34.076205] [DEBUG] [LOCAL ] TG: Primary data saved (10581 records). [2025-09-26T21:37:34.076361] [INFO ] [MAIN ] TG: Full history saved. [2025-09-26T21:37:34.076471] [INFO ] [MAIN ] Update Progress: 2078/2371 symbols completed. TG took 31.8s. Estimated remaining: 39m 8s. Rate: 7.5 symbols/min [2025-09-26T21:37:34.311688] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-09. [2025-09-26T21:37:34.472463] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-26T21:37:35.111737] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-08. [2025-09-26T21:37:35.961669] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T21:37:35.970497] [INFO ] [REMOTE ] TFPM: Full fetch complete (50758 records). [2025-09-26T21:37:35.970678] [DEBUG] [VALIDATOR ] TFPM: Validating primary data. [2025-09-26T21:37:36.097420] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-26T21:37:36.106910] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-09. [2025-09-26T21:37:36.408832] [DEBUG] [VALIDATOR ] TFPM: All expected trading days are present. [2025-09-26T21:37:36.409001] [DEBUG] [VALIDATOR ] TFPM: Primary data validation passed. [2025-09-26T21:37:36.409931] [INFO ] [MAIN ] TFPM: Fetched primary data is valid. [2025-09-26T21:37:36.410000] [DEBUG] [LOCAL ] TFPM: Saving primary data. [2025-09-26T21:37:36.414419] [DEBUG] [LOCAL ] TFPM: Trimmed 50758 records to 37997 (keeping 200 days of data) [2025-09-26T21:37:36.651980] [DEBUG] [LOCAL ] TFPM: Primary data saved (37997 records). [2025-09-26T21:37:36.652142] [INFO ] [MAIN ] TFPM: Full history saved. [2025-09-26T21:37:36.652234] [INFO ] [MAIN ] Update Progress: 2079/2371 symbols completed. TFPM took 40.8s. Estimated remaining: 38m 59s. Rate: 7.5 symbols/min [2025-09-26T21:37:37.248418] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-26T21:37:37.253400] [INFO ] [REMOTE ] TGE: Full fetch complete (9348 records). [2025-09-26T21:37:37.253524] [DEBUG] [VALIDATOR ] TGE: Validating primary data. [2025-09-26T21:37:37.458412] [WARN ] [VALIDATOR ] TGE: Validation failed - insufficient historical data. Have 79 unique days, need 200 days [2025-09-26T21:37:37.458771] [FATAL] [MAIN ] TGE: Fetched primary data is invalid. Refusing to save it. [2025-09-26T21:37:37.458865] [WARN ] [MAIN ] TGE: Deleting existing primary and derivative data due to validation failure. [2025-09-26T21:37:37.458942] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-09-26T21:37:37.459011] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-09-26T21:37:37.459050] [INFO ] [LOCAL ] TGE: Starting deletion of derivative data. [2025-09-26T21:37:37.459108] [DEBUG] [LOCAL ] TGE: No derivative data file found to delete. [2025-09-26T21:37:37.459219] [INFO ] [MAIN ] Update Progress: 2080/2371 symbols completed. TGE took 27.0s. Estimated remaining: 38m 50s. Rate: 7.5 symbols/min [2025-09-26T21:37:38.148375] [INFO ] [MAIN ] TGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:37:38.176328] [INFO ] [MAIN ] TGT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:37:38.175209] [INFO ] [MAIN ] TGLS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:37:38.212674] [INFO ] [MAIN ] TGNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:37:38.275533] [DEBUG] [LOCAL ] TGLS: Loaded 28513 existing records from primary storage. [2025-09-26T21:37:38.276065] [INFO ] [MAIN ] TGLS: Loaded 28513 existing records. [2025-09-26T21:37:38.429760] [DEBUG] [LOCAL ] TGS: Loaded 32812 existing records from primary storage. [2025-09-26T21:37:38.451596] [INFO ] [MAIN ] TGS: Loaded 32812 existing records. [2025-09-26T21:37:38.478607] [DEBUG] [LOCAL ] TGNA: Loaded 49082 existing records from primary storage. [2025-09-26T21:37:38.541201] [INFO ] [MAIN ] TGNA: Loaded 49082 existing records. [2025-09-26T21:37:38.523635] [DEBUG] [LOCAL ] TGT: Loaded 54168 existing records from primary storage. [2025-09-26T21:37:38.617827] [INFO ] [MAIN ] TGT: Loaded 54168 existing records. [2025-09-26T21:37:38.635435] [WARN ] [MAIN ] TGLS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:37:38.816550] [INFO ] [MAIN ] TGLS: Wiping existing primary data before full refresh. [2025-09-26T21:37:38.859322] [INFO ] [LOCAL ] TGLS: Starting deletion of primary data. [2025-09-26T21:37:38.941424] [DEBUG] [LOCAL ] TGLS: Deleted primary data file. [2025-09-26T21:37:38.975776] [INFO ] [MAIN ] TGLS: Starting full primary refresh. [2025-09-26T21:37:39.082695] [WARN ] [MAIN ] TGNA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:37:39.169419] [WARN ] [MAIN ] TGS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:37:39.214245] [INFO ] [MAIN ] TGNA: Wiping existing primary data before full refresh. [2025-09-26T21:37:39.247483] [INFO ] [LOCAL ] TGNA: Starting deletion of primary data. [2025-09-26T21:37:39.248907] [INFO ] [MAIN ] TGS: Wiping existing primary data before full refresh. [2025-09-26T21:37:39.254234] [INFO ] [LOCAL ] TGS: Starting deletion of primary data. [2025-09-26T21:37:39.286724] [DEBUG] [LOCAL ] TGS: Deleted primary data file. [2025-09-26T21:37:39.293671] [INFO ] [MAIN ] TGS: Starting full primary refresh. [2025-09-26T21:37:39.264636] [DEBUG] [LOCAL ] TGNA: Deleted primary data file. [2025-09-26T21:37:39.304237] [WARN ] [MAIN ] TGT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:37:39.324117] [INFO ] [MAIN ] TGNA: Starting full primary refresh. [2025-09-26T21:37:39.443057] [INFO ] [MAIN ] TGT: Wiping existing primary data before full refresh. [2025-09-26T21:37:39.570155] [INFO ] [LOCAL ] TGT: Starting deletion of primary data. [2025-09-26T21:37:39.685219] [DEBUG] [LOCAL ] TGT: Deleted primary data file. [2025-09-26T21:37:39.713928] [INFO ] [MAIN ] TGT: Starting full primary refresh. [2025-09-26T21:37:40.492153] [INFO ] [REMOTE ] TGLS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:37:40.567690] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2024-12. [2025-09-26T21:37:40.545954] [INFO ] [REMOTE ] TGNA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:37:40.618029] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2024-12. [2025-09-26T21:37:40.654155] [INFO ] [REMOTE ] TGS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:37:40.687625] [INFO ] [REMOTE ] TGS: Fetching primary data for 2024-12. [2025-09-26T21:37:40.785246] [INFO ] [REMOTE ] TGT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:37:40.785564] [INFO ] [REMOTE ] TGT: Fetching primary data for 2024-12. [2025-09-26T21:37:41.825453] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-26T21:37:41.831222] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-01. [2025-09-26T21:37:42.013464] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-26T21:37:42.020313] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-01. [2025-09-26T21:37:42.382528] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-26T21:37:42.392701] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-01. [2025-09-26T21:37:42.718714] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-26T21:37:42.729826] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-01. [2025-09-26T21:37:43.267512] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-26T21:37:43.274412] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-02. [2025-09-26T21:37:43.413107] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-26T21:37:43.911732] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-02. [2025-09-26T21:37:44.047843] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-26T21:37:44.453514] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-26T21:37:44.524447] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-26T21:37:44.711726] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-02. [2025-09-26T21:37:45.420487] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-26T21:37:45.511718] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-02. [2025-09-26T21:37:46.311701] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-03. [2025-09-26T21:37:46.457255] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-26T21:37:47.111717] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-03. [2025-09-26T21:37:47.733473] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-26T21:37:47.921266] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-03. [2025-09-26T21:37:47.928133] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-09-26T21:37:48.711726] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-03. [2025-09-26T21:37:49.005451] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-26T21:37:49.319180] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-26T21:37:49.511743] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-04. [2025-09-26T21:37:50.311734] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-04. [2025-09-26T21:37:51.029025] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-26T21:37:51.111695] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-04. [2025-09-26T21:37:51.314173] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-26T21:37:51.344576] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-26T21:37:51.911710] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-05. [2025-09-26T21:37:52.711731] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-05. [2025-09-26T21:37:53.337174] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-26T21:37:53.516828] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-06. [2025-09-26T21:37:53.537813] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-09-26T21:37:54.311746] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-04. [2025-09-26T21:37:54.359925] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-26T21:37:54.898739] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-26T21:37:55.111696] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-05. [2025-09-26T21:37:55.560508] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-26T21:37:55.911708] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-06. [2025-09-26T21:37:56.711743] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-05. [2025-09-26T21:37:57.447895] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-09-26T21:37:57.511683] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-07. [2025-09-26T21:37:57.538729] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-26T21:37:58.068381] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-26T21:37:58.311733] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-07. [2025-09-26T21:37:58.977283] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-26T21:37:59.111760] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-06. [2025-09-26T21:37:59.911681] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-06. [2025-09-26T21:38:00.051132] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-26T21:38:00.294864] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-26T21:38:00.711735] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-08. [2025-09-26T21:38:01.511744] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-08. [2025-09-26T21:38:02.311824] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-07. [2025-09-26T21:38:02.445035] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-06 (2.53 seconds). [2025-09-26T21:38:02.682078] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-26T21:38:02.716155] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-26T21:38:03.111679] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-09. [2025-09-26T21:38:03.211441] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-26T21:38:03.911751] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-08. [2025-09-26T21:38:04.711733] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-07. [2025-09-26T21:38:04.736112] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-26T21:38:04.745213] [INFO ] [REMOTE ] TGS: Full fetch complete (47615 records). [2025-09-26T21:38:04.745365] [DEBUG] [VALIDATOR ] TGS: Validating primary data. [2025-09-26T21:38:05.168485] [DEBUG] [VALIDATOR ] TGS: All expected trading days are present. [2025-09-26T21:38:05.179539] [DEBUG] [VALIDATOR ] TGS: Primary data validation passed. [2025-09-26T21:38:05.182078] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-26T21:38:05.181238] [INFO ] [MAIN ] TGS: Fetched primary data is valid. [2025-09-26T21:38:05.188594] [DEBUG] [LOCAL ] TGS: Saving primary data. [2025-09-26T21:38:05.190611] [DEBUG] [LOCAL ] TGS: Trimmed 47615 records to 33072 (keeping 200 days of data) [2025-09-26T21:38:05.385205] [DEBUG] [LOCAL ] TGS: Primary data saved (33072 records). [2025-09-26T21:38:05.385351] [INFO ] [MAIN ] TGS: Full history saved. [2025-09-26T21:38:05.385441] [INFO ] [MAIN ] Update Progress: 2081/2371 symbols completed. TGS took 27.9s. Estimated remaining: 38m 45s. Rate: 7.5 symbols/min [2025-09-26T21:38:05.516825] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-09. [2025-09-26T21:38:05.574332] [INFO ] [MAIN ] THC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:38:05.624507] [DEBUG] [LOCAL ] THC: Loaded 48304 existing records from primary storage. [2025-09-26T21:38:05.624681] [INFO ] [MAIN ] THC: Loaded 48304 existing records. [2025-09-26T21:38:05.823419] [WARN ] [MAIN ] THC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:38:05.823846] [INFO ] [MAIN ] THC: Wiping existing primary data before full refresh. [2025-09-26T21:38:05.823906] [INFO ] [LOCAL ] THC: Starting deletion of primary data. [2025-09-26T21:38:05.824961] [DEBUG] [LOCAL ] THC: Deleted primary data file. [2025-09-26T21:38:05.825024] [INFO ] [MAIN ] THC: Starting full primary refresh. [2025-09-26T21:38:06.198420] [INFO ] [REMOTE ] THC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:38:06.311734] [INFO ] [REMOTE ] THC: Fetching primary data for 2024-12. [2025-09-26T21:38:06.877091] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-26T21:38:06.883167] [INFO ] [REMOTE ] TGLS: Full fetch complete (40453 records). [2025-09-26T21:38:06.883290] [DEBUG] [VALIDATOR ] TGLS: Validating primary data. [2025-09-26T21:38:07.116851] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-09. [2025-09-26T21:38:07.301982] [DEBUG] [VALIDATOR ] TGLS: All expected trading days are present. [2025-09-26T21:38:07.302278] [DEBUG] [VALIDATOR ] TGLS: Primary data validation passed. [2025-09-26T21:38:07.303176] [INFO ] [MAIN ] TGLS: Fetched primary data is valid. [2025-09-26T21:38:07.303264] [DEBUG] [LOCAL ] TGLS: Saving primary data. [2025-09-26T21:38:07.336596] [DEBUG] [LOCAL ] TGLS: Trimmed 40453 records to 28709 (keeping 200 days of data) [2025-09-26T21:38:07.338981] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-09-26T21:38:07.538219] [DEBUG] [LOCAL ] TGLS: Primary data saved (28709 records). [2025-09-26T21:38:07.538376] [INFO ] [MAIN ] TGLS: Full history saved. [2025-09-26T21:38:07.538564] [INFO ] [MAIN ] Update Progress: 2082/2371 symbols completed. TGLS took 30.1s. Estimated remaining: 38m 36s. Rate: 7.5 symbols/min [2025-09-26T21:38:07.718088] [INFO ] [MAIN ] THG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:38:07.742019] [DEBUG] [LOCAL ] THG: Loaded 21891 existing records from primary storage. [2025-09-26T21:38:07.742158] [INFO ] [MAIN ] THG: Loaded 21891 existing records. [2025-09-26T21:38:07.924520] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-08. [2025-09-26T21:38:07.931269] [WARN ] [MAIN ] THG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:38:07.932758] [INFO ] [MAIN ] THG: Wiping existing primary data before full refresh. [2025-09-26T21:38:07.932890] [INFO ] [LOCAL ] THG: Starting deletion of primary data. [2025-09-26T21:38:07.933624] [DEBUG] [LOCAL ] THG: Deleted primary data file. [2025-09-26T21:38:07.933732] [INFO ] [MAIN ] THG: Starting full primary refresh. [2025-09-26T21:38:08.546546] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-26T21:38:08.554960] [INFO ] [REMOTE ] THG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:38:08.711869] [INFO ] [REMOTE ] THG: Fetching primary data for 2024-12. [2025-09-26T21:38:08.845430] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-26T21:38:08.856932] [INFO ] [REMOTE ] TGNA: Full fetch complete (69940 records). [2025-09-26T21:38:08.857125] [DEBUG] [VALIDATOR ] TGNA: Validating primary data. [2025-09-26T21:38:09.358513] [DEBUG] [VALIDATOR ] TGNA: All expected trading days are present. [2025-09-26T21:38:09.358608] [DEBUG] [VALIDATOR ] TGNA: Primary data validation passed. [2025-09-26T21:38:09.359622] [INFO ] [MAIN ] TGNA: Fetched primary data is valid. [2025-09-26T21:38:09.359751] [DEBUG] [LOCAL ] TGNA: Saving primary data. [2025-09-26T21:38:09.361318] [DEBUG] [LOCAL ] TGNA: Trimmed 69940 records to 49444 (keeping 200 days of data) [2025-09-26T21:38:09.563703] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-01. [2025-09-26T21:38:09.700975] [DEBUG] [LOCAL ] TGNA: Primary data saved (49444 records). [2025-09-26T21:38:09.701127] [INFO ] [MAIN ] TGNA: Full history saved. [2025-09-26T21:38:09.701354] [INFO ] [MAIN ] Update Progress: 2083/2371 symbols completed. TGNA took 32.2s. Estimated remaining: 38m 27s. Rate: 7.5 symbols/min [2025-09-26T21:38:09.888610] [INFO ] [MAIN ] THIR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:38:09.907258] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-26T21:38:09.909329] [DEBUG] [LOCAL ] THIR: Loaded 2219 existing records from primary storage. [2025-09-26T21:38:09.909496] [INFO ] [MAIN ] THIR: Loaded 2219 existing records. [2025-09-26T21:38:10.111207] [WARN ] [MAIN ] THIR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:38:10.111574] [INFO ] [MAIN ] THIR: Wiping existing primary data before full refresh. [2025-09-26T21:38:10.111683] [INFO ] [LOCAL ] THIR: Starting deletion of primary data. [2025-09-26T21:38:10.112164] [DEBUG] [LOCAL ] THIR: Deleted primary data file. [2025-09-26T21:38:10.112228] [INFO ] [MAIN ] THIR: Starting full primary refresh. [2025-09-26T21:38:10.316154] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-01. [2025-09-26T21:38:10.537350] [INFO ] [REMOTE ] THIR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:38:10.540147] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-09-26T21:38:11.111722] [INFO ] [REMOTE ] THIR: Fetching primary data for 2024-12. [2025-09-26T21:38:11.421215] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-26T21:38:11.464508] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-26T21:38:11.608169] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-26T21:38:11.911715] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-02. [2025-09-26T21:38:12.711720] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-09. [2025-09-26T21:38:13.206558] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-26T21:38:13.511761] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-03. [2025-09-26T21:38:14.311746] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-01. [2025-09-26T21:38:14.654268] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-26T21:38:14.813520] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-26T21:38:15.111694] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-02. [2025-09-26T21:38:15.276515] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-09-26T21:38:15.287039] [INFO ] [REMOTE ] TGT: Full fetch complete (77860 records). [2025-09-26T21:38:15.287195] [DEBUG] [VALIDATOR ] TGT: Validating primary data. [2025-09-26T21:38:15.564460] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-26T21:38:15.706789] [DEBUG] [VALIDATOR ] TGT: All expected trading days are present. [2025-09-26T21:38:15.706912] [DEBUG] [VALIDATOR ] TGT: Primary data validation passed. [2025-09-26T21:38:15.708097] [INFO ] [MAIN ] TGT: Fetched primary data is valid. [2025-09-26T21:38:15.708165] [DEBUG] [LOCAL ] TGT: Saving primary data. [2025-09-26T21:38:15.709925] [DEBUG] [LOCAL ] TGT: Trimmed 77860 records to 54558 (keeping 200 days of data) [2025-09-26T21:38:15.913923] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-02. [2025-09-26T21:38:16.101794] [DEBUG] [LOCAL ] TGT: Primary data saved (54558 records). [2025-09-26T21:38:16.101956] [INFO ] [MAIN ] TGT: Full history saved. [2025-09-26T21:38:16.102076] [INFO ] [MAIN ] Update Progress: 2084/2371 symbols completed. TGT took 38.6s. Estimated remaining: 38m 19s. Rate: 7.5 symbols/min [2025-09-26T21:38:16.317895] [INFO ] [MAIN ] THLV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:38:16.322441] [DEBUG] [LOCAL ] THLV: Loaded 1612 existing records from primary storage. [2025-09-26T21:38:16.322579] [INFO ] [MAIN ] THLV: Loaded 1612 existing records. [2025-09-26T21:38:16.590971] [WARN ] [MAIN ] THLV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:38:16.591369] [INFO ] [MAIN ] THLV: Wiping existing primary data before full refresh. [2025-09-26T21:38:16.591439] [INFO ] [LOCAL ] THLV: Starting deletion of primary data. [2025-09-26T21:38:16.591801] [DEBUG] [LOCAL ] THLV: Deleted primary data file. [2025-09-26T21:38:16.591866] [INFO ] [MAIN ] THLV: Starting full primary refresh. [2025-09-26T21:38:16.716925] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-03. [2025-09-26T21:38:16.989109] [INFO ] [REMOTE ] THLV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:38:17.129838] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-26T21:38:17.511727] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-04. [2025-09-26T21:38:17.804816] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-26T21:38:18.311734] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-04. [2025-09-26T21:38:18.741262] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-26T21:38:18.864958] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-26T21:38:19.111721] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-03. [2025-09-26T21:38:19.911725] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-05. [2025-09-26T21:38:20.711705] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-05. [2025-09-26T21:38:21.028002] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-26T21:38:21.121920] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-26T21:38:21.137459] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-26T21:38:21.511736] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-06. [2025-09-26T21:38:22.311744] [INFO ] [REMOTE ] THLV: Fetching primary data for 2024-12. [2025-09-26T21:38:22.706161] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-26T21:38:22.772751] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-26T21:38:23.111718] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-06. [2025-09-26T21:38:23.577695] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-26T21:38:23.911734] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-01. [2025-09-26T21:38:24.550479] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-26T21:38:24.711745] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-04. [2025-09-26T21:38:25.511718] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-07. [2025-09-26T21:38:26.042839] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-26T21:38:26.311742] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-02. [2025-09-26T21:38:26.513218] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-26T21:38:26.774235] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-26T21:38:27.111720] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-08. [2025-09-26T21:38:27.656179] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-26T21:38:27.911737] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-09. [2025-09-26T21:38:28.377610] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-26T21:38:28.378787] [INFO ] [REMOTE ] THIR: Full fetch complete (2696 records). [2025-09-26T21:38:28.378859] [DEBUG] [VALIDATOR ] THIR: Validating primary data. [2025-09-26T21:38:28.716866] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-05. [2025-09-26T21:38:28.756035] [DEBUG] [VALIDATOR ] THIR: All expected trading days are present. [2025-09-26T21:38:28.756118] [DEBUG] [VALIDATOR ] THIR: Primary data validation passed. [2025-09-26T21:38:28.756231] [INFO ] [MAIN ] THIR: Fetched primary data is valid. [2025-09-26T21:38:28.756321] [DEBUG] [LOCAL ] THIR: Saving primary data. [2025-09-26T21:38:28.756773] [DEBUG] [LOCAL ] THIR: Trimmed 2696 records to 2238 (keeping 200 days of data) [2025-09-26T21:38:28.771372] [DEBUG] [LOCAL ] THIR: Primary data saved (2238 records). [2025-09-26T21:38:28.771549] [INFO ] [MAIN ] THIR: Full history saved. [2025-09-26T21:38:28.771693] [INFO ] [MAIN ] Update Progress: 2085/2371 symbols completed. THIR took 19.1s. Estimated remaining: 38m 12s. Rate: 7.5 symbols/min [2025-09-26T21:38:28.951121] [INFO ] [MAIN ] THO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:38:28.996893] [DEBUG] [LOCAL ] THO: Loaded 42681 existing records from primary storage. [2025-09-26T21:38:28.997063] [INFO ] [MAIN ] THO: Loaded 42681 existing records. [2025-09-26T21:38:29.181259] [WARN ] [MAIN ] THO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:38:29.181506] [INFO ] [MAIN ] THO: Wiping existing primary data before full refresh. [2025-09-26T21:38:29.181554] [INFO ] [LOCAL ] THO: Starting deletion of primary data. [2025-09-26T21:38:29.182595] [DEBUG] [LOCAL ] THO: Deleted primary data file. [2025-09-26T21:38:29.182692] [INFO ] [MAIN ] THO: Starting full primary refresh. [2025-09-26T21:38:29.516879] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-03. [2025-09-26T21:38:29.557633] [INFO ] [REMOTE ] THO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:38:29.995270] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-26T21:38:30.311724] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-04. [2025-09-26T21:38:30.770850] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-26T21:38:30.773536] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-26T21:38:31.111724] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-07. [2025-09-26T21:38:31.911728] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-05. [2025-09-26T21:38:32.343238] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-26T21:38:32.353954] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-26T21:38:32.711726] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-06. [2025-09-26T21:38:33.159467] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-26T21:38:33.511744] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-08. [2025-09-26T21:38:34.311730] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-07. [2025-09-26T21:38:34.662430] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-26T21:38:34.682694] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-26T21:38:35.111745] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-08. [2025-09-26T21:38:35.389411] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-26T21:38:35.911720] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-09. [2025-09-26T21:38:36.297497] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-26T21:38:36.298801] [INFO ] [REMOTE ] THLV: Full fetch complete (2664 records). [2025-09-26T21:38:36.298951] [DEBUG] [VALIDATOR ] THLV: Validating primary data. [2025-09-26T21:38:36.690318] [DEBUG] [VALIDATOR ] THLV: All expected trading days are present. [2025-09-26T21:38:36.690401] [DEBUG] [VALIDATOR ] THLV: Primary data validation passed. [2025-09-26T21:38:36.690525] [INFO ] [MAIN ] THLV: Fetched primary data is valid. [2025-09-26T21:38:36.690565] [DEBUG] [LOCAL ] THLV: Saving primary data. [2025-09-26T21:38:36.690952] [DEBUG] [LOCAL ] THLV: Trimmed 2664 records to 1614 (keeping 200 days of data) [2025-09-26T21:38:36.701235] [DEBUG] [LOCAL ] THLV: Primary data saved (1614 records). [2025-09-26T21:38:36.701315] [INFO ] [MAIN ] THLV: Full history saved. [2025-09-26T21:38:36.701396] [INFO ] [MAIN ] Update Progress: 2086/2371 symbols completed. THLV took 20.6s. Estimated remaining: 38m 4s. Rate: 7.5 symbols/min [2025-09-26T21:38:36.716875] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-09. [2025-09-26T21:38:36.888780] [INFO ] [MAIN ] THQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:38:36.916800] [DEBUG] [LOCAL ] THQ: Loaded 24695 existing records from primary storage. [2025-09-26T21:38:36.916944] [INFO ] [MAIN ] THQ: Loaded 24695 existing records. [2025-09-26T21:38:37.107937] [WARN ] [MAIN ] THQ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:38:37.108213] [INFO ] [MAIN ] THQ: Wiping existing primary data before full refresh. [2025-09-26T21:38:37.108261] [INFO ] [LOCAL ] THQ: Starting deletion of primary data. [2025-09-26T21:38:37.109278] [DEBUG] [LOCAL ] THQ: Deleted primary data file. [2025-09-26T21:38:37.109340] [INFO ] [MAIN ] THQ: Starting full primary refresh. [2025-09-26T21:38:37.497563] [INFO ] [REMOTE ] THQ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:38:37.511674] [INFO ] [REMOTE ] THQ: Fetching primary data for 2024-12. [2025-09-26T21:38:37.913497] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-26T21:38:37.918399] [INFO ] [REMOTE ] THG: Full fetch complete (31119 records). [2025-09-26T21:38:37.918511] [DEBUG] [VALIDATOR ] THG: Validating primary data. [2025-09-26T21:38:38.315976] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-06. [2025-09-26T21:38:38.329298] [DEBUG] [VALIDATOR ] THG: All expected trading days are present. [2025-09-26T21:38:38.329439] [DEBUG] [VALIDATOR ] THG: Primary data validation passed. [2025-09-26T21:38:38.330383] [INFO ] [MAIN ] THG: Fetched primary data is valid. [2025-09-26T21:38:38.330590] [DEBUG] [LOCAL ] THG: Saving primary data. [2025-09-26T21:38:38.331829] [DEBUG] [LOCAL ] THG: Trimmed 31119 records to 22081 (keeping 200 days of data) [2025-09-26T21:38:38.487725] [DEBUG] [LOCAL ] THG: Primary data saved (22081 records). [2025-09-26T21:38:38.487863] [INFO ] [MAIN ] THG: Full history saved. [2025-09-26T21:38:38.487969] [INFO ] [MAIN ] Update Progress: 2087/2371 symbols completed. THG took 30.9s. Estimated remaining: 37m 55s. Rate: 7.5 symbols/min [2025-09-26T21:38:38.691193] [INFO ] [MAIN ] THR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:38:38.702672] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-26T21:38:38.731428] [DEBUG] [LOCAL ] THR: Loaded 20062 existing records from primary storage. [2025-09-26T21:38:38.731695] [INFO ] [MAIN ] THR: Loaded 20062 existing records. [2025-09-26T21:38:38.931359] [WARN ] [MAIN ] THR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:38:38.931709] [INFO ] [MAIN ] THR: Wiping existing primary data before full refresh. [2025-09-26T21:38:38.931786] [INFO ] [LOCAL ] THR: Starting deletion of primary data. [2025-09-26T21:38:38.932773] [DEBUG] [LOCAL ] THR: Deleted primary data file. [2025-09-26T21:38:38.932856] [INFO ] [MAIN ] THR: Starting full primary refresh. [2025-09-26T21:38:39.116777] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-01. [2025-09-26T21:38:39.365172] [INFO ] [REMOTE ] THR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:38:39.911719] [INFO ] [REMOTE ] THR: Fetching primary data for 2024-12. [2025-09-26T21:38:40.316885] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-26T21:38:40.375391] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-26T21:38:40.711720] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-07. [2025-09-26T21:38:41.016942] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-26T21:38:41.511726] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-01. [2025-09-26T21:38:42.311709] [INFO ] [REMOTE ] THO: Fetching primary data for 2024-12. [2025-09-26T21:38:42.558294] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-26T21:38:42.596039] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-26T21:38:43.111728] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-02. [2025-09-26T21:38:43.881225] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-26T21:38:43.911695] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-08. [2025-09-26T21:38:44.135680] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-26T21:38:44.711721] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-02. [2025-09-26T21:38:45.486570] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-26T21:38:45.511707] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-09. [2025-09-26T21:38:45.895673] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-26T21:38:46.311728] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-01. [2025-09-26T21:38:47.121691] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-03. [2025-09-26T21:38:47.127571] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-26T21:38:47.137081] [INFO ] [REMOTE ] THC: Full fetch complete (69441 records). [2025-09-26T21:38:47.137256] [DEBUG] [VALIDATOR ] THC: Validating primary data. [2025-09-26T21:38:47.579699] [DEBUG] [VALIDATOR ] THC: All expected trading days are present. [2025-09-26T21:38:47.579964] [DEBUG] [VALIDATOR ] THC: Primary data validation passed. [2025-09-26T21:38:47.581287] [INFO ] [MAIN ] THC: Fetched primary data is valid. [2025-09-26T21:38:47.581448] [DEBUG] [LOCAL ] THC: Saving primary data. [2025-09-26T21:38:47.583915] [DEBUG] [LOCAL ] THC: Trimmed 69441 records to 48617 (keeping 200 days of data) [2025-09-26T21:38:47.609587] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-26T21:38:47.911868] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-02. [2025-09-26T21:38:47.928004] [DEBUG] [LOCAL ] THC: Primary data saved (48617 records). [2025-09-26T21:38:47.928116] [INFO ] [MAIN ] THC: Full history saved. [2025-09-26T21:38:47.928216] [INFO ] [MAIN ] Update Progress: 2088/2371 symbols completed. THC took 42.5s. Estimated remaining: 37m 47s. Rate: 7.5 symbols/min [2025-09-26T21:38:48.104161] [INFO ] [MAIN ] THS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:38:48.143936] [DEBUG] [LOCAL ] THS: Loaded 38320 existing records from primary storage. [2025-09-26T21:38:48.144082] [INFO ] [MAIN ] THS: Loaded 38320 existing records. [2025-09-26T21:38:48.334923] [WARN ] [MAIN ] THS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:38:48.340961] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-26T21:38:48.341054] [INFO ] [MAIN ] THS: Wiping existing primary data before full refresh. [2025-09-26T21:38:48.345194] [INFO ] [LOCAL ] THS: Starting deletion of primary data. [2025-09-26T21:38:48.346353] [DEBUG] [LOCAL ] THS: Deleted primary data file. [2025-09-26T21:38:48.346423] [INFO ] [MAIN ] THS: Starting full primary refresh. [2025-09-26T21:38:48.716827] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-04. [2025-09-26T21:38:48.722068] [INFO ] [REMOTE ] THS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:38:49.144502] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-26T21:38:49.511714] [INFO ] [REMOTE ] THS: Fetching primary data for 2024-12. [2025-09-26T21:38:49.886427] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-26T21:38:50.311720] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-03. [2025-09-26T21:38:50.843840] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-26T21:38:51.111719] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-05. [2025-09-26T21:38:51.911696] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-03. [2025-09-26T21:38:52.084914] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-26T21:38:52.227313] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-26T21:38:52.711728] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-01. [2025-09-26T21:38:52.738634] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-26T21:38:53.511745] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-06. [2025-09-26T21:38:54.000336] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-26T21:38:54.311697] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-04. [2025-09-26T21:38:54.537454] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-26T21:38:55.111734] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-04. [2025-09-26T21:38:55.609256] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-26T21:38:55.911719] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-07. [2025-09-26T21:38:56.711739] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-05. [2025-09-26T21:38:56.971740] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-26T21:38:57.334588] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-26T21:38:57.511742] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-02. [2025-09-26T21:38:58.058260] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-26T21:38:58.311731] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-08. [2025-09-26T21:38:58.955320] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-26T21:38:59.111747] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-03. [2025-09-26T21:38:59.746411] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-26T21:38:59.911730] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-09. [2025-09-26T21:39:00.560687] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-26T21:39:00.711740] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-06. [2025-09-26T21:39:01.031166] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-26T21:39:01.039269] [INFO ] [REMOTE ] THQ: Full fetch complete (34991 records). [2025-09-26T21:39:01.039500] [DEBUG] [VALIDATOR ] THQ: Validating primary data. [2025-09-26T21:39:01.512174] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-05. [2025-09-26T21:39:01.644797] [DEBUG] [VALIDATOR ] THQ: All expected trading days are present. [2025-09-26T21:39:01.644933] [DEBUG] [VALIDATOR ] THQ: Primary data validation passed. [2025-09-26T21:39:01.646367] [INFO ] [MAIN ] THQ: Fetched primary data is valid. [2025-09-26T21:39:01.646469] [DEBUG] [LOCAL ] THQ: Saving primary data. [2025-09-26T21:39:01.648034] [DEBUG] [LOCAL ] THQ: Trimmed 34991 records to 24879 (keeping 200 days of data) [2025-09-26T21:39:01.829227] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-26T21:39:01.901484] [DEBUG] [LOCAL ] THQ: Primary data saved (24879 records). [2025-09-26T21:39:01.901676] [INFO ] [MAIN ] THQ: Full history saved. [2025-09-26T21:39:01.901797] [INFO ] [MAIN ] Update Progress: 2089/2371 symbols completed. THQ took 25.2s. Estimated remaining: 37m 40s. Rate: 7.5 symbols/min [2025-09-26T21:39:02.141967] [INFO ] [MAIN ] THW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:39:02.164593] [DEBUG] [LOCAL ] THW: Loaded 19235 existing records from primary storage. [2025-09-26T21:39:02.164795] [INFO ] [MAIN ] THW: Loaded 19235 existing records. [2025-09-26T21:39:02.317990] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-07. [2025-09-26T21:39:02.366200] [WARN ] [MAIN ] THW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:39:02.366465] [INFO ] [MAIN ] THW: Wiping existing primary data before full refresh. [2025-09-26T21:39:02.366519] [INFO ] [LOCAL ] THW: Starting deletion of primary data. [2025-09-26T21:39:02.367170] [DEBUG] [LOCAL ] THW: Deleted primary data file. [2025-09-26T21:39:02.367238] [INFO ] [MAIN ] THW: Starting full primary refresh. [2025-09-26T21:39:02.755947] [INFO ] [REMOTE ] THW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:39:03.111729] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-04. [2025-09-26T21:39:03.227298] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-26T21:39:03.374888] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-26T21:39:03.911733] [INFO ] [REMOTE ] THW: Fetching primary data for 2024-12. [2025-09-26T21:39:04.686703] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-26T21:39:04.711671] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-06. [2025-09-26T21:39:05.062915] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-26T21:39:05.511732] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-08. [2025-09-26T21:39:06.094282] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-26T21:39:06.311700] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-07. [2025-09-26T21:39:06.662110] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-26T21:39:07.111718] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-09. [2025-09-26T21:39:07.734270] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-26T21:39:07.911699] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-01. [2025-09-26T21:39:08.178972] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-26T21:39:08.183537] [INFO ] [REMOTE ] THR: Full fetch complete (28816 records). [2025-09-26T21:39:08.183619] [DEBUG] [VALIDATOR ] THR: Validating primary data. [2025-09-26T21:39:08.571474] [DEBUG] [VALIDATOR ] THR: All expected trading days are present. [2025-09-26T21:39:08.571565] [DEBUG] [VALIDATOR ] THR: Primary data validation passed. [2025-09-26T21:39:08.572237] [INFO ] [MAIN ] THR: Fetched primary data is valid. [2025-09-26T21:39:08.572306] [DEBUG] [LOCAL ] THR: Saving primary data. [2025-09-26T21:39:08.573433] [DEBUG] [LOCAL ] THR: Trimmed 28816 records to 20218 (keeping 200 days of data) [2025-09-26T21:39:08.701476] [DEBUG] [LOCAL ] THR: Primary data saved (20218 records). [2025-09-26T21:39:08.701606] [INFO ] [MAIN ] THR: Full history saved. [2025-09-26T21:39:08.701729] [INFO ] [MAIN ] Update Progress: 2090/2371 symbols completed. THR took 30.2s. Estimated remaining: 37m 31s. Rate: 7.5 symbols/min [2025-09-26T21:39:08.716773] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-05. [2025-09-26T21:39:08.889551] [INFO ] [MAIN ] TIC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:39:08.889741] [DEBUG] [LOCAL ] TIC: No existing data file found in primary storage. [2025-09-26T21:39:08.889790] [WARN ] [MAIN ] TIC: No existing data found, performing full refresh instead. [2025-09-26T21:39:08.889942] [INFO ] [MAIN ] TIC: Wiping existing primary data before full refresh. [2025-09-26T21:39:08.889989] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-09-26T21:39:08.890032] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-09-26T21:39:08.890066] [INFO ] [MAIN ] TIC: Starting full primary refresh. [2025-09-26T21:39:09.268573] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-26T21:39:09.299149] [INFO ] [REMOTE ] TIC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:39:09.511743] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-02. [2025-09-26T21:39:10.311741] [INFO ] [REMOTE ] TIC: Fetching primary data for 2024-12. [2025-09-26T21:39:10.382145] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-26T21:39:10.401318] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-26T21:39:10.721634] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:39:10.722003] [WARN ] [REMOTE ] TIC: No data returned for month 2024-12 [2025-09-26T21:39:11.111722] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-08. [2025-09-26T21:39:11.911726] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-01. [2025-09-26T21:39:12.113237] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:39:12.113626] [WARN ] [REMOTE ] TIC: No data returned for month 2025-01 [2025-09-26T21:39:12.641214] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-26T21:39:12.711703] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-06. [2025-09-26T21:39:13.511736] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-02. [2025-09-26T21:39:13.940907] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-26T21:39:14.021265] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-26T21:39:14.311726] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-03. [2025-09-26T21:39:15.111722] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-09. [2025-09-26T21:39:15.294926] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-26T21:39:15.911745] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-07. [2025-09-26T21:39:16.709779] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-26T21:39:16.717804] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-04. [2025-09-26T21:39:16.719444] [INFO ] [REMOTE ] THO: Full fetch complete (60234 records). [2025-09-26T21:39:16.719535] [DEBUG] [VALIDATOR ] THO: Validating primary data. [2025-09-26T21:39:17.156222] [DEBUG] [VALIDATOR ] THO: All expected trading days are present. [2025-09-26T21:39:17.156362] [DEBUG] [VALIDATOR ] THO: Primary data validation passed. [2025-09-26T21:39:17.157400] [INFO ] [MAIN ] THO: Fetched primary data is valid. [2025-09-26T21:39:17.157517] [DEBUG] [LOCAL ] THO: Saving primary data. [2025-09-26T21:39:17.166304] [DEBUG] [LOCAL ] THO: Trimmed 60234 records to 42957 (keeping 200 days of data) [2025-09-26T21:39:17.423819] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-26T21:39:17.487685] [DEBUG] [LOCAL ] THO: Primary data saved (42957 records). [2025-09-26T21:39:17.487830] [INFO ] [MAIN ] THO: Full history saved. [2025-09-26T21:39:17.488013] [INFO ] [MAIN ] Update Progress: 2091/2371 symbols completed. THO took 48.7s. Estimated remaining: 37m 24s. Rate: 7.5 symbols/min [2025-09-26T21:39:17.518337] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-03. [2025-09-26T21:39:17.684800] [INFO ] [MAIN ] TIMB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:39:17.735576] [DEBUG] [LOCAL ] TIMB: Loaded 36834 existing records from primary storage. [2025-09-26T21:39:17.735767] [INFO ] [MAIN ] TIMB: Loaded 36834 existing records. [2025-09-26T21:39:17.881868] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-26T21:39:17.947022] [WARN ] [MAIN ] TIMB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:39:17.947275] [INFO ] [MAIN ] TIMB: Wiping existing primary data before full refresh. [2025-09-26T21:39:17.947332] [INFO ] [LOCAL ] TIMB: Starting deletion of primary data. [2025-09-26T21:39:17.948422] [DEBUG] [LOCAL ] TIMB: Deleted primary data file. [2025-09-26T21:39:17.948493] [INFO ] [MAIN ] TIMB: Starting full primary refresh. [2025-09-26T21:39:18.312619] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-05. [2025-09-26T21:39:18.316718] [INFO ] [REMOTE ] TIMB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:39:18.562050] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-26T21:39:19.111734] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-08. [2025-09-26T21:39:19.774468] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-26T21:39:19.911737] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-06. [2025-09-26T21:39:20.711726] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-04. [2025-09-26T21:39:20.940604] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-26T21:39:21.492600] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-26T21:39:21.511679] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-07. [2025-09-26T21:39:21.737538] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-26T21:39:22.311739] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-09. [2025-09-26T21:39:22.878989] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-26T21:39:23.111718] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-08. [2025-09-26T21:39:23.746236] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-26T21:39:23.754329] [INFO ] [REMOTE ] THS: Full fetch complete (53660 records). [2025-09-26T21:39:23.754451] [DEBUG] [VALIDATOR ] THS: Validating primary data. [2025-09-26T21:39:23.920200] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-05. [2025-09-26T21:39:24.175863] [DEBUG] [VALIDATOR ] THS: All expected trading days are present. [2025-09-26T21:39:24.175952] [DEBUG] [VALIDATOR ] THS: Primary data validation passed. [2025-09-26T21:39:24.181123] [INFO ] [MAIN ] THS: Fetched primary data is valid. [2025-09-26T21:39:24.182096] [DEBUG] [LOCAL ] THS: Saving primary data. [2025-09-26T21:39:24.183691] [DEBUG] [LOCAL ] THS: Trimmed 53660 records to 38565 (keeping 200 days of data) [2025-09-26T21:39:24.425321] [DEBUG] [LOCAL ] THS: Primary data saved (38565 records). [2025-09-26T21:39:24.425482] [INFO ] [MAIN ] THS: Full history saved. [2025-09-26T21:39:24.425633] [INFO ] [MAIN ] Update Progress: 2092/2371 symbols completed. THS took 36.5s. Estimated remaining: 37m 15s. Rate: 7.5 symbols/min [2025-09-26T21:39:24.606785] [INFO ] [MAIN ] TISI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:39:24.612305] [DEBUG] [LOCAL ] TISI: Loaded 3795 existing records from primary storage. [2025-09-26T21:39:24.612390] [INFO ] [MAIN ] TISI: Loaded 3795 existing records. [2025-09-26T21:39:24.716864] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2024-12. [2025-09-26T21:39:24.853189] [WARN ] [MAIN ] TISI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:39:24.853831] [INFO ] [MAIN ] TISI: Wiping existing primary data before full refresh. [2025-09-26T21:39:24.853911] [INFO ] [LOCAL ] TISI: Starting deletion of primary data. [2025-09-26T21:39:24.854556] [DEBUG] [LOCAL ] TISI: Deleted primary data file. [2025-09-26T21:39:24.854633] [INFO ] [MAIN ] TISI: Starting full primary refresh. [2025-09-26T21:39:25.006426] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-26T21:39:25.249834] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-26T21:39:25.311995] [INFO ] [REMOTE ] TISI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:39:25.511726] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-09. [2025-09-26T21:39:26.239377] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-26T21:39:26.311710] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-06. [2025-09-26T21:39:27.111690] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-01. [2025-09-26T21:39:27.138955] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-26T21:39:27.148858] [INFO ] [REMOTE ] TIC: Full fetch complete (39076 records). [2025-09-26T21:39:27.149007] [DEBUG] [VALIDATOR ] TIC: Validating primary data. [2025-09-26T21:39:27.355015] [WARN ] [VALIDATOR ] TIC: Validation failed - insufficient historical data. Have 152 unique days, need 200 days [2025-09-26T21:39:27.355494] [FATAL] [MAIN ] TIC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T21:39:27.355618] [WARN ] [MAIN ] TIC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T21:39:27.355717] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-09-26T21:39:27.355787] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-09-26T21:39:27.355825] [INFO ] [LOCAL ] TIC: Starting deletion of derivative data. [2025-09-26T21:39:27.355880] [DEBUG] [LOCAL ] TIC: No derivative data file found to delete. [2025-09-26T21:39:27.355967] [INFO ] [MAIN ] Update Progress: 2093/2371 symbols completed. TIC took 18.7s. Estimated remaining: 37m 7s. Rate: 7.5 symbols/min [2025-09-26T21:39:27.525314] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-26T21:39:27.567694] [INFO ] [MAIN ] TIXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:39:27.600100] [DEBUG] [LOCAL ] TIXT: Loaded 31678 existing records from primary storage. [2025-09-26T21:39:27.600258] [INFO ] [MAIN ] TIXT: Loaded 31678 existing records. [2025-09-26T21:39:27.802927] [WARN ] [MAIN ] TIXT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:39:27.803181] [INFO ] [MAIN ] TIXT: Wiping existing primary data before full refresh. [2025-09-26T21:39:27.803231] [INFO ] [LOCAL ] TIXT: Starting deletion of primary data. [2025-09-26T21:39:27.804012] [DEBUG] [LOCAL ] TIXT: Deleted primary data file. [2025-09-26T21:39:27.804074] [INFO ] [MAIN ] TIXT: Starting full primary refresh. [2025-09-26T21:39:27.916907] [INFO ] [REMOTE ] TISI: Fetching primary data for 2024-12. [2025-09-26T21:39:28.216030] [INFO ] [REMOTE ] TIXT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:39:28.550688] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-26T21:39:28.575097] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-26T21:39:28.711726] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-02. [2025-09-26T21:39:29.511732] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-01. [2025-09-26T21:39:29.992694] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-26T21:39:30.263634] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-26T21:39:30.311709] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-07. [2025-09-26T21:39:31.111700] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-02. [2025-09-26T21:39:31.549301] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-26T21:39:31.592594] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-26T21:39:31.911717] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-03. [2025-09-26T21:39:32.555458] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-26T21:39:32.711716] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-08. [2025-09-26T21:39:33.511702] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-03. [2025-09-26T21:39:33.741098] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-26T21:39:34.311717] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2024-12. [2025-09-26T21:39:34.981321] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-26T21:39:35.111718] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-04. [2025-09-26T21:39:35.724413] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-26T21:39:35.911735] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-01. [2025-09-26T21:39:36.659782] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-26T21:39:36.711705] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-04. [2025-09-26T21:39:37.211046] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-26T21:39:37.511086] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-26T21:39:37.514741] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-05. [2025-09-26T21:39:38.101905] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-26T21:39:38.311722] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-06. [2025-09-26T21:39:38.939388] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-26T21:39:39.111721] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-09. [2025-09-26T21:39:39.911780] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-07. [2025-09-26T21:39:40.152487] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-26T21:39:40.156255] [INFO ] [REMOTE ] THW: Full fetch complete (29384 records). [2025-09-26T21:39:40.156348] [DEBUG] [VALIDATOR ] THW: Validating primary data. [2025-09-26T21:39:40.266245] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-26T21:39:40.555775] [DEBUG] [VALIDATOR ] THW: All expected trading days are present. [2025-09-26T21:39:40.555911] [DEBUG] [VALIDATOR ] THW: Primary data validation passed. [2025-09-26T21:39:40.556712] [INFO ] [MAIN ] THW: Fetched primary data is valid. [2025-09-26T21:39:40.556778] [DEBUG] [LOCAL ] THW: Saving primary data. [2025-09-26T21:39:40.557810] [DEBUG] [LOCAL ] THW: Trimmed 29384 records to 19392 (keeping 200 days of data) [2025-09-26T21:39:40.694113] [DEBUG] [LOCAL ] THW: Primary data saved (19392 records). [2025-09-26T21:39:40.694294] [INFO ] [MAIN ] THW: Full history saved. [2025-09-26T21:39:40.694409] [INFO ] [MAIN ] Update Progress: 2094/2371 symbols completed. THW took 38.8s. Estimated remaining: 36m 59s. Rate: 7.5 symbols/min [2025-09-26T21:39:40.718705] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-08. [2025-09-26T21:39:40.918341] [INFO ] [MAIN ] TJX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:39:41.006441] [DEBUG] [LOCAL ] TJX: Loaded 54059 existing records from primary storage. [2025-09-26T21:39:41.006721] [INFO ] [MAIN ] TJX: Loaded 54059 existing records. [2025-09-26T21:39:41.246065] [WARN ] [MAIN ] TJX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:39:41.246298] [INFO ] [MAIN ] TJX: Wiping existing primary data before full refresh. [2025-09-26T21:39:41.246372] [INFO ] [LOCAL ] TJX: Starting deletion of primary data. [2025-09-26T21:39:41.248065] [DEBUG] [LOCAL ] TJX: Deleted primary data file. [2025-09-26T21:39:41.248127] [INFO ] [MAIN ] TJX: Starting full primary refresh. [2025-09-26T21:39:41.346014] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-26T21:39:41.516831] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-05. [2025-09-26T21:39:41.617224] [INFO ] [REMOTE ] TJX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:39:42.311728] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-02. [2025-09-26T21:39:42.984733] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T21:39:43.111726] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-06. [2025-09-26T21:39:43.532984] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-26T21:39:43.911732] [INFO ] [REMOTE ] TJX: Fetching primary data for 2024-12. [2025-09-26T21:39:44.602113] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-26T21:39:44.711720] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-03. [2025-09-26T21:39:45.511720] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-07. [2025-09-26T21:39:45.573484] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-26T21:39:45.934098] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-26T21:39:46.311748] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-09. [2025-09-26T21:39:46.751576] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-26T21:39:46.752624] [INFO ] [REMOTE ] TISI: Full fetch complete (4936 records). [2025-09-26T21:39:46.752824] [DEBUG] [VALIDATOR ] TISI: Validating primary data. [2025-09-26T21:39:47.114136] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-04. [2025-09-26T21:39:47.142293] [DEBUG] [VALIDATOR ] TISI: All expected trading days are present. [2025-09-26T21:39:47.142427] [DEBUG] [VALIDATOR ] TISI: Primary data validation passed. [2025-09-26T21:39:47.142754] [INFO ] [MAIN ] TISI: Fetched primary data is valid. [2025-09-26T21:39:47.142835] [DEBUG] [LOCAL ] TISI: Saving primary data. [2025-09-26T21:39:47.143473] [DEBUG] [LOCAL ] TISI: Trimmed 4936 records to 3805 (keeping 200 days of data) [2025-09-26T21:39:47.168690] [DEBUG] [LOCAL ] TISI: Primary data saved (3805 records). [2025-09-26T21:39:47.168906] [INFO ] [MAIN ] TISI: Full history saved. [2025-09-26T21:39:47.169071] [INFO ] [MAIN ] Update Progress: 2095/2371 symbols completed. TISI took 22.7s. Estimated remaining: 36m 51s. Rate: 7.5 symbols/min [2025-09-26T21:39:47.376154] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-26T21:39:47.379777] [INFO ] [MAIN ] TK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:39:47.441999] [DEBUG] [LOCAL ] TK: Loaded 39941 existing records from primary storage. [2025-09-26T21:39:47.442181] [INFO ] [MAIN ] TK: Loaded 39941 existing records. [2025-09-26T21:39:47.637933] [WARN ] [MAIN ] TK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:39:47.638195] [INFO ] [MAIN ] TK: Wiping existing primary data before full refresh. [2025-09-26T21:39:47.638242] [INFO ] [LOCAL ] TK: Starting deletion of primary data. [2025-09-26T21:39:47.639071] [DEBUG] [LOCAL ] TK: Deleted primary data file. [2025-09-26T21:39:47.639130] [INFO ] [MAIN ] TK: Starting full primary refresh. [2025-09-26T21:39:47.916876] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-01. [2025-09-26T21:39:48.016559] [INFO ] [REMOTE ] TK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:39:48.299002] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-26T21:39:48.711727] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-05. [2025-09-26T21:39:49.511693] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-08. [2025-09-26T21:39:49.696969] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-26T21:39:49.918110] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-26T21:39:50.311732] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-06. [2025-09-26T21:39:50.980825] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-26T21:39:51.111730] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-02. [2025-09-26T21:39:51.820974] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-26T21:39:51.911744] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-09. [2025-09-26T21:39:52.711719] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-07. [2025-09-26T21:39:52.991061] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-26T21:39:53.179345] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-26T21:39:53.185365] [INFO ] [REMOTE ] TIMB: Full fetch complete (54550 records). [2025-09-26T21:39:53.185465] [DEBUG] [VALIDATOR ] TIMB: Validating primary data. [2025-09-26T21:39:53.516847] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-03. [2025-09-26T21:39:53.645963] [DEBUG] [VALIDATOR ] TIMB: All expected trading days are present. [2025-09-26T21:39:53.646095] [DEBUG] [VALIDATOR ] TIMB: Primary data validation passed. [2025-09-26T21:39:53.647467] [INFO ] [MAIN ] TIMB: Fetched primary data is valid. [2025-09-26T21:39:53.647554] [DEBUG] [LOCAL ] TIMB: Saving primary data. [2025-09-26T21:39:53.649680] [DEBUG] [LOCAL ] TIMB: Trimmed 54550 records to 36983 (keeping 200 days of data) [2025-09-26T21:39:53.916927] [DEBUG] [LOCAL ] TIMB: Primary data saved (36983 records). [2025-09-26T21:39:53.917098] [INFO ] [MAIN ] TIMB: Full history saved. [2025-09-26T21:39:53.917200] [INFO ] [MAIN ] Update Progress: 2096/2371 symbols completed. TIMB took 36.4s. Estimated remaining: 36m 43s. Rate: 7.5 symbols/min [2025-09-26T21:39:54.163389] [INFO ] [MAIN ] TKC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:39:54.197861] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-26T21:39:54.251680] [DEBUG] [LOCAL ] TKC: Loaded 38717 existing records from primary storage. [2025-09-26T21:39:54.251887] [INFO ] [MAIN ] TKC: Loaded 38717 existing records. [2025-09-26T21:39:54.323276] [INFO ] [REMOTE ] TK: Fetching primary data for 2024-12. [2025-09-26T21:39:54.524316] [WARN ] [MAIN ] TKC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:39:54.524711] [INFO ] [MAIN ] TKC: Wiping existing primary data before full refresh. [2025-09-26T21:39:54.524775] [INFO ] [LOCAL ] TKC: Starting deletion of primary data. [2025-09-26T21:39:54.525597] [DEBUG] [LOCAL ] TKC: Deleted primary data file. [2025-09-26T21:39:54.525700] [INFO ] [MAIN ] TKC: Starting full primary refresh. [2025-09-26T21:39:54.940116] [INFO ] [REMOTE ] TKC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:39:55.111736] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-08. [2025-09-26T21:39:55.613010] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-26T21:39:55.911722] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-04. [2025-09-26T21:39:56.206454] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-26T21:39:56.438784] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-26T21:39:56.711717] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-09. [2025-09-26T21:39:57.511721] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-01. [2025-09-26T21:39:57.927638] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-26T21:39:57.984945] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-26T21:39:57.993774] [INFO ] [REMOTE ] TIXT: Full fetch complete (45678 records). [2025-09-26T21:39:57.993901] [DEBUG] [VALIDATOR ] TIXT: Validating primary data. [2025-09-26T21:39:58.316885] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-05. [2025-09-26T21:39:58.395324] [DEBUG] [VALIDATOR ] TIXT: All expected trading days are present. [2025-09-26T21:39:58.395411] [DEBUG] [VALIDATOR ] TIXT: Primary data validation passed. [2025-09-26T21:39:58.396329] [INFO ] [MAIN ] TIXT: Fetched primary data is valid. [2025-09-26T21:39:58.396395] [DEBUG] [LOCAL ] TIXT: Saving primary data. [2025-09-26T21:39:58.398016] [DEBUG] [LOCAL ] TIXT: Trimmed 45678 records to 31824 (keeping 200 days of data) [2025-09-26T21:39:58.538638] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-26T21:39:58.611872] [DEBUG] [LOCAL ] TIXT: Primary data saved (31824 records). [2025-09-26T21:39:58.612090] [INFO ] [MAIN ] TIXT: Full history saved. [2025-09-26T21:39:58.612198] [INFO ] [MAIN ] Update Progress: 2097/2371 symbols completed. TIXT took 31.3s. Estimated remaining: 36m 35s. Rate: 7.5 symbols/min [2025-09-26T21:39:58.794186] [INFO ] [MAIN ] TKO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:39:58.843567] [DEBUG] [LOCAL ] TKO: Loaded 44485 existing records from primary storage. [2025-09-26T21:39:58.843739] [INFO ] [MAIN ] TKO: Loaded 44485 existing records. [2025-09-26T21:39:59.030550] [WARN ] [MAIN ] TKO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:39:59.030839] [INFO ] [MAIN ] TKO: Wiping existing primary data before full refresh. [2025-09-26T21:39:59.030887] [INFO ] [LOCAL ] TKO: Starting deletion of primary data. [2025-09-26T21:39:59.031968] [DEBUG] [LOCAL ] TKO: Deleted primary data file. [2025-09-26T21:39:59.032028] [INFO ] [MAIN ] TKO: Starting full primary refresh. [2025-09-26T21:39:59.116788] [INFO ] [REMOTE ] TKC: Fetching primary data for 2024-12. [2025-09-26T21:39:59.428876] [INFO ] [REMOTE ] TKO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:39:59.911728] [INFO ] [REMOTE ] TKO: Fetching primary data for 2024-12. [2025-09-26T21:40:00.525104] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-26T21:40:00.540090] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-26T21:40:00.711736] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-02. [2025-09-26T21:40:01.352171] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-26T21:40:01.511768] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-01. [2025-09-26T21:40:01.739148] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-26T21:40:02.311721] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-03. [2025-09-26T21:40:03.111687] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-06. [2025-09-26T21:40:03.207995] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-26T21:40:03.911750] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-01. [2025-09-26T21:40:03.955283] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-26T21:40:04.711731] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-04. [2025-09-26T21:40:05.181491] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-26T21:40:05.249777] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-26T21:40:05.511729] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-02. [2025-09-26T21:40:06.310314] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T21:40:06.319509] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-07. [2025-09-26T21:40:06.729204] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-26T21:40:07.111760] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-05. [2025-09-26T21:40:07.911718] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-03. [2025-09-26T21:40:08.447908] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-26T21:40:08.523274] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-26T21:40:08.711757] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-08. [2025-09-26T21:40:09.439186] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-26T21:40:09.511712] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-04. [2025-09-26T21:40:10.311702] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-02. [2025-09-26T21:40:10.717229] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-26T21:40:11.033179] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T21:40:11.111716] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-06. [2025-09-26T21:40:11.911711] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-09. [2025-09-26T21:40:12.069562] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-26T21:40:12.281796] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-26T21:40:12.644055] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-26T21:40:12.655702] [INFO ] [REMOTE ] TJX: Full fetch complete (77678 records). [2025-09-26T21:40:12.655900] [DEBUG] [VALIDATOR ] TJX: Validating primary data. [2025-09-26T21:40:12.716861] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-05. [2025-09-26T21:40:13.082976] [DEBUG] [VALIDATOR ] TJX: All expected trading days are present. [2025-09-26T21:40:13.083147] [DEBUG] [VALIDATOR ] TJX: Primary data validation passed. [2025-09-26T21:40:13.084467] [INFO ] [MAIN ] TJX: Fetched primary data is valid. [2025-09-26T21:40:13.084537] [DEBUG] [LOCAL ] TJX: Saving primary data. [2025-09-26T21:40:13.086597] [DEBUG] [LOCAL ] TJX: Trimmed 77678 records to 54449 (keeping 200 days of data) [2025-09-26T21:40:13.441796] [DEBUG] [LOCAL ] TJX: Primary data saved (54449 records). [2025-09-26T21:40:13.441956] [INFO ] [MAIN ] TJX: Full history saved. [2025-09-26T21:40:13.442082] [INFO ] [MAIN ] Update Progress: 2098/2371 symbols completed. TJX took 32.7s. Estimated remaining: 36m 27s. Rate: 7.5 symbols/min [2025-09-26T21:40:13.520616] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-07. [2025-09-26T21:40:13.626636] [INFO ] [MAIN ] TKR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:40:13.665551] [DEBUG] [LOCAL ] TKR: Loaded 40556 existing records from primary storage. [2025-09-26T21:40:13.665735] [INFO ] [MAIN ] TKR: Loaded 40556 existing records. [2025-09-26T21:40:13.854716] [WARN ] [MAIN ] TKR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:40:13.855068] [INFO ] [MAIN ] TKR: Wiping existing primary data before full refresh. [2025-09-26T21:40:13.855127] [INFO ] [LOCAL ] TKR: Starting deletion of primary data. [2025-09-26T21:40:13.856190] [DEBUG] [LOCAL ] TKR: Deleted primary data file. [2025-09-26T21:40:13.856255] [INFO ] [MAIN ] TKR: Starting full primary refresh. [2025-09-26T21:40:14.237841] [INFO ] [REMOTE ] TKR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:40:14.311763] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-03. [2025-09-26T21:40:14.390714] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-26T21:40:14.843223] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-26T21:40:15.111714] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-06. [2025-09-26T21:40:15.911723] [INFO ] [REMOTE ] TKR: Fetching primary data for 2024-12. [2025-09-26T21:40:16.294734] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-26T21:40:16.711749] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-04. [2025-09-26T21:40:16.786236] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-26T21:40:17.356711] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-26T21:40:17.511717] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-01. [2025-09-26T21:40:18.311716] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-07. [2025-09-26T21:40:18.539383] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-26T21:40:19.001770] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-26T21:40:19.111733] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-05. [2025-09-26T21:40:19.892791] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-26T21:40:19.911678] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-08. [2025-09-26T21:40:20.711720] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-02. [2025-09-26T21:40:20.776276] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-26T21:40:21.447392] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-26T21:40:21.511683] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-06. [2025-09-26T21:40:22.242059] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-26T21:40:22.311745] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-03. [2025-09-26T21:40:23.043784] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-26T21:40:23.111712] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-08. [2025-09-26T21:40:23.906769] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-26T21:40:23.915210] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-09. [2025-09-26T21:40:24.194056] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-26T21:40:24.711752] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-04. [2025-09-26T21:40:25.277620] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-26T21:40:25.285172] [INFO ] [REMOTE ] TK: Full fetch complete (56766 records). [2025-09-26T21:40:25.285327] [DEBUG] [VALIDATOR ] TK: Validating primary data. [2025-09-26T21:40:25.516859] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-09. [2025-09-26T21:40:25.732604] [DEBUG] [VALIDATOR ] TK: All expected trading days are present. [2025-09-26T21:40:25.732773] [DEBUG] [VALIDATOR ] TK: Primary data validation passed. [2025-09-26T21:40:25.733849] [INFO ] [MAIN ] TK: Fetched primary data is valid. [2025-09-26T21:40:25.733917] [DEBUG] [LOCAL ] TK: Saving primary data. [2025-09-26T21:40:25.735540] [DEBUG] [LOCAL ] TK: Trimmed 56766 records to 40151 (keeping 200 days of data) [2025-09-26T21:40:25.987493] [DEBUG] [LOCAL ] TK: Primary data saved (40151 records). [2025-09-26T21:40:25.987742] [INFO ] [MAIN ] TK: Full history saved. [2025-09-26T21:40:25.987908] [INFO ] [MAIN ] Update Progress: 2099/2371 symbols completed. TK took 38.8s. Estimated remaining: 36m 20s. Rate: 7.5 symbols/min [2025-09-26T21:40:26.172774] [INFO ] [MAIN ] TLK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:40:26.218517] [DEBUG] [LOCAL ] TLK: Loaded 39713 existing records from primary storage. [2025-09-26T21:40:26.218772] [INFO ] [MAIN ] TLK: Loaded 39713 existing records. [2025-09-26T21:40:26.316920] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-07. [2025-09-26T21:40:26.437025] [WARN ] [MAIN ] TLK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:40:26.437706] [INFO ] [MAIN ] TLK: Wiping existing primary data before full refresh. [2025-09-26T21:40:26.437825] [INFO ] [LOCAL ] TLK: Starting deletion of primary data. [2025-09-26T21:40:26.439084] [DEBUG] [LOCAL ] TLK: Deleted primary data file. [2025-09-26T21:40:26.439156] [INFO ] [MAIN ] TLK: Starting full primary refresh. [2025-09-26T21:40:26.543638] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-26T21:40:26.894723] [INFO ] [REMOTE ] TLK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:40:27.111717] [INFO ] [REMOTE ] TLK: Fetching primary data for 2024-12. [2025-09-26T21:40:27.224693] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-26T21:40:27.233679] [INFO ] [REMOTE ] TKC: Full fetch complete (51649 records). [2025-09-26T21:40:27.233828] [DEBUG] [VALIDATOR ] TKC: Validating primary data. [2025-09-26T21:40:27.645202] [DEBUG] [VALIDATOR ] TKC: All expected trading days are present. [2025-09-26T21:40:27.645378] [DEBUG] [VALIDATOR ] TKC: Primary data validation passed. [2025-09-26T21:40:27.646908] [INFO ] [MAIN ] TKC: Fetched primary data is valid. [2025-09-26T21:40:27.646993] [DEBUG] [LOCAL ] TKC: Saving primary data. [2025-09-26T21:40:27.648378] [DEBUG] [LOCAL ] TKC: Trimmed 51649 records to 39062 (keeping 200 days of data) [2025-09-26T21:40:27.882664] [DEBUG] [LOCAL ] TKC: Primary data saved (39062 records). [2025-09-26T21:40:27.882837] [INFO ] [MAIN ] TKC: Full history saved. [2025-09-26T21:40:27.882959] [INFO ] [MAIN ] Update Progress: 2100/2371 symbols completed. TKC took 34.0s. Estimated remaining: 36m 11s. Rate: 7.5 symbols/min [2025-09-26T21:40:27.919031] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-05. [2025-09-26T21:40:28.104534] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-26T21:40:28.108634] [INFO ] [MAIN ] TLYS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:40:28.142054] [DEBUG] [LOCAL ] TLYS: Loaded 17017 existing records from primary storage. [2025-09-26T21:40:28.142241] [INFO ] [MAIN ] TLYS: Loaded 17017 existing records. [2025-09-26T21:40:28.335690] [WARN ] [MAIN ] TLYS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:40:28.335969] [INFO ] [MAIN ] TLYS: Wiping existing primary data before full refresh. [2025-09-26T21:40:28.336024] [INFO ] [LOCAL ] TLYS: Starting deletion of primary data. [2025-09-26T21:40:28.336481] [DEBUG] [LOCAL ] TLYS: Deleted primary data file. [2025-09-26T21:40:28.336541] [INFO ] [MAIN ] TLYS: Starting full primary refresh. [2025-09-26T21:40:28.716731] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-08. [2025-09-26T21:40:28.733475] [INFO ] [REMOTE ] TLYS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:40:28.751194] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-26T21:40:29.511713] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2024-12. [2025-09-26T21:40:29.603436] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-26T21:40:29.660131] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-26T21:40:30.311733] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-06. [2025-09-26T21:40:30.519888] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-26T21:40:31.111742] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-01. [2025-09-26T21:40:31.727384] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-26T21:40:31.911743] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-09. [2025-09-26T21:40:32.200697] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-26T21:40:32.711720] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-02. [2025-09-26T21:40:33.143695] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-26T21:40:33.153109] [INFO ] [REMOTE ] TKO: Full fetch complete (64641 records). [2025-09-26T21:40:33.153339] [DEBUG] [VALIDATOR ] TKO: Validating primary data. [2025-09-26T21:40:33.518547] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-01. [2025-09-26T21:40:33.568215] [DEBUG] [VALIDATOR ] TKO: All expected trading days are present. [2025-09-26T21:40:33.568400] [DEBUG] [VALIDATOR ] TKO: Primary data validation passed. [2025-09-26T21:40:33.569721] [INFO ] [MAIN ] TKO: Fetched primary data is valid. [2025-09-26T21:40:33.569816] [DEBUG] [LOCAL ] TKO: Saving primary data. [2025-09-26T21:40:33.571333] [DEBUG] [LOCAL ] TKO: Trimmed 64641 records to 44814 (keeping 200 days of data) [2025-09-26T21:40:33.838772] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-26T21:40:33.901122] [DEBUG] [LOCAL ] TKO: Primary data saved (44814 records). [2025-09-26T21:40:33.901309] [INFO ] [MAIN ] TKO: Full history saved. [2025-09-26T21:40:33.901416] [INFO ] [MAIN ] Update Progress: 2101/2371 symbols completed. TKO took 35.3s. Estimated remaining: 36m 3s. Rate: 7.5 symbols/min [2025-09-26T21:40:34.085951] [INFO ] [MAIN ] TM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:40:34.124503] [DEBUG] [LOCAL ] TM: Loaded 36783 existing records from primary storage. [2025-09-26T21:40:34.124697] [INFO ] [MAIN ] TM: Loaded 36783 existing records. [2025-09-26T21:40:34.313583] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-07. [2025-09-26T21:40:34.313787] [WARN ] [MAIN ] TM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:40:34.320257] [INFO ] [MAIN ] TM: Wiping existing primary data before full refresh. [2025-09-26T21:40:34.322420] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-26T21:40:34.321558] [INFO ] [LOCAL ] TM: Starting deletion of primary data. [2025-09-26T21:40:34.325955] [DEBUG] [LOCAL ] TM: Deleted primary data file. [2025-09-26T21:40:34.326029] [INFO ] [MAIN ] TM: Starting full primary refresh. [2025-09-26T21:40:34.705152] [INFO ] [REMOTE ] TM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:40:35.111725] [INFO ] [REMOTE ] TM: Fetching primary data for 2024-12. [2025-09-26T21:40:35.839404] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-26T21:40:35.911717] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-03. [2025-09-26T21:40:36.711735] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-08. [2025-09-26T21:40:36.837117] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-26T21:40:37.511691] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-01. [2025-09-26T21:40:37.550823] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-26T21:40:38.186794] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-26T21:40:38.311714] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-04. [2025-09-26T21:40:39.111704] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-09. [2025-09-26T21:40:39.199603] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-26T21:40:39.618003] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-26T21:40:39.911718] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-02. [2025-09-26T21:40:40.316120] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-26T21:40:40.324994] [INFO ] [REMOTE ] TKR: Full fetch complete (57732 records). [2025-09-26T21:40:40.325157] [DEBUG] [VALIDATOR ] TKR: Validating primary data. [2025-09-26T21:40:40.729082] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-26T21:40:40.723248] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-02. [2025-09-26T21:40:40.748137] [DEBUG] [VALIDATOR ] TKR: All expected trading days are present. [2025-09-26T21:40:40.748267] [DEBUG] [VALIDATOR ] TKR: Primary data validation passed. [2025-09-26T21:40:40.749297] [INFO ] [MAIN ] TKR: Fetched primary data is valid. [2025-09-26T21:40:40.749506] [DEBUG] [LOCAL ] TKR: Saving primary data. [2025-09-26T21:40:40.751060] [DEBUG] [LOCAL ] TKR: Trimmed 57732 records to 40832 (keeping 200 days of data) [2025-09-26T21:40:41.007268] [DEBUG] [LOCAL ] TKR: Primary data saved (40832 records). [2025-09-26T21:40:41.007432] [INFO ] [MAIN ] TKR: Full history saved. [2025-09-26T21:40:41.007535] [INFO ] [MAIN ] Update Progress: 2102/2371 symbols completed. TKR took 27.6s. Estimated remaining: 35m 55s. Rate: 7.5 symbols/min [2025-09-26T21:40:41.194499] [INFO ] [MAIN ] TME: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:40:41.253572] [DEBUG] [LOCAL ] TME: Loaded 53589 existing records from primary storage. [2025-09-26T21:40:41.253830] [INFO ] [MAIN ] TME: Loaded 53589 existing records. [2025-09-26T21:40:41.435859] [WARN ] [MAIN ] TME: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:40:41.436203] [INFO ] [MAIN ] TME: Wiping existing primary data before full refresh. [2025-09-26T21:40:41.436274] [INFO ] [LOCAL ] TME: Starting deletion of primary data. [2025-09-26T21:40:41.437744] [DEBUG] [LOCAL ] TME: Deleted primary data file. [2025-09-26T21:40:41.437821] [INFO ] [MAIN ] TME: Starting full primary refresh. [2025-09-26T21:40:41.516911] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-05. [2025-09-26T21:40:41.810432] [INFO ] [REMOTE ] TME: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:40:42.311699] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-03. [2025-09-26T21:40:42.384748] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-26T21:40:43.116786] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-03. [2025-09-26T21:40:43.129729] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-26T21:40:43.208792] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-26T21:40:43.911731] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-06. [2025-09-26T21:40:44.018224] [DEBUG] [REMOTE ] TLK: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-09-26T21:40:44.018578] [WARN ] [REMOTE ] TLK: No data returned for month 2025-06 [2025-09-26T21:40:44.711688] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-04. [2025-09-26T21:40:44.744087] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-26T21:40:45.511689] [INFO ] [REMOTE ] TME: Fetching primary data for 2024-12. [2025-09-26T21:40:45.639807] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-26T21:40:46.311712] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-04. [2025-09-26T21:40:47.111717] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-07. [2025-09-26T21:40:47.330250] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-26T21:40:47.911745] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-05. [2025-09-26T21:40:48.184731] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-26T21:40:48.590840] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-26T21:40:48.711724] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-01. [2025-09-26T21:40:49.044672] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-26T21:40:49.511714] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-06. [2025-09-26T21:40:50.311740] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-08. [2025-09-26T21:40:50.577775] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-26T21:40:50.606137] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-26T21:40:51.111744] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-02. [2025-09-26T21:40:51.911729] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-07. [2025-09-26T21:40:51.959523] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-26T21:40:52.711713] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-09. [2025-09-26T21:40:52.948762] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-26T21:40:52.973036] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-26T21:40:53.511766] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-08. [2025-09-26T21:40:54.108694] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-26T21:40:54.116475] [INFO ] [REMOTE ] TLK: Full fetch complete (51310 records). [2025-09-26T21:40:54.116694] [DEBUG] [VALIDATOR ] TLK: Validating primary data. [2025-09-26T21:40:54.261835] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-26T21:40:54.316499] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-05. [2025-09-26T21:40:54.344765] [WARN ] [VALIDATOR ] TLK: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-26T21:40:54.345286] [FATAL] [MAIN ] TLK: Fetched primary data is invalid. Refusing to save it. [2025-09-26T21:40:54.345604] [WARN ] [MAIN ] TLK: Deleting existing primary and derivative data due to validation failure. [2025-09-26T21:40:54.345708] [INFO ] [LOCAL ] TLK: Starting deletion of primary data. [2025-09-26T21:40:54.345776] [DEBUG] [LOCAL ] TLK: No primary data file found to delete. [2025-09-26T21:40:54.345814] [INFO ] [LOCAL ] TLK: Starting deletion of derivative data. [2025-09-26T21:40:54.346473] [DEBUG] [LOCAL ] TLK: Deleted derivative data file. [2025-09-26T21:40:54.346585] [INFO ] [MAIN ] Update Progress: 2103/2371 symbols completed. TLK took 28.4s. Estimated remaining: 35m 47s. Rate: 7.5 symbols/min [2025-09-26T21:40:54.523274] [INFO ] [MAIN ] TMHC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:40:54.566504] [DEBUG] [LOCAL ] TMHC: Loaded 45968 existing records from primary storage. [2025-09-26T21:40:54.566710] [INFO ] [MAIN ] TMHC: Loaded 45968 existing records. [2025-09-26T21:40:54.754423] [WARN ] [MAIN ] TMHC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:40:54.754719] [INFO ] [MAIN ] TMHC: Wiping existing primary data before full refresh. [2025-09-26T21:40:54.754778] [INFO ] [LOCAL ] TMHC: Starting deletion of primary data. [2025-09-26T21:40:54.755839] [DEBUG] [LOCAL ] TMHC: Deleted primary data file. [2025-09-26T21:40:54.755903] [INFO ] [MAIN ] TMHC: Starting full primary refresh. [2025-09-26T21:40:55.130302] [INFO ] [REMOTE ] TMHC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:40:55.124482] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-09. [2025-09-26T21:40:55.921495] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2024-12. [2025-09-26T21:40:55.927381] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-26T21:40:56.163557] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-26T21:40:56.166987] [INFO ] [REMOTE ] TLYS: Full fetch complete (21942 records). [2025-09-26T21:40:56.167100] [DEBUG] [VALIDATOR ] TLYS: Validating primary data. [2025-09-26T21:40:56.547001] [DEBUG] [VALIDATOR ] TLYS: All expected trading days are present. [2025-09-26T21:40:56.547099] [DEBUG] [VALIDATOR ] TLYS: Primary data validation passed. [2025-09-26T21:40:56.547680] [INFO ] [MAIN ] TLYS: Fetched primary data is valid. [2025-09-26T21:40:56.547744] [DEBUG] [LOCAL ] TLYS: Saving primary data. [2025-09-26T21:40:56.548442] [DEBUG] [LOCAL ] TLYS: Trimmed 21942 records to 17064 (keeping 200 days of data) [2025-09-26T21:40:56.646210] [DEBUG] [LOCAL ] TLYS: Primary data saved (17064 records). [2025-09-26T21:40:56.646379] [INFO ] [MAIN ] TLYS: Full history saved. [2025-09-26T21:40:56.646494] [INFO ] [MAIN ] Update Progress: 2104/2371 symbols completed. TLYS took 28.8s. Estimated remaining: 35m 39s. Rate: 7.5 symbols/min [2025-09-26T21:40:56.716925] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-06. [2025-09-26T21:40:56.823855] [INFO ] [MAIN ] TMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:40:56.886239] [DEBUG] [LOCAL ] TMO: Loaded 52717 existing records from primary storage. [2025-09-26T21:40:56.886418] [INFO ] [MAIN ] TMO: Loaded 52717 existing records. [2025-09-26T21:40:57.072196] [WARN ] [MAIN ] TMO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:40:57.072438] [INFO ] [MAIN ] TMO: Wiping existing primary data before full refresh. [2025-09-26T21:40:57.072485] [INFO ] [LOCAL ] TMO: Starting deletion of primary data. [2025-09-26T21:40:57.074325] [DEBUG] [LOCAL ] TMO: Deleted primary data file. [2025-09-26T21:40:57.074388] [INFO ] [MAIN ] TMO: Starting full primary refresh. [2025-09-26T21:40:57.447801] [INFO ] [REMOTE ] TMO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:40:57.474294] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-26T21:40:57.511714] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-03. [2025-09-26T21:40:58.311716] [INFO ] [REMOTE ] TMO: Fetching primary data for 2024-12. [2025-09-26T21:40:58.496025] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-26T21:40:59.087011] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-26T21:40:59.111689] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-04. [2025-09-26T21:40:59.797006] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-26T21:40:59.911735] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-01. [2025-09-26T21:41:00.711723] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-01. [2025-09-26T21:41:01.172574] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-26T21:41:01.511773] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-07. [2025-09-26T21:41:01.847755] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-26T21:41:02.305883] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-26T21:41:02.314808] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-05. [2025-09-26T21:41:03.111752] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-02. [2025-09-26T21:41:03.243931] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-26T21:41:03.911734] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-08. [2025-09-26T21:41:04.552582] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-26T21:41:04.711708] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-06. [2025-09-26T21:41:04.925812] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-26T21:41:05.452948] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-26T21:41:05.511750] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-09. [2025-09-26T21:41:06.311796] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-02. [2025-09-26T21:41:06.346265] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-26T21:41:06.977946] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-26T21:41:06.984242] [INFO ] [REMOTE ] TM: Full fetch complete (52897 records). [2025-09-26T21:41:06.984447] [DEBUG] [VALIDATOR ] TM: Validating primary data. [2025-09-26T21:41:07.116921] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-03. [2025-09-26T21:41:07.399586] [DEBUG] [VALIDATOR ] TM: All expected trading days are present. [2025-09-26T21:41:07.399747] [DEBUG] [VALIDATOR ] TM: Primary data validation passed. [2025-09-26T21:41:07.400796] [INFO ] [MAIN ] TM: Fetched primary data is valid. [2025-09-26T21:41:07.400873] [DEBUG] [LOCAL ] TM: Saving primary data. [2025-09-26T21:41:07.402267] [DEBUG] [LOCAL ] TM: Trimmed 52897 records to 36992 (keeping 200 days of data) [2025-09-26T21:41:07.660020] [DEBUG] [LOCAL ] TM: Primary data saved (36992 records). [2025-09-26T21:41:07.660184] [INFO ] [MAIN ] TM: Full history saved. [2025-09-26T21:41:07.660291] [INFO ] [MAIN ] Update Progress: 2105/2371 symbols completed. TM took 33.8s. Estimated remaining: 35m 31s. Rate: 7.5 symbols/min [2025-09-26T21:41:07.852421] [INFO ] [MAIN ] TNC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:41:07.870605] [DEBUG] [LOCAL ] TNC: Loaded 15213 existing records from primary storage. [2025-09-26T21:41:07.870820] [INFO ] [MAIN ] TNC: Loaded 15213 existing records. [2025-09-26T21:41:07.916630] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-07. [2025-09-26T21:41:08.098549] [WARN ] [MAIN ] TNC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:41:08.100839] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-26T21:41:08.110572] [INFO ] [MAIN ] TNC: Wiping existing primary data before full refresh. [2025-09-26T21:41:08.111001] [INFO ] [LOCAL ] TNC: Starting deletion of primary data. [2025-09-26T21:41:08.111552] [DEBUG] [LOCAL ] TNC: Deleted primary data file. [2025-09-26T21:41:08.111614] [INFO ] [MAIN ] TNC: Starting full primary refresh. [2025-09-26T21:41:08.482754] [INFO ] [REMOTE ] TNC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:41:08.711760] [INFO ] [REMOTE ] TNC: Fetching primary data for 2024-12. [2025-09-26T21:41:09.173976] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-26T21:41:09.511718] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-04. [2025-09-26T21:41:09.819277] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-26T21:41:10.098879] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-26T21:41:10.311731] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-01. [2025-09-26T21:41:11.111706] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-03. [2025-09-26T21:41:11.300874] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-26T21:41:11.514029] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-26T21:41:11.911736] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-08. [2025-09-26T21:41:12.711703] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-02. [2025-09-26T21:41:12.808587] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-26T21:41:13.511767] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-04. [2025-09-26T21:41:13.828835] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-26T21:41:14.006385] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-26T21:41:14.311727] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-05. [2025-09-26T21:41:14.842639] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-26T21:41:15.111767] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-05. [2025-09-26T21:41:15.911682] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-09. [2025-09-26T21:41:16.542595] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-26T21:41:16.666176] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-26T21:41:16.711698] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-06. [2025-09-26T21:41:17.511728] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-06. [2025-09-26T21:41:17.828061] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-26T21:41:17.839336] [INFO ] [REMOTE ] TME: Full fetch complete (76933 records). [2025-09-26T21:41:17.839508] [DEBUG] [VALIDATOR ] TME: Validating primary data. [2025-09-26T21:41:18.314624] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-03. [2025-09-26T21:41:18.315274] [DEBUG] [VALIDATOR ] TME: All expected trading days are present. [2025-09-26T21:41:18.316754] [DEBUG] [VALIDATOR ] TME: Primary data validation passed. [2025-09-26T21:41:18.318960] [INFO ] [MAIN ] TME: Fetched primary data is valid. [2025-09-26T21:41:18.319166] [DEBUG] [LOCAL ] TME: Saving primary data. [2025-09-26T21:41:18.321721] [DEBUG] [LOCAL ] TME: Trimmed 76933 records to 53979 (keeping 200 days of data) [2025-09-26T21:41:18.697231] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-26T21:41:18.715843] [DEBUG] [LOCAL ] TME: Primary data saved (53979 records). [2025-09-26T21:41:18.716154] [INFO ] [MAIN ] TME: Full history saved. [2025-09-26T21:41:18.716467] [INFO ] [MAIN ] Update Progress: 2106/2371 symbols completed. TME took 37.7s. Estimated remaining: 35m 23s. Rate: 7.5 symbols/min [2025-09-26T21:41:18.929376] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-26T21:41:18.933957] [INFO ] [MAIN ] TNET: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:41:18.974440] [DEBUG] [LOCAL ] TNET: Loaded 29060 existing records from primary storage. [2025-09-26T21:41:18.974587] [INFO ] [MAIN ] TNET: Loaded 29060 existing records. [2025-09-26T21:41:19.129029] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-07. [2025-09-26T21:41:19.174491] [WARN ] [MAIN ] TNET: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:41:19.175273] [INFO ] [MAIN ] TNET: Wiping existing primary data before full refresh. [2025-09-26T21:41:19.175396] [INFO ] [LOCAL ] TNET: Starting deletion of primary data. [2025-09-26T21:41:19.181466] [DEBUG] [LOCAL ] TNET: Deleted primary data file. [2025-09-26T21:41:19.188509] [INFO ] [MAIN ] TNET: Starting full primary refresh. [2025-09-26T21:41:19.195272] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-26T21:41:19.555717] [INFO ] [REMOTE ] TNET: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:41:19.911756] [INFO ] [REMOTE ] TNET: Fetching primary data for 2024-12. [2025-09-26T21:41:20.711694] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-07. [2025-09-26T21:41:20.884292] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-26T21:41:21.201951] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-26T21:41:21.511730] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-01. [2025-09-26T21:41:22.311733] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-04. [2025-09-26T21:41:22.624821] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-26T21:41:22.843580] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-26T21:41:23.111727] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-08. [2025-09-26T21:41:23.403247] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-26T21:41:23.911730] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-08. [2025-09-26T21:41:24.711758] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-02. [2025-09-26T21:41:25.141725] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-26T21:41:25.511773] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-05. [2025-09-26T21:41:25.582127] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-26T21:41:26.232447] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-26T21:41:26.311713] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-03. [2025-09-26T21:41:26.502844] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-26T21:41:27.111733] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-06. [2025-09-26T21:41:27.471128] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-26T21:41:27.911755] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-09. [2025-09-26T21:41:28.056759] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-26T21:41:28.695768] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-26T21:41:28.706613] [INFO ] [REMOTE ] TMO: Full fetch complete (75472 records). [2025-09-26T21:41:28.706822] [DEBUG] [VALIDATOR ] TMO: Validating primary data. [2025-09-26T21:41:28.718702] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-07. [2025-09-26T21:41:29.125784] [DEBUG] [VALIDATOR ] TMO: All expected trading days are present. [2025-09-26T21:41:29.125938] [DEBUG] [VALIDATOR ] TMO: Primary data validation passed. [2025-09-26T21:41:29.127053] [INFO ] [MAIN ] TMO: Fetched primary data is valid. [2025-09-26T21:41:29.127122] [DEBUG] [LOCAL ] TMO: Saving primary data. [2025-09-26T21:41:29.128854] [DEBUG] [LOCAL ] TMO: Trimmed 75472 records to 53089 (keeping 200 days of data) [2025-09-26T21:41:29.502752] [DEBUG] [LOCAL ] TMO: Primary data saved (53089 records). [2025-09-26T21:41:29.502935] [INFO ] [MAIN ] TMO: Full history saved. [2025-09-26T21:41:29.503032] [INFO ] [MAIN ] Update Progress: 2107/2371 symbols completed. TMO took 32.9s. Estimated remaining: 35m 16s. Rate: 7.5 symbols/min [2025-09-26T21:41:29.517042] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-04. [2025-09-26T21:41:29.697995] [INFO ] [MAIN ] TNGY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:41:29.698334] [DEBUG] [LOCAL ] TNGY: No existing data file found in primary storage. [2025-09-26T21:41:29.698395] [WARN ] [MAIN ] TNGY: No existing data found, performing full refresh instead. [2025-09-26T21:41:29.698551] [INFO ] [MAIN ] TNGY: Wiping existing primary data before full refresh. [2025-09-26T21:41:29.698596] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-09-26T21:41:29.698637] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-09-26T21:41:29.698721] [INFO ] [MAIN ] TNGY: Starting full primary refresh. [2025-09-26T21:41:29.870973] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-26T21:41:30.103015] [INFO ] [REMOTE ] TNGY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:41:30.311747] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2024-12. [2025-09-26T21:41:30.627306] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:41:30.627754] [WARN ] [REMOTE ] TNGY: No data returned for month 2024-12 [2025-09-26T21:41:31.069537] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-26T21:41:31.111721] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-05. [2025-09-26T21:41:31.911721] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-08. [2025-09-26T21:41:32.401272] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-26T21:41:32.528024] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-26T21:41:32.711729] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-06. [2025-09-26T21:41:33.511704] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-01. [2025-09-26T21:41:33.810273] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:41:33.810665] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-01 [2025-09-26T21:41:33.833042] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-26T21:41:34.311727] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-09. [2025-09-26T21:41:35.111733] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-02. [2025-09-26T21:41:35.324241] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:41:35.324586] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-02 [2025-09-26T21:41:35.911711] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-09. [2025-09-26T21:41:35.991112] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-26T21:41:36.000369] [INFO ] [REMOTE ] TMHC: Full fetch complete (65965 records). [2025-09-26T21:41:36.000509] [DEBUG] [VALIDATOR ] TMHC: Validating primary data. [2025-09-26T21:41:36.418801] [DEBUG] [VALIDATOR ] TMHC: All expected trading days are present. [2025-09-26T21:41:36.418901] [DEBUG] [VALIDATOR ] TMHC: Primary data validation passed. [2025-09-26T21:41:36.419979] [INFO ] [MAIN ] TMHC: Fetched primary data is valid. [2025-09-26T21:41:36.420048] [DEBUG] [LOCAL ] TMHC: Saving primary data. [2025-09-26T21:41:36.421569] [DEBUG] [LOCAL ] TMHC: Trimmed 65965 records to 46274 (keeping 200 days of data) [2025-09-26T21:41:36.719598] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-07. [2025-09-26T21:41:36.747376] [DEBUG] [LOCAL ] TMHC: Primary data saved (46274 records). [2025-09-26T21:41:36.747568] [INFO ] [MAIN ] TMHC: Full history saved. [2025-09-26T21:41:36.747710] [INFO ] [MAIN ] Update Progress: 2108/2371 symbols completed. TMHC took 42.4s. Estimated remaining: 35m 8s. Rate: 7.5 symbols/min [2025-09-26T21:41:36.896795] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-26T21:41:36.929519] [INFO ] [REMOTE ] TNC: Full fetch complete (23148 records). [2025-09-26T21:41:36.930439] [DEBUG] [VALIDATOR ] TNC: Validating primary data. [2025-09-26T21:41:37.002522] [INFO ] [MAIN ] TNK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:41:37.343352] [DEBUG] [LOCAL ] TNK: Loaded 35468 existing records from primary storage. [2025-09-26T21:41:37.371552] [INFO ] [MAIN ] TNK: Loaded 35468 existing records. [2025-09-26T21:41:37.403880] [DEBUG] [VALIDATOR ] TNC: All expected trading days are present. [2025-09-26T21:41:37.421727] [DEBUG] [VALIDATOR ] TNC: Primary data validation passed. [2025-09-26T21:41:37.459784] [INFO ] [MAIN ] TNC: Fetched primary data is valid. [2025-09-26T21:41:37.485693] [DEBUG] [LOCAL ] TNC: Saving primary data. [2025-09-26T21:41:37.513906] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-03. [2025-09-26T21:41:37.508496] [DEBUG] [LOCAL ] TNC: Trimmed 23148 records to 15334 (keeping 200 days of data) [2025-09-26T21:41:37.593107] [WARN ] [MAIN ] TNK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:41:37.594028] [INFO ] [MAIN ] TNK: Wiping existing primary data before full refresh. [2025-09-26T21:41:37.594138] [INFO ] [LOCAL ] TNK: Starting deletion of primary data. [2025-09-26T21:41:37.595524] [DEBUG] [LOCAL ] TNK: Deleted primary data file. [2025-09-26T21:41:37.595622] [INFO ] [MAIN ] TNK: Starting full primary refresh. [2025-09-26T21:41:37.843812] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:41:37.888880] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-03 [2025-09-26T21:41:38.092405] [INFO ] [REMOTE ] TNK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:41:38.126732] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-26T21:41:38.141720] [DEBUG] [LOCAL ] TNC: Primary data saved (15334 records). [2025-09-26T21:41:38.142231] [INFO ] [MAIN ] TNC: Full history saved. [2025-09-26T21:41:38.142386] [INFO ] [MAIN ] Update Progress: 2109/2371 symbols completed. TNC took 30.5s. Estimated remaining: 34m 59s. Rate: 7.5 symbols/min [2025-09-26T21:41:38.314914] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-04. [2025-09-26T21:41:38.344685] [INFO ] [MAIN ] TNL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:41:38.389998] [DEBUG] [LOCAL ] TNL: Loaded 42237 existing records from primary storage. [2025-09-26T21:41:38.390161] [INFO ] [MAIN ] TNL: Loaded 42237 existing records. [2025-09-26T21:41:38.557015] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:41:38.572739] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-04 [2025-09-26T21:41:38.595321] [WARN ] [MAIN ] TNL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:41:38.595568] [INFO ] [MAIN ] TNL: Wiping existing primary data before full refresh. [2025-09-26T21:41:38.595618] [INFO ] [LOCAL ] TNL: Starting deletion of primary data. [2025-09-26T21:41:38.596826] [DEBUG] [LOCAL ] TNL: Deleted primary data file. [2025-09-26T21:41:38.596889] [INFO ] [MAIN ] TNL: Starting full primary refresh. [2025-09-26T21:41:39.011088] [INFO ] [REMOTE ] TNL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:41:39.111750] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-05. [2025-09-26T21:41:39.332833] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:41:39.333293] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-05 [2025-09-26T21:41:39.911720] [INFO ] [REMOTE ] TNK: Fetching primary data for 2024-12. [2025-09-26T21:41:40.711770] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-06. [2025-09-26T21:41:41.252016] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-26T21:41:41.311375] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T21:41:41.511693] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-01. [2025-09-26T21:41:42.311717] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-07. [2025-09-26T21:41:42.972743] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-26T21:41:42.989039] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-26T21:41:43.111868] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-08. [2025-09-26T21:41:43.911713] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-08. [2025-09-26T21:41:44.415201] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-26T21:41:44.607037] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-26T21:41:44.711741] [INFO ] [REMOTE ] TNL: Fetching primary data for 2024-12. [2025-09-26T21:41:45.511719] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-09. [2025-09-26T21:41:46.122629] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-26T21:41:46.311731] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-09. [2025-09-26T21:41:46.705601] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-26T21:41:46.714376] [INFO ] [REMOTE ] TNET: Full fetch complete (41707 records). [2025-09-26T21:41:46.714555] [DEBUG] [VALIDATOR ] TNET: Validating primary data. [2025-09-26T21:41:46.850845] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-26T21:41:46.889310] [INFO ] [REMOTE ] TNGY: Full fetch complete (3379 records). [2025-09-26T21:41:46.900687] [DEBUG] [VALIDATOR ] TNGY: Validating primary data. [2025-09-26T21:41:47.112888] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-01. [2025-09-26T21:41:47.285684] [WARN ] [VALIDATOR ] TNGY: Validation failed - insufficient historical data. Have 72 unique days, need 200 days [2025-09-26T21:41:47.326394] [FATAL] [MAIN ] TNGY: Fetched primary data is invalid. Refusing to save it. [2025-09-26T21:41:47.350800] [WARN ] [MAIN ] TNGY: Deleting existing primary and derivative data due to validation failure. [2025-09-26T21:41:47.350948] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-09-26T21:41:47.351071] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-09-26T21:41:47.351151] [INFO ] [LOCAL ] TNGY: Starting deletion of derivative data. [2025-09-26T21:41:47.351248] [DEBUG] [LOCAL ] TNGY: No derivative data file found to delete. [2025-09-26T21:41:47.351435] [INFO ] [MAIN ] Update Progress: 2110/2371 symbols completed. TNGY took 17.8s. Estimated remaining: 34m 51s. Rate: 7.5 symbols/min [2025-09-26T21:41:47.363677] [DEBUG] [VALIDATOR ] TNET: All expected trading days are present. [2025-09-26T21:41:47.364121] [DEBUG] [VALIDATOR ] TNET: Primary data validation passed. [2025-09-26T21:41:47.365297] [INFO ] [MAIN ] TNET: Fetched primary data is valid. [2025-09-26T21:41:47.365381] [DEBUG] [LOCAL ] TNET: Saving primary data. [2025-09-26T21:41:47.485897] [DEBUG] [LOCAL ] TNET: Trimmed 41707 records to 29247 (keeping 200 days of data) [2025-09-26T21:41:47.682022] [INFO ] [MAIN ] TOL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:41:47.789003] [DEBUG] [LOCAL ] TNET: Primary data saved (29247 records). [2025-09-26T21:41:47.789299] [INFO ] [MAIN ] TNET: Full history saved. [2025-09-26T21:41:47.789430] [INFO ] [MAIN ] Update Progress: 2111/2371 symbols completed. TNET took 29.1s. Estimated remaining: 34m 42s. Rate: 7.5 symbols/min [2025-09-26T21:41:47.918550] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-02. [2025-09-26T21:41:47.986317] [DEBUG] [LOCAL ] TOL: Loaded 51422 existing records from primary storage. [2025-09-26T21:41:47.993730] [INFO ] [MAIN ] TOL: Loaded 51422 existing records. [2025-09-26T21:41:48.050499] [INFO ] [MAIN ] TOST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:41:48.242211] [WARN ] [MAIN ] TOL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:41:48.242917] [INFO ] [MAIN ] TOL: Wiping existing primary data before full refresh. [2025-09-26T21:41:48.242985] [INFO ] [LOCAL ] TOL: Starting deletion of primary data. [2025-09-26T21:41:48.258437] [DEBUG] [LOCAL ] TOL: Deleted primary data file. [2025-09-26T21:41:48.258589] [INFO ] [MAIN ] TOL: Starting full primary refresh. [2025-09-26T21:41:48.461851] [DEBUG] [LOCAL ] TOST: Loaded 54071 existing records from primary storage. [2025-09-26T21:41:48.479775] [INFO ] [MAIN ] TOST: Loaded 54071 existing records. [2025-09-26T21:41:48.875884] [WARN ] [MAIN ] TOST: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:41:48.898613] [INFO ] [REMOTE ] TOL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:41:48.899065] [INFO ] [MAIN ] TOST: Wiping existing primary data before full refresh. [2025-09-26T21:41:48.899683] [INFO ] [REMOTE ] TOL: Fetching primary data for 2024-12. [2025-09-26T21:41:48.899372] [INFO ] [LOCAL ] TOST: Starting deletion of primary data. [2025-09-26T21:41:48.909319] [DEBUG] [LOCAL ] TOST: Deleted primary data file. [2025-09-26T21:41:48.919889] [INFO ] [MAIN ] TOST: Starting full primary refresh. [2025-09-26T21:41:48.968715] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-26T21:41:49.329513] [INFO ] [REMOTE ] TOST: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:41:49.410997] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-26T21:41:49.511714] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-03. [2025-09-26T21:41:50.311755] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-02. [2025-09-26T21:41:50.644178] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-26T21:41:50.891469] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-26T21:41:51.111718] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-04. [2025-09-26T21:41:51.784379] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-26T21:41:51.911735] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-03. [2025-09-26T21:41:52.243091] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-26T21:41:52.711721] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-05. [2025-09-26T21:41:53.511692] [INFO ] [REMOTE ] TOST: Fetching primary data for 2024-12. [2025-09-26T21:41:53.537876] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-26T21:41:54.194595] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-26T21:41:54.311734] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-06. [2025-09-26T21:41:55.111703] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-04. [2025-09-26T21:41:55.552733] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-26T21:41:55.625166] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-26T21:41:55.911719] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-01. [2025-09-26T21:41:56.721797] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-01. [2025-09-26T21:41:56.750106] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-26T21:41:57.511700] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-07. [2025-09-26T21:41:57.804854] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-26T21:41:58.311738] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-02. [2025-09-26T21:41:58.573401] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-26T21:41:58.711407] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-26T21:41:59.111776] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-02. [2025-09-26T21:41:59.911731] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-08. [2025-09-26T21:42:00.064821] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-26T21:42:00.711726] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-03. [2025-09-26T21:42:00.876803] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-26T21:42:01.356968] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-26T21:42:01.511742] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-03. [2025-09-26T21:42:02.311716] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-05. [2025-09-26T21:42:02.746972] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-26T21:42:03.111703] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-04. [2025-09-26T21:42:03.522297] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-26T21:42:03.562736] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-26T21:42:03.911729] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-09. [2025-09-26T21:42:04.716840] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-06. [2025-09-26T21:42:04.737684] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-26T21:42:05.327959] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-26T21:42:05.335231] [INFO ] [REMOTE ] TNK: Full fetch complete (51819 records). [2025-09-26T21:42:05.335358] [DEBUG] [VALIDATOR ] TNK: Validating primary data. [2025-09-26T21:42:05.519735] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-05. [2025-09-26T21:42:05.748735] [DEBUG] [VALIDATOR ] TNK: All expected trading days are present. [2025-09-26T21:42:05.748836] [DEBUG] [VALIDATOR ] TNK: Primary data validation passed. [2025-09-26T21:42:05.749816] [INFO ] [MAIN ] TNK: Fetched primary data is valid. [2025-09-26T21:42:05.749886] [DEBUG] [LOCAL ] TNK: Saving primary data. [2025-09-26T21:42:05.751208] [DEBUG] [LOCAL ] TNK: Trimmed 51819 records to 35701 (keeping 200 days of data) [2025-09-26T21:42:05.977666] [DEBUG] [LOCAL ] TNK: Primary data saved (35701 records). [2025-09-26T21:42:05.977825] [INFO ] [MAIN ] TNK: Full history saved. [2025-09-26T21:42:05.977917] [INFO ] [MAIN ] Update Progress: 2112/2371 symbols completed. TNK took 29.2s. Estimated remaining: 34m 35s. Rate: 7.5 symbols/min [2025-09-26T21:42:06.166805] [INFO ] [MAIN ] TPB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:42:06.192913] [DEBUG] [LOCAL ] TPB: Loaded 25164 existing records from primary storage. [2025-09-26T21:42:06.193123] [INFO ] [MAIN ] TPB: Loaded 25164 existing records. [2025-09-26T21:42:06.315971] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-04. [2025-09-26T21:42:06.403735] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-26T21:42:06.409686] [WARN ] [MAIN ] TPB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:42:06.418190] [INFO ] [MAIN ] TPB: Wiping existing primary data before full refresh. [2025-09-26T21:42:06.418255] [INFO ] [LOCAL ] TPB: Starting deletion of primary data. [2025-09-26T21:42:06.419239] [DEBUG] [LOCAL ] TPB: Deleted primary data file. [2025-09-26T21:42:06.419307] [INFO ] [MAIN ] TPB: Starting full primary refresh. [2025-09-26T21:42:06.825855] [INFO ] [REMOTE ] TPB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:42:07.111761] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-07. [2025-09-26T21:42:07.911724] [INFO ] [REMOTE ] TPB: Fetching primary data for 2024-12. [2025-09-26T21:42:08.157565] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-09-26T21:42:08.272170] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-26T21:42:08.711712] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-05. [2025-09-26T21:42:09.109371] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-26T21:42:09.170402] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-26T21:42:09.511758] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-01. [2025-09-26T21:42:10.311727] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-06. [2025-09-26T21:42:10.704582] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-26T21:42:10.769559] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-26T21:42:11.111750] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-02. [2025-09-26T21:42:11.911690] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-06. [2025-09-26T21:42:12.163868] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-26T21:42:12.296436] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-26T21:42:12.711724] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-03. [2025-09-26T21:42:13.511700] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-07. [2025-09-26T21:42:13.873551] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-26T21:42:13.931005] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-26T21:42:14.311747] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-07. [2025-09-26T21:42:15.111694] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-04. [2025-09-26T21:42:15.172732] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-26T21:42:15.911716] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-08. [2025-09-26T21:42:16.247371] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-26T21:42:16.450024] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-26T21:42:16.711727] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-08. [2025-09-26T21:42:17.487889] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-26T21:42:17.511677] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-09. [2025-09-26T21:42:18.311750] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-08. [2025-09-26T21:42:18.876438] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-26T21:42:18.981744] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-26T21:42:18.990307] [INFO ] [REMOTE ] TNL: Full fetch complete (58777 records). [2025-09-26T21:42:18.990479] [DEBUG] [VALIDATOR ] TNL: Validating primary data. [2025-09-26T21:42:19.116858] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-09. [2025-09-26T21:42:19.410246] [DEBUG] [VALIDATOR ] TNL: All expected trading days are present. [2025-09-26T21:42:19.410406] [DEBUG] [VALIDATOR ] TNL: Primary data validation passed. [2025-09-26T21:42:19.411455] [INFO ] [MAIN ] TNL: Fetched primary data is valid. [2025-09-26T21:42:19.411523] [DEBUG] [LOCAL ] TNL: Saving primary data. [2025-09-26T21:42:19.414096] [DEBUG] [LOCAL ] TNL: Trimmed 58777 records to 42474 (keeping 200 days of data) [2025-09-26T21:42:19.693493] [DEBUG] [LOCAL ] TNL: Primary data saved (42474 records). [2025-09-26T21:42:19.693699] [INFO ] [MAIN ] TNL: Full history saved. [2025-09-26T21:42:19.693892] [INFO ] [MAIN ] Update Progress: 2113/2371 symbols completed. TNL took 41.6s. Estimated remaining: 34m 28s. Rate: 7.5 symbols/min [2025-09-26T21:42:19.885609] [INFO ] [MAIN ] TPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:42:19.911722] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-05. [2025-09-26T21:42:19.930929] [DEBUG] [LOCAL ] TPC: Loaded 39083 existing records from primary storage. [2025-09-26T21:42:19.931110] [INFO ] [MAIN ] TPC: Loaded 39083 existing records. [2025-09-26T21:42:20.132009] [WARN ] [MAIN ] TPC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:42:20.132427] [INFO ] [MAIN ] TPC: Wiping existing primary data before full refresh. [2025-09-26T21:42:20.132486] [INFO ] [LOCAL ] TPC: Starting deletion of primary data. [2025-09-26T21:42:20.133399] [DEBUG] [LOCAL ] TPC: Deleted primary data file. [2025-09-26T21:42:20.133460] [INFO ] [MAIN ] TPC: Starting full primary refresh. [2025-09-26T21:42:20.561901] [INFO ] [REMOTE ] TPC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:42:20.564403] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-26T21:42:20.711693] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-09. [2025-09-26T21:42:21.032268] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-26T21:42:21.157747] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-26T21:42:21.168524] [INFO ] [REMOTE ] TOST: Full fetch complete (77698 records). [2025-09-26T21:42:21.168738] [DEBUG] [VALIDATOR ] TOST: Validating primary data. [2025-09-26T21:42:21.520243] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-06. [2025-09-26T21:42:21.582037] [DEBUG] [VALIDATOR ] TOST: All expected trading days are present. [2025-09-26T21:42:21.582258] [DEBUG] [VALIDATOR ] TOST: Primary data validation passed. [2025-09-26T21:42:21.583465] [INFO ] [MAIN ] TOST: Fetched primary data is valid. [2025-09-26T21:42:21.583535] [DEBUG] [LOCAL ] TOST: Saving primary data. [2025-09-26T21:42:21.585539] [DEBUG] [LOCAL ] TOST: Trimmed 77698 records to 54461 (keeping 200 days of data) [2025-09-26T21:42:21.928244] [DEBUG] [LOCAL ] TOST: Primary data saved (54461 records). [2025-09-26T21:42:21.928466] [INFO ] [MAIN ] TOST: Full history saved. [2025-09-26T21:42:21.928681] [INFO ] [MAIN ] Update Progress: 2114/2371 symbols completed. TOST took 34.1s. Estimated remaining: 34m 19s. Rate: 7.5 symbols/min [2025-09-26T21:42:22.120245] [INFO ] [MAIN ] TPH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:42:22.164797] [DEBUG] [LOCAL ] TPH: Loaded 45521 existing records from primary storage. [2025-09-26T21:42:22.164971] [INFO ] [MAIN ] TPH: Loaded 45521 existing records. [2025-09-26T21:42:22.314057] [INFO ] [REMOTE ] TPC: Fetching primary data for 2024-12. [2025-09-26T21:42:22.359584] [WARN ] [MAIN ] TPH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:42:22.361052] [INFO ] [MAIN ] TPH: Wiping existing primary data before full refresh. [2025-09-26T21:42:22.361162] [INFO ] [LOCAL ] TPH: Starting deletion of primary data. [2025-09-26T21:42:22.362355] [DEBUG] [LOCAL ] TPH: Deleted primary data file. [2025-09-26T21:42:22.362426] [INFO ] [MAIN ] TPH: Starting full primary refresh. [2025-09-26T21:42:22.842744] [INFO ] [REMOTE ] TPH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:42:22.874162] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-26T21:42:22.902098] [INFO ] [REMOTE ] TOL: Full fetch complete (73950 records). [2025-09-26T21:42:22.902870] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-26T21:42:22.903153] [DEBUG] [VALIDATOR ] TOL: Validating primary data. [2025-09-26T21:42:23.123742] [INFO ] [REMOTE ] TPH: Fetching primary data for 2024-12. [2025-09-26T21:42:23.351845] [DEBUG] [VALIDATOR ] TOL: All expected trading days are present. [2025-09-26T21:42:23.351950] [DEBUG] [VALIDATOR ] TOL: Primary data validation passed. [2025-09-26T21:42:23.353092] [INFO ] [MAIN ] TOL: Fetched primary data is valid. [2025-09-26T21:42:23.353163] [DEBUG] [LOCAL ] TOL: Saving primary data. [2025-09-26T21:42:23.354813] [DEBUG] [LOCAL ] TOL: Trimmed 73950 records to 51738 (keeping 200 days of data) [2025-09-26T21:42:23.722127] [DEBUG] [LOCAL ] TOL: Primary data saved (51738 records). [2025-09-26T21:42:23.722285] [INFO ] [MAIN ] TOL: Full history saved. [2025-09-26T21:42:23.722424] [INFO ] [MAIN ] Update Progress: 2115/2371 symbols completed. TOL took 36.4s. Estimated remaining: 34m 10s. Rate: 7.5 symbols/min [2025-09-26T21:42:23.932013] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-07. [2025-09-26T21:42:23.931926] [INFO ] [MAIN ] TPL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:42:23.942146] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-26T21:42:23.965590] [DEBUG] [LOCAL ] TPL: Loaded 12456 existing records from primary storage. [2025-09-26T21:42:23.965759] [INFO ] [MAIN ] TPL: Loaded 12456 existing records. [2025-09-26T21:42:24.157287] [WARN ] [MAIN ] TPL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:42:24.157548] [INFO ] [MAIN ] TPL: Wiping existing primary data before full refresh. [2025-09-26T21:42:24.157599] [INFO ] [LOCAL ] TPL: Starting deletion of primary data. [2025-09-26T21:42:24.158075] [DEBUG] [LOCAL ] TPL: Deleted primary data file. [2025-09-26T21:42:24.158136] [INFO ] [MAIN ] TPL: Starting full primary refresh. [2025-09-26T21:42:24.545912] [INFO ] [REMOTE ] TPL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:42:24.711701] [INFO ] [REMOTE ] TPL: Fetching primary data for 2024-12. [2025-09-26T21:42:24.932628] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-26T21:42:25.004025] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-26T21:42:25.511689] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-01. [2025-09-26T21:42:25.893866] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-26T21:42:26.311760] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-01. [2025-09-26T21:42:26.640045] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-26T21:42:27.111714] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-01. [2025-09-26T21:42:27.334417] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-26T21:42:27.911713] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-02. [2025-09-26T21:42:28.455598] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-26T21:42:28.711744] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-08. [2025-09-26T21:42:28.779416] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-26T21:42:29.511751] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-03. [2025-09-26T21:42:29.741449] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-26T21:42:30.311733] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-02. [2025-09-26T21:42:30.517263] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-26T21:42:31.111728] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-04. [2025-09-26T21:42:31.671976] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-26T21:42:31.911747] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-09. [2025-09-26T21:42:32.155452] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-26T21:42:32.711736] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-02. [2025-09-26T21:42:33.165987] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-26T21:42:33.172261] [INFO ] [REMOTE ] TPB: Full fetch complete (34816 records). [2025-09-26T21:42:33.172394] [DEBUG] [VALIDATOR ] TPB: Validating primary data. [2025-09-26T21:42:33.520754] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-05. [2025-09-26T21:42:33.624903] [DEBUG] [VALIDATOR ] TPB: All expected trading days are present. [2025-09-26T21:42:33.624993] [DEBUG] [VALIDATOR ] TPB: Primary data validation passed. [2025-09-26T21:42:33.625820] [INFO ] [MAIN ] TPB: Fetched primary data is valid. [2025-09-26T21:42:33.625886] [DEBUG] [LOCAL ] TPB: Saving primary data. [2025-09-26T21:42:33.626925] [DEBUG] [LOCAL ] TPB: Trimmed 34816 records to 25409 (keeping 200 days of data) [2025-09-26T21:42:33.794704] [DEBUG] [LOCAL ] TPB: Primary data saved (25409 records). [2025-09-26T21:42:33.794846] [INFO ] [MAIN ] TPB: Full history saved. [2025-09-26T21:42:33.794938] [INFO ] [MAIN ] Update Progress: 2116/2371 symbols completed. TPB took 27.8s. Estimated remaining: 34m 3s. Rate: 7.5 symbols/min [2025-09-26T21:42:33.980494] [INFO ] [MAIN ] TPR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:42:34.036199] [DEBUG] [LOCAL ] TPR: Loaded 53866 existing records from primary storage. [2025-09-26T21:42:34.036375] [INFO ] [MAIN ] TPR: Loaded 53866 existing records. [2025-09-26T21:42:34.237330] [WARN ] [MAIN ] TPR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:42:34.256536] [INFO ] [MAIN ] TPR: Wiping existing primary data before full refresh. [2025-09-26T21:42:34.256784] [INFO ] [LOCAL ] TPR: Starting deletion of primary data. [2025-09-26T21:42:34.258149] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-26T21:42:34.264700] [DEBUG] [LOCAL ] TPR: Deleted primary data file. [2025-09-26T21:42:34.265356] [INFO ] [MAIN ] TPR: Starting full primary refresh. [2025-09-26T21:42:34.312770] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-03. [2025-09-26T21:42:34.631218] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-26T21:42:34.668449] [INFO ] [REMOTE ] TPR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:42:35.111752] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-06. [2025-09-26T21:42:35.911739] [INFO ] [REMOTE ] TPR: Fetching primary data for 2024-12. [2025-09-26T21:42:35.991052] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-26T21:42:36.247175] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-26T21:42:36.711730] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-03. [2025-09-26T21:42:37.511749] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-07. [2025-09-26T21:42:37.824093] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-26T21:42:38.162522] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-26T21:42:38.189800] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-26T21:42:38.311732] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-04. [2025-09-26T21:42:39.111749] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-08. [2025-09-26T21:42:39.852295] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-26T21:42:39.911705] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-04. [2025-09-26T21:42:40.104273] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-26T21:42:40.711731] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-09. [2025-09-26T21:42:41.511733] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-05. [2025-09-26T21:42:41.666048] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-26T21:42:41.709349] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-26T21:42:41.712118] [INFO ] [REMOTE ] TPL: Full fetch complete (18097 records). [2025-09-26T21:42:41.712204] [DEBUG] [VALIDATOR ] TPL: Validating primary data. [2025-09-26T21:42:42.149017] [DEBUG] [VALIDATOR ] TPL: All expected trading days are present. [2025-09-26T21:42:42.149130] [DEBUG] [VALIDATOR ] TPL: Primary data validation passed. [2025-09-26T21:42:42.149592] [INFO ] [MAIN ] TPL: Fetched primary data is valid. [2025-09-26T21:42:42.149704] [DEBUG] [LOCAL ] TPL: Saving primary data. [2025-09-26T21:42:42.150402] [DEBUG] [LOCAL ] TPL: Trimmed 18097 records to 12533 (keeping 200 days of data) [2025-09-26T21:42:42.232107] [DEBUG] [LOCAL ] TPL: Primary data saved (12533 records). [2025-09-26T21:42:42.232255] [INFO ] [MAIN ] TPL: Full history saved. [2025-09-26T21:42:42.232415] [INFO ] [MAIN ] Update Progress: 2117/2371 symbols completed. TPL took 18.5s. Estimated remaining: 33m 55s. Rate: 7.5 symbols/min [2025-09-26T21:42:42.311717] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-05. [2025-09-26T21:42:42.958935] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-26T21:42:43.111724] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-06. [2025-09-26T21:42:43.875971] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-26T21:42:43.911684] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-06. [2025-09-26T21:42:44.686360] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-26T21:42:44.711677] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-07. [2025-09-26T21:42:45.314274] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-26T21:42:45.511738] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-01. [2025-09-26T21:42:46.240039] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-26T21:42:46.311726] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-08. [2025-09-26T21:42:47.111762] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-07. [2025-09-26T21:42:47.326038] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-26T21:42:47.911743] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-02. [2025-09-26T21:42:47.955737] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-26T21:42:48.716829] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-09. [2025-09-26T21:42:48.740599] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-26T21:42:49.511731] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-08. [2025-09-26T21:42:49.947616] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-26T21:42:50.019095] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-26T21:42:50.027148] [INFO ] [REMOTE ] TPC: Full fetch complete (54964 records). [2025-09-26T21:42:50.027275] [DEBUG] [VALIDATOR ] TPC: Validating primary data. [2025-09-26T21:42:50.316813] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-03. [2025-09-26T21:42:50.449859] [DEBUG] [VALIDATOR ] TPC: All expected trading days are present. [2025-09-26T21:42:50.449940] [DEBUG] [VALIDATOR ] TPC: Primary data validation passed. [2025-09-26T21:42:50.450831] [INFO ] [MAIN ] TPC: Fetched primary data is valid. [2025-09-26T21:42:50.450908] [DEBUG] [LOCAL ] TPC: Saving primary data. [2025-09-26T21:42:50.452140] [DEBUG] [LOCAL ] TPC: Trimmed 54964 records to 39311 (keeping 200 days of data) [2025-09-26T21:42:50.692282] [DEBUG] [LOCAL ] TPC: Primary data saved (39311 records). [2025-09-26T21:42:50.692781] [INFO ] [MAIN ] TPC: Full history saved. [2025-09-26T21:42:50.692991] [INFO ] [MAIN ] Update Progress: 2118/2371 symbols completed. TPC took 31.0s. Estimated remaining: 33m 47s. Rate: 7.5 symbols/min [2025-09-26T21:42:50.965316] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-26T21:42:51.111781] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-09. [2025-09-26T21:42:52.319741] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-26T21:42:52.337940] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-04. [2025-09-26T21:42:52.729678] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-26T21:42:52.738989] [INFO ] [REMOTE ] TPH: Full fetch complete (64997 records). [2025-09-26T21:42:52.739299] [DEBUG] [VALIDATOR ] TPH: Validating primary data. [2025-09-26T21:42:53.155479] [DEBUG] [VALIDATOR ] TPH: All expected trading days are present. [2025-09-26T21:42:53.155569] [DEBUG] [VALIDATOR ] TPH: Primary data validation passed. [2025-09-26T21:42:53.156714] [INFO ] [MAIN ] TPH: Fetched primary data is valid. [2025-09-26T21:42:53.156781] [DEBUG] [LOCAL ] TPH: Saving primary data. [2025-09-26T21:42:53.158208] [DEBUG] [LOCAL ] TPH: Trimmed 64997 records to 45821 (keeping 200 days of data) [2025-09-26T21:42:53.432023] [DEBUG] [LOCAL ] TPH: Primary data saved (45821 records). [2025-09-26T21:42:53.432215] [INFO ] [MAIN ] TPH: Full history saved. [2025-09-26T21:42:53.432347] [INFO ] [MAIN ] Update Progress: 2119/2371 symbols completed. TPH took 31.5s. Estimated remaining: 33m 38s. Rate: 7.5 symbols/min [2025-09-26T21:42:54.137314] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-26T21:42:54.149142] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-05. [2025-09-26T21:42:56.066984] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-26T21:42:56.078525] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-06. [2025-09-26T21:42:58.078167] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-26T21:42:58.089980] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-07. [2025-09-26T21:43:00.067356] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-26T21:43:00.080568] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-08. [2025-09-26T21:43:02.125965] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-26T21:43:02.138440] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-09. [2025-09-26T21:43:03.929707] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-26T21:43:03.940927] [INFO ] [REMOTE ] TPR: Full fetch complete (77430 records). [2025-09-26T21:43:03.941099] [DEBUG] [VALIDATOR ] TPR: Validating primary data. [2025-09-26T21:43:04.362610] [DEBUG] [VALIDATOR ] TPR: All expected trading days are present. [2025-09-26T21:43:04.362726] [DEBUG] [VALIDATOR ] TPR: Primary data validation passed. [2025-09-26T21:43:04.363818] [INFO ] [MAIN ] TPR: Fetched primary data is valid. [2025-09-26T21:43:04.363886] [DEBUG] [LOCAL ] TPR: Saving primary data. [2025-09-26T21:43:04.365477] [DEBUG] [LOCAL ] TPR: Trimmed 77430 records to 54252 (keeping 200 days of data) [2025-09-26T21:43:04.713146] [DEBUG] [LOCAL ] TPR: Primary data saved (54252 records). [2025-09-26T21:43:04.713289] [INFO ] [MAIN ] TPR: Full history saved. [2025-09-26T21:43:04.713376] [INFO ] [MAIN ] Update Progress: 2120/2371 symbols completed. TPR took 30.9s. Estimated remaining: 33m 31s. Rate: 7.5 symbols/min [2025-09-26T21:43:05.331341] [INFO ] [MAIN ] TPYP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:43:05.395961] [INFO ] [MAIN ] TPVG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:43:05.427831] [INFO ] [MAIN ] TPZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:43:05.492321] [INFO ] [MAIN ] TR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:43:05.497719] [DEBUG] [LOCAL ] TPYP: Loaded 7942 existing records from primary storage. [2025-09-26T21:43:05.498711] [INFO ] [MAIN ] TPYP: Loaded 7942 existing records. [2025-09-26T21:43:05.567089] [DEBUG] [LOCAL ] TPZ: Loaded 5068 existing records from primary storage. [2025-09-26T21:43:05.621551] [INFO ] [MAIN ] TPZ: Loaded 5068 existing records. [2025-09-26T21:43:05.719405] [DEBUG] [LOCAL ] TR: Loaded 18389 existing records from primary storage. [2025-09-26T21:43:05.771344] [INFO ] [MAIN ] TR: Loaded 18389 existing records. [2025-09-26T21:43:05.814934] [DEBUG] [LOCAL ] TPVG: Loaded 27220 existing records from primary storage. [2025-09-26T21:43:05.820257] [INFO ] [MAIN ] TPVG: Loaded 27220 existing records. [2025-09-26T21:43:05.888482] [WARN ] [MAIN ] TPYP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:43:05.978127] [INFO ] [MAIN ] TPYP: Wiping existing primary data before full refresh. [2025-09-26T21:43:06.026814] [INFO ] [LOCAL ] TPYP: Starting deletion of primary data. [2025-09-26T21:43:06.110226] [DEBUG] [LOCAL ] TPYP: Deleted primary data file. [2025-09-26T21:43:06.115999] [INFO ] [MAIN ] TPYP: Starting full primary refresh. [2025-09-26T21:43:06.196020] [WARN ] [MAIN ] TPZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:43:06.249399] [INFO ] [MAIN ] TPZ: Wiping existing primary data before full refresh. [2025-09-26T21:43:06.301857] [INFO ] [LOCAL ] TPZ: Starting deletion of primary data. [2025-09-26T21:43:06.407917] [WARN ] [MAIN ] TR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:43:06.391448] [DEBUG] [LOCAL ] TPZ: Deleted primary data file. [2025-09-26T21:43:06.444689] [INFO ] [MAIN ] TPZ: Starting full primary refresh. [2025-09-26T21:43:06.461141] [WARN ] [MAIN ] TPVG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:43:06.461289] [INFO ] [MAIN ] TR: Wiping existing primary data before full refresh. [2025-09-26T21:43:06.461411] [INFO ] [LOCAL ] TR: Starting deletion of primary data. [2025-09-26T21:43:06.518455] [INFO ] [MAIN ] TPVG: Wiping existing primary data before full refresh. [2025-09-26T21:43:06.571030] [INFO ] [LOCAL ] TPVG: Starting deletion of primary data. [2025-09-26T21:43:06.565771] [DEBUG] [LOCAL ] TR: Deleted primary data file. [2025-09-26T21:43:06.618755] [DEBUG] [LOCAL ] TPVG: Deleted primary data file. [2025-09-26T21:43:06.613524] [INFO ] [MAIN ] TR: Starting full primary refresh. [2025-09-26T21:43:06.690701] [INFO ] [MAIN ] TPVG: Starting full primary refresh. [2025-09-26T21:43:07.534487] [INFO ] [REMOTE ] TPYP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:43:07.598991] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2024-12. [2025-09-26T21:43:07.685010] [INFO ] [REMOTE ] TPZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:43:07.725622] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2024-12. [2025-09-26T21:43:08.028720] [INFO ] [REMOTE ] TPVG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:43:08.042337] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2024-12. [2025-09-26T21:43:08.069005] [INFO ] [REMOTE ] TR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:43:08.069787] [INFO ] [REMOTE ] TR: Fetching primary data for 2024-12. [2025-09-26T21:43:08.481978] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-26T21:43:08.484335] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-01. [2025-09-26T21:43:08.752276] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-26T21:43:08.755584] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-01. [2025-09-26T21:43:09.209123] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-26T21:43:09.213556] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-01. [2025-09-26T21:43:09.402473] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-26T21:43:09.406393] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-02. [2025-09-26T21:43:09.415100] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-26T21:43:09.418431] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-02. [2025-09-26T21:43:09.546728] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-26T21:43:09.554813] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-01. [2025-09-26T21:43:09.882393] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-26T21:43:09.885132] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-03. [2025-09-26T21:43:10.135788] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-26T21:43:10.138081] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-03. [2025-09-26T21:43:10.240463] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-26T21:43:10.244193] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-02. [2025-09-26T21:43:10.342435] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-26T21:43:10.344897] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-04. [2025-09-26T21:43:10.711223] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-26T21:43:10.717791] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-02. [2025-09-26T21:43:10.884941] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-26T21:43:10.887595] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-04. [2025-09-26T21:43:11.196727] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-26T21:43:11.200383] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-03. [2025-09-26T21:43:11.208712] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-26T21:43:11.211796] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-05. [2025-09-26T21:43:11.694224] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-26T21:43:11.696572] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-05. [2025-09-26T21:43:11.770254] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-26T21:43:11.886564] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-26T21:43:11.911691] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-03. [2025-09-26T21:43:12.105917] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-26T21:43:12.293573] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-26T21:43:12.711736] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-04. [2025-09-26T21:43:13.285597] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-26T21:43:13.511743] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-06. [2025-09-26T21:43:13.690893] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-26T21:43:14.102000] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-26T21:43:14.311733] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-07. [2025-09-26T21:43:15.025230] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-26T21:43:15.111880] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-05. [2025-09-26T21:43:15.911692] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-04. [2025-09-26T21:43:16.231394] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-26T21:43:16.711739] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-06. [2025-09-26T21:43:16.931070] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-26T21:43:17.511730] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-06. [2025-09-26T21:43:17.794172] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-26T21:43:18.274735] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-26T21:43:18.311717] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-07. [2025-09-26T21:43:19.111721] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-07. [2025-09-26T21:43:19.474525] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-26T21:43:19.570166] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-26T21:43:19.911717] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-08. [2025-09-26T21:43:20.503419] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-26T21:43:20.711761] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-05. [2025-09-26T21:43:21.511751] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-08. [2025-09-26T21:43:21.888434] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-26T21:43:22.280875] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-26T21:43:22.311703] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-09. [2025-09-26T21:43:23.064639] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-26T21:43:23.066866] [INFO ] [REMOTE ] TPYP: Full fetch complete (12609 records). [2025-09-26T21:43:23.066989] [DEBUG] [VALIDATOR ] TPYP: Validating primary data. [2025-09-26T21:43:23.116936] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-06. [2025-09-26T21:43:23.474825] [DEBUG] [VALIDATOR ] TPYP: All expected trading days are present. [2025-09-26T21:43:23.474929] [DEBUG] [VALIDATOR ] TPYP: Primary data validation passed. [2025-09-26T21:43:23.475298] [INFO ] [MAIN ] TPYP: Fetched primary data is valid. [2025-09-26T21:43:23.475418] [DEBUG] [LOCAL ] TPYP: Saving primary data. [2025-09-26T21:43:23.476254] [DEBUG] [LOCAL ] TPYP: Trimmed 12609 records to 8039 (keeping 200 days of data) [2025-09-26T21:43:23.531541] [DEBUG] [LOCAL ] TPYP: Primary data saved (8039 records). [2025-09-26T21:43:23.531737] [INFO ] [MAIN ] TPYP: Full history saved. [2025-09-26T21:43:23.531879] [INFO ] [MAIN ] Update Progress: 2121/2371 symbols completed. TPYP took 18.8s. Estimated remaining: 33m 24s. Rate: 7.5 symbols/min [2025-09-26T21:43:23.723709] [INFO ] [MAIN ] TRAK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:43:23.735258] [DEBUG] [LOCAL ] TRAK: Loaded 9342 existing records from primary storage. [2025-09-26T21:43:23.735417] [INFO ] [MAIN ] TRAK: Loaded 9342 existing records. [2025-09-26T21:43:23.919700] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-09. [2025-09-26T21:43:23.925866] [WARN ] [MAIN ] TRAK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:43:23.926402] [INFO ] [MAIN ] TRAK: Wiping existing primary data before full refresh. [2025-09-26T21:43:23.926487] [INFO ] [LOCAL ] TRAK: Starting deletion of primary data. [2025-09-26T21:43:23.928239] [DEBUG] [LOCAL ] TRAK: Deleted primary data file. [2025-09-26T21:43:23.928317] [INFO ] [MAIN ] TRAK: Starting full primary refresh. [2025-09-26T21:43:24.365887] [INFO ] [REMOTE ] TRAK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:43:24.503862] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-26T21:43:24.711742] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-08. [2025-09-26T21:43:24.766037] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-26T21:43:24.767733] [INFO ] [REMOTE ] TPZ: Full fetch complete (9250 records). [2025-09-26T21:43:24.767835] [DEBUG] [VALIDATOR ] TPZ: Validating primary data. [2025-09-26T21:43:25.184150] [DEBUG] [VALIDATOR ] TPZ: All expected trading days are present. [2025-09-26T21:43:25.184241] [DEBUG] [VALIDATOR ] TPZ: Primary data validation passed. [2025-09-26T21:43:25.184553] [INFO ] [MAIN ] TPZ: Fetched primary data is valid. [2025-09-26T21:43:25.184619] [DEBUG] [LOCAL ] TPZ: Saving primary data. [2025-09-26T21:43:25.185115] [DEBUG] [LOCAL ] TPZ: Trimmed 9250 records to 5095 (keeping 200 days of data) [2025-09-26T21:43:25.218623] [DEBUG] [LOCAL ] TPZ: Primary data saved (5095 records). [2025-09-26T21:43:25.218840] [INFO ] [MAIN ] TPZ: Full history saved. [2025-09-26T21:43:25.218962] [INFO ] [MAIN ] Update Progress: 2122/2371 symbols completed. TPZ took 20.5s. Estimated remaining: 33m 15s. Rate: 7.5 symbols/min [2025-09-26T21:43:25.399506] [INFO ] [MAIN ] TRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:43:25.423208] [DEBUG] [LOCAL ] TRC: Loaded 16113 existing records from primary storage. [2025-09-26T21:43:25.423364] [INFO ] [MAIN ] TRC: Loaded 16113 existing records. [2025-09-26T21:43:25.512393] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-07. [2025-09-26T21:43:25.631820] [WARN ] [MAIN ] TRC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:43:25.632137] [INFO ] [MAIN ] TRC: Wiping existing primary data before full refresh. [2025-09-26T21:43:25.632212] [INFO ] [LOCAL ] TRC: Starting deletion of primary data. [2025-09-26T21:43:25.632745] [DEBUG] [LOCAL ] TRC: Deleted primary data file. [2025-09-26T21:43:25.632808] [INFO ] [MAIN ] TRC: Starting full primary refresh. [2025-09-26T21:43:25.859085] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-26T21:43:26.070837] [INFO ] [REMOTE ] TRC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:43:26.311726] [INFO ] [REMOTE ] TRC: Fetching primary data for 2024-12. [2025-09-26T21:43:26.525564] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-26T21:43:27.111709] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2024-12. [2025-09-26T21:43:27.340607] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-26T21:43:27.911691] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-01. [2025-09-26T21:43:27.971613] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-26T21:43:28.711730] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-08. [2025-09-26T21:43:28.743089] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-26T21:43:29.511753] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-01. [2025-09-26T21:43:30.083284] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-26T21:43:30.311721] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-09. [2025-09-26T21:43:30.333780] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-26T21:43:31.111736] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-02. [2025-09-26T21:43:31.419238] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-26T21:43:31.425144] [INFO ] [REMOTE ] TR: Full fetch complete (24935 records). [2025-09-26T21:43:31.425333] [DEBUG] [VALIDATOR ] TR: Validating primary data. [2025-09-26T21:43:31.842682] [DEBUG] [VALIDATOR ] TR: All expected trading days are present. [2025-09-26T21:43:31.842780] [DEBUG] [VALIDATOR ] TR: Primary data validation passed. [2025-09-26T21:43:31.843337] [INFO ] [MAIN ] TR: Fetched primary data is valid. [2025-09-26T21:43:31.843379] [DEBUG] [LOCAL ] TR: Saving primary data. [2025-09-26T21:43:31.845339] [DEBUG] [LOCAL ] TR: Trimmed 24935 records to 18494 (keeping 200 days of data) [2025-09-26T21:43:31.915426] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-02. [2025-09-26T21:43:31.976419] [DEBUG] [LOCAL ] TR: Primary data saved (18494 records). [2025-09-26T21:43:31.976560] [INFO ] [MAIN ] TR: Full history saved. [2025-09-26T21:43:31.976724] [INFO ] [MAIN ] Update Progress: 2123/2371 symbols completed. TR took 27.3s. Estimated remaining: 33m 7s. Rate: 7.5 symbols/min [2025-09-26T21:43:32.055259] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-26T21:43:32.170019] [INFO ] [MAIN ] TREX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:43:32.222288] [DEBUG] [LOCAL ] TREX: Loaded 50361 existing records from primary storage. [2025-09-26T21:43:32.222435] [INFO ] [MAIN ] TREX: Loaded 50361 existing records. [2025-09-26T21:43:32.416793] [WARN ] [MAIN ] TREX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:43:32.417399] [INFO ] [MAIN ] TREX: Wiping existing primary data before full refresh. [2025-09-26T21:43:32.417452] [INFO ] [LOCAL ] TREX: Starting deletion of primary data. [2025-09-26T21:43:32.418721] [DEBUG] [LOCAL ] TREX: Deleted primary data file. [2025-09-26T21:43:32.418785] [INFO ] [MAIN ] TREX: Starting full primary refresh. [2025-09-26T21:43:32.718937] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-09. [2025-09-26T21:43:32.813418] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-26T21:43:32.819603] [INFO ] [REMOTE ] TREX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:43:33.511763] [INFO ] [REMOTE ] TREX: Fetching primary data for 2024-12. [2025-09-26T21:43:34.033112] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-26T21:43:34.039129] [INFO ] [REMOTE ] TPVG: Full fetch complete (40298 records). [2025-09-26T21:43:34.039252] [DEBUG] [VALIDATOR ] TPVG: Validating primary data. [2025-09-26T21:43:34.316810] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-03. [2025-09-26T21:43:34.450417] [DEBUG] [VALIDATOR ] TPVG: All expected trading days are present. [2025-09-26T21:43:34.450555] [DEBUG] [VALIDATOR ] TPVG: Primary data validation passed. [2025-09-26T21:43:34.452287] [INFO ] [MAIN ] TPVG: Fetched primary data is valid. [2025-09-26T21:43:34.452393] [DEBUG] [LOCAL ] TPVG: Saving primary data. [2025-09-26T21:43:34.458221] [DEBUG] [LOCAL ] TPVG: Trimmed 40298 records to 27400 (keeping 200 days of data) [2025-09-26T21:43:34.642917] [DEBUG] [LOCAL ] TPVG: Primary data saved (27400 records). [2025-09-26T21:43:34.643077] [INFO ] [MAIN ] TPVG: Full history saved. [2025-09-26T21:43:34.643341] [INFO ] [MAIN ] Update Progress: 2124/2371 symbols completed. TPVG took 29.9s. Estimated remaining: 32m 58s. Rate: 7.5 symbols/min [2025-09-26T21:43:34.829872] [INFO ] [MAIN ] TRGP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:43:34.908032] [DEBUG] [LOCAL ] TRGP: Loaded 51169 existing records from primary storage. [2025-09-26T21:43:34.908241] [INFO ] [MAIN ] TRGP: Loaded 51169 existing records. [2025-09-26T21:43:35.102056] [WARN ] [MAIN ] TRGP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:43:35.102470] [INFO ] [MAIN ] TRGP: Wiping existing primary data before full refresh. [2025-09-26T21:43:35.102857] [INFO ] [LOCAL ] TRGP: Starting deletion of primary data. [2025-09-26T21:43:35.104428] [DEBUG] [LOCAL ] TRGP: Deleted primary data file. [2025-09-26T21:43:35.104773] [INFO ] [MAIN ] TRGP: Starting full primary refresh. [2025-09-26T21:43:35.121524] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-03. [2025-09-26T21:43:35.260389] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-26T21:43:35.334052] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-26T21:43:35.564723] [INFO ] [REMOTE ] TRGP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:43:35.911708] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-01. [2025-09-26T21:43:36.160848] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-26T21:43:36.711726] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2024-12. [2025-09-26T21:43:37.091177] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-26T21:43:37.511718] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-04. [2025-09-26T21:43:38.311688] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-04. [2025-09-26T21:43:38.357629] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-26T21:43:38.505391] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-26T21:43:39.111691] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-01. [2025-09-26T21:43:39.494160] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-26T21:43:39.911721] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-05. [2025-09-26T21:43:40.711691] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-05. [2025-09-26T21:43:40.889914] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-26T21:43:41.159947] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-26T21:43:41.266405] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-26T21:43:41.511706] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-02. [2025-09-26T21:43:42.311719] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-06. [2025-09-26T21:43:43.111726] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-06. [2025-09-26T21:43:43.290494] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-26T21:43:43.355840] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-26T21:43:43.885527] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-26T21:43:43.911705] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-07. [2025-09-26T21:43:44.386127] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-26T21:43:44.711777] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-07. [2025-09-26T21:43:45.511751] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-08. [2025-09-26T21:43:45.703606] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-26T21:43:45.974305] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-26T21:43:46.311733] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-09. [2025-09-26T21:43:47.077601] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-26T21:43:47.080432] [INFO ] [REMOTE ] TRAK: Full fetch complete (13376 records). [2025-09-26T21:43:47.080540] [DEBUG] [VALIDATOR ] TRAK: Validating primary data. [2025-09-26T21:43:47.117146] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-03. [2025-09-26T21:43:47.511087] [DEBUG] [VALIDATOR ] TRAK: All expected trading days are present. [2025-09-26T21:43:47.511172] [DEBUG] [VALIDATOR ] TRAK: Primary data validation passed. [2025-09-26T21:43:47.511475] [INFO ] [MAIN ] TRAK: Fetched primary data is valid. [2025-09-26T21:43:47.511516] [DEBUG] [LOCAL ] TRAK: Saving primary data. [2025-09-26T21:43:47.512565] [DEBUG] [LOCAL ] TRAK: Trimmed 13376 records to 9383 (keeping 200 days of data) [2025-09-26T21:43:47.576453] [DEBUG] [LOCAL ] TRAK: Primary data saved (9383 records). [2025-09-26T21:43:47.576633] [INFO ] [MAIN ] TRAK: Full history saved. [2025-09-26T21:43:47.576809] [INFO ] [MAIN ] Update Progress: 2125/2371 symbols completed. TRAK took 24.0s. Estimated remaining: 32m 51s. Rate: 7.5 symbols/min [2025-09-26T21:43:47.797435] [INFO ] [MAIN ] TRN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:43:47.849266] [DEBUG] [LOCAL ] TRN: Loaded 37620 existing records from primary storage. [2025-09-26T21:43:47.849419] [INFO ] [MAIN ] TRN: Loaded 37620 existing records. [2025-09-26T21:43:47.921461] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-02. [2025-09-26T21:43:48.048993] [WARN ] [MAIN ] TRN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:43:48.049320] [INFO ] [MAIN ] TRN: Wiping existing primary data before full refresh. [2025-09-26T21:43:48.049378] [INFO ] [LOCAL ] TRN: Starting deletion of primary data. [2025-09-26T21:43:48.050978] [DEBUG] [LOCAL ] TRN: Deleted primary data file. [2025-09-26T21:43:48.051229] [INFO ] [MAIN ] TRN: Starting full primary refresh. [2025-09-26T21:43:48.429560] [INFO ] [REMOTE ] TRN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:43:48.711702] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-08. [2025-09-26T21:43:49.064367] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-26T21:43:49.512112] [INFO ] [REMOTE ] TRN: Fetching primary data for 2024-12. [2025-09-26T21:43:49.515717] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-26T21:43:49.622298] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-26T21:43:50.311781] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-04. [2025-09-26T21:43:51.016058] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-26T21:43:51.111730] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-03. [2025-09-26T21:43:51.911704] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-09. [2025-09-26T21:43:52.052622] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-26T21:43:52.711702] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-01. [2025-09-26T21:43:52.871053] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-26T21:43:52.891573] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-26T21:43:52.895418] [INFO ] [REMOTE ] TRC: Full fetch complete (22117 records). [2025-09-26T21:43:52.895530] [DEBUG] [VALIDATOR ] TRC: Validating primary data. [2025-09-26T21:43:53.287512] [DEBUG] [VALIDATOR ] TRC: All expected trading days are present. [2025-09-26T21:43:53.287600] [DEBUG] [VALIDATOR ] TRC: Primary data validation passed. [2025-09-26T21:43:53.288123] [INFO ] [MAIN ] TRC: Fetched primary data is valid. [2025-09-26T21:43:53.288189] [DEBUG] [LOCAL ] TRC: Saving primary data. [2025-09-26T21:43:53.289811] [DEBUG] [LOCAL ] TRC: Trimmed 22117 records to 16189 (keeping 200 days of data) [2025-09-26T21:43:53.394418] [DEBUG] [LOCAL ] TRC: Primary data saved (16189 records). [2025-09-26T21:43:53.394622] [INFO ] [MAIN ] TRC: Full history saved. [2025-09-26T21:43:53.394810] [INFO ] [MAIN ] Update Progress: 2126/2371 symbols completed. TRC took 28.2s. Estimated remaining: 32m 43s. Rate: 7.5 symbols/min [2025-09-26T21:43:53.516795] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-04. [2025-09-26T21:43:53.581030] [INFO ] [MAIN ] TRNO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:43:53.637395] [DEBUG] [LOCAL ] TRNO: Loaded 44330 existing records from primary storage. [2025-09-26T21:43:53.637542] [INFO ] [MAIN ] TRNO: Loaded 44330 existing records. [2025-09-26T21:43:53.846100] [WARN ] [MAIN ] TRNO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:43:53.846452] [INFO ] [MAIN ] TRNO: Wiping existing primary data before full refresh. [2025-09-26T21:43:53.846579] [INFO ] [LOCAL ] TRNO: Starting deletion of primary data. [2025-09-26T21:43:53.847675] [DEBUG] [LOCAL ] TRNO: Deleted primary data file. [2025-09-26T21:43:53.847739] [INFO ] [MAIN ] TRNO: Starting full primary refresh. [2025-09-26T21:43:54.271921] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-26T21:43:54.278512] [INFO ] [REMOTE ] TRNO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:43:54.311673] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2024-12. [2025-09-26T21:43:55.111726] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-05. [2025-09-26T21:43:55.193362] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-26T21:43:55.895785] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-26T21:43:55.911688] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-02. [2025-09-26T21:43:56.639848] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-26T21:43:56.711737] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-06. [2025-09-26T21:43:57.239246] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-26T21:43:57.511747] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-05. [2025-09-26T21:43:58.311736] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-03. [2025-09-26T21:43:58.620927] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-26T21:43:58.719118] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-26T21:43:59.111724] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-07. [2025-09-26T21:43:59.897610] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-26T21:43:59.911661] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-04. [2025-09-26T21:44:00.711722] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-01. [2025-09-26T21:44:01.087185] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-26T21:44:01.499788] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-26T21:44:01.511660] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-05. [2025-09-26T21:44:02.235089] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-26T21:44:02.311726] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-02. [2025-09-26T21:44:02.988298] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-26T21:44:03.111726] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-06. [2025-09-26T21:44:03.821766] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-26T21:44:03.911708] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-06. [2025-09-26T21:44:04.445191] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-26T21:44:04.711719] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-08. [2025-09-26T21:44:05.276473] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-26T21:44:05.511731] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-03. [2025-09-26T21:44:06.311695] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-07. [2025-09-26T21:44:06.422598] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-26T21:44:07.111743] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-09. [2025-09-26T21:44:07.142752] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-26T21:44:07.880823] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-26T21:44:07.905595] [INFO ] [REMOTE ] TRGP: Full fetch complete (73472 records). [2025-09-26T21:44:07.914520] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-07. [2025-09-26T21:44:07.918579] [DEBUG] [VALIDATOR ] TRGP: Validating primary data. [2025-09-26T21:44:07.921361] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-26T21:44:08.357808] [DEBUG] [VALIDATOR ] TRGP: All expected trading days are present. [2025-09-26T21:44:08.357931] [DEBUG] [VALIDATOR ] TRGP: Primary data validation passed. [2025-09-26T21:44:08.358989] [INFO ] [MAIN ] TRGP: Fetched primary data is valid. [2025-09-26T21:44:08.359060] [DEBUG] [LOCAL ] TRGP: Saving primary data. [2025-09-26T21:44:08.360669] [DEBUG] [LOCAL ] TRGP: Trimmed 73472 records to 51504 (keeping 200 days of data) [2025-09-26T21:44:08.712384] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-08. [2025-09-26T21:44:08.712749] [DEBUG] [LOCAL ] TRGP: Primary data saved (51504 records). [2025-09-26T21:44:08.713901] [INFO ] [MAIN ] TRGP: Full history saved. [2025-09-26T21:44:08.714058] [INFO ] [MAIN ] Update Progress: 2127/2371 symbols completed. TRGP took 34.1s. Estimated remaining: 32m 35s. Rate: 7.5 symbols/min [2025-09-26T21:44:08.900066] [INFO ] [MAIN ] TROX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:44:08.954474] [DEBUG] [LOCAL ] TROX: Loaded 52162 existing records from primary storage. [2025-09-26T21:44:08.954626] [INFO ] [MAIN ] TROX: Loaded 52162 existing records. [2025-09-26T21:44:09.161602] [WARN ] [MAIN ] TROX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:44:09.161965] [INFO ] [MAIN ] TROX: Wiping existing primary data before full refresh. [2025-09-26T21:44:09.162024] [INFO ] [LOCAL ] TROX: Starting deletion of primary data. [2025-09-26T21:44:09.163177] [DEBUG] [LOCAL ] TROX: Deleted primary data file. [2025-09-26T21:44:09.163240] [INFO ] [MAIN ] TROX: Starting full primary refresh. [2025-09-26T21:44:09.524717] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-04. [2025-09-26T21:44:09.574033] [INFO ] [REMOTE ] TROX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:44:09.767498] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-26T21:44:09.877514] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-26T21:44:10.311752] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-08. [2025-09-26T21:44:11.111733] [INFO ] [REMOTE ] TROX: Fetching primary data for 2024-12. [2025-09-26T21:44:11.307385] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-26T21:44:11.911733] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-05. [2025-09-26T21:44:12.087873] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-26T21:44:12.358302] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-26T21:44:12.711734] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-09. [2025-09-26T21:44:13.511709] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-01. [2025-09-26T21:44:13.726782] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-26T21:44:14.311720] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-09. [2025-09-26T21:44:14.402503] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-26T21:44:14.412398] [INFO ] [REMOTE ] TREX: Full fetch complete (71040 records). [2025-09-26T21:44:14.412529] [DEBUG] [VALIDATOR ] TREX: Validating primary data. [2025-09-26T21:44:14.854785] [DEBUG] [VALIDATOR ] TREX: All expected trading days are present. [2025-09-26T21:44:14.854895] [DEBUG] [VALIDATOR ] TREX: Primary data validation passed. [2025-09-26T21:44:14.856044] [INFO ] [MAIN ] TREX: Fetched primary data is valid. [2025-09-26T21:44:14.856150] [DEBUG] [LOCAL ] TREX: Saving primary data. [2025-09-26T21:44:14.857673] [DEBUG] [LOCAL ] TREX: Trimmed 71040 records to 50733 (keeping 200 days of data) [2025-09-26T21:44:15.134349] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-06. [2025-09-26T21:44:15.196834] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-26T21:44:15.216760] [DEBUG] [LOCAL ] TREX: Primary data saved (50733 records). [2025-09-26T21:44:15.217440] [INFO ] [MAIN ] TREX: Full history saved. [2025-09-26T21:44:15.217599] [INFO ] [MAIN ] Update Progress: 2128/2371 symbols completed. TREX took 43.2s. Estimated remaining: 32m 27s. Rate: 7.5 symbols/min [2025-09-26T21:44:15.403771] [INFO ] [MAIN ] TRP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:44:15.454563] [DEBUG] [LOCAL ] TRP: Loaded 52505 existing records from primary storage. [2025-09-26T21:44:15.454765] [INFO ] [MAIN ] TRP: Loaded 52505 existing records. [2025-09-26T21:44:15.652523] [WARN ] [MAIN ] TRP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:44:15.653105] [INFO ] [MAIN ] TRP: Wiping existing primary data before full refresh. [2025-09-26T21:44:15.653354] [INFO ] [LOCAL ] TRP: Starting deletion of primary data. [2025-09-26T21:44:15.654554] [DEBUG] [LOCAL ] TRP: Deleted primary data file. [2025-09-26T21:44:15.654620] [INFO ] [MAIN ] TRP: Starting full primary refresh. [2025-09-26T21:44:15.816367] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-26T21:44:15.877527] [INFO ] [REMOTE ] TRN: Full fetch complete (52963 records). [2025-09-26T21:44:15.880485] [DEBUG] [VALIDATOR ] TRN: Validating primary data. [2025-09-26T21:44:15.918893] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-02. [2025-09-26T21:44:16.291296] [INFO ] [REMOTE ] TRP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:44:16.531909] [DEBUG] [VALIDATOR ] TRN: All expected trading days are present. [2025-09-26T21:44:16.532134] [DEBUG] [VALIDATOR ] TRN: Primary data validation passed. [2025-09-26T21:44:16.533318] [INFO ] [MAIN ] TRN: Fetched primary data is valid. [2025-09-26T21:44:16.533388] [DEBUG] [LOCAL ] TRN: Saving primary data. [2025-09-26T21:44:16.534892] [DEBUG] [LOCAL ] TRN: Trimmed 52963 records to 37786 (keeping 200 days of data) [2025-09-26T21:44:16.714032] [INFO ] [REMOTE ] TRP: Fetching primary data for 2024-12. [2025-09-26T21:44:16.787884] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-26T21:44:16.816780] [DEBUG] [LOCAL ] TRN: Primary data saved (37786 records). [2025-09-26T21:44:16.816916] [INFO ] [MAIN ] TRN: Full history saved. [2025-09-26T21:44:16.817005] [INFO ] [MAIN ] Update Progress: 2129/2371 symbols completed. TRN took 29.2s. Estimated remaining: 32m 18s. Rate: 7.5 symbols/min [2025-09-26T21:44:17.004913] [INFO ] [MAIN ] TRTX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:44:17.044709] [DEBUG] [LOCAL ] TRTX: Loaded 37759 existing records from primary storage. [2025-09-26T21:44:17.044850] [INFO ] [MAIN ] TRTX: Loaded 37759 existing records. [2025-09-26T21:44:17.245484] [WARN ] [MAIN ] TRTX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:44:17.245800] [INFO ] [MAIN ] TRTX: Wiping existing primary data before full refresh. [2025-09-26T21:44:17.245858] [INFO ] [LOCAL ] TRTX: Starting deletion of primary data. [2025-09-26T21:44:17.246822] [DEBUG] [LOCAL ] TRTX: Deleted primary data file. [2025-09-26T21:44:17.246884] [INFO ] [MAIN ] TRTX: Starting full primary refresh. [2025-09-26T21:44:17.514835] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-07. [2025-09-26T21:44:17.646179] [INFO ] [REMOTE ] TRTX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:44:17.704472] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-26T21:44:18.311704] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-03. [2025-09-26T21:44:18.575421] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-26T21:44:18.714995] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-26T21:44:19.111748] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-08. [2025-09-26T21:44:19.771314] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-26T21:44:19.911748] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-01. [2025-09-26T21:44:20.610774] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-26T21:44:20.711733] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-09. [2025-09-26T21:44:21.511719] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-04. [2025-09-26T21:44:21.729350] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-26T21:44:22.308952] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-26T21:44:22.317193] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-02. [2025-09-26T21:44:22.319922] [INFO ] [REMOTE ] TRNO: Full fetch complete (63985 records). [2025-09-26T21:44:22.320190] [DEBUG] [VALIDATOR ] TRNO: Validating primary data. [2025-09-26T21:44:22.760880] [DEBUG] [VALIDATOR ] TRNO: All expected trading days are present. [2025-09-26T21:44:22.761001] [DEBUG] [VALIDATOR ] TRNO: Primary data validation passed. [2025-09-26T21:44:22.762093] [INFO ] [MAIN ] TRNO: Fetched primary data is valid. [2025-09-26T21:44:22.762167] [DEBUG] [LOCAL ] TRNO: Saving primary data. [2025-09-26T21:44:22.763746] [DEBUG] [LOCAL ] TRNO: Trimmed 63985 records to 44598 (keeping 200 days of data) [2025-09-26T21:44:23.058302] [DEBUG] [LOCAL ] TRNO: Primary data saved (44598 records). [2025-09-26T21:44:23.058468] [INFO ] [MAIN ] TRNO: Full history saved. [2025-09-26T21:44:23.058570] [INFO ] [MAIN ] Update Progress: 2130/2371 symbols completed. TRNO took 29.7s. Estimated remaining: 32m 10s. Rate: 7.5 symbols/min [2025-09-26T21:44:23.121561] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2024-12. [2025-09-26T21:44:23.264454] [INFO ] [MAIN ] TRU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:44:23.327285] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-26T21:44:23.357535] [DEBUG] [LOCAL ] TRU: Loaded 51583 existing records from primary storage. [2025-09-26T21:44:23.357733] [INFO ] [MAIN ] TRU: Loaded 51583 existing records. [2025-09-26T21:44:23.604685] [WARN ] [MAIN ] TRU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:44:23.604966] [INFO ] [MAIN ] TRU: Wiping existing primary data before full refresh. [2025-09-26T21:44:23.605015] [INFO ] [LOCAL ] TRU: Starting deletion of primary data. [2025-09-26T21:44:23.607144] [DEBUG] [LOCAL ] TRU: Deleted primary data file. [2025-09-26T21:44:23.607234] [INFO ] [MAIN ] TRU: Starting full primary refresh. [2025-09-26T21:44:23.920536] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-05. [2025-09-26T21:44:24.056971] [INFO ] [REMOTE ] TRU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:44:24.097730] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-26T21:44:24.171905] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-26T21:44:24.711758] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-03. [2025-09-26T21:44:25.511694] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-01. [2025-09-26T21:44:25.720487] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-26T21:44:26.311728] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-06. [2025-09-26T21:44:26.560727] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-26T21:44:26.826319] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-26T21:44:27.111739] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-04. [2025-09-26T21:44:27.911735] [INFO ] [REMOTE ] TRU: Fetching primary data for 2024-12. [2025-09-26T21:44:27.982694] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-26T21:44:28.711780] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-07. [2025-09-26T21:44:28.887843] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-26T21:44:29.511729] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-05. [2025-09-26T21:44:29.574092] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-26T21:44:30.311765] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-01. [2025-09-26T21:44:30.856475] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-26T21:44:31.111740] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-02. [2025-09-26T21:44:31.331735] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-26T21:44:31.911738] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-08. [2025-09-26T21:44:32.027177] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-26T21:44:32.092280] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-26T21:44:32.711759] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-06. [2025-09-26T21:44:33.511732] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-03. [2025-09-26T21:44:33.604527] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-26T21:44:34.311732] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-02. [2025-09-26T21:44:34.462213] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-26T21:44:34.563626] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-26T21:44:35.111730] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-04. [2025-09-26T21:44:35.914479] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-09. [2025-09-26T21:44:35.920679] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-26T21:44:36.695782] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-26T21:44:36.711675] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-05. [2025-09-26T21:44:37.511717] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-03. [2025-09-26T21:44:37.708054] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-26T21:44:37.719452] [INFO ] [REMOTE ] TROX: Full fetch complete (72862 records). [2025-09-26T21:44:37.719693] [DEBUG] [VALIDATOR ] TROX: Validating primary data. [2025-09-26T21:44:38.179789] [DEBUG] [VALIDATOR ] TROX: All expected trading days are present. [2025-09-26T21:44:38.179986] [DEBUG] [VALIDATOR ] TROX: Primary data validation passed. [2025-09-26T21:44:38.181512] [INFO ] [MAIN ] TROX: Fetched primary data is valid. [2025-09-26T21:44:38.181667] [DEBUG] [LOCAL ] TROX: Saving primary data. [2025-09-26T21:44:38.206666] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T21:44:38.206865] [DEBUG] [LOCAL ] TROX: Trimmed 72862 records to 52550 (keeping 200 days of data) [2025-09-26T21:44:38.316730] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-07. [2025-09-26T21:44:38.546812] [DEBUG] [LOCAL ] TROX: Primary data saved (52550 records). [2025-09-26T21:44:38.547018] [INFO ] [MAIN ] TROX: Full history saved. [2025-09-26T21:44:38.547168] [INFO ] [MAIN ] Update Progress: 2131/2371 symbols completed. TROX took 29.8s. Estimated remaining: 32m 3s. Rate: 7.5 symbols/min [2025-09-26T21:44:38.775889] [INFO ] [MAIN ] TRV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:44:38.828461] [DEBUG] [LOCAL ] TRV: Loaded 48449 existing records from primary storage. [2025-09-26T21:44:38.828617] [INFO ] [MAIN ] TRV: Loaded 48449 existing records. [2025-09-26T21:44:39.020675] [WARN ] [MAIN ] TRV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:44:39.020919] [INFO ] [MAIN ] TRV: Wiping existing primary data before full refresh. [2025-09-26T21:44:39.020969] [INFO ] [LOCAL ] TRV: Starting deletion of primary data. [2025-09-26T21:44:39.022110] [DEBUG] [LOCAL ] TRV: Deleted primary data file. [2025-09-26T21:44:39.022174] [INFO ] [MAIN ] TRV: Starting full primary refresh. [2025-09-26T21:44:39.113683] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-06. [2025-09-26T21:44:39.408267] [INFO ] [REMOTE ] TRV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:44:39.456389] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-26T21:44:39.911734] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-04. [2025-09-26T21:44:40.098953] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-26T21:44:40.711739] [INFO ] [REMOTE ] TRV: Fetching primary data for 2024-12. [2025-09-26T21:44:40.864116] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-26T21:44:41.511725] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-07. [2025-09-26T21:44:41.827748] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-26T21:44:42.311756] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-05. [2025-09-26T21:44:42.457711] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-26T21:44:43.059721] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-26T21:44:43.111669] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-08. [2025-09-26T21:44:43.911713] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-08. [2025-09-26T21:44:44.051015] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-26T21:44:44.613593] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-26T21:44:44.711746] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-06. [2025-09-26T21:44:45.511714] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-09. [2025-09-26T21:44:45.571816] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-26T21:44:46.311715] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-01. [2025-09-26T21:44:46.387697] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-26T21:44:46.413458] [DEBUG] [REMOTE ] TRV: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-26T21:44:46.413828] [WARN ] [REMOTE ] TRV: No data returned for month 2025-01 [2025-09-26T21:44:46.547516] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-26T21:44:46.555528] [INFO ] [REMOTE ] TRTX: Full fetch complete (53042 records). [2025-09-26T21:44:46.555726] [DEBUG] [VALIDATOR ] TRTX: Validating primary data. [2025-09-26T21:44:46.976314] [DEBUG] [VALIDATOR ] TRTX: All expected trading days are present. [2025-09-26T21:44:46.976426] [DEBUG] [VALIDATOR ] TRTX: Primary data validation passed. [2025-09-26T21:44:46.977463] [INFO ] [MAIN ] TRTX: Fetched primary data is valid. [2025-09-26T21:44:46.977609] [DEBUG] [LOCAL ] TRTX: Saving primary data. [2025-09-26T21:44:46.979021] [DEBUG] [LOCAL ] TRTX: Trimmed 53042 records to 38058 (keeping 200 days of data) [2025-09-26T21:44:47.144475] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-02. [2025-09-26T21:44:47.212606] [DEBUG] [LOCAL ] TRTX: Primary data saved (38058 records). [2025-09-26T21:44:47.212814] [INFO ] [MAIN ] TRTX: Full history saved. [2025-09-26T21:44:47.212973] [INFO ] [MAIN ] Update Progress: 2132/2371 symbols completed. TRTX took 30.4s. Estimated remaining: 31m 55s. Rate: 7.5 symbols/min [2025-09-26T21:44:47.398468] [INFO ] [MAIN ] TS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:44:47.448474] [DEBUG] [LOCAL ] TS: Loaded 52046 existing records from primary storage. [2025-09-26T21:44:47.448619] [INFO ] [MAIN ] TS: Loaded 52046 existing records. [2025-09-26T21:44:47.650306] [WARN ] [MAIN ] TS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:44:47.650637] [INFO ] [MAIN ] TS: Wiping existing primary data before full refresh. [2025-09-26T21:44:47.650771] [INFO ] [LOCAL ] TS: Starting deletion of primary data. [2025-09-26T21:44:47.651882] [DEBUG] [LOCAL ] TS: Deleted primary data file. [2025-09-26T21:44:47.651943] [INFO ] [MAIN ] TS: Starting full primary refresh. [2025-09-26T21:44:47.920247] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-09. [2025-09-26T21:44:48.032228] [INFO ] [REMOTE ] TS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:44:48.711723] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-07. [2025-09-26T21:44:48.944979] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-26T21:44:49.511745] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-03. [2025-09-26T21:44:49.671969] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-26T21:44:49.682500] [INFO ] [REMOTE ] TRP: Full fetch complete (75562 records). [2025-09-26T21:44:49.682674] [DEBUG] [VALIDATOR ] TRP: Validating primary data. [2025-09-26T21:44:50.089106] [DEBUG] [VALIDATOR ] TRP: All expected trading days are present. [2025-09-26T21:44:50.089392] [DEBUG] [VALIDATOR ] TRP: Primary data validation passed. [2025-09-26T21:44:50.090555] [INFO ] [MAIN ] TRP: Fetched primary data is valid. [2025-09-26T21:44:50.090706] [DEBUG] [LOCAL ] TRP: Saving primary data. [2025-09-26T21:44:50.092703] [DEBUG] [LOCAL ] TRP: Trimmed 75562 records to 52891 (keeping 200 days of data) [2025-09-26T21:44:50.352128] [INFO ] [REMOTE ] TS: Fetching primary data for 2024-12. [2025-09-26T21:44:50.381026] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-26T21:44:50.491751] [DEBUG] [LOCAL ] TRP: Primary data saved (52891 records). [2025-09-26T21:44:50.491926] [INFO ] [MAIN ] TRP: Full history saved. [2025-09-26T21:44:50.492041] [INFO ] [MAIN ] Update Progress: 2133/2371 symbols completed. TRP took 35.3s. Estimated remaining: 31m 47s. Rate: 7.5 symbols/min [2025-09-26T21:44:50.682750] [INFO ] [MAIN ] TSE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:44:50.711751] [DEBUG] [LOCAL ] TSE: Loaded 28865 existing records from primary storage. [2025-09-26T21:44:50.711908] [INFO ] [MAIN ] TSE: Loaded 28865 existing records. [2025-09-26T21:44:50.907175] [WARN ] [MAIN ] TSE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:44:50.907470] [INFO ] [MAIN ] TSE: Wiping existing primary data before full refresh. [2025-09-26T21:44:50.907521] [INFO ] [LOCAL ] TSE: Starting deletion of primary data. [2025-09-26T21:44:50.908279] [DEBUG] [LOCAL ] TSE: Deleted primary data file. [2025-09-26T21:44:50.908355] [INFO ] [MAIN ] TSE: Starting full primary refresh. [2025-09-26T21:44:51.134782] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-08. [2025-09-26T21:44:51.289822] [INFO ] [REMOTE ] TSE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:44:51.472855] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-26T21:44:51.752494] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T21:44:51.911727] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-04. [2025-09-26T21:44:52.711705] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-01. [2025-09-26T21:44:52.977503] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-26T21:44:53.511731] [INFO ] [REMOTE ] TSE: Fetching primary data for 2024-12. [2025-09-26T21:44:53.866143] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-26T21:44:54.311709] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-09. [2025-09-26T21:44:54.540494] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-26T21:44:54.911326] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T21:44:55.111720] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-05. [2025-09-26T21:44:55.911708] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-02. [2025-09-26T21:44:56.080867] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-26T21:44:56.091177] [INFO ] [REMOTE ] TRU: Full fetch complete (73190 records). [2025-09-26T21:44:56.091308] [DEBUG] [VALIDATOR ] TRU: Validating primary data. [2025-09-26T21:44:56.510795] [DEBUG] [VALIDATOR ] TRU: All expected trading days are present. [2025-09-26T21:44:56.510902] [DEBUG] [VALIDATOR ] TRU: Primary data validation passed. [2025-09-26T21:44:56.512069] [INFO ] [MAIN ] TRU: Fetched primary data is valid. [2025-09-26T21:44:56.512141] [DEBUG] [LOCAL ] TRU: Saving primary data. [2025-09-26T21:44:56.513834] [DEBUG] [LOCAL ] TRU: Trimmed 73190 records to 51965 (keeping 200 days of data) [2025-09-26T21:44:56.737265] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-01. [2025-09-26T21:44:56.876639] [DEBUG] [LOCAL ] TRU: Primary data saved (51965 records). [2025-09-26T21:44:56.876928] [INFO ] [MAIN ] TRU: Full history saved. [2025-09-26T21:44:56.877222] [INFO ] [MAIN ] Update Progress: 2134/2371 symbols completed. TRU took 33.8s. Estimated remaining: 31m 38s. Rate: 7.5 symbols/min [2025-09-26T21:44:57.032638] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-26T21:44:57.111140] [INFO ] [MAIN ] TSI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:44:57.121854] [DEBUG] [LOCAL ] TSI: Loaded 8063 existing records from primary storage. [2025-09-26T21:44:57.122026] [INFO ] [MAIN ] TSI: Loaded 8063 existing records. [2025-09-26T21:44:57.314160] [WARN ] [MAIN ] TSI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:44:57.314565] [INFO ] [MAIN ] TSI: Wiping existing primary data before full refresh. [2025-09-26T21:44:57.314824] [INFO ] [LOCAL ] TSI: Starting deletion of primary data. [2025-09-26T21:44:57.315273] [DEBUG] [LOCAL ] TSI: Deleted primary data file. [2025-09-26T21:44:57.315338] [INFO ] [MAIN ] TSI: Starting full primary refresh. [2025-09-26T21:44:57.513754] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-06. [2025-09-26T21:44:57.534807] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-26T21:44:57.754411] [INFO ] [REMOTE ] TSI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:44:57.921290] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-26T21:44:58.311731] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-02. [2025-09-26T21:44:59.111717] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-03. [2025-09-26T21:44:59.318029] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-26T21:44:59.520882] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-26T21:44:59.911731] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-07. [2025-09-26T21:45:00.711695] [INFO ] [REMOTE ] TSI: Fetching primary data for 2024-12. [2025-09-26T21:45:00.784199] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-26T21:45:01.203339] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-26T21:45:01.511723] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-03. [2025-09-26T21:45:02.038871] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-26T21:45:02.311746] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-04. [2025-09-26T21:45:02.868787] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-26T21:45:03.111739] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-04. [2025-09-26T21:45:03.911738] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-01. [2025-09-26T21:45:04.469900] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-26T21:45:04.509452] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-26T21:45:04.678790] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-26T21:45:04.711728] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-05. [2025-09-26T21:45:05.511717] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-08. [2025-09-26T21:45:06.311730] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-02. [2025-09-26T21:45:06.607723] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-26T21:45:07.111700] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-05. [2025-09-26T21:45:07.329550] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-26T21:45:07.348049] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-26T21:45:07.911749] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-06. [2025-09-26T21:45:08.575176] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-26T21:45:08.711750] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-03. [2025-09-26T21:45:09.368812] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-26T21:45:09.511705] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-09. [2025-09-26T21:45:09.651065] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-26T21:45:10.258122] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-26T21:45:10.267188] [INFO ] [REMOTE ] TRV: Full fetch complete (62628 records). [2025-09-26T21:45:10.267375] [DEBUG] [VALIDATOR ] TRV: Validating primary data. [2025-09-26T21:45:10.316858] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-07. [2025-09-26T21:45:10.493838] [WARN ] [VALIDATOR ] TRV: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-26T21:45:10.494745] [FATAL] [MAIN ] TRV: Fetched primary data is invalid. Refusing to save it. [2025-09-26T21:45:10.494827] [WARN ] [MAIN ] TRV: Deleting existing primary and derivative data due to validation failure. [2025-09-26T21:45:10.494962] [INFO ] [LOCAL ] TRV: Starting deletion of primary data. [2025-09-26T21:45:10.495096] [DEBUG] [LOCAL ] TRV: No primary data file found to delete. [2025-09-26T21:45:10.495166] [INFO ] [LOCAL ] TRV: Starting deletion of derivative data. [2025-09-26T21:45:10.495721] [DEBUG] [LOCAL ] TRV: Deleted derivative data file. [2025-09-26T21:45:10.495853] [INFO ] [MAIN ] Update Progress: 2135/2371 symbols completed. TRV took 31.9s. Estimated remaining: 31m 31s. Rate: 7.5 symbols/min [2025-09-26T21:45:10.681937] [INFO ] [MAIN ] TSLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:45:10.732287] [DEBUG] [LOCAL ] TSLX: Loaded 35517 existing records from primary storage. [2025-09-26T21:45:10.732444] [INFO ] [MAIN ] TSLX: Loaded 35517 existing records. [2025-09-26T21:45:10.927820] [WARN ] [MAIN ] TSLX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:45:10.928070] [INFO ] [MAIN ] TSLX: Wiping existing primary data before full refresh. [2025-09-26T21:45:10.928118] [INFO ] [LOCAL ] TSLX: Starting deletion of primary data. [2025-09-26T21:45:10.929096] [DEBUG] [LOCAL ] TSLX: Deleted primary data file. [2025-09-26T21:45:10.929156] [INFO ] [MAIN ] TSLX: Starting full primary refresh. [2025-09-26T21:45:11.115439] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-04. [2025-09-26T21:45:11.323824] [INFO ] [REMOTE ] TSLX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:45:11.911721] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-06. [2025-09-26T21:45:12.000723] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-26T21:45:12.274110] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-26T21:45:12.711719] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-05. [2025-09-26T21:45:13.239444] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-26T21:45:13.361930] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-26T21:45:13.511757] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-06. [2025-09-26T21:45:14.311883] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2024-12. [2025-09-26T21:45:14.327534] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-26T21:45:15.111733] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-07. [2025-09-26T21:45:15.604784] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-26T21:45:15.911723] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-08. [2025-09-26T21:45:16.500607] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-26T21:45:16.711742] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-07. [2025-09-26T21:45:17.511709] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-08. [2025-09-26T21:45:17.703067] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-26T21:45:17.739520] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-26T21:45:18.311712] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-08. [2025-09-26T21:45:18.757158] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-26T21:45:19.077241] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-26T21:45:19.111743] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-01. [2025-09-26T21:45:19.911731] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-09. [2025-09-26T21:45:20.375016] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-26T21:45:20.711710] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-09. [2025-09-26T21:45:20.980179] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-26T21:45:20.985387] [INFO ] [REMOTE ] TSE: Full fetch complete (41811 records). [2025-09-26T21:45:20.985571] [DEBUG] [VALIDATOR ] TSE: Validating primary data. [2025-09-26T21:45:21.393744] [DEBUG] [VALIDATOR ] TSE: All expected trading days are present. [2025-09-26T21:45:21.393931] [DEBUG] [VALIDATOR ] TSE: Primary data validation passed. [2025-09-26T21:45:21.394985] [INFO ] [MAIN ] TSE: Fetched primary data is valid. [2025-09-26T21:45:21.395083] [DEBUG] [LOCAL ] TSE: Saving primary data. [2025-09-26T21:45:21.396436] [DEBUG] [LOCAL ] TSE: Trimmed 41811 records to 29074 (keeping 200 days of data) [2025-09-26T21:45:21.511836] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-02. [2025-09-26T21:45:21.589093] [DEBUG] [LOCAL ] TSE: Primary data saved (29074 records). [2025-09-26T21:45:21.589260] [INFO ] [MAIN ] TSE: Full history saved. [2025-09-26T21:45:21.589357] [INFO ] [MAIN ] Update Progress: 2136/2371 symbols completed. TSE took 31.1s. Estimated remaining: 31m 23s. Rate: 7.5 symbols/min [2025-09-26T21:45:21.772729] [INFO ] [MAIN ] TSM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:45:21.859178] [DEBUG] [LOCAL ] TSM: Loaded 54209 existing records from primary storage. [2025-09-26T21:45:21.859422] [INFO ] [MAIN ] TSM: Loaded 54209 existing records. [2025-09-26T21:45:22.056277] [WARN ] [MAIN ] TSM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:45:22.056518] [INFO ] [MAIN ] TSM: Wiping existing primary data before full refresh. [2025-09-26T21:45:22.056566] [INFO ] [LOCAL ] TSM: Starting deletion of primary data. [2025-09-26T21:45:22.057907] [DEBUG] [LOCAL ] TSM: Deleted primary data file. [2025-09-26T21:45:22.057978] [INFO ] [MAIN ] TSM: Starting full primary refresh. [2025-09-26T21:45:22.319784] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-09. [2025-09-26T21:45:22.440398] [INFO ] [REMOTE ] TSM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:45:22.472403] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-26T21:45:22.483798] [INFO ] [REMOTE ] TS: Full fetch complete (74458 records). [2025-09-26T21:45:22.483992] [DEBUG] [VALIDATOR ] TS: Validating primary data. [2025-09-26T21:45:22.956555] [DEBUG] [VALIDATOR ] TS: All expected trading days are present. [2025-09-26T21:45:22.958639] [DEBUG] [VALIDATOR ] TS: Primary data validation passed. [2025-09-26T21:45:22.958552] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-26T21:45:22.959981] [INFO ] [MAIN ] TS: Fetched primary data is valid. [2025-09-26T21:45:22.967164] [DEBUG] [LOCAL ] TS: Saving primary data. [2025-09-26T21:45:22.969365] [DEBUG] [LOCAL ] TS: Trimmed 74458 records to 52425 (keeping 200 days of data) [2025-09-26T21:45:23.149460] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-03. [2025-09-26T21:45:23.195749] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-26T21:45:23.202490] [INFO ] [REMOTE ] TSI: Full fetch complete (13244 records). [2025-09-26T21:45:23.203235] [DEBUG] [VALIDATOR ] TSI: Validating primary data. [2025-09-26T21:45:23.731989] [DEBUG] [VALIDATOR ] TSI: All expected trading days are present. [2025-09-26T21:45:23.732417] [DEBUG] [VALIDATOR ] TSI: Primary data validation passed. [2025-09-26T21:45:23.733638] [INFO ] [MAIN ] TSI: Fetched primary data is valid. [2025-09-26T21:45:23.733772] [DEBUG] [LOCAL ] TSI: Saving primary data. [2025-09-26T21:45:23.736205] [DEBUG] [LOCAL ] TSI: Trimmed 13244 records to 8090 (keeping 200 days of data) [2025-09-26T21:45:23.874453] [DEBUG] [LOCAL ] TSI: Primary data saved (8090 records). [2025-09-26T21:45:23.875636] [INFO ] [MAIN ] TSI: Full history saved. [2025-09-26T21:45:23.875828] [INFO ] [MAIN ] Update Progress: 2137/2371 symbols completed. TSI took 27.0s. Estimated remaining: 31m 15s. Rate: 7.5 symbols/min [2025-09-26T21:45:23.927487] [INFO ] [REMOTE ] TSM: Fetching primary data for 2024-12. [2025-09-26T21:45:24.074580] [DEBUG] [LOCAL ] TS: Primary data saved (52425 records). [2025-09-26T21:45:24.091475] [INFO ] [MAIN ] TS: Full history saved. [2025-09-26T21:45:24.097314] [INFO ] [MAIN ] Update Progress: 2138/2371 symbols completed. TS took 36.9s. Estimated remaining: 31m 6s. Rate: 7.5 symbols/min [2025-09-26T21:45:24.139166] [INFO ] [MAIN ] TSN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:45:24.331623] [INFO ] [MAIN ] TSQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:45:24.362019] [DEBUG] [LOCAL ] TSQ: Loaded 12165 existing records from primary storage. [2025-09-26T21:45:24.362178] [INFO ] [MAIN ] TSQ: Loaded 12165 existing records. [2025-09-26T21:45:24.548031] [DEBUG] [LOCAL ] TSN: Loaded 53256 existing records from primary storage. [2025-09-26T21:45:24.582514] [INFO ] [MAIN ] TSN: Loaded 53256 existing records. [2025-09-26T21:45:24.582330] [WARN ] [MAIN ] TSQ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:45:24.616706] [INFO ] [MAIN ] TSQ: Wiping existing primary data before full refresh. [2025-09-26T21:45:24.651945] [INFO ] [LOCAL ] TSQ: Starting deletion of primary data. [2025-09-26T21:45:24.690951] [DEBUG] [LOCAL ] TSQ: Deleted primary data file. [2025-09-26T21:45:24.698729] [INFO ] [MAIN ] TSQ: Starting full primary refresh. [2025-09-26T21:45:24.958009] [WARN ] [MAIN ] TSN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:45:25.064622] [INFO ] [MAIN ] TSN: Wiping existing primary data before full refresh. [2025-09-26T21:45:25.077818] [INFO ] [LOCAL ] TSN: Starting deletion of primary data. [2025-09-26T21:45:25.093498] [DEBUG] [LOCAL ] TSN: Deleted primary data file. [2025-09-26T21:45:25.110261] [INFO ] [MAIN ] TSN: Starting full primary refresh. [2025-09-26T21:45:25.326122] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-26T21:45:25.363403] [INFO ] [REMOTE ] TSQ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:45:25.369905] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2024-12. [2025-09-26T21:45:25.521939] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-04. [2025-09-26T21:45:25.677741] [INFO ] [REMOTE ] TSN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:45:26.200020] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-26T21:45:26.311721] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-01. [2025-09-26T21:45:26.854069] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-26T21:45:26.885052] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2024-12 (2.96 seconds). [2025-09-26T21:45:27.111749] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-05. [2025-09-26T21:45:27.210015] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-26T21:45:27.911756] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-01. [2025-09-26T21:45:28.505603] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-26T21:45:28.711717] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-02. [2025-09-26T21:45:29.495124] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-26T21:45:29.511696] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-06. [2025-09-26T21:45:30.311714] [INFO ] [REMOTE ] TSN: Fetching primary data for 2024-12. [2025-09-26T21:45:30.694184] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-01 (2.78 seconds). [2025-09-26T21:45:30.998802] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-26T21:45:31.111791] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-07. [2025-09-26T21:45:31.898900] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-26T21:45:31.911671] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-01. [2025-09-26T21:45:32.691521] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-26T21:45:32.711693] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-08. [2025-09-26T21:45:33.511708] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-03. [2025-09-26T21:45:33.758914] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-26T21:45:34.096882] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-26T21:45:34.311722] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-09. [2025-09-26T21:45:34.334592] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-26T21:45:35.111719] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-02. [2025-09-26T21:45:35.729014] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-26T21:45:35.736189] [INFO ] [REMOTE ] TSLX: Full fetch complete (49054 records). [2025-09-26T21:45:35.736392] [DEBUG] [VALIDATOR ] TSLX: Validating primary data. [2025-09-26T21:45:35.921081] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-04. [2025-09-26T21:45:36.152268] [DEBUG] [VALIDATOR ] TSLX: All expected trading days are present. [2025-09-26T21:45:36.152357] [DEBUG] [VALIDATOR ] TSLX: Primary data validation passed. [2025-09-26T21:45:36.153164] [INFO ] [MAIN ] TSLX: Fetched primary data is valid. [2025-09-26T21:45:36.153262] [DEBUG] [LOCAL ] TSLX: Saving primary data. [2025-09-26T21:45:36.156403] [DEBUG] [LOCAL ] TSLX: Trimmed 49054 records to 35752 (keeping 200 days of data) [2025-09-26T21:45:36.399333] [DEBUG] [LOCAL ] TSLX: Primary data saved (35752 records). [2025-09-26T21:45:36.399520] [INFO ] [MAIN ] TSLX: Full history saved. [2025-09-26T21:45:36.399774] [INFO ] [MAIN ] Update Progress: 2139/2371 symbols completed. TSLX took 25.9s. Estimated remaining: 30m 58s. Rate: 7.5 symbols/min [2025-09-26T21:45:36.602049] [INFO ] [MAIN ] TT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:45:36.672873] [DEBUG] [LOCAL ] TT: Loaded 48171 existing records from primary storage. [2025-09-26T21:45:36.673060] [INFO ] [MAIN ] TT: Loaded 48171 existing records. [2025-09-26T21:45:36.724541] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-02. [2025-09-26T21:45:36.924702] [WARN ] [MAIN ] TT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:45:36.925149] [INFO ] [MAIN ] TT: Wiping existing primary data before full refresh. [2025-09-26T21:45:36.933195] [INFO ] [LOCAL ] TT: Starting deletion of primary data. [2025-09-26T21:45:36.933590] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-26T21:45:36.936678] [DEBUG] [LOCAL ] TT: Deleted primary data file. [2025-09-26T21:45:36.937096] [INFO ] [MAIN ] TT: Starting full primary refresh. [2025-09-26T21:45:37.329233] [INFO ] [REMOTE ] TT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:45:37.511727] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-05. [2025-09-26T21:45:37.878623] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-02 (2.77 seconds). [2025-09-26T21:45:38.317181] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-03. [2025-09-26T21:45:38.338249] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-26T21:45:38.550391] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-26T21:45:39.111745] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-03. [2025-09-26T21:45:39.911784] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-06. [2025-09-26T21:45:40.711763] [INFO ] [REMOTE ] TT: Fetching primary data for 2024-12. [2025-09-26T21:45:40.974532] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-26T21:45:41.077563] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-26T21:45:41.168606] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-03 (2.85 seconds). [2025-09-26T21:45:41.237605] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-26T21:45:41.511731] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-04. [2025-09-26T21:45:42.311756] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-01. [2025-09-26T21:45:43.047824] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-26T21:45:43.111696] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-04. [2025-09-26T21:45:43.434935] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-26T21:45:43.911721] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-05. [2025-09-26T21:45:44.711761] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-02. [2025-09-26T21:45:45.513841] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-07. [2025-09-26T21:45:45.520742] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-26T21:45:45.953489] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-04 (2.84 seconds). [2025-09-26T21:45:46.031687] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-26T21:45:46.311704] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-05. [2025-09-26T21:45:46.456217] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-26T21:45:47.111761] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-03. [2025-09-26T21:45:47.894852] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-26T21:45:47.911660] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-04. [2025-09-26T21:45:48.700673] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-26T21:45:48.711695] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-06. [2025-09-26T21:45:48.844469] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-09-26T21:45:49.511731] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-06. [2025-09-26T21:45:50.260192] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T21:45:50.311764] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-08. [2025-09-26T21:45:51.111718] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-05. [2025-09-26T21:45:51.182293] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-26T21:45:51.912842] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-09. [2025-09-26T21:45:51.934564] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-26T21:45:52.014993] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-09-26T21:45:52.645378] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-26T21:45:52.647825] [INFO ] [REMOTE ] TSQ: Full fetch complete (16629 records). [2025-09-26T21:45:52.647912] [DEBUG] [VALIDATOR ] TSQ: Validating primary data. [2025-09-26T21:45:52.716800] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-06. [2025-09-26T21:45:53.063503] [DEBUG] [VALIDATOR ] TSQ: All expected trading days are present. [2025-09-26T21:45:53.063626] [DEBUG] [VALIDATOR ] TSQ: Primary data validation passed. [2025-09-26T21:45:53.064573] [INFO ] [MAIN ] TSQ: Fetched primary data is valid. [2025-09-26T21:45:53.064683] [DEBUG] [LOCAL ] TSQ: Saving primary data. [2025-09-26T21:45:53.065670] [DEBUG] [LOCAL ] TSQ: Trimmed 16629 records to 12195 (keeping 200 days of data) [2025-09-26T21:45:53.165333] [DEBUG] [LOCAL ] TSQ: Primary data saved (12195 records). [2025-09-26T21:45:53.165670] [INFO ] [MAIN ] TSQ: Full history saved. [2025-09-26T21:45:53.165843] [INFO ] [MAIN ] Update Progress: 2140/2371 symbols completed. TSQ took 29.1s. Estimated remaining: 30m 51s. Rate: 7.5 symbols/min [2025-09-26T21:45:53.362414] [INFO ] [MAIN ] TTAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:45:53.362843] [DEBUG] [LOCAL ] TTAM: No existing data file found in primary storage. [2025-09-26T21:45:53.362956] [WARN ] [MAIN ] TTAM: No existing data found, performing full refresh instead. [2025-09-26T21:45:53.363086] [INFO ] [MAIN ] TTAM: Wiping existing primary data before full refresh. [2025-09-26T21:45:53.363128] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-09-26T21:45:53.363171] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-09-26T21:45:53.363207] [INFO ] [MAIN ] TTAM: Starting full primary refresh. [2025-09-26T21:45:53.525252] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-07. [2025-09-26T21:45:53.773512] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-26T21:45:53.817445] [INFO ] [REMOTE ] TTAM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:45:54.311760] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-07. [2025-09-26T21:45:55.068553] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-26T21:45:55.111748] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-08. [2025-09-26T21:45:55.728805] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-26T21:45:55.893829] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-26T21:45:55.911674] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-09. [2025-09-26T21:45:56.675505] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-26T21:45:56.685782] [INFO ] [REMOTE ] TT: Full fetch complete (69838 records). [2025-09-26T21:45:56.685970] [DEBUG] [VALIDATOR ] TT: Validating primary data. [2025-09-26T21:45:56.718084] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-07. [2025-09-26T21:45:57.111327] [DEBUG] [VALIDATOR ] TT: All expected trading days are present. [2025-09-26T21:45:57.111428] [DEBUG] [VALIDATOR ] TT: Primary data validation passed. [2025-09-26T21:45:57.112576] [INFO ] [MAIN ] TT: Fetched primary data is valid. [2025-09-26T21:45:57.112672] [DEBUG] [LOCAL ] TT: Saving primary data. [2025-09-26T21:45:57.116762] [DEBUG] [LOCAL ] TT: Trimmed 69838 records to 48538 (keeping 200 days of data) [2025-09-26T21:45:57.441509] [DEBUG] [LOCAL ] TT: Primary data saved (48538 records). [2025-09-26T21:45:57.441732] [INFO ] [MAIN ] TT: Full history saved. [2025-09-26T21:45:57.441869] [INFO ] [MAIN ] Update Progress: 2141/2371 symbols completed. TT took 21.0s. Estimated remaining: 30m 43s. Rate: 7.5 symbols/min [2025-09-26T21:45:57.517133] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2024-12. [2025-09-26T21:45:57.628755] [INFO ] [MAIN ] TTC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:45:57.671873] [DEBUG] [LOCAL ] TTC: Loaded 42754 existing records from primary storage. [2025-09-26T21:45:57.672080] [INFO ] [MAIN ] TTC: Loaded 42754 existing records. [2025-09-26T21:45:57.775968] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:45:57.791835] [WARN ] [REMOTE ] TTAM: No data returned for month 2024-12 [2025-09-26T21:45:57.880949] [WARN ] [MAIN ] TTC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:45:57.881248] [INFO ] [MAIN ] TTC: Wiping existing primary data before full refresh. [2025-09-26T21:45:57.881351] [INFO ] [LOCAL ] TTC: Starting deletion of primary data. [2025-09-26T21:45:57.882324] [DEBUG] [LOCAL ] TTC: Deleted primary data file. [2025-09-26T21:45:57.882387] [INFO ] [MAIN ] TTC: Starting full primary refresh. [2025-09-26T21:45:58.271026] [INFO ] [REMOTE ] TTC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:45:58.311768] [INFO ] [REMOTE ] TTC: Fetching primary data for 2024-12. [2025-09-26T21:45:59.111746] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-01. [2025-09-26T21:45:59.742057] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:45:59.742622] [WARN ] [REMOTE ] TTAM: No data returned for month 2025-01 [2025-09-26T21:45:59.779560] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-07 (3.06 seconds). [2025-09-26T21:45:59.865762] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-26T21:45:59.911703] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-01. [2025-09-26T21:46:00.711755] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-08. [2025-09-26T21:46:01.385624] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-26T21:46:01.511755] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-08. [2025-09-26T21:46:02.311800] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-02. [2025-09-26T21:46:03.111710] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-02. [2025-09-26T21:46:03.442796] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-26T21:46:03.535437] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-08 (2.82 seconds). [2025-09-26T21:46:03.577675] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-26T21:46:03.911791] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-09. [2025-09-26T21:46:04.685875] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-26T21:46:04.711698] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-03. [2025-09-26T21:46:05.511873] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-09. [2025-09-26T21:46:06.311712] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-03. [2025-09-26T21:46:06.344110] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-26T21:46:06.659945] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-09 (2.75 seconds). [2025-09-26T21:46:06.670709] [INFO ] [REMOTE ] TSM: Full fetch complete (77990 records). [2025-09-26T21:46:06.670858] [DEBUG] [VALIDATOR ] TSM: Validating primary data. [2025-09-26T21:46:07.098090] [DEBUG] [VALIDATOR ] TSM: All expected trading days are present. [2025-09-26T21:46:07.098191] [DEBUG] [VALIDATOR ] TSM: Primary data validation passed. [2025-09-26T21:46:07.099455] [INFO ] [MAIN ] TSM: Fetched primary data is valid. [2025-09-26T21:46:07.099527] [DEBUG] [LOCAL ] TSM: Saving primary data. [2025-09-26T21:46:07.101252] [DEBUG] [LOCAL ] TSM: Trimmed 77990 records to 54599 (keeping 200 days of data) [2025-09-26T21:46:07.167428] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-04. [2025-09-26T21:46:07.510018] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-26T21:46:07.530050] [INFO ] [REMOTE ] TSN: Full fetch complete (76270 records). [2025-09-26T21:46:07.531519] [DEBUG] [VALIDATOR ] TSN: Validating primary data. [2025-09-26T21:46:07.944336] [DEBUG] [LOCAL ] TSM: Primary data saved (54599 records). [2025-09-26T21:46:07.960521] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-26T21:46:07.962936] [INFO ] [MAIN ] TSM: Full history saved. [2025-09-26T21:46:07.967406] [INFO ] [MAIN ] Update Progress: 2142/2371 symbols completed. TSM took 46.4s. Estimated remaining: 30m 35s. Rate: 7.5 symbols/min [2025-09-26T21:46:08.040041] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-04. [2025-09-26T21:46:08.051109] [DEBUG] [VALIDATOR ] TSN: All expected trading days are present. [2025-09-26T21:46:08.056668] [DEBUG] [VALIDATOR ] TSN: Primary data validation passed. [2025-09-26T21:46:08.098238] [INFO ] [MAIN ] TSN: Fetched primary data is valid. [2025-09-26T21:46:08.105138] [DEBUG] [LOCAL ] TSN: Saving primary data. [2025-09-26T21:46:08.158243] [DEBUG] [LOCAL ] TSN: Trimmed 76270 records to 53638 (keeping 200 days of data) [2025-09-26T21:46:08.214891] [INFO ] [MAIN ] TTE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:46:08.534721] [DEBUG] [LOCAL ] TTE: Loaded 52025 existing records from primary storage. [2025-09-26T21:46:08.535287] [INFO ] [MAIN ] TTE: Loaded 52025 existing records. [2025-09-26T21:46:08.812876] [WARN ] [MAIN ] TTE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:46:08.819098] [INFO ] [MAIN ] TTE: Wiping existing primary data before full refresh. [2025-09-26T21:46:08.819276] [INFO ] [LOCAL ] TTE: Starting deletion of primary data. [2025-09-26T21:46:08.854430] [DEBUG] [LOCAL ] TTE: Deleted primary data file. [2025-09-26T21:46:08.880429] [INFO ] [MAIN ] TTE: Starting full primary refresh. [2025-09-26T21:46:09.171039] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-26T21:46:09.219482] [DEBUG] [LOCAL ] TSN: Primary data saved (53638 records). [2025-09-26T21:46:09.253173] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-05. [2025-09-26T21:46:09.238016] [INFO ] [MAIN ] TSN: Full history saved. [2025-09-26T21:46:09.267454] [INFO ] [MAIN ] Update Progress: 2143/2371 symbols completed. TSN took 45.4s. Estimated remaining: 30m 26s. Rate: 7.5 symbols/min [2025-09-26T21:46:09.501379] [INFO ] [REMOTE ] TTE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:46:09.535072] [INFO ] [REMOTE ] TTE: Fetching primary data for 2024-12. [2025-09-26T21:46:09.624547] [INFO ] [MAIN ] TTI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:46:09.628240] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-26T21:46:09.681256] [DEBUG] [LOCAL ] TTI: Loaded 45740 existing records from primary storage. [2025-09-26T21:46:09.681444] [INFO ] [MAIN ] TTI: Loaded 45740 existing records. [2025-09-26T21:46:09.874955] [WARN ] [MAIN ] TTI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:46:09.875241] [INFO ] [MAIN ] TTI: Wiping existing primary data before full refresh. [2025-09-26T21:46:09.875289] [INFO ] [LOCAL ] TTI: Starting deletion of primary data. [2025-09-26T21:46:09.876291] [DEBUG] [LOCAL ] TTI: Deleted primary data file. [2025-09-26T21:46:09.876352] [INFO ] [MAIN ] TTI: Starting full primary refresh. [2025-09-26T21:46:10.245104] [INFO ] [REMOTE ] TTI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:46:10.311782] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-05. [2025-09-26T21:46:10.917365] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-26T21:46:11.111750] [INFO ] [REMOTE ] TTI: Fetching primary data for 2024-12. [2025-09-26T21:46:11.505344] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-26T21:46:11.711080] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-26T21:46:11.911747] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-01. [2025-09-26T21:46:12.711780] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-06. [2025-09-26T21:46:12.818183] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-26T21:46:13.511722] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-06. [2025-09-26T21:46:13.743339] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-26T21:46:14.306488] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-26T21:46:14.316033] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-02. [2025-09-26T21:46:14.644425] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-26T21:46:15.111755] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-07. [2025-09-26T21:46:15.911704] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-01. [2025-09-26T21:46:16.085506] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-26T21:46:16.711707] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-03. [2025-09-26T21:46:16.819618] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-26T21:46:17.447423] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-26T21:46:17.511758] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-08. [2025-09-26T21:46:18.311709] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-02. [2025-09-26T21:46:18.616976] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-26T21:46:18.992877] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-26T21:46:19.111713] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-04. [2025-09-26T21:46:19.911710] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-07. [2025-09-26T21:46:19.963416] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-26T21:46:20.711727] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-03. [2025-09-26T21:46:21.394665] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-26T21:46:21.511737] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-08. [2025-09-26T21:46:22.181833] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-04 (3.07 seconds). [2025-09-26T21:46:22.311707] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-09. [2025-09-26T21:46:22.341455] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-26T21:46:22.791070] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-26T21:46:23.111726] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-04. [2025-09-26T21:46:23.848202] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-26T21:46:23.856362] [INFO ] [REMOTE ] TTC: Full fetch complete (62178 records). [2025-09-26T21:46:23.856523] [DEBUG] [VALIDATOR ] TTC: Validating primary data. [2025-09-26T21:46:23.917004] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-05. [2025-09-26T21:46:24.280290] [DEBUG] [VALIDATOR ] TTC: All expected trading days are present. [2025-09-26T21:46:24.280381] [DEBUG] [VALIDATOR ] TTC: Primary data validation passed. [2025-09-26T21:46:24.281426] [INFO ] [MAIN ] TTC: Fetched primary data is valid. [2025-09-26T21:46:24.281491] [DEBUG] [LOCAL ] TTC: Saving primary data. [2025-09-26T21:46:24.282832] [DEBUG] [LOCAL ] TTC: Trimmed 62178 records to 43005 (keeping 200 days of data) [2025-09-26T21:46:24.546426] [DEBUG] [LOCAL ] TTC: Primary data saved (43005 records). [2025-09-26T21:46:24.546557] [INFO ] [MAIN ] TTC: Full history saved. [2025-09-26T21:46:24.546745] [INFO ] [MAIN ] Update Progress: 2144/2371 symbols completed. TTC took 27.1s. Estimated remaining: 30m 19s. Rate: 7.5 symbols/min [2025-09-26T21:46:24.711949] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-09. [2025-09-26T21:46:24.731585] [INFO ] [MAIN ] TU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:46:24.783201] [DEBUG] [LOCAL ] TU: Loaded 50254 existing records from primary storage. [2025-09-26T21:46:24.783579] [INFO ] [MAIN ] TU: Loaded 50254 existing records. [2025-09-26T21:46:24.975206] [WARN ] [MAIN ] TU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:46:24.975617] [INFO ] [MAIN ] TU: Wiping existing primary data before full refresh. [2025-09-26T21:46:24.991034] [INFO ] [LOCAL ] TU: Starting deletion of primary data. [2025-09-26T21:46:25.005526] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-26T21:46:25.005598] [DEBUG] [LOCAL ] TU: Deleted primary data file. [2025-09-26T21:46:25.005886] [INFO ] [MAIN ] TU: Starting full primary refresh. [2025-09-26T21:46:25.387257] [INFO ] [REMOTE ] TU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:46:25.511686] [INFO ] [REMOTE ] TU: Fetching primary data for 2024-12. [2025-09-26T21:46:25.816420] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-26T21:46:25.921159] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-26T21:46:25.926760] [INFO ] [REMOTE ] TTAM: Full fetch complete (33311 records). [2025-09-26T21:46:25.926855] [DEBUG] [VALIDATOR ] TTAM: Validating primary data. [2025-09-26T21:46:26.122606] [WARN ] [VALIDATOR ] TTAM: Validation failed - insufficient historical data. Have 160 unique days, need 200 days [2025-09-26T21:46:26.123104] [FATAL] [MAIN ] TTAM: Fetched primary data is invalid. Refusing to save it. [2025-09-26T21:46:26.123177] [WARN ] [MAIN ] TTAM: Deleting existing primary and derivative data due to validation failure. [2025-09-26T21:46:26.123250] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-09-26T21:46:26.123316] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-09-26T21:46:26.123355] [INFO ] [LOCAL ] TTAM: Starting deletion of derivative data. [2025-09-26T21:46:26.123412] [DEBUG] [LOCAL ] TTAM: No derivative data file found to delete. [2025-09-26T21:46:26.123509] [INFO ] [MAIN ] Update Progress: 2145/2371 symbols completed. TTAM took 33.0s. Estimated remaining: 30m 10s. Rate: 7.5 symbols/min [2025-09-26T21:46:26.306245] [INFO ] [MAIN ] TUYA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:46:26.311749] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-06. [2025-09-26T21:46:26.367011] [DEBUG] [LOCAL ] TUYA: Loaded 46865 existing records from primary storage. [2025-09-26T21:46:26.367253] [INFO ] [MAIN ] TUYA: Loaded 46865 existing records. [2025-09-26T21:46:26.553031] [WARN ] [MAIN ] TUYA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:46:26.553484] [INFO ] [MAIN ] TUYA: Wiping existing primary data before full refresh. [2025-09-26T21:46:26.553555] [INFO ] [LOCAL ] TUYA: Starting deletion of primary data. [2025-09-26T21:46:26.554591] [DEBUG] [LOCAL ] TUYA: Deleted primary data file. [2025-09-26T21:46:26.554708] [INFO ] [MAIN ] TUYA: Starting full primary refresh. [2025-09-26T21:46:26.916809] [INFO ] [REMOTE ] TUYA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:46:27.111715] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-05. [2025-09-26T21:46:27.385294] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-26T21:46:27.911746] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-01. [2025-09-26T21:46:28.253255] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-26T21:46:28.397404] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-26T21:46:28.711796] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-07. [2025-09-26T21:46:29.511756] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-06. [2025-09-26T21:46:29.846955] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-26T21:46:30.311736] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2024-12. [2025-09-26T21:46:30.718974] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-26T21:46:31.111759] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-02. [2025-09-26T21:46:31.161329] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-26T21:46:31.852527] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-26T21:46:31.911671] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-01. [2025-09-26T21:46:32.716829] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-07. [2025-09-26T21:46:32.733061] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-26T21:46:32.954931] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-26T21:46:33.511744] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-08. [2025-09-26T21:46:34.311719] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-02. [2025-09-26T21:46:34.368356] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-26T21:46:35.111782] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-08. [2025-09-26T21:46:35.284267] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-26T21:46:35.911697] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-09. [2025-09-26T21:46:36.472886] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-26T21:46:36.711734] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-03. [2025-09-26T21:46:36.798600] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-26T21:46:37.511781] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-09. [2025-09-26T21:46:37.755893] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-26T21:46:37.767005] [INFO ] [REMOTE ] TTE: Full fetch complete (75054 records). [2025-09-26T21:46:37.767234] [DEBUG] [VALIDATOR ] TTE: Validating primary data. [2025-09-26T21:46:38.222970] [DEBUG] [VALIDATOR ] TTE: All expected trading days are present. [2025-09-26T21:46:38.223152] [DEBUG] [VALIDATOR ] TTE: Primary data validation passed. [2025-09-26T21:46:38.225260] [INFO ] [MAIN ] TTE: Fetched primary data is valid. [2025-09-26T21:46:38.225355] [DEBUG] [LOCAL ] TTE: Saving primary data. [2025-09-26T21:46:38.227519] [DEBUG] [LOCAL ] TTE: Trimmed 75054 records to 52395 (keeping 200 days of data) [2025-09-26T21:46:38.324366] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-03. [2025-09-26T21:46:38.373837] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-26T21:46:38.614512] [DEBUG] [LOCAL ] TTE: Primary data saved (52395 records). [2025-09-26T21:46:38.614749] [INFO ] [MAIN ] TTE: Full history saved. [2025-09-26T21:46:38.614896] [INFO ] [MAIN ] Update Progress: 2146/2371 symbols completed. TTE took 30.6s. Estimated remaining: 30m 3s. Rate: 7.5 symbols/min [2025-09-26T21:46:38.789289] [INFO ] [MAIN ] TV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:46:38.832795] [DEBUG] [LOCAL ] TV: Loaded 43277 existing records from primary storage. [2025-09-26T21:46:38.833036] [INFO ] [MAIN ] TV: Loaded 43277 existing records. [2025-09-26T21:46:39.028155] [WARN ] [MAIN ] TV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:46:39.028725] [INFO ] [MAIN ] TV: Wiping existing primary data before full refresh. [2025-09-26T21:46:39.028799] [INFO ] [LOCAL ] TV: Starting deletion of primary data. [2025-09-26T21:46:39.041917] [DEBUG] [LOCAL ] TV: Deleted primary data file. [2025-09-26T21:46:39.047344] [INFO ] [MAIN ] TV: Starting full primary refresh. [2025-09-26T21:46:39.123447] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-04. [2025-09-26T21:46:39.139105] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-26T21:46:39.222322] [INFO ] [REMOTE ] TTI: Full fetch complete (65068 records). [2025-09-26T21:46:39.229432] [DEBUG] [VALIDATOR ] TTI: Validating primary data. [2025-09-26T21:46:39.760795] [INFO ] [REMOTE ] TV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:46:39.916483] [INFO ] [REMOTE ] TV: Fetching primary data for 2024-12. [2025-09-26T21:46:39.957319] [DEBUG] [VALIDATOR ] TTI: All expected trading days are present. [2025-09-26T21:46:39.957571] [DEBUG] [VALIDATOR ] TTI: Primary data validation passed. [2025-09-26T21:46:39.960043] [INFO ] [MAIN ] TTI: Fetched primary data is valid. [2025-09-26T21:46:39.960378] [DEBUG] [LOCAL ] TTI: Saving primary data. [2025-09-26T21:46:39.962052] [DEBUG] [LOCAL ] TTI: Trimmed 65068 records to 46112 (keeping 200 days of data) [2025-09-26T21:46:40.243624] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-26T21:46:40.278023] [DEBUG] [LOCAL ] TTI: Primary data saved (46112 records). [2025-09-26T21:46:40.278685] [INFO ] [MAIN ] TTI: Full history saved. [2025-09-26T21:46:40.279021] [INFO ] [MAIN ] Update Progress: 2147/2371 symbols completed. TTI took 31.0s. Estimated remaining: 29m 54s. Rate: 7.5 symbols/min [2025-09-26T21:46:40.469140] [INFO ] [MAIN ] TVC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:46:40.475935] [DEBUG] [LOCAL ] TVC: Loaded 3455 existing records from primary storage. [2025-09-26T21:46:40.476058] [INFO ] [MAIN ] TVC: Loaded 3455 existing records. [2025-09-26T21:46:40.674619] [WARN ] [MAIN ] TVC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:46:40.675374] [INFO ] [MAIN ] TVC: Wiping existing primary data before full refresh. [2025-09-26T21:46:40.675513] [INFO ] [LOCAL ] TVC: Starting deletion of primary data. [2025-09-26T21:46:40.675848] [DEBUG] [LOCAL ] TVC: Deleted primary data file. [2025-09-26T21:46:40.675910] [INFO ] [MAIN ] TVC: Starting full primary refresh. [2025-09-26T21:46:40.723308] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-04. [2025-09-26T21:46:41.065598] [INFO ] [REMOTE ] TVC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:46:41.096352] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-26T21:46:41.511719] [INFO ] [REMOTE ] TVC: Fetching primary data for 2024-12. [2025-09-26T21:46:41.662462] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-26T21:46:42.211383] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-26T21:46:42.311744] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-01. [2025-09-26T21:46:42.773706] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-26T21:46:43.111736] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-05. [2025-09-26T21:46:43.911760] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-05. [2025-09-26T21:46:43.990867] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-26T21:46:44.711738] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-02. [2025-09-26T21:46:45.006116] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-26T21:46:45.511744] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-01. [2025-09-26T21:46:45.725407] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-26T21:46:46.000449] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-26T21:46:46.107902] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-26T21:46:46.311724] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-02. [2025-09-26T21:46:46.940707] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-26T21:46:47.111787] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-03. [2025-09-26T21:46:47.730789] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-26T21:46:47.911754] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-04. [2025-09-26T21:46:48.501576] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-26T21:46:48.711733] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-06. [2025-09-26T21:46:49.511773] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-03. [2025-09-26T21:46:50.311731] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-06. [2025-09-26T21:46:50.364520] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-26T21:46:50.913501] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-26T21:46:51.111738] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-04. [2025-09-26T21:46:51.911715] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-05. [2025-09-26T21:46:51.976569] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-26T21:46:52.481633] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-26T21:46:52.720129] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-07. [2025-09-26T21:46:52.727187] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-26T21:46:53.511757] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-06. [2025-09-26T21:46:54.104010] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-26T21:46:54.323026] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-07. [2025-09-26T21:46:54.344659] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-26T21:46:55.111722] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-07. [2025-09-26T21:46:55.673293] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-26T21:46:55.911724] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-05. [2025-09-26T21:46:56.065703] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-26T21:46:56.711790] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-08. [2025-09-26T21:46:57.511710] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-08. [2025-09-26T21:46:57.635345] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-26T21:46:58.311757] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-06. [2025-09-26T21:46:58.382687] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-26T21:46:58.881567] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-26T21:46:59.111710] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-09. [2025-09-26T21:46:59.814004] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-26T21:46:59.911727] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-07. [2025-09-26T21:47:00.711691] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-09. [2025-09-26T21:47:00.814099] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-26T21:47:00.823903] [INFO ] [REMOTE ] TU: Full fetch complete (72896 records). [2025-09-26T21:47:00.824156] [DEBUG] [VALIDATOR ] TU: Validating primary data. [2025-09-26T21:47:01.266907] [DEBUG] [VALIDATOR ] TU: All expected trading days are present. [2025-09-26T21:47:01.267061] [DEBUG] [VALIDATOR ] TU: Primary data validation passed. [2025-09-26T21:47:01.268325] [INFO ] [MAIN ] TU: Fetched primary data is valid. [2025-09-26T21:47:01.268418] [DEBUG] [LOCAL ] TU: Saving primary data. [2025-09-26T21:47:01.270210] [DEBUG] [LOCAL ] TU: Trimmed 72896 records to 50606 (keeping 200 days of data) [2025-09-26T21:47:01.398459] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-26T21:47:01.519555] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-08. [2025-09-26T21:47:01.628559] [DEBUG] [LOCAL ] TU: Primary data saved (50606 records). [2025-09-26T21:47:01.628741] [INFO ] [MAIN ] TU: Full history saved. [2025-09-26T21:47:01.628860] [INFO ] [MAIN ] Update Progress: 2148/2371 symbols completed. TU took 37.1s. Estimated remaining: 29m 48s. Rate: 7.5 symbols/min [2025-09-26T21:47:01.816125] [INFO ] [MAIN ] TVE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:47:01.821675] [DEBUG] [LOCAL ] TVE: Loaded 2786 existing records from primary storage. [2025-09-26T21:47:01.821781] [INFO ] [MAIN ] TVE: Loaded 2786 existing records. [2025-09-26T21:47:02.017611] [WARN ] [MAIN ] TVE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:47:02.018007] [INFO ] [MAIN ] TVE: Wiping existing primary data before full refresh. [2025-09-26T21:47:02.018060] [INFO ] [LOCAL ] TVE: Starting deletion of primary data. [2025-09-26T21:47:02.018346] [DEBUG] [LOCAL ] TVE: Deleted primary data file. [2025-09-26T21:47:02.018411] [INFO ] [MAIN ] TVE: Starting full primary refresh. [2025-09-26T21:47:02.312284] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-08. [2025-09-26T21:47:02.474802] [INFO ] [REMOTE ] TVE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:47:02.499455] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-26T21:47:02.508500] [INFO ] [REMOTE ] TUYA: Full fetch complete (65778 records). [2025-09-26T21:47:02.508684] [DEBUG] [VALIDATOR ] TUYA: Validating primary data. [2025-09-26T21:47:02.916276] [DEBUG] [VALIDATOR ] TUYA: All expected trading days are present. [2025-09-26T21:47:02.916947] [DEBUG] [VALIDATOR ] TUYA: Primary data validation passed. [2025-09-26T21:47:02.918497] [INFO ] [MAIN ] TUYA: Fetched primary data is valid. [2025-09-26T21:47:02.922665] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-26T21:47:02.922753] [DEBUG] [LOCAL ] TUYA: Saving primary data. [2025-09-26T21:47:02.926041] [DEBUG] [LOCAL ] TUYA: Trimmed 65778 records to 47185 (keeping 200 days of data) [2025-09-26T21:47:03.068178] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-26T21:47:03.129446] [INFO ] [REMOTE ] TVE: Fetching primary data for 2024-12. [2025-09-26T21:47:03.243548] [DEBUG] [LOCAL ] TUYA: Primary data saved (47185 records). [2025-09-26T21:47:03.243732] [INFO ] [MAIN ] TUYA: Full history saved. [2025-09-26T21:47:03.243842] [INFO ] [MAIN ] Update Progress: 2149/2371 symbols completed. TUYA took 37.1s. Estimated remaining: 29m 39s. Rate: 7.5 symbols/min [2025-09-26T21:47:03.426322] [INFO ] [MAIN ] TWI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:47:03.459825] [DEBUG] [LOCAL ] TWI: Loaded 34766 existing records from primary storage. [2025-09-26T21:47:03.459972] [INFO ] [MAIN ] TWI: Loaded 34766 existing records. [2025-09-26T21:47:03.668949] [WARN ] [MAIN ] TWI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:47:03.669198] [INFO ] [MAIN ] TWI: Wiping existing primary data before full refresh. [2025-09-26T21:47:03.669248] [INFO ] [LOCAL ] TWI: Starting deletion of primary data. [2025-09-26T21:47:03.670170] [DEBUG] [LOCAL ] TWI: Deleted primary data file. [2025-09-26T21:47:03.670233] [INFO ] [MAIN ] TWI: Starting full primary refresh. [2025-09-26T21:47:03.878548] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-26T21:47:03.916833] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-09. [2025-09-26T21:47:04.075961] [INFO ] [REMOTE ] TWI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:47:04.711711] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-01. [2025-09-26T21:47:05.348029] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-26T21:47:05.511709] [INFO ] [REMOTE ] TWI: Fetching primary data for 2024-12. [2025-09-26T21:47:05.669922] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-26T21:47:05.677981] [INFO ] [REMOTE ] TV: Full fetch complete (62229 records). [2025-09-26T21:47:05.678116] [DEBUG] [VALIDATOR ] TV: Validating primary data. [2025-09-26T21:47:06.092583] [DEBUG] [VALIDATOR ] TV: All expected trading days are present. [2025-09-26T21:47:06.092706] [DEBUG] [VALIDATOR ] TV: Primary data validation passed. [2025-09-26T21:47:06.093685] [INFO ] [MAIN ] TV: Fetched primary data is valid. [2025-09-26T21:47:06.093762] [DEBUG] [LOCAL ] TV: Saving primary data. [2025-09-26T21:47:06.095133] [DEBUG] [LOCAL ] TV: Trimmed 62229 records to 43514 (keeping 200 days of data) [2025-09-26T21:47:06.311750] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-09. [2025-09-26T21:47:06.361713] [DEBUG] [LOCAL ] TV: Primary data saved (43514 records). [2025-09-26T21:47:06.361846] [INFO ] [MAIN ] TV: Full history saved. [2025-09-26T21:47:06.361933] [INFO ] [MAIN ] Update Progress: 2150/2371 symbols completed. TV took 27.7s. Estimated remaining: 29m 30s. Rate: 7.5 symbols/min [2025-09-26T21:47:06.541369] [INFO ] [MAIN ] TWLO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:47:06.594100] [DEBUG] [LOCAL ] TWLO: Loaded 53111 existing records from primary storage. [2025-09-26T21:47:06.594259] [INFO ] [MAIN ] TWLO: Loaded 53111 existing records. [2025-09-26T21:47:06.781463] [WARN ] [MAIN ] TWLO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:47:06.781739] [INFO ] [MAIN ] TWLO: Wiping existing primary data before full refresh. [2025-09-26T21:47:06.781797] [INFO ] [LOCAL ] TWLO: Starting deletion of primary data. [2025-09-26T21:47:06.783174] [DEBUG] [LOCAL ] TWLO: Deleted primary data file. [2025-09-26T21:47:06.783240] [INFO ] [MAIN ] TWLO: Starting full primary refresh. [2025-09-26T21:47:06.882940] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-26T21:47:06.911500] [INFO ] [REMOTE ] TVC: Full fetch complete (5633 records). [2025-09-26T21:47:06.934750] [DEBUG] [VALIDATOR ] TVC: Validating primary data. [2025-09-26T21:47:07.122043] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-02. [2025-09-26T21:47:07.390316] [INFO ] [REMOTE ] TWLO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:47:07.585732] [DEBUG] [VALIDATOR ] TVC: All expected trading days are present. [2025-09-26T21:47:07.586000] [DEBUG] [VALIDATOR ] TVC: Primary data validation passed. [2025-09-26T21:47:07.586325] [INFO ] [MAIN ] TVC: Fetched primary data is valid. [2025-09-26T21:47:07.586737] [DEBUG] [LOCAL ] TVC: Saving primary data. [2025-09-26T21:47:07.588239] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-26T21:47:07.598783] [DEBUG] [LOCAL ] TVC: Trimmed 5633 records to 3466 (keeping 200 days of data) [2025-09-26T21:47:07.620996] [DEBUG] [LOCAL ] TVC: Primary data saved (3466 records). [2025-09-26T21:47:07.621134] [INFO ] [MAIN ] TVC: Full history saved. [2025-09-26T21:47:07.621236] [INFO ] [MAIN ] Update Progress: 2151/2371 symbols completed. TVC took 27.3s. Estimated remaining: 29m 22s. Rate: 7.5 symbols/min [2025-09-26T21:47:07.801141] [INFO ] [MAIN ] TWN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:47:07.806423] [DEBUG] [LOCAL ] TWN: Loaded 3228 existing records from primary storage. [2025-09-26T21:47:07.806565] [INFO ] [MAIN ] TWN: Loaded 3228 existing records. [2025-09-26T21:47:07.908961] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-26T21:47:07.915725] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2024-12. [2025-09-26T21:47:08.045629] [WARN ] [MAIN ] TWN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:47:08.045926] [INFO ] [MAIN ] TWN: Wiping existing primary data before full refresh. [2025-09-26T21:47:08.046017] [INFO ] [LOCAL ] TWN: Starting deletion of primary data. [2025-09-26T21:47:08.046379] [DEBUG] [LOCAL ] TWN: Deleted primary data file. [2025-09-26T21:47:08.046480] [INFO ] [MAIN ] TWN: Starting full primary refresh. [2025-09-26T21:47:08.472151] [INFO ] [REMOTE ] TWN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:47:08.711728] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-01. [2025-09-26T21:47:09.511719] [INFO ] [REMOTE ] TWN: Fetching primary data for 2024-12. [2025-09-26T21:47:10.123933] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-26T21:47:10.149683] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-26T21:47:10.191244] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-09-26T21:47:10.311723] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-01. [2025-09-26T21:47:10.901259] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-26T21:47:11.111720] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-01. [2025-09-26T21:47:11.911734] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-02. [2025-09-26T21:47:12.509432] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-26T21:47:12.711733] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-03. [2025-09-26T21:47:13.242505] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-26T21:47:13.413591] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-26T21:47:13.511702] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-03. [2025-09-26T21:47:14.220303] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-26T21:47:14.311712] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-02. [2025-09-26T21:47:15.111733] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-02. [2025-09-26T21:47:15.911722] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-04. [2025-09-26T21:47:16.557517] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-09-26T21:47:16.572298] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-26T21:47:16.665248] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-26T21:47:16.711672] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-03. [2025-09-26T21:47:17.511719] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-03. [2025-09-26T21:47:18.311747] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-04. [2025-09-26T21:47:18.757046] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-26T21:47:18.810021] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-26T21:47:18.941480] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-26T21:47:19.111733] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-04. [2025-09-26T21:47:19.911726] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-05. [2025-09-26T21:47:20.510622] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-26T21:47:20.711717] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-04. [2025-09-26T21:47:21.056271] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-26T21:47:21.511725] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-06. [2025-09-26T21:47:22.150314] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-26T21:47:22.214839] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-26T21:47:22.311708] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-05. [2025-09-26T21:47:22.783698] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-26T21:47:23.111720] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-07. [2025-09-26T21:47:23.677788] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-26T21:47:23.911727] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-05. [2025-09-26T21:47:24.711751] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-06. [2025-09-26T21:47:25.330961] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-26T21:47:25.366841] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-26T21:47:25.511707] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-08. [2025-09-26T21:47:25.978736] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-26T21:47:26.311756] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-06. [2025-09-26T21:47:27.111720] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-07. [2025-09-26T21:47:27.669748] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-26T21:47:27.783079] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-26T21:47:27.911731] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-08. [2025-09-26T21:47:28.368442] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-26T21:47:28.711724] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-09. [2025-09-26T21:47:29.259413] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-26T21:47:29.260556] [INFO ] [REMOTE ] TVE: Full fetch complete (4343 records). [2025-09-26T21:47:29.260628] [DEBUG] [VALIDATOR ] TVE: Validating primary data. [2025-09-26T21:47:29.520767] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-05. [2025-09-26T21:47:29.652149] [DEBUG] [VALIDATOR ] TVE: All expected trading days are present. [2025-09-26T21:47:29.652230] [DEBUG] [VALIDATOR ] TVE: Primary data validation passed. [2025-09-26T21:47:29.652370] [INFO ] [MAIN ] TVE: Fetched primary data is valid. [2025-09-26T21:47:29.652426] [DEBUG] [LOCAL ] TVE: Saving primary data. [2025-09-26T21:47:29.652848] [DEBUG] [LOCAL ] TVE: Trimmed 4343 records to 2795 (keeping 200 days of data) [2025-09-26T21:47:29.670257] [DEBUG] [LOCAL ] TVE: Primary data saved (2795 records). [2025-09-26T21:47:29.670373] [INFO ] [MAIN ] TVE: Full history saved. [2025-09-26T21:47:29.670566] [INFO ] [MAIN ] Update Progress: 2152/2371 symbols completed. TVE took 28.0s. Estimated remaining: 29m 15s. Rate: 7.5 symbols/min [2025-09-26T21:47:29.852950] [INFO ] [MAIN ] TWO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:47:29.911462] [DEBUG] [LOCAL ] TWO: Loaded 48681 existing records from primary storage. [2025-09-26T21:47:29.911631] [INFO ] [MAIN ] TWO: Loaded 48681 existing records. [2025-09-26T21:47:30.095908] [WARN ] [MAIN ] TWO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:47:30.096281] [INFO ] [MAIN ] TWO: Wiping existing primary data before full refresh. [2025-09-26T21:47:30.096346] [INFO ] [LOCAL ] TWO: Starting deletion of primary data. [2025-09-26T21:47:30.097632] [DEBUG] [LOCAL ] TWO: Deleted primary data file. [2025-09-26T21:47:30.097723] [INFO ] [MAIN ] TWO: Starting full primary refresh. [2025-09-26T21:47:30.318351] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-07. [2025-09-26T21:47:30.475883] [INFO ] [REMOTE ] TWO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:47:31.111726] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-09. [2025-09-26T21:47:31.430300] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-26T21:47:31.448363] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-26T21:47:31.450182] [INFO ] [REMOTE ] TWN: Full fetch complete (5362 records). [2025-09-26T21:47:31.450271] [DEBUG] [VALIDATOR ] TWN: Validating primary data. [2025-09-26T21:47:31.836596] [DEBUG] [VALIDATOR ] TWN: All expected trading days are present. [2025-09-26T21:47:31.836765] [DEBUG] [VALIDATOR ] TWN: Primary data validation passed. [2025-09-26T21:47:31.836991] [INFO ] [MAIN ] TWN: Fetched primary data is valid. [2025-09-26T21:47:31.837071] [DEBUG] [LOCAL ] TWN: Saving primary data. [2025-09-26T21:47:31.837807] [DEBUG] [LOCAL ] TWN: Trimmed 5362 records to 3250 (keeping 200 days of data) [2025-09-26T21:47:31.874983] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-26T21:47:31.892677] [DEBUG] [LOCAL ] TWN: Primary data saved (3250 records). [2025-09-26T21:47:31.892827] [INFO ] [MAIN ] TWN: Full history saved. [2025-09-26T21:47:31.892945] [INFO ] [MAIN ] Update Progress: 2153/2371 symbols completed. TWN took 24.3s. Estimated remaining: 29m 7s. Rate: 7.5 symbols/min [2025-09-26T21:47:31.916807] [INFO ] [REMOTE ] TWO: Fetching primary data for 2024-12. [2025-09-26T21:47:32.073068] [INFO ] [MAIN ] TWOD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:47:32.073251] [DEBUG] [LOCAL ] TWOD: No existing data file found in primary storage. [2025-09-26T21:47:32.073307] [WARN ] [MAIN ] TWOD: No existing data found, performing full refresh instead. [2025-09-26T21:47:32.073453] [INFO ] [MAIN ] TWOD: Wiping existing primary data before full refresh. [2025-09-26T21:47:32.073496] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-09-26T21:47:32.073538] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-09-26T21:47:32.073570] [INFO ] [MAIN ] TWOD: Starting full primary refresh. [2025-09-26T21:47:32.446182] [INFO ] [REMOTE ] TWOD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:47:32.711717] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2024-12. [2025-09-26T21:47:32.917335] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:47:32.917720] [WARN ] [REMOTE ] TWOD: No data returned for month 2024-12 [2025-09-26T21:47:33.511735] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-08. [2025-09-26T21:47:33.725994] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-26T21:47:34.311725] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-01. [2025-09-26T21:47:34.520955] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:47:34.521299] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-01 [2025-09-26T21:47:34.803373] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-26T21:47:35.111742] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-06. [2025-09-26T21:47:35.911743] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-01. [2025-09-26T21:47:36.711765] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-02. [2025-09-26T21:47:36.907275] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:47:36.907663] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-02 [2025-09-26T21:47:37.286666] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-26T21:47:37.511715] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-07. [2025-09-26T21:47:37.551203] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-26T21:47:38.311745] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-02. [2025-09-26T21:47:39.111735] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-09. [2025-09-26T21:47:39.550236] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-26T21:47:39.891201] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-26T21:47:39.911678] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-03. [2025-09-26T21:47:40.090916] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-26T21:47:40.097422] [INFO ] [REMOTE ] TWI: Full fetch complete (53149 records). [2025-09-26T21:47:40.097555] [DEBUG] [VALIDATOR ] TWI: Validating primary data. [2025-09-26T21:47:40.503962] [DEBUG] [VALIDATOR ] TWI: All expected trading days are present. [2025-09-26T21:47:40.504049] [DEBUG] [VALIDATOR ] TWI: Primary data validation passed. [2025-09-26T21:47:40.505234] [INFO ] [MAIN ] TWI: Fetched primary data is valid. [2025-09-26T21:47:40.505316] [DEBUG] [LOCAL ] TWI: Saving primary data. [2025-09-26T21:47:40.506533] [DEBUG] [LOCAL ] TWI: Trimmed 53149 records to 34981 (keeping 200 days of data) [2025-09-26T21:47:40.711743] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-08. [2025-09-26T21:47:40.715575] [DEBUG] [LOCAL ] TWI: Primary data saved (34981 records). [2025-09-26T21:47:40.715728] [INFO ] [MAIN ] TWI: Full history saved. [2025-09-26T21:47:40.715834] [INFO ] [MAIN ] Update Progress: 2154/2371 symbols completed. TWI took 37.5s. Estimated remaining: 28m 59s. Rate: 7.5 symbols/min [2025-09-26T21:47:40.905279] [INFO ] [MAIN ] TX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:47:40.930038] [DEBUG] [LOCAL ] TX: Loaded 23787 existing records from primary storage. [2025-09-26T21:47:40.930182] [INFO ] [MAIN ] TX: Loaded 23787 existing records. [2025-09-26T21:47:41.125471] [WARN ] [MAIN ] TX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:47:41.125777] [INFO ] [MAIN ] TX: Wiping existing primary data before full refresh. [2025-09-26T21:47:41.125832] [INFO ] [LOCAL ] TX: Starting deletion of primary data. [2025-09-26T21:47:41.126707] [DEBUG] [LOCAL ] TX: Deleted primary data file. [2025-09-26T21:47:41.126774] [INFO ] [MAIN ] TX: Starting full primary refresh. [2025-09-26T21:47:41.534506] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-03. [2025-09-26T21:47:41.580512] [INFO ] [REMOTE ] TX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:47:41.670899] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-26T21:47:41.797235] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:47:41.797669] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-03 [2025-09-26T21:47:42.311744] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-04. [2025-09-26T21:47:42.515036] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:47:42.515377] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-04 [2025-09-26T21:47:42.925784] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-26T21:47:43.111742] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-09. [2025-09-26T21:47:43.911737] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-04. [2025-09-26T21:47:44.711690] [INFO ] [REMOTE ] TX: Fetching primary data for 2024-12. [2025-09-26T21:47:45.069553] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-26T21:47:45.080023] [INFO ] [REMOTE ] TWLO: Full fetch complete (76451 records). [2025-09-26T21:47:45.080190] [DEBUG] [VALIDATOR ] TWLO: Validating primary data. [2025-09-26T21:47:45.520963] [DEBUG] [VALIDATOR ] TWLO: All expected trading days are present. [2025-09-26T21:47:45.517286] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-05. [2025-09-26T21:47:45.523053] [DEBUG] [VALIDATOR ] TWLO: Primary data validation passed. [2025-09-26T21:47:45.524196] [INFO ] [MAIN ] TWLO: Fetched primary data is valid. [2025-09-26T21:47:45.524298] [DEBUG] [LOCAL ] TWLO: Saving primary data. [2025-09-26T21:47:45.529505] [DEBUG] [LOCAL ] TWLO: Trimmed 76451 records to 53501 (keeping 200 days of data) [2025-09-26T21:47:45.897525] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-26T21:47:45.924327] [DEBUG] [LOCAL ] TWLO: Primary data saved (53501 records). [2025-09-26T21:47:45.924467] [INFO ] [MAIN ] TWLO: Full history saved. [2025-09-26T21:47:45.924691] [INFO ] [MAIN ] Update Progress: 2155/2371 symbols completed. TWLO took 39.6s. Estimated remaining: 28m 50s. Rate: 7.5 symbols/min [2025-09-26T21:47:46.078468] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-26T21:47:46.078968] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-26T21:47:46.143500] [INFO ] [MAIN ] TXNM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:47:46.199888] [DEBUG] [LOCAL ] TXNM: Loaded 44153 existing records from primary storage. [2025-09-26T21:47:46.200043] [INFO ] [MAIN ] TXNM: Loaded 44153 existing records. [2025-09-26T21:47:46.316813] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-05. [2025-09-26T21:47:46.391856] [WARN ] [MAIN ] TXNM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:47:46.392107] [INFO ] [MAIN ] TXNM: Wiping existing primary data before full refresh. [2025-09-26T21:47:46.392165] [INFO ] [LOCAL ] TXNM: Starting deletion of primary data. [2025-09-26T21:47:46.393356] [DEBUG] [LOCAL ] TXNM: Deleted primary data file. [2025-09-26T21:47:46.393432] [INFO ] [MAIN ] TXNM: Starting full primary refresh. [2025-09-26T21:47:46.777880] [INFO ] [REMOTE ] TXNM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:47:47.111721] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2024-12. [2025-09-26T21:47:47.911707] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-06. [2025-09-26T21:47:48.172944] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-26T21:47:48.482850] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-26T21:47:48.652125] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-26T21:47:48.711736] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-01. [2025-09-26T21:47:49.511748] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-06. [2025-09-26T21:47:50.295545] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-26T21:47:50.311663] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-02. [2025-09-26T21:47:51.111799] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-07. [2025-09-26T21:47:51.238510] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-26T21:47:51.628594] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-26T21:47:51.739054] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-26T21:47:51.911721] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-03. [2025-09-26T21:47:52.711717] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-08. [2025-09-26T21:47:53.484624] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-26T21:47:53.511678] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-09. [2025-09-26T21:47:53.657718] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-26T21:47:54.115037] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-26T21:47:54.117514] [INFO ] [REMOTE ] TWOD: Full fetch complete (4326 records). [2025-09-26T21:47:54.117611] [DEBUG] [VALIDATOR ] TWOD: Validating primary data. [2025-09-26T21:47:54.315146] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-07. [2025-09-26T21:47:54.331632] [WARN ] [VALIDATOR ] TWOD: Validation failed - insufficient historical data. Have 92 unique days, need 200 days [2025-09-26T21:47:54.333058] [FATAL] [MAIN ] TWOD: Fetched primary data is invalid. Refusing to save it. [2025-09-26T21:47:54.333147] [WARN ] [MAIN ] TWOD: Deleting existing primary and derivative data due to validation failure. [2025-09-26T21:47:54.333214] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-09-26T21:47:54.333294] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-09-26T21:47:54.333351] [INFO ] [LOCAL ] TWOD: Starting deletion of derivative data. [2025-09-26T21:47:54.333424] [DEBUG] [LOCAL ] TWOD: No derivative data file found to delete. [2025-09-26T21:47:54.333528] [INFO ] [MAIN ] Update Progress: 2156/2371 symbols completed. TWOD took 22.4s. Estimated remaining: 28m 42s. Rate: 7.5 symbols/min [2025-09-26T21:47:54.523614] [INFO ] [MAIN ] TXO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:47:54.549220] [DEBUG] [LOCAL ] TXO: Loaded 18913 existing records from primary storage. [2025-09-26T21:47:54.549433] [INFO ] [MAIN ] TXO: Loaded 18913 existing records. [2025-09-26T21:47:54.745010] [WARN ] [MAIN ] TXO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:47:54.745277] [INFO ] [MAIN ] TXO: Wiping existing primary data before full refresh. [2025-09-26T21:47:54.745327] [INFO ] [LOCAL ] TXO: Starting deletion of primary data. [2025-09-26T21:47:54.746419] [DEBUG] [LOCAL ] TXO: Deleted primary data file. [2025-09-26T21:47:54.746498] [INFO ] [MAIN ] TXO: Starting full primary refresh. [2025-09-26T21:47:55.116364] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-01. [2025-09-26T21:47:55.143139] [INFO ] [REMOTE ] TXO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:47:55.911720] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-04. [2025-09-26T21:47:56.299166] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-26T21:47:56.388568] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-26T21:47:56.711712] [INFO ] [REMOTE ] TXO: Fetching primary data for 2024-12. [2025-09-26T21:47:57.440804] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-26T21:47:57.509498] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-26T21:47:57.512521] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-05. [2025-09-26T21:47:58.311726] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-01. [2025-09-26T21:47:59.111727] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-02. [2025-09-26T21:47:59.161195] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-26T21:47:59.206959] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-26T21:47:59.911714] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-06. [2025-09-26T21:48:00.591878] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-26T21:48:00.711713] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-08. [2025-09-26T21:48:01.511692] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-03. [2025-09-26T21:48:01.587259] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-26T21:48:02.312132] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-07. [2025-09-26T21:48:02.415285] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-26T21:48:02.782629] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-26T21:48:03.111731] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-04. [2025-09-26T21:48:03.911712] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-02. [2025-09-26T21:48:03.982274] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-26T21:48:04.043260] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-26T21:48:04.711722] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-09. [2025-09-26T21:48:04.997293] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-26T21:48:05.511751] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-03. [2025-09-26T21:48:06.311733] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-05. [2025-09-26T21:48:06.335211] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-26T21:48:06.491990] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-26T21:48:06.501555] [INFO ] [REMOTE ] TWO: Full fetch complete (68913 records). [2025-09-26T21:48:06.501716] [DEBUG] [VALIDATOR ] TWO: Validating primary data. [2025-09-26T21:48:06.914328] [DEBUG] [VALIDATOR ] TWO: All expected trading days are present. [2025-09-26T21:48:06.914432] [DEBUG] [VALIDATOR ] TWO: Primary data validation passed. [2025-09-26T21:48:06.915446] [INFO ] [MAIN ] TWO: Fetched primary data is valid. [2025-09-26T21:48:06.915512] [DEBUG] [LOCAL ] TWO: Saving primary data. [2025-09-26T21:48:06.919945] [DEBUG] [LOCAL ] TWO: Trimmed 68913 records to 49002 (keeping 200 days of data) [2025-09-26T21:48:07.119237] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-08. [2025-09-26T21:48:07.251900] [DEBUG] [LOCAL ] TWO: Primary data saved (49002 records). [2025-09-26T21:48:07.252049] [INFO ] [MAIN ] TWO: Full history saved. [2025-09-26T21:48:07.252156] [INFO ] [MAIN ] Update Progress: 2157/2371 symbols completed. TWO took 37.6s. Estimated remaining: 28m 35s. Rate: 7.5 symbols/min [2025-09-26T21:48:07.402949] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-26T21:48:07.911720] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-06. [2025-09-26T21:48:08.711711] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-04. [2025-09-26T21:48:08.883217] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-26T21:48:08.993571] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-26T21:48:09.511734] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-09. [2025-09-26T21:48:09.617357] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-26T21:48:10.311744] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-07. [2025-09-26T21:48:10.873854] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-26T21:48:10.881832] [INFO ] [REMOTE ] TXNM: Full fetch complete (62657 records). [2025-09-26T21:48:10.881993] [DEBUG] [VALIDATOR ] TXNM: Validating primary data. [2025-09-26T21:48:11.142953] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-05. [2025-09-26T21:48:11.325371] [DEBUG] [VALIDATOR ] TXNM: All expected trading days are present. [2025-09-26T21:48:11.325468] [DEBUG] [VALIDATOR ] TXNM: Primary data validation passed. [2025-09-26T21:48:11.326561] [INFO ] [MAIN ] TXNM: Fetched primary data is valid. [2025-09-26T21:48:11.326681] [DEBUG] [LOCAL ] TXNM: Saving primary data. [2025-09-26T21:48:11.328361] [DEBUG] [LOCAL ] TXNM: Trimmed 62657 records to 44463 (keeping 200 days of data) [2025-09-26T21:48:11.624088] [DEBUG] [LOCAL ] TXNM: Primary data saved (44463 records). [2025-09-26T21:48:11.624247] [INFO ] [MAIN ] TXNM: Full history saved. [2025-09-26T21:48:11.624349] [INFO ] [MAIN ] Update Progress: 2158/2371 symbols completed. TXNM took 25.7s. Estimated remaining: 28m 26s. Rate: 7.5 symbols/min [2025-09-26T21:48:11.727748] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-26T21:48:11.911728] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-08. [2025-09-26T21:48:12.387723] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-26T21:48:12.711728] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-06. [2025-09-26T21:48:13.093435] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-26T21:48:13.511715] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-09. [2025-09-26T21:48:13.872994] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-26T21:48:14.311746] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-07. [2025-09-26T21:48:14.573283] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-26T21:48:14.581936] [INFO ] [REMOTE ] TX: Full fetch complete (35723 records). [2025-09-26T21:48:14.582104] [DEBUG] [VALIDATOR ] TX: Validating primary data. [2025-09-26T21:48:14.989248] [DEBUG] [VALIDATOR ] TX: All expected trading days are present. [2025-09-26T21:48:14.989334] [DEBUG] [VALIDATOR ] TX: Primary data validation passed. [2025-09-26T21:48:14.990209] [INFO ] [MAIN ] TX: Fetched primary data is valid. [2025-09-26T21:48:14.990307] [DEBUG] [LOCAL ] TX: Saving primary data. [2025-09-26T21:48:14.991466] [DEBUG] [LOCAL ] TX: Trimmed 35723 records to 23932 (keeping 200 days of data) [2025-09-26T21:48:15.152475] [DEBUG] [LOCAL ] TX: Primary data saved (23932 records). [2025-09-26T21:48:15.152703] [INFO ] [MAIN ] TX: Full history saved. [2025-09-26T21:48:15.152863] [INFO ] [MAIN ] Update Progress: 2159/2371 symbols completed. TX took 34.4s. Estimated remaining: 28m 18s. Rate: 7.5 symbols/min [2025-09-26T21:48:15.368997] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-26T21:48:15.373440] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-08. [2025-09-26T21:48:16.452517] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-26T21:48:16.458213] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-09. [2025-09-26T21:48:17.469529] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-26T21:48:17.474368] [INFO ] [REMOTE ] TXO: Full fetch complete (25997 records). [2025-09-26T21:48:17.474501] [DEBUG] [VALIDATOR ] TXO: Validating primary data. [2025-09-26T21:48:17.890727] [DEBUG] [VALIDATOR ] TXO: All expected trading days are present. [2025-09-26T21:48:17.890831] [DEBUG] [VALIDATOR ] TXO: Primary data validation passed. [2025-09-26T21:48:17.891482] [INFO ] [MAIN ] TXO: Fetched primary data is valid. [2025-09-26T21:48:17.891527] [DEBUG] [LOCAL ] TXO: Saving primary data. [2025-09-26T21:48:17.892485] [DEBUG] [LOCAL ] TXO: Trimmed 25997 records to 19060 (keeping 200 days of data) [2025-09-26T21:48:18.031791] [DEBUG] [LOCAL ] TXO: Primary data saved (19060 records). [2025-09-26T21:48:18.032020] [INFO ] [MAIN ] TXO: Full history saved. [2025-09-26T21:48:18.032151] [INFO ] [MAIN ] Update Progress: 2160/2371 symbols completed. TXO took 23.7s. Estimated remaining: 28m 9s. Rate: 7.5 symbols/min [2025-09-26T21:48:18.758789] [INFO ] [MAIN ] TYL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:48:18.839385] [INFO ] [MAIN ] TYG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:48:18.832938] [INFO ] [MAIN ] TXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:48:18.834887] [INFO ] [MAIN ] TY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:48:18.868590] [DEBUG] [LOCAL ] TY: Loaded 7718 existing records from primary storage. [2025-09-26T21:48:18.868965] [INFO ] [MAIN ] TY: Loaded 7718 existing records. [2025-09-26T21:48:18.899552] [DEBUG] [LOCAL ] TYG: Loaded 14343 existing records from primary storage. [2025-09-26T21:48:18.945789] [INFO ] [MAIN ] TYG: Loaded 14343 existing records. [2025-09-26T21:48:18.960511] [DEBUG] [LOCAL ] TYL: Loaded 22453 existing records from primary storage. [2025-09-26T21:48:18.977012] [INFO ] [MAIN ] TYL: Loaded 22453 existing records. [2025-09-26T21:48:19.397822] [WARN ] [MAIN ] TY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:48:19.438050] [INFO ] [MAIN ] TY: Wiping existing primary data before full refresh. [2025-09-26T21:48:19.445159] [WARN ] [MAIN ] TYG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:48:19.472487] [INFO ] [LOCAL ] TY: Starting deletion of primary data. [2025-09-26T21:48:19.480768] [INFO ] [MAIN ] TYG: Wiping existing primary data before full refresh. [2025-09-26T21:48:19.484849] [INFO ] [LOCAL ] TYG: Starting deletion of primary data. [2025-09-26T21:48:19.487422] [DEBUG] [LOCAL ] TXT: Loaded 50103 existing records from primary storage. [2025-09-26T21:48:19.502987] [INFO ] [MAIN ] TXT: Loaded 50103 existing records. [2025-09-26T21:48:19.510297] [DEBUG] [LOCAL ] TYG: Deleted primary data file. [2025-09-26T21:48:19.506090] [DEBUG] [LOCAL ] TY: Deleted primary data file. [2025-09-26T21:48:19.510215] [WARN ] [MAIN ] TYL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:48:19.522467] [INFO ] [MAIN ] TY: Starting full primary refresh. [2025-09-26T21:48:19.515890] [INFO ] [MAIN ] TYG: Starting full primary refresh. [2025-09-26T21:48:19.538518] [INFO ] [MAIN ] TYL: Wiping existing primary data before full refresh. [2025-09-26T21:48:19.615968] [INFO ] [LOCAL ] TYL: Starting deletion of primary data. [2025-09-26T21:48:19.845126] [DEBUG] [LOCAL ] TYL: Deleted primary data file. [2025-09-26T21:48:19.903180] [INFO ] [MAIN ] TYL: Starting full primary refresh. [2025-09-26T21:48:20.162294] [WARN ] [MAIN ] TXT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:48:20.278805] [INFO ] [MAIN ] TXT: Wiping existing primary data before full refresh. [2025-09-26T21:48:20.348887] [INFO ] [LOCAL ] TXT: Starting deletion of primary data. [2025-09-26T21:48:20.470115] [DEBUG] [LOCAL ] TXT: Deleted primary data file. [2025-09-26T21:48:20.519735] [INFO ] [MAIN ] TXT: Starting full primary refresh. [2025-09-26T21:48:20.747499] [INFO ] [REMOTE ] TY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:48:20.814795] [INFO ] [REMOTE ] TY: Fetching primary data for 2024-12. [2025-09-26T21:48:20.945836] [INFO ] [REMOTE ] TYG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:48:20.977421] [INFO ] [REMOTE ] TYG: Fetching primary data for 2024-12. [2025-09-26T21:48:21.264370] [INFO ] [REMOTE ] TYL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:48:21.268332] [INFO ] [REMOTE ] TYL: Fetching primary data for 2024-12. [2025-09-26T21:48:21.351294] [INFO ] [REMOTE ] TXT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:48:21.351628] [INFO ] [REMOTE ] TXT: Fetching primary data for 2024-12. [2025-09-26T21:48:21.791521] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-26T21:48:21.794137] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-01. [2025-09-26T21:48:22.129605] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-26T21:48:22.132967] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-01. [2025-09-26T21:48:22.313407] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-26T21:48:22.316900] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-02. [2025-09-26T21:48:22.417750] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-26T21:48:22.422406] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-01. [2025-09-26T21:48:22.638537] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-26T21:48:23.112269] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-01. [2025-09-26T21:48:23.113239] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-26T21:48:23.278076] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-26T21:48:23.708152] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-26T21:48:23.911722] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-03. [2025-09-26T21:48:24.647609] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-26T21:48:24.711771] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-02. [2025-09-26T21:48:24.784615] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-26T21:48:25.511761] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-02. [2025-09-26T21:48:25.816313] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-26T21:48:26.311753] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-04. [2025-09-26T21:48:27.103226] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-26T21:48:27.111666] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-05. [2025-09-26T21:48:27.245787] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-26T21:48:27.837964] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-26T21:48:27.911753] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-03. [2025-09-26T21:48:28.711811] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-03. [2025-09-26T21:48:29.061111] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-26T21:48:29.511764] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-06. [2025-09-26T21:48:30.249194] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-26T21:48:30.311685] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-04. [2025-09-26T21:48:30.511748] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-26T21:48:31.111765] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-07. [2025-09-26T21:48:31.725512] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-26T21:48:31.781616] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-26T21:48:31.911762] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-08. [2025-09-26T21:48:32.627930] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-26T21:48:32.711739] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-09. [2025-09-26T21:48:33.275943] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-26T21:48:33.278212] [INFO ] [REMOTE ] TY: Full fetch complete (11766 records). [2025-09-26T21:48:33.278285] [DEBUG] [VALIDATOR ] TY: Validating primary data. [2025-09-26T21:48:33.516899] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-02. [2025-09-26T21:48:33.646282] [DEBUG] [VALIDATOR ] TY: All expected trading days are present. [2025-09-26T21:48:33.646388] [DEBUG] [VALIDATOR ] TY: Primary data validation passed. [2025-09-26T21:48:33.646853] [INFO ] [MAIN ] TY: Fetched primary data is valid. [2025-09-26T21:48:33.646916] [DEBUG] [LOCAL ] TY: Saving primary data. [2025-09-26T21:48:33.647435] [DEBUG] [LOCAL ] TY: Trimmed 11766 records to 7756 (keeping 200 days of data) [2025-09-26T21:48:33.699185] [DEBUG] [LOCAL ] TY: Primary data saved (7756 records). [2025-09-26T21:48:33.699322] [INFO ] [MAIN ] TY: Full history saved. [2025-09-26T21:48:33.699420] [INFO ] [MAIN ] Update Progress: 2161/2371 symbols completed. TY took 15.7s. Estimated remaining: 28m 2s. Rate: 7.5 symbols/min [2025-09-26T21:48:33.872615] [INFO ] [MAIN ] U: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:48:33.930160] [DEBUG] [LOCAL ] U: Loaded 54189 existing records from primary storage. [2025-09-26T21:48:33.930369] [INFO ] [MAIN ] U: Loaded 54189 existing records. [2025-09-26T21:48:34.121271] [WARN ] [MAIN ] U: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:48:34.122066] [INFO ] [MAIN ] U: Wiping existing primary data before full refresh. [2025-09-26T21:48:34.122127] [INFO ] [LOCAL ] U: Starting deletion of primary data. [2025-09-26T21:48:34.123714] [DEBUG] [LOCAL ] U: Deleted primary data file. [2025-09-26T21:48:34.123789] [INFO ] [MAIN ] U: Starting full primary refresh. [2025-09-26T21:48:34.312974] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-04. [2025-09-26T21:48:34.573547] [INFO ] [REMOTE ] U: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:48:34.585946] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-26T21:48:35.111761] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-05. [2025-09-26T21:48:35.911715] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-03. [2025-09-26T21:48:35.952896] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-26T21:48:36.275777] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-26T21:48:36.711732] [INFO ] [REMOTE ] U: Fetching primary data for 2024-12. [2025-09-26T21:48:36.973385] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-26T21:48:37.511744] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-04. [2025-09-26T21:48:38.311777] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-06. [2025-09-26T21:48:38.598197] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-26T21:48:39.111700] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-05. [2025-09-26T21:48:39.276422] [INFO ] [REMOTE ] U: Incremental fetch complete for 2024-12 (2.56 seconds). [2025-09-26T21:48:39.503823] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-26T21:48:39.911771] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-07. [2025-09-26T21:48:40.711752] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-05. [2025-09-26T21:48:40.861229] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-26T21:48:41.133102] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-26T21:48:41.276629] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-26T21:48:41.511736] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-06. [2025-09-26T21:48:42.311754] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-06. [2025-09-26T21:48:43.111737] [INFO ] [REMOTE ] U: Fetching primary data for 2025-01. [2025-09-26T21:48:43.213161] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-26T21:48:43.268747] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-26T21:48:43.911774] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-07. [2025-09-26T21:48:44.711829] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-07. [2025-09-26T21:48:45.516966] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-08. [2025-09-26T21:48:45.540292] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-09-26T21:48:45.842841] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-26T21:48:45.870745] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-26T21:48:46.311762] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-08. [2025-09-26T21:48:46.712128] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-26T21:48:47.111759] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-08. [2025-09-26T21:48:47.911738] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-09. [2025-09-26T21:48:48.052560] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-26T21:48:48.145321] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-26T21:48:48.491053] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-26T21:48:48.496081] [INFO ] [REMOTE ] TYL: Full fetch complete (31359 records). [2025-09-26T21:48:48.496284] [DEBUG] [VALIDATOR ] TYL: Validating primary data. [2025-09-26T21:48:48.717810] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-09. [2025-09-26T21:48:48.913068] [DEBUG] [VALIDATOR ] TYL: All expected trading days are present. [2025-09-26T21:48:48.913188] [DEBUG] [VALIDATOR ] TYL: Primary data validation passed. [2025-09-26T21:48:48.914301] [INFO ] [MAIN ] TYL: Fetched primary data is valid. [2025-09-26T21:48:48.914391] [DEBUG] [LOCAL ] TYL: Saving primary data. [2025-09-26T21:48:48.915376] [DEBUG] [LOCAL ] TYL: Trimmed 31359 records to 22582 (keeping 200 days of data) [2025-09-26T21:48:49.071463] [DEBUG] [LOCAL ] TYL: Primary data saved (22582 records). [2025-09-26T21:48:49.071746] [INFO ] [MAIN ] TYL: Full history saved. [2025-09-26T21:48:49.071889] [INFO ] [MAIN ] Update Progress: 2162/2371 symbols completed. TYL took 31.0s. Estimated remaining: 27m 55s. Rate: 7.5 symbols/min [2025-09-26T21:48:49.249538] [INFO ] [MAIN ] UA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:48:49.305971] [DEBUG] [LOCAL ] UA: Loaded 50812 existing records from primary storage. [2025-09-26T21:48:49.306175] [INFO ] [MAIN ] UA: Loaded 50812 existing records. [2025-09-26T21:48:49.503290] [WARN ] [MAIN ] UA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:48:49.503619] [INFO ] [MAIN ] UA: Wiping existing primary data before full refresh. [2025-09-26T21:48:49.503716] [INFO ] [LOCAL ] UA: Starting deletion of primary data. [2025-09-26T21:48:49.505303] [DEBUG] [LOCAL ] UA: Deleted primary data file. [2025-09-26T21:48:49.505375] [INFO ] [MAIN ] UA: Starting full primary refresh. [2025-09-26T21:48:49.517026] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-09. [2025-09-26T21:48:49.793534] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-26T21:48:49.819727] [INFO ] [REMOTE ] TYG: Full fetch complete (22580 records). [2025-09-26T21:48:49.820307] [DEBUG] [VALIDATOR ] TYG: Validating primary data. [2025-09-26T21:48:49.992871] [INFO ] [REMOTE ] UA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:48:50.312928] [INFO ] [REMOTE ] UA: Fetching primary data for 2024-12. [2025-09-26T21:48:50.324883] [DEBUG] [VALIDATOR ] TYG: All expected trading days are present. [2025-09-26T21:48:50.325022] [DEBUG] [VALIDATOR ] TYG: Primary data validation passed. [2025-09-26T21:48:50.325748] [INFO ] [MAIN ] TYG: Fetched primary data is valid. [2025-09-26T21:48:50.326063] [DEBUG] [LOCAL ] TYG: Saving primary data. [2025-09-26T21:48:50.327584] [DEBUG] [LOCAL ] TYG: Trimmed 22580 records to 14410 (keeping 200 days of data) [2025-09-26T21:48:50.423455] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-26T21:48:50.458926] [DEBUG] [LOCAL ] TYG: Primary data saved (14410 records). [2025-09-26T21:48:50.459296] [INFO ] [MAIN ] TYG: Full history saved. [2025-09-26T21:48:50.459413] [INFO ] [MAIN ] Update Progress: 2163/2371 symbols completed. TYG took 32.4s. Estimated remaining: 27m 46s. Rate: 7.5 symbols/min [2025-09-26T21:48:50.504987] [INFO ] [REMOTE ] TXT: Full fetch complete (72266 records). [2025-09-26T21:48:50.544245] [DEBUG] [VALIDATOR ] TXT: Validating primary data. [2025-09-26T21:48:50.791736] [INFO ] [MAIN ] UAA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:48:51.112884] [INFO ] [REMOTE ] U: Fetching primary data for 2025-02. [2025-09-26T21:48:51.116911] [DEBUG] [VALIDATOR ] TXT: All expected trading days are present. [2025-09-26T21:48:51.118281] [DEBUG] [VALIDATOR ] TXT: Primary data validation passed. [2025-09-26T21:48:51.120393] [INFO ] [MAIN ] TXT: Fetched primary data is valid. [2025-09-26T21:48:51.120619] [DEBUG] [LOCAL ] TXT: Saving primary data. [2025-09-26T21:48:51.142863] [DEBUG] [LOCAL ] TXT: Trimmed 72266 records to 50470 (keeping 200 days of data) [2025-09-26T21:48:51.142608] [DEBUG] [LOCAL ] UAA: Loaded 53899 existing records from primary storage. [2025-09-26T21:48:51.143065] [INFO ] [MAIN ] UAA: Loaded 53899 existing records. [2025-09-26T21:48:51.455970] [WARN ] [MAIN ] UAA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:48:51.456961] [INFO ] [MAIN ] UAA: Wiping existing primary data before full refresh. [2025-09-26T21:48:51.457672] [INFO ] [LOCAL ] UAA: Starting deletion of primary data. [2025-09-26T21:48:51.459315] [DEBUG] [LOCAL ] UAA: Deleted primary data file. [2025-09-26T21:48:51.459638] [INFO ] [MAIN ] UAA: Starting full primary refresh. [2025-09-26T21:48:51.966221] [INFO ] [REMOTE ] UAA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:48:51.967214] [INFO ] [REMOTE ] UAA: Fetching primary data for 2024-12. [2025-09-26T21:48:52.089237] [DEBUG] [LOCAL ] TXT: Primary data saved (50470 records). [2025-09-26T21:48:52.090204] [INFO ] [MAIN ] TXT: Full history saved. [2025-09-26T21:48:52.090427] [INFO ] [MAIN ] Update Progress: 2164/2371 symbols completed. TXT took 34.1s. Estimated remaining: 27m 38s. Rate: 7.5 symbols/min [2025-09-26T21:48:52.249170] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-26T21:48:52.319752] [INFO ] [MAIN ] UAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:48:52.328494] [DEBUG] [LOCAL ] UAN: Loaded 5475 existing records from primary storage. [2025-09-26T21:48:52.328681] [INFO ] [MAIN ] UAN: Loaded 5475 existing records. [2025-09-26T21:48:52.512870] [WARN ] [MAIN ] UAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:48:52.513243] [INFO ] [MAIN ] UAN: Wiping existing primary data before full refresh. [2025-09-26T21:48:52.513297] [INFO ] [LOCAL ] UAN: Starting deletion of primary data. [2025-09-26T21:48:52.513821] [DEBUG] [LOCAL ] UAN: Deleted primary data file. [2025-09-26T21:48:52.513894] [INFO ] [MAIN ] UAN: Starting full primary refresh. [2025-09-26T21:48:52.741567] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-01. [2025-09-26T21:48:52.913045] [INFO ] [REMOTE ] UAN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:48:53.502187] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-09-26T21:48:53.512253] [INFO ] [REMOTE ] UAN: Fetching primary data for 2024-12. [2025-09-26T21:48:53.795391] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-26T21:48:54.203051] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-26T21:48:54.311736] [INFO ] [REMOTE ] U: Fetching primary data for 2025-03. [2025-09-26T21:48:54.338301] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-26T21:48:55.111735] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-02. [2025-09-26T21:48:55.911760] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-01. [2025-09-26T21:48:56.593128] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-26T21:48:56.716849] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-01. [2025-09-26T21:48:56.741748] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T21:48:57.468125] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-26T21:48:57.511726] [INFO ] [REMOTE ] U: Fetching primary data for 2025-04. [2025-09-26T21:48:57.805148] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-26T21:48:58.311735] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-02. [2025-09-26T21:48:59.111755] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-03. [2025-09-26T21:48:59.583437] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-26T21:48:59.911731] [INFO ] [REMOTE ] U: Fetching primary data for 2025-05. [2025-09-26T21:49:00.130321] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-26T21:49:00.656701] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T21:49:00.711712] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-02. [2025-09-26T21:49:01.344119] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-26T21:49:01.511727] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-03. [2025-09-26T21:49:02.137578] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-26T21:49:02.292790] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-26T21:49:02.311690] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-03. [2025-09-26T21:49:03.111714] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-04. [2025-09-26T21:49:03.911688] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-04. [2025-09-26T21:49:04.018897] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-26T21:49:04.710065] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-26T21:49:04.712147] [INFO ] [REMOTE ] U: Fetching primary data for 2025-06. [2025-09-26T21:49:04.893235] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-26T21:49:05.511720] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-05. [2025-09-26T21:49:06.311724] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-04. [2025-09-26T21:49:06.985344] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-09-26T21:49:07.111696] [INFO ] [REMOTE ] U: Fetching primary data for 2025-07. [2025-09-26T21:49:07.277849] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-26T21:49:07.911725] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-05. [2025-09-26T21:49:08.151477] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-26T21:49:08.410692] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-26T21:49:08.711729] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-05. [2025-09-26T21:49:09.511693] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-06. [2025-09-26T21:49:09.601565] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-26T21:49:09.961691] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-26T21:49:10.311717] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-06. [2025-09-26T21:49:10.719286] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-26T21:49:11.111733] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-07. [2025-09-26T21:49:11.708832] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-26T21:49:11.838116] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-26T21:49:11.911719] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-06. [2025-09-26T21:49:12.711730] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-07. [2025-09-26T21:49:13.511704] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-08. [2025-09-26T21:49:13.674749] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-26T21:49:14.189083] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-26T21:49:14.311734] [INFO ] [REMOTE ] U: Fetching primary data for 2025-08. [2025-09-26T21:49:14.461414] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-26T21:49:15.111716] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-09. [2025-09-26T21:49:15.788784] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-26T21:49:15.790913] [INFO ] [REMOTE ] UAN: Full fetch complete (8178 records). [2025-09-26T21:49:15.791005] [DEBUG] [VALIDATOR ] UAN: Validating primary data. [2025-09-26T21:49:15.916833] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-08. [2025-09-26T21:49:16.182350] [DEBUG] [VALIDATOR ] UAN: All expected trading days are present. [2025-09-26T21:49:16.182445] [DEBUG] [VALIDATOR ] UAN: Primary data validation passed. [2025-09-26T21:49:16.182732] [INFO ] [MAIN ] UAN: Fetched primary data is valid. [2025-09-26T21:49:16.182808] [DEBUG] [LOCAL ] UAN: Saving primary data. [2025-09-26T21:49:16.183268] [DEBUG] [LOCAL ] UAN: Trimmed 8178 records to 5507 (keeping 200 days of data) [2025-09-26T21:49:16.218882] [DEBUG] [LOCAL ] UAN: Primary data saved (5507 records). [2025-09-26T21:49:16.219027] [INFO ] [MAIN ] UAN: Full history saved. [2025-09-26T21:49:16.219147] [INFO ] [MAIN ] Update Progress: 2165/2371 symbols completed. UAN took 24.1s. Estimated remaining: 27m 31s. Rate: 7.5 symbols/min [2025-09-26T21:49:16.408759] [INFO ] [MAIN ] UBER: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:49:16.465225] [DEBUG] [LOCAL ] UBER: Loaded 54196 existing records from primary storage. [2025-09-26T21:49:16.465390] [INFO ] [MAIN ] UBER: Loaded 54196 existing records. [2025-09-26T21:49:16.669246] [WARN ] [MAIN ] UBER: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:49:16.669886] [INFO ] [MAIN ] UBER: Wiping existing primary data before full refresh. [2025-09-26T21:49:16.669964] [INFO ] [LOCAL ] UBER: Starting deletion of primary data. [2025-09-26T21:49:16.671954] [DEBUG] [LOCAL ] UBER: Deleted primary data file. [2025-09-26T21:49:16.672025] [INFO ] [MAIN ] UBER: Starting full primary refresh. [2025-09-26T21:49:16.720306] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-07. [2025-09-26T21:49:17.077630] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-08 (2.77 seconds). [2025-09-26T21:49:17.112134] [INFO ] [REMOTE ] UBER: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:49:17.511711] [INFO ] [REMOTE ] U: Fetching primary data for 2025-09. [2025-09-26T21:49:17.889365] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-26T21:49:18.311704] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-09. [2025-09-26T21:49:18.719423] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-26T21:49:19.111719] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-08. [2025-09-26T21:49:19.908210] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-09-26T21:49:19.918207] [INFO ] [REMOTE ] UBER: Fetching primary data for 2024-12. [2025-09-26T21:49:19.920178] [INFO ] [REMOTE ] U: Full fetch complete (77925 records). [2025-09-26T21:49:19.920294] [DEBUG] [VALIDATOR ] U: Validating primary data. [2025-09-26T21:49:20.343044] [DEBUG] [VALIDATOR ] U: All expected trading days are present. [2025-09-26T21:49:20.343158] [DEBUG] [VALIDATOR ] U: Primary data validation passed. [2025-09-26T21:49:20.344474] [INFO ] [MAIN ] U: Fetched primary data is valid. [2025-09-26T21:49:20.344560] [DEBUG] [LOCAL ] U: Saving primary data. [2025-09-26T21:49:20.373111] [DEBUG] [LOCAL ] U: Trimmed 77925 records to 54579 (keeping 200 days of data) [2025-09-26T21:49:20.374354] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-26T21:49:20.385670] [INFO ] [REMOTE ] UA: Full fetch complete (72943 records). [2025-09-26T21:49:20.385845] [DEBUG] [VALIDATOR ] UA: Validating primary data. [2025-09-26T21:49:21.063950] [DEBUG] [VALIDATOR ] UA: All expected trading days are present. [2025-09-26T21:49:21.064082] [DEBUG] [VALIDATOR ] UA: Primary data validation passed. [2025-09-26T21:49:21.065933] [INFO ] [MAIN ] UA: Fetched primary data is valid. [2025-09-26T21:49:21.066687] [DEBUG] [LOCAL ] UA: Saving primary data. [2025-09-26T21:49:21.085603] [DEBUG] [LOCAL ] UA: Trimmed 72943 records to 51189 (keeping 200 days of data) [2025-09-26T21:49:21.346056] [DEBUG] [LOCAL ] U: Primary data saved (54579 records). [2025-09-26T21:49:21.372247] [INFO ] [MAIN ] U: Full history saved. [2025-09-26T21:49:21.372474] [INFO ] [MAIN ] Update Progress: 2166/2371 symbols completed. U took 47.7s. Estimated remaining: 27m 23s. Rate: 7.5 symbols/min [2025-09-26T21:49:21.503602] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-09-26T21:49:21.561435] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-09. [2025-09-26T21:49:21.646490] [INFO ] [MAIN ] UBS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:49:21.723027] [DEBUG] [LOCAL ] UA: Primary data saved (51189 records). [2025-09-26T21:49:21.723188] [INFO ] [MAIN ] UA: Full history saved. [2025-09-26T21:49:21.723304] [INFO ] [MAIN ] Update Progress: 2167/2371 symbols completed. UA took 32.7s. Estimated remaining: 27m 14s. Rate: 7.5 symbols/min [2025-09-26T21:49:21.950193] [DEBUG] [LOCAL ] UBS: Loaded 52821 existing records from primary storage. [2025-09-26T21:49:21.973787] [INFO ] [MAIN ] UBS: Loaded 52821 existing records. [2025-09-26T21:49:22.011552] [INFO ] [MAIN ] UCB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:49:22.206327] [WARN ] [MAIN ] UBS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:49:22.207347] [INFO ] [MAIN ] UBS: Wiping existing primary data before full refresh. [2025-09-26T21:49:22.207546] [INFO ] [LOCAL ] UBS: Starting deletion of primary data. [2025-09-26T21:49:22.224572] [DEBUG] [LOCAL ] UBS: Deleted primary data file. [2025-09-26T21:49:22.224748] [INFO ] [MAIN ] UBS: Starting full primary refresh. [2025-09-26T21:49:22.348282] [DEBUG] [LOCAL ] UCB: Loaded 38325 existing records from primary storage. [2025-09-26T21:49:22.389350] [INFO ] [MAIN ] UCB: Loaded 38325 existing records. [2025-09-26T21:49:22.835121] [WARN ] [MAIN ] UCB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:49:22.859792] [INFO ] [REMOTE ] UBS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:49:22.860314] [INFO ] [MAIN ] UCB: Wiping existing primary data before full refresh. [2025-09-26T21:49:22.860809] [INFO ] [REMOTE ] UBS: Fetching primary data for 2024-12. [2025-09-26T21:49:22.860446] [INFO ] [LOCAL ] UCB: Starting deletion of primary data. [2025-09-26T21:49:22.862922] [DEBUG] [LOCAL ] UCB: Deleted primary data file. [2025-09-26T21:49:22.862997] [INFO ] [MAIN ] UCB: Starting full primary refresh. [2025-09-26T21:49:23.018765] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2024-12 (3.10 seconds). [2025-09-26T21:49:23.045935] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-01. [2025-09-26T21:49:23.308702] [INFO ] [REMOTE ] UCB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:49:23.309085] [INFO ] [REMOTE ] UCB: Fetching primary data for 2024-12. [2025-09-26T21:49:23.584466] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-26T21:49:23.599962] [INFO ] [REMOTE ] UAA: Full fetch complete (77478 records). [2025-09-26T21:49:23.600138] [DEBUG] [VALIDATOR ] UAA: Validating primary data. [2025-09-26T21:49:24.050453] [DEBUG] [VALIDATOR ] UAA: All expected trading days are present. [2025-09-26T21:49:24.050550] [DEBUG] [VALIDATOR ] UAA: Primary data validation passed. [2025-09-26T21:49:24.051718] [INFO ] [MAIN ] UAA: Fetched primary data is valid. [2025-09-26T21:49:24.051789] [DEBUG] [LOCAL ] UAA: Saving primary data. [2025-09-26T21:49:24.053386] [DEBUG] [LOCAL ] UAA: Trimmed 77478 records to 54287 (keeping 200 days of data) [2025-09-26T21:49:24.387387] [DEBUG] [LOCAL ] UAA: Primary data saved (54287 records). [2025-09-26T21:49:24.387583] [INFO ] [MAIN ] UAA: Full history saved. [2025-09-26T21:49:24.387739] [INFO ] [MAIN ] Update Progress: 2168/2371 symbols completed. UAA took 33.9s. Estimated remaining: 27m 6s. Rate: 7.5 symbols/min [2025-09-26T21:49:24.568495] [INFO ] [MAIN ] UDR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:49:24.619698] [DEBUG] [LOCAL ] UDR: Loaded 52177 existing records from primary storage. [2025-09-26T21:49:24.619910] [INFO ] [MAIN ] UDR: Loaded 52177 existing records. [2025-09-26T21:49:24.817407] [WARN ] [MAIN ] UDR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:49:24.818179] [INFO ] [MAIN ] UDR: Wiping existing primary data before full refresh. [2025-09-26T21:49:24.870214] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-26T21:49:24.873526] [INFO ] [LOCAL ] UDR: Starting deletion of primary data. [2025-09-26T21:49:24.883177] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-01. [2025-09-26T21:49:24.884524] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-26T21:49:24.884609] [DEBUG] [LOCAL ] UDR: Deleted primary data file. [2025-09-26T21:49:24.885086] [INFO ] [MAIN ] UDR: Starting full primary refresh. [2025-09-26T21:49:24.897371] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-01. [2025-09-26T21:49:25.327547] [INFO ] [REMOTE ] UDR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:49:25.511727] [INFO ] [REMOTE ] UDR: Fetching primary data for 2024-12. [2025-09-26T21:49:25.722960] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-01 (2.68 seconds). [2025-09-26T21:49:26.311731] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-02. [2025-09-26T21:49:26.373448] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-26T21:49:26.473901] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-26T21:49:26.816693] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-26T21:49:27.111719] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-02. [2025-09-26T21:49:27.911713] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-02. [2025-09-26T21:49:28.467639] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-26T21:49:28.711729] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-01. [2025-09-26T21:49:28.970174] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-02 (2.66 seconds). [2025-09-26T21:49:29.511711] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-03. [2025-09-26T21:49:29.640475] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-26T21:49:30.240337] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-26T21:49:30.311687] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-03. [2025-09-26T21:49:31.111727] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-03. [2025-09-26T21:49:31.911741] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-02. [2025-09-26T21:49:32.047313] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-09-26T21:49:32.124073] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-26T21:49:32.678769] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-26T21:49:32.711685] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-04. [2025-09-26T21:49:33.151824] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-26T21:49:33.511753] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-04. [2025-09-26T21:49:34.310995] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T21:49:34.319813] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-03. [2025-09-26T21:49:35.111724] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-04. [2025-09-26T21:49:35.911735] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-05. [2025-09-26T21:49:35.999330] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-26T21:49:36.298452] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-26T21:49:36.711714] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-05. [2025-09-26T21:49:37.162599] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-26T21:49:37.478781] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-26T21:49:37.511677] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-06. [2025-09-26T21:49:38.311726] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-04. [2025-09-26T21:49:38.984676] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-26T21:49:39.111719] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-07. [2025-09-26T21:49:39.338163] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-05 (2.63 seconds). [2025-09-26T21:49:39.911695] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-06. [2025-09-26T21:49:40.121307] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-26T21:49:40.647677] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-26T21:49:40.711764] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-08. [2025-09-26T21:49:41.511701] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-05. [2025-09-26T21:49:42.119523] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-26T21:49:42.311732] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-09. [2025-09-26T21:49:42.479349] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-06 (2.57 seconds). [2025-09-26T21:49:43.111700] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-07. [2025-09-26T21:49:43.392039] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-26T21:49:43.767769] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-26T21:49:43.775023] [INFO ] [REMOTE ] UCB: Full fetch complete (54721 records). [2025-09-26T21:49:43.775195] [DEBUG] [VALIDATOR ] UCB: Validating primary data. [2025-09-26T21:49:43.925423] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-06. [2025-09-26T21:49:44.186777] [DEBUG] [VALIDATOR ] UCB: All expected trading days are present. [2025-09-26T21:49:44.186872] [DEBUG] [VALIDATOR ] UCB: Primary data validation passed. [2025-09-26T21:49:44.187826] [INFO ] [MAIN ] UCB: Fetched primary data is valid. [2025-09-26T21:49:44.187928] [DEBUG] [LOCAL ] UCB: Saving primary data. [2025-09-26T21:49:44.189295] [DEBUG] [LOCAL ] UCB: Trimmed 54721 records to 38555 (keeping 200 days of data) [2025-09-26T21:49:44.439164] [DEBUG] [LOCAL ] UCB: Primary data saved (38555 records). [2025-09-26T21:49:44.439339] [INFO ] [MAIN ] UCB: Full history saved. [2025-09-26T21:49:44.439464] [INFO ] [MAIN ] Update Progress: 2169/2371 symbols completed. UCB took 22.7s. Estimated remaining: 26m 59s. Rate: 7.5 symbols/min [2025-09-26T21:49:44.616990] [INFO ] [MAIN ] UE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:49:44.669486] [DEBUG] [LOCAL ] UE: Loaded 43255 existing records from primary storage. [2025-09-26T21:49:44.669673] [INFO ] [MAIN ] UE: Loaded 43255 existing records. [2025-09-26T21:49:44.719627] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-05. [2025-09-26T21:49:44.877170] [WARN ] [MAIN ] UE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:49:44.877453] [INFO ] [MAIN ] UE: Wiping existing primary data before full refresh. [2025-09-26T21:49:44.877502] [INFO ] [LOCAL ] UE: Starting deletion of primary data. [2025-09-26T21:49:44.878431] [DEBUG] [LOCAL ] UE: Deleted primary data file. [2025-09-26T21:49:44.878501] [INFO ] [MAIN ] UE: Starting full primary refresh. [2025-09-26T21:49:45.278768] [INFO ] [REMOTE ] UE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:49:45.511727] [INFO ] [REMOTE ] UE: Fetching primary data for 2024-12. [2025-09-26T21:49:45.669018] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-09-26T21:49:45.737985] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-26T21:49:46.311689] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-07. [2025-09-26T21:49:46.614550] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-26T21:49:47.067947] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-26T21:49:47.111697] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-08. [2025-09-26T21:49:47.911705] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-01. [2025-09-26T21:49:47.965281] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-26T21:49:48.711766] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-06. [2025-09-26T21:49:49.188884] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-26T21:49:49.434793] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-26T21:49:49.511717] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-09. [2025-09-26T21:49:50.012369] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-26T21:49:50.311379] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-26T21:49:50.321042] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-02. [2025-09-26T21:49:50.323413] [INFO ] [REMOTE ] UBER: Full fetch complete (77978 records). [2025-09-26T21:49:50.323529] [DEBUG] [VALIDATOR ] UBER: Validating primary data. [2025-09-26T21:49:50.768701] [DEBUG] [VALIDATOR ] UBER: All expected trading days are present. [2025-09-26T21:49:50.768820] [DEBUG] [VALIDATOR ] UBER: Primary data validation passed. [2025-09-26T21:49:50.770157] [INFO ] [MAIN ] UBER: Fetched primary data is valid. [2025-09-26T21:49:50.770233] [DEBUG] [LOCAL ] UBER: Saving primary data. [2025-09-26T21:49:50.772032] [DEBUG] [LOCAL ] UBER: Trimmed 77978 records to 54586 (keeping 200 days of data) [2025-09-26T21:49:51.111873] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-07. [2025-09-26T21:49:51.134554] [DEBUG] [LOCAL ] UBER: Primary data saved (54586 records). [2025-09-26T21:49:51.134736] [INFO ] [MAIN ] UBER: Full history saved. [2025-09-26T21:49:51.134871] [INFO ] [MAIN ] Update Progress: 2170/2371 symbols completed. UBER took 34.9s. Estimated remaining: 26m 51s. Rate: 7.5 symbols/min [2025-09-26T21:49:51.314586] [INFO ] [MAIN ] UFI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:49:51.326373] [DEBUG] [LOCAL ] UFI: Loaded 8169 existing records from primary storage. [2025-09-26T21:49:51.326504] [INFO ] [MAIN ] UFI: Loaded 8169 existing records. [2025-09-26T21:49:51.513942] [WARN ] [MAIN ] UFI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:49:51.514351] [INFO ] [MAIN ] UFI: Wiping existing primary data before full refresh. [2025-09-26T21:49:51.514415] [INFO ] [LOCAL ] UFI: Starting deletion of primary data. [2025-09-26T21:49:51.514758] [DEBUG] [LOCAL ] UFI: Deleted primary data file. [2025-09-26T21:49:51.514830] [INFO ] [MAIN ] UFI: Starting full primary refresh. [2025-09-26T21:49:51.894620] [INFO ] [REMOTE ] UFI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:49:51.915428] [INFO ] [REMOTE ] UFI: Fetching primary data for 2024-12. [2025-09-26T21:49:51.920381] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-26T21:49:52.699860] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-26T21:49:52.711674] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-01. [2025-09-26T21:49:52.795948] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-26T21:49:53.511724] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-08. [2025-09-26T21:49:53.569261] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-26T21:49:54.311734] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-08. [2025-09-26T21:49:55.111687] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-03. [2025-09-26T21:49:55.187380] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-26T21:49:55.911714] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-02. [2025-09-26T21:49:56.058411] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-26T21:49:56.272985] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-26T21:49:56.698997] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-26T21:49:56.711675] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-03. [2025-09-26T21:49:57.511708] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-09. [2025-09-26T21:49:57.551735] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-26T21:49:58.278273] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-26T21:49:58.288665] [INFO ] [REMOTE ] UDR: Full fetch complete (74493 records). [2025-09-26T21:49:58.288822] [DEBUG] [VALIDATOR ] UDR: Validating primary data. [2025-09-26T21:49:58.319830] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-04. [2025-09-26T21:49:58.710046] [DEBUG] [VALIDATOR ] UDR: All expected trading days are present. [2025-09-26T21:49:58.710148] [DEBUG] [VALIDATOR ] UDR: Primary data validation passed. [2025-09-26T21:49:58.711269] [INFO ] [MAIN ] UDR: Fetched primary data is valid. [2025-09-26T21:49:58.711336] [DEBUG] [LOCAL ] UDR: Saving primary data. [2025-09-26T21:49:58.712991] [DEBUG] [LOCAL ] UDR: Trimmed 74493 records to 52555 (keeping 200 days of data) [2025-09-26T21:49:59.042037] [DEBUG] [LOCAL ] UDR: Primary data saved (52555 records). [2025-09-26T21:49:59.042196] [INFO ] [MAIN ] UDR: Full history saved. [2025-09-26T21:49:59.042303] [INFO ] [MAIN ] Update Progress: 2171/2371 symbols completed. UDR took 34.7s. Estimated remaining: 26m 43s. Rate: 7.5 symbols/min [2025-09-26T21:49:59.116919] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-04. [2025-09-26T21:49:59.235064] [INFO ] [MAIN ] UGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:49:59.289180] [DEBUG] [LOCAL ] UGI: Loaded 50914 existing records from primary storage. [2025-09-26T21:49:59.289421] [INFO ] [MAIN ] UGI: Loaded 50914 existing records. [2025-09-26T21:49:59.304717] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-26T21:49:59.496037] [WARN ] [MAIN ] UGI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:49:59.496301] [INFO ] [MAIN ] UGI: Wiping existing primary data before full refresh. [2025-09-26T21:49:59.496349] [INFO ] [LOCAL ] UGI: Starting deletion of primary data. [2025-09-26T21:49:59.497739] [DEBUG] [LOCAL ] UGI: Deleted primary data file. [2025-09-26T21:49:59.497801] [INFO ] [MAIN ] UGI: Starting full primary refresh. [2025-09-26T21:49:59.884636] [INFO ] [REMOTE ] UGI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:49:59.911704] [INFO ] [REMOTE ] UGI: Fetching primary data for 2024-12. [2025-09-26T21:50:00.720062] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-05. [2025-09-26T21:50:00.725922] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-26T21:50:01.511728] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-09. [2025-09-26T21:50:01.577425] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-26T21:50:01.583389] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-26T21:50:02.311734] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-01. [2025-09-26T21:50:03.111722] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-05. [2025-09-26T21:50:03.339550] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-26T21:50:03.351918] [INFO ] [REMOTE ] UBS: Full fetch complete (75607 records). [2025-09-26T21:50:03.352084] [DEBUG] [VALIDATOR ] UBS: Validating primary data. [2025-09-26T21:50:03.806676] [DEBUG] [VALIDATOR ] UBS: All expected trading days are present. [2025-09-26T21:50:03.806962] [DEBUG] [VALIDATOR ] UBS: Primary data validation passed. [2025-09-26T21:50:03.808278] [INFO ] [MAIN ] UBS: Fetched primary data is valid. [2025-09-26T21:50:03.808371] [DEBUG] [LOCAL ] UBS: Saving primary data. [2025-09-26T21:50:03.810326] [DEBUG] [LOCAL ] UBS: Trimmed 75607 records to 53187 (keeping 200 days of data) [2025-09-26T21:50:03.930729] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-26T21:50:03.928433] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-06. [2025-09-26T21:50:04.199698] [DEBUG] [LOCAL ] UBS: Primary data saved (53187 records). [2025-09-26T21:50:04.199865] [INFO ] [MAIN ] UBS: Full history saved. [2025-09-26T21:50:04.199981] [INFO ] [MAIN ] Update Progress: 2172/2371 symbols completed. UBS took 42.8s. Estimated remaining: 26m 34s. Rate: 7.5 symbols/min [2025-09-26T21:50:04.400572] [INFO ] [MAIN ] UGP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:50:04.455585] [DEBUG] [LOCAL ] UGP: Loaded 42992 existing records from primary storage. [2025-09-26T21:50:04.455777] [INFO ] [MAIN ] UGP: Loaded 42992 existing records. [2025-09-26T21:50:04.676709] [WARN ] [MAIN ] UGP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:50:04.677468] [INFO ] [MAIN ] UGP: Wiping existing primary data before full refresh. [2025-09-26T21:50:04.677727] [INFO ] [LOCAL ] UGP: Starting deletion of primary data. [2025-09-26T21:50:04.686913] [DEBUG] [LOCAL ] UGP: Deleted primary data file. [2025-09-26T21:50:04.702425] [INFO ] [MAIN ] UGP: Starting full primary refresh. [2025-09-26T21:50:04.709608] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-26T21:50:04.716821] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-02. [2025-09-26T21:50:04.817114] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-26T21:50:05.102245] [INFO ] [REMOTE ] UGP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:50:05.511714] [INFO ] [REMOTE ] UGP: Fetching primary data for 2024-12. [2025-09-26T21:50:06.311710] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-06. [2025-09-26T21:50:06.440950] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-26T21:50:07.113070] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-03. [2025-09-26T21:50:07.118765] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-26T21:50:07.811071] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-26T21:50:07.911720] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-01. [2025-09-26T21:50:08.711738] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-07. [2025-09-26T21:50:09.038249] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-26T21:50:09.109807] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-26T21:50:09.511726] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-07. [2025-09-26T21:50:10.311699] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-04. [2025-09-26T21:50:10.401577] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-26T21:50:10.509287] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-26T21:50:11.111720] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-02. [2025-09-26T21:50:11.911720] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-08. [2025-09-26T21:50:12.178566] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-26T21:50:12.485478] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-26T21:50:12.711728] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-05. [2025-09-26T21:50:12.882384] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-26T21:50:13.511838] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-09. [2025-09-26T21:50:14.311745] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-03. [2025-09-26T21:50:14.406827] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-26T21:50:14.408970] [INFO ] [REMOTE ] UFI: Full fetch complete (12355 records). [2025-09-26T21:50:14.409048] [DEBUG] [VALIDATOR ] UFI: Validating primary data. [2025-09-26T21:50:14.820514] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-26T21:50:14.867901] [DEBUG] [VALIDATOR ] UFI: All expected trading days are present. [2025-09-26T21:50:14.868463] [DEBUG] [VALIDATOR ] UFI: Primary data validation passed. [2025-09-26T21:50:14.868880] [INFO ] [MAIN ] UFI: Fetched primary data is valid. [2025-09-26T21:50:14.868981] [DEBUG] [LOCAL ] UFI: Saving primary data. [2025-09-26T21:50:14.870070] [DEBUG] [LOCAL ] UFI: Trimmed 12355 records to 8229 (keeping 200 days of data) [2025-09-26T21:50:14.917268] [DEBUG] [LOCAL ] UFI: Primary data saved (8229 records). [2025-09-26T21:50:14.917400] [INFO ] [MAIN ] UFI: Full history saved. [2025-09-26T21:50:14.917491] [INFO ] [MAIN ] Update Progress: 2173/2371 symbols completed. UFI took 23.8s. Estimated remaining: 26m 27s. Rate: 7.5 symbols/min [2025-09-26T21:50:15.099499] [INFO ] [MAIN ] UHAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:50:15.112126] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-06. [2025-09-26T21:50:15.121089] [DEBUG] [LOCAL ] UHAL: Loaded 16671 existing records from primary storage. [2025-09-26T21:50:15.121222] [INFO ] [MAIN ] UHAL: Loaded 16671 existing records. [2025-09-26T21:50:15.312267] [WARN ] [MAIN ] UHAL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:50:15.312706] [INFO ] [MAIN ] UHAL: Wiping existing primary data before full refresh. [2025-09-26T21:50:15.312765] [INFO ] [LOCAL ] UHAL: Starting deletion of primary data. [2025-09-26T21:50:15.313329] [DEBUG] [LOCAL ] UHAL: Deleted primary data file. [2025-09-26T21:50:15.313392] [INFO ] [MAIN ] UHAL: Starting full primary refresh. [2025-09-26T21:50:15.718419] [INFO ] [REMOTE ] UHAL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:50:15.911756] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2024-12. [2025-09-26T21:50:16.501530] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-26T21:50:16.722167] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-04. [2025-09-26T21:50:16.729522] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-26T21:50:17.009440] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-26T21:50:17.511738] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-01. [2025-09-26T21:50:18.311724] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-07. [2025-09-26T21:50:18.556455] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-26T21:50:18.627477] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-26T21:50:19.111725] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-08. [2025-09-26T21:50:19.911700] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-02. [2025-09-26T21:50:20.048741] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-26T21:50:20.554037] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-26T21:50:20.711694] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-05. [2025-09-26T21:50:20.818085] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-26T21:50:21.511715] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-08. [2025-09-26T21:50:22.316918] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-03. [2025-09-26T21:50:22.323072] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-26T21:50:23.111727] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-06. [2025-09-26T21:50:23.262432] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-26T21:50:23.283685] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-26T21:50:23.911724] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-09. [2025-09-26T21:50:24.711629] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-04. [2025-09-26T21:50:25.171916] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-26T21:50:25.320246] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-26T21:50:25.332748] [INFO ] [REMOTE ] UE: Full fetch complete (61456 records). [2025-09-26T21:50:25.332931] [DEBUG] [VALIDATOR ] UE: Validating primary data. [2025-09-26T21:50:25.517742] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-09. [2025-09-26T21:50:25.777869] [DEBUG] [VALIDATOR ] UE: All expected trading days are present. [2025-09-26T21:50:25.777997] [DEBUG] [VALIDATOR ] UE: Primary data validation passed. [2025-09-26T21:50:25.790036] [INFO ] [MAIN ] UE: Fetched primary data is valid. [2025-09-26T21:50:25.790229] [DEBUG] [LOCAL ] UE: Saving primary data. [2025-09-26T21:50:25.791970] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-26T21:50:25.797161] [DEBUG] [LOCAL ] UE: Trimmed 61456 records to 43513 (keeping 200 days of data) [2025-09-26T21:50:26.088786] [DEBUG] [LOCAL ] UE: Primary data saved (43513 records). [2025-09-26T21:50:26.088981] [INFO ] [MAIN ] UE: Full history saved. [2025-09-26T21:50:26.089249] [INFO ] [MAIN ] Update Progress: 2174/2371 symbols completed. UE took 41.6s. Estimated remaining: 26m 19s. Rate: 7.5 symbols/min [2025-09-26T21:50:26.278176] [INFO ] [MAIN ] UHS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:50:26.311727] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-05. [2025-09-26T21:50:26.330662] [DEBUG] [LOCAL ] UHS: Loaded 41433 existing records from primary storage. [2025-09-26T21:50:26.330820] [INFO ] [MAIN ] UHS: Loaded 41433 existing records. [2025-09-26T21:50:26.521710] [WARN ] [MAIN ] UHS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:50:26.521979] [INFO ] [MAIN ] UHS: Wiping existing primary data before full refresh. [2025-09-26T21:50:26.522033] [INFO ] [LOCAL ] UHS: Starting deletion of primary data. [2025-09-26T21:50:26.523146] [DEBUG] [LOCAL ] UHS: Deleted primary data file. [2025-09-26T21:50:26.523220] [INFO ] [MAIN ] UHS: Starting full primary refresh. [2025-09-26T21:50:26.931416] [INFO ] [REMOTE ] UHS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:50:27.106010] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-26T21:50:27.115824] [INFO ] [REMOTE ] UHS: Fetching primary data for 2024-12. [2025-09-26T21:50:27.119934] [INFO ] [REMOTE ] UGI: Full fetch complete (73400 records). [2025-09-26T21:50:27.120099] [DEBUG] [VALIDATOR ] UGI: Validating primary data. [2025-09-26T21:50:27.391777] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-26T21:50:27.621729] [DEBUG] [VALIDATOR ] UGI: All expected trading days are present. [2025-09-26T21:50:27.621825] [DEBUG] [VALIDATOR ] UGI: Primary data validation passed. [2025-09-26T21:50:27.622902] [INFO ] [MAIN ] UGI: Fetched primary data is valid. [2025-09-26T21:50:27.623006] [DEBUG] [LOCAL ] UGI: Saving primary data. [2025-09-26T21:50:27.624553] [DEBUG] [LOCAL ] UGI: Trimmed 73400 records to 51290 (keeping 200 days of data) [2025-09-26T21:50:27.928290] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-07. [2025-09-26T21:50:27.973910] [DEBUG] [LOCAL ] UGI: Primary data saved (51290 records). [2025-09-26T21:50:27.974075] [INFO ] [MAIN ] UGI: Full history saved. [2025-09-26T21:50:27.974185] [INFO ] [MAIN ] Update Progress: 2175/2371 symbols completed. UGI took 28.9s. Estimated remaining: 26m 10s. Rate: 7.5 symbols/min [2025-09-26T21:50:28.153394] [INFO ] [MAIN ] UHT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:50:28.165947] [DEBUG] [LOCAL ] UHT: Loaded 10040 existing records from primary storage. [2025-09-26T21:50:28.166129] [INFO ] [MAIN ] UHT: Loaded 10040 existing records. [2025-09-26T21:50:28.366981] [WARN ] [MAIN ] UHT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:50:28.367282] [INFO ] [MAIN ] UHT: Wiping existing primary data before full refresh. [2025-09-26T21:50:28.367348] [INFO ] [LOCAL ] UHT: Starting deletion of primary data. [2025-09-26T21:50:28.367816] [DEBUG] [LOCAL ] UHT: Deleted primary data file. [2025-09-26T21:50:28.367878] [INFO ] [MAIN ] UHT: Starting full primary refresh. [2025-09-26T21:50:28.728391] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-06. [2025-09-26T21:50:28.774620] [INFO ] [REMOTE ] UHT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:50:28.800141] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-26T21:50:29.511729] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-01. [2025-09-26T21:50:29.768145] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-26T21:50:29.799170] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-26T21:50:30.311753] [INFO ] [REMOTE ] UHT: Fetching primary data for 2024-12. [2025-09-26T21:50:30.747234] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-26T21:50:31.111730] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-02. [2025-09-26T21:50:31.220889] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-26T21:50:31.911726] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-08. [2025-09-26T21:50:32.705893] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-26T21:50:32.713455] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-01. [2025-09-26T21:50:33.511712] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-03. [2025-09-26T21:50:33.557223] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-26T21:50:33.692610] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-26T21:50:34.311763] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-07. [2025-09-26T21:50:35.054802] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-26T21:50:35.111703] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-09. [2025-09-26T21:50:35.242758] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-26T21:50:35.911713] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-02. [2025-09-26T21:50:36.711721] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-08. [2025-09-26T21:50:36.760478] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-26T21:50:36.760224] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T21:50:36.772514] [INFO ] [REMOTE ] UGP: Full fetch complete (62087 records). [2025-09-26T21:50:36.772718] [DEBUG] [VALIDATOR ] UGP: Validating primary data. [2025-09-26T21:50:37.182290] [DEBUG] [VALIDATOR ] UGP: All expected trading days are present. [2025-09-26T21:50:37.182418] [DEBUG] [VALIDATOR ] UGP: Primary data validation passed. [2025-09-26T21:50:37.183410] [INFO ] [MAIN ] UGP: Fetched primary data is valid. [2025-09-26T21:50:37.183479] [DEBUG] [LOCAL ] UGP: Saving primary data. [2025-09-26T21:50:37.184942] [DEBUG] [LOCAL ] UGP: Trimmed 62087 records to 43319 (keeping 200 days of data) [2025-09-26T21:50:37.448095] [DEBUG] [LOCAL ] UGP: Primary data saved (43319 records). [2025-09-26T21:50:37.448237] [INFO ] [MAIN ] UGP: Full history saved. [2025-09-26T21:50:37.448349] [INFO ] [MAIN ] Update Progress: 2176/2371 symbols completed. UGP took 33.2s. Estimated remaining: 26m 2s. Rate: 7.5 symbols/min [2025-09-26T21:50:37.516821] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-03. [2025-09-26T21:50:37.637507] [INFO ] [MAIN ] UI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:50:37.654630] [DEBUG] [LOCAL ] UI: Loaded 12905 existing records from primary storage. [2025-09-26T21:50:37.654793] [INFO ] [MAIN ] UI: Loaded 12905 existing records. [2025-09-26T21:50:37.863884] [WARN ] [MAIN ] UI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:50:37.865228] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-26T21:50:37.869373] [INFO ] [MAIN ] UI: Wiping existing primary data before full refresh. [2025-09-26T21:50:37.869441] [INFO ] [LOCAL ] UI: Starting deletion of primary data. [2025-09-26T21:50:37.869978] [DEBUG] [LOCAL ] UI: Deleted primary data file. [2025-09-26T21:50:37.870042] [INFO ] [MAIN ] UI: Starting full primary refresh. [2025-09-26T21:50:38.242373] [INFO ] [REMOTE ] UI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:50:38.311745] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-04. [2025-09-26T21:50:38.488247] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-26T21:50:39.111732] [INFO ] [REMOTE ] UI: Fetching primary data for 2024-12. [2025-09-26T21:50:39.911700] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-04. [2025-09-26T21:50:39.993740] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-26T21:50:40.057212] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-26T21:50:40.545343] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-26T21:50:40.711733] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-05. [2025-09-26T21:50:41.491275] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-26T21:50:41.511720] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-05. [2025-09-26T21:50:42.311726] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-09. [2025-09-26T21:50:43.109623] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-26T21:50:43.117669] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-01. [2025-09-26T21:50:43.399188] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-26T21:50:43.403906] [INFO ] [REMOTE ] UHAL: Full fetch complete (23251 records). [2025-09-26T21:50:43.404019] [DEBUG] [VALIDATOR ] UHAL: Validating primary data. [2025-09-26T21:50:43.801081] [DEBUG] [VALIDATOR ] UHAL: All expected trading days are present. [2025-09-26T21:50:43.801178] [DEBUG] [VALIDATOR ] UHAL: Primary data validation passed. [2025-09-26T21:50:43.801730] [INFO ] [MAIN ] UHAL: Fetched primary data is valid. [2025-09-26T21:50:43.801791] [DEBUG] [LOCAL ] UHAL: Saving primary data. [2025-09-26T21:50:43.802761] [DEBUG] [LOCAL ] UHAL: Trimmed 23251 records to 16817 (keeping 200 days of data) [2025-09-26T21:50:43.907248] [DEBUG] [LOCAL ] UHAL: Primary data saved (16817 records). [2025-09-26T21:50:43.907401] [INFO ] [MAIN ] UHAL: Full history saved. [2025-09-26T21:50:43.907514] [INFO ] [MAIN ] Update Progress: 2177/2371 symbols completed. UHAL took 29.0s. Estimated remaining: 25m 54s. Rate: 7.5 symbols/min [2025-09-26T21:50:43.919263] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-06. [2025-09-26T21:50:44.087031] [INFO ] [MAIN ] UIS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:50:44.106316] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-26T21:50:44.145059] [DEBUG] [LOCAL ] UIS: Loaded 37319 existing records from primary storage. [2025-09-26T21:50:44.145212] [INFO ] [MAIN ] UIS: Loaded 37319 existing records. [2025-09-26T21:50:44.328424] [WARN ] [MAIN ] UIS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:50:44.328734] [INFO ] [MAIN ] UIS: Wiping existing primary data before full refresh. [2025-09-26T21:50:44.328792] [INFO ] [LOCAL ] UIS: Starting deletion of primary data. [2025-09-26T21:50:44.329568] [DEBUG] [LOCAL ] UIS: Deleted primary data file. [2025-09-26T21:50:44.329629] [INFO ] [MAIN ] UIS: Starting full primary refresh. [2025-09-26T21:50:44.713005] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-02. [2025-09-26T21:50:44.738552] [INFO ] [REMOTE ] UIS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:50:45.511687] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-06. [2025-09-26T21:50:45.679572] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-26T21:50:45.825162] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-26T21:50:46.311712] [INFO ] [REMOTE ] UIS: Fetching primary data for 2024-12. [2025-09-26T21:50:46.320225] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-26T21:50:47.111750] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-03. [2025-09-26T21:50:47.720360] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-26T21:50:47.911719] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-01. [2025-09-26T21:50:48.167038] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-26T21:50:48.711777] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-07. [2025-09-26T21:50:49.276849] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-26T21:50:49.293575] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-26T21:50:49.511760] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-08. [2025-09-26T21:50:50.311729] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-02. [2025-09-26T21:50:50.330718] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-26T21:50:51.111769] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-09. [2025-09-26T21:50:51.735034] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-26T21:50:51.911726] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-04. [2025-09-26T21:50:51.947983] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-26T21:50:51.952039] [INFO ] [REMOTE ] UHT: Full fetch complete (15188 records). [2025-09-26T21:50:51.952173] [DEBUG] [VALIDATOR ] UHT: Validating primary data. [2025-09-26T21:50:52.364249] [DEBUG] [VALIDATOR ] UHT: All expected trading days are present. [2025-09-26T21:50:52.364361] [DEBUG] [VALIDATOR ] UHT: Primary data validation passed. [2025-09-26T21:50:52.364763] [INFO ] [MAIN ] UHT: Fetched primary data is valid. [2025-09-26T21:50:52.364825] [DEBUG] [LOCAL ] UHT: Saving primary data. [2025-09-26T21:50:52.365433] [DEBUG] [LOCAL ] UHT: Trimmed 15188 records to 10131 (keeping 200 days of data) [2025-09-26T21:50:52.432541] [DEBUG] [LOCAL ] UHT: Primary data saved (10131 records). [2025-09-26T21:50:52.432741] [INFO ] [MAIN ] UHT: Full history saved. [2025-09-26T21:50:52.432872] [INFO ] [MAIN ] Update Progress: 2178/2371 symbols completed. UHT took 24.5s. Estimated remaining: 25m 46s. Rate: 7.5 symbols/min [2025-09-26T21:50:52.623340] [INFO ] [MAIN ] UL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:50:52.680155] [DEBUG] [LOCAL ] UL: Loaded 53455 existing records from primary storage. [2025-09-26T21:50:52.680345] [INFO ] [MAIN ] UL: Loaded 53455 existing records. [2025-09-26T21:50:52.716879] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-03. [2025-09-26T21:50:52.891899] [WARN ] [MAIN ] UL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:50:52.892377] [INFO ] [MAIN ] UL: Wiping existing primary data before full refresh. [2025-09-26T21:50:52.892438] [INFO ] [LOCAL ] UL: Starting deletion of primary data. [2025-09-26T21:50:52.894083] [DEBUG] [LOCAL ] UL: Deleted primary data file. [2025-09-26T21:50:52.894148] [INFO ] [MAIN ] UL: Starting full primary refresh. [2025-09-26T21:50:52.998745] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-26T21:50:53.305934] [INFO ] [REMOTE ] UL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:50:53.511751] [INFO ] [REMOTE ] UL: Fetching primary data for 2024-12. [2025-09-26T21:50:54.263586] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T21:50:54.311726] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-04. [2025-09-26T21:50:55.111712] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-07. [2025-09-26T21:50:55.337318] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-26T21:50:55.803256] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-26T21:50:55.911720] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-05. [2025-09-26T21:50:56.429135] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-26T21:50:56.711762] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-05. [2025-09-26T21:50:57.497851] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-26T21:50:57.511673] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-06. [2025-09-26T21:50:57.770782] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-26T21:50:58.311746] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-01. [2025-09-26T21:50:59.055527] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-26T21:50:59.111704] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-06. [2025-09-26T21:50:59.911718] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-08. [2025-09-26T21:51:00.019313] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-26T21:51:00.252942] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-26T21:51:00.616854] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-26T21:51:00.711730] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-02. [2025-09-26T21:51:01.511760] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-07. [2025-09-26T21:51:02.311724] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-09. [2025-09-26T21:51:02.626799] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-26T21:51:03.027396] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-26T21:51:03.035929] [INFO ] [REMOTE ] UHS: Full fetch complete (58254 records). [2025-09-26T21:51:03.036165] [DEBUG] [VALIDATOR ] UHS: Validating primary data. [2025-09-26T21:51:03.117078] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-07. [2025-09-26T21:51:03.158909] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-26T21:51:03.578549] [DEBUG] [VALIDATOR ] UHS: All expected trading days are present. [2025-09-26T21:51:03.578703] [DEBUG] [VALIDATOR ] UHS: Primary data validation passed. [2025-09-26T21:51:03.579828] [INFO ] [MAIN ] UHS: Fetched primary data is valid. [2025-09-26T21:51:03.579956] [DEBUG] [LOCAL ] UHS: Saving primary data. [2025-09-26T21:51:03.582158] [DEBUG] [LOCAL ] UHS: Trimmed 58254 records to 41674 (keeping 200 days of data) [2025-09-26T21:51:03.876208] [DEBUG] [LOCAL ] UHS: Primary data saved (41674 records). [2025-09-26T21:51:03.876351] [INFO ] [MAIN ] UHS: Full history saved. [2025-09-26T21:51:03.876479] [INFO ] [MAIN ] Update Progress: 2179/2371 symbols completed. UHS took 37.8s. Estimated remaining: 25m 39s. Rate: 7.5 symbols/min [2025-09-26T21:51:03.916812] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-08. [2025-09-26T21:51:04.060721] [INFO ] [MAIN ] ULS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:51:04.101236] [DEBUG] [LOCAL ] ULS: Loaded 39538 existing records from primary storage. [2025-09-26T21:51:04.101390] [INFO ] [MAIN ] ULS: Loaded 39538 existing records. [2025-09-26T21:51:04.294905] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-26T21:51:04.330346] [WARN ] [MAIN ] ULS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:51:04.330699] [INFO ] [MAIN ] ULS: Wiping existing primary data before full refresh. [2025-09-26T21:51:04.330764] [INFO ] [LOCAL ] ULS: Starting deletion of primary data. [2025-09-26T21:51:04.331749] [DEBUG] [LOCAL ] ULS: Deleted primary data file. [2025-09-26T21:51:04.331832] [INFO ] [MAIN ] ULS: Starting full primary refresh. [2025-09-26T21:51:04.710295] [INFO ] [REMOTE ] ULS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:51:04.711675] [INFO ] [REMOTE ] ULS: Fetching primary data for 2024-12. [2025-09-26T21:51:05.452156] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-26T21:51:05.511734] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-09. [2025-09-26T21:51:06.234409] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-26T21:51:06.311766] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-01. [2025-09-26T21:51:07.030217] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-26T21:51:07.037398] [INFO ] [REMOTE ] UIS: Full fetch complete (51825 records). [2025-09-26T21:51:07.037552] [DEBUG] [VALIDATOR ] UIS: Validating primary data. [2025-09-26T21:51:07.114672] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-03. [2025-09-26T21:51:07.482948] [DEBUG] [VALIDATOR ] UIS: All expected trading days are present. [2025-09-26T21:51:07.483115] [DEBUG] [VALIDATOR ] UIS: Primary data validation passed. [2025-09-26T21:51:07.484343] [INFO ] [MAIN ] UIS: Fetched primary data is valid. [2025-09-26T21:51:07.484487] [DEBUG] [LOCAL ] UIS: Saving primary data. [2025-09-26T21:51:07.488184] [DEBUG] [LOCAL ] UIS: Trimmed 51825 records to 37552 (keeping 200 days of data) [2025-09-26T21:51:07.588441] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-26T21:51:07.730254] [DEBUG] [LOCAL ] UIS: Primary data saved (37552 records). [2025-09-26T21:51:07.730433] [INFO ] [MAIN ] UIS: Full history saved. [2025-09-26T21:51:07.730555] [INFO ] [MAIN ] Update Progress: 2180/2371 symbols completed. UIS took 23.8s. Estimated remaining: 25m 30s. Rate: 7.5 symbols/min [2025-09-26T21:51:07.908299] [INFO ] [MAIN ] UMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:51:07.911689] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-02. [2025-09-26T21:51:07.961451] [DEBUG] [LOCAL ] UMC: Loaded 53104 existing records from primary storage. [2025-09-26T21:51:07.961611] [INFO ] [MAIN ] UMC: Loaded 53104 existing records. [2025-09-26T21:51:08.194592] [WARN ] [MAIN ] UMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:51:08.194898] [INFO ] [MAIN ] UMC: Wiping existing primary data before full refresh. [2025-09-26T21:51:08.194955] [INFO ] [LOCAL ] UMC: Starting deletion of primary data. [2025-09-26T21:51:08.196141] [DEBUG] [LOCAL ] UMC: Deleted primary data file. [2025-09-26T21:51:08.196204] [INFO ] [MAIN ] UMC: Starting full primary refresh. [2025-09-26T21:51:08.587207] [INFO ] [REMOTE ] UMC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:51:08.711713] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-08. [2025-09-26T21:51:08.854728] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-26T21:51:09.309762] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-26T21:51:09.511730] [INFO ] [REMOTE ] UMC: Fetching primary data for 2024-12. [2025-09-26T21:51:09.834985] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-26T21:51:10.311738] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-09. [2025-09-26T21:51:11.111716] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-04. [2025-09-26T21:51:11.401968] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-26T21:51:11.437706] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-26T21:51:11.441723] [INFO ] [REMOTE ] UI: Full fetch complete (18229 records). [2025-09-26T21:51:11.441817] [DEBUG] [VALIDATOR ] UI: Validating primary data. [2025-09-26T21:51:11.850552] [DEBUG] [VALIDATOR ] UI: All expected trading days are present. [2025-09-26T21:51:11.850639] [DEBUG] [VALIDATOR ] UI: Primary data validation passed. [2025-09-26T21:51:11.851174] [INFO ] [MAIN ] UI: Fetched primary data is valid. [2025-09-26T21:51:11.851270] [DEBUG] [LOCAL ] UI: Saving primary data. [2025-09-26T21:51:11.852098] [DEBUG] [LOCAL ] UI: Trimmed 18229 records to 13008 (keeping 200 days of data) [2025-09-26T21:51:11.915949] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-01. [2025-09-26T21:51:11.946548] [DEBUG] [LOCAL ] UI: Primary data saved (13008 records). [2025-09-26T21:51:11.946775] [INFO ] [MAIN ] UI: Full history saved. [2025-09-26T21:51:11.946944] [INFO ] [MAIN ] Update Progress: 2181/2371 symbols completed. UI took 34.5s. Estimated remaining: 25m 22s. Rate: 7.5 symbols/min [2025-09-26T21:51:12.126128] [INFO ] [MAIN ] UMH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:51:12.164028] [DEBUG] [LOCAL ] UMH: Loaded 33809 existing records from primary storage. [2025-09-26T21:51:12.164213] [INFO ] [MAIN ] UMH: Loaded 33809 existing records. [2025-09-26T21:51:12.355081] [WARN ] [MAIN ] UMH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:51:12.355356] [INFO ] [MAIN ] UMH: Wiping existing primary data before full refresh. [2025-09-26T21:51:12.355405] [INFO ] [LOCAL ] UMH: Starting deletion of primary data. [2025-09-26T21:51:12.356300] [DEBUG] [LOCAL ] UMH: Deleted primary data file. [2025-09-26T21:51:12.356363] [INFO ] [MAIN ] UMH: Starting full primary refresh. [2025-09-26T21:51:12.715246] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-03. [2025-09-26T21:51:12.750790] [INFO ] [REMOTE ] UMH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:51:13.061700] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-26T21:51:13.511727] [INFO ] [REMOTE ] UMH: Fetching primary data for 2024-12. [2025-09-26T21:51:13.803798] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-26T21:51:13.989979] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-26T21:51:14.311746] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-05. [2025-09-26T21:51:14.617956] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-26T21:51:15.111723] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-02. [2025-09-26T21:51:15.911707] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-01. [2025-09-26T21:51:16.155572] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-26T21:51:16.711713] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-04. [2025-09-26T21:51:16.815787] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-26T21:51:16.982053] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-26T21:51:17.511736] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-06. [2025-09-26T21:51:18.285686] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-26T21:51:18.311738] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-02. [2025-09-26T21:51:19.060314] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T21:51:19.111706] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-05. [2025-09-26T21:51:19.439071] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-26T21:51:19.911718] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-03. [2025-09-26T21:51:20.663599] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-26T21:51:20.711700] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-07. [2025-09-26T21:51:21.511717] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-03. [2025-09-26T21:51:21.820221] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-26T21:51:22.311701] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-06. [2025-09-26T21:51:22.598042] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-26T21:51:22.977472] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-26T21:51:23.111713] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-04. [2025-09-26T21:51:23.378054] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-26T21:51:23.911733] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-07. [2025-09-26T21:51:24.630754] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T21:51:24.711776] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-08. [2025-09-26T21:51:25.366989] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-26T21:51:25.511741] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-05. [2025-09-26T21:51:26.311788] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-08. [2025-09-26T21:51:26.716618] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-26T21:51:26.920157] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-26T21:51:27.111773] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-06. [2025-09-26T21:51:27.574080] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-26T21:51:27.911742] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-09. [2025-09-26T21:51:28.423058] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-26T21:51:28.711743] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-09. [2025-09-26T21:51:29.481762] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-26T21:51:29.489296] [INFO ] [REMOTE ] ULS: Full fetch complete (54353 records). [2025-09-26T21:51:29.489408] [DEBUG] [VALIDATOR ] ULS: Validating primary data. [2025-09-26T21:51:29.524122] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-07. [2025-09-26T21:51:29.923608] [DEBUG] [VALIDATOR ] ULS: All expected trading days are present. [2025-09-26T21:51:29.923749] [DEBUG] [VALIDATOR ] ULS: Primary data validation passed. [2025-09-26T21:51:29.925013] [INFO ] [MAIN ] ULS: Fetched primary data is valid. [2025-09-26T21:51:29.925093] [DEBUG] [LOCAL ] ULS: Saving primary data. [2025-09-26T21:51:29.926572] [DEBUG] [LOCAL ] ULS: Trimmed 54353 records to 39769 (keeping 200 days of data) [2025-09-26T21:51:30.193483] [DEBUG] [LOCAL ] ULS: Primary data saved (39769 records). [2025-09-26T21:51:30.193667] [INFO ] [MAIN ] ULS: Full history saved. [2025-09-26T21:51:30.193833] [INFO ] [MAIN ] Update Progress: 2182/2371 symbols completed. ULS took 26.3s. Estimated remaining: 25m 15s. Rate: 7.5 symbols/min [2025-09-26T21:51:30.315213] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-04. [2025-09-26T21:51:30.402264] [INFO ] [MAIN ] UNF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:51:30.417720] [DEBUG] [LOCAL ] UNF: Loaded 11977 existing records from primary storage. [2025-09-26T21:51:30.417861] [INFO ] [MAIN ] UNF: Loaded 11977 existing records. [2025-09-26T21:51:30.654033] [WARN ] [MAIN ] UNF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:51:30.654795] [INFO ] [MAIN ] UNF: Wiping existing primary data before full refresh. [2025-09-26T21:51:30.655110] [INFO ] [LOCAL ] UNF: Starting deletion of primary data. [2025-09-26T21:51:30.656018] [DEBUG] [LOCAL ] UNF: Deleted primary data file. [2025-09-26T21:51:30.656162] [INFO ] [MAIN ] UNF: Starting full primary refresh. [2025-09-26T21:51:30.824388] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-26T21:51:30.945021] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-26T21:51:30.981954] [INFO ] [REMOTE ] UL: Full fetch complete (76878 records). [2025-09-26T21:51:31.030273] [DEBUG] [VALIDATOR ] UL: Validating primary data. [2025-09-26T21:51:31.112033] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-08. [2025-09-26T21:51:31.296930] [INFO ] [REMOTE ] UNF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:51:31.599698] [DEBUG] [VALIDATOR ] UL: All expected trading days are present. [2025-09-26T21:51:31.599797] [DEBUG] [VALIDATOR ] UL: Primary data validation passed. [2025-09-26T21:51:31.600946] [INFO ] [MAIN ] UL: Fetched primary data is valid. [2025-09-26T21:51:31.601014] [DEBUG] [LOCAL ] UL: Saving primary data. [2025-09-26T21:51:31.602781] [DEBUG] [LOCAL ] UL: Trimmed 76878 records to 53843 (keeping 200 days of data) [2025-09-26T21:51:31.917013] [INFO ] [REMOTE ] UNF: Fetching primary data for 2024-12. [2025-09-26T21:51:31.984905] [DEBUG] [LOCAL ] UL: Primary data saved (53843 records). [2025-09-26T21:51:31.985109] [INFO ] [MAIN ] UL: Full history saved. [2025-09-26T21:51:31.985284] [INFO ] [MAIN ] Update Progress: 2183/2371 symbols completed. UL took 39.6s. Estimated remaining: 25m 6s. Rate: 7.5 symbols/min [2025-09-26T21:51:32.205414] [INFO ] [MAIN ] UNFI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:51:32.246628] [DEBUG] [LOCAL ] UNFI: Loaded 42191 existing records from primary storage. [2025-09-26T21:51:32.246837] [INFO ] [MAIN ] UNFI: Loaded 42191 existing records. [2025-09-26T21:51:32.442757] [WARN ] [MAIN ] UNFI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:51:32.443286] [INFO ] [MAIN ] UNFI: Wiping existing primary data before full refresh. [2025-09-26T21:51:32.443366] [INFO ] [LOCAL ] UNFI: Starting deletion of primary data. [2025-09-26T21:51:32.459240] [DEBUG] [LOCAL ] UNFI: Deleted primary data file. [2025-09-26T21:51:32.482089] [INFO ] [MAIN ] UNFI: Starting full primary refresh. [2025-09-26T21:51:32.523868] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-26T21:51:32.722563] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-05. [2025-09-26T21:51:32.917171] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-26T21:51:32.916477] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-26T21:51:32.964864] [INFO ] [REMOTE ] UNFI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:51:33.511754] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-09. [2025-09-26T21:51:34.311704] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-01. [2025-09-26T21:51:34.761257] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-26T21:51:35.095587] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-26T21:51:35.103948] [INFO ] [REMOTE ] UMH: Full fetch complete (46507 records). [2025-09-26T21:51:35.104154] [DEBUG] [VALIDATOR ] UMH: Validating primary data. [2025-09-26T21:51:35.116798] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-06. [2025-09-26T21:51:35.231275] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-26T21:51:35.545296] [DEBUG] [VALIDATOR ] UMH: All expected trading days are present. [2025-09-26T21:51:35.545390] [DEBUG] [VALIDATOR ] UMH: Primary data validation passed. [2025-09-26T21:51:35.546369] [INFO ] [MAIN ] UMH: Fetched primary data is valid. [2025-09-26T21:51:35.546450] [DEBUG] [LOCAL ] UMH: Saving primary data. [2025-09-26T21:51:35.547629] [DEBUG] [LOCAL ] UMH: Trimmed 46507 records to 34078 (keeping 200 days of data) [2025-09-26T21:51:35.759899] [DEBUG] [LOCAL ] UMH: Primary data saved (34078 records). [2025-09-26T21:51:35.760058] [INFO ] [MAIN ] UMH: Full history saved. [2025-09-26T21:51:35.760151] [INFO ] [MAIN ] Update Progress: 2184/2371 symbols completed. UMH took 23.8s. Estimated remaining: 24m 58s. Rate: 7.5 symbols/min [2025-09-26T21:51:35.917870] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2024-12. [2025-09-26T21:51:35.946530] [INFO ] [MAIN ] UNH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:51:36.003894] [DEBUG] [LOCAL ] UNH: Loaded 54184 existing records from primary storage. [2025-09-26T21:51:36.004068] [INFO ] [MAIN ] UNH: Loaded 54184 existing records. [2025-09-26T21:51:36.193847] [WARN ] [MAIN ] UNH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:51:36.194102] [INFO ] [MAIN ] UNH: Wiping existing primary data before full refresh. [2025-09-26T21:51:36.194155] [INFO ] [LOCAL ] UNH: Starting deletion of primary data. [2025-09-26T21:51:36.195579] [DEBUG] [LOCAL ] UNH: Deleted primary data file. [2025-09-26T21:51:36.195673] [INFO ] [MAIN ] UNH: Starting full primary refresh. [2025-09-26T21:51:36.595768] [INFO ] [REMOTE ] UNH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:51:36.711694] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-02. [2025-09-26T21:51:36.972547] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-26T21:51:37.511743] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-07. [2025-09-26T21:51:37.623757] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-26T21:51:37.779544] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-26T21:51:38.311724] [INFO ] [REMOTE ] UNH: Fetching primary data for 2024-12. [2025-09-26T21:51:39.111708] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-01. [2025-09-26T21:51:39.331325] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-26T21:51:39.911748] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-08. [2025-09-26T21:51:40.245763] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-26T21:51:40.711721] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-03. [2025-09-26T21:51:41.018233] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2024-12 (2.71 seconds). [2025-09-26T21:51:41.511717] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-01. [2025-09-26T21:51:41.633504] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-26T21:51:41.673018] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-26T21:51:42.311721] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-02. [2025-09-26T21:51:43.111721] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-04. [2025-09-26T21:51:43.303592] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-26T21:51:43.860296] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-09-26T21:51:43.911703] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-09. [2025-09-26T21:51:44.166545] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-26T21:51:44.711721] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-02. [2025-09-26T21:51:45.511714] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-05. [2025-09-26T21:51:45.822621] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-26T21:51:45.833725] [INFO ] [REMOTE ] UMC: Full fetch complete (76588 records). [2025-09-26T21:51:45.833870] [DEBUG] [VALIDATOR ] UMC: Validating primary data. [2025-09-26T21:51:46.251490] [DEBUG] [VALIDATOR ] UMC: All expected trading days are present. [2025-09-26T21:51:46.251725] [DEBUG] [VALIDATOR ] UMC: Primary data validation passed. [2025-09-26T21:51:46.252989] [INFO ] [MAIN ] UMC: Fetched primary data is valid. [2025-09-26T21:51:46.253070] [DEBUG] [LOCAL ] UMC: Saving primary data. [2025-09-26T21:51:46.254858] [DEBUG] [LOCAL ] UMC: Trimmed 76588 records to 53490 (keeping 200 days of data) [2025-09-26T21:51:46.322060] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-03. [2025-09-26T21:51:46.369633] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-26T21:51:46.606860] [DEBUG] [LOCAL ] UMC: Primary data saved (53490 records). [2025-09-26T21:51:46.607052] [INFO ] [MAIN ] UMC: Full history saved. [2025-09-26T21:51:46.607253] [INFO ] [MAIN ] Update Progress: 2185/2371 symbols completed. UMC took 38.9s. Estimated remaining: 24m 50s. Rate: 7.5 symbols/min [2025-09-26T21:51:46.739266] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-26T21:51:46.842483] [INFO ] [MAIN ] UNM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:51:46.891063] [DEBUG] [LOCAL ] UNM: Loaded 49045 existing records from primary storage. [2025-09-26T21:51:46.891236] [INFO ] [MAIN ] UNM: Loaded 49045 existing records. [2025-09-26T21:51:47.078336] [WARN ] [MAIN ] UNM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:51:47.078615] [INFO ] [MAIN ] UNM: Wiping existing primary data before full refresh. [2025-09-26T21:51:47.078695] [INFO ] [LOCAL ] UNM: Starting deletion of primary data. [2025-09-26T21:51:47.079809] [DEBUG] [LOCAL ] UNM: Deleted primary data file. [2025-09-26T21:51:47.079886] [INFO ] [MAIN ] UNM: Starting full primary refresh. [2025-09-26T21:51:47.116877] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-06. [2025-09-26T21:51:47.447195] [INFO ] [REMOTE ] UNM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:51:47.911699] [INFO ] [REMOTE ] UNM: Fetching primary data for 2024-12. [2025-09-26T21:51:48.080047] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-26T21:51:48.131338] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-26T21:51:48.711710] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-07. [2025-09-26T21:51:49.511711] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-03. [2025-09-26T21:51:49.681529] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-26T21:51:49.701637] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-26T21:51:50.311770] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-08. [2025-09-26T21:51:51.111737] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-01. [2025-09-26T21:51:51.123316] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-26T21:51:51.754073] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-26T21:51:51.911717] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-04. [2025-09-26T21:51:52.711688] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-04. [2025-09-26T21:51:52.817363] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-26T21:51:53.334354] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-26T21:51:53.511734] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-09. [2025-09-26T21:51:54.311707] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-02. [2025-09-26T21:51:54.369393] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-26T21:51:54.372171] [INFO ] [REMOTE ] UNF: Full fetch complete (17213 records). [2025-09-26T21:51:54.372252] [DEBUG] [VALIDATOR ] UNF: Validating primary data. [2025-09-26T21:51:54.773324] [DEBUG] [VALIDATOR ] UNF: All expected trading days are present. [2025-09-26T21:51:54.773440] [DEBUG] [VALIDATOR ] UNF: Primary data validation passed. [2025-09-26T21:51:54.773926] [INFO ] [MAIN ] UNF: Fetched primary data is valid. [2025-09-26T21:51:54.773992] [DEBUG] [LOCAL ] UNF: Saving primary data. [2025-09-26T21:51:54.774598] [DEBUG] [LOCAL ] UNF: Trimmed 17213 records to 12048 (keeping 200 days of data) [2025-09-26T21:51:54.854986] [DEBUG] [LOCAL ] UNF: Primary data saved (12048 records). [2025-09-26T21:51:54.855428] [INFO ] [MAIN ] UNF: Full history saved. [2025-09-26T21:51:54.855547] [INFO ] [MAIN ] Update Progress: 2186/2371 symbols completed. UNF took 24.7s. Estimated remaining: 24m 42s. Rate: 7.5 symbols/min [2025-09-26T21:51:55.045153] [INFO ] [MAIN ] UNMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:51:55.051090] [DEBUG] [LOCAL ] UNMA: Loaded 3611 existing records from primary storage. [2025-09-26T21:51:55.051207] [INFO ] [MAIN ] UNMA: Loaded 3611 existing records. [2025-09-26T21:51:55.122613] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-05. [2025-09-26T21:51:55.246116] [WARN ] [MAIN ] UNMA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:51:55.246754] [INFO ] [MAIN ] UNMA: Wiping existing primary data before full refresh. [2025-09-26T21:51:55.246912] [INFO ] [LOCAL ] UNMA: Starting deletion of primary data. [2025-09-26T21:51:55.247240] [DEBUG] [LOCAL ] UNMA: Deleted primary data file. [2025-09-26T21:51:55.247392] [INFO ] [MAIN ] UNMA: Starting full primary refresh. [2025-09-26T21:51:55.619899] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-04 (2.91 seconds). [2025-09-26T21:51:55.698991] [INFO ] [REMOTE ] UNMA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:51:55.918407] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-05. [2025-09-26T21:51:55.936700] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-26T21:51:56.448194] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-26T21:51:56.711732] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-03. [2025-09-26T21:51:57.511723] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2024-12. [2025-09-26T21:51:58.311714] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-06. [2025-09-26T21:51:58.336222] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-26T21:51:58.542571] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-26T21:51:58.820755] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-05 (2.90 seconds). [2025-09-26T21:51:59.111746] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-01. [2025-09-26T21:51:59.716785] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-26T21:51:59.911718] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-04. [2025-09-26T21:52:00.041297] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-26T21:52:00.711728] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-02. [2025-09-26T21:52:01.262034] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-26T21:52:01.511732] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-03. [2025-09-26T21:52:01.690555] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-26T21:52:02.140886] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-26T21:52:02.311749] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-05. [2025-09-26T21:52:03.111711] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-07. [2025-09-26T21:52:03.911692] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-06. [2025-09-26T21:52:04.012686] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-26T21:52:04.711696] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-06. [2025-09-26T21:52:04.980004] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-26T21:52:05.511729] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-08. [2025-09-26T21:52:06.234001] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-26T21:52:06.311709] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-07. [2025-09-26T21:52:06.511494] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-09-26T21:52:07.071108] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-26T21:52:07.111687] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-04. [2025-09-26T21:52:07.691958] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-26T21:52:07.695539] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-26T21:52:07.911740] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-08. [2025-09-26T21:52:08.711725] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-09. [2025-09-26T21:52:09.511706] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-05. [2025-09-26T21:52:09.574137] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-26T21:52:10.142615] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-26T21:52:10.300567] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-26T21:52:10.309174] [INFO ] [REMOTE ] UNFI: Full fetch complete (59059 records). [2025-09-26T21:52:10.309331] [DEBUG] [VALIDATOR ] UNFI: Validating primary data. [2025-09-26T21:52:10.321118] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-07. [2025-09-26T21:52:10.735690] [DEBUG] [VALIDATOR ] UNFI: All expected trading days are present. [2025-09-26T21:52:10.735812] [DEBUG] [VALIDATOR ] UNFI: Primary data validation passed. [2025-09-26T21:52:10.737030] [INFO ] [MAIN ] UNFI: Fetched primary data is valid. [2025-09-26T21:52:10.737107] [DEBUG] [LOCAL ] UNFI: Saving primary data. [2025-09-26T21:52:10.738605] [DEBUG] [LOCAL ] UNFI: Trimmed 59059 records to 42528 (keeping 200 days of data) [2025-09-26T21:52:11.009056] [DEBUG] [LOCAL ] UNFI: Primary data saved (42528 records). [2025-09-26T21:52:11.009197] [INFO ] [MAIN ] UNFI: Full history saved. [2025-09-26T21:52:11.009320] [INFO ] [MAIN ] Update Progress: 2187/2371 symbols completed. UNFI took 39.0s. Estimated remaining: 24m 35s. Rate: 7.5 symbols/min [2025-09-26T21:52:11.114689] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-09. [2025-09-26T21:52:11.188249] [INFO ] [MAIN ] UNP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:52:11.240236] [DEBUG] [LOCAL ] UNP: Loaded 53641 existing records from primary storage. [2025-09-26T21:52:11.240408] [INFO ] [MAIN ] UNP: Loaded 53641 existing records. [2025-09-26T21:52:11.423251] [WARN ] [MAIN ] UNP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:52:11.423494] [INFO ] [MAIN ] UNP: Wiping existing primary data before full refresh. [2025-09-26T21:52:11.423544] [INFO ] [LOCAL ] UNP: Starting deletion of primary data. [2025-09-26T21:52:11.424913] [DEBUG] [LOCAL ] UNP: Deleted primary data file. [2025-09-26T21:52:11.424988] [INFO ] [MAIN ] UNP: Starting full primary refresh. [2025-09-26T21:52:11.788205] [INFO ] [REMOTE ] UNP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:52:11.911727] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-06. [2025-09-26T21:52:12.465107] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-26T21:52:12.711734] [INFO ] [REMOTE ] UNP: Fetching primary data for 2024-12. [2025-09-26T21:52:12.817084] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-26T21:52:12.827379] [INFO ] [REMOTE ] UNM: Full fetch complete (70104 records). [2025-09-26T21:52:12.827539] [DEBUG] [VALIDATOR ] UNM: Validating primary data. [2025-09-26T21:52:13.279620] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-07 (2.96 seconds). [2025-09-26T21:52:13.313107] [DEBUG] [VALIDATOR ] UNM: All expected trading days are present. [2025-09-26T21:52:13.313418] [DEBUG] [VALIDATOR ] UNM: Primary data validation passed. [2025-09-26T21:52:13.314578] [INFO ] [MAIN ] UNM: Fetched primary data is valid. [2025-09-26T21:52:13.314828] [DEBUG] [LOCAL ] UNM: Saving primary data. [2025-09-26T21:52:13.316676] [DEBUG] [LOCAL ] UNM: Trimmed 70104 records to 49368 (keeping 200 days of data) [2025-09-26T21:52:13.534307] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-08. [2025-09-26T21:52:13.635556] [DEBUG] [LOCAL ] UNM: Primary data saved (49368 records). [2025-09-26T21:52:13.635875] [INFO ] [MAIN ] UNM: Full history saved. [2025-09-26T21:52:13.636017] [INFO ] [MAIN ] Update Progress: 2188/2371 symbols completed. UNM took 27.0s. Estimated remaining: 24m 26s. Rate: 7.5 symbols/min [2025-09-26T21:52:13.811156] [INFO ] [MAIN ] UP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:52:13.853871] [DEBUG] [LOCAL ] UP: Loaded 43475 existing records from primary storage. [2025-09-26T21:52:13.854021] [INFO ] [MAIN ] UP: Loaded 43475 existing records. [2025-09-26T21:52:14.035719] [WARN ] [MAIN ] UP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:52:14.036025] [INFO ] [MAIN ] UP: Wiping existing primary data before full refresh. [2025-09-26T21:52:14.036079] [INFO ] [LOCAL ] UP: Starting deletion of primary data. [2025-09-26T21:52:14.036930] [DEBUG] [LOCAL ] UP: Deleted primary data file. [2025-09-26T21:52:14.036992] [INFO ] [MAIN ] UP: Starting full primary refresh. [2025-09-26T21:52:14.314508] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-07. [2025-09-26T21:52:14.409407] [INFO ] [REMOTE ] UP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:52:14.507616] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T21:52:14.972714] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-26T21:52:15.111723] [INFO ] [REMOTE ] UP: Fetching primary data for 2024-12. [2025-09-26T21:52:15.911727] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-08. [2025-09-26T21:52:16.356207] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-08 (2.82 seconds). [2025-09-26T21:52:16.459627] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-26T21:52:16.711686] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-01. [2025-09-26T21:52:16.808903] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-26T21:52:17.511718] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-09. [2025-09-26T21:52:17.989518] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-26T21:52:17.990785] [INFO ] [REMOTE ] UNMA: Full fetch complete (5784 records). [2025-09-26T21:52:17.990858] [DEBUG] [VALIDATOR ] UNMA: Validating primary data. [2025-09-26T21:52:18.316857] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-01. [2025-09-26T21:52:18.379556] [DEBUG] [VALIDATOR ] UNMA: All expected trading days are present. [2025-09-26T21:52:18.379739] [DEBUG] [VALIDATOR ] UNMA: Primary data validation passed. [2025-09-26T21:52:18.379955] [INFO ] [MAIN ] UNMA: Fetched primary data is valid. [2025-09-26T21:52:18.380035] [DEBUG] [LOCAL ] UNMA: Saving primary data. [2025-09-26T21:52:18.380604] [DEBUG] [LOCAL ] UNMA: Trimmed 5784 records to 3627 (keeping 200 days of data) [2025-09-26T21:52:18.403698] [DEBUG] [LOCAL ] UNMA: Primary data saved (3627 records). [2025-09-26T21:52:18.403794] [INFO ] [MAIN ] UNMA: Full history saved. [2025-09-26T21:52:18.403886] [INFO ] [MAIN ] Update Progress: 2189/2371 symbols completed. UNMA took 23.5s. Estimated remaining: 24m 18s. Rate: 7.5 symbols/min [2025-09-26T21:52:18.594478] [INFO ] [MAIN ] UPS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:52:18.629579] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-26T21:52:18.689023] [DEBUG] [LOCAL ] UPS: Loaded 54100 existing records from primary storage. [2025-09-26T21:52:18.689189] [INFO ] [MAIN ] UPS: Loaded 54100 existing records. [2025-09-26T21:52:18.871354] [WARN ] [MAIN ] UPS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:52:18.871600] [INFO ] [MAIN ] UPS: Wiping existing primary data before full refresh. [2025-09-26T21:52:18.871678] [INFO ] [LOCAL ] UPS: Starting deletion of primary data. [2025-09-26T21:52:18.873032] [DEBUG] [LOCAL ] UPS: Deleted primary data file. [2025-09-26T21:52:18.873104] [INFO ] [MAIN ] UPS: Starting full primary refresh. [2025-09-26T21:52:19.116830] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-09. [2025-09-26T21:52:19.297575] [INFO ] [REMOTE ] UPS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:52:19.911750] [INFO ] [REMOTE ] UPS: Fetching primary data for 2024-12. [2025-09-26T21:52:19.996174] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-26T21:52:20.048719] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-26T21:52:20.060263] [INFO ] [REMOTE ] UNH: Full fetch complete (77866 records). [2025-09-26T21:52:20.060480] [DEBUG] [VALIDATOR ] UNH: Validating primary data. [2025-09-26T21:52:20.543494] [DEBUG] [VALIDATOR ] UNH: All expected trading days are present. [2025-09-26T21:52:20.543624] [DEBUG] [VALIDATOR ] UNH: Primary data validation passed. [2025-09-26T21:52:20.544980] [INFO ] [MAIN ] UNH: Fetched primary data is valid. [2025-09-26T21:52:20.545051] [DEBUG] [LOCAL ] UNH: Saving primary data. [2025-09-26T21:52:20.546772] [DEBUG] [LOCAL ] UNH: Trimmed 77866 records to 54574 (keeping 200 days of data) [2025-09-26T21:52:20.758759] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-02. [2025-09-26T21:52:20.933836] [DEBUG] [LOCAL ] UNH: Primary data saved (54574 records). [2025-09-26T21:52:20.934032] [INFO ] [MAIN ] UNH: Full history saved. [2025-09-26T21:52:20.935660] [INFO ] [MAIN ] Update Progress: 2190/2371 symbols completed. UNH took 45.2s. Estimated remaining: 24m 9s. Rate: 7.5 symbols/min [2025-09-26T21:52:21.126809] [INFO ] [MAIN ] URI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:52:21.189339] [DEBUG] [LOCAL ] URI: Loaded 36449 existing records from primary storage. [2025-09-26T21:52:21.189487] [INFO ] [MAIN ] URI: Loaded 36449 existing records. [2025-09-26T21:52:21.381400] [WARN ] [MAIN ] URI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:52:21.381706] [INFO ] [MAIN ] URI: Wiping existing primary data before full refresh. [2025-09-26T21:52:21.381764] [INFO ] [LOCAL ] URI: Starting deletion of primary data. [2025-09-26T21:52:21.382545] [DEBUG] [LOCAL ] URI: Deleted primary data file. [2025-09-26T21:52:21.382606] [INFO ] [MAIN ] URI: Starting full primary refresh. [2025-09-26T21:52:21.516888] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-02. [2025-09-26T21:52:21.778753] [INFO ] [REMOTE ] URI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:52:21.816987] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-26T21:52:22.191346] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-26T21:52:22.311728] [INFO ] [REMOTE ] URI: Fetching primary data for 2024-12. [2025-09-26T21:52:23.111717] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-01. [2025-09-26T21:52:23.179695] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-26T21:52:23.864772] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-26T21:52:23.911709] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-03. [2025-09-26T21:52:24.711716] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-03. [2025-09-26T21:52:25.054969] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-26T21:52:25.511740] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-01. [2025-09-26T21:52:25.514420] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-26T21:52:26.311732] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-02. [2025-09-26T21:52:26.372426] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-26T21:52:27.111721] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-04. [2025-09-26T21:52:27.229910] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-26T21:52:27.911761] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-02. [2025-09-26T21:52:28.428831] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-26T21:52:28.711751] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-04. [2025-09-26T21:52:28.980063] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-26T21:52:29.457341] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-26T21:52:29.511766] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-05. [2025-09-26T21:52:30.075169] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-26T21:52:30.311740] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-03. [2025-09-26T21:52:31.072187] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-26T21:52:31.111685] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-06. [2025-09-26T21:52:31.884113] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-26T21:52:31.911681] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-04. [2025-09-26T21:52:32.643187] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-26T21:52:32.711716] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-03. [2025-09-26T21:52:33.511681] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-07. [2025-09-26T21:52:33.696954] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-26T21:52:34.311702] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-05. [2025-09-26T21:52:34.804775] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-26T21:52:35.111720] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-05. [2025-09-26T21:52:35.321239] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-26T21:52:35.888194] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-26T21:52:35.911672] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-06. [2025-09-26T21:52:36.319864] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-26T21:52:36.711730] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-06. [2025-09-26T21:52:37.269346] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-26T21:52:37.511747] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-07. [2025-09-26T21:52:38.174989] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-26T21:52:38.311760] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-08. [2025-09-26T21:52:39.111693] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-07. [2025-09-26T21:52:39.216918] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-26T21:52:39.911740] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-08. [2025-09-26T21:52:40.034170] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-26T21:52:40.711710] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-04. [2025-09-26T21:52:40.742846] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-26T21:52:40.915917] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-26T21:52:41.511727] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-09. [2025-09-26T21:52:42.267960] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-26T21:52:42.278956] [INFO ] [REMOTE ] UNP: Full fetch complete (76912 records). [2025-09-26T21:52:42.279109] [DEBUG] [VALIDATOR ] UNP: Validating primary data. [2025-09-26T21:52:42.316888] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-09. [2025-09-26T21:52:42.710265] [DEBUG] [VALIDATOR ] UNP: All expected trading days are present. [2025-09-26T21:52:42.710458] [DEBUG] [VALIDATOR ] UNP: Primary data validation passed. [2025-09-26T21:52:42.711868] [INFO ] [MAIN ] UNP: Fetched primary data is valid. [2025-09-26T21:52:42.712083] [DEBUG] [LOCAL ] UNP: Saving primary data. [2025-09-26T21:52:42.714043] [DEBUG] [LOCAL ] UNP: Trimmed 76912 records to 54030 (keeping 200 days of data) [2025-09-26T21:52:42.874570] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-26T21:52:43.122751] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-05. [2025-09-26T21:52:43.135850] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-26T21:52:43.147753] [INFO ] [REMOTE ] URI: Full fetch complete (53751 records). [2025-09-26T21:52:43.149122] [DEBUG] [VALIDATOR ] URI: Validating primary data. [2025-09-26T21:52:43.255517] [DEBUG] [LOCAL ] UNP: Primary data saved (54030 records). [2025-09-26T21:52:43.280037] [INFO ] [MAIN ] UNP: Full history saved. [2025-09-26T21:52:43.280172] [INFO ] [MAIN ] Update Progress: 2191/2371 symbols completed. UNP took 32.3s. Estimated remaining: 24m 3s. Rate: 7.5 symbols/min [2025-09-26T21:52:43.673987] [INFO ] [MAIN ] USA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:52:43.795848] [DEBUG] [VALIDATOR ] URI: All expected trading days are present. [2025-09-26T21:52:43.795980] [DEBUG] [VALIDATOR ] URI: Primary data validation passed. [2025-09-26T21:52:43.797235] [INFO ] [MAIN ] URI: Fetched primary data is valid. [2025-09-26T21:52:43.797324] [DEBUG] [LOCAL ] URI: Saving primary data. [2025-09-26T21:52:43.811220] [DEBUG] [LOCAL ] URI: Trimmed 53751 records to 36669 (keeping 200 days of data) [2025-09-26T21:52:43.892313] [DEBUG] [LOCAL ] USA: Loaded 36217 existing records from primary storage. [2025-09-26T21:52:43.920600] [INFO ] [MAIN ] USA: Loaded 36217 existing records. [2025-09-26T21:52:43.919915] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-08. [2025-09-26T21:52:44.136077] [WARN ] [MAIN ] USA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:52:44.137119] [INFO ] [MAIN ] USA: Wiping existing primary data before full refresh. [2025-09-26T21:52:44.137724] [INFO ] [LOCAL ] USA: Starting deletion of primary data. [2025-09-26T21:52:44.139103] [DEBUG] [LOCAL ] USA: Deleted primary data file. [2025-09-26T21:52:44.139635] [INFO ] [MAIN ] USA: Starting full primary refresh. [2025-09-26T21:52:44.584225] [INFO ] [REMOTE ] USA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:52:44.707962] [DEBUG] [LOCAL ] URI: Primary data saved (36669 records). [2025-09-26T21:52:44.708228] [INFO ] [MAIN ] URI: Full history saved. [2025-09-26T21:52:44.708580] [INFO ] [MAIN ] Update Progress: 2192/2371 symbols completed. URI took 23.8s. Estimated remaining: 23m 54s. Rate: 7.5 symbols/min [2025-09-26T21:52:44.723578] [INFO ] [REMOTE ] USA: Fetching primary data for 2024-12. [2025-09-26T21:52:44.914753] [INFO ] [MAIN ] USAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:52:44.942958] [DEBUG] [LOCAL ] USAC: Loaded 22931 existing records from primary storage. [2025-09-26T21:52:44.943170] [INFO ] [MAIN ] USAC: Loaded 22931 existing records. [2025-09-26T21:52:45.146212] [WARN ] [MAIN ] USAC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:52:45.146713] [INFO ] [MAIN ] USAC: Wiping existing primary data before full refresh. [2025-09-26T21:52:45.146788] [INFO ] [LOCAL ] USAC: Starting deletion of primary data. [2025-09-26T21:52:45.147600] [DEBUG] [LOCAL ] USAC: Deleted primary data file. [2025-09-26T21:52:45.147701] [INFO ] [MAIN ] USAC: Starting full primary refresh. [2025-09-26T21:52:45.550147] [INFO ] [REMOTE ] USAC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:52:45.551477] [INFO ] [REMOTE ] USAC: Fetching primary data for 2024-12. [2025-09-26T21:52:45.590121] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-09-26T21:52:45.732895] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-26T21:52:45.869372] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-26T21:52:46.313719] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-06. [2025-09-26T21:52:46.318974] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-26T21:52:47.111739] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-01. [2025-09-26T21:52:47.911719] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-09. [2025-09-26T21:52:48.598169] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-26T21:52:48.627840] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-09-26T21:52:48.711724] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-02. [2025-09-26T21:52:49.511766] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-07. [2025-09-26T21:52:50.108171] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-26T21:52:50.111678] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-26T21:52:50.131343] [INFO ] [REMOTE ] UP: Full fetch complete (62208 records). [2025-09-26T21:52:50.131623] [DEBUG] [VALIDATOR ] UP: Validating primary data. [2025-09-26T21:52:50.317399] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-01. [2025-09-26T21:52:50.544834] [DEBUG] [VALIDATOR ] UP: All expected trading days are present. [2025-09-26T21:52:50.544925] [DEBUG] [VALIDATOR ] UP: Primary data validation passed. [2025-09-26T21:52:50.546040] [INFO ] [MAIN ] UP: Fetched primary data is valid. [2025-09-26T21:52:50.546110] [DEBUG] [LOCAL ] UP: Saving primary data. [2025-09-26T21:52:50.548759] [DEBUG] [LOCAL ] UP: Trimmed 62208 records to 43857 (keeping 200 days of data) [2025-09-26T21:52:50.834589] [DEBUG] [LOCAL ] UP: Primary data saved (43857 records). [2025-09-26T21:52:50.834820] [INFO ] [MAIN ] UP: Full history saved. [2025-09-26T21:52:50.835105] [INFO ] [MAIN ] Update Progress: 2193/2371 symbols completed. UP took 37.2s. Estimated remaining: 23m 46s. Rate: 7.5 symbols/min [2025-09-26T21:52:51.037925] [INFO ] [MAIN ] USB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:52:51.103439] [DEBUG] [LOCAL ] USB: Loaded 54078 existing records from primary storage. [2025-09-26T21:52:51.103735] [INFO ] [MAIN ] USB: Loaded 54078 existing records. [2025-09-26T21:52:51.137326] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-03. [2025-09-26T21:52:51.297630] [WARN ] [MAIN ] USB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:52:51.297982] [INFO ] [MAIN ] USB: Wiping existing primary data before full refresh. [2025-09-26T21:52:51.298035] [INFO ] [LOCAL ] USB: Starting deletion of primary data. [2025-09-26T21:52:51.299464] [DEBUG] [LOCAL ] USB: Deleted primary data file. [2025-09-26T21:52:51.299528] [INFO ] [MAIN ] USB: Starting full primary refresh. [2025-09-26T21:52:51.711397] [INFO ] [REMOTE ] USB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:52:51.729962] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-26T21:52:51.848518] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-26T21:52:51.911739] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-02. [2025-09-26T21:52:52.711763] [INFO ] [REMOTE ] USB: Fetching primary data for 2024-12. [2025-09-26T21:52:52.855785] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-26T21:52:53.286055] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-26T21:52:53.511774] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-03. [2025-09-26T21:52:54.287476] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-26T21:52:54.311694] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-04. [2025-09-26T21:52:54.788158] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-26T21:52:55.111725] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-08. [2025-09-26T21:52:55.411057] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-26T21:52:55.911717] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-05. [2025-09-26T21:52:56.711732] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-04. [2025-09-26T21:52:57.300688] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-26T21:52:57.511704] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-01. [2025-09-26T21:52:57.645255] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-09-26T21:52:57.869884] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-26T21:52:58.311765] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-09. [2025-09-26T21:52:59.089479] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-26T21:52:59.118620] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-02. [2025-09-26T21:52:59.148398] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-26T21:52:59.160620] [INFO ] [REMOTE ] UPS: Full fetch complete (77755 records). [2025-09-26T21:52:59.161113] [DEBUG] [VALIDATOR ] UPS: Validating primary data. [2025-09-26T21:52:59.584564] [DEBUG] [VALIDATOR ] UPS: All expected trading days are present. [2025-09-26T21:52:59.584725] [DEBUG] [VALIDATOR ] UPS: Primary data validation passed. [2025-09-26T21:52:59.586255] [INFO ] [MAIN ] UPS: Fetched primary data is valid. [2025-09-26T21:52:59.586330] [DEBUG] [LOCAL ] UPS: Saving primary data. [2025-09-26T21:52:59.588427] [DEBUG] [LOCAL ] UPS: Trimmed 77755 records to 54490 (keeping 200 days of data) [2025-09-26T21:52:59.924351] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-05. [2025-09-26T21:52:59.983785] [DEBUG] [LOCAL ] UPS: Primary data saved (54490 records). [2025-09-26T21:52:59.984000] [INFO ] [MAIN ] UPS: Full history saved. [2025-09-26T21:52:59.984182] [INFO ] [MAIN ] Update Progress: 2194/2371 symbols completed. UPS took 41.6s. Estimated remaining: 23m 38s. Rate: 7.5 symbols/min [2025-09-26T21:53:00.178096] [INFO ] [MAIN ] USFD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:53:00.241921] [DEBUG] [LOCAL ] USFD: Loaded 51583 existing records from primary storage. [2025-09-26T21:53:00.242225] [INFO ] [MAIN ] USFD: Loaded 51583 existing records. [2025-09-26T21:53:00.425275] [WARN ] [MAIN ] USFD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:53:00.425606] [INFO ] [MAIN ] USFD: Wiping existing primary data before full refresh. [2025-09-26T21:53:00.425696] [INFO ] [LOCAL ] USFD: Starting deletion of primary data. [2025-09-26T21:53:00.427011] [DEBUG] [LOCAL ] USFD: Deleted primary data file. [2025-09-26T21:53:00.427076] [INFO ] [MAIN ] USFD: Starting full primary refresh. [2025-09-26T21:53:00.721047] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-06. [2025-09-26T21:53:00.821353] [INFO ] [REMOTE ] USFD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:53:01.081465] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-26T21:53:01.208472] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-26T21:53:01.511736] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-03. [2025-09-26T21:53:02.179729] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-26T21:53:02.311777] [INFO ] [REMOTE ] USFD: Fetching primary data for 2024-12. [2025-09-26T21:53:03.111720] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-06. [2025-09-26T21:53:03.507287] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-26T21:53:03.911682] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-04. [2025-09-26T21:53:04.059735] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-26T21:53:04.223389] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-26T21:53:04.711729] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-07. [2025-09-26T21:53:05.511721] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-07. [2025-09-26T21:53:06.151148] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-26T21:53:06.310283] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-26T21:53:06.318817] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-01. [2025-09-26T21:53:06.520513] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-26T21:53:07.111726] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-08. [2025-09-26T21:53:07.911691] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-08. [2025-09-26T21:53:08.025730] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-26T21:53:08.586006] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-26T21:53:08.711699] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-05. [2025-09-26T21:53:08.948812] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-26T21:53:09.511767] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-09. [2025-09-26T21:53:10.311738] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-09. [2025-09-26T21:53:10.747720] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-26T21:53:11.031483] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-26T21:53:11.039458] [INFO ] [REMOTE ] USA: Full fetch complete (51717 records). [2025-09-26T21:53:11.039597] [DEBUG] [VALIDATOR ] USA: Validating primary data. [2025-09-26T21:53:11.117211] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-02. [2025-09-26T21:53:11.469906] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-26T21:53:11.468912] [DEBUG] [VALIDATOR ] USA: All expected trading days are present. [2025-09-26T21:53:11.470083] [DEBUG] [VALIDATOR ] USA: Primary data validation passed. [2025-09-26T21:53:11.476696] [INFO ] [MAIN ] USA: Fetched primary data is valid. [2025-09-26T21:53:11.476978] [DEBUG] [LOCAL ] USA: Saving primary data. [2025-09-26T21:53:11.477441] [INFO ] [REMOTE ] USAC: Full fetch complete (35752 records). [2025-09-26T21:53:11.477526] [DEBUG] [VALIDATOR ] USAC: Validating primary data. [2025-09-26T21:53:11.563818] [DEBUG] [LOCAL ] USA: Trimmed 51717 records to 36524 (keeping 200 days of data) [2025-09-26T21:53:11.914801] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-06. [2025-09-26T21:53:12.068465] [DEBUG] [VALIDATOR ] USAC: All expected trading days are present. [2025-09-26T21:53:12.068596] [DEBUG] [VALIDATOR ] USAC: Primary data validation passed. [2025-09-26T21:53:12.069831] [INFO ] [MAIN ] USAC: Fetched primary data is valid. [2025-09-26T21:53:12.079045] [DEBUG] [LOCAL ] USAC: Saving primary data. [2025-09-26T21:53:12.113951] [DEBUG] [LOCAL ] USAC: Trimmed 35752 records to 23060 (keeping 200 days of data) [2025-09-26T21:53:12.136471] [DEBUG] [LOCAL ] USA: Primary data saved (36524 records). [2025-09-26T21:53:12.136620] [INFO ] [MAIN ] USA: Full history saved. [2025-09-26T21:53:12.137064] [INFO ] [MAIN ] Update Progress: 2195/2371 symbols completed. USA took 28.9s. Estimated remaining: 23m 30s. Rate: 7.5 symbols/min [2025-09-26T21:53:12.426377] [INFO ] [MAIN ] USNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:53:12.480608] [DEBUG] [LOCAL ] USAC: Primary data saved (23060 records). [2025-09-26T21:53:12.480861] [INFO ] [MAIN ] USAC: Full history saved. [2025-09-26T21:53:12.480984] [INFO ] [MAIN ] Update Progress: 2196/2371 symbols completed. USAC took 27.8s. Estimated remaining: 23m 22s. Rate: 7.5 symbols/min [2025-09-26T21:53:12.567603] [DEBUG] [LOCAL ] USNA: Loaded 18261 existing records from primary storage. [2025-09-26T21:53:12.579885] [INFO ] [MAIN ] USNA: Loaded 18261 existing records. [2025-09-26T21:53:12.804404] [INFO ] [MAIN ] USPH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:53:12.890791] [WARN ] [MAIN ] USNA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:53:12.891311] [INFO ] [MAIN ] USNA: Wiping existing primary data before full refresh. [2025-09-26T21:53:12.891393] [INFO ] [LOCAL ] USNA: Starting deletion of primary data. [2025-09-26T21:53:12.892070] [DEBUG] [LOCAL ] USNA: Deleted primary data file. [2025-09-26T21:53:12.892172] [INFO ] [MAIN ] USNA: Starting full primary refresh. [2025-09-26T21:53:13.027353] [DEBUG] [LOCAL ] USPH: Loaded 16720 existing records from primary storage. [2025-09-26T21:53:13.080887] [INFO ] [MAIN ] USPH: Loaded 16720 existing records. [2025-09-26T21:53:13.301257] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-26T21:53:13.400213] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-03. [2025-09-26T21:53:13.526988] [INFO ] [REMOTE ] USNA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:53:13.543417] [INFO ] [REMOTE ] USNA: Fetching primary data for 2024-12. [2025-09-26T21:53:13.549820] [WARN ] [MAIN ] USPH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:53:13.551051] [INFO ] [MAIN ] USPH: Wiping existing primary data before full refresh. [2025-09-26T21:53:13.551131] [INFO ] [LOCAL ] USPH: Starting deletion of primary data. [2025-09-26T21:53:13.551866] [DEBUG] [LOCAL ] USPH: Deleted primary data file. [2025-09-26T21:53:13.551943] [INFO ] [MAIN ] USPH: Starting full primary refresh. [2025-09-26T21:53:13.930828] [INFO ] [REMOTE ] USPH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:53:13.965535] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-26T21:53:14.311695] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-07. [2025-09-26T21:53:14.587917] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-26T21:53:15.111715] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-01. [2025-09-26T21:53:15.199285] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-26T21:53:15.911736] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-04. [2025-09-26T21:53:16.245537] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-26T21:53:16.507979] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-26T21:53:16.711746] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-08. [2025-09-26T21:53:17.406307] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-26T21:53:17.511738] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-05. [2025-09-26T21:53:18.311757] [INFO ] [REMOTE ] USPH: Fetching primary data for 2024-12. [2025-09-26T21:53:18.672237] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-26T21:53:19.025698] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-26T21:53:19.111765] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-01. [2025-09-26T21:53:19.203806] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-26T21:53:19.911755] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-09. [2025-09-26T21:53:20.011239] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-26T21:53:20.352053] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-26T21:53:20.363125] [INFO ] [REMOTE ] USB: Full fetch complete (77710 records). [2025-09-26T21:53:20.363355] [DEBUG] [VALIDATOR ] USB: Validating primary data. [2025-09-26T21:53:20.718055] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-02. [2025-09-26T21:53:20.779291] [DEBUG] [VALIDATOR ] USB: All expected trading days are present. [2025-09-26T21:53:20.779412] [DEBUG] [VALIDATOR ] USB: Primary data validation passed. [2025-09-26T21:53:20.781040] [INFO ] [MAIN ] USB: Fetched primary data is valid. [2025-09-26T21:53:20.781110] [DEBUG] [LOCAL ] USB: Saving primary data. [2025-09-26T21:53:20.783182] [DEBUG] [LOCAL ] USB: Trimmed 77710 records to 54468 (keeping 200 days of data) [2025-09-26T21:53:21.133190] [DEBUG] [LOCAL ] USB: Primary data saved (54468 records). [2025-09-26T21:53:21.133390] [INFO ] [MAIN ] USB: Full history saved. [2025-09-26T21:53:21.133539] [INFO ] [MAIN ] Update Progress: 2197/2371 symbols completed. USB took 30.3s. Estimated remaining: 23m 14s. Rate: 7.5 symbols/min [2025-09-26T21:53:21.511770] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-02. [2025-09-26T21:53:21.674632] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-26T21:53:22.311747] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-03. [2025-09-26T21:53:22.646155] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-26T21:53:23.111762] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-03. [2025-09-26T21:53:23.338835] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-26T21:53:23.911706] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-06. [2025-09-26T21:53:24.312466] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-26T21:53:24.711792] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-04. [2025-09-26T21:53:25.511786] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-04. [2025-09-26T21:53:25.762749] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-26T21:53:25.787182] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-26T21:53:26.311755] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-07. [2025-09-26T21:53:26.674094] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-26T21:53:27.111807] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-05. [2025-09-26T21:53:27.911717] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-05. [2025-09-26T21:53:27.993859] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-26T21:53:28.519411] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-26T21:53:28.560721] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-26T21:53:28.711682] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-06. [2025-09-26T21:53:29.511735] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-08. [2025-09-26T21:53:29.758042] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-26T21:53:30.311780] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-07. [2025-09-26T21:53:31.111825] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-06. [2025-09-26T21:53:31.278768] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-26T21:53:31.339542] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-26T21:53:31.911833] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-08. [2025-09-26T21:53:32.204975] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-26T21:53:32.711776] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-07. [2025-09-26T21:53:32.862261] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-26T21:53:33.511716] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-09. [2025-09-26T21:53:33.761431] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-26T21:53:34.311803] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-08. [2025-09-26T21:53:35.111795] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-09. [2025-09-26T21:53:35.262359] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-26T21:53:35.272571] [INFO ] [REMOTE ] USFD: Full fetch complete (73919 records). [2025-09-26T21:53:35.272771] [DEBUG] [VALIDATOR ] USFD: Validating primary data. [2025-09-26T21:53:35.426070] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-26T21:53:35.715550] [DEBUG] [VALIDATOR ] USFD: All expected trading days are present. [2025-09-26T21:53:35.715685] [DEBUG] [VALIDATOR ] USFD: Primary data validation passed. [2025-09-26T21:53:35.717243] [INFO ] [MAIN ] USFD: Fetched primary data is valid. [2025-09-26T21:53:35.717328] [DEBUG] [LOCAL ] USFD: Saving primary data. [2025-09-26T21:53:35.719279] [DEBUG] [LOCAL ] USFD: Trimmed 73919 records to 51959 (keeping 200 days of data) [2025-09-26T21:53:35.930831] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-09. [2025-09-26T21:53:36.046287] [DEBUG] [LOCAL ] USFD: Primary data saved (51959 records). [2025-09-26T21:53:36.046480] [INFO ] [MAIN ] USFD: Full history saved. [2025-09-26T21:53:36.046743] [INFO ] [MAIN ] Update Progress: 2198/2371 symbols completed. USFD took 36.1s. Estimated remaining: 23m 6s. Rate: 7.5 symbols/min [2025-09-26T21:53:36.153598] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-26T21:53:36.157234] [INFO ] [REMOTE ] USNA: Full fetch complete (26525 records). [2025-09-26T21:53:36.157319] [DEBUG] [VALIDATOR ] USNA: Validating primary data. [2025-09-26T21:53:36.541290] [DEBUG] [VALIDATOR ] USNA: All expected trading days are present. [2025-09-26T21:53:36.541425] [DEBUG] [VALIDATOR ] USNA: Primary data validation passed. [2025-09-26T21:53:36.542292] [INFO ] [MAIN ] USNA: Fetched primary data is valid. [2025-09-26T21:53:36.542357] [DEBUG] [LOCAL ] USNA: Saving primary data. [2025-09-26T21:53:36.543157] [DEBUG] [LOCAL ] USNA: Trimmed 26525 records to 18368 (keeping 200 days of data) [2025-09-26T21:53:36.661743] [DEBUG] [LOCAL ] USNA: Primary data saved (18368 records). [2025-09-26T21:53:36.661955] [INFO ] [MAIN ] USNA: Full history saved. [2025-09-26T21:53:36.662078] [INFO ] [MAIN ] Update Progress: 2199/2371 symbols completed. USNA took 24.5s. Estimated remaining: 22m 58s. Rate: 7.5 symbols/min [2025-09-26T21:53:36.921852] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-26T21:53:36.925607] [INFO ] [REMOTE ] USPH: Full fetch complete (22562 records). [2025-09-26T21:53:36.925723] [DEBUG] [VALIDATOR ] USPH: Validating primary data. [2025-09-26T21:53:37.342811] [DEBUG] [VALIDATOR ] USPH: All expected trading days are present. [2025-09-26T21:53:37.342919] [DEBUG] [VALIDATOR ] USPH: Primary data validation passed. [2025-09-26T21:53:37.343633] [INFO ] [MAIN ] USPH: Fetched primary data is valid. [2025-09-26T21:53:37.343714] [DEBUG] [LOCAL ] USPH: Saving primary data. [2025-09-26T21:53:37.344454] [DEBUG] [LOCAL ] USPH: Trimmed 22562 records to 16827 (keeping 200 days of data) [2025-09-26T21:53:37.453909] [DEBUG] [LOCAL ] USPH: Primary data saved (16827 records). [2025-09-26T21:53:37.454124] [INFO ] [MAIN ] USPH: Full history saved. [2025-09-26T21:53:37.454238] [INFO ] [MAIN ] Update Progress: 2200/2371 symbols completed. USPH took 25.0s. Estimated remaining: 22m 49s. Rate: 7.5 symbols/min [2025-09-26T21:53:38.124706] [INFO ] [MAIN ] UTZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:53:38.134398] [INFO ] [MAIN ] UTF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:53:38.333566] [INFO ] [MAIN ] UTI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:53:38.356165] [INFO ] [MAIN ] UTL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:53:38.372477] [DEBUG] [LOCAL ] UTL: Loaded 11165 existing records from primary storage. [2025-09-26T21:53:38.372880] [INFO ] [MAIN ] UTL: Loaded 11165 existing records. [2025-09-26T21:53:38.540431] [DEBUG] [LOCAL ] UTF: Loaded 28971 existing records from primary storage. [2025-09-26T21:53:38.541720] [INFO ] [MAIN ] UTF: Loaded 28971 existing records. [2025-09-26T21:53:38.788575] [DEBUG] [LOCAL ] UTI: Loaded 40842 existing records from primary storage. [2025-09-26T21:53:38.794049] [DEBUG] [LOCAL ] UTZ: Loaded 45025 existing records from primary storage. [2025-09-26T21:53:38.773797] [WARN ] [MAIN ] UTL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:53:38.794938] [INFO ] [MAIN ] UTZ: Loaded 45025 existing records. [2025-09-26T21:53:38.794802] [INFO ] [MAIN ] UTL: Wiping existing primary data before full refresh. [2025-09-26T21:53:38.828596] [INFO ] [MAIN ] UTI: Loaded 40842 existing records. [2025-09-26T21:53:38.860188] [INFO ] [LOCAL ] UTL: Starting deletion of primary data. [2025-09-26T21:53:39.027930] [WARN ] [MAIN ] UTF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:53:39.066320] [DEBUG] [LOCAL ] UTL: Deleted primary data file. [2025-09-26T21:53:39.087766] [INFO ] [MAIN ] UTL: Starting full primary refresh. [2025-09-26T21:53:39.087986] [INFO ] [MAIN ] UTF: Wiping existing primary data before full refresh. [2025-09-26T21:53:39.127358] [INFO ] [LOCAL ] UTF: Starting deletion of primary data. [2025-09-26T21:53:39.180483] [DEBUG] [LOCAL ] UTF: Deleted primary data file. [2025-09-26T21:53:39.271674] [INFO ] [MAIN ] UTF: Starting full primary refresh. [2025-09-26T21:53:39.334254] [WARN ] [MAIN ] UTZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:53:39.491498] [INFO ] [MAIN ] UTZ: Wiping existing primary data before full refresh. [2025-09-26T21:53:39.532918] [INFO ] [LOCAL ] UTZ: Starting deletion of primary data. [2025-09-26T21:53:39.532796] [WARN ] [MAIN ] UTI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:53:39.601535] [DEBUG] [LOCAL ] UTZ: Deleted primary data file. [2025-09-26T21:53:39.630702] [INFO ] [MAIN ] UTZ: Starting full primary refresh. [2025-09-26T21:53:39.590506] [INFO ] [MAIN ] UTI: Wiping existing primary data before full refresh. [2025-09-26T21:53:39.697599] [INFO ] [LOCAL ] UTI: Starting deletion of primary data. [2025-09-26T21:53:39.733140] [DEBUG] [LOCAL ] UTI: Deleted primary data file. [2025-09-26T21:53:39.844841] [INFO ] [MAIN ] UTI: Starting full primary refresh. [2025-09-26T21:53:40.374713] [INFO ] [REMOTE ] UTL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:53:40.518566] [INFO ] [REMOTE ] UTL: Fetching primary data for 2024-12. [2025-09-26T21:53:40.678895] [INFO ] [REMOTE ] UTF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:53:40.727091] [INFO ] [REMOTE ] UTF: Fetching primary data for 2024-12. [2025-09-26T21:53:40.931589] [INFO ] [REMOTE ] UTZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:53:40.954412] [INFO ] [REMOTE ] UTI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:53:40.955177] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2024-12. [2025-09-26T21:53:40.955807] [INFO ] [REMOTE ] UTI: Fetching primary data for 2024-12. [2025-09-26T21:53:41.596399] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-26T21:53:41.599267] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-01. [2025-09-26T21:53:41.773966] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-26T21:53:41.780450] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-01. [2025-09-26T21:53:41.996498] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-26T21:53:42.004190] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-01. [2025-09-26T21:53:42.409238] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-26T21:53:42.412360] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-02. [2025-09-26T21:53:42.435739] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-26T21:53:43.103989] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-26T21:53:43.111637] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-02. [2025-09-26T21:53:43.250340] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-26T21:53:43.464082] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-26T21:53:43.911771] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-01. [2025-09-26T21:53:44.369464] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-26T21:53:44.711768] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-02. [2025-09-26T21:53:45.402941] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-26T21:53:45.511769] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-02. [2025-09-26T21:53:46.311740] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-03. [2025-09-26T21:53:46.478778] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-26T21:53:46.903181] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-26T21:53:47.111694] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-03. [2025-09-26T21:53:47.180444] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-26T21:53:47.911743] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-03. [2025-09-26T21:53:48.711723] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-04. [2025-09-26T21:53:48.779607] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-26T21:53:49.161234] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-26T21:53:49.228557] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-26T21:53:49.511777] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-05. [2025-09-26T21:53:50.311736] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-04. [2025-09-26T21:53:50.352362] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-26T21:53:51.111759] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-06. [2025-09-26T21:53:51.854966] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-26T21:53:51.911706] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-04. [2025-09-26T21:53:52.008736] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-26T21:53:52.711731] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-03. [2025-09-26T21:53:53.323288] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-26T21:53:53.511779] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-05. [2025-09-26T21:53:54.311721] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-07. [2025-09-26T21:53:54.353579] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-26T21:53:54.890040] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-26T21:53:55.112512] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-04. [2025-09-26T21:53:55.113673] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-26T21:53:55.911770] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-08. [2025-09-26T21:53:56.711698] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-05. [2025-09-26T21:53:56.955850] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-26T21:53:57.059037] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-26T21:53:57.511790] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-05. [2025-09-26T21:53:58.179994] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T21:53:58.311695] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-06. [2025-09-26T21:53:59.111697] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-06. [2025-09-26T21:53:59.224778] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-26T21:53:59.872792] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-26T21:53:59.911671] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-07. [2025-09-26T21:54:00.354283] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-26T21:54:00.711725] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-09. [2025-09-26T21:54:01.465582] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-26T21:54:01.511696] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-07. [2025-09-26T21:54:01.779517] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-26T21:54:01.783008] [INFO ] [REMOTE ] UTL: Full fetch complete (15265 records). [2025-09-26T21:54:01.783099] [DEBUG] [VALIDATOR ] UTL: Validating primary data. [2025-09-26T21:54:02.177293] [DEBUG] [VALIDATOR ] UTL: All expected trading days are present. [2025-09-26T21:54:02.177390] [DEBUG] [VALIDATOR ] UTL: Primary data validation passed. [2025-09-26T21:54:02.177781] [INFO ] [MAIN ] UTL: Fetched primary data is valid. [2025-09-26T21:54:02.177850] [DEBUG] [LOCAL ] UTL: Saving primary data. [2025-09-26T21:54:02.178533] [DEBUG] [LOCAL ] UTL: Trimmed 15265 records to 11273 (keeping 200 days of data) [2025-09-26T21:54:02.249995] [DEBUG] [LOCAL ] UTL: Primary data saved (11273 records). [2025-09-26T21:54:02.250156] [INFO ] [MAIN ] UTL: Full history saved. [2025-09-26T21:54:02.250249] [INFO ] [MAIN ] Update Progress: 2201/2371 symbols completed. UTL took 24.8s. Estimated remaining: 22m 42s. Rate: 7.5 symbols/min [2025-09-26T21:54:02.317964] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-08. [2025-09-26T21:54:02.438787] [INFO ] [MAIN ] UVE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:54:02.462549] [DEBUG] [LOCAL ] UVE: Loaded 21997 existing records from primary storage. [2025-09-26T21:54:02.462751] [INFO ] [MAIN ] UVE: Loaded 21997 existing records. [2025-09-26T21:54:02.673504] [WARN ] [MAIN ] UVE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:54:02.674293] [INFO ] [MAIN ] UVE: Wiping existing primary data before full refresh. [2025-09-26T21:54:02.674355] [INFO ] [LOCAL ] UVE: Starting deletion of primary data. [2025-09-26T21:54:02.675149] [DEBUG] [LOCAL ] UVE: Deleted primary data file. [2025-09-26T21:54:02.675215] [INFO ] [MAIN ] UVE: Starting full primary refresh. [2025-09-26T21:54:02.973874] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-26T21:54:03.093770] [INFO ] [REMOTE ] UVE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:54:03.111689] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-08. [2025-09-26T21:54:03.911722] [INFO ] [REMOTE ] UVE: Fetching primary data for 2024-12. [2025-09-26T21:54:04.100696] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-26T21:54:04.510500] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-26T21:54:04.711785] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-09. [2025-09-26T21:54:04.879497] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-26T21:54:05.511732] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-06. [2025-09-26T21:54:06.120679] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-26T21:54:06.128602] [INFO ] [REMOTE ] UTF: Full fetch complete (41491 records). [2025-09-26T21:54:06.128803] [DEBUG] [VALIDATOR ] UTF: Validating primary data. [2025-09-26T21:54:06.327908] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-01. [2025-09-26T21:54:06.550197] [DEBUG] [VALIDATOR ] UTF: All expected trading days are present. [2025-09-26T21:54:06.550398] [DEBUG] [VALIDATOR ] UTF: Primary data validation passed. [2025-09-26T21:54:06.551377] [INFO ] [MAIN ] UTF: Fetched primary data is valid. [2025-09-26T21:54:06.551446] [DEBUG] [LOCAL ] UTF: Saving primary data. [2025-09-26T21:54:06.552613] [DEBUG] [LOCAL ] UTF: Trimmed 41491 records to 29200 (keeping 200 days of data) [2025-09-26T21:54:06.738894] [DEBUG] [LOCAL ] UTF: Primary data saved (29200 records). [2025-09-26T21:54:06.739049] [INFO ] [MAIN ] UTF: Full history saved. [2025-09-26T21:54:06.739145] [INFO ] [MAIN ] Update Progress: 2202/2371 symbols completed. UTF took 29.3s. Estimated remaining: 22m 34s. Rate: 7.5 symbols/min [2025-09-26T21:54:06.925178] [INFO ] [MAIN ] UVV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:54:06.950573] [DEBUG] [LOCAL ] UVV: Loaded 22542 existing records from primary storage. [2025-09-26T21:54:06.950758] [INFO ] [MAIN ] UVV: Loaded 22542 existing records. [2025-09-26T21:54:07.132357] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-09. [2025-09-26T21:54:07.181509] [WARN ] [MAIN ] UVV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:54:07.182353] [INFO ] [MAIN ] UVV: Wiping existing primary data before full refresh. [2025-09-26T21:54:07.182488] [INFO ] [LOCAL ] UVV: Starting deletion of primary data. [2025-09-26T21:54:07.183107] [DEBUG] [LOCAL ] UVV: Deleted primary data file. [2025-09-26T21:54:07.183179] [INFO ] [MAIN ] UVV: Starting full primary refresh. [2025-09-26T21:54:07.310769] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-26T21:54:07.589956] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-26T21:54:07.667247] [INFO ] [REMOTE ] UVV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:54:07.911735] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-07. [2025-09-26T21:54:08.711696] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-02. [2025-09-26T21:54:08.786784] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T21:54:08.794927] [INFO ] [REMOTE ] UTI: Full fetch complete (58050 records). [2025-09-26T21:54:08.795117] [DEBUG] [VALIDATOR ] UTI: Validating primary data. [2025-09-26T21:54:09.310725] [DEBUG] [VALIDATOR ] UTI: All expected trading days are present. [2025-09-26T21:54:09.310850] [DEBUG] [VALIDATOR ] UTI: Primary data validation passed. [2025-09-26T21:54:09.311957] [INFO ] [MAIN ] UTI: Fetched primary data is valid. [2025-09-26T21:54:09.312082] [DEBUG] [LOCAL ] UTI: Saving primary data. [2025-09-26T21:54:09.313884] [DEBUG] [LOCAL ] UTI: Trimmed 58050 records to 41146 (keeping 200 days of data) [2025-09-26T21:54:09.435447] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-26T21:54:09.527448] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-08. [2025-09-26T21:54:09.607064] [DEBUG] [LOCAL ] UTI: Primary data saved (41146 records). [2025-09-26T21:54:09.607198] [INFO ] [MAIN ] UTI: Full history saved. [2025-09-26T21:54:09.607285] [INFO ] [MAIN ] Update Progress: 2203/2371 symbols completed. UTI took 32.2s. Estimated remaining: 22m 26s. Rate: 7.5 symbols/min [2025-09-26T21:54:09.801285] [INFO ] [MAIN ] UWMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:54:09.817042] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-26T21:54:09.870255] [DEBUG] [LOCAL ] UWMC: Loaded 53128 existing records from primary storage. [2025-09-26T21:54:09.870415] [INFO ] [MAIN ] UWMC: Loaded 53128 existing records. [2025-09-26T21:54:10.070666] [WARN ] [MAIN ] UWMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:54:10.071104] [INFO ] [MAIN ] UWMC: Wiping existing primary data before full refresh. [2025-09-26T21:54:10.071168] [INFO ] [LOCAL ] UWMC: Starting deletion of primary data. [2025-09-26T21:54:10.072407] [DEBUG] [LOCAL ] UWMC: Deleted primary data file. [2025-09-26T21:54:10.072470] [INFO ] [MAIN ] UWMC: Starting full primary refresh. [2025-09-26T21:54:10.316814] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-03. [2025-09-26T21:54:10.469292] [INFO ] [REMOTE ] UWMC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:54:11.111736] [INFO ] [REMOTE ] UVV: Fetching primary data for 2024-12. [2025-09-26T21:54:11.152853] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-26T21:54:11.420367] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-26T21:54:11.911747] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2024-12. [2025-09-26T21:54:12.123451] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-26T21:54:12.711730] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-04. [2025-09-26T21:54:13.511746] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-01. [2025-09-26T21:54:13.760482] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-26T21:54:13.860277] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-26T21:54:14.311735] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-01. [2025-09-26T21:54:14.565235] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-26T21:54:15.111733] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-09. [2025-09-26T21:54:15.911682] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-02. [2025-09-26T21:54:16.014606] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-26T21:54:16.671003] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-26T21:54:16.680245] [INFO ] [REMOTE ] UTZ: Full fetch complete (63913 records). [2025-09-26T21:54:16.680511] [DEBUG] [VALIDATOR ] UTZ: Validating primary data. [2025-09-26T21:54:16.718524] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-02. [2025-09-26T21:54:16.844314] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-26T21:54:17.143999] [DEBUG] [VALIDATOR ] UTZ: All expected trading days are present. [2025-09-26T21:54:17.144131] [DEBUG] [VALIDATOR ] UTZ: Primary data validation passed. [2025-09-26T21:54:17.145785] [INFO ] [MAIN ] UTZ: Fetched primary data is valid. [2025-09-26T21:54:17.145855] [DEBUG] [LOCAL ] UTZ: Saving primary data. [2025-09-26T21:54:17.147665] [DEBUG] [LOCAL ] UTZ: Trimmed 63913 records to 45341 (keeping 200 days of data) [2025-09-26T21:54:17.439450] [DEBUG] [LOCAL ] UTZ: Primary data saved (45341 records). [2025-09-26T21:54:17.439660] [INFO ] [MAIN ] UTZ: Full history saved. [2025-09-26T21:54:17.442481] [INFO ] [MAIN ] Update Progress: 2204/2371 symbols completed. UTZ took 40.0s. Estimated remaining: 22m 18s. Rate: 7.5 symbols/min [2025-09-26T21:54:17.516967] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-03. [2025-09-26T21:54:17.634150] [INFO ] [MAIN ] UZD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:54:17.654766] [DEBUG] [LOCAL ] UZD: Loaded 6391 existing records from primary storage. [2025-09-26T21:54:17.654949] [INFO ] [MAIN ] UZD: Loaded 6391 existing records. [2025-09-26T21:54:17.837509] [WARN ] [MAIN ] UZD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:54:17.837881] [INFO ] [MAIN ] UZD: Wiping existing primary data before full refresh. [2025-09-26T21:54:17.838015] [INFO ] [LOCAL ] UZD: Starting deletion of primary data. [2025-09-26T21:54:17.838777] [DEBUG] [LOCAL ] UZD: Deleted primary data file. [2025-09-26T21:54:17.839128] [INFO ] [MAIN ] UZD: Starting full primary refresh. [2025-09-26T21:54:18.220319] [INFO ] [REMOTE ] UZD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:54:18.311763] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-05. [2025-09-26T21:54:18.386867] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-26T21:54:18.559546] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-26T21:54:19.111775] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-03. [2025-09-26T21:54:19.613169] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-26T21:54:19.911750] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-04. [2025-09-26T21:54:20.711783] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-06. [2025-09-26T21:54:20.798097] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-26T21:54:21.000136] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-26T21:54:21.511745] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-05. [2025-09-26T21:54:22.104594] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-26T21:54:22.311714] [INFO ] [REMOTE ] UZD: Fetching primary data for 2024-12. [2025-09-26T21:54:22.637314] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-26T21:54:23.111743] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-06. [2025-09-26T21:54:23.248217] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-26T21:54:23.911974] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-07. [2025-09-26T21:54:24.367978] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-26T21:54:24.711839] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-04. [2025-09-26T21:54:25.265075] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-26T21:54:25.511796] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-01. [2025-09-26T21:54:26.208158] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-26T21:54:26.311765] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-02. [2025-09-26T21:54:26.569701] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-26T21:54:26.738630] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-26T21:54:27.111750] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-05. [2025-09-26T21:54:27.911757] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-03. [2025-09-26T21:54:28.642794] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-26T21:54:28.711711] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-04. [2025-09-26T21:54:29.037855] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-26T21:54:29.450258] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-26T21:54:29.511783] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-05. [2025-09-26T21:54:30.127567] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-26T21:54:30.311823] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-07. [2025-09-26T21:54:31.111752] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-08. [2025-09-26T21:54:31.674519] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-26T21:54:31.911766] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-06. [2025-09-26T21:54:32.130483] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-26T21:54:32.711753] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-06. [2025-09-26T21:54:33.487936] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-26T21:54:33.511682] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-07. [2025-09-26T21:54:33.562014] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-26T21:54:34.083795] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-26T21:54:34.311796] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-07. [2025-09-26T21:54:35.111804] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-08. [2025-09-26T21:54:35.911707] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-09. [2025-09-26T21:54:36.074309] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-26T21:54:36.128635] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-26T21:54:36.711713] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-08. [2025-09-26T21:54:36.913020] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-26T21:54:36.919377] [INFO ] [REMOTE ] UVE: Full fetch complete (29682 records). [2025-09-26T21:54:36.919690] [DEBUG] [VALIDATOR ] UVE: Validating primary data. [2025-09-26T21:54:37.355399] [DEBUG] [VALIDATOR ] UVE: All expected trading days are present. [2025-09-26T21:54:37.355526] [DEBUG] [VALIDATOR ] UVE: Primary data validation passed. [2025-09-26T21:54:37.356575] [INFO ] [MAIN ] UVE: Fetched primary data is valid. [2025-09-26T21:54:37.356668] [DEBUG] [LOCAL ] UVE: Saving primary data. [2025-09-26T21:54:37.357741] [DEBUG] [LOCAL ] UVE: Trimmed 29682 records to 22124 (keeping 200 days of data) [2025-09-26T21:54:37.509602] [DEBUG] [LOCAL ] UVE: Primary data saved (22124 records). [2025-09-26T21:54:37.509812] [INFO ] [MAIN ] UVE: Full history saved. [2025-09-26T21:54:37.509919] [INFO ] [MAIN ] Update Progress: 2205/2371 symbols completed. UVE took 35.3s. Estimated remaining: 22m 11s. Rate: 7.5 symbols/min [2025-09-26T21:54:37.521586] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-08. [2025-09-26T21:54:37.690535] [INFO ] [MAIN ] UZE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:54:37.700519] [DEBUG] [LOCAL ] UZE: Loaded 7510 existing records from primary storage. [2025-09-26T21:54:37.700698] [INFO ] [MAIN ] UZE: Loaded 7510 existing records. [2025-09-26T21:54:37.891469] [WARN ] [MAIN ] UZE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:54:37.892061] [INFO ] [MAIN ] UZE: Wiping existing primary data before full refresh. [2025-09-26T21:54:37.892132] [INFO ] [LOCAL ] UZE: Starting deletion of primary data. [2025-09-26T21:54:37.892601] [DEBUG] [LOCAL ] UZE: Deleted primary data file. [2025-09-26T21:54:37.892706] [INFO ] [MAIN ] UZE: Starting full primary refresh. [2025-09-26T21:54:38.270579] [INFO ] [REMOTE ] UZE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:54:38.311708] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-09. [2025-09-26T21:54:38.667609] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-26T21:54:38.808542] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-26T21:54:38.939952] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-26T21:54:38.941606] [INFO ] [REMOTE ] UZD: Full fetch complete (9484 records). [2025-09-26T21:54:38.941708] [DEBUG] [VALIDATOR ] UZD: Validating primary data. [2025-09-26T21:54:39.119216] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-09. [2025-09-26T21:54:39.313337] [DEBUG] [VALIDATOR ] UZD: All expected trading days are present. [2025-09-26T21:54:39.313443] [DEBUG] [VALIDATOR ] UZD: Primary data validation passed. [2025-09-26T21:54:39.313865] [INFO ] [MAIN ] UZD: Fetched primary data is valid. [2025-09-26T21:54:39.313951] [DEBUG] [LOCAL ] UZD: Saving primary data. [2025-09-26T21:54:39.314481] [DEBUG] [LOCAL ] UZD: Trimmed 9484 records to 6455 (keeping 200 days of data) [2025-09-26T21:54:39.354294] [DEBUG] [LOCAL ] UZD: Primary data saved (6455 records). [2025-09-26T21:54:39.354448] [INFO ] [MAIN ] UZD: Full history saved. [2025-09-26T21:54:39.354585] [INFO ] [MAIN ] Update Progress: 2206/2371 symbols completed. UZD took 21.9s. Estimated remaining: 22m 2s. Rate: 7.5 symbols/min [2025-09-26T21:54:39.531403] [INFO ] [MAIN ] UZF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:54:39.541579] [DEBUG] [LOCAL ] UZF: Loaded 6530 existing records from primary storage. [2025-09-26T21:54:39.541780] [INFO ] [MAIN ] UZF: Loaded 6530 existing records. [2025-09-26T21:54:39.727918] [WARN ] [MAIN ] UZF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:54:39.728312] [INFO ] [MAIN ] UZF: Wiping existing primary data before full refresh. [2025-09-26T21:54:39.728379] [INFO ] [LOCAL ] UZF: Starting deletion of primary data. [2025-09-26T21:54:39.728796] [DEBUG] [LOCAL ] UZF: Deleted primary data file. [2025-09-26T21:54:39.728873] [INFO ] [MAIN ] UZF: Starting full primary refresh. [2025-09-26T21:54:39.920038] [INFO ] [REMOTE ] UZE: Fetching primary data for 2024-12. [2025-09-26T21:54:40.139094] [INFO ] [REMOTE ] UZF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:54:40.372307] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-26T21:54:40.376943] [INFO ] [REMOTE ] UVV: Full fetch complete (29811 records). [2025-09-26T21:54:40.377045] [DEBUG] [VALIDATOR ] UVV: Validating primary data. [2025-09-26T21:54:40.542027] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-26T21:54:40.723253] [INFO ] [REMOTE ] UZF: Fetching primary data for 2024-12. [2025-09-26T21:54:40.775096] [DEBUG] [VALIDATOR ] UVV: All expected trading days are present. [2025-09-26T21:54:40.775279] [DEBUG] [VALIDATOR ] UVV: Primary data validation passed. [2025-09-26T21:54:40.776294] [INFO ] [MAIN ] UVV: Fetched primary data is valid. [2025-09-26T21:54:40.776364] [DEBUG] [LOCAL ] UVV: Saving primary data. [2025-09-26T21:54:40.777493] [DEBUG] [LOCAL ] UVV: Trimmed 29811 records to 22660 (keeping 200 days of data) [2025-09-26T21:54:40.949222] [DEBUG] [LOCAL ] UVV: Primary data saved (22660 records). [2025-09-26T21:54:40.949416] [INFO ] [MAIN ] UVV: Full history saved. [2025-09-26T21:54:40.949524] [INFO ] [MAIN ] Update Progress: 2207/2371 symbols completed. UVV took 34.2s. Estimated remaining: 21m 54s. Rate: 7.5 symbols/min [2025-09-26T21:54:41.125520] [INFO ] [MAIN ] V: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:54:41.192330] [DEBUG] [LOCAL ] V: Loaded 54149 existing records from primary storage. [2025-09-26T21:54:41.192561] [INFO ] [MAIN ] V: Loaded 54149 existing records. [2025-09-26T21:54:41.376810] [WARN ] [MAIN ] V: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:54:41.377132] [INFO ] [MAIN ] V: Wiping existing primary data before full refresh. [2025-09-26T21:54:41.377186] [INFO ] [LOCAL ] V: Starting deletion of primary data. [2025-09-26T21:54:41.379005] [DEBUG] [LOCAL ] V: Deleted primary data file. [2025-09-26T21:54:41.379069] [INFO ] [MAIN ] V: Starting full primary refresh. [2025-09-26T21:54:41.524221] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-09. [2025-09-26T21:54:41.574204] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-26T21:54:41.824458] [INFO ] [REMOTE ] V: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:54:42.311759] [INFO ] [REMOTE ] V: Fetching primary data for 2024-12. [2025-09-26T21:54:43.111762] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-01. [2025-09-26T21:54:43.457562] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-26T21:54:43.469593] [INFO ] [REMOTE ] UWMC: Full fetch complete (75500 records). [2025-09-26T21:54:43.469888] [DEBUG] [VALIDATOR ] UWMC: Validating primary data. [2025-09-26T21:54:43.909769] [DEBUG] [VALIDATOR ] UWMC: All expected trading days are present. [2025-09-26T21:54:43.909459] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-26T21:54:43.910149] [DEBUG] [VALIDATOR ] UWMC: Primary data validation passed. [2025-09-26T21:54:43.914566] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-02. [2025-09-26T21:54:43.913710] [INFO ] [MAIN ] UWMC: Fetched primary data is valid. [2025-09-26T21:54:43.914920] [DEBUG] [LOCAL ] UWMC: Saving primary data. [2025-09-26T21:54:43.926242] [DEBUG] [LOCAL ] UWMC: Trimmed 75500 records to 53516 (keeping 200 days of data) [2025-09-26T21:54:44.269416] [DEBUG] [LOCAL ] UWMC: Primary data saved (53516 records). [2025-09-26T21:54:44.269635] [INFO ] [MAIN ] UWMC: Full history saved. [2025-09-26T21:54:44.269790] [INFO ] [MAIN ] Update Progress: 2208/2371 symbols completed. UWMC took 34.7s. Estimated remaining: 21m 45s. Rate: 7.5 symbols/min [2025-09-26T21:54:44.492799] [INFO ] [MAIN ] VAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:54:44.498625] [INFO ] [REMOTE ] V: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-26T21:54:44.517294] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-26T21:54:44.563426] [DEBUG] [LOCAL ] VAC: Loaded 34804 existing records from primary storage. [2025-09-26T21:54:44.563633] [INFO ] [MAIN ] VAC: Loaded 34804 existing records. [2025-09-26T21:54:44.716868] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-01. [2025-09-26T21:54:44.746938] [WARN ] [MAIN ] VAC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:54:44.747255] [INFO ] [MAIN ] VAC: Wiping existing primary data before full refresh. [2025-09-26T21:54:44.747315] [INFO ] [LOCAL ] VAC: Starting deletion of primary data. [2025-09-26T21:54:44.748424] [DEBUG] [LOCAL ] VAC: Deleted primary data file. [2025-09-26T21:54:44.748493] [INFO ] [MAIN ] VAC: Starting full primary refresh. [2025-09-26T21:54:45.136150] [INFO ] [REMOTE ] VAC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:54:45.413891] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-26T21:54:45.511775] [INFO ] [REMOTE ] V: Fetching primary data for 2025-01. [2025-09-26T21:54:46.311813] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-02. [2025-09-26T21:54:47.001359] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-26T21:54:47.111780] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-03. [2025-09-26T21:54:47.728847] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-09-26T21:54:47.904082] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-26T21:54:47.911687] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-04. [2025-09-26T21:54:48.690221] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-26T21:54:48.711736] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-05. [2025-09-26T21:54:49.373182] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-26T21:54:49.511747] [INFO ] [REMOTE ] V: Fetching primary data for 2025-02. [2025-09-26T21:54:50.311716] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-03. [2025-09-26T21:54:51.021907] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-26T21:54:51.111696] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-06. [2025-09-26T21:54:51.498428] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-26T21:54:51.702186] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-26T21:54:51.911713] [INFO ] [REMOTE ] VAC: Fetching primary data for 2024-12. [2025-09-26T21:54:52.711728] [INFO ] [REMOTE ] V: Fetching primary data for 2025-03. [2025-09-26T21:54:53.070386] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-26T21:54:53.511726] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-01. [2025-09-26T21:54:54.311684] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-04. [2025-09-26T21:54:54.786002] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-26T21:54:54.798788] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-26T21:54:55.007312] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-26T21:54:55.111714] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-07. [2025-09-26T21:54:55.687106] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-26T21:54:55.911730] [INFO ] [REMOTE ] V: Fetching primary data for 2025-04. [2025-09-26T21:54:56.711727] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-02. [2025-09-26T21:54:57.511750] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-08. [2025-09-26T21:54:58.118337] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-26T21:54:58.134997] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-26T21:54:58.311759] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-05. [2025-09-26T21:54:58.357639] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-26T21:54:59.067704] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-26T21:54:59.111721] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-09. [2025-09-26T21:54:59.717510] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-26T21:54:59.719089] [INFO ] [REMOTE ] UZF: Full fetch complete (8844 records). [2025-09-26T21:54:59.719196] [DEBUG] [VALIDATOR ] UZF: Validating primary data. [2025-09-26T21:54:59.921783] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-06. [2025-09-26T21:55:00.102690] [DEBUG] [VALIDATOR ] UZF: All expected trading days are present. [2025-09-26T21:55:00.102781] [DEBUG] [VALIDATOR ] UZF: Primary data validation passed. [2025-09-26T21:55:00.103011] [INFO ] [MAIN ] UZF: Fetched primary data is valid. [2025-09-26T21:55:00.103107] [DEBUG] [LOCAL ] UZF: Saving primary data. [2025-09-26T21:55:00.103596] [DEBUG] [LOCAL ] UZF: Trimmed 8844 records to 6574 (keeping 200 days of data) [2025-09-26T21:55:00.148739] [DEBUG] [LOCAL ] UZF: Primary data saved (6574 records). [2025-09-26T21:55:00.148900] [INFO ] [MAIN ] UZF: Full history saved. [2025-09-26T21:55:00.149103] [INFO ] [MAIN ] Update Progress: 2209/2371 symbols completed. UZF took 20.8s. Estimated remaining: 21m 38s. Rate: 7.5 symbols/min [2025-09-26T21:55:00.333332] [INFO ] [MAIN ] VAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:55:00.409727] [DEBUG] [LOCAL ] VAL: Loaded 50797 existing records from primary storage. [2025-09-26T21:55:00.409898] [INFO ] [MAIN ] VAL: Loaded 50797 existing records. [2025-09-26T21:55:00.601306] [WARN ] [MAIN ] VAL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:55:00.601571] [INFO ] [MAIN ] VAL: Wiping existing primary data before full refresh. [2025-09-26T21:55:00.601630] [INFO ] [LOCAL ] VAL: Starting deletion of primary data. [2025-09-26T21:55:00.602769] [DEBUG] [LOCAL ] VAL: Deleted primary data file. [2025-09-26T21:55:00.602842] [INFO ] [MAIN ] VAL: Starting full primary refresh. [2025-09-26T21:55:00.711847] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-03. [2025-09-26T21:55:00.723129] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-26T21:55:01.023477] [INFO ] [REMOTE ] VAL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:55:01.511738] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-07. [2025-09-26T21:55:02.093405] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-26T21:55:02.209969] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-26T21:55:02.311733] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-08. [2025-09-26T21:55:03.111719] [INFO ] [REMOTE ] V: Fetching primary data for 2025-05. [2025-09-26T21:55:03.349465] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-26T21:55:03.911727] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-04. [2025-09-26T21:55:04.711715] [INFO ] [REMOTE ] VAL: Fetching primary data for 2024-12. [2025-09-26T21:55:05.466472] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-26T21:55:05.512676] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-09. [2025-09-26T21:55:05.516001] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-09-26T21:55:06.194159] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-26T21:55:06.196353] [INFO ] [REMOTE ] UZE: Full fetch complete (10124 records). [2025-09-26T21:55:06.196509] [DEBUG] [VALIDATOR ] UZE: Validating primary data. [2025-09-26T21:55:06.315458] [INFO ] [REMOTE ] V: Fetching primary data for 2025-06. [2025-09-26T21:55:06.602946] [DEBUG] [VALIDATOR ] UZE: All expected trading days are present. [2025-09-26T21:55:06.603216] [DEBUG] [VALIDATOR ] UZE: Primary data validation passed. [2025-09-26T21:55:06.603542] [INFO ] [MAIN ] UZE: Fetched primary data is valid. [2025-09-26T21:55:06.603734] [DEBUG] [LOCAL ] UZE: Saving primary data. [2025-09-26T21:55:06.614798] [DEBUG] [LOCAL ] UZE: Trimmed 10124 records to 7528 (keeping 200 days of data) [2025-09-26T21:55:06.634964] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-26T21:55:06.696351] [DEBUG] [LOCAL ] UZE: Primary data saved (7528 records). [2025-09-26T21:55:06.696490] [INFO ] [MAIN ] UZE: Full history saved. [2025-09-26T21:55:06.696662] [INFO ] [MAIN ] Update Progress: 2210/2371 symbols completed. UZE took 29.2s. Estimated remaining: 21m 30s. Rate: 7.5 symbols/min [2025-09-26T21:55:06.897021] [INFO ] [MAIN ] VALE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:55:06.965881] [DEBUG] [LOCAL ] VALE: Loaded 54084 existing records from primary storage. [2025-09-26T21:55:06.966074] [INFO ] [MAIN ] VALE: Loaded 54084 existing records. [2025-09-26T21:55:07.120929] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-01. [2025-09-26T21:55:07.167790] [WARN ] [MAIN ] VALE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:55:07.168082] [INFO ] [MAIN ] VALE: Wiping existing primary data before full refresh. [2025-09-26T21:55:07.168134] [INFO ] [LOCAL ] VALE: Starting deletion of primary data. [2025-09-26T21:55:07.169490] [DEBUG] [LOCAL ] VALE: Deleted primary data file. [2025-09-26T21:55:07.169555] [INFO ] [MAIN ] VALE: Starting full primary refresh. [2025-09-26T21:55:07.591938] [INFO ] [REMOTE ] VALE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:55:07.911739] [INFO ] [REMOTE ] VALE: Fetching primary data for 2024-12. [2025-09-26T21:55:08.721623] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-05. [2025-09-26T21:55:08.725581] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-09-26T21:55:08.907611] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-26T21:55:09.511731] [INFO ] [REMOTE ] V: Fetching primary data for 2025-07. [2025-09-26T21:55:09.847142] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-26T21:55:10.311714] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-02. [2025-09-26T21:55:10.352630] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-26T21:55:11.111720] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-01. [2025-09-26T21:55:11.916861] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-06. [2025-09-26T21:55:11.940561] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-09-26T21:55:11.984040] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-26T21:55:12.711717] [INFO ] [REMOTE ] V: Fetching primary data for 2025-08. [2025-09-26T21:55:13.243837] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-26T21:55:13.402921] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-26T21:55:13.511748] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-07. [2025-09-26T21:55:14.311733] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-03. [2025-09-26T21:55:14.937117] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-26T21:55:14.973931] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-26T21:55:15.111721] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-02. [2025-09-26T21:55:15.911700] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-08. [2025-09-26T21:55:16.116290] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-26T21:55:16.711796] [INFO ] [REMOTE ] V: Fetching primary data for 2025-09. [2025-09-26T21:55:17.082854] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-26T21:55:17.343947] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-26T21:55:17.465040] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-26T21:55:17.478983] [INFO ] [REMOTE ] V: Full fetch complete (77822 records). [2025-09-26T21:55:17.479182] [DEBUG] [VALIDATOR ] V: Validating primary data. [2025-09-26T21:55:17.516868] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-09. [2025-09-26T21:55:17.988886] [DEBUG] [VALIDATOR ] V: All expected trading days are present. [2025-09-26T21:55:17.989056] [DEBUG] [VALIDATOR ] V: Primary data validation passed. [2025-09-26T21:55:17.990517] [INFO ] [MAIN ] V: Fetched primary data is valid. [2025-09-26T21:55:17.990620] [DEBUG] [LOCAL ] V: Saving primary data. [2025-09-26T21:55:17.993173] [DEBUG] [LOCAL ] V: Trimmed 77822 records to 54535 (keeping 200 days of data) [2025-09-26T21:55:18.312746] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-03. [2025-09-26T21:55:18.457231] [DEBUG] [LOCAL ] V: Primary data saved (54535 records). [2025-09-26T21:55:18.457428] [INFO ] [MAIN ] V: Full history saved. [2025-09-26T21:55:18.457578] [INFO ] [MAIN ] Update Progress: 2211/2371 symbols completed. V took 37.5s. Estimated remaining: 21m 22s. Rate: 7.5 symbols/min [2025-09-26T21:55:18.674515] [INFO ] [MAIN ] VATE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:55:18.688208] [DEBUG] [LOCAL ] VATE: Loaded 5649 existing records from primary storage. [2025-09-26T21:55:18.688681] [INFO ] [MAIN ] VATE: Loaded 5649 existing records. [2025-09-26T21:55:18.919484] [WARN ] [MAIN ] VATE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:55:18.920168] [INFO ] [MAIN ] VATE: Wiping existing primary data before full refresh. [2025-09-26T21:55:18.920259] [INFO ] [LOCAL ] VATE: Starting deletion of primary data. [2025-09-26T21:55:18.920716] [DEBUG] [LOCAL ] VATE: Deleted primary data file. [2025-09-26T21:55:18.920781] [INFO ] [MAIN ] VATE: Starting full primary refresh. [2025-09-26T21:55:19.118935] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-04. [2025-09-26T21:55:19.342990] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-26T21:55:19.350612] [INFO ] [REMOTE ] VATE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:55:19.363144] [INFO ] [REMOTE ] VAC: Full fetch complete (47919 records). [2025-09-26T21:55:19.363361] [DEBUG] [VALIDATOR ] VAC: Validating primary data. [2025-09-26T21:55:19.917913] [DEBUG] [VALIDATOR ] VAC: All expected trading days are present. [2025-09-26T21:55:19.917189] [INFO ] [REMOTE ] VATE: Fetching primary data for 2024-12. [2025-09-26T21:55:19.919146] [DEBUG] [VALIDATOR ] VAC: Primary data validation passed. [2025-09-26T21:55:19.920136] [INFO ] [MAIN ] VAC: Fetched primary data is valid. [2025-09-26T21:55:19.920295] [DEBUG] [LOCAL ] VAC: Saving primary data. [2025-09-26T21:55:19.923137] [DEBUG] [LOCAL ] VAC: Trimmed 47919 records to 35026 (keeping 200 days of data) [2025-09-26T21:55:20.150503] [DEBUG] [LOCAL ] VAC: Primary data saved (35026 records). [2025-09-26T21:55:20.150674] [INFO ] [MAIN ] VAC: Full history saved. [2025-09-26T21:55:20.150783] [INFO ] [MAIN ] Update Progress: 2212/2371 symbols completed. VAC took 35.9s. Estimated remaining: 21m 14s. Rate: 7.5 symbols/min [2025-09-26T21:55:20.328327] [INFO ] [MAIN ] VBF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:55:20.340789] [DEBUG] [LOCAL ] VBF: Loaded 7136 existing records from primary storage. [2025-09-26T21:55:20.340904] [INFO ] [MAIN ] VBF: Loaded 7136 existing records. [2025-09-26T21:55:20.555431] [WARN ] [MAIN ] VBF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:55:20.556939] [INFO ] [MAIN ] VBF: Wiping existing primary data before full refresh. [2025-09-26T21:55:20.562359] [INFO ] [LOCAL ] VBF: Starting deletion of primary data. [2025-09-26T21:55:20.563286] [DEBUG] [LOCAL ] VBF: Deleted primary data file. [2025-09-26T21:55:20.563695] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-26T21:55:20.563779] [INFO ] [MAIN ] VBF: Starting full primary refresh. [2025-09-26T21:55:20.729345] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-01. [2025-09-26T21:55:20.780997] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-09-26T21:55:21.028637] [INFO ] [REMOTE ] VBF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:55:21.062916] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-26T21:55:21.511750] [INFO ] [REMOTE ] VBF: Fetching primary data for 2024-12. [2025-09-26T21:55:21.933106] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-26T21:55:22.027264] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-26T21:55:22.311734] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-04. [2025-09-26T21:55:23.111728] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-01. [2025-09-26T21:55:23.727111] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-26T21:55:23.911695] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-02. [2025-09-26T21:55:24.319264] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-26T21:55:24.711743] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-05. [2025-09-26T21:55:24.777075] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-26T21:55:25.511769] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-02. [2025-09-26T21:55:26.311722] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-03. [2025-09-26T21:55:26.509942] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-26T21:55:26.771874] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-26T21:55:27.111703] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-05. [2025-09-26T21:55:27.190002] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-26T21:55:27.911735] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-04. [2025-09-26T21:55:28.619992] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-26T21:55:28.711726] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-05. [2025-09-26T21:55:28.914700] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-26T21:55:29.355089] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-26T21:55:29.511740] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-06. [2025-09-26T21:55:30.311728] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-06. [2025-09-26T21:55:30.911523] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-26T21:55:31.111728] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-07. [2025-09-26T21:55:31.317373] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-26T21:55:31.606922] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-26T21:55:31.911723] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-06. [2025-09-26T21:55:32.711747] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-03. [2025-09-26T21:55:33.478166] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-26T21:55:33.511673] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-04. [2025-09-26T21:55:33.867512] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-26T21:55:34.106876] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-26T21:55:34.311759] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-07. [2025-09-26T21:55:35.111732] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-07. [2025-09-26T21:55:35.911737] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-08. [2025-09-26T21:55:36.333241] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-26T21:55:36.538619] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-26T21:55:36.711719] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-09. [2025-09-26T21:55:37.288712] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-26T21:55:37.345807] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-26T21:55:37.347730] [INFO ] [REMOTE ] VATE: Full fetch complete (10521 records). [2025-09-26T21:55:37.347825] [DEBUG] [VALIDATOR ] VATE: Validating primary data. [2025-09-26T21:55:37.537207] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-08. [2025-09-26T21:55:37.746731] [DEBUG] [VALIDATOR ] VATE: All expected trading days are present. [2025-09-26T21:55:37.746828] [DEBUG] [VALIDATOR ] VATE: Primary data validation passed. [2025-09-26T21:55:37.747134] [INFO ] [MAIN ] VATE: Fetched primary data is valid. [2025-09-26T21:55:37.747195] [DEBUG] [LOCAL ] VATE: Saving primary data. [2025-09-26T21:55:37.747886] [DEBUG] [LOCAL ] VATE: Trimmed 10521 records to 5658 (keeping 200 days of data) [2025-09-26T21:55:37.781595] [DEBUG] [LOCAL ] VATE: Primary data saved (5658 records). [2025-09-26T21:55:37.781791] [INFO ] [MAIN ] VATE: Full history saved. [2025-09-26T21:55:37.781919] [INFO ] [MAIN ] Update Progress: 2213/2371 symbols completed. VATE took 19.3s. Estimated remaining: 21m 6s. Rate: 7.5 symbols/min [2025-09-26T21:55:37.967296] [INFO ] [MAIN ] VCV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:55:37.983510] [DEBUG] [LOCAL ] VCV: Loaded 13629 existing records from primary storage. [2025-09-26T21:55:37.983713] [INFO ] [MAIN ] VCV: Loaded 13629 existing records. [2025-09-26T21:55:38.189617] [WARN ] [MAIN ] VCV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:55:38.189994] [INFO ] [MAIN ] VCV: Wiping existing primary data before full refresh. [2025-09-26T21:55:38.190053] [INFO ] [LOCAL ] VCV: Starting deletion of primary data. [2025-09-26T21:55:38.190614] [DEBUG] [LOCAL ] VCV: Deleted primary data file. [2025-09-26T21:55:38.190715] [INFO ] [MAIN ] VCV: Starting full primary refresh. [2025-09-26T21:55:38.316787] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-08. [2025-09-26T21:55:38.573166] [INFO ] [REMOTE ] VCV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:55:39.111721] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-05. [2025-09-26T21:55:39.339531] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-26T21:55:39.698244] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-26T21:55:39.911717] [INFO ] [REMOTE ] VCV: Fetching primary data for 2024-12. [2025-09-26T21:55:40.359753] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-26T21:55:40.711706] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-09. [2025-09-26T21:55:40.950481] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-26T21:55:41.511731] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-01. [2025-09-26T21:55:42.311710] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-06. [2025-09-26T21:55:42.336897] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-26T21:55:42.590737] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-26T21:55:42.601911] [INFO ] [REMOTE ] VALE: Full fetch complete (77764 records). [2025-09-26T21:55:42.602113] [DEBUG] [VALIDATOR ] VALE: Validating primary data. [2025-09-26T21:55:43.036746] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-26T21:55:43.036424] [DEBUG] [VALIDATOR ] VALE: All expected trading days are present. [2025-09-26T21:55:43.039204] [DEBUG] [VALIDATOR ] VALE: Primary data validation passed. [2025-09-26T21:55:43.041004] [INFO ] [MAIN ] VALE: Fetched primary data is valid. [2025-09-26T21:55:43.041083] [DEBUG] [LOCAL ] VALE: Saving primary data. [2025-09-26T21:55:43.042572] [DEBUG] [LOCAL ] VALE: Trimmed 77764 records to 54474 (keeping 200 days of data) [2025-09-26T21:55:43.111711] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-02. [2025-09-26T21:55:43.436258] [DEBUG] [LOCAL ] VALE: Primary data saved (54474 records). [2025-09-26T21:55:43.436415] [INFO ] [MAIN ] VALE: Full history saved. [2025-09-26T21:55:43.436565] [INFO ] [MAIN ] Update Progress: 2214/2371 symbols completed. VALE took 36.7s. Estimated remaining: 20m 58s. Rate: 7.5 symbols/min [2025-09-26T21:55:43.633682] [INFO ] [MAIN ] VEEV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:55:43.683441] [DEBUG] [LOCAL ] VEEV: Loaded 47463 existing records from primary storage. [2025-09-26T21:55:43.683664] [INFO ] [MAIN ] VEEV: Loaded 47463 existing records. [2025-09-26T21:55:43.873815] [WARN ] [MAIN ] VEEV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:55:43.874107] [INFO ] [MAIN ] VEEV: Wiping existing primary data before full refresh. [2025-09-26T21:55:43.874163] [INFO ] [LOCAL ] VEEV: Starting deletion of primary data. [2025-09-26T21:55:43.875218] [DEBUG] [LOCAL ] VEEV: Deleted primary data file. [2025-09-26T21:55:43.875279] [INFO ] [MAIN ] VEEV: Starting full primary refresh. [2025-09-26T21:55:43.916823] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-07. [2025-09-26T21:55:43.996238] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-26T21:55:44.274791] [INFO ] [REMOTE ] VEEV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:55:44.711776] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2024-12. [2025-09-26T21:55:44.888974] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-26T21:55:45.511765] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-09. [2025-09-26T21:55:46.311741] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-08. [2025-09-26T21:55:46.497154] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-26T21:55:47.081490] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-26T21:55:47.111676] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-09. [2025-09-26T21:55:47.205298] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-26T21:55:47.215790] [INFO ] [REMOTE ] VAL: Full fetch complete (73311 records). [2025-09-26T21:55:47.215969] [DEBUG] [VALIDATOR ] VAL: Validating primary data. [2025-09-26T21:55:47.642971] [DEBUG] [VALIDATOR ] VAL: All expected trading days are present. [2025-09-26T21:55:47.643085] [DEBUG] [VALIDATOR ] VAL: Primary data validation passed. [2025-09-26T21:55:47.644331] [INFO ] [MAIN ] VAL: Fetched primary data is valid. [2025-09-26T21:55:47.644464] [DEBUG] [LOCAL ] VAL: Saving primary data. [2025-09-26T21:55:47.646177] [DEBUG] [LOCAL ] VAL: Trimmed 73311 records to 51142 (keeping 200 days of data) [2025-09-26T21:55:47.751864] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-26T21:55:47.755525] [INFO ] [REMOTE ] VBF: Full fetch complete (10416 records). [2025-09-26T21:55:47.755959] [DEBUG] [VALIDATOR ] VBF: Validating primary data. [2025-09-26T21:55:47.940021] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-03. [2025-09-26T21:55:48.235079] [DEBUG] [LOCAL ] VAL: Primary data saved (51142 records). [2025-09-26T21:55:48.260944] [INFO ] [MAIN ] VAL: Full history saved. [2025-09-26T21:55:48.304387] [INFO ] [MAIN ] Update Progress: 2215/2371 symbols completed. VAL took 48.2s. Estimated remaining: 20m 50s. Rate: 7.5 symbols/min [2025-09-26T21:55:48.545008] [DEBUG] [VALIDATOR ] VBF: All expected trading days are present. [2025-09-26T21:55:48.564225] [DEBUG] [VALIDATOR ] VBF: Primary data validation passed. [2025-09-26T21:55:48.571345] [INFO ] [MAIN ] VBF: Fetched primary data is valid. [2025-09-26T21:55:48.580364] [DEBUG] [LOCAL ] VBF: Saving primary data. [2025-09-26T21:55:48.600010] [INFO ] [MAIN ] VEL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:55:48.602365] [DEBUG] [LOCAL ] VBF: Trimmed 10416 records to 7206 (keeping 200 days of data) [2025-09-26T21:55:48.654508] [DEBUG] [LOCAL ] VBF: Primary data saved (7206 records). [2025-09-26T21:55:48.654721] [INFO ] [MAIN ] VBF: Full history saved. [2025-09-26T21:55:48.654851] [INFO ] [MAIN ] Update Progress: 2216/2371 symbols completed. VBF took 28.5s. Estimated remaining: 20m 41s. Rate: 7.5 symbols/min [2025-09-26T21:55:48.709780] [DEBUG] [LOCAL ] VEL: Loaded 13206 existing records from primary storage. [2025-09-26T21:55:48.722122] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-01. [2025-09-26T21:55:48.744414] [INFO ] [MAIN ] VEL: Loaded 13206 existing records. [2025-09-26T21:55:48.936363] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-26T21:55:48.996187] [INFO ] [MAIN ] VET: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:55:49.061804] [WARN ] [MAIN ] VEL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:55:49.062079] [INFO ] [MAIN ] VEL: Wiping existing primary data before full refresh. [2025-09-26T21:55:49.062155] [INFO ] [LOCAL ] VEL: Starting deletion of primary data. [2025-09-26T21:55:49.062776] [DEBUG] [LOCAL ] VEL: Deleted primary data file. [2025-09-26T21:55:49.062839] [INFO ] [MAIN ] VEL: Starting full primary refresh. [2025-09-26T21:55:49.419686] [DEBUG] [LOCAL ] VET: Loaded 44385 existing records from primary storage. [2025-09-26T21:55:49.439820] [INFO ] [MAIN ] VET: Loaded 44385 existing records. [2025-09-26T21:55:49.512395] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-04. [2025-09-26T21:55:49.684399] [INFO ] [REMOTE ] VEL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:55:49.765265] [WARN ] [MAIN ] VET: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:55:49.765585] [INFO ] [MAIN ] VET: Wiping existing primary data before full refresh. [2025-09-26T21:55:49.765638] [INFO ] [LOCAL ] VET: Starting deletion of primary data. [2025-09-26T21:55:49.766820] [DEBUG] [LOCAL ] VET: Deleted primary data file. [2025-09-26T21:55:49.766884] [INFO ] [MAIN ] VET: Starting full primary refresh. [2025-09-26T21:55:50.167536] [INFO ] [REMOTE ] VET: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:55:50.311767] [INFO ] [REMOTE ] VET: Fetching primary data for 2024-12. [2025-09-26T21:55:50.415499] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-26T21:55:50.711733] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-26T21:55:51.111733] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-02. [2025-09-26T21:55:51.916869] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-05. [2025-09-26T21:55:51.940098] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-26T21:55:52.683627] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-26T21:55:52.711734] [INFO ] [REMOTE ] VEL: Fetching primary data for 2024-12. [2025-09-26T21:55:52.803793] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-26T21:55:53.435860] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-26T21:55:53.511720] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-06. [2025-09-26T21:55:54.311720] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-01. [2025-09-26T21:55:54.485034] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-26T21:55:54.739483] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-26T21:55:55.111722] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-02. [2025-09-26T21:55:55.855171] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-26T21:55:55.911700] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-03. [2025-09-26T21:55:56.711719] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-03. [2025-09-26T21:55:56.932024] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-26T21:55:57.511757] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-04. [2025-09-26T21:55:58.311746] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-01. [2025-09-26T21:55:58.336335] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-26T21:55:58.502529] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-26T21:55:59.111732] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-07. [2025-09-26T21:55:59.911687] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-05. [2025-09-26T21:56:00.037585] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-26T21:56:00.115894] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-26T21:56:00.711717] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-04. [2025-09-26T21:56:00.847593] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-26T21:56:01.511768] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-06. [2025-09-26T21:56:02.311765] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-02. [2025-09-26T21:56:02.476599] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-26T21:56:02.496013] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-26T21:56:03.111709] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-08. [2025-09-26T21:56:03.812487] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-26T21:56:03.830952] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-26T21:56:03.911717] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-05. [2025-09-26T21:56:04.711727] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-07. [2025-09-26T21:56:05.518771] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-03. [2025-09-26T21:56:05.523266] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-26T21:56:05.678469] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-26T21:56:06.311763] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-09. [2025-09-26T21:56:07.111741] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-08. [2025-09-26T21:56:07.249536] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-26T21:56:07.343830] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-26T21:56:07.347794] [INFO ] [REMOTE ] VCV: Full fetch complete (19670 records). [2025-09-26T21:56:07.347948] [DEBUG] [VALIDATOR ] VCV: Validating primary data. [2025-09-26T21:56:07.751196] [DEBUG] [VALIDATOR ] VCV: All expected trading days are present. [2025-09-26T21:56:07.751353] [DEBUG] [VALIDATOR ] VCV: Primary data validation passed. [2025-09-26T21:56:07.751946] [INFO ] [MAIN ] VCV: Fetched primary data is valid. [2025-09-26T21:56:07.752017] [DEBUG] [LOCAL ] VCV: Saving primary data. [2025-09-26T21:56:07.752793] [DEBUG] [LOCAL ] VCV: Trimmed 19670 records to 13766 (keeping 200 days of data) [2025-09-26T21:56:07.851445] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-26T21:56:07.851600] [DEBUG] [LOCAL ] VCV: Primary data saved (13766 records). [2025-09-26T21:56:07.852042] [INFO ] [MAIN ] VCV: Full history saved. [2025-09-26T21:56:07.853360] [INFO ] [MAIN ] Update Progress: 2217/2371 symbols completed. VCV took 30.1s. Estimated remaining: 20m 34s. Rate: 7.5 symbols/min [2025-09-26T21:56:07.916912] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-09. [2025-09-26T21:56:08.038814] [INFO ] [MAIN ] VFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:56:08.099731] [DEBUG] [LOCAL ] VFC: Loaded 54000 existing records from primary storage. [2025-09-26T21:56:08.099956] [INFO ] [MAIN ] VFC: Loaded 54000 existing records. [2025-09-26T21:56:08.288464] [WARN ] [MAIN ] VFC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:56:08.288878] [INFO ] [MAIN ] VFC: Wiping existing primary data before full refresh. [2025-09-26T21:56:08.288949] [INFO ] [LOCAL ] VFC: Starting deletion of primary data. [2025-09-26T21:56:08.290362] [DEBUG] [LOCAL ] VFC: Deleted primary data file. [2025-09-26T21:56:08.290425] [INFO ] [MAIN ] VFC: Starting full primary refresh. [2025-09-26T21:56:08.698081] [INFO ] [REMOTE ] VFC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:56:08.711710] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-04. [2025-09-26T21:56:08.772995] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-26T21:56:08.776298] [INFO ] [REMOTE ] VEL: Full fetch complete (16921 records). [2025-09-26T21:56:08.776404] [DEBUG] [VALIDATOR ] VEL: Validating primary data. [2025-09-26T21:56:09.162889] [DEBUG] [VALIDATOR ] VEL: All expected trading days are present. [2025-09-26T21:56:09.162999] [DEBUG] [VALIDATOR ] VEL: Primary data validation passed. [2025-09-26T21:56:09.163454] [INFO ] [MAIN ] VEL: Fetched primary data is valid. [2025-09-26T21:56:09.163511] [DEBUG] [LOCAL ] VEL: Saving primary data. [2025-09-26T21:56:09.164192] [DEBUG] [LOCAL ] VEL: Trimmed 16921 records to 13299 (keeping 200 days of data) [2025-09-26T21:56:09.250042] [DEBUG] [LOCAL ] VEL: Primary data saved (13299 records). [2025-09-26T21:56:09.250220] [INFO ] [MAIN ] VEL: Full history saved. [2025-09-26T21:56:09.250348] [INFO ] [MAIN ] Update Progress: 2218/2371 symbols completed. VEL took 20.9s. Estimated remaining: 20m 26s. Rate: 7.5 symbols/min [2025-09-26T21:56:09.428446] [INFO ] [MAIN ] VG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:56:09.428781] [DEBUG] [LOCAL ] VG: No existing data file found in primary storage. [2025-09-26T21:56:09.428896] [WARN ] [MAIN ] VG: No existing data found, performing full refresh instead. [2025-09-26T21:56:09.429079] [INFO ] [MAIN ] VG: Wiping existing primary data before full refresh. [2025-09-26T21:56:09.429187] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-09-26T21:56:09.429259] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-09-26T21:56:09.429296] [INFO ] [MAIN ] VG: Starting full primary refresh. [2025-09-26T21:56:09.516902] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-06. [2025-09-26T21:56:09.828243] [INFO ] [REMOTE ] VG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:56:10.311719] [INFO ] [REMOTE ] VFC: Fetching primary data for 2024-12. [2025-09-26T21:56:10.629192] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-26T21:56:11.111821] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-05. [2025-09-26T21:56:11.390365] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-26T21:56:11.911780] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-07. [2025-09-26T21:56:12.246966] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-26T21:56:12.711757] [INFO ] [REMOTE ] VG: Fetching primary data for 2024-12. [2025-09-26T21:56:12.773422] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-26T21:56:13.095751] [DEBUG] [REMOTE ] VG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:56:13.096119] [WARN ] [REMOTE ] VG: No data returned for month 2024-12 [2025-09-26T21:56:13.511704] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-01. [2025-09-26T21:56:13.710695] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-26T21:56:14.149720] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-26T21:56:14.311765] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-08. [2025-09-26T21:56:15.111732] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-01. [2025-09-26T21:56:15.911759] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-06. [2025-09-26T21:56:16.092760] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-26T21:56:16.711746] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-09. [2025-09-26T21:56:16.832589] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-26T21:56:17.511958] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-02. [2025-09-26T21:56:17.513882] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-26T21:56:18.234224] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-26T21:56:18.243507] [INFO ] [REMOTE ] VEEV: Full fetch complete (68295 records). [2025-09-26T21:56:18.243702] [DEBUG] [VALIDATOR ] VEEV: Validating primary data. [2025-09-26T21:56:18.316831] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-02. [2025-09-26T21:56:18.658455] [DEBUG] [VALIDATOR ] VEEV: All expected trading days are present. [2025-09-26T21:56:18.658576] [DEBUG] [VALIDATOR ] VEEV: Primary data validation passed. [2025-09-26T21:56:18.659753] [INFO ] [MAIN ] VEEV: Fetched primary data is valid. [2025-09-26T21:56:18.659822] [DEBUG] [LOCAL ] VEEV: Saving primary data. [2025-09-26T21:56:18.661297] [DEBUG] [LOCAL ] VEEV: Trimmed 68295 records to 47821 (keeping 200 days of data) [2025-09-26T21:56:18.962614] [DEBUG] [LOCAL ] VEEV: Primary data saved (47821 records). [2025-09-26T21:56:18.962846] [INFO ] [MAIN ] VEEV: Full history saved. [2025-09-26T21:56:18.962981] [INFO ] [MAIN ] Update Progress: 2219/2371 symbols completed. VEEV took 35.5s. Estimated remaining: 20m 18s. Rate: 7.5 symbols/min [2025-09-26T21:56:19.120238] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-07. [2025-09-26T21:56:19.139382] [INFO ] [MAIN ] VGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:56:19.149368] [DEBUG] [LOCAL ] VGI: Loaded 5203 existing records from primary storage. [2025-09-26T21:56:19.149503] [INFO ] [MAIN ] VGI: Loaded 5203 existing records. [2025-09-26T21:56:19.334243] [WARN ] [MAIN ] VGI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:56:19.334894] [INFO ] [MAIN ] VGI: Wiping existing primary data before full refresh. [2025-09-26T21:56:19.334985] [INFO ] [LOCAL ] VGI: Starting deletion of primary data. [2025-09-26T21:56:19.335475] [DEBUG] [LOCAL ] VGI: Deleted primary data file. [2025-09-26T21:56:19.335541] [INFO ] [MAIN ] VGI: Starting full primary refresh. [2025-09-26T21:56:19.706320] [INFO ] [REMOTE ] VGI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:56:19.741364] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-26T21:56:19.911710] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-03. [2025-09-26T21:56:20.328758] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-26T21:56:20.412058] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-26T21:56:20.711766] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-03. [2025-09-26T21:56:21.500191] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-26T21:56:21.511673] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-04. [2025-09-26T21:56:22.311817] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-08. [2025-09-26T21:56:22.787074] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-26T21:56:23.111729] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-04. [2025-09-26T21:56:23.699446] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-26T21:56:23.911706] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-05. [2025-09-26T21:56:23.998704] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-26T21:56:24.711735] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-09. [2025-09-26T21:56:24.861576] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-26T21:56:25.511724] [INFO ] [REMOTE ] VGI: Fetching primary data for 2024-12. [2025-09-26T21:56:25.968049] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-26T21:56:26.146104] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-26T21:56:26.271254] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-26T21:56:26.279767] [INFO ] [REMOTE ] VET: Full fetch complete (64468 records). [2025-09-26T21:56:26.279899] [DEBUG] [VALIDATOR ] VET: Validating primary data. [2025-09-26T21:56:26.316785] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-06. [2025-09-26T21:56:26.705860] [DEBUG] [VALIDATOR ] VET: All expected trading days are present. [2025-09-26T21:56:26.705962] [DEBUG] [VALIDATOR ] VET: Primary data validation passed. [2025-09-26T21:56:26.707098] [INFO ] [MAIN ] VET: Fetched primary data is valid. [2025-09-26T21:56:26.707169] [DEBUG] [LOCAL ] VET: Saving primary data. [2025-09-26T21:56:26.711167] [DEBUG] [LOCAL ] VET: Trimmed 64468 records to 44749 (keeping 200 days of data) [2025-09-26T21:56:26.985823] [DEBUG] [LOCAL ] VET: Primary data saved (44749 records). [2025-09-26T21:56:26.986032] [INFO ] [MAIN ] VET: Full history saved. [2025-09-26T21:56:26.986169] [INFO ] [MAIN ] Update Progress: 2220/2371 symbols completed. VET took 38.3s. Estimated remaining: 20m 10s. Rate: 7.5 symbols/min [2025-09-26T21:56:27.116893] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-01. [2025-09-26T21:56:27.178635] [INFO ] [MAIN ] VGM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:56:27.197532] [DEBUG] [LOCAL ] VGM: Loaded 18293 existing records from primary storage. [2025-09-26T21:56:27.197711] [INFO ] [MAIN ] VGM: Loaded 18293 existing records. [2025-09-26T21:56:27.382920] [WARN ] [MAIN ] VGM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:56:27.383184] [INFO ] [MAIN ] VGM: Wiping existing primary data before full refresh. [2025-09-26T21:56:27.383234] [INFO ] [LOCAL ] VGM: Starting deletion of primary data. [2025-09-26T21:56:27.383877] [DEBUG] [LOCAL ] VGM: Deleted primary data file. [2025-09-26T21:56:27.383938] [INFO ] [MAIN ] VGM: Starting full primary refresh. [2025-09-26T21:56:27.782808] [INFO ] [REMOTE ] VGM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:56:27.847742] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-26T21:56:27.911705] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-02. [2025-09-26T21:56:28.337515] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-26T21:56:28.377760] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-26T21:56:28.711746] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-07. [2025-09-26T21:56:29.511752] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-03. [2025-09-26T21:56:30.254953] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-26T21:56:30.311722] [INFO ] [REMOTE ] VGM: Fetching primary data for 2024-12. [2025-09-26T21:56:30.705187] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-26T21:56:31.111722] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-04. [2025-09-26T21:56:31.359144] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-26T21:56:31.717575] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-26T21:56:31.911757] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-05. [2025-09-26T21:56:32.711718] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-05. [2025-09-26T21:56:33.272796] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-26T21:56:33.511737] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-01. [2025-09-26T21:56:34.088720] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-26T21:56:34.311707] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-08. [2025-09-26T21:56:34.326994] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-26T21:56:35.111741] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-02. [2025-09-26T21:56:35.818110] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-26T21:56:35.911743] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-06. [2025-09-26T21:56:36.311518] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-26T21:56:36.487682] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-26T21:56:36.711750] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-09. [2025-09-26T21:56:37.511730] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-06. [2025-09-26T21:56:38.311709] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-03. [2025-09-26T21:56:38.533938] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-26T21:56:38.544384] [INFO ] [REMOTE ] VFC: Full fetch complete (77586 records). [2025-09-26T21:56:38.544557] [DEBUG] [VALIDATOR ] VFC: Validating primary data. [2025-09-26T21:56:38.963676] [DEBUG] [VALIDATOR ] VFC: All expected trading days are present. [2025-09-26T21:56:38.963775] [DEBUG] [VALIDATOR ] VFC: Primary data validation passed. [2025-09-26T21:56:38.964955] [INFO ] [MAIN ] VFC: Fetched primary data is valid. [2025-09-26T21:56:38.965026] [DEBUG] [LOCAL ] VFC: Saving primary data. [2025-09-26T21:56:38.966886] [DEBUG] [LOCAL ] VFC: Trimmed 77586 records to 54390 (keeping 200 days of data) [2025-09-26T21:56:39.157480] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-07. [2025-09-26T21:56:39.329807] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-26T21:56:39.345944] [DEBUG] [LOCAL ] VFC: Primary data saved (54390 records). [2025-09-26T21:56:39.346077] [INFO ] [MAIN ] VFC: Full history saved. [2025-09-26T21:56:39.346165] [INFO ] [MAIN ] Update Progress: 2221/2371 symbols completed. VFC took 31.5s. Estimated remaining: 20m 2s. Rate: 7.5 symbols/min [2025-09-26T21:56:39.538117] [INFO ] [MAIN ] VHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:56:39.543075] [DEBUG] [LOCAL ] VHI: Loaded 2896 existing records from primary storage. [2025-09-26T21:56:39.543183] [INFO ] [MAIN ] VHI: Loaded 2896 existing records. [2025-09-26T21:56:39.748095] [WARN ] [MAIN ] VHI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:56:39.748503] [INFO ] [MAIN ] VHI: Wiping existing primary data before full refresh. [2025-09-26T21:56:39.748773] [INFO ] [LOCAL ] VHI: Starting deletion of primary data. [2025-09-26T21:56:39.759432] [DEBUG] [LOCAL ] VHI: Deleted primary data file. [2025-09-26T21:56:39.764666] [INFO ] [MAIN ] VHI: Starting full primary refresh. [2025-09-26T21:56:39.854406] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-09-26T21:56:39.916804] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-04. [2025-09-26T21:56:40.111240] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-26T21:56:40.195715] [INFO ] [REMOTE ] VHI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:56:40.711695] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-08. [2025-09-26T21:56:40.943512] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-26T21:56:41.311137] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-26T21:56:41.511740] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-09. [2025-09-26T21:56:42.311744] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-07. [2025-09-26T21:56:42.430726] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-26T21:56:42.432911] [INFO ] [REMOTE ] VGI: Full fetch complete (7764 records). [2025-09-26T21:56:42.432985] [DEBUG] [VALIDATOR ] VGI: Validating primary data. [2025-09-26T21:56:42.809595] [DEBUG] [VALIDATOR ] VGI: All expected trading days are present. [2025-09-26T21:56:42.809729] [DEBUG] [VALIDATOR ] VGI: Primary data validation passed. [2025-09-26T21:56:42.810018] [INFO ] [MAIN ] VGI: Fetched primary data is valid. [2025-09-26T21:56:42.810070] [DEBUG] [LOCAL ] VGI: Saving primary data. [2025-09-26T21:56:42.810518] [DEBUG] [LOCAL ] VGI: Trimmed 7764 records to 5237 (keeping 200 days of data) [2025-09-26T21:56:42.841559] [DEBUG] [LOCAL ] VGI: Primary data saved (5237 records). [2025-09-26T21:56:42.841772] [INFO ] [MAIN ] VGI: Full history saved. [2025-09-26T21:56:42.841937] [INFO ] [MAIN ] Update Progress: 2222/2371 symbols completed. VGI took 23.9s. Estimated remaining: 19m 54s. Rate: 7.5 symbols/min [2025-09-26T21:56:43.024505] [INFO ] [MAIN ] VIA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:56:43.024855] [DEBUG] [LOCAL ] VIA: No existing data file found in primary storage. [2025-09-26T21:56:43.024935] [WARN ] [MAIN ] VIA: No existing data found, performing full refresh instead. [2025-09-26T21:56:43.025158] [INFO ] [MAIN ] VIA: Wiping existing primary data before full refresh. [2025-09-26T21:56:43.025242] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-09-26T21:56:43.025290] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-09-26T21:56:43.025429] [INFO ] [MAIN ] VIA: Starting full primary refresh. [2025-09-26T21:56:43.120608] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-05. [2025-09-26T21:56:43.405022] [INFO ] [REMOTE ] VIA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:56:43.911723] [INFO ] [REMOTE ] VHI: Fetching primary data for 2024-12. [2025-09-26T21:56:44.193229] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-26T21:56:44.356640] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-26T21:56:44.601051] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-26T21:56:44.711744] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-01. [2025-09-26T21:56:45.511716] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-08. [2025-09-26T21:56:46.311728] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-06. [2025-09-26T21:56:46.831056] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-26T21:56:47.111740] [INFO ] [REMOTE ] VIA: Fetching primary data for 2024-12. [2025-09-26T21:56:47.388161] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:56:47.388554] [WARN ] [REMOTE ] VIA: No data returned for month 2024-12 [2025-09-26T21:56:47.696455] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-26T21:56:47.782387] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-26T21:56:47.911725] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-02. [2025-09-26T21:56:48.385766] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-26T21:56:48.711782] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-09. [2025-09-26T21:56:49.511746] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-03. [2025-09-26T21:56:50.104330] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-26T21:56:50.311692] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-01. [2025-09-26T21:56:50.389096] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-26T21:56:50.399287] [INFO ] [REMOTE ] VG: Full fetch complete (65677 records). [2025-09-26T21:56:50.399455] [DEBUG] [VALIDATOR ] VG: Validating primary data. [2025-09-26T21:56:50.560086] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:56:50.583796] [WARN ] [REMOTE ] VIA: No data returned for month 2025-01 [2025-09-26T21:56:50.605711] [WARN ] [VALIDATOR ] VG: Validation failed - insufficient historical data. Have 170 unique days, need 200 days [2025-09-26T21:56:50.606726] [FATAL] [MAIN ] VG: Fetched primary data is invalid. Refusing to save it. [2025-09-26T21:56:50.606809] [WARN ] [MAIN ] VG: Deleting existing primary and derivative data due to validation failure. [2025-09-26T21:56:50.606902] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-09-26T21:56:50.607061] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-09-26T21:56:50.607153] [INFO ] [LOCAL ] VG: Starting deletion of derivative data. [2025-09-26T21:56:50.607239] [DEBUG] [LOCAL ] VG: No derivative data file found to delete. [2025-09-26T21:56:50.607339] [INFO ] [MAIN ] Update Progress: 2223/2371 symbols completed. VG took 41.4s. Estimated remaining: 19m 46s. Rate: 7.5 symbols/min [2025-09-26T21:56:50.782963] [INFO ] [MAIN ] VICI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:56:50.849091] [DEBUG] [LOCAL ] VICI: Loaded 54039 existing records from primary storage. [2025-09-26T21:56:50.849240] [INFO ] [MAIN ] VICI: Loaded 54039 existing records. [2025-09-26T21:56:51.040092] [WARN ] [MAIN ] VICI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:56:51.040448] [INFO ] [MAIN ] VICI: Wiping existing primary data before full refresh. [2025-09-26T21:56:51.040533] [INFO ] [LOCAL ] VICI: Starting deletion of primary data. [2025-09-26T21:56:51.041840] [DEBUG] [LOCAL ] VICI: Deleted primary data file. [2025-09-26T21:56:51.041912] [INFO ] [MAIN ] VICI: Starting full primary refresh. [2025-09-26T21:56:51.116862] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-07. [2025-09-26T21:56:51.412710] [INFO ] [REMOTE ] VICI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:56:51.911703] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-04. [2025-09-26T21:56:52.265787] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-26T21:56:52.274393] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-26T21:56:52.711714] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-05. [2025-09-26T21:56:53.206509] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-26T21:56:53.511724] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-08. [2025-09-26T21:56:54.311703] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-06. [2025-09-26T21:56:54.590698] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-26T21:56:54.871316] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-26T21:56:55.111719] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-09. [2025-09-26T21:56:55.911722] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-02. [2025-09-26T21:56:56.204605] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:56:56.205772] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-26T21:56:56.206144] [WARN ] [REMOTE ] VIA: No data returned for month 2025-02 [2025-09-26T21:56:56.211142] [INFO ] [REMOTE ] VGM: Full fetch complete (26172 records). [2025-09-26T21:56:56.211267] [DEBUG] [VALIDATOR ] VGM: Validating primary data. [2025-09-26T21:56:56.620805] [DEBUG] [VALIDATOR ] VGM: All expected trading days are present. [2025-09-26T21:56:56.620897] [DEBUG] [VALIDATOR ] VGM: Primary data validation passed. [2025-09-26T21:56:56.621549] [INFO ] [MAIN ] VGM: Fetched primary data is valid. [2025-09-26T21:56:56.621624] [DEBUG] [LOCAL ] VGM: Saving primary data. [2025-09-26T21:56:56.622506] [DEBUG] [LOCAL ] VGM: Trimmed 26172 records to 18384 (keeping 200 days of data) [2025-09-26T21:56:56.711906] [INFO ] [REMOTE ] VICI: Fetching primary data for 2024-12. [2025-09-26T21:56:56.744544] [DEBUG] [LOCAL ] VGM: Primary data saved (18384 records). [2025-09-26T21:56:56.744740] [INFO ] [MAIN ] VGM: Full history saved. [2025-09-26T21:56:56.744853] [INFO ] [MAIN ] Update Progress: 2224/2371 symbols completed. VGM took 29.8s. Estimated remaining: 19m 37s. Rate: 7.5 symbols/min [2025-09-26T21:56:56.929280] [INFO ] [MAIN ] VIK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:56:56.982305] [DEBUG] [LOCAL ] VIK: Loaded 52883 existing records from primary storage. [2025-09-26T21:56:56.982462] [INFO ] [MAIN ] VIK: Loaded 52883 existing records. [2025-09-26T21:56:57.175482] [WARN ] [MAIN ] VIK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:56:57.175824] [INFO ] [MAIN ] VIK: Wiping existing primary data before full refresh. [2025-09-26T21:56:57.175879] [INFO ] [LOCAL ] VIK: Starting deletion of primary data. [2025-09-26T21:56:57.176998] [DEBUG] [LOCAL ] VIK: Deleted primary data file. [2025-09-26T21:56:57.177061] [INFO ] [MAIN ] VIK: Starting full primary refresh. [2025-09-26T21:56:57.516826] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-03. [2025-09-26T21:56:57.573331] [INFO ] [REMOTE ] VIK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:56:57.774984] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:56:57.775323] [WARN ] [REMOTE ] VIA: No data returned for month 2025-03 [2025-09-26T21:56:58.311716] [INFO ] [REMOTE ] VIK: Fetching primary data for 2024-12. [2025-09-26T21:56:58.794961] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-26T21:56:59.111747] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-04. [2025-09-26T21:56:59.316366] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:56:59.316802] [WARN ] [REMOTE ] VIA: No data returned for month 2025-04 [2025-09-26T21:56:59.751609] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-26T21:56:59.911727] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-05. [2025-09-26T21:57:00.130961] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:57:00.131291] [WARN ] [REMOTE ] VIA: No data returned for month 2025-05 [2025-09-26T21:57:00.711751] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-01. [2025-09-26T21:57:01.511724] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-06. [2025-09-26T21:57:01.742746] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:57:01.743119] [WARN ] [REMOTE ] VIA: No data returned for month 2025-06 [2025-09-26T21:57:02.311724] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-07. [2025-09-26T21:57:02.782099] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-26T21:57:02.949563] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-26T21:57:03.111709] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-02. [2025-09-26T21:57:03.911722] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-01. [2025-09-26T21:57:04.711725] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-07. [2025-09-26T21:57:04.975336] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:57:04.975724] [WARN ] [REMOTE ] VIA: No data returned for month 2025-07 [2025-09-26T21:57:05.026863] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-26T21:57:05.511729] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-08. [2025-09-26T21:57:05.801269] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-26T21:57:05.997546] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-26T21:57:06.311726] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-03. [2025-09-26T21:57:07.111714] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-02. [2025-09-26T21:57:07.911736] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-08. [2025-09-26T21:57:08.133946] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:57:08.134390] [WARN ] [REMOTE ] VIA: No data returned for month 2025-08 [2025-09-26T21:57:08.363797] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-26T21:57:08.716801] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-04. [2025-09-26T21:57:08.733182] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-26T21:57:09.511729] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-09. [2025-09-26T21:57:09.996856] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-26T21:57:09.998004] [INFO ] [REMOTE ] VHI: Full fetch complete (4554 records). [2025-09-26T21:57:09.998076] [DEBUG] [VALIDATOR ] VHI: Validating primary data. [2025-09-26T21:57:10.319317] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-03. [2025-09-26T21:57:10.407926] [DEBUG] [VALIDATOR ] VHI: All expected trading days are present. [2025-09-26T21:57:10.408019] [DEBUG] [VALIDATOR ] VHI: Primary data validation passed. [2025-09-26T21:57:10.408179] [INFO ] [MAIN ] VHI: Fetched primary data is valid. [2025-09-26T21:57:10.408219] [DEBUG] [LOCAL ] VHI: Saving primary data. [2025-09-26T21:57:10.408602] [DEBUG] [LOCAL ] VHI: Trimmed 4554 records to 2905 (keeping 200 days of data) [2025-09-26T21:57:10.428750] [DEBUG] [LOCAL ] VHI: Primary data saved (2905 records). [2025-09-26T21:57:10.428866] [INFO ] [MAIN ] VHI: Full history saved. [2025-09-26T21:57:10.428972] [INFO ] [MAIN ] Update Progress: 2225/2371 symbols completed. VHI took 31.1s. Estimated remaining: 19m 30s. Rate: 7.5 symbols/min [2025-09-26T21:57:10.618176] [INFO ] [MAIN ] VIPS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:57:10.681638] [DEBUG] [LOCAL ] VIPS: Loaded 51734 existing records from primary storage. [2025-09-26T21:57:10.681818] [INFO ] [MAIN ] VIPS: Loaded 51734 existing records. [2025-09-26T21:57:10.886161] [WARN ] [MAIN ] VIPS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:57:10.886801] [INFO ] [MAIN ] VIPS: Wiping existing primary data before full refresh. [2025-09-26T21:57:10.886908] [INFO ] [LOCAL ] VIPS: Starting deletion of primary data. [2025-09-26T21:57:10.888422] [DEBUG] [LOCAL ] VIPS: Deleted primary data file. [2025-09-26T21:57:10.888486] [INFO ] [MAIN ] VIPS: Starting full primary refresh. [2025-09-26T21:57:11.118260] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-09. [2025-09-26T21:57:11.295588] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-09-26T21:57:11.394619] [INFO ] [REMOTE ] VIPS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:57:11.787149] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-26T21:57:11.911733] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-05. [2025-09-26T21:57:12.337275] [INFO ] [REMOTE ] VIA: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-26T21:57:12.341332] [INFO ] [REMOTE ] VIA: Full fetch complete (2576 records). [2025-09-26T21:57:12.341451] [DEBUG] [VALIDATOR ] VIA: Validating primary data. [2025-09-26T21:57:12.541897] [WARN ] [VALIDATOR ] VIA: Validation failed - insufficient historical data. Have 11 unique days, need 200 days [2025-09-26T21:57:12.542225] [FATAL] [MAIN ] VIA: Fetched primary data is invalid. Refusing to save it. [2025-09-26T21:57:12.542356] [WARN ] [MAIN ] VIA: Deleting existing primary and derivative data due to validation failure. [2025-09-26T21:57:12.542542] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-09-26T21:57:12.542632] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-09-26T21:57:12.542726] [INFO ] [LOCAL ] VIA: Starting deletion of derivative data. [2025-09-26T21:57:12.542812] [DEBUG] [LOCAL ] VIA: No derivative data file found to delete. [2025-09-26T21:57:12.543073] [INFO ] [MAIN ] Update Progress: 2226/2371 symbols completed. VIA took 29.7s. Estimated remaining: 19m 21s. Rate: 7.5 symbols/min [2025-09-26T21:57:12.730425] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2024-12. [2025-09-26T21:57:12.735470] [INFO ] [MAIN ] VIRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:57:12.812399] [DEBUG] [LOCAL ] VIRT: Loaded 47172 existing records from primary storage. [2025-09-26T21:57:12.812675] [INFO ] [MAIN ] VIRT: Loaded 47172 existing records. [2025-09-26T21:57:12.999193] [WARN ] [MAIN ] VIRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:57:12.999535] [INFO ] [MAIN ] VIRT: Wiping existing primary data before full refresh. [2025-09-26T21:57:12.999590] [INFO ] [LOCAL ] VIRT: Starting deletion of primary data. [2025-09-26T21:57:13.000948] [DEBUG] [LOCAL ] VIRT: Deleted primary data file. [2025-09-26T21:57:13.001025] [INFO ] [MAIN ] VIRT: Starting full primary refresh. [2025-09-26T21:57:13.445149] [INFO ] [REMOTE ] VIRT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:57:13.511727] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-04. [2025-09-26T21:57:13.913579] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-26T21:57:14.311707] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-06. [2025-09-26T21:57:14.697629] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-26T21:57:14.923000] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-26T21:57:15.111717] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2024-12. [2025-09-26T21:57:15.911694] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-01. [2025-09-26T21:57:16.197151] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-26T21:57:16.711730] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-07. [2025-09-26T21:57:16.989451] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-26T21:57:17.511707] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-01. [2025-09-26T21:57:17.716017] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-26T21:57:18.311700] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-05. [2025-09-26T21:57:18.622150] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-26T21:57:19.111735] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-02. [2025-09-26T21:57:19.205859] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-26T21:57:19.911734] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-02. [2025-09-26T21:57:20.016691] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-26T21:57:20.632958] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-26T21:57:20.711727] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-03. [2025-09-26T21:57:21.511726] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-08. [2025-09-26T21:57:21.576033] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-26T21:57:22.043028] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-26T21:57:22.311724] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-03. [2025-09-26T21:57:23.111711] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-06. [2025-09-26T21:57:23.446957] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-26T21:57:23.911943] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-09. [2025-09-26T21:57:24.089742] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-26T21:57:24.721959] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-04. [2025-09-26T21:57:24.730152] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-26T21:57:24.743287] [INFO ] [REMOTE ] VICI: Full fetch complete (77655 records). [2025-09-26T21:57:24.743500] [DEBUG] [VALIDATOR ] VICI: Validating primary data. [2025-09-26T21:57:25.356600] [DEBUG] [VALIDATOR ] VICI: All expected trading days are present. [2025-09-26T21:57:25.356826] [DEBUG] [VALIDATOR ] VICI: Primary data validation passed. [2025-09-26T21:57:25.358264] [INFO ] [MAIN ] VICI: Fetched primary data is valid. [2025-09-26T21:57:25.359137] [DEBUG] [LOCAL ] VICI: Saving primary data. [2025-09-26T21:57:25.361352] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-26T21:57:25.373574] [DEBUG] [LOCAL ] VICI: Trimmed 77655 records to 54427 (keeping 200 days of data) [2025-09-26T21:57:25.514721] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-07. [2025-09-26T21:57:25.738588] [DEBUG] [LOCAL ] VICI: Primary data saved (54427 records). [2025-09-26T21:57:25.738784] [INFO ] [MAIN ] VICI: Full history saved. [2025-09-26T21:57:25.738903] [INFO ] [MAIN ] Update Progress: 2227/2371 symbols completed. VICI took 35.1s. Estimated remaining: 19m 14s. Rate: 7.5 symbols/min [2025-09-26T21:57:25.930846] [INFO ] [MAIN ] VIST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:57:25.981932] [DEBUG] [LOCAL ] VIST: Loaded 46370 existing records from primary storage. [2025-09-26T21:57:25.982111] [INFO ] [MAIN ] VIST: Loaded 46370 existing records. [2025-09-26T21:57:26.199128] [WARN ] [MAIN ] VIST: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:57:26.199430] [INFO ] [MAIN ] VIST: Wiping existing primary data before full refresh. [2025-09-26T21:57:26.199499] [INFO ] [LOCAL ] VIST: Starting deletion of primary data. [2025-09-26T21:57:26.200502] [DEBUG] [LOCAL ] VIST: Deleted primary data file. [2025-09-26T21:57:26.200566] [INFO ] [MAIN ] VIST: Starting full primary refresh. [2025-09-26T21:57:26.313526] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-04. [2025-09-26T21:57:26.599959] [INFO ] [REMOTE ] VIST: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:57:26.633674] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-26T21:57:27.111694] [INFO ] [REMOTE ] VIST: Fetching primary data for 2024-12. [2025-09-26T21:57:27.524480] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-26T21:57:27.909064] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T21:57:27.919275] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-08. [2025-09-26T21:57:28.716932] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-05. [2025-09-26T21:57:28.735844] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-26T21:57:29.511728] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-05. [2025-09-26T21:57:29.844485] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-26T21:57:30.311743] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-09. [2025-09-26T21:57:30.544445] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-26T21:57:31.111708] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-01. [2025-09-26T21:57:31.911732] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-06. [2025-09-26T21:57:32.418345] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-05 (2.91 seconds). [2025-09-26T21:57:32.593851] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-26T21:57:32.605787] [INFO ] [REMOTE ] VIK: Full fetch complete (75852 records). [2025-09-26T21:57:32.605972] [DEBUG] [VALIDATOR ] VIK: Validating primary data. [2025-09-26T21:57:32.724218] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-06. [2025-09-26T21:57:33.059295] [DEBUG] [VALIDATOR ] VIK: All expected trading days are present. [2025-09-26T21:57:33.059516] [DEBUG] [VALIDATOR ] VIK: Primary data validation passed. [2025-09-26T21:57:33.060892] [INFO ] [MAIN ] VIK: Fetched primary data is valid. [2025-09-26T21:57:33.061149] [DEBUG] [LOCAL ] VIK: Saving primary data. [2025-09-26T21:57:33.092108] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-26T21:57:33.102206] [DEBUG] [LOCAL ] VIK: Trimmed 75852 records to 53250 (keeping 200 days of data) [2025-09-26T21:57:33.447620] [DEBUG] [LOCAL ] VIK: Primary data saved (53250 records). [2025-09-26T21:57:33.447940] [INFO ] [MAIN ] VIK: Full history saved. [2025-09-26T21:57:33.448093] [INFO ] [MAIN ] Update Progress: 2228/2371 symbols completed. VIK took 36.7s. Estimated remaining: 19m 6s. Rate: 7.5 symbols/min [2025-09-26T21:57:33.518287] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-02. [2025-09-26T21:57:33.673881] [INFO ] [MAIN ] VIV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:57:33.676959] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-26T21:57:33.741033] [DEBUG] [LOCAL ] VIV: Loaded 45434 existing records from primary storage. [2025-09-26T21:57:33.741192] [INFO ] [MAIN ] VIV: Loaded 45434 existing records. [2025-09-26T21:57:33.932836] [WARN ] [MAIN ] VIV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:57:33.933140] [INFO ] [MAIN ] VIV: Wiping existing primary data before full refresh. [2025-09-26T21:57:33.933192] [INFO ] [LOCAL ] VIV: Starting deletion of primary data. [2025-09-26T21:57:33.934185] [DEBUG] [LOCAL ] VIV: Deleted primary data file. [2025-09-26T21:57:33.934249] [INFO ] [MAIN ] VIV: Starting full primary refresh. [2025-09-26T21:57:34.331234] [INFO ] [REMOTE ] VIV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:57:34.324693] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-07. [2025-09-26T21:57:34.363511] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-26T21:57:35.111743] [INFO ] [REMOTE ] VIV: Fetching primary data for 2024-12. [2025-09-26T21:57:35.313563] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-26T21:57:35.911764] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-03. [2025-09-26T21:57:36.009304] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-26T21:57:36.711758] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-07. [2025-09-26T21:57:36.827674] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-26T21:57:37.511746] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-01. [2025-09-26T21:57:37.577545] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-26T21:57:38.311729] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-04. [2025-09-26T21:57:38.351484] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-26T21:57:39.111710] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-08. [2025-09-26T21:57:39.178986] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-26T21:57:39.911709] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-02. [2025-09-26T21:57:40.123303] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-26T21:57:40.325263] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-26T21:57:40.711723] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-08. [2025-09-26T21:57:41.398507] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-26T21:57:41.511717] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-03. [2025-09-26T21:57:42.311695] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-05. [2025-09-26T21:57:42.415221] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-26T21:57:43.116763] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-09. [2025-09-26T21:57:43.134174] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-26T21:57:43.902777] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-26T21:57:43.911734] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-04. [2025-09-26T21:57:44.711714] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-06. [2025-09-26T21:57:44.849851] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-26T21:57:44.860227] [INFO ] [REMOTE ] VIPS: Full fetch complete (74608 records). [2025-09-26T21:57:44.860404] [DEBUG] [VALIDATOR ] VIPS: Validating primary data. [2025-09-26T21:57:45.271466] [DEBUG] [VALIDATOR ] VIPS: All expected trading days are present. [2025-09-26T21:57:45.271600] [DEBUG] [VALIDATOR ] VIPS: Primary data validation passed. [2025-09-26T21:57:45.272764] [INFO ] [MAIN ] VIPS: Fetched primary data is valid. [2025-09-26T21:57:45.272874] [DEBUG] [LOCAL ] VIPS: Saving primary data. [2025-09-26T21:57:45.274427] [DEBUG] [LOCAL ] VIPS: Trimmed 74608 records to 52093 (keeping 200 days of data) [2025-09-26T21:57:45.512051] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-09. [2025-09-26T21:57:45.633395] [DEBUG] [LOCAL ] VIPS: Primary data saved (52093 records). [2025-09-26T21:57:45.634406] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T21:57:45.634722] [INFO ] [MAIN ] VIPS: Full history saved. [2025-09-26T21:57:45.634918] [INFO ] [MAIN ] Update Progress: 2229/2371 symbols completed. VIPS took 35.2s. Estimated remaining: 18m 58s. Rate: 7.5 symbols/min [2025-09-26T21:57:45.842976] [INFO ] [MAIN ] VKQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:57:45.862514] [DEBUG] [LOCAL ] VKQ: Loaded 17468 existing records from primary storage. [2025-09-26T21:57:45.862688] [INFO ] [MAIN ] VKQ: Loaded 17468 existing records. [2025-09-26T21:57:46.053277] [WARN ] [MAIN ] VKQ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:57:46.053586] [INFO ] [MAIN ] VKQ: Wiping existing primary data before full refresh. [2025-09-26T21:57:46.053667] [INFO ] [LOCAL ] VKQ: Starting deletion of primary data. [2025-09-26T21:57:46.054231] [DEBUG] [LOCAL ] VKQ: Deleted primary data file. [2025-09-26T21:57:46.054292] [INFO ] [MAIN ] VKQ: Starting full primary refresh. [2025-09-26T21:57:46.312335] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-05. [2025-09-26T21:57:46.431411] [INFO ] [REMOTE ] VKQ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:57:46.455885] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-26T21:57:47.108507] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-26T21:57:47.116983] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-07. [2025-09-26T21:57:47.119216] [INFO ] [REMOTE ] VIRT: Full fetch complete (66904 records). [2025-09-26T21:57:47.119408] [DEBUG] [VALIDATOR ] VIRT: Validating primary data. [2025-09-26T21:57:47.536831] [DEBUG] [VALIDATOR ] VIRT: All expected trading days are present. [2025-09-26T21:57:47.536933] [DEBUG] [VALIDATOR ] VIRT: Primary data validation passed. [2025-09-26T21:57:47.537975] [INFO ] [MAIN ] VIRT: Fetched primary data is valid. [2025-09-26T21:57:47.538045] [DEBUG] [LOCAL ] VIRT: Saving primary data. [2025-09-26T21:57:47.539591] [DEBUG] [LOCAL ] VIRT: Trimmed 66904 records to 47448 (keeping 200 days of data) [2025-09-26T21:57:47.857297] [DEBUG] [LOCAL ] VIRT: Primary data saved (47448 records). [2025-09-26T21:57:47.857539] [INFO ] [MAIN ] VIRT: Full history saved. [2025-09-26T21:57:47.857721] [INFO ] [MAIN ] Update Progress: 2230/2371 symbols completed. VIRT took 35.3s. Estimated remaining: 18m 50s. Rate: 7.5 symbols/min [2025-09-26T21:57:47.919639] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2024-12. [2025-09-26T21:57:48.054762] [INFO ] [MAIN ] VLN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:57:48.085517] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-26T21:57:48.121412] [DEBUG] [LOCAL ] VLN: Loaded 28836 existing records from primary storage. [2025-09-26T21:57:48.121560] [INFO ] [MAIN ] VLN: Loaded 28836 existing records. [2025-09-26T21:57:48.308597] [WARN ] [MAIN ] VLN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:57:48.308877] [INFO ] [MAIN ] VLN: Wiping existing primary data before full refresh. [2025-09-26T21:57:48.308926] [INFO ] [LOCAL ] VLN: Starting deletion of primary data. [2025-09-26T21:57:48.309537] [DEBUG] [LOCAL ] VLN: Deleted primary data file. [2025-09-26T21:57:48.309598] [INFO ] [MAIN ] VLN: Starting full primary refresh. [2025-09-26T21:57:48.703332] [INFO ] [REMOTE ] VLN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:57:48.716803] [INFO ] [REMOTE ] VLN: Fetching primary data for 2024-12. [2025-09-26T21:57:48.736986] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-26T21:57:49.061772] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-26T21:57:49.511727] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-06. [2025-09-26T21:57:50.311702] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-08. [2025-09-26T21:57:50.395677] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-26T21:57:51.101140] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-26T21:57:51.111924] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-07. [2025-09-26T21:57:51.911737] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-01. [2025-09-26T21:57:52.080880] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-26T21:57:52.711720] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-09. [2025-09-26T21:57:52.824944] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-26T21:57:52.898817] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-26T21:57:53.511720] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-08. [2025-09-26T21:57:54.311706] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-01. [2025-09-26T21:57:54.502346] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-26T21:57:54.512582] [INFO ] [REMOTE ] VIST: Full fetch complete (66872 records). [2025-09-26T21:57:54.512809] [DEBUG] [VALIDATOR ] VIST: Validating primary data. [2025-09-26T21:57:54.921887] [DEBUG] [VALIDATOR ] VIST: All expected trading days are present. [2025-09-26T21:57:54.922015] [DEBUG] [VALIDATOR ] VIST: Primary data validation passed. [2025-09-26T21:57:54.923946] [INFO ] [MAIN ] VIST: Fetched primary data is valid. [2025-09-26T21:57:54.924022] [DEBUG] [LOCAL ] VIST: Saving primary data. [2025-09-26T21:57:54.926507] [DEBUG] [LOCAL ] VIST: Trimmed 66872 records to 46722 (keeping 200 days of data) [2025-09-26T21:57:55.121026] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-02. [2025-09-26T21:57:55.263885] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-26T21:57:55.291113] [DEBUG] [LOCAL ] VIST: Primary data saved (46722 records). [2025-09-26T21:57:55.291382] [INFO ] [MAIN ] VIST: Full history saved. [2025-09-26T21:57:55.291545] [INFO ] [MAIN ] Update Progress: 2231/2371 symbols completed. VIST took 29.6s. Estimated remaining: 18m 42s. Rate: 7.5 symbols/min [2025-09-26T21:57:55.470251] [INFO ] [MAIN ] VLO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:57:55.506741] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-26T21:57:55.580107] [DEBUG] [LOCAL ] VLO: Loaded 53476 existing records from primary storage. [2025-09-26T21:57:55.580329] [INFO ] [MAIN ] VLO: Loaded 53476 existing records. [2025-09-26T21:57:55.765452] [WARN ] [MAIN ] VLO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:57:55.766075] [INFO ] [MAIN ] VLO: Wiping existing primary data before full refresh. [2025-09-26T21:57:55.766159] [INFO ] [LOCAL ] VLO: Starting deletion of primary data. [2025-09-26T21:57:55.772884] [DEBUG] [LOCAL ] VLO: Deleted primary data file. [2025-09-26T21:57:55.780122] [INFO ] [MAIN ] VLO: Starting full primary refresh. [2025-09-26T21:57:55.787281] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-26T21:57:55.916930] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-03. [2025-09-26T21:57:56.162875] [INFO ] [REMOTE ] VLO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:57:56.711747] [INFO ] [REMOTE ] VLO: Fetching primary data for 2024-12. [2025-09-26T21:57:56.989066] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-26T21:57:57.511752] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-02. [2025-09-26T21:57:58.311726] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-04. [2025-09-26T21:57:58.693016] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-26T21:57:58.762765] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-26T21:57:58.991589] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-26T21:57:59.111728] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-05. [2025-09-26T21:57:59.911746] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-09. [2025-09-26T21:58:00.054204] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-26T21:58:00.711758] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-01. [2025-09-26T21:58:01.513150] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-03. [2025-09-26T21:58:01.516712] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-26T21:58:01.527049] [INFO ] [REMOTE ] VIV: Full fetch complete (64596 records). [2025-09-26T21:58:01.527290] [DEBUG] [VALIDATOR ] VIV: Validating primary data. [2025-09-26T21:58:01.938280] [DEBUG] [VALIDATOR ] VIV: All expected trading days are present. [2025-09-26T21:58:01.938490] [DEBUG] [VALIDATOR ] VIV: Primary data validation passed. [2025-09-26T21:58:01.939767] [INFO ] [MAIN ] VIV: Fetched primary data is valid. [2025-09-26T21:58:01.939842] [DEBUG] [LOCAL ] VIV: Saving primary data. [2025-09-26T21:58:01.941578] [DEBUG] [LOCAL ] VIV: Trimmed 64596 records to 45667 (keeping 200 days of data) [2025-09-26T21:58:02.240879] [DEBUG] [LOCAL ] VIV: Primary data saved (45667 records). [2025-09-26T21:58:02.241103] [INFO ] [MAIN ] VIV: Full history saved. [2025-09-26T21:58:02.241221] [INFO ] [MAIN ] Update Progress: 2232/2371 symbols completed. VIV took 28.8s. Estimated remaining: 18m 33s. Rate: 7.5 symbols/min [2025-09-26T21:58:02.316946] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-06. [2025-09-26T21:58:02.437192] [INFO ] [MAIN ] VLRS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:58:02.477778] [DEBUG] [LOCAL ] VLRS: Loaded 40930 existing records from primary storage. [2025-09-26T21:58:02.477952] [INFO ] [MAIN ] VLRS: Loaded 40930 existing records. [2025-09-26T21:58:02.703863] [WARN ] [MAIN ] VLRS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:58:02.709457] [INFO ] [MAIN ] VLRS: Wiping existing primary data before full refresh. [2025-09-26T21:58:02.709691] [INFO ] [LOCAL ] VLRS: Starting deletion of primary data. [2025-09-26T21:58:02.709344] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-26T21:58:02.714819] [DEBUG] [LOCAL ] VLRS: Deleted primary data file. [2025-09-26T21:58:02.726913] [INFO ] [MAIN ] VLRS: Starting full primary refresh. [2025-09-26T21:58:02.861674] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-26T21:58:03.124444] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-02. [2025-09-26T21:58:03.140528] [INFO ] [REMOTE ] VLRS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:58:03.382775] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-26T21:58:03.911792] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-07. [2025-09-26T21:58:04.711726] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-04. [2025-09-26T21:58:04.907470] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-26T21:58:04.942350] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-26T21:58:05.511749] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-08. [2025-09-26T21:58:05.687569] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-26T21:58:06.311726] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2024-12. [2025-09-26T21:58:06.538086] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-26T21:58:07.111770] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-05. [2025-09-26T21:58:07.691347] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-26T21:58:07.911725] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-09. [2025-09-26T21:58:08.188982] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-26T21:58:08.711764] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-03. [2025-09-26T21:58:09.070839] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-26T21:58:09.075171] [INFO ] [REMOTE ] VKQ: Full fetch complete (24569 records). [2025-09-26T21:58:09.075326] [DEBUG] [VALIDATOR ] VKQ: Validating primary data. [2025-09-26T21:58:09.481476] [DEBUG] [VALIDATOR ] VKQ: All expected trading days are present. [2025-09-26T21:58:09.481602] [DEBUG] [VALIDATOR ] VKQ: Primary data validation passed. [2025-09-26T21:58:09.482317] [INFO ] [MAIN ] VKQ: Fetched primary data is valid. [2025-09-26T21:58:09.482386] [DEBUG] [LOCAL ] VKQ: Saving primary data. [2025-09-26T21:58:09.483261] [DEBUG] [LOCAL ] VKQ: Trimmed 24569 records to 17552 (keeping 200 days of data) [2025-09-26T21:58:09.527872] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-01. [2025-09-26T21:58:09.597336] [DEBUG] [LOCAL ] VKQ: Primary data saved (17552 records). [2025-09-26T21:58:09.597513] [INFO ] [MAIN ] VKQ: Full history saved. [2025-09-26T21:58:09.597680] [INFO ] [MAIN ] Update Progress: 2233/2371 symbols completed. VKQ took 24.0s. Estimated remaining: 18m 25s. Rate: 7.5 symbols/min [2025-09-26T21:58:09.771929] [INFO ] [MAIN ] VLT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:58:09.780432] [DEBUG] [LOCAL ] VLT: Loaded 4596 existing records from primary storage. [2025-09-26T21:58:09.780569] [INFO ] [MAIN ] VLT: Loaded 4596 existing records. [2025-09-26T21:58:09.962948] [WARN ] [MAIN ] VLT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:58:09.963301] [INFO ] [MAIN ] VLT: Wiping existing primary data before full refresh. [2025-09-26T21:58:09.963367] [INFO ] [LOCAL ] VLT: Starting deletion of primary data. [2025-09-26T21:58:09.963756] [DEBUG] [LOCAL ] VLT: Deleted primary data file. [2025-09-26T21:58:09.963817] [INFO ] [MAIN ] VLT: Starting full primary refresh. [2025-09-26T21:58:10.320431] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-06. [2025-09-26T21:58:10.342338] [INFO ] [REMOTE ] VLT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:58:10.647908] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-26T21:58:10.997426] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-26T21:58:11.111699] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-02. [2025-09-26T21:58:11.645054] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-26T21:58:11.911758] [INFO ] [REMOTE ] VLT: Fetching primary data for 2024-12. [2025-09-26T21:58:12.603266] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-26T21:58:12.711725] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-03. [2025-09-26T21:58:12.835085] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-26T21:58:13.511757] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-07. [2025-09-26T21:58:14.251996] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T21:58:14.311744] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-04. [2025-09-26T21:58:14.560405] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-26T21:58:15.111750] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-04. [2025-09-26T21:58:15.911703] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-01. [2025-09-26T21:58:15.965917] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-26T21:58:16.711745] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-05. [2025-09-26T21:58:16.877915] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-26T21:58:17.196748] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-26T21:58:17.511746] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-02. [2025-09-26T21:58:18.226726] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-26T21:58:18.267071] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-26T21:58:18.311731] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-03. [2025-09-26T21:58:18.869130] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-26T21:58:19.111773] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-08. [2025-09-26T21:58:19.911765] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-05. [2025-09-26T21:58:20.664997] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-26T21:58:20.711679] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-09. [2025-09-26T21:58:21.511738] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-04. [2025-09-26T21:58:21.896959] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-26T21:58:22.103388] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-26T21:58:22.110228] [INFO ] [REMOTE ] VLN: Full fetch complete (43176 records). [2025-09-26T21:58:22.110361] [DEBUG] [VALIDATOR ] VLN: Validating primary data. [2025-09-26T21:58:22.318112] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-06. [2025-09-26T21:58:22.383000] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-26T21:58:22.550325] [DEBUG] [VALIDATOR ] VLN: All expected trading days are present. [2025-09-26T21:58:22.550452] [DEBUG] [VALIDATOR ] VLN: Primary data validation passed. [2025-09-26T21:58:22.551751] [INFO ] [MAIN ] VLN: Fetched primary data is valid. [2025-09-26T21:58:22.551816] [DEBUG] [LOCAL ] VLN: Saving primary data. [2025-09-26T21:58:22.552983] [DEBUG] [LOCAL ] VLN: Trimmed 43176 records to 29056 (keeping 200 days of data) [2025-09-26T21:58:22.719520] [DEBUG] [LOCAL ] VLN: Primary data saved (29056 records). [2025-09-26T21:58:22.719737] [INFO ] [MAIN ] VLN: Full history saved. [2025-09-26T21:58:22.719873] [INFO ] [MAIN ] Update Progress: 2234/2371 symbols completed. VLN took 34.9s. Estimated remaining: 18m 18s. Rate: 7.5 symbols/min [2025-09-26T21:58:22.890613] [INFO ] [MAIN ] VLTO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:58:22.939672] [DEBUG] [LOCAL ] VLTO: Loaded 46368 existing records from primary storage. [2025-09-26T21:58:22.939916] [INFO ] [MAIN ] VLTO: Loaded 46368 existing records. [2025-09-26T21:58:23.115266] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-05. [2025-09-26T21:58:23.121469] [WARN ] [MAIN ] VLTO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:58:23.123241] [INFO ] [MAIN ] VLTO: Wiping existing primary data before full refresh. [2025-09-26T21:58:23.123306] [INFO ] [LOCAL ] VLTO: Starting deletion of primary data. [2025-09-26T21:58:23.124769] [DEBUG] [LOCAL ] VLTO: Deleted primary data file. [2025-09-26T21:58:23.124834] [INFO ] [MAIN ] VLTO: Starting full primary refresh. [2025-09-26T21:58:23.502255] [INFO ] [REMOTE ] VLTO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:58:23.756338] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-26T21:58:23.911710] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-06. [2025-09-26T21:58:24.422621] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-26T21:58:24.543256] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-26T21:58:24.711753] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-06. [2025-09-26T21:58:25.511746] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-07. [2025-09-26T21:58:26.198734] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-26T21:58:26.311772] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-07. [2025-09-26T21:58:26.888141] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-26T21:58:27.111702] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2024-12. [2025-09-26T21:58:27.429260] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-26T21:58:27.911721] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-08. [2025-09-26T21:58:28.716118] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-08. [2025-09-26T21:58:28.718740] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-26T21:58:29.335769] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-26T21:58:29.511732] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-07. [2025-09-26T21:58:29.951290] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-26T21:58:30.311713] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-09. [2025-09-26T21:58:31.102305] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-26T21:58:31.112450] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-01. [2025-09-26T21:58:31.114478] [INFO ] [REMOTE ] VLO: Full fetch complete (76934 records). [2025-09-26T21:58:31.114715] [DEBUG] [VALIDATOR ] VLO: Validating primary data. [2025-09-26T21:58:31.227374] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-26T21:58:31.630953] [DEBUG] [VALIDATOR ] VLO: All expected trading days are present. [2025-09-26T21:58:31.631061] [DEBUG] [VALIDATOR ] VLO: Primary data validation passed. [2025-09-26T21:58:31.632171] [INFO ] [MAIN ] VLO: Fetched primary data is valid. [2025-09-26T21:58:31.632242] [DEBUG] [LOCAL ] VLO: Saving primary data. [2025-09-26T21:58:31.633850] [DEBUG] [LOCAL ] VLO: Trimmed 76934 records to 53865 (keeping 200 days of data) [2025-09-26T21:58:31.943916] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-08. [2025-09-26T21:58:31.999773] [DEBUG] [LOCAL ] VLO: Primary data saved (53865 records). [2025-09-26T21:58:31.999942] [INFO ] [MAIN ] VLO: Full history saved. [2025-09-26T21:58:32.001331] [INFO ] [MAIN ] Update Progress: 2235/2371 symbols completed. VLO took 36.7s. Estimated remaining: 18m 10s. Rate: 7.5 symbols/min [2025-09-26T21:58:32.176076] [INFO ] [MAIN ] VMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:58:32.244776] [DEBUG] [LOCAL ] VMC: Loaded 43970 existing records from primary storage. [2025-09-26T21:58:32.244957] [INFO ] [MAIN ] VMC: Loaded 43970 existing records. [2025-09-26T21:58:32.431187] [WARN ] [MAIN ] VMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:58:32.431483] [INFO ] [MAIN ] VMC: Wiping existing primary data before full refresh. [2025-09-26T21:58:32.431541] [INFO ] [LOCAL ] VMC: Starting deletion of primary data. [2025-09-26T21:58:32.432629] [DEBUG] [LOCAL ] VMC: Deleted primary data file. [2025-09-26T21:58:32.432731] [INFO ] [MAIN ] VMC: Starting full primary refresh. [2025-09-26T21:58:32.716563] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-09. [2025-09-26T21:58:32.835677] [INFO ] [REMOTE ] VMC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:58:32.865065] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-26T21:58:33.316709] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-26T21:58:33.359608] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-26T21:58:33.361243] [INFO ] [REMOTE ] VLT: Full fetch complete (7507 records). [2025-09-26T21:58:33.361353] [DEBUG] [VALIDATOR ] VLT: Validating primary data. [2025-09-26T21:58:33.516805] [INFO ] [REMOTE ] VMC: Fetching primary data for 2024-12. [2025-09-26T21:58:33.755420] [DEBUG] [VALIDATOR ] VLT: All expected trading days are present. [2025-09-26T21:58:33.755523] [DEBUG] [VALIDATOR ] VLT: Primary data validation passed. [2025-09-26T21:58:33.755813] [INFO ] [MAIN ] VLT: Fetched primary data is valid. [2025-09-26T21:58:33.755895] [DEBUG] [LOCAL ] VLT: Saving primary data. [2025-09-26T21:58:33.756610] [DEBUG] [LOCAL ] VLT: Trimmed 7507 records to 4615 (keeping 200 days of data) [2025-09-26T21:58:33.791909] [DEBUG] [LOCAL ] VLT: Primary data saved (4615 records). [2025-09-26T21:58:33.792070] [INFO ] [MAIN ] VLT: Full history saved. [2025-09-26T21:58:33.792189] [INFO ] [MAIN ] Update Progress: 2236/2371 symbols completed. VLT took 24.2s. Estimated remaining: 18m 1s. Rate: 7.5 symbols/min [2025-09-26T21:58:33.981397] [INFO ] [MAIN ] VMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:58:34.000101] [DEBUG] [LOCAL ] VMI: Loaded 15578 existing records from primary storage. [2025-09-26T21:58:34.000269] [INFO ] [MAIN ] VMI: Loaded 15578 existing records. [2025-09-26T21:58:34.192470] [WARN ] [MAIN ] VMI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:58:34.192769] [INFO ] [MAIN ] VMI: Wiping existing primary data before full refresh. [2025-09-26T21:58:34.192827] [INFO ] [LOCAL ] VMI: Starting deletion of primary data. [2025-09-26T21:58:34.193393] [DEBUG] [LOCAL ] VMI: Deleted primary data file. [2025-09-26T21:58:34.193457] [INFO ] [MAIN ] VMI: Starting full primary refresh. [2025-09-26T21:58:34.316795] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-09. [2025-09-26T21:58:34.584890] [INFO ] [REMOTE ] VMI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:58:35.111711] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-02. [2025-09-26T21:58:35.186556] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-26T21:58:35.700205] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-26T21:58:35.707775] [INFO ] [REMOTE ] VLRS: Full fetch complete (58610 records). [2025-09-26T21:58:35.707927] [DEBUG] [VALIDATOR ] VLRS: Validating primary data. [2025-09-26T21:58:35.911929] [INFO ] [REMOTE ] VMI: Fetching primary data for 2024-12. [2025-09-26T21:58:36.138247] [DEBUG] [VALIDATOR ] VLRS: All expected trading days are present. [2025-09-26T21:58:36.138333] [DEBUG] [VALIDATOR ] VLRS: Primary data validation passed. [2025-09-26T21:58:36.139333] [INFO ] [MAIN ] VLRS: Fetched primary data is valid. [2025-09-26T21:58:36.139401] [DEBUG] [LOCAL ] VLRS: Saving primary data. [2025-09-26T21:58:36.140689] [DEBUG] [LOCAL ] VLRS: Trimmed 58610 records to 41188 (keeping 200 days of data) [2025-09-26T21:58:36.382724] [DEBUG] [LOCAL ] VLRS: Primary data saved (41188 records). [2025-09-26T21:58:36.382973] [INFO ] [MAIN ] VLRS: Full history saved. [2025-09-26T21:58:36.383118] [INFO ] [MAIN ] Update Progress: 2237/2371 symbols completed. VLRS took 34.1s. Estimated remaining: 17m 53s. Rate: 7.5 symbols/min [2025-09-26T21:58:36.476552] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-26T21:58:36.711724] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-03. [2025-09-26T21:58:36.786804] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-26T21:58:37.511728] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-01. [2025-09-26T21:58:38.171432] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-26T21:58:38.311735] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-01. [2025-09-26T21:58:39.094519] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-26T21:58:39.111680] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-02. [2025-09-26T21:58:39.294558] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-26T21:58:39.911721] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-04. [2025-09-26T21:58:40.711825] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-26T21:58:40.711947] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-02. [2025-09-26T21:58:41.431779] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T21:58:41.511703] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-05. [2025-09-26T21:58:41.614892] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-26T21:58:42.311721] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-03. [2025-09-26T21:58:43.111742] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-03. [2025-09-26T21:58:43.168506] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-26T21:58:43.354246] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-26T21:58:43.911731] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-04. [2025-09-26T21:58:44.711731] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-06. [2025-09-26T21:58:44.942346] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-26T21:58:44.989602] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-26T21:58:45.511743] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-04. [2025-09-26T21:58:46.016830] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-26T21:58:46.311739] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-05. [2025-09-26T21:58:47.111705] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-07. [2025-09-26T21:58:47.173851] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-26T21:58:47.384831] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-26T21:58:47.911719] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-06. [2025-09-26T21:58:48.536715] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-26T21:58:48.711693] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-05. [2025-09-26T21:58:48.958964] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-26T21:58:49.511727] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-08. [2025-09-26T21:58:50.311700] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-07. [2025-09-26T21:58:50.400089] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-26T21:58:50.767691] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-26T21:58:51.111719] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-09. [2025-09-26T21:58:51.355085] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-26T21:58:51.821280] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-26T21:58:51.830886] [INFO ] [REMOTE ] VLTO: Full fetch complete (66811 records). [2025-09-26T21:58:51.831055] [DEBUG] [VALIDATOR ] VLTO: Validating primary data. [2025-09-26T21:58:51.916917] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-06. [2025-09-26T21:58:52.242124] [DEBUG] [VALIDATOR ] VLTO: All expected trading days are present. [2025-09-26T21:58:52.242209] [DEBUG] [VALIDATOR ] VLTO: Primary data validation passed. [2025-09-26T21:58:52.243244] [INFO ] [MAIN ] VLTO: Fetched primary data is valid. [2025-09-26T21:58:52.243321] [DEBUG] [LOCAL ] VLTO: Saving primary data. [2025-09-26T21:58:52.244710] [DEBUG] [LOCAL ] VLTO: Trimmed 66811 records to 46710 (keeping 200 days of data) [2025-09-26T21:58:52.541235] [DEBUG] [LOCAL ] VLTO: Primary data saved (46710 records). [2025-09-26T21:58:52.541400] [INFO ] [MAIN ] VLTO: Full history saved. [2025-09-26T21:58:52.541521] [INFO ] [MAIN ] Update Progress: 2238/2371 symbols completed. VLTO took 29.8s. Estimated remaining: 17m 46s. Rate: 7.5 symbols/min [2025-09-26T21:58:52.711733] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-08. [2025-09-26T21:58:53.589626] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-26T21:58:53.599803] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-07. [2025-09-26T21:58:53.702970] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-26T21:58:54.311741] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-09. [2025-09-26T21:58:55.297613] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-26T21:58:55.307389] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-08. [2025-09-26T21:58:55.333310] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-26T21:58:55.336878] [INFO ] [REMOTE ] VMI: Full fetch complete (21236 records). [2025-09-26T21:58:55.336966] [DEBUG] [VALIDATOR ] VMI: Validating primary data. [2025-09-26T21:58:55.720527] [DEBUG] [VALIDATOR ] VMI: All expected trading days are present. [2025-09-26T21:58:55.720638] [DEBUG] [VALIDATOR ] VMI: Primary data validation passed. [2025-09-26T21:58:55.721223] [INFO ] [MAIN ] VMI: Fetched primary data is valid. [2025-09-26T21:58:55.721294] [DEBUG] [LOCAL ] VMI: Saving primary data. [2025-09-26T21:58:55.722075] [DEBUG] [LOCAL ] VMI: Trimmed 21236 records to 15711 (keeping 200 days of data) [2025-09-26T21:58:55.840382] [DEBUG] [LOCAL ] VMI: Primary data saved (15711 records). [2025-09-26T21:58:55.840562] [INFO ] [MAIN ] VMI: Full history saved. [2025-09-26T21:58:55.840696] [INFO ] [MAIN ] Update Progress: 2239/2371 symbols completed. VMI took 22.0s. Estimated remaining: 17m 37s. Rate: 7.5 symbols/min [2025-09-26T21:58:56.879448] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-26T21:58:56.889034] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-09. [2025-09-26T21:58:57.601000] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-26T21:58:57.609270] [INFO ] [REMOTE ] VMC: Full fetch complete (62602 records). [2025-09-26T21:58:57.609428] [DEBUG] [VALIDATOR ] VMC: Validating primary data. [2025-09-26T21:58:58.008326] [DEBUG] [VALIDATOR ] VMC: All expected trading days are present. [2025-09-26T21:58:58.008419] [DEBUG] [VALIDATOR ] VMC: Primary data validation passed. [2025-09-26T21:58:58.009553] [INFO ] [MAIN ] VMC: Fetched primary data is valid. [2025-09-26T21:58:58.009624] [DEBUG] [LOCAL ] VMC: Saving primary data. [2025-09-26T21:58:58.011123] [DEBUG] [LOCAL ] VMC: Trimmed 62602 records to 44263 (keeping 200 days of data) [2025-09-26T21:58:58.316262] [DEBUG] [LOCAL ] VMC: Primary data saved (44263 records). [2025-09-26T21:58:58.316545] [INFO ] [MAIN ] VMC: Full history saved. [2025-09-26T21:58:58.317768] [INFO ] [MAIN ] Update Progress: 2240/2371 symbols completed. VMC took 26.3s. Estimated remaining: 17m 29s. Rate: 7.5 symbols/min [2025-09-26T21:58:58.870136] [INFO ] [MAIN ] VNO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:58:58.947011] [INFO ] [MAIN ] VMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:58:59.090215] [INFO ] [MAIN ] VNCE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:58:59.086670] [INFO ] [MAIN ] VNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:58:59.113501] [DEBUG] [LOCAL ] VMO: Loaded 21177 existing records from primary storage. [2025-09-26T21:58:59.113923] [INFO ] [MAIN ] VMO: Loaded 21177 existing records. [2025-09-26T21:58:59.117569] [DEBUG] [LOCAL ] VNCE: Loaded 7418 existing records from primary storage. [2025-09-26T21:58:59.123335] [INFO ] [MAIN ] VNCE: Loaded 7418 existing records. [2025-09-26T21:58:59.411937] [DEBUG] [LOCAL ] VNO: Loaded 49325 existing records from primary storage. [2025-09-26T21:58:59.442315] [INFO ] [MAIN ] VNO: Loaded 49325 existing records. [2025-09-26T21:58:59.599798] [WARN ] [MAIN ] VMO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:58:59.600203] [WARN ] [MAIN ] VNCE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:58:59.608783] [INFO ] [MAIN ] VMO: Wiping existing primary data before full refresh. [2025-09-26T21:58:59.619336] [INFO ] [LOCAL ] VMO: Starting deletion of primary data. [2025-09-26T21:58:59.624917] [INFO ] [MAIN ] VNCE: Wiping existing primary data before full refresh. [2025-09-26T21:58:59.636146] [DEBUG] [LOCAL ] VMO: Deleted primary data file. [2025-09-26T21:58:59.636425] [INFO ] [MAIN ] VMO: Starting full primary refresh. [2025-09-26T21:58:59.636044] [INFO ] [LOCAL ] VNCE: Starting deletion of primary data. [2025-09-26T21:58:59.683742] [DEBUG] [LOCAL ] VNT: Loaded 44172 existing records from primary storage. [2025-09-26T21:58:59.725211] [DEBUG] [LOCAL ] VNCE: Deleted primary data file. [2025-09-26T21:58:59.745467] [INFO ] [MAIN ] VNT: Loaded 44172 existing records. [2025-09-26T21:58:59.740257] [INFO ] [MAIN ] VNCE: Starting full primary refresh. [2025-09-26T21:59:00.294522] [WARN ] [MAIN ] VNO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:59:00.402473] [INFO ] [MAIN ] VNO: Wiping existing primary data before full refresh. [2025-09-26T21:59:00.449861] [INFO ] [LOCAL ] VNO: Starting deletion of primary data. [2025-09-26T21:59:00.467005] [WARN ] [MAIN ] VNT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:59:00.526248] [DEBUG] [LOCAL ] VNO: Deleted primary data file. [2025-09-26T21:59:00.552924] [INFO ] [MAIN ] VNT: Wiping existing primary data before full refresh. [2025-09-26T21:59:00.587042] [INFO ] [LOCAL ] VNT: Starting deletion of primary data. [2025-09-26T21:59:00.576621] [INFO ] [MAIN ] VNO: Starting full primary refresh. [2025-09-26T21:59:00.665910] [DEBUG] [LOCAL ] VNT: Deleted primary data file. [2025-09-26T21:59:00.696163] [INFO ] [MAIN ] VNT: Starting full primary refresh. [2025-09-26T21:59:01.050763] [INFO ] [REMOTE ] VMO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:59:00.994868] [INFO ] [REMOTE ] VNCE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:59:01.125257] [INFO ] [REMOTE ] VMO: Fetching primary data for 2024-12. [2025-09-26T21:59:01.144327] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2024-12. [2025-09-26T21:59:01.640972] [INFO ] [REMOTE ] VNO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:59:01.646736] [INFO ] [REMOTE ] VNO: Fetching primary data for 2024-12. [2025-09-26T21:59:01.720136] [INFO ] [REMOTE ] VNT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:59:01.720518] [INFO ] [REMOTE ] VNT: Fetching primary data for 2024-12. [2025-09-26T21:59:02.377309] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-26T21:59:02.381541] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-01. [2025-09-26T21:59:02.453708] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-26T21:59:02.459244] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-01. [2025-09-26T21:59:02.795940] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-26T21:59:02.804272] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-01. [2025-09-26T21:59:03.068811] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-26T21:59:03.078579] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-01. [2025-09-26T21:59:03.118062] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-26T21:59:03.122555] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-02. [2025-09-26T21:59:03.397510] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-26T21:59:03.911769] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-02. [2025-09-26T21:59:04.173324] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-26T21:59:04.409523] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-26T21:59:04.443528] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-26T21:59:04.711733] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-02. [2025-09-26T21:59:04.789394] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-26T21:59:05.511758] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-02. [2025-09-26T21:59:06.312827] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-26T21:59:06.311709] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-03. [2025-09-26T21:59:07.111704] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-03. [2025-09-26T21:59:07.181227] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-26T21:59:07.429192] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-26T21:59:07.733011] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-26T21:59:07.911765] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-03. [2025-09-26T21:59:08.711798] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-04. [2025-09-26T21:59:09.510983] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-26T21:59:09.520879] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-03. [2025-09-26T21:59:09.887573] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-26T21:59:10.311767] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-05. [2025-09-26T21:59:11.111733] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-04. [2025-09-26T21:59:11.209727] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-26T21:59:11.304908] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-26T21:59:11.494088] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-26T21:59:11.911750] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-04. [2025-09-26T21:59:12.711755] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-06. [2025-09-26T21:59:13.511714] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-04. [2025-09-26T21:59:13.837123] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-26T21:59:14.007952] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-26T21:59:14.311761] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-05. [2025-09-26T21:59:15.111712] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-07. [2025-09-26T21:59:15.241310] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-26T21:59:15.239435] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-26T21:59:15.911730] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-05. [2025-09-26T21:59:16.186905] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-26T21:59:16.711749] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-05. [2025-09-26T21:59:17.511768] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-08. [2025-09-26T21:59:17.655103] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-26T21:59:18.289408] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-26T21:59:18.311670] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-06. [2025-09-26T21:59:18.544908] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-26T21:59:18.976165] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-26T21:59:19.111740] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-06. [2025-09-26T21:59:19.911772] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-07. [2025-09-26T21:59:20.592507] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-26T21:59:20.670451] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-26T21:59:20.711689] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-07. [2025-09-26T21:59:21.511775] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-08. [2025-09-26T21:59:22.007879] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-26T21:59:22.311697] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-06. [2025-09-26T21:59:22.363763] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-26T21:59:23.111769] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-09. [2025-09-26T21:59:23.903578] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-26T21:59:23.912931] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-08. [2025-09-26T21:59:24.344670] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-26T21:59:24.350454] [INFO ] [REMOTE ] VMO: Full fetch complete (31476 records). [2025-09-26T21:59:24.350563] [DEBUG] [VALIDATOR ] VMO: Validating primary data. [2025-09-26T21:59:24.716884] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-07. [2025-09-26T21:59:24.762571] [DEBUG] [VALIDATOR ] VMO: All expected trading days are present. [2025-09-26T21:59:24.762734] [DEBUG] [VALIDATOR ] VMO: Primary data validation passed. [2025-09-26T21:59:24.763716] [INFO ] [MAIN ] VMO: Fetched primary data is valid. [2025-09-26T21:59:24.763820] [DEBUG] [LOCAL ] VMO: Saving primary data. [2025-09-26T21:59:24.766067] [DEBUG] [LOCAL ] VMO: Trimmed 31476 records to 21297 (keeping 200 days of data) [2025-09-26T21:59:24.909520] [DEBUG] [LOCAL ] VMO: Primary data saved (21297 records). [2025-09-26T21:59:24.909820] [INFO ] [MAIN ] VMO: Full history saved. [2025-09-26T21:59:24.910074] [INFO ] [MAIN ] Update Progress: 2241/2371 symbols completed. VMO took 26.6s. Estimated remaining: 17m 22s. Rate: 7.5 symbols/min [2025-09-26T21:59:25.151960] [INFO ] [MAIN ] VOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:59:25.167982] [DEBUG] [LOCAL ] VOC: Loaded 8970 existing records from primary storage. [2025-09-26T21:59:25.168132] [INFO ] [MAIN ] VOC: Loaded 8970 existing records. [2025-09-26T21:59:25.359835] [WARN ] [MAIN ] VOC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:59:25.360721] [INFO ] [MAIN ] VOC: Wiping existing primary data before full refresh. [2025-09-26T21:59:25.360860] [INFO ] [LOCAL ] VOC: Starting deletion of primary data. [2025-09-26T21:59:25.361404] [DEBUG] [LOCAL ] VOC: Deleted primary data file. [2025-09-26T21:59:25.361593] [INFO ] [MAIN ] VOC: Starting full primary refresh. [2025-09-26T21:59:25.519546] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-09. [2025-09-26T21:59:25.706136] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-26T21:59:25.795703] [INFO ] [REMOTE ] VOC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:59:26.311743] [INFO ] [REMOTE ] VOC: Fetching primary data for 2024-12. [2025-09-26T21:59:26.511222] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-26T21:59:26.903331] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-26T21:59:26.909196] [INFO ] [REMOTE ] VNCE: Full fetch complete (15533 records). [2025-09-26T21:59:26.909276] [DEBUG] [VALIDATOR ] VNCE: Validating primary data. [2025-09-26T21:59:27.115323] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-26T21:59:27.114741] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-08. [2025-09-26T21:59:27.313957] [DEBUG] [VALIDATOR ] VNCE: All expected trading days are present. [2025-09-26T21:59:27.314049] [DEBUG] [VALIDATOR ] VNCE: Primary data validation passed. [2025-09-26T21:59:27.314515] [INFO ] [MAIN ] VNCE: Fetched primary data is valid. [2025-09-26T21:59:27.314559] [DEBUG] [LOCAL ] VNCE: Saving primary data. [2025-09-26T21:59:27.315728] [DEBUG] [LOCAL ] VNCE: Trimmed 15533 records to 7593 (keeping 200 days of data) [2025-09-26T21:59:27.366676] [DEBUG] [LOCAL ] VNCE: Primary data saved (7593 records). [2025-09-26T21:59:27.366836] [INFO ] [MAIN ] VNCE: Full history saved. [2025-09-26T21:59:27.367009] [INFO ] [MAIN ] Update Progress: 2242/2371 symbols completed. VNCE took 29.0s. Estimated remaining: 17m 14s. Rate: 7.5 symbols/min [2025-09-26T21:59:27.551621] [INFO ] [MAIN ] VOYA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:59:27.608771] [DEBUG] [LOCAL ] VOYA: Loaded 43089 existing records from primary storage. [2025-09-26T21:59:27.608952] [INFO ] [MAIN ] VOYA: Loaded 43089 existing records. [2025-09-26T21:59:27.802763] [WARN ] [MAIN ] VOYA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:59:27.803110] [INFO ] [MAIN ] VOYA: Wiping existing primary data before full refresh. [2025-09-26T21:59:27.803190] [INFO ] [LOCAL ] VOYA: Starting deletion of primary data. [2025-09-26T21:59:27.805100] [DEBUG] [LOCAL ] VOYA: Deleted primary data file. [2025-09-26T21:59:27.805168] [INFO ] [MAIN ] VOYA: Starting full primary refresh. [2025-09-26T21:59:27.917125] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-09. [2025-09-26T21:59:28.188258] [INFO ] [REMOTE ] VOYA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:59:28.711763] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-01. [2025-09-26T21:59:28.823225] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-26T21:59:29.492179] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-26T21:59:29.500902] [INFO ] [REMOTE ] VNT: Full fetch complete (63488 records). [2025-09-26T21:59:29.501079] [DEBUG] [VALIDATOR ] VNT: Validating primary data. [2025-09-26T21:59:29.516952] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2024-12. [2025-09-26T21:59:29.628911] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-26T21:59:29.944720] [DEBUG] [VALIDATOR ] VNT: All expected trading days are present. [2025-09-26T21:59:29.944873] [DEBUG] [VALIDATOR ] VNT: Primary data validation passed. [2025-09-26T21:59:29.946773] [INFO ] [MAIN ] VNT: Fetched primary data is valid. [2025-09-26T21:59:29.946847] [DEBUG] [LOCAL ] VNT: Saving primary data. [2025-09-26T21:59:29.949000] [DEBUG] [LOCAL ] VNT: Trimmed 63488 records to 44451 (keeping 200 days of data) [2025-09-26T21:59:30.254272] [DEBUG] [LOCAL ] VNT: Primary data saved (44451 records). [2025-09-26T21:59:30.254540] [INFO ] [MAIN ] VNT: Full history saved. [2025-09-26T21:59:30.254769] [INFO ] [MAIN ] Update Progress: 2243/2371 symbols completed. VNT took 31.9s. Estimated remaining: 17m 5s. Rate: 7.5 symbols/min [2025-09-26T21:59:30.318712] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-09. [2025-09-26T21:59:30.448565] [INFO ] [MAIN ] VOYG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:59:30.448849] [DEBUG] [LOCAL ] VOYG: No existing data file found in primary storage. [2025-09-26T21:59:30.448899] [WARN ] [MAIN ] VOYG: No existing data found, performing full refresh instead. [2025-09-26T21:59:30.449060] [INFO ] [MAIN ] VOYG: Wiping existing primary data before full refresh. [2025-09-26T21:59:30.449107] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-09-26T21:59:30.449163] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-09-26T21:59:30.449281] [INFO ] [MAIN ] VOYG: Starting full primary refresh. [2025-09-26T21:59:30.835199] [INFO ] [REMOTE ] VOYG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:59:31.111789] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-02. [2025-09-26T21:59:31.208842] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-26T21:59:31.911819] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2024-12. [2025-09-26T21:59:31.913059] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-26T21:59:32.126992] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:59:32.129316] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-26T21:59:32.129406] [WARN ] [REMOTE ] VOYG: No data returned for month 2024-12 [2025-09-26T21:59:32.141725] [INFO ] [REMOTE ] VNO: Full fetch complete (70487 records). [2025-09-26T21:59:32.141931] [DEBUG] [VALIDATOR ] VNO: Validating primary data. [2025-09-26T21:59:32.574289] [DEBUG] [VALIDATOR ] VNO: All expected trading days are present. [2025-09-26T21:59:32.574400] [DEBUG] [VALIDATOR ] VNO: Primary data validation passed. [2025-09-26T21:59:32.575942] [INFO ] [MAIN ] VNO: Fetched primary data is valid. [2025-09-26T21:59:32.576012] [DEBUG] [LOCAL ] VNO: Saving primary data. [2025-09-26T21:59:32.580764] [DEBUG] [LOCAL ] VNO: Trimmed 70487 records to 49668 (keeping 200 days of data) [2025-09-26T21:59:32.711953] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-01. [2025-09-26T21:59:32.905804] [DEBUG] [LOCAL ] VNO: Primary data saved (49668 records). [2025-09-26T21:59:32.906036] [INFO ] [MAIN ] VNO: Full history saved. [2025-09-26T21:59:32.906197] [INFO ] [MAIN ] Update Progress: 2244/2371 symbols completed. VNO took 34.6s. Estimated remaining: 16m 57s. Rate: 7.5 symbols/min [2025-09-26T21:59:33.011542] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:59:33.015020] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-01 [2025-09-26T21:59:33.085752] [INFO ] [MAIN ] VPG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:59:33.108089] [DEBUG] [LOCAL ] VPG: Loaded 17301 existing records from primary storage. [2025-09-26T21:59:33.108292] [INFO ] [MAIN ] VPG: Loaded 17301 existing records. [2025-09-26T21:59:33.290205] [WARN ] [MAIN ] VPG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:59:33.290573] [INFO ] [MAIN ] VPG: Wiping existing primary data before full refresh. [2025-09-26T21:59:33.290638] [INFO ] [LOCAL ] VPG: Starting deletion of primary data. [2025-09-26T21:59:33.291278] [DEBUG] [LOCAL ] VPG: Deleted primary data file. [2025-09-26T21:59:33.291350] [INFO ] [MAIN ] VPG: Starting full primary refresh. [2025-09-26T21:59:33.516973] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-02. [2025-09-26T21:59:33.664820] [INFO ] [REMOTE ] VPG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:59:33.950503] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:59:33.951000] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-02 [2025-09-26T21:59:34.311744] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-03. [2025-09-26T21:59:34.988841] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-26T21:59:35.111818] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-04. [2025-09-26T21:59:35.911753] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-03. [2025-09-26T21:59:36.023328] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-26T21:59:36.350325] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:59:36.350801] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-03 [2025-09-26T21:59:36.711738] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-04. [2025-09-26T21:59:36.924953] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:59:36.925444] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-04 [2025-09-26T21:59:37.511776] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-01. [2025-09-26T21:59:38.311753] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-05. [2025-09-26T21:59:38.680465] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T21:59:38.680941] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-05 [2025-09-26T21:59:38.993546] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-26T21:59:39.111759] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-05. [2025-09-26T21:59:39.882317] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-26T21:59:39.911776] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-06. [2025-09-26T21:59:40.711779] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-02. [2025-09-26T21:59:41.483246] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-26T21:59:41.511705] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-07. [2025-09-26T21:59:41.829942] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-26T21:59:42.311786] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-03. [2025-09-26T21:59:43.111716] [INFO ] [REMOTE ] VPG: Fetching primary data for 2024-12. [2025-09-26T21:59:43.390796] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-26T21:59:43.911715] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-08. [2025-09-26T21:59:43.966583] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-26T21:59:44.150101] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-26T21:59:44.711758] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-06. [2025-09-26T21:59:45.508238] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-26T21:59:45.510306] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-26T21:59:45.513017] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-04. [2025-09-26T21:59:46.311769] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-07. [2025-09-26T21:59:47.111718] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-01. [2025-09-26T21:59:47.150540] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-26T21:59:47.246118] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-26T21:59:47.906124] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-26T21:59:47.911671] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-02. [2025-09-26T21:59:48.711700] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-09. [2025-09-26T21:59:48.774808] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-26T21:59:49.511748] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-03. [2025-09-26T21:59:50.223886] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-26T21:59:50.232414] [INFO ] [REMOTE ] VOYG: Full fetch complete (24696 records). [2025-09-26T21:59:50.232547] [DEBUG] [VALIDATOR ] VOYG: Validating primary data. [2025-09-26T21:59:50.316350] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-05. [2025-09-26T21:59:50.428616] [WARN ] [VALIDATOR ] VOYG: Validation failed - insufficient historical data. Have 75 unique days, need 200 days [2025-09-26T21:59:50.429253] [FATAL] [MAIN ] VOYG: Fetched primary data is invalid. Refusing to save it. [2025-09-26T21:59:50.429407] [WARN ] [MAIN ] VOYG: Deleting existing primary and derivative data due to validation failure. [2025-09-26T21:59:50.429568] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-09-26T21:59:50.429870] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-09-26T21:59:50.429947] [INFO ] [LOCAL ] VOYG: Starting deletion of derivative data. [2025-09-26T21:59:50.430020] [DEBUG] [LOCAL ] VOYG: No derivative data file found to delete. [2025-09-26T21:59:50.430115] [INFO ] [MAIN ] Update Progress: 2245/2371 symbols completed. VOYG took 20.2s. Estimated remaining: 16m 50s. Rate: 7.5 symbols/min [2025-09-26T21:59:50.546880] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-26T21:59:50.623163] [INFO ] [MAIN ] VPV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T21:59:50.631271] [DEBUG] [LOCAL ] VPV: Loaded 5389 existing records from primary storage. [2025-09-26T21:59:50.631410] [INFO ] [MAIN ] VPV: Loaded 5389 existing records. [2025-09-26T21:59:50.819981] [WARN ] [MAIN ] VPV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T21:59:50.820266] [INFO ] [MAIN ] VPV: Wiping existing primary data before full refresh. [2025-09-26T21:59:50.820317] [INFO ] [LOCAL ] VPV: Starting deletion of primary data. [2025-09-26T21:59:50.820711] [DEBUG] [LOCAL ] VPV: Deleted primary data file. [2025-09-26T21:59:50.820772] [INFO ] [MAIN ] VPV: Starting full primary refresh. [2025-09-26T21:59:51.111775] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-04. [2025-09-26T21:59:51.195917] [INFO ] [REMOTE ] VPV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T21:59:51.911758] [INFO ] [REMOTE ] VPV: Fetching primary data for 2024-12. [2025-09-26T21:59:51.967609] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-26T21:59:52.217047] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-26T21:59:52.484720] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-26T21:59:52.711736] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-05. [2025-09-26T21:59:53.511722] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-06. [2025-09-26T21:59:53.775200] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-26T21:59:54.311760] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-08. [2025-09-26T21:59:54.791903] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-26T21:59:54.812622] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-26T21:59:55.111735] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-06. [2025-09-26T21:59:55.911730] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-07. [2025-09-26T21:59:56.373632] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-26T21:59:56.711731] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-01. [2025-09-26T21:59:57.422600] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-26T21:59:57.481890] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-26T21:59:57.511731] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-02. [2025-09-26T21:59:58.270323] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-26T21:59:58.311706] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-03. [2025-09-26T21:59:58.927664] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-26T21:59:59.111759] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-07. [2025-09-26T21:59:59.911711] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-04. [2025-09-26T22:00:00.071976] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-26T22:00:00.674491] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-26T22:00:00.711696] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-05. [2025-09-26T22:00:01.486620] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-26T22:00:01.511756] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-09. [2025-09-26T22:00:02.221735] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-26T22:00:02.224869] [INFO ] [REMOTE ] VOC: Full fetch complete (13149 records). [2025-09-26T22:00:02.224976] [DEBUG] [VALIDATOR ] VOC: Validating primary data. [2025-09-26T22:00:02.316933] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-08. [2025-09-26T22:00:02.683733] [DEBUG] [VALIDATOR ] VOC: All expected trading days are present. [2025-09-26T22:00:02.683835] [DEBUG] [VALIDATOR ] VOC: Primary data validation passed. [2025-09-26T22:00:02.684292] [INFO ] [MAIN ] VOC: Fetched primary data is valid. [2025-09-26T22:00:02.684341] [DEBUG] [LOCAL ] VOC: Saving primary data. [2025-09-26T22:00:02.685071] [DEBUG] [LOCAL ] VOC: Trimmed 13149 records to 9021 (keeping 200 days of data) [2025-09-26T22:00:02.753676] [DEBUG] [LOCAL ] VOC: Primary data saved (9021 records). [2025-09-26T22:00:02.753915] [INFO ] [MAIN ] VOC: Full history saved. [2025-09-26T22:00:02.754163] [INFO ] [MAIN ] Update Progress: 2246/2371 symbols completed. VOC took 37.8s. Estimated remaining: 16m 42s. Rate: 7.5 symbols/min [2025-09-26T22:00:02.983056] [INFO ] [MAIN ] VRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:00:03.029086] [DEBUG] [LOCAL ] VRE: Loaded 35057 existing records from primary storage. [2025-09-26T22:00:03.029287] [INFO ] [MAIN ] VRE: Loaded 35057 existing records. [2025-09-26T22:00:03.115078] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-08. [2025-09-26T22:00:03.294003] [WARN ] [MAIN ] VRE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:00:03.294457] [INFO ] [MAIN ] VRE: Wiping existing primary data before full refresh. [2025-09-26T22:00:03.294701] [INFO ] [LOCAL ] VRE: Starting deletion of primary data. [2025-09-26T22:00:03.295984] [DEBUG] [LOCAL ] VRE: Deleted primary data file. [2025-09-26T22:00:03.296072] [INFO ] [MAIN ] VRE: Starting full primary refresh. [2025-09-26T22:00:03.460474] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-26T22:00:03.872818] [INFO ] [REMOTE ] VRE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:00:03.911748] [INFO ] [REMOTE ] VRE: Fetching primary data for 2024-12. [2025-09-26T22:00:04.711745] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-09. [2025-09-26T22:00:04.751847] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-26T22:00:05.311961] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T22:00:05.511741] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-01. [2025-09-26T22:00:05.721126] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-26T22:00:05.724358] [INFO ] [REMOTE ] VPG: Full fetch complete (22963 records). [2025-09-26T22:00:05.724448] [DEBUG] [VALIDATOR ] VPG: Validating primary data. [2025-09-26T22:00:06.120256] [DEBUG] [VALIDATOR ] VPG: All expected trading days are present. [2025-09-26T22:00:06.120378] [DEBUG] [VALIDATOR ] VPG: Primary data validation passed. [2025-09-26T22:00:06.120925] [INFO ] [MAIN ] VPG: Fetched primary data is valid. [2025-09-26T22:00:06.120990] [DEBUG] [LOCAL ] VPG: Saving primary data. [2025-09-26T22:00:06.121772] [DEBUG] [LOCAL ] VPG: Trimmed 22963 records to 17373 (keeping 200 days of data) [2025-09-26T22:00:06.225326] [DEBUG] [LOCAL ] VPG: Primary data saved (17373 records). [2025-09-26T22:00:06.225476] [INFO ] [MAIN ] VPG: Full history saved. [2025-09-26T22:00:06.225565] [INFO ] [MAIN ] Update Progress: 2247/2371 symbols completed. VPG took 33.3s. Estimated remaining: 16m 33s. Rate: 7.5 symbols/min [2025-09-26T22:00:06.319764] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-09. [2025-09-26T22:00:06.422120] [INFO ] [MAIN ] VRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:00:06.498838] [DEBUG] [LOCAL ] VRT: Loaded 54143 existing records from primary storage. [2025-09-26T22:00:06.499010] [INFO ] [MAIN ] VRT: Loaded 54143 existing records. [2025-09-26T22:00:06.723306] [WARN ] [MAIN ] VRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:00:06.723694] [INFO ] [MAIN ] VRT: Wiping existing primary data before full refresh. [2025-09-26T22:00:06.723754] [INFO ] [LOCAL ] VRT: Starting deletion of primary data. [2025-09-26T22:00:06.725130] [DEBUG] [LOCAL ] VRT: Deleted primary data file. [2025-09-26T22:00:06.725192] [INFO ] [MAIN ] VRT: Starting full primary refresh. [2025-09-26T22:00:06.983956] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-26T22:00:07.116906] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-02. [2025-09-26T22:00:07.152899] [INFO ] [REMOTE ] VRT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:00:07.918303] [INFO ] [REMOTE ] VRT: Fetching primary data for 2024-12. [2025-09-26T22:00:07.923142] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-26T22:00:07.933611] [INFO ] [REMOTE ] VOYA: Full fetch complete (62101 records). [2025-09-26T22:00:07.933826] [DEBUG] [VALIDATOR ] VOYA: Validating primary data. [2025-09-26T22:00:08.369461] [DEBUG] [VALIDATOR ] VOYA: All expected trading days are present. [2025-09-26T22:00:08.369581] [DEBUG] [VALIDATOR ] VOYA: Primary data validation passed. [2025-09-26T22:00:08.370833] [INFO ] [MAIN ] VOYA: Fetched primary data is valid. [2025-09-26T22:00:08.370957] [DEBUG] [LOCAL ] VOYA: Saving primary data. [2025-09-26T22:00:08.388957] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-26T22:00:08.394860] [DEBUG] [LOCAL ] VOYA: Trimmed 62101 records to 43377 (keeping 200 days of data) [2025-09-26T22:00:08.690348] [DEBUG] [LOCAL ] VOYA: Primary data saved (43377 records). [2025-09-26T22:00:08.690510] [INFO ] [MAIN ] VOYA: Full history saved. [2025-09-26T22:00:08.690667] [INFO ] [MAIN ] Update Progress: 2248/2371 symbols completed. VOYA took 41.3s. Estimated remaining: 16m 25s. Rate: 7.5 symbols/min [2025-09-26T22:00:08.716938] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-03. [2025-09-26T22:00:08.887116] [INFO ] [MAIN ] VRTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:00:08.898502] [DEBUG] [LOCAL ] VRTS: Loaded 9214 existing records from primary storage. [2025-09-26T22:00:08.898714] [INFO ] [MAIN ] VRTS: Loaded 9214 existing records. [2025-09-26T22:00:09.105884] [WARN ] [MAIN ] VRTS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:00:09.106151] [INFO ] [MAIN ] VRTS: Wiping existing primary data before full refresh. [2025-09-26T22:00:09.106201] [INFO ] [LOCAL ] VRTS: Starting deletion of primary data. [2025-09-26T22:00:09.106684] [DEBUG] [LOCAL ] VRTS: Deleted primary data file. [2025-09-26T22:00:09.106776] [INFO ] [MAIN ] VRTS: Starting full primary refresh. [2025-09-26T22:00:09.487609] [INFO ] [REMOTE ] VRTS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:00:09.511682] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2024-12. [2025-09-26T22:00:10.175778] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-26T22:00:10.205214] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-26T22:00:10.311704] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-01. [2025-09-26T22:00:10.454799] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2024-12 (2.54 seconds). [2025-09-26T22:00:11.073196] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-26T22:00:11.111705] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-02. [2025-09-26T22:00:11.755303] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-26T22:00:11.911758] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-03. [2025-09-26T22:00:12.640362] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-26T22:00:12.711786] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-04. [2025-09-26T22:00:13.511739] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-04. [2025-09-26T22:00:14.227694] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T22:00:14.286108] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-26T22:00:14.311735] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-05. [2025-09-26T22:00:15.111755] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-05. [2025-09-26T22:00:15.697611] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-26T22:00:15.864182] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-26T22:00:15.911798] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-06. [2025-09-26T22:00:16.497772] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-26T22:00:16.711751] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-06. [2025-09-26T22:00:17.511771] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-01. [2025-09-26T22:00:17.759896] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-26T22:00:18.311769] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-06. [2025-09-26T22:00:19.111760] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-07. [2025-09-26T22:00:19.752810] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-26T22:00:19.780778] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-26T22:00:19.911725] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-08. [2025-09-26T22:00:20.065521] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-01 (2.55 seconds). [2025-09-26T22:00:20.294047] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-26T22:00:20.711775] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-07. [2025-09-26T22:00:21.285993] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-26T22:00:21.511798] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-08. [2025-09-26T22:00:22.288544] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-26T22:00:22.311735] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-09. [2025-09-26T22:00:23.111733] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-09. [2025-09-26T22:00:23.145717] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-26T22:00:23.147827] [INFO ] [REMOTE ] VRTS: Full fetch complete (11344 records). [2025-09-26T22:00:23.147902] [DEBUG] [VALIDATOR ] VRTS: Validating primary data. [2025-09-26T22:00:23.575995] [DEBUG] [VALIDATOR ] VRTS: All expected trading days are present. [2025-09-26T22:00:23.576122] [DEBUG] [VALIDATOR ] VRTS: Primary data validation passed. [2025-09-26T22:00:23.576606] [INFO ] [MAIN ] VRTS: Fetched primary data is valid. [2025-09-26T22:00:23.576721] [DEBUG] [LOCAL ] VRTS: Saving primary data. [2025-09-26T22:00:23.577275] [DEBUG] [LOCAL ] VRTS: Trimmed 11344 records to 9287 (keeping 200 days of data) [2025-09-26T22:00:23.640151] [DEBUG] [LOCAL ] VRTS: Primary data saved (9287 records). [2025-09-26T22:00:23.640312] [INFO ] [MAIN ] VRTS: Full history saved. [2025-09-26T22:00:23.640407] [INFO ] [MAIN ] Update Progress: 2249/2371 symbols completed. VRTS took 14.9s. Estimated remaining: 16m 18s. Rate: 7.5 symbols/min [2025-09-26T22:00:23.779703] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-26T22:00:23.828951] [INFO ] [REMOTE ] VPV: Full fetch complete (9338 records). [2025-09-26T22:00:23.830525] [DEBUG] [VALIDATOR ] VPV: Validating primary data. [2025-09-26T22:00:23.890129] [INFO ] [MAIN ] VSCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:00:23.916876] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-07. [2025-09-26T22:00:24.315834] [DEBUG] [VALIDATOR ] VPV: All expected trading days are present. [2025-09-26T22:00:24.304516] [DEBUG] [LOCAL ] VSCO: Loaded 53190 existing records from primary storage. [2025-09-26T22:00:24.316201] [INFO ] [MAIN ] VSCO: Loaded 53190 existing records. [2025-09-26T22:00:24.316080] [DEBUG] [VALIDATOR ] VPV: Primary data validation passed. [2025-09-26T22:00:24.321844] [INFO ] [MAIN ] VPV: Fetched primary data is valid. [2025-09-26T22:00:24.365492] [DEBUG] [LOCAL ] VPV: Saving primary data. [2025-09-26T22:00:24.409877] [DEBUG] [LOCAL ] VPV: Trimmed 9338 records to 5429 (keeping 200 days of data) [2025-09-26T22:00:24.562892] [WARN ] [MAIN ] VSCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:00:24.567126] [DEBUG] [LOCAL ] VPV: Primary data saved (5429 records). [2025-09-26T22:00:24.565212] [INFO ] [MAIN ] VSCO: Wiping existing primary data before full refresh. [2025-09-26T22:00:24.567307] [INFO ] [MAIN ] VPV: Full history saved. [2025-09-26T22:00:24.567407] [INFO ] [LOCAL ] VSCO: Starting deletion of primary data. [2025-09-26T22:00:24.567688] [INFO ] [MAIN ] Update Progress: 2250/2371 symbols completed. VPV took 34.1s. Estimated remaining: 16m 9s. Rate: 7.5 symbols/min [2025-09-26T22:00:24.574019] [DEBUG] [LOCAL ] VSCO: Deleted primary data file. [2025-09-26T22:00:24.633639] [INFO ] [MAIN ] VSCO: Starting full primary refresh. [2025-09-26T22:00:24.718347] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-02. [2025-09-26T22:00:24.886669] [INFO ] [MAIN ] VSH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:00:25.172680] [INFO ] [REMOTE ] VSCO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:00:25.195590] [DEBUG] [LOCAL ] VSH: Loaded 48887 existing records from primary storage. [2025-09-26T22:00:25.195824] [INFO ] [MAIN ] VSH: Loaded 48887 existing records. [2025-09-26T22:00:25.395631] [WARN ] [MAIN ] VSH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:00:25.396157] [INFO ] [MAIN ] VSH: Wiping existing primary data before full refresh. [2025-09-26T22:00:25.396307] [INFO ] [LOCAL ] VSH: Starting deletion of primary data. [2025-09-26T22:00:25.397570] [DEBUG] [LOCAL ] VSH: Deleted primary data file. [2025-09-26T22:00:25.397637] [INFO ] [MAIN ] VSH: Starting full primary refresh. [2025-09-26T22:00:25.528387] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2024-12. [2025-09-26T22:00:25.575589] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-26T22:00:25.824150] [INFO ] [REMOTE ] VSH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:00:26.311746] [INFO ] [REMOTE ] VSH: Fetching primary data for 2024-12. [2025-09-26T22:00:27.111691] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-08. [2025-09-26T22:00:27.288167] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-02 (2.57 seconds). [2025-09-26T22:00:27.492352] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-26T22:00:27.911726] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-01. [2025-09-26T22:00:28.093961] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-26T22:00:28.132914] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-26T22:00:28.711743] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-09. [2025-09-26T22:00:29.404323] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-26T22:00:29.511708] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-03. [2025-09-26T22:00:30.188844] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-26T22:00:30.197497] [INFO ] [REMOTE ] VRE: Full fetch complete (47856 records). [2025-09-26T22:00:30.197703] [DEBUG] [VALIDATOR ] VRE: Validating primary data. [2025-09-26T22:00:30.317442] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-02. [2025-09-26T22:00:30.621816] [DEBUG] [VALIDATOR ] VRE: All expected trading days are present. [2025-09-26T22:00:30.621924] [DEBUG] [VALIDATOR ] VRE: Primary data validation passed. [2025-09-26T22:00:30.622978] [INFO ] [MAIN ] VRE: Fetched primary data is valid. [2025-09-26T22:00:30.623049] [DEBUG] [LOCAL ] VRE: Saving primary data. [2025-09-26T22:00:30.624721] [DEBUG] [LOCAL ] VRE: Trimmed 47856 records to 35345 (keeping 200 days of data) [2025-09-26T22:00:30.849605] [DEBUG] [LOCAL ] VRE: Primary data saved (35345 records). [2025-09-26T22:00:30.849811] [INFO ] [MAIN ] VRE: Full history saved. [2025-09-26T22:00:30.849957] [INFO ] [MAIN ] Update Progress: 2251/2371 symbols completed. VRE took 28.1s. Estimated remaining: 16m 1s. Rate: 7.5 symbols/min [2025-09-26T22:00:31.042167] [INFO ] [MAIN ] VST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:00:31.102660] [DEBUG] [LOCAL ] VST: Loaded 54110 existing records from primary storage. [2025-09-26T22:00:31.102850] [INFO ] [MAIN ] VST: Loaded 54110 existing records. [2025-09-26T22:00:31.136263] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-01. [2025-09-26T22:00:31.302063] [WARN ] [MAIN ] VST: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:00:31.302349] [INFO ] [MAIN ] VST: Wiping existing primary data before full refresh. [2025-09-26T22:00:31.302414] [INFO ] [LOCAL ] VST: Starting deletion of primary data. [2025-09-26T22:00:31.303741] [DEBUG] [LOCAL ] VST: Deleted primary data file. [2025-09-26T22:00:31.303809] [INFO ] [MAIN ] VST: Starting full primary refresh. [2025-09-26T22:00:31.716192] [INFO ] [REMOTE ] VST: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:00:31.911731] [INFO ] [REMOTE ] VST: Fetching primary data for 2024-12. [2025-09-26T22:00:32.022332] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-26T22:00:32.134967] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-09-26T22:00:32.711791] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-04. [2025-09-26T22:00:32.904569] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-26T22:00:33.511764] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-02. [2025-09-26T22:00:34.275600] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-09-26T22:00:34.311728] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-01. [2025-09-26T22:00:35.111730] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-03. [2025-09-26T22:00:35.149413] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-26T22:00:35.200599] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-26T22:00:35.911738] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-05. [2025-09-26T22:00:36.711895] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-03. [2025-09-26T22:00:36.969395] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-01 (2.66 seconds). [2025-09-26T22:00:37.210934] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-26T22:00:37.511763] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-02. [2025-09-26T22:00:38.311730] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-04. [2025-09-26T22:00:38.404209] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-09-26T22:00:38.547713] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-26T22:00:39.111737] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-04. [2025-09-26T22:00:39.911709] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-06. [2025-09-26T22:00:40.160164] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-02 (2.65 seconds). [2025-09-26T22:00:40.273562] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-26T22:00:40.711683] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-05. [2025-09-26T22:00:41.127751] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-26T22:00:41.511723] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-03. [2025-09-26T22:00:42.174358] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-26T22:00:42.311694] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-07. [2025-09-26T22:00:42.572914] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-26T22:00:43.111719] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-06. [2025-09-26T22:00:43.911712] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-05. [2025-09-26T22:00:43.978770] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-09-26T22:00:44.711748] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-04. [2025-09-26T22:00:44.865192] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-09-26T22:00:44.973246] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-26T22:00:45.511696] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-08. [2025-09-26T22:00:45.780083] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-26T22:00:46.311722] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-06. [2025-09-26T22:00:47.116794] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-07. [2025-09-26T22:00:47.135556] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-26T22:00:47.911695] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-05. [2025-09-26T22:00:48.265785] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-26T22:00:48.395542] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-08 (2.88 seconds). [2025-09-26T22:00:48.711713] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-07. [2025-09-26T22:00:49.034358] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-26T22:00:49.511739] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-09. [2025-09-26T22:00:50.317174] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-08. [2025-09-26T22:00:50.323346] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-26T22:00:50.434930] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-26T22:00:51.111762] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-06. [2025-09-26T22:00:51.911748] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-08. [2025-09-26T22:00:52.016698] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-09-26T22:00:52.031990] [INFO ] [REMOTE ] VRT: Full fetch complete (77831 records). [2025-09-26T22:00:52.032194] [DEBUG] [VALIDATOR ] VRT: Validating primary data. [2025-09-26T22:00:52.487252] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-26T22:00:52.540163] [DEBUG] [VALIDATOR ] VRT: All expected trading days are present. [2025-09-26T22:00:52.540432] [DEBUG] [VALIDATOR ] VRT: Primary data validation passed. [2025-09-26T22:00:52.541700] [INFO ] [MAIN ] VRT: Fetched primary data is valid. [2025-09-26T22:00:52.541815] [DEBUG] [LOCAL ] VRT: Saving primary data. [2025-09-26T22:00:52.543625] [DEBUG] [LOCAL ] VRT: Trimmed 77831 records to 54533 (keeping 200 days of data) [2025-09-26T22:00:52.727321] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-09. [2025-09-26T22:00:52.894180] [DEBUG] [LOCAL ] VRT: Primary data saved (54533 records). [2025-09-26T22:00:52.894339] [INFO ] [MAIN ] VRT: Full history saved. [2025-09-26T22:00:52.894442] [INFO ] [MAIN ] Update Progress: 2252/2371 symbols completed. VRT took 46.7s. Estimated remaining: 15m 54s. Rate: 7.5 symbols/min [2025-09-26T22:00:53.085688] [INFO ] [MAIN ] VSTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:00:53.136374] [DEBUG] [LOCAL ] VSTS: Loaded 49414 existing records from primary storage. [2025-09-26T22:00:53.136557] [INFO ] [MAIN ] VSTS: Loaded 49414 existing records. [2025-09-26T22:00:53.332384] [WARN ] [MAIN ] VSTS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:00:53.332797] [INFO ] [MAIN ] VSTS: Wiping existing primary data before full refresh. [2025-09-26T22:00:53.332920] [INFO ] [LOCAL ] VSTS: Starting deletion of primary data. [2025-09-26T22:00:53.333946] [DEBUG] [LOCAL ] VSTS: Deleted primary data file. [2025-09-26T22:00:53.334011] [INFO ] [MAIN ] VSTS: Starting full primary refresh. [2025-09-26T22:00:53.810843] [INFO ] [REMOTE ] VSTS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:00:53.811501] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2024-12. [2025-09-26T22:00:53.819548] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-26T22:00:53.923886] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-06 (2.81 seconds). [2025-09-26T22:00:54.311722] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-07. [2025-09-26T22:00:54.619555] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-26T22:00:54.637220] [INFO ] [REMOTE ] VSCO: Full fetch complete (76173 records). [2025-09-26T22:00:54.637425] [DEBUG] [VALIDATOR ] VSCO: Validating primary data. [2025-09-26T22:00:55.089235] [DEBUG] [VALIDATOR ] VSCO: All expected trading days are present. [2025-09-26T22:00:55.089551] [DEBUG] [VALIDATOR ] VSCO: Primary data validation passed. [2025-09-26T22:00:55.090828] [INFO ] [MAIN ] VSCO: Fetched primary data is valid. [2025-09-26T22:00:55.090898] [DEBUG] [LOCAL ] VSCO: Saving primary data. [2025-09-26T22:00:55.092610] [DEBUG] [LOCAL ] VSCO: Trimmed 76173 records to 53556 (keeping 200 days of data) [2025-09-26T22:00:55.147217] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-09. [2025-09-26T22:00:55.430582] [DEBUG] [LOCAL ] VSCO: Primary data saved (53556 records). [2025-09-26T22:00:55.430771] [INFO ] [MAIN ] VSCO: Full history saved. [2025-09-26T22:00:55.430874] [INFO ] [MAIN ] Update Progress: 2253/2371 symbols completed. VSCO took 31.8s. Estimated remaining: 15m 45s. Rate: 7.5 symbols/min [2025-09-26T22:00:55.622035] [INFO ] [MAIN ] VTEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:00:55.655393] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-26T22:00:55.705160] [DEBUG] [LOCAL ] VTEX: Loaded 43673 existing records from primary storage. [2025-09-26T22:00:55.705385] [INFO ] [MAIN ] VTEX: Loaded 43673 existing records. [2025-09-26T22:00:55.891405] [WARN ] [MAIN ] VTEX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:00:55.891746] [INFO ] [MAIN ] VTEX: Wiping existing primary data before full refresh. [2025-09-26T22:00:55.891807] [INFO ] [LOCAL ] VTEX: Starting deletion of primary data. [2025-09-26T22:00:55.892819] [DEBUG] [LOCAL ] VTEX: Deleted primary data file. [2025-09-26T22:00:55.892913] [INFO ] [MAIN ] VTEX: Starting full primary refresh. [2025-09-26T22:00:55.920398] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-01. [2025-09-26T22:00:56.284617] [INFO ] [REMOTE ] VTEX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:00:56.711718] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2024-12. [2025-09-26T22:00:56.743139] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-26T22:00:56.752751] [INFO ] [REMOTE ] VSH: Full fetch complete (71085 records). [2025-09-26T22:00:56.752907] [DEBUG] [VALIDATOR ] VSH: Validating primary data. [2025-09-26T22:00:57.185347] [DEBUG] [VALIDATOR ] VSH: All expected trading days are present. [2025-09-26T22:00:57.185504] [DEBUG] [VALIDATOR ] VSH: Primary data validation passed. [2025-09-26T22:00:57.186819] [INFO ] [MAIN ] VSH: Fetched primary data is valid. [2025-09-26T22:00:57.186970] [DEBUG] [LOCAL ] VSH: Saving primary data. [2025-09-26T22:00:57.201405] [DEBUG] [LOCAL ] VSH: Trimmed 71085 records to 49188 (keeping 200 days of data) [2025-09-26T22:00:57.223940] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-07 (2.91 seconds). [2025-09-26T22:00:57.524494] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-08. [2025-09-26T22:00:57.568189] [DEBUG] [LOCAL ] VSH: Primary data saved (49188 records). [2025-09-26T22:00:57.568491] [INFO ] [MAIN ] VSH: Full history saved. [2025-09-26T22:00:57.568737] [INFO ] [MAIN ] Update Progress: 2254/2371 symbols completed. VSH took 33.0s. Estimated remaining: 15m 37s. Rate: 7.5 symbols/min [2025-09-26T22:00:57.788426] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-26T22:00:57.808460] [INFO ] [MAIN ] VTLE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:00:57.880946] [DEBUG] [LOCAL ] VTLE: Loaded 48959 existing records from primary storage. [2025-09-26T22:00:57.881220] [INFO ] [MAIN ] VTLE: Loaded 48959 existing records. [2025-09-26T22:00:58.088242] [WARN ] [MAIN ] VTLE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:00:58.088606] [INFO ] [MAIN ] VTLE: Wiping existing primary data before full refresh. [2025-09-26T22:00:58.088796] [INFO ] [LOCAL ] VTLE: Starting deletion of primary data. [2025-09-26T22:00:58.089951] [DEBUG] [LOCAL ] VTLE: Deleted primary data file. [2025-09-26T22:00:58.090019] [INFO ] [MAIN ] VTLE: Starting full primary refresh. [2025-09-26T22:00:58.303138] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-26T22:00:58.317883] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-02. [2025-09-26T22:00:58.523483] [INFO ] [REMOTE ] VTLE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:00:59.111772] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-01. [2025-09-26T22:00:59.911857] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2024-12. [2025-09-26T22:00:59.914347] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-26T22:01:00.044264] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-09-26T22:01:00.437508] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-26T22:01:00.711746] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-09. [2025-09-26T22:01:01.313042] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T22:01:01.483124] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-26T22:01:01.493780] [INFO ] [REMOTE ] VST: Full fetch complete (77807 records). [2025-09-26T22:01:01.493963] [DEBUG] [VALIDATOR ] VST: Validating primary data. [2025-09-26T22:01:01.516779] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-01. [2025-09-26T22:01:01.926104] [DEBUG] [VALIDATOR ] VST: All expected trading days are present. [2025-09-26T22:01:01.926308] [DEBUG] [VALIDATOR ] VST: Primary data validation passed. [2025-09-26T22:01:01.927693] [INFO ] [MAIN ] VST: Fetched primary data is valid. [2025-09-26T22:01:01.927783] [DEBUG] [LOCAL ] VST: Saving primary data. [2025-09-26T22:01:01.929845] [DEBUG] [LOCAL ] VST: Trimmed 77807 records to 54498 (keeping 200 days of data) [2025-09-26T22:01:02.290480] [DEBUG] [LOCAL ] VST: Primary data saved (54498 records). [2025-09-26T22:01:02.290665] [INFO ] [MAIN ] VST: Full history saved. [2025-09-26T22:01:02.290823] [INFO ] [MAIN ] Update Progress: 2255/2371 symbols completed. VST took 31.4s. Estimated remaining: 15m 29s. Rate: 7.5 symbols/min [2025-09-26T22:01:02.316832] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-02. [2025-09-26T22:01:02.474585] [INFO ] [MAIN ] VTMX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:01:02.493947] [DEBUG] [LOCAL ] VTMX: Loaded 17636 existing records from primary storage. [2025-09-26T22:01:02.494093] [INFO ] [MAIN ] VTMX: Loaded 17636 existing records. [2025-09-26T22:01:02.686787] [WARN ] [MAIN ] VTMX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:01:02.687131] [INFO ] [MAIN ] VTMX: Wiping existing primary data before full refresh. [2025-09-26T22:01:02.687200] [INFO ] [LOCAL ] VTMX: Starting deletion of primary data. [2025-09-26T22:01:02.687864] [DEBUG] [LOCAL ] VTMX: Deleted primary data file. [2025-09-26T22:01:02.687933] [INFO ] [MAIN ] VTMX: Starting full primary refresh. [2025-09-26T22:01:03.090726] [INFO ] [REMOTE ] VTMX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:01:03.111803] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-03. [2025-09-26T22:01:03.175783] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-26T22:01:03.809705] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-26T22:01:03.911722] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-02. [2025-09-26T22:01:04.711795] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2024-12. [2025-09-26T22:01:04.904664] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-26T22:01:05.516798] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-04. [2025-09-26T22:01:05.534405] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-26T22:01:05.755089] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-26T22:01:06.311747] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-03. [2025-09-26T22:01:07.111731] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-03. [2025-09-26T22:01:07.280307] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-26T22:01:07.911723] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-01. [2025-09-26T22:01:07.994714] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-26T22:01:08.711700] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-05. [2025-09-26T22:01:08.905327] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-26T22:01:08.906848] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-26T22:01:09.511742] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-04. [2025-09-26T22:01:10.311785] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-02. [2025-09-26T22:01:10.475548] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-26T22:01:11.111700] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-06. [2025-09-26T22:01:11.348135] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-26T22:01:11.424042] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-26T22:01:11.911751] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-04. [2025-09-26T22:01:12.711710] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-03. [2025-09-26T22:01:12.893634] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-26T22:01:13.380568] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-26T22:01:13.511739] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-07. [2025-09-26T22:01:13.684128] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-26T22:01:14.311771] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-05. [2025-09-26T22:01:15.111712] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-05. [2025-09-26T22:01:15.385803] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-26T22:01:15.911712] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-04. [2025-09-26T22:01:15.951587] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-26T22:01:16.711713] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-06. [2025-09-26T22:01:17.011094] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-26T22:01:17.074066] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-26T22:01:17.511767] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-08. [2025-09-26T22:01:18.229905] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-26T22:01:18.311733] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-06. [2025-09-26T22:01:19.111702] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-07. [2025-09-26T22:01:19.250957] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-26T22:01:19.911726] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-05. [2025-09-26T22:01:19.975427] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-26T22:01:20.649901] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-26T22:01:20.711714] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-09. [2025-09-26T22:01:20.944126] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-26T22:01:21.511727] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-06. [2025-09-26T22:01:22.230799] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-26T22:01:22.242359] [INFO ] [REMOTE ] VSTS: Full fetch complete (69845 records). [2025-09-26T22:01:22.242554] [DEBUG] [VALIDATOR ] VSTS: Validating primary data. [2025-09-26T22:01:22.315331] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-07. [2025-09-26T22:01:22.662065] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-26T22:01:22.717696] [DEBUG] [VALIDATOR ] VSTS: All expected trading days are present. [2025-09-26T22:01:22.717794] [DEBUG] [VALIDATOR ] VSTS: Primary data validation passed. [2025-09-26T22:01:22.718986] [INFO ] [MAIN ] VSTS: Fetched primary data is valid. [2025-09-26T22:01:22.719054] [DEBUG] [LOCAL ] VSTS: Saving primary data. [2025-09-26T22:01:22.720524] [DEBUG] [LOCAL ] VSTS: Trimmed 69845 records to 49773 (keeping 200 days of data) [2025-09-26T22:01:23.039679] [DEBUG] [LOCAL ] VSTS: Primary data saved (49773 records). [2025-09-26T22:01:23.039862] [INFO ] [MAIN ] VSTS: Full history saved. [2025-09-26T22:01:23.040021] [INFO ] [MAIN ] Update Progress: 2256/2371 symbols completed. VSTS took 30.1s. Estimated remaining: 15m 22s. Rate: 7.5 symbols/min [2025-09-26T22:01:23.121221] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-07. [2025-09-26T22:01:23.229742] [INFO ] [MAIN ] VTN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:01:23.240261] [DEBUG] [LOCAL ] VTN: Loaded 7252 existing records from primary storage. [2025-09-26T22:01:23.240391] [INFO ] [MAIN ] VTN: Loaded 7252 existing records. [2025-09-26T22:01:23.424831] [WARN ] [MAIN ] VTN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:01:23.425151] [INFO ] [MAIN ] VTN: Wiping existing primary data before full refresh. [2025-09-26T22:01:23.425205] [INFO ] [LOCAL ] VTN: Starting deletion of primary data. [2025-09-26T22:01:23.425604] [DEBUG] [LOCAL ] VTN: Deleted primary data file. [2025-09-26T22:01:23.425699] [INFO ] [MAIN ] VTN: Starting full primary refresh. [2025-09-26T22:01:23.803117] [INFO ] [REMOTE ] VTN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:01:23.911729] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-08. [2025-09-26T22:01:24.117391] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-26T22:01:24.170559] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-26T22:01:24.711722] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-08. [2025-09-26T22:01:25.511727] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-08. [2025-09-26T22:01:25.565021] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-26T22:01:25.567571] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-26T22:01:26.311761] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-09. [2025-09-26T22:01:27.078316] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-26T22:01:27.083736] [INFO ] [REMOTE ] VTMX: Full fetch complete (25979 records). [2025-09-26T22:01:27.083824] [DEBUG] [VALIDATOR ] VTMX: Validating primary data. [2025-09-26T22:01:27.120712] [INFO ] [REMOTE ] VTN: Fetching primary data for 2024-12. [2025-09-26T22:01:27.537455] [DEBUG] [VALIDATOR ] VTMX: All expected trading days are present. [2025-09-26T22:01:27.537573] [DEBUG] [VALIDATOR ] VTMX: Primary data validation passed. [2025-09-26T22:01:27.539698] [INFO ] [MAIN ] VTMX: Fetched primary data is valid. [2025-09-26T22:01:27.541920] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-26T22:01:27.552026] [DEBUG] [LOCAL ] VTMX: Saving primary data. [2025-09-26T22:01:27.553919] [DEBUG] [LOCAL ] VTMX: Trimmed 25979 records to 17811 (keeping 200 days of data) [2025-09-26T22:01:27.675861] [DEBUG] [LOCAL ] VTMX: Primary data saved (17811 records). [2025-09-26T22:01:27.676023] [INFO ] [MAIN ] VTMX: Full history saved. [2025-09-26T22:01:27.676116] [INFO ] [MAIN ] Update Progress: 2257/2371 symbols completed. VTMX took 25.4s. Estimated remaining: 15m 13s. Rate: 7.5 symbols/min [2025-09-26T22:01:27.856041] [INFO ] [MAIN ] VTOL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:01:27.877767] [DEBUG] [LOCAL ] VTOL: Loaded 19814 existing records from primary storage. [2025-09-26T22:01:27.877920] [INFO ] [MAIN ] VTOL: Loaded 19814 existing records. [2025-09-26T22:01:27.923168] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-09. [2025-09-26T22:01:28.112001] [WARN ] [MAIN ] VTOL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:01:28.123466] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-26T22:01:28.123581] [INFO ] [MAIN ] VTOL: Wiping existing primary data before full refresh. [2025-09-26T22:01:28.126427] [INFO ] [LOCAL ] VTOL: Starting deletion of primary data. [2025-09-26T22:01:28.127767] [DEBUG] [LOCAL ] VTOL: Deleted primary data file. [2025-09-26T22:01:28.127853] [INFO ] [MAIN ] VTOL: Starting full primary refresh. [2025-09-26T22:01:28.502399] [INFO ] [REMOTE ] VTOL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:01:28.711722] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-09. [2025-09-26T22:01:29.511714] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2024-12. [2025-09-26T22:01:29.665616] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-26T22:01:29.678107] [INFO ] [REMOTE ] VTEX: Full fetch complete (60755 records). [2025-09-26T22:01:29.678312] [DEBUG] [VALIDATOR ] VTEX: Validating primary data. [2025-09-26T22:01:30.140909] [DEBUG] [VALIDATOR ] VTEX: All expected trading days are present. [2025-09-26T22:01:30.141029] [DEBUG] [VALIDATOR ] VTEX: Primary data validation passed. [2025-09-26T22:01:30.142178] [INFO ] [MAIN ] VTEX: Fetched primary data is valid. [2025-09-26T22:01:30.142267] [DEBUG] [LOCAL ] VTEX: Saving primary data. [2025-09-26T22:01:30.146563] [DEBUG] [LOCAL ] VTEX: Trimmed 60755 records to 43948 (keeping 200 days of data) [2025-09-26T22:01:30.318163] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-01. [2025-09-26T22:01:30.405793] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-26T22:01:30.417683] [INFO ] [REMOTE ] VTLE: Full fetch complete (68831 records). [2025-09-26T22:01:30.418416] [DEBUG] [VALIDATOR ] VTLE: Validating primary data. [2025-09-26T22:01:30.761411] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-26T22:01:30.914279] [DEBUG] [LOCAL ] VTEX: Primary data saved (43948 records). [2025-09-26T22:01:30.920583] [INFO ] [MAIN ] VTEX: Full history saved. [2025-09-26T22:01:30.921166] [INFO ] [MAIN ] Update Progress: 2258/2371 symbols completed. VTEX took 35.5s. Estimated remaining: 15m 5s. Rate: 7.5 symbols/min [2025-09-26T22:01:30.938893] [DEBUG] [VALIDATOR ] VTLE: All expected trading days are present. [2025-09-26T22:01:30.956739] [DEBUG] [VALIDATOR ] VTLE: Primary data validation passed. [2025-09-26T22:01:30.981198] [INFO ] [MAIN ] VTLE: Fetched primary data is valid. [2025-09-26T22:01:31.003905] [DEBUG] [LOCAL ] VTLE: Saving primary data. [2025-09-26T22:01:31.052548] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-26T22:01:31.110467] [DEBUG] [LOCAL ] VTLE: Trimmed 68831 records to 49337 (keeping 200 days of data) [2025-09-26T22:01:31.117022] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-02. [2025-09-26T22:01:31.148054] [INFO ] [MAIN ] VTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:01:31.374942] [DEBUG] [LOCAL ] VTR: Loaded 53235 existing records from primary storage. [2025-09-26T22:01:31.406350] [INFO ] [MAIN ] VTR: Loaded 53235 existing records. [2025-09-26T22:01:31.629735] [WARN ] [MAIN ] VTR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:01:31.633247] [INFO ] [MAIN ] VTR: Wiping existing primary data before full refresh. [2025-09-26T22:01:31.634738] [INFO ] [LOCAL ] VTR: Starting deletion of primary data. [2025-09-26T22:01:31.641866] [DEBUG] [LOCAL ] VTR: Deleted primary data file. [2025-09-26T22:01:31.642239] [INFO ] [MAIN ] VTR: Starting full primary refresh. [2025-09-26T22:01:31.920148] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-01. [2025-09-26T22:01:32.046323] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-26T22:01:32.098778] [DEBUG] [LOCAL ] VTLE: Primary data saved (49337 records). [2025-09-26T22:01:32.113584] [INFO ] [MAIN ] VTLE: Full history saved. [2025-09-26T22:01:32.138833] [INFO ] [MAIN ] Update Progress: 2259/2371 symbols completed. VTLE took 34.6s. Estimated remaining: 14m 57s. Rate: 7.5 symbols/min [2025-09-26T22:01:32.144986] [INFO ] [REMOTE ] VTR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:01:32.321752] [INFO ] [MAIN ] VTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:01:32.353964] [DEBUG] [LOCAL ] VTS: Loaded 30775 existing records from primary storage. [2025-09-26T22:01:32.354106] [INFO ] [MAIN ] VTS: Loaded 30775 existing records. [2025-09-26T22:01:32.564335] [WARN ] [MAIN ] VTS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:01:32.564786] [INFO ] [MAIN ] VTS: Wiping existing primary data before full refresh. [2025-09-26T22:01:32.564858] [INFO ] [LOCAL ] VTS: Starting deletion of primary data. [2025-09-26T22:01:32.565955] [DEBUG] [LOCAL ] VTS: Deleted primary data file. [2025-09-26T22:01:32.566221] [INFO ] [MAIN ] VTS: Starting full primary refresh. [2025-09-26T22:01:32.716865] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-03. [2025-09-26T22:01:32.916517] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-26T22:01:33.002173] [INFO ] [REMOTE ] VTS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:01:33.506380] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-26T22:01:33.511676] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-04. [2025-09-26T22:01:34.220113] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-26T22:01:34.311746] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-02. [2025-09-26T22:01:35.111738] [INFO ] [REMOTE ] VTS: Fetching primary data for 2024-12. [2025-09-26T22:01:35.297050] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-26T22:01:35.911724] [INFO ] [REMOTE ] VTR: Fetching primary data for 2024-12. [2025-09-26T22:01:36.200134] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-26T22:01:36.711725] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-01. [2025-09-26T22:01:37.511691] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-05. [2025-09-26T22:01:37.721502] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-26T22:01:37.826537] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-26T22:01:38.140961] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-26T22:01:38.311768] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-01. [2025-09-26T22:01:39.111761] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-03. [2025-09-26T22:01:39.911732] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-06. [2025-09-26T22:01:40.018718] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-26T22:01:40.124581] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-26T22:01:40.659208] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-26T22:01:40.711699] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-04. [2025-09-26T22:01:41.511753] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-02. [2025-09-26T22:01:41.958092] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-26T22:01:42.311725] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-02. [2025-09-26T22:01:43.111712] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-07. [2025-09-26T22:01:43.266619] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-26T22:01:43.295299] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-26T22:01:43.835081] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-26T22:01:43.911765] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-05. [2025-09-26T22:01:44.711720] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-03. [2025-09-26T22:01:44.984011] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-26T22:01:45.511729] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-03. [2025-09-26T22:01:46.311703] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-08. [2025-09-26T22:01:46.651565] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-26T22:01:46.691415] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-26T22:01:46.771868] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-26T22:01:47.111742] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-09. [2025-09-26T22:01:47.908379] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-26T22:01:47.911792] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-06. [2025-09-26T22:01:47.913233] [INFO ] [REMOTE ] VTN: Full fetch complete (11475 records). [2025-09-26T22:01:47.913365] [DEBUG] [VALIDATOR ] VTN: Validating primary data. [2025-09-26T22:01:48.324334] [DEBUG] [VALIDATOR ] VTN: All expected trading days are present. [2025-09-26T22:01:48.324482] [DEBUG] [VALIDATOR ] VTN: Primary data validation passed. [2025-09-26T22:01:48.325079] [INFO ] [MAIN ] VTN: Fetched primary data is valid. [2025-09-26T22:01:48.325149] [DEBUG] [LOCAL ] VTN: Saving primary data. [2025-09-26T22:01:48.325858] [DEBUG] [LOCAL ] VTN: Trimmed 11475 records to 7293 (keeping 200 days of data) [2025-09-26T22:01:48.391058] [DEBUG] [LOCAL ] VTN: Primary data saved (7293 records). [2025-09-26T22:01:48.391321] [INFO ] [MAIN ] VTN: Full history saved. [2025-09-26T22:01:48.391460] [INFO ] [MAIN ] Update Progress: 2260/2371 symbols completed. VTN took 25.4s. Estimated remaining: 14m 49s. Rate: 7.5 symbols/min [2025-09-26T22:01:48.579338] [INFO ] [MAIN ] VVR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:01:48.631170] [DEBUG] [LOCAL ] VVR: Loaded 30917 existing records from primary storage. [2025-09-26T22:01:48.631380] [INFO ] [MAIN ] VVR: Loaded 30917 existing records. [2025-09-26T22:01:48.716911] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-04. [2025-09-26T22:01:48.833880] [WARN ] [MAIN ] VVR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:01:48.834199] [INFO ] [MAIN ] VVR: Wiping existing primary data before full refresh. [2025-09-26T22:01:48.834304] [INFO ] [LOCAL ] VVR: Starting deletion of primary data. [2025-09-26T22:01:48.835398] [DEBUG] [LOCAL ] VVR: Deleted primary data file. [2025-09-26T22:01:48.835459] [INFO ] [MAIN ] VVR: Starting full primary refresh. [2025-09-26T22:01:49.210852] [INFO ] [REMOTE ] VVR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:01:49.227467] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-26T22:01:49.511725] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-04. [2025-09-26T22:01:50.311722] [INFO ] [REMOTE ] VVR: Fetching primary data for 2024-12. [2025-09-26T22:01:50.694487] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-26T22:01:50.912636] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-26T22:01:51.111719] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-05. [2025-09-26T22:01:51.728918] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-26T22:01:51.911767] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-07. [2025-09-26T22:01:52.537944] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-26T22:01:52.711696] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-06. [2025-09-26T22:01:53.107280] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-26T22:01:53.511801] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-05. [2025-09-26T22:01:54.123212] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-26T22:01:54.311796] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-01. [2025-09-26T22:01:55.111758] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-08. [2025-09-26T22:01:55.316905] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-26T22:01:55.719250] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-26T22:01:55.911755] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-02. [2025-09-26T22:01:56.268780] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-26T22:01:56.711828] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-07. [2025-09-26T22:01:57.208373] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-26T22:01:57.511730] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-06. [2025-09-26T22:01:57.999076] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-26T22:01:58.311757] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-08. [2025-09-26T22:01:59.111741] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-09. [2025-09-26T22:01:59.332088] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-26T22:01:59.644067] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-26T22:01:59.911781] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-09. [2025-09-26T22:02:00.093749] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-26T22:02:00.097738] [INFO ] [REMOTE ] VTOL: Full fetch complete (25987 records). [2025-09-26T22:02:00.097842] [DEBUG] [VALIDATOR ] VTOL: Validating primary data. [2025-09-26T22:02:00.491614] [DEBUG] [VALIDATOR ] VTOL: All expected trading days are present. [2025-09-26T22:02:00.491755] [DEBUG] [VALIDATOR ] VTOL: Primary data validation passed. [2025-09-26T22:02:00.492687] [INFO ] [MAIN ] VTOL: Fetched primary data is valid. [2025-09-26T22:02:00.492827] [DEBUG] [LOCAL ] VTOL: Saving primary data. [2025-09-26T22:02:00.493754] [DEBUG] [LOCAL ] VTOL: Trimmed 25987 records to 19915 (keeping 200 days of data) [2025-09-26T22:02:00.627795] [DEBUG] [LOCAL ] VTOL: Primary data saved (19915 records). [2025-09-26T22:02:00.628018] [INFO ] [MAIN ] VTOL: Full history saved. [2025-09-26T22:02:00.628223] [INFO ] [MAIN ] Update Progress: 2261/2371 symbols completed. VTOL took 33.0s. Estimated remaining: 14m 41s. Rate: 7.5 symbols/min [2025-09-26T22:02:00.717000] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-07. [2025-09-26T22:02:00.821115] [INFO ] [MAIN ] VVV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:02:00.899094] [DEBUG] [LOCAL ] VVV: Loaded 50595 existing records from primary storage. [2025-09-26T22:02:00.899382] [INFO ] [MAIN ] VVV: Loaded 50595 existing records. [2025-09-26T22:02:01.100279] [WARN ] [MAIN ] VVV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:02:01.100978] [INFO ] [MAIN ] VVV: Wiping existing primary data before full refresh. [2025-09-26T22:02:01.101278] [INFO ] [LOCAL ] VVV: Starting deletion of primary data. [2025-09-26T22:02:01.108867] [DEBUG] [LOCAL ] VVV: Deleted primary data file. [2025-09-26T22:02:01.120947] [INFO ] [MAIN ] VVV: Starting full primary refresh. [2025-09-26T22:02:01.128153] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-26T22:02:01.240151] [INFO ] [REMOTE ] VTS: Full fetch complete (40990 records). [2025-09-26T22:02:01.253001] [DEBUG] [VALIDATOR ] VTS: Validating primary data. [2025-09-26T22:02:01.512952] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-03. [2025-09-26T22:02:02.046122] [INFO ] [REMOTE ] VVV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:02:02.171404] [DEBUG] [VALIDATOR ] VTS: All expected trading days are present. [2025-09-26T22:02:02.171516] [DEBUG] [VALIDATOR ] VTS: Primary data validation passed. [2025-09-26T22:02:02.172693] [INFO ] [MAIN ] VTS: Fetched primary data is valid. [2025-09-26T22:02:02.172796] [DEBUG] [LOCAL ] VTS: Saving primary data. [2025-09-26T22:02:02.174146] [DEBUG] [LOCAL ] VTS: Trimmed 40990 records to 30992 (keeping 200 days of data) [2025-09-26T22:02:02.331459] [INFO ] [REMOTE ] VVV: Fetching primary data for 2024-12. [2025-09-26T22:02:02.375248] [DEBUG] [LOCAL ] VTS: Primary data saved (30992 records). [2025-09-26T22:02:02.375453] [INFO ] [MAIN ] VTS: Full history saved. [2025-09-26T22:02:02.375614] [INFO ] [MAIN ] Update Progress: 2262/2371 symbols completed. VTS took 30.2s. Estimated remaining: 14m 33s. Rate: 7.5 symbols/min [2025-09-26T22:02:02.568535] [INFO ] [MAIN ] VVX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:02:02.623792] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-26T22:02:02.645426] [DEBUG] [LOCAL ] VVX: Loaded 23504 existing records from primary storage. [2025-09-26T22:02:02.646080] [INFO ] [MAIN ] VVX: Loaded 23504 existing records. [2025-09-26T22:02:02.843691] [WARN ] [MAIN ] VVX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:02:02.844256] [INFO ] [MAIN ] VVX: Wiping existing primary data before full refresh. [2025-09-26T22:02:02.844339] [INFO ] [LOCAL ] VVX: Starting deletion of primary data. [2025-09-26T22:02:02.845095] [DEBUG] [LOCAL ] VVX: Deleted primary data file. [2025-09-26T22:02:02.845162] [INFO ] [MAIN ] VVX: Starting full primary refresh. [2025-09-26T22:02:03.125462] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-08. [2025-09-26T22:02:03.207998] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-26T22:02:03.296245] [INFO ] [REMOTE ] VVX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:02:03.911767] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-04. [2025-09-26T22:02:04.094724] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-26T22:02:04.718588] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-01. [2025-09-26T22:02:04.752611] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-26T22:02:05.319754] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-26T22:02:05.511817] [INFO ] [REMOTE ] VVX: Fetching primary data for 2024-12. [2025-09-26T22:02:06.311795] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-05. [2025-09-26T22:02:06.425016] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-26T22:02:06.718989] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-26T22:02:07.111776] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-02. [2025-09-26T22:02:07.245865] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-26T22:02:07.911765] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-06. [2025-09-26T22:02:08.711754] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-01. [2025-09-26T22:02:08.839865] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-26T22:02:09.331671] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-26T22:02:09.511735] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-07. [2025-09-26T22:02:09.825344] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-26T22:02:10.311702] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-02. [2025-09-26T22:02:10.703926] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-26T22:02:11.111738] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-09. [2025-09-26T22:02:11.440675] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-26T22:02:11.874072] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-26T22:02:11.884386] [INFO ] [REMOTE ] VTR: Full fetch complete (76360 records). [2025-09-26T22:02:11.884521] [DEBUG] [VALIDATOR ] VTR: Validating primary data. [2025-09-26T22:02:11.916876] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-03. [2025-09-26T22:02:12.316435] [DEBUG] [VALIDATOR ] VTR: All expected trading days are present. [2025-09-26T22:02:12.316568] [DEBUG] [VALIDATOR ] VTR: Primary data validation passed. [2025-09-26T22:02:12.318077] [INFO ] [MAIN ] VTR: Fetched primary data is valid. [2025-09-26T22:02:12.318149] [DEBUG] [LOCAL ] VTR: Saving primary data. [2025-09-26T22:02:12.319965] [DEBUG] [LOCAL ] VTR: Trimmed 76360 records to 53620 (keeping 200 days of data) [2025-09-26T22:02:12.709447] [DEBUG] [LOCAL ] VTR: Primary data saved (53620 records). [2025-09-26T22:02:12.709688] [INFO ] [MAIN ] VTR: Full history saved. [2025-09-26T22:02:12.709827] [INFO ] [MAIN ] Update Progress: 2263/2371 symbols completed. VTR took 41.8s. Estimated remaining: 14m 25s. Rate: 7.5 symbols/min [2025-09-26T22:02:12.715331] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-03. [2025-09-26T22:02:12.898583] [INFO ] [MAIN ] VYX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:02:12.945713] [DEBUG] [LOCAL ] VYX: Loaded 49359 existing records from primary storage. [2025-09-26T22:02:12.945868] [INFO ] [MAIN ] VYX: Loaded 49359 existing records. [2025-09-26T22:02:13.133528] [WARN ] [MAIN ] VYX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:02:13.133802] [INFO ] [MAIN ] VYX: Wiping existing primary data before full refresh. [2025-09-26T22:02:13.133876] [INFO ] [LOCAL ] VYX: Starting deletion of primary data. [2025-09-26T22:02:13.134896] [DEBUG] [LOCAL ] VYX: Deleted primary data file. [2025-09-26T22:02:13.134960] [INFO ] [MAIN ] VYX: Starting full primary refresh. [2025-09-26T22:02:13.525187] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-08. [2025-09-26T22:02:13.532864] [INFO ] [REMOTE ] VYX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:02:13.664171] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-26T22:02:13.931677] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-26T22:02:14.311747] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-04. [2025-09-26T22:02:14.797800] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-26T22:02:15.111807] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-04. [2025-09-26T22:02:15.540511] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-26T22:02:15.911741] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-05. [2025-09-26T22:02:16.711702] [INFO ] [REMOTE ] VYX: Fetching primary data for 2024-12. [2025-09-26T22:02:16.857792] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-26T22:02:17.099985] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-26T22:02:17.511754] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-06. [2025-09-26T22:02:18.071284] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-26T22:02:18.311759] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-09. [2025-09-26T22:02:18.722200] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-26T22:02:19.111733] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-01. [2025-09-26T22:02:19.797429] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-26T22:02:19.804860] [INFO ] [REMOTE ] VVR: Full fetch complete (46003 records). [2025-09-26T22:02:19.804982] [DEBUG] [VALIDATOR ] VVR: Validating primary data. [2025-09-26T22:02:19.916837] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-05. [2025-09-26T22:02:20.250957] [DEBUG] [VALIDATOR ] VVR: All expected trading days are present. [2025-09-26T22:02:20.251082] [DEBUG] [VALIDATOR ] VVR: Primary data validation passed. [2025-09-26T22:02:20.252426] [INFO ] [MAIN ] VVR: Fetched primary data is valid. [2025-09-26T22:02:20.252496] [DEBUG] [LOCAL ] VVR: Saving primary data. [2025-09-26T22:02:20.253964] [DEBUG] [LOCAL ] VVR: Trimmed 46003 records to 31251 (keeping 200 days of data) [2025-09-26T22:02:20.441927] [DEBUG] [LOCAL ] VVR: Primary data saved (31251 records). [2025-09-26T22:02:20.442082] [INFO ] [MAIN ] VVR: Full history saved. [2025-09-26T22:02:20.442206] [INFO ] [MAIN ] Update Progress: 2264/2371 symbols completed. VVR took 32.1s. Estimated remaining: 14m 17s. Rate: 7.5 symbols/min [2025-09-26T22:02:20.634351] [INFO ] [MAIN ] VZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:02:20.689613] [DEBUG] [LOCAL ] VZ: Loaded 54181 existing records from primary storage. [2025-09-26T22:02:20.689793] [INFO ] [MAIN ] VZ: Loaded 54181 existing records. [2025-09-26T22:02:20.724297] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-07. [2025-09-26T22:02:20.918702] [WARN ] [MAIN ] VZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:02:20.930149] [INFO ] [MAIN ] VZ: Wiping existing primary data before full refresh. [2025-09-26T22:02:20.935402] [INFO ] [LOCAL ] VZ: Starting deletion of primary data. [2025-09-26T22:02:20.950638] [DEBUG] [LOCAL ] VZ: Deleted primary data file. [2025-09-26T22:02:20.950558] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-26T22:02:20.950909] [INFO ] [MAIN ] VZ: Starting full primary refresh. [2025-09-26T22:02:21.348049] [INFO ] [REMOTE ] VZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:02:21.386689] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T22:02:21.511701] [INFO ] [REMOTE ] VZ: Fetching primary data for 2024-12. [2025-09-26T22:02:21.894118] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-26T22:02:22.311746] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-06. [2025-09-26T22:02:23.111729] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-02. [2025-09-26T22:02:23.911718] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-08. [2025-09-26T22:02:23.992541] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-26T22:02:24.043553] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2024-12 (2.53 seconds). [2025-09-26T22:02:24.711698] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-01. [2025-09-26T22:02:24.810310] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-26T22:02:25.318254] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-26T22:02:25.511723] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-03. [2025-09-26T22:02:26.311735] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-07. [2025-09-26T22:02:27.111727] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-09. [2025-09-26T22:02:27.197614] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-09-26T22:02:27.337121] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-26T22:02:27.911682] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-02. [2025-09-26T22:02:28.026184] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-26T22:02:28.426217] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-26T22:02:28.434147] [INFO ] [REMOTE ] VVX: Full fetch complete (33531 records). [2025-09-26T22:02:28.434387] [DEBUG] [VALIDATOR ] VVX: Validating primary data. [2025-09-26T22:02:28.720811] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-08. [2025-09-26T22:02:28.874244] [DEBUG] [VALIDATOR ] VVX: All expected trading days are present. [2025-09-26T22:02:28.874341] [DEBUG] [VALIDATOR ] VVX: Primary data validation passed. [2025-09-26T22:02:28.875185] [INFO ] [MAIN ] VVX: Fetched primary data is valid. [2025-09-26T22:02:28.875252] [DEBUG] [LOCAL ] VVX: Saving primary data. [2025-09-26T22:02:28.876377] [DEBUG] [LOCAL ] VVX: Trimmed 33531 records to 23664 (keeping 200 days of data) [2025-09-26T22:02:29.020842] [DEBUG] [LOCAL ] VVX: Primary data saved (23664 records). [2025-09-26T22:02:29.020989] [INFO ] [MAIN ] VVX: Full history saved. [2025-09-26T22:02:29.021088] [INFO ] [MAIN ] Update Progress: 2265/2371 symbols completed. VVX took 26.6s. Estimated remaining: 14m 9s. Rate: 7.5 symbols/min [2025-09-26T22:02:29.216507] [INFO ] [MAIN ] W: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:02:29.271822] [DEBUG] [LOCAL ] W: Loaded 53885 existing records from primary storage. [2025-09-26T22:02:29.271978] [INFO ] [MAIN ] W: Loaded 53885 existing records. [2025-09-26T22:02:29.473562] [WARN ] [MAIN ] W: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:02:29.474327] [INFO ] [MAIN ] W: Wiping existing primary data before full refresh. [2025-09-26T22:02:29.474420] [INFO ] [LOCAL ] W: Starting deletion of primary data. [2025-09-26T22:02:29.475751] [DEBUG] [LOCAL ] W: Deleted primary data file. [2025-09-26T22:02:29.475819] [INFO ] [MAIN ] W: Starting full primary refresh. [2025-09-26T22:02:29.516905] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-04. [2025-09-26T22:02:29.935665] [INFO ] [REMOTE ] W: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:02:30.132041] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-26T22:02:30.311768] [INFO ] [REMOTE ] W: Fetching primary data for 2024-12. [2025-09-26T22:02:30.503621] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-26T22:02:31.010027] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-26T22:02:31.111705] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-05. [2025-09-26T22:02:31.919225] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-03. [2025-09-26T22:02:31.941837] [INFO ] [REMOTE ] W: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-26T22:02:32.342248] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-26T22:02:32.711768] [INFO ] [REMOTE ] W: Fetching primary data for 2025-01. [2025-09-26T22:02:33.511728] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-09. [2025-09-26T22:02:34.238842] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-26T22:02:34.311709] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-04. [2025-09-26T22:02:34.559496] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-26T22:02:35.105423] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-26T22:02:35.115158] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-06. [2025-09-26T22:02:35.117445] [INFO ] [REMOTE ] VVV: Full fetch complete (72361 records). [2025-09-26T22:02:35.117574] [DEBUG] [VALIDATOR ] VVV: Validating primary data. [2025-09-26T22:02:35.562593] [DEBUG] [VALIDATOR ] VVV: All expected trading days are present. [2025-09-26T22:02:35.562733] [DEBUG] [VALIDATOR ] VVV: Primary data validation passed. [2025-09-26T22:02:35.564028] [INFO ] [MAIN ] VVV: Fetched primary data is valid. [2025-09-26T22:02:35.564101] [DEBUG] [LOCAL ] VVV: Saving primary data. [2025-09-26T22:02:35.566011] [DEBUG] [LOCAL ] VVV: Trimmed 72361 records to 50933 (keeping 200 days of data) [2025-09-26T22:02:35.897509] [DEBUG] [LOCAL ] VVV: Primary data saved (50933 records). [2025-09-26T22:02:35.897896] [INFO ] [MAIN ] VVV: Full history saved. [2025-09-26T22:02:35.898005] [INFO ] [MAIN ] Update Progress: 2266/2371 symbols completed. VVV took 35.3s. Estimated remaining: 14m 1s. Rate: 7.5 symbols/min [2025-09-26T22:02:35.932570] [INFO ] [REMOTE ] W: Fetching primary data for 2025-02. [2025-09-26T22:02:36.087259] [INFO ] [MAIN ] WAB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:02:36.142181] [DEBUG] [LOCAL ] WAB: Loaded 44516 existing records from primary storage. [2025-09-26T22:02:36.142337] [INFO ] [MAIN ] WAB: Loaded 44516 existing records. [2025-09-26T22:02:36.335232] [WARN ] [MAIN ] WAB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:02:36.335523] [INFO ] [MAIN ] WAB: Wiping existing primary data before full refresh. [2025-09-26T22:02:36.335574] [INFO ] [LOCAL ] WAB: Starting deletion of primary data. [2025-09-26T22:02:36.336698] [DEBUG] [LOCAL ] WAB: Deleted primary data file. [2025-09-26T22:02:36.336764] [INFO ] [MAIN ] WAB: Starting full primary refresh. [2025-09-26T22:02:36.753784] [INFO ] [REMOTE ] WAB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:02:36.754389] [INFO ] [REMOTE ] WAB: Fetching primary data for 2024-12. [2025-09-26T22:02:36.805438] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-26T22:02:36.905794] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-26T22:02:37.354861] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-26T22:02:37.511722] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-05. [2025-09-26T22:02:38.311770] [INFO ] [REMOTE ] W: Fetching primary data for 2025-03. [2025-09-26T22:02:38.429846] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-26T22:02:39.111737] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-01. [2025-09-26T22:02:39.832629] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-09-26T22:02:39.911692] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-07. [2025-09-26T22:02:40.018470] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-26T22:02:40.711723] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-06. [2025-09-26T22:02:40.850304] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-26T22:02:41.463664] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-26T22:02:41.511735] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-02. [2025-09-26T22:02:42.311756] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-08. [2025-09-26T22:02:42.945768] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-26T22:02:43.111736] [INFO ] [REMOTE ] W: Fetching primary data for 2025-04. [2025-09-26T22:02:43.149702] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-09-26T22:02:43.911731] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-03. [2025-09-26T22:02:44.087371] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-26T22:02:44.711790] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-07. [2025-09-26T22:02:45.265491] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-26T22:02:45.511729] [INFO ] [REMOTE ] W: Fetching primary data for 2025-05. [2025-09-26T22:02:45.731298] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-26T22:02:46.311732] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-04. [2025-09-26T22:02:47.111697] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-09. [2025-09-26T22:02:47.377599] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-09-26T22:02:47.547809] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-26T22:02:47.908934] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T22:02:47.918237] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-08. [2025-09-26T22:02:48.571550] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-26T22:02:48.581175] [INFO ] [REMOTE ] VYX: Full fetch complete (70304 records). [2025-09-26T22:02:48.581325] [DEBUG] [VALIDATOR ] VYX: Validating primary data. [2025-09-26T22:02:48.716792] [INFO ] [REMOTE ] W: Fetching primary data for 2025-06. [2025-09-26T22:02:48.998621] [DEBUG] [VALIDATOR ] VYX: All expected trading days are present. [2025-09-26T22:02:48.998745] [DEBUG] [VALIDATOR ] VYX: Primary data validation passed. [2025-09-26T22:02:48.999838] [INFO ] [MAIN ] VYX: Fetched primary data is valid. [2025-09-26T22:02:48.999919] [DEBUG] [LOCAL ] VYX: Saving primary data. [2025-09-26T22:02:49.001475] [DEBUG] [LOCAL ] VYX: Trimmed 70304 records to 49624 (keeping 200 days of data) [2025-09-26T22:02:49.299220] [DEBUG] [LOCAL ] VYX: Primary data saved (49624 records). [2025-09-26T22:02:49.299864] [INFO ] [MAIN ] VYX: Full history saved. [2025-09-26T22:02:49.300101] [INFO ] [MAIN ] Update Progress: 2267/2371 symbols completed. VYX took 36.6s. Estimated remaining: 13m 53s. Rate: 7.5 symbols/min [2025-09-26T22:02:49.476356] [INFO ] [MAIN ] WAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:02:49.518542] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-05. [2025-09-26T22:02:49.521739] [DEBUG] [LOCAL ] WAL: Loaded 45685 existing records from primary storage. [2025-09-26T22:02:49.521836] [INFO ] [MAIN ] WAL: Loaded 45685 existing records. [2025-09-26T22:02:49.706283] [WARN ] [MAIN ] WAL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:02:49.706602] [INFO ] [MAIN ] WAL: Wiping existing primary data before full refresh. [2025-09-26T22:02:49.706695] [INFO ] [LOCAL ] WAL: Starting deletion of primary data. [2025-09-26T22:02:49.707818] [DEBUG] [LOCAL ] WAL: Deleted primary data file. [2025-09-26T22:02:49.707879] [INFO ] [MAIN ] WAL: Starting full primary refresh. [2025-09-26T22:02:50.104206] [INFO ] [REMOTE ] WAL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:02:50.197115] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-26T22:02:50.311721] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-09. [2025-09-26T22:02:50.594732] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-26T22:02:50.698718] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-26T22:02:50.709637] [INFO ] [REMOTE ] VZ: Full fetch complete (77958 records). [2025-09-26T22:02:50.709904] [DEBUG] [VALIDATOR ] VZ: Validating primary data. [2025-09-26T22:02:51.123527] [INFO ] [REMOTE ] WAL: Fetching primary data for 2024-12. [2025-09-26T22:02:51.151597] [DEBUG] [VALIDATOR ] VZ: All expected trading days are present. [2025-09-26T22:02:51.151742] [DEBUG] [VALIDATOR ] VZ: Primary data validation passed. [2025-09-26T22:02:51.153177] [INFO ] [MAIN ] VZ: Fetched primary data is valid. [2025-09-26T22:02:51.153426] [DEBUG] [LOCAL ] VZ: Saving primary data. [2025-09-26T22:02:51.155462] [DEBUG] [LOCAL ] VZ: Trimmed 77958 records to 54571 (keeping 200 days of data) [2025-09-26T22:02:51.506732] [DEBUG] [LOCAL ] VZ: Primary data saved (54571 records). [2025-09-26T22:02:51.506980] [INFO ] [MAIN ] VZ: Full history saved. [2025-09-26T22:02:51.507116] [INFO ] [MAIN ] Update Progress: 2268/2371 symbols completed. VZ took 31.1s. Estimated remaining: 13m 45s. Rate: 7.5 symbols/min [2025-09-26T22:02:51.698518] [INFO ] [MAIN ] WAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:02:51.726012] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-26T22:02:51.770113] [DEBUG] [LOCAL ] WAT: Loaded 35382 existing records from primary storage. [2025-09-26T22:02:51.770383] [INFO ] [MAIN ] WAT: Loaded 35382 existing records. [2025-09-26T22:02:51.916963] [INFO ] [REMOTE ] W: Fetching primary data for 2025-07. [2025-09-26T22:02:51.961427] [WARN ] [MAIN ] WAT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:02:51.961708] [INFO ] [MAIN ] WAT: Wiping existing primary data before full refresh. [2025-09-26T22:02:51.961767] [INFO ] [LOCAL ] WAT: Starting deletion of primary data. [2025-09-26T22:02:51.962638] [DEBUG] [LOCAL ] WAT: Deleted primary data file. [2025-09-26T22:02:51.962725] [INFO ] [MAIN ] WAT: Starting full primary refresh. [2025-09-26T22:02:52.379786] [INFO ] [REMOTE ] WAT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:02:52.711720] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-06. [2025-09-26T22:02:52.869345] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-26T22:02:53.511729] [INFO ] [REMOTE ] WAT: Fetching primary data for 2024-12. [2025-09-26T22:02:54.071349] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-26T22:02:54.240694] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-26T22:02:54.311745] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-07. [2025-09-26T22:02:54.430319] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-26T22:02:55.111728] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-01. [2025-09-26T22:02:55.911731] [INFO ] [REMOTE ] W: Fetching primary data for 2025-08. [2025-09-26T22:02:56.049078] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-26T22:02:56.460023] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-26T22:02:56.711745] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-02. [2025-09-26T22:02:57.511757] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-08. [2025-09-26T22:02:57.979871] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-26T22:02:58.228279] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-26T22:02:58.311731] [INFO ] [REMOTE ] W: Fetching primary data for 2025-09. [2025-09-26T22:02:59.111761] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-01. [2025-09-26T22:02:59.162115] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-26T22:02:59.911762] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-03. [2025-09-26T22:03:00.164799] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-26T22:03:00.176180] [INFO ] [REMOTE ] W: Full fetch complete (77430 records). [2025-09-26T22:03:00.176323] [DEBUG] [VALIDATOR ] W: Validating primary data. [2025-09-26T22:03:00.594590] [DEBUG] [VALIDATOR ] W: All expected trading days are present. [2025-09-26T22:03:00.594867] [DEBUG] [VALIDATOR ] W: Primary data validation passed. [2025-09-26T22:03:00.596244] [INFO ] [MAIN ] W: Fetched primary data is valid. [2025-09-26T22:03:00.596329] [DEBUG] [LOCAL ] W: Saving primary data. [2025-09-26T22:03:00.598670] [DEBUG] [LOCAL ] W: Trimmed 77430 records to 54266 (keeping 200 days of data) [2025-09-26T22:03:00.713591] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-09. [2025-09-26T22:03:00.867371] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-26T22:03:01.013850] [DEBUG] [LOCAL ] W: Primary data saved (54266 records). [2025-09-26T22:03:01.014029] [INFO ] [MAIN ] W: Full history saved. [2025-09-26T22:03:01.014200] [INFO ] [MAIN ] Update Progress: 2269/2371 symbols completed. W took 32.0s. Estimated remaining: 13m 37s. Rate: 7.5 symbols/min [2025-09-26T22:03:01.268308] [INFO ] [MAIN ] WBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:03:01.268684] [DEBUG] [LOCAL ] WBI: No existing data file found in primary storage. [2025-09-26T22:03:01.268776] [WARN ] [MAIN ] WBI: No existing data found, performing full refresh instead. [2025-09-26T22:03:01.269188] [INFO ] [MAIN ] WBI: Wiping existing primary data before full refresh. [2025-09-26T22:03:01.269312] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-09-26T22:03:01.269476] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-09-26T22:03:01.269590] [INFO ] [MAIN ] WBI: Starting full primary refresh. [2025-09-26T22:03:01.516844] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-02. [2025-09-26T22:03:01.537942] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-26T22:03:01.876119] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-26T22:03:01.883588] [INFO ] [REMOTE ] WBI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:03:01.894828] [INFO ] [REMOTE ] WAB: Full fetch complete (64507 records). [2025-09-26T22:03:01.895042] [DEBUG] [VALIDATOR ] WAB: Validating primary data. [2025-09-26T22:03:02.317016] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-04. [2025-09-26T22:03:02.482782] [DEBUG] [VALIDATOR ] WAB: All expected trading days are present. [2025-09-26T22:03:02.482885] [DEBUG] [VALIDATOR ] WAB: Primary data validation passed. [2025-09-26T22:03:02.483959] [INFO ] [MAIN ] WAB: Fetched primary data is valid. [2025-09-26T22:03:02.484031] [DEBUG] [LOCAL ] WAB: Saving primary data. [2025-09-26T22:03:02.487829] [DEBUG] [LOCAL ] WAB: Trimmed 64507 records to 44872 (keeping 200 days of data) [2025-09-26T22:03:02.791125] [DEBUG] [LOCAL ] WAB: Primary data saved (44872 records). [2025-09-26T22:03:02.791278] [INFO ] [MAIN ] WAB: Full history saved. [2025-09-26T22:03:02.791385] [INFO ] [MAIN ] Update Progress: 2270/2371 symbols completed. WAB took 26.9s. Estimated remaining: 13m 29s. Rate: 7.5 symbols/min [2025-09-26T22:03:02.977758] [INFO ] [MAIN ] WBS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:03:03.025889] [DEBUG] [LOCAL ] WBS: Loaded 49117 existing records from primary storage. [2025-09-26T22:03:03.026073] [INFO ] [MAIN ] WBS: Loaded 49117 existing records. [2025-09-26T22:03:03.112901] [INFO ] [REMOTE ] WBI: Fetching primary data for 2024-12. [2025-09-26T22:03:03.228469] [WARN ] [MAIN ] WBS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:03:03.228812] [INFO ] [MAIN ] WBS: Wiping existing primary data before full refresh. [2025-09-26T22:03:03.229012] [INFO ] [LOCAL ] WBS: Starting deletion of primary data. [2025-09-26T22:03:03.230241] [DEBUG] [LOCAL ] WBS: Deleted primary data file. [2025-09-26T22:03:03.230303] [INFO ] [MAIN ] WBS: Starting full primary refresh. [2025-09-26T22:03:03.375929] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T22:03:03.411352] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-26T22:03:03.416788] [WARN ] [REMOTE ] WBI: No data returned for month 2024-12 [2025-09-26T22:03:03.701797] [INFO ] [REMOTE ] WBS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:03:03.859461] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-26T22:03:03.911733] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-05. [2025-09-26T22:03:04.711731] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-03. [2025-09-26T22:03:05.448200] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-26T22:03:05.511682] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-01. [2025-09-26T22:03:05.717859] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T22:03:05.718264] [WARN ] [REMOTE ] WBI: No data returned for month 2025-01 [2025-09-26T22:03:06.267945] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-26T22:03:06.311747] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-06. [2025-09-26T22:03:07.111770] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-04. [2025-09-26T22:03:07.702808] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-26T22:03:07.911737] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-02. [2025-09-26T22:03:08.120885] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T22:03:08.121233] [WARN ] [REMOTE ] WBI: No data returned for month 2025-02 [2025-09-26T22:03:08.711771] [INFO ] [REMOTE ] WBS: Fetching primary data for 2024-12. [2025-09-26T22:03:09.053101] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-26T22:03:09.511747] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-05. [2025-09-26T22:03:10.311713] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-03. [2025-09-26T22:03:10.368580] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-26T22:03:10.513220] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T22:03:10.513580] [WARN ] [REMOTE ] WBI: No data returned for month 2025-03 [2025-09-26T22:03:11.083428] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-26T22:03:11.111698] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-07. [2025-09-26T22:03:11.911725] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-06. [2025-09-26T22:03:12.707611] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-26T22:03:12.716890] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-01. [2025-09-26T22:03:13.511724] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-04. [2025-09-26T22:03:13.644362] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-26T22:03:13.715933] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T22:03:13.716304] [WARN ] [REMOTE ] WBI: No data returned for month 2025-04 [2025-09-26T22:03:14.311722] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-07. [2025-09-26T22:03:14.504772] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-26T22:03:15.111755] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-02. [2025-09-26T22:03:15.911694] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-05. [2025-09-26T22:03:16.090186] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-26T22:03:16.118568] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T22:03:16.118932] [WARN ] [REMOTE ] WBI: No data returned for month 2025-05 [2025-09-26T22:03:16.711710] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-08. [2025-09-26T22:03:16.756121] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-26T22:03:17.511746] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-06. [2025-09-26T22:03:17.714855] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T22:03:17.715289] [WARN ] [REMOTE ] WBI: No data returned for month 2025-06 [2025-09-26T22:03:18.311733] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-07. [2025-09-26T22:03:18.379779] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-26T22:03:18.506466] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T22:03:18.506905] [WARN ] [REMOTE ] WBI: No data returned for month 2025-07 [2025-09-26T22:03:19.111734] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-08. [2025-09-26T22:03:19.329975] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T22:03:19.330422] [WARN ] [REMOTE ] WBI: No data returned for month 2025-08 [2025-09-26T22:03:19.911740] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-09. [2025-09-26T22:03:20.711723] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-09. [2025-09-26T22:03:21.030002] [INFO ] [REMOTE ] WBI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-26T22:03:21.034007] [INFO ] [REMOTE ] WBI: Full fetch complete (2584 records). [2025-09-26T22:03:21.034087] [DEBUG] [VALIDATOR ] WBI: Validating primary data. [2025-09-26T22:03:21.231696] [WARN ] [VALIDATOR ] WBI: Validation failed - insufficient historical data. Have 8 unique days, need 200 days [2025-09-26T22:03:21.231936] [FATAL] [MAIN ] WBI: Fetched primary data is invalid. Refusing to save it. [2025-09-26T22:03:21.232008] [WARN ] [MAIN ] WBI: Deleting existing primary and derivative data due to validation failure. [2025-09-26T22:03:21.232082] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-09-26T22:03:21.232176] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-09-26T22:03:21.232248] [INFO ] [LOCAL ] WBI: Starting deletion of derivative data. [2025-09-26T22:03:21.232319] [DEBUG] [LOCAL ] WBI: No derivative data file found to delete. [2025-09-26T22:03:21.232386] [INFO ] [MAIN ] Update Progress: 2271/2371 symbols completed. WBI took 20.2s. Estimated remaining: 13m 21s. Rate: 7.5 symbols/min [2025-09-26T22:03:21.419905] [INFO ] [MAIN ] WBX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:03:21.437838] [DEBUG] [LOCAL ] WBX: Loaded 12545 existing records from primary storage. [2025-09-26T22:03:21.437989] [INFO ] [MAIN ] WBX: Loaded 12545 existing records. [2025-09-26T22:03:21.516843] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-08. [2025-09-26T22:03:21.641174] [WARN ] [MAIN ] WBX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:03:21.641459] [INFO ] [MAIN ] WBX: Wiping existing primary data before full refresh. [2025-09-26T22:03:21.641521] [INFO ] [LOCAL ] WBX: Starting deletion of primary data. [2025-09-26T22:03:21.641906] [DEBUG] [LOCAL ] WBX: Deleted primary data file. [2025-09-26T22:03:21.641974] [INFO ] [MAIN ] WBX: Starting full primary refresh. [2025-09-26T22:03:22.037720] [INFO ] [REMOTE ] WBX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:03:22.311716] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-03. [2025-09-26T22:03:22.439637] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-26T22:03:22.449705] [INFO ] [REMOTE ] WAL: Full fetch complete (66518 records). [2025-09-26T22:03:22.449904] [DEBUG] [VALIDATOR ] WAL: Validating primary data. [2025-09-26T22:03:22.898460] [DEBUG] [VALIDATOR ] WAL: All expected trading days are present. [2025-09-26T22:03:22.898583] [DEBUG] [VALIDATOR ] WAL: Primary data validation passed. [2025-09-26T22:03:22.899777] [INFO ] [MAIN ] WAL: Fetched primary data is valid. [2025-09-26T22:03:22.899921] [DEBUG] [LOCAL ] WAL: Saving primary data. [2025-09-26T22:03:22.901561] [DEBUG] [LOCAL ] WAL: Trimmed 66518 records to 46040 (keeping 200 days of data) [2025-09-26T22:03:23.049463] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-26T22:03:23.130035] [INFO ] [REMOTE ] WBX: Fetching primary data for 2024-12. [2025-09-26T22:03:23.250783] [DEBUG] [LOCAL ] WAL: Primary data saved (46040 records). [2025-09-26T22:03:23.250941] [INFO ] [MAIN ] WAL: Full history saved. [2025-09-26T22:03:23.251064] [INFO ] [MAIN ] Update Progress: 2272/2371 symbols completed. WAL took 34.0s. Estimated remaining: 13m 13s. Rate: 7.5 symbols/min [2025-09-26T22:03:23.436790] [INFO ] [MAIN ] WCC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:03:23.479576] [DEBUG] [LOCAL ] WCC: Loaded 40294 existing records from primary storage. [2025-09-26T22:03:23.479864] [INFO ] [MAIN ] WCC: Loaded 40294 existing records. [2025-09-26T22:03:23.681865] [WARN ] [MAIN ] WCC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:03:23.682321] [INFO ] [MAIN ] WCC: Wiping existing primary data before full refresh. [2025-09-26T22:03:23.682372] [INFO ] [LOCAL ] WCC: Starting deletion of primary data. [2025-09-26T22:03:23.683342] [DEBUG] [LOCAL ] WCC: Deleted primary data file. [2025-09-26T22:03:23.683405] [INFO ] [MAIN ] WCC: Starting full primary refresh. [2025-09-26T22:03:23.919571] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-09. [2025-09-26T22:03:24.099371] [INFO ] [REMOTE ] WCC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:03:24.151850] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-26T22:03:24.585138] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-26T22:03:24.672169] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-26T22:03:24.679601] [INFO ] [REMOTE ] WAT: Full fetch complete (49971 records). [2025-09-26T22:03:24.679778] [DEBUG] [VALIDATOR ] WAT: Validating primary data. [2025-09-26T22:03:24.716782] [INFO ] [REMOTE ] WCC: Fetching primary data for 2024-12. [2025-09-26T22:03:25.101999] [DEBUG] [VALIDATOR ] WAT: All expected trading days are present. [2025-09-26T22:03:25.102084] [DEBUG] [VALIDATOR ] WAT: Primary data validation passed. [2025-09-26T22:03:25.103030] [INFO ] [MAIN ] WAT: Fetched primary data is valid. [2025-09-26T22:03:25.103095] [DEBUG] [LOCAL ] WAT: Saving primary data. [2025-09-26T22:03:25.104357] [DEBUG] [LOCAL ] WAT: Trimmed 49971 records to 35620 (keeping 200 days of data) [2025-09-26T22:03:25.348394] [DEBUG] [LOCAL ] WAT: Primary data saved (35620 records). [2025-09-26T22:03:25.348676] [INFO ] [MAIN ] WAT: Full history saved. [2025-09-26T22:03:25.348783] [INFO ] [MAIN ] Update Progress: 2273/2371 symbols completed. WAT took 33.8s. Estimated remaining: 13m 5s. Rate: 7.5 symbols/min [2025-09-26T22:03:25.522314] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-01. [2025-09-26T22:03:25.526525] [INFO ] [MAIN ] WCN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:03:25.584161] [DEBUG] [LOCAL ] WCN: Loaded 48385 existing records from primary storage. [2025-09-26T22:03:25.584310] [INFO ] [MAIN ] WCN: Loaded 48385 existing records. [2025-09-26T22:03:25.775418] [WARN ] [MAIN ] WCN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:03:25.775962] [INFO ] [MAIN ] WCN: Wiping existing primary data before full refresh. [2025-09-26T22:03:25.776046] [INFO ] [LOCAL ] WCN: Starting deletion of primary data. [2025-09-26T22:03:25.777756] [DEBUG] [LOCAL ] WCN: Deleted primary data file. [2025-09-26T22:03:25.777844] [INFO ] [MAIN ] WCN: Starting full primary refresh. [2025-09-26T22:03:26.315790] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-04. [2025-09-26T22:03:26.401232] [INFO ] [REMOTE ] WCN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:03:26.432771] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-26T22:03:26.848787] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-26T22:03:27.111735] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-01. [2025-09-26T22:03:27.854414] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-26T22:03:27.911710] [INFO ] [REMOTE ] WCN: Fetching primary data for 2024-12. [2025-09-26T22:03:28.711721] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-05. [2025-09-26T22:03:28.776486] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-26T22:03:29.511760] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-02. [2025-09-26T22:03:29.733457] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-26T22:03:30.311751] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-01. [2025-09-26T22:03:30.463935] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-26T22:03:30.799780] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-26T22:03:31.111718] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-06. [2025-09-26T22:03:31.911707] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-02. [2025-09-26T22:03:32.042833] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-26T22:03:32.711713] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-03. [2025-09-26T22:03:32.837260] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-26T22:03:33.511705] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-07. [2025-09-26T22:03:33.514505] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-26T22:03:33.984484] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-26T22:03:34.311727] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-02. [2025-09-26T22:03:35.111728] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-03. [2025-09-26T22:03:35.357618] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-26T22:03:35.911689] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-04. [2025-09-26T22:03:36.031994] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-26T22:03:36.679367] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-26T22:03:36.711690] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-03. [2025-09-26T22:03:36.837600] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-26T22:03:37.511731] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-04. [2025-09-26T22:03:38.311695] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-08. [2025-09-26T22:03:38.405533] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-26T22:03:39.111695] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-05. [2025-09-26T22:03:39.138935] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-26T22:03:39.911696] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-04. [2025-09-26T22:03:39.951842] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-26T22:03:40.228426] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-26T22:03:40.711722] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-09. [2025-09-26T22:03:41.511724] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-06. [2025-09-26T22:03:41.893687] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-26T22:03:42.311726] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-05. [2025-09-26T22:03:42.593220] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-26T22:03:42.656546] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-26T22:03:42.666430] [INFO ] [REMOTE ] WBS: Full fetch complete (69486 records). [2025-09-26T22:03:42.666630] [DEBUG] [VALIDATOR ] WBS: Validating primary data. [2025-09-26T22:03:43.092318] [DEBUG] [VALIDATOR ] WBS: All expected trading days are present. [2025-09-26T22:03:43.092423] [DEBUG] [VALIDATOR ] WBS: Primary data validation passed. [2025-09-26T22:03:43.093634] [INFO ] [MAIN ] WBS: Fetched primary data is valid. [2025-09-26T22:03:43.093764] [DEBUG] [LOCAL ] WBS: Saving primary data. [2025-09-26T22:03:43.095699] [DEBUG] [LOCAL ] WBS: Trimmed 69486 records to 49471 (keeping 200 days of data) [2025-09-26T22:03:43.162715] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-05. [2025-09-26T22:03:43.430694] [DEBUG] [LOCAL ] WBS: Primary data saved (49471 records). [2025-09-26T22:03:43.430852] [INFO ] [MAIN ] WBS: Full history saved. [2025-09-26T22:03:43.431032] [INFO ] [MAIN ] Update Progress: 2274/2371 symbols completed. WBS took 40.6s. Estimated remaining: 12m 57s. Rate: 7.5 symbols/min [2025-09-26T22:03:43.619750] [INFO ] [MAIN ] WD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:03:43.647755] [DEBUG] [LOCAL ] WD: Loaded 23615 existing records from primary storage. [2025-09-26T22:03:43.647896] [INFO ] [MAIN ] WD: Loaded 23615 existing records. [2025-09-26T22:03:43.845459] [WARN ] [MAIN ] WD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:03:43.846064] [INFO ] [MAIN ] WD: Wiping existing primary data before full refresh. [2025-09-26T22:03:43.846314] [INFO ] [LOCAL ] WD: Starting deletion of primary data. [2025-09-26T22:03:43.847295] [DEBUG] [LOCAL ] WD: Deleted primary data file. [2025-09-26T22:03:43.847374] [INFO ] [MAIN ] WD: Starting full primary refresh. [2025-09-26T22:03:43.916532] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-07. [2025-09-26T22:03:44.202214] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-26T22:03:44.295890] [INFO ] [REMOTE ] WD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:03:44.711708] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-06. [2025-09-26T22:03:44.766618] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-26T22:03:45.068781] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-26T22:03:45.511778] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-08. [2025-09-26T22:03:46.140214] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-26T22:03:46.152393] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-26T22:03:46.311749] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-06. [2025-09-26T22:03:47.111721] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-07. [2025-09-26T22:03:47.911704] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-09. [2025-09-26T22:03:47.974333] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-26T22:03:48.341565] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-26T22:03:48.342978] [INFO ] [REMOTE ] WBX: Full fetch complete (25472 records). [2025-09-26T22:03:48.343068] [DEBUG] [VALIDATOR ] WBX: Validating primary data. [2025-09-26T22:03:48.720937] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-07. [2025-09-26T22:03:48.762091] [DEBUG] [VALIDATOR ] WBX: All expected trading days are present. [2025-09-26T22:03:48.762198] [DEBUG] [VALIDATOR ] WBX: Primary data validation passed. [2025-09-26T22:03:48.762859] [INFO ] [MAIN ] WBX: Fetched primary data is valid. [2025-09-26T22:03:48.763177] [DEBUG] [LOCAL ] WBX: Saving primary data. [2025-09-26T22:03:48.764166] [DEBUG] [LOCAL ] WBX: Trimmed 25472 records to 12558 (keeping 200 days of data) [2025-09-26T22:03:48.848589] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-26T22:03:48.878512] [DEBUG] [LOCAL ] WBX: Primary data saved (12558 records). [2025-09-26T22:03:48.879077] [INFO ] [MAIN ] WBX: Full history saved. [2025-09-26T22:03:48.879200] [INFO ] [MAIN ] Update Progress: 2275/2371 symbols completed. WBX took 27.6s. Estimated remaining: 12m 49s. Rate: 7.5 symbols/min [2025-09-26T22:03:49.074830] [INFO ] [MAIN ] WDH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:03:49.095488] [DEBUG] [LOCAL ] WDH: Loaded 17486 existing records from primary storage. [2025-09-26T22:03:49.095697] [INFO ] [MAIN ] WDH: Loaded 17486 existing records. [2025-09-26T22:03:49.282254] [WARN ] [MAIN ] WDH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:03:49.282524] [INFO ] [MAIN ] WDH: Wiping existing primary data before full refresh. [2025-09-26T22:03:49.282573] [INFO ] [LOCAL ] WDH: Starting deletion of primary data. [2025-09-26T22:03:49.283215] [DEBUG] [LOCAL ] WDH: Deleted primary data file. [2025-09-26T22:03:49.283276] [INFO ] [MAIN ] WDH: Starting full primary refresh. [2025-09-26T22:03:49.517118] [INFO ] [REMOTE ] WD: Fetching primary data for 2024-12. [2025-09-26T22:03:49.647153] [INFO ] [REMOTE ] WDH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:03:50.311737] [INFO ] [REMOTE ] WDH: Fetching primary data for 2024-12. [2025-09-26T22:03:50.587203] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-26T22:03:50.599163] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-26T22:03:51.111721] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-01. [2025-09-26T22:03:51.296431] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-26T22:03:51.911704] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-08. [2025-09-26T22:03:52.020864] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-26T22:03:52.711732] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-01. [2025-09-26T22:03:53.492369] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-26T22:03:53.511691] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-02. [2025-09-26T22:03:53.689062] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-26T22:03:54.311723] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-02. [2025-09-26T22:03:54.395852] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-26T22:03:55.111734] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-03. [2025-09-26T22:03:55.450181] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-26T22:03:55.911727] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-09. [2025-09-26T22:03:56.104970] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-26T22:03:56.711751] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-04. [2025-09-26T22:03:57.511709] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-03. [2025-09-26T22:03:57.653090] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-26T22:03:57.653428] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-26T22:03:57.667114] [INFO ] [REMOTE ] WCN: Full fetch complete (69461 records). [2025-09-26T22:03:57.667244] [DEBUG] [VALIDATOR ] WCN: Validating primary data. [2025-09-26T22:03:58.066324] [DEBUG] [VALIDATOR ] WCN: All expected trading days are present. [2025-09-26T22:03:58.066413] [DEBUG] [VALIDATOR ] WCN: Primary data validation passed. [2025-09-26T22:03:58.067549] [INFO ] [MAIN ] WCN: Fetched primary data is valid. [2025-09-26T22:03:58.067617] [DEBUG] [LOCAL ] WCN: Saving primary data. [2025-09-26T22:03:58.072145] [DEBUG] [LOCAL ] WCN: Trimmed 69461 records to 48708 (keeping 200 days of data) [2025-09-26T22:03:58.312014] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-05. [2025-09-26T22:03:58.393741] [DEBUG] [LOCAL ] WCN: Primary data saved (48708 records). [2025-09-26T22:03:58.393927] [INFO ] [MAIN ] WCN: Full history saved. [2025-09-26T22:03:58.394087] [INFO ] [MAIN ] Update Progress: 2276/2371 symbols completed. WCN took 33.0s. Estimated remaining: 12m 41s. Rate: 7.5 symbols/min [2025-09-26T22:03:58.577989] [INFO ] [MAIN ] WDI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:03:58.578218] [DEBUG] [LOCAL ] WDI: No existing data file found in primary storage. [2025-09-26T22:03:58.578424] [WARN ] [MAIN ] WDI: No existing data found, performing full refresh instead. [2025-09-26T22:03:58.578585] [INFO ] [MAIN ] WDI: Wiping existing primary data before full refresh. [2025-09-26T22:03:58.578631] [INFO ] [LOCAL ] WDI: Starting deletion of primary data. [2025-09-26T22:03:58.578717] [DEBUG] [LOCAL ] WDI: No primary data file found to delete. [2025-09-26T22:03:58.578761] [INFO ] [MAIN ] WDI: Starting full primary refresh. [2025-09-26T22:03:58.900531] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-26T22:03:58.988632] [INFO ] [REMOTE ] WDI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:03:59.103450] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-26T22:03:59.111680] [INFO ] [REMOTE ] WDI: Fetching primary data for 2024-12. [2025-09-26T22:03:59.911735] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-08. [2025-09-26T22:04:00.494488] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-26T22:04:00.711758] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-04. [2025-09-26T22:04:01.511730] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-01. [2025-09-26T22:04:01.547185] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-26T22:04:02.000408] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-26T22:04:02.311729] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-05. [2025-09-26T22:04:02.720014] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-26T22:04:03.111686] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-06. [2025-09-26T22:04:03.518284] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-26T22:04:03.911729] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-09. [2025-09-26T22:04:04.086749] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-26T22:04:04.711771] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-02. [2025-09-26T22:04:05.511726] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-07. [2025-09-26T22:04:05.654439] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-26T22:04:05.663227] [INFO ] [REMOTE ] WCC: Full fetch complete (58010 records). [2025-09-26T22:04:05.663414] [DEBUG] [VALIDATOR ] WCC: Validating primary data. [2025-09-26T22:04:06.112232] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-26T22:04:06.119232] [DEBUG] [VALIDATOR ] WCC: All expected trading days are present. [2025-09-26T22:04:06.119858] [DEBUG] [VALIDATOR ] WCC: Primary data validation passed. [2025-09-26T22:04:06.121240] [INFO ] [MAIN ] WCC: Fetched primary data is valid. [2025-09-26T22:04:06.121335] [DEBUG] [LOCAL ] WCC: Saving primary data. [2025-09-26T22:04:06.124747] [DEBUG] [LOCAL ] WCC: Trimmed 58010 records to 40567 (keeping 200 days of data) [2025-09-26T22:04:06.323979] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-03. [2025-09-26T22:04:06.410980] [DEBUG] [LOCAL ] WCC: Primary data saved (40567 records). [2025-09-26T22:04:06.411142] [INFO ] [MAIN ] WCC: Full history saved. [2025-09-26T22:04:06.411250] [INFO ] [MAIN ] Update Progress: 2277/2371 symbols completed. WCC took 43.2s. Estimated remaining: 12m 33s. Rate: 7.5 symbols/min [2025-09-26T22:04:06.691575] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-26T22:04:07.111727] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-08. [2025-09-26T22:04:07.451861] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-26T22:04:07.896004] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-26T22:04:07.911672] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-09. [2025-09-26T22:04:08.711755] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-06. [2025-09-26T22:04:09.274028] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-26T22:04:09.280438] [INFO ] [REMOTE ] WDH: Full fetch complete (23054 records). [2025-09-26T22:04:09.280530] [DEBUG] [VALIDATOR ] WDH: Validating primary data. [2025-09-26T22:04:09.516848] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-04. [2025-09-26T22:04:09.709335] [DEBUG] [VALIDATOR ] WDH: All expected trading days are present. [2025-09-26T22:04:09.709521] [DEBUG] [VALIDATOR ] WDH: Primary data validation passed. [2025-09-26T22:04:09.710169] [INFO ] [MAIN ] WDH: Fetched primary data is valid. [2025-09-26T22:04:09.710320] [DEBUG] [LOCAL ] WDH: Saving primary data. [2025-09-26T22:04:09.711156] [DEBUG] [LOCAL ] WDH: Trimmed 23054 records to 17597 (keeping 200 days of data) [2025-09-26T22:04:09.821778] [DEBUG] [LOCAL ] WDH: Primary data saved (17597 records). [2025-09-26T22:04:09.822032] [INFO ] [MAIN ] WDH: Full history saved. [2025-09-26T22:04:09.822157] [INFO ] [MAIN ] Update Progress: 2278/2371 symbols completed. WDH took 20.9s. Estimated remaining: 12m 25s. Rate: 7.5 symbols/min [2025-09-26T22:04:09.873941] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-26T22:04:10.311735] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-07. [2025-09-26T22:04:10.857789] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-26T22:04:11.111707] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-05. [2025-09-26T22:04:11.179555] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-26T22:04:11.911730] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-08. [2025-09-26T22:04:12.504067] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-26T22:04:12.711727] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-06. [2025-09-26T22:04:12.983115] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-26T22:04:13.471539] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-26T22:04:13.511698] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-07. [2025-09-26T22:04:14.311757] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-09. [2025-09-26T22:04:14.565403] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-26T22:04:15.111746] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-08. [2025-09-26T22:04:15.551739] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-26T22:04:15.556618] [INFO ] [REMOTE ] WD: Full fetch complete (33014 records). [2025-09-26T22:04:15.556747] [DEBUG] [VALIDATOR ] WD: Validating primary data. [2025-09-26T22:04:15.948188] [DEBUG] [VALIDATOR ] WD: All expected trading days are present. [2025-09-26T22:04:15.948275] [DEBUG] [VALIDATOR ] WD: Primary data validation passed. [2025-09-26T22:04:15.949052] [INFO ] [MAIN ] WD: Fetched primary data is valid. [2025-09-26T22:04:15.949118] [DEBUG] [LOCAL ] WD: Saving primary data. [2025-09-26T22:04:15.950086] [DEBUG] [LOCAL ] WD: Trimmed 33014 records to 23747 (keeping 200 days of data) [2025-09-26T22:04:16.106707] [DEBUG] [LOCAL ] WD: Primary data saved (23747 records). [2025-09-26T22:04:16.106973] [INFO ] [MAIN ] WD: Full history saved. [2025-09-26T22:04:16.107196] [INFO ] [MAIN ] Update Progress: 2279/2371 symbols completed. WD took 32.7s. Estimated remaining: 12m 17s. Rate: 7.5 symbols/min [2025-09-26T22:04:16.197388] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-26T22:04:16.202836] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-09. [2025-09-26T22:04:17.243151] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-26T22:04:17.247398] [INFO ] [REMOTE ] WDI: Full fetch complete (30752 records). [2025-09-26T22:04:17.247506] [DEBUG] [VALIDATOR ] WDI: Validating primary data. [2025-09-26T22:04:17.649863] [DEBUG] [VALIDATOR ] WDI: All expected trading days are present. [2025-09-26T22:04:17.649946] [DEBUG] [VALIDATOR ] WDI: Primary data validation passed. [2025-09-26T22:04:17.650594] [INFO ] [MAIN ] WDI: Fetched primary data is valid. [2025-09-26T22:04:17.650636] [DEBUG] [LOCAL ] WDI: Saving primary data. [2025-09-26T22:04:17.652821] [DEBUG] [LOCAL ] WDI: Trimmed 30752 records to 21314 (keeping 200 days of data) [2025-09-26T22:04:17.792053] [DEBUG] [LOCAL ] WDI: Primary data saved (21314 records). [2025-09-26T22:04:17.792200] [INFO ] [MAIN ] WDI: Full history saved. [2025-09-26T22:04:17.792289] [INFO ] [MAIN ] Update Progress: 2280/2371 symbols completed. WDI took 19.4s. Estimated remaining: 12m 9s. Rate: 7.5 symbols/min [2025-09-26T22:04:18.469952] [INFO ] [MAIN ] WEA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:04:18.489942] [INFO ] [MAIN ] WEC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:04:18.599812] [INFO ] [MAIN ] WDS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:04:18.604057] [INFO ] [MAIN ] WEAV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:04:18.618131] [DEBUG] [LOCAL ] WEA: Loaded 7359 existing records from primary storage. [2025-09-26T22:04:18.618390] [INFO ] [MAIN ] WEA: Loaded 7359 existing records. [2025-09-26T22:04:18.868850] [DEBUG] [LOCAL ] WEAV: Loaded 42256 existing records from primary storage. [2025-09-26T22:04:18.895315] [WARN ] [MAIN ] WEA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:04:18.895441] [INFO ] [MAIN ] WEAV: Loaded 42256 existing records. [2025-09-26T22:04:18.926076] [INFO ] [MAIN ] WEA: Wiping existing primary data before full refresh. [2025-09-26T22:04:18.934673] [DEBUG] [LOCAL ] WDS: Loaded 43934 existing records from primary storage. [2025-09-26T22:04:18.934798] [INFO ] [LOCAL ] WEA: Starting deletion of primary data. [2025-09-26T22:04:18.946606] [INFO ] [MAIN ] WDS: Loaded 43934 existing records. [2025-09-26T22:04:18.966163] [DEBUG] [LOCAL ] WEA: Deleted primary data file. [2025-09-26T22:04:19.034676] [INFO ] [MAIN ] WEA: Starting full primary refresh. [2025-09-26T22:04:19.056161] [DEBUG] [LOCAL ] WEC: Loaded 52584 existing records from primary storage. [2025-09-26T22:04:19.151048] [INFO ] [MAIN ] WEC: Loaded 52584 existing records. [2025-09-26T22:04:19.586891] [WARN ] [MAIN ] WEAV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:04:19.587084] [WARN ] [MAIN ] WDS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:04:19.680840] [INFO ] [MAIN ] WEAV: Wiping existing primary data before full refresh. [2025-09-26T22:04:19.764712] [INFO ] [MAIN ] WDS: Wiping existing primary data before full refresh. [2025-09-26T22:04:19.773013] [INFO ] [LOCAL ] WEAV: Starting deletion of primary data. [2025-09-26T22:04:19.791196] [WARN ] [MAIN ] WEC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:04:19.791356] [INFO ] [LOCAL ] WDS: Starting deletion of primary data. [2025-09-26T22:04:19.817807] [DEBUG] [LOCAL ] WDS: Deleted primary data file. [2025-09-26T22:04:19.802024] [DEBUG] [LOCAL ] WEAV: Deleted primary data file. [2025-09-26T22:04:19.850769] [INFO ] [MAIN ] WDS: Starting full primary refresh. [2025-09-26T22:04:19.833896] [INFO ] [MAIN ] WEC: Wiping existing primary data before full refresh. [2025-09-26T22:04:19.856195] [INFO ] [MAIN ] WEAV: Starting full primary refresh. [2025-09-26T22:04:19.871774] [INFO ] [LOCAL ] WEC: Starting deletion of primary data. [2025-09-26T22:04:19.883457] [DEBUG] [LOCAL ] WEC: Deleted primary data file. [2025-09-26T22:04:19.972032] [INFO ] [MAIN ] WEC: Starting full primary refresh. [2025-09-26T22:04:20.377223] [INFO ] [REMOTE ] WEA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:04:20.467007] [INFO ] [REMOTE ] WEA: Fetching primary data for 2024-12. [2025-09-26T22:04:21.103355] [INFO ] [REMOTE ] WDS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:04:21.156610] [INFO ] [REMOTE ] WDS: Fetching primary data for 2024-12. [2025-09-26T22:04:21.213064] [INFO ] [REMOTE ] WEAV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:04:21.272541] [INFO ] [REMOTE ] WEC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:04:21.272901] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2024-12. [2025-09-26T22:04:21.274845] [INFO ] [REMOTE ] WEC: Fetching primary data for 2024-12. [2025-09-26T22:04:21.329795] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-26T22:04:21.331903] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-01. [2025-09-26T22:04:21.953899] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-26T22:04:21.955820] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-02. [2025-09-26T22:04:22.526154] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-26T22:04:22.529375] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-03. [2025-09-26T22:04:22.787222] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-26T22:04:22.797756] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-01. [2025-09-26T22:04:22.864943] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-26T22:04:22.934573] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-26T22:04:22.985548] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-26T22:04:23.111720] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-04. [2025-09-26T22:04:23.809327] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-26T22:04:23.911696] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-01. [2025-09-26T22:04:24.238997] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-26T22:04:24.711715] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-02. [2025-09-26T22:04:25.511699] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-05. [2025-09-26T22:04:25.567453] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-26T22:04:26.162475] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-26T22:04:26.262296] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-26T22:04:26.311701] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-03. [2025-09-26T22:04:27.111721] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-02. [2025-09-26T22:04:27.866416] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T22:04:27.911691] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-01. [2025-09-26T22:04:28.716805] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-04. [2025-09-26T22:04:28.734158] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-26T22:04:29.511759] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-03. [2025-09-26T22:04:29.731902] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-26T22:04:29.789250] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-26T22:04:30.311715] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-05. [2025-09-26T22:04:31.111696] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-06. [2025-09-26T22:04:31.200896] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-26T22:04:31.786291] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-26T22:04:31.816869] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-26T22:04:31.911764] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-07. [2025-09-26T22:04:32.582826] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-26T22:04:32.711713] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-02. [2025-09-26T22:04:33.511723] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-04. [2025-09-26T22:04:34.311749] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-08. [2025-09-26T22:04:34.535709] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-26T22:04:35.019030] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-26T22:04:35.111761] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-06. [2025-09-26T22:04:35.226782] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T22:04:35.911746] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-09. [2025-09-26T22:04:36.441681] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-26T22:04:36.615939] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-26T22:04:36.619144] [INFO ] [REMOTE ] WEA: Full fetch complete (9824 records). [2025-09-26T22:04:36.619397] [DEBUG] [VALIDATOR ] WEA: Validating primary data. [2025-09-26T22:04:36.716897] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-03. [2025-09-26T22:04:36.994991] [DEBUG] [VALIDATOR ] WEA: All expected trading days are present. [2025-09-26T22:04:36.995090] [DEBUG] [VALIDATOR ] WEA: Primary data validation passed. [2025-09-26T22:04:36.995402] [INFO ] [MAIN ] WEA: Fetched primary data is valid. [2025-09-26T22:04:36.995457] [DEBUG] [LOCAL ] WEA: Saving primary data. [2025-09-26T22:04:36.995950] [DEBUG] [LOCAL ] WEA: Trimmed 9824 records to 7379 (keeping 200 days of data) [2025-09-26T22:04:37.047742] [DEBUG] [LOCAL ] WEA: Primary data saved (7379 records). [2025-09-26T22:04:37.047910] [INFO ] [MAIN ] WEA: Full history saved. [2025-09-26T22:04:37.048008] [INFO ] [MAIN ] Update Progress: 2281/2371 symbols completed. WEA took 19.3s. Estimated remaining: 12m 1s. Rate: 7.5 symbols/min [2025-09-26T22:04:37.230050] [INFO ] [MAIN ] WELL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:04:37.289616] [DEBUG] [LOCAL ] WELL: Loaded 52744 existing records from primary storage. [2025-09-26T22:04:37.289852] [INFO ] [MAIN ] WELL: Loaded 52744 existing records. [2025-09-26T22:04:37.486037] [WARN ] [MAIN ] WELL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:04:37.486420] [INFO ] [MAIN ] WELL: Wiping existing primary data before full refresh. [2025-09-26T22:04:37.486675] [INFO ] [LOCAL ] WELL: Starting deletion of primary data. [2025-09-26T22:04:37.488084] [DEBUG] [LOCAL ] WELL: Deleted primary data file. [2025-09-26T22:04:37.488150] [INFO ] [MAIN ] WELL: Starting full primary refresh. [2025-09-26T22:04:37.521954] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-07. [2025-09-26T22:04:37.865274] [INFO ] [REMOTE ] WELL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:04:38.311717] [INFO ] [REMOTE ] WELL: Fetching primary data for 2024-12. [2025-09-26T22:04:38.724996] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-26T22:04:39.068974] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-26T22:04:39.116906] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-01. [2025-09-26T22:04:39.124985] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-26T22:04:39.911714] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-04. [2025-09-26T22:04:39.986227] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-26T22:04:40.711749] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-05. [2025-09-26T22:04:41.511762] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-08. [2025-09-26T22:04:41.734858] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-26T22:04:42.313350] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-05. [2025-09-26T22:04:42.330452] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-26T22:04:42.720432] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-26T22:04:43.111743] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-09. [2025-09-26T22:04:43.911722] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-02. [2025-09-26T22:04:44.228232] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-26T22:04:44.584497] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-26T22:04:44.593759] [INFO ] [REMOTE ] WEAV: Full fetch complete (61506 records). [2025-09-26T22:04:44.593935] [DEBUG] [VALIDATOR ] WEAV: Validating primary data. [2025-09-26T22:04:44.712171] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-06. [2025-09-26T22:04:45.024812] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-26T22:04:45.057256] [DEBUG] [VALIDATOR ] WEAV: All expected trading days are present. [2025-09-26T22:04:45.057469] [DEBUG] [VALIDATOR ] WEAV: Primary data validation passed. [2025-09-26T22:04:45.059232] [INFO ] [MAIN ] WEAV: Fetched primary data is valid. [2025-09-26T22:04:45.059322] [DEBUG] [LOCAL ] WEAV: Saving primary data. [2025-09-26T22:04:45.061013] [DEBUG] [LOCAL ] WEAV: Trimmed 61506 records to 42562 (keeping 200 days of data) [2025-09-26T22:04:45.318625] [DEBUG] [LOCAL ] WEAV: Primary data saved (42562 records). [2025-09-26T22:04:45.318839] [INFO ] [MAIN ] WEAV: Full history saved. [2025-09-26T22:04:45.318973] [INFO ] [MAIN ] Update Progress: 2282/2371 symbols completed. WEAV took 27.5s. Estimated remaining: 11m 53s. Rate: 7.5 symbols/min [2025-09-26T22:04:45.501311] [INFO ] [MAIN ] WES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:04:45.511725] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-06. [2025-09-26T22:04:45.555447] [DEBUG] [LOCAL ] WES: Loaded 48352 existing records from primary storage. [2025-09-26T22:04:45.555688] [INFO ] [MAIN ] WES: Loaded 48352 existing records. [2025-09-26T22:04:45.740181] [WARN ] [MAIN ] WES: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:04:45.740523] [INFO ] [MAIN ] WES: Wiping existing primary data before full refresh. [2025-09-26T22:04:45.740583] [INFO ] [LOCAL ] WES: Starting deletion of primary data. [2025-09-26T22:04:45.741793] [DEBUG] [LOCAL ] WES: Deleted primary data file. [2025-09-26T22:04:45.741854] [INFO ] [MAIN ] WES: Starting full primary refresh. [2025-09-26T22:04:46.129086] [INFO ] [REMOTE ] WES: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:04:46.311768] [INFO ] [REMOTE ] WES: Fetching primary data for 2024-12. [2025-09-26T22:04:46.389300] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-26T22:04:47.111748] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-07. [2025-09-26T22:04:47.366998] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-26T22:04:47.911763] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-03. [2025-09-26T22:04:48.037023] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-26T22:04:48.653659] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-26T22:04:48.716871] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-01. [2025-09-26T22:04:48.740550] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-26T22:04:49.511803] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-04. [2025-09-26T22:04:50.316875] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-07. [2025-09-26T22:04:50.331548] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-26T22:04:50.555633] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-26T22:04:51.111775] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-08. [2025-09-26T22:04:51.911754] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-05. [2025-09-26T22:04:52.152825] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-26T22:04:52.691976] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-26T22:04:52.711676] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-09. [2025-09-26T22:04:52.749862] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-26T22:04:53.511792] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-02. [2025-09-26T22:04:54.311723] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-08. [2025-09-26T22:04:54.424602] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-26T22:04:54.433753] [INFO ] [REMOTE ] WDS: Full fetch complete (64768 records). [2025-09-26T22:04:54.433974] [DEBUG] [VALIDATOR ] WDS: Validating primary data. [2025-09-26T22:04:54.850328] [DEBUG] [VALIDATOR ] WDS: All expected trading days are present. [2025-09-26T22:04:54.850445] [DEBUG] [VALIDATOR ] WDS: Primary data validation passed. [2025-09-26T22:04:54.851894] [INFO ] [MAIN ] WDS: Fetched primary data is valid. [2025-09-26T22:04:54.851973] [DEBUG] [LOCAL ] WDS: Saving primary data. [2025-09-26T22:04:54.853722] [DEBUG] [LOCAL ] WDS: Trimmed 64768 records to 44259 (keeping 200 days of data) [2025-09-26T22:04:55.111996] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-06. [2025-09-26T22:04:55.177836] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-26T22:04:55.192003] [DEBUG] [LOCAL ] WDS: Primary data saved (44259 records). [2025-09-26T22:04:55.192160] [INFO ] [MAIN ] WDS: Full history saved. [2025-09-26T22:04:55.192276] [INFO ] [MAIN ] Update Progress: 2283/2371 symbols completed. WDS took 37.4s. Estimated remaining: 11m 45s. Rate: 7.5 symbols/min [2025-09-26T22:04:55.372000] [INFO ] [MAIN ] WEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:04:55.417331] [DEBUG] [LOCAL ] WEX: Loaded 35516 existing records from primary storage. [2025-09-26T22:04:55.417674] [INFO ] [MAIN ] WEX: Loaded 35516 existing records. [2025-09-26T22:04:55.611881] [WARN ] [MAIN ] WEX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:04:55.612202] [INFO ] [MAIN ] WEX: Wiping existing primary data before full refresh. [2025-09-26T22:04:55.612321] [INFO ] [LOCAL ] WEX: Starting deletion of primary data. [2025-09-26T22:04:55.613325] [DEBUG] [LOCAL ] WEX: Deleted primary data file. [2025-09-26T22:04:55.613386] [INFO ] [MAIN ] WEX: Starting full primary refresh. [2025-09-26T22:04:55.916227] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-03. [2025-09-26T22:04:55.997513] [INFO ] [REMOTE ] WEX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:04:56.030047] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-26T22:04:56.075141] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-26T22:04:56.711774] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-07. [2025-09-26T22:04:57.519526] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-09. [2025-09-26T22:04:57.527262] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-26T22:04:57.733396] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-26T22:04:58.257603] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-26T22:04:58.269238] [INFO ] [REMOTE ] WEC: Full fetch complete (75485 records). [2025-09-26T22:04:58.269458] [DEBUG] [VALIDATOR ] WEC: Validating primary data. [2025-09-26T22:04:58.316891] [INFO ] [REMOTE ] WEX: Fetching primary data for 2024-12. [2025-09-26T22:04:58.676045] [DEBUG] [VALIDATOR ] WEC: All expected trading days are present. [2025-09-26T22:04:58.676163] [DEBUG] [VALIDATOR ] WEC: Primary data validation passed. [2025-09-26T22:04:58.678434] [INFO ] [MAIN ] WEC: Fetched primary data is valid. [2025-09-26T22:04:58.678522] [DEBUG] [LOCAL ] WEC: Saving primary data. [2025-09-26T22:04:58.680618] [DEBUG] [LOCAL ] WEC: Trimmed 75485 records to 52958 (keeping 200 days of data) [2025-09-26T22:04:59.037213] [DEBUG] [LOCAL ] WEC: Primary data saved (52958 records). [2025-09-26T22:04:59.037422] [INFO ] [MAIN ] WEC: Full history saved. [2025-09-26T22:04:59.037561] [INFO ] [MAIN ] Update Progress: 2284/2371 symbols completed. WEC took 41.2s. Estimated remaining: 11m 37s. Rate: 7.5 symbols/min [2025-09-26T22:04:59.118500] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-04. [2025-09-26T22:04:59.224171] [INFO ] [MAIN ] WF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:04:59.240070] [DEBUG] [LOCAL ] WF: Loaded 10863 existing records from primary storage. [2025-09-26T22:04:59.240322] [INFO ] [MAIN ] WF: Loaded 10863 existing records. [2025-09-26T22:04:59.474382] [WARN ] [MAIN ] WF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:04:59.474796] [INFO ] [MAIN ] WF: Wiping existing primary data before full refresh. [2025-09-26T22:04:59.474855] [INFO ] [LOCAL ] WF: Starting deletion of primary data. [2025-09-26T22:04:59.475284] [DEBUG] [LOCAL ] WF: Deleted primary data file. [2025-09-26T22:04:59.475347] [INFO ] [MAIN ] WF: Starting full primary refresh. [2025-09-26T22:04:59.797140] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-26T22:04:59.892121] [INFO ] [REMOTE ] WF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:04:59.911696] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-01. [2025-09-26T22:05:00.711702] [INFO ] [REMOTE ] WF: Fetching primary data for 2024-12. [2025-09-26T22:05:01.046322] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-26T22:05:01.511936] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-08. [2025-09-26T22:05:01.518515] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-26T22:05:01.675430] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-26T22:05:02.311759] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-01. [2025-09-26T22:05:02.374722] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-26T22:05:03.111681] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-09. [2025-09-26T22:05:03.482720] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-26T22:05:03.911716] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-02. [2025-09-26T22:05:03.982976] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-26T22:05:03.994829] [INFO ] [REMOTE ] WELL: Full fetch complete (75741 records). [2025-09-26T22:05:03.995048] [DEBUG] [VALIDATOR ] WELL: Validating primary data. [2025-09-26T22:05:04.421184] [DEBUG] [VALIDATOR ] WELL: All expected trading days are present. [2025-09-26T22:05:04.421340] [DEBUG] [VALIDATOR ] WELL: Primary data validation passed. [2025-09-26T22:05:04.423048] [INFO ] [MAIN ] WELL: Fetched primary data is valid. [2025-09-26T22:05:04.423148] [DEBUG] [LOCAL ] WELL: Saving primary data. [2025-09-26T22:05:04.425048] [DEBUG] [LOCAL ] WELL: Trimmed 75741 records to 53132 (keeping 200 days of data) [2025-09-26T22:05:04.735093] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-02. [2025-09-26T22:05:04.793927] [DEBUG] [LOCAL ] WELL: Primary data saved (53132 records). [2025-09-26T22:05:04.794126] [INFO ] [MAIN ] WELL: Full history saved. [2025-09-26T22:05:04.795696] [INFO ] [MAIN ] Update Progress: 2285/2371 symbols completed. WELL took 27.7s. Estimated remaining: 11m 29s. Rate: 7.5 symbols/min [2025-09-26T22:05:04.974671] [INFO ] [MAIN ] WFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:05:05.040704] [DEBUG] [LOCAL ] WFC: Loaded 54138 existing records from primary storage. [2025-09-26T22:05:05.040894] [INFO ] [MAIN ] WFC: Loaded 54138 existing records. [2025-09-26T22:05:05.260419] [WARN ] [MAIN ] WFC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:05:05.260852] [INFO ] [MAIN ] WFC: Wiping existing primary data before full refresh. [2025-09-26T22:05:05.260944] [INFO ] [LOCAL ] WFC: Starting deletion of primary data. [2025-09-26T22:05:05.262839] [DEBUG] [LOCAL ] WFC: Deleted primary data file. [2025-09-26T22:05:05.263147] [INFO ] [MAIN ] WFC: Starting full primary refresh. [2025-09-26T22:05:05.530267] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-05. [2025-09-26T22:05:05.636338] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-26T22:05:05.683389] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-26T22:05:05.770237] [INFO ] [REMOTE ] WFC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:05:06.311780] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-03. [2025-09-26T22:05:07.111767] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-03. [2025-09-26T22:05:07.505767] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-26T22:05:07.911734] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-06. [2025-09-26T22:05:08.008725] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-26T22:05:08.033438] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-26T22:05:08.711737] [INFO ] [REMOTE ] WFC: Fetching primary data for 2024-12. [2025-09-26T22:05:09.521363] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-04. [2025-09-26T22:05:09.545070] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-26T22:05:10.311709] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-07. [2025-09-26T22:05:10.524537] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-26T22:05:10.725015] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-26T22:05:11.111748] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-05. [2025-09-26T22:05:11.850433] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-26T22:05:11.903464] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-26T22:05:11.911663] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-06. [2025-09-26T22:05:12.711721] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-04. [2025-09-26T22:05:12.773244] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-26T22:05:13.511727] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-01. [2025-09-26T22:05:14.311759] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-08. [2025-09-26T22:05:14.498157] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-26T22:05:15.111741] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-05. [2025-09-26T22:05:15.610446] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-26T22:05:15.911697] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-02. [2025-09-26T22:05:16.200715] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-26T22:05:16.610190] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-26T22:05:16.711740] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-09. [2025-09-26T22:05:17.511704] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-07. [2025-09-26T22:05:17.762717] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-26T22:05:17.870220] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-26T22:05:17.879764] [INFO ] [REMOTE ] WES: Full fetch complete (69841 records). [2025-09-26T22:05:17.879923] [DEBUG] [VALIDATOR ] WES: Validating primary data. [2025-09-26T22:05:18.314337] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-06. [2025-09-26T22:05:18.315847] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-26T22:05:18.321465] [DEBUG] [VALIDATOR ] WES: All expected trading days are present. [2025-09-26T22:05:18.322112] [DEBUG] [VALIDATOR ] WES: Primary data validation passed. [2025-09-26T22:05:18.323916] [INFO ] [MAIN ] WES: Fetched primary data is valid. [2025-09-26T22:05:18.324271] [DEBUG] [LOCAL ] WES: Saving primary data. [2025-09-26T22:05:18.326271] [DEBUG] [LOCAL ] WES: Trimmed 69841 records to 48689 (keeping 200 days of data) [2025-09-26T22:05:18.648639] [DEBUG] [LOCAL ] WES: Primary data saved (48689 records). [2025-09-26T22:05:18.648857] [INFO ] [MAIN ] WES: Full history saved. [2025-09-26T22:05:18.648969] [INFO ] [MAIN ] Update Progress: 2286/2371 symbols completed. WES took 33.3s. Estimated remaining: 11m 21s. Rate: 7.5 symbols/min [2025-09-26T22:05:18.837172] [INFO ] [MAIN ] WFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:05:18.866877] [DEBUG] [LOCAL ] WFG: Loaded 25074 existing records from primary storage. [2025-09-26T22:05:18.867037] [INFO ] [MAIN ] WFG: Loaded 25074 existing records. [2025-09-26T22:05:19.068577] [WARN ] [MAIN ] WFG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:05:19.068877] [INFO ] [MAIN ] WFG: Wiping existing primary data before full refresh. [2025-09-26T22:05:19.068927] [INFO ] [LOCAL ] WFG: Starting deletion of primary data. [2025-09-26T22:05:19.069577] [DEBUG] [LOCAL ] WFG: Deleted primary data file. [2025-09-26T22:05:19.069680] [INFO ] [MAIN ] WFG: Starting full primary refresh. [2025-09-26T22:05:19.116893] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-03. [2025-09-26T22:05:19.455674] [INFO ] [REMOTE ] WFG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:05:19.730340] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-26T22:05:19.911732] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-07. [2025-09-26T22:05:20.711713] [INFO ] [REMOTE ] WFG: Fetching primary data for 2024-12. [2025-09-26T22:05:21.329613] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-26T22:05:21.371639] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-26T22:05:21.454892] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-26T22:05:21.511750] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-08. [2025-09-26T22:05:22.196215] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-26T22:05:22.311750] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-09. [2025-09-26T22:05:23.063482] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-26T22:05:23.065903] [INFO ] [REMOTE ] WF: Full fetch complete (16475 records). [2025-09-26T22:05:23.065984] [DEBUG] [VALIDATOR ] WF: Validating primary data. [2025-09-26T22:05:23.116992] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-04. [2025-09-26T22:05:23.468191] [DEBUG] [VALIDATOR ] WF: All expected trading days are present. [2025-09-26T22:05:23.468302] [DEBUG] [VALIDATOR ] WF: Primary data validation passed. [2025-09-26T22:05:23.468793] [INFO ] [MAIN ] WF: Fetched primary data is valid. [2025-09-26T22:05:23.468863] [DEBUG] [LOCAL ] WF: Saving primary data. [2025-09-26T22:05:23.469781] [DEBUG] [LOCAL ] WF: Trimmed 16475 records to 10903 (keeping 200 days of data) [2025-09-26T22:05:23.552046] [DEBUG] [LOCAL ] WF: Primary data saved (10903 records). [2025-09-26T22:05:23.552219] [INFO ] [MAIN ] WF: Full history saved. [2025-09-26T22:05:23.552349] [INFO ] [MAIN ] Update Progress: 2287/2371 symbols completed. WF took 24.5s. Estimated remaining: 11m 13s. Rate: 7.5 symbols/min [2025-09-26T22:05:23.742197] [INFO ] [MAIN ] WGO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:05:23.792183] [DEBUG] [LOCAL ] WGO: Loaded 39576 existing records from primary storage. [2025-09-26T22:05:23.792356] [INFO ] [MAIN ] WGO: Loaded 39576 existing records. [2025-09-26T22:05:23.912918] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-08. [2025-09-26T22:05:23.999372] [WARN ] [MAIN ] WGO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:05:23.999621] [INFO ] [MAIN ] WGO: Wiping existing primary data before full refresh. [2025-09-26T22:05:23.999731] [INFO ] [LOCAL ] WGO: Starting deletion of primary data. [2025-09-26T22:05:24.001251] [DEBUG] [LOCAL ] WGO: Deleted primary data file. [2025-09-26T22:05:24.001326] [INFO ] [MAIN ] WGO: Starting full primary refresh. [2025-09-26T22:05:24.385250] [INFO ] [REMOTE ] WGO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:05:24.711716] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-01. [2025-09-26T22:05:25.349327] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-26T22:05:25.439371] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-26T22:05:25.512188] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-05. [2025-09-26T22:05:25.549444] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-26T22:05:26.311731] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-02. [2025-09-26T22:05:27.111736] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-09. [2025-09-26T22:05:27.585872] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-26T22:05:27.614221] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-26T22:05:27.911732] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-03. [2025-09-26T22:05:28.428959] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-26T22:05:28.435140] [INFO ] [REMOTE ] WEX: Full fetch complete (50834 records). [2025-09-26T22:05:28.435273] [DEBUG] [VALIDATOR ] WEX: Validating primary data. [2025-09-26T22:05:28.716838] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-06. [2025-09-26T22:05:28.849499] [DEBUG] [VALIDATOR ] WEX: All expected trading days are present. [2025-09-26T22:05:28.849624] [DEBUG] [VALIDATOR ] WEX: Primary data validation passed. [2025-09-26T22:05:28.850716] [INFO ] [MAIN ] WEX: Fetched primary data is valid. [2025-09-26T22:05:28.850862] [DEBUG] [LOCAL ] WEX: Saving primary data. [2025-09-26T22:05:28.870725] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-26T22:05:28.877226] [DEBUG] [LOCAL ] WEX: Trimmed 50834 records to 35697 (keeping 200 days of data) [2025-09-26T22:05:29.133793] [DEBUG] [LOCAL ] WEX: Primary data saved (35697 records). [2025-09-26T22:05:29.134134] [INFO ] [MAIN ] WEX: Full history saved. [2025-09-26T22:05:29.134622] [INFO ] [MAIN ] Update Progress: 2288/2371 symbols completed. WEX took 33.9s. Estimated remaining: 11m 5s. Rate: 7.5 symbols/min [2025-09-26T22:05:29.394150] [INFO ] [MAIN ] WH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:05:29.471725] [DEBUG] [LOCAL ] WH: Loaded 46030 existing records from primary storage. [2025-09-26T22:05:29.471928] [INFO ] [MAIN ] WH: Loaded 46030 existing records. [2025-09-26T22:05:29.516955] [INFO ] [REMOTE ] WGO: Fetching primary data for 2024-12. [2025-09-26T22:05:29.670291] [WARN ] [MAIN ] WH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:05:29.670705] [INFO ] [MAIN ] WH: Wiping existing primary data before full refresh. [2025-09-26T22:05:29.670770] [INFO ] [LOCAL ] WH: Starting deletion of primary data. [2025-09-26T22:05:29.672028] [DEBUG] [LOCAL ] WH: Deleted primary data file. [2025-09-26T22:05:29.672103] [INFO ] [MAIN ] WH: Starting full primary refresh. [2025-09-26T22:05:30.053152] [INFO ] [REMOTE ] WH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:05:30.311735] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-04. [2025-09-26T22:05:30.719628] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-26T22:05:30.929871] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-26T22:05:31.111725] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-07. [2025-09-26T22:05:31.730588] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-26T22:05:31.911741] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-05. [2025-09-26T22:05:32.711735] [INFO ] [REMOTE ] WH: Fetching primary data for 2024-12. [2025-09-26T22:05:33.008735] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-26T22:05:33.350827] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-26T22:05:33.511733] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-06. [2025-09-26T22:05:34.311724] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-08. [2025-09-26T22:05:34.485898] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-26T22:05:34.655486] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-26T22:05:35.111738] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-01. [2025-09-26T22:05:35.911712] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-01. [2025-09-26T22:05:36.295402] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-26T22:05:36.392295] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-26T22:05:36.711743] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-09. [2025-09-26T22:05:37.485737] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T22:05:37.511680] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-07. [2025-09-26T22:05:37.593238] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-26T22:05:37.605928] [INFO ] [REMOTE ] WFC: Full fetch complete (77791 records). [2025-09-26T22:05:37.606159] [DEBUG] [VALIDATOR ] WFC: Validating primary data. [2025-09-26T22:05:38.092213] [DEBUG] [VALIDATOR ] WFC: All expected trading days are present. [2025-09-26T22:05:38.092335] [DEBUG] [VALIDATOR ] WFC: Primary data validation passed. [2025-09-26T22:05:38.093692] [INFO ] [MAIN ] WFC: Fetched primary data is valid. [2025-09-26T22:05:38.093771] [DEBUG] [LOCAL ] WFC: Saving primary data. [2025-09-26T22:05:38.095424] [DEBUG] [LOCAL ] WFC: Trimmed 77791 records to 54528 (keeping 200 days of data) [2025-09-26T22:05:38.331137] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-02. [2025-09-26T22:05:38.469964] [DEBUG] [LOCAL ] WFC: Primary data saved (54528 records). [2025-09-26T22:05:38.470142] [INFO ] [MAIN ] WFC: Full history saved. [2025-09-26T22:05:38.470298] [INFO ] [MAIN ] Update Progress: 2289/2371 symbols completed. WFC took 33.7s. Estimated remaining: 10m 57s. Rate: 7.5 symbols/min [2025-09-26T22:05:38.660895] [INFO ] [MAIN ] WHD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:05:38.705012] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-26T22:05:38.726257] [DEBUG] [LOCAL ] WHD: Loaded 40871 existing records from primary storage. [2025-09-26T22:05:38.726852] [INFO ] [MAIN ] WHD: Loaded 40871 existing records. [2025-09-26T22:05:38.940870] [WARN ] [MAIN ] WHD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:05:38.941208] [INFO ] [MAIN ] WHD: Wiping existing primary data before full refresh. [2025-09-26T22:05:38.941312] [INFO ] [LOCAL ] WHD: Starting deletion of primary data. [2025-09-26T22:05:38.942456] [DEBUG] [LOCAL ] WHD: Deleted primary data file. [2025-09-26T22:05:38.942522] [INFO ] [MAIN ] WHD: Starting full primary refresh. [2025-09-26T22:05:39.115401] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-08. [2025-09-26T22:05:39.338486] [INFO ] [REMOTE ] WHD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:05:39.911798] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-02. [2025-09-26T22:05:39.981317] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-26T22:05:40.377360] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-26T22:05:40.711731] [INFO ] [REMOTE ] WHD: Fetching primary data for 2024-12. [2025-09-26T22:05:41.402868] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-26T22:05:41.511695] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-03. [2025-09-26T22:05:42.140594] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-26T22:05:42.311829] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-01. [2025-09-26T22:05:43.111723] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-03. [2025-09-26T22:05:43.241863] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-26T22:05:43.744760] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-26T22:05:43.911774] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-04. [2025-09-26T22:05:44.711710] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-09. [2025-09-26T22:05:44.865425] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-26T22:05:45.520578] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-02. [2025-09-26T22:05:45.527125] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-26T22:05:45.884109] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-26T22:05:45.890066] [INFO ] [REMOTE ] WFG: Full fetch complete (35765 records). [2025-09-26T22:05:45.890218] [DEBUG] [VALIDATOR ] WFG: Validating primary data. [2025-09-26T22:05:46.314818] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-05. [2025-09-26T22:05:46.329779] [DEBUG] [VALIDATOR ] WFG: All expected trading days are present. [2025-09-26T22:05:46.329894] [DEBUG] [VALIDATOR ] WFG: Primary data validation passed. [2025-09-26T22:05:46.331144] [INFO ] [MAIN ] WFG: Fetched primary data is valid. [2025-09-26T22:05:46.331220] [DEBUG] [LOCAL ] WFG: Saving primary data. [2025-09-26T22:05:46.332989] [DEBUG] [LOCAL ] WFG: Trimmed 35765 records to 25211 (keeping 200 days of data) [2025-09-26T22:05:46.515293] [DEBUG] [LOCAL ] WFG: Primary data saved (25211 records). [2025-09-26T22:05:46.515472] [INFO ] [MAIN ] WFG: Full history saved. [2025-09-26T22:05:46.515609] [INFO ] [MAIN ] Update Progress: 2290/2371 symbols completed. WFG took 27.9s. Estimated remaining: 10m 49s. Rate: 7.5 symbols/min [2025-09-26T22:05:46.717076] [INFO ] [MAIN ] WHG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:05:46.724058] [DEBUG] [LOCAL ] WHG: Loaded 3397 existing records from primary storage. [2025-09-26T22:05:46.724145] [INFO ] [MAIN ] WHG: Loaded 3397 existing records. [2025-09-26T22:05:46.915462] [WARN ] [MAIN ] WHG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:05:46.915974] [INFO ] [MAIN ] WHG: Wiping existing primary data before full refresh. [2025-09-26T22:05:46.916051] [INFO ] [LOCAL ] WHG: Starting deletion of primary data. [2025-09-26T22:05:46.916525] [DEBUG] [LOCAL ] WHG: Deleted primary data file. [2025-09-26T22:05:46.916632] [INFO ] [MAIN ] WHG: Starting full primary refresh. [2025-09-26T22:05:47.120244] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-26T22:05:47.112629] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-04. [2025-09-26T22:05:47.339487] [INFO ] [REMOTE ] WHG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:05:47.789102] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T22:05:47.911778] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-06. [2025-09-26T22:05:48.711703] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-03. [2025-09-26T22:05:48.786096] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-26T22:05:49.484549] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-26T22:05:49.511685] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-07. [2025-09-26T22:05:50.311720] [INFO ] [REMOTE ] WHG: Fetching primary data for 2024-12. [2025-09-26T22:05:50.473035] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-26T22:05:50.672102] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-26T22:05:51.111729] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-04. [2025-09-26T22:05:51.184111] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-26T22:05:51.911757] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-05. [2025-09-26T22:05:52.711753] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-01. [2025-09-26T22:05:52.756765] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-26T22:05:53.203437] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-26T22:05:53.511724] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-02. [2025-09-26T22:05:53.624204] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-26T22:05:54.098985] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-26T22:05:54.311740] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-06. [2025-09-26T22:05:55.111770] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-08. [2025-09-26T22:05:55.913187] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-05. [2025-09-26T22:05:55.920605] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-26T22:05:56.097009] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-26T22:05:56.711740] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-07. [2025-09-26T22:05:57.432716] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-26T22:05:57.511701] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-06. [2025-09-26T22:05:58.311810] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-09. [2025-09-26T22:05:58.520176] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-26T22:05:59.031412] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-26T22:05:59.111700] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-07. [2025-09-26T22:05:59.770978] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-26T22:05:59.782464] [INFO ] [REMOTE ] WGO: Full fetch complete (57407 records). [2025-09-26T22:05:59.782835] [DEBUG] [VALIDATOR ] WGO: Validating primary data. [2025-09-26T22:05:59.916992] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-08. [2025-09-26T22:06:00.388627] [DEBUG] [VALIDATOR ] WGO: All expected trading days are present. [2025-09-26T22:06:00.388872] [DEBUG] [VALIDATOR ] WGO: Primary data validation passed. [2025-09-26T22:06:00.392219] [INFO ] [MAIN ] WGO: Fetched primary data is valid. [2025-09-26T22:06:00.392554] [DEBUG] [LOCAL ] WGO: Saving primary data. [2025-09-26T22:06:00.395359] [DEBUG] [LOCAL ] WGO: Trimmed 57407 records to 39823 (keeping 200 days of data) [2025-09-26T22:06:00.718710] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-03. [2025-09-26T22:06:00.811473] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-26T22:06:00.853144] [DEBUG] [LOCAL ] WGO: Primary data saved (39823 records). [2025-09-26T22:06:00.853345] [INFO ] [MAIN ] WGO: Full history saved. [2025-09-26T22:06:00.853525] [INFO ] [MAIN ] Update Progress: 2291/2371 symbols completed. WGO took 37.3s. Estimated remaining: 10m 41s. Rate: 7.5 symbols/min [2025-09-26T22:06:01.072909] [INFO ] [MAIN ] WHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:06:01.139855] [DEBUG] [LOCAL ] WHR: Loaded 48496 existing records from primary storage. [2025-09-26T22:06:01.140088] [INFO ] [MAIN ] WHR: Loaded 48496 existing records. [2025-09-26T22:06:01.333561] [WARN ] [MAIN ] WHR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:06:01.334321] [INFO ] [MAIN ] WHR: Wiping existing primary data before full refresh. [2025-09-26T22:06:01.334385] [INFO ] [LOCAL ] WHR: Starting deletion of primary data. [2025-09-26T22:06:01.335856] [DEBUG] [LOCAL ] WHR: Deleted primary data file. [2025-09-26T22:06:01.335944] [INFO ] [MAIN ] WHR: Starting full primary refresh. [2025-09-26T22:06:01.430078] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-26T22:06:01.511877] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-04. [2025-09-26T22:06:01.738508] [INFO ] [REMOTE ] WHR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:06:01.776628] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-26T22:06:02.269059] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-26T22:06:02.311805] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-05. [2025-09-26T22:06:02.940366] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-26T22:06:03.111808] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-08. [2025-09-26T22:06:03.911732] [INFO ] [REMOTE ] WHR: Fetching primary data for 2024-12. [2025-09-26T22:06:04.717290] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-09. [2025-09-26T22:06:04.724304] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-26T22:06:05.511761] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-06. [2025-09-26T22:06:05.608823] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-26T22:06:05.922891] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-26T22:06:05.933920] [INFO ] [REMOTE ] WH: Full fetch complete (64978 records). [2025-09-26T22:06:05.936816] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-26T22:06:05.938922] [DEBUG] [VALIDATOR ] WH: Validating primary data. [2025-09-26T22:06:06.324207] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-01. [2025-09-26T22:06:06.362896] [DEBUG] [VALIDATOR ] WH: All expected trading days are present. [2025-09-26T22:06:06.363028] [DEBUG] [VALIDATOR ] WH: Primary data validation passed. [2025-09-26T22:06:06.364179] [INFO ] [MAIN ] WH: Fetched primary data is valid. [2025-09-26T22:06:06.364250] [DEBUG] [LOCAL ] WH: Saving primary data. [2025-09-26T22:06:06.366084] [DEBUG] [LOCAL ] WH: Trimmed 64978 records to 46339 (keeping 200 days of data) [2025-09-26T22:06:06.677918] [DEBUG] [LOCAL ] WH: Primary data saved (46339 records). [2025-09-26T22:06:06.678073] [INFO ] [MAIN ] WH: Full history saved. [2025-09-26T22:06:06.678178] [INFO ] [MAIN ] Update Progress: 2292/2371 symbols completed. WH took 37.5s. Estimated remaining: 10m 33s. Rate: 7.5 symbols/min [2025-09-26T22:06:06.865182] [INFO ] [MAIN ] WIA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:06:06.872431] [DEBUG] [LOCAL ] WIA: Loaded 4901 existing records from primary storage. [2025-09-26T22:06:06.872538] [INFO ] [MAIN ] WIA: Loaded 4901 existing records. [2025-09-26T22:06:07.057259] [WARN ] [MAIN ] WIA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:06:07.057593] [INFO ] [MAIN ] WIA: Wiping existing primary data before full refresh. [2025-09-26T22:06:07.057676] [INFO ] [LOCAL ] WIA: Starting deletion of primary data. [2025-09-26T22:06:07.058034] [DEBUG] [LOCAL ] WIA: Deleted primary data file. [2025-09-26T22:06:07.058096] [INFO ] [MAIN ] WIA: Starting full primary refresh. [2025-09-26T22:06:07.117029] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-07. [2025-09-26T22:06:07.447230] [INFO ] [REMOTE ] WIA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:06:07.790904] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-26T22:06:07.911771] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-08. [2025-09-26T22:06:08.066077] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-26T22:06:08.402964] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-26T22:06:08.711741] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-09. [2025-09-26T22:06:09.511804] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-09. [2025-09-26T22:06:10.114343] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-26T22:06:10.115587] [INFO ] [REMOTE ] WHG: Full fetch complete (4651 records). [2025-09-26T22:06:10.115681] [DEBUG] [VALIDATOR ] WHG: Validating primary data. [2025-09-26T22:06:10.313968] [INFO ] [REMOTE ] WIA: Fetching primary data for 2024-12. [2025-09-26T22:06:10.403174] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-26T22:06:10.470138] [INFO ] [REMOTE ] WHD: Full fetch complete (57306 records). [2025-09-26T22:06:10.476224] [DEBUG] [VALIDATOR ] WHD: Validating primary data. [2025-09-26T22:06:10.667946] [DEBUG] [VALIDATOR ] WHG: All expected trading days are present. [2025-09-26T22:06:10.668123] [DEBUG] [VALIDATOR ] WHG: Primary data validation passed. [2025-09-26T22:06:10.668389] [INFO ] [MAIN ] WHG: Fetched primary data is valid. [2025-09-26T22:06:10.668883] [DEBUG] [LOCAL ] WHG: Saving primary data. [2025-09-26T22:06:10.685458] [DEBUG] [LOCAL ] WHG: Trimmed 4651 records to 3416 (keeping 200 days of data) [2025-09-26T22:06:10.876323] [DEBUG] [LOCAL ] WHG: Primary data saved (3416 records). [2025-09-26T22:06:10.895857] [INFO ] [MAIN ] WHG: Full history saved. [2025-09-26T22:06:10.898857] [INFO ] [MAIN ] Update Progress: 2293/2371 symbols completed. WHG took 24.4s. Estimated remaining: 10m 25s. Rate: 7.5 symbols/min [2025-09-26T22:06:11.106131] [DEBUG] [VALIDATOR ] WHD: All expected trading days are present. [2025-09-26T22:06:11.116940] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-02. [2025-09-26T22:06:11.116855] [DEBUG] [VALIDATOR ] WHD: Primary data validation passed. [2025-09-26T22:06:11.134955] [INFO ] [MAIN ] WHD: Fetched primary data is valid. [2025-09-26T22:06:11.139433] [DEBUG] [LOCAL ] WHD: Saving primary data. [2025-09-26T22:06:11.148205] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-26T22:06:11.205156] [DEBUG] [LOCAL ] WHD: Trimmed 57306 records to 41130 (keeping 200 days of data) [2025-09-26T22:06:11.223508] [INFO ] [MAIN ] WINN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:06:11.331805] [DEBUG] [LOCAL ] WINN: Loaded 11895 existing records from primary storage. [2025-09-26T22:06:11.332589] [INFO ] [MAIN ] WINN: Loaded 11895 existing records. [2025-09-26T22:06:11.527202] [WARN ] [MAIN ] WINN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:06:11.529575] [INFO ] [MAIN ] WINN: Wiping existing primary data before full refresh. [2025-09-26T22:06:11.530053] [INFO ] [LOCAL ] WINN: Starting deletion of primary data. [2025-09-26T22:06:11.531298] [DEBUG] [LOCAL ] WINN: Deleted primary data file. [2025-09-26T22:06:11.531382] [INFO ] [MAIN ] WINN: Starting full primary refresh. [2025-09-26T22:06:11.918778] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-01. [2025-09-26T22:06:11.968733] [INFO ] [REMOTE ] WINN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:06:12.137989] [DEBUG] [LOCAL ] WHD: Primary data saved (41130 records). [2025-09-26T22:06:12.138203] [INFO ] [MAIN ] WHD: Full history saved. [2025-09-26T22:06:12.138317] [INFO ] [MAIN ] Update Progress: 2294/2371 symbols completed. WHD took 33.7s. Estimated remaining: 10m 17s. Rate: 7.5 symbols/min [2025-09-26T22:06:12.317574] [INFO ] [MAIN ] WIT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:06:12.375280] [DEBUG] [LOCAL ] WIT: Loaded 52681 existing records from primary storage. [2025-09-26T22:06:12.375510] [INFO ] [MAIN ] WIT: Loaded 52681 existing records. [2025-09-26T22:06:12.564246] [WARN ] [MAIN ] WIT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:06:12.564720] [INFO ] [MAIN ] WIT: Wiping existing primary data before full refresh. [2025-09-26T22:06:12.564778] [INFO ] [LOCAL ] WIT: Starting deletion of primary data. [2025-09-26T22:06:12.566045] [DEBUG] [LOCAL ] WIT: Deleted primary data file. [2025-09-26T22:06:12.566109] [INFO ] [MAIN ] WIT: Starting full primary refresh. [2025-09-26T22:06:12.678030] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-26T22:06:12.721748] [INFO ] [REMOTE ] WINN: Fetching primary data for 2024-12. [2025-09-26T22:06:12.956821] [INFO ] [REMOTE ] WIT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:06:12.986123] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-26T22:06:13.511757] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-03. [2025-09-26T22:06:13.690591] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-26T22:06:14.311773] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-01. [2025-09-26T22:06:15.111804] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-02. [2025-09-26T22:06:15.227450] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-26T22:06:15.266663] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-26T22:06:15.733005] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-26T22:06:15.911760] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-02. [2025-09-26T22:06:16.671038] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-26T22:06:16.711718] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-04. [2025-09-26T22:06:17.511755] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-03. [2025-09-26T22:06:18.311719] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-03. [2025-09-26T22:06:18.551771] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-26T22:06:18.587307] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-26T22:06:19.051742] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-26T22:06:19.111692] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-04. [2025-09-26T22:06:19.740017] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-26T22:06:19.911747] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-05. [2025-09-26T22:06:20.557461] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-26T22:06:20.711735] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-06. [2025-09-26T22:06:21.349416] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-26T22:06:21.511763] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-04. [2025-09-26T22:06:22.311724] [INFO ] [REMOTE ] WIT: Fetching primary data for 2024-12. [2025-09-26T22:06:22.496237] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-26T22:06:23.111728] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-05. [2025-09-26T22:06:23.911715] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-07. [2025-09-26T22:06:24.085223] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-26T22:06:24.519078] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-26T22:06:24.711786] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-08. [2025-09-26T22:06:24.943884] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-26T22:06:25.391628] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-26T22:06:25.511777] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-01. [2025-09-26T22:06:26.311774] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-05. [2025-09-26T22:06:27.111752] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-09. [2025-09-26T22:06:27.178115] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-26T22:06:27.555111] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-26T22:06:27.759387] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-26T22:06:27.761291] [INFO ] [REMOTE ] WIA: Full fetch complete (7295 records). [2025-09-26T22:06:27.761363] [DEBUG] [VALIDATOR ] WIA: Validating primary data. [2025-09-26T22:06:27.916871] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-02. [2025-09-26T22:06:28.167707] [DEBUG] [VALIDATOR ] WIA: All expected trading days are present. [2025-09-26T22:06:28.167828] [DEBUG] [VALIDATOR ] WIA: Primary data validation passed. [2025-09-26T22:06:28.168268] [INFO ] [MAIN ] WIA: Fetched primary data is valid. [2025-09-26T22:06:28.168334] [DEBUG] [LOCAL ] WIA: Saving primary data. [2025-09-26T22:06:28.168848] [DEBUG] [LOCAL ] WIA: Trimmed 7295 records to 4937 (keeping 200 days of data) [2025-09-26T22:06:28.201118] [DEBUG] [LOCAL ] WIA: Primary data saved (4937 records). [2025-09-26T22:06:28.201277] [INFO ] [MAIN ] WIA: Full history saved. [2025-09-26T22:06:28.201417] [INFO ] [MAIN ] Update Progress: 2295/2371 symbols completed. WIA took 21.5s. Estimated remaining: 10m 9s. Rate: 7.5 symbols/min [2025-09-26T22:06:28.376734] [INFO ] [MAIN ] WIW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:06:28.399429] [DEBUG] [LOCAL ] WIW: Loaded 20711 existing records from primary storage. [2025-09-26T22:06:28.399637] [INFO ] [MAIN ] WIW: Loaded 20711 existing records. [2025-09-26T22:06:28.583566] [WARN ] [MAIN ] WIW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:06:28.584252] [INFO ] [MAIN ] WIW: Wiping existing primary data before full refresh. [2025-09-26T22:06:28.584312] [INFO ] [LOCAL ] WIW: Starting deletion of primary data. [2025-09-26T22:06:28.585025] [DEBUG] [LOCAL ] WIW: Deleted primary data file. [2025-09-26T22:06:28.585087] [INFO ] [MAIN ] WIW: Starting full primary refresh. [2025-09-26T22:06:28.726868] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-06. [2025-09-26T22:06:28.953219] [INFO ] [REMOTE ] WIW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:06:29.511772] [INFO ] [REMOTE ] WIW: Fetching primary data for 2024-12. [2025-09-26T22:06:29.662918] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-26T22:06:30.311735] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-03. [2025-09-26T22:06:30.498812] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-26T22:06:30.553922] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-26T22:06:31.111764] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-06. [2025-09-26T22:06:31.917634] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-01. [2025-09-26T22:06:31.922702] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-26T22:06:32.101904] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-26T22:06:32.711758] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-04. [2025-09-26T22:06:33.008863] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-26T22:06:33.511749] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-02. [2025-09-26T22:06:34.281170] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-26T22:06:34.311715] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-07. [2025-09-26T22:06:34.654800] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-26T22:06:35.111814] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-03. [2025-09-26T22:06:35.911784] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-05. [2025-09-26T22:06:36.162667] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-26T22:06:36.297700] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-26T22:06:36.711782] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-04. [2025-09-26T22:06:37.511733] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-07. [2025-09-26T22:06:37.864858] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-26T22:06:37.913809] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-26T22:06:38.247477] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-26T22:06:38.311683] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-05. [2025-09-26T22:06:39.111754] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-08. [2025-09-26T22:06:39.494405] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-26T22:06:39.905436] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-26T22:06:39.911659] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-09. [2025-09-26T22:06:40.711749] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-06. [2025-09-26T22:06:40.723143] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-26T22:06:40.725837] [INFO ] [REMOTE ] WINN: Full fetch complete (17643 records). [2025-09-26T22:06:40.725923] [DEBUG] [VALIDATOR ] WINN: Validating primary data. [2025-09-26T22:06:41.116399] [DEBUG] [VALIDATOR ] WINN: All expected trading days are present. [2025-09-26T22:06:41.116569] [DEBUG] [VALIDATOR ] WINN: Primary data validation passed. [2025-09-26T22:06:41.117157] [INFO ] [MAIN ] WINN: Fetched primary data is valid. [2025-09-26T22:06:41.117251] [DEBUG] [LOCAL ] WINN: Saving primary data. [2025-09-26T22:06:41.118099] [DEBUG] [LOCAL ] WINN: Trimmed 17643 records to 11944 (keeping 200 days of data) [2025-09-26T22:06:41.200608] [DEBUG] [LOCAL ] WINN: Primary data saved (11944 records). [2025-09-26T22:06:41.200863] [INFO ] [MAIN ] WINN: Full history saved. [2025-09-26T22:06:41.201007] [INFO ] [MAIN ] Update Progress: 2296/2371 symbols completed. WINN took 30.3s. Estimated remaining: 10m 1s. Rate: 7.5 symbols/min [2025-09-26T22:06:41.386436] [INFO ] [MAIN ] WK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:06:41.432216] [DEBUG] [LOCAL ] WK: Loaded 37017 existing records from primary storage. [2025-09-26T22:06:41.432420] [INFO ] [MAIN ] WK: Loaded 37017 existing records. [2025-09-26T22:06:41.516785] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-06. [2025-09-26T22:06:41.627809] [WARN ] [MAIN ] WK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:06:41.628227] [INFO ] [MAIN ] WK: Wiping existing primary data before full refresh. [2025-09-26T22:06:41.628324] [INFO ] [LOCAL ] WK: Starting deletion of primary data. [2025-09-26T22:06:41.629473] [DEBUG] [LOCAL ] WK: Deleted primary data file. [2025-09-26T22:06:41.629535] [INFO ] [MAIN ] WK: Starting full primary refresh. [2025-09-26T22:06:41.915731] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-26T22:06:42.043851] [INFO ] [REMOTE ] WK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:06:42.311809] [INFO ] [REMOTE ] WK: Fetching primary data for 2024-12. [2025-09-26T22:06:43.111739] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-08. [2025-09-26T22:06:43.331700] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-26T22:06:43.657805] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-26T22:06:43.911769] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-07. [2025-09-26T22:06:44.596038] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-26T22:06:44.711741] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-07. [2025-09-26T22:06:45.052443] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-26T22:06:45.511768] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-08. [2025-09-26T22:06:46.311702] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-01. [2025-09-26T22:06:46.680133] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-26T22:06:46.728752] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-26T22:06:47.111760] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-09. [2025-09-26T22:06:47.716989] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-26T22:06:47.911687] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-02. [2025-09-26T22:06:48.711717] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-08. [2025-09-26T22:06:48.851373] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-26T22:06:48.861483] [INFO ] [REMOTE ] WHR: Full fetch complete (68505 records). [2025-09-26T22:06:48.861687] [DEBUG] [VALIDATOR ] WHR: Validating primary data. [2025-09-26T22:06:49.287163] [DEBUG] [VALIDATOR ] WHR: All expected trading days are present. [2025-09-26T22:06:49.287427] [DEBUG] [VALIDATOR ] WHR: Primary data validation passed. [2025-09-26T22:06:49.288798] [INFO ] [MAIN ] WHR: Fetched primary data is valid. [2025-09-26T22:06:49.288871] [DEBUG] [LOCAL ] WHR: Saving primary data. [2025-09-26T22:06:49.290739] [DEBUG] [LOCAL ] WHR: Trimmed 68505 records to 48846 (keeping 200 days of data) [2025-09-26T22:06:49.421207] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-26T22:06:49.526024] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-03. [2025-09-26T22:06:49.659572] [DEBUG] [LOCAL ] WHR: Primary data saved (48846 records). [2025-09-26T22:06:49.659793] [INFO ] [MAIN ] WHR: Full history saved. [2025-09-26T22:06:49.659933] [INFO ] [MAIN ] Update Progress: 2297/2371 symbols completed. WHR took 48.8s. Estimated remaining: 9m 53s. Rate: 7.5 symbols/min [2025-09-26T22:06:49.844868] [INFO ] [MAIN ] WKC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:06:49.881691] [DEBUG] [LOCAL ] WKC: Loaded 35324 existing records from primary storage. [2025-09-26T22:06:49.881862] [INFO ] [MAIN ] WKC: Loaded 35324 existing records. [2025-09-26T22:06:50.076531] [WARN ] [MAIN ] WKC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:06:50.077191] [INFO ] [MAIN ] WKC: Wiping existing primary data before full refresh. [2025-09-26T22:06:50.077353] [INFO ] [LOCAL ] WKC: Starting deletion of primary data. [2025-09-26T22:06:50.078419] [DEBUG] [LOCAL ] WKC: Deleted primary data file. [2025-09-26T22:06:50.078489] [INFO ] [MAIN ] WKC: Starting full primary refresh. [2025-09-26T22:06:50.318940] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-09. [2025-09-26T22:06:50.489526] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-26T22:06:50.523483] [INFO ] [REMOTE ] WKC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:06:51.042058] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-26T22:06:51.111686] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-04. [2025-09-26T22:06:51.527323] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-26T22:06:51.532548] [INFO ] [REMOTE ] WIW: Full fetch complete (30114 records). [2025-09-26T22:06:51.532771] [DEBUG] [VALIDATOR ] WIW: Validating primary data. [2025-09-26T22:06:51.922284] [INFO ] [REMOTE ] WKC: Fetching primary data for 2024-12. [2025-09-26T22:06:51.955891] [DEBUG] [VALIDATOR ] WIW: All expected trading days are present. [2025-09-26T22:06:51.955994] [DEBUG] [VALIDATOR ] WIW: Primary data validation passed. [2025-09-26T22:06:51.957113] [INFO ] [MAIN ] WIW: Fetched primary data is valid. [2025-09-26T22:06:51.957179] [DEBUG] [LOCAL ] WIW: Saving primary data. [2025-09-26T22:06:51.958062] [DEBUG] [LOCAL ] WIW: Trimmed 30114 records to 20756 (keeping 200 days of data) [2025-09-26T22:06:52.087925] [DEBUG] [LOCAL ] WIW: Primary data saved (20756 records). [2025-09-26T22:06:52.088076] [INFO ] [MAIN ] WIW: Full history saved. [2025-09-26T22:06:52.088191] [INFO ] [MAIN ] Update Progress: 2298/2371 symbols completed. WIW took 23.9s. Estimated remaining: 9m 45s. Rate: 7.5 symbols/min [2025-09-26T22:06:52.331780] [INFO ] [MAIN ] WLK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:06:52.387276] [DEBUG] [LOCAL ] WLK: Loaded 45752 existing records from primary storage. [2025-09-26T22:06:52.387437] [INFO ] [MAIN ] WLK: Loaded 45752 existing records. [2025-09-26T22:06:52.695522] [WARN ] [MAIN ] WLK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:06:52.696239] [INFO ] [MAIN ] WLK: Wiping existing primary data before full refresh. [2025-09-26T22:06:52.696376] [INFO ] [LOCAL ] WLK: Starting deletion of primary data. [2025-09-26T22:06:52.710977] [DEBUG] [LOCAL ] WLK: Deleted primary data file. [2025-09-26T22:06:52.716334] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-09. [2025-09-26T22:06:52.722313] [INFO ] [MAIN ] WLK: Starting full primary refresh. [2025-09-26T22:06:52.767878] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-26T22:06:53.346875] [INFO ] [REMOTE ] WLK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:06:53.451307] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-26T22:06:53.511796] [INFO ] [REMOTE ] WLK: Fetching primary data for 2024-12. [2025-09-26T22:06:54.311784] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-05. [2025-09-26T22:06:54.538831] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-26T22:06:54.549336] [INFO ] [REMOTE ] WIT: Full fetch complete (75588 records). [2025-09-26T22:06:54.549505] [DEBUG] [VALIDATOR ] WIT: Validating primary data. [2025-09-26T22:06:54.969988] [DEBUG] [VALIDATOR ] WIT: All expected trading days are present. [2025-09-26T22:06:54.970093] [DEBUG] [VALIDATOR ] WIT: Primary data validation passed. [2025-09-26T22:06:54.971438] [INFO ] [MAIN ] WIT: Fetched primary data is valid. [2025-09-26T22:06:54.971516] [DEBUG] [LOCAL ] WIT: Saving primary data. [2025-09-26T22:06:54.973245] [DEBUG] [LOCAL ] WIT: Trimmed 75588 records to 53070 (keeping 200 days of data) [2025-09-26T22:06:55.114848] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-01. [2025-09-26T22:06:55.248294] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-26T22:06:55.342372] [DEBUG] [LOCAL ] WIT: Primary data saved (53070 records). [2025-09-26T22:06:55.342529] [INFO ] [MAIN ] WIT: Full history saved. [2025-09-26T22:06:55.342625] [INFO ] [MAIN ] Update Progress: 2299/2371 symbols completed. WIT took 43.2s. Estimated remaining: 9m 37s. Rate: 7.5 symbols/min [2025-09-26T22:06:55.525200] [INFO ] [MAIN ] WLKP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:06:55.537086] [DEBUG] [LOCAL ] WLKP: Loaded 6741 existing records from primary storage. [2025-09-26T22:06:55.537282] [INFO ] [MAIN ] WLKP: Loaded 6741 existing records. [2025-09-26T22:06:55.724948] [WARN ] [MAIN ] WLKP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:06:55.725379] [INFO ] [MAIN ] WLKP: Wiping existing primary data before full refresh. [2025-09-26T22:06:55.725436] [INFO ] [LOCAL ] WLKP: Starting deletion of primary data. [2025-09-26T22:06:55.725834] [DEBUG] [LOCAL ] WLKP: Deleted primary data file. [2025-09-26T22:06:55.725930] [INFO ] [MAIN ] WLKP: Starting full primary refresh. [2025-09-26T22:06:55.915366] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-01. [2025-09-26T22:06:56.114988] [INFO ] [REMOTE ] WLKP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:06:56.171914] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-26T22:06:56.655535] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-26T22:06:56.711697] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-02. [2025-09-26T22:06:56.994251] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-26T22:06:57.511724] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2024-12. [2025-09-26T22:06:58.162327] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-26T22:06:58.302337] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-26T22:06:58.311670] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-01. [2025-09-26T22:06:59.067834] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-26T22:06:59.111720] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-06. [2025-09-26T22:06:59.911721] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-02. [2025-09-26T22:07:00.430535] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-26T22:07:00.711746] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-07. [2025-09-26T22:07:01.470390] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-26T22:07:01.511767] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-03. [2025-09-26T22:07:02.311722] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-02. [2025-09-26T22:07:02.370915] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-26T22:07:02.992480] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-26T22:07:03.090183] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-26T22:07:03.111675] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-04. [2025-09-26T22:07:03.911719] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-03. [2025-09-26T22:07:04.589518] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-26T22:07:04.711722] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-03. [2025-09-26T22:07:05.417057] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-26T22:07:05.513289] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-05. [2025-09-26T22:07:05.516220] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-26T22:07:06.311744] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-08. [2025-09-26T22:07:06.899470] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-26T22:07:07.111739] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-04. [2025-09-26T22:07:07.519580] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-26T22:07:07.850006] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-26T22:07:07.911728] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-05. [2025-09-26T22:07:08.711757] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-04. [2025-09-26T22:07:09.392772] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-26T22:07:09.511750] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-06. [2025-09-26T22:07:10.311710] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-06. [2025-09-26T22:07:10.364386] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-26T22:07:10.932166] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-26T22:07:11.039101] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-26T22:07:11.111717] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-07. [2025-09-26T22:07:11.758907] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-26T22:07:11.911738] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-07. [2025-09-26T22:07:12.711721] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-09. [2025-09-26T22:07:13.291720] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-26T22:07:13.511757] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-08. [2025-09-26T22:07:14.311755] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-05. [2025-09-26T22:07:14.347027] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-26T22:07:14.355084] [INFO ] [REMOTE ] WK: Full fetch complete (52233 records). [2025-09-26T22:07:14.355225] [DEBUG] [VALIDATOR ] WK: Validating primary data. [2025-09-26T22:07:14.753804] [DEBUG] [VALIDATOR ] WK: All expected trading days are present. [2025-09-26T22:07:14.753925] [DEBUG] [VALIDATOR ] WK: Primary data validation passed. [2025-09-26T22:07:14.754988] [INFO ] [MAIN ] WK: Fetched primary data is valid. [2025-09-26T22:07:14.755209] [DEBUG] [LOCAL ] WK: Saving primary data. [2025-09-26T22:07:14.756586] [DEBUG] [LOCAL ] WK: Trimmed 52233 records to 37342 (keeping 200 days of data) [2025-09-26T22:07:14.902201] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-26T22:07:15.020080] [DEBUG] [LOCAL ] WK: Primary data saved (37342 records). [2025-09-26T22:07:15.020260] [INFO ] [MAIN ] WK: Full history saved. [2025-09-26T22:07:15.020367] [INFO ] [MAIN ] Update Progress: 2300/2371 symbols completed. WK took 33.8s. Estimated remaining: 9m 29s. Rate: 7.5 symbols/min [2025-09-26T22:07:15.121544] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-09. [2025-09-26T22:07:15.196686] [INFO ] [MAIN ] WLTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:07:15.196907] [DEBUG] [LOCAL ] WLTG: No existing data file found in primary storage. [2025-09-26T22:07:15.196963] [WARN ] [MAIN ] WLTG: No existing data found, performing full refresh instead. [2025-09-26T22:07:15.197161] [INFO ] [MAIN ] WLTG: Wiping existing primary data before full refresh. [2025-09-26T22:07:15.197226] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-09-26T22:07:15.197285] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-09-26T22:07:15.197333] [INFO ] [MAIN ] WLTG: Starting full primary refresh. [2025-09-26T22:07:15.576092] [INFO ] [REMOTE ] WLTG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:07:15.911725] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-08. [2025-09-26T22:07:16.185846] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-26T22:07:16.293307] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-26T22:07:16.301457] [INFO ] [REMOTE ] WKC: Full fetch complete (51185 records). [2025-09-26T22:07:16.301604] [DEBUG] [VALIDATOR ] WKC: Validating primary data. [2025-09-26T22:07:16.633354] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-26T22:07:16.720799] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-06. [2025-09-26T22:07:16.744072] [DEBUG] [VALIDATOR ] WKC: All expected trading days are present. [2025-09-26T22:07:16.744205] [DEBUG] [VALIDATOR ] WKC: Primary data validation passed. [2025-09-26T22:07:16.746048] [INFO ] [MAIN ] WKC: Fetched primary data is valid. [2025-09-26T22:07:16.746290] [DEBUG] [LOCAL ] WKC: Saving primary data. [2025-09-26T22:07:16.748037] [DEBUG] [LOCAL ] WKC: Trimmed 51185 records to 35538 (keeping 200 days of data) [2025-09-26T22:07:16.985609] [DEBUG] [LOCAL ] WKC: Primary data saved (35538 records). [2025-09-26T22:07:16.985793] [INFO ] [MAIN ] WKC: Full history saved. [2025-09-26T22:07:16.985954] [INFO ] [MAIN ] Update Progress: 2301/2371 symbols completed. WKC took 27.3s. Estimated remaining: 9m 21s. Rate: 7.5 symbols/min [2025-09-26T22:07:17.161940] [INFO ] [MAIN ] WLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:07:17.199453] [DEBUG] [LOCAL ] WLY: Loaded 30208 existing records from primary storage. [2025-09-26T22:07:17.199669] [INFO ] [MAIN ] WLY: Loaded 30208 existing records. [2025-09-26T22:07:17.397019] [WARN ] [MAIN ] WLY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:07:17.397307] [INFO ] [MAIN ] WLY: Wiping existing primary data before full refresh. [2025-09-26T22:07:17.397359] [INFO ] [LOCAL ] WLY: Starting deletion of primary data. [2025-09-26T22:07:17.398370] [DEBUG] [LOCAL ] WLY: Deleted primary data file. [2025-09-26T22:07:17.398445] [INFO ] [MAIN ] WLY: Starting full primary refresh. [2025-09-26T22:07:17.516850] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-09. [2025-09-26T22:07:17.778450] [INFO ] [REMOTE ] WLY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:07:18.141027] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-26T22:07:18.143771] [INFO ] [REMOTE ] WLKP: Full fetch complete (10274 records). [2025-09-26T22:07:18.143848] [DEBUG] [VALIDATOR ] WLKP: Validating primary data. [2025-09-26T22:07:18.312467] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2024-12. [2025-09-26T22:07:18.540046] [DEBUG] [VALIDATOR ] WLKP: All expected trading days are present. [2025-09-26T22:07:18.540155] [DEBUG] [VALIDATOR ] WLKP: Primary data validation passed. [2025-09-26T22:07:18.540666] [INFO ] [MAIN ] WLKP: Fetched primary data is valid. [2025-09-26T22:07:18.540765] [DEBUG] [LOCAL ] WLKP: Saving primary data. [2025-09-26T22:07:18.541502] [DEBUG] [LOCAL ] WLKP: Trimmed 10274 records to 6800 (keeping 200 days of data) [2025-09-26T22:07:18.604297] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-26T22:07:18.627612] [DEBUG] [LOCAL ] WLKP: Primary data saved (6800 records). [2025-09-26T22:07:18.627769] [INFO ] [MAIN ] WLKP: Full history saved. [2025-09-26T22:07:18.627862] [INFO ] [MAIN ] Update Progress: 2302/2371 symbols completed. WLKP took 23.3s. Estimated remaining: 9m 13s. Rate: 7.5 symbols/min [2025-09-26T22:07:18.820371] [INFO ] [MAIN ] WM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:07:18.818431] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-26T22:07:18.896598] [DEBUG] [LOCAL ] WM: Loaded 51342 existing records from primary storage. [2025-09-26T22:07:18.896830] [INFO ] [MAIN ] WM: Loaded 51342 existing records. [2025-09-26T22:07:19.086377] [WARN ] [MAIN ] WM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:07:19.086707] [INFO ] [MAIN ] WM: Wiping existing primary data before full refresh. [2025-09-26T22:07:19.086765] [INFO ] [LOCAL ] WM: Starting deletion of primary data. [2025-09-26T22:07:19.088429] [DEBUG] [LOCAL ] WM: Deleted primary data file. [2025-09-26T22:07:19.088492] [INFO ] [MAIN ] WM: Starting full primary refresh. [2025-09-26T22:07:19.118313] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-01. [2025-09-26T22:07:19.491856] [INFO ] [REMOTE ] WM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:07:19.526387] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-26T22:07:19.911734] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-02. [2025-09-26T22:07:20.246272] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-26T22:07:20.711728] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-03. [2025-09-26T22:07:21.138142] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-26T22:07:21.511740] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-04. [2025-09-26T22:07:21.934724] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-26T22:07:22.311731] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-05. [2025-09-26T22:07:22.651703] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-26T22:07:23.111723] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-06. [2025-09-26T22:07:23.640389] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-26T22:07:23.911728] [INFO ] [REMOTE ] WLY: Fetching primary data for 2024-12. [2025-09-26T22:07:24.711723] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-07. [2025-09-26T22:07:25.147578] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-26T22:07:25.199759] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-26T22:07:25.511721] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-07. [2025-09-26T22:07:26.311716] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-01. [2025-09-26T22:07:27.111709] [INFO ] [REMOTE ] WM: Fetching primary data for 2024-12. [2025-09-26T22:07:27.168460] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-26T22:07:27.230252] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-26T22:07:27.911731] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-02. [2025-09-26T22:07:28.110249] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-26T22:07:28.711725] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-08. [2025-09-26T22:07:29.094820] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-26T22:07:29.511737] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-01. [2025-09-26T22:07:30.311708] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-03. [2025-09-26T22:07:30.354212] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-26T22:07:30.521757] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-26T22:07:31.111722] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-09. [2025-09-26T22:07:31.789362] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-26T22:07:31.911729] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-04. [2025-09-26T22:07:32.719440] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-02. [2025-09-26T22:07:32.728043] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-26T22:07:32.737862] [INFO ] [REMOTE ] WLK: Full fetch complete (62896 records). [2025-09-26T22:07:32.738019] [DEBUG] [VALIDATOR ] WLK: Validating primary data. [2025-09-26T22:07:33.203511] [DEBUG] [VALIDATOR ] WLK: All expected trading days are present. [2025-09-26T22:07:33.203667] [DEBUG] [VALIDATOR ] WLK: Primary data validation passed. [2025-09-26T22:07:33.204946] [INFO ] [MAIN ] WLK: Fetched primary data is valid. [2025-09-26T22:07:33.205050] [DEBUG] [LOCAL ] WLK: Saving primary data. [2025-09-26T22:07:33.230139] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-26T22:07:33.238674] [DEBUG] [LOCAL ] WLK: Trimmed 62896 records to 46113 (keeping 200 days of data) [2025-09-26T22:07:33.511920] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-05. [2025-09-26T22:07:33.562025] [DEBUG] [LOCAL ] WLK: Primary data saved (46113 records). [2025-09-26T22:07:33.562197] [INFO ] [MAIN ] WLK: Full history saved. [2025-09-26T22:07:33.562436] [INFO ] [MAIN ] Update Progress: 2303/2371 symbols completed. WLK took 41.5s. Estimated remaining: 9m 5s. Rate: 7.5 symbols/min [2025-09-26T22:07:33.705633] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-26T22:07:33.783711] [INFO ] [MAIN ] WMB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:07:33.846580] [DEBUG] [LOCAL ] WMB: Loaded 54061 existing records from primary storage. [2025-09-26T22:07:33.846797] [INFO ] [MAIN ] WMB: Loaded 54061 existing records. [2025-09-26T22:07:34.032302] [WARN ] [MAIN ] WMB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:07:34.032599] [INFO ] [MAIN ] WMB: Wiping existing primary data before full refresh. [2025-09-26T22:07:34.032688] [INFO ] [LOCAL ] WMB: Starting deletion of primary data. [2025-09-26T22:07:34.034099] [DEBUG] [LOCAL ] WMB: Deleted primary data file. [2025-09-26T22:07:34.034171] [INFO ] [MAIN ] WMB: Starting full primary refresh. [2025-09-26T22:07:34.316935] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-08. [2025-09-26T22:07:34.420298] [INFO ] [REMOTE ] WMB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:07:34.788971] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-26T22:07:34.863443] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-26T22:07:35.111717] [INFO ] [REMOTE ] WMB: Fetching primary data for 2024-12. [2025-09-26T22:07:35.917268] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-09. [2025-09-26T22:07:35.940049] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-26T22:07:36.289110] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-26T22:07:36.290186] [INFO ] [REMOTE ] WLTG: Full fetch complete (1661 records). [2025-09-26T22:07:36.290259] [DEBUG] [VALIDATOR ] WLTG: Validating primary data. [2025-09-26T22:07:36.494418] [WARN ] [VALIDATOR ] WLTG: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-26T22:07:36.494688] [FATAL] [MAIN ] WLTG: Fetched primary data is invalid. Refusing to save it. [2025-09-26T22:07:36.494776] [WARN ] [MAIN ] WLTG: Deleting existing primary and derivative data due to validation failure. [2025-09-26T22:07:36.494854] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-09-26T22:07:36.494922] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-09-26T22:07:36.495001] [INFO ] [LOCAL ] WLTG: Starting deletion of derivative data. [2025-09-26T22:07:36.495079] [DEBUG] [LOCAL ] WLTG: No derivative data file found to delete. [2025-09-26T22:07:36.495246] [INFO ] [MAIN ] Update Progress: 2304/2371 symbols completed. WLTG took 21.5s. Estimated remaining: 8m 57s. Rate: 7.5 symbols/min [2025-09-26T22:07:36.675790] [INFO ] [MAIN ] WMK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:07:36.702817] [DEBUG] [LOCAL ] WMK: Loaded 14634 existing records from primary storage. [2025-09-26T22:07:36.702962] [INFO ] [MAIN ] WMK: Loaded 14634 existing records. [2025-09-26T22:07:36.716836] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-06. [2025-09-26T22:07:36.902917] [WARN ] [MAIN ] WMK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:07:36.904236] [INFO ] [MAIN ] WMK: Wiping existing primary data before full refresh. [2025-09-26T22:07:36.904297] [INFO ] [LOCAL ] WMK: Starting deletion of primary data. [2025-09-26T22:07:36.905251] [DEBUG] [LOCAL ] WMK: Deleted primary data file. [2025-09-26T22:07:36.905312] [INFO ] [MAIN ] WMK: Starting full primary refresh. [2025-09-26T22:07:37.271886] [INFO ] [REMOTE ] WMK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:07:37.511794] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-01. [2025-09-26T22:07:38.201738] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-26T22:07:38.316868] [INFO ] [REMOTE ] WMK: Fetching primary data for 2024-12. [2025-09-26T22:07:38.335336] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-26T22:07:39.111698] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-03. [2025-09-26T22:07:39.177472] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-26T22:07:39.921586] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-01. [2025-09-26T22:07:39.929019] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-26T22:07:40.711699] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-07. [2025-09-26T22:07:40.755281] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-26T22:07:41.511740] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-02. [2025-09-26T22:07:42.143340] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-26T22:07:42.311698] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-08. [2025-09-26T22:07:42.628397] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-26T22:07:43.111704] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-02. [2025-09-26T22:07:43.389985] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-26T22:07:43.917160] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-03. [2025-09-26T22:07:43.931082] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-26T22:07:44.711734] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-03. [2025-09-26T22:07:44.901590] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-26T22:07:45.511757] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-04. [2025-09-26T22:07:45.623619] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-26T22:07:46.311714] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-09. [2025-09-26T22:07:46.558857] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-26T22:07:47.111697] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-05. [2025-09-26T22:07:47.577409] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-26T22:07:47.583711] [INFO ] [REMOTE ] WLY: Full fetch complete (43043 records). [2025-09-26T22:07:47.583836] [DEBUG] [VALIDATOR ] WLY: Validating primary data. [2025-09-26T22:07:47.916811] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-04. [2025-09-26T22:07:47.992086] [DEBUG] [VALIDATOR ] WLY: All expected trading days are present. [2025-09-26T22:07:47.992179] [DEBUG] [VALIDATOR ] WLY: Primary data validation passed. [2025-09-26T22:07:47.993260] [INFO ] [MAIN ] WLY: Fetched primary data is valid. [2025-09-26T22:07:47.993330] [DEBUG] [LOCAL ] WLY: Saving primary data. [2025-09-26T22:07:47.994956] [DEBUG] [LOCAL ] WLY: Trimmed 43043 records to 30414 (keeping 200 days of data) [2025-09-26T22:07:48.186837] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-26T22:07:48.209804] [DEBUG] [LOCAL ] WLY: Primary data saved (30414 records). [2025-09-26T22:07:48.209949] [INFO ] [MAIN ] WLY: Full history saved. [2025-09-26T22:07:48.210056] [INFO ] [MAIN ] Update Progress: 2305/2371 symbols completed. WLY took 31.2s. Estimated remaining: 8m 49s. Rate: 7.5 symbols/min [2025-09-26T22:07:48.452796] [INFO ] [MAIN ] WMS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:07:48.493357] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-26T22:07:48.549576] [DEBUG] [LOCAL ] WMS: Loaded 39993 existing records from primary storage. [2025-09-26T22:07:48.549763] [INFO ] [MAIN ] WMS: Loaded 39993 existing records. [2025-09-26T22:07:48.713677] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-06. [2025-09-26T22:07:48.746241] [WARN ] [MAIN ] WMS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:07:48.746575] [INFO ] [MAIN ] WMS: Wiping existing primary data before full refresh. [2025-09-26T22:07:48.746629] [INFO ] [LOCAL ] WMS: Starting deletion of primary data. [2025-09-26T22:07:48.747550] [DEBUG] [LOCAL ] WMS: Deleted primary data file. [2025-09-26T22:07:48.747610] [INFO ] [MAIN ] WMS: Starting full primary refresh. [2025-09-26T22:07:49.123343] [INFO ] [REMOTE ] WMS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:07:49.511701] [INFO ] [REMOTE ] WMS: Fetching primary data for 2024-12. [2025-09-26T22:07:49.666816] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-26T22:07:50.311746] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-05. [2025-09-26T22:07:51.112027] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-04. [2025-09-26T22:07:51.120021] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-26T22:07:51.181520] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-26T22:07:51.911712] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-07. [2025-09-26T22:07:51.975951] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-26T22:07:52.711710] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-01. [2025-09-26T22:07:52.845574] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-26T22:07:53.511762] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-08. [2025-09-26T22:07:54.244621] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-26T22:07:54.311721] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-05. [2025-09-26T22:07:54.513166] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-26T22:07:55.111701] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-02. [2025-09-26T22:07:55.215329] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-26T22:07:55.911717] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-06. [2025-09-26T22:07:56.636843] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-26T22:07:56.714791] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-06. [2025-09-26T22:07:56.721040] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-26T22:07:57.511707] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-07. [2025-09-26T22:07:57.543617] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-26T22:07:58.311707] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-07. [2025-09-26T22:07:58.351092] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-26T22:07:59.111705] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-03. [2025-09-26T22:07:59.250795] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-26T22:07:59.911730] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-08. [2025-09-26T22:08:00.711744] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-09. [2025-09-26T22:08:00.753193] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-26T22:08:00.798349] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-26T22:08:01.511765] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-04. [2025-09-26T22:08:01.834926] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-26T22:08:01.838807] [INFO ] [REMOTE ] WMK: Full fetch complete (19506 records). [2025-09-26T22:08:01.838924] [DEBUG] [VALIDATOR ] WMK: Validating primary data. [2025-09-26T22:08:02.239410] [DEBUG] [VALIDATOR ] WMK: All expected trading days are present. [2025-09-26T22:08:02.239509] [DEBUG] [VALIDATOR ] WMK: Primary data validation passed. [2025-09-26T22:08:02.240062] [INFO ] [MAIN ] WMK: Fetched primary data is valid. [2025-09-26T22:08:02.240129] [DEBUG] [LOCAL ] WMK: Saving primary data. [2025-09-26T22:08:02.240913] [DEBUG] [LOCAL ] WMK: Trimmed 19506 records to 14753 (keeping 200 days of data) [2025-09-26T22:08:02.319097] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-09. [2025-09-26T22:08:02.350404] [DEBUG] [LOCAL ] WMK: Primary data saved (14753 records). [2025-09-26T22:08:02.350551] [INFO ] [MAIN ] WMK: Full history saved. [2025-09-26T22:08:02.350678] [INFO ] [MAIN ] Update Progress: 2306/2371 symbols completed. WMK took 25.9s. Estimated remaining: 8m 41s. Rate: 7.5 symbols/min [2025-09-26T22:08:02.534096] [INFO ] [MAIN ] WMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:08:02.602541] [DEBUG] [LOCAL ] WMT: Loaded 54190 existing records from primary storage. [2025-09-26T22:08:02.602742] [INFO ] [MAIN ] WMT: Loaded 54190 existing records. [2025-09-26T22:08:02.806819] [WARN ] [MAIN ] WMT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:08:02.807188] [INFO ] [MAIN ] WMT: Wiping existing primary data before full refresh. [2025-09-26T22:08:02.807265] [INFO ] [LOCAL ] WMT: Starting deletion of primary data. [2025-09-26T22:08:02.817549] [DEBUG] [LOCAL ] WMT: Deleted primary data file. [2025-09-26T22:08:02.831283] [INFO ] [MAIN ] WMT: Starting full primary refresh. [2025-09-26T22:08:02.838579] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-26T22:08:03.117404] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-08. [2025-09-26T22:08:03.263523] [INFO ] [REMOTE ] WMT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:08:03.294385] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-26T22:08:03.305088] [INFO ] [REMOTE ] WMB: Full fetch complete (77690 records). [2025-09-26T22:08:03.305260] [DEBUG] [VALIDATOR ] WMB: Validating primary data. [2025-09-26T22:08:03.731629] [DEBUG] [VALIDATOR ] WMB: All expected trading days are present. [2025-09-26T22:08:03.731856] [DEBUG] [VALIDATOR ] WMB: Primary data validation passed. [2025-09-26T22:08:03.733278] [INFO ] [MAIN ] WMB: Fetched primary data is valid. [2025-09-26T22:08:03.733350] [DEBUG] [LOCAL ] WMB: Saving primary data. [2025-09-26T22:08:03.735024] [DEBUG] [LOCAL ] WMB: Trimmed 77690 records to 54451 (keeping 200 days of data) [2025-09-26T22:08:03.932441] [INFO ] [REMOTE ] WMT: Fetching primary data for 2024-12. [2025-09-26T22:08:04.116452] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-26T22:08:04.147832] [DEBUG] [LOCAL ] WMB: Primary data saved (54451 records). [2025-09-26T22:08:04.148010] [INFO ] [MAIN ] WMB: Full history saved. [2025-09-26T22:08:04.148121] [INFO ] [MAIN ] Update Progress: 2307/2371 symbols completed. WMB took 30.6s. Estimated remaining: 8m 33s. Rate: 7.5 symbols/min [2025-09-26T22:08:04.323458] [INFO ] [MAIN ] WNC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:08:04.362800] [DEBUG] [LOCAL ] WNC: Loaded 40262 existing records from primary storage. [2025-09-26T22:08:04.362995] [INFO ] [MAIN ] WNC: Loaded 40262 existing records. [2025-09-26T22:08:04.554478] [WARN ] [MAIN ] WNC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:08:04.554866] [INFO ] [MAIN ] WNC: Wiping existing primary data before full refresh. [2025-09-26T22:08:04.554923] [INFO ] [LOCAL ] WNC: Starting deletion of primary data. [2025-09-26T22:08:04.555900] [DEBUG] [LOCAL ] WNC: Deleted primary data file. [2025-09-26T22:08:04.555962] [INFO ] [MAIN ] WNC: Starting full primary refresh. [2025-09-26T22:08:04.717997] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-09. [2025-09-26T22:08:04.941195] [INFO ] [REMOTE ] WNC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:08:05.511719] [INFO ] [REMOTE ] WNC: Fetching primary data for 2024-12. [2025-09-26T22:08:05.571611] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-26T22:08:05.582062] [INFO ] [REMOTE ] WM: Full fetch complete (73766 records). [2025-09-26T22:08:05.582230] [DEBUG] [VALIDATOR ] WM: Validating primary data. [2025-09-26T22:08:05.993141] [DEBUG] [VALIDATOR ] WM: All expected trading days are present. [2025-09-26T22:08:05.993232] [DEBUG] [VALIDATOR ] WM: Primary data validation passed. [2025-09-26T22:08:05.994426] [INFO ] [MAIN ] WM: Fetched primary data is valid. [2025-09-26T22:08:05.994495] [DEBUG] [LOCAL ] WM: Saving primary data. [2025-09-26T22:08:05.997482] [DEBUG] [LOCAL ] WM: Trimmed 73766 records to 51697 (keeping 200 days of data) [2025-09-26T22:08:06.313100] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-05. [2025-09-26T22:08:06.355083] [DEBUG] [LOCAL ] WM: Primary data saved (51697 records). [2025-09-26T22:08:06.355244] [INFO ] [MAIN ] WM: Full history saved. [2025-09-26T22:08:06.356390] [INFO ] [MAIN ] Update Progress: 2308/2371 symbols completed. WM took 47.7s. Estimated remaining: 8m 25s. Rate: 7.5 symbols/min [2025-09-26T22:08:06.544107] [INFO ] [MAIN ] WNS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:08:06.612473] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2024-12 (2.68 seconds). [2025-09-26T22:08:06.641355] [DEBUG] [LOCAL ] WNS: Loaded 40320 existing records from primary storage. [2025-09-26T22:08:06.641534] [INFO ] [MAIN ] WNS: Loaded 40320 existing records. [2025-09-26T22:08:06.833246] [WARN ] [MAIN ] WNS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:08:06.833861] [INFO ] [MAIN ] WNS: Wiping existing primary data before full refresh. [2025-09-26T22:08:06.833930] [INFO ] [LOCAL ] WNS: Starting deletion of primary data. [2025-09-26T22:08:06.834815] [DEBUG] [LOCAL ] WNS: Deleted primary data file. [2025-09-26T22:08:06.834878] [INFO ] [MAIN ] WNS: Starting full primary refresh. [2025-09-26T22:08:07.119231] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-01. [2025-09-26T22:08:07.194256] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-26T22:08:07.289183] [INFO ] [REMOTE ] WNS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:08:07.920202] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-01. [2025-09-26T22:08:07.926249] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-26T22:08:08.711728] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-06. [2025-09-26T22:08:09.391136] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-26T22:08:09.511734] [INFO ] [REMOTE ] WNS: Fetching primary data for 2024-12. [2025-09-26T22:08:09.728987] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-01 (2.61 seconds). [2025-09-26T22:08:10.275302] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-26T22:08:10.311690] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-07. [2025-09-26T22:08:10.418818] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-26T22:08:11.111823] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-02. [2025-09-26T22:08:11.647859] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-26T22:08:11.911758] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-08. [2025-09-26T22:08:12.711746] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-02. [2025-09-26T22:08:12.788532] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-26T22:08:13.511747] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-01. [2025-09-26T22:08:13.549058] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-26T22:08:14.312016] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-09. [2025-09-26T22:08:15.035132] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-26T22:08:15.111690] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-02. [2025-09-26T22:08:15.335582] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-02 (2.62 seconds). [2025-09-26T22:08:15.911711] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-03. [2025-09-26T22:08:15.970498] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-26T22:08:15.979260] [INFO ] [REMOTE ] WMS: Full fetch complete (57292 records). [2025-09-26T22:08:15.979405] [DEBUG] [VALIDATOR ] WMS: Validating primary data. [2025-09-26T22:08:16.390253] [DEBUG] [VALIDATOR ] WMS: All expected trading days are present. [2025-09-26T22:08:16.390399] [DEBUG] [VALIDATOR ] WMS: Primary data validation passed. [2025-09-26T22:08:16.391861] [INFO ] [MAIN ] WMS: Fetched primary data is valid. [2025-09-26T22:08:16.391936] [DEBUG] [LOCAL ] WMS: Saving primary data. [2025-09-26T22:08:16.393790] [DEBUG] [LOCAL ] WMS: Trimmed 57292 records to 40249 (keeping 200 days of data) [2025-09-26T22:08:16.672687] [DEBUG] [LOCAL ] WMS: Primary data saved (40249 records). [2025-09-26T22:08:16.680042] [INFO ] [MAIN ] WMS: Full history saved. [2025-09-26T22:08:16.691053] [INFO ] [MAIN ] Update Progress: 2309/2371 symbols completed. WMS took 28.5s. Estimated remaining: 8m 17s. Rate: 7.5 symbols/min [2025-09-26T22:08:16.720202] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-26T22:08:16.720365] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-03. [2025-09-26T22:08:16.893799] [INFO ] [MAIN ] WOLF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:08:16.959662] [DEBUG] [LOCAL ] WOLF: Loaded 53922 existing records from primary storage. [2025-09-26T22:08:16.959881] [INFO ] [MAIN ] WOLF: Loaded 53922 existing records. [2025-09-26T22:08:17.150389] [WARN ] [MAIN ] WOLF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:08:17.150758] [INFO ] [MAIN ] WOLF: Wiping existing primary data before full refresh. [2025-09-26T22:08:17.150820] [INFO ] [LOCAL ] WOLF: Starting deletion of primary data. [2025-09-26T22:08:17.158508] [DEBUG] [LOCAL ] WOLF: Deleted primary data file. [2025-09-26T22:08:17.158620] [INFO ] [MAIN ] WOLF: Starting full primary refresh. [2025-09-26T22:08:17.519861] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-03. [2025-09-26T22:08:17.546736] [INFO ] [REMOTE ] WOLF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:08:17.586026] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-26T22:08:18.311742] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-04. [2025-09-26T22:08:19.005302] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-26T22:08:19.111735] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2024-12. [2025-09-26T22:08:19.378382] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-09-26T22:08:19.911718] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-04. [2025-09-26T22:08:20.013936] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-26T22:08:20.711747] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-04. [2025-09-26T22:08:21.423275] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-26T22:08:21.511782] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-05. [2025-09-26T22:08:21.924635] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-26T22:08:22.311719] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-01. [2025-09-26T22:08:22.551221] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-09-26T22:08:23.067502] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-26T22:08:23.111720] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-05. [2025-09-26T22:08:23.911722] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-05. [2025-09-26T22:08:24.585783] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T22:08:24.649884] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-09-26T22:08:24.711774] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-06. [2025-09-26T22:08:25.511785] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-02. [2025-09-26T22:08:26.098093] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-26T22:08:26.311750] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-07. [2025-09-26T22:08:26.477587] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-09-26T22:08:27.111748] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-06. [2025-09-26T22:08:27.790014] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-26T22:08:27.911756] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-03. [2025-09-26T22:08:28.040286] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-26T22:08:28.711734] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-06. [2025-09-26T22:08:29.368081] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-26T22:08:29.511791] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-07. [2025-09-26T22:08:30.110622] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-26T22:08:30.311766] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-07. [2025-09-26T22:08:30.414308] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-09-26T22:08:31.111789] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-08. [2025-09-26T22:08:31.804397] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-26T22:08:31.911735] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-04. [2025-09-26T22:08:32.356361] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-07 (2.84 seconds). [2025-09-26T22:08:32.539815] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-26T22:08:32.711740] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-08. [2025-09-26T22:08:33.511760] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-08. [2025-09-26T22:08:34.311706] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-09. [2025-09-26T22:08:34.426970] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-09-26T22:08:35.029324] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-26T22:08:35.111689] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-09. [2025-09-26T22:08:35.348344] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-09-26T22:08:35.714737] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-26T22:08:35.722861] [INFO ] [REMOTE ] WNS: Full fetch complete (54944 records). [2025-09-26T22:08:35.723046] [DEBUG] [VALIDATOR ] WNS: Validating primary data. [2025-09-26T22:08:35.916911] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-09. [2025-09-26T22:08:36.145578] [DEBUG] [VALIDATOR ] WNS: All expected trading days are present. [2025-09-26T22:08:36.145754] [DEBUG] [VALIDATOR ] WNS: Primary data validation passed. [2025-09-26T22:08:36.147268] [INFO ] [MAIN ] WNS: Fetched primary data is valid. [2025-09-26T22:08:36.147345] [DEBUG] [LOCAL ] WNS: Saving primary data. [2025-09-26T22:08:36.150413] [DEBUG] [LOCAL ] WNS: Trimmed 54944 records to 40539 (keeping 200 days of data) [2025-09-26T22:08:36.385996] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-26T22:08:36.403296] [INFO ] [REMOTE ] WNC: Full fetch complete (57481 records). [2025-09-26T22:08:36.406786] [DEBUG] [VALIDATOR ] WNC: Validating primary data. [2025-09-26T22:08:36.695388] [DEBUG] [LOCAL ] WNS: Primary data saved (40539 records). [2025-09-26T22:08:36.719042] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-05. [2025-09-26T22:08:36.718878] [INFO ] [MAIN ] WNS: Full history saved. [2025-09-26T22:08:36.725793] [INFO ] [MAIN ] Update Progress: 2310/2371 symbols completed. WNS took 30.4s. Estimated remaining: 8m 9s. Rate: 7.5 symbols/min [2025-09-26T22:08:37.015710] [DEBUG] [VALIDATOR ] WNC: All expected trading days are present. [2025-09-26T22:08:37.038292] [DEBUG] [VALIDATOR ] WNC: Primary data validation passed. [2025-09-26T22:08:37.039979] [INFO ] [MAIN ] WNC: Fetched primary data is valid. [2025-09-26T22:08:37.040103] [DEBUG] [LOCAL ] WNC: Saving primary data. [2025-09-26T22:08:37.038225] [INFO ] [MAIN ] WOR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:08:37.079152] [DEBUG] [LOCAL ] WNC: Trimmed 57481 records to 40452 (keeping 200 days of data) [2025-09-26T22:08:37.078920] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-26T22:08:37.092040] [INFO ] [REMOTE ] WMT: Full fetch complete (77968 records). [2025-09-26T22:08:37.092248] [DEBUG] [VALIDATOR ] WMT: Validating primary data. [2025-09-26T22:08:37.326801] [DEBUG] [LOCAL ] WOR: Loaded 25005 existing records from primary storage. [2025-09-26T22:08:37.352156] [INFO ] [MAIN ] WOR: Loaded 25005 existing records. [2025-09-26T22:08:37.756010] [WARN ] [MAIN ] WOR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:08:37.793525] [INFO ] [MAIN ] WOR: Wiping existing primary data before full refresh. [2025-09-26T22:08:37.795353] [INFO ] [LOCAL ] WOR: Starting deletion of primary data. [2025-09-26T22:08:37.814778] [DEBUG] [LOCAL ] WOR: Deleted primary data file. [2025-09-26T22:08:37.815377] [INFO ] [MAIN ] WOR: Starting full primary refresh. [2025-09-26T22:08:37.882270] [DEBUG] [VALIDATOR ] WMT: All expected trading days are present. [2025-09-26T22:08:37.902099] [DEBUG] [VALIDATOR ] WMT: Primary data validation passed. [2025-09-26T22:08:37.913107] [INFO ] [MAIN ] WMT: Fetched primary data is valid. [2025-09-26T22:08:37.927193] [DEBUG] [LOCAL ] WMT: Saving primary data. [2025-09-26T22:08:38.002513] [DEBUG] [LOCAL ] WMT: Trimmed 77968 records to 54580 (keeping 200 days of data) [2025-09-26T22:08:38.353573] [INFO ] [REMOTE ] WOR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:08:38.354902] [INFO ] [REMOTE ] WOR: Fetching primary data for 2024-12. [2025-09-26T22:08:38.636804] [DEBUG] [LOCAL ] WNC: Primary data saved (40452 records). [2025-09-26T22:08:38.637812] [INFO ] [MAIN ] WNC: Full history saved. [2025-09-26T22:08:38.638283] [INFO ] [MAIN ] Update Progress: 2311/2371 symbols completed. WNC took 34.5s. Estimated remaining: 8m 1s. Rate: 7.5 symbols/min [2025-09-26T22:08:38.832746] [INFO ] [MAIN ] WOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:08:38.877075] [DEBUG] [LOCAL ] WOW: Loaded 30492 existing records from primary storage. [2025-09-26T22:08:38.877682] [INFO ] [MAIN ] WOW: Loaded 30492 existing records. [2025-09-26T22:08:39.154309] [WARN ] [MAIN ] WOW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:08:39.156212] [INFO ] [MAIN ] WOW: Wiping existing primary data before full refresh. [2025-09-26T22:08:39.156973] [INFO ] [LOCAL ] WOW: Starting deletion of primary data. [2025-09-26T22:08:39.161635] [DEBUG] [LOCAL ] WOW: Deleted primary data file. [2025-09-26T22:08:39.161738] [INFO ] [MAIN ] WOW: Starting full primary refresh. [2025-09-26T22:08:39.587250] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-05 (2.87 seconds). [2025-09-26T22:08:39.630560] [INFO ] [REMOTE ] WOW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:08:39.632501] [INFO ] [REMOTE ] WOW: Fetching primary data for 2024-12. [2025-09-26T22:08:39.652886] [DEBUG] [LOCAL ] WMT: Primary data saved (54580 records). [2025-09-26T22:08:39.654466] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-06. [2025-09-26T22:08:39.653927] [INFO ] [MAIN ] WMT: Full history saved. [2025-09-26T22:08:39.667616] [INFO ] [MAIN ] Update Progress: 2312/2371 symbols completed. WMT took 37.3s. Estimated remaining: 7m 53s. Rate: 7.5 symbols/min [2025-09-26T22:08:39.676821] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-26T22:08:39.863429] [INFO ] [MAIN ] WPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:08:39.915542] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-01. [2025-09-26T22:08:39.917905] [DEBUG] [LOCAL ] WPC: Loaded 48858 existing records from primary storage. [2025-09-26T22:08:39.918107] [INFO ] [MAIN ] WPC: Loaded 48858 existing records. [2025-09-26T22:08:40.105008] [WARN ] [MAIN ] WPC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:08:40.105378] [INFO ] [MAIN ] WPC: Wiping existing primary data before full refresh. [2025-09-26T22:08:40.105432] [INFO ] [LOCAL ] WPC: Starting deletion of primary data. [2025-09-26T22:08:40.112205] [DEBUG] [LOCAL ] WPC: Deleted primary data file. [2025-09-26T22:08:40.112284] [INFO ] [MAIN ] WPC: Starting full primary refresh. [2025-09-26T22:08:40.495571] [INFO ] [REMOTE ] WPC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:08:40.711769] [INFO ] [REMOTE ] WPC: Fetching primary data for 2024-12. [2025-09-26T22:08:40.845977] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-26T22:08:41.285986] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-26T22:08:41.511722] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-01. [2025-09-26T22:08:41.747725] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-26T22:08:42.311758] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-02. [2025-09-26T22:08:42.700550] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-26T22:08:42.734340] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-26T22:08:43.111751] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-07. [2025-09-26T22:08:43.444870] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-26T22:08:43.911754] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-03. [2025-09-26T22:08:44.711772] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-01. [2025-09-26T22:08:45.300068] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-26T22:08:45.511724] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-02. [2025-09-26T22:08:45.914244] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-07 (2.80 seconds). [2025-09-26T22:08:46.311740] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-08. [2025-09-26T22:08:46.422940] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-26T22:08:46.469082] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-26T22:08:47.111768] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-02. [2025-09-26T22:08:47.911789] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-04. [2025-09-26T22:08:48.643908] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-09-26T22:08:48.716828] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-09. [2025-09-26T22:08:48.733201] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-26T22:08:49.239711] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-26T22:08:49.511735] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-05. [2025-09-26T22:08:50.311689] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-03. [2025-09-26T22:08:50.679900] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-26T22:08:51.111705] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-03. [2025-09-26T22:08:51.234927] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-09-26T22:08:51.245862] [INFO ] [REMOTE ] WOLF: Full fetch complete (77600 records). [2025-09-26T22:08:51.246111] [DEBUG] [VALIDATOR ] WOLF: Validating primary data. [2025-09-26T22:08:51.357871] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-26T22:08:51.755745] [DEBUG] [VALIDATOR ] WOLF: All expected trading days are present. [2025-09-26T22:08:51.755856] [DEBUG] [VALIDATOR ] WOLF: Primary data validation passed. [2025-09-26T22:08:51.757166] [INFO ] [MAIN ] WOLF: Fetched primary data is valid. [2025-09-26T22:08:51.757238] [DEBUG] [LOCAL ] WOLF: Saving primary data. [2025-09-26T22:08:51.760568] [DEBUG] [LOCAL ] WOLF: Trimmed 77600 records to 54312 (keeping 200 days of data) [2025-09-26T22:08:51.934237] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-04. [2025-09-26T22:08:52.096000] [DEBUG] [LOCAL ] WOLF: Primary data saved (54312 records). [2025-09-26T22:08:52.096168] [INFO ] [MAIN ] WOLF: Full history saved. [2025-09-26T22:08:52.096271] [INFO ] [MAIN ] Update Progress: 2313/2371 symbols completed. WOLF took 35.4s. Estimated remaining: 7m 45s. Rate: 7.5 symbols/min [2025-09-26T22:08:52.280289] [INFO ] [MAIN ] WPM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:08:52.338584] [DEBUG] [LOCAL ] WPM: Loaded 53121 existing records from primary storage. [2025-09-26T22:08:52.338836] [INFO ] [MAIN ] WPM: Loaded 53121 existing records. [2025-09-26T22:08:52.527186] [WARN ] [MAIN ] WPM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:08:52.527557] [INFO ] [MAIN ] WPM: Wiping existing primary data before full refresh. [2025-09-26T22:08:52.527627] [INFO ] [LOCAL ] WPM: Starting deletion of primary data. [2025-09-26T22:08:52.531552] [DEBUG] [LOCAL ] WPM: Deleted primary data file. [2025-09-26T22:08:52.531621] [INFO ] [MAIN ] WPM: Starting full primary refresh. [2025-09-26T22:08:52.721212] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-06. [2025-09-26T22:08:52.918519] [INFO ] [REMOTE ] WPM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:08:53.049206] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-26T22:08:53.350503] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-26T22:08:53.511729] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-05. [2025-09-26T22:08:54.002408] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-26T22:08:54.272538] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-26T22:08:54.311729] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-04. [2025-09-26T22:08:55.111735] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-06. [2025-09-26T22:08:55.911724] [INFO ] [REMOTE ] WPM: Fetching primary data for 2024-12. [2025-09-26T22:08:56.097995] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-26T22:08:56.317553] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-26T22:08:56.711721] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-05. [2025-09-26T22:08:57.511769] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-07. [2025-09-26T22:08:57.734427] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-26T22:08:58.311944] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-01. [2025-09-26T22:08:58.557218] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-26T22:08:58.880590] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-26T22:08:59.111749] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-07. [2025-09-26T22:08:59.911769] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-06. [2025-09-26T22:09:00.170241] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-26T22:09:00.536497] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-26T22:09:00.711764] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-02. [2025-09-26T22:09:01.439343] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-26T22:09:01.511733] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-08. [2025-09-26T22:09:02.311713] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-08. [2025-09-26T22:09:02.422140] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-26T22:09:02.829054] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-26T22:09:03.111716] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-07. [2025-09-26T22:09:03.901301] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-26T22:09:03.911671] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-03. [2025-09-26T22:09:04.711694] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-09. [2025-09-26T22:09:04.948525] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-26T22:09:05.511705] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-09. [2025-09-26T22:09:05.770864] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-26T22:09:05.971145] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-26T22:09:05.976991] [INFO ] [REMOTE ] WOR: Full fetch complete (36309 records). [2025-09-26T22:09:05.977282] [DEBUG] [VALIDATOR ] WOR: Validating primary data. [2025-09-26T22:09:06.316795] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-08. [2025-09-26T22:09:06.391846] [DEBUG] [VALIDATOR ] WOR: All expected trading days are present. [2025-09-26T22:09:06.391945] [DEBUG] [VALIDATOR ] WOR: Primary data validation passed. [2025-09-26T22:09:06.392911] [INFO ] [MAIN ] WOR: Fetched primary data is valid. [2025-09-26T22:09:06.393014] [DEBUG] [LOCAL ] WOR: Saving primary data. [2025-09-26T22:09:06.394160] [DEBUG] [LOCAL ] WOR: Trimmed 36309 records to 25288 (keeping 200 days of data) [2025-09-26T22:09:06.567169] [DEBUG] [LOCAL ] WOR: Primary data saved (25288 records). [2025-09-26T22:09:06.567331] [INFO ] [MAIN ] WOR: Full history saved. [2025-09-26T22:09:06.567430] [INFO ] [MAIN ] Update Progress: 2314/2371 symbols completed. WOR took 29.8s. Estimated remaining: 7m 37s. Rate: 7.5 symbols/min [2025-09-26T22:09:06.766893] [INFO ] [MAIN ] WPP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:09:06.808574] [DEBUG] [LOCAL ] WPP: Loaded 34018 existing records from primary storage. [2025-09-26T22:09:06.808757] [INFO ] [MAIN ] WPP: Loaded 34018 existing records. [2025-09-26T22:09:07.009998] [WARN ] [MAIN ] WPP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:09:07.010283] [INFO ] [MAIN ] WPP: Wiping existing primary data before full refresh. [2025-09-26T22:09:07.010335] [INFO ] [LOCAL ] WPP: Starting deletion of primary data. [2025-09-26T22:09:07.011856] [DEBUG] [LOCAL ] WPP: Deleted primary data file. [2025-09-26T22:09:07.011929] [INFO ] [MAIN ] WPP: Starting full primary refresh. [2025-09-26T22:09:07.120352] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-04. [2025-09-26T22:09:07.171402] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-26T22:09:07.242440] [INFO ] [REMOTE ] WOW: Full fetch complete (41896 records). [2025-09-26T22:09:07.294181] [DEBUG] [VALIDATOR ] WOW: Validating primary data. [2025-09-26T22:09:07.573700] [INFO ] [REMOTE ] WPP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:09:07.865476] [DEBUG] [VALIDATOR ] WOW: All expected trading days are present. [2025-09-26T22:09:07.865572] [DEBUG] [VALIDATOR ] WOW: Primary data validation passed. [2025-09-26T22:09:07.866563] [INFO ] [MAIN ] WOW: Fetched primary data is valid. [2025-09-26T22:09:07.866628] [DEBUG] [LOCAL ] WOW: Saving primary data. [2025-09-26T22:09:07.868251] [DEBUG] [LOCAL ] WOW: Trimmed 41896 records to 30769 (keeping 200 days of data) [2025-09-26T22:09:07.922028] [INFO ] [REMOTE ] WPP: Fetching primary data for 2024-12. [2025-09-26T22:09:08.058807] [DEBUG] [LOCAL ] WOW: Primary data saved (30769 records). [2025-09-26T22:09:08.059045] [INFO ] [MAIN ] WOW: Full history saved. [2025-09-26T22:09:08.059217] [INFO ] [MAIN ] Update Progress: 2315/2371 symbols completed. WOW took 29.4s. Estimated remaining: 7m 29s. Rate: 7.5 symbols/min [2025-09-26T22:09:08.263635] [INFO ] [MAIN ] WRB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:09:08.280564] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-26T22:09:08.342811] [DEBUG] [LOCAL ] WRB: Loaded 50934 existing records from primary storage. [2025-09-26T22:09:08.343037] [INFO ] [MAIN ] WRB: Loaded 50934 existing records. [2025-09-26T22:09:08.545999] [WARN ] [MAIN ] WRB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:09:08.546828] [INFO ] [MAIN ] WRB: Wiping existing primary data before full refresh. [2025-09-26T22:09:08.546889] [INFO ] [LOCAL ] WRB: Starting deletion of primary data. [2025-09-26T22:09:08.549831] [DEBUG] [LOCAL ] WRB: Deleted primary data file. [2025-09-26T22:09:08.549940] [INFO ] [MAIN ] WRB: Starting full primary refresh. [2025-09-26T22:09:08.716327] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-09. [2025-09-26T22:09:08.966932] [INFO ] [REMOTE ] WRB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:09:09.003246] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-26T22:09:09.203345] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-26T22:09:09.511723] [INFO ] [REMOTE ] WRB: Fetching primary data for 2024-12. [2025-09-26T22:09:10.311702] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-01. [2025-09-26T22:09:10.420587] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-26T22:09:10.429977] [INFO ] [REMOTE ] WPC: Full fetch complete (70826 records). [2025-09-26T22:09:10.430138] [DEBUG] [VALIDATOR ] WPC: Validating primary data. [2025-09-26T22:09:10.853723] [DEBUG] [VALIDATOR ] WPC: All expected trading days are present. [2025-09-26T22:09:10.853818] [DEBUG] [VALIDATOR ] WPC: Primary data validation passed. [2025-09-26T22:09:10.855074] [INFO ] [MAIN ] WPC: Fetched primary data is valid. [2025-09-26T22:09:10.855142] [DEBUG] [LOCAL ] WPC: Saving primary data. [2025-09-26T22:09:10.856966] [DEBUG] [LOCAL ] WPC: Trimmed 70826 records to 49217 (keeping 200 days of data) [2025-09-26T22:09:11.113241] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-05. [2025-09-26T22:09:11.189092] [DEBUG] [LOCAL ] WPC: Primary data saved (49217 records). [2025-09-26T22:09:11.189741] [INFO ] [MAIN ] WPC: Full history saved. [2025-09-26T22:09:11.190424] [INFO ] [MAIN ] Update Progress: 2316/2371 symbols completed. WPC took 31.5s. Estimated remaining: 7m 20s. Rate: 7.5 symbols/min [2025-09-26T22:09:11.422663] [INFO ] [MAIN ] WRBY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:09:11.426313] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-26T22:09:11.510032] [DEBUG] [LOCAL ] WRBY: Loaded 51247 existing records from primary storage. [2025-09-26T22:09:11.510212] [INFO ] [MAIN ] WRBY: Loaded 51247 existing records. [2025-09-26T22:09:11.702204] [WARN ] [MAIN ] WRBY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:09:11.702476] [INFO ] [MAIN ] WRBY: Wiping existing primary data before full refresh. [2025-09-26T22:09:11.702527] [INFO ] [LOCAL ] WRBY: Starting deletion of primary data. [2025-09-26T22:09:11.705804] [DEBUG] [LOCAL ] WRBY: Deleted primary data file. [2025-09-26T22:09:11.705887] [INFO ] [MAIN ] WRBY: Starting full primary refresh. [2025-09-26T22:09:11.915913] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-01. [2025-09-26T22:09:12.069406] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-26T22:09:12.148183] [INFO ] [REMOTE ] WRBY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:09:12.711739] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2024-12. [2025-09-26T22:09:13.132828] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-26T22:09:13.511716] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-06. [2025-09-26T22:09:13.892574] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-26T22:09:14.124383] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-26T22:09:14.311719] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-02. [2025-09-26T22:09:15.111729] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-02. [2025-09-26T22:09:15.410252] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-26T22:09:15.911735] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-01. [2025-09-26T22:09:16.074526] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-26T22:09:16.278048] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-26T22:09:16.711750] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-03. [2025-09-26T22:09:17.511713] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-03. [2025-09-26T22:09:17.733018] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-26T22:09:18.238560] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-26T22:09:18.311730] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-07. [2025-09-26T22:09:19.047876] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T22:09:19.111690] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-04. [2025-09-26T22:09:19.911702] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-02. [2025-09-26T22:09:20.219462] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-26T22:09:20.543283] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-26T22:09:20.711724] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-08. [2025-09-26T22:09:21.511699] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-04. [2025-09-26T22:09:21.544843] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T22:09:22.311732] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-05. [2025-09-26T22:09:22.908446] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-26T22:09:23.111714] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-03. [2025-09-26T22:09:23.426608] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-26T22:09:23.610917] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-26T22:09:23.911722] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-05. [2025-09-26T22:09:24.711694] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-06. [2025-09-26T22:09:24.820049] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-26T22:09:25.511699] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-04. [2025-09-26T22:09:25.684207] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-26T22:09:26.129952] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-26T22:09:26.311725] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-09. [2025-09-26T22:09:27.121053] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-06. [2025-09-26T22:09:27.143923] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-26T22:09:27.911697] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-07. [2025-09-26T22:09:28.156943] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-26T22:09:28.167546] [INFO ] [REMOTE ] WPM: Full fetch complete (75860 records). [2025-09-26T22:09:28.167830] [DEBUG] [VALIDATOR ] WPM: Validating primary data. [2025-09-26T22:09:28.594276] [DEBUG] [VALIDATOR ] WPM: All expected trading days are present. [2025-09-26T22:09:28.594388] [DEBUG] [VALIDATOR ] WPM: Primary data validation passed. [2025-09-26T22:09:28.595838] [INFO ] [MAIN ] WPM: Fetched primary data is valid. [2025-09-26T22:09:28.595907] [DEBUG] [LOCAL ] WPM: Saving primary data. [2025-09-26T22:09:28.598790] [DEBUG] [LOCAL ] WPM: Trimmed 75860 records to 53504 (keeping 200 days of data) [2025-09-26T22:09:28.711701] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-05. [2025-09-26T22:09:28.969995] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-26T22:09:29.005620] [DEBUG] [LOCAL ] WPM: Primary data saved (53504 records). [2025-09-26T22:09:29.005828] [INFO ] [MAIN ] WPM: Full history saved. [2025-09-26T22:09:29.005986] [INFO ] [MAIN ] Update Progress: 2317/2371 symbols completed. WPM took 36.9s. Estimated remaining: 7m 13s. Rate: 7.5 symbols/min [2025-09-26T22:09:29.511737] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-07. [2025-09-26T22:09:29.568131] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-26T22:09:30.311722] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-08. [2025-09-26T22:09:30.603296] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-26T22:09:31.111736] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-06. [2025-09-26T22:09:31.259999] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-26T22:09:31.773629] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-26T22:09:31.911752] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-09. [2025-09-26T22:09:32.711690] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-08. [2025-09-26T22:09:32.819552] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-26T22:09:32.884865] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-26T22:09:32.892035] [INFO ] [REMOTE ] WPP: Full fetch complete (45272 records). [2025-09-26T22:09:32.892151] [DEBUG] [VALIDATOR ] WPP: Validating primary data. [2025-09-26T22:09:33.289038] [DEBUG] [VALIDATOR ] WPP: All expected trading days are present. [2025-09-26T22:09:33.289150] [DEBUG] [VALIDATOR ] WPP: Primary data validation passed. [2025-09-26T22:09:33.290170] [INFO ] [MAIN ] WPP: Fetched primary data is valid. [2025-09-26T22:09:33.290236] [DEBUG] [LOCAL ] WPP: Saving primary data. [2025-09-26T22:09:33.291329] [DEBUG] [LOCAL ] WPP: Trimmed 45272 records to 34282 (keeping 200 days of data) [2025-09-26T22:09:33.514491] [DEBUG] [LOCAL ] WPP: Primary data saved (34282 records). [2025-09-26T22:09:33.511874] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-07. [2025-09-26T22:09:33.515688] [INFO ] [MAIN ] WPP: Full history saved. [2025-09-26T22:09:33.515925] [INFO ] [MAIN ] Update Progress: 2318/2371 symbols completed. WPP took 26.9s. Estimated remaining: 7m 5s. Rate: 7.5 symbols/min [2025-09-26T22:09:34.352433] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-26T22:09:34.363234] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-09. [2025-09-26T22:09:35.082613] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-26T22:09:35.092628] [INFO ] [REMOTE ] WRB: Full fetch complete (73307 records). [2025-09-26T22:09:35.092791] [DEBUG] [VALIDATOR ] WRB: Validating primary data. [2025-09-26T22:09:35.547571] [DEBUG] [VALIDATOR ] WRB: All expected trading days are present. [2025-09-26T22:09:35.547725] [DEBUG] [VALIDATOR ] WRB: Primary data validation passed. [2025-09-26T22:09:35.549155] [INFO ] [MAIN ] WRB: Fetched primary data is valid. [2025-09-26T22:09:35.549305] [DEBUG] [LOCAL ] WRB: Saving primary data. [2025-09-26T22:09:35.581531] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-26T22:09:35.579852] [DEBUG] [LOCAL ] WRB: Trimmed 73307 records to 51313 (keeping 200 days of data) [2025-09-26T22:09:35.593771] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-08. [2025-09-26T22:09:35.929207] [DEBUG] [LOCAL ] WRB: Primary data saved (51313 records). [2025-09-26T22:09:35.929385] [INFO ] [MAIN ] WRB: Full history saved. [2025-09-26T22:09:35.929485] [INFO ] [MAIN ] Update Progress: 2319/2371 symbols completed. WRB took 27.9s. Estimated remaining: 6m 56s. Rate: 7.5 symbols/min [2025-09-26T22:09:37.299900] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-26T22:09:37.310989] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-09. [2025-09-26T22:09:38.952489] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-26T22:09:38.962620] [INFO ] [REMOTE ] WRBY: Full fetch complete (73388 records). [2025-09-26T22:09:38.962821] [DEBUG] [VALIDATOR ] WRBY: Validating primary data. [2025-09-26T22:09:39.377680] [DEBUG] [VALIDATOR ] WRBY: All expected trading days are present. [2025-09-26T22:09:39.377793] [DEBUG] [VALIDATOR ] WRBY: Primary data validation passed. [2025-09-26T22:09:39.379018] [INFO ] [MAIN ] WRBY: Fetched primary data is valid. [2025-09-26T22:09:39.379084] [DEBUG] [LOCAL ] WRBY: Saving primary data. [2025-09-26T22:09:39.381076] [DEBUG] [LOCAL ] WRBY: Trimmed 73388 records to 51609 (keeping 200 days of data) [2025-09-26T22:09:39.700740] [DEBUG] [LOCAL ] WRBY: Primary data saved (51609 records). [2025-09-26T22:09:39.700889] [INFO ] [MAIN ] WRBY: Full history saved. [2025-09-26T22:09:39.700995] [INFO ] [MAIN ] Update Progress: 2320/2371 symbols completed. WRBY took 28.5s. Estimated remaining: 6m 48s. Rate: 7.5 symbols/min [2025-09-26T22:09:40.424096] [INFO ] [MAIN ] WSO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:09:40.420391] [INFO ] [MAIN ] WS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:09:40.449908] [INFO ] [MAIN ] WSR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:09:40.475584] [INFO ] [MAIN ] WSM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:09:40.505818] [DEBUG] [LOCAL ] WSO: Loaded 24870 existing records from primary storage. [2025-09-26T22:09:40.511157] [INFO ] [MAIN ] WSO: Loaded 24870 existing records. [2025-09-26T22:09:40.562131] [DEBUG] [LOCAL ] WS: Loaded 24167 existing records from primary storage. [2025-09-26T22:09:40.573008] [INFO ] [MAIN ] WS: Loaded 24167 existing records. [2025-09-26T22:09:40.726153] [DEBUG] [LOCAL ] WSR: Loaded 23424 existing records from primary storage. [2025-09-26T22:09:40.743934] [INFO ] [MAIN ] WSR: Loaded 23424 existing records. [2025-09-26T22:09:41.020637] [WARN ] [MAIN ] WS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:09:41.024301] [WARN ] [MAIN ] WSO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:09:41.044204] [INFO ] [MAIN ] WS: Wiping existing primary data before full refresh. [2025-09-26T22:09:41.071547] [INFO ] [MAIN ] WSO: Wiping existing primary data before full refresh. [2025-09-26T22:09:41.071858] [INFO ] [LOCAL ] WS: Starting deletion of primary data. [2025-09-26T22:09:41.071779] [INFO ] [LOCAL ] WSO: Starting deletion of primary data. [2025-09-26T22:09:41.077794] [DEBUG] [LOCAL ] WSM: Loaded 50211 existing records from primary storage. [2025-09-26T22:09:41.077975] [INFO ] [MAIN ] WSM: Loaded 50211 existing records. [2025-09-26T22:09:41.083188] [DEBUG] [LOCAL ] WS: Deleted primary data file. [2025-09-26T22:09:41.099894] [INFO ] [MAIN ] WS: Starting full primary refresh. [2025-09-26T22:09:41.100005] [DEBUG] [LOCAL ] WSO: Deleted primary data file. [2025-09-26T22:09:41.161453] [INFO ] [MAIN ] WSO: Starting full primary refresh. [2025-09-26T22:09:41.489130] [WARN ] [MAIN ] WSR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:09:41.607484] [INFO ] [MAIN ] WSR: Wiping existing primary data before full refresh. [2025-09-26T22:09:41.612984] [WARN ] [MAIN ] WSM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:09:41.629189] [INFO ] [LOCAL ] WSR: Starting deletion of primary data. [2025-09-26T22:09:41.687531] [DEBUG] [LOCAL ] WSR: Deleted primary data file. [2025-09-26T22:09:41.682524] [INFO ] [MAIN ] WSM: Wiping existing primary data before full refresh. [2025-09-26T22:09:41.715798] [INFO ] [LOCAL ] WSM: Starting deletion of primary data. [2025-09-26T22:09:41.721512] [INFO ] [MAIN ] WSR: Starting full primary refresh. [2025-09-26T22:09:41.802931] [DEBUG] [LOCAL ] WSM: Deleted primary data file. [2025-09-26T22:09:41.854986] [INFO ] [MAIN ] WSM: Starting full primary refresh. [2025-09-26T22:09:42.691867] [INFO ] [REMOTE ] WS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:09:42.720417] [INFO ] [REMOTE ] WSO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:09:42.745398] [INFO ] [REMOTE ] WSO: Fetching primary data for 2024-12. [2025-09-26T22:09:42.745912] [INFO ] [REMOTE ] WS: Fetching primary data for 2024-12. [2025-09-26T22:09:43.112360] [INFO ] [REMOTE ] WSR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:09:43.130462] [INFO ] [REMOTE ] WSR: Fetching primary data for 2024-12. [2025-09-26T22:09:43.134238] [INFO ] [REMOTE ] WSM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:09:43.135607] [INFO ] [REMOTE ] WSM: Fetching primary data for 2024-12. [2025-09-26T22:09:43.891995] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-26T22:09:43.896362] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-01. [2025-09-26T22:09:44.267671] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-26T22:09:44.279764] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-01. [2025-09-26T22:09:44.290855] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-26T22:09:44.296613] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-01. [2025-09-26T22:09:44.926990] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-26T22:09:44.937932] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-01. [2025-09-26T22:09:45.051511] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-26T22:09:45.056200] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-02. [2025-09-26T22:09:45.432156] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-26T22:09:45.437317] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-02. [2025-09-26T22:09:45.530259] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-26T22:09:45.536397] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-02. [2025-09-26T22:09:45.960973] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-26T22:09:45.966404] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-03. [2025-09-26T22:09:46.480995] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-26T22:09:46.488419] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-03. [2025-09-26T22:09:46.565113] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-26T22:09:46.790418] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-26T22:09:47.111782] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-02. [2025-09-26T22:09:47.243023] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-26T22:09:47.400601] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-26T22:09:47.911780] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-04. [2025-09-26T22:09:48.711746] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-03. [2025-09-26T22:09:48.817334] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-26T22:09:49.276315] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-26T22:09:49.511780] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-03. [2025-09-26T22:09:49.642672] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-26T22:09:50.311760] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-05. [2025-09-26T22:09:51.111733] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-04. [2025-09-26T22:09:51.556361] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-26T22:09:51.591559] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-26T22:09:51.911771] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-04. [2025-09-26T22:09:52.390805] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-26T22:09:52.711735] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-05. [2025-09-26T22:09:53.055851] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-26T22:09:53.511718] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-06. [2025-09-26T22:09:54.039821] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-26T22:09:54.311698] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-05. [2025-09-26T22:09:54.670344] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-26T22:09:55.122013] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-04. [2025-09-26T22:09:55.133998] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-26T22:09:55.911733] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-06. [2025-09-26T22:09:56.711773] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-07. [2025-09-26T22:09:57.014744] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-26T22:09:57.258308] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-26T22:09:57.511739] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-05. [2025-09-26T22:09:57.993265] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-26T22:09:58.311739] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-06. [2025-09-26T22:09:59.111732] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-07. [2025-09-26T22:09:59.406393] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-26T22:09:59.450714] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-26T22:09:59.911730] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-06. [2025-09-26T22:09:59.946078] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-26T22:10:00.711762] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-08. [2025-09-26T22:10:01.511774] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-07. [2025-09-26T22:10:01.817299] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-26T22:10:01.945987] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-26T22:10:02.311731] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-09. [2025-09-26T22:10:02.879801] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-26T22:10:03.111729] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-08. [2025-09-26T22:10:03.549562] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-26T22:10:03.555094] [INFO ] [REMOTE ] WS: Full fetch complete (36546 records). [2025-09-26T22:10:03.555219] [DEBUG] [VALIDATOR ] WS: Validating primary data. [2025-09-26T22:10:03.921275] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-07. [2025-09-26T22:10:03.964675] [DEBUG] [VALIDATOR ] WS: All expected trading days are present. [2025-09-26T22:10:03.964779] [DEBUG] [VALIDATOR ] WS: Primary data validation passed. [2025-09-26T22:10:03.965904] [INFO ] [MAIN ] WS: Fetched primary data is valid. [2025-09-26T22:10:03.965976] [DEBUG] [LOCAL ] WS: Saving primary data. [2025-09-26T22:10:03.967160] [DEBUG] [LOCAL ] WS: Trimmed 36546 records to 24434 (keeping 200 days of data) [2025-09-26T22:10:04.121511] [DEBUG] [LOCAL ] WS: Primary data saved (24434 records). [2025-09-26T22:10:04.121695] [INFO ] [MAIN ] WS: Full history saved. [2025-09-26T22:10:04.121809] [INFO ] [MAIN ] Update Progress: 2321/2371 symbols completed. WS took 24.4s. Estimated remaining: 6m 41s. Rate: 7.5 symbols/min [2025-09-26T22:10:04.311976] [INFO ] [MAIN ] WST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:10:04.330116] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-26T22:10:04.376249] [DEBUG] [LOCAL ] WST: Loaded 37866 existing records from primary storage. [2025-09-26T22:10:04.376406] [INFO ] [MAIN ] WST: Loaded 37866 existing records. [2025-09-26T22:10:04.583558] [WARN ] [MAIN ] WST: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:10:04.584029] [INFO ] [MAIN ] WST: Wiping existing primary data before full refresh. [2025-09-26T22:10:04.584091] [INFO ] [LOCAL ] WST: Starting deletion of primary data. [2025-09-26T22:10:04.586392] [DEBUG] [LOCAL ] WST: Deleted primary data file. [2025-09-26T22:10:04.586497] [INFO ] [MAIN ] WST: Starting full primary refresh. [2025-09-26T22:10:04.716854] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-09. [2025-09-26T22:10:04.976683] [INFO ] [REMOTE ] WST: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:10:05.511748] [INFO ] [REMOTE ] WST: Fetching primary data for 2024-12. [2025-09-26T22:10:05.930625] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-26T22:10:06.187376] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-26T22:10:06.193574] [INFO ] [REMOTE ] WSO: Full fetch complete (34131 records). [2025-09-26T22:10:06.193753] [DEBUG] [VALIDATOR ] WSO: Validating primary data. [2025-09-26T22:10:06.316801] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-08. [2025-09-26T22:10:06.606157] [DEBUG] [VALIDATOR ] WSO: All expected trading days are present. [2025-09-26T22:10:06.606286] [DEBUG] [VALIDATOR ] WSO: Primary data validation passed. [2025-09-26T22:10:06.607423] [INFO ] [MAIN ] WSO: Fetched primary data is valid. [2025-09-26T22:10:06.607538] [DEBUG] [LOCAL ] WSO: Saving primary data. [2025-09-26T22:10:06.609011] [DEBUG] [LOCAL ] WSO: Trimmed 34131 records to 25059 (keeping 200 days of data) [2025-09-26T22:10:06.723838] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-26T22:10:06.801264] [DEBUG] [LOCAL ] WSO: Primary data saved (25059 records). [2025-09-26T22:10:06.801414] [INFO ] [MAIN ] WSO: Full history saved. [2025-09-26T22:10:06.801525] [INFO ] [MAIN ] Update Progress: 2322/2371 symbols completed. WSO took 27.1s. Estimated remaining: 6m 33s. Rate: 7.5 symbols/min [2025-09-26T22:10:06.979494] [INFO ] [MAIN ] WT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:10:07.026444] [DEBUG] [LOCAL ] WT: Loaded 47993 existing records from primary storage. [2025-09-26T22:10:07.026627] [INFO ] [MAIN ] WT: Loaded 47993 existing records. [2025-09-26T22:10:07.116826] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-08. [2025-09-26T22:10:07.219128] [WARN ] [MAIN ] WT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:10:07.219454] [INFO ] [MAIN ] WT: Wiping existing primary data before full refresh. [2025-09-26T22:10:07.219504] [INFO ] [LOCAL ] WT: Starting deletion of primary data. [2025-09-26T22:10:07.222237] [DEBUG] [LOCAL ] WT: Deleted primary data file. [2025-09-26T22:10:07.222303] [INFO ] [MAIN ] WT: Starting full primary refresh. [2025-09-26T22:10:07.653052] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-26T22:10:07.652090] [INFO ] [REMOTE ] WT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:10:07.911724] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-01. [2025-09-26T22:10:08.711736] [INFO ] [REMOTE ] WT: Fetching primary data for 2024-12. [2025-09-26T22:10:08.884386] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-26T22:10:09.311256] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-26T22:10:09.511769] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-09. [2025-09-26T22:10:10.233164] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-26T22:10:10.242891] [INFO ] [REMOTE ] WSM: Full fetch complete (72114 records). [2025-09-26T22:10:10.243087] [DEBUG] [VALIDATOR ] WSM: Validating primary data. [2025-09-26T22:10:10.316502] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-02. [2025-09-26T22:10:10.727387] [DEBUG] [VALIDATOR ] WSM: All expected trading days are present. [2025-09-26T22:10:10.729743] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-26T22:10:10.739568] [DEBUG] [VALIDATOR ] WSM: Primary data validation passed. [2025-09-26T22:10:10.741868] [INFO ] [MAIN ] WSM: Fetched primary data is valid. [2025-09-26T22:10:10.741946] [DEBUG] [LOCAL ] WSM: Saving primary data. [2025-09-26T22:10:10.743483] [DEBUG] [LOCAL ] WSM: Trimmed 72114 records to 50533 (keeping 200 days of data) [2025-09-26T22:10:11.083945] [DEBUG] [LOCAL ] WSM: Primary data saved (50533 records). [2025-09-26T22:10:11.084182] [INFO ] [MAIN ] WSM: Full history saved. [2025-09-26T22:10:11.084374] [INFO ] [MAIN ] Update Progress: 2323/2371 symbols completed. WSM took 31.4s. Estimated remaining: 6m 24s. Rate: 7.5 symbols/min [2025-09-26T22:10:11.124342] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-01. [2025-09-26T22:10:11.303407] [INFO ] [MAIN ] WTI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:10:11.350615] [DEBUG] [LOCAL ] WTI: Loaded 44092 existing records from primary storage. [2025-09-26T22:10:11.350838] [INFO ] [MAIN ] WTI: Loaded 44092 existing records. [2025-09-26T22:10:11.546197] [WARN ] [MAIN ] WTI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:10:11.546616] [INFO ] [MAIN ] WTI: Wiping existing primary data before full refresh. [2025-09-26T22:10:11.546700] [INFO ] [LOCAL ] WTI: Starting deletion of primary data. [2025-09-26T22:10:11.548897] [DEBUG] [LOCAL ] WTI: Deleted primary data file. [2025-09-26T22:10:11.548960] [INFO ] [MAIN ] WTI: Starting full primary refresh. [2025-09-26T22:10:11.911706] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-09. [2025-09-26T22:10:11.926346] [INFO ] [REMOTE ] WTI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:10:12.200627] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-26T22:10:12.711699] [INFO ] [REMOTE ] WTI: Fetching primary data for 2024-12. [2025-09-26T22:10:12.821071] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-26T22:10:13.139639] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-26T22:10:13.144270] [INFO ] [REMOTE ] WSR: Full fetch complete (32796 records). [2025-09-26T22:10:13.144370] [DEBUG] [VALIDATOR ] WSR: Validating primary data. [2025-09-26T22:10:13.521001] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-02. [2025-09-26T22:10:13.557866] [DEBUG] [VALIDATOR ] WSR: All expected trading days are present. [2025-09-26T22:10:13.557959] [DEBUG] [VALIDATOR ] WSR: Primary data validation passed. [2025-09-26T22:10:13.558795] [INFO ] [MAIN ] WSR: Fetched primary data is valid. [2025-09-26T22:10:13.558864] [DEBUG] [LOCAL ] WSR: Saving primary data. [2025-09-26T22:10:13.560004] [DEBUG] [LOCAL ] WSR: Trimmed 32796 records to 23550 (keeping 200 days of data) [2025-09-26T22:10:13.714549] [DEBUG] [LOCAL ] WSR: Primary data saved (23550 records). [2025-09-26T22:10:13.714734] [INFO ] [MAIN ] WSR: Full history saved. [2025-09-26T22:10:13.714844] [INFO ] [MAIN ] Update Progress: 2324/2371 symbols completed. WSR took 34.0s. Estimated remaining: 6m 16s. Rate: 7.5 symbols/min [2025-09-26T22:10:13.902005] [INFO ] [MAIN ] WTM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:10:13.902281] [DEBUG] [LOCAL ] WTM: No existing data file found in primary storage. [2025-09-26T22:10:13.902324] [WARN ] [MAIN ] WTM: No existing data found, performing full refresh instead. [2025-09-26T22:10:13.902542] [INFO ] [MAIN ] WTM: Wiping existing primary data before full refresh. [2025-09-26T22:10:13.902590] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-09-26T22:10:13.902635] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-09-26T22:10:13.902717] [INFO ] [MAIN ] WTM: Starting full primary refresh. [2025-09-26T22:10:14.306387] [INFO ] [REMOTE ] WTM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:10:14.311691] [INFO ] [REMOTE ] WTM: Fetching primary data for 2024-12. [2025-09-26T22:10:14.429827] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-26T22:10:14.780598] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-26T22:10:14.830813] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-26T22:10:15.111736] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-01. [2025-09-26T22:10:15.651197] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-26T22:10:15.911726] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-02. [2025-09-26T22:10:16.440448] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-26T22:10:16.711757] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-03. [2025-09-26T22:10:17.511722] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-01. [2025-09-26T22:10:18.311702] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-03. [2025-09-26T22:10:18.346691] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-26T22:10:18.865678] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-26T22:10:19.111732] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-04. [2025-09-26T22:10:19.204053] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-26T22:10:19.597952] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-26T22:10:19.911726] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-05. [2025-09-26T22:10:20.317691] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-26T22:10:20.711727] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-02. [2025-09-26T22:10:21.511732] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-06. [2025-09-26T22:10:22.219147] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-26T22:10:22.222593] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-26T22:10:22.311733] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-03. [2025-09-26T22:10:23.111714] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-04. [2025-09-26T22:10:23.865637] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T22:10:23.911690] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-03. [2025-09-26T22:10:24.711716] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-07. [2025-09-26T22:10:25.201737] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-26T22:10:25.206112] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-26T22:10:25.516818] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-08. [2025-09-26T22:10:25.536308] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-26T22:10:26.035716] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-26T22:10:26.311716] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-09. [2025-09-26T22:10:26.943870] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-26T22:10:26.945296] [INFO ] [REMOTE ] WTM: Full fetch complete (2277 records). [2025-09-26T22:10:26.945371] [DEBUG] [VALIDATOR ] WTM: Validating primary data. [2025-09-26T22:10:27.114567] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-05. [2025-09-26T22:10:27.145563] [WARN ] [VALIDATOR ] WTM: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-26T22:10:27.145827] [FATAL] [MAIN ] WTM: Fetched primary data is invalid. Refusing to save it. [2025-09-26T22:10:27.145882] [WARN ] [MAIN ] WTM: Deleting existing primary and derivative data due to validation failure. [2025-09-26T22:10:27.145965] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-09-26T22:10:27.146072] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-09-26T22:10:27.146129] [INFO ] [LOCAL ] WTM: Starting deletion of derivative data. [2025-09-26T22:10:27.146199] [DEBUG] [LOCAL ] WTM: No derivative data file found to delete. [2025-09-26T22:10:27.146284] [INFO ] [MAIN ] Update Progress: 2325/2371 symbols completed. WTM took 13.4s. Estimated remaining: 6m 8s. Rate: 7.5 symbols/min [2025-09-26T22:10:27.335456] [INFO ] [MAIN ] WTRG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:10:27.390431] [DEBUG] [LOCAL ] WTRG: Loaded 51278 existing records from primary storage. [2025-09-26T22:10:27.390609] [INFO ] [MAIN ] WTRG: Loaded 51278 existing records. [2025-09-26T22:10:27.589206] [WARN ] [MAIN ] WTRG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:10:27.589516] [INFO ] [MAIN ] WTRG: Wiping existing primary data before full refresh. [2025-09-26T22:10:27.589605] [INFO ] [LOCAL ] WTRG: Starting deletion of primary data. [2025-09-26T22:10:27.592724] [DEBUG] [LOCAL ] WTRG: Deleted primary data file. [2025-09-26T22:10:27.592791] [INFO ] [MAIN ] WTRG: Starting full primary refresh. [2025-09-26T22:10:27.916883] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-04. [2025-09-26T22:10:27.978289] [INFO ] [REMOTE ] WTRG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:10:28.711738] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2024-12. [2025-09-26T22:10:28.856954] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-26T22:10:29.511709] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-06. [2025-09-26T22:10:29.620102] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-26T22:10:30.311927] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-04. [2025-09-26T22:10:30.356294] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-26T22:10:31.099842] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-26T22:10:31.111679] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-07. [2025-09-26T22:10:31.911701] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-01. [2025-09-26T22:10:32.065831] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-26T22:10:32.533113] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-26T22:10:32.711721] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-05. [2025-09-26T22:10:33.511708] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-05. [2025-09-26T22:10:33.578465] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-26T22:10:34.311734] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-02. [2025-09-26T22:10:34.426273] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-26T22:10:35.111712] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-06. [2025-09-26T22:10:35.142961] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-26T22:10:35.757988] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-26T22:10:35.911743] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-08. [2025-09-26T22:10:36.711705] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-03. [2025-09-26T22:10:36.983568] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-26T22:10:37.511737] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-06. [2025-09-26T22:10:37.659213] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-26T22:10:38.174021] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-26T22:10:38.311740] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-09. [2025-09-26T22:10:39.121866] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-04. [2025-09-26T22:10:39.127277] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-26T22:10:39.911732] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-07. [2025-09-26T22:10:39.969076] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-26T22:10:39.980084] [INFO ] [REMOTE ] WT: Full fetch complete (69042 records). [2025-09-26T22:10:39.980338] [DEBUG] [VALIDATOR ] WT: Validating primary data. [2025-09-26T22:10:40.400702] [DEBUG] [VALIDATOR ] WT: All expected trading days are present. [2025-09-26T22:10:40.400825] [DEBUG] [VALIDATOR ] WT: Primary data validation passed. [2025-09-26T22:10:40.402113] [INFO ] [MAIN ] WT: Fetched primary data is valid. [2025-09-26T22:10:40.402206] [DEBUG] [LOCAL ] WT: Saving primary data. [2025-09-26T22:10:40.403823] [DEBUG] [LOCAL ] WT: Trimmed 69042 records to 48354 (keeping 200 days of data) [2025-09-26T22:10:40.668300] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-26T22:10:40.714012] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-05. [2025-09-26T22:10:40.770413] [DEBUG] [LOCAL ] WT: Primary data saved (48354 records). [2025-09-26T22:10:40.770635] [INFO ] [MAIN ] WT: Full history saved. [2025-09-26T22:10:40.770810] [INFO ] [MAIN ] Update Progress: 2326/2371 symbols completed. WT took 34.0s. Estimated remaining: 6m 1s. Rate: 7.5 symbols/min [2025-09-26T22:10:40.963099] [INFO ] [MAIN ] WTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:10:40.983805] [DEBUG] [LOCAL ] WTS: Loaded 18543 existing records from primary storage. [2025-09-26T22:10:40.983976] [INFO ] [MAIN ] WTS: Loaded 18543 existing records. [2025-09-26T22:10:41.195194] [WARN ] [MAIN ] WTS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:10:41.195856] [INFO ] [MAIN ] WTS: Wiping existing primary data before full refresh. [2025-09-26T22:10:41.196721] [INFO ] [LOCAL ] WTS: Starting deletion of primary data. [2025-09-26T22:10:41.207210] [DEBUG] [LOCAL ] WTS: Deleted primary data file. [2025-09-26T22:10:41.225974] [INFO ] [MAIN ] WTS: Starting full primary refresh. [2025-09-26T22:10:41.233783] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-26T22:10:41.519295] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-08. [2025-09-26T22:10:41.662718] [INFO ] [REMOTE ] WTS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:10:42.311720] [INFO ] [REMOTE ] WTS: Fetching primary data for 2024-12. [2025-09-26T22:10:42.648721] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-26T22:10:42.953494] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-26T22:10:43.104203] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-26T22:10:43.112414] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-07. [2025-09-26T22:10:43.911729] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-09. [2025-09-26T22:10:44.717449] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-06. [2025-09-26T22:10:44.724856] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-26T22:10:45.483862] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-26T22:10:45.493030] [INFO ] [REMOTE ] WTI: Full fetch complete (64173 records). [2025-09-26T22:10:45.493288] [DEBUG] [VALIDATOR ] WTI: Validating primary data. [2025-09-26T22:10:45.517938] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-08. [2025-09-26T22:10:46.002780] [DEBUG] [VALIDATOR ] WTI: All expected trading days are present. [2025-09-26T22:10:46.002908] [DEBUG] [VALIDATOR ] WTI: Primary data validation passed. [2025-09-26T22:10:46.004489] [INFO ] [MAIN ] WTI: Fetched primary data is valid. [2025-09-26T22:10:46.004576] [DEBUG] [LOCAL ] WTI: Saving primary data. [2025-09-26T22:10:46.006609] [DEBUG] [LOCAL ] WTI: Trimmed 64173 records to 44472 (keeping 200 days of data) [2025-09-26T22:10:46.284727] [DEBUG] [LOCAL ] WTI: Primary data saved (44472 records). [2025-09-26T22:10:46.284879] [INFO ] [MAIN ] WTI: Full history saved. [2025-09-26T22:10:46.285036] [INFO ] [MAIN ] Update Progress: 2327/2371 symbols completed. WTI took 35.2s. Estimated remaining: 5m 53s. Rate: 7.5 symbols/min [2025-09-26T22:10:46.324900] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-01. [2025-09-26T22:10:46.498985] [INFO ] [MAIN ] WTTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:10:46.534894] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-26T22:10:46.585379] [DEBUG] [LOCAL ] WTTR: Loaded 45381 existing records from primary storage. [2025-09-26T22:10:46.586258] [INFO ] [MAIN ] WTTR: Loaded 45381 existing records. [2025-09-26T22:10:46.855944] [WARN ] [MAIN ] WTTR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:10:46.856395] [INFO ] [MAIN ] WTTR: Wiping existing primary data before full refresh. [2025-09-26T22:10:46.856566] [INFO ] [LOCAL ] WTTR: Starting deletion of primary data. [2025-09-26T22:10:46.864880] [DEBUG] [LOCAL ] WTTR: Deleted primary data file. [2025-09-26T22:10:46.877483] [INFO ] [MAIN ] WTTR: Starting full primary refresh. [2025-09-26T22:10:46.878562] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-26T22:10:47.120235] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-07. [2025-09-26T22:10:47.282006] [INFO ] [REMOTE ] WTTR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:10:47.548730] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-26T22:10:47.911722] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-09. [2025-09-26T22:10:48.598723] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-26T22:10:48.606001] [INFO ] [REMOTE ] WST: Full fetch complete (53668 records). [2025-09-26T22:10:48.606140] [DEBUG] [VALIDATOR ] WST: Validating primary data. [2025-09-26T22:10:48.714793] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-02. [2025-09-26T22:10:49.037594] [DEBUG] [VALIDATOR ] WST: All expected trading days are present. [2025-09-26T22:10:49.037873] [DEBUG] [VALIDATOR ] WST: Primary data validation passed. [2025-09-26T22:10:49.038936] [INFO ] [MAIN ] WST: Fetched primary data is valid. [2025-09-26T22:10:49.039019] [DEBUG] [LOCAL ] WST: Saving primary data. [2025-09-26T22:10:49.051564] [DEBUG] [LOCAL ] WST: Trimmed 53668 records to 38092 (keeping 200 days of data) [2025-09-26T22:10:49.075195] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-26T22:10:49.336472] [DEBUG] [LOCAL ] WST: Primary data saved (38092 records). [2025-09-26T22:10:49.336629] [INFO ] [MAIN ] WST: Full history saved. [2025-09-26T22:10:49.336807] [INFO ] [MAIN ] Update Progress: 2328/2371 symbols completed. WST took 45.2s. Estimated remaining: 5m 44s. Rate: 7.5 symbols/min [2025-09-26T22:10:49.510799] [INFO ] [MAIN ] WU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:10:49.511668] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2024-12. [2025-09-26T22:10:49.567711] [DEBUG] [LOCAL ] WU: Loaded 53843 existing records from primary storage. [2025-09-26T22:10:49.567865] [INFO ] [MAIN ] WU: Loaded 53843 existing records. [2025-09-26T22:10:49.757598] [WARN ] [MAIN ] WU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:10:49.758113] [INFO ] [MAIN ] WU: Wiping existing primary data before full refresh. [2025-09-26T22:10:49.758219] [INFO ] [LOCAL ] WU: Starting deletion of primary data. [2025-09-26T22:10:49.760997] [DEBUG] [LOCAL ] WU: Deleted primary data file. [2025-09-26T22:10:49.761064] [INFO ] [MAIN ] WU: Starting full primary refresh. [2025-09-26T22:10:49.953002] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-26T22:10:50.175736] [INFO ] [REMOTE ] WU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:10:50.311746] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-03. [2025-09-26T22:10:51.123084] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-08. [2025-09-26T22:10:51.126346] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-26T22:10:51.466570] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-26T22:10:51.911726] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-04. [2025-09-26T22:10:52.711715] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-01. [2025-09-26T22:10:53.027487] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-26T22:10:53.053004] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-26T22:10:53.511747] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-09. [2025-09-26T22:10:54.316862] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-05. [2025-09-26T22:10:54.341332] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-26T22:10:55.111748] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-02. [2025-09-26T22:10:55.283519] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-26T22:10:55.295616] [INFO ] [REMOTE ] WTRG: Full fetch complete (73282 records). [2025-09-26T22:10:55.295825] [DEBUG] [VALIDATOR ] WTRG: Validating primary data. [2025-09-26T22:10:55.648189] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-26T22:10:55.768358] [DEBUG] [VALIDATOR ] WTRG: All expected trading days are present. [2025-09-26T22:10:55.768504] [DEBUG] [VALIDATOR ] WTRG: Primary data validation passed. [2025-09-26T22:10:55.769963] [INFO ] [MAIN ] WTRG: Fetched primary data is valid. [2025-09-26T22:10:55.770050] [DEBUG] [LOCAL ] WTRG: Saving primary data. [2025-09-26T22:10:55.771815] [DEBUG] [LOCAL ] WTRG: Trimmed 73282 records to 51656 (keeping 200 days of data) [2025-09-26T22:10:55.959953] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-06. [2025-09-26T22:10:56.112292] [DEBUG] [LOCAL ] WTRG: Primary data saved (51656 records). [2025-09-26T22:10:56.112488] [INFO ] [MAIN ] WTRG: Full history saved. [2025-09-26T22:10:56.112672] [INFO ] [MAIN ] Update Progress: 2329/2371 symbols completed. WTRG took 29.0s. Estimated remaining: 5m 36s. Rate: 7.5 symbols/min [2025-09-26T22:10:56.301973] [INFO ] [MAIN ] WWW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:10:56.333359] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-26T22:10:56.387178] [DEBUG] [LOCAL ] WWW: Loaded 49549 existing records from primary storage. [2025-09-26T22:10:56.387329] [INFO ] [MAIN ] WWW: Loaded 49549 existing records. [2025-09-26T22:10:56.578319] [WARN ] [MAIN ] WWW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:10:56.578609] [INFO ] [MAIN ] WWW: Wiping existing primary data before full refresh. [2025-09-26T22:10:56.578717] [INFO ] [LOCAL ] WWW: Starting deletion of primary data. [2025-09-26T22:10:56.581369] [DEBUG] [LOCAL ] WWW: Deleted primary data file. [2025-09-26T22:10:56.581445] [INFO ] [MAIN ] WWW: Starting full primary refresh. [2025-09-26T22:10:56.716811] [INFO ] [REMOTE ] WU: Fetching primary data for 2024-12. [2025-09-26T22:10:56.976534] [INFO ] [REMOTE ] WWW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:10:57.010103] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-26T22:10:57.511738] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-07. [2025-09-26T22:10:57.616836] [DEBUG] [REMOTE ] WTS: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-26T22:10:57.617187] [WARN ] [REMOTE ] WTS: No data returned for month 2025-07 [2025-09-26T22:10:58.311695] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-03. [2025-09-26T22:10:58.647115] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-26T22:10:59.111728] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-08. [2025-09-26T22:10:59.911738] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-01. [2025-09-26T22:11:00.041860] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-26T22:11:00.252543] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-26T22:11:00.711763] [INFO ] [REMOTE ] WWW: Fetching primary data for 2024-12. [2025-09-26T22:11:01.511720] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-04. [2025-09-26T22:11:01.988038] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-26T22:11:02.317443] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-09. [2025-09-26T22:11:02.343928] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-26T22:11:03.111693] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-02. [2025-09-26T22:11:03.153505] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-26T22:11:03.194386] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-26T22:11:03.197820] [INFO ] [REMOTE ] WTS: Full fetch complete (23188 records). [2025-09-26T22:11:03.197932] [DEBUG] [VALIDATOR ] WTS: Validating primary data. [2025-09-26T22:11:03.412377] [WARN ] [VALIDATOR ] WTS: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-09-26T22:11:03.412845] [FATAL] [MAIN ] WTS: Fetched primary data is invalid. Refusing to save it. [2025-09-26T22:11:03.412921] [WARN ] [MAIN ] WTS: Deleting existing primary and derivative data due to validation failure. [2025-09-26T22:11:03.412996] [INFO ] [LOCAL ] WTS: Starting deletion of primary data. [2025-09-26T22:11:03.413104] [DEBUG] [LOCAL ] WTS: No primary data file found to delete. [2025-09-26T22:11:03.413175] [INFO ] [LOCAL ] WTS: Starting deletion of derivative data. [2025-09-26T22:11:03.413719] [DEBUG] [LOCAL ] WTS: Deleted derivative data file. [2025-09-26T22:11:03.413827] [INFO ] [MAIN ] Update Progress: 2330/2371 symbols completed. WTS took 22.6s. Estimated remaining: 5m 28s. Rate: 7.5 symbols/min [2025-09-26T22:11:03.606430] [INFO ] [MAIN ] WY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:11:03.666760] [DEBUG] [LOCAL ] WY: Loaded 53509 existing records from primary storage. [2025-09-26T22:11:03.666964] [INFO ] [MAIN ] WY: Loaded 53509 existing records. [2025-09-26T22:11:03.877721] [WARN ] [MAIN ] WY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:11:03.877974] [INFO ] [MAIN ] WY: Wiping existing primary data before full refresh. [2025-09-26T22:11:03.878023] [INFO ] [LOCAL ] WY: Starting deletion of primary data. [2025-09-26T22:11:03.880246] [DEBUG] [LOCAL ] WY: Deleted primary data file. [2025-09-26T22:11:03.880312] [INFO ] [MAIN ] WY: Starting full primary refresh. [2025-09-26T22:11:03.916868] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-01. [2025-09-26T22:11:04.274883] [INFO ] [REMOTE ] WY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:11:04.711713] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-05. [2025-09-26T22:11:04.887869] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-26T22:11:05.505082] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-26T22:11:05.513855] [INFO ] [REMOTE ] WY: Fetching primary data for 2024-12. [2025-09-26T22:11:06.311697] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-03. [2025-09-26T22:11:06.345784] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-26T22:11:07.111692] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-02. [2025-09-26T22:11:07.369308] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-26T22:11:07.911712] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-01. [2025-09-26T22:11:08.232408] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-26T22:11:08.711717] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-06. [2025-09-26T22:11:08.832172] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-26T22:11:09.511736] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-03. [2025-09-26T22:11:09.821799] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-26T22:11:10.136031] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-26T22:11:10.311741] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-04. [2025-09-26T22:11:11.111706] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-02. [2025-09-26T22:11:11.273677] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-26T22:11:11.911731] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-04. [2025-09-26T22:11:12.350228] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-26T22:11:12.711762] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-05. [2025-09-26T22:11:12.877547] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-26T22:11:13.511716] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-07. [2025-09-26T22:11:13.606343] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-26T22:11:14.311707] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-03. [2025-09-26T22:11:14.411169] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-26T22:11:15.111695] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-06. [2025-09-26T22:11:15.156729] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-26T22:11:15.911723] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-08. [2025-09-26T22:11:16.209258] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-26T22:11:16.711730] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-05. [2025-09-26T22:11:17.075331] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-26T22:11:17.366601] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-26T22:11:17.511719] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-09. [2025-09-26T22:11:18.311726] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-04. [2025-09-26T22:11:18.370368] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-26T22:11:18.754671] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-26T22:11:18.764200] [INFO ] [REMOTE ] WTTR: Full fetch complete (65608 records). [2025-09-26T22:11:18.764369] [DEBUG] [VALIDATOR ] WTTR: Validating primary data. [2025-09-26T22:11:19.116804] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-07. [2025-09-26T22:11:19.192772] [DEBUG] [VALIDATOR ] WTTR: All expected trading days are present. [2025-09-26T22:11:19.192869] [DEBUG] [VALIDATOR ] WTTR: Primary data validation passed. [2025-09-26T22:11:19.194362] [INFO ] [MAIN ] WTTR: Fetched primary data is valid. [2025-09-26T22:11:19.194455] [DEBUG] [LOCAL ] WTTR: Saving primary data. [2025-09-26T22:11:19.196226] [DEBUG] [LOCAL ] WTTR: Trimmed 65608 records to 45735 (keeping 200 days of data) [2025-09-26T22:11:19.490789] [DEBUG] [LOCAL ] WTTR: Primary data saved (45735 records). [2025-09-26T22:11:19.490936] [INFO ] [MAIN ] WTTR: Full history saved. [2025-09-26T22:11:19.491054] [INFO ] [MAIN ] Update Progress: 2331/2371 symbols completed. WTTR took 33.2s. Estimated remaining: 5m 20s. Rate: 7.5 symbols/min [2025-09-26T22:11:19.666391] [INFO ] [MAIN ] XFLT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:11:19.704098] [DEBUG] [LOCAL ] XFLT: Loaded 30152 existing records from primary storage. [2025-09-26T22:11:19.704281] [INFO ] [MAIN ] XFLT: Loaded 30152 existing records. [2025-09-26T22:11:19.902932] [WARN ] [MAIN ] XFLT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:11:19.903225] [INFO ] [MAIN ] XFLT: Wiping existing primary data before full refresh. [2025-09-26T22:11:19.903285] [INFO ] [LOCAL ] XFLT: Starting deletion of primary data. [2025-09-26T22:11:19.904507] [DEBUG] [LOCAL ] XFLT: Deleted primary data file. [2025-09-26T22:11:19.904579] [INFO ] [MAIN ] XFLT: Starting full primary refresh. [2025-09-26T22:11:19.927115] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-06. [2025-09-26T22:11:20.304778] [INFO ] [REMOTE ] XFLT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:11:20.344374] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-26T22:11:20.711731] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2024-12. [2025-09-26T22:11:21.058347] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-26T22:11:21.278264] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-26T22:11:21.511716] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-05. [2025-09-26T22:11:22.135235] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-26T22:11:22.311724] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-01. [2025-09-26T22:11:23.111728] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-07. [2025-09-26T22:11:23.520389] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-26T22:11:23.821192] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-26T22:11:23.911737] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-06. [2025-09-26T22:11:24.711730] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-02. [2025-09-26T22:11:24.915599] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-26T22:11:25.511754] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-08. [2025-09-26T22:11:25.735813] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-26T22:11:25.944225] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-26T22:11:26.311723] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-07. [2025-09-26T22:11:27.111744] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-08. [2025-09-26T22:11:27.525812] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-26T22:11:27.911698] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-09. [2025-09-26T22:11:28.331445] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-26T22:11:28.711753] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-03. [2025-09-26T22:11:29.151482] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-26T22:11:29.511722] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-08. [2025-09-26T22:11:29.838639] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-26T22:11:29.849297] [INFO ] [REMOTE ] WU: Full fetch complete (77332 records). [2025-09-26T22:11:29.849465] [DEBUG] [VALIDATOR ] WU: Validating primary data. [2025-09-26T22:11:30.258582] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T22:11:30.310513] [DEBUG] [VALIDATOR ] WU: All expected trading days are present. [2025-09-26T22:11:30.310607] [DEBUG] [VALIDATOR ] WU: Primary data validation passed. [2025-09-26T22:11:30.312100] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-04. [2025-09-26T22:11:30.312043] [INFO ] [MAIN ] WU: Fetched primary data is valid. [2025-09-26T22:11:30.312279] [DEBUG] [LOCAL ] WU: Saving primary data. [2025-09-26T22:11:30.316734] [DEBUG] [LOCAL ] WU: Trimmed 77332 records to 54232 (keeping 200 days of data) [2025-09-26T22:11:30.673659] [DEBUG] [LOCAL ] WU: Primary data saved (54232 records). [2025-09-26T22:11:30.673826] [INFO ] [MAIN ] WU: Full history saved. [2025-09-26T22:11:30.673942] [INFO ] [MAIN ] Update Progress: 2332/2371 symbols completed. WU took 41.3s. Estimated remaining: 5m 13s. Rate: 7.5 symbols/min [2025-09-26T22:11:30.864730] [INFO ] [MAIN ] XHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:11:30.912763] [DEBUG] [LOCAL ] XHR: Loaded 44450 existing records from primary storage. [2025-09-26T22:11:30.912921] [INFO ] [MAIN ] XHR: Loaded 44450 existing records. [2025-09-26T22:11:31.106167] [WARN ] [MAIN ] XHR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:11:31.106465] [INFO ] [MAIN ] XHR: Wiping existing primary data before full refresh. [2025-09-26T22:11:31.106526] [INFO ] [LOCAL ] XHR: Starting deletion of primary data. [2025-09-26T22:11:31.109005] [DEBUG] [LOCAL ] XHR: Deleted primary data file. [2025-09-26T22:11:31.109096] [INFO ] [MAIN ] XHR: Starting full primary refresh. [2025-09-26T22:11:31.132228] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-09. [2025-09-26T22:11:31.509934] [INFO ] [REMOTE ] XHR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:11:31.541868] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-26T22:11:31.729610] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-26T22:11:31.911747] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-05. [2025-09-26T22:11:32.645876] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-26T22:11:32.657538] [INFO ] [REMOTE ] WWW: Full fetch complete (70096 records). [2025-09-26T22:11:32.657789] [DEBUG] [VALIDATOR ] WWW: Validating primary data. [2025-09-26T22:11:32.716372] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-09. [2025-09-26T22:11:33.047099] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-26T22:11:33.153403] [DEBUG] [VALIDATOR ] WWW: All expected trading days are present. [2025-09-26T22:11:33.153495] [DEBUG] [VALIDATOR ] WWW: Primary data validation passed. [2025-09-26T22:11:33.154742] [INFO ] [MAIN ] WWW: Fetched primary data is valid. [2025-09-26T22:11:33.154810] [DEBUG] [LOCAL ] WWW: Saving primary data. [2025-09-26T22:11:33.156363] [DEBUG] [LOCAL ] WWW: Trimmed 70096 records to 49906 (keeping 200 days of data) [2025-09-26T22:11:33.467760] [DEBUG] [LOCAL ] WWW: Primary data saved (49906 records). [2025-09-26T22:11:33.467913] [INFO ] [MAIN ] WWW: Full history saved. [2025-09-26T22:11:33.468030] [INFO ] [MAIN ] Update Progress: 2333/2371 symbols completed. WWW took 37.4s. Estimated remaining: 5m 4s. Rate: 7.5 symbols/min [2025-09-26T22:11:33.514860] [INFO ] [REMOTE ] XHR: Fetching primary data for 2024-12. [2025-09-26T22:11:33.684262] [INFO ] [MAIN ] XIFR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:11:33.687499] [DEBUG] [LOCAL ] XIFR: No existing data file found in primary storage. [2025-09-26T22:11:33.687610] [WARN ] [MAIN ] XIFR: No existing data found, performing full refresh instead. [2025-09-26T22:11:33.687848] [INFO ] [MAIN ] XIFR: Wiping existing primary data before full refresh. [2025-09-26T22:11:33.688171] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-09-26T22:11:33.688269] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-09-26T22:11:33.688344] [INFO ] [MAIN ] XIFR: Starting full primary refresh. [2025-09-26T22:11:33.723820] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-26T22:11:33.796152] [INFO ] [REMOTE ] WY: Full fetch complete (76841 records). [2025-09-26T22:11:33.807423] [DEBUG] [VALIDATOR ] WY: Validating primary data. [2025-09-26T22:11:34.318498] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-06. [2025-09-26T22:11:34.386939] [INFO ] [REMOTE ] XIFR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:11:34.572243] [DEBUG] [VALIDATOR ] WY: All expected trading days are present. [2025-09-26T22:11:34.572349] [DEBUG] [VALIDATOR ] WY: Primary data validation passed. [2025-09-26T22:11:34.573545] [INFO ] [MAIN ] WY: Fetched primary data is valid. [2025-09-26T22:11:34.573613] [DEBUG] [LOCAL ] WY: Saving primary data. [2025-09-26T22:11:34.575275] [DEBUG] [LOCAL ] WY: Trimmed 76841 records to 53899 (keeping 200 days of data) [2025-09-26T22:11:34.920486] [DEBUG] [LOCAL ] WY: Primary data saved (53899 records). [2025-09-26T22:11:34.920667] [INFO ] [MAIN ] WY: Full history saved. [2025-09-26T22:11:34.920793] [INFO ] [MAIN ] Update Progress: 2334/2371 symbols completed. WY took 31.5s. Estimated remaining: 4m 56s. Rate: 7.5 symbols/min [2025-09-26T22:11:35.104445] [INFO ] [MAIN ] XOM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:11:35.114736] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2024-12. [2025-09-26T22:11:35.132489] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-26T22:11:35.197547] [DEBUG] [LOCAL ] XOM: Loaded 54183 existing records from primary storage. [2025-09-26T22:11:35.197733] [INFO ] [MAIN ] XOM: Loaded 54183 existing records. [2025-09-26T22:11:35.347357] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T22:11:35.365723] [WARN ] [REMOTE ] XIFR: No data returned for month 2024-12 [2025-09-26T22:11:35.387746] [WARN ] [MAIN ] XOM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:11:35.388276] [INFO ] [MAIN ] XOM: Wiping existing primary data before full refresh. [2025-09-26T22:11:35.388328] [INFO ] [LOCAL ] XOM: Starting deletion of primary data. [2025-09-26T22:11:35.390974] [DEBUG] [LOCAL ] XOM: Deleted primary data file. [2025-09-26T22:11:35.391042] [INFO ] [MAIN ] XOM: Starting full primary refresh. [2025-09-26T22:11:35.781059] [INFO ] [REMOTE ] XOM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:11:35.798976] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-26T22:11:35.911743] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-01. [2025-09-26T22:11:36.131721] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T22:11:36.132122] [WARN ] [REMOTE ] XIFR: No data returned for month 2025-01 [2025-09-26T22:11:36.711755] [INFO ] [REMOTE ] XOM: Fetching primary data for 2024-12. [2025-09-26T22:11:37.511770] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-07. [2025-09-26T22:11:38.311753] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-01. [2025-09-26T22:11:38.933864] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-26T22:11:39.111712] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-02. [2025-09-26T22:11:39.210538] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2024-12 (2.50 seconds). [2025-09-26T22:11:39.774153] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-26T22:11:39.911754] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-02. [2025-09-26T22:11:40.711732] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-01. [2025-09-26T22:11:40.931667] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-26T22:11:41.352708] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-26T22:11:41.511758] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-03. [2025-09-26T22:11:42.311735] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-03. [2025-09-26T22:11:43.078052] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-09-26T22:11:43.111689] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-08. [2025-09-26T22:11:43.169051] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-26T22:11:43.911736] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-04. [2025-09-26T22:11:43.971757] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-26T22:11:44.423517] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-26T22:11:44.711760] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-09. [2025-09-26T22:11:45.511724] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-02. [2025-09-26T22:11:45.581296] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-26T22:11:46.299750] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-26T22:11:46.306700] [INFO ] [REMOTE ] XFLT: Full fetch complete (44244 records). [2025-09-26T22:11:46.306837] [DEBUG] [VALIDATOR ] XFLT: Validating primary data. [2025-09-26T22:11:46.320286] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-05. [2025-09-26T22:11:46.708770] [DEBUG] [VALIDATOR ] XFLT: All expected trading days are present. [2025-09-26T22:11:46.708868] [DEBUG] [VALIDATOR ] XFLT: Primary data validation passed. [2025-09-26T22:11:46.710042] [INFO ] [MAIN ] XFLT: Fetched primary data is valid. [2025-09-26T22:11:46.710151] [DEBUG] [LOCAL ] XFLT: Saving primary data. [2025-09-26T22:11:46.711404] [DEBUG] [LOCAL ] XFLT: Trimmed 44244 records to 30306 (keeping 200 days of data) [2025-09-26T22:11:46.905091] [DEBUG] [LOCAL ] XFLT: Primary data saved (30306 records). [2025-09-26T22:11:46.905244] [INFO ] [MAIN ] XFLT: Full history saved. [2025-09-26T22:11:46.905482] [INFO ] [MAIN ] Update Progress: 2335/2371 symbols completed. XFLT took 27.4s. Estimated remaining: 4m 48s. Rate: 7.5 symbols/min [2025-09-26T22:11:47.091943] [INFO ] [MAIN ] XPER: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:11:47.113840] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-04. [2025-09-26T22:11:47.128691] [DEBUG] [LOCAL ] XPER: Loaded 29865 existing records from primary storage. [2025-09-26T22:11:47.128856] [INFO ] [MAIN ] XPER: Loaded 29865 existing records. [2025-09-26T22:11:47.322558] [WARN ] [MAIN ] XPER: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:11:47.322842] [INFO ] [MAIN ] XPER: Wiping existing primary data before full refresh. [2025-09-26T22:11:47.322983] [INFO ] [LOCAL ] XPER: Starting deletion of primary data. [2025-09-26T22:11:47.324494] [DEBUG] [LOCAL ] XPER: Deleted primary data file. [2025-09-26T22:11:47.324573] [INFO ] [MAIN ] XPER: Starting full primary refresh. [2025-09-26T22:11:47.727540] [INFO ] [REMOTE ] XPER: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:11:47.774962] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-26T22:11:47.911698] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-03. [2025-09-26T22:11:48.007618] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-26T22:11:48.373913] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-26T22:11:48.711782] [INFO ] [REMOTE ] XPER: Fetching primary data for 2024-12. [2025-09-26T22:11:49.511743] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-05. [2025-09-26T22:11:49.990612] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-26T22:11:50.029046] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-26T22:11:50.311761] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-06. [2025-09-26T22:11:51.111697] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-01. [2025-09-26T22:11:51.183681] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-26T22:11:51.911725] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-04. [2025-09-26T22:11:51.952290] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-26T22:11:52.335984] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-26T22:11:52.711737] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-07. [2025-09-26T22:11:53.511731] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-06. [2025-09-26T22:11:54.277134] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-26T22:11:54.311686] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-05. [2025-09-26T22:11:54.425365] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-26T22:11:54.996790] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-26T22:11:55.111727] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-02. [2025-09-26T22:11:55.911735] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-08. [2025-09-26T22:11:56.255890] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-26T22:11:56.711737] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-03. [2025-09-26T22:11:56.956473] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-09-26T22:11:57.480681] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-26T22:11:57.511724] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-07. [2025-09-26T22:11:58.025095] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-26T22:11:58.311723] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-06. [2025-09-26T22:11:58.412970] [DEBUG] [REMOTE ] XOM: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-09-26T22:11:58.413360] [WARN ] [REMOTE ] XOM: No data returned for month 2025-06 [2025-09-26T22:11:58.823167] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-26T22:11:59.111728] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-09. [2025-09-26T22:11:59.911721] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-07. [2025-09-26T22:12:00.711697] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-04. [2025-09-26T22:12:00.749909] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-26T22:12:00.759417] [INFO ] [REMOTE ] XIFR: Full fetch complete (55296 records). [2025-09-26T22:12:00.759573] [DEBUG] [VALIDATOR ] XIFR: Validating primary data. [2025-09-26T22:12:00.961973] [WARN ] [VALIDATOR ] XIFR: Validation failed - insufficient historical data. Have 164 unique days, need 200 days [2025-09-26T22:12:00.962692] [FATAL] [MAIN ] XIFR: Fetched primary data is invalid. Refusing to save it. [2025-09-26T22:12:00.962783] [WARN ] [MAIN ] XIFR: Deleting existing primary and derivative data due to validation failure. [2025-09-26T22:12:00.962861] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-09-26T22:12:00.962933] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-09-26T22:12:00.962972] [INFO ] [LOCAL ] XIFR: Starting deletion of derivative data. [2025-09-26T22:12:00.963037] [DEBUG] [LOCAL ] XIFR: No derivative data file found to delete. [2025-09-26T22:12:00.963129] [INFO ] [MAIN ] Update Progress: 2336/2371 symbols completed. XIFR took 27.5s. Estimated remaining: 4m 40s. Rate: 7.5 symbols/min [2025-09-26T22:12:01.141458] [INFO ] [MAIN ] XPEV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:12:01.209495] [DEBUG] [LOCAL ] XPEV: Loaded 54029 existing records from primary storage. [2025-09-26T22:12:01.209701] [INFO ] [MAIN ] XPEV: Loaded 54029 existing records. [2025-09-26T22:12:01.398393] [WARN ] [MAIN ] XPEV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:12:01.398700] [INFO ] [MAIN ] XPEV: Wiping existing primary data before full refresh. [2025-09-26T22:12:01.398758] [INFO ] [LOCAL ] XPEV: Starting deletion of primary data. [2025-09-26T22:12:01.401482] [DEBUG] [LOCAL ] XPEV: Deleted primary data file. [2025-09-26T22:12:01.401569] [INFO ] [MAIN ] XPEV: Starting full primary refresh. [2025-09-26T22:12:01.516798] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-08. [2025-09-26T22:12:01.798179] [INFO ] [REMOTE ] XPEV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:12:02.311709] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2024-12. [2025-09-26T22:12:02.571935] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-07 (2.66 seconds). [2025-09-26T22:12:02.695405] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-26T22:12:03.077034] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-26T22:12:03.111726] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-09. [2025-09-26T22:12:03.911720] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-05. [2025-09-26T22:12:04.578493] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-26T22:12:04.653398] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-26T22:12:04.662224] [INFO ] [REMOTE ] XHR: Full fetch complete (61532 records). [2025-09-26T22:12:04.662417] [DEBUG] [VALIDATOR ] XHR: Validating primary data. [2025-09-26T22:12:04.716945] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-01. [2025-09-26T22:12:05.095301] [DEBUG] [VALIDATOR ] XHR: All expected trading days are present. [2025-09-26T22:12:05.095405] [DEBUG] [VALIDATOR ] XHR: Primary data validation passed. [2025-09-26T22:12:05.096722] [INFO ] [MAIN ] XHR: Fetched primary data is valid. [2025-09-26T22:12:05.096796] [DEBUG] [LOCAL ] XHR: Saving primary data. [2025-09-26T22:12:05.098274] [DEBUG] [LOCAL ] XHR: Trimmed 61532 records to 44680 (keeping 200 days of data) [2025-09-26T22:12:05.227893] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-26T22:12:05.413359] [DEBUG] [LOCAL ] XHR: Primary data saved (44680 records). [2025-09-26T22:12:05.413512] [INFO ] [MAIN ] XHR: Full history saved. [2025-09-26T22:12:05.413633] [INFO ] [MAIN ] Update Progress: 2337/2371 symbols completed. XHR took 34.7s. Estimated remaining: 4m 32s. Rate: 7.5 symbols/min [2025-09-26T22:12:05.521028] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-06. [2025-09-26T22:12:05.609628] [INFO ] [MAIN ] XPO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:12:05.609854] [DEBUG] [LOCAL ] XPO: No existing data file found in primary storage. [2025-09-26T22:12:05.609913] [WARN ] [MAIN ] XPO: No existing data found, performing full refresh instead. [2025-09-26T22:12:05.610066] [INFO ] [MAIN ] XPO: Wiping existing primary data before full refresh. [2025-09-26T22:12:05.610114] [INFO ] [LOCAL ] XPO: Starting deletion of primary data. [2025-09-26T22:12:05.610158] [DEBUG] [LOCAL ] XPO: No primary data file found to delete. [2025-09-26T22:12:05.610193] [INFO ] [MAIN ] XPO: Starting full primary refresh. [2025-09-26T22:12:05.992488] [INFO ] [REMOTE ] XPO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:12:06.311684] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-08. [2025-09-26T22:12:06.774899] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-26T22:12:07.049747] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-09-26T22:12:07.111732] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-07. [2025-09-26T22:12:07.911739] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-02. [2025-09-26T22:12:08.328770] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-26T22:12:08.449760] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-26T22:12:08.711737] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-09. [2025-09-26T22:12:09.511706] [INFO ] [REMOTE ] XPO: Fetching primary data for 2024-12. [2025-09-26T22:12:09.624953] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-26T22:12:09.635948] [INFO ] [REMOTE ] XOM: Full fetch complete (70122 records). [2025-09-26T22:12:09.636216] [DEBUG] [VALIDATOR ] XOM: Validating primary data. [2025-09-26T22:12:09.868071] [WARN ] [VALIDATOR ] XOM: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-26T22:12:09.869336] [FATAL] [MAIN ] XOM: Fetched primary data is invalid. Refusing to save it. [2025-09-26T22:12:09.869519] [WARN ] [MAIN ] XOM: Deleting existing primary and derivative data due to validation failure. [2025-09-26T22:12:09.869776] [INFO ] [LOCAL ] XOM: Starting deletion of primary data. [2025-09-26T22:12:09.870004] [DEBUG] [LOCAL ] XOM: No primary data file found to delete. [2025-09-26T22:12:09.870116] [INFO ] [LOCAL ] XOM: Starting deletion of derivative data. [2025-09-26T22:12:09.870742] [DEBUG] [LOCAL ] XOM: Deleted derivative data file. [2025-09-26T22:12:09.870896] [INFO ] [MAIN ] Update Progress: 2338/2371 symbols completed. XOM took 34.9s. Estimated remaining: 4m 24s. Rate: 7.5 symbols/min [2025-09-26T22:12:10.096004] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-26T22:12:10.099469] [INFO ] [MAIN ] XPOF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:12:10.154569] [DEBUG] [LOCAL ] XPOF: Loaded 39074 existing records from primary storage. [2025-09-26T22:12:10.154783] [INFO ] [MAIN ] XPOF: Loaded 39074 existing records. [2025-09-26T22:12:10.316832] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-08. [2025-09-26T22:12:10.349557] [WARN ] [MAIN ] XPOF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:12:10.349898] [INFO ] [MAIN ] XPOF: Wiping existing primary data before full refresh. [2025-09-26T22:12:10.349955] [INFO ] [LOCAL ] XPOF: Starting deletion of primary data. [2025-09-26T22:12:10.352234] [DEBUG] [LOCAL ] XPOF: Deleted primary data file. [2025-09-26T22:12:10.352300] [INFO ] [MAIN ] XPOF: Starting full primary refresh. [2025-09-26T22:12:10.740795] [INFO ] [REMOTE ] XPOF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:12:11.111767] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-03. [2025-09-26T22:12:11.411598] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-26T22:12:11.729106] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-26T22:12:11.911742] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2024-12. [2025-09-26T22:12:12.711770] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-09. [2025-09-26T22:12:13.225253] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-26T22:12:13.395729] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-26T22:12:13.511726] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-04. [2025-09-26T22:12:14.085979] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-26T22:12:14.093921] [INFO ] [REMOTE ] XPER: Full fetch complete (43275 records). [2025-09-26T22:12:14.094168] [DEBUG] [VALIDATOR ] XPER: Validating primary data. [2025-09-26T22:12:14.316816] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-01. [2025-09-26T22:12:14.508717] [DEBUG] [VALIDATOR ] XPER: All expected trading days are present. [2025-09-26T22:12:14.508810] [DEBUG] [VALIDATOR ] XPER: Primary data validation passed. [2025-09-26T22:12:14.509756] [INFO ] [MAIN ] XPER: Fetched primary data is valid. [2025-09-26T22:12:14.509821] [DEBUG] [LOCAL ] XPER: Saving primary data. [2025-09-26T22:12:14.510911] [DEBUG] [LOCAL ] XPER: Trimmed 43275 records to 30181 (keeping 200 days of data) [2025-09-26T22:12:14.684576] [DEBUG] [LOCAL ] XPER: Primary data saved (30181 records). [2025-09-26T22:12:14.684756] [INFO ] [MAIN ] XPER: Full history saved. [2025-09-26T22:12:14.684908] [INFO ] [MAIN ] Update Progress: 2339/2371 symbols completed. XPER took 27.8s. Estimated remaining: 4m 16s. Rate: 7.5 symbols/min [2025-09-26T22:12:14.866137] [INFO ] [MAIN ] XPRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:12:14.915296] [DEBUG] [LOCAL ] XPRO: Loaded 46275 existing records from primary storage. [2025-09-26T22:12:14.915465] [INFO ] [MAIN ] XPRO: Loaded 46275 existing records. [2025-09-26T22:12:15.108265] [WARN ] [MAIN ] XPRO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:12:15.108571] [INFO ] [MAIN ] XPRO: Wiping existing primary data before full refresh. [2025-09-26T22:12:15.108631] [INFO ] [LOCAL ] XPRO: Starting deletion of primary data. [2025-09-26T22:12:15.110856] [DEBUG] [LOCAL ] XPRO: Deleted primary data file. [2025-09-26T22:12:15.110921] [INFO ] [MAIN ] XPRO: Starting full primary refresh. [2025-09-26T22:12:15.144446] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-01. [2025-09-26T22:12:15.500161] [INFO ] [REMOTE ] XPRO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:12:15.665392] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-26T22:12:15.911722] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2024-12. [2025-09-26T22:12:16.077122] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-09-26T22:12:16.711743] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-05. [2025-09-26T22:12:16.953348] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-26T22:12:17.504546] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-26T22:12:17.514485] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-02. [2025-09-26T22:12:18.311746] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-02. [2025-09-26T22:12:19.112833] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-01. [2025-09-26T22:12:19.115974] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-09-26T22:12:19.210856] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-26T22:12:19.655968] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-26T22:12:19.911730] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-03. [2025-09-26T22:12:20.711716] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-03. [2025-09-26T22:12:20.750738] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-26T22:12:21.511747] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-06. [2025-09-26T22:12:21.557515] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-26T22:12:22.311741] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-02. [2025-09-26T22:12:22.504965] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-26T22:12:23.111715] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-04. [2025-09-26T22:12:23.784358] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-26T22:12:23.895535] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-09-26T22:12:23.911682] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-07. [2025-09-26T22:12:24.711701] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-04. [2025-09-26T22:12:24.833368] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T22:12:25.511760] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-05. [2025-09-26T22:12:26.198211] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-26T22:12:26.233465] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T22:12:26.311717] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-05. [2025-09-26T22:12:27.111707] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-03. [2025-09-26T22:12:27.355944] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-26T22:12:27.911791] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-06. [2025-09-26T22:12:27.948214] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-26T22:12:28.519798] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-26T22:12:28.711754] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-04. [2025-09-26T22:12:29.511769] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-08. [2025-09-26T22:12:29.641505] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-26T22:12:30.311742] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-07. [2025-09-26T22:12:30.471995] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-26T22:12:31.111798] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-06. [2025-09-26T22:12:31.569317] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-26T22:12:31.911730] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-05. [2025-09-26T22:12:32.035355] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-26T22:12:32.515571] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-26T22:12:32.711753] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-07. [2025-09-26T22:12:33.498978] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-26T22:12:33.511675] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-06. [2025-09-26T22:12:34.219752] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-26T22:12:34.311687] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-08. [2025-09-26T22:12:35.065457] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T22:12:35.111699] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-07. [2025-09-26T22:12:35.902559] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-26T22:12:35.911767] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-08. [2025-09-26T22:12:36.711717] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-09. [2025-09-26T22:12:36.818763] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-26T22:12:37.511727] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-08. [2025-09-26T22:12:37.585062] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-26T22:12:38.311774] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-09. [2025-09-26T22:12:39.030936] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-09-26T22:12:39.041563] [INFO ] [REMOTE ] XPEV: Full fetch complete (77680 records). [2025-09-26T22:12:39.041772] [DEBUG] [VALIDATOR ] XPEV: Validating primary data. [2025-09-26T22:12:39.116853] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-09. [2025-09-26T22:12:39.419942] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-26T22:12:39.531892] [DEBUG] [VALIDATOR ] XPEV: All expected trading days are present. [2025-09-26T22:12:39.532031] [DEBUG] [VALIDATOR ] XPEV: Primary data validation passed. [2025-09-26T22:12:39.533677] [INFO ] [MAIN ] XPEV: Fetched primary data is valid. [2025-09-26T22:12:39.533764] [DEBUG] [LOCAL ] XPEV: Saving primary data. [2025-09-26T22:12:39.535999] [DEBUG] [LOCAL ] XPEV: Trimmed 77680 records to 54419 (keeping 200 days of data) [2025-09-26T22:12:39.658348] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-26T22:12:39.673190] [INFO ] [REMOTE ] XPO: Full fetch complete (69978 records). [2025-09-26T22:12:39.675629] [DEBUG] [VALIDATOR ] XPO: Validating primary data. [2025-09-26T22:12:39.917146] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-09. [2025-09-26T22:12:40.179524] [DEBUG] [VALIDATOR ] XPO: All expected trading days are present. [2025-09-26T22:12:40.179720] [DEBUG] [VALIDATOR ] XPO: Primary data validation passed. [2025-09-26T22:12:40.192699] [INFO ] [MAIN ] XPO: Fetched primary data is valid. [2025-09-26T22:12:40.192845] [DEBUG] [LOCAL ] XPO: Saving primary data. [2025-09-26T22:12:40.231609] [DEBUG] [LOCAL ] XPO: Trimmed 69978 records to 48656 (keeping 200 days of data) [2025-09-26T22:12:40.671883] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-26T22:12:40.687343] [DEBUG] [LOCAL ] XPO: Primary data saved (48656 records). [2025-09-26T22:12:40.690774] [INFO ] [MAIN ] XPO: Full history saved. [2025-09-26T22:12:40.694745] [INFO ] [MAIN ] Update Progress: 2340/2371 symbols completed. XPO took 35.3s. Estimated remaining: 4m 8s. Rate: 7.5 symbols/min [2025-09-26T22:12:40.690619] [INFO ] [REMOTE ] XPOF: Full fetch complete (52172 records). [2025-09-26T22:12:40.694545] [DEBUG] [LOCAL ] XPEV: Primary data saved (54419 records). [2025-09-26T22:12:40.695223] [DEBUG] [VALIDATOR ] XPOF: Validating primary data. [2025-09-26T22:12:40.695422] [INFO ] [MAIN ] XPEV: Full history saved. [2025-09-26T22:12:40.708225] [INFO ] [MAIN ] Update Progress: 2341/2371 symbols completed. XPEV took 39.7s. Estimated remaining: 4m 0s. Rate: 7.5 symbols/min [2025-09-26T22:12:41.293220] [INFO ] [MAIN ] XYL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:12:41.277297] [INFO ] [MAIN ] XYF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:12:41.521943] [DEBUG] [VALIDATOR ] XPOF: All expected trading days are present. [2025-09-26T22:12:41.522112] [DEBUG] [VALIDATOR ] XPOF: Primary data validation passed. [2025-09-26T22:12:41.523352] [INFO ] [MAIN ] XPOF: Fetched primary data is valid. [2025-09-26T22:12:41.523677] [DEBUG] [LOCAL ] XPOF: Saving primary data. [2025-09-26T22:12:41.547564] [DEBUG] [LOCAL ] XPOF: Trimmed 52172 records to 39243 (keeping 200 days of data) [2025-09-26T22:12:41.571818] [DEBUG] [LOCAL ] XYF: Loaded 28337 existing records from primary storage. [2025-09-26T22:12:41.572447] [INFO ] [MAIN ] XYF: Loaded 28337 existing records. [2025-09-26T22:12:41.617830] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-26T22:12:41.794941] [DEBUG] [LOCAL ] XYL: Loaded 48470 existing records from primary storage. [2025-09-26T22:12:41.795532] [INFO ] [MAIN ] XYL: Loaded 48470 existing records. [2025-09-26T22:12:41.793999] [INFO ] [REMOTE ] XPRO: Full fetch complete (66578 records). [2025-09-26T22:12:41.879116] [DEBUG] [VALIDATOR ] XPRO: Validating primary data. [2025-09-26T22:12:42.015552] [WARN ] [MAIN ] XYF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:12:42.060246] [INFO ] [MAIN ] XYF: Wiping existing primary data before full refresh. [2025-09-26T22:12:42.065505] [INFO ] [LOCAL ] XYF: Starting deletion of primary data. [2025-09-26T22:12:42.123283] [DEBUG] [LOCAL ] XYF: Deleted primary data file. [2025-09-26T22:12:42.134483] [INFO ] [MAIN ] XYF: Starting full primary refresh. [2025-09-26T22:12:42.353232] [WARN ] [MAIN ] XYL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:12:42.434950] [INFO ] [MAIN ] XYL: Wiping existing primary data before full refresh. [2025-09-26T22:12:42.475739] [INFO ] [LOCAL ] XYL: Starting deletion of primary data. [2025-09-26T22:12:42.485583] [DEBUG] [LOCAL ] XYL: Deleted primary data file. [2025-09-26T22:12:42.496018] [INFO ] [MAIN ] XYL: Starting full primary refresh. [2025-09-26T22:12:43.123603] [DEBUG] [VALIDATOR ] XPRO: All expected trading days are present. [2025-09-26T22:12:43.160365] [DEBUG] [VALIDATOR ] XPRO: Primary data validation passed. [2025-09-26T22:12:43.225044] [INFO ] [MAIN ] XPRO: Fetched primary data is valid. [2025-09-26T22:12:43.276986] [DEBUG] [LOCAL ] XPRO: Saving primary data. [2025-09-26T22:12:43.399617] [DEBUG] [LOCAL ] XPRO: Trimmed 66578 records to 46617 (keeping 200 days of data) [2025-09-26T22:12:43.495362] [INFO ] [REMOTE ] XYL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:12:43.586883] [INFO ] [REMOTE ] XYL: Fetching primary data for 2024-12. [2025-09-26T22:12:43.585961] [INFO ] [REMOTE ] XYF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:12:43.623804] [INFO ] [REMOTE ] XYF: Fetching primary data for 2024-12. [2025-09-26T22:12:43.643326] [DEBUG] [LOCAL ] XPOF: Primary data saved (39243 records). [2025-09-26T22:12:43.644207] [INFO ] [MAIN ] XPOF: Full history saved. [2025-09-26T22:12:43.644620] [INFO ] [MAIN ] Update Progress: 2342/2371 symbols completed. XPOF took 33.8s. Estimated remaining: 3m 52s. Rate: 7.5 symbols/min [2025-09-26T22:12:43.853525] [INFO ] [MAIN ] XYZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:12:43.854595] [DEBUG] [LOCAL ] XYZ: No existing data file found in primary storage. [2025-09-26T22:12:43.854997] [WARN ] [MAIN ] XYZ: No existing data found, performing full refresh instead. [2025-09-26T22:12:43.855993] [INFO ] [MAIN ] XYZ: Wiping existing primary data before full refresh. [2025-09-26T22:12:43.856331] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-09-26T22:12:43.856689] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-09-26T22:12:43.857031] [INFO ] [MAIN ] XYZ: Starting full primary refresh. [2025-09-26T22:12:44.345306] [INFO ] [REMOTE ] XYZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:12:44.346523] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2024-12. [2025-09-26T22:12:44.419271] [DEBUG] [LOCAL ] XPRO: Primary data saved (46617 records). [2025-09-26T22:12:44.419425] [INFO ] [MAIN ] XPRO: Full history saved. [2025-09-26T22:12:44.419546] [INFO ] [MAIN ] Update Progress: 2343/2371 symbols completed. XPRO took 29.7s. Estimated remaining: 3m 44s. Rate: 7.5 symbols/min [2025-09-26T22:12:44.534455] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-26T22:12:44.578210] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-01. [2025-09-26T22:12:44.612933] [INFO ] [MAIN ] YALA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:12:44.609148] [DEBUG] [REMOTE ] XYZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T22:12:44.614717] [WARN ] [REMOTE ] XYZ: No data returned for month 2024-12 [2025-09-26T22:12:44.615045] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-01. [2025-09-26T22:12:44.656520] [DEBUG] [LOCAL ] YALA: Loaded 37777 existing records from primary storage. [2025-09-26T22:12:44.656843] [INFO ] [MAIN ] YALA: Loaded 37777 existing records. [2025-09-26T22:12:44.848377] [WARN ] [MAIN ] YALA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:12:44.848748] [INFO ] [MAIN ] YALA: Wiping existing primary data before full refresh. [2025-09-26T22:12:44.848805] [INFO ] [LOCAL ] YALA: Starting deletion of primary data. [2025-09-26T22:12:44.849796] [DEBUG] [LOCAL ] YALA: Deleted primary data file. [2025-09-26T22:12:44.849858] [INFO ] [MAIN ] YALA: Starting full primary refresh. [2025-09-26T22:12:45.232552] [INFO ] [REMOTE ] YALA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:12:45.239498] [INFO ] [REMOTE ] YALA: Fetching primary data for 2024-12. [2025-09-26T22:12:45.241102] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-26T22:12:45.378900] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-26T22:12:45.511733] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-02. [2025-09-26T22:12:46.018546] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-26T22:12:46.096142] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-26T22:12:46.297997] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-26T22:12:46.311673] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-01. [2025-09-26T22:12:47.111702] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-02. [2025-09-26T22:12:47.265086] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-26T22:12:47.911744] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-01. [2025-09-26T22:12:48.711847] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-02. [2025-09-26T22:12:49.425420] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-26T22:12:49.511794] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-03. [2025-09-26T22:12:49.682697] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-26T22:12:49.722731] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-26T22:12:50.311759] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-03. [2025-09-26T22:12:51.111743] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-03. [2025-09-26T22:12:51.422099] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-26T22:12:51.911770] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-02. [2025-09-26T22:12:52.025117] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-09-26T22:12:52.504157] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-26T22:12:52.711768] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-04. [2025-09-26T22:12:53.511714] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-04. [2025-09-26T22:12:53.700872] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-26T22:12:54.311732] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-04. [2025-09-26T22:12:54.381054] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-26T22:12:54.548122] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-26T22:12:55.111780] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-05. [2025-09-26T22:12:55.911716] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-03. [2025-09-26T22:12:55.989512] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-26T22:12:56.054824] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-26T22:12:56.711738] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-06. [2025-09-26T22:12:57.511752] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-05. [2025-09-26T22:12:57.881813] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-26T22:12:57.942181] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-26T22:12:58.311732] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-05. [2025-09-26T22:12:59.111803] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-04. [2025-09-26T22:12:59.216180] [DEBUG] [REMOTE ] XYL: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-09-26T22:12:59.216711] [WARN ] [REMOTE ] XYL: No data returned for month 2025-04 [2025-09-26T22:12:59.911711] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-05. [2025-09-26T22:12:59.956827] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-09-26T22:12:59.993962] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-26T22:13:00.711734] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-07. [2025-09-26T22:13:01.511701] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-06. [2025-09-26T22:13:01.958189] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-26T22:13:02.251478] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-26T22:13:02.311709] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-08. [2025-09-26T22:13:03.047171] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-26T22:13:03.111698] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-06. [2025-09-26T22:13:03.749988] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-26T22:13:03.911738] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-09. [2025-09-26T22:13:04.711712] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-06. [2025-09-26T22:13:04.797775] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-26T22:13:05.032863] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-26T22:13:05.037963] [INFO ] [REMOTE ] XYF: Full fetch complete (31728 records). [2025-09-26T22:13:05.038087] [DEBUG] [VALIDATOR ] XYF: Validating primary data. [2025-09-26T22:13:05.460136] [DEBUG] [VALIDATOR ] XYF: All expected trading days are present. [2025-09-26T22:13:05.460242] [DEBUG] [VALIDATOR ] XYF: Primary data validation passed. [2025-09-26T22:13:05.461169] [INFO ] [MAIN ] XYF: Fetched primary data is valid. [2025-09-26T22:13:05.461239] [DEBUG] [LOCAL ] XYF: Saving primary data. [2025-09-26T22:13:05.462343] [DEBUG] [LOCAL ] XYF: Trimmed 31728 records to 28464 (keeping 200 days of data) [2025-09-26T22:13:05.515791] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-07. [2025-09-26T22:13:05.647627] [DEBUG] [LOCAL ] XYF: Primary data saved (28464 records). [2025-09-26T22:13:05.647812] [INFO ] [MAIN ] XYF: Full history saved. [2025-09-26T22:13:05.647913] [INFO ] [MAIN ] Update Progress: 2344/2371 symbols completed. XYF took 25.0s. Estimated remaining: 3m 36s. Rate: 7.5 symbols/min [2025-09-26T22:13:05.828002] [INFO ] [MAIN ] YELP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:13:05.872164] [DEBUG] [LOCAL ] YELP: Loaded 45619 existing records from primary storage. [2025-09-26T22:13:05.872330] [INFO ] [MAIN ] YELP: Loaded 45619 existing records. [2025-09-26T22:13:06.065525] [WARN ] [MAIN ] YELP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:13:06.065843] [INFO ] [MAIN ] YELP: Wiping existing primary data before full refresh. [2025-09-26T22:13:06.065898] [INFO ] [LOCAL ] YELP: Starting deletion of primary data. [2025-09-26T22:13:06.070441] [DEBUG] [LOCAL ] YELP: Deleted primary data file. [2025-09-26T22:13:06.070508] [INFO ] [MAIN ] YELP: Starting full primary refresh. [2025-09-26T22:13:06.319368] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-07. [2025-09-26T22:13:06.450379] [INFO ] [REMOTE ] YELP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:13:06.949692] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-26T22:13:07.050456] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-26T22:13:07.111722] [INFO ] [REMOTE ] YELP: Fetching primary data for 2024-12. [2025-09-26T22:13:07.916632] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-08. [2025-09-26T22:13:07.922118] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-26T22:13:08.617710] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-26T22:13:08.711715] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-01. [2025-09-26T22:13:09.511715] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-08. [2025-09-26T22:13:09.573860] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-26T22:13:10.295905] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-26T22:13:10.311687] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-02. [2025-09-26T22:13:11.108195] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-26T22:13:11.115597] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-07. [2025-09-26T22:13:11.892579] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-26T22:13:11.911718] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-03. [2025-09-26T22:13:12.711738] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-09. [2025-09-26T22:13:13.432461] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-26T22:13:13.442931] [INFO ] [REMOTE ] XYL: Full fetch complete (61864 records). [2025-09-26T22:13:13.443071] [DEBUG] [VALIDATOR ] XYL: Validating primary data. [2025-09-26T22:13:13.513978] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-09. [2025-09-26T22:13:13.659838] [WARN ] [VALIDATOR ] XYL: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-26T22:13:13.660886] [FATAL] [MAIN ] XYL: Fetched primary data is invalid. Refusing to save it. [2025-09-26T22:13:13.661001] [WARN ] [MAIN ] XYL: Deleting existing primary and derivative data due to validation failure. [2025-09-26T22:13:13.661392] [INFO ] [LOCAL ] XYL: Starting deletion of primary data. [2025-09-26T22:13:13.661547] [DEBUG] [LOCAL ] XYL: No primary data file found to delete. [2025-09-26T22:13:13.661819] [INFO ] [LOCAL ] XYL: Starting deletion of derivative data. [2025-09-26T22:13:13.662244] [DEBUG] [LOCAL ] XYL: Deleted derivative data file. [2025-09-26T22:13:13.662371] [INFO ] [MAIN ] Update Progress: 2345/2371 symbols completed. XYL took 32.9s. Estimated remaining: 3m 28s. Rate: 7.5 symbols/min [2025-09-26T22:13:13.843280] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-09-26T22:13:13.917374] [INFO ] [MAIN ] YETI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:13:13.953597] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-26T22:13:14.014233] [DEBUG] [LOCAL ] YETI: Loaded 52840 existing records from primary storage. [2025-09-26T22:13:14.014429] [INFO ] [MAIN ] YETI: Loaded 52840 existing records. [2025-09-26T22:13:14.202132] [WARN ] [MAIN ] YETI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:13:14.202492] [INFO ] [MAIN ] YETI: Wiping existing primary data before full refresh. [2025-09-26T22:13:14.202579] [INFO ] [LOCAL ] YETI: Starting deletion of primary data. [2025-09-26T22:13:14.207750] [DEBUG] [LOCAL ] YETI: Deleted primary data file. [2025-09-26T22:13:14.207815] [INFO ] [MAIN ] YETI: Starting full primary refresh. [2025-09-26T22:13:14.316955] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-04. [2025-09-26T22:13:14.599800] [INFO ] [REMOTE ] YETI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:13:14.899130] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-26T22:13:14.907836] [INFO ] [REMOTE ] YALA: Full fetch complete (46532 records). [2025-09-26T22:13:14.908026] [DEBUG] [VALIDATOR ] YALA: Validating primary data. [2025-09-26T22:13:15.116878] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-08. [2025-09-26T22:13:15.318903] [DEBUG] [VALIDATOR ] YALA: All expected trading days are present. [2025-09-26T22:13:15.319011] [DEBUG] [VALIDATOR ] YALA: Primary data validation passed. [2025-09-26T22:13:15.320165] [INFO ] [MAIN ] YALA: Fetched primary data is valid. [2025-09-26T22:13:15.320233] [DEBUG] [LOCAL ] YALA: Saving primary data. [2025-09-26T22:13:15.321555] [DEBUG] [LOCAL ] YALA: Trimmed 46532 records to 37892 (keeping 200 days of data) [2025-09-26T22:13:15.539797] [DEBUG] [LOCAL ] YALA: Primary data saved (37892 records). [2025-09-26T22:13:15.539966] [INFO ] [MAIN ] YALA: Full history saved. [2025-09-26T22:13:15.540064] [INFO ] [MAIN ] Update Progress: 2346/2371 symbols completed. YALA took 31.1s. Estimated remaining: 3m 20s. Rate: 7.5 symbols/min [2025-09-26T22:13:15.720289] [INFO ] [MAIN ] YEXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:13:15.762171] [DEBUG] [LOCAL ] YEXT: Loaded 43579 existing records from primary storage. [2025-09-26T22:13:15.762328] [INFO ] [MAIN ] YEXT: Loaded 43579 existing records. [2025-09-26T22:13:15.915078] [INFO ] [REMOTE ] YETI: Fetching primary data for 2024-12. [2025-09-26T22:13:15.965294] [WARN ] [MAIN ] YEXT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:13:15.966039] [INFO ] [MAIN ] YEXT: Wiping existing primary data before full refresh. [2025-09-26T22:13:15.966235] [INFO ] [LOCAL ] YEXT: Starting deletion of primary data. [2025-09-26T22:13:15.979448] [DEBUG] [LOCAL ] YEXT: Deleted primary data file. [2025-09-26T22:13:15.995509] [INFO ] [MAIN ] YEXT: Starting full primary refresh. [2025-09-26T22:13:16.095436] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-26T22:13:16.377008] [INFO ] [REMOTE ] YEXT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:13:16.711733] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-05. [2025-09-26T22:13:17.511712] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2024-12. [2025-09-26T22:13:17.870677] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-08 (2.75 seconds). [2025-09-26T22:13:17.916076] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-26T22:13:18.242478] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-26T22:13:18.311697] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-06. [2025-09-26T22:13:19.111750] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-01. [2025-09-26T22:13:19.164479] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-26T22:13:19.817306] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-26T22:13:19.911723] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-01. [2025-09-26T22:13:20.711746] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-07. [2025-09-26T22:13:20.796922] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-26T22:13:21.516791] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-02. [2025-09-26T22:13:21.533732] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-26T22:13:22.320414] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-02. [2025-09-26T22:13:22.327044] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-26T22:13:23.111711] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-09. [2025-09-26T22:13:23.240121] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-26T22:13:23.809600] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-26T22:13:23.911707] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-03. [2025-09-26T22:13:24.138186] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-26T22:13:24.148928] [INFO ] [REMOTE ] XYZ: Full fetch complete (67397 records). [2025-09-26T22:13:24.149155] [DEBUG] [VALIDATOR ] XYZ: Validating primary data. [2025-09-26T22:13:24.357076] [WARN ] [VALIDATOR ] XYZ: Validation failed - insufficient historical data. Have 173 unique days, need 200 days [2025-09-26T22:13:24.357967] [FATAL] [MAIN ] XYZ: Fetched primary data is invalid. Refusing to save it. [2025-09-26T22:13:24.358053] [WARN ] [MAIN ] XYZ: Deleting existing primary and derivative data due to validation failure. [2025-09-26T22:13:24.358142] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-09-26T22:13:24.358241] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-09-26T22:13:24.358292] [INFO ] [LOCAL ] XYZ: Starting deletion of derivative data. [2025-09-26T22:13:24.358355] [DEBUG] [LOCAL ] XYZ: No derivative data file found to delete. [2025-09-26T22:13:24.358494] [INFO ] [MAIN ] Update Progress: 2347/2371 symbols completed. XYZ took 40.7s. Estimated remaining: 3m 12s. Rate: 7.5 symbols/min [2025-09-26T22:13:24.539060] [INFO ] [MAIN ] YMM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:13:24.593941] [DEBUG] [LOCAL ] YMM: Loaded 53043 existing records from primary storage. [2025-09-26T22:13:24.594114] [INFO ] [MAIN ] YMM: Loaded 53043 existing records. [2025-09-26T22:13:24.716813] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-03. [2025-09-26T22:13:24.796712] [WARN ] [MAIN ] YMM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:13:24.797009] [INFO ] [MAIN ] YMM: Wiping existing primary data before full refresh. [2025-09-26T22:13:24.797095] [INFO ] [LOCAL ] YMM: Starting deletion of primary data. [2025-09-26T22:13:24.799836] [DEBUG] [LOCAL ] YMM: Deleted primary data file. [2025-09-26T22:13:24.799905] [INFO ] [MAIN ] YMM: Starting full primary refresh. [2025-09-26T22:13:25.203764] [INFO ] [REMOTE ] YMM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:13:25.511774] [INFO ] [REMOTE ] YMM: Fetching primary data for 2024-12. [2025-09-26T22:13:25.718517] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-26T22:13:26.311793] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-08. [2025-09-26T22:13:26.387367] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-26T22:13:27.111739] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-04. [2025-09-26T22:13:27.293006] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-26T22:13:27.709185] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-26T22:13:27.911777] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-01. [2025-09-26T22:13:28.722108] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-09. [2025-09-26T22:13:28.732710] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-26T22:13:29.511796] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-05. [2025-09-26T22:13:29.828178] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-26T22:13:29.872934] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-26T22:13:29.882095] [INFO ] [REMOTE ] YELP: Full fetch complete (64251 records). [2025-09-26T22:13:29.882253] [DEBUG] [VALIDATOR ] YELP: Validating primary data. [2025-09-26T22:13:30.319546] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-04. [2025-09-26T22:13:30.322013] [DEBUG] [VALIDATOR ] YELP: All expected trading days are present. [2025-09-26T22:13:30.322168] [DEBUG] [VALIDATOR ] YELP: Primary data validation passed. [2025-09-26T22:13:30.323411] [INFO ] [MAIN ] YELP: Fetched primary data is valid. [2025-09-26T22:13:30.323664] [DEBUG] [LOCAL ] YELP: Saving primary data. [2025-09-26T22:13:30.325356] [DEBUG] [LOCAL ] YELP: Trimmed 64251 records to 45909 (keeping 200 days of data) [2025-09-26T22:13:30.604922] [DEBUG] [LOCAL ] YELP: Primary data saved (45909 records). [2025-09-26T22:13:30.605081] [INFO ] [MAIN ] YELP: Full history saved. [2025-09-26T22:13:30.605232] [INFO ] [MAIN ] Update Progress: 2348/2371 symbols completed. YELP took 25.0s. Estimated remaining: 3m 4s. Rate: 7.5 symbols/min [2025-09-26T22:13:30.795371] [INFO ] [MAIN ] YOU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:13:30.848971] [DEBUG] [LOCAL ] YOU: Loaded 50190 existing records from primary storage. [2025-09-26T22:13:30.849212] [INFO ] [MAIN ] YOU: Loaded 50190 existing records. [2025-09-26T22:13:31.047748] [WARN ] [MAIN ] YOU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:13:31.048936] [INFO ] [MAIN ] YOU: Wiping existing primary data before full refresh. [2025-09-26T22:13:31.061067] [INFO ] [LOCAL ] YOU: Starting deletion of primary data. [2025-09-26T22:13:31.077257] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-26T22:13:31.080536] [DEBUG] [LOCAL ] YOU: Deleted primary data file. [2025-09-26T22:13:31.086097] [INFO ] [MAIN ] YOU: Starting full primary refresh. [2025-09-26T22:13:31.120334] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-06. [2025-09-26T22:13:31.482480] [INFO ] [REMOTE ] YOU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:13:31.911737] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-02. [2025-09-26T22:13:32.178544] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-26T22:13:32.436464] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-26T22:13:32.711777] [INFO ] [REMOTE ] YOU: Fetching primary data for 2024-12. [2025-09-26T22:13:33.511711] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-07. [2025-09-26T22:13:33.681522] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-26T22:13:34.200486] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-26T22:13:34.311774] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-05. [2025-09-26T22:13:34.994286] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-26T22:13:35.111767] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-08. [2025-09-26T22:13:35.911739] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-03. [2025-09-26T22:13:36.178329] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-26T22:13:36.624039] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-26T22:13:36.711718] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-09. [2025-09-26T22:13:37.511708] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-01. [2025-09-26T22:13:37.675011] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-26T22:13:38.311714] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-04. [2025-09-26T22:13:38.395113] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-26T22:13:38.404208] [INFO ] [REMOTE ] YEXT: Full fetch complete (63443 records). [2025-09-26T22:13:38.404375] [DEBUG] [VALIDATOR ] YEXT: Validating primary data. [2025-09-26T22:13:38.800693] [DEBUG] [VALIDATOR ] YEXT: All expected trading days are present. [2025-09-26T22:13:38.800890] [DEBUG] [VALIDATOR ] YEXT: Primary data validation passed. [2025-09-26T22:13:38.802871] [INFO ] [MAIN ] YEXT: Fetched primary data is valid. [2025-09-26T22:13:38.803001] [DEBUG] [LOCAL ] YEXT: Saving primary data. [2025-09-26T22:13:38.804857] [DEBUG] [LOCAL ] YEXT: Trimmed 63443 records to 43863 (keeping 200 days of data) [2025-09-26T22:13:38.945025] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-26T22:13:39.116414] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-02. [2025-09-26T22:13:39.132519] [DEBUG] [LOCAL ] YEXT: Primary data saved (43863 records). [2025-09-26T22:13:39.132638] [INFO ] [MAIN ] YEXT: Full history saved. [2025-09-26T22:13:39.132907] [INFO ] [MAIN ] Update Progress: 2349/2371 symbols completed. YEXT took 23.6s. Estimated remaining: 2m 56s. Rate: 7.5 symbols/min [2025-09-26T22:13:39.313980] [INFO ] [MAIN ] YPF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:13:39.369989] [DEBUG] [LOCAL ] YPF: Loaded 50878 existing records from primary storage. [2025-09-26T22:13:39.370165] [INFO ] [MAIN ] YPF: Loaded 50878 existing records. [2025-09-26T22:13:39.562952] [WARN ] [MAIN ] YPF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:13:39.563275] [INFO ] [MAIN ] YPF: Wiping existing primary data before full refresh. [2025-09-26T22:13:39.563329] [INFO ] [LOCAL ] YPF: Starting deletion of primary data. [2025-09-26T22:13:39.566998] [DEBUG] [LOCAL ] YPF: Deleted primary data file. [2025-09-26T22:13:39.567065] [INFO ] [MAIN ] YPF: Starting full primary refresh. [2025-09-26T22:13:39.919045] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-06. [2025-09-26T22:13:39.969029] [INFO ] [REMOTE ] YPF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:13:40.187260] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-26T22:13:40.711729] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-05. [2025-09-26T22:13:40.903280] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-26T22:13:41.375125] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-26T22:13:41.511797] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-03. [2025-09-26T22:13:42.311864] [INFO ] [REMOTE ] YPF: Fetching primary data for 2024-12. [2025-09-26T22:13:42.873631] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-26T22:13:43.111717] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-07. [2025-09-26T22:13:43.297094] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-26T22:13:43.911768] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-04. [2025-09-26T22:13:44.302545] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-26T22:13:44.711774] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-06. [2025-09-26T22:13:44.927457] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-26T22:13:45.511818] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-01. [2025-09-26T22:13:45.858094] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-26T22:13:46.311711] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-05. [2025-09-26T22:13:46.435166] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-26T22:13:47.111723] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-07. [2025-09-26T22:13:47.223766] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-26T22:13:47.659076] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-26T22:13:47.911769] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-02. [2025-09-26T22:13:48.670192] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-26T22:13:48.711685] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-06. [2025-09-26T22:13:49.511706] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-08. [2025-09-26T22:13:49.570240] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-26T22:13:50.311724] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-03. [2025-09-26T22:13:50.384703] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-26T22:13:51.111740] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-08. [2025-09-26T22:13:51.478246] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-26T22:13:51.911711] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-09. [2025-09-26T22:13:52.108800] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-26T22:13:52.610212] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-26T22:13:52.711704] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-07. [2025-09-26T22:13:53.272543] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-26T22:13:53.284065] [INFO ] [REMOTE ] YMM: Full fetch complete (76413 records). [2025-09-26T22:13:53.284343] [DEBUG] [VALIDATOR ] YMM: Validating primary data. [2025-09-26T22:13:53.516961] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-09. [2025-09-26T22:13:53.748320] [DEBUG] [VALIDATOR ] YMM: All expected trading days are present. [2025-09-26T22:13:53.748439] [DEBUG] [VALIDATOR ] YMM: Primary data validation passed. [2025-09-26T22:13:53.750398] [INFO ] [MAIN ] YMM: Fetched primary data is valid. [2025-09-26T22:13:53.750497] [DEBUG] [LOCAL ] YMM: Saving primary data. [2025-09-26T22:13:53.752581] [DEBUG] [LOCAL ] YMM: Trimmed 76413 records to 53425 (keeping 200 days of data) [2025-09-26T22:13:54.125229] [DEBUG] [LOCAL ] YMM: Primary data saved (53425 records). [2025-09-26T22:13:54.125455] [INFO ] [MAIN ] YMM: Full history saved. [2025-09-26T22:13:54.125625] [INFO ] [MAIN ] Update Progress: 2350/2371 symbols completed. YMM took 29.8s. Estimated remaining: 2m 48s. Rate: 7.5 symbols/min [2025-09-26T22:13:54.289689] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-26T22:13:54.313363] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-04. [2025-09-26T22:13:54.384191] [INFO ] [MAIN ] YRD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:13:54.401307] [DEBUG] [LOCAL ] YRD: Loaded 12668 existing records from primary storage. [2025-09-26T22:13:54.401473] [INFO ] [MAIN ] YRD: Loaded 12668 existing records. [2025-09-26T22:13:54.592048] [WARN ] [MAIN ] YRD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:13:54.592370] [INFO ] [MAIN ] YRD: Wiping existing primary data before full refresh. [2025-09-26T22:13:54.592423] [INFO ] [LOCAL ] YRD: Starting deletion of primary data. [2025-09-26T22:13:54.593093] [DEBUG] [LOCAL ] YRD: Deleted primary data file. [2025-09-26T22:13:54.593167] [INFO ] [MAIN ] YRD: Starting full primary refresh. [2025-09-26T22:13:54.986998] [INFO ] [REMOTE ] YRD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:13:55.111718] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-08. [2025-09-26T22:13:55.643790] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-26T22:13:55.658991] [INFO ] [REMOTE ] YETI: Full fetch complete (75441 records). [2025-09-26T22:13:55.659207] [DEBUG] [VALIDATOR ] YETI: Validating primary data. [2025-09-26T22:13:55.921429] [INFO ] [REMOTE ] YRD: Fetching primary data for 2024-12. [2025-09-26T22:13:56.072529] [DEBUG] [VALIDATOR ] YETI: All expected trading days are present. [2025-09-26T22:13:56.072718] [DEBUG] [VALIDATOR ] YETI: Primary data validation passed. [2025-09-26T22:13:56.074211] [INFO ] [MAIN ] YETI: Fetched primary data is valid. [2025-09-26T22:13:56.074319] [DEBUG] [LOCAL ] YETI: Saving primary data. [2025-09-26T22:13:56.080327] [DEBUG] [LOCAL ] YETI: Trimmed 75441 records to 53216 (keeping 200 days of data) [2025-09-26T22:13:56.230358] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-26T22:13:56.480836] [DEBUG] [LOCAL ] YETI: Primary data saved (53216 records). [2025-09-26T22:13:56.481049] [INFO ] [MAIN ] YETI: Full history saved. [2025-09-26T22:13:56.481213] [INFO ] [MAIN ] Update Progress: 2351/2371 symbols completed. YETI took 42.8s. Estimated remaining: 2m 40s. Rate: 7.5 symbols/min [2025-09-26T22:13:56.664309] [INFO ] [MAIN ] YSG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:13:56.692874] [DEBUG] [LOCAL ] YSG: Loaded 25342 existing records from primary storage. [2025-09-26T22:13:56.693036] [INFO ] [MAIN ] YSG: Loaded 25342 existing records. [2025-09-26T22:13:56.726278] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-05. [2025-09-26T22:13:56.899735] [WARN ] [MAIN ] YSG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:13:56.901366] [INFO ] [MAIN ] YSG: Wiping existing primary data before full refresh. [2025-09-26T22:13:56.901577] [INFO ] [LOCAL ] YSG: Starting deletion of primary data. [2025-09-26T22:13:56.903575] [DEBUG] [LOCAL ] YSG: Deleted primary data file. [2025-09-26T22:13:56.903771] [INFO ] [MAIN ] YSG: Starting full primary refresh. [2025-09-26T22:13:57.065674] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-26T22:13:57.143154] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-26T22:13:57.399062] [INFO ] [REMOTE ] YSG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:13:57.511732] [INFO ] [REMOTE ] YSG: Fetching primary data for 2024-12. [2025-09-26T22:13:58.187967] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-26T22:13:58.311755] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-01. [2025-09-26T22:13:58.455146] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-26T22:13:59.111724] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-06. [2025-09-26T22:13:59.239972] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-26T22:13:59.911775] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-01. [2025-09-26T22:14:00.711742] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-09. [2025-09-26T22:14:00.903930] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-26T22:14:01.079365] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-26T22:14:01.511739] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-07. [2025-09-26T22:14:02.311778] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-02. [2025-09-26T22:14:02.552692] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-26T22:14:02.570582] [INFO ] [REMOTE ] YOU: Full fetch complete (72085 records). [2025-09-26T22:14:02.570878] [DEBUG] [VALIDATOR ] YOU: Validating primary data. [2025-09-26T22:14:03.006942] [DEBUG] [VALIDATOR ] YOU: All expected trading days are present. [2025-09-26T22:14:03.007134] [DEBUG] [VALIDATOR ] YOU: Primary data validation passed. [2025-09-26T22:14:03.008484] [INFO ] [MAIN ] YOU: Fetched primary data is valid. [2025-09-26T22:14:03.008589] [DEBUG] [LOCAL ] YOU: Saving primary data. [2025-09-26T22:14:03.013007] [DEBUG] [LOCAL ] YOU: Trimmed 72085 records to 50504 (keeping 200 days of data) [2025-09-26T22:14:03.123401] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-02. [2025-09-26T22:14:03.307750] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-26T22:14:03.309416] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-26T22:14:03.432933] [DEBUG] [LOCAL ] YOU: Primary data saved (50504 records). [2025-09-26T22:14:03.433124] [INFO ] [MAIN ] YOU: Full history saved. [2025-09-26T22:14:03.433421] [INFO ] [MAIN ] Update Progress: 2352/2371 symbols completed. YOU took 32.8s. Estimated remaining: 2m 32s. Rate: 7.5 symbols/min [2025-09-26T22:14:03.613064] [INFO ] [MAIN ] YUM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:14:03.682555] [DEBUG] [LOCAL ] YUM: Loaded 51593 existing records from primary storage. [2025-09-26T22:14:03.682764] [INFO ] [MAIN ] YUM: Loaded 51593 existing records. [2025-09-26T22:14:03.884079] [WARN ] [MAIN ] YUM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:14:03.884525] [INFO ] [MAIN ] YUM: Wiping existing primary data before full refresh. [2025-09-26T22:14:03.884597] [INFO ] [LOCAL ] YUM: Starting deletion of primary data. [2025-09-26T22:14:03.888183] [DEBUG] [LOCAL ] YUM: Deleted primary data file. [2025-09-26T22:14:03.888262] [INFO ] [MAIN ] YUM: Starting full primary refresh. [2025-09-26T22:14:03.920343] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-03. [2025-09-26T22:14:04.277622] [INFO ] [REMOTE ] YUM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:14:04.296977] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-26T22:14:04.711722] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-08. [2025-09-26T22:14:05.134130] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-26T22:14:05.511752] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-03. [2025-09-26T22:14:06.311702] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-04. [2025-09-26T22:14:06.513725] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-26T22:14:06.549464] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-26T22:14:07.111711] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-09. [2025-09-26T22:14:07.311911] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-26T22:14:07.911732] [INFO ] [REMOTE ] YUM: Fetching primary data for 2024-12. [2025-09-26T22:14:08.711733] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-05. [2025-09-26T22:14:08.907414] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-26T22:14:08.919593] [INFO ] [REMOTE ] YPF: Full fetch complete (73504 records). [2025-09-26T22:14:08.919800] [DEBUG] [VALIDATOR ] YPF: Validating primary data. [2025-09-26T22:14:09.340892] [DEBUG] [VALIDATOR ] YPF: All expected trading days are present. [2025-09-26T22:14:09.340992] [DEBUG] [VALIDATOR ] YPF: Primary data validation passed. [2025-09-26T22:14:09.342326] [INFO ] [MAIN ] YPF: Fetched primary data is valid. [2025-09-26T22:14:09.342395] [DEBUG] [LOCAL ] YPF: Saving primary data. [2025-09-26T22:14:09.344154] [DEBUG] [LOCAL ] YPF: Trimmed 73504 records to 51252 (keeping 200 days of data) [2025-09-26T22:14:09.539583] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-04. [2025-09-26T22:14:09.631873] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-26T22:14:09.732596] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-26T22:14:09.762675] [DEBUG] [LOCAL ] YPF: Primary data saved (51252 records). [2025-09-26T22:14:09.762934] [INFO ] [MAIN ] YPF: Full history saved. [2025-09-26T22:14:09.763107] [INFO ] [MAIN ] Update Progress: 2353/2371 symbols completed. YPF took 30.6s. Estimated remaining: 2m 24s. Rate: 7.5 symbols/min [2025-09-26T22:14:10.022589] [INFO ] [MAIN ] YUMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:14:10.082838] [DEBUG] [LOCAL ] YUMC: Loaded 53072 existing records from primary storage. [2025-09-26T22:14:10.083073] [INFO ] [MAIN ] YUMC: Loaded 53072 existing records. [2025-09-26T22:14:10.263243] [WARN ] [MAIN ] YUMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:14:10.263550] [INFO ] [MAIN ] YUMC: Wiping existing primary data before full refresh. [2025-09-26T22:14:10.263601] [INFO ] [LOCAL ] YUMC: Starting deletion of primary data. [2025-09-26T22:14:10.267119] [DEBUG] [LOCAL ] YUMC: Deleted primary data file. [2025-09-26T22:14:10.267190] [INFO ] [MAIN ] YUMC: Starting full primary refresh. [2025-09-26T22:14:10.319955] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-06. [2025-09-26T22:14:10.672911] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-26T22:14:10.676953] [INFO ] [REMOTE ] YUMC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:14:11.111749] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-01. [2025-09-26T22:14:11.762484] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-26T22:14:11.911727] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2024-12. [2025-09-26T22:14:12.711739] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-07. [2025-09-26T22:14:13.206992] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-26T22:14:13.511741] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-02. [2025-09-26T22:14:13.734191] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-26T22:14:14.201221] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-26T22:14:14.311711] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-05. [2025-09-26T22:14:15.111721] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-08. [2025-09-26T22:14:15.126099] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-26T22:14:15.304740] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-26T22:14:15.911736] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-03. [2025-09-26T22:14:16.412574] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-26T22:14:16.711761] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-01. [2025-09-26T22:14:17.511733] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-06. [2025-09-26T22:14:17.818314] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-26T22:14:18.311761] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-09. [2025-09-26T22:14:18.512568] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-26T22:14:18.531421] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-26T22:14:19.111731] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-02. [2025-09-26T22:14:19.696255] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-26T22:14:19.701635] [INFO ] [REMOTE ] YSG: Full fetch complete (32607 records). [2025-09-26T22:14:19.701763] [DEBUG] [VALIDATOR ] YSG: Validating primary data. [2025-09-26T22:14:19.922790] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-07. [2025-09-26T22:14:20.124517] [DEBUG] [VALIDATOR ] YSG: All expected trading days are present. [2025-09-26T22:14:20.124612] [DEBUG] [VALIDATOR ] YSG: Primary data validation passed. [2025-09-26T22:14:20.125530] [INFO ] [MAIN ] YSG: Fetched primary data is valid. [2025-09-26T22:14:20.125597] [DEBUG] [LOCAL ] YSG: Saving primary data. [2025-09-26T22:14:20.127294] [DEBUG] [LOCAL ] YSG: Trimmed 32607 records to 25485 (keeping 200 days of data) [2025-09-26T22:14:20.298041] [DEBUG] [LOCAL ] YSG: Primary data saved (25485 records). [2025-09-26T22:14:20.298257] [INFO ] [MAIN ] YSG: Full history saved. [2025-09-26T22:14:20.298406] [INFO ] [MAIN ] Update Progress: 2354/2371 symbols completed. YSG took 23.8s. Estimated remaining: 2m 16s. Rate: 7.5 symbols/min [2025-09-26T22:14:20.486727] [INFO ] [MAIN ] ZBH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:14:20.550583] [DEBUG] [LOCAL ] ZBH: Loaded 51599 existing records from primary storage. [2025-09-26T22:14:20.550775] [INFO ] [MAIN ] ZBH: Loaded 51599 existing records. [2025-09-26T22:14:20.719022] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-04. [2025-09-26T22:14:20.763270] [WARN ] [MAIN ] ZBH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:14:20.763510] [INFO ] [MAIN ] ZBH: Wiping existing primary data before full refresh. [2025-09-26T22:14:20.763584] [INFO ] [LOCAL ] ZBH: Starting deletion of primary data. [2025-09-26T22:14:20.766294] [DEBUG] [LOCAL ] ZBH: Deleted primary data file. [2025-09-26T22:14:20.766365] [INFO ] [MAIN ] ZBH: Starting full primary refresh. [2025-09-26T22:14:20.868070] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-26T22:14:21.171472] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-26T22:14:21.214635] [INFO ] [REMOTE ] ZBH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:14:21.511728] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-03. [2025-09-26T22:14:22.311693] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2024-12. [2025-09-26T22:14:22.681803] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-26T22:14:23.111696] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-08. [2025-09-26T22:14:23.377985] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-26T22:14:23.694471] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-26T22:14:23.911710] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-01. [2025-09-26T22:14:23.981035] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-26T22:14:24.711777] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-09. [2025-09-26T22:14:25.511746] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-05. [2025-09-26T22:14:25.522504] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-26T22:14:25.525592] [INFO ] [REMOTE ] YRD: Full fetch complete (19115 records). [2025-09-26T22:14:25.525702] [DEBUG] [VALIDATOR ] YRD: Validating primary data. [2025-09-26T22:14:25.944544] [DEBUG] [VALIDATOR ] YRD: All expected trading days are present. [2025-09-26T22:14:25.944760] [DEBUG] [VALIDATOR ] YRD: Primary data validation passed. [2025-09-26T22:14:25.945417] [INFO ] [MAIN ] YRD: Fetched primary data is valid. [2025-09-26T22:14:25.945483] [DEBUG] [LOCAL ] YRD: Saving primary data. [2025-09-26T22:14:25.946314] [DEBUG] [LOCAL ] YRD: Trimmed 19115 records to 12726 (keeping 200 days of data) [2025-09-26T22:14:26.050057] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-26T22:14:26.090159] [DEBUG] [LOCAL ] YRD: Primary data saved (12726 records). [2025-09-26T22:14:26.090339] [INFO ] [MAIN ] YRD: Full history saved. [2025-09-26T22:14:26.090450] [INFO ] [MAIN ] Update Progress: 2355/2371 symbols completed. YRD took 32.0s. Estimated remaining: 2m 8s. Rate: 7.5 symbols/min [2025-09-26T22:14:26.317927] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-02. [2025-09-26T22:14:26.322078] [INFO ] [MAIN ] ZEPP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:14:26.345147] [DEBUG] [LOCAL ] ZEPP: Loaded 17114 existing records from primary storage. [2025-09-26T22:14:26.345304] [INFO ] [MAIN ] ZEPP: Loaded 17114 existing records. [2025-09-26T22:14:26.536954] [WARN ] [MAIN ] ZEPP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:14:26.537255] [INFO ] [MAIN ] ZEPP: Wiping existing primary data before full refresh. [2025-09-26T22:14:26.537305] [INFO ] [LOCAL ] ZEPP: Starting deletion of primary data. [2025-09-26T22:14:26.538243] [DEBUG] [LOCAL ] ZEPP: Deleted primary data file. [2025-09-26T22:14:26.538308] [INFO ] [MAIN ] ZEPP: Starting full primary refresh. [2025-09-26T22:14:26.923895] [INFO ] [REMOTE ] ZEPP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:14:27.026811] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-26T22:14:27.111735] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-06. [2025-09-26T22:14:27.911734] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2024-12. [2025-09-26T22:14:27.974434] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-26T22:14:28.485969] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-26T22:14:28.711743] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-03. [2025-09-26T22:14:28.948090] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-26T22:14:29.511752] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-04. [2025-09-26T22:14:30.311700] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-01. [2025-09-26T22:14:30.657958] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-26T22:14:30.940216] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-26T22:14:31.111702] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-07. [2025-09-26T22:14:31.360579] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-26T22:14:31.911720] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-02. [2025-09-26T22:14:32.483860] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-26T22:14:32.711725] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-05. [2025-09-26T22:14:33.018201] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-26T22:14:33.511740] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-08. [2025-09-26T22:14:34.311761] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-03. [2025-09-26T22:14:34.644243] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-26T22:14:34.690072] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-26T22:14:35.111709] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-04. [2025-09-26T22:14:35.494981] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-26T22:14:35.691707] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-26T22:14:35.911770] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-04. [2025-09-26T22:14:36.711731] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-09. [2025-09-26T22:14:37.445813] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-26T22:14:37.460333] [INFO ] [REMOTE ] YUM: Full fetch complete (74377 records). [2025-09-26T22:14:37.460543] [DEBUG] [VALIDATOR ] YUM: Validating primary data. [2025-09-26T22:14:37.512271] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-05. [2025-09-26T22:14:37.894223] [DEBUG] [VALIDATOR ] YUM: All expected trading days are present. [2025-09-26T22:14:37.894320] [DEBUG] [VALIDATOR ] YUM: Primary data validation passed. [2025-09-26T22:14:37.895489] [INFO ] [MAIN ] YUM: Fetched primary data is valid. [2025-09-26T22:14:37.895557] [DEBUG] [LOCAL ] YUM: Saving primary data. [2025-09-26T22:14:37.897521] [DEBUG] [LOCAL ] YUM: Trimmed 74377 records to 51931 (keeping 200 days of data) [2025-09-26T22:14:38.025165] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-26T22:14:38.293812] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-26T22:14:38.313039] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-06. [2025-09-26T22:14:38.324071] [DEBUG] [LOCAL ] YUM: Primary data saved (51931 records). [2025-09-26T22:14:38.324304] [INFO ] [MAIN ] YUM: Full history saved. [2025-09-26T22:14:38.324420] [INFO ] [MAIN ] Update Progress: 2356/2371 symbols completed. YUM took 34.9s. Estimated remaining: 2m 0s. Rate: 7.5 symbols/min [2025-09-26T22:14:38.518862] [INFO ] [MAIN ] ZETA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:14:38.586423] [DEBUG] [LOCAL ] ZETA: Loaded 53985 existing records from primary storage. [2025-09-26T22:14:38.586667] [INFO ] [MAIN ] ZETA: Loaded 53985 existing records. [2025-09-26T22:14:38.786994] [WARN ] [MAIN ] ZETA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:14:38.787348] [INFO ] [MAIN ] ZETA: Wiping existing primary data before full refresh. [2025-09-26T22:14:38.787413] [INFO ] [LOCAL ] ZETA: Starting deletion of primary data. [2025-09-26T22:14:38.790332] [DEBUG] [LOCAL ] ZETA: Deleted primary data file. [2025-09-26T22:14:38.790398] [INFO ] [MAIN ] ZETA: Starting full primary refresh. [2025-09-26T22:14:39.116829] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-06. [2025-09-26T22:14:39.193254] [INFO ] [REMOTE ] ZETA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:14:39.747958] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-26T22:14:39.911718] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2024-12. [2025-09-26T22:14:40.054785] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-26T22:14:40.711757] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-05. [2025-09-26T22:14:41.511731] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-07. [2025-09-26T22:14:42.296968] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-09-26T22:14:42.311671] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-01. [2025-09-26T22:14:42.910347] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-26T22:14:43.057624] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-26T22:14:43.111719] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-07. [2025-09-26T22:14:43.911729] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-08. [2025-09-26T22:14:44.274431] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-26T22:14:44.711746] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-02. [2025-09-26T22:14:45.197375] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-26T22:14:45.511706] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-06. [2025-09-26T22:14:45.555361] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-26T22:14:46.311715] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-08. [2025-09-26T22:14:47.062814] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-09-26T22:14:47.111710] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-03. [2025-09-26T22:14:47.260972] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-26T22:14:47.911697] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-09. [2025-09-26T22:14:48.236253] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-26T22:14:48.711764] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-09. [2025-09-26T22:14:49.305829] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-26T22:14:49.358710] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-26T22:14:49.365311] [INFO ] [REMOTE ] ZEPP: Full fetch complete (18665 records). [2025-09-26T22:14:49.365453] [DEBUG] [VALIDATOR ] ZEPP: Validating primary data. [2025-09-26T22:14:49.516854] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-07. [2025-09-26T22:14:49.764751] [DEBUG] [VALIDATOR ] ZEPP: All expected trading days are present. [2025-09-26T22:14:49.764843] [DEBUG] [VALIDATOR ] ZEPP: Primary data validation passed. [2025-09-26T22:14:49.765319] [INFO ] [MAIN ] ZEPP: Fetched primary data is valid. [2025-09-26T22:14:49.765360] [DEBUG] [LOCAL ] ZEPP: Saving primary data. [2025-09-26T22:14:49.766071] [DEBUG] [LOCAL ] ZEPP: Trimmed 18665 records to 17335 (keeping 200 days of data) [2025-09-26T22:14:49.874744] [DEBUG] [LOCAL ] ZEPP: Primary data saved (17335 records). [2025-09-26T22:14:49.874960] [INFO ] [MAIN ] ZEPP: Full history saved. [2025-09-26T22:14:49.875162] [INFO ] [MAIN ] Update Progress: 2357/2371 symbols completed. ZEPP took 23.8s. Estimated remaining: 1m 52s. Rate: 7.5 symbols/min [2025-09-26T22:14:50.311683] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-04. [2025-09-26T22:14:50.569508] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-26T22:14:50.581243] [INFO ] [REMOTE ] YUMC: Full fetch complete (76176 records). [2025-09-26T22:14:50.581415] [DEBUG] [VALIDATOR ] YUMC: Validating primary data. [2025-09-26T22:14:51.040102] [DEBUG] [VALIDATOR ] YUMC: All expected trading days are present. [2025-09-26T22:14:51.040214] [DEBUG] [VALIDATOR ] YUMC: Primary data validation passed. [2025-09-26T22:14:51.041453] [INFO ] [MAIN ] YUMC: Fetched primary data is valid. [2025-09-26T22:14:51.041529] [DEBUG] [LOCAL ] YUMC: Saving primary data. [2025-09-26T22:14:51.043939] [DEBUG] [LOCAL ] YUMC: Trimmed 76176 records to 53455 (keeping 200 days of data) [2025-09-26T22:14:51.395236] [DEBUG] [LOCAL ] YUMC: Primary data saved (53455 records). [2025-09-26T22:14:51.395463] [INFO ] [MAIN ] YUMC: Full history saved. [2025-09-26T22:14:51.395571] [INFO ] [MAIN ] Update Progress: 2358/2371 symbols completed. YUMC took 41.6s. Estimated remaining: 1m 44s. Rate: 7.5 symbols/min [2025-09-26T22:14:51.477391] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-26T22:14:51.489413] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-08. [2025-09-26T22:14:52.414826] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-26T22:14:52.426334] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-05. [2025-09-26T22:14:52.815113] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-26T22:14:52.826233] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-09. [2025-09-26T22:14:54.489999] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-26T22:14:54.500534] [INFO ] [REMOTE ] ZBH: Full fetch complete (73868 records). [2025-09-26T22:14:54.500712] [DEBUG] [VALIDATOR ] ZBH: Validating primary data. [2025-09-26T22:14:54.701153] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-26T22:14:54.752905] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-06. [2025-09-26T22:14:54.983573] [DEBUG] [VALIDATOR ] ZBH: All expected trading days are present. [2025-09-26T22:14:54.983713] [DEBUG] [VALIDATOR ] ZBH: Primary data validation passed. [2025-09-26T22:14:54.985122] [INFO ] [MAIN ] ZBH: Fetched primary data is valid. [2025-09-26T22:14:54.985218] [DEBUG] [LOCAL ] ZBH: Saving primary data. [2025-09-26T22:14:54.987014] [DEBUG] [LOCAL ] ZBH: Trimmed 73868 records to 51948 (keeping 200 days of data) [2025-09-26T22:14:55.320274] [DEBUG] [LOCAL ] ZBH: Primary data saved (51948 records). [2025-09-26T22:14:55.320492] [INFO ] [MAIN ] ZBH: Full history saved. [2025-09-26T22:14:55.320668] [INFO ] [MAIN ] Update Progress: 2359/2371 symbols completed. ZBH took 35.0s. Estimated remaining: 1m 36s. Rate: 7.5 symbols/min [2025-09-26T22:14:57.290104] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-06 (2.54 seconds). [2025-09-26T22:14:57.301370] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-07. [2025-09-26T22:14:59.822040] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-09-26T22:14:59.835406] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-08. [2025-09-26T22:15:02.482260] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-08 (2.65 seconds). [2025-09-26T22:15:02.494617] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-09. [2025-09-26T22:15:04.913461] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-09-26T22:15:04.924173] [INFO ] [REMOTE ] ZETA: Full fetch complete (77678 records). [2025-09-26T22:15:04.924333] [DEBUG] [VALIDATOR ] ZETA: Validating primary data. [2025-09-26T22:15:05.349778] [DEBUG] [VALIDATOR ] ZETA: All expected trading days are present. [2025-09-26T22:15:05.349888] [DEBUG] [VALIDATOR ] ZETA: Primary data validation passed. [2025-09-26T22:15:05.351359] [INFO ] [MAIN ] ZETA: Fetched primary data is valid. [2025-09-26T22:15:05.351431] [DEBUG] [LOCAL ] ZETA: Saving primary data. [2025-09-26T22:15:05.353450] [DEBUG] [LOCAL ] ZETA: Trimmed 77678 records to 54375 (keeping 200 days of data) [2025-09-26T22:15:05.691537] [DEBUG] [LOCAL ] ZETA: Primary data saved (54375 records). [2025-09-26T22:15:05.691734] [INFO ] [MAIN ] ZETA: Full history saved. [2025-09-26T22:15:05.691850] [INFO ] [MAIN ] Update Progress: 2360/2371 symbols completed. ZETA took 27.4s. Estimated remaining: 1m 28s. Rate: 7.5 symbols/min [2025-09-26T22:15:06.298141] [INFO ] [MAIN ] ZIM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:15:06.341118] [INFO ] [MAIN ] ZH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:15:06.448706] [INFO ] [MAIN ] ZGN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:15:06.480011] [INFO ] [MAIN ] ZIP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:15:06.508504] [DEBUG] [LOCAL ] ZH: Loaded 27089 existing records from primary storage. [2025-09-26T22:15:06.508770] [INFO ] [MAIN ] ZH: Loaded 27089 existing records. [2025-09-26T22:15:06.722945] [DEBUG] [LOCAL ] ZIP: Loaded 44679 existing records from primary storage. [2025-09-26T22:15:06.745797] [INFO ] [MAIN ] ZIP: Loaded 44679 existing records. [2025-09-26T22:15:06.827865] [WARN ] [MAIN ] ZH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:15:06.855338] [DEBUG] [LOCAL ] ZIM: Loaded 53915 existing records from primary storage. [2025-09-26T22:15:06.861067] [INFO ] [MAIN ] ZIM: Loaded 53915 existing records. [2025-09-26T22:15:06.854332] [DEBUG] [LOCAL ] ZGN: Loaded 41076 existing records from primary storage. [2025-09-26T22:15:06.861330] [INFO ] [MAIN ] ZGN: Loaded 41076 existing records. [2025-09-26T22:15:06.913305] [INFO ] [MAIN ] ZH: Wiping existing primary data before full refresh. [2025-09-26T22:15:06.913557] [INFO ] [LOCAL ] ZH: Starting deletion of primary data. [2025-09-26T22:15:06.970614] [DEBUG] [LOCAL ] ZH: Deleted primary data file. [2025-09-26T22:15:07.139680] [INFO ] [MAIN ] ZH: Starting full primary refresh. [2025-09-26T22:15:07.531383] [WARN ] [MAIN ] ZIP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:15:07.557815] [WARN ] [MAIN ] ZGN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:15:07.534033] [WARN ] [MAIN ] ZIM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:15:07.577248] [INFO ] [MAIN ] ZIP: Wiping existing primary data before full refresh. [2025-09-26T22:15:07.577402] [INFO ] [LOCAL ] ZIP: Starting deletion of primary data. [2025-09-26T22:15:07.577892] [INFO ] [MAIN ] ZGN: Wiping existing primary data before full refresh. [2025-09-26T22:15:07.583902] [INFO ] [MAIN ] ZIM: Wiping existing primary data before full refresh. [2025-09-26T22:15:07.604933] [INFO ] [LOCAL ] ZIM: Starting deletion of primary data. [2025-09-26T22:15:07.594541] [INFO ] [LOCAL ] ZGN: Starting deletion of primary data. [2025-09-26T22:15:07.583987] [DEBUG] [LOCAL ] ZIP: Deleted primary data file. [2025-09-26T22:15:07.629083] [DEBUG] [LOCAL ] ZGN: Deleted primary data file. [2025-09-26T22:15:07.664138] [INFO ] [MAIN ] ZIP: Starting full primary refresh. [2025-09-26T22:15:07.667000] [DEBUG] [LOCAL ] ZIM: Deleted primary data file. [2025-09-26T22:15:07.675134] [INFO ] [MAIN ] ZGN: Starting full primary refresh. [2025-09-26T22:15:07.695012] [INFO ] [MAIN ] ZIM: Starting full primary refresh. [2025-09-26T22:15:08.376869] [INFO ] [REMOTE ] ZH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:15:08.451599] [INFO ] [REMOTE ] ZH: Fetching primary data for 2024-12. [2025-09-26T22:15:08.972193] [INFO ] [REMOTE ] ZIP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:15:09.010798] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2024-12. [2025-09-26T22:15:09.135617] [INFO ] [REMOTE ] ZIM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:15:09.136094] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2024-12. [2025-09-26T22:15:09.177389] [INFO ] [REMOTE ] ZGN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:15:09.177790] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2024-12. [2025-09-26T22:15:09.694285] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-26T22:15:09.699577] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-01. [2025-09-26T22:15:10.514482] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-26T22:15:10.525572] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-01. [2025-09-26T22:15:10.693540] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-26T22:15:10.698930] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-02. [2025-09-26T22:15:10.723706] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-26T22:15:10.732810] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-01. [2025-09-26T22:15:11.449316] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-26T22:15:11.462081] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-01. [2025-09-26T22:15:11.485030] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-26T22:15:11.492603] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-02. [2025-09-26T22:15:12.176135] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-26T22:15:12.185774] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-02. [2025-09-26T22:15:12.340085] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-26T22:15:12.348856] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-03. [2025-09-26T22:15:12.799726] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-26T22:15:12.807172] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-03. [2025-09-26T22:15:13.489338] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-26T22:15:13.501061] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-02. [2025-09-26T22:15:13.524178] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-26T22:15:13.532736] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-03. [2025-09-26T22:15:13.561013] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-26T22:15:13.570581] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-04. [2025-09-26T22:15:14.502172] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-26T22:15:14.512747] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-04. [2025-09-26T22:15:14.956355] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-26T22:15:14.964049] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-05. [2025-09-26T22:15:15.026849] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-26T22:15:15.036835] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-04. [2025-09-26T22:15:15.545543] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-26T22:15:15.555957] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-03. [2025-09-26T22:15:16.220870] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-26T22:15:16.227491] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-06. [2025-09-26T22:15:16.369600] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-26T22:15:16.380332] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-05. [2025-09-26T22:15:16.458887] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-26T22:15:16.469147] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-05. [2025-09-26T22:15:17.315797] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-26T22:15:17.323123] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-07. [2025-09-26T22:15:17.858530] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-26T22:15:17.871129] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-04. [2025-09-26T22:15:17.959192] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T22:15:17.968237] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-06. [2025-09-26T22:15:18.060258] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-26T22:15:18.070490] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-06. [2025-09-26T22:15:18.648758] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-26T22:15:18.655497] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-08. [2025-09-26T22:15:19.526899] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-26T22:15:19.536347] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-07. [2025-09-26T22:15:19.659143] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-26T22:15:19.724931] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-26T22:15:19.829246] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-26T22:15:19.911735] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-05. [2025-09-26T22:15:20.711736] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-07. [2025-09-26T22:15:21.100828] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-26T22:15:21.511747] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-09. [2025-09-26T22:15:22.242944] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-26T22:15:22.316859] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-06. [2025-09-26T22:15:22.334024] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-26T22:15:22.399569] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-26T22:15:22.405801] [INFO ] [REMOTE ] ZH: Full fetch complete (40161 records). [2025-09-26T22:15:22.405919] [DEBUG] [VALIDATOR ] ZH: Validating primary data. [2025-09-26T22:15:22.826942] [DEBUG] [VALIDATOR ] ZH: All expected trading days are present. [2025-09-26T22:15:22.827044] [DEBUG] [VALIDATOR ] ZH: Primary data validation passed. [2025-09-26T22:15:22.827956] [INFO ] [MAIN ] ZH: Fetched primary data is valid. [2025-09-26T22:15:22.828041] [DEBUG] [LOCAL ] ZH: Saving primary data. [2025-09-26T22:15:22.829249] [DEBUG] [LOCAL ] ZH: Trimmed 40161 records to 27298 (keeping 200 days of data) [2025-09-26T22:15:22.990499] [DEBUG] [LOCAL ] ZH: Primary data saved (27298 records). [2025-09-26T22:15:22.990691] [INFO ] [MAIN ] ZH: Full history saved. [2025-09-26T22:15:22.990836] [INFO ] [MAIN ] Update Progress: 2361/2371 symbols completed. ZH took 17.3s. Estimated remaining: 1m 20s. Rate: 7.5 symbols/min [2025-09-26T22:15:23.116819] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-08. [2025-09-26T22:15:23.176048] [INFO ] [MAIN ] ZK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:15:23.219250] [DEBUG] [LOCAL ] ZK: Loaded 40293 existing records from primary storage. [2025-09-26T22:15:23.219448] [INFO ] [MAIN ] ZK: Loaded 40293 existing records. [2025-09-26T22:15:23.428662] [WARN ] [MAIN ] ZK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:15:23.429065] [INFO ] [MAIN ] ZK: Wiping existing primary data before full refresh. [2025-09-26T22:15:23.429157] [INFO ] [LOCAL ] ZK: Starting deletion of primary data. [2025-09-26T22:15:23.432111] [DEBUG] [LOCAL ] ZK: Deleted primary data file. [2025-09-26T22:15:23.432178] [INFO ] [MAIN ] ZK: Starting full primary refresh. [2025-09-26T22:15:23.847465] [INFO ] [REMOTE ] ZK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:15:23.911732] [INFO ] [REMOTE ] ZK: Fetching primary data for 2024-12. [2025-09-26T22:15:24.589589] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-09-26T22:15:24.646995] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-26T22:15:24.711707] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-09. [2025-09-26T22:15:25.517343] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-08. [2025-09-26T22:15:25.522878] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-26T22:15:26.140336] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-26T22:15:26.148710] [INFO ] [REMOTE ] ZGN: Full fetch complete (58201 records). [2025-09-26T22:15:26.148868] [DEBUG] [VALIDATOR ] ZGN: Validating primary data. [2025-09-26T22:15:26.316797] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-07. [2025-09-26T22:15:26.578534] [DEBUG] [VALIDATOR ] ZGN: All expected trading days are present. [2025-09-26T22:15:26.578681] [DEBUG] [VALIDATOR ] ZGN: Primary data validation passed. [2025-09-26T22:15:26.579866] [INFO ] [MAIN ] ZGN: Fetched primary data is valid. [2025-09-26T22:15:26.579937] [DEBUG] [LOCAL ] ZGN: Saving primary data. [2025-09-26T22:15:26.581462] [DEBUG] [LOCAL ] ZGN: Trimmed 58201 records to 41333 (keeping 200 days of data) [2025-09-26T22:15:26.842326] [DEBUG] [LOCAL ] ZGN: Primary data saved (41333 records). [2025-09-26T22:15:26.842514] [INFO ] [MAIN ] ZGN: Full history saved. [2025-09-26T22:15:26.842697] [INFO ] [MAIN ] Update Progress: 2362/2371 symbols completed. ZGN took 21.2s. Estimated remaining: 1m 12s. Rate: 7.5 symbols/min [2025-09-26T22:15:27.032785] [INFO ] [MAIN ] ZKH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:15:27.044880] [DEBUG] [LOCAL ] ZKH: Loaded 8074 existing records from primary storage. [2025-09-26T22:15:27.045023] [INFO ] [MAIN ] ZKH: Loaded 8074 existing records. [2025-09-26T22:15:27.115546] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-01. [2025-09-26T22:15:27.267696] [WARN ] [MAIN ] ZKH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:15:27.281786] [INFO ] [MAIN ] ZKH: Wiping existing primary data before full refresh. [2025-09-26T22:15:27.283314] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-26T22:15:27.283433] [INFO ] [LOCAL ] ZKH: Starting deletion of primary data. [2025-09-26T22:15:27.294332] [DEBUG] [LOCAL ] ZKH: Deleted primary data file. [2025-09-26T22:15:27.294418] [INFO ] [MAIN ] ZKH: Starting full primary refresh. [2025-09-26T22:15:27.706873] [INFO ] [REMOTE ] ZKH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:15:27.911717] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2024-12. [2025-09-26T22:15:28.697428] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-26T22:15:28.702638] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-26T22:15:28.711711] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-09. [2025-09-26T22:15:28.785895] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-09-26T22:15:29.511792] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-02. [2025-09-26T22:15:30.154544] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-26T22:15:30.162711] [INFO ] [REMOTE ] ZIP: Full fetch complete (59430 records). [2025-09-26T22:15:30.162887] [DEBUG] [VALIDATOR ] ZIP: Validating primary data. [2025-09-26T22:15:30.316833] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-01. [2025-09-26T22:15:30.582426] [DEBUG] [VALIDATOR ] ZIP: All expected trading days are present. [2025-09-26T22:15:30.582578] [DEBUG] [VALIDATOR ] ZIP: Primary data validation passed. [2025-09-26T22:15:30.583914] [INFO ] [MAIN ] ZIP: Fetched primary data is valid. [2025-09-26T22:15:30.584021] [DEBUG] [LOCAL ] ZIP: Saving primary data. [2025-09-26T22:15:30.585949] [DEBUG] [LOCAL ] ZIP: Trimmed 59430 records to 44952 (keeping 200 days of data) [2025-09-26T22:15:30.691437] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-26T22:15:30.887829] [DEBUG] [LOCAL ] ZIP: Primary data saved (44952 records). [2025-09-26T22:15:30.887984] [INFO ] [MAIN ] ZIP: Full history saved. [2025-09-26T22:15:30.888081] [INFO ] [MAIN ] Update Progress: 2363/2371 symbols completed. ZIP took 25.2s. Estimated remaining: 1m 4s. Rate: 7.5 symbols/min [2025-09-26T22:15:31.079268] [INFO ] [MAIN ] ZTO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:15:31.111990] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-03. [2025-09-26T22:15:31.129134] [DEBUG] [LOCAL ] ZTO: Loaded 50367 existing records from primary storage. [2025-09-26T22:15:31.129288] [INFO ] [MAIN ] ZTO: Loaded 50367 existing records. [2025-09-26T22:15:31.264403] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-26T22:15:31.359743] [WARN ] [MAIN ] ZTO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:15:31.360113] [INFO ] [MAIN ] ZTO: Wiping existing primary data before full refresh. [2025-09-26T22:15:31.360187] [INFO ] [LOCAL ] ZTO: Starting deletion of primary data. [2025-09-26T22:15:31.362606] [DEBUG] [LOCAL ] ZTO: Deleted primary data file. [2025-09-26T22:15:31.362720] [INFO ] [MAIN ] ZTO: Starting full primary refresh. [2025-09-26T22:15:31.761929] [INFO ] [REMOTE ] ZTO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:15:31.911745] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2024-12. [2025-09-26T22:15:32.711736] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-02. [2025-09-26T22:15:32.964469] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-26T22:15:33.490404] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-26T22:15:33.511712] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-03. [2025-09-26T22:15:33.737468] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-26T22:15:34.261938] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-26T22:15:34.311757] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-04. [2025-09-26T22:15:34.696879] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-26T22:15:35.111728] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-01. [2025-09-26T22:15:35.911724] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-04. [2025-09-26T22:15:36.711746] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-08. [2025-09-26T22:15:36.907413] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-26T22:15:37.223177] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-26T22:15:37.511731] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-05. [2025-09-26T22:15:38.096293] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-26T22:15:38.311732] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-06. [2025-09-26T22:15:38.873891] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-26T22:15:38.937237] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-26T22:15:39.111732] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-07. [2025-09-26T22:15:39.911721] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-02. [2025-09-26T22:15:40.084450] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-26T22:15:40.711731] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-08. [2025-09-26T22:15:41.511765] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-09. [2025-09-26T22:15:41.548862] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-26T22:15:41.908012] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-26T22:15:42.311735] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-09. [2025-09-26T22:15:43.095019] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-26T22:15:43.097285] [INFO ] [REMOTE ] ZKH: Full fetch complete (11956 records). [2025-09-26T22:15:43.097368] [DEBUG] [VALIDATOR ] ZKH: Validating primary data. [2025-09-26T22:15:43.121241] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-05. [2025-09-26T22:15:43.523357] [DEBUG] [VALIDATOR ] ZKH: All expected trading days are present. [2025-09-26T22:15:43.523468] [DEBUG] [VALIDATOR ] ZKH: Primary data validation passed. [2025-09-26T22:15:43.523924] [INFO ] [MAIN ] ZKH: Fetched primary data is valid. [2025-09-26T22:15:43.524046] [DEBUG] [LOCAL ] ZKH: Saving primary data. [2025-09-26T22:15:43.525015] [DEBUG] [LOCAL ] ZKH: Trimmed 11956 records to 8119 (keeping 200 days of data) [2025-09-26T22:15:43.572717] [DEBUG] [LOCAL ] ZKH: Primary data saved (8119 records). [2025-09-26T22:15:43.572924] [INFO ] [MAIN ] ZKH: Full history saved. [2025-09-26T22:15:43.573029] [INFO ] [MAIN ] Update Progress: 2364/2371 symbols completed. ZKH took 16.7s. Estimated remaining: 56.1s. Rate: 7.5 symbols/min [2025-09-26T22:15:43.779344] [INFO ] [MAIN ] ZTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:15:43.814812] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-09-26T22:15:43.831054] [INFO ] [REMOTE ] ZIM: Full fetch complete (77499 records). [2025-09-26T22:15:43.831360] [DEBUG] [VALIDATOR ] ZIM: Validating primary data. [2025-09-26T22:15:43.924254] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-03. [2025-09-26T22:15:43.919038] [DEBUG] [LOCAL ] ZTR: Loaded 16787 existing records from primary storage. [2025-09-26T22:15:43.949153] [INFO ] [MAIN ] ZTR: Loaded 16787 existing records. [2025-09-26T22:15:44.385027] [WARN ] [MAIN ] ZTR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:15:44.389712] [INFO ] [MAIN ] ZTR: Wiping existing primary data before full refresh. [2025-09-26T22:15:44.390293] [INFO ] [LOCAL ] ZTR: Starting deletion of primary data. [2025-09-26T22:15:44.452603] [DEBUG] [LOCAL ] ZTR: Deleted primary data file. [2025-09-26T22:15:44.457079] [INFO ] [MAIN ] ZTR: Starting full primary refresh. [2025-09-26T22:15:44.550403] [DEBUG] [VALIDATOR ] ZIM: All expected trading days are present. [2025-09-26T22:15:44.578203] [DEBUG] [VALIDATOR ] ZIM: Primary data validation passed. [2025-09-26T22:15:44.606249] [INFO ] [MAIN ] ZIM: Fetched primary data is valid. [2025-09-26T22:15:44.619253] [DEBUG] [LOCAL ] ZIM: Saving primary data. [2025-09-26T22:15:44.642431] [DEBUG] [LOCAL ] ZIM: Trimmed 77499 records to 54298 (keeping 200 days of data) [2025-09-26T22:15:44.953470] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-26T22:15:45.020102] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-06. [2025-09-26T22:15:45.101399] [INFO ] [REMOTE ] ZTR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:15:45.342446] [DEBUG] [LOCAL ] ZIM: Primary data saved (54298 records). [2025-09-26T22:15:45.342630] [INFO ] [MAIN ] ZIM: Full history saved. [2025-09-26T22:15:45.342767] [INFO ] [MAIN ] Update Progress: 2365/2371 symbols completed. ZIM took 39.6s. Estimated remaining: 48.1s. Rate: 7.5 symbols/min [2025-09-26T22:15:45.525124] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2024-12. [2025-09-26T22:15:45.529268] [INFO ] [MAIN ] ZTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:15:45.588473] [DEBUG] [LOCAL ] ZTS: Loaded 53392 existing records from primary storage. [2025-09-26T22:15:45.588693] [INFO ] [MAIN ] ZTS: Loaded 53392 existing records. [2025-09-26T22:15:45.781900] [WARN ] [MAIN ] ZTS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:15:45.782861] [INFO ] [MAIN ] ZTS: Wiping existing primary data before full refresh. [2025-09-26T22:15:45.782913] [INFO ] [LOCAL ] ZTS: Starting deletion of primary data. [2025-09-26T22:15:45.797517] [DEBUG] [LOCAL ] ZTS: Deleted primary data file. [2025-09-26T22:15:45.818850] [INFO ] [MAIN ] ZTS: Starting full primary refresh. [2025-09-26T22:15:45.910881] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-26T22:15:46.224281] [INFO ] [REMOTE ] ZTS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:15:46.311726] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2024-12. [2025-09-26T22:15:46.488773] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-26T22:15:46.525339] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-26T22:15:46.763317] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-26T22:15:47.111769] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-01. [2025-09-26T22:15:47.911714] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-07. [2025-09-26T22:15:48.371066] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-26T22:15:48.711753] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-04. [2025-09-26T22:15:49.222096] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-26T22:15:49.511765] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-02. [2025-09-26T22:15:50.215571] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-26T22:15:50.311726] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-05. [2025-09-26T22:15:50.624521] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-26T22:15:51.111772] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-01. [2025-09-26T22:15:51.693699] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-26T22:15:51.911705] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-08. [2025-09-26T22:15:52.029863] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-26T22:15:52.711731] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-02. [2025-09-26T22:15:53.026883] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-26T22:15:53.507810] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-26T22:15:53.517409] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-06. [2025-09-26T22:15:54.311757] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-03. [2025-09-26T22:15:55.111697] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-09. [2025-09-26T22:15:55.172130] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-26T22:15:55.214559] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-26T22:15:55.911722] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-04. [2025-09-26T22:15:56.684074] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-26T22:15:56.693906] [INFO ] [REMOTE ] ZK: Full fetch complete (57315 records). [2025-09-26T22:15:56.694198] [DEBUG] [VALIDATOR ] ZK: Validating primary data. [2025-09-26T22:15:56.718050] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-03. [2025-09-26T22:15:56.932891] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-26T22:15:57.184824] [DEBUG] [VALIDATOR ] ZK: All expected trading days are present. [2025-09-26T22:15:57.184933] [DEBUG] [VALIDATOR ] ZK: Primary data validation passed. [2025-09-26T22:15:57.186166] [INFO ] [MAIN ] ZK: Fetched primary data is valid. [2025-09-26T22:15:57.186259] [DEBUG] [LOCAL ] ZK: Saving primary data. [2025-09-26T22:15:57.189922] [DEBUG] [LOCAL ] ZK: Trimmed 57315 records to 40504 (keeping 200 days of data) [2025-09-26T22:15:57.443657] [DEBUG] [LOCAL ] ZK: Primary data saved (40504 records). [2025-09-26T22:15:57.443807] [INFO ] [MAIN ] ZK: Full history saved. [2025-09-26T22:15:57.443933] [INFO ] [MAIN ] Update Progress: 2366/2371 symbols completed. ZK took 34.5s. Estimated remaining: 40.1s. Rate: 7.5 symbols/min [2025-09-26T22:15:57.513037] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-07. [2025-09-26T22:15:57.677676] [INFO ] [MAIN ] ZVIA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:15:57.719359] [DEBUG] [LOCAL ] ZVIA: Loaded 35664 existing records from primary storage. [2025-09-26T22:15:57.719539] [INFO ] [MAIN ] ZVIA: Loaded 35664 existing records. [2025-09-26T22:15:57.863185] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-26T22:15:57.929771] [WARN ] [MAIN ] ZVIA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:15:57.930082] [INFO ] [MAIN ] ZVIA: Wiping existing primary data before full refresh. [2025-09-26T22:15:57.930131] [INFO ] [LOCAL ] ZVIA: Starting deletion of primary data. [2025-09-26T22:15:57.932065] [DEBUG] [LOCAL ] ZVIA: Deleted primary data file. [2025-09-26T22:15:57.932131] [INFO ] [MAIN ] ZVIA: Starting full primary refresh. [2025-09-26T22:15:58.316034] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-04. [2025-09-26T22:15:58.342886] [INFO ] [REMOTE ] ZVIA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:15:59.111738] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2024-12. [2025-09-26T22:15:59.338134] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-26T22:15:59.361954] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-26T22:15:59.911724] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-08. [2025-09-26T22:16:00.331536] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-26T22:16:00.711723] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-01. [2025-09-26T22:16:01.511734] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-05. [2025-09-26T22:16:01.762516] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-26T22:16:02.002343] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-26T22:16:02.311734] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-06. [2025-09-26T22:16:02.515992] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-26T22:16:03.111730] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-02. [2025-09-26T22:16:03.154831] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-26T22:16:03.911722] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-09. [2025-09-26T22:16:04.602358] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-26T22:16:04.711869] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-03. [2025-09-26T22:16:05.238075] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-26T22:16:05.247598] [INFO ] [REMOTE ] ZTO: Full fetch complete (73129 records). [2025-09-26T22:16:05.247797] [DEBUG] [VALIDATOR ] ZTO: Validating primary data. [2025-09-26T22:16:05.516850] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-07. [2025-09-26T22:16:05.684442] [DEBUG] [VALIDATOR ] ZTO: All expected trading days are present. [2025-09-26T22:16:05.684554] [DEBUG] [VALIDATOR ] ZTO: Primary data validation passed. [2025-09-26T22:16:05.685736] [INFO ] [MAIN ] ZTO: Fetched primary data is valid. [2025-09-26T22:16:05.685806] [DEBUG] [LOCAL ] ZTO: Saving primary data. [2025-09-26T22:16:05.687595] [DEBUG] [LOCAL ] ZTO: Trimmed 73129 records to 50751 (keeping 200 days of data) [2025-09-26T22:16:05.958258] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-26T22:16:06.073307] [DEBUG] [LOCAL ] ZTO: Primary data saved (50751 records). [2025-09-26T22:16:06.073512] [INFO ] [MAIN ] ZTO: Full history saved. [2025-09-26T22:16:06.073634] [INFO ] [MAIN ] Update Progress: 2367/2371 symbols completed. ZTO took 35.2s. Estimated remaining: 32.0s. Rate: 7.5 symbols/min [2025-09-26T22:16:06.311010] [INFO ] [MAIN ] ZWS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T22:16:06.311866] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-04. [2025-09-26T22:16:06.379930] [DEBUG] [LOCAL ] ZWS: Loaded 42806 existing records from primary storage. [2025-09-26T22:16:06.380344] [INFO ] [MAIN ] ZWS: Loaded 42806 existing records. [2025-09-26T22:16:06.560172] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-26T22:16:06.646894] [WARN ] [MAIN ] ZWS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T22:16:06.647181] [INFO ] [MAIN ] ZWS: Wiping existing primary data before full refresh. [2025-09-26T22:16:06.647232] [INFO ] [LOCAL ] ZWS: Starting deletion of primary data. [2025-09-26T22:16:06.649204] [DEBUG] [LOCAL ] ZWS: Deleted primary data file. [2025-09-26T22:16:06.649268] [INFO ] [MAIN ] ZWS: Starting full primary refresh. [2025-09-26T22:16:07.031936] [INFO ] [REMOTE ] ZWS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T22:16:07.111715] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2024-12. [2025-09-26T22:16:07.651893] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-26T22:16:07.911733] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-08. [2025-09-26T22:16:08.637235] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-26T22:16:08.711727] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-01. [2025-09-26T22:16:08.765451] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-26T22:16:09.511733] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-05. [2025-09-26T22:16:10.270496] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-26T22:16:10.304100] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-26T22:16:10.311665] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-06. [2025-09-26T22:16:11.111720] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-02. [2025-09-26T22:16:11.420081] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-26T22:16:11.911733] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-07. [2025-09-26T22:16:12.688037] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-26T22:16:12.711705] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-09. [2025-09-26T22:16:13.023877] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-26T22:16:13.509971] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-26T22:16:13.520082] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-03. [2025-09-26T22:16:13.523243] [INFO ] [REMOTE ] ZTS: Full fetch complete (76689 records). [2025-09-26T22:16:13.523380] [DEBUG] [VALIDATOR ] ZTS: Validating primary data. [2025-09-26T22:16:13.944937] [DEBUG] [VALIDATOR ] ZTS: All expected trading days are present. [2025-09-26T22:16:13.945035] [DEBUG] [VALIDATOR ] ZTS: Primary data validation passed. [2025-09-26T22:16:13.946259] [INFO ] [MAIN ] ZTS: Fetched primary data is valid. [2025-09-26T22:16:13.946335] [DEBUG] [LOCAL ] ZTS: Saving primary data. [2025-09-26T22:16:13.948126] [DEBUG] [LOCAL ] ZTS: Trimmed 76689 records to 53775 (keeping 200 days of data) [2025-09-26T22:16:14.311932] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-05. [2025-09-26T22:16:14.325089] [DEBUG] [LOCAL ] ZTS: Primary data saved (53775 records). [2025-09-26T22:16:14.325299] [INFO ] [MAIN ] ZTS: Full history saved. [2025-09-26T22:16:14.325410] [INFO ] [MAIN ] Update Progress: 2368/2371 symbols completed. ZTS took 29.0s. Estimated remaining: 24.0s. Rate: 7.5 symbols/min [2025-09-26T22:16:15.111743] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-08. [2025-09-26T22:16:15.170956] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-26T22:16:15.859722] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-26T22:16:15.911729] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-04. [2025-09-26T22:16:16.307168] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-26T22:16:16.711788] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-09. [2025-09-26T22:16:17.511738] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-06. [2025-09-26T22:16:17.602132] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-26T22:16:17.605768] [INFO ] [REMOTE ] ZTR: Full fetch complete (26829 records). [2025-09-26T22:16:17.605902] [DEBUG] [VALIDATOR ] ZTR: Validating primary data. [2025-09-26T22:16:18.009434] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-26T22:16:18.103863] [DEBUG] [VALIDATOR ] ZTR: All expected trading days are present. [2025-09-26T22:16:18.103959] [DEBUG] [VALIDATOR ] ZTR: Primary data validation passed. [2025-09-26T22:16:18.104716] [INFO ] [MAIN ] ZTR: Fetched primary data is valid. [2025-09-26T22:16:18.104808] [DEBUG] [LOCAL ] ZTR: Saving primary data. [2025-09-26T22:16:18.108256] [DEBUG] [LOCAL ] ZTR: Trimmed 26829 records to 16911 (keeping 200 days of data) [2025-09-26T22:16:18.228074] [DEBUG] [LOCAL ] ZTR: Primary data saved (16911 records). [2025-09-26T22:16:18.228234] [INFO ] [MAIN ] ZTR: Full history saved. [2025-09-26T22:16:18.228466] [INFO ] [MAIN ] Update Progress: 2369/2371 symbols completed. ZTR took 34.7s. Estimated remaining: 16.0s. Rate: 7.5 symbols/min [2025-09-26T22:16:18.311790] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-05. [2025-09-26T22:16:18.950670] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-26T22:16:19.111768] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-07. [2025-09-26T22:16:19.697141] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-26T22:16:19.911734] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-06. [2025-09-26T22:16:20.642616] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-26T22:16:20.711728] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-08. [2025-09-26T22:16:21.423005] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-26T22:16:21.511755] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-07. [2025-09-26T22:16:22.166532] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-26T22:16:22.311744] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-09. [2025-09-26T22:16:23.153729] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-26T22:16:23.165270] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-08. [2025-09-26T22:16:23.792982] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-26T22:16:23.802212] [INFO ] [REMOTE ] ZVIA: Full fetch complete (52574 records). [2025-09-26T22:16:23.802459] [DEBUG] [VALIDATOR ] ZVIA: Validating primary data. [2025-09-26T22:16:24.247890] [DEBUG] [VALIDATOR ] ZVIA: All expected trading days are present. [2025-09-26T22:16:24.248184] [DEBUG] [VALIDATOR ] ZVIA: Primary data validation passed. [2025-09-26T22:16:24.249564] [INFO ] [MAIN ] ZVIA: Fetched primary data is valid. [2025-09-26T22:16:24.249696] [DEBUG] [LOCAL ] ZVIA: Saving primary data. [2025-09-26T22:16:24.251390] [DEBUG] [LOCAL ] ZVIA: Trimmed 52574 records to 35966 (keeping 200 days of data) [2025-09-26T22:16:24.452805] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-26T22:16:24.497347] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-09. [2025-09-26T22:16:24.528331] [DEBUG] [LOCAL ] ZVIA: Primary data saved (35966 records). [2025-09-26T22:16:24.528490] [INFO ] [MAIN ] ZVIA: Full history saved. [2025-09-26T22:16:24.528616] [INFO ] [MAIN ] Update Progress: 2370/2371 symbols completed. ZVIA took 27.1s. Estimated remaining: 8.0s. Rate: 7.5 symbols/min [2025-09-26T22:16:26.044882] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-26T22:16:26.054084] [INFO ] [REMOTE ] ZWS: Full fetch complete (62032 records). [2025-09-26T22:16:26.054311] [DEBUG] [VALIDATOR ] ZWS: Validating primary data. [2025-09-26T22:16:26.480471] [DEBUG] [VALIDATOR ] ZWS: All expected trading days are present. [2025-09-26T22:16:26.480841] [DEBUG] [VALIDATOR ] ZWS: Primary data validation passed. [2025-09-26T22:16:26.481946] [INFO ] [MAIN ] ZWS: Fetched primary data is valid. [2025-09-26T22:16:26.482013] [DEBUG] [LOCAL ] ZWS: Saving primary data. [2025-09-26T22:16:26.484704] [DEBUG] [LOCAL ] ZWS: Trimmed 62032 records to 43134 (keeping 200 days of data) [2025-09-26T22:16:26.778253] [DEBUG] [LOCAL ] ZWS: Primary data saved (43134 records). [2025-09-26T22:16:26.778406] [INFO ] [MAIN ] ZWS: Full history saved. [2025-09-26T22:16:26.778527] [INFO ] [MAIN ] Update Progress: 2371/2371 symbols completed. ZWS took 20.7s. Estimated remaining: 0.0s. Rate: 7.5 symbols/min [2025-09-26T22:16:26.785575] [INFO ] [MAIN ] Parallel update completed in 5h 16m 24s [2025-09-26T22:16:26.785845] [WARN ] [MAIN ] Failed symbols (297): AAM, AAMI, AAUC, AAT, ABT, ABR, ACCO, ACHR, AD, AEM... [2025-09-26T22:16:26.785960] [INFO ] [MAIN ] Update success rate: 87.5% (2074/2371 symbols) [2025-09-26T22:16:27.590747] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Primary Update Completed (2074/2371 @ 87.47%)' [2025-09-26T22:16:27.592364] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-09-26T22:16:27.592836] [INFO ] [STATE ] Last completion updated: 2025-09-26T22:16:27.592451 [2025-09-26T22:16:27.593119] [WARN ] [STATE ] State set to: RUNNING [2025-09-26T22:16:27.593194] [INFO ] [MAIN ] Running derivative generation in parallel mode [2025-09-26T22:16:27.593359] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-09-26T22:16:27.593421] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-09-26T22:16:27.595354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMC.csv [2025-09-26T22:16:27.595675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FF.csv [2025-09-26T22:16:27.595922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLOW.csv [2025-09-26T22:16:27.596183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTN.csv [2025-09-26T22:16:27.596493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBR.csv [2025-09-26T22:16:27.596864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TX.csv [2025-09-26T22:16:27.597126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTZ.csv [2025-09-26T22:16:27.597361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSF.csv [2025-09-26T22:16:27.597717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTZ.csv [2025-09-26T22:16:27.598143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERO.csv [2025-09-26T22:16:27.598401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPP.csv [2025-09-26T22:16:27.598694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBDC.csv [2025-09-26T22:16:27.599013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLL.csv [2025-09-26T22:16:27.599348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HII.csv [2025-09-26T22:16:27.599664] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MX.csv [2025-09-26T22:16:27.599933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSI.csv [2025-09-26T22:16:27.600256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGD.csv [2025-09-26T22:16:27.600512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMWL.csv [2025-09-26T22:16:27.600952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDST.csv [2025-09-26T22:16:27.601236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEN.csv [2025-09-26T22:16:27.601530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGO.csv [2025-09-26T22:16:27.601804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRK.csv [2025-09-26T22:16:27.602081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRL.csv [2025-09-26T22:16:27.602371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXYZ.csv [2025-09-26T22:16:27.602625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPFD.csv [2025-09-26T22:16:27.602975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMX.csv [2025-09-26T22:16:27.603279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BV.csv [2025-09-26T22:16:27.603487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYN.csv [2025-09-26T22:16:27.603811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHE.csv [2025-09-26T22:16:27.604126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACV.csv [2025-09-26T22:16:27.604358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZC.csv [2025-09-26T22:16:27.604583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NABL.csv [2025-09-26T22:16:27.604929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SII.csv [2025-09-26T22:16:27.605180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCV.csv [2025-09-26T22:16:27.605456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIN.csv [2025-09-26T22:16:27.605827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNX.csv [2025-09-26T22:16:27.606117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TREX.csv [2025-09-26T22:16:27.606325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTST.csv [2025-09-26T22:16:27.606552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKM.csv [2025-09-26T22:16:27.606783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCF.csv [2025-09-26T22:16:27.607267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITC.csv [2025-09-26T22:16:27.607479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLGN.csv [2025-09-26T22:16:27.607775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRK.csv [2025-09-26T22:16:27.608094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGI.csv [2025-09-26T22:16:27.608339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEPU.csv [2025-09-26T22:16:27.608545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTB.csv [2025-09-26T22:16:27.609251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEN.csv [2025-09-26T22:16:27.609474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMS.csv [2025-09-26T22:16:27.609847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSV.csv [2025-09-26T22:16:27.610143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VKQ.csv [2025-09-26T22:16:27.610460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNNE.csv [2025-09-26T22:16:27.610774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVX.csv [2025-09-26T22:16:27.611043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLNK.csv [2025-09-26T22:16:27.611362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINV.csv [2025-09-26T22:16:27.611554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/S.csv [2025-09-26T22:16:27.611883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSS.csv [2025-09-26T22:16:27.612178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JELD.csv [2025-09-26T22:16:27.612419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JKS.csv [2025-09-26T22:16:27.612617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCA.csv [2025-09-26T22:16:27.613235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAT.csv [2025-09-26T22:16:27.613474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QUAD.csv [2025-09-26T22:16:27.613723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUR.csv [2025-09-26T22:16:27.613946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRMB.csv [2025-09-26T22:16:27.614218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTE.csv [2025-09-26T22:16:27.614518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPI.csv [2025-09-26T22:16:27.614864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAZ.csv [2025-09-26T22:16:27.615284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YPF.csv [2025-09-26T22:16:27.615737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTL.csv [2025-09-26T22:16:27.615931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UFI.csv [2025-09-26T22:16:27.616194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFC.csv [2025-09-26T22:16:27.616438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEO.csv [2025-09-26T22:16:27.616721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTHY.csv [2025-09-26T22:16:27.616961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPHR.csv [2025-09-26T22:16:27.617164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNW.csv [2025-09-26T22:16:27.617449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BP.csv [2025-09-26T22:16:27.617729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRC.csv [2025-09-26T22:16:27.618063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BB.csv [2025-09-26T22:16:27.618344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDOT.csv [2025-09-26T22:16:27.618607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVS.csv [2025-09-26T22:16:27.618932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVR.csv [2025-09-26T22:16:27.619130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNST.csv [2025-09-26T22:16:27.619406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OSCR.csv [2025-09-26T22:16:27.619622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVGS.csv [2025-09-26T22:16:27.619885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMF.csv [2025-09-26T22:16:27.620152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALL.csv [2025-09-26T22:16:27.620564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVB.csv [2025-09-26T22:16:27.620988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OR.csv [2025-09-26T22:16:27.621393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIPR.csv [2025-09-26T22:16:27.621682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMR.csv [2025-09-26T22:16:27.622006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVH.csv [2025-09-26T22:16:27.622248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLCO.csv [2025-09-26T22:16:27.622556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVI.csv [2025-09-26T22:16:27.622776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WY.csv [2025-09-26T22:16:27.623064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGLS.csv [2025-09-26T22:16:27.623551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TD.csv [2025-09-26T22:16:27.623847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAG.csv [2025-09-26T22:16:27.624055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMU.csv [2025-09-26T22:16:27.624448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUMN.csv [2025-09-26T22:16:27.624619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPFI.csv [2025-09-26T22:16:27.624934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGR.csv [2025-09-26T22:16:27.625325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGD.csv [2025-09-26T22:16:27.625580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHF.csv [2025-09-26T22:16:27.625833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBX.csv [2025-09-26T22:16:27.626067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENO.csv [2025-09-26T22:16:27.626332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPB.csv [2025-09-26T22:16:27.626609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DECK.csv [2025-09-26T22:16:27.626934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBC.csv [2025-09-26T22:16:27.627213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTY.csv [2025-09-26T22:16:27.627447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPG.csv [2025-09-26T22:16:27.627740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUZ.csv [2025-09-26T22:16:27.627992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRX.csv [2025-09-26T22:16:27.628258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIPO.csv [2025-09-26T22:16:27.628520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPI.csv [2025-09-26T22:16:27.628899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/H.csv [2025-09-26T22:16:27.629153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNQ.csv [2025-09-26T22:16:27.629410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAY.csv [2025-09-26T22:16:27.629744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEQ.csv [2025-09-26T22:16:27.630014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIT.csv [2025-09-26T22:16:27.630285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTRG.csv [2025-09-26T22:16:27.630468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGP.csv [2025-09-26T22:16:27.630755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPOR.csv [2025-09-26T22:16:27.631040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRH.csv [2025-09-26T22:16:27.631268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCPT.csv [2025-09-26T22:16:27.631471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFN.csv [2025-09-26T22:16:27.631717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAE.csv [2025-09-26T22:16:27.631971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOL.csv [2025-09-26T22:16:27.632197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYB.csv [2025-09-26T22:16:27.632442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNF.csv [2025-09-26T22:16:27.632987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOR.csv [2025-09-26T22:16:27.633448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IMAX.csv [2025-09-26T22:16:27.633734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZN.csv [2025-09-26T22:16:27.634023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WS.csv [2025-09-26T22:16:27.634276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAL.csv [2025-09-26T22:16:27.634538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLR.csv [2025-09-26T22:16:27.635151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BK.csv [2025-09-26T22:16:27.635415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIM.csv [2025-09-26T22:16:27.635712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCN.csv [2025-09-26T22:16:27.636000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNY.csv [2025-09-26T22:16:27.636457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLO.csv [2025-09-26T22:16:27.636708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVT.csv [2025-09-26T22:16:27.636948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOV.csv [2025-09-26T22:16:27.637378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPR.csv [2025-09-26T22:16:27.637596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KWR.csv [2025-09-26T22:16:27.637864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AORT.csv [2025-09-26T22:16:27.638149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWNB.csv [2025-09-26T22:16:27.638363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAN.csv [2025-09-26T22:16:27.638533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGN.csv [2025-09-26T22:16:27.638881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAPL.csv [2025-09-26T22:16:27.639076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USB.csv [2025-09-26T22:16:27.639352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGT.csv [2025-09-26T22:16:27.639583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLO.csv [2025-09-26T22:16:27.639929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCS.csv [2025-09-26T22:16:27.640351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YSG.csv [2025-09-26T22:16:27.640578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATO.csv [2025-09-26T22:16:27.640947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSL.csv [2025-09-26T22:16:27.641131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NREF.csv [2025-09-26T22:16:27.641357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFG.csv [2025-09-26T22:16:27.641586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNT.csv [2025-09-26T22:16:27.641847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIM.csv [2025-09-26T22:16:27.642049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRT.csv [2025-09-26T22:16:27.642394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAI.csv [2025-09-26T22:16:27.642878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMO.csv [2025-09-26T22:16:27.643025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRB.csv [2025-09-26T22:16:27.643242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTH.csv [2025-09-26T22:16:27.643459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRO.csv [2025-09-26T22:16:27.643706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCN.csv [2025-09-26T22:16:27.643934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFSI.csv [2025-09-26T22:16:27.644173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNG.csv [2025-09-26T22:16:27.644385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXU.csv [2025-09-26T22:16:27.644636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRGP.csv [2025-09-26T22:16:27.644982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMEZ.csv [2025-09-26T22:16:27.645218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHAL.csv [2025-09-26T22:16:27.645396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOB.csv [2025-09-26T22:16:27.645702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPER.csv [2025-09-26T22:16:27.645898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPH.csv [2025-09-26T22:16:27.646111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WST.csv [2025-09-26T22:16:27.646398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GL.csv [2025-09-26T22:16:27.646757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRS.csv [2025-09-26T22:16:27.646967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FR.csv [2025-09-26T22:16:27.647159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIM.csv [2025-09-26T22:16:27.647353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTR.csv [2025-09-26T22:16:27.647587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MD.csv [2025-09-26T22:16:27.647841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFJ.csv [2025-09-26T22:16:27.648081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHI.csv [2025-09-26T22:16:27.648513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHW.csv [2025-09-26T22:16:27.648744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKE.csv [2025-09-26T22:16:27.648943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPA.csv [2025-09-26T22:16:27.649205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEE.csv [2025-09-26T22:16:27.649544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTR.csv [2025-09-26T22:16:27.649784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFA.csv [2025-09-26T22:16:27.649990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNV.csv [2025-09-26T22:16:27.650262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNOW.csv [2025-09-26T22:16:27.650514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBZ.csv [2025-09-26T22:16:27.650771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPMC.csv [2025-09-26T22:16:27.651073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIO.csv [2025-09-26T22:16:27.651335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRI.csv [2025-09-26T22:16:27.651599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNY.csv [2025-09-26T22:16:27.651873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYT.csv [2025-09-26T22:16:27.652084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSD.csv [2025-09-26T22:16:27.652317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHC.csv [2025-09-26T22:16:27.652516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLB.csv [2025-09-26T22:16:27.652929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXC.csv [2025-09-26T22:16:27.653218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWLP.csv [2025-09-26T22:16:27.653410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNA.csv [2025-09-26T22:16:27.653853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFG.csv [2025-09-26T22:16:27.654055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NU.csv [2025-09-26T22:16:27.654247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXNM.csv [2025-09-26T22:16:27.654466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGI.csv [2025-09-26T22:16:27.654706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ULS.csv [2025-09-26T22:16:27.654918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNI.csv [2025-09-26T22:16:27.655131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFS.csv [2025-09-26T22:16:27.655762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BC.csv [2025-09-26T22:16:27.656103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSD.csv [2025-09-26T22:16:27.656343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSG.csv [2025-09-26T22:16:27.656612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYL.csv [2025-09-26T22:16:27.657062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIMB.csv [2025-09-26T22:16:27.657309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPS.csv [2025-09-26T22:16:27.657560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRK.csv [2025-09-26T22:16:27.657798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZ.csv [2025-09-26T22:16:27.658015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAC.csv [2025-09-26T22:16:27.658242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HI.csv [2025-09-26T22:16:27.658461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSCI.csv [2025-09-26T22:16:27.658752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNG.csv [2025-09-26T22:16:27.658912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRD.csv [2025-09-26T22:16:27.659106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNN.csv [2025-09-26T22:16:27.659792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABEV.csv [2025-09-26T22:16:27.660048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAC.csv [2025-09-26T22:16:27.660460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRBR.csv [2025-09-26T22:16:27.660629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTO.csv [2025-09-26T22:16:27.660890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SF.csv [2025-09-26T22:16:27.661082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMI.csv [2025-09-26T22:16:27.661320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHN.csv [2025-09-26T22:16:27.661527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGZ.csv [2025-09-26T22:16:27.661739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAN.csv [2025-09-26T22:16:27.661962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMBT.csv [2025-09-26T22:16:27.662169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QD.csv [2025-09-26T22:16:27.662410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VICI.csv [2025-09-26T22:16:27.662614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACI.csv [2025-09-26T22:16:27.662921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHG.csv [2025-09-26T22:16:27.663094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRDY.csv [2025-09-26T22:16:27.663552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AX.csv [2025-09-26T22:16:27.663932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHK.csv [2025-09-26T22:16:27.664158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPC.csv [2025-09-26T22:16:27.664444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRX.csv [2025-09-26T22:16:27.664621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRC.csv [2025-09-26T22:16:27.664878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAM.csv [2025-09-26T22:16:27.665114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBER.csv [2025-09-26T22:16:27.665368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEO.csv [2025-09-26T22:16:27.665576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RXO.csv [2025-09-26T22:16:27.665798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AJG.csv [2025-09-26T22:16:27.666004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTN.csv [2025-09-26T22:16:27.666297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTT.csv [2025-09-26T22:16:27.666561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFB.csv [2025-09-26T22:16:27.667083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFLY.csv [2025-09-26T22:16:27.667271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBU.csv [2025-09-26T22:16:27.667511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHY.csv [2025-09-26T22:16:27.667773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITGR.csv [2025-09-26T22:16:27.667936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRV.csv [2025-09-26T22:16:27.668152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRC.csv [2025-09-26T22:16:27.668394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOR.csv [2025-09-26T22:16:27.668569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGL.csv [2025-09-26T22:16:27.668920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWT.csv [2025-09-26T22:16:27.669101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUS.csv [2025-09-26T22:16:27.669672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFZ.csv [2025-09-26T22:16:27.669838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WD.csv [2025-09-26T22:16:27.670060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEAV.csv [2025-09-26T22:16:27.670294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHN.csv [2025-09-26T22:16:27.670507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WK.csv [2025-09-26T22:16:27.670766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHWY.csv [2025-09-26T22:16:27.670992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMR.csv [2025-09-26T22:16:27.671176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLY.csv [2025-09-26T22:16:27.671402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGF.csv [2025-09-26T22:16:27.671589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEL.csv [2025-09-26T22:16:27.671872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRBK.csv [2025-09-26T22:16:27.672059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOLV.csv [2025-09-26T22:16:27.672256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIXT.csv [2025-09-26T22:16:27.672482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBRK.csv [2025-09-26T22:16:27.672821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOG.csv [2025-09-26T22:16:27.673027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COMP.csv [2025-09-26T22:16:27.673404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LRN.csv [2025-09-26T22:16:27.673593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGA.csv [2025-09-26T22:16:27.673901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXC.csv [2025-09-26T22:16:27.674373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUN.csv [2025-09-26T22:16:27.674589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHI.csv [2025-09-26T22:16:27.674879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEG.csv [2025-09-26T22:16:27.675117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMT.csv [2025-09-26T22:16:27.675343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LC.csv [2025-09-26T22:16:27.675538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ES.csv [2025-09-26T22:16:27.675886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BARK.csv [2025-09-26T22:16:27.676108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYTR.csv [2025-09-26T22:16:27.676359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHG.csv [2025-09-26T22:16:27.676570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OKE.csv [2025-09-26T22:16:27.676837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HESM.csv [2025-09-26T22:16:27.677093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XHR.csv [2025-09-26T22:16:27.677363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TROX.csv [2025-09-26T22:16:27.677580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNW.csv [2025-09-26T22:16:27.677908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDV.csv [2025-09-26T22:16:27.678155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BILL.csv [2025-09-26T22:16:27.678337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFD.csv [2025-09-26T22:16:27.678561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHX.csv [2025-09-26T22:16:27.678834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRBY.csv [2025-09-26T22:16:27.679037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REZI.csv [2025-09-26T22:16:27.679261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STC.csv [2025-09-26T22:16:27.679537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQI.csv [2025-09-26T22:16:27.679792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCI.csv [2025-09-26T22:16:27.680004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOC.csv [2025-09-26T22:16:27.680268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIC.csv [2025-09-26T22:16:27.680604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATGE.csv [2025-09-26T22:16:27.681273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPC.csv [2025-09-26T22:16:27.681554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALUR.csv [2025-09-26T22:16:27.681794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRI.csv [2025-09-26T22:16:27.682041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEE.csv [2025-09-26T22:16:27.682285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHK.csv [2025-09-26T22:16:27.682513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIMN.csv [2025-09-26T22:16:27.682710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLD.csv [2025-09-26T22:16:27.683024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKE.csv [2025-09-26T22:16:27.683235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLXR.csv [2025-09-26T22:16:27.683483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPM.csv [2025-09-26T22:16:27.683889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTS.csv [2025-09-26T22:16:27.684088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDI.csv [2025-09-26T22:16:27.684293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLI.csv [2025-09-26T22:16:27.684464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QSR.csv [2025-09-26T22:16:27.684721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSV.csv [2025-09-26T22:16:27.684937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAA.csv [2025-09-26T22:16:27.685190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THS.csv [2025-09-26T22:16:27.685410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDIV.csv [2025-09-26T22:16:27.685712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BALL.csv [2025-09-26T22:16:27.685947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IR.csv [2025-09-26T22:16:27.686123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODV.csv [2025-09-26T22:16:27.686564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDL.csv [2025-09-26T22:16:27.686812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVLG.csv [2025-09-26T22:16:27.686990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMI.csv [2025-09-26T22:16:27.687195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNF.csv [2025-09-26T22:16:27.687390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CW.csv [2025-09-26T22:16:27.687586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRDN.csv [2025-09-26T22:16:27.687917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYI.csv [2025-09-26T22:16:27.688144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACK.csv [2025-09-26T22:16:27.688318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMT.csv [2025-09-26T22:16:27.688486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLYM.csv [2025-09-26T22:16:27.688715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DINO.csv [2025-09-26T22:16:27.688952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAC.csv [2025-09-26T22:16:27.689105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMG.csv [2025-09-26T22:16:27.689309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AKR.csv [2025-09-26T22:16:27.689467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPG.csv [2025-09-26T22:16:27.689674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMM.csv [2025-09-26T22:16:27.689883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPH.csv [2025-09-26T22:16:27.690151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADT.csv [2025-09-26T22:16:27.690526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLDR.csv [2025-09-26T22:16:27.690848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIT.csv [2025-09-26T22:16:27.691128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTS.csv [2025-09-26T22:16:27.691393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBF.csv [2025-09-26T22:16:27.691630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARCO.csv [2025-09-26T22:16:27.691826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBHC.csv [2025-09-26T22:16:27.692039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHC.csv [2025-09-26T22:16:27.692461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SG.csv [2025-09-26T22:16:27.692626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPT.csv [2025-09-26T22:16:27.692817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THLV.csv [2025-09-26T22:16:27.693085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXTA.csv [2025-09-26T22:16:27.693245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MA.csv [2025-09-26T22:16:27.693486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APAM.csv [2025-09-26T22:16:27.693694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIRT.csv [2025-09-26T22:16:27.693880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAR.csv [2025-09-26T22:16:27.694105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIG.csv [2025-09-26T22:16:27.694301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTG.csv [2025-09-26T22:16:27.694504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BW.csv [2025-09-26T22:16:27.694786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRA.csv [2025-09-26T22:16:27.695026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MODG.csv [2025-09-26T22:16:27.695258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STK.csv [2025-09-26T22:16:27.695591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWZ.csv [2025-09-26T22:16:27.695890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATR.csv [2025-09-26T22:16:27.696083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFXT.csv [2025-09-26T22:16:27.696266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CF.csv [2025-09-26T22:16:27.696465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTBB.csv [2025-09-26T22:16:27.696669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GROV.csv [2025-09-26T22:16:27.696899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRGY.csv [2025-09-26T22:16:27.697080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLVT.csv [2025-09-26T22:16:27.697270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HHH.csv [2025-09-26T22:16:27.697565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTO.csv [2025-09-26T22:16:27.697765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEA.csv [2025-09-26T22:16:27.698036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUD.csv [2025-09-26T22:16:27.698263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRAK.csv [2025-09-26T22:16:27.698505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPG.csv [2025-09-26T22:16:27.698754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIG.csv [2025-09-26T22:16:27.698917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVV.csv [2025-09-26T22:16:27.699070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPC.csv [2025-09-26T22:16:27.699252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IH.csv [2025-09-26T22:16:27.699452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VZ.csv [2025-09-26T22:16:27.699611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTH.csv [2025-09-26T22:16:27.699876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUM.csv [2025-09-26T22:16:27.700068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTVA.csv [2025-09-26T22:16:27.700278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXT.csv [2025-09-26T22:16:27.700529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSTS.csv [2025-09-26T22:16:27.700806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESS.csv [2025-09-26T22:16:27.701090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALK.csv [2025-09-26T22:16:27.701295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FICO.csv [2025-09-26T22:16:27.701487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USA.csv [2025-09-26T22:16:27.701697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNC.csv [2025-09-26T22:16:27.702168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSB.csv [2025-09-26T22:16:27.702375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSCO.csv [2025-09-26T22:16:27.702589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KF.csv [2025-09-26T22:16:27.702838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVA.csv [2025-09-26T22:16:27.703055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPRU.csv [2025-09-26T22:16:27.703334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFN.csv [2025-09-26T22:16:27.703493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPB.csv [2025-09-26T22:16:27.703888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXK.csv [2025-09-26T22:16:27.704487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKKT.csv [2025-09-26T22:16:27.704847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHGG.csv [2025-09-26T22:16:27.705081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIS.csv [2025-09-26T22:16:27.705520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHOC.csv [2025-09-26T22:16:27.705762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBGS.csv [2025-09-26T22:16:27.706395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKV.csv [2025-09-26T22:16:27.706684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVD.csv [2025-09-26T22:16:27.706921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLC.csv [2025-09-26T22:16:27.707122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLQT.csv [2025-09-26T22:16:27.707352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVRR.csv [2025-09-26T22:16:27.707567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMB.csv [2025-09-26T22:16:27.707832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVNA.csv [2025-09-26T22:16:27.708016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGR.csv [2025-09-26T22:16:27.708221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBXG.csv [2025-09-26T22:16:27.708434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BZH.csv [2025-09-26T22:16:27.708623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRA.csv [2025-09-26T22:16:27.708822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPP.csv [2025-09-26T22:16:27.709014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGR.csv [2025-09-26T22:16:27.709236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEI.csv [2025-09-26T22:16:27.709465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KB.csv [2025-09-26T22:16:27.709723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGL.csv [2025-09-26T22:16:27.709904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUI.csv [2025-09-26T22:16:27.710078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAI.csv [2025-09-26T22:16:27.710235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CULP.csv [2025-09-26T22:16:27.710492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHEL.csv [2025-09-26T22:16:27.710732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNT.csv [2025-09-26T22:16:27.710949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WM.csv [2025-09-26T22:16:27.711205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDW.csv [2025-09-26T22:16:27.711391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COLD.csv [2025-09-26T22:16:27.712052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BJ.csv [2025-09-26T22:16:27.712220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THW.csv [2025-09-26T22:16:27.712405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNO.csv [2025-09-26T22:16:27.712613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXG.csv [2025-09-26T22:16:27.712864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COUR.csv [2025-09-26T22:16:27.713069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CP.csv [2025-09-26T22:16:27.713380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCK.csv [2025-09-26T22:16:27.713631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVT.csv [2025-09-26T22:16:27.713912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHR.csv [2025-09-26T22:16:27.714088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDN.csv [2025-09-26T22:16:27.714308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPRO.csv [2025-09-26T22:16:27.714517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSA.csv [2025-09-26T22:16:27.714764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHC.csv [2025-09-26T22:16:27.714993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTU.csv [2025-09-26T22:16:27.715150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLTO.csv [2025-09-26T22:16:27.715530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEI.csv [2025-09-26T22:16:27.715815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBM.csv [2025-09-26T22:16:27.716021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXR.csv [2025-09-26T22:16:27.716222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAT.csv [2025-09-26T22:16:27.716420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LION.csv [2025-09-26T22:16:27.716723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXC.csv [2025-09-26T22:16:27.716923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVX.csv [2025-09-26T22:16:27.717393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGR.csv [2025-09-26T22:16:27.717569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPOT.csv [2025-09-26T22:16:27.717877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEM.csv [2025-09-26T22:16:27.718185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWP.csv [2025-09-26T22:16:27.718408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLTY.csv [2025-09-26T22:16:27.718610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBAN.csv [2025-09-26T22:16:27.718825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RHI.csv [2025-09-26T22:16:27.719043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HXL.csv [2025-09-26T22:16:27.719220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHT.csv [2025-09-26T22:16:27.719461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQN.csv [2025-09-26T22:16:27.719619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROG.csv [2025-09-26T22:16:27.719902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VALE.csv [2025-09-26T22:16:27.720111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRM.csv [2025-09-26T22:16:27.720291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CION.csv [2025-09-26T22:16:27.720593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMS.csv [2025-09-26T22:16:27.720798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFR.csv [2025-09-26T22:16:27.720996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRT.csv [2025-09-26T22:16:27.721202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GENI.csv [2025-09-26T22:16:27.721362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VFC.csv [2025-09-26T22:16:27.721555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMFG.csv [2025-09-26T22:16:27.721784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECC.csv [2025-09-26T22:16:27.721979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGTY.csv [2025-09-26T22:16:27.722157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCI.csv [2025-09-26T22:16:27.722327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NJR.csv [2025-09-26T22:16:27.722484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CR.csv [2025-09-26T22:16:27.722751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENFY.csv [2025-09-26T22:16:27.722963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFI.csv [2025-09-26T22:16:27.723137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OC.csv [2025-09-26T22:16:27.723283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SM.csv [2025-09-26T22:16:27.723695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CB.csv [2025-09-26T22:16:27.723898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGG.csv [2025-09-26T22:16:27.724161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDT.csv [2025-09-26T22:16:27.724467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTM.csv [2025-09-26T22:16:27.724764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TJX.csv [2025-09-26T22:16:27.725029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMN.csv [2025-09-26T22:16:27.725222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYI.csv [2025-09-26T22:16:27.725382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOAH.csv [2025-09-26T22:16:27.725589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPR.csv [2025-09-26T22:16:27.725896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTG.csv [2025-09-26T22:16:27.726158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOS.csv [2025-09-26T22:16:27.726380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GETY.csv [2025-09-26T22:16:27.726793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKH.csv [2025-09-26T22:16:27.727008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRH.csv [2025-09-26T22:16:27.727167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HKD.csv [2025-09-26T22:16:27.727354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAB.csv [2025-09-26T22:16:27.727556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REVG.csv [2025-09-26T22:16:27.728040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SIG.csv [2025-09-26T22:16:27.728227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRT.csv [2025-09-26T22:16:27.728428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITUB.csv [2025-09-26T22:16:27.728676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HASI.csv [2025-09-26T22:16:27.728886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNS.csv [2025-09-26T22:16:27.729131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SILA.csv [2025-09-26T22:16:27.729315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIW.csv [2025-09-26T22:16:27.729473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NX.csv [2025-09-26T22:16:27.729633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGRE.csv [2025-09-26T22:16:27.730113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNC.csv [2025-09-26T22:16:27.730268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCDL.csv [2025-09-26T22:16:27.730498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HR.csv [2025-09-26T22:16:27.730733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRND.csv [2025-09-26T22:16:27.731000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCTS.csv [2025-09-26T22:16:27.731230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNX.csv [2025-09-26T22:16:27.731421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBX.csv [2025-09-26T22:16:27.731620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTEX.csv [2025-09-26T22:16:27.731837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AL.csv [2025-09-26T22:16:27.732024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEX.csv [2025-09-26T22:16:27.732172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NC.csv [2025-09-26T22:16:27.732342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNL.csv [2025-09-26T22:16:27.732497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VATE.csv [2025-09-26T22:16:27.732783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFS.csv [2025-09-26T22:16:27.732971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDS.csv [2025-09-26T22:16:27.733370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWK.csv [2025-09-26T22:16:27.733524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EARN.csv [2025-09-26T22:16:27.733753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNP.csv [2025-09-26T22:16:27.733896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRI.csv [2025-09-26T22:16:27.734102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOI.csv [2025-09-26T22:16:27.734264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSB.csv [2025-09-26T22:16:27.734444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FG.csv [2025-09-26T22:16:27.734578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKT.csv [2025-09-26T22:16:27.734763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVE.csv [2025-09-26T22:16:27.734934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNR.csv [2025-09-26T22:16:27.735110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUV.csv [2025-09-26T22:16:27.735274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RL.csv [2025-09-26T22:16:27.735531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXT.csv [2025-09-26T22:16:27.735907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLE.csv [2025-09-26T22:16:27.736074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHMI.csv [2025-09-26T22:16:27.736250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LW.csv [2025-09-26T22:16:27.736461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTWO.csv [2025-09-26T22:16:27.736808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/J.csv [2025-09-26T22:16:27.737139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAE.csv [2025-09-26T22:16:27.737348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXS.csv [2025-09-26T22:16:27.737496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONON.csv [2025-09-26T22:16:27.737806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFY.csv [2025-09-26T22:16:27.737992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSN.csv [2025-09-26T22:16:27.738186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLYS.csv [2025-09-26T22:16:27.738360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBRE.csv [2025-09-26T22:16:27.738533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWO.csv [2025-09-26T22:16:27.739005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFB.csv [2025-09-26T22:16:27.739182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSA.csv [2025-09-26T22:16:27.739365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDY.csv [2025-09-26T22:16:27.739553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLG.csv [2025-09-26T22:16:27.739747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIA.csv [2025-09-26T22:16:27.739903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNGR.csv [2025-09-26T22:16:27.740116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNET.csv [2025-09-26T22:16:27.740329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNL.csv [2025-09-26T22:16:27.740511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTB.csv [2025-09-26T22:16:27.740872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBI.csv [2025-09-26T22:16:27.741056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESAB.csv [2025-09-26T22:16:27.741213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SONY.csv [2025-09-26T22:16:27.741390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOC.csv [2025-09-26T22:16:27.741564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAC.csv [2025-09-26T22:16:27.741738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PD.csv [2025-09-26T22:16:27.741920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JXN.csv [2025-09-26T22:16:27.742258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOT.csv [2025-09-26T22:16:27.742456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDI.csv [2025-09-26T22:16:27.742688] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABM.csv [2025-09-26T22:16:27.742872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCUS.csv [2025-09-26T22:16:27.743044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNRC.csv [2025-09-26T22:16:27.743198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIY.csv [2025-09-26T22:16:27.743375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIA.csv [2025-09-26T22:16:27.743525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITP.csv [2025-09-26T22:16:27.743732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DG.csv [2025-09-26T22:16:27.743905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MANU.csv [2025-09-26T22:16:27.744108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHD.csv [2025-09-26T22:16:27.744257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXE.csv [2025-09-26T22:16:27.744458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELME.csv [2025-09-26T22:16:27.744621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIPS.csv [2025-09-26T22:16:27.744812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOL.csv [2025-09-26T22:16:27.744988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPO.csv [2025-09-26T22:16:27.745197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GD.csv [2025-09-26T22:16:27.745420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPYP.csv [2025-09-26T22:16:27.745573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRGV.csv [2025-09-26T22:16:27.745870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTF.csv [2025-09-26T22:16:27.746026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVRI.csv [2025-09-26T22:16:27.746195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDP.csv [2025-09-26T22:16:27.746351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RERE.csv [2025-09-26T22:16:27.746930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBU.csv [2025-09-26T22:16:27.747119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMO.csv [2025-09-26T22:16:27.747424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STNG.csv [2025-09-26T22:16:27.747639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHT.csv [2025-09-26T22:16:27.747874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAC.csv [2025-09-26T22:16:27.748080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VYX.csv [2025-09-26T22:16:27.748510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNI.csv [2025-09-26T22:16:27.748829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETO.csv [2025-09-26T22:16:27.749023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCO.csv [2025-09-26T22:16:27.749238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUK.csv [2025-09-26T22:16:27.749499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVS.csv [2025-09-26T22:16:27.749713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JFR.csv [2025-09-26T22:16:27.749867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RELX.csv [2025-09-26T22:16:27.750074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IEX.csv [2025-09-26T22:16:27.750256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MET.csv [2025-09-26T22:16:27.750450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLN.csv [2025-09-26T22:16:27.750624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBS.csv [2025-09-26T22:16:27.750815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQNS.csv [2025-09-26T22:16:27.751001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETN.csv [2025-09-26T22:16:27.751198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVYO.csv [2025-09-26T22:16:27.751398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVR.csv [2025-09-26T22:16:27.751568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMI.csv [2025-09-26T22:16:27.751806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECVT.csv [2025-09-26T22:16:27.752075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VET.csv [2025-09-26T22:16:27.752304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENIC.csv [2025-09-26T22:16:27.752511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBS.csv [2025-09-26T22:16:27.752788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTV.csv [2025-09-26T22:16:27.752988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STM.csv [2025-09-26T22:16:27.753204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CII.csv [2025-09-26T22:16:27.753382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALTG.csv [2025-09-26T22:16:27.753520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOCL.csv [2025-09-26T22:16:27.753787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBC.csv [2025-09-26T22:16:27.753967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSE.csv [2025-09-26T22:16:27.754473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIT.csv [2025-09-26T22:16:27.754752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAL.csv [2025-09-26T22:16:27.754957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHH.csv [2025-09-26T22:16:27.755111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXC.csv [2025-09-26T22:16:27.755301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUKB.csv [2025-09-26T22:16:27.755625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ED.csv [2025-09-26T22:16:27.755833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JGH.csv [2025-09-26T22:16:27.756017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMT.csv [2025-09-26T22:16:27.756172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RWT.csv [2025-09-26T22:16:27.756352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QGEN.csv [2025-09-26T22:16:27.756579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MC.csv [2025-09-26T22:16:27.756825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBTA.csv [2025-09-26T22:16:27.756985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWI.csv [2025-09-26T22:16:27.757170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAO.csv [2025-09-26T22:16:27.757361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UWMC.csv [2025-09-26T22:16:27.757575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFY.csv [2025-09-26T22:16:27.757786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEEV.csv [2025-09-26T22:16:27.757918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WES.csv [2025-09-26T22:16:27.758078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRS.csv [2025-09-26T22:16:27.758253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIPR.csv [2025-09-26T22:16:27.758415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDD.csv [2025-09-26T22:16:27.758631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YETI.csv [2025-09-26T22:16:27.758839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/U.csv [2025-09-26T22:16:27.759010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAC.csv [2025-09-26T22:16:27.759208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KR.csv [2025-09-26T22:16:27.759392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCE.csv [2025-09-26T22:16:27.759822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBRT.csv [2025-09-26T22:16:27.760046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALEX.csv [2025-09-26T22:16:27.760255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNP.csv [2025-09-26T22:16:27.760413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOW.csv [2025-09-26T22:16:27.760587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBP.csv [2025-09-26T22:16:27.760875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEN.csv [2025-09-26T22:16:27.761073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAA.csv [2025-09-26T22:16:27.761241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXRT.csv [2025-09-26T22:16:27.761812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKD.csv [2025-09-26T22:16:27.762007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUA.csv [2025-09-26T22:16:27.762184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JNJ.csv [2025-09-26T22:16:27.762355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGY.csv [2025-09-26T22:16:27.762544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LH.csv [2025-09-26T22:16:27.762728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGS.csv [2025-09-26T22:16:27.762926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOOT.csv [2025-09-26T22:16:27.763111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSTM.csv [2025-09-26T22:16:27.763267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUMP.csv [2025-09-26T22:16:27.763696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPH.csv [2025-09-26T22:16:27.763885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLX.csv [2025-09-26T22:16:27.764056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAC.csv [2025-09-26T22:16:27.764226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVO.csv [2025-09-26T22:16:27.764409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENVA.csv [2025-09-26T22:16:27.764591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAG.csv [2025-09-26T22:16:27.765141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWF.csv [2025-09-26T22:16:27.765351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYY.csv [2025-09-26T22:16:27.765597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVR.csv [2025-09-26T22:16:27.765788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDP.csv [2025-09-26T22:16:27.765948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAN.csv [2025-09-26T22:16:27.766226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMN.csv [2025-09-26T22:16:27.766470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZH.csv [2025-09-26T22:16:27.766629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMAI.csv [2025-09-26T22:16:27.766817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMP.csv [2025-09-26T22:16:27.767065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLF.csv [2025-09-26T22:16:27.767263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SD.csv [2025-09-26T22:16:27.767586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKLZ.csv [2025-09-26T22:16:27.767935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINS.csv [2025-09-26T22:16:27.768140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LANV.csv [2025-09-26T22:16:27.768332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALX.csv [2025-09-26T22:16:27.768512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBN.csv [2025-09-26T22:16:27.768727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFA.csv [2025-09-26T22:16:27.769005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDO.csv [2025-09-26T22:16:27.769180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYN.csv [2025-09-26T22:16:27.769407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKR.csv [2025-09-26T22:16:27.769609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURB.csv [2025-09-26T22:16:27.769943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HP.csv [2025-09-26T22:16:27.770124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCQ.csv [2025-09-26T22:16:27.770404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPR.csv [2025-09-26T22:16:27.770630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVT.csv [2025-09-26T22:16:27.770894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPJ.csv [2025-09-26T22:16:27.771092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDL.csv [2025-09-26T22:16:27.771298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRIM.csv [2025-09-26T22:16:27.771544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIC.csv [2025-09-26T22:16:27.771797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBH.csv [2025-09-26T22:16:27.772016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWK.csv [2025-09-26T22:16:27.772235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGP.csv [2025-09-26T22:16:27.772389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAM.csv [2025-09-26T22:16:27.773006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHC.csv [2025-09-26T22:16:27.773438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTI.csv [2025-09-26T22:16:27.773759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOLE.csv [2025-09-26T22:16:27.773953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHD.csv [2025-09-26T22:16:27.774163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMCM.csv [2025-09-26T22:16:27.774436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMO.csv [2025-09-26T22:16:27.774635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WWW.csv [2025-09-26T22:16:27.774902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AI.csv [2025-09-26T22:16:27.775109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIO.csv [2025-09-26T22:16:27.775510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USFD.csv [2025-09-26T22:16:27.775721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOV.csv [2025-09-26T22:16:27.775884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVO.csv [2025-09-26T22:16:27.776082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDP.csv [2025-09-26T22:16:27.776286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSDL.csv [2025-09-26T22:16:27.776454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIGS.csv [2025-09-26T22:16:27.776676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTW.csv [2025-09-26T22:16:27.776833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MG.csv [2025-09-26T22:16:27.776989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODC.csv [2025-09-26T22:16:27.777164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOBY.csv [2025-09-26T22:16:27.777351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKR.csv [2025-09-26T22:16:27.777547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONL.csv [2025-09-26T22:16:27.777712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRI.csv [2025-09-26T22:16:27.777867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNK.csv [2025-09-26T22:16:27.778009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/M.csv [2025-09-26T22:16:27.778184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGX.csv [2025-09-26T22:16:27.778373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIST.csv [2025-09-26T22:16:27.778583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMAX.csv [2025-09-26T22:16:27.778818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDC.csv [2025-09-26T22:16:27.778995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STE.csv [2025-09-26T22:16:27.779161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUPV.csv [2025-09-26T22:16:27.779405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAF.csv [2025-09-26T22:16:27.779697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAP.csv [2025-09-26T22:16:27.779913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPR.csv [2025-09-26T22:16:27.780148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LU.csv [2025-09-26T22:16:27.780754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPQ.csv [2025-09-26T22:16:27.780963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALV.csv [2025-09-26T22:16:27.781150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAXS.csv [2025-09-26T22:16:27.781302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMT.csv [2025-09-26T22:16:27.781525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEF.csv [2025-09-26T22:16:27.781812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVL.csv [2025-09-26T22:16:27.782142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBP.csv [2025-09-26T22:16:27.782320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGD.csv [2025-09-26T22:16:27.782518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LITB.csv [2025-09-26T22:16:27.782716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSKD.csv [2025-09-26T22:16:27.782953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UL.csv [2025-09-26T22:16:27.783191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXG.csv [2025-09-26T22:16:27.783377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATV.csv [2025-09-26T22:16:27.783573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOUR.csv [2025-09-26T22:16:27.783808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAZ.csv [2025-09-26T22:16:27.784050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBI.csv [2025-09-26T22:16:27.784334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUL.csv [2025-09-26T22:16:27.784578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLS.csv [2025-09-26T22:16:27.784790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELP.csv [2025-09-26T22:16:27.785009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DQ.csv [2025-09-26T22:16:27.785153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHG.csv [2025-09-26T22:16:27.785331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPNG.csv [2025-09-26T22:16:27.785505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NDMO.csv [2025-09-26T22:16:27.785817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZO.csv [2025-09-26T22:16:27.786099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COOK.csv [2025-09-26T22:16:27.786452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUMC.csv [2025-09-26T22:16:27.786602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSBD.csv [2025-09-26T22:16:27.786845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOC.csv [2025-09-26T22:16:27.787039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKO.csv [2025-09-26T22:16:27.787199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSC.csv [2025-09-26T22:16:27.787685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGHC.csv [2025-09-26T22:16:27.787844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTW.csv [2025-09-26T22:16:27.788007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMK.csv [2025-09-26T22:16:27.788251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SID.csv [2025-09-26T22:16:27.788442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFPM.csv [2025-09-26T22:16:27.788608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDF.csv [2025-09-26T22:16:27.788794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPIR.csv [2025-09-26T22:16:27.788958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOF.csv [2025-09-26T22:16:27.789099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GYLD.csv [2025-09-26T22:16:27.789243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NYT.csv [2025-09-26T22:16:27.789397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMM.csv [2025-09-26T22:16:27.789602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMP.csv [2025-09-26T22:16:27.789835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMO.csv [2025-09-26T22:16:27.789996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HE.csv [2025-09-26T22:16:27.790202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOD.csv [2025-09-26T22:16:27.790773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBW.csv [2025-09-26T22:16:27.790945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMO.csv [2025-09-26T22:16:27.791115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTRN.csv [2025-09-26T22:16:27.791264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WKC.csv [2025-09-26T22:16:27.791451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOF.csv [2025-09-26T22:16:27.791716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMT.csv [2025-09-26T22:16:27.791911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAL.csv [2025-09-26T22:16:27.792128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZVIA.csv [2025-09-26T22:16:27.792534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEVA.csv [2025-09-26T22:16:27.792717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOMD.csv [2025-09-26T22:16:27.792893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVS.csv [2025-09-26T22:16:27.793108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CL.csv [2025-09-26T22:16:27.793285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNF.csv [2025-09-26T22:16:27.793480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRW.csv [2025-09-26T22:16:27.793732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SST.csv [2025-09-26T22:16:27.793921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNCE.csv [2025-09-26T22:16:27.794099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNS.csv [2025-09-26T22:16:27.794283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUZ.csv [2025-09-26T22:16:27.794448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WT.csv [2025-09-26T22:16:27.794776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBI.csv [2025-09-26T22:16:27.794951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELAN.csv [2025-09-26T22:16:27.795117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMS.csv [2025-09-26T22:16:27.795288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOP.csv [2025-09-26T22:16:27.795501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CX.csv [2025-09-26T22:16:27.795709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRB.csv [2025-09-26T22:16:27.795866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTB.csv [2025-09-26T22:16:27.796023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RH.csv [2025-09-26T22:16:27.796257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BROS.csv [2025-09-26T22:16:27.796445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNNT.csv [2025-09-26T22:16:27.796622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSN.csv [2025-09-26T22:16:27.796841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXT.csv [2025-09-26T22:16:27.797078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTES.csv [2025-09-26T22:16:27.797230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPRK.csv [2025-09-26T22:16:27.797440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVF.csv [2025-09-26T22:16:27.797627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMN.csv [2025-09-26T22:16:27.797893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OTIS.csv [2025-09-26T22:16:27.798100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTS.csv [2025-09-26T22:16:27.798257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRC.csv [2025-09-26T22:16:27.798467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRN.csv [2025-09-26T22:16:27.798609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPN.csv [2025-09-26T22:16:27.798823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BURL.csv [2025-09-26T22:16:27.799200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTD.csv [2025-09-26T22:16:27.799400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHG.csv [2025-09-26T22:16:27.799693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LLY.csv [2025-09-26T22:16:27.799894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CALX.csv [2025-09-26T22:16:27.800068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIW.csv [2025-09-26T22:16:27.800317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCO.csv [2025-09-26T22:16:27.800479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SREA.csv [2025-09-26T22:16:27.800635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDG.csv [2025-09-26T22:16:27.800944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBR.csv [2025-09-26T22:16:27.801159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEA.csv [2025-09-26T22:16:27.801376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSR.csv [2025-09-26T22:16:27.801681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STLA.csv [2025-09-26T22:16:27.801848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMC.csv [2025-09-26T22:16:27.802043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXV.csv [2025-09-26T22:16:27.802335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLOB.csv [2025-09-26T22:16:27.802542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMG.csv [2025-09-26T22:16:27.802769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVA.csv [2025-09-26T22:16:27.803021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YMM.csv [2025-09-26T22:16:27.803256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YALA.csv [2025-09-26T22:16:27.803471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IP.csv [2025-09-26T22:16:27.803791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNO.csv [2025-09-26T22:16:27.803960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEXA.csv [2025-09-26T22:16:27.804330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMHC.csv [2025-09-26T22:16:27.804570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/K.csv [2025-09-26T22:16:27.804916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HDB.csv [2025-09-26T22:16:27.805089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAFE.csv [2025-09-26T22:16:27.805351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHM.csv [2025-09-26T22:16:27.805526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QTWO.csv [2025-09-26T22:16:27.805738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOK.csv [2025-09-26T22:16:27.805972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPCE.csv [2025-09-26T22:16:27.806117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOAR.csv [2025-09-26T22:16:27.806340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPF.csv [2025-09-26T22:16:27.806555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFX.csv [2025-09-26T22:16:27.806814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLIO.csv [2025-09-26T22:16:27.806978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDR.csv [2025-09-26T22:16:27.807169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMX.csv [2025-09-26T22:16:27.807327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTO.csv [2025-09-26T22:16:27.807491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTO.csv [2025-09-26T22:16:27.807634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOA.csv [2025-09-26T22:16:27.807872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLS.csv [2025-09-26T22:16:27.808035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TM.csv [2025-09-26T22:16:27.808219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERJ.csv [2025-09-26T22:16:27.808374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNC.csv [2025-09-26T22:16:27.808531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPLX.csv [2025-09-26T22:16:27.808773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MED.csv [2025-09-26T22:16:27.808932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPE.csv [2025-09-26T22:16:27.809098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIK.csv [2025-09-26T22:16:27.809320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGR.csv [2025-09-26T22:16:27.809557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPF.csv [2025-09-26T22:16:27.809739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSI.csv [2025-09-26T22:16:27.809891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDU.csv [2025-09-26T22:16:27.810047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTMX.csv [2025-09-26T22:16:27.810220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBM.csv [2025-09-26T22:16:27.810479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CANG.csv [2025-09-26T22:16:27.810695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTI.csv [2025-09-26T22:16:27.810865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UIS.csv [2025-09-26T22:16:27.811305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RC.csv [2025-09-26T22:16:27.811503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LII.csv [2025-09-26T22:16:27.811745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVH.csv [2025-09-26T22:16:27.811944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPRT.csv [2025-09-26T22:16:27.812134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCI.csv [2025-09-26T22:16:27.812315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIO.csv [2025-09-26T22:16:27.812479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOTE.csv [2025-09-26T22:16:27.812629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SABA.csv [2025-09-26T22:16:27.812945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSH.csv [2025-09-26T22:16:27.813073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCOR.csv [2025-09-26T22:16:27.813429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVK.csv [2025-09-26T22:16:27.813627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHLD.csv [2025-09-26T22:16:27.813834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESE.csv [2025-09-26T22:16:27.813996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GF.csv [2025-09-26T22:16:27.814209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GE.csv [2025-09-26T22:16:27.814407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSI.csv [2025-09-26T22:16:27.814673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEN.csv [2025-09-26T22:16:27.814885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGV.csv [2025-09-26T22:16:27.815090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGC.csv [2025-09-26T22:16:27.815281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FT.csv [2025-09-26T22:16:27.815437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQY.csv [2025-09-26T22:16:27.815693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOOS.csv [2025-09-26T22:16:27.815850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNMA.csv [2025-09-26T22:16:27.816031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSAC.csv [2025-09-26T22:16:27.816219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAR.csv [2025-09-26T22:16:27.816524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIP.csv [2025-09-26T22:16:27.816973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKIL.csv [2025-09-26T22:16:27.817179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSM.csv [2025-09-26T22:16:27.817790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFH.csv [2025-09-26T22:16:27.817967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIV.csv [2025-09-26T22:16:27.818162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTOL.csv [2025-09-26T22:16:27.818501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXL.csv [2025-09-26T22:16:27.818720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLI.csv [2025-09-26T22:16:27.818898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUC.csv [2025-09-26T22:16:27.819162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEE.csv [2025-09-26T22:16:27.819359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENS.csv [2025-09-26T22:16:27.819842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AA.csv [2025-09-26T22:16:27.820079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWRE.csv [2025-09-26T22:16:27.820676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFL.csv [2025-09-26T22:16:27.820884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WINN.csv [2025-09-26T22:16:27.821081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UE.csv [2025-09-26T22:16:27.821321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBAB.csv [2025-09-26T22:16:27.821491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEB.csv [2025-09-26T22:16:27.821701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIV.csv [2025-09-26T22:16:27.822142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEL.csv [2025-09-26T22:16:27.822307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QS.csv [2025-09-26T22:16:27.822470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHI.csv [2025-09-26T22:16:27.822666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGM.csv [2025-09-26T22:16:27.822878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTD.csv [2025-09-26T22:16:27.823091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOLF.csv [2025-09-26T22:16:27.823257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWH.csv [2025-09-26T22:16:27.823458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVST.csv [2025-09-26T22:16:27.823676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LCII.csv [2025-09-26T22:16:27.823909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOS.csv [2025-09-26T22:16:27.824121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNOP.csv [2025-09-26T22:16:27.824497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIM.csv [2025-09-26T22:16:27.824755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBC.csv [2025-09-26T22:16:27.824982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAIN.csv [2025-09-26T22:16:27.825152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAK.csv [2025-09-26T22:16:27.825284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLG.csv [2025-09-26T22:16:27.825446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEAF.csv [2025-09-26T22:16:27.825786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSM.csv [2025-09-26T22:16:27.825950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVR.csv [2025-09-26T22:16:27.826127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELS.csv [2025-09-26T22:16:27.826288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WH.csv [2025-09-26T22:16:27.826511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPV.csv [2025-09-26T22:16:27.826782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGNA.csv [2025-09-26T22:16:27.827013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CC.csv [2025-09-26T22:16:27.827219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAM.csv [2025-09-26T22:16:27.827439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COTY.csv [2025-09-26T22:16:27.827635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFH.csv [2025-09-26T22:16:27.827860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAY.csv [2025-09-26T22:16:27.828019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMWB.csv [2025-09-26T22:16:27.828241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOUS.csv [2025-09-26T22:16:27.828413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRO.csv [2025-09-26T22:16:27.828586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOG.csv [2025-09-26T22:16:27.828786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHIN.csv [2025-09-26T22:16:27.828975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPRI.csv [2025-09-26T22:16:27.829159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPL.csv [2025-09-26T22:16:27.829327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOTU.csv [2025-09-26T22:16:27.829495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAD.csv [2025-09-26T22:16:27.829712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYD.csv [2025-09-26T22:16:27.829912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOX.csv [2025-09-26T22:16:27.830067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEW.csv [2025-09-26T22:16:27.830238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIN.csv [2025-09-26T22:16:27.830699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOF.csv [2025-09-26T22:16:27.830877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMC.csv [2025-09-26T22:16:27.831092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THR.csv [2025-09-26T22:16:27.831263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NE.csv [2025-09-26T22:16:27.831430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHR.csv [2025-09-26T22:16:27.831601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSX.csv [2025-09-26T22:16:27.831846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTG.csv [2025-09-26T22:16:27.832009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCM.csv [2025-09-26T22:16:27.832186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AM.csv [2025-09-26T22:16:27.832352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEG.csv [2025-09-26T22:16:27.832552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASA.csv [2025-09-26T22:16:27.832728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNSO.csv [2025-09-26T22:16:27.832902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLI.csv [2025-09-26T22:16:27.833101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARW.csv [2025-09-26T22:16:27.833299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHM.csv [2025-09-26T22:16:27.833441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPWR.csv [2025-09-26T22:16:27.833755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FGN.csv [2025-09-26T22:16:27.833968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTO.csv [2025-09-26T22:16:27.834142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PH.csv [2025-09-26T22:16:27.834334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DD.csv [2025-09-26T22:16:27.834548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWLO.csv [2025-09-26T22:16:27.834769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRNO.csv [2025-09-26T22:16:27.834934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSO.csv [2025-09-26T22:16:27.835094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBT.csv [2025-09-26T22:16:27.835259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UDR.csv [2025-09-26T22:16:27.835429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETG.csv [2025-09-26T22:16:27.835629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTGC.csv [2025-09-26T22:16:27.835819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSL.csv [2025-09-26T22:16:27.836014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ISD.csv [2025-09-26T22:16:27.836173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THG.csv [2025-09-26T22:16:27.836381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNK.csv [2025-09-26T22:16:27.836537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOV.csv [2025-09-26T22:16:27.836717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRE.csv [2025-09-26T22:16:27.836872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYI.csv [2025-09-26T22:16:27.837122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FE.csv [2025-09-26T22:16:27.837328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXK.csv [2025-09-26T22:16:27.837491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDY.csv [2025-09-26T22:16:27.837716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFF.csv [2025-09-26T22:16:27.838006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGM.csv [2025-09-26T22:16:27.838140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTI.csv [2025-09-26T22:16:27.838549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRG.csv [2025-09-26T22:16:27.838752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCS.csv [2025-09-26T22:16:27.838908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCS.csv [2025-09-26T22:16:27.839068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAM.csv [2025-09-26T22:16:27.839235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCC.csv [2025-09-26T22:16:27.839419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNT.csv [2025-09-26T22:16:27.839601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSI.csv [2025-09-26T22:16:27.839778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COF.csv [2025-09-26T22:16:27.839968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIV.csv [2025-09-26T22:16:27.840116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNH.csv [2025-09-26T22:16:27.840315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRL.csv [2025-09-26T22:16:27.840490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGT.csv [2025-09-26T22:16:27.840638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CACI.csv [2025-09-26T22:16:27.840887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJM.csv [2025-09-26T22:16:27.841021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SN.csv [2025-09-26T22:16:27.841356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PERF.csv [2025-09-26T22:16:27.841531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DV.csv [2025-09-26T22:16:27.842087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BG.csv [2025-09-26T22:16:27.842352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGC.csv [2025-09-26T22:16:27.842482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPCT.csv [2025-09-26T22:16:27.842960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHAK.csv [2025-09-26T22:16:27.843148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALSN.csv [2025-09-26T22:16:27.843336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UPS.csv [2025-09-26T22:16:27.843497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQV.csv [2025-09-26T22:16:27.843714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESI.csv [2025-09-26T22:16:27.843886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCJ.csv [2025-09-26T22:16:27.844090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TG.csv [2025-09-26T22:16:27.844292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDH.csv [2025-09-26T22:16:27.844440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBNA.csv [2025-09-26T22:16:27.844627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REXR.csv [2025-09-26T22:16:27.844820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RKT.csv [2025-09-26T22:16:27.844981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/G.csv [2025-09-26T22:16:27.845148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRT.csv [2025-09-26T22:16:27.845335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VCV.csv [2025-09-26T22:16:27.845593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNH.csv [2025-09-26T22:16:27.845860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSU.csv [2025-09-26T22:16:27.846022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRNT.csv [2025-09-26T22:16:27.846210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETW.csv [2025-09-26T22:16:27.849772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSW.csv [2025-09-26T22:16:27.850104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATS.csv [2025-09-26T22:16:27.850575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGY.csv [2025-09-26T22:16:27.850946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEL.csv [2025-09-26T22:16:27.851137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KT.csv [2025-09-26T22:16:27.851332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GS.csv [2025-09-26T22:16:27.851534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARS.csv [2025-09-26T22:16:27.851760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEO.csv [2025-09-26T22:16:27.851943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPG.csv [2025-09-26T22:16:27.852101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPC.csv [2025-09-26T22:16:27.852251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LFT.csv [2025-09-26T22:16:27.852443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPI.csv [2025-09-26T22:16:27.852616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPJA.csv [2025-09-26T22:16:27.853115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKU.csv [2025-09-26T22:16:27.853454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAC.csv [2025-09-26T22:16:27.853719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTE.csv [2025-09-26T22:16:27.853960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TK.csv [2025-09-26T22:16:27.854206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEO.csv [2025-09-26T22:16:27.854389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RHP.csv [2025-09-26T22:16:27.854955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLD.csv [2025-09-26T22:16:27.855133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLP.csv [2025-09-26T22:16:27.855297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBH.csv [2025-09-26T22:16:27.855477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USAC.csv [2025-09-26T22:16:27.855692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLT.csv [2025-09-26T22:16:27.855825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDT.csv [2025-09-26T22:16:27.855968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSM.csv [2025-09-26T22:16:27.856202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDO.csv [2025-09-26T22:16:27.856415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLY.csv [2025-09-26T22:16:27.856576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAVA.csv [2025-09-26T22:16:27.856775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBR.csv [2025-09-26T22:16:27.856952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOG.csv [2025-09-26T22:16:27.857165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZKH.csv [2025-09-26T22:16:27.857315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RQI.csv [2025-09-26T22:16:27.857544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/T.csv [2025-09-26T22:16:27.857739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSG.csv [2025-09-26T22:16:27.857921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBK.csv [2025-09-26T22:16:27.858135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HZO.csv [2025-09-26T22:16:27.858328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STRV.csv [2025-09-26T22:16:27.858547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLX.csv [2025-09-26T22:16:27.858938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THQ.csv [2025-09-26T22:16:27.859142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCU.csv [2025-09-26T22:16:27.859391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWH.csv [2025-09-26T22:16:27.859862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMD.csv [2025-09-26T22:16:27.860081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOUG.csv [2025-09-26T22:16:27.860231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEGI.csv [2025-09-26T22:16:27.860398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CE.csv [2025-09-26T22:16:27.860639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMND.csv [2025-09-26T22:16:27.860816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNN.csv [2025-09-26T22:16:27.860992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMG.csv [2025-09-26T22:16:27.861120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PML.csv [2025-09-26T22:16:27.861276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIG.csv [2025-09-26T22:16:27.861485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OUT.csv [2025-09-26T22:16:27.861705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUE.csv [2025-09-26T22:16:27.861893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCCO.csv [2025-09-26T22:16:27.862065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFC.csv [2025-09-26T22:16:27.862221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPK.csv [2025-09-26T22:16:27.862394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEX.csv [2025-09-26T22:16:27.862635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASB.csv [2025-09-26T22:16:27.862852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTA.csv [2025-09-26T22:16:27.863031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMC.csv [2025-09-26T22:16:27.863189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGA.csv [2025-09-26T22:16:27.863417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SES.csv [2025-09-26T22:16:27.863695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVAL.csv [2025-09-26T22:16:27.863884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGS.csv [2025-09-26T22:16:27.864080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWX.csv [2025-09-26T22:16:27.864252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSBD.csv [2025-09-26T22:16:27.864519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXE.csv [2025-09-26T22:16:27.864770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEP.csv [2025-09-26T22:16:27.864964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDOS.csv [2025-09-26T22:16:27.865130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFMZ.csv [2025-09-26T22:16:27.865288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPX.csv [2025-09-26T22:16:27.865452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOBO.csv [2025-09-26T22:16:27.865579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/POR.csv [2025-09-26T22:16:27.865806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEC.csv [2025-09-26T22:16:27.866013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CI.csv [2025-09-26T22:16:27.866223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOYA.csv [2025-09-26T22:16:27.866420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEU.csv [2025-09-26T22:16:27.866733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXP.csv [2025-09-26T22:16:27.866865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFG.csv [2025-09-26T22:16:27.867031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMX.csv [2025-09-26T22:16:27.867211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VST.csv [2025-09-26T22:16:27.867371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRO.csv [2025-09-26T22:16:27.867548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZK.csv [2025-09-26T22:16:27.867778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNFI.csv [2025-09-26T22:16:27.867966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/E.csv [2025-09-26T22:16:27.868277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NET.csv [2025-09-26T22:16:27.868422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRC.csv [2025-09-26T22:16:27.868962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBWI.csv [2025-09-26T22:16:27.869126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TR.csv [2025-09-26T22:16:27.869279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RM.csv [2025-09-26T22:16:27.869411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGER.csv [2025-09-26T22:16:27.869693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEL.csv [2025-09-26T22:16:27.869883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEX.csv [2025-09-26T22:16:27.870338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKT.csv [2025-09-26T22:16:27.870507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ING.csv [2025-09-26T22:16:27.870751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARMK.csv [2025-09-26T22:16:27.871011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPE.csv [2025-09-26T22:16:27.871470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGU.csv [2025-09-26T22:16:27.871723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTUS.csv [2025-09-26T22:16:27.871918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWLT.csv [2025-09-26T22:16:27.872178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARE.csv [2025-09-26T22:16:27.872382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGB.csv [2025-09-26T22:16:27.872575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTTR.csv [2025-09-26T22:16:27.872792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRTS.csv [2025-09-26T22:16:27.872982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAN.csv [2025-09-26T22:16:27.873141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOW.csv [2025-09-26T22:16:27.873557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFRC.csv [2025-09-26T22:16:27.873789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSF.csv [2025-09-26T22:16:27.873975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GME.csv [2025-09-26T22:16:27.874138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCC.csv [2025-09-26T22:16:27.874294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLNT.csv [2025-09-26T22:16:27.874911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGB.csv [2025-09-26T22:16:27.875127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGI.csv [2025-09-26T22:16:27.875275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UCB.csv [2025-09-26T22:16:27.875396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLT.csv [2025-09-26T22:16:27.875566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRE.csv [2025-09-26T22:16:27.875767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMI.csv [2025-09-26T22:16:27.875942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USPH.csv [2025-09-26T22:16:27.876120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTC.csv [2025-09-26T22:16:27.876319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCL.csv [2025-09-26T22:16:27.876470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFH.csv [2025-09-26T22:16:27.876660] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETX.csv [2025-09-26T22:16:27.876828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRT.csv [2025-09-26T22:16:27.876981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVTY.csv [2025-09-26T22:16:27.877198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMPO.csv [2025-09-26T22:16:27.877569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPJ.csv [2025-09-26T22:16:27.877813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHD.csv [2025-09-26T22:16:27.877964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KD.csv [2025-09-26T22:16:27.878137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNJ.csv [2025-09-26T22:16:27.878336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOLF.csv [2025-09-26T22:16:27.878488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPGI.csv [2025-09-26T22:16:27.878690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIR.csv [2025-09-26T22:16:27.878849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NATL.csv [2025-09-26T22:16:27.879000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSW.csv [2025-09-26T22:16:27.879298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITE.csv [2025-09-26T22:16:27.879473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AG.csv [2025-09-26T22:16:27.879626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAH.csv [2025-09-26T22:16:27.879861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIF.csv [2025-09-26T22:16:27.880079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRG.csv [2025-09-26T22:16:27.880253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEO.csv [2025-09-26T22:16:27.880402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIO.csv [2025-09-26T22:16:27.880559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KN.csv [2025-09-26T22:16:27.880741] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COHR.csv [2025-09-26T22:16:27.880935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCT.csv [2025-09-26T22:16:27.881070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJC.csv [2025-09-26T22:16:27.881218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEC.csv [2025-09-26T22:16:27.881373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PARR.csv [2025-09-26T22:16:27.881551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HD.csv [2025-09-26T22:16:27.881756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAN.csv [2025-09-26T22:16:27.881920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WGO.csv [2025-09-26T22:16:27.882123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARR.csv [2025-09-26T22:16:27.882296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHX.csv [2025-09-26T22:16:27.882810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GKOS.csv [2025-09-26T22:16:27.882995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCD.csv [2025-09-26T22:16:27.883350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKE.csv [2025-09-26T22:16:27.883527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSD.csv [2025-09-26T22:16:27.883741] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMD.csv [2025-09-26T22:16:27.883984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICL.csv [2025-09-26T22:16:27.884155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSR.csv [2025-09-26T22:16:27.884317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADNT.csv [2025-09-26T22:16:27.884443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQT.csv [2025-09-26T22:16:27.884584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTR.csv [2025-09-26T22:16:27.884812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGM.csv [2025-09-26T22:16:27.885010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCO.csv [2025-09-26T22:16:27.885178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLW.csv [2025-09-26T22:16:27.885330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITT.csv [2025-09-26T22:16:27.885553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALE.csv [2025-09-26T22:16:27.885734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOD.csv [2025-09-26T22:16:27.885915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBI.csv [2025-09-26T22:16:27.886074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIE.csv [2025-09-26T22:16:27.886251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPS.csv [2025-09-26T22:16:27.886557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LB.csv [2025-09-26T22:16:27.886752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPL.csv [2025-09-26T22:16:27.886922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNSL.csv [2025-09-26T22:16:27.887378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STVN.csv [2025-09-26T22:16:27.887526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CON.csv [2025-09-26T22:16:27.887693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAL.csv [2025-09-26T22:16:27.887846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROK.csv [2025-09-26T22:16:27.888011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LND.csv [2025-09-26T22:16:27.888184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFF.csv [2025-09-26T22:16:27.888343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMTG.csv [2025-09-26T22:16:27.888510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JILL.csv [2025-09-26T22:16:27.888667] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRU.csv [2025-09-26T22:16:27.888828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SB.csv [2025-09-26T22:16:27.888958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RF.csv [2025-09-26T22:16:27.889125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JMIA.csv [2025-09-26T22:16:27.889256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIC.csv [2025-09-26T22:16:27.889467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMC.csv [2025-09-26T22:16:27.889616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONIT.csv [2025-09-26T22:16:27.889824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGS.csv [2025-09-26T22:16:27.889967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TU.csv [2025-09-26T22:16:27.890408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBD.csv [2025-09-26T22:16:27.890567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGI.csv [2025-09-26T22:16:27.890823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASPN.csv [2025-09-26T22:16:27.890975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWG.csv [2025-09-26T22:16:27.891120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RJF.csv [2025-09-26T22:16:27.891321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMY.csv [2025-09-26T22:16:27.891492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TV.csv [2025-09-26T22:16:27.891631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBB.csv [2025-09-26T22:16:27.891819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDA.csv [2025-09-26T22:16:27.891966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCK.csv [2025-09-26T22:16:27.892151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAH.csv [2025-09-26T22:16:27.892322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HL.csv [2025-09-26T22:16:27.892483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FND.csv [2025-09-26T22:16:27.892660] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRT.csv [2025-09-26T22:16:27.892851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TISI.csv [2025-09-26T22:16:27.893036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRFM.csv [2025-09-26T22:16:27.893237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMO.csv [2025-09-26T22:16:27.893444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCN.csv [2025-09-26T22:16:27.893624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKST.csv [2025-09-26T22:16:27.893922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMH.csv [2025-09-26T22:16:27.894118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNTK.csv [2025-09-26T22:16:27.894366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATI.csv [2025-09-26T22:16:27.894663] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STT.csv [2025-09-26T22:16:27.894854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPC.csv [2025-09-26T22:16:27.895027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNM.csv [2025-09-26T22:16:27.895216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDA.csv [2025-09-26T22:16:27.895462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNI.csv [2025-09-26T22:16:27.895664] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETD.csv [2025-09-26T22:16:27.895799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHK.csv [2025-09-26T22:16:27.895988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEI.csv [2025-09-26T22:16:27.896172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMS.csv [2025-09-26T22:16:27.896390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TALO.csv [2025-09-26T22:16:27.896599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDLR.csv [2025-09-26T22:16:27.896903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADCT.csv [2025-09-26T22:16:27.897047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKC.csv [2025-09-26T22:16:27.897280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRSP.csv [2025-09-26T22:16:27.897448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKYH.csv [2025-09-26T22:16:27.897570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MXF.csv [2025-09-26T22:16:27.897749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIHL.csv [2025-09-26T22:16:27.897886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVT.csv [2025-09-26T22:16:27.898292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHR.csv [2025-09-26T22:16:27.898463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDF.csv [2025-09-26T22:16:27.898816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIP.csv [2025-09-26T22:16:27.898995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAAS.csv [2025-09-26T22:16:27.899409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHCO.csv [2025-09-26T22:16:27.899601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HY.csv [2025-09-26T22:16:27.899772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGS.csv [2025-09-26T22:16:27.899970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOST.csv [2025-09-26T22:16:27.900110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOND.csv [2025-09-26T22:16:27.900406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPG.csv [2025-09-26T22:16:27.900606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AON.csv [2025-09-26T22:16:27.900788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXW.csv [2025-09-26T22:16:27.900931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLOP.csv [2025-09-26T22:16:27.901074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDW.csv [2025-09-26T22:16:27.901213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPT.csv [2025-09-26T22:16:27.901377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KSS.csv [2025-09-26T22:16:27.901541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEF.csv [2025-09-26T22:16:27.901723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEC.csv [2025-09-26T22:16:27.901868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NQP.csv [2025-09-26T22:16:27.902007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNV.csv [2025-09-26T22:16:27.902420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBY.csv [2025-09-26T22:16:27.902598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRE.csv [2025-09-26T22:16:27.902815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTM.csv [2025-09-26T22:16:27.902941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBA.csv [2025-09-26T22:16:27.903068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LBRT.csv [2025-09-26T22:16:27.903236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGT.csv [2025-09-26T22:16:27.903461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAK.csv [2025-09-26T22:16:27.903638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMI.csv [2025-09-26T22:16:27.903860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDX.csv [2025-09-26T22:16:27.904004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VHI.csv [2025-09-26T22:16:27.904182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FI.csv [2025-09-26T22:16:27.904364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAO.csv [2025-09-26T22:16:27.904567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YOU.csv [2025-09-26T22:16:27.904802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHAB.csv [2025-09-26T22:16:27.905005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTF.csv [2025-09-26T22:16:27.905205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAR.csv [2025-09-26T22:16:27.905381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNTY.csv [2025-09-26T22:16:27.905677] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENOV.csv [2025-09-26T22:16:27.905892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KORE.csv [2025-09-26T22:16:27.906108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBS.csv [2025-09-26T22:16:27.906346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVV.csv [2025-09-26T22:16:27.906625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSFE.csv [2025-09-26T22:16:27.907053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEN.csv [2025-09-26T22:16:27.907327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YEXT.csv [2025-09-26T22:16:27.907775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HNI.csv [2025-09-26T22:16:27.908003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMI.csv [2025-09-26T22:16:27.908207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHCT.csv [2025-09-26T22:16:27.908408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTB.csv [2025-09-26T22:16:27.908665] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIF.csv [2025-09-26T22:16:27.908960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUB.csv [2025-09-26T22:16:27.909140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVEX.csv [2025-09-26T22:16:27.909276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACS.csv [2025-09-26T22:16:27.909425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAN.csv [2025-09-26T22:16:27.909579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMMZ.csv [2025-09-26T22:16:27.909760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINE.csv [2025-09-26T22:16:27.909928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GXO.csv [2025-09-26T22:16:27.910073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMF.csv [2025-09-26T22:16:27.910222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXD.csv [2025-09-26T22:16:27.910459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BA.csv [2025-09-26T22:16:27.910909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUM.csv [2025-09-26T22:16:27.911045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLN.csv [2025-09-26T22:16:27.911181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQM.csv [2025-09-26T22:16:27.911345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIX.csv [2025-09-26T22:16:27.911474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINS.csv [2025-09-26T22:16:27.911622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLNG.csv [2025-09-26T22:16:27.911799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLY.csv [2025-09-26T22:16:27.911951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PII.csv [2025-09-26T22:16:27.912118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFL.csv [2025-09-26T22:16:27.912297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOS.csv [2025-09-26T22:16:27.912476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNX.csv [2025-09-26T22:16:27.912669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSLY.csv [2025-09-26T22:16:27.912839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWW.csv [2025-09-26T22:16:27.913208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVG.csv [2025-09-26T22:16:27.913390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNA.csv [2025-09-26T22:16:27.913553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XFLT.csv [2025-09-26T22:16:27.913768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUK.csv [2025-09-26T22:16:27.913961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIB.csv [2025-09-26T22:16:27.914217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTH.csv [2025-09-26T22:16:27.914429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAL.csv [2025-09-26T22:16:27.914631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USNA.csv [2025-09-26T22:16:27.914904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYK.csv [2025-09-26T22:16:27.915032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNP.csv [2025-09-26T22:16:27.915167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FET.csv [2025-09-26T22:16:27.915328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMN.csv [2025-09-26T22:16:27.915525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMCR.csv [2025-09-26T22:16:27.915848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADX.csv [2025-09-26T22:16:27.915978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFG.csv [2025-09-26T22:16:27.916090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THIR.csv [2025-09-26T22:16:27.916231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPAD.csv [2025-09-26T22:16:27.916726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCE.csv [2025-09-26T22:16:27.916935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACP.csv [2025-09-26T22:16:27.917088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSHP.csv [2025-09-26T22:16:27.917244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRP.csv [2025-09-26T22:16:27.917408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYG.csv [2025-09-26T22:16:27.917599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOH.csv [2025-09-26T22:16:27.917800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKL.csv [2025-09-26T22:16:27.917952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDT.csv [2025-09-26T22:16:27.918097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/W.csv [2025-09-26T22:16:27.918245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WU.csv [2025-09-26T22:16:27.918412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASAN.csv [2025-09-26T22:16:27.918551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSP.csv [2025-09-26T22:16:27.918734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCN.csv [2025-09-26T22:16:27.918881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMP.csv [2025-09-26T22:16:27.919030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLJ.csv [2025-09-26T22:16:27.919477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCC.csv [2025-09-26T22:16:27.919672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBB.csv [2025-09-26T22:16:27.919880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TUYA.csv [2025-09-26T22:16:27.920014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUK.csv [2025-09-26T22:16:27.920115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSBR.csv [2025-09-26T22:16:27.920271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGE.csv [2025-09-26T22:16:27.920430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCI.csv [2025-09-26T22:16:27.920590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FAF.csv [2025-09-26T22:16:27.920782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAR.csv [2025-09-26T22:16:27.920953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMC.csv [2025-09-26T22:16:27.921405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGE.csv [2025-09-26T22:16:27.921565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/F.csv [2025-09-26T22:16:27.921740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSQH.csv [2025-09-26T22:16:27.921913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVE.csv [2025-09-26T22:16:27.922164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRM.csv [2025-09-26T22:16:27.922379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRTG.csv [2025-09-26T22:16:27.922533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEYS.csv [2025-09-26T22:16:27.922803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRI.csv [2025-09-26T22:16:27.922977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXI.csv [2025-09-26T22:16:27.923161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOH.csv [2025-09-26T22:16:27.923291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBT.csv [2025-09-26T22:16:27.923439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSK.csv [2025-09-26T22:16:27.923676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNT.csv [2025-09-26T22:16:27.923852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HWM.csv [2025-09-26T22:16:27.924028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSY.csv [2025-09-26T22:16:27.924167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHI.csv [2025-09-26T22:16:27.924335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTY.csv [2025-09-26T22:16:27.924502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSA.csv [2025-09-26T22:16:27.924660] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSI.csv [2025-09-26T22:16:27.924806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ST.csv [2025-09-26T22:16:27.925005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWG.csv [2025-09-26T22:16:27.925161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPI.csv [2025-09-26T22:16:27.925298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRT.csv [2025-09-26T22:16:27.925474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOW.csv [2025-09-26T22:16:27.925719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/V.csv [2025-09-26T22:16:27.925847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTDR.csv [2025-09-26T22:16:27.925951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLPR.csv [2025-09-26T22:16:27.926078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHY.csv [2025-09-26T22:16:27.926256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TY.csv [2025-09-26T22:16:27.926434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOMB.csv [2025-09-26T22:16:27.926584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEA.csv [2025-09-26T22:16:27.926802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLW.csv [2025-09-26T22:16:27.926996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KYN.csv [2025-09-26T22:16:27.927170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCS.csv [2025-09-26T22:16:27.927539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPI.csv [2025-09-26T22:16:27.927708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYV.csv [2025-09-26T22:16:27.927851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXX.csv [2025-09-26T22:16:27.927997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMCO.csv [2025-09-26T22:16:27.928165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRGE.csv [2025-09-26T22:16:27.928305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPEV.csv [2025-09-26T22:16:27.928475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YRD.csv [2025-09-26T22:16:27.928616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESRT.csv [2025-09-26T22:16:27.928802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KW.csv [2025-09-26T22:16:27.928953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMM.csv [2025-09-26T22:16:27.929105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENB.csv [2025-09-26T22:16:27.929289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITW.csv [2025-09-26T22:16:27.929434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SVV.csv [2025-09-26T22:16:27.929605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLF.csv [2025-09-26T22:16:27.929808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPV.csv [2025-09-26T22:16:27.929964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTX.csv [2025-09-26T22:16:27.930089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLB.csv [2025-09-26T22:16:27.930219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSM.csv [2025-09-26T22:16:27.930410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANF.csv [2025-09-26T22:16:27.930533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCHW.csv [2025-09-26T22:16:27.930934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGM.csv [2025-09-26T22:16:27.931161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANET.csv [2025-09-26T22:16:27.931319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQV.csv [2025-09-26T22:16:27.931536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THC.csv [2025-09-26T22:16:27.931746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLN.csv [2025-09-26T22:16:27.931922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBS.csv [2025-09-26T22:16:27.932190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZEPP.csv [2025-09-26T22:16:27.932347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIA.csv [2025-09-26T22:16:27.932470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNM.csv [2025-09-26T22:16:27.932608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PK.csv [2025-09-26T22:16:27.932808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLRS.csv [2025-09-26T22:16:27.932950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OEC.csv [2025-09-26T22:16:27.933090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IT.csv [2025-09-26T22:16:27.933215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBRG.csv [2025-09-26T22:16:27.933342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVE.csv [2025-09-26T22:16:27.933464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCI.csv [2025-09-26T22:16:27.933739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CATO.csv [2025-09-26T22:16:27.934233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGX.csv [2025-09-26T22:16:27.934400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IX.csv [2025-09-26T22:16:27.934565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/L.csv [2025-09-26T22:16:27.934731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSX.csv [2025-09-26T22:16:27.934926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYD.csv [2025-09-26T22:16:27.935155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDS.csv [2025-09-26T22:16:27.935362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AR.csv [2025-09-26T22:16:27.935522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCL.csv [2025-09-26T22:16:27.935694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBR.csv [2025-09-26T22:16:27.936278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPAY.csv [2025-09-26T22:16:27.936534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEG.csv [2025-09-26T22:16:27.936706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIEN.csv [2025-09-26T22:16:27.937136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBD.csv [2025-09-26T22:16:27.937289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTX.csv [2025-09-26T22:16:27.937447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRCC.csv [2025-09-26T22:16:27.937607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SU.csv [2025-09-26T22:16:27.937895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWI.csv [2025-09-26T22:16:27.938052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMU.csv [2025-09-26T22:16:27.938440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGH.csv [2025-09-26T22:16:27.938615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEF.csv [2025-09-26T22:16:27.939232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNS.csv [2025-09-26T22:16:27.939428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAYC.csv [2025-09-26T22:16:27.939629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNR.csv [2025-09-26T22:16:27.939897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GM.csv [2025-09-26T22:16:27.940126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCI.csv [2025-09-26T22:16:27.940324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFL.csv [2025-09-26T22:16:27.940519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKY.csv [2025-09-26T22:16:27.940723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXG.csv [2025-09-26T22:16:27.940876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIO.csv [2025-09-26T22:16:27.941023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAYW.csv [2025-09-26T22:16:27.941179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MP.csv [2025-09-26T22:16:27.941310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORA.csv [2025-09-26T22:16:27.941535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLUT.csv [2025-09-26T22:16:27.941720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUFG.csv [2025-09-26T22:16:27.941868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEO.csv [2025-09-26T22:16:27.942075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLVM.csv [2025-09-26T22:16:27.942306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/A.csv [2025-09-26T22:16:27.942448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPT.csv [2025-09-26T22:16:27.942694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZE.csv [2025-09-26T22:16:27.942843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIS.csv [2025-09-26T22:16:27.943023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRP.csv [2025-09-26T22:16:27.943163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEA.csv [2025-09-26T22:16:27.943316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAS.csv [2025-09-26T22:16:27.943597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVWR.csv [2025-09-26T22:16:27.943819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSP.csv [2025-09-26T22:16:27.943964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUVB.csv [2025-09-26T22:16:27.944145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTS.csv [2025-09-26T22:16:27.944330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCI.csv [2025-09-26T22:16:27.944477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PWR.csv [2025-09-26T22:16:27.944789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBTG.csv [2025-09-26T22:16:27.945145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWN.csv [2025-09-26T22:16:27.945312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGAU.csv [2025-09-26T22:16:27.945464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SR.csv [2025-09-26T22:16:27.945715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNH.csv [2025-09-26T22:16:27.945875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHS.csv [2025-09-26T22:16:27.946002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLK.csv [2025-09-26T22:16:27.946138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPOF.csv [2025-09-26T22:16:27.946580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BME.csv [2025-09-26T22:16:27.946914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDT.csv [2025-09-26T22:16:27.947091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTLS.csv [2025-09-26T22:16:27.947257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYD.csv [2025-09-26T22:16:27.947414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PL.csv [2025-09-26T22:16:27.947542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDS.csv [2025-09-26T22:16:27.947717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSCO.csv [2025-09-26T22:16:27.947884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NZF.csv [2025-09-26T22:16:27.948035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWL.csv [2025-09-26T22:16:27.948442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKSY.csv [2025-09-26T22:16:27.948605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GES.csv [2025-09-26T22:16:27.949105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAX.csv [2025-09-26T22:16:27.949257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLP.csv [2025-09-26T22:16:27.949413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLP.csv [2025-09-26T22:16:27.949553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTB.csv [2025-09-26T22:16:27.949736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INN.csv [2025-09-26T22:16:27.949862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHR.csv [2025-09-26T22:16:27.950005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCZ.csv [2025-09-26T22:16:27.950196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCA.csv [2025-09-26T22:16:27.950382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXC.csv [2025-09-26T22:16:27.950564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSK.csv [2025-09-26T22:16:27.950955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CQP.csv [2025-09-26T22:16:27.951152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STWD.csv [2025-09-26T22:16:27.951334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGRO.csv [2025-09-26T22:16:27.951659] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACR.csv [2025-09-26T22:16:27.951883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDRE.csv [2025-09-26T22:16:27.952159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LSPD.csv [2025-09-26T22:16:27.952303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LGI.csv [2025-09-26T22:16:27.952512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIM.csv [2025-09-26T22:16:27.952661] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHN.csv [2025-09-26T22:16:27.952962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEMR.csv [2025-09-26T22:16:27.953114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOE.csv [2025-09-26T22:16:27.953238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTL.csv [2025-09-26T22:16:27.953399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFR.csv [2025-09-26T22:16:27.953555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSA.csv [2025-09-26T22:16:27.953782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/URI.csv [2025-09-26T22:16:27.954213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHP.csv [2025-09-26T22:16:27.954369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGI.csv [2025-09-26T22:16:27.954544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBN.csv [2025-09-26T22:16:27.954866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZWS.csv [2025-09-26T22:16:27.955030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAD.csv [2025-09-26T22:16:27.955187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RS.csv [2025-09-26T22:16:27.955377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DGX.csv [2025-09-26T22:16:27.955530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBIN.csv [2025-09-26T22:16:27.955689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLLY.csv [2025-09-26T22:16:27.955833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFL.csv [2025-09-26T22:16:27.956024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBA.csv [2025-09-26T22:16:27.956459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABG.csv [2025-09-26T22:16:27.956605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YELP.csv [2025-09-26T22:16:27.956775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UI.csv [2025-09-26T22:16:27.956897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTR.csv [2025-09-26T22:16:27.957352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITT.csv [2025-09-26T22:16:27.957516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EG.csv [2025-09-26T22:16:27.957688] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PATH.csv [2025-09-26T22:16:27.958071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLK.csv [2025-09-26T22:16:27.958243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQL.csv [2025-09-26T22:16:27.958383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJE.csv [2025-09-26T22:16:27.958584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGCO.csv [2025-09-26T22:16:27.958736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXP.csv [2025-09-26T22:16:27.958938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFIN.csv [2025-09-26T22:16:27.959128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUYA.csv [2025-09-26T22:16:27.959290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATX.csv [2025-09-26T22:16:27.959455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRTX.csv [2025-09-26T22:16:27.959620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBR.csv [2025-09-26T22:16:27.959779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPK.csv [2025-09-26T22:16:27.959962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AN.csv [2025-09-26T22:16:27.960170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COR.csv [2025-09-26T22:16:27.960338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZD.csv [2025-09-26T22:16:27.960497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LADR.csv [2025-09-26T22:16:27.960661] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBS.csv [2025-09-26T22:16:27.960815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMRT.csv [2025-09-26T22:16:27.960976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESTC.csv [2025-09-26T22:16:27.961122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OVV.csv [2025-09-26T22:16:27.961279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLM.csv [2025-09-26T22:16:27.961468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARLO.csv [2025-09-26T22:16:27.961610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNAP.csv [2025-09-26T22:16:27.961815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHS.csv [2025-09-26T22:16:27.961990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCR.csv [2025-09-26T22:16:27.962172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSAN.csv [2025-09-26T22:16:27.962319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXE.csv [2025-09-26T22:16:27.962460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RAMP.csv [2025-09-26T22:16:27.962627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHT.csv [2025-09-26T22:16:27.962932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIG.csv [2025-09-26T22:16:27.963103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OOMA.csv [2025-09-26T22:16:27.963312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGO.csv [2025-09-26T22:16:27.963492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RA.csv [2025-09-26T22:16:27.963719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSBC.csv [2025-09-26T22:16:27.963895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAW.csv [2025-09-26T22:16:27.964104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SW.csv [2025-09-26T22:16:27.964290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELF.csv [2025-09-26T22:16:27.964515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TME.csv [2025-09-26T22:16:27.964715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYG.csv [2025-09-26T22:16:27.964960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AES.csv [2025-09-26T22:16:27.965113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAI.csv [2025-09-26T22:16:27.965266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBI.csv [2025-09-26T22:16:27.965589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UA.csv [2025-09-26T22:16:27.965947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTOS.csv [2025-09-26T22:16:27.966104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDE.csv [2025-09-26T22:16:27.966245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NKX.csv [2025-09-26T22:16:27.966432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVC.csv [2025-09-26T22:16:27.966641] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOW.csv [2025-09-26T22:16:27.966912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUW.csv [2025-09-26T22:16:27.967076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPX.csv [2025-09-26T22:16:27.967497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFS.csv [2025-09-26T22:16:27.968010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFBS.csv [2025-09-26T22:16:27.968218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXP.csv [2025-09-26T22:16:27.968378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSL.csv [2025-09-26T22:16:27.968824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFK.csv [2025-09-26T22:16:27.968980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HVT.csv [2025-09-26T22:16:27.969114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRE.csv [2025-09-26T22:16:27.969248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THO.csv [2025-09-26T22:16:27.969418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAP.csv [2025-09-26T22:16:27.969570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVC.csv [2025-09-26T22:16:27.969732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFLT.csv [2025-09-26T22:16:27.969844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEUE.csv [2025-09-26T22:16:27.969977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQBK.csv [2025-09-26T22:16:27.970140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLE.csv [2025-09-26T22:16:27.970586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLCO.csv [2025-09-26T22:16:27.970809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMH.csv [2025-09-26T22:16:27.970952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROL.csv [2025-09-26T22:16:27.971092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBL.csv [2025-09-26T22:16:27.971250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCS.csv [2025-09-26T22:16:27.971392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUN.csv [2025-09-26T22:16:27.971559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BN.csv [2025-09-26T22:16:27.971923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAE.csv [2025-09-26T22:16:27.972086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHO.csv [2025-09-26T22:16:27.972213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPW.csv [2025-09-26T22:16:27.972372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOMR.csv [2025-09-26T22:16:27.972543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMBK.csv [2025-09-26T22:16:27.972717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAGN.csv [2025-09-26T22:16:27.972848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPH.csv [2025-09-26T22:16:27.973003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOA.csv [2025-09-26T22:16:27.973172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVC.csv [2025-09-26T22:16:27.973311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFGC.csv [2025-09-26T22:16:27.973463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMN.csv [2025-09-26T22:16:27.973681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSO.csv [2025-09-26T22:16:27.973857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STZ.csv [2025-09-26T22:16:27.974009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVX.csv [2025-09-26T22:16:27.974171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDE.csv [2025-09-26T22:16:27.974312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDS.csv [2025-09-26T22:16:27.974455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FERG.csv [2025-09-26T22:16:27.974580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBK.csv [2025-09-26T22:16:27.974775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASIX.csv [2025-09-26T22:16:27.974951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOR.csv [2025-09-26T22:16:27.975126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOD.csv [2025-09-26T22:16:27.975276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPC.csv [2025-09-26T22:16:27.975441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYF.csv [2025-09-26T22:16:27.975581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TECK.csv [2025-09-26T22:16:27.975750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCB.csv [2025-09-26T22:16:27.975887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFM.csv [2025-09-26T22:16:27.976029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKC.csv [2025-09-26T22:16:27.976185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLX.csv [2025-09-26T22:16:27.976336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVZ.csv [2025-09-26T22:16:27.976584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/R.csv [2025-09-26T22:16:27.976737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMC.csv [2025-09-26T22:16:27.976861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDX.csv [2025-09-26T22:16:27.977011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCN.csv [2025-09-26T22:16:27.977170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LHX.csv [2025-09-26T22:16:27.977328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDC.csv [2025-09-26T22:16:27.977491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WF.csv [2025-09-26T22:16:27.977633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMRE.csv [2025-09-26T22:16:27.977823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUV.csv [2025-09-26T22:16:27.977964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTN.csv [2025-09-26T22:16:27.978175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWXT.csv [2025-09-26T22:16:27.978414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPM.csv [2025-09-26T22:16:27.978739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACEL.csv [2025-09-26T22:16:27.978868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPVG.csv [2025-09-26T22:16:27.979003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFC.csv [2025-09-26T22:16:27.979163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNE.csv [2025-09-26T22:16:27.979323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPV.csv [2025-09-26T22:16:27.979479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SARO.csv [2025-09-26T22:16:27.979604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWN.csv [2025-09-26T22:16:27.979798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIG.csv [2025-09-26T22:16:27.979931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVF.csv [2025-09-26T22:16:27.980332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLND.csv [2025-09-26T22:16:27.980519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLR.csv [2025-09-26T22:16:27.980640] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NHI.csv [2025-09-26T22:16:27.980805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPZ.csv [2025-09-26T22:16:27.980945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRLL.csv [2025-09-26T22:16:27.981134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEM.csv [2025-09-26T22:16:27.981706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBN.csv [2025-09-26T22:16:27.981900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCF.csv [2025-09-26T22:16:27.982117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHD.csv [2025-09-26T22:16:27.982324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETY.csv [2025-09-26T22:16:27.982591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZETA.csv [2025-09-26T22:16:27.982813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBLX.csv [2025-09-26T22:16:27.983010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFC.csv [2025-09-26T22:16:27.983168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UP.csv [2025-09-26T22:16:27.983330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLS.csv [2025-09-26T22:16:27.983567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STAG.csv [2025-09-26T22:16:27.983785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCIF.csv [2025-09-26T22:16:27.983965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KODK.csv [2025-09-26T22:16:27.984241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALB.csv [2025-09-26T22:16:27.984410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLDT.csv [2025-09-26T22:16:27.984624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PJT.csv [2025-09-26T22:16:27.984802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCI.csv [2025-09-26T22:16:27.984930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLY.csv [2025-09-26T22:16:27.985034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VBF.csv [2025-09-26T22:16:27.985154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RY.csv [2025-09-26T22:16:27.985302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDRL.csv [2025-09-26T22:16:27.985461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATKR.csv [2025-09-26T22:16:27.985702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BX.csv [2025-09-26T22:16:27.985860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MWA.csv [2025-09-26T22:16:27.985984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GVA.csv [2025-09-26T22:16:27.986125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBP.csv [2025-09-26T22:16:27.986307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OFG.csv [2025-09-26T22:16:27.986838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIRK.csv [2025-09-26T22:16:27.987016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MS.csv [2025-09-26T22:16:27.987166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMM.csv [2025-09-26T22:16:27.987581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOMA.csv [2025-09-26T22:16:27.987799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNP.csv [2025-09-26T22:16:27.987939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNS.csv [2025-09-26T22:16:27.988088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQR.csv [2025-09-26T22:16:27.988216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBI.csv [2025-09-26T22:16:27.988356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRB.csv [2025-09-26T22:16:27.988524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRI.csv [2025-09-26T22:16:27.988683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBOT.csv [2025-09-26T22:16:27.988840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEV.csv [2025-09-26T22:16:27.988996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAB.csv [2025-09-26T22:16:27.989204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMRC.csv [2025-09-26T22:16:27.989346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQH.csv [2025-09-26T22:16:27.989491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNMD.csv [2025-09-26T22:16:27.989631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QXO.csv [2025-09-26T22:16:27.989826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DY.csv [2025-09-26T22:16:27.990057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMA.csv [2025-09-26T22:16:27.990256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HFRO.csv [2025-09-26T22:16:27.990380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBB.csv [2025-09-26T22:16:27.990524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALIT.csv [2025-09-26T22:16:27.990698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAN.csv [2025-09-26T22:16:27.990829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRM.csv [2025-09-26T22:16:27.990946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AME.csv [2025-09-26T22:16:27.991123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZB.csv [2025-09-26T22:16:27.991359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CABO.csv [2025-09-26T22:16:27.991540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKRS.csv [2025-09-26T22:16:27.991693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXN.csv [2025-09-26T22:16:27.991857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJD.csv [2025-09-26T22:16:27.992047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBB.csv [2025-09-26T22:16:27.992180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDM.csv [2025-09-26T22:16:27.992285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRC.csv [2025-09-26T22:16:27.992446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGA.csv [2025-09-26T22:16:27.992903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BE.csv [2025-09-26T22:16:27.993028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRA.csv [2025-09-26T22:16:27.993135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OII.csv [2025-09-26T22:16:27.993262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OCFT.csv [2025-09-26T22:16:27.993387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGB.csv [2025-09-26T22:16:27.993488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTM.csv [2025-09-26T22:16:27.993959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BANC.csv [2025-09-26T22:16:27.994121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSTK.csv [2025-09-26T22:16:27.994292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FC.csv [2025-09-26T22:16:27.994466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMED.csv [2025-09-26T22:16:27.994803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EL.csv [2025-09-26T22:16:27.995462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBVA.csv [2025-09-26T22:16:27.995920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJT.csv [2025-09-26T22:16:27.996076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEI.csv [2025-09-26T22:16:27.996216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXDT.csv [2025-09-26T22:16:27.996635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGS.csv [2025-09-26T22:16:27.996815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUSA.csv [2025-09-26T22:16:27.996944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OHI.csv [2025-09-26T22:16:27.997120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTLE.csv [2025-09-26T22:16:27.997287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELV.csv [2025-09-26T22:16:27.997480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAH.csv [2025-09-26T22:16:27.997622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSQ.csv [2025-09-26T22:16:27.997821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIAX.csv [2025-09-26T22:16:27.998171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDC.csv [2025-09-26T22:16:27.998293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRUC.csv [2025-09-26T22:16:27.998437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIL.csv [2025-09-26T22:16:27.998915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHVN.csv [2025-09-26T22:16:27.999106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHS.csv [2025-09-26T22:16:27.999323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSX.csv [2025-09-26T22:16:27.999487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAG.csv [2025-09-26T22:16:28.000004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHG.csv [2025-09-26T22:16:28.000135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVH.csv [2025-09-26T22:16:28.000362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASR.csv [2025-09-26T22:16:28.000512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFS.csv [2025-09-26T22:16:28.000666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOV.csv [2025-09-26T22:16:28.000894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BORR.csv [2025-09-26T22:16:28.001072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BY.csv [2025-09-26T22:16:28.001227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IONQ.csv [2025-09-26T22:16:28.001368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBBB.csv [2025-09-26T22:16:28.001598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEQ.csv [2025-09-26T22:16:28.001775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZF.csv [2025-09-26T22:16:28.001941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPH.csv [2025-09-26T22:16:28.002065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REX.csv [2025-09-26T22:16:28.002165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFII.csv [2025-09-26T22:16:28.002793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHO.csv [2025-09-26T22:16:28.002922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIM.csv [2025-09-26T22:16:28.003032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZB.csv [2025-09-26T22:16:28.003189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXFR.csv [2025-09-26T22:16:28.003631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBL.csv [2025-09-26T22:16:28.004012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCSF.csv [2025-09-26T22:16:28.004215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKN.csv [2025-09-26T22:16:28.004361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFG.csv [2025-09-26T22:16:28.004508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOC.csv [2025-09-26T22:16:28.004672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSLX.csv [2025-09-26T22:16:28.004817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUNA.csv [2025-09-26T22:16:28.004951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVG.csv [2025-09-26T22:16:28.005120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHG.csv [2025-09-26T22:16:28.005244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFO.csv [2025-09-26T22:16:28.005368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVR.csv [2025-09-26T22:16:28.005515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANVS.csv [2025-09-26T22:16:28.005731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUBO.csv [2025-09-26T22:16:28.005910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IOT.csv [2025-09-26T22:16:28.006036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXJ.csv [2025-09-26T22:16:28.006252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLW.csv [2025-09-26T22:16:28.006420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBH.csv [2025-09-26T22:16:28.006561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHPT.csv [2025-09-26T22:16:28.006713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORN.csv [2025-09-26T22:16:28.006836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGS.csv [2025-09-26T22:16:28.006980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOF.csv [2025-09-26T22:16:28.007109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORC.csv [2025-09-26T22:16:28.007280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAL.csv [2025-09-26T22:16:28.007439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMR.csv [2025-09-26T22:16:28.007588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHI.csv [2025-09-26T22:16:28.007772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIS.csv [2025-09-26T22:16:28.007897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUX.csv [2025-09-26T22:16:28.008041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TS.csv [2025-09-26T22:16:28.008193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVT.csv [2025-09-26T22:16:28.008356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICE.csv [2025-09-26T22:16:28.008502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPNT.csv [2025-09-26T22:16:28.008893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CODI.csv [2025-09-26T22:16:28.009022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRLB.csv [2025-09-26T22:16:28.009130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKG.csv [2025-09-26T22:16:28.009253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZM.csv [2025-09-26T22:16:28.009448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAT.csv [2025-09-26T22:16:28.009608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAFN.csv [2025-09-26T22:16:28.009792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMZ.csv [2025-09-26T22:16:28.009949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAND.csv [2025-09-26T22:16:28.010140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAF.csv [2025-09-26T22:16:28.010291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRMN.csv [2025-09-26T22:16:28.010439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIB.csv [2025-09-26T22:16:28.010584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCLH.csv [2025-09-26T22:16:28.010844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPB.csv [2025-09-26T22:16:28.010993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JQC.csv [2025-09-26T22:16:28.011167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDDY.csv [2025-09-26T22:16:28.011344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCY.csv [2025-09-26T22:16:28.011541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMT.csv [2025-09-26T22:16:28.011724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DE.csv [2025-09-26T22:16:28.011875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FN.csv [2025-09-26T22:16:28.012017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFM.csv [2025-09-26T22:16:28.012166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFA.csv [2025-09-26T22:16:28.012420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RACE.csv [2025-09-26T22:16:28.012709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAM.csv [2025-09-26T22:16:28.012843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIN.csv [2025-09-26T22:16:28.013001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIX.csv [2025-09-26T22:16:28.013285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABBV.csv [2025-09-26T22:16:28.013444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFX.csv [2025-09-26T22:16:28.013622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMS.csv [2025-09-26T22:16:28.013791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFI.csv [2025-09-26T22:16:28.013934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDO.csv [2025-09-26T22:16:28.014072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCM.csv [2025-09-26T22:16:28.014232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDOC.csv [2025-09-26T22:16:28.014365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMT.csv [2025-09-26T22:16:28.014467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKX.csv [2025-09-26T22:16:28.014583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDU.csv [2025-09-26T22:16:28.014736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPM.csv [2025-09-26T22:16:28.014994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZGN.csv [2025-09-26T22:16:28.015145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/POST.csv [2025-09-26T22:16:28.015310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAVA.csv [2025-09-26T22:16:28.015466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETJ.csv [2025-09-26T22:16:28.015633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLC.csv [2025-09-26T22:16:28.015807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NINE.csv [2025-09-26T22:16:28.015984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEVI.csv [2025-09-26T22:16:28.016129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAT.csv [2025-09-26T22:16:28.016572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBUC.csv [2025-09-26T22:16:28.016738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMB.csv [2025-09-26T22:16:28.016896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTK.csv [2025-09-26T22:16:28.017026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BABA.csv [2025-09-26T22:16:28.017138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGZ.csv [2025-09-26T22:16:28.017288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ET.csv [2025-09-26T22:16:28.017715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTF.csv [2025-09-26T22:16:28.017903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMT.csv [2025-09-26T22:16:28.018125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZBH.csv [2025-09-26T22:16:28.018356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STN.csv [2025-09-26T22:16:28.018497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUG.csv [2025-09-26T22:16:28.018750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPP.csv [2025-09-26T22:16:28.018919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTD.csv [2025-09-26T22:16:28.019057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OI.csv [2025-09-26T22:16:28.019201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTAL.csv [2025-09-26T22:16:28.019353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDV.csv [2025-09-26T22:16:28.019493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPI.csv [2025-09-26T22:16:28.019662] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WELL.csv [2025-09-26T22:16:28.019842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMC.csv [2025-09-26T22:16:28.020008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASH.csv [2025-09-26T22:16:28.020152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVLV.csv [2025-09-26T22:16:28.020347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TT.csv [2025-09-26T22:16:28.020580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYF.csv [2025-09-26T22:16:28.020775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PR.csv [2025-09-26T22:16:28.020991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAR.csv [2025-09-26T22:16:28.021184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBL.csv [2025-09-26T22:16:28.021308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MT.csv [2025-09-26T22:16:28.021451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCC.csv [2025-09-26T22:16:28.021827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIS.csv [2025-09-26T22:16:28.021990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RES.csv [2025-09-26T22:16:28.022419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDX.csv [2025-09-26T22:16:28.022565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KREF.csv [2025-09-26T22:16:28.022725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUJ.csv [2025-09-26T22:16:28.022882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRGO.csv [2025-09-26T22:16:28.023026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRO.csv [2025-09-26T22:16:28.023239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAP.csv [2025-09-26T22:16:28.023398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCX.csv [2025-09-26T22:16:28.023534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMI.csv [2025-09-26T22:16:28.023722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPMT.csv [2025-09-26T22:16:28.023863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SON.csv [2025-09-26T22:16:28.024026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPF.csv [2025-09-26T22:16:28.024149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAP.csv [2025-09-26T22:16:28.024266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLKP.csv [2025-09-26T22:16:28.024404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCD.csv [2025-09-26T22:16:28.024526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCO.csv [2025-09-26T22:16:28.024678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRP.csv [2025-09-26T22:16:28.024823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTC.csv [2025-09-26T22:16:28.024959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RITM.csv [2025-09-26T22:16:28.025058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMD.csv [2025-09-26T22:16:28.025198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVUE.csv [2025-09-26T22:16:28.025347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWK.csv [2025-09-26T22:16:28.025499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXR.csv [2025-09-26T22:16:28.025618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRKS.csv [2025-09-26T22:16:28.025780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTDD.csv [2025-09-26T22:16:28.025922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SA.csv [2025-09-26T22:16:28.026104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNL.csv [2025-09-26T22:16:28.026248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXO.csv [2025-09-26T22:16:28.026389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RRX.csv [2025-09-26T22:16:28.026534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRU.csv [2025-09-26T22:16:28.026787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIMS.csv [2025-09-26T22:16:28.026943] [INFO ] [LOCAL ] Deleted 1941 derivative data files. [2025-09-26T22:16:28.027023] [INFO ] [LOCAL ] Scanning primary storage for available symbols. [2025-09-26T22:16:28.029158] [INFO ] [LOCAL ] Found 2074 symbols with primary data. [2025-09-26T22:16:28.029623] [INFO ] [MAIN ] Starting parallel derivative generation with 3 worker threads for 2074 symbols [2025-09-26T22:16:28.032110] [INFO ] [MAIN ] AA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:28.031838] [INFO ] [MAIN ] A: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:28.032824] [INFO ] [MAIN ] AAP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:28.183405] [DEBUG] [LOCAL ] AAP: Loaded 52789 existing records from primary storage. [2025-09-26T22:16:28.185070] [INFO ] [MAIN ] AAP: Loaded 52789 primary data records. [2025-09-26T22:16:28.204247] [DEBUG] [LOCAL ] AA: Loaded 54394 existing records from primary storage. [2025-09-26T22:16:28.224698] [INFO ] [MAIN ] AA: Loaded 54394 primary data records. [2025-09-26T22:16:28.211925] [DEBUG] [LOCAL ] A: Loaded 51487 existing records from primary storage. [2025-09-26T22:16:28.330538] [INFO ] [MAIN ] A: Loaded 51487 primary data records. [2025-09-26T22:16:29.376508] [DEBUG] [MAIN ] AAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:29.378117] [INFO ] [MAIN ] AAP: Generated 1820 derivative records from 52789 primary records. [2025-09-26T22:16:29.378521] [DEBUG] [LOCAL ] AAP: Saving derivative data. [2025-09-26T22:16:29.393808] [DEBUG] [MAIN ] AA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:29.410845] [INFO ] [MAIN ] AA: Generated 1820 derivative records from 54394 primary records. [2025-09-26T22:16:29.412167] [DEBUG] [LOCAL ] AA: Saving derivative data. [2025-09-26T22:16:29.438492] [DEBUG] [MAIN ] A: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:29.444856] [INFO ] [MAIN ] A: Generated 1820 derivative records from 51487 primary records. [2025-09-26T22:16:29.447516] [DEBUG] [LOCAL ] AAP: Derivative data saved (1820 records). [2025-09-26T22:16:29.447890] [DEBUG] [LOCAL ] A: Saving derivative data. [2025-09-26T22:16:29.448969] [INFO ] [MAIN ] AAP: Successfully saved derivative data. [2025-09-26T22:16:29.451351] [INFO ] [MAIN ] Derivative Progress: 1/2074 symbols completed. AAP took 1.4s. Estimated remaining: 49m 8s. Rate: 42.2 symbols/min [2025-09-26T22:16:29.452044] [INFO ] [MAIN ] AB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:29.465035] [DEBUG] [LOCAL ] AA: Derivative data saved (1820 records). [2025-09-26T22:16:29.469697] [INFO ] [MAIN ] AA: Successfully saved derivative data. [2025-09-26T22:16:29.473925] [DEBUG] [LOCAL ] A: Derivative data saved (1820 records). [2025-09-26T22:16:29.476690] [INFO ] [MAIN ] A: Successfully saved derivative data. [2025-09-26T22:16:29.476447] [INFO ] [MAIN ] Derivative Progress: 2/2074 symbols completed. AA took 1.4s. Estimated remaining: 24m 59s. Rate: 82.9 symbols/min [2025-09-26T22:16:29.479331] [INFO ] [MAIN ] Derivative Progress: 3/2074 symbols completed. A took 1.4s. Estimated remaining: 16m 41s. Rate: 124.1 symbols/min [2025-09-26T22:16:29.479592] [INFO ] [MAIN ] ABBV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:29.480410] [INFO ] [MAIN ] ABCB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:29.508704] [DEBUG] [LOCAL ] AB: Loaded 28642 existing records from primary storage. [2025-09-26T22:16:29.509021] [INFO ] [MAIN ] AB: Loaded 28642 primary data records. [2025-09-26T22:16:29.672603] [DEBUG] [LOCAL ] ABCB: Loaded 31144 existing records from primary storage. [2025-09-26T22:16:29.702878] [INFO ] [MAIN ] ABCB: Loaded 31144 primary data records. [2025-09-26T22:16:29.986412] [DEBUG] [LOCAL ] ABBV: Loaded 54465 existing records from primary storage. [2025-09-26T22:16:30.005517] [INFO ] [MAIN ] ABBV: Loaded 54465 primary data records. [2025-09-26T22:16:30.621677] [DEBUG] [MAIN ] AB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:30.623148] [INFO ] [MAIN ] AB: Generated 1820 derivative records from 28642 primary records. [2025-09-26T22:16:30.624520] [DEBUG] [LOCAL ] AB: Saving derivative data. [2025-09-26T22:16:30.657334] [DEBUG] [MAIN ] ABCB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:30.659144] [INFO ] [MAIN ] ABCB: Generated 1820 derivative records from 31144 primary records. [2025-09-26T22:16:30.659611] [DEBUG] [LOCAL ] ABCB: Saving derivative data. [2025-09-26T22:16:30.677699] [DEBUG] [LOCAL ] AB: Derivative data saved (1820 records). [2025-09-26T22:16:30.678976] [INFO ] [MAIN ] AB: Successfully saved derivative data. [2025-09-26T22:16:30.678814] [DEBUG] [LOCAL ] ABCB: Derivative data saved (1820 records). [2025-09-26T22:16:30.682086] [INFO ] [MAIN ] Derivative Progress: 4/2074 symbols completed. AB took 1.2s. Estimated remaining: 22m 53s. Rate: 90.5 symbols/min [2025-09-26T22:16:30.680045] [INFO ] [MAIN ] ABCB: Successfully saved derivative data. [2025-09-26T22:16:30.685278] [INFO ] [MAIN ] Derivative Progress: 5/2074 symbols completed. ABCB took 1.2s. Estimated remaining: 18m 19s. Rate: 113.0 symbols/min [2025-09-26T22:16:30.682390] [INFO ] [MAIN ] ABEV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:30.686147] [INFO ] [MAIN ] ABG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:30.699702] [DEBUG] [MAIN ] ABBV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:30.700686] [INFO ] [MAIN ] ABBV: Generated 1820 derivative records from 54465 primary records. [2025-09-26T22:16:30.700883] [DEBUG] [LOCAL ] ABBV: Saving derivative data. [2025-09-26T22:16:30.720018] [DEBUG] [LOCAL ] ABBV: Derivative data saved (1820 records). [2025-09-26T22:16:30.720229] [INFO ] [MAIN ] ABBV: Successfully saved derivative data. [2025-09-26T22:16:30.722982] [INFO ] [MAIN ] Derivative Progress: 6/2074 symbols completed. ABBV took 1.2s. Estimated remaining: 15m 28s. Rate: 133.6 symbols/min [2025-09-26T22:16:30.723493] [INFO ] [MAIN ] ABM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:30.743405] [DEBUG] [LOCAL ] ABG: Loaded 19034 existing records from primary storage. [2025-09-26T22:16:30.743596] [INFO ] [MAIN ] ABG: Loaded 19034 primary data records. [2025-09-26T22:16:30.905475] [DEBUG] [LOCAL ] ABM: Loaded 32915 existing records from primary storage. [2025-09-26T22:16:30.916117] [INFO ] [MAIN ] ABM: Loaded 32915 primary data records. [2025-09-26T22:16:30.974605] [DEBUG] [LOCAL ] ABEV: Loaded 54055 existing records from primary storage. [2025-09-26T22:16:31.034548] [INFO ] [MAIN ] ABEV: Loaded 54055 primary data records. [2025-09-26T22:16:31.908196] [DEBUG] [MAIN ] ABG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:31.910206] [INFO ] [MAIN ] ABG: Generated 1820 derivative records from 19034 primary records. [2025-09-26T22:16:31.910897] [DEBUG] [LOCAL ] ABG: Saving derivative data. [2025-09-26T22:16:31.939456] [DEBUG] [LOCAL ] ABG: Derivative data saved (1820 records). [2025-09-26T22:16:31.940089] [INFO ] [MAIN ] ABG: Successfully saved derivative data. [2025-09-26T22:16:31.958006] [DEBUG] [MAIN ] ABM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:31.956225] [INFO ] [MAIN ] Derivative Progress: 7/2074 symbols completed. ABG took 1.3s. Estimated remaining: 19m 20s. Rate: 107.0 symbols/min [2025-09-26T22:16:31.960037] [INFO ] [MAIN ] ABM: Generated 1820 derivative records from 32915 primary records. [2025-09-26T22:16:31.960370] [INFO ] [MAIN ] ACA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:31.960739] [DEBUG] [LOCAL ] ABM: Saving derivative data. [2025-09-26T22:16:31.976060] [DEBUG] [MAIN ] ABEV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:31.989140] [INFO ] [MAIN ] ABEV: Generated 1820 derivative records from 54055 primary records. [2025-09-26T22:16:31.993971] [DEBUG] [LOCAL ] ABM: Derivative data saved (1820 records). [2025-09-26T22:16:31.994209] [INFO ] [MAIN ] ABM: Successfully saved derivative data. [2025-09-26T22:16:31.996530] [DEBUG] [LOCAL ] ABEV: Saving derivative data. [2025-09-26T22:16:31.996283] [INFO ] [MAIN ] Derivative Progress: 8/2074 symbols completed. ABM took 1.3s. Estimated remaining: 17m 4s. Rate: 121.0 symbols/min [2025-09-26T22:16:31.997420] [INFO ] [MAIN ] ACEL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:32.032197] [DEBUG] [LOCAL ] ABEV: Derivative data saved (1820 records). [2025-09-26T22:16:32.031485] [DEBUG] [LOCAL ] ACA: Loaded 24034 existing records from primary storage. [2025-09-26T22:16:32.032357] [INFO ] [MAIN ] ABEV: Successfully saved derivative data. [2025-09-26T22:16:32.032507] [INFO ] [MAIN ] ACA: Loaded 24034 primary data records. [2025-09-26T22:16:32.040433] [INFO ] [MAIN ] Derivative Progress: 9/2074 symbols completed. ABEV took 1.4s. Estimated remaining: 15m 20s. Rate: 134.6 symbols/min [2025-09-26T22:16:32.056043] [INFO ] [MAIN ] ACI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:32.167060] [DEBUG] [LOCAL ] ACEL: Loaded 27405 existing records from primary storage. [2025-09-26T22:16:32.173057] [INFO ] [MAIN ] ACEL: Loaded 27405 primary data records. [2025-09-26T22:16:32.626313] [DEBUG] [LOCAL ] ACI: Loaded 54044 existing records from primary storage. [2025-09-26T22:16:32.650300] [INFO ] [MAIN ] ACI: Loaded 54044 primary data records. [2025-09-26T22:16:33.130228] [DEBUG] [MAIN ] ACA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:33.131319] [INFO ] [MAIN ] ACA: Generated 1820 derivative records from 24034 primary records. [2025-09-26T22:16:33.131559] [DEBUG] [LOCAL ] ACA: Saving derivative data. [2025-09-26T22:16:33.150382] [DEBUG] [LOCAL ] ACA: Derivative data saved (1820 records). [2025-09-26T22:16:33.153511] [INFO ] [MAIN ] ACA: Successfully saved derivative data. [2025-09-26T22:16:33.156239] [INFO ] [MAIN ] Derivative Progress: 10/2074 symbols completed. ACA took 1.2s. Estimated remaining: 17m 38s. Rate: 117.0 symbols/min [2025-09-26T22:16:33.157823] [INFO ] [MAIN ] ACM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:33.172726] [DEBUG] [MAIN ] ACEL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:33.173734] [INFO ] [MAIN ] ACEL: Generated 1820 derivative records from 27405 primary records. [2025-09-26T22:16:33.173895] [DEBUG] [LOCAL ] ACEL: Saving derivative data. [2025-09-26T22:16:33.194070] [DEBUG] [LOCAL ] ACEL: Derivative data saved (1820 records). [2025-09-26T22:16:33.194511] [INFO ] [MAIN ] ACEL: Successfully saved derivative data. [2025-09-26T22:16:33.196766] [INFO ] [MAIN ] Derivative Progress: 11/2074 symbols completed. ACEL took 1.2s. Estimated remaining: 16m 9s. Rate: 127.7 symbols/min [2025-09-26T22:16:33.197353] [INFO ] [MAIN ] ACN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:33.219913] [DEBUG] [MAIN ] ACI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:33.221044] [INFO ] [MAIN ] ACI: Generated 1820 derivative records from 54044 primary records. [2025-09-26T22:16:33.221135] [DEBUG] [LOCAL ] ACI: Saving derivative data. [2025-09-26T22:16:33.249802] [DEBUG] [LOCAL ] ACI: Derivative data saved (1820 records). [2025-09-26T22:16:33.250016] [INFO ] [MAIN ] ACI: Successfully saved derivative data. [2025-09-26T22:16:33.252478] [INFO ] [MAIN ] Derivative Progress: 12/2074 symbols completed. ACI took 1.2s. Estimated remaining: 14m 58s. Rate: 137.8 symbols/min [2025-09-26T22:16:33.253835] [INFO ] [MAIN ] ACP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:33.269004] [DEBUG] [LOCAL ] ACM: Loaded 43767 existing records from primary storage. [2025-09-26T22:16:33.269331] [INFO ] [MAIN ] ACM: Loaded 43767 primary data records. [2025-09-26T22:16:33.537187] [DEBUG] [LOCAL ] ACP: Loaded 31428 existing records from primary storage. [2025-09-26T22:16:33.539978] [DEBUG] [LOCAL ] ACN: Loaded 54204 existing records from primary storage. [2025-09-26T22:16:33.667797] [INFO ] [MAIN ] ACP: Loaded 31428 primary data records. [2025-09-26T22:16:33.682381] [INFO ] [MAIN ] ACN: Loaded 54204 primary data records. [2025-09-26T22:16:34.418805] [DEBUG] [MAIN ] ACM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:34.420212] [INFO ] [MAIN ] ACM: Generated 1820 derivative records from 43767 primary records. [2025-09-26T22:16:34.421357] [DEBUG] [LOCAL ] ACM: Saving derivative data. [2025-09-26T22:16:34.441268] [DEBUG] [LOCAL ] ACM: Derivative data saved (1820 records). [2025-09-26T22:16:34.443927] [INFO ] [MAIN ] ACM: Successfully saved derivative data. [2025-09-26T22:16:34.446975] [INFO ] [MAIN ] Derivative Progress: 13/2074 symbols completed. ACM took 1.3s. Estimated remaining: 16m 57s. Rate: 121.5 symbols/min [2025-09-26T22:16:34.461424] [DEBUG] [MAIN ] ACP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:34.463310] [INFO ] [MAIN ] ACP: Generated 1820 derivative records from 31428 primary records. [2025-09-26T22:16:34.463448] [DEBUG] [LOCAL ] ACP: Saving derivative data. [2025-09-26T22:16:34.497833] [DEBUG] [MAIN ] ACN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:34.501462] [INFO ] [MAIN ] ACN: Generated 1820 derivative records from 54204 primary records. [2025-09-26T22:16:34.500486] [DEBUG] [LOCAL ] ACP: Derivative data saved (1820 records). [2025-09-26T22:16:34.501682] [INFO ] [MAIN ] ACP: Successfully saved derivative data. [2025-09-26T22:16:34.501607] [DEBUG] [LOCAL ] ACN: Saving derivative data. [2025-09-26T22:16:34.505168] [INFO ] [MAIN ] Derivative Progress: 14/2074 symbols completed. ACP took 1.3s. Estimated remaining: 15m 53s. Rate: 129.7 symbols/min [2025-09-26T22:16:34.523323] [DEBUG] [LOCAL ] ACN: Derivative data saved (1820 records). [2025-09-26T22:16:34.523480] [INFO ] [MAIN ] ACN: Successfully saved derivative data. [2025-09-26T22:16:34.526457] [INFO ] [MAIN ] Derivative Progress: 15/2074 symbols completed. ACN took 1.3s. Estimated remaining: 14m 52s. Rate: 138.5 symbols/min [2025-09-26T22:16:34.527324] [INFO ] [MAIN ] ACR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:34.527630] [INFO ] [MAIN ] ACV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:34.527938] [INFO ] [MAIN ] ACRE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:34.541455] [DEBUG] [LOCAL ] ACR: Loaded 6352 existing records from primary storage. [2025-09-26T22:16:34.544973] [INFO ] [MAIN ] ACR: Loaded 6352 primary data records. [2025-09-26T22:16:34.544901] [DEBUG] [LOCAL ] ACV: Loaded 7095 existing records from primary storage. [2025-09-26T22:16:34.556886] [INFO ] [MAIN ] ACV: Loaded 7095 primary data records. [2025-09-26T22:16:34.859958] [DEBUG] [LOCAL ] ACRE: Loaded 34027 existing records from primary storage. [2025-09-26T22:16:35.022819] [INFO ] [MAIN ] ACRE: Loaded 34027 primary data records. [2025-09-26T22:16:35.591837] [DEBUG] [MAIN ] ACR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:35.595004] [INFO ] [MAIN ] ACR: Generated 1820 derivative records from 6352 primary records. [2025-09-26T22:16:35.596048] [DEBUG] [LOCAL ] ACR: Saving derivative data. [2025-09-26T22:16:35.623554] [DEBUG] [MAIN ] ACV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:35.626137] [INFO ] [MAIN ] ACV: Generated 1820 derivative records from 7095 primary records. [2025-09-26T22:16:35.627502] [DEBUG] [LOCAL ] ACV: Saving derivative data. [2025-09-26T22:16:35.628914] [DEBUG] [LOCAL ] ACR: Derivative data saved (1820 records). [2025-09-26T22:16:35.629119] [INFO ] [MAIN ] ACR: Successfully saved derivative data. [2025-09-26T22:16:35.631972] [INFO ] [MAIN ] Derivative Progress: 16/2074 symbols completed. ACR took 1.1s. Estimated remaining: 16m 18s. Rate: 126.3 symbols/min [2025-09-26T22:16:35.633069] [INFO ] [MAIN ] ACVA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:35.671136] [DEBUG] [MAIN ] ACRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:35.673665] [INFO ] [MAIN ] ACRE: Generated 1820 derivative records from 34027 primary records. [2025-09-26T22:16:35.675899] [DEBUG] [LOCAL ] ACV: Derivative data saved (1820 records). [2025-09-26T22:16:35.675979] [DEBUG] [LOCAL ] ACRE: Saving derivative data. [2025-09-26T22:16:35.677801] [INFO ] [MAIN ] ACV: Successfully saved derivative data. [2025-09-26T22:16:35.692827] [INFO ] [MAIN ] Derivative Progress: 17/2074 symbols completed. ACV took 1.2s. Estimated remaining: 15m 27s. Rate: 133.1 symbols/min [2025-09-26T22:16:35.693486] [INFO ] [MAIN ] ADC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:35.703173] [DEBUG] [LOCAL ] ACRE: Derivative data saved (1820 records). [2025-09-26T22:16:35.703330] [INFO ] [MAIN ] ACRE: Successfully saved derivative data. [2025-09-26T22:16:35.706044] [INFO ] [MAIN ] Derivative Progress: 18/2074 symbols completed. ACRE took 1.2s. Estimated remaining: 14m 37s. Rate: 140.7 symbols/min [2025-09-26T22:16:35.706568] [INFO ] [MAIN ] ADCT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:35.770193] [DEBUG] [LOCAL ] ACVA: Loaded 50072 existing records from primary storage. [2025-09-26T22:16:35.771010] [INFO ] [MAIN ] ACVA: Loaded 50072 primary data records. [2025-09-26T22:16:35.872180] [DEBUG] [LOCAL ] ADC: Loaded 46934 existing records from primary storage. [2025-09-26T22:16:35.912032] [INFO ] [MAIN ] ADC: Loaded 46934 primary data records. [2025-09-26T22:16:35.911889] [DEBUG] [LOCAL ] ADCT: Loaded 34670 existing records from primary storage. [2025-09-26T22:16:35.962247] [INFO ] [MAIN ] ADCT: Loaded 34670 primary data records. [2025-09-26T22:16:36.875978] [DEBUG] [MAIN ] ACVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:36.877241] [INFO ] [MAIN ] ACVA: Generated 1820 derivative records from 50072 primary records. [2025-09-26T22:16:36.877478] [DEBUG] [LOCAL ] ACVA: Saving derivative data. [2025-09-26T22:16:36.898861] [DEBUG] [LOCAL ] ACVA: Derivative data saved (1820 records). [2025-09-26T22:16:36.901448] [INFO ] [MAIN ] ACVA: Successfully saved derivative data. [2025-09-26T22:16:36.903627] [INFO ] [MAIN ] Derivative Progress: 19/2074 symbols completed. ACVA took 1.3s. Estimated remaining: 15m 60s. Rate: 128.5 symbols/min [2025-09-26T22:16:36.904502] [INFO ] [MAIN ] ADM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:36.921402] [DEBUG] [MAIN ] ADCT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:36.923305] [INFO ] [MAIN ] ADCT: Generated 1820 derivative records from 34670 primary records. [2025-09-26T22:16:36.923476] [DEBUG] [LOCAL ] ADCT: Saving derivative data. [2025-09-26T22:16:36.946483] [DEBUG] [MAIN ] ADC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:36.950207] [INFO ] [MAIN ] ADC: Generated 1820 derivative records from 46934 primary records. [2025-09-26T22:16:36.950807] [DEBUG] [LOCAL ] ADC: Saving derivative data. [2025-09-26T22:16:36.956208] [DEBUG] [LOCAL ] ADCT: Derivative data saved (1820 records). [2025-09-26T22:16:36.967280] [INFO ] [MAIN ] ADCT: Successfully saved derivative data. [2025-09-26T22:16:36.971160] [INFO ] [MAIN ] Derivative Progress: 20/2074 symbols completed. ADCT took 1.3s. Estimated remaining: 15m 18s. Rate: 134.2 symbols/min [2025-09-26T22:16:36.972013] [INFO ] [MAIN ] ADNT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:36.976278] [DEBUG] [LOCAL ] ADC: Derivative data saved (1820 records). [2025-09-26T22:16:36.976413] [INFO ] [MAIN ] ADC: Successfully saved derivative data. [2025-09-26T22:16:36.979182] [INFO ] [MAIN ] Derivative Progress: 21/2074 symbols completed. ADC took 1.3s. Estimated remaining: 14m 35s. Rate: 140.8 symbols/min [2025-09-26T22:16:36.979622] [INFO ] [MAIN ] ADT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:37.025394] [DEBUG] [LOCAL ] ADM: Loaded 54175 existing records from primary storage. [2025-09-26T22:16:37.025689] [INFO ] [MAIN ] ADM: Loaded 54175 primary data records. [2025-09-26T22:16:37.206936] [DEBUG] [LOCAL ] ADNT: Loaded 48095 existing records from primary storage. [2025-09-26T22:16:37.287357] [DEBUG] [LOCAL ] ADT: Loaded 54253 existing records from primary storage. [2025-09-26T22:16:37.255756] [INFO ] [MAIN ] ADNT: Loaded 48095 primary data records. [2025-09-26T22:16:37.287703] [INFO ] [MAIN ] ADT: Loaded 54253 primary data records. [2025-09-26T22:16:38.175433] [DEBUG] [MAIN ] ADM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:38.177122] [INFO ] [MAIN ] ADM: Generated 1820 derivative records from 54175 primary records. [2025-09-26T22:16:38.177368] [DEBUG] [LOCAL ] ADM: Saving derivative data. [2025-09-26T22:16:38.209263] [DEBUG] [LOCAL ] ADM: Derivative data saved (1820 records). [2025-09-26T22:16:38.210073] [INFO ] [MAIN ] ADM: Successfully saved derivative data. [2025-09-26T22:16:38.212521] [INFO ] [MAIN ] Derivative Progress: 22/2074 symbols completed. ADM took 1.3s. Estimated remaining: 15m 50s. Rate: 129.6 symbols/min [2025-09-26T22:16:38.213385] [INFO ] [MAIN ] ADX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:38.236418] [DEBUG] [MAIN ] ADT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:38.237753] [INFO ] [MAIN ] ADT: Generated 1820 derivative records from 54253 primary records. [2025-09-26T22:16:38.237851] [DEBUG] [LOCAL ] ADT: Saving derivative data. [2025-09-26T22:16:38.253525] [DEBUG] [MAIN ] ADNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:38.264250] [INFO ] [MAIN ] ADNT: Generated 1820 derivative records from 48095 primary records. [2025-09-26T22:16:38.267370] [DEBUG] [LOCAL ] ADNT: Saving derivative data. [2025-09-26T22:16:38.295595] [DEBUG] [LOCAL ] ADT: Derivative data saved (1820 records). [2025-09-26T22:16:38.298129] [INFO ] [MAIN ] ADT: Successfully saved derivative data. [2025-09-26T22:16:38.300724] [INFO ] [MAIN ] Derivative Progress: 23/2074 symbols completed. ADT took 1.3s. Estimated remaining: 15m 16s. Rate: 134.4 symbols/min [2025-09-26T22:16:38.303458] [INFO ] [MAIN ] AEE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:38.306257] [DEBUG] [LOCAL ] ADNT: Derivative data saved (1820 records). [2025-09-26T22:16:38.307328] [INFO ] [MAIN ] ADNT: Successfully saved derivative data. [2025-09-26T22:16:38.317413] [INFO ] [MAIN ] Derivative Progress: 24/2074 symbols completed. ADNT took 1.3s. Estimated remaining: 14m 39s. Rate: 140.0 symbols/min [2025-09-26T22:16:38.319038] [INFO ] [MAIN ] AEFC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:38.320360] [DEBUG] [LOCAL ] ADX: Loaded 28180 existing records from primary storage. [2025-09-26T22:16:38.320709] [INFO ] [MAIN ] ADX: Loaded 28180 primary data records. [2025-09-26T22:16:38.445155] [DEBUG] [LOCAL ] AEFC: Loaded 8643 existing records from primary storage. [2025-09-26T22:16:38.445458] [INFO ] [MAIN ] AEFC: Loaded 8643 primary data records. [2025-09-26T22:16:38.845968] [DEBUG] [LOCAL ] AEE: Loaded 50875 existing records from primary storage. [2025-09-26T22:16:38.876538] [INFO ] [MAIN ] AEE: Loaded 50875 primary data records. [2025-09-26T22:16:39.409594] [DEBUG] [MAIN ] ADX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:39.411167] [INFO ] [MAIN ] ADX: Generated 1820 derivative records from 28180 primary records. [2025-09-26T22:16:39.411285] [DEBUG] [LOCAL ] ADX: Saving derivative data. [2025-09-26T22:16:39.438452] [DEBUG] [LOCAL ] ADX: Derivative data saved (1820 records). [2025-09-26T22:16:39.451878] [DEBUG] [MAIN ] AEFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:39.452149] [INFO ] [MAIN ] ADX: Successfully saved derivative data. [2025-09-26T22:16:39.453483] [INFO ] [MAIN ] AEFC: Generated 1820 derivative records from 8643 primary records. [2025-09-26T22:16:39.453859] [DEBUG] [LOCAL ] AEFC: Saving derivative data. [2025-09-26T22:16:39.456324] [INFO ] [MAIN ] Derivative Progress: 25/2074 symbols completed. ADX took 1.2s. Estimated remaining: 15m 37s. Rate: 131.3 symbols/min [2025-09-26T22:16:39.457931] [INFO ] [MAIN ] AEG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:39.478083] [DEBUG] [LOCAL ] AEFC: Derivative data saved (1820 records). [2025-09-26T22:16:39.478520] [INFO ] [MAIN ] AEFC: Successfully saved derivative data. [2025-09-26T22:16:39.482220] [INFO ] [MAIN ] Derivative Progress: 26/2074 symbols completed. AEFC took 1.2s. Estimated remaining: 15m 2s. Rate: 136.2 symbols/min [2025-09-26T22:16:39.483024] [INFO ] [MAIN ] AEO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:39.497715] [DEBUG] [MAIN ] AEE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:39.498945] [INFO ] [MAIN ] AEE: Generated 1820 derivative records from 50875 primary records. [2025-09-26T22:16:39.499068] [DEBUG] [LOCAL ] AEE: Saving derivative data. [2025-09-26T22:16:39.522572] [DEBUG] [LOCAL ] AEE: Derivative data saved (1820 records). [2025-09-26T22:16:39.522836] [INFO ] [MAIN ] AEE: Successfully saved derivative data. [2025-09-26T22:16:39.525001] [INFO ] [MAIN ] Derivative Progress: 27/2074 symbols completed. AEE took 1.2s. Estimated remaining: 14m 32s. Rate: 140.9 symbols/min [2025-09-26T22:16:39.525749] [INFO ] [MAIN ] AES: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:39.580816] [DEBUG] [LOCAL ] AEG: Loaded 50307 existing records from primary storage. [2025-09-26T22:16:39.581815] [INFO ] [MAIN ] AEG: Loaded 50307 primary data records. [2025-09-26T22:16:39.672593] [DEBUG] [LOCAL ] AEO: Loaded 54336 existing records from primary storage. [2025-09-26T22:16:39.722857] [INFO ] [MAIN ] AEO: Loaded 54336 primary data records. [2025-09-26T22:16:40.052353] [DEBUG] [LOCAL ] AES: Loaded 54450 existing records from primary storage. [2025-09-26T22:16:40.066343] [INFO ] [MAIN ] AES: Loaded 54450 primary data records. [2025-09-26T22:16:40.804048] [DEBUG] [MAIN ] AEG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:40.806161] [INFO ] [MAIN ] AEG: Generated 1820 derivative records from 50307 primary records. [2025-09-26T22:16:40.806700] [DEBUG] [LOCAL ] AEG: Saving derivative data. [2025-09-26T22:16:40.861463] [DEBUG] [MAIN ] AEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:40.864714] [DEBUG] [LOCAL ] AEG: Derivative data saved (1820 records). [2025-09-26T22:16:40.865917] [INFO ] [MAIN ] AEG: Successfully saved derivative data. [2025-09-26T22:16:40.868981] [INFO ] [MAIN ] Derivative Progress: 28/2074 symbols completed. AEG took 1.4s. Estimated remaining: 15m 38s. Rate: 130.8 symbols/min [2025-09-26T22:16:40.865547] [INFO ] [MAIN ] AEO: Generated 1820 derivative records from 54336 primary records. [2025-09-26T22:16:40.870268] [DEBUG] [LOCAL ] AEO: Saving derivative data. [2025-09-26T22:16:40.913591] [DEBUG] [MAIN ] AES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:40.915081] [DEBUG] [LOCAL ] AEO: Derivative data saved (1820 records). [2025-09-26T22:16:40.915200] [INFO ] [MAIN ] AEO: Successfully saved derivative data. [2025-09-26T22:16:40.916356] [INFO ] [MAIN ] AES: Generated 1820 derivative records from 54450 primary records. [2025-09-26T22:16:40.920208] [DEBUG] [LOCAL ] AES: Saving derivative data. [2025-09-26T22:16:40.920024] [INFO ] [MAIN ] Derivative Progress: 29/2074 symbols completed. AEO took 1.4s. Estimated remaining: 15m 9s. Rate: 135.0 symbols/min [2025-09-26T22:16:40.941268] [DEBUG] [LOCAL ] AES: Derivative data saved (1820 records). [2025-09-26T22:16:40.941425] [INFO ] [MAIN ] AES: Successfully saved derivative data. [2025-09-26T22:16:40.946814] [INFO ] [MAIN ] Derivative Progress: 30/2074 symbols completed. AES took 1.4s. Estimated remaining: 14m 40s. Rate: 139.3 symbols/min [2025-09-26T22:16:40.947919] [INFO ] [MAIN ] AFB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:40.948263] [INFO ] [MAIN ] AFGB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:40.948175] [INFO ] [MAIN ] AFG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:40.957144] [DEBUG] [LOCAL ] AFGB: Loaded 2404 existing records from primary storage. [2025-09-26T22:16:40.957343] [INFO ] [MAIN ] AFGB: Loaded 2404 primary data records. [2025-09-26T22:16:41.096255] [DEBUG] [LOCAL ] AFB: Loaded 11422 existing records from primary storage. [2025-09-26T22:16:41.120156] [INFO ] [MAIN ] AFB: Loaded 11422 primary data records. [2025-09-26T22:16:41.275469] [DEBUG] [LOCAL ] AFG: Loaded 33021 existing records from primary storage. [2025-09-26T22:16:41.314108] [INFO ] [MAIN ] AFG: Loaded 33021 primary data records. [2025-09-26T22:16:42.242768] [DEBUG] [MAIN ] AFGB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:42.256101] [INFO ] [MAIN ] AFGB: Generated 1820 derivative records from 2404 primary records. [2025-09-26T22:16:42.256773] [DEBUG] [MAIN ] AFB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:42.257447] [INFO ] [MAIN ] AFB: Generated 1820 derivative records from 11422 primary records. [2025-09-26T22:16:42.257550] [DEBUG] [LOCAL ] AFGB: Saving derivative data. [2025-09-26T22:16:42.259393] [DEBUG] [LOCAL ] AFB: Saving derivative data. [2025-09-26T22:16:42.303086] [DEBUG] [MAIN ] AFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:42.305872] [DEBUG] [LOCAL ] AFGB: Derivative data saved (1820 records). [2025-09-26T22:16:42.305151] [INFO ] [MAIN ] AFG: Generated 1820 derivative records from 33021 primary records. [2025-09-26T22:16:42.306529] [INFO ] [MAIN ] AFGB: Successfully saved derivative data. [2025-09-26T22:16:42.308793] [INFO ] [MAIN ] Derivative Progress: 31/2074 symbols completed. AFGB took 1.4s. Estimated remaining: 15m 41s. Rate: 130.3 symbols/min [2025-09-26T22:16:42.308913] [DEBUG] [LOCAL ] AFG: Saving derivative data. [2025-09-26T22:16:42.306615] [DEBUG] [LOCAL ] AFB: Derivative data saved (1820 records). [2025-09-26T22:16:42.309952] [INFO ] [MAIN ] AFB: Successfully saved derivative data. [2025-09-26T22:16:42.312962] [INFO ] [MAIN ] Derivative Progress: 32/2074 symbols completed. AFB took 1.4s. Estimated remaining: 15m 11s. Rate: 134.4 symbols/min [2025-09-26T22:16:42.310231] [INFO ] [MAIN ] AFGC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:42.325292] [INFO ] [MAIN ] AFGD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:42.334542] [DEBUG] [LOCAL ] AFGD: Loaded 1859 existing records from primary storage. [2025-09-26T22:16:42.334882] [INFO ] [MAIN ] AFGD: Loaded 1859 primary data records. [2025-09-26T22:16:42.334799] [DEBUG] [LOCAL ] AFGC: Loaded 2602 existing records from primary storage. [2025-09-26T22:16:42.369527] [INFO ] [MAIN ] AFGC: Loaded 2602 primary data records. [2025-09-26T22:16:42.403986] [DEBUG] [LOCAL ] AFG: Derivative data saved (1820 records). [2025-09-26T22:16:42.441021] [INFO ] [MAIN ] AFG: Successfully saved derivative data. [2025-09-26T22:16:42.487440] [INFO ] [MAIN ] Derivative Progress: 33/2074 symbols completed. AFG took 1.5s. Estimated remaining: 14m 54s. Rate: 136.9 symbols/min [2025-09-26T22:16:42.517946] [INFO ] [MAIN ] AG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:43.099534] [DEBUG] [LOCAL ] AG: Loaded 54423 existing records from primary storage. [2025-09-26T22:16:43.100788] [INFO ] [MAIN ] AG: Loaded 54423 primary data records. [2025-09-26T22:16:43.231324] [DEBUG] [MAIN ] AFGD: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-09-26T22:16:43.251279] [INFO ] [MAIN ] AFGD: Generated 1818 derivative records from 1859 primary records. [2025-09-26T22:16:43.257074] [DEBUG] [LOCAL ] AFGD: Saving derivative data. [2025-09-26T22:16:43.263196] [DEBUG] [MAIN ] AFGC: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:16:43.338983] [INFO ] [MAIN ] AFGC: Generated 1819 derivative records from 2602 primary records. [2025-09-26T22:16:43.345627] [DEBUG] [LOCAL ] AFGC: Saving derivative data. [2025-09-26T22:16:43.498209] [DEBUG] [LOCAL ] AFGD: Derivative data saved (1818 records). [2025-09-26T22:16:43.500040] [INFO ] [MAIN ] AFGD: Successfully saved derivative data. [2025-09-26T22:16:43.502722] [INFO ] [MAIN ] Derivative Progress: 34/2074 symbols completed. AFGD took 1.2s. Estimated remaining: 15m 28s. Rate: 131.8 symbols/min [2025-09-26T22:16:43.506504] [DEBUG] [LOCAL ] AFGC: Derivative data saved (1819 records). [2025-09-26T22:16:43.505225] [INFO ] [MAIN ] AGCO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:43.507416] [INFO ] [MAIN ] AFGC: Successfully saved derivative data. [2025-09-26T22:16:43.510705] [INFO ] [MAIN ] Derivative Progress: 35/2074 symbols completed. AFGC took 1.2s. Estimated remaining: 15m 2s. Rate: 135.6 symbols/min [2025-09-26T22:16:43.511734] [INFO ] [MAIN ] AGD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:43.542383] [DEBUG] [MAIN ] AG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:43.543305] [INFO ] [MAIN ] AG: Generated 1820 derivative records from 54423 primary records. [2025-09-26T22:16:43.543492] [DEBUG] [LOCAL ] AG: Saving derivative data. [2025-09-26T22:16:43.551564] [DEBUG] [LOCAL ] AGD: Loaded 17937 existing records from primary storage. [2025-09-26T22:16:43.562946] [INFO ] [MAIN ] AGD: Loaded 17937 primary data records. [2025-09-26T22:16:43.734909] [DEBUG] [LOCAL ] AG: Derivative data saved (1820 records). [2025-09-26T22:16:43.724120] [DEBUG] [LOCAL ] AGCO: Loaded 43086 existing records from primary storage. [2025-09-26T22:16:43.763911] [INFO ] [MAIN ] AG: Successfully saved derivative data. [2025-09-26T22:16:43.773441] [INFO ] [MAIN ] AGCO: Loaded 43086 primary data records. [2025-09-26T22:16:43.796115] [INFO ] [MAIN ] Derivative Progress: 36/2074 symbols completed. AG took 1.3s. Estimated remaining: 14m 53s. Rate: 137.0 symbols/min [2025-09-26T22:16:43.946293] [INFO ] [MAIN ] AGI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:44.301494] [DEBUG] [MAIN ] AGD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:44.316203] [INFO ] [MAIN ] AGD: Generated 1820 derivative records from 17937 primary records. [2025-09-26T22:16:44.317900] [DEBUG] [LOCAL ] AGD: Saving derivative data. [2025-09-26T22:16:44.329058] [DEBUG] [LOCAL ] AGI: Loaded 54195 existing records from primary storage. [2025-09-26T22:16:44.334924] [INFO ] [MAIN ] AGI: Loaded 54195 primary data records. [2025-09-26T22:16:44.361880] [DEBUG] [LOCAL ] AGD: Derivative data saved (1820 records). [2025-09-26T22:16:44.378763] [INFO ] [MAIN ] AGD: Successfully saved derivative data. [2025-09-26T22:16:44.433378] [INFO ] [MAIN ] Derivative Progress: 37/2074 symbols completed. AGD took 0.9s. Estimated remaining: 15m 3s. Rate: 135.3 symbols/min [2025-09-26T22:16:44.469061] [INFO ] [MAIN ] AGL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:44.576191] [DEBUG] [MAIN ] AGCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:44.692412] [INFO ] [MAIN ] AGCO: Generated 1820 derivative records from 43086 primary records. [2025-09-26T22:16:44.704027] [DEBUG] [LOCAL ] AGCO: Saving derivative data. [2025-09-26T22:16:44.728362] [DEBUG] [LOCAL ] AGCO: Derivative data saved (1820 records). [2025-09-26T22:16:44.728720] [INFO ] [MAIN ] AGCO: Successfully saved derivative data. [2025-09-26T22:16:44.731517] [INFO ] [MAIN ] Derivative Progress: 38/2074 symbols completed. AGCO took 1.2s. Estimated remaining: 14m 55s. Rate: 136.5 symbols/min [2025-09-26T22:16:44.732166] [INFO ] [MAIN ] AGM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:44.756005] [DEBUG] [MAIN ] AGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:44.761744] [INFO ] [MAIN ] AGI: Generated 1820 derivative records from 54195 primary records. [2025-09-26T22:16:44.762408] [DEBUG] [LOCAL ] AGI: Saving derivative data. [2025-09-26T22:16:44.762207] [DEBUG] [LOCAL ] AGM: Loaded 10125 existing records from primary storage. [2025-09-26T22:16:44.762682] [INFO ] [MAIN ] AGM: Loaded 10125 primary data records. [2025-09-26T22:16:44.951927] [DEBUG] [LOCAL ] AGL: Loaded 53191 existing records from primary storage. [2025-09-26T22:16:44.952093] [DEBUG] [LOCAL ] AGI: Derivative data saved (1820 records). [2025-09-26T22:16:44.953045] [INFO ] [MAIN ] AGI: Successfully saved derivative data. [2025-09-26T22:16:44.966012] [INFO ] [MAIN ] AGL: Loaded 53191 primary data records. [2025-09-26T22:16:44.960734] [INFO ] [MAIN ] Derivative Progress: 39/2074 symbols completed. AGI took 1.0s. Estimated remaining: 14m 43s. Rate: 138.2 symbols/min [2025-09-26T22:16:45.037585] [INFO ] [MAIN ] AGO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:45.581425] [DEBUG] [LOCAL ] AGO: Loaded 28356 existing records from primary storage. [2025-09-26T22:16:45.582001] [INFO ] [MAIN ] AGO: Loaded 28356 primary data records. [2025-09-26T22:16:45.939565] [DEBUG] [MAIN ] AGM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:45.941870] [INFO ] [MAIN ] AGM: Generated 1820 derivative records from 10125 primary records. [2025-09-26T22:16:45.942078] [DEBUG] [LOCAL ] AGM: Saving derivative data. [2025-09-26T22:16:45.963161] [DEBUG] [LOCAL ] AGM: Derivative data saved (1820 records). [2025-09-26T22:16:45.964498] [INFO ] [MAIN ] AGM: Successfully saved derivative data. [2025-09-26T22:16:45.968358] [INFO ] [MAIN ] Derivative Progress: 40/2074 symbols completed. AGM took 1.2s. Estimated remaining: 15m 12s. Rate: 133.8 symbols/min [2025-09-26T22:16:45.970104] [INFO ] [MAIN ] AGRO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:45.985702] [DEBUG] [MAIN ] AGL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:45.986788] [INFO ] [MAIN ] AGL: Generated 1820 derivative records from 53191 primary records. [2025-09-26T22:16:45.987005] [DEBUG] [LOCAL ] AGL: Saving derivative data. [2025-09-26T22:16:46.009562] [DEBUG] [LOCAL ] AGL: Derivative data saved (1820 records). [2025-09-26T22:16:46.009884] [INFO ] [MAIN ] AGL: Successfully saved derivative data. [2025-09-26T22:16:46.012593] [INFO ] [MAIN ] Derivative Progress: 41/2074 symbols completed. AGL took 1.5s. Estimated remaining: 14m 52s. Rate: 136.8 symbols/min [2025-09-26T22:16:46.013228] [INFO ] [MAIN ] AGX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:46.035585] [DEBUG] [MAIN ] AGO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:46.036796] [INFO ] [MAIN ] AGO: Generated 1820 derivative records from 28356 primary records. [2025-09-26T22:16:46.037073] [DEBUG] [LOCAL ] AGO: Saving derivative data. [2025-09-26T22:16:46.065906] [DEBUG] [LOCAL ] AGO: Derivative data saved (1820 records). [2025-09-26T22:16:46.066019] [INFO ] [MAIN ] AGO: Successfully saved derivative data. [2025-09-26T22:16:46.065763] [DEBUG] [LOCAL ] AGRO: Loaded 34097 existing records from primary storage. [2025-09-26T22:16:46.066130] [INFO ] [MAIN ] AGRO: Loaded 34097 primary data records. [2025-09-26T22:16:46.068588] [INFO ] [MAIN ] Derivative Progress: 42/2074 symbols completed. AGO took 1.0s. Estimated remaining: 14m 33s. Rate: 139.7 symbols/min [2025-09-26T22:16:46.074019] [INFO ] [MAIN ] AHR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:46.237608] [DEBUG] [LOCAL ] AGX: Loaded 33823 existing records from primary storage. [2025-09-26T22:16:46.270740] [INFO ] [MAIN ] AGX: Loaded 33823 primary data records. [2025-09-26T22:16:46.596859] [DEBUG] [LOCAL ] AHR: Loaded 49946 existing records from primary storage. [2025-09-26T22:16:46.647523] [INFO ] [MAIN ] AHR: Loaded 49946 primary data records. [2025-09-26T22:16:47.192184] [DEBUG] [MAIN ] AGRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:47.194152] [INFO ] [MAIN ] AGRO: Generated 1820 derivative records from 34097 primary records. [2025-09-26T22:16:47.195111] [DEBUG] [LOCAL ] AGRO: Saving derivative data. [2025-09-26T22:16:47.217961] [DEBUG] [LOCAL ] AGRO: Derivative data saved (1820 records). [2025-09-26T22:16:47.218384] [INFO ] [MAIN ] AGRO: Successfully saved derivative data. [2025-09-26T22:16:47.221147] [INFO ] [MAIN ] Derivative Progress: 43/2074 symbols completed. AGRO took 1.3s. Estimated remaining: 15m 6s. Rate: 134.4 symbols/min [2025-09-26T22:16:47.237335] [DEBUG] [MAIN ] AGX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:47.238314] [INFO ] [MAIN ] AGX: Generated 1820 derivative records from 33823 primary records. [2025-09-26T22:16:47.238692] [DEBUG] [LOCAL ] AGX: Saving derivative data. [2025-09-26T22:16:47.260597] [DEBUG] [LOCAL ] AGX: Derivative data saved (1820 records). [2025-09-26T22:16:47.260950] [INFO ] [MAIN ] AGX: Successfully saved derivative data. [2025-09-26T22:16:47.276408] [INFO ] [MAIN ] Derivative Progress: 44/2074 symbols completed. AGX took 1.3s. Estimated remaining: 14m 48s. Rate: 137.2 symbols/min [2025-09-26T22:16:47.276947] [DEBUG] [MAIN ] AHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:47.277992] [INFO ] [MAIN ] AHR: Generated 1820 derivative records from 49946 primary records. [2025-09-26T22:16:47.278064] [DEBUG] [LOCAL ] AHR: Saving derivative data. [2025-09-26T22:16:47.294551] [DEBUG] [LOCAL ] AHR: Derivative data saved (1820 records). [2025-09-26T22:16:47.294633] [INFO ] [MAIN ] AHR: Successfully saved derivative data. [2025-09-26T22:16:47.298125] [INFO ] [MAIN ] Derivative Progress: 45/2074 symbols completed. AHR took 1.2s. Estimated remaining: 14m 29s. Rate: 140.1 symbols/min [2025-09-26T22:16:47.299280] [INFO ] [MAIN ] AI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:47.299515] [INFO ] [MAIN ] AHT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:47.299730] [INFO ] [MAIN ] AIG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:47.312020] [DEBUG] [LOCAL ] AHT: Loaded 6181 existing records from primary storage. [2025-09-26T22:16:47.312243] [INFO ] [MAIN ] AHT: Loaded 6181 primary data records. [2025-09-26T22:16:47.715019] [DEBUG] [LOCAL ] AI: Loaded 54529 existing records from primary storage. [2025-09-26T22:16:47.732810] [INFO ] [MAIN ] AI: Loaded 54529 primary data records. [2025-09-26T22:16:47.747457] [DEBUG] [LOCAL ] AIG: Loaded 54254 existing records from primary storage. [2025-09-26T22:16:47.767109] [INFO ] [MAIN ] AIG: Loaded 54254 primary data records. [2025-09-26T22:16:48.445717] [DEBUG] [MAIN ] AHT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:48.447241] [INFO ] [MAIN ] AHT: Generated 1820 derivative records from 6181 primary records. [2025-09-26T22:16:48.449002] [DEBUG] [LOCAL ] AHT: Saving derivative data. [2025-09-26T22:16:48.466271] [DEBUG] [LOCAL ] AHT: Derivative data saved (1820 records). [2025-09-26T22:16:48.468208] [INFO ] [MAIN ] AHT: Successfully saved derivative data. [2025-09-26T22:16:48.471953] [INFO ] [MAIN ] Derivative Progress: 46/2074 symbols completed. AHT took 1.2s. Estimated remaining: 15m 1s. Rate: 135.0 symbols/min [2025-09-26T22:16:48.472887] [INFO ] [MAIN ] AIN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:48.497992] [DEBUG] [MAIN ] AI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:48.511229] [INFO ] [MAIN ] AI: Generated 1820 derivative records from 54529 primary records. [2025-09-26T22:16:48.511714] [DEBUG] [LOCAL ] AI: Saving derivative data. [2025-09-26T22:16:48.513104] [DEBUG] [MAIN ] AIG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:48.520814] [INFO ] [MAIN ] AIG: Generated 1820 derivative records from 54254 primary records. [2025-09-26T22:16:48.521307] [DEBUG] [LOCAL ] AIG: Saving derivative data. [2025-09-26T22:16:48.560551] [DEBUG] [LOCAL ] AIN: Loaded 24906 existing records from primary storage. [2025-09-26T22:16:48.561772] [INFO ] [MAIN ] AIN: Loaded 24906 primary data records. [2025-09-26T22:16:48.606896] [DEBUG] [LOCAL ] AI: Derivative data saved (1820 records). [2025-09-26T22:16:48.621787] [DEBUG] [LOCAL ] AIG: Derivative data saved (1820 records). [2025-09-26T22:16:48.639463] [INFO ] [MAIN ] AIG: Successfully saved derivative data. [2025-09-26T22:16:48.621687] [INFO ] [MAIN ] AI: Successfully saved derivative data. [2025-09-26T22:16:48.641971] [INFO ] [MAIN ] Derivative Progress: 47/2074 symbols completed. AI took 1.3s. Estimated remaining: 14m 49s. Rate: 136.8 symbols/min [2025-09-26T22:16:48.649847] [INFO ] [MAIN ] AIO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:48.650119] [INFO ] [MAIN ] Derivative Progress: 48/2074 symbols completed. AIG took 1.3s. Estimated remaining: 14m 30s. Rate: 139.7 symbols/min [2025-09-26T22:16:48.675865] [INFO ] [MAIN ] AIT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:48.796239] [DEBUG] [LOCAL ] AIO: Loaded 13477 existing records from primary storage. [2025-09-26T22:16:48.906313] [INFO ] [MAIN ] AIO: Loaded 13477 primary data records. [2025-09-26T22:16:49.052792] [DEBUG] [LOCAL ] AIT: Loaded 28208 existing records from primary storage. [2025-09-26T22:16:49.067333] [INFO ] [MAIN ] AIT: Loaded 28208 primary data records. [2025-09-26T22:16:49.716032] [DEBUG] [MAIN ] AIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:49.718220] [INFO ] [MAIN ] AIN: Generated 1820 derivative records from 24906 primary records. [2025-09-26T22:16:49.719882] [DEBUG] [LOCAL ] AIN: Saving derivative data. [2025-09-26T22:16:49.749976] [DEBUG] [LOCAL ] AIN: Derivative data saved (1820 records). [2025-09-26T22:16:49.751786] [INFO ] [MAIN ] AIN: Successfully saved derivative data. [2025-09-26T22:16:49.755986] [INFO ] [MAIN ] Derivative Progress: 49/2074 symbols completed. AIN took 1.3s. Estimated remaining: 14m 58s. Rate: 135.3 symbols/min [2025-09-26T22:16:49.758525] [INFO ] [MAIN ] AIV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:49.774591] [DEBUG] [MAIN ] AIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:49.775718] [INFO ] [MAIN ] AIO: Generated 1820 derivative records from 13477 primary records. [2025-09-26T22:16:49.775855] [DEBUG] [LOCAL ] AIO: Saving derivative data. [2025-09-26T22:16:49.809948] [DEBUG] [MAIN ] AIT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:49.812373] [DEBUG] [LOCAL ] AIO: Derivative data saved (1820 records). [2025-09-26T22:16:49.811795] [INFO ] [MAIN ] AIT: Generated 1820 derivative records from 28208 primary records. [2025-09-26T22:16:49.812581] [DEBUG] [LOCAL ] AIT: Saving derivative data. [2025-09-26T22:16:49.812690] [INFO ] [MAIN ] AIO: Successfully saved derivative data. [2025-09-26T22:16:49.815482] [INFO ] [MAIN ] Derivative Progress: 50/2074 symbols completed. AIO took 1.2s. Estimated remaining: 14m 42s. Rate: 137.7 symbols/min [2025-09-26T22:16:49.827281] [INFO ] [MAIN ] AIZ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:49.845907] [DEBUG] [LOCAL ] AIT: Derivative data saved (1820 records). [2025-09-26T22:16:49.858660] [INFO ] [MAIN ] AIT: Successfully saved derivative data. [2025-09-26T22:16:49.860943] [INFO ] [MAIN ] Derivative Progress: 51/2074 symbols completed. AIT took 1.2s. Estimated remaining: 14m 26s. Rate: 140.2 symbols/min [2025-09-26T22:16:49.861418] [INFO ] [MAIN ] AIZN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:49.862896] [DEBUG] [LOCAL ] AIV: Loaded 40950 existing records from primary storage. [2025-09-26T22:16:49.863143] [INFO ] [MAIN ] AIV: Loaded 40950 primary data records. [2025-09-26T22:16:49.965952] [DEBUG] [LOCAL ] AIZN: Loaded 3935 existing records from primary storage. [2025-09-26T22:16:49.994773] [INFO ] [MAIN ] AIZN: Loaded 3935 primary data records. [2025-09-26T22:16:50.084704] [DEBUG] [LOCAL ] AIZ: Loaded 30543 existing records from primary storage. [2025-09-26T22:16:50.144887] [INFO ] [MAIN ] AIZ: Loaded 30543 primary data records. [2025-09-26T22:16:50.931549] [DEBUG] [MAIN ] AIV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:50.933037] [INFO ] [MAIN ] AIV: Generated 1820 derivative records from 40950 primary records. [2025-09-26T22:16:50.937167] [DEBUG] [LOCAL ] AIV: Saving derivative data. [2025-09-26T22:16:50.964684] [DEBUG] [MAIN ] AIZN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:50.970454] [INFO ] [MAIN ] AIZN: Generated 1820 derivative records from 3935 primary records. [2025-09-26T22:16:50.971638] [DEBUG] [LOCAL ] AIZN: Saving derivative data. [2025-09-26T22:16:50.974300] [DEBUG] [LOCAL ] AIV: Derivative data saved (1820 records). [2025-09-26T22:16:50.984365] [INFO ] [MAIN ] AIV: Successfully saved derivative data. [2025-09-26T22:16:50.986811] [INFO ] [MAIN ] Derivative Progress: 52/2074 symbols completed. AIV took 1.2s. Estimated remaining: 14m 53s. Rate: 135.9 symbols/min [2025-09-26T22:16:50.988894] [INFO ] [MAIN ] AJG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:51.005066] [DEBUG] [LOCAL ] AIZN: Derivative data saved (1820 records). [2025-09-26T22:16:51.005731] [INFO ] [MAIN ] AIZN: Successfully saved derivative data. [2025-09-26T22:16:51.005418] [DEBUG] [MAIN ] AIZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:51.006753] [INFO ] [MAIN ] AIZ: Generated 1820 derivative records from 30543 primary records. [2025-09-26T22:16:51.006867] [DEBUG] [LOCAL ] AIZ: Saving derivative data. [2025-09-26T22:16:51.010128] [INFO ] [MAIN ] Derivative Progress: 53/2074 symbols completed. AIZN took 1.1s. Estimated remaining: 14m 36s. Rate: 138.4 symbols/min [2025-09-26T22:16:51.011396] [INFO ] [MAIN ] AKR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:51.032265] [DEBUG] [LOCAL ] AIZ: Derivative data saved (1820 records). [2025-09-26T22:16:51.032549] [INFO ] [MAIN ] AIZ: Successfully saved derivative data. [2025-09-26T22:16:51.035176] [INFO ] [MAIN ] Derivative Progress: 54/2074 symbols completed. AIZ took 1.2s. Estimated remaining: 14m 21s. Rate: 140.8 symbols/min [2025-09-26T22:16:51.035696] [INFO ] [MAIN ] AL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:51.112166] [DEBUG] [LOCAL ] AKR: Loaded 46481 existing records from primary storage. [2025-09-26T22:16:51.113275] [INFO ] [MAIN ] AKR: Loaded 46481 primary data records. [2025-09-26T22:16:51.113073] [DEBUG] [LOCAL ] AJG: Loaded 47710 existing records from primary storage. [2025-09-26T22:16:51.113510] [INFO ] [MAIN ] AJG: Loaded 47710 primary data records. [2025-09-26T22:16:51.373894] [DEBUG] [LOCAL ] AL: Loaded 44831 existing records from primary storage. [2025-09-26T22:16:51.433796] [INFO ] [MAIN ] AL: Loaded 44831 primary data records. [2025-09-26T22:16:52.233320] [DEBUG] [MAIN ] AJG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:52.234029] [DEBUG] [MAIN ] AKR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:52.235017] [INFO ] [MAIN ] AJG: Generated 1820 derivative records from 47710 primary records. [2025-09-26T22:16:52.236383] [INFO ] [MAIN ] AKR: Generated 1820 derivative records from 46481 primary records. [2025-09-26T22:16:52.236694] [DEBUG] [LOCAL ] AJG: Saving derivative data. [2025-09-26T22:16:52.236804] [DEBUG] [LOCAL ] AKR: Saving derivative data. [2025-09-26T22:16:52.275440] [DEBUG] [LOCAL ] AKR: Derivative data saved (1820 records). [2025-09-26T22:16:52.275992] [INFO ] [MAIN ] AKR: Successfully saved derivative data. [2025-09-26T22:16:52.280470] [INFO ] [MAIN ] Derivative Progress: 55/2074 symbols completed. AKR took 1.3s. Estimated remaining: 14m 50s. Rate: 136.1 symbols/min [2025-09-26T22:16:52.281356] [INFO ] [MAIN ] ALB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:52.298180] [DEBUG] [MAIN ] AL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:52.298331] [DEBUG] [LOCAL ] AJG: Derivative data saved (1820 records). [2025-09-26T22:16:52.299516] [INFO ] [MAIN ] AL: Generated 1820 derivative records from 44831 primary records. [2025-09-26T22:16:52.299752] [DEBUG] [LOCAL ] AL: Saving derivative data. [2025-09-26T22:16:52.300934] [INFO ] [MAIN ] AJG: Successfully saved derivative data. [2025-09-26T22:16:52.315671] [INFO ] [MAIN ] Derivative Progress: 56/2074 symbols completed. AJG took 1.3s. Estimated remaining: 14m 35s. Rate: 138.3 symbols/min [2025-09-26T22:16:52.316637] [INFO ] [MAIN ] ALC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:52.321238] [DEBUG] [LOCAL ] AL: Derivative data saved (1820 records). [2025-09-26T22:16:52.321444] [INFO ] [MAIN ] AL: Successfully saved derivative data. [2025-09-26T22:16:52.324115] [INFO ] [MAIN ] Derivative Progress: 57/2074 symbols completed. AL took 1.3s. Estimated remaining: 14m 20s. Rate: 140.8 symbols/min [2025-09-26T22:16:52.324599] [INFO ] [MAIN ] ALE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:52.372717] [DEBUG] [LOCAL ] ALE: Loaded 30788 existing records from primary storage. [2025-09-26T22:16:52.372862] [INFO ] [MAIN ] ALE: Loaded 30788 primary data records. [2025-09-26T22:16:52.527236] [DEBUG] [LOCAL ] ALB: Loaded 54000 existing records from primary storage. [2025-09-26T22:16:52.583839] [INFO ] [MAIN ] ALB: Loaded 54000 primary data records. [2025-09-26T22:16:52.613597] [DEBUG] [LOCAL ] ALC: Loaded 51537 existing records from primary storage. [2025-09-26T22:16:52.746108] [INFO ] [MAIN ] ALC: Loaded 51537 primary data records. [2025-09-26T22:16:53.457700] [DEBUG] [MAIN ] ALE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:53.458673] [INFO ] [MAIN ] ALE: Generated 1820 derivative records from 30788 primary records. [2025-09-26T22:16:53.458894] [DEBUG] [LOCAL ] ALE: Saving derivative data. [2025-09-26T22:16:53.480585] [DEBUG] [LOCAL ] ALE: Derivative data saved (1820 records). [2025-09-26T22:16:53.481906] [INFO ] [MAIN ] ALE: Successfully saved derivative data. [2025-09-26T22:16:53.485222] [INFO ] [MAIN ] Derivative Progress: 58/2074 symbols completed. ALE took 1.2s. Estimated remaining: 14m 45s. Rate: 136.7 symbols/min [2025-09-26T22:16:53.499868] [DEBUG] [MAIN ] ALB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:53.501448] [INFO ] [MAIN ] ALB: Generated 1820 derivative records from 54000 primary records. [2025-09-26T22:16:53.502395] [DEBUG] [LOCAL ] ALB: Saving derivative data. [2025-09-26T22:16:53.529310] [DEBUG] [MAIN ] ALC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:53.531442] [INFO ] [MAIN ] ALC: Generated 1820 derivative records from 51537 primary records. [2025-09-26T22:16:53.534614] [DEBUG] [LOCAL ] ALB: Derivative data saved (1820 records). [2025-09-26T22:16:53.534712] [DEBUG] [LOCAL ] ALC: Saving derivative data. [2025-09-26T22:16:53.534796] [INFO ] [MAIN ] ALB: Successfully saved derivative data. [2025-09-26T22:16:53.537794] [INFO ] [MAIN ] Derivative Progress: 59/2074 symbols completed. ALB took 1.3s. Estimated remaining: 14m 31s. Rate: 138.8 symbols/min [2025-09-26T22:16:53.554030] [DEBUG] [LOCAL ] ALC: Derivative data saved (1820 records). [2025-09-26T22:16:53.554166] [INFO ] [MAIN ] ALC: Successfully saved derivative data. [2025-09-26T22:16:53.557589] [INFO ] [MAIN ] Derivative Progress: 60/2074 symbols completed. ALC took 1.2s. Estimated remaining: 14m 17s. Rate: 141.0 symbols/min [2025-09-26T22:16:53.558477] [INFO ] [MAIN ] ALIT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:53.558359] [INFO ] [MAIN ] ALEX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:53.558766] [INFO ] [MAIN ] ALG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:53.573161] [DEBUG] [LOCAL ] ALG: Loaded 10562 existing records from primary storage. [2025-09-26T22:16:53.573323] [INFO ] [MAIN ] ALG: Loaded 10562 primary data records. [2025-09-26T22:16:53.796956] [DEBUG] [LOCAL ] ALEX: Loaded 31769 existing records from primary storage. [2025-09-26T22:16:53.934898] [INFO ] [MAIN ] ALEX: Loaded 31769 primary data records. [2025-09-26T22:16:54.031495] [DEBUG] [LOCAL ] ALIT: Loaded 53534 existing records from primary storage. [2025-09-26T22:16:54.045361] [INFO ] [MAIN ] ALIT: Loaded 53534 primary data records. [2025-09-26T22:16:54.653120] [DEBUG] [MAIN ] ALG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:54.654466] [INFO ] [MAIN ] ALG: Generated 1820 derivative records from 10562 primary records. [2025-09-26T22:16:54.654736] [DEBUG] [LOCAL ] ALG: Saving derivative data. [2025-09-26T22:16:54.677359] [DEBUG] [LOCAL ] ALG: Derivative data saved (1820 records). [2025-09-26T22:16:54.679581] [INFO ] [MAIN ] ALG: Successfully saved derivative data. [2025-09-26T22:16:54.682482] [INFO ] [MAIN ] Derivative Progress: 61/2074 symbols completed. ALG took 1.1s. Estimated remaining: 14m 40s. Rate: 137.3 symbols/min [2025-09-26T22:16:54.683064] [INFO ] [MAIN ] ALK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:54.698512] [DEBUG] [MAIN ] ALEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:54.699670] [INFO ] [MAIN ] ALEX: Generated 1820 derivative records from 31769 primary records. [2025-09-26T22:16:54.700749] [DEBUG] [LOCAL ] ALEX: Saving derivative data. [2025-09-26T22:16:54.731672] [DEBUG] [MAIN ] ALIT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:54.733022] [INFO ] [MAIN ] ALIT: Generated 1820 derivative records from 53534 primary records. [2025-09-26T22:16:54.733599] [DEBUG] [LOCAL ] ALIT: Saving derivative data. [2025-09-26T22:16:54.734454] [DEBUG] [LOCAL ] ALEX: Derivative data saved (1820 records). [2025-09-26T22:16:54.736827] [INFO ] [MAIN ] ALEX: Successfully saved derivative data. [2025-09-26T22:16:54.739263] [INFO ] [MAIN ] Derivative Progress: 62/2074 symbols completed. ALEX took 1.2s. Estimated remaining: 14m 27s. Rate: 139.3 symbols/min [2025-09-26T22:16:54.740108] [INFO ] [MAIN ] ALL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:54.757695] [DEBUG] [LOCAL ] ALIT: Derivative data saved (1820 records). [2025-09-26T22:16:54.758031] [INFO ] [MAIN ] ALIT: Successfully saved derivative data. [2025-09-26T22:16:54.760514] [INFO ] [MAIN ] Derivative Progress: 63/2074 symbols completed. ALIT took 1.2s. Estimated remaining: 14m 13s. Rate: 141.4 symbols/min [2025-09-26T22:16:54.760867] [INFO ] [MAIN ] ALLE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:54.812355] [DEBUG] [LOCAL ] ALK: Loaded 53840 existing records from primary storage. [2025-09-26T22:16:54.812699] [INFO ] [MAIN ] ALK: Loaded 53840 primary data records. [2025-09-26T22:16:54.994260] [DEBUG] [LOCAL ] ALLE: Loaded 45637 existing records from primary storage. [2025-09-26T22:16:55.025875] [INFO ] [MAIN ] ALLE: Loaded 45637 primary data records. [2025-09-26T22:16:55.172298] [DEBUG] [LOCAL ] ALL: Loaded 50903 existing records from primary storage. [2025-09-26T22:16:55.199326] [INFO ] [MAIN ] ALL: Loaded 50903 primary data records. [2025-09-26T22:16:55.933987] [DEBUG] [MAIN ] ALK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:55.935948] [INFO ] [MAIN ] ALK: Generated 1820 derivative records from 53840 primary records. [2025-09-26T22:16:55.937342] [DEBUG] [LOCAL ] ALK: Saving derivative data. [2025-09-26T22:16:55.961412] [DEBUG] [LOCAL ] ALK: Derivative data saved (1820 records). [2025-09-26T22:16:55.961900] [INFO ] [MAIN ] ALK: Successfully saved derivative data. [2025-09-26T22:16:55.964989] [INFO ] [MAIN ] Derivative Progress: 64/2074 symbols completed. ALK took 1.3s. Estimated remaining: 14m 37s. Rate: 137.5 symbols/min [2025-09-26T22:16:55.965393] [INFO ] [MAIN ] ALLY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:56.000318] [DEBUG] [MAIN ] ALL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:55.999958] [DEBUG] [MAIN ] ALLE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:56.001201] [INFO ] [MAIN ] ALL: Generated 1820 derivative records from 50903 primary records. [2025-09-26T22:16:56.001967] [DEBUG] [LOCAL ] ALL: Saving derivative data. [2025-09-26T22:16:56.001888] [INFO ] [MAIN ] ALLE: Generated 1820 derivative records from 45637 primary records. [2025-09-26T22:16:56.002791] [DEBUG] [LOCAL ] ALLE: Saving derivative data. [2025-09-26T22:16:56.039063] [DEBUG] [LOCAL ] ALL: Derivative data saved (1820 records). [2025-09-26T22:16:56.040350] [INFO ] [MAIN ] ALL: Successfully saved derivative data. [2025-09-26T22:16:56.043175] [INFO ] [MAIN ] Derivative Progress: 65/2074 symbols completed. ALL took 1.3s. Estimated remaining: 14m 26s. Rate: 139.2 symbols/min [2025-09-26T22:16:56.044263] [INFO ] [MAIN ] ALSN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:56.044925] [DEBUG] [LOCAL ] ALLE: Derivative data saved (1820 records). [2025-09-26T22:16:56.045018] [INFO ] [MAIN ] ALLE: Successfully saved derivative data. [2025-09-26T22:16:56.047462] [INFO ] [MAIN ] Derivative Progress: 66/2074 symbols completed. ALLE took 1.3s. Estimated remaining: 14m 12s. Rate: 141.3 symbols/min [2025-09-26T22:16:56.062699] [INFO ] [MAIN ] ALTG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:56.094616] [DEBUG] [LOCAL ] ALLY: Loaded 53997 existing records from primary storage. [2025-09-26T22:16:56.094977] [INFO ] [MAIN ] ALLY: Loaded 53997 primary data records. [2025-09-26T22:16:56.240976] [DEBUG] [LOCAL ] ALTG: Loaded 24161 existing records from primary storage. [2025-09-26T22:16:56.262955] [INFO ] [MAIN ] ALTG: Loaded 24161 primary data records. [2025-09-26T22:16:56.382203] [DEBUG] [LOCAL ] ALSN: Loaded 43953 existing records from primary storage. [2025-09-26T22:16:56.405551] [INFO ] [MAIN ] ALSN: Loaded 43953 primary data records. [2025-09-26T22:16:57.125988] [DEBUG] [MAIN ] ALLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:57.127069] [INFO ] [MAIN ] ALLY: Generated 1820 derivative records from 53997 primary records. [2025-09-26T22:16:57.127304] [DEBUG] [LOCAL ] ALLY: Saving derivative data. [2025-09-26T22:16:57.170492] [DEBUG] [MAIN ] ALTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:57.172390] [INFO ] [MAIN ] ALTG: Generated 1820 derivative records from 24161 primary records. [2025-09-26T22:16:57.172712] [DEBUG] [LOCAL ] ALTG: Saving derivative data. [2025-09-26T22:16:57.182531] [DEBUG] [LOCAL ] ALLY: Derivative data saved (1820 records). [2025-09-26T22:16:57.193560] [INFO ] [MAIN ] ALLY: Successfully saved derivative data. [2025-09-26T22:16:57.193468] [DEBUG] [LOCAL ] ALTG: Derivative data saved (1820 records). [2025-09-26T22:16:57.194006] [INFO ] [MAIN ] ALTG: Successfully saved derivative data. [2025-09-26T22:16:57.196860] [INFO ] [MAIN ] Derivative Progress: 67/2074 symbols completed. ALLY took 1.2s. Estimated remaining: 14m 34s. Rate: 137.8 symbols/min [2025-09-26T22:16:57.200192] [INFO ] [MAIN ] ALUR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:57.200475] [INFO ] [MAIN ] Derivative Progress: 68/2074 symbols completed. ALTG took 1.1s. Estimated remaining: 14m 21s. Rate: 139.9 symbols/min [2025-09-26T22:16:57.201109] [INFO ] [MAIN ] ALV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:57.215265] [DEBUG] [MAIN ] ALSN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:57.216135] [INFO ] [MAIN ] ALSN: Generated 1820 derivative records from 43953 primary records. [2025-09-26T22:16:57.216297] [DEBUG] [LOCAL ] ALSN: Saving derivative data. [2025-09-26T22:16:57.237518] [DEBUG] [LOCAL ] ALSN: Derivative data saved (1820 records). [2025-09-26T22:16:57.237695] [INFO ] [MAIN ] ALSN: Successfully saved derivative data. [2025-09-26T22:16:57.240255] [INFO ] [MAIN ] Derivative Progress: 69/2074 symbols completed. ALSN took 1.2s. Estimated remaining: 14m 9s. Rate: 141.7 symbols/min [2025-09-26T22:16:57.240745] [INFO ] [MAIN ] ALX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:57.249836] [DEBUG] [LOCAL ] ALUR: Loaded 10950 existing records from primary storage. [2025-09-26T22:16:57.250201] [INFO ] [MAIN ] ALUR: Loaded 10950 primary data records. [2025-09-26T22:16:57.362607] [DEBUG] [LOCAL ] ALX: Loaded 6121 existing records from primary storage. [2025-09-26T22:16:57.402626] [INFO ] [MAIN ] ALX: Loaded 6121 primary data records. [2025-09-26T22:16:57.668915] [DEBUG] [LOCAL ] ALV: Loaded 43217 existing records from primary storage. [2025-09-26T22:16:57.789424] [INFO ] [MAIN ] ALV: Loaded 43217 primary data records. [2025-09-26T22:16:58.414959] [DEBUG] [MAIN ] ALUR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:58.417400] [INFO ] [MAIN ] ALUR: Generated 1820 derivative records from 10950 primary records. [2025-09-26T22:16:58.418444] [DEBUG] [LOCAL ] ALUR: Saving derivative data. [2025-09-26T22:16:58.445534] [DEBUG] [MAIN ] ALX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:58.447668] [INFO ] [MAIN ] ALX: Generated 1820 derivative records from 6121 primary records. [2025-09-26T22:16:58.448292] [DEBUG] [LOCAL ] ALX: Saving derivative data. [2025-09-26T22:16:58.465148] [DEBUG] [LOCAL ] ALUR: Derivative data saved (1820 records). [2025-09-26T22:16:58.467432] [INFO ] [MAIN ] ALUR: Successfully saved derivative data. [2025-09-26T22:16:58.469915] [INFO ] [MAIN ] Derivative Progress: 70/2074 symbols completed. ALUR took 1.3s. Estimated remaining: 14m 31s. Rate: 138.0 symbols/min [2025-09-26T22:16:58.471394] [INFO ] [MAIN ] AM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:58.488003] [DEBUG] [MAIN ] ALV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:58.489218] [INFO ] [MAIN ] ALV: Generated 1820 derivative records from 43217 primary records. [2025-09-26T22:16:58.490033] [DEBUG] [LOCAL ] ALX: Derivative data saved (1820 records). [2025-09-26T22:16:58.489964] [DEBUG] [LOCAL ] ALV: Saving derivative data. [2025-09-26T22:16:58.490149] [INFO ] [MAIN ] ALX: Successfully saved derivative data. [2025-09-26T22:16:58.493907] [INFO ] [MAIN ] Derivative Progress: 71/2074 symbols completed. ALX took 1.3s. Estimated remaining: 14m 19s. Rate: 139.8 symbols/min [2025-09-26T22:16:58.494959] [INFO ] [MAIN ] AMBC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:58.516199] [DEBUG] [LOCAL ] ALV: Derivative data saved (1820 records). [2025-09-26T22:16:58.521430] [INFO ] [MAIN ] ALV: Successfully saved derivative data. [2025-09-26T22:16:58.524088] [INFO ] [MAIN ] Derivative Progress: 72/2074 symbols completed. ALV took 1.3s. Estimated remaining: 14m 8s. Rate: 141.7 symbols/min [2025-09-26T22:16:58.524707] [INFO ] [MAIN ] AMBP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:58.553822] [DEBUG] [LOCAL ] AMBC: Loaded 37453 existing records from primary storage. [2025-09-26T22:16:58.554154] [INFO ] [MAIN ] AMBC: Loaded 37453 primary data records. [2025-09-26T22:16:58.791918] [DEBUG] [LOCAL ] AM: Loaded 52887 existing records from primary storage. [2025-09-26T22:16:58.904272] [INFO ] [MAIN ] AM: Loaded 52887 primary data records. [2025-09-26T22:16:58.945332] [DEBUG] [LOCAL ] AMBP: Loaded 45863 existing records from primary storage. [2025-09-26T22:16:58.956346] [INFO ] [MAIN ] AMBP: Loaded 45863 primary data records. [2025-09-26T22:16:59.630004] [DEBUG] [MAIN ] AMBC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:59.631455] [INFO ] [MAIN ] AMBC: Generated 1820 derivative records from 37453 primary records. [2025-09-26T22:16:59.631723] [DEBUG] [LOCAL ] AMBC: Saving derivative data. [2025-09-26T22:16:59.657350] [DEBUG] [LOCAL ] AMBC: Derivative data saved (1820 records). [2025-09-26T22:16:59.670416] [INFO ] [MAIN ] AMBC: Successfully saved derivative data. [2025-09-26T22:16:59.670948] [DEBUG] [MAIN ] AM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:59.673503] [INFO ] [MAIN ] Derivative Progress: 73/2074 symbols completed. AMBC took 1.2s. Estimated remaining: 14m 27s. Rate: 138.4 symbols/min [2025-09-26T22:16:59.674685] [INFO ] [MAIN ] AM: Generated 1820 derivative records from 52887 primary records. [2025-09-26T22:16:59.675229] [DEBUG] [LOCAL ] AM: Saving derivative data. [2025-09-26T22:16:59.694597] [DEBUG] [LOCAL ] AM: Derivative data saved (1820 records). [2025-09-26T22:16:59.707347] [DEBUG] [MAIN ] AMBP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:16:59.710927] [INFO ] [MAIN ] AM: Successfully saved derivative data. [2025-09-26T22:16:59.711717] [INFO ] [MAIN ] AMBP: Generated 1820 derivative records from 45863 primary records. [2025-09-26T22:16:59.714544] [INFO ] [MAIN ] Derivative Progress: 74/2074 symbols completed. AM took 1.2s. Estimated remaining: 14m 16s. Rate: 140.1 symbols/min [2025-09-26T22:16:59.714724] [DEBUG] [LOCAL ] AMBP: Saving derivative data. [2025-09-26T22:16:59.731244] [DEBUG] [LOCAL ] AMBP: Derivative data saved (1820 records). [2025-09-26T22:16:59.731311] [INFO ] [MAIN ] AMBP: Successfully saved derivative data. [2025-09-26T22:16:59.733869] [INFO ] [MAIN ] Derivative Progress: 75/2074 symbols completed. AMBP took 1.2s. Estimated remaining: 14m 5s. Rate: 141.9 symbols/min [2025-09-26T22:16:59.734855] [INFO ] [MAIN ] AMC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:59.735412] [INFO ] [MAIN ] AME: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:59.735349] [INFO ] [MAIN ] AMCR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:16:59.796414] [DEBUG] [LOCAL ] AMCR: Loaded 54449 existing records from primary storage. [2025-09-26T22:16:59.808490] [INFO ] [MAIN ] AMCR: Loaded 54449 primary data records. [2025-09-26T22:16:59.989319] [DEBUG] [LOCAL ] AME: Loaded 49252 existing records from primary storage. [2025-09-26T22:17:00.023727] [INFO ] [MAIN ] AME: Loaded 49252 primary data records. [2025-09-26T22:17:00.053752] [DEBUG] [LOCAL ] AMC: Loaded 54539 existing records from primary storage. [2025-09-26T22:17:00.156704] [INFO ] [MAIN ] AMC: Loaded 54539 primary data records. [2025-09-26T22:17:00.930840] [DEBUG] [MAIN ] AMCR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:00.932932] [INFO ] [MAIN ] AMCR: Generated 1820 derivative records from 54449 primary records. [2025-09-26T22:17:00.933198] [DEBUG] [LOCAL ] AMCR: Saving derivative data. [2025-09-26T22:17:00.959388] [DEBUG] [LOCAL ] AMCR: Derivative data saved (1820 records). [2025-09-26T22:17:00.959569] [INFO ] [MAIN ] AMCR: Successfully saved derivative data. [2025-09-26T22:17:00.963067] [INFO ] [MAIN ] Derivative Progress: 76/2074 symbols completed. AMCR took 1.2s. Estimated remaining: 14m 26s. Rate: 138.5 symbols/min [2025-09-26T22:17:00.964206] [INFO ] [MAIN ] AMG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:00.992075] [DEBUG] [MAIN ] AME: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:00.992526] [DEBUG] [MAIN ] AMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:00.993632] [INFO ] [MAIN ] AME: Generated 1820 derivative records from 49252 primary records. [2025-09-26T22:17:00.993820] [DEBUG] [LOCAL ] AME: Saving derivative data. [2025-09-26T22:17:00.995434] [INFO ] [MAIN ] AMC: Generated 1820 derivative records from 54539 primary records. [2025-09-26T22:17:00.996564] [DEBUG] [LOCAL ] AMC: Saving derivative data. [2025-09-26T22:17:01.029141] [DEBUG] [LOCAL ] AMC: Derivative data saved (1820 records). [2025-09-26T22:17:01.033501] [INFO ] [MAIN ] AMC: Successfully saved derivative data. [2025-09-26T22:17:01.033237] [DEBUG] [LOCAL ] AME: Derivative data saved (1820 records). [2025-09-26T22:17:01.037543] [INFO ] [MAIN ] AME: Successfully saved derivative data. [2025-09-26T22:17:01.037397] [INFO ] [MAIN ] Derivative Progress: 77/2074 symbols completed. AMC took 1.3s. Estimated remaining: 14m 16s. Rate: 140.0 symbols/min [2025-09-26T22:17:01.048246] [INFO ] [MAIN ] AMH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:01.048525] [INFO ] [MAIN ] Derivative Progress: 78/2074 symbols completed. AME took 1.3s. Estimated remaining: 14m 5s. Rate: 141.7 symbols/min [2025-09-26T22:17:01.049006] [INFO ] [MAIN ] AMN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:01.059931] [DEBUG] [LOCAL ] AMG: Loaded 21046 existing records from primary storage. [2025-09-26T22:17:01.060243] [INFO ] [MAIN ] AMG: Loaded 21046 primary data records. [2025-09-26T22:17:01.347191] [DEBUG] [LOCAL ] AMN: Loaded 42588 existing records from primary storage. [2025-09-26T22:17:01.473318] [INFO ] [MAIN ] AMN: Loaded 42588 primary data records. [2025-09-26T22:17:01.565183] [DEBUG] [LOCAL ] AMH: Loaded 52467 existing records from primary storage. [2025-09-26T22:17:01.608573] [INFO ] [MAIN ] AMH: Loaded 52467 primary data records. [2025-09-26T22:17:02.245728] [DEBUG] [MAIN ] AMG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:02.262171] [INFO ] [MAIN ] AMG: Generated 1820 derivative records from 21046 primary records. [2025-09-26T22:17:02.262350] [DEBUG] [LOCAL ] AMG: Saving derivative data. [2025-09-26T22:17:02.287223] [DEBUG] [LOCAL ] AMG: Derivative data saved (1820 records). [2025-09-26T22:17:02.288076] [INFO ] [MAIN ] AMG: Successfully saved derivative data. [2025-09-26T22:17:02.291489] [INFO ] [MAIN ] Derivative Progress: 79/2074 symbols completed. AMG took 1.3s. Estimated remaining: 14m 25s. Rate: 138.3 symbols/min [2025-09-26T22:17:02.291870] [INFO ] [MAIN ] AMP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:02.311863] [DEBUG] [MAIN ] AMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:02.313114] [INFO ] [MAIN ] AMN: Generated 1820 derivative records from 42588 primary records. [2025-09-26T22:17:02.313291] [DEBUG] [LOCAL ] AMN: Saving derivative data. [2025-09-26T22:17:02.332218] [DEBUG] [LOCAL ] AMN: Derivative data saved (1820 records). [2025-09-26T22:17:02.332401] [INFO ] [MAIN ] AMN: Successfully saved derivative data. [2025-09-26T22:17:02.335071] [INFO ] [MAIN ] Derivative Progress: 80/2074 symbols completed. AMN took 1.3s. Estimated remaining: 14m 15s. Rate: 139.9 symbols/min [2025-09-26T22:17:02.344045] [INFO ] [MAIN ] AMPX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:02.372154] [DEBUG] [MAIN ] AMH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:02.373173] [INFO ] [MAIN ] AMH: Generated 1820 derivative records from 52467 primary records. [2025-09-26T22:17:02.373954] [DEBUG] [LOCAL ] AMP: Loaded 32959 existing records from primary storage. [2025-09-26T22:17:02.374045] [DEBUG] [LOCAL ] AMH: Saving derivative data. [2025-09-26T22:17:02.374684] [INFO ] [MAIN ] AMP: Loaded 32959 primary data records. [2025-09-26T22:17:02.437708] [DEBUG] [LOCAL ] AMH: Derivative data saved (1820 records). [2025-09-26T22:17:02.450579] [INFO ] [MAIN ] AMH: Successfully saved derivative data. [2025-09-26T22:17:02.455986] [INFO ] [MAIN ] Derivative Progress: 81/2074 symbols completed. AMH took 1.4s. Estimated remaining: 14m 7s. Rate: 141.2 symbols/min [2025-09-26T22:17:02.476607] [INFO ] [MAIN ] AMR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:02.785541] [DEBUG] [LOCAL ] AMPX: Loaded 52949 existing records from primary storage. [2025-09-26T22:17:02.785880] [INFO ] [MAIN ] AMPX: Loaded 52949 primary data records. [2025-09-26T22:17:02.913778] [DEBUG] [LOCAL ] AMR: Loaded 29441 existing records from primary storage. [2025-09-26T22:17:02.924215] [INFO ] [MAIN ] AMR: Loaded 29441 primary data records. [2025-09-26T22:17:03.320331] [DEBUG] [MAIN ] AMP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:03.349809] [INFO ] [MAIN ] AMP: Generated 1820 derivative records from 32959 primary records. [2025-09-26T22:17:03.350228] [DEBUG] [LOCAL ] AMP: Saving derivative data. [2025-09-26T22:17:03.494767] [DEBUG] [LOCAL ] AMP: Derivative data saved (1820 records). [2025-09-26T22:17:03.495196] [INFO ] [MAIN ] AMP: Successfully saved derivative data. [2025-09-26T22:17:03.497966] [INFO ] [MAIN ] Derivative Progress: 82/2074 symbols completed. AMP took 1.2s. Estimated remaining: 14m 22s. Rate: 138.7 symbols/min [2025-09-26T22:17:03.499001] [INFO ] [MAIN ] AMRC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:03.518004] [DEBUG] [MAIN ] AMPX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:03.518964] [INFO ] [MAIN ] AMPX: Generated 1820 derivative records from 52949 primary records. [2025-09-26T22:17:03.519189] [DEBUG] [LOCAL ] AMPX: Saving derivative data. [2025-09-26T22:17:03.539633] [DEBUG] [LOCAL ] AMPX: Derivative data saved (1820 records). [2025-09-26T22:17:03.539932] [INFO ] [MAIN ] AMPX: Successfully saved derivative data. [2025-09-26T22:17:03.542466] [INFO ] [MAIN ] Derivative Progress: 83/2074 symbols completed. AMPX took 1.2s. Estimated remaining: 14m 12s. Rate: 140.2 symbols/min [2025-09-26T22:17:03.543114] [INFO ] [MAIN ] AMT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:03.566340] [DEBUG] [MAIN ] AMR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:03.567543] [INFO ] [MAIN ] AMR: Generated 1820 derivative records from 29441 primary records. [2025-09-26T22:17:03.567796] [DEBUG] [LOCAL ] AMR: Saving derivative data. [2025-09-26T22:17:03.597818] [DEBUG] [LOCAL ] AMR: Derivative data saved (1820 records). [2025-09-26T22:17:03.598094] [INFO ] [MAIN ] AMR: Successfully saved derivative data. [2025-09-26T22:17:03.600741] [INFO ] [MAIN ] Derivative Progress: 84/2074 symbols completed. AMR took 1.1s. Estimated remaining: 14m 3s. Rate: 141.7 symbols/min [2025-09-26T22:17:03.602092] [INFO ] [MAIN ] AMTB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:03.601759] [DEBUG] [LOCAL ] AMRC: Loaded 38981 existing records from primary storage. [2025-09-26T22:17:03.602885] [INFO ] [MAIN ] AMRC: Loaded 38981 primary data records. [2025-09-26T22:17:03.820462] [DEBUG] [LOCAL ] AMTB: Loaded 20599 existing records from primary storage. [2025-09-26T22:17:03.944697] [INFO ] [MAIN ] AMTB: Loaded 20599 primary data records. [2025-09-26T22:17:04.002340] [DEBUG] [LOCAL ] AMT: Loaded 53212 existing records from primary storage. [2025-09-26T22:17:04.016714] [INFO ] [MAIN ] AMT: Loaded 53212 primary data records. [2025-09-26T22:17:04.682695] [DEBUG] [MAIN ] AMRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:04.683973] [INFO ] [MAIN ] AMRC: Generated 1820 derivative records from 38981 primary records. [2025-09-26T22:17:04.684381] [DEBUG] [LOCAL ] AMRC: Saving derivative data. [2025-09-26T22:17:04.709333] [DEBUG] [LOCAL ] AMRC: Derivative data saved (1820 records). [2025-09-26T22:17:04.711379] [INFO ] [MAIN ] AMRC: Successfully saved derivative data. [2025-09-26T22:17:04.714445] [INFO ] [MAIN ] Derivative Progress: 85/2074 symbols completed. AMRC took 1.2s. Estimated remaining: 14m 18s. Rate: 139.0 symbols/min [2025-09-26T22:17:04.715217] [INFO ] [MAIN ] AMTD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:04.729473] [DEBUG] [MAIN ] AMTB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:04.730672] [INFO ] [MAIN ] AMTB: Generated 1820 derivative records from 20599 primary records. [2025-09-26T22:17:04.731982] [DEBUG] [LOCAL ] AMTB: Saving derivative data. [2025-09-26T22:17:04.752393] [DEBUG] [LOCAL ] AMTB: Derivative data saved (1820 records). [2025-09-26T22:17:04.752685] [INFO ] [MAIN ] AMTB: Successfully saved derivative data. [2025-09-26T22:17:04.747915] [DEBUG] [LOCAL ] AMTD: Loaded 3622 existing records from primary storage. [2025-09-26T22:17:04.755410] [INFO ] [MAIN ] Derivative Progress: 86/2074 symbols completed. AMTB took 1.2s. Estimated remaining: 14m 9s. Rate: 140.5 symbols/min [2025-09-26T22:17:04.756988] [INFO ] [MAIN ] AMTD: Loaded 3622 primary data records. [2025-09-26T22:17:04.756537] [INFO ] [MAIN ] AMTM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:04.848986] [DEBUG] [MAIN ] AMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:04.863009] [INFO ] [MAIN ] AMT: Generated 1820 derivative records from 53212 primary records. [2025-09-26T22:17:04.868263] [DEBUG] [LOCAL ] AMT: Saving derivative data. [2025-09-26T22:17:04.990224] [DEBUG] [LOCAL ] AMT: Derivative data saved (1820 records). [2025-09-26T22:17:05.099776] [INFO ] [MAIN ] AMT: Successfully saved derivative data. [2025-09-26T22:17:05.116216] [INFO ] [MAIN ] Derivative Progress: 87/2074 symbols completed. AMT took 1.6s. Estimated remaining: 14m 7s. Rate: 140.8 symbols/min [2025-09-26T22:17:05.117673] [INFO ] [MAIN ] AMWL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:05.145232] [DEBUG] [LOCAL ] AMWL: Loaded 8830 existing records from primary storage. [2025-09-26T22:17:05.160407] [INFO ] [MAIN ] AMWL: Loaded 8830 primary data records. [2025-09-26T22:17:05.161384] [DEBUG] [LOCAL ] AMTM: Loaded 51451 existing records from primary storage. [2025-09-26T22:17:05.161500] [INFO ] [MAIN ] AMTM: Loaded 51451 primary data records. [2025-09-26T22:17:05.581893] [DEBUG] [MAIN ] AMTD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:05.582875] [INFO ] [MAIN ] AMTD: Generated 1820 derivative records from 3622 primary records. [2025-09-26T22:17:05.823797] [DEBUG] [LOCAL ] AMTD: Saving derivative data. [2025-09-26T22:17:05.857589] [DEBUG] [LOCAL ] AMTD: Derivative data saved (1820 records). [2025-09-26T22:17:05.858370] [INFO ] [MAIN ] AMTD: Successfully saved derivative data. [2025-09-26T22:17:05.860735] [INFO ] [MAIN ] Derivative Progress: 88/2074 symbols completed. AMTD took 1.1s. Estimated remaining: 14m 14s. Rate: 139.6 symbols/min [2025-09-26T22:17:05.886383] [DEBUG] [MAIN ] AMTM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:05.887375] [INFO ] [MAIN ] AMTM: Generated 1820 derivative records from 51451 primary records. [2025-09-26T22:17:05.887460] [DEBUG] [LOCAL ] AMTM: Saving derivative data. [2025-09-26T22:17:05.901173] [DEBUG] [MAIN ] AMWL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:05.909879] [INFO ] [MAIN ] AMWL: Generated 1820 derivative records from 8830 primary records. [2025-09-26T22:17:05.914694] [DEBUG] [LOCAL ] AMWL: Saving derivative data. [2025-09-26T22:17:05.928118] [DEBUG] [LOCAL ] AMTM: Derivative data saved (1820 records). [2025-09-26T22:17:05.932203] [INFO ] [MAIN ] AMTM: Successfully saved derivative data. [2025-09-26T22:17:05.937894] [INFO ] [MAIN ] Derivative Progress: 89/2074 symbols completed. AMTM took 1.2s. Estimated remaining: 14m 5s. Rate: 140.9 symbols/min [2025-09-26T22:17:05.939499] [DEBUG] [LOCAL ] AMWL: Derivative data saved (1820 records). [2025-09-26T22:17:05.939566] [INFO ] [MAIN ] AMWL: Successfully saved derivative data. [2025-09-26T22:17:05.941995] [INFO ] [MAIN ] Derivative Progress: 90/2074 symbols completed. AMWL took 0.8s. Estimated remaining: 13m 56s. Rate: 142.4 symbols/min [2025-09-26T22:17:05.942672] [INFO ] [MAIN ] AMX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:05.942896] [INFO ] [MAIN ] AN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:05.942942] [INFO ] [MAIN ] ANET: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:05.999732] [DEBUG] [LOCAL ] AN: Loaded 32842 existing records from primary storage. [2025-09-26T22:17:05.999941] [INFO ] [MAIN ] AN: Loaded 32842 primary data records. [2025-09-26T22:17:06.160699] [DEBUG] [LOCAL ] ANET: Loaded 54546 existing records from primary storage. [2025-09-26T22:17:06.201344] [INFO ] [MAIN ] ANET: Loaded 54546 primary data records. [2025-09-26T22:17:06.187861] [DEBUG] [LOCAL ] AMX: Loaded 49855 existing records from primary storage. [2025-09-26T22:17:06.241347] [INFO ] [MAIN ] AMX: Loaded 49855 primary data records. [2025-09-26T22:17:07.105222] [DEBUG] [MAIN ] AN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:07.106240] [INFO ] [MAIN ] AN: Generated 1820 derivative records from 32842 primary records. [2025-09-26T22:17:07.106526] [DEBUG] [LOCAL ] AN: Saving derivative data. [2025-09-26T22:17:07.140434] [DEBUG] [MAIN ] ANET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:07.142389] [INFO ] [MAIN ] ANET: Generated 1820 derivative records from 54546 primary records. [2025-09-26T22:17:07.143023] [DEBUG] [LOCAL ] ANET: Saving derivative data. [2025-09-26T22:17:07.155099] [DEBUG] [LOCAL ] AN: Derivative data saved (1820 records). [2025-09-26T22:17:07.158780] [INFO ] [MAIN ] AN: Successfully saved derivative data. [2025-09-26T22:17:07.165336] [INFO ] [MAIN ] Derivative Progress: 91/2074 symbols completed. AN took 1.2s. Estimated remaining: 14m 13s. Rate: 139.5 symbols/min [2025-09-26T22:17:07.165665] [INFO ] [MAIN ] ANF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:07.163158] [DEBUG] [LOCAL ] ANET: Derivative data saved (1820 records). [2025-09-26T22:17:07.173871] [INFO ] [MAIN ] ANET: Successfully saved derivative data. [2025-09-26T22:17:07.176978] [INFO ] [MAIN ] Derivative Progress: 92/2074 symbols completed. ANET took 1.2s. Estimated remaining: 14m 3s. Rate: 141.0 symbols/min [2025-09-26T22:17:07.182511] [INFO ] [MAIN ] ANRO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:07.183480] [DEBUG] [MAIN ] AMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:07.184727] [INFO ] [MAIN ] AMX: Generated 1820 derivative records from 49855 primary records. [2025-09-26T22:17:07.184937] [DEBUG] [LOCAL ] AMX: Saving derivative data. [2025-09-26T22:17:07.209096] [DEBUG] [LOCAL ] AMX: Derivative data saved (1820 records). [2025-09-26T22:17:07.209312] [INFO ] [MAIN ] AMX: Successfully saved derivative data. [2025-09-26T22:17:07.212116] [INFO ] [MAIN ] Derivative Progress: 93/2074 symbols completed. AMX took 1.3s. Estimated remaining: 13m 55s. Rate: 142.4 symbols/min [2025-09-26T22:17:07.212605] [INFO ] [MAIN ] ANVS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:07.222445] [DEBUG] [LOCAL ] ANRO: Loaded 19387 existing records from primary storage. [2025-09-26T22:17:07.222597] [INFO ] [MAIN ] ANRO: Loaded 19387 primary data records. [2025-09-26T22:17:07.434064] [DEBUG] [LOCAL ] ANVS: Loaded 23508 existing records from primary storage. [2025-09-26T22:17:07.459750] [INFO ] [MAIN ] ANVS: Loaded 23508 primary data records. [2025-09-26T22:17:07.578573] [DEBUG] [LOCAL ] ANF: Loaded 52967 existing records from primary storage. [2025-09-26T22:17:07.588630] [INFO ] [MAIN ] ANF: Loaded 52967 primary data records. [2025-09-26T22:17:08.261376] [DEBUG] [MAIN ] ANRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:08.262681] [INFO ] [MAIN ] ANRO: Generated 1820 derivative records from 19387 primary records. [2025-09-26T22:17:08.262845] [DEBUG] [LOCAL ] ANRO: Saving derivative data. [2025-09-26T22:17:08.282886] [DEBUG] [LOCAL ] ANRO: Derivative data saved (1820 records). [2025-09-26T22:17:08.283579] [INFO ] [MAIN ] ANRO: Successfully saved derivative data. [2025-09-26T22:17:08.286442] [INFO ] [MAIN ] Derivative Progress: 94/2074 symbols completed. ANRO took 1.1s. Estimated remaining: 14m 8s. Rate: 140.1 symbols/min [2025-09-26T22:17:08.287172] [INFO ] [MAIN ] AOD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:08.326219] [DEBUG] [MAIN ] ANF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:08.325863] [DEBUG] [MAIN ] ANVS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:08.327977] [INFO ] [MAIN ] ANVS: Generated 1820 derivative records from 23508 primary records. [2025-09-26T22:17:08.327166] [INFO ] [MAIN ] ANF: Generated 1820 derivative records from 52967 primary records. [2025-09-26T22:17:08.328252] [DEBUG] [LOCAL ] ANF: Saving derivative data. [2025-09-26T22:17:08.328126] [DEBUG] [LOCAL ] ANVS: Saving derivative data. [2025-09-26T22:17:08.377681] [DEBUG] [LOCAL ] AOD: Loaded 30414 existing records from primary storage. [2025-09-26T22:17:08.379557] [INFO ] [MAIN ] AOD: Loaded 30414 primary data records. [2025-09-26T22:17:08.379998] [DEBUG] [LOCAL ] ANF: Derivative data saved (1820 records). [2025-09-26T22:17:08.393492] [INFO ] [MAIN ] ANF: Successfully saved derivative data. [2025-09-26T22:17:08.408828] [INFO ] [MAIN ] Derivative Progress: 95/2074 symbols completed. ANF took 1.2s. Estimated remaining: 14m 1s. Rate: 141.2 symbols/min [2025-09-26T22:17:08.431486] [INFO ] [MAIN ] AOMR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:08.469490] [DEBUG] [LOCAL ] ANVS: Derivative data saved (1820 records). [2025-09-26T22:17:08.481855] [INFO ] [MAIN ] ANVS: Successfully saved derivative data. [2025-09-26T22:17:08.491334] [INFO ] [MAIN ] Derivative Progress: 96/2074 symbols completed. ANVS took 1.3s. Estimated remaining: 13m 54s. Rate: 142.4 symbols/min [2025-09-26T22:17:08.506340] [INFO ] [MAIN ] AON: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:08.591153] [DEBUG] [LOCAL ] AOMR: Loaded 16852 existing records from primary storage. [2025-09-26T22:17:08.611122] [INFO ] [MAIN ] AOMR: Loaded 16852 primary data records. [2025-09-26T22:17:09.021608] [DEBUG] [LOCAL ] AON: Loaded 46248 existing records from primary storage. [2025-09-26T22:17:09.031730] [INFO ] [MAIN ] AON: Loaded 46248 primary data records. [2025-09-26T22:17:09.538281] [DEBUG] [MAIN ] AOD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:09.539314] [INFO ] [MAIN ] AOD: Generated 1820 derivative records from 30414 primary records. [2025-09-26T22:17:09.539614] [DEBUG] [LOCAL ] AOD: Saving derivative data. [2025-09-26T22:17:09.562022] [DEBUG] [LOCAL ] AOD: Derivative data saved (1820 records). [2025-09-26T22:17:09.562402] [INFO ] [MAIN ] AOD: Successfully saved derivative data. [2025-09-26T22:17:09.565086] [INFO ] [MAIN ] Derivative Progress: 97/2074 symbols completed. AOD took 1.3s. Estimated remaining: 14m 7s. Rate: 140.1 symbols/min [2025-09-26T22:17:09.565830] [INFO ] [MAIN ] AORT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:09.581503] [DEBUG] [MAIN ] AOMR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:09.583001] [INFO ] [MAIN ] AOMR: Generated 1820 derivative records from 16852 primary records. [2025-09-26T22:17:09.583376] [DEBUG] [LOCAL ] AOMR: Saving derivative data. [2025-09-26T22:17:09.613552] [DEBUG] [LOCAL ] AOMR: Derivative data saved (1820 records). [2025-09-26T22:17:09.613933] [INFO ] [MAIN ] AOMR: Successfully saved derivative data. [2025-09-26T22:17:09.619302] [INFO ] [MAIN ] Derivative Progress: 98/2074 symbols completed. AOMR took 1.2s. Estimated remaining: 13m 59s. Rate: 141.4 symbols/min [2025-09-26T22:17:09.621048] [INFO ] [MAIN ] AOS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:09.645095] [DEBUG] [LOCAL ] AORT: Loaded 30087 existing records from primary storage. [2025-09-26T22:17:09.644171] [DEBUG] [MAIN ] AON: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:09.646070] [INFO ] [MAIN ] AON: Generated 1820 derivative records from 46248 primary records. [2025-09-26T22:17:09.646270] [INFO ] [MAIN ] AORT: Loaded 30087 primary data records. [2025-09-26T22:17:09.646209] [DEBUG] [LOCAL ] AON: Saving derivative data. [2025-09-26T22:17:09.854178] [DEBUG] [LOCAL ] AON: Derivative data saved (1820 records). [2025-09-26T22:17:09.877405] [INFO ] [MAIN ] AON: Successfully saved derivative data. [2025-09-26T22:17:09.991123] [INFO ] [MAIN ] Derivative Progress: 99/2074 symbols completed. AON took 1.5s. Estimated remaining: 13m 57s. Rate: 141.6 symbols/min [2025-09-26T22:17:10.020723] [INFO ] [MAIN ] APAM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:10.022389] [DEBUG] [LOCAL ] AOS: Loaded 49769 existing records from primary storage. [2025-09-26T22:17:10.022763] [INFO ] [MAIN ] AOS: Loaded 49769 primary data records. [2025-09-26T22:17:10.378753] [DEBUG] [LOCAL ] APAM: Loaded 36969 existing records from primary storage. [2025-09-26T22:17:10.381014] [INFO ] [MAIN ] APAM: Loaded 36969 primary data records. [2025-09-26T22:17:10.434213] [DEBUG] [MAIN ] AORT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:10.471037] [INFO ] [MAIN ] AORT: Generated 1820 derivative records from 30087 primary records. [2025-09-26T22:17:10.508523] [DEBUG] [LOCAL ] AORT: Saving derivative data. [2025-09-26T22:17:10.576066] [DEBUG] [LOCAL ] AORT: Derivative data saved (1820 records). [2025-09-26T22:17:10.580899] [INFO ] [MAIN ] AORT: Successfully saved derivative data. [2025-09-26T22:17:10.583451] [INFO ] [MAIN ] Derivative Progress: 100/2074 symbols completed. AORT took 1.0s. Estimated remaining: 14m 0s. Rate: 141.0 symbols/min [2025-09-26T22:17:10.592488] [INFO ] [MAIN ] APH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:10.769342] [DEBUG] [MAIN ] AOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:10.770477] [INFO ] [MAIN ] AOS: Generated 1820 derivative records from 49769 primary records. [2025-09-26T22:17:10.770930] [DEBUG] [LOCAL ] AOS: Saving derivative data. [2025-09-26T22:17:10.792327] [DEBUG] [LOCAL ] AOS: Derivative data saved (1820 records). [2025-09-26T22:17:10.792569] [INFO ] [MAIN ] AOS: Successfully saved derivative data. [2025-09-26T22:17:10.795732] [INFO ] [MAIN ] Derivative Progress: 101/2074 symbols completed. AOS took 1.2s. Estimated remaining: 13m 55s. Rate: 141.7 symbols/min [2025-09-26T22:17:10.796232] [INFO ] [MAIN ] APO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:10.831876] [DEBUG] [MAIN ] APAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:10.832866] [INFO ] [MAIN ] APAM: Generated 1820 derivative records from 36969 primary records. [2025-09-26T22:17:10.833010] [DEBUG] [LOCAL ] APAM: Saving derivative data. [2025-09-26T22:17:10.853483] [DEBUG] [LOCAL ] APAM: Derivative data saved (1820 records). [2025-09-26T22:17:10.854600] [INFO ] [MAIN ] APAM: Successfully saved derivative data. [2025-09-26T22:17:10.873184] [INFO ] [MAIN ] Derivative Progress: 102/2074 symbols completed. APAM took 0.9s. Estimated remaining: 13m 48s. Rate: 142.8 symbols/min [2025-09-26T22:17:10.875493] [INFO ] [MAIN ] APTV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:10.876871] [DEBUG] [LOCAL ] APH: Loaded 54471 existing records from primary storage. [2025-09-26T22:17:10.877546] [INFO ] [MAIN ] APH: Loaded 54471 primary data records. [2025-09-26T22:17:11.074800] [DEBUG] [LOCAL ] APO: Loaded 54162 existing records from primary storage. [2025-09-26T22:17:11.091415] [INFO ] [MAIN ] APO: Loaded 54162 primary data records. [2025-09-26T22:17:11.682390] [DEBUG] [LOCAL ] APTV: Loaded 52964 existing records from primary storage. [2025-09-26T22:17:11.682855] [INFO ] [MAIN ] APTV: Loaded 52964 primary data records. [2025-09-26T22:17:12.025639] [DEBUG] [MAIN ] APH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:12.026940] [INFO ] [MAIN ] APH: Generated 1820 derivative records from 54471 primary records. [2025-09-26T22:17:12.027193] [DEBUG] [LOCAL ] APH: Saving derivative data. [2025-09-26T22:17:12.047553] [DEBUG] [LOCAL ] APH: Derivative data saved (1820 records). [2025-09-26T22:17:12.048000] [INFO ] [MAIN ] APH: Successfully saved derivative data. [2025-09-26T22:17:12.051412] [INFO ] [MAIN ] Derivative Progress: 103/2074 symbols completed. APH took 1.5s. Estimated remaining: 14m 2s. Rate: 140.4 symbols/min [2025-09-26T22:17:12.070931] [DEBUG] [MAIN ] APO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:12.071736] [INFO ] [MAIN ] APO: Generated 1820 derivative records from 54162 primary records. [2025-09-26T22:17:12.072013] [DEBUG] [LOCAL ] APO: Saving derivative data. [2025-09-26T22:17:12.090754] [DEBUG] [LOCAL ] APO: Derivative data saved (1820 records). [2025-09-26T22:17:12.091061] [INFO ] [MAIN ] APO: Successfully saved derivative data. [2025-09-26T22:17:12.094791] [INFO ] [MAIN ] Derivative Progress: 104/2074 symbols completed. APO took 1.3s. Estimated remaining: 13m 55s. Rate: 141.6 symbols/min [2025-09-26T22:17:12.111317] [DEBUG] [MAIN ] APTV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:12.112146] [INFO ] [MAIN ] APTV: Generated 1820 derivative records from 52964 primary records. [2025-09-26T22:17:12.112218] [DEBUG] [LOCAL ] APTV: Saving derivative data. [2025-09-26T22:17:12.129958] [DEBUG] [LOCAL ] APTV: Derivative data saved (1820 records). [2025-09-26T22:17:12.130045] [INFO ] [MAIN ] APTV: Successfully saved derivative data. [2025-09-26T22:17:12.132729] [INFO ] [MAIN ] Derivative Progress: 105/2074 symbols completed. APTV took 1.3s. Estimated remaining: 13m 47s. Rate: 142.8 symbols/min [2025-09-26T22:17:12.133810] [INFO ] [MAIN ] AR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:12.133929] [INFO ] [MAIN ] AQNB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:12.134277] [INFO ] [MAIN ] AQN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:12.143289] [DEBUG] [LOCAL ] AQNB: Loaded 4228 existing records from primary storage. [2025-09-26T22:17:12.143707] [INFO ] [MAIN ] AQNB: Loaded 4228 primary data records. [2025-09-26T22:17:12.519347] [DEBUG] [LOCAL ] AQN: Loaded 52684 existing records from primary storage. [2025-09-26T22:17:12.537515] [INFO ] [MAIN ] AQN: Loaded 52684 primary data records. [2025-09-26T22:17:12.551628] [DEBUG] [LOCAL ] AR: Loaded 54364 existing records from primary storage. [2025-09-26T22:17:12.578893] [INFO ] [MAIN ] AR: Loaded 54364 primary data records. [2025-09-26T22:17:13.257960] [DEBUG] [MAIN ] AQNB: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:17:13.261015] [INFO ] [MAIN ] AQNB: Generated 1819 derivative records from 4228 primary records. [2025-09-26T22:17:13.263001] [DEBUG] [LOCAL ] AQNB: Saving derivative data. [2025-09-26T22:17:13.285704] [DEBUG] [LOCAL ] AQNB: Derivative data saved (1819 records). [2025-09-26T22:17:13.286485] [INFO ] [MAIN ] AQNB: Successfully saved derivative data. [2025-09-26T22:17:13.290500] [INFO ] [MAIN ] Derivative Progress: 106/2074 symbols completed. AQNB took 1.2s. Estimated remaining: 14m 0s. Rate: 140.5 symbols/min [2025-09-26T22:17:13.291027] [INFO ] [MAIN ] ARCO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:13.315493] [DEBUG] [MAIN ] AQN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:13.316972] [INFO ] [MAIN ] AQN: Generated 1820 derivative records from 52684 primary records. [2025-09-26T22:17:13.317067] [DEBUG] [LOCAL ] AQN: Saving derivative data. [2025-09-26T22:17:13.331098] [DEBUG] [MAIN ] AR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:13.332381] [INFO ] [MAIN ] AR: Generated 1820 derivative records from 54364 primary records. [2025-09-26T22:17:13.339536] [DEBUG] [LOCAL ] AR: Saving derivative data. [2025-09-26T22:17:13.362256] [DEBUG] [LOCAL ] AR: Derivative data saved (1820 records). [2025-09-26T22:17:13.362440] [INFO ] [MAIN ] AR: Successfully saved derivative data. [2025-09-26T22:17:13.377792] [INFO ] [MAIN ] Derivative Progress: 107/2074 symbols completed. AR took 1.2s. Estimated remaining: 13m 54s. Rate: 141.6 symbols/min [2025-09-26T22:17:13.379613] [INFO ] [MAIN ] ARDC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:13.382882] [DEBUG] [LOCAL ] AQN: Derivative data saved (1820 records). [2025-09-26T22:17:13.383020] [INFO ] [MAIN ] AQN: Successfully saved derivative data. [2025-09-26T22:17:13.385430] [INFO ] [MAIN ] Derivative Progress: 108/2074 symbols completed. AQN took 1.3s. Estimated remaining: 13m 46s. Rate: 142.9 symbols/min [2025-09-26T22:17:13.386083] [INFO ] [MAIN ] ARE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:13.402704] [DEBUG] [LOCAL ] ARCO: Loaded 45249 existing records from primary storage. [2025-09-26T22:17:13.403055] [INFO ] [MAIN ] ARCO: Loaded 45249 primary data records. [2025-09-26T22:17:13.512433] [DEBUG] [LOCAL ] ARDC: Loaded 14821 existing records from primary storage. [2025-09-26T22:17:13.533225] [INFO ] [MAIN ] ARDC: Loaded 14821 primary data records. [2025-09-26T22:17:13.934771] [DEBUG] [LOCAL ] ARE: Loaded 51319 existing records from primary storage. [2025-09-26T22:17:13.969570] [INFO ] [MAIN ] ARE: Loaded 51319 primary data records. [2025-09-26T22:17:14.471966] [DEBUG] [MAIN ] ARDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:14.473408] [DEBUG] [MAIN ] ARCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:14.475551] [INFO ] [MAIN ] ARCO: Generated 1820 derivative records from 45249 primary records. [2025-09-26T22:17:14.476465] [INFO ] [MAIN ] ARDC: Generated 1820 derivative records from 14821 primary records. [2025-09-26T22:17:14.477114] [DEBUG] [LOCAL ] ARCO: Saving derivative data. [2025-09-26T22:17:14.477209] [DEBUG] [LOCAL ] ARDC: Saving derivative data. [2025-09-26T22:17:14.512312] [DEBUG] [LOCAL ] ARDC: Derivative data saved (1820 records). [2025-09-26T22:17:14.514131] [INFO ] [MAIN ] ARDC: Successfully saved derivative data. [2025-09-26T22:17:14.517090] [INFO ] [MAIN ] Derivative Progress: 109/2074 symbols completed. ARDC took 1.1s. Estimated remaining: 13m 58s. Rate: 140.7 symbols/min [2025-09-26T22:17:14.522508] [INFO ] [MAIN ] ARES: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:14.522950] [DEBUG] [LOCAL ] ARCO: Derivative data saved (1820 records). [2025-09-26T22:17:14.523784] [INFO ] [MAIN ] ARCO: Successfully saved derivative data. [2025-09-26T22:17:14.535015] [INFO ] [MAIN ] Derivative Progress: 110/2074 symbols completed. ARCO took 1.2s. Estimated remaining: 13m 50s. Rate: 141.9 symbols/min [2025-09-26T22:17:14.541098] [INFO ] [MAIN ] ARI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:14.541671] [DEBUG] [MAIN ] ARE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:14.543219] [INFO ] [MAIN ] ARE: Generated 1820 derivative records from 51319 primary records. [2025-09-26T22:17:14.543471] [DEBUG] [LOCAL ] ARE: Saving derivative data. [2025-09-26T22:17:14.560843] [DEBUG] [LOCAL ] ARE: Derivative data saved (1820 records). [2025-09-26T22:17:14.560979] [INFO ] [MAIN ] ARE: Successfully saved derivative data. [2025-09-26T22:17:14.564946] [INFO ] [MAIN ] Derivative Progress: 111/2074 symbols completed. ARE took 1.2s. Estimated remaining: 13m 43s. Rate: 143.1 symbols/min [2025-09-26T22:17:14.565753] [INFO ] [MAIN ] ARLO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:14.630985] [DEBUG] [LOCAL ] ARES: Loaded 50322 existing records from primary storage. [2025-09-26T22:17:14.644680] [INFO ] [MAIN ] ARES: Loaded 50322 primary data records. [2025-09-26T22:17:14.681254] [DEBUG] [LOCAL ] ARLO: Loaded 44493 existing records from primary storage. [2025-09-26T22:17:14.707525] [INFO ] [MAIN ] ARLO: Loaded 44493 primary data records. [2025-09-26T22:17:14.699140] [DEBUG] [LOCAL ] ARI: Loaded 44009 existing records from primary storage. [2025-09-26T22:17:14.730719] [INFO ] [MAIN ] ARI: Loaded 44009 primary data records. [2025-09-26T22:17:15.782174] [DEBUG] [MAIN ] ARES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:15.783529] [DEBUG] [MAIN ] ARI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:15.785342] [INFO ] [MAIN ] ARES: Generated 1820 derivative records from 50322 primary records. [2025-09-26T22:17:15.787104] [INFO ] [MAIN ] ARI: Generated 1820 derivative records from 44009 primary records. [2025-09-26T22:17:15.785614] [DEBUG] [LOCAL ] ARES: Saving derivative data. [2025-09-26T22:17:15.787720] [DEBUG] [LOCAL ] ARI: Saving derivative data. [2025-09-26T22:17:15.826245] [DEBUG] [LOCAL ] ARI: Derivative data saved (1820 records). [2025-09-26T22:17:15.827899] [INFO ] [MAIN ] ARI: Successfully saved derivative data. [2025-09-26T22:17:15.833509] [INFO ] [MAIN ] Derivative Progress: 112/2074 symbols completed. ARI took 1.3s. Estimated remaining: 13m 57s. Rate: 140.6 symbols/min [2025-09-26T22:17:15.838668] [INFO ] [MAIN ] ARMK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:15.838800] [DEBUG] [LOCAL ] ARES: Derivative data saved (1820 records). [2025-09-26T22:17:15.837997] [DEBUG] [MAIN ] ARLO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:15.839125] [INFO ] [MAIN ] ARES: Successfully saved derivative data. [2025-09-26T22:17:15.842174] [INFO ] [MAIN ] ARLO: Generated 1820 derivative records from 44493 primary records. [2025-09-26T22:17:15.841115] [INFO ] [MAIN ] Derivative Progress: 113/2074 symbols completed. ARES took 1.3s. Estimated remaining: 13m 50s. Rate: 141.8 symbols/min [2025-09-26T22:17:15.843188] [INFO ] [MAIN ] AROC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:15.842710] [DEBUG] [LOCAL ] ARLO: Saving derivative data. [2025-09-26T22:17:15.873720] [DEBUG] [LOCAL ] ARLO: Derivative data saved (1820 records). [2025-09-26T22:17:15.874489] [INFO ] [MAIN ] ARLO: Successfully saved derivative data. [2025-09-26T22:17:15.879562] [INFO ] [MAIN ] Derivative Progress: 114/2074 symbols completed. ARLO took 1.3s. Estimated remaining: 13m 43s. Rate: 142.9 symbols/min [2025-09-26T22:17:15.880537] [INFO ] [MAIN ] ARR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:15.998108] [DEBUG] [LOCAL ] AROC: Loaded 49733 existing records from primary storage. [2025-09-26T22:17:15.999019] [DEBUG] [LOCAL ] ARMK: Loaded 51112 existing records from primary storage. [2025-09-26T22:17:15.999299] [INFO ] [MAIN ] AROC: Loaded 49733 primary data records. [2025-09-26T22:17:15.999426] [INFO ] [MAIN ] ARMK: Loaded 51112 primary data records. [2025-09-26T22:17:16.194263] [DEBUG] [LOCAL ] ARR: Loaded 52809 existing records from primary storage. [2025-09-26T22:17:16.226001] [INFO ] [MAIN ] ARR: Loaded 52809 primary data records. [2025-09-26T22:17:17.053387] [DEBUG] [MAIN ] AROC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:17.054845] [INFO ] [MAIN ] AROC: Generated 1820 derivative records from 49733 primary records. [2025-09-26T22:17:17.055341] [DEBUG] [LOCAL ] AROC: Saving derivative data. [2025-09-26T22:17:17.089084] [DEBUG] [LOCAL ] AROC: Derivative data saved (1820 records). [2025-09-26T22:17:17.089454] [INFO ] [MAIN ] AROC: Successfully saved derivative data. [2025-09-26T22:17:17.092030] [INFO ] [MAIN ] Derivative Progress: 115/2074 symbols completed. AROC took 1.2s. Estimated remaining: 13m 56s. Rate: 140.6 symbols/min [2025-09-26T22:17:17.087619] [DEBUG] [MAIN ] ARMK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:17.093682] [INFO ] [MAIN ] ARMK: Generated 1820 derivative records from 51112 primary records. [2025-09-26T22:17:17.094723] [DEBUG] [LOCAL ] ARMK: Saving derivative data. [2025-09-26T22:17:17.095221] [INFO ] [MAIN ] ARW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:17.115431] [DEBUG] [LOCAL ] ARMK: Derivative data saved (1820 records). [2025-09-26T22:17:17.115825] [INFO ] [MAIN ] ARMK: Successfully saved derivative data. [2025-09-26T22:17:17.127556] [INFO ] [MAIN ] Derivative Progress: 116/2074 symbols completed. ARMK took 1.3s. Estimated remaining: 13m 49s. Rate: 141.8 symbols/min [2025-09-26T22:17:17.128072] [INFO ] [MAIN ] AS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:17.134897] [DEBUG] [MAIN ] ARR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:17.136023] [INFO ] [MAIN ] ARR: Generated 1820 derivative records from 52809 primary records. [2025-09-26T22:17:17.136260] [DEBUG] [LOCAL ] ARR: Saving derivative data. [2025-09-26T22:17:17.154309] [DEBUG] [LOCAL ] ARR: Derivative data saved (1820 records). [2025-09-26T22:17:17.154401] [INFO ] [MAIN ] ARR: Successfully saved derivative data. [2025-09-26T22:17:17.157776] [INFO ] [MAIN ] Derivative Progress: 117/2074 symbols completed. ARR took 1.3s. Estimated remaining: 13m 42s. Rate: 142.9 symbols/min [2025-09-26T22:17:17.159512] [INFO ] [MAIN ] ASA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:17.193973] [DEBUG] [LOCAL ] ARW: Loaded 33660 existing records from primary storage. [2025-09-26T22:17:17.211422] [INFO ] [MAIN ] ARW: Loaded 33660 primary data records. [2025-09-26T22:17:17.257144] [DEBUG] [LOCAL ] ASA: Loaded 14109 existing records from primary storage. [2025-09-26T22:17:17.287617] [INFO ] [MAIN ] ASA: Loaded 14109 primary data records. [2025-09-26T22:17:17.406747] [DEBUG] [LOCAL ] AS: Loaded 53854 existing records from primary storage. [2025-09-26T22:17:17.412249] [INFO ] [MAIN ] AS: Loaded 53854 primary data records. [2025-09-26T22:17:18.348945] [DEBUG] [MAIN ] ARW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:18.349750] [DEBUG] [MAIN ] ASA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:18.351746] [INFO ] [MAIN ] ARW: Generated 1820 derivative records from 33660 primary records. [2025-09-26T22:17:18.353439] [INFO ] [MAIN ] ASA: Generated 1820 derivative records from 14109 primary records. [2025-09-26T22:17:18.355128] [DEBUG] [LOCAL ] ASA: Saving derivative data. [2025-09-26T22:17:18.353591] [DEBUG] [LOCAL ] ARW: Saving derivative data. [2025-09-26T22:17:18.409603] [DEBUG] [LOCAL ] ASA: Derivative data saved (1820 records). [2025-09-26T22:17:18.407872] [DEBUG] [MAIN ] AS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:18.412592] [INFO ] [MAIN ] ASA: Successfully saved derivative data. [2025-09-26T22:17:18.412492] [INFO ] [MAIN ] AS: Generated 1820 derivative records from 53854 primary records. [2025-09-26T22:17:18.417681] [DEBUG] [LOCAL ] AS: Saving derivative data. [2025-09-26T22:17:18.417525] [INFO ] [MAIN ] Derivative Progress: 118/2074 symbols completed. ASA took 1.3s. Estimated remaining: 13m 55s. Rate: 140.5 symbols/min [2025-09-26T22:17:18.435138] [DEBUG] [LOCAL ] ARW: Derivative data saved (1820 records). [2025-09-26T22:17:18.435501] [INFO ] [MAIN ] ARW: Successfully saved derivative data. [2025-09-26T22:17:18.437547] [INFO ] [MAIN ] Derivative Progress: 119/2074 symbols completed. ARW took 1.3s. Estimated remaining: 13m 48s. Rate: 141.6 symbols/min [2025-09-26T22:17:18.441166] [DEBUG] [LOCAL ] AS: Derivative data saved (1820 records). [2025-09-26T22:17:18.441336] [INFO ] [MAIN ] AS: Successfully saved derivative data. [2025-09-26T22:17:18.444453] [INFO ] [MAIN ] Derivative Progress: 120/2074 symbols completed. AS took 1.3s. Estimated remaining: 13m 41s. Rate: 142.8 symbols/min [2025-09-26T22:17:18.445288] [INFO ] [MAIN ] ASAN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:18.445818] [INFO ] [MAIN ] ASBA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:18.446964] [INFO ] [MAIN ] ASB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:18.455437] [DEBUG] [LOCAL ] ASBA: Loaded 3458 existing records from primary storage. [2025-09-26T22:17:18.455572] [INFO ] [MAIN ] ASBA: Loaded 3458 primary data records. [2025-09-26T22:17:18.833414] [DEBUG] [LOCAL ] ASAN: Loaded 53512 existing records from primary storage. [2025-09-26T22:17:18.833795] [INFO ] [MAIN ] ASAN: Loaded 53512 primary data records. [2025-09-26T22:17:18.971597] [DEBUG] [LOCAL ] ASB: Loaded 50299 existing records from primary storage. [2025-09-26T22:17:18.976632] [INFO ] [MAIN ] ASB: Loaded 50299 primary data records. [2025-09-26T22:17:19.542003] [DEBUG] [MAIN ] ASBA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:19.543173] [INFO ] [MAIN ] ASBA: Generated 1820 derivative records from 3458 primary records. [2025-09-26T22:17:19.544030] [DEBUG] [LOCAL ] ASBA: Saving derivative data. [2025-09-26T22:17:19.563868] [DEBUG] [LOCAL ] ASBA: Derivative data saved (1820 records). [2025-09-26T22:17:19.564589] [INFO ] [MAIN ] ASBA: Successfully saved derivative data. [2025-09-26T22:17:19.567869] [INFO ] [MAIN ] Derivative Progress: 121/2074 symbols completed. ASBA took 1.1s. Estimated remaining: 13m 52s. Rate: 140.9 symbols/min [2025-09-26T22:17:19.568351] [INFO ] [MAIN ] ASGI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:19.586848] [DEBUG] [MAIN ] ASAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:19.587973] [INFO ] [MAIN ] ASAN: Generated 1820 derivative records from 53512 primary records. [2025-09-26T22:17:19.588183] [DEBUG] [LOCAL ] ASAN: Saving derivative data. [2025-09-26T22:17:19.605677] [DEBUG] [LOCAL ] ASAN: Derivative data saved (1820 records). [2025-09-26T22:17:19.605871] [INFO ] [MAIN ] ASAN: Successfully saved derivative data. [2025-09-26T22:17:19.608144] [INFO ] [MAIN ] Derivative Progress: 122/2074 symbols completed. ASAN took 1.2s. Estimated remaining: 13m 45s. Rate: 141.9 symbols/min [2025-09-26T22:17:19.608779] [INFO ] [MAIN ] ASGN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:19.641079] [DEBUG] [MAIN ] ASB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:19.643694] [INFO ] [MAIN ] ASB: Generated 1820 derivative records from 50299 primary records. [2025-09-26T22:17:19.644158] [DEBUG] [LOCAL ] ASGI: Loaded 22711 existing records from primary storage. [2025-09-26T22:17:19.644471] [DEBUG] [LOCAL ] ASB: Saving derivative data. [2025-09-26T22:17:19.645136] [INFO ] [MAIN ] ASGI: Loaded 22711 primary data records. [2025-09-26T22:17:19.747422] [DEBUG] [LOCAL ] ASB: Derivative data saved (1820 records). [2025-09-26T22:17:19.760108] [INFO ] [MAIN ] ASB: Successfully saved derivative data. [2025-09-26T22:17:19.768979] [INFO ] [MAIN ] Derivative Progress: 123/2074 symbols completed. ASB took 1.3s. Estimated remaining: 13m 41s. Rate: 142.6 symbols/min [2025-09-26T22:17:19.787071] [INFO ] [MAIN ] ASH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:19.873360] [DEBUG] [LOCAL ] ASGN: Loaded 36554 existing records from primary storage. [2025-09-26T22:17:19.891995] [INFO ] [MAIN ] ASGN: Loaded 36554 primary data records. [2025-09-26T22:17:20.388989] [DEBUG] [LOCAL ] ASH: Loaded 38339 existing records from primary storage. [2025-09-26T22:17:20.389409] [INFO ] [MAIN ] ASH: Loaded 38339 primary data records. [2025-09-26T22:17:20.743166] [DEBUG] [MAIN ] ASGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:20.744402] [INFO ] [MAIN ] ASGI: Generated 1820 derivative records from 22711 primary records. [2025-09-26T22:17:20.745213] [DEBUG] [LOCAL ] ASGI: Saving derivative data. [2025-09-26T22:17:20.768487] [DEBUG] [LOCAL ] ASGI: Derivative data saved (1820 records). [2025-09-26T22:17:20.768639] [INFO ] [MAIN ] ASGI: Successfully saved derivative data. [2025-09-26T22:17:20.770913] [INFO ] [MAIN ] Derivative Progress: 124/2074 symbols completed. ASGI took 1.2s. Estimated remaining: 13m 49s. Rate: 141.1 symbols/min [2025-09-26T22:17:20.771384] [INFO ] [MAIN ] ASIX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:20.785104] [DEBUG] [MAIN ] ASGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:20.786050] [INFO ] [MAIN ] ASGN: Generated 1820 derivative records from 36554 primary records. [2025-09-26T22:17:20.787446] [DEBUG] [LOCAL ] ASGN: Saving derivative data. [2025-09-26T22:17:20.808427] [DEBUG] [LOCAL ] ASGN: Derivative data saved (1820 records). [2025-09-26T22:17:20.809668] [INFO ] [MAIN ] ASGN: Successfully saved derivative data. [2025-09-26T22:17:20.819221] [INFO ] [MAIN ] Derivative Progress: 125/2074 symbols completed. ASGN took 1.2s. Estimated remaining: 13m 43s. Rate: 142.1 symbols/min [2025-09-26T22:17:20.820071] [INFO ] [MAIN ] ASPN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:20.834414] [DEBUG] [MAIN ] ASH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:20.843805] [INFO ] [MAIN ] ASH: Generated 1820 derivative records from 38339 primary records. [2025-09-26T22:17:20.844181] [DEBUG] [LOCAL ] ASH: Saving derivative data. [2025-09-26T22:17:20.845989] [DEBUG] [LOCAL ] ASIX: Loaded 22834 existing records from primary storage. [2025-09-26T22:17:20.857671] [INFO ] [MAIN ] ASIX: Loaded 22834 primary data records. [2025-09-26T22:17:20.965918] [DEBUG] [LOCAL ] ASH: Derivative data saved (1820 records). [2025-09-26T22:17:20.990053] [INFO ] [MAIN ] ASH: Successfully saved derivative data. [2025-09-26T22:17:21.018792] [INFO ] [MAIN ] Derivative Progress: 126/2074 symbols completed. ASH took 1.2s. Estimated remaining: 13m 39s. Rate: 142.7 symbols/min [2025-09-26T22:17:21.029592] [INFO ] [MAIN ] ASR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:21.228223] [DEBUG] [LOCAL ] ASPN: Loaded 50293 existing records from primary storage. [2025-09-26T22:17:21.243218] [INFO ] [MAIN ] ASPN: Loaded 50293 primary data records. [2025-09-26T22:17:21.261631] [DEBUG] [LOCAL ] ASR: Loaded 9381 existing records from primary storage. [2025-09-26T22:17:21.292519] [INFO ] [MAIN ] ASR: Loaded 9381 primary data records. [2025-09-26T22:17:22.008341] [DEBUG] [MAIN ] ASIX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:22.009713] [INFO ] [MAIN ] ASIX: Generated 1820 derivative records from 22834 primary records. [2025-09-26T22:17:22.010077] [DEBUG] [LOCAL ] ASIX: Saving derivative data. [2025-09-26T22:17:22.030633] [DEBUG] [LOCAL ] ASIX: Derivative data saved (1820 records). [2025-09-26T22:17:22.032685] [INFO ] [MAIN ] ASIX: Successfully saved derivative data. [2025-09-26T22:17:22.035343] [INFO ] [MAIN ] Derivative Progress: 127/2074 symbols completed. ASIX took 1.3s. Estimated remaining: 13m 48s. Rate: 141.1 symbols/min [2025-09-26T22:17:22.036972] [INFO ] [MAIN ] ASX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:22.059062] [DEBUG] [MAIN ] ASR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:22.060254] [INFO ] [MAIN ] ASR: Generated 1820 derivative records from 9381 primary records. [2025-09-26T22:17:22.060477] [DEBUG] [LOCAL ] ASR: Saving derivative data. [2025-09-26T22:17:22.094173] [DEBUG] [MAIN ] ASPN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:22.095258] [INFO ] [MAIN ] ASPN: Generated 1820 derivative records from 50293 primary records. [2025-09-26T22:17:22.097934] [DEBUG] [LOCAL ] ASR: Derivative data saved (1820 records). [2025-09-26T22:17:22.095907] [DEBUG] [LOCAL ] ASPN: Saving derivative data. [2025-09-26T22:17:22.099194] [INFO ] [MAIN ] ASR: Successfully saved derivative data. [2025-09-26T22:17:22.102077] [INFO ] [MAIN ] Derivative Progress: 128/2074 symbols completed. ASR took 1.1s. Estimated remaining: 13m 42s. Rate: 142.0 symbols/min [2025-09-26T22:17:22.102756] [INFO ] [MAIN ] ATEN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:22.133933] [DEBUG] [LOCAL ] ASPN: Derivative data saved (1820 records). [2025-09-26T22:17:22.134230] [INFO ] [MAIN ] ASPN: Successfully saved derivative data. [2025-09-26T22:17:22.137286] [INFO ] [MAIN ] Derivative Progress: 129/2074 symbols completed. ASPN took 1.3s. Estimated remaining: 13m 36s. Rate: 143.0 symbols/min [2025-09-26T22:17:22.137749] [INFO ] [MAIN ] ATGE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:22.163337] [DEBUG] [LOCAL ] ASX: Loaded 53639 existing records from primary storage. [2025-09-26T22:17:22.163879] [INFO ] [MAIN ] ASX: Loaded 53639 primary data records. [2025-09-26T22:17:22.343862] [DEBUG] [LOCAL ] ATGE: Loaded 32251 existing records from primary storage. [2025-09-26T22:17:22.370539] [INFO ] [MAIN ] ATGE: Loaded 32251 primary data records. [2025-09-26T22:17:22.395545] [DEBUG] [LOCAL ] ATEN: Loaded 40398 existing records from primary storage. [2025-09-26T22:17:22.560399] [INFO ] [MAIN ] ATEN: Loaded 40398 primary data records. [2025-09-26T22:17:23.221083] [DEBUG] [MAIN ] ASX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:23.222903] [INFO ] [MAIN ] ASX: Generated 1820 derivative records from 53639 primary records. [2025-09-26T22:17:23.223012] [DEBUG] [LOCAL ] ASX: Saving derivative data. [2025-09-26T22:17:23.254473] [DEBUG] [MAIN ] ATGE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:23.255836] [DEBUG] [LOCAL ] ASX: Derivative data saved (1820 records). [2025-09-26T22:17:23.256764] [INFO ] [MAIN ] ATGE: Generated 1820 derivative records from 32251 primary records. [2025-09-26T22:17:23.256955] [INFO ] [MAIN ] ASX: Successfully saved derivative data. [2025-09-26T22:17:23.257048] [DEBUG] [LOCAL ] ATGE: Saving derivative data. [2025-09-26T22:17:23.259286] [INFO ] [MAIN ] Derivative Progress: 130/2074 symbols completed. ASX took 1.2s. Estimated remaining: 13m 46s. Rate: 141.2 symbols/min [2025-09-26T22:17:23.260592] [INFO ] [MAIN ] ATHM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:23.281121] [DEBUG] [LOCAL ] ATGE: Derivative data saved (1820 records). [2025-09-26T22:17:23.281483] [INFO ] [MAIN ] ATGE: Successfully saved derivative data. [2025-09-26T22:17:23.284429] [INFO ] [MAIN ] Derivative Progress: 131/2074 symbols completed. ATGE took 1.1s. Estimated remaining: 13m 40s. Rate: 142.2 symbols/min [2025-09-26T22:17:23.284841] [INFO ] [MAIN ] ATHS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:23.298589] [DEBUG] [MAIN ] ATEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:23.299580] [INFO ] [MAIN ] ATEN: Generated 1820 derivative records from 40398 primary records. [2025-09-26T22:17:23.299815] [DEBUG] [LOCAL ] ATEN: Saving derivative data. [2025-09-26T22:17:23.330001] [DEBUG] [LOCAL ] ATHS: Loaded 7145 existing records from primary storage. [2025-09-26T22:17:23.331038] [DEBUG] [LOCAL ] ATEN: Derivative data saved (1820 records). [2025-09-26T22:17:23.331168] [INFO ] [MAIN ] ATEN: Successfully saved derivative data. [2025-09-26T22:17:23.334035] [INFO ] [MAIN ] Derivative Progress: 132/2074 symbols completed. ATEN took 1.2s. Estimated remaining: 13m 34s. Rate: 143.2 symbols/min [2025-09-26T22:17:23.334219] [INFO ] [MAIN ] ATHS: Loaded 7145 primary data records. [2025-09-26T22:17:23.334505] [INFO ] [MAIN ] ATI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:23.457367] [DEBUG] [LOCAL ] ATHM: Loaded 33015 existing records from primary storage. [2025-09-26T22:17:23.461684] [INFO ] [MAIN ] ATHM: Loaded 33015 primary data records. [2025-09-26T22:17:24.073971] [DEBUG] [LOCAL ] ATI: Loaded 52283 existing records from primary storage. [2025-09-26T22:17:24.074264] [INFO ] [MAIN ] ATI: Loaded 52283 primary data records. [2025-09-26T22:17:24.449382] [DEBUG] [MAIN ] ATHS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:24.450743] [INFO ] [MAIN ] ATHS: Generated 1820 derivative records from 7145 primary records. [2025-09-26T22:17:24.450945] [DEBUG] [LOCAL ] ATHS: Saving derivative data. [2025-09-26T22:17:24.493063] [DEBUG] [MAIN ] ATHM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:24.494723] [DEBUG] [LOCAL ] ATHS: Derivative data saved (1820 records). [2025-09-26T22:17:24.494848] [INFO ] [MAIN ] ATHS: Successfully saved derivative data. [2025-09-26T22:17:24.495891] [INFO ] [MAIN ] ATHM: Generated 1820 derivative records from 33015 primary records. [2025-09-26T22:17:24.496038] [DEBUG] [LOCAL ] ATHM: Saving derivative data. [2025-09-26T22:17:24.499205] [INFO ] [MAIN ] Derivative Progress: 133/2074 symbols completed. ATHS took 1.2s. Estimated remaining: 13m 44s. Rate: 141.3 symbols/min [2025-09-26T22:17:24.518939] [DEBUG] [LOCAL ] ATHM: Derivative data saved (1820 records). [2025-09-26T22:17:24.519281] [INFO ] [MAIN ] ATHM: Successfully saved derivative data. [2025-09-26T22:17:24.522959] [INFO ] [MAIN ] Derivative Progress: 134/2074 symbols completed. ATHM took 1.3s. Estimated remaining: 13m 38s. Rate: 142.3 symbols/min [2025-09-26T22:17:24.539025] [DEBUG] [MAIN ] ATI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:24.539950] [INFO ] [MAIN ] ATI: Generated 1820 derivative records from 52283 primary records. [2025-09-26T22:17:24.540022] [DEBUG] [LOCAL ] ATI: Saving derivative data. [2025-09-26T22:17:24.557036] [DEBUG] [LOCAL ] ATI: Derivative data saved (1820 records). [2025-09-26T22:17:24.557111] [INFO ] [MAIN ] ATI: Successfully saved derivative data. [2025-09-26T22:17:24.561011] [INFO ] [MAIN ] Derivative Progress: 135/2074 symbols completed. ATI took 1.2s. Estimated remaining: 13m 32s. Rate: 143.3 symbols/min [2025-09-26T22:17:24.561928] [INFO ] [MAIN ] ATKR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:24.562183] [INFO ] [MAIN ] ATMU: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:24.562312] [INFO ] [MAIN ] ATO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:24.636550] [DEBUG] [LOCAL ] ATMU: Loaded 40274 existing records from primary storage. [2025-09-26T22:17:24.637377] [DEBUG] [LOCAL ] ATKR: Loaded 36196 existing records from primary storage. [2025-09-26T22:17:24.636773] [INFO ] [MAIN ] ATMU: Loaded 40274 primary data records. [2025-09-26T22:17:24.637504] [INFO ] [MAIN ] ATKR: Loaded 36196 primary data records. [2025-09-26T22:17:24.887631] [DEBUG] [LOCAL ] ATO: Loaded 42489 existing records from primary storage. [2025-09-26T22:17:24.903918] [INFO ] [MAIN ] ATO: Loaded 42489 primary data records. [2025-09-26T22:17:25.680316] [DEBUG] [MAIN ] ATKR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:25.682296] [INFO ] [MAIN ] ATKR: Generated 1820 derivative records from 36196 primary records. [2025-09-26T22:17:25.682627] [DEBUG] [LOCAL ] ATKR: Saving derivative data. [2025-09-26T22:17:25.708999] [DEBUG] [MAIN ] ATMU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:25.711072] [INFO ] [MAIN ] ATMU: Generated 1820 derivative records from 40274 primary records. [2025-09-26T22:17:25.711874] [DEBUG] [LOCAL ] ATMU: Saving derivative data. [2025-09-26T22:17:25.732351] [DEBUG] [LOCAL ] ATKR: Derivative data saved (1820 records). [2025-09-26T22:17:25.733659] [INFO ] [MAIN ] ATKR: Successfully saved derivative data. [2025-09-26T22:17:25.744262] [INFO ] [MAIN ] Derivative Progress: 136/2074 symbols completed. ATKR took 1.2s. Estimated remaining: 13m 42s. Rate: 141.4 symbols/min [2025-09-26T22:17:25.756311] [DEBUG] [MAIN ] ATO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:25.755930] [DEBUG] [LOCAL ] ATMU: Derivative data saved (1820 records). [2025-09-26T22:17:25.756812] [INFO ] [MAIN ] ATMU: Successfully saved derivative data. [2025-09-26T22:17:25.756725] [INFO ] [MAIN ] ATR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:25.758109] [INFO ] [MAIN ] ATO: Generated 1820 derivative records from 42489 primary records. [2025-09-26T22:17:25.761236] [INFO ] [MAIN ] Derivative Progress: 137/2074 symbols completed. ATMU took 1.2s. Estimated remaining: 13m 36s. Rate: 142.4 symbols/min [2025-09-26T22:17:25.761375] [DEBUG] [LOCAL ] ATO: Saving derivative data. [2025-09-26T22:17:25.762807] [INFO ] [MAIN ] ATS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:25.780090] [DEBUG] [LOCAL ] ATO: Derivative data saved (1820 records). [2025-09-26T22:17:25.780288] [INFO ] [MAIN ] ATO: Successfully saved derivative data. [2025-09-26T22:17:25.783757] [INFO ] [MAIN ] Derivative Progress: 138/2074 symbols completed. ATO took 1.2s. Estimated remaining: 13m 30s. Rate: 143.4 symbols/min [2025-09-26T22:17:25.784230] [INFO ] [MAIN ] ATUS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:25.801389] [DEBUG] [LOCAL ] ATS: Loaded 18145 existing records from primary storage. [2025-09-26T22:17:25.801697] [INFO ] [MAIN ] ATS: Loaded 18145 primary data records. [2025-09-26T22:17:25.951392] [DEBUG] [LOCAL ] ATR: Loaded 30839 existing records from primary storage. [2025-09-26T22:17:25.994196] [INFO ] [MAIN ] ATR: Loaded 30839 primary data records. [2025-09-26T22:17:26.262901] [DEBUG] [LOCAL ] ATUS: Loaded 49958 existing records from primary storage. [2025-09-26T22:17:26.280817] [INFO ] [MAIN ] ATUS: Loaded 49958 primary data records. [2025-09-26T22:17:26.898301] [DEBUG] [MAIN ] ATS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:26.901674] [INFO ] [MAIN ] ATS: Generated 1820 derivative records from 18145 primary records. [2025-09-26T22:17:26.902303] [DEBUG] [LOCAL ] ATS: Saving derivative data. [2025-09-26T22:17:26.922975] [DEBUG] [LOCAL ] ATS: Derivative data saved (1820 records). [2025-09-26T22:17:26.923111] [INFO ] [MAIN ] ATS: Successfully saved derivative data. [2025-09-26T22:17:26.925762] [INFO ] [MAIN ] Derivative Progress: 139/2074 symbols completed. ATS took 1.2s. Estimated remaining: 13m 40s. Rate: 141.6 symbols/min [2025-09-26T22:17:26.927587] [INFO ] [MAIN ] AUB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:26.946102] [DEBUG] [MAIN ] ATR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:26.951822] [INFO ] [MAIN ] ATR: Generated 1820 derivative records from 30839 primary records. [2025-09-26T22:17:26.951975] [DEBUG] [LOCAL ] ATR: Saving derivative data. [2025-09-26T22:17:26.977587] [DEBUG] [MAIN ] ATUS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:26.979443] [INFO ] [MAIN ] ATUS: Generated 1820 derivative records from 49958 primary records. [2025-09-26T22:17:26.979818] [DEBUG] [LOCAL ] ATUS: Saving derivative data. [2025-09-26T22:17:26.996980] [DEBUG] [LOCAL ] ATR: Derivative data saved (1820 records). [2025-09-26T22:17:26.998551] [INFO ] [MAIN ] ATR: Successfully saved derivative data. [2025-09-26T22:17:27.001383] [INFO ] [MAIN ] Derivative Progress: 140/2074 symbols completed. ATR took 1.2s. Estimated remaining: 13m 35s. Rate: 142.4 symbols/min [2025-09-26T22:17:27.002148] [INFO ] [MAIN ] AUNA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:27.004738] [DEBUG] [LOCAL ] ATUS: Derivative data saved (1820 records). [2025-09-26T22:17:27.004964] [INFO ] [MAIN ] ATUS: Successfully saved derivative data. [2025-09-26T22:17:27.008895] [INFO ] [MAIN ] Derivative Progress: 141/2074 symbols completed. ATUS took 1.2s. Estimated remaining: 13m 29s. Rate: 143.4 symbols/min [2025-09-26T22:17:27.009347] [INFO ] [MAIN ] AVA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:27.026677] [DEBUG] [LOCAL ] AUNA: Loaded 4966 existing records from primary storage. [2025-09-26T22:17:27.026827] [INFO ] [MAIN ] AUNA: Loaded 4966 primary data records. [2025-09-26T22:17:27.161459] [DEBUG] [LOCAL ] AUB: Loaded 47072 existing records from primary storage. [2025-09-26T22:17:27.161743] [INFO ] [MAIN ] AUB: Loaded 47072 primary data records. [2025-09-26T22:17:27.372471] [DEBUG] [LOCAL ] AVA: Loaded 40183 existing records from primary storage. [2025-09-26T22:17:27.372837] [INFO ] [MAIN ] AVA: Loaded 40183 primary data records. [2025-09-26T22:17:28.061489] [DEBUG] [MAIN ] AUNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:28.064085] [INFO ] [MAIN ] AUNA: Generated 1820 derivative records from 4966 primary records. [2025-09-26T22:17:28.065099] [DEBUG] [LOCAL ] AUNA: Saving derivative data. [2025-09-26T22:17:28.090180] [DEBUG] [MAIN ] AUB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:28.092092] [INFO ] [MAIN ] AUB: Generated 1820 derivative records from 47072 primary records. [2025-09-26T22:17:28.093022] [DEBUG] [LOCAL ] AUB: Saving derivative data. [2025-09-26T22:17:28.109395] [DEBUG] [LOCAL ] AUNA: Derivative data saved (1820 records). [2025-09-26T22:17:28.110356] [INFO ] [MAIN ] AUNA: Successfully saved derivative data. [2025-09-26T22:17:28.112517] [INFO ] [MAIN ] Derivative Progress: 142/2074 symbols completed. AUNA took 1.1s. Estimated remaining: 13m 37s. Rate: 141.8 symbols/min [2025-09-26T22:17:28.113322] [INFO ] [MAIN ] AVAL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:28.129831] [DEBUG] [LOCAL ] AUB: Derivative data saved (1820 records). [2025-09-26T22:17:28.135349] [DEBUG] [MAIN ] AVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:28.140353] [INFO ] [MAIN ] AVA: Generated 1820 derivative records from 40183 primary records. [2025-09-26T22:17:28.140632] [DEBUG] [LOCAL ] AVAL: Loaded 9040 existing records from primary storage. [2025-09-26T22:17:28.140736] [INFO ] [MAIN ] AUB: Successfully saved derivative data. [2025-09-26T22:17:28.140874] [INFO ] [MAIN ] AVAL: Loaded 9040 primary data records. [2025-09-26T22:17:28.140956] [DEBUG] [LOCAL ] AVA: Saving derivative data. [2025-09-26T22:17:28.143801] [INFO ] [MAIN ] Derivative Progress: 143/2074 symbols completed. AUB took 1.2s. Estimated remaining: 13m 32s. Rate: 142.7 symbols/min [2025-09-26T22:17:28.178238] [INFO ] [MAIN ] AVB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:28.511702] [DEBUG] [LOCAL ] AVA: Derivative data saved (1820 records). [2025-09-26T22:17:28.521632] [INFO ] [MAIN ] AVA: Successfully saved derivative data. [2025-09-26T22:17:28.524707] [INFO ] [MAIN ] Derivative Progress: 144/2074 symbols completed. AVA took 1.5s. Estimated remaining: 13m 31s. Rate: 142.8 symbols/min [2025-09-26T22:17:28.525236] [INFO ] [MAIN ] AVD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:28.563227] [DEBUG] [LOCAL ] AVB: Loaded 42457 existing records from primary storage. [2025-09-26T22:17:28.563678] [INFO ] [MAIN ] AVB: Loaded 42457 primary data records. [2025-09-26T22:17:28.682318] [DEBUG] [LOCAL ] AVD: Loaded 23030 existing records from primary storage. [2025-09-26T22:17:28.694784] [INFO ] [MAIN ] AVD: Loaded 23030 primary data records. [2025-09-26T22:17:28.871327] [DEBUG] [MAIN ] AVAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:29.026964] [INFO ] [MAIN ] AVAL: Generated 1820 derivative records from 9040 primary records. [2025-09-26T22:17:29.039861] [DEBUG] [LOCAL ] AVAL: Saving derivative data. [2025-09-26T22:17:29.264817] [DEBUG] [LOCAL ] AVAL: Derivative data saved (1820 records). [2025-09-26T22:17:29.265362] [INFO ] [MAIN ] AVAL: Successfully saved derivative data. [2025-09-26T22:17:29.267623] [INFO ] [MAIN ] Derivative Progress: 145/2074 symbols completed. AVAL took 1.2s. Estimated remaining: 13m 35s. Rate: 142.1 symbols/min [2025-09-26T22:17:29.268485] [INFO ] [MAIN ] AVK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:29.293412] [DEBUG] [MAIN ] AVB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:29.299375] [INFO ] [MAIN ] AVB: Generated 1820 derivative records from 42457 primary records. [2025-09-26T22:17:29.299632] [DEBUG] [LOCAL ] AVB: Saving derivative data. [2025-09-26T22:17:29.323690] [DEBUG] [LOCAL ] AVK: Loaded 18064 existing records from primary storage. [2025-09-26T22:17:29.335570] [DEBUG] [LOCAL ] AVB: Derivative data saved (1820 records). [2025-09-26T22:17:29.340580] [INFO ] [MAIN ] AVK: Loaded 18064 primary data records. [2025-09-26T22:17:29.346543] [DEBUG] [MAIN ] AVD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:29.347309] [INFO ] [MAIN ] AVD: Generated 1820 derivative records from 23030 primary records. [2025-09-26T22:17:29.346214] [INFO ] [MAIN ] AVB: Successfully saved derivative data. [2025-09-26T22:17:29.388836] [DEBUG] [LOCAL ] AVD: Saving derivative data. [2025-09-26T22:17:29.380547] [INFO ] [MAIN ] Derivative Progress: 146/2074 symbols completed. AVB took 1.2s. Estimated remaining: 13m 30s. Rate: 142.8 symbols/min [2025-09-26T22:17:29.400060] [INFO ] [MAIN ] AVNS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:29.696141] [DEBUG] [LOCAL ] AVD: Derivative data saved (1820 records). [2025-09-26T22:17:29.705379] [INFO ] [MAIN ] AVD: Successfully saved derivative data. [2025-09-26T22:17:29.708629] [INFO ] [MAIN ] Derivative Progress: 147/2074 symbols completed. AVD took 1.2s. Estimated remaining: 13m 29s. Rate: 143.0 symbols/min [2025-09-26T22:17:29.709113] [INFO ] [MAIN ] AVNT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:29.728085] [DEBUG] [LOCAL ] AVNS: Loaded 34132 existing records from primary storage. [2025-09-26T22:17:29.728372] [INFO ] [MAIN ] AVNS: Loaded 34132 primary data records. [2025-09-26T22:17:30.092893] [DEBUG] [LOCAL ] AVNT: Loaded 39887 existing records from primary storage. [2025-09-26T22:17:30.093401] [INFO ] [MAIN ] AVNT: Loaded 39887 primary data records. [2025-09-26T22:17:30.148738] [DEBUG] [MAIN ] AVK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:30.186515] [INFO ] [MAIN ] AVK: Generated 1820 derivative records from 18064 primary records. [2025-09-26T22:17:30.209879] [DEBUG] [LOCAL ] AVK: Saving derivative data. [2025-09-26T22:17:30.511836] [DEBUG] [LOCAL ] AVK: Derivative data saved (1820 records). [2025-09-26T22:17:30.512232] [INFO ] [MAIN ] AVK: Successfully saved derivative data. [2025-09-26T22:17:30.514587] [INFO ] [MAIN ] Derivative Progress: 148/2074 symbols completed. AVK took 1.2s. Estimated remaining: 13m 33s. Rate: 142.1 symbols/min [2025-09-26T22:17:30.534994] [DEBUG] [MAIN ] AVNS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:30.535873] [INFO ] [MAIN ] AVNS: Generated 1820 derivative records from 34132 primary records. [2025-09-26T22:17:30.535997] [DEBUG] [LOCAL ] AVNS: Saving derivative data. [2025-09-26T22:17:30.554916] [DEBUG] [LOCAL ] AVNS: Derivative data saved (1820 records). [2025-09-26T22:17:30.555134] [INFO ] [MAIN ] AVNS: Successfully saved derivative data. [2025-09-26T22:17:30.558044] [INFO ] [MAIN ] Derivative Progress: 149/2074 symbols completed. AVNS took 1.2s. Estimated remaining: 13m 28s. Rate: 143.0 symbols/min [2025-09-26T22:17:30.573277] [DEBUG] [MAIN ] AVNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:30.573957] [INFO ] [MAIN ] AVNT: Generated 1820 derivative records from 39887 primary records. [2025-09-26T22:17:30.574022] [DEBUG] [LOCAL ] AVNT: Saving derivative data. [2025-09-26T22:17:30.590039] [DEBUG] [LOCAL ] AVNT: Derivative data saved (1820 records). [2025-09-26T22:17:30.590109] [INFO ] [MAIN ] AVNT: Successfully saved derivative data. [2025-09-26T22:17:30.592969] [INFO ] [MAIN ] Derivative Progress: 150/2074 symbols completed. AVNT took 0.9s. Estimated remaining: 13m 22s. Rate: 143.9 symbols/min [2025-09-26T22:17:30.593540] [INFO ] [MAIN ] AWI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:30.593708] [INFO ] [MAIN ] AVTR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:30.593806] [INFO ] [MAIN ] AWF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:30.643852] [DEBUG] [LOCAL ] AWF: Loaded 24608 existing records from primary storage. [2025-09-26T22:17:30.644357] [INFO ] [MAIN ] AWF: Loaded 24608 primary data records. [2025-09-26T22:17:30.666248] [DEBUG] [LOCAL ] AWI: Loaded 26185 existing records from primary storage. [2025-09-26T22:17:30.752515] [INFO ] [MAIN ] AWI: Loaded 26185 primary data records. [2025-09-26T22:17:30.922381] [DEBUG] [LOCAL ] AVTR: Loaded 54345 existing records from primary storage. [2025-09-26T22:17:30.952556] [INFO ] [MAIN ] AVTR: Loaded 54345 primary data records. [2025-09-26T22:17:31.728416] [DEBUG] [MAIN ] AWF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:31.733674] [INFO ] [MAIN ] AWF: Generated 1820 derivative records from 24608 primary records. [2025-09-26T22:17:31.735338] [DEBUG] [LOCAL ] AWF: Saving derivative data. [2025-09-26T22:17:31.749915] [DEBUG] [MAIN ] AWI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:31.753164] [INFO ] [MAIN ] AWI: Generated 1820 derivative records from 26185 primary records. [2025-09-26T22:17:31.753431] [DEBUG] [LOCAL ] AWI: Saving derivative data. [2025-09-26T22:17:31.786296] [DEBUG] [LOCAL ] AWF: Derivative data saved (1820 records). [2025-09-26T22:17:31.789008] [DEBUG] [LOCAL ] AWI: Derivative data saved (1820 records). [2025-09-26T22:17:31.789631] [INFO ] [MAIN ] AWF: Successfully saved derivative data. [2025-09-26T22:17:31.789511] [INFO ] [MAIN ] AWI: Successfully saved derivative data. [2025-09-26T22:17:31.793669] [INFO ] [MAIN ] Derivative Progress: 151/2074 symbols completed. AWI took 1.2s. Estimated remaining: 13m 32s. Rate: 142.1 symbols/min [2025-09-26T22:17:31.798816] [INFO ] [MAIN ] AWK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:31.798680] [INFO ] [MAIN ] Derivative Progress: 152/2074 symbols completed. AWF took 1.2s. Estimated remaining: 13m 26s. Rate: 143.0 symbols/min [2025-09-26T22:17:31.801793] [INFO ] [MAIN ] AWP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:31.817755] [DEBUG] [MAIN ] AVTR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:31.818828] [INFO ] [MAIN ] AVTR: Generated 1820 derivative records from 54345 primary records. [2025-09-26T22:17:31.818980] [DEBUG] [LOCAL ] AVTR: Saving derivative data. [2025-09-26T22:17:31.844200] [DEBUG] [LOCAL ] AVTR: Derivative data saved (1820 records). [2025-09-26T22:17:31.850583] [INFO ] [MAIN ] AVTR: Successfully saved derivative data. [2025-09-26T22:17:31.855131] [INFO ] [MAIN ] Derivative Progress: 153/2074 symbols completed. AVTR took 1.3s. Estimated remaining: 13m 21s. Rate: 143.8 symbols/min [2025-09-26T22:17:31.855461] [INFO ] [MAIN ] AX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:31.856174] [DEBUG] [LOCAL ] AWP: Loaded 21835 existing records from primary storage. [2025-09-26T22:17:31.856953] [INFO ] [MAIN ] AWP: Loaded 21835 primary data records. [2025-09-26T22:17:32.082184] [DEBUG] [LOCAL ] AWK: Loaded 49489 existing records from primary storage. [2025-09-26T22:17:32.106557] [DEBUG] [LOCAL ] AX: Loaded 28929 existing records from primary storage. [2025-09-26T22:17:32.107149] [INFO ] [MAIN ] AWK: Loaded 49489 primary data records. [2025-09-26T22:17:32.214217] [INFO ] [MAIN ] AX: Loaded 28929 primary data records. [2025-09-26T22:17:33.006607] [DEBUG] [MAIN ] AWP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:33.007523] [INFO ] [MAIN ] AWP: Generated 1820 derivative records from 21835 primary records. [2025-09-26T22:17:33.007625] [DEBUG] [LOCAL ] AWP: Saving derivative data. [2025-09-26T22:17:33.031402] [DEBUG] [LOCAL ] AWP: Derivative data saved (1820 records). [2025-09-26T22:17:33.031492] [INFO ] [MAIN ] AWP: Successfully saved derivative data. [2025-09-26T22:17:33.033993] [INFO ] [MAIN ] Derivative Progress: 154/2074 symbols completed. AWP took 1.2s. Estimated remaining: 13m 30s. Rate: 142.1 symbols/min [2025-09-26T22:17:33.034669] [INFO ] [MAIN ] AXL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:33.070367] [DEBUG] [MAIN ] AWK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:33.072100] [INFO ] [MAIN ] AWK: Generated 1820 derivative records from 49489 primary records. [2025-09-26T22:17:33.072276] [DEBUG] [LOCAL ] AWK: Saving derivative data. [2025-09-26T22:17:33.072600] [DEBUG] [MAIN ] AX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:33.082897] [INFO ] [MAIN ] AX: Generated 1820 derivative records from 28929 primary records. [2025-09-26T22:17:33.087530] [DEBUG] [LOCAL ] AX: Saving derivative data. [2025-09-26T22:17:33.107774] [DEBUG] [LOCAL ] AWK: Derivative data saved (1820 records). [2025-09-26T22:17:33.108698] [INFO ] [MAIN ] AWK: Successfully saved derivative data. [2025-09-26T22:17:33.112053] [INFO ] [MAIN ] Derivative Progress: 155/2074 symbols completed. AWK took 1.3s. Estimated remaining: 13m 26s. Rate: 142.9 symbols/min [2025-09-26T22:17:33.113384] [INFO ] [MAIN ] AXP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:33.131933] [DEBUG] [LOCAL ] AX: Derivative data saved (1820 records). [2025-09-26T22:17:33.132102] [INFO ] [MAIN ] AX: Successfully saved derivative data. [2025-09-26T22:17:33.135054] [INFO ] [MAIN ] Derivative Progress: 156/2074 symbols completed. AX took 1.3s. Estimated remaining: 13m 20s. Rate: 143.8 symbols/min [2025-09-26T22:17:33.135678] [INFO ] [MAIN ] AXR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:33.142455] [DEBUG] [LOCAL ] AXR: Loaded 3220 existing records from primary storage. [2025-09-26T22:17:33.142857] [INFO ] [MAIN ] AXR: Loaded 3220 primary data records. [2025-09-26T22:17:33.211412] [DEBUG] [LOCAL ] AXL: Loaded 51239 existing records from primary storage. [2025-09-26T22:17:33.229215] [INFO ] [MAIN ] AXL: Loaded 51239 primary data records. [2025-09-26T22:17:33.793425] [DEBUG] [LOCAL ] AXP: Loaded 53999 existing records from primary storage. [2025-09-26T22:17:33.819531] [INFO ] [MAIN ] AXP: Loaded 53999 primary data records. [2025-09-26T22:17:34.484713] [DEBUG] [MAIN ] AXR: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-09-26T22:17:34.486292] [INFO ] [MAIN ] AXR: Generated 1818 derivative records from 3220 primary records. [2025-09-26T22:17:34.486769] [DEBUG] [LOCAL ] AXR: Saving derivative data. [2025-09-26T22:17:34.523111] [DEBUG] [MAIN ] AXL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:34.528229] [INFO ] [MAIN ] AXL: Generated 1820 derivative records from 51239 primary records. [2025-09-26T22:17:34.527182] [DEBUG] [LOCAL ] AXR: Derivative data saved (1818 records). [2025-09-26T22:17:34.529402] [INFO ] [MAIN ] AXR: Successfully saved derivative data. [2025-09-26T22:17:34.532954] [INFO ] [MAIN ] Derivative Progress: 157/2074 symbols completed. AXR took 1.4s. Estimated remaining: 13m 32s. Rate: 141.6 symbols/min [2025-09-26T22:17:34.533975] [INFO ] [MAIN ] AXS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:34.533101] [DEBUG] [LOCAL ] AXL: Saving derivative data. [2025-09-26T22:17:34.550436] [DEBUG] [MAIN ] AXP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:34.565729] [INFO ] [MAIN ] AXP: Generated 1820 derivative records from 53999 primary records. [2025-09-26T22:17:34.566339] [DEBUG] [LOCAL ] AXP: Saving derivative data. [2025-09-26T22:17:34.568669] [DEBUG] [LOCAL ] AXL: Derivative data saved (1820 records). [2025-09-26T22:17:34.569404] [INFO ] [MAIN ] AXL: Successfully saved derivative data. [2025-09-26T22:17:34.573140] [INFO ] [MAIN ] Derivative Progress: 158/2074 symbols completed. AXL took 1.5s. Estimated remaining: 13m 27s. Rate: 142.5 symbols/min [2025-09-26T22:17:34.573726] [INFO ] [MAIN ] AXTA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:34.592535] [DEBUG] [LOCAL ] AXP: Derivative data saved (1820 records). [2025-09-26T22:17:34.592741] [INFO ] [MAIN ] AXP: Successfully saved derivative data. [2025-09-26T22:17:34.595696] [INFO ] [MAIN ] Derivative Progress: 159/2074 symbols completed. AXP took 1.5s. Estimated remaining: 13m 22s. Rate: 143.3 symbols/min [2025-09-26T22:17:34.596148] [INFO ] [MAIN ] AZO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:34.619954] [DEBUG] [LOCAL ] AZO: Loaded 11687 existing records from primary storage. [2025-09-26T22:17:34.620721] [INFO ] [MAIN ] AZO: Loaded 11687 primary data records. [2025-09-26T22:17:34.686978] [DEBUG] [LOCAL ] AXS: Loaded 38920 existing records from primary storage. [2025-09-26T22:17:34.723355] [INFO ] [MAIN ] AXS: Loaded 38920 primary data records. [2025-09-26T22:17:34.958496] [DEBUG] [LOCAL ] AXTA: Loaded 52835 existing records from primary storage. [2025-09-26T22:17:34.996800] [INFO ] [MAIN ] AXTA: Loaded 52835 primary data records. [2025-09-26T22:17:35.745510] [DEBUG] [MAIN ] AZO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:35.761624] [INFO ] [MAIN ] AZO: Generated 1820 derivative records from 11687 primary records. [2025-09-26T22:17:35.762213] [DEBUG] [MAIN ] AXS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:35.762474] [DEBUG] [LOCAL ] AZO: Saving derivative data. [2025-09-26T22:17:35.764672] [INFO ] [MAIN ] AXS: Generated 1820 derivative records from 38920 primary records. [2025-09-26T22:17:35.764970] [DEBUG] [LOCAL ] AXS: Saving derivative data. [2025-09-26T22:17:35.802159] [DEBUG] [LOCAL ] AZO: Derivative data saved (1820 records). [2025-09-26T22:17:35.802974] [INFO ] [MAIN ] AZO: Successfully saved derivative data. [2025-09-26T22:17:35.806920] [INFO ] [MAIN ] Derivative Progress: 160/2074 symbols completed. AZO took 1.2s. Estimated remaining: 13m 31s. Rate: 141.6 symbols/min [2025-09-26T22:17:35.810573] [INFO ] [MAIN ] AZZ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:35.827529] [DEBUG] [MAIN ] AXTA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:35.829397] [INFO ] [MAIN ] AXTA: Generated 1820 derivative records from 52835 primary records. [2025-09-26T22:17:35.828453] [DEBUG] [LOCAL ] AXS: Derivative data saved (1820 records). [2025-09-26T22:17:35.829816] [INFO ] [MAIN ] AXS: Successfully saved derivative data. [2025-09-26T22:17:35.829750] [DEBUG] [LOCAL ] AXTA: Saving derivative data. [2025-09-26T22:17:35.832970] [INFO ] [MAIN ] Derivative Progress: 161/2074 symbols completed. AXS took 1.3s. Estimated remaining: 13m 26s. Rate: 142.5 symbols/min [2025-09-26T22:17:35.833334] [INFO ] [MAIN ] BA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:35.861633] [DEBUG] [LOCAL ] AXTA: Derivative data saved (1820 records). [2025-09-26T22:17:35.867730] [INFO ] [MAIN ] AXTA: Successfully saved derivative data. [2025-09-26T22:17:35.870807] [INFO ] [MAIN ] Derivative Progress: 162/2074 symbols completed. AXTA took 1.3s. Estimated remaining: 13m 21s. Rate: 143.3 symbols/min [2025-09-26T22:17:35.871206] [INFO ] [MAIN ] BABA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:35.882109] [DEBUG] [LOCAL ] AZZ: Loaded 22359 existing records from primary storage. [2025-09-26T22:17:35.882323] [INFO ] [MAIN ] AZZ: Loaded 22359 primary data records. [2025-09-26T22:17:36.245533] [DEBUG] [LOCAL ] BA: Loaded 54571 existing records from primary storage. [2025-09-26T22:17:36.245765] [INFO ] [MAIN ] BA: Loaded 54571 primary data records. [2025-09-26T22:17:36.363496] [DEBUG] [LOCAL ] BABA: Loaded 54600 existing records from primary storage. [2025-09-26T22:17:36.371714] [INFO ] [MAIN ] BABA: Loaded 54600 primary data records. [2025-09-26T22:17:36.985331] [DEBUG] [MAIN ] AZZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:36.986839] [INFO ] [MAIN ] AZZ: Generated 1820 derivative records from 22359 primary records. [2025-09-26T22:17:36.987276] [DEBUG] [LOCAL ] AZZ: Saving derivative data. [2025-09-26T22:17:37.008248] [DEBUG] [LOCAL ] AZZ: Derivative data saved (1820 records). [2025-09-26T22:17:37.008519] [INFO ] [MAIN ] AZZ: Successfully saved derivative data. [2025-09-26T22:17:37.012672] [INFO ] [MAIN ] Derivative Progress: 163/2074 symbols completed. AZZ took 1.2s. Estimated remaining: 13m 29s. Rate: 141.8 symbols/min [2025-09-26T22:17:37.030740] [DEBUG] [MAIN ] BA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:37.031638] [INFO ] [MAIN ] BA: Generated 1820 derivative records from 54571 primary records. [2025-09-26T22:17:37.031825] [DEBUG] [LOCAL ] BA: Saving derivative data. [2025-09-26T22:17:37.066447] [DEBUG] [MAIN ] BABA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:37.066045] [DEBUG] [LOCAL ] BA: Derivative data saved (1820 records). [2025-09-26T22:17:37.066630] [INFO ] [MAIN ] BA: Successfully saved derivative data. [2025-09-26T22:17:37.069143] [INFO ] [MAIN ] Derivative Progress: 164/2074 symbols completed. BA took 1.2s. Estimated remaining: 13m 24s. Rate: 142.5 symbols/min [2025-09-26T22:17:37.070215] [INFO ] [MAIN ] BABA: Generated 1820 derivative records from 54600 primary records. [2025-09-26T22:17:37.070324] [DEBUG] [LOCAL ] BABA: Saving derivative data. [2025-09-26T22:17:37.086597] [DEBUG] [LOCAL ] BABA: Derivative data saved (1820 records). [2025-09-26T22:17:37.086695] [INFO ] [MAIN ] BABA: Successfully saved derivative data. [2025-09-26T22:17:37.089628] [INFO ] [MAIN ] Derivative Progress: 165/2074 symbols completed. BABA took 1.2s. Estimated remaining: 13m 19s. Rate: 143.4 symbols/min [2025-09-26T22:17:37.090401] [INFO ] [MAIN ] BAH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:37.090605] [INFO ] [MAIN ] BAK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:37.090356] [INFO ] [MAIN ] BAC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:37.153949] [DEBUG] [LOCAL ] BAK: Loaded 39413 existing records from primary storage. [2025-09-26T22:17:37.181270] [INFO ] [MAIN ] BAK: Loaded 39413 primary data records. [2025-09-26T22:17:37.194440] [DEBUG] [LOCAL ] BAC: Loaded 54588 existing records from primary storage. [2025-09-26T22:17:37.217920] [INFO ] [MAIN ] BAC: Loaded 54588 primary data records. [2025-09-26T22:17:37.455125] [DEBUG] [LOCAL ] BAH: Loaded 52477 existing records from primary storage. [2025-09-26T22:17:37.508713] [INFO ] [MAIN ] BAH: Loaded 52477 primary data records. [2025-09-26T22:17:38.241941] [DEBUG] [MAIN ] BAK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:38.243391] [INFO ] [MAIN ] BAK: Generated 1820 derivative records from 39413 primary records. [2025-09-26T22:17:38.243714] [DEBUG] [LOCAL ] BAK: Saving derivative data. [2025-09-26T22:17:38.276415] [DEBUG] [MAIN ] BAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:38.279088] [INFO ] [MAIN ] BAC: Generated 1820 derivative records from 54588 primary records. [2025-09-26T22:17:38.279591] [DEBUG] [LOCAL ] BAC: Saving derivative data. [2025-09-26T22:17:38.282560] [DEBUG] [LOCAL ] BAK: Derivative data saved (1820 records). [2025-09-26T22:17:38.283161] [INFO ] [MAIN ] BAK: Successfully saved derivative data. [2025-09-26T22:17:38.294219] [INFO ] [MAIN ] Derivative Progress: 166/2074 symbols completed. BAK took 1.2s. Estimated remaining: 13m 28s. Rate: 141.7 symbols/min [2025-09-26T22:17:38.301008] [INFO ] [MAIN ] BALL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:38.302983] [DEBUG] [LOCAL ] BAC: Derivative data saved (1820 records). [2025-09-26T22:17:38.303239] [INFO ] [MAIN ] BAC: Successfully saved derivative data. [2025-09-26T22:17:38.306423] [INFO ] [MAIN ] Derivative Progress: 167/2074 symbols completed. BAC took 1.2s. Estimated remaining: 13m 23s. Rate: 142.6 symbols/min [2025-09-26T22:17:38.306980] [INFO ] [MAIN ] BAM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:38.325374] [DEBUG] [MAIN ] BAH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:38.326338] [INFO ] [MAIN ] BAH: Generated 1820 derivative records from 52477 primary records. [2025-09-26T22:17:38.326493] [DEBUG] [LOCAL ] BAH: Saving derivative data. [2025-09-26T22:17:38.344942] [DEBUG] [LOCAL ] BAH: Derivative data saved (1820 records). [2025-09-26T22:17:38.345088] [INFO ] [MAIN ] BAH: Successfully saved derivative data. [2025-09-26T22:17:38.349421] [INFO ] [MAIN ] Derivative Progress: 168/2074 symbols completed. BAH took 1.3s. Estimated remaining: 13m 18s. Rate: 143.3 symbols/min [2025-09-26T22:17:38.349930] [INFO ] [MAIN ] BANC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:38.418351] [DEBUG] [LOCAL ] BALL: Loaded 52583 existing records from primary storage. [2025-09-26T22:17:38.418589] [INFO ] [MAIN ] BALL: Loaded 52583 primary data records. [2025-09-26T22:17:38.442703] [DEBUG] [LOCAL ] BAM: Loaded 52779 existing records from primary storage. [2025-09-26T22:17:38.464821] [INFO ] [MAIN ] BAM: Loaded 52779 primary data records. [2025-09-26T22:17:38.968181] [DEBUG] [LOCAL ] BANC: Loaded 52019 existing records from primary storage. [2025-09-26T22:17:38.987419] [INFO ] [MAIN ] BANC: Loaded 52019 primary data records. [2025-09-26T22:17:39.617976] [DEBUG] [MAIN ] BALL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:39.619764] [INFO ] [MAIN ] BALL: Generated 1820 derivative records from 52583 primary records. [2025-09-26T22:17:39.620435] [DEBUG] [LOCAL ] BALL: Saving derivative data. [2025-09-26T22:17:39.640323] [DEBUG] [LOCAL ] BALL: Derivative data saved (1820 records). [2025-09-26T22:17:39.641479] [INFO ] [MAIN ] BALL: Successfully saved derivative data. [2025-09-26T22:17:39.645065] [INFO ] [MAIN ] Derivative Progress: 169/2074 symbols completed. BALL took 1.3s. Estimated remaining: 13m 27s. Rate: 141.6 symbols/min [2025-09-26T22:17:39.647736] [INFO ] [MAIN ] BAP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:39.663404] [DEBUG] [MAIN ] BAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:39.664764] [INFO ] [MAIN ] BAM: Generated 1820 derivative records from 52779 primary records. [2025-09-26T22:17:39.664986] [DEBUG] [LOCAL ] BAM: Saving derivative data. [2025-09-26T22:17:39.698083] [DEBUG] [LOCAL ] BAM: Derivative data saved (1820 records). [2025-09-26T22:17:39.698769] [DEBUG] [MAIN ] BANC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:39.699585] [INFO ] [MAIN ] BANC: Generated 1820 derivative records from 52019 primary records. [2025-09-26T22:17:39.698874] [INFO ] [MAIN ] BAM: Successfully saved derivative data. [2025-09-26T22:17:39.702679] [INFO ] [MAIN ] Derivative Progress: 170/2074 symbols completed. BAM took 1.4s. Estimated remaining: 13m 23s. Rate: 142.3 symbols/min [2025-09-26T22:17:39.703128] [INFO ] [MAIN ] BARK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:39.703208] [DEBUG] [LOCAL ] BANC: Saving derivative data. [2025-09-26T22:17:39.728162] [DEBUG] [LOCAL ] BANC: Derivative data saved (1820 records). [2025-09-26T22:17:39.737591] [DEBUG] [LOCAL ] BAP: Loaded 26635 existing records from primary storage. [2025-09-26T22:17:39.737866] [INFO ] [MAIN ] BAP: Loaded 26635 primary data records. [2025-09-26T22:17:39.736981] [INFO ] [MAIN ] BANC: Successfully saved derivative data. [2025-09-26T22:17:39.740918] [INFO ] [MAIN ] Derivative Progress: 171/2074 symbols completed. BANC took 1.4s. Estimated remaining: 13m 18s. Rate: 143.1 symbols/min [2025-09-26T22:17:39.741420] [INFO ] [MAIN ] BAX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:40.042371] [DEBUG] [LOCAL ] BARK: Loaded 38893 existing records from primary storage. [2025-09-26T22:17:40.085968] [INFO ] [MAIN ] BARK: Loaded 38893 primary data records. [2025-09-26T22:17:40.278367] [DEBUG] [LOCAL ] BAX: Loaded 54273 existing records from primary storage. [2025-09-26T22:17:40.392741] [INFO ] [MAIN ] BAX: Loaded 54273 primary data records. [2025-09-26T22:17:40.814712] [DEBUG] [MAIN ] BAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:40.816442] [INFO ] [MAIN ] BAP: Generated 1820 derivative records from 26635 primary records. [2025-09-26T22:17:40.816732] [DEBUG] [LOCAL ] BAP: Saving derivative data. [2025-09-26T22:17:40.838367] [DEBUG] [LOCAL ] BAP: Derivative data saved (1820 records). [2025-09-26T22:17:40.851454] [INFO ] [MAIN ] BAP: Successfully saved derivative data. [2025-09-26T22:17:40.851983] [DEBUG] [MAIN ] BARK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:40.855512] [INFO ] [MAIN ] BARK: Generated 1820 derivative records from 38893 primary records. [2025-09-26T22:17:40.854499] [INFO ] [MAIN ] Derivative Progress: 172/2074 symbols completed. BAP took 1.2s. Estimated remaining: 13m 25s. Rate: 141.7 symbols/min [2025-09-26T22:17:40.856194] [INFO ] [MAIN ] BB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:40.856996] [DEBUG] [LOCAL ] BARK: Saving derivative data. [2025-09-26T22:17:40.875359] [DEBUG] [LOCAL ] BARK: Derivative data saved (1820 records). [2025-09-26T22:17:40.875580] [INFO ] [MAIN ] BARK: Successfully saved derivative data. [2025-09-26T22:17:40.878412] [INFO ] [MAIN ] Derivative Progress: 173/2074 symbols completed. BARK took 1.2s. Estimated remaining: 13m 20s. Rate: 142.5 symbols/min [2025-09-26T22:17:40.878700] [INFO ] [MAIN ] BBAI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:40.896633] [DEBUG] [MAIN ] BAX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:40.897566] [INFO ] [MAIN ] BAX: Generated 1820 derivative records from 54273 primary records. [2025-09-26T22:17:40.897706] [DEBUG] [LOCAL ] BAX: Saving derivative data. [2025-09-26T22:17:40.914260] [DEBUG] [LOCAL ] BAX: Derivative data saved (1820 records). [2025-09-26T22:17:40.914526] [INFO ] [MAIN ] BAX: Successfully saved derivative data. [2025-09-26T22:17:40.917768] [INFO ] [MAIN ] Derivative Progress: 174/2074 symbols completed. BAX took 1.2s. Estimated remaining: 13m 16s. Rate: 143.2 symbols/min [2025-09-26T22:17:40.918243] [INFO ] [MAIN ] BBAR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:40.972420] [DEBUG] [LOCAL ] BB: Loaded 53701 existing records from primary storage. [2025-09-26T22:17:40.972721] [INFO ] [MAIN ] BB: Loaded 53701 primary data records. [2025-09-26T22:17:41.112973] [DEBUG] [LOCAL ] BBAI: Loaded 54600 existing records from primary storage. [2025-09-26T22:17:41.153382] [DEBUG] [LOCAL ] BBAR: Loaded 41988 existing records from primary storage. [2025-09-26T22:17:41.158956] [INFO ] [MAIN ] BBAR: Loaded 41988 primary data records. [2025-09-26T22:17:41.153548] [INFO ] [MAIN ] BBAI: Loaded 54600 primary data records. [2025-09-26T22:17:42.130314] [DEBUG] [MAIN ] BB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:42.131582] [INFO ] [MAIN ] BB: Generated 1820 derivative records from 53701 primary records. [2025-09-26T22:17:42.131950] [DEBUG] [LOCAL ] BB: Saving derivative data. [2025-09-26T22:17:42.149632] [DEBUG] [LOCAL ] BB: Derivative data saved (1820 records). [2025-09-26T22:17:42.152195] [INFO ] [MAIN ] BB: Successfully saved derivative data. [2025-09-26T22:17:42.155262] [INFO ] [MAIN ] Derivative Progress: 175/2074 symbols completed. BB took 1.3s. Estimated remaining: 13m 24s. Rate: 141.7 symbols/min [2025-09-26T22:17:42.156026] [INFO ] [MAIN ] BBD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:42.172147] [DEBUG] [MAIN ] BBAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:42.173101] [INFO ] [MAIN ] BBAR: Generated 1820 derivative records from 41988 primary records. [2025-09-26T22:17:42.173304] [DEBUG] [LOCAL ] BBAR: Saving derivative data. [2025-09-26T22:17:42.194121] [DEBUG] [MAIN ] BBAI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:42.201141] [INFO ] [MAIN ] BBAI: Generated 1820 derivative records from 54600 primary records. [2025-09-26T22:17:42.202127] [DEBUG] [LOCAL ] BBAI: Saving derivative data. [2025-09-26T22:17:42.211474] [DEBUG] [LOCAL ] BBAR: Derivative data saved (1820 records). [2025-09-26T22:17:42.211770] [INFO ] [MAIN ] BBAR: Successfully saved derivative data. [2025-09-26T22:17:42.219194] [INFO ] [MAIN ] Derivative Progress: 176/2074 symbols completed. BBAR took 1.3s. Estimated remaining: 13m 20s. Rate: 142.3 symbols/min [2025-09-26T22:17:42.222673] [INFO ] [MAIN ] BBDC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:42.224595] [DEBUG] [LOCAL ] BBAI: Derivative data saved (1820 records). [2025-09-26T22:17:42.225051] [INFO ] [MAIN ] BBAI: Successfully saved derivative data. [2025-09-26T22:17:42.228690] [INFO ] [MAIN ] Derivative Progress: 177/2074 symbols completed. BBAI took 1.4s. Estimated remaining: 13m 15s. Rate: 143.1 symbols/min [2025-09-26T22:17:42.229125] [INFO ] [MAIN ] BBDO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:42.251307] [DEBUG] [LOCAL ] BBDO: Loaded 5051 existing records from primary storage. [2025-09-26T22:17:42.251470] [INFO ] [MAIN ] BBDO: Loaded 5051 primary data records. [2025-09-26T22:17:42.378705] [DEBUG] [LOCAL ] BBD: Loaded 53959 existing records from primary storage. [2025-09-26T22:17:42.391115] [INFO ] [MAIN ] BBD: Loaded 53959 primary data records. [2025-09-26T22:17:42.549469] [DEBUG] [LOCAL ] BBDC: Loaded 33756 existing records from primary storage. [2025-09-26T22:17:42.573869] [INFO ] [MAIN ] BBDC: Loaded 33756 primary data records. [2025-09-26T22:17:43.302596] [DEBUG] [MAIN ] BBDO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:43.305039] [INFO ] [MAIN ] BBDO: Generated 1820 derivative records from 5051 primary records. [2025-09-26T22:17:43.305307] [DEBUG] [LOCAL ] BBDO: Saving derivative data. [2025-09-26T22:17:43.325626] [DEBUG] [LOCAL ] BBDO: Derivative data saved (1820 records). [2025-09-26T22:17:43.333893] [INFO ] [MAIN ] BBDO: Successfully saved derivative data. [2025-09-26T22:17:43.340847] [INFO ] [MAIN ] Derivative Progress: 178/2074 symbols completed. BBDO took 1.1s. Estimated remaining: 13m 22s. Rate: 141.8 symbols/min [2025-09-26T22:17:43.342685] [DEBUG] [MAIN ] BBD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:43.343572] [INFO ] [MAIN ] BBD: Generated 1820 derivative records from 53959 primary records. [2025-09-26T22:17:43.343803] [DEBUG] [LOCAL ] BBD: Saving derivative data. [2025-09-26T22:17:43.363846] [DEBUG] [LOCAL ] BBD: Derivative data saved (1820 records). [2025-09-26T22:17:43.364019] [INFO ] [MAIN ] BBD: Successfully saved derivative data. [2025-09-26T22:17:43.368149] [INFO ] [MAIN ] Derivative Progress: 179/2074 symbols completed. BBD took 1.2s. Estimated remaining: 13m 18s. Rate: 142.6 symbols/min [2025-09-26T22:17:43.380933] [DEBUG] [MAIN ] BBDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:43.381556] [INFO ] [MAIN ] BBDC: Generated 1820 derivative records from 33756 primary records. [2025-09-26T22:17:43.381619] [DEBUG] [LOCAL ] BBDC: Saving derivative data. [2025-09-26T22:17:43.397177] [DEBUG] [LOCAL ] BBDC: Derivative data saved (1820 records). [2025-09-26T22:17:43.397244] [INFO ] [MAIN ] BBDC: Successfully saved derivative data. [2025-09-26T22:17:43.400187] [INFO ] [MAIN ] Derivative Progress: 180/2074 symbols completed. BBDC took 1.2s. Estimated remaining: 13m 13s. Rate: 143.3 symbols/min [2025-09-26T22:17:43.401383] [INFO ] [MAIN ] BBU: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:43.401526] [INFO ] [MAIN ] BBN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:43.401664] [INFO ] [MAIN ] BBUC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:43.409845] [DEBUG] [LOCAL ] BBU: Loaded 4478 existing records from primary storage. [2025-09-26T22:17:43.410914] [INFO ] [MAIN ] BBU: Loaded 4478 primary data records. [2025-09-26T22:17:43.517719] [DEBUG] [LOCAL ] BBUC: Loaded 13503 existing records from primary storage. [2025-09-26T22:17:43.543264] [INFO ] [MAIN ] BBUC: Loaded 13503 primary data records. [2025-09-26T22:17:43.661072] [DEBUG] [LOCAL ] BBN: Loaded 18193 existing records from primary storage. [2025-09-26T22:17:43.679182] [INFO ] [MAIN ] BBN: Loaded 18193 primary data records. [2025-09-26T22:17:44.474012] [DEBUG] [MAIN ] BBU: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:17:44.475300] [INFO ] [MAIN ] BBU: Generated 1819 derivative records from 4478 primary records. [2025-09-26T22:17:44.475759] [DEBUG] [LOCAL ] BBU: Saving derivative data. [2025-09-26T22:17:44.497825] [DEBUG] [LOCAL ] BBU: Derivative data saved (1819 records). [2025-09-26T22:17:44.505942] [INFO ] [MAIN ] BBU: Successfully saved derivative data. [2025-09-26T22:17:44.512997] [DEBUG] [MAIN ] BBUC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:44.518102] [INFO ] [MAIN ] BBUC: Generated 1820 derivative records from 13503 primary records. [2025-09-26T22:17:44.517077] [INFO ] [MAIN ] Derivative Progress: 181/2074 symbols completed. BBU took 1.1s. Estimated remaining: 13m 20s. Rate: 142.0 symbols/min [2025-09-26T22:17:44.519084] [DEBUG] [LOCAL ] BBUC: Saving derivative data. [2025-09-26T22:17:44.520316] [INFO ] [MAIN ] BBVA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:44.546250] [DEBUG] [MAIN ] BBN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:44.550255] [INFO ] [MAIN ] BBN: Generated 1820 derivative records from 18193 primary records. [2025-09-26T22:17:44.551449] [DEBUG] [LOCAL ] BBUC: Derivative data saved (1820 records). [2025-09-26T22:17:44.551561] [DEBUG] [LOCAL ] BBN: Saving derivative data. [2025-09-26T22:17:44.552117] [INFO ] [MAIN ] BBUC: Successfully saved derivative data. [2025-09-26T22:17:44.556128] [INFO ] [MAIN ] Derivative Progress: 182/2074 symbols completed. BBUC took 1.2s. Estimated remaining: 13m 16s. Rate: 142.7 symbols/min [2025-09-26T22:17:44.556500] [INFO ] [MAIN ] BBW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:44.573500] [DEBUG] [LOCAL ] BBN: Derivative data saved (1820 records). [2025-09-26T22:17:44.573619] [INFO ] [MAIN ] BBN: Successfully saved derivative data. [2025-09-26T22:17:44.576945] [INFO ] [MAIN ] Derivative Progress: 183/2074 symbols completed. BBN took 1.2s. Estimated remaining: 13m 11s. Rate: 143.4 symbols/min [2025-09-26T22:17:44.577673] [INFO ] [MAIN ] BBWI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:44.615357] [DEBUG] [LOCAL ] BBW: Loaded 27177 existing records from primary storage. [2025-09-26T22:17:44.615512] [INFO ] [MAIN ] BBW: Loaded 27177 primary data records. [2025-09-26T22:17:44.743328] [DEBUG] [LOCAL ] BBVA: Loaded 50167 existing records from primary storage. [2025-09-26T22:17:44.770127] [INFO ] [MAIN ] BBVA: Loaded 50167 primary data records. [2025-09-26T22:17:45.094786] [DEBUG] [LOCAL ] BBWI: Loaded 54360 existing records from primary storage. [2025-09-26T22:17:45.111185] [INFO ] [MAIN ] BBWI: Loaded 54360 primary data records. [2025-09-26T22:17:45.670159] [DEBUG] [MAIN ] BBW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:45.671556] [INFO ] [MAIN ] BBW: Generated 1820 derivative records from 27177 primary records. [2025-09-26T22:17:45.671711] [DEBUG] [LOCAL ] BBW: Saving derivative data. [2025-09-26T22:17:45.703115] [DEBUG] [MAIN ] BBVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:45.704586] [INFO ] [MAIN ] BBVA: Generated 1820 derivative records from 50167 primary records. [2025-09-26T22:17:45.705202] [DEBUG] [LOCAL ] BBVA: Saving derivative data. [2025-09-26T22:17:45.707112] [DEBUG] [LOCAL ] BBW: Derivative data saved (1820 records). [2025-09-26T22:17:45.707862] [INFO ] [MAIN ] BBW: Successfully saved derivative data. [2025-09-26T22:17:45.711071] [INFO ] [MAIN ] Derivative Progress: 184/2074 symbols completed. BBW took 1.2s. Estimated remaining: 13m 18s. Rate: 142.1 symbols/min [2025-09-26T22:17:45.711399] [INFO ] [MAIN ] BBY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:45.728070] [DEBUG] [LOCAL ] BBVA: Derivative data saved (1820 records). [2025-09-26T22:17:45.728287] [INFO ] [MAIN ] BBVA: Successfully saved derivative data. [2025-09-26T22:17:45.731621] [INFO ] [MAIN ] Derivative Progress: 185/2074 symbols completed. BBVA took 1.2s. Estimated remaining: 13m 13s. Rate: 142.9 symbols/min [2025-09-26T22:17:45.732530] [INFO ] [MAIN ] BC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:45.750972] [DEBUG] [MAIN ] BBWI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:45.751821] [INFO ] [MAIN ] BBWI: Generated 1820 derivative records from 54360 primary records. [2025-09-26T22:17:45.751991] [DEBUG] [LOCAL ] BBWI: Saving derivative data. [2025-09-26T22:17:45.770154] [DEBUG] [LOCAL ] BBWI: Derivative data saved (1820 records). [2025-09-26T22:17:45.770334] [INFO ] [MAIN ] BBWI: Successfully saved derivative data. [2025-09-26T22:17:45.773551] [INFO ] [MAIN ] Derivative Progress: 186/2074 symbols completed. BBWI took 1.2s. Estimated remaining: 13m 9s. Rate: 143.5 symbols/min [2025-09-26T22:17:45.773930] [INFO ] [MAIN ] BCAT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:45.828510] [DEBUG] [LOCAL ] BBY: Loaded 54253 existing records from primary storage. [2025-09-26T22:17:45.841268] [INFO ] [MAIN ] BBY: Loaded 54253 primary data records. [2025-09-26T22:17:45.862387] [DEBUG] [LOCAL ] BC: Loaded 45020 existing records from primary storage. [2025-09-26T22:17:45.896456] [INFO ] [MAIN ] BC: Loaded 45020 primary data records. [2025-09-26T22:17:46.107022] [DEBUG] [LOCAL ] BCAT: Loaded 34910 existing records from primary storage. [2025-09-26T22:17:46.232913] [INFO ] [MAIN ] BCAT: Loaded 34910 primary data records. [2025-09-26T22:17:46.971916] [DEBUG] [MAIN ] BBY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:46.973411] [INFO ] [MAIN ] BBY: Generated 1820 derivative records from 54253 primary records. [2025-09-26T22:17:46.973847] [DEBUG] [LOCAL ] BBY: Saving derivative data. [2025-09-26T22:17:46.996684] [DEBUG] [LOCAL ] BBY: Derivative data saved (1820 records). [2025-09-26T22:17:46.997034] [INFO ] [MAIN ] BBY: Successfully saved derivative data. [2025-09-26T22:17:46.999259] [INFO ] [MAIN ] Derivative Progress: 187/2074 symbols completed. BBY took 1.3s. Estimated remaining: 13m 17s. Rate: 142.1 symbols/min [2025-09-26T22:17:47.015996] [INFO ] [MAIN ] BCC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:47.017524] [DEBUG] [MAIN ] BC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:47.019034] [INFO ] [MAIN ] BC: Generated 1820 derivative records from 45020 primary records. [2025-09-26T22:17:47.019402] [DEBUG] [LOCAL ] BC: Saving derivative data. [2025-09-26T22:17:47.059329] [DEBUG] [MAIN ] BCAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:47.054903] [DEBUG] [LOCAL ] BC: Derivative data saved (1820 records). [2025-09-26T22:17:47.061056] [INFO ] [MAIN ] BC: Successfully saved derivative data. [2025-09-26T22:17:47.060940] [INFO ] [MAIN ] BCAT: Generated 1820 derivative records from 34910 primary records. [2025-09-26T22:17:47.064674] [INFO ] [MAIN ] Derivative Progress: 188/2074 symbols completed. BC took 1.3s. Estimated remaining: 13m 13s. Rate: 142.7 symbols/min [2025-09-26T22:17:47.073632] [INFO ] [MAIN ] BCE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:47.073901] [DEBUG] [LOCAL ] BCAT: Saving derivative data. [2025-09-26T22:17:47.098544] [DEBUG] [LOCAL ] BCC: Loaded 28735 existing records from primary storage. [2025-09-26T22:17:47.099401] [INFO ] [MAIN ] BCC: Loaded 28735 primary data records. [2025-09-26T22:17:47.159556] [DEBUG] [LOCAL ] BCAT: Derivative data saved (1820 records). [2025-09-26T22:17:47.159861] [INFO ] [MAIN ] BCAT: Successfully saved derivative data. [2025-09-26T22:17:47.172083] [INFO ] [MAIN ] Derivative Progress: 189/2074 symbols completed. BCAT took 1.4s. Estimated remaining: 13m 9s. Rate: 143.3 symbols/min [2025-09-26T22:17:47.177776] [INFO ] [MAIN ] BCO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:47.483062] [DEBUG] [LOCAL ] BCE: Loaded 53072 existing records from primary storage. [2025-09-26T22:17:47.492365] [INFO ] [MAIN ] BCE: Loaded 53072 primary data records. [2025-09-26T22:17:47.493049] [DEBUG] [LOCAL ] BCO: Loaded 26740 existing records from primary storage. [2025-09-26T22:17:47.506164] [INFO ] [MAIN ] BCO: Loaded 26740 primary data records. [2025-09-26T22:17:48.220387] [DEBUG] [MAIN ] BCC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:48.221685] [INFO ] [MAIN ] BCC: Generated 1820 derivative records from 28735 primary records. [2025-09-26T22:17:48.221790] [DEBUG] [LOCAL ] BCC: Saving derivative data. [2025-09-26T22:17:48.249046] [DEBUG] [LOCAL ] BCC: Derivative data saved (1820 records). [2025-09-26T22:17:48.249406] [INFO ] [MAIN ] BCC: Successfully saved derivative data. [2025-09-26T22:17:48.252227] [INFO ] [MAIN ] Derivative Progress: 190/2074 symbols completed. BCC took 1.2s. Estimated remaining: 13m 15s. Rate: 142.1 symbols/min [2025-09-26T22:17:48.252861] [INFO ] [MAIN ] BCSF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:48.268996] [DEBUG] [MAIN ] BCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:48.271426] [INFO ] [MAIN ] BCO: Generated 1820 derivative records from 26740 primary records. [2025-09-26T22:17:48.272394] [DEBUG] [LOCAL ] BCO: Saving derivative data. [2025-09-26T22:17:48.295136] [DEBUG] [MAIN ] BCE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:48.300622] [INFO ] [MAIN ] BCE: Generated 1820 derivative records from 53072 primary records. [2025-09-26T22:17:48.304306] [DEBUG] [LOCAL ] BCE: Saving derivative data. [2025-09-26T22:17:48.306677] [DEBUG] [LOCAL ] BCO: Derivative data saved (1820 records). [2025-09-26T22:17:48.314373] [INFO ] [MAIN ] BCO: Successfully saved derivative data. [2025-09-26T22:17:48.317756] [INFO ] [MAIN ] Derivative Progress: 191/2074 symbols completed. BCO took 1.1s. Estimated remaining: 13m 12s. Rate: 142.7 symbols/min [2025-09-26T22:17:48.322789] [INFO ] [MAIN ] BCX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:48.335869] [DEBUG] [LOCAL ] BCE: Derivative data saved (1820 records). [2025-09-26T22:17:48.336136] [INFO ] [MAIN ] BCE: Successfully saved derivative data. [2025-09-26T22:17:48.339776] [INFO ] [MAIN ] Derivative Progress: 192/2074 symbols completed. BCE took 1.3s. Estimated remaining: 13m 7s. Rate: 143.4 symbols/min [2025-09-26T22:17:48.340271] [INFO ] [MAIN ] BDC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:48.352501] [DEBUG] [LOCAL ] BCSF: Loaded 28231 existing records from primary storage. [2025-09-26T22:17:48.352782] [INFO ] [MAIN ] BCSF: Loaded 28231 primary data records. [2025-09-26T22:17:48.483002] [DEBUG] [LOCAL ] BCX: Loaded 21920 existing records from primary storage. [2025-09-26T22:17:48.494072] [INFO ] [MAIN ] BCX: Loaded 21920 primary data records. [2025-09-26T22:17:48.561066] [DEBUG] [LOCAL ] BDC: Loaded 25073 existing records from primary storage. [2025-09-26T22:17:48.638743] [INFO ] [MAIN ] BDC: Loaded 25073 primary data records. [2025-09-26T22:17:49.422246] [DEBUG] [MAIN ] BCSF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:49.425049] [INFO ] [MAIN ] BCSF: Generated 1820 derivative records from 28231 primary records. [2025-09-26T22:17:49.428021] [DEBUG] [LOCAL ] BCSF: Saving derivative data. [2025-09-26T22:17:49.457482] [DEBUG] [MAIN ] BCX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:49.459401] [INFO ] [MAIN ] BCX: Generated 1820 derivative records from 21920 primary records. [2025-09-26T22:17:49.459697] [DEBUG] [LOCAL ] BCX: Saving derivative data. [2025-09-26T22:17:49.491063] [DEBUG] [LOCAL ] BCSF: Derivative data saved (1820 records). [2025-09-26T22:17:49.497812] [INFO ] [MAIN ] BCSF: Successfully saved derivative data. [2025-09-26T22:17:49.498463] [DEBUG] [LOCAL ] BCX: Derivative data saved (1820 records). [2025-09-26T22:17:49.498574] [INFO ] [MAIN ] BCX: Successfully saved derivative data. [2025-09-26T22:17:49.497180] [DEBUG] [MAIN ] BDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:49.501205] [INFO ] [MAIN ] Derivative Progress: 193/2074 symbols completed. BCSF took 1.2s. Estimated remaining: 13m 14s. Rate: 142.1 symbols/min [2025-09-26T22:17:49.506087] [INFO ] [MAIN ] Derivative Progress: 194/2074 symbols completed. BCX took 1.2s. Estimated remaining: 13m 10s. Rate: 142.9 symbols/min [2025-09-26T22:17:49.505784] [INFO ] [MAIN ] BDC: Generated 1820 derivative records from 25073 primary records. [2025-09-26T22:17:49.506273] [DEBUG] [LOCAL ] BDC: Saving derivative data. [2025-09-26T22:17:49.523584] [DEBUG] [LOCAL ] BDC: Derivative data saved (1820 records). [2025-09-26T22:17:49.523674] [INFO ] [MAIN ] BDC: Successfully saved derivative data. [2025-09-26T22:17:49.526878] [INFO ] [MAIN ] Derivative Progress: 195/2074 symbols completed. BDC took 1.2s. Estimated remaining: 13m 5s. Rate: 143.6 symbols/min [2025-09-26T22:17:49.527670] [INFO ] [MAIN ] BDJ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:49.527618] [INFO ] [MAIN ] BDX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:49.527873] [INFO ] [MAIN ] BDN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:49.562561] [DEBUG] [LOCAL ] BDJ: Loaded 29325 existing records from primary storage. [2025-09-26T22:17:49.562750] [INFO ] [MAIN ] BDJ: Loaded 29325 primary data records. [2025-09-26T22:17:49.793914] [DEBUG] [LOCAL ] BDN: Loaded 48230 existing records from primary storage. [2025-09-26T22:17:49.776820] [DEBUG] [LOCAL ] BDX: Loaded 53191 existing records from primary storage. [2025-09-26T22:17:49.828707] [INFO ] [MAIN ] BDX: Loaded 53191 primary data records. [2025-09-26T22:17:49.834295] [INFO ] [MAIN ] BDN: Loaded 48230 primary data records. [2025-09-26T22:17:50.670275] [DEBUG] [MAIN ] BDJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:50.672325] [INFO ] [MAIN ] BDJ: Generated 1820 derivative records from 29325 primary records. [2025-09-26T22:17:50.672848] [DEBUG] [LOCAL ] BDJ: Saving derivative data. [2025-09-26T22:17:50.692309] [DEBUG] [LOCAL ] BDJ: Derivative data saved (1820 records). [2025-09-26T22:17:50.692679] [INFO ] [MAIN ] BDJ: Successfully saved derivative data. [2025-09-26T22:17:50.694866] [INFO ] [MAIN ] Derivative Progress: 196/2074 symbols completed. BDJ took 1.2s. Estimated remaining: 13m 12s. Rate: 142.3 symbols/min [2025-09-26T22:17:50.695168] [INFO ] [MAIN ] BE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:50.723945] [DEBUG] [MAIN ] BDX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:50.729759] [INFO ] [MAIN ] BDX: Generated 1820 derivative records from 53191 primary records. [2025-09-26T22:17:50.729942] [DEBUG] [LOCAL ] BDX: Saving derivative data. [2025-09-26T22:17:50.730491] [DEBUG] [MAIN ] BDN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:50.731504] [INFO ] [MAIN ] BDN: Generated 1820 derivative records from 48230 primary records. [2025-09-26T22:17:50.731678] [DEBUG] [LOCAL ] BDN: Saving derivative data. [2025-09-26T22:17:50.761504] [DEBUG] [LOCAL ] BDN: Derivative data saved (1820 records). [2025-09-26T22:17:50.762513] [INFO ] [MAIN ] BDN: Successfully saved derivative data. [2025-09-26T22:17:50.765759] [INFO ] [MAIN ] Derivative Progress: 197/2074 symbols completed. BDN took 1.2s. Estimated remaining: 13m 8s. Rate: 142.9 symbols/min [2025-09-26T22:17:50.766340] [INFO ] [MAIN ] BEN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:50.769516] [DEBUG] [LOCAL ] BDX: Derivative data saved (1820 records). [2025-09-26T22:17:50.769819] [INFO ] [MAIN ] BDX: Successfully saved derivative data. [2025-09-26T22:17:50.786687] [INFO ] [MAIN ] Derivative Progress: 198/2074 symbols completed. BDX took 1.3s. Estimated remaining: 13m 4s. Rate: 143.6 symbols/min [2025-09-26T22:17:50.787315] [INFO ] [MAIN ] BEPC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:50.810810] [DEBUG] [LOCAL ] BE: Loaded 54433 existing records from primary storage. [2025-09-26T22:17:50.812482] [INFO ] [MAIN ] BE: Loaded 54433 primary data records. [2025-09-26T22:17:51.213004] [DEBUG] [LOCAL ] BEN: Loaded 53833 existing records from primary storage. [2025-09-26T22:17:51.211385] [DEBUG] [LOCAL ] BEPC: Loaded 47209 existing records from primary storage. [2025-09-26T22:17:51.214111] [INFO ] [MAIN ] BEN: Loaded 53833 primary data records. [2025-09-26T22:17:51.214199] [INFO ] [MAIN ] BEPC: Loaded 47209 primary data records. [2025-09-26T22:17:51.904308] [DEBUG] [MAIN ] BE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:51.906322] [INFO ] [MAIN ] BE: Generated 1820 derivative records from 54433 primary records. [2025-09-26T22:17:51.906494] [DEBUG] [LOCAL ] BE: Saving derivative data. [2025-09-26T22:17:51.926803] [DEBUG] [LOCAL ] BE: Derivative data saved (1820 records). [2025-09-26T22:17:51.927138] [INFO ] [MAIN ] BE: Successfully saved derivative data. [2025-09-26T22:17:51.930887] [INFO ] [MAIN ] Derivative Progress: 199/2074 symbols completed. BE took 1.2s. Estimated remaining: 13m 11s. Rate: 142.3 symbols/min [2025-09-26T22:17:51.931581] [INFO ] [MAIN ] BEPH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:51.941473] [DEBUG] [LOCAL ] BEPH: Loaded 5208 existing records from primary storage. [2025-09-26T22:17:51.945212] [INFO ] [MAIN ] BEPH: Loaded 5208 primary data records. [2025-09-26T22:17:52.008375] [DEBUG] [MAIN ] BEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:52.022214] [DEBUG] [MAIN ] BEPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:52.036190] [INFO ] [MAIN ] BEN: Generated 1820 derivative records from 53833 primary records. [2025-09-26T22:17:52.046950] [INFO ] [MAIN ] BEPC: Generated 1820 derivative records from 47209 primary records. [2025-09-26T22:17:52.038793] [DEBUG] [LOCAL ] BEN: Saving derivative data. [2025-09-26T22:17:52.052823] [DEBUG] [LOCAL ] BEPC: Saving derivative data. [2025-09-26T22:17:52.138246] [DEBUG] [LOCAL ] BEPC: Derivative data saved (1820 records). [2025-09-26T22:17:52.150843] [INFO ] [MAIN ] BEPC: Successfully saved derivative data. [2025-09-26T22:17:52.153915] [INFO ] [MAIN ] Derivative Progress: 200/2074 symbols completed. BEPC took 1.4s. Estimated remaining: 13m 8s. Rate: 142.6 symbols/min [2025-09-26T22:17:52.160876] [INFO ] [MAIN ] BEPI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:52.160958] [DEBUG] [LOCAL ] BEN: Derivative data saved (1820 records). [2025-09-26T22:17:52.171351] [INFO ] [MAIN ] BEN: Successfully saved derivative data. [2025-09-26T22:17:52.173889] [INFO ] [MAIN ] Derivative Progress: 201/2074 symbols completed. BEN took 1.4s. Estimated remaining: 13m 4s. Rate: 143.3 symbols/min [2025-09-26T22:17:52.179290] [INFO ] [MAIN ] BEPJ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:52.260314] [DEBUG] [LOCAL ] BEPJ: Loaded 3268 existing records from primary storage. [2025-09-26T22:17:52.406702] [INFO ] [MAIN ] BEPJ: Loaded 3268 primary data records. [2025-09-26T22:17:52.406903] [DEBUG] [LOCAL ] BEPI: Loaded 3487 existing records from primary storage. [2025-09-26T22:17:52.421821] [INFO ] [MAIN ] BEPI: Loaded 3487 primary data records. [2025-09-26T22:17:53.120248] [DEBUG] [MAIN ] BEPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:53.121961] [INFO ] [MAIN ] BEPH: Generated 1820 derivative records from 5208 primary records. [2025-09-26T22:17:53.122584] [DEBUG] [LOCAL ] BEPH: Saving derivative data. [2025-09-26T22:17:53.148198] [DEBUG] [LOCAL ] BEPH: Derivative data saved (1820 records). [2025-09-26T22:17:53.148813] [INFO ] [MAIN ] BEPH: Successfully saved derivative data. [2025-09-26T22:17:53.151150] [INFO ] [MAIN ] Derivative Progress: 202/2074 symbols completed. BEPH took 1.2s. Estimated remaining: 13m 9s. Rate: 142.4 symbols/min [2025-09-26T22:17:53.151963] [INFO ] [MAIN ] BFAM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:53.171510] [DEBUG] [MAIN ] BEPI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:53.174246] [INFO ] [MAIN ] BEPI: Generated 1820 derivative records from 3487 primary records. [2025-09-26T22:17:53.174359] [DEBUG] [LOCAL ] BEPI: Saving derivative data. [2025-09-26T22:17:53.203205] [DEBUG] [MAIN ] BEPJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:53.207963] [INFO ] [MAIN ] BEPJ: Generated 1820 derivative records from 3268 primary records. [2025-09-26T22:17:53.208140] [DEBUG] [LOCAL ] BEPJ: Saving derivative data. [2025-09-26T22:17:53.206768] [DEBUG] [LOCAL ] BEPI: Derivative data saved (1820 records). [2025-09-26T22:17:53.209576] [INFO ] [MAIN ] BEPI: Successfully saved derivative data. [2025-09-26T22:17:53.212989] [INFO ] [MAIN ] Derivative Progress: 203/2074 symbols completed. BEPI took 1.1s. Estimated remaining: 13m 5s. Rate: 143.0 symbols/min [2025-09-26T22:17:53.222190] [INFO ] [MAIN ] BFH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:53.230381] [DEBUG] [LOCAL ] BEPJ: Derivative data saved (1820 records). [2025-09-26T22:17:53.240115] [INFO ] [MAIN ] BEPJ: Successfully saved derivative data. [2025-09-26T22:17:53.243345] [INFO ] [MAIN ] Derivative Progress: 204/2074 symbols completed. BEPJ took 1.1s. Estimated remaining: 13m 1s. Rate: 143.6 symbols/min [2025-09-26T22:17:53.244021] [INFO ] [MAIN ] BFK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:53.262211] [DEBUG] [LOCAL ] BFAM: Loaded 33519 existing records from primary storage. [2025-09-26T22:17:53.267195] [INFO ] [MAIN ] BFAM: Loaded 33519 primary data records. [2025-09-26T22:17:53.323189] [DEBUG] [LOCAL ] BFK: Loaded 14145 existing records from primary storage. [2025-09-26T22:17:53.351590] [INFO ] [MAIN ] BFK: Loaded 14145 primary data records. [2025-09-26T22:17:53.618023] [DEBUG] [LOCAL ] BFH: Loaded 42308 existing records from primary storage. [2025-09-26T22:17:53.646594] [INFO ] [MAIN ] BFH: Loaded 42308 primary data records. [2025-09-26T22:17:54.365567] [DEBUG] [MAIN ] BFAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:54.366906] [INFO ] [MAIN ] BFAM: Generated 1820 derivative records from 33519 primary records. [2025-09-26T22:17:54.367081] [DEBUG] [LOCAL ] BFAM: Saving derivative data. [2025-09-26T22:17:54.389970] [DEBUG] [MAIN ] BFK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:54.400124] [DEBUG] [LOCAL ] BFAM: Derivative data saved (1820 records). [2025-09-26T22:17:54.400284] [INFO ] [MAIN ] BFAM: Successfully saved derivative data. [2025-09-26T22:17:54.399467] [INFO ] [MAIN ] BFK: Generated 1820 derivative records from 14145 primary records. [2025-09-26T22:17:54.403016] [INFO ] [MAIN ] Derivative Progress: 205/2074 symbols completed. BFAM took 1.3s. Estimated remaining: 13m 7s. Rate: 142.4 symbols/min [2025-09-26T22:17:54.400733] [DEBUG] [LOCAL ] BFK: Saving derivative data. [2025-09-26T22:17:54.403474] [INFO ] [MAIN ] BFLY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:54.428060] [DEBUG] [LOCAL ] BFK: Derivative data saved (1820 records). [2025-09-26T22:17:54.428561] [INFO ] [MAIN ] BFK: Successfully saved derivative data. [2025-09-26T22:17:54.431800] [INFO ] [MAIN ] Derivative Progress: 206/2074 symbols completed. BFK took 1.2s. Estimated remaining: 13m 3s. Rate: 143.1 symbols/min [2025-09-26T22:17:54.432193] [INFO ] [MAIN ] BFS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:54.447597] [DEBUG] [MAIN ] BFH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:54.448392] [INFO ] [MAIN ] BFH: Generated 1820 derivative records from 42308 primary records. [2025-09-26T22:17:54.448459] [DEBUG] [LOCAL ] BFH: Saving derivative data. [2025-09-26T22:17:54.471897] [DEBUG] [LOCAL ] BFH: Derivative data saved (1820 records). [2025-09-26T22:17:54.472391] [INFO ] [MAIN ] BFH: Successfully saved derivative data. [2025-09-26T22:17:54.472298] [DEBUG] [LOCAL ] BFS: Loaded 9240 existing records from primary storage. [2025-09-26T22:17:54.475509] [INFO ] [MAIN ] Derivative Progress: 207/2074 symbols completed. BFH took 1.3s. Estimated remaining: 12m 60s. Rate: 143.7 symbols/min [2025-09-26T22:17:54.475814] [INFO ] [MAIN ] BFS: Loaded 9240 primary data records. [2025-09-26T22:17:54.476109] [INFO ] [MAIN ] BFZ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:54.675150] [DEBUG] [LOCAL ] BFLY: Loaded 52590 existing records from primary storage. [2025-09-26T22:17:54.721977] [DEBUG] [LOCAL ] BFZ: Loaded 12223 existing records from primary storage. [2025-09-26T22:17:54.864485] [INFO ] [MAIN ] BFLY: Loaded 52590 primary data records. [2025-09-26T22:17:54.870122] [INFO ] [MAIN ] BFZ: Loaded 12223 primary data records. [2025-09-26T22:17:55.551013] [DEBUG] [MAIN ] BFS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:55.551989] [INFO ] [MAIN ] BFS: Generated 1820 derivative records from 9240 primary records. [2025-09-26T22:17:55.552406] [DEBUG] [LOCAL ] BFS: Saving derivative data. [2025-09-26T22:17:55.575357] [DEBUG] [LOCAL ] BFS: Derivative data saved (1820 records). [2025-09-26T22:17:55.575823] [INFO ] [MAIN ] BFS: Successfully saved derivative data. [2025-09-26T22:17:55.578118] [INFO ] [MAIN ] Derivative Progress: 208/2074 symbols completed. BFS took 1.1s. Estimated remaining: 13m 5s. Rate: 142.5 symbols/min [2025-09-26T22:17:55.591869] [DEBUG] [MAIN ] BFLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:55.593384] [INFO ] [MAIN ] BFLY: Generated 1820 derivative records from 52590 primary records. [2025-09-26T22:17:55.594251] [DEBUG] [LOCAL ] BFLY: Saving derivative data. [2025-09-26T22:17:55.620207] [DEBUG] [MAIN ] BFZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:55.623884] [INFO ] [MAIN ] BFZ: Generated 1820 derivative records from 12223 primary records. [2025-09-26T22:17:55.624411] [DEBUG] [LOCAL ] BFZ: Saving derivative data. [2025-09-26T22:17:55.625526] [DEBUG] [LOCAL ] BFLY: Derivative data saved (1820 records). [2025-09-26T22:17:55.625672] [INFO ] [MAIN ] BFLY: Successfully saved derivative data. [2025-09-26T22:17:55.629296] [INFO ] [MAIN ] Derivative Progress: 209/2074 symbols completed. BFLY took 1.2s. Estimated remaining: 13m 2s. Rate: 143.2 symbols/min [2025-09-26T22:17:55.644759] [DEBUG] [LOCAL ] BFZ: Derivative data saved (1820 records). [2025-09-26T22:17:55.644839] [INFO ] [MAIN ] BFZ: Successfully saved derivative data. [2025-09-26T22:17:55.647796] [INFO ] [MAIN ] Derivative Progress: 210/2074 symbols completed. BFZ took 1.2s. Estimated remaining: 12m 58s. Rate: 143.8 symbols/min [2025-09-26T22:17:55.648428] [INFO ] [MAIN ] BG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:55.648718] [INFO ] [MAIN ] BGB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:55.649477] [INFO ] [MAIN ] BGH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:55.674581] [DEBUG] [LOCAL ] BGB: Loaded 17621 existing records from primary storage. [2025-09-26T22:17:55.674762] [INFO ] [MAIN ] BGB: Loaded 17621 primary data records. [2025-09-26T22:17:55.693945] [DEBUG] [LOCAL ] BGH: Loaded 16728 existing records from primary storage. [2025-09-26T22:17:55.717065] [INFO ] [MAIN ] BGH: Loaded 16728 primary data records. [2025-09-26T22:17:56.193686] [DEBUG] [LOCAL ] BG: Loaded 51118 existing records from primary storage. [2025-09-26T22:17:56.213953] [INFO ] [MAIN ] BG: Loaded 51118 primary data records. [2025-09-26T22:17:56.831055] [DEBUG] [MAIN ] BGB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:56.833186] [INFO ] [MAIN ] BGB: Generated 1820 derivative records from 17621 primary records. [2025-09-26T22:17:56.833676] [DEBUG] [LOCAL ] BGB: Saving derivative data. [2025-09-26T22:17:56.871113] [DEBUG] [LOCAL ] BGB: Derivative data saved (1820 records). [2025-09-26T22:17:56.871738] [INFO ] [MAIN ] BGB: Successfully saved derivative data. [2025-09-26T22:17:56.872157] [DEBUG] [MAIN ] BGH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:56.876982] [INFO ] [MAIN ] BGH: Generated 1820 derivative records from 16728 primary records. [2025-09-26T22:17:56.877381] [DEBUG] [LOCAL ] BGH: Saving derivative data. [2025-09-26T22:17:56.875681] [INFO ] [MAIN ] Derivative Progress: 211/2074 symbols completed. BGB took 1.2s. Estimated remaining: 13m 4s. Rate: 142.5 symbols/min [2025-09-26T22:17:56.878874] [INFO ] [MAIN ] BGR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:56.914546] [DEBUG] [LOCAL ] BGH: Derivative data saved (1820 records). [2025-09-26T22:17:56.926992] [INFO ] [MAIN ] BGH: Successfully saved derivative data. [2025-09-26T22:17:56.932565] [INFO ] [MAIN ] Derivative Progress: 212/2074 symbols completed. BGH took 1.3s. Estimated remaining: 13m 1s. Rate: 143.1 symbols/min [2025-09-26T22:17:56.933260] [DEBUG] [MAIN ] BG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:56.933521] [INFO ] [MAIN ] BGS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:56.934613] [INFO ] [MAIN ] BG: Generated 1820 derivative records from 51118 primary records. [2025-09-26T22:17:56.934830] [DEBUG] [LOCAL ] BG: Saving derivative data. [2025-09-26T22:17:56.937262] [DEBUG] [LOCAL ] BGR: Loaded 13658 existing records from primary storage. [2025-09-26T22:17:56.945856] [INFO ] [MAIN ] BGR: Loaded 13658 primary data records. [2025-09-26T22:17:57.089192] [DEBUG] [LOCAL ] BG: Derivative data saved (1820 records). [2025-09-26T22:17:57.100015] [INFO ] [MAIN ] BG: Successfully saved derivative data. [2025-09-26T22:17:57.154770] [INFO ] [MAIN ] Derivative Progress: 213/2074 symbols completed. BG took 1.5s. Estimated remaining: 12m 59s. Rate: 143.4 symbols/min [2025-09-26T22:17:57.173513] [INFO ] [MAIN ] BGSF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:57.346008] [DEBUG] [LOCAL ] BGSF: Loaded 7050 existing records from primary storage. [2025-09-26T22:17:57.347799] [DEBUG] [LOCAL ] BGS: Loaded 51183 existing records from primary storage. [2025-09-26T22:17:57.346439] [INFO ] [MAIN ] BGSF: Loaded 7050 primary data records. [2025-09-26T22:17:57.348703] [INFO ] [MAIN ] BGS: Loaded 51183 primary data records. [2025-09-26T22:17:58.064727] [DEBUG] [MAIN ] BGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:58.068957] [INFO ] [MAIN ] BGR: Generated 1820 derivative records from 13658 primary records. [2025-09-26T22:17:58.069362] [DEBUG] [LOCAL ] BGR: Saving derivative data. [2025-09-26T22:17:58.096573] [DEBUG] [LOCAL ] BGR: Derivative data saved (1820 records). [2025-09-26T22:17:58.097384] [INFO ] [MAIN ] BGR: Successfully saved derivative data. [2025-09-26T22:17:58.100245] [INFO ] [MAIN ] Derivative Progress: 214/2074 symbols completed. BGR took 1.2s. Estimated remaining: 13m 3s. Rate: 142.6 symbols/min [2025-09-26T22:17:58.100717] [INFO ] [MAIN ] BGT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:58.134017] [DEBUG] [MAIN ] BGSF: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-09-26T22:17:58.136125] [INFO ] [MAIN ] BGSF: Generated 1818 derivative records from 7050 primary records. [2025-09-26T22:17:58.135112] [DEBUG] [MAIN ] BGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:58.136411] [DEBUG] [LOCAL ] BGSF: Saving derivative data. [2025-09-26T22:17:58.137262] [INFO ] [MAIN ] BGS: Generated 1820 derivative records from 51183 primary records. [2025-09-26T22:17:58.137977] [DEBUG] [LOCAL ] BGS: Saving derivative data. [2025-09-26T22:17:58.169714] [DEBUG] [LOCAL ] BGSF: Derivative data saved (1818 records). [2025-09-26T22:17:58.170217] [INFO ] [MAIN ] BGSF: Successfully saved derivative data. [2025-09-26T22:17:58.173831] [INFO ] [MAIN ] Derivative Progress: 215/2074 symbols completed. BGSF took 1.0s. Estimated remaining: 12m 59s. Rate: 143.1 symbols/min [2025-09-26T22:17:58.180389] [INFO ] [MAIN ] BGX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:58.182788] [DEBUG] [LOCAL ] BGT: Loaded 16793 existing records from primary storage. [2025-09-26T22:17:58.183571] [INFO ] [MAIN ] BGT: Loaded 16793 primary data records. [2025-09-26T22:17:58.259446] [DEBUG] [LOCAL ] BGS: Derivative data saved (1820 records). [2025-09-26T22:17:58.272607] [INFO ] [MAIN ] BGS: Successfully saved derivative data. [2025-09-26T22:17:58.285946] [INFO ] [MAIN ] Derivative Progress: 216/2074 symbols completed. BGS took 1.4s. Estimated remaining: 12m 56s. Rate: 143.6 symbols/min [2025-09-26T22:17:58.321942] [INFO ] [MAIN ] BGY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:58.311260] [DEBUG] [LOCAL ] BGX: Loaded 10900 existing records from primary storage. [2025-09-26T22:17:58.338088] [INFO ] [MAIN ] BGX: Loaded 10900 primary data records. [2025-09-26T22:17:58.714993] [DEBUG] [LOCAL ] BGY: Loaded 22790 existing records from primary storage. [2025-09-26T22:17:58.744450] [INFO ] [MAIN ] BGY: Loaded 22790 primary data records. [2025-09-26T22:17:59.306926] [DEBUG] [MAIN ] BGT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:59.308722] [INFO ] [MAIN ] BGT: Generated 1820 derivative records from 16793 primary records. [2025-09-26T22:17:59.309173] [DEBUG] [LOCAL ] BGT: Saving derivative data. [2025-09-26T22:17:59.327826] [DEBUG] [LOCAL ] BGT: Derivative data saved (1820 records). [2025-09-26T22:17:59.328236] [INFO ] [MAIN ] BGT: Successfully saved derivative data. [2025-09-26T22:17:59.332841] [INFO ] [MAIN ] Derivative Progress: 217/2074 symbols completed. BGT took 1.2s. Estimated remaining: 13m 1s. Rate: 142.6 symbols/min [2025-09-26T22:17:59.333931] [INFO ] [MAIN ] BHC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:59.349271] [DEBUG] [MAIN ] BGX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:59.350386] [INFO ] [MAIN ] BGX: Generated 1820 derivative records from 10900 primary records. [2025-09-26T22:17:59.350813] [DEBUG] [LOCAL ] BGX: Saving derivative data. [2025-09-26T22:17:59.367836] [DEBUG] [LOCAL ] BGX: Derivative data saved (1820 records). [2025-09-26T22:17:59.368119] [INFO ] [MAIN ] BGX: Successfully saved derivative data. [2025-09-26T22:17:59.372387] [INFO ] [MAIN ] Derivative Progress: 218/2074 symbols completed. BGX took 1.2s. Estimated remaining: 12m 58s. Rate: 143.2 symbols/min [2025-09-26T22:17:59.372790] [INFO ] [MAIN ] BHK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:59.391037] [DEBUG] [MAIN ] BGY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:17:59.391888] [INFO ] [MAIN ] BGY: Generated 1820 derivative records from 22790 primary records. [2025-09-26T22:17:59.392060] [DEBUG] [LOCAL ] BGY: Saving derivative data. [2025-09-26T22:17:59.433690] [DEBUG] [LOCAL ] BHK: Loaded 22922 existing records from primary storage. [2025-09-26T22:17:59.435034] [DEBUG] [LOCAL ] BGY: Derivative data saved (1820 records). [2025-09-26T22:17:59.435200] [INFO ] [MAIN ] BGY: Successfully saved derivative data. [2025-09-26T22:17:59.435359] [INFO ] [MAIN ] BHK: Loaded 22922 primary data records. [2025-09-26T22:17:59.454709] [INFO ] [MAIN ] Derivative Progress: 219/2074 symbols completed. BGY took 1.1s. Estimated remaining: 12m 54s. Rate: 143.7 symbols/min [2025-09-26T22:17:59.523771] [INFO ] [MAIN ] BHP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:17:59.502527] [DEBUG] [LOCAL ] BHC: Loaded 47495 existing records from primary storage. [2025-09-26T22:17:59.543779] [INFO ] [MAIN ] BHC: Loaded 47495 primary data records. [2025-09-26T22:18:00.184816] [DEBUG] [LOCAL ] BHP: Loaded 54153 existing records from primary storage. [2025-09-26T22:18:00.185943] [INFO ] [MAIN ] BHP: Loaded 54153 primary data records. [2025-09-26T22:18:00.536100] [DEBUG] [MAIN ] BHK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:00.537800] [DEBUG] [MAIN ] BHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:00.537465] [INFO ] [MAIN ] BHK: Generated 1820 derivative records from 22922 primary records. [2025-09-26T22:18:00.538444] [INFO ] [MAIN ] BHC: Generated 1820 derivative records from 47495 primary records. [2025-09-26T22:18:00.538626] [DEBUG] [LOCAL ] BHK: Saving derivative data. [2025-09-26T22:18:00.538789] [DEBUG] [LOCAL ] BHC: Saving derivative data. [2025-09-26T22:18:00.575985] [DEBUG] [LOCAL ] BHC: Derivative data saved (1820 records). [2025-09-26T22:18:00.576787] [INFO ] [MAIN ] BHC: Successfully saved derivative data. [2025-09-26T22:18:00.583240] [INFO ] [MAIN ] Derivative Progress: 220/2074 symbols completed. BHC took 1.2s. Estimated remaining: 12m 60s. Rate: 142.6 symbols/min [2025-09-26T22:18:00.584083] [DEBUG] [LOCAL ] BHK: Derivative data saved (1820 records). [2025-09-26T22:18:00.584618] [INFO ] [MAIN ] BHR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:00.585091] [INFO ] [MAIN ] BHK: Successfully saved derivative data. [2025-09-26T22:18:00.588914] [INFO ] [MAIN ] Derivative Progress: 221/2074 symbols completed. BHK took 1.2s. Estimated remaining: 12m 56s. Rate: 143.3 symbols/min [2025-09-26T22:18:00.590206] [INFO ] [MAIN ] BHVN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:00.609353] [DEBUG] [MAIN ] BHP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:00.616456] [INFO ] [MAIN ] BHP: Generated 1820 derivative records from 54153 primary records. [2025-09-26T22:18:00.616798] [DEBUG] [LOCAL ] BHP: Saving derivative data. [2025-09-26T22:18:00.641051] [DEBUG] [LOCAL ] BHR: Loaded 21771 existing records from primary storage. [2025-09-26T22:18:00.642634] [DEBUG] [LOCAL ] BHP: Derivative data saved (1820 records). [2025-09-26T22:18:00.643448] [INFO ] [MAIN ] BHR: Loaded 21771 primary data records. [2025-09-26T22:18:00.643585] [INFO ] [MAIN ] BHP: Successfully saved derivative data. [2025-09-26T22:18:00.669778] [INFO ] [MAIN ] Derivative Progress: 222/2074 symbols completed. BHP took 1.2s. Estimated remaining: 12m 53s. Rate: 143.8 symbols/min [2025-09-26T22:18:00.686393] [INFO ] [MAIN ] BILL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:01.054170] [DEBUG] [LOCAL ] BHVN: Loaded 50401 existing records from primary storage. [2025-09-26T22:18:01.054750] [INFO ] [MAIN ] BHVN: Loaded 50401 primary data records. [2025-09-26T22:18:01.263040] [DEBUG] [LOCAL ] BILL: Loaded 53105 existing records from primary storage. [2025-09-26T22:18:01.294021] [INFO ] [MAIN ] BILL: Loaded 53105 primary data records. [2025-09-26T22:18:01.748901] [DEBUG] [MAIN ] BHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:01.766251] [INFO ] [MAIN ] BHR: Generated 1820 derivative records from 21771 primary records. [2025-09-26T22:18:01.766431] [DEBUG] [LOCAL ] BHR: Saving derivative data. [2025-09-26T22:18:01.787535] [DEBUG] [LOCAL ] BHR: Derivative data saved (1820 records). [2025-09-26T22:18:01.788211] [INFO ] [MAIN ] BHR: Successfully saved derivative data. [2025-09-26T22:18:01.791443] [INFO ] [MAIN ] Derivative Progress: 223/2074 symbols completed. BHR took 1.2s. Estimated remaining: 12m 58s. Rate: 142.7 symbols/min [2025-09-26T22:18:01.810450] [DEBUG] [MAIN ] BHVN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:01.811381] [INFO ] [MAIN ] BHVN: Generated 1820 derivative records from 50401 primary records. [2025-09-26T22:18:01.811542] [DEBUG] [LOCAL ] BHVN: Saving derivative data. [2025-09-26T22:18:01.830181] [DEBUG] [LOCAL ] BHVN: Derivative data saved (1820 records). [2025-09-26T22:18:01.831193] [INFO ] [MAIN ] BHVN: Successfully saved derivative data. [2025-09-26T22:18:01.834586] [INFO ] [MAIN ] Derivative Progress: 224/2074 symbols completed. BHVN took 1.2s. Estimated remaining: 12m 55s. Rate: 143.3 symbols/min [2025-09-26T22:18:01.849150] [DEBUG] [MAIN ] BILL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:01.849838] [INFO ] [MAIN ] BILL: Generated 1820 derivative records from 53105 primary records. [2025-09-26T22:18:01.849905] [DEBUG] [LOCAL ] BILL: Saving derivative data. [2025-09-26T22:18:01.866180] [DEBUG] [LOCAL ] BILL: Derivative data saved (1820 records). [2025-09-26T22:18:01.866248] [INFO ] [MAIN ] BILL: Successfully saved derivative data. [2025-09-26T22:18:01.871948] [INFO ] [MAIN ] Derivative Progress: 225/2074 symbols completed. BILL took 1.2s. Estimated remaining: 12m 51s. Rate: 143.9 symbols/min [2025-09-26T22:18:01.872759] [INFO ] [MAIN ] BIO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:01.872966] [INFO ] [MAIN ] BIP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:01.873058] [INFO ] [MAIN ] BIPC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:01.920787] [DEBUG] [LOCAL ] BIO: Loaded 25533 existing records from primary storage. [2025-09-26T22:18:01.930038] [INFO ] [MAIN ] BIO: Loaded 25533 primary data records. [2025-09-26T22:18:02.085245] [DEBUG] [LOCAL ] BIPC: Loaded 42317 existing records from primary storage. [2025-09-26T22:18:02.073102] [DEBUG] [LOCAL ] BIP: Loaded 40240 existing records from primary storage. [2025-09-26T22:18:02.090618] [INFO ] [MAIN ] BIPC: Loaded 42317 primary data records. [2025-09-26T22:18:02.095993] [INFO ] [MAIN ] BIP: Loaded 40240 primary data records. [2025-09-26T22:18:02.956559] [DEBUG] [MAIN ] BIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:02.957767] [INFO ] [MAIN ] BIO: Generated 1820 derivative records from 25533 primary records. [2025-09-26T22:18:02.958118] [DEBUG] [LOCAL ] BIO: Saving derivative data. [2025-09-26T22:18:02.991285] [DEBUG] [MAIN ] BIPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:02.992270] [DEBUG] [LOCAL ] BIO: Derivative data saved (1820 records). [2025-09-26T22:18:02.993248] [INFO ] [MAIN ] BIPC: Generated 1820 derivative records from 42317 primary records. [2025-09-26T22:18:02.992378] [INFO ] [MAIN ] BIO: Successfully saved derivative data. [2025-09-26T22:18:02.995128] [DEBUG] [LOCAL ] BIPC: Saving derivative data. [2025-09-26T22:18:02.999512] [INFO ] [MAIN ] Derivative Progress: 226/2074 symbols completed. BIO took 1.1s. Estimated remaining: 12m 57s. Rate: 142.8 symbols/min [2025-09-26T22:18:02.999817] [INFO ] [MAIN ] BIPH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:03.031125] [DEBUG] [MAIN ] BIP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:03.032042] [INFO ] [MAIN ] BIP: Generated 1820 derivative records from 40240 primary records. [2025-09-26T22:18:03.030371] [DEBUG] [LOCAL ] BIPC: Derivative data saved (1820 records). [2025-09-26T22:18:03.032216] [DEBUG] [LOCAL ] BIP: Saving derivative data. [2025-09-26T22:18:03.035130] [DEBUG] [LOCAL ] BIPH: Loaded 2632 existing records from primary storage. [2025-09-26T22:18:03.035599] [INFO ] [MAIN ] BIPH: Loaded 2632 primary data records. [2025-09-26T22:18:03.035490] [INFO ] [MAIN ] BIPC: Successfully saved derivative data. [2025-09-26T22:18:03.062757] [INFO ] [MAIN ] Derivative Progress: 227/2074 symbols completed. BIPC took 1.2s. Estimated remaining: 12m 53s. Rate: 143.3 symbols/min [2025-09-26T22:18:03.088597] [INFO ] [MAIN ] BIPI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:03.170502] [DEBUG] [LOCAL ] BIPI: Loaded 3282 existing records from primary storage. [2025-09-26T22:18:03.255139] [INFO ] [MAIN ] BIPI: Loaded 3282 primary data records. [2025-09-26T22:18:03.344007] [DEBUG] [LOCAL ] BIP: Derivative data saved (1820 records). [2025-09-26T22:18:03.459719] [INFO ] [MAIN ] BIP: Successfully saved derivative data. [2025-09-26T22:18:03.498173] [INFO ] [MAIN ] Derivative Progress: 228/2074 symbols completed. BIP took 1.6s. Estimated remaining: 12m 53s. Rate: 143.3 symbols/min [2025-09-26T22:18:03.512017] [INFO ] [MAIN ] BIPJ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:03.582289] [DEBUG] [LOCAL ] BIPJ: Loaded 3026 existing records from primary storage. [2025-09-26T22:18:03.748538] [INFO ] [MAIN ] BIPJ: Loaded 3026 primary data records. [2025-09-26T22:18:04.100012] [DEBUG] [MAIN ] BIPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:04.101358] [INFO ] [MAIN ] BIPH: Generated 1820 derivative records from 2632 primary records. [2025-09-26T22:18:04.101776] [DEBUG] [LOCAL ] BIPH: Saving derivative data. [2025-09-26T22:18:04.121131] [DEBUG] [LOCAL ] BIPH: Derivative data saved (1820 records). [2025-09-26T22:18:04.123307] [INFO ] [MAIN ] BIPH: Successfully saved derivative data. [2025-09-26T22:18:04.126668] [INFO ] [MAIN ] Derivative Progress: 229/2074 symbols completed. BIPH took 1.1s. Estimated remaining: 12m 54s. Rate: 143.0 symbols/min [2025-09-26T22:18:04.129267] [INFO ] [MAIN ] BIRK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:04.143323] [DEBUG] [MAIN ] BIPI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:04.144408] [INFO ] [MAIN ] BIPI: Generated 1820 derivative records from 3282 primary records. [2025-09-26T22:18:04.144840] [DEBUG] [LOCAL ] BIPI: Saving derivative data. [2025-09-26T22:18:04.166059] [DEBUG] [LOCAL ] BIPI: Derivative data saved (1820 records). [2025-09-26T22:18:04.166421] [INFO ] [MAIN ] BIPI: Successfully saved derivative data. [2025-09-26T22:18:04.169569] [INFO ] [MAIN ] Derivative Progress: 230/2074 symbols completed. BIPI took 1.1s. Estimated remaining: 12m 51s. Rate: 143.5 symbols/min [2025-09-26T22:18:04.170164] [INFO ] [MAIN ] BIT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:04.184277] [DEBUG] [MAIN ] BIPJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:04.185390] [INFO ] [MAIN ] BIPJ: Generated 1820 derivative records from 3026 primary records. [2025-09-26T22:18:04.185474] [DEBUG] [LOCAL ] BIPJ: Saving derivative data. [2025-09-26T22:18:04.201033] [DEBUG] [LOCAL ] BIPJ: Derivative data saved (1820 records). [2025-09-26T22:18:04.201276] [INFO ] [MAIN ] BIPJ: Successfully saved derivative data. [2025-09-26T22:18:04.206865] [INFO ] [MAIN ] Derivative Progress: 231/2074 symbols completed. BIPJ took 0.7s. Estimated remaining: 12m 47s. Rate: 144.1 symbols/min [2025-09-26T22:18:04.221591] [INFO ] [MAIN ] BJ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:04.254819] [DEBUG] [LOCAL ] BIT: Loaded 22765 existing records from primary storage. [2025-09-26T22:18:04.256256] [INFO ] [MAIN ] BIT: Loaded 22765 primary data records. [2025-09-26T22:18:04.256075] [DEBUG] [LOCAL ] BIRK: Loaded 51674 existing records from primary storage. [2025-09-26T22:18:04.261909] [INFO ] [MAIN ] BIRK: Loaded 51674 primary data records. [2025-09-26T22:18:04.938135] [DEBUG] [LOCAL ] BJ: Loaded 52156 existing records from primary storage. [2025-09-26T22:18:04.948346] [INFO ] [MAIN ] BJ: Loaded 52156 primary data records. [2025-09-26T22:18:05.386954] [DEBUG] [MAIN ] BIT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:05.403597] [INFO ] [MAIN ] BIT: Generated 1820 derivative records from 22765 primary records. [2025-09-26T22:18:05.404387] [DEBUG] [MAIN ] BIRK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:05.404799] [DEBUG] [LOCAL ] BIT: Saving derivative data. [2025-09-26T22:18:05.406865] [INFO ] [MAIN ] BIRK: Generated 1820 derivative records from 51674 primary records. [2025-09-26T22:18:05.407960] [DEBUG] [LOCAL ] BIRK: Saving derivative data. [2025-09-26T22:18:05.442320] [DEBUG] [LOCAL ] BIRK: Derivative data saved (1820 records). [2025-09-26T22:18:05.446061] [INFO ] [MAIN ] BIRK: Successfully saved derivative data. [2025-09-26T22:18:05.449739] [INFO ] [MAIN ] Derivative Progress: 232/2074 symbols completed. BIRK took 1.3s. Estimated remaining: 12m 53s. Rate: 142.9 symbols/min [2025-09-26T22:18:05.451355] [INFO ] [MAIN ] BK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:05.451784] [DEBUG] [LOCAL ] BIT: Derivative data saved (1820 records). [2025-09-26T22:18:05.452075] [INFO ] [MAIN ] BIT: Successfully saved derivative data. [2025-09-26T22:18:05.457134] [INFO ] [MAIN ] Derivative Progress: 233/2074 symbols completed. BIT took 1.3s. Estimated remaining: 12m 50s. Rate: 143.5 symbols/min [2025-09-26T22:18:05.457763] [INFO ] [MAIN ] BKD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:05.477857] [DEBUG] [MAIN ] BJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:05.478895] [INFO ] [MAIN ] BJ: Generated 1820 derivative records from 52156 primary records. [2025-09-26T22:18:05.479052] [DEBUG] [LOCAL ] BJ: Saving derivative data. [2025-09-26T22:18:05.499979] [DEBUG] [LOCAL ] BJ: Derivative data saved (1820 records). [2025-09-26T22:18:05.500228] [INFO ] [MAIN ] BJ: Successfully saved derivative data. [2025-09-26T22:18:05.504349] [INFO ] [MAIN ] Derivative Progress: 234/2074 symbols completed. BJ took 1.3s. Estimated remaining: 12m 46s. Rate: 144.0 symbols/min [2025-09-26T22:18:05.505161] [INFO ] [MAIN ] BKE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:05.560825] [DEBUG] [LOCAL ] BKD: Loaded 50889 existing records from primary storage. [2025-09-26T22:18:05.561933] [INFO ] [MAIN ] BKD: Loaded 50889 primary data records. [2025-09-26T22:18:05.661437] [DEBUG] [LOCAL ] BK: Loaded 54319 existing records from primary storage. [2025-09-26T22:18:05.679089] [INFO ] [MAIN ] BK: Loaded 54319 primary data records. [2025-09-26T22:18:05.715996] [DEBUG] [LOCAL ] BKE: Loaded 35206 existing records from primary storage. [2025-09-26T22:18:05.729159] [INFO ] [MAIN ] BKE: Loaded 35206 primary data records. [2025-09-26T22:18:06.640769] [DEBUG] [MAIN ] BKD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:06.642256] [INFO ] [MAIN ] BKD: Generated 1820 derivative records from 50889 primary records. [2025-09-26T22:18:06.642578] [DEBUG] [LOCAL ] BKD: Saving derivative data. [2025-09-26T22:18:06.676578] [DEBUG] [MAIN ] BK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:06.681379] [INFO ] [MAIN ] BK: Generated 1820 derivative records from 54319 primary records. [2025-09-26T22:18:06.682056] [DEBUG] [LOCAL ] BK: Saving derivative data. [2025-09-26T22:18:06.680424] [DEBUG] [LOCAL ] BKD: Derivative data saved (1820 records). [2025-09-26T22:18:06.692717] [INFO ] [MAIN ] BKD: Successfully saved derivative data. [2025-09-26T22:18:06.699354] [INFO ] [MAIN ] Derivative Progress: 235/2074 symbols completed. BKD took 1.2s. Estimated remaining: 12m 52s. Rate: 142.9 symbols/min [2025-09-26T22:18:06.703725] [INFO ] [MAIN ] BKH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:06.723483] [DEBUG] [LOCAL ] BK: Derivative data saved (1820 records). [2025-09-26T22:18:06.724239] [DEBUG] [MAIN ] BKE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:06.724607] [INFO ] [MAIN ] BK: Successfully saved derivative data. [2025-09-26T22:18:06.725632] [INFO ] [MAIN ] BKE: Generated 1820 derivative records from 35206 primary records. [2025-09-26T22:18:06.729321] [DEBUG] [LOCAL ] BKE: Saving derivative data. [2025-09-26T22:18:06.729109] [INFO ] [MAIN ] Derivative Progress: 236/2074 symbols completed. BK took 1.3s. Estimated remaining: 12m 49s. Rate: 143.5 symbols/min [2025-09-26T22:18:06.729764] [INFO ] [MAIN ] BKKT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:06.749181] [DEBUG] [LOCAL ] BKE: Derivative data saved (1820 records). [2025-09-26T22:18:06.749424] [INFO ] [MAIN ] BKE: Successfully saved derivative data. [2025-09-26T22:18:06.754545] [INFO ] [MAIN ] Derivative Progress: 237/2074 symbols completed. BKE took 1.2s. Estimated remaining: 12m 45s. Rate: 144.0 symbols/min [2025-09-26T22:18:06.755082] [INFO ] [MAIN ] BKN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:06.768210] [DEBUG] [LOCAL ] BKN: Loaded 7853 existing records from primary storage. [2025-09-26T22:18:06.768526] [INFO ] [MAIN ] BKN: Loaded 7853 primary data records. [2025-09-26T22:18:06.930364] [DEBUG] [LOCAL ] BKKT: Loaded 35164 existing records from primary storage. [2025-09-26T22:18:06.936476] [INFO ] [MAIN ] BKKT: Loaded 35164 primary data records. [2025-09-26T22:18:06.942396] [DEBUG] [LOCAL ] BKH: Loaded 37133 existing records from primary storage. [2025-09-26T22:18:06.988117] [INFO ] [MAIN ] BKH: Loaded 37133 primary data records. [2025-09-26T22:18:07.906729] [DEBUG] [MAIN ] BKN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:07.907744] [INFO ] [MAIN ] BKN: Generated 1820 derivative records from 7853 primary records. [2025-09-26T22:18:07.908031] [DEBUG] [LOCAL ] BKN: Saving derivative data. [2025-09-26T22:18:07.930029] [DEBUG] [LOCAL ] BKN: Derivative data saved (1820 records). [2025-09-26T22:18:07.930210] [INFO ] [MAIN ] BKN: Successfully saved derivative data. [2025-09-26T22:18:07.933511] [INFO ] [MAIN ] Derivative Progress: 238/2074 symbols completed. BKN took 1.2s. Estimated remaining: 12m 51s. Rate: 142.9 symbols/min [2025-09-26T22:18:07.958638] [DEBUG] [MAIN ] BKH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:07.973761] [INFO ] [MAIN ] BKH: Generated 1820 derivative records from 37133 primary records. [2025-09-26T22:18:07.972734] [DEBUG] [MAIN ] BKKT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:07.974964] [INFO ] [MAIN ] BKKT: Generated 1820 derivative records from 35164 primary records. [2025-09-26T22:18:07.975048] [DEBUG] [LOCAL ] BKH: Saving derivative data. [2025-09-26T22:18:07.975824] [DEBUG] [LOCAL ] BKKT: Saving derivative data. [2025-09-26T22:18:08.009087] [DEBUG] [LOCAL ] BKH: Derivative data saved (1820 records). [2025-09-26T22:18:08.011505] [INFO ] [MAIN ] BKH: Successfully saved derivative data. [2025-09-26T22:18:08.015686] [INFO ] [MAIN ] Derivative Progress: 239/2074 symbols completed. BKH took 1.3s. Estimated remaining: 12m 48s. Rate: 143.4 symbols/min [2025-09-26T22:18:08.017951] [DEBUG] [LOCAL ] BKKT: Derivative data saved (1820 records). [2025-09-26T22:18:08.018122] [INFO ] [MAIN ] BKKT: Successfully saved derivative data. [2025-09-26T22:18:08.021261] [INFO ] [MAIN ] Derivative Progress: 240/2074 symbols completed. BKKT took 1.3s. Estimated remaining: 12m 44s. Rate: 144.0 symbols/min [2025-09-26T22:18:08.022295] [INFO ] [MAIN ] BKSY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:08.022474] [INFO ] [MAIN ] BKT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:08.022808] [INFO ] [MAIN ] BKU: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:08.038711] [DEBUG] [LOCAL ] BKT: Loaded 11125 existing records from primary storage. [2025-09-26T22:18:08.038928] [INFO ] [MAIN ] BKT: Loaded 11125 primary data records. [2025-09-26T22:18:08.296035] [DEBUG] [LOCAL ] BKSY: Loaded 48993 existing records from primary storage. [2025-09-26T22:18:08.298515] [INFO ] [MAIN ] BKSY: Loaded 48993 primary data records. [2025-09-26T22:18:08.298346] [DEBUG] [LOCAL ] BKU: Loaded 42412 existing records from primary storage. [2025-09-26T22:18:08.304124] [INFO ] [MAIN ] BKU: Loaded 42412 primary data records. [2025-09-26T22:18:09.146229] [DEBUG] [MAIN ] BKT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:09.148678] [INFO ] [MAIN ] BKT: Generated 1820 derivative records from 11125 primary records. [2025-09-26T22:18:09.149133] [DEBUG] [LOCAL ] BKT: Saving derivative data. [2025-09-26T22:18:09.174233] [DEBUG] [LOCAL ] BKT: Derivative data saved (1820 records). [2025-09-26T22:18:09.175126] [INFO ] [MAIN ] BKT: Successfully saved derivative data. [2025-09-26T22:18:09.178570] [INFO ] [MAIN ] Derivative Progress: 241/2074 symbols completed. BKT took 1.2s. Estimated remaining: 12m 49s. Rate: 143.0 symbols/min [2025-09-26T22:18:09.179293] [INFO ] [MAIN ] BKV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:09.217402] [DEBUG] [MAIN ] BKU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:09.217909] [DEBUG] [MAIN ] BKSY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:09.219167] [INFO ] [MAIN ] BKU: Generated 1820 derivative records from 42412 primary records. [2025-09-26T22:18:09.220377] [INFO ] [MAIN ] BKSY: Generated 1820 derivative records from 48993 primary records. [2025-09-26T22:18:09.220599] [DEBUG] [LOCAL ] BKU: Saving derivative data. [2025-09-26T22:18:09.221396] [DEBUG] [LOCAL ] BKSY: Saving derivative data. [2025-09-26T22:18:09.261847] [DEBUG] [LOCAL ] BKSY: Derivative data saved (1820 records). [2025-09-26T22:18:09.262845] [INFO ] [MAIN ] BKSY: Successfully saved derivative data. [2025-09-26T22:18:09.267786] [INFO ] [MAIN ] Derivative Progress: 242/2074 symbols completed. BKSY took 1.2s. Estimated remaining: 12m 46s. Rate: 143.4 symbols/min [2025-09-26T22:18:09.268222] [INFO ] [MAIN ] BLCO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:09.272713] [DEBUG] [LOCAL ] BKU: Derivative data saved (1820 records). [2025-09-26T22:18:09.273799] [INFO ] [MAIN ] BKU: Successfully saved derivative data. [2025-09-26T22:18:09.277575] [INFO ] [MAIN ] Derivative Progress: 243/2074 symbols completed. BKU took 1.3s. Estimated remaining: 12m 43s. Rate: 144.0 symbols/min [2025-09-26T22:18:09.278033] [INFO ] [MAIN ] BLD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:09.291107] [DEBUG] [LOCAL ] BKV: Loaded 30278 existing records from primary storage. [2025-09-26T22:18:09.291634] [INFO ] [MAIN ] BKV: Loaded 30278 primary data records. [2025-09-26T22:18:09.530508] [DEBUG] [LOCAL ] BLD: Loaded 28408 existing records from primary storage. [2025-09-26T22:18:09.532430] [DEBUG] [LOCAL ] BLCO: Loaded 36110 existing records from primary storage. [2025-09-26T22:18:09.685736] [INFO ] [MAIN ] BLD: Loaded 28408 primary data records. [2025-09-26T22:18:09.695404] [INFO ] [MAIN ] BLCO: Loaded 36110 primary data records. [2025-09-26T22:18:10.398951] [DEBUG] [MAIN ] BKV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:10.400294] [INFO ] [MAIN ] BKV: Generated 1820 derivative records from 30278 primary records. [2025-09-26T22:18:10.400769] [DEBUG] [LOCAL ] BKV: Saving derivative data. [2025-09-26T22:18:10.425560] [DEBUG] [LOCAL ] BKV: Derivative data saved (1820 records). [2025-09-26T22:18:10.425853] [INFO ] [MAIN ] BKV: Successfully saved derivative data. [2025-09-26T22:18:10.429401] [INFO ] [MAIN ] Derivative Progress: 244/2074 symbols completed. BKV took 1.3s. Estimated remaining: 12m 48s. Rate: 143.0 symbols/min [2025-09-26T22:18:10.430278] [INFO ] [MAIN ] BLDR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:10.445112] [DEBUG] [MAIN ] BLD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:10.446736] [INFO ] [MAIN ] BLD: Generated 1820 derivative records from 28408 primary records. [2025-09-26T22:18:10.446827] [DEBUG] [LOCAL ] BLD: Saving derivative data. [2025-09-26T22:18:10.468178] [DEBUG] [MAIN ] BLCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:10.473341] [INFO ] [MAIN ] BLCO: Generated 1820 derivative records from 36110 primary records. [2025-09-26T22:18:10.474108] [DEBUG] [LOCAL ] BLCO: Saving derivative data. [2025-09-26T22:18:10.491059] [DEBUG] [LOCAL ] BLD: Derivative data saved (1820 records). [2025-09-26T22:18:10.493880] [INFO ] [MAIN ] BLD: Successfully saved derivative data. [2025-09-26T22:18:10.498418] [INFO ] [MAIN ] Derivative Progress: 245/2074 symbols completed. BLD took 1.2s. Estimated remaining: 12m 45s. Rate: 143.5 symbols/min [2025-09-26T22:18:10.499218] [DEBUG] [LOCAL ] BLCO: Derivative data saved (1820 records). [2025-09-26T22:18:10.499310] [INFO ] [MAIN ] BLCO: Successfully saved derivative data. [2025-09-26T22:18:10.499672] [INFO ] [MAIN ] BLE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:10.504278] [INFO ] [MAIN ] Derivative Progress: 246/2074 symbols completed. BLCO took 1.2s. Estimated remaining: 12m 41s. Rate: 144.0 symbols/min [2025-09-26T22:18:10.504837] [INFO ] [MAIN ] BLK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:10.538824] [DEBUG] [LOCAL ] BLE: Loaded 14718 existing records from primary storage. [2025-09-26T22:18:10.545360] [INFO ] [MAIN ] BLE: Loaded 14718 primary data records. [2025-09-26T22:18:10.669900] [DEBUG] [LOCAL ] BLDR: Loaded 52403 existing records from primary storage. [2025-09-26T22:18:10.690305] [INFO ] [MAIN ] BLDR: Loaded 52403 primary data records. [2025-09-26T22:18:10.989041] [DEBUG] [LOCAL ] BLK: Loaded 35240 existing records from primary storage. [2025-09-26T22:18:11.021781] [INFO ] [MAIN ] BLK: Loaded 35240 primary data records. [2025-09-26T22:18:11.735746] [DEBUG] [MAIN ] BLE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:11.737794] [INFO ] [MAIN ] BLE: Generated 1820 derivative records from 14718 primary records. [2025-09-26T22:18:11.738125] [DEBUG] [LOCAL ] BLE: Saving derivative data. [2025-09-26T22:18:11.757897] [DEBUG] [LOCAL ] BLE: Derivative data saved (1820 records). [2025-09-26T22:18:11.758142] [INFO ] [MAIN ] BLE: Successfully saved derivative data. [2025-09-26T22:18:11.761836] [INFO ] [MAIN ] Derivative Progress: 247/2074 symbols completed. BLE took 1.3s. Estimated remaining: 12m 47s. Rate: 142.9 symbols/min [2025-09-26T22:18:11.763000] [INFO ] [MAIN ] BLND: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:11.784410] [DEBUG] [MAIN ] BLDR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:11.785797] [INFO ] [MAIN ] BLDR: Generated 1820 derivative records from 52403 primary records. [2025-09-26T22:18:11.786079] [DEBUG] [LOCAL ] BLDR: Saving derivative data. [2025-09-26T22:18:11.821275] [DEBUG] [MAIN ] BLK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:11.825084] [INFO ] [MAIN ] BLK: Generated 1820 derivative records from 35240 primary records. [2025-09-26T22:18:11.825778] [DEBUG] [LOCAL ] BLK: Saving derivative data. [2025-09-26T22:18:11.827514] [DEBUG] [LOCAL ] BLDR: Derivative data saved (1820 records). [2025-09-26T22:18:11.828075] [INFO ] [MAIN ] BLDR: Successfully saved derivative data. [2025-09-26T22:18:11.832134] [INFO ] [MAIN ] Derivative Progress: 248/2074 symbols completed. BLDR took 1.4s. Estimated remaining: 12m 44s. Rate: 143.3 symbols/min [2025-09-26T22:18:11.840239] [INFO ] [MAIN ] BLW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:11.862401] [DEBUG] [LOCAL ] BLK: Derivative data saved (1820 records). [2025-09-26T22:18:11.862604] [INFO ] [MAIN ] BLK: Successfully saved derivative data. [2025-09-26T22:18:11.867211] [INFO ] [MAIN ] Derivative Progress: 249/2074 symbols completed. BLK took 1.4s. Estimated remaining: 12m 41s. Rate: 143.9 symbols/min [2025-09-26T22:18:11.867764] [INFO ] [MAIN ] BLX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:11.896508] [DEBUG] [LOCAL ] BLW: Loaded 13044 existing records from primary storage. [2025-09-26T22:18:11.896757] [INFO ] [MAIN ] BLW: Loaded 13044 primary data records. [2025-09-26T22:18:11.934822] [DEBUG] [LOCAL ] BLND: Loaded 50107 existing records from primary storage. [2025-09-26T22:18:11.975971] [INFO ] [MAIN ] BLND: Loaded 50107 primary data records. [2025-09-26T22:18:12.054095] [DEBUG] [LOCAL ] BLX: Loaded 15880 existing records from primary storage. [2025-09-26T22:18:12.093495] [INFO ] [MAIN ] BLX: Loaded 15880 primary data records. [2025-09-26T22:18:12.963107] [DEBUG] [MAIN ] BLW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:12.964575] [INFO ] [MAIN ] BLW: Generated 1820 derivative records from 13044 primary records. [2025-09-26T22:18:12.964945] [DEBUG] [LOCAL ] BLW: Saving derivative data. [2025-09-26T22:18:13.002735] [DEBUG] [MAIN ] BLND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:13.004347] [INFO ] [MAIN ] BLND: Generated 1820 derivative records from 50107 primary records. [2025-09-26T22:18:13.019746] [DEBUG] [LOCAL ] BLND: Saving derivative data. [2025-09-26T22:18:13.021052] [DEBUG] [MAIN ] BLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:13.022279] [INFO ] [MAIN ] BLX: Generated 1820 derivative records from 15880 primary records. [2025-09-26T22:18:13.023278] [DEBUG] [LOCAL ] BLX: Saving derivative data. [2025-09-26T22:18:13.024458] [DEBUG] [LOCAL ] BLW: Derivative data saved (1820 records). [2025-09-26T22:18:13.024869] [INFO ] [MAIN ] BLW: Successfully saved derivative data. [2025-09-26T22:18:13.028572] [INFO ] [MAIN ] Derivative Progress: 250/2074 symbols completed. BLW took 1.2s. Estimated remaining: 12m 46s. Rate: 142.9 symbols/min [2025-09-26T22:18:13.042352] [INFO ] [MAIN ] BMA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:13.061536] [DEBUG] [LOCAL ] BLX: Derivative data saved (1820 records). [2025-09-26T22:18:13.062018] [INFO ] [MAIN ] BLX: Successfully saved derivative data. [2025-09-26T22:18:13.065393] [INFO ] [MAIN ] Derivative Progress: 251/2074 symbols completed. BLX took 1.2s. Estimated remaining: 12m 43s. Rate: 143.4 symbols/min [2025-09-26T22:18:13.066159] [INFO ] [MAIN ] BME: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:13.076623] [DEBUG] [LOCAL ] BLND: Derivative data saved (1820 records). [2025-09-26T22:18:13.076928] [INFO ] [MAIN ] BLND: Successfully saved derivative data. [2025-09-26T22:18:13.080956] [INFO ] [MAIN ] Derivative Progress: 252/2074 symbols completed. BLND took 1.3s. Estimated remaining: 12m 40s. Rate: 143.9 symbols/min [2025-09-26T22:18:13.081393] [INFO ] [MAIN ] BMEZ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:13.104418] [DEBUG] [LOCAL ] BME: Loaded 10968 existing records from primary storage. [2025-09-26T22:18:13.104593] [INFO ] [MAIN ] BME: Loaded 10968 primary data records. [2025-09-26T22:18:13.256010] [DEBUG] [LOCAL ] BMA: Loaded 35645 existing records from primary storage. [2025-09-26T22:18:13.256945] [INFO ] [MAIN ] BMA: Loaded 35645 primary data records. [2025-09-26T22:18:13.575780] [DEBUG] [LOCAL ] BMEZ: Loaded 26421 existing records from primary storage. [2025-09-26T22:18:13.600267] [INFO ] [MAIN ] BMEZ: Loaded 26421 primary data records. [2025-09-26T22:18:14.247851] [DEBUG] [MAIN ] BME: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:14.249869] [INFO ] [MAIN ] BME: Generated 1820 derivative records from 10968 primary records. [2025-09-26T22:18:14.250102] [DEBUG] [LOCAL ] BME: Saving derivative data. [2025-09-26T22:18:14.271174] [DEBUG] [LOCAL ] BME: Derivative data saved (1820 records). [2025-09-26T22:18:14.272251] [INFO ] [MAIN ] BME: Successfully saved derivative data. [2025-09-26T22:18:14.275176] [INFO ] [MAIN ] Derivative Progress: 253/2074 symbols completed. BME took 1.2s. Estimated remaining: 12m 45s. Rate: 142.9 symbols/min [2025-09-26T22:18:14.289208] [DEBUG] [MAIN ] BMA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:14.290272] [INFO ] [MAIN ] BMA: Generated 1820 derivative records from 35645 primary records. [2025-09-26T22:18:14.290494] [DEBUG] [LOCAL ] BMA: Saving derivative data. [2025-09-26T22:18:14.322473] [DEBUG] [MAIN ] BMEZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:14.323924] [INFO ] [MAIN ] BMEZ: Generated 1820 derivative records from 26421 primary records. [2025-09-26T22:18:14.324447] [DEBUG] [LOCAL ] BMEZ: Saving derivative data. [2025-09-26T22:18:14.327050] [DEBUG] [LOCAL ] BMA: Derivative data saved (1820 records). [2025-09-26T22:18:14.327500] [INFO ] [MAIN ] BMA: Successfully saved derivative data. [2025-09-26T22:18:14.338963] [INFO ] [MAIN ] Derivative Progress: 254/2074 symbols completed. BMA took 1.3s. Estimated remaining: 12m 42s. Rate: 143.4 symbols/min [2025-09-26T22:18:14.350022] [DEBUG] [LOCAL ] BMEZ: Derivative data saved (1820 records). [2025-09-26T22:18:14.350208] [INFO ] [MAIN ] BMEZ: Successfully saved derivative data. [2025-09-26T22:18:14.354017] [INFO ] [MAIN ] Derivative Progress: 255/2074 symbols completed. BMEZ took 1.3s. Estimated remaining: 12m 38s. Rate: 143.9 symbols/min [2025-09-26T22:18:14.355322] [INFO ] [MAIN ] BMI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:14.355452] [INFO ] [MAIN ] BMN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:14.355789] [INFO ] [MAIN ] BMO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:14.363259] [DEBUG] [LOCAL ] BMN: Loaded 2548 existing records from primary storage. [2025-09-26T22:18:14.363509] [INFO ] [MAIN ] BMN: Loaded 2548 primary data records. [2025-09-26T22:18:14.563051] [DEBUG] [LOCAL ] BMI: Loaded 24611 existing records from primary storage. [2025-09-26T22:18:14.594834] [INFO ] [MAIN ] BMI: Loaded 24611 primary data records. [2025-09-26T22:18:14.817909] [DEBUG] [LOCAL ] BMO: Loaded 41940 existing records from primary storage. [2025-09-26T22:18:14.826295] [INFO ] [MAIN ] BMO: Loaded 41940 primary data records. [2025-09-26T22:18:15.431532] [DEBUG] [MAIN ] BMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:15.432782] [INFO ] [MAIN ] BMN: Generated 1820 derivative records from 2548 primary records. [2025-09-26T22:18:15.432887] [DEBUG] [LOCAL ] BMN: Saving derivative data. [2025-09-26T22:18:15.458603] [DEBUG] [LOCAL ] BMN: Derivative data saved (1820 records). [2025-09-26T22:18:15.459277] [INFO ] [MAIN ] BMN: Successfully saved derivative data. [2025-09-26T22:18:15.464714] [INFO ] [MAIN ] Derivative Progress: 256/2074 symbols completed. BMN took 1.1s. Estimated remaining: 12m 43s. Rate: 143.0 symbols/min [2025-09-26T22:18:15.465220] [INFO ] [MAIN ] BMY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:15.491150] [DEBUG] [MAIN ] BMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:15.505200] [INFO ] [MAIN ] BMI: Generated 1820 derivative records from 24611 primary records. [2025-09-26T22:18:15.505732] [DEBUG] [LOCAL ] BMI: Saving derivative data. [2025-09-26T22:18:15.505592] [DEBUG] [MAIN ] BMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:15.508402] [INFO ] [MAIN ] BMO: Generated 1820 derivative records from 41940 primary records. [2025-09-26T22:18:15.508498] [DEBUG] [LOCAL ] BMO: Saving derivative data. [2025-09-26T22:18:15.549303] [DEBUG] [LOCAL ] BMI: Derivative data saved (1820 records). [2025-09-26T22:18:15.550757] [INFO ] [MAIN ] BMI: Successfully saved derivative data. [2025-09-26T22:18:15.554521] [INFO ] [MAIN ] Derivative Progress: 257/2074 symbols completed. BMI took 1.2s. Estimated remaining: 12m 40s. Rate: 143.4 symbols/min [2025-09-26T22:18:15.555403] [INFO ] [MAIN ] BN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:15.575324] [DEBUG] [LOCAL ] BMO: Derivative data saved (1820 records). [2025-09-26T22:18:15.575706] [INFO ] [MAIN ] BMO: Successfully saved derivative data. [2025-09-26T22:18:15.579915] [INFO ] [MAIN ] Derivative Progress: 258/2074 symbols completed. BMO took 1.2s. Estimated remaining: 12m 37s. Rate: 143.9 symbols/min [2025-09-26T22:18:15.580568] [INFO ] [MAIN ] BNED: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:15.606837] [DEBUG] [LOCAL ] BMY: Loaded 54537 existing records from primary storage. [2025-09-26T22:18:15.607214] [INFO ] [MAIN ] BMY: Loaded 54537 primary data records. [2025-09-26T22:18:15.786326] [DEBUG] [LOCAL ] BNED: Loaded 30226 existing records from primary storage. [2025-09-26T22:18:15.849812] [INFO ] [MAIN ] BNED: Loaded 30226 primary data records. [2025-09-26T22:18:16.110509] [DEBUG] [LOCAL ] BN: Loaded 53774 existing records from primary storage. [2025-09-26T22:18:16.142539] [INFO ] [MAIN ] BN: Loaded 53774 primary data records. [2025-09-26T22:18:16.787859] [DEBUG] [MAIN ] BMY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:16.789783] [INFO ] [MAIN ] BMY: Generated 1820 derivative records from 54537 primary records. [2025-09-26T22:18:16.790119] [DEBUG] [LOCAL ] BMY: Saving derivative data. [2025-09-26T22:18:16.833936] [DEBUG] [MAIN ] BNED: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:16.835944] [INFO ] [MAIN ] BNED: Generated 1820 derivative records from 30226 primary records. [2025-09-26T22:18:16.836698] [DEBUG] [LOCAL ] BNED: Saving derivative data. [2025-09-26T22:18:16.851859] [DEBUG] [LOCAL ] BMY: Derivative data saved (1820 records). [2025-09-26T22:18:16.852891] [INFO ] [MAIN ] BMY: Successfully saved derivative data. [2025-09-26T22:18:16.855947] [INFO ] [MAIN ] Derivative Progress: 259/2074 symbols completed. BMY took 1.4s. Estimated remaining: 12m 43s. Rate: 142.8 symbols/min [2025-09-26T22:18:16.857100] [INFO ] [MAIN ] BNH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:16.880597] [DEBUG] [LOCAL ] BNED: Derivative data saved (1820 records). [2025-09-26T22:18:16.880897] [INFO ] [MAIN ] BNED: Successfully saved derivative data. [2025-09-26T22:18:16.885013] [INFO ] [MAIN ] Derivative Progress: 260/2074 symbols completed. BNED took 1.3s. Estimated remaining: 12m 39s. Rate: 143.3 symbols/min [2025-09-26T22:18:16.881260] [DEBUG] [MAIN ] BN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:16.888988] [INFO ] [MAIN ] BNJ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:16.889419] [DEBUG] [LOCAL ] BNH: Loaded 4926 existing records from primary storage. [2025-09-26T22:18:16.889827] [INFO ] [MAIN ] BNH: Loaded 4926 primary data records. [2025-09-26T22:18:16.890618] [INFO ] [MAIN ] BN: Generated 1820 derivative records from 53774 primary records. [2025-09-26T22:18:16.890818] [DEBUG] [LOCAL ] BN: Saving derivative data. [2025-09-26T22:18:16.968904] [DEBUG] [LOCAL ] BNJ: Loaded 2631 existing records from primary storage. [2025-09-26T22:18:16.983627] [INFO ] [MAIN ] BNJ: Loaded 2631 primary data records. [2025-09-26T22:18:17.108913] [DEBUG] [LOCAL ] BN: Derivative data saved (1820 records). [2025-09-26T22:18:17.137096] [INFO ] [MAIN ] BN: Successfully saved derivative data. [2025-09-26T22:18:17.152564] [INFO ] [MAIN ] Derivative Progress: 261/2074 symbols completed. BN took 1.6s. Estimated remaining: 12m 38s. Rate: 143.5 symbols/min [2025-09-26T22:18:17.202555] [INFO ] [MAIN ] BNL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:17.607072] [DEBUG] [MAIN ] BNJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:17.609447] [INFO ] [MAIN ] BNJ: Generated 1820 derivative records from 2631 primary records. [2025-09-26T22:18:17.609680] [DEBUG] [LOCAL ] BNJ: Saving derivative data. [2025-09-26T22:18:17.652249] [DEBUG] [MAIN ] BNH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:17.653704] [INFO ] [MAIN ] BNH: Generated 1820 derivative records from 4926 primary records. [2025-09-26T22:18:17.655079] [DEBUG] [LOCAL ] BNH: Saving derivative data. [2025-09-26T22:18:17.658590] [DEBUG] [LOCAL ] BNL: Loaded 47577 existing records from primary storage. [2025-09-26T22:18:17.659268] [DEBUG] [LOCAL ] BNJ: Derivative data saved (1820 records). [2025-09-26T22:18:17.669518] [INFO ] [MAIN ] BNJ: Successfully saved derivative data. [2025-09-26T22:18:17.672367] [INFO ] [MAIN ] Derivative Progress: 262/2074 symbols completed. BNJ took 0.8s. Estimated remaining: 12m 38s. Rate: 143.4 symbols/min [2025-09-26T22:18:17.665868] [INFO ] [MAIN ] BNL: Loaded 47577 primary data records. [2025-09-26T22:18:17.685190] [INFO ] [MAIN ] BNS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:17.781953] [DEBUG] [LOCAL ] BNH: Derivative data saved (1820 records). [2025-09-26T22:18:17.786277] [INFO ] [MAIN ] BNH: Successfully saved derivative data. [2025-09-26T22:18:17.789506] [INFO ] [MAIN ] Derivative Progress: 263/2074 symbols completed. BNH took 0.9s. Estimated remaining: 12m 36s. Rate: 143.8 symbols/min [2025-09-26T22:18:17.789872] [INFO ] [MAIN ] BNT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:17.992355] [DEBUG] [LOCAL ] BNT: Loaded 3473 existing records from primary storage. [2025-09-26T22:18:18.002802] [INFO ] [MAIN ] BNT: Loaded 3473 primary data records. [2025-09-26T22:18:18.168840] [DEBUG] [LOCAL ] BNS: Loaded 52212 existing records from primary storage. [2025-09-26T22:18:18.192075] [INFO ] [MAIN ] BNS: Loaded 52212 primary data records. [2025-09-26T22:18:18.816537] [DEBUG] [MAIN ] BNL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:18.819197] [INFO ] [MAIN ] BNL: Generated 1820 derivative records from 47577 primary records. [2025-09-26T22:18:18.819344] [DEBUG] [LOCAL ] BNL: Saving derivative data. [2025-09-26T22:18:18.839533] [DEBUG] [LOCAL ] BNL: Derivative data saved (1820 records). [2025-09-26T22:18:18.839856] [INFO ] [MAIN ] BNL: Successfully saved derivative data. [2025-09-26T22:18:18.842532] [INFO ] [MAIN ] Derivative Progress: 264/2074 symbols completed. BNL took 1.7s. Estimated remaining: 12m 40s. Rate: 142.9 symbols/min [2025-09-26T22:18:18.843461] [INFO ] [MAIN ] BNY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:18.863124] [DEBUG] [MAIN ] BNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:18.866124] [INFO ] [MAIN ] BNT: Generated 1820 derivative records from 3473 primary records. [2025-09-26T22:18:18.866407] [DEBUG] [LOCAL ] BNT: Saving derivative data. [2025-09-26T22:18:18.883343] [DEBUG] [LOCAL ] BNY: Loaded 7446 existing records from primary storage. [2025-09-26T22:18:18.884350] [INFO ] [MAIN ] BNY: Loaded 7446 primary data records. [2025-09-26T22:18:18.981297] [DEBUG] [LOCAL ] BNT: Derivative data saved (1820 records). [2025-09-26T22:18:18.989229] [INFO ] [MAIN ] BNT: Successfully saved derivative data. [2025-09-26T22:18:19.000813] [INFO ] [MAIN ] Derivative Progress: 265/2074 symbols completed. BNT took 1.2s. Estimated remaining: 12m 38s. Rate: 143.3 symbols/min [2025-09-26T22:18:19.019482] [INFO ] [MAIN ] BOE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:19.018979] [DEBUG] [MAIN ] BNS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:19.026298] [INFO ] [MAIN ] BNS: Generated 1820 derivative records from 52212 primary records. [2025-09-26T22:18:19.061610] [DEBUG] [LOCAL ] BNS: Saving derivative data. [2025-09-26T22:18:19.262592] [DEBUG] [LOCAL ] BOE: Loaded 17816 existing records from primary storage. [2025-09-26T22:18:19.264606] [DEBUG] [LOCAL ] BNS: Derivative data saved (1820 records). [2025-09-26T22:18:19.265091] [INFO ] [MAIN ] BOE: Loaded 17816 primary data records. [2025-09-26T22:18:19.265418] [INFO ] [MAIN ] BNS: Successfully saved derivative data. [2025-09-26T22:18:19.269133] [INFO ] [MAIN ] Derivative Progress: 266/2074 symbols completed. BNS took 1.6s. Estimated remaining: 12m 36s. Rate: 143.5 symbols/min [2025-09-26T22:18:19.281834] [INFO ] [MAIN ] BOH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:19.655085] [DEBUG] [LOCAL ] BOH: Loaded 31676 existing records from primary storage. [2025-09-26T22:18:19.655495] [INFO ] [MAIN ] BOH: Loaded 31676 primary data records. [2025-09-26T22:18:19.656368] [DEBUG] [MAIN ] BNY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:19.657779] [INFO ] [MAIN ] BNY: Generated 1820 derivative records from 7446 primary records. [2025-09-26T22:18:19.670486] [DEBUG] [LOCAL ] BNY: Saving derivative data. [2025-09-26T22:18:19.877813] [DEBUG] [LOCAL ] BNY: Derivative data saved (1820 records). [2025-09-26T22:18:20.002845] [INFO ] [MAIN ] BNY: Successfully saved derivative data. [2025-09-26T22:18:20.006863] [INFO ] [MAIN ] Derivative Progress: 267/2074 symbols completed. BNY took 1.2s. Estimated remaining: 12m 38s. Rate: 143.1 symbols/min [2025-09-26T22:18:20.008211] [INFO ] [MAIN ] BOND: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:20.026825] [DEBUG] [MAIN ] BOE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:20.031966] [INFO ] [MAIN ] BOE: Generated 1820 derivative records from 17816 primary records. [2025-09-26T22:18:20.032937] [DEBUG] [LOCAL ] BOE: Saving derivative data. [2025-09-26T22:18:20.055520] [DEBUG] [LOCAL ] BOE: Derivative data saved (1820 records). [2025-09-26T22:18:20.055996] [INFO ] [MAIN ] BOE: Successfully saved derivative data. [2025-09-26T22:18:20.067928] [INFO ] [MAIN ] Derivative Progress: 268/2074 symbols completed. BOE took 1.0s. Estimated remaining: 12m 35s. Rate: 143.5 symbols/min [2025-09-26T22:18:20.084609] [DEBUG] [LOCAL ] BOND: Loaded 32554 existing records from primary storage. [2025-09-26T22:18:20.084950] [INFO ] [MAIN ] BOND: Loaded 32554 primary data records. [2025-09-26T22:18:20.143589] [DEBUG] [MAIN ] BOH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:20.179326] [INFO ] [MAIN ] BOH: Generated 1820 derivative records from 31676 primary records. [2025-09-26T22:18:20.196442] [DEBUG] [LOCAL ] BOH: Saving derivative data. [2025-09-26T22:18:20.310942] [DEBUG] [LOCAL ] BOH: Derivative data saved (1820 records). [2025-09-26T22:18:20.434089] [INFO ] [MAIN ] BOH: Successfully saved derivative data. [2025-09-26T22:18:20.437485] [INFO ] [MAIN ] Derivative Progress: 269/2074 symbols completed. BOH took 1.2s. Estimated remaining: 12m 34s. Rate: 143.6 symbols/min [2025-09-26T22:18:20.463192] [DEBUG] [MAIN ] BOND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:20.463895] [INFO ] [MAIN ] BOND: Generated 1820 derivative records from 32554 primary records. [2025-09-26T22:18:20.463958] [DEBUG] [LOCAL ] BOND: Saving derivative data. [2025-09-26T22:18:20.480433] [DEBUG] [LOCAL ] BOND: Derivative data saved (1820 records). [2025-09-26T22:18:20.480621] [INFO ] [MAIN ] BOND: Successfully saved derivative data. [2025-09-26T22:18:20.483362] [INFO ] [MAIN ] Derivative Progress: 270/2074 symbols completed. BOND took 0.5s. Estimated remaining: 12m 31s. Rate: 144.1 symbols/min [2025-09-26T22:18:20.484754] [INFO ] [MAIN ] BOW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:20.484383] [INFO ] [MAIN ] BOOT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:20.484909] [INFO ] [MAIN ] BORR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:20.512851] [DEBUG] [LOCAL ] BOW: Loaded 23974 existing records from primary storage. [2025-09-26T22:18:20.513144] [INFO ] [MAIN ] BOW: Loaded 23974 primary data records. [2025-09-26T22:18:20.713511] [DEBUG] [LOCAL ] BOOT: Loaded 41409 existing records from primary storage. [2025-09-26T22:18:20.735170] [DEBUG] [LOCAL ] BORR: Loaded 51902 existing records from primary storage. [2025-09-26T22:18:20.765021] [INFO ] [MAIN ] BOOT: Loaded 41409 primary data records. [2025-09-26T22:18:20.785698] [INFO ] [MAIN ] BORR: Loaded 51902 primary data records. [2025-09-26T22:18:21.618529] [DEBUG] [MAIN ] BOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:21.620124] [INFO ] [MAIN ] BOW: Generated 1820 derivative records from 23974 primary records. [2025-09-26T22:18:21.620406] [DEBUG] [LOCAL ] BOW: Saving derivative data. [2025-09-26T22:18:21.658291] [DEBUG] [LOCAL ] BOW: Derivative data saved (1820 records). [2025-09-26T22:18:21.658462] [INFO ] [MAIN ] BOW: Successfully saved derivative data. [2025-09-26T22:18:21.661982] [INFO ] [MAIN ] Derivative Progress: 271/2074 symbols completed. BOW took 1.2s. Estimated remaining: 12m 36s. Rate: 143.1 symbols/min [2025-09-26T22:18:21.662461] [DEBUG] [MAIN ] BOOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:21.663019] [INFO ] [MAIN ] BOX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:21.676463] [INFO ] [MAIN ] BOOT: Generated 1820 derivative records from 41409 primary records. [2025-09-26T22:18:21.676744] [DEBUG] [LOCAL ] BOOT: Saving derivative data. [2025-09-26T22:18:21.678855] [DEBUG] [MAIN ] BORR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:21.680336] [INFO ] [MAIN ] BORR: Generated 1820 derivative records from 51902 primary records. [2025-09-26T22:18:21.692543] [DEBUG] [LOCAL ] BORR: Saving derivative data. [2025-09-26T22:18:21.712324] [DEBUG] [LOCAL ] BOOT: Derivative data saved (1820 records). [2025-09-26T22:18:21.713135] [INFO ] [MAIN ] BOOT: Successfully saved derivative data. [2025-09-26T22:18:21.716445] [INFO ] [MAIN ] Derivative Progress: 272/2074 symbols completed. BOOT took 1.2s. Estimated remaining: 12m 33s. Rate: 143.6 symbols/min [2025-09-26T22:18:21.717056] [INFO ] [MAIN ] BP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:21.719827] [DEBUG] [LOCAL ] BORR: Derivative data saved (1820 records). [2025-09-26T22:18:21.719927] [INFO ] [MAIN ] BORR: Successfully saved derivative data. [2025-09-26T22:18:21.724595] [INFO ] [MAIN ] Derivative Progress: 273/2074 symbols completed. BORR took 1.2s. Estimated remaining: 12m 30s. Rate: 144.1 symbols/min [2025-09-26T22:18:21.725200] [INFO ] [MAIN ] BR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:21.775266] [DEBUG] [LOCAL ] BOX: Loaded 51017 existing records from primary storage. [2025-09-26T22:18:21.775673] [INFO ] [MAIN ] BOX: Loaded 51017 primary data records. [2025-09-26T22:18:21.992254] [DEBUG] [LOCAL ] BP: Loaded 54491 existing records from primary storage. [2025-09-26T22:18:21.993731] [DEBUG] [LOCAL ] BR: Loaded 35251 existing records from primary storage. [2025-09-26T22:18:22.026852] [INFO ] [MAIN ] BP: Loaded 54491 primary data records. [2025-09-26T22:18:22.027165] [INFO ] [MAIN ] BR: Loaded 35251 primary data records. [2025-09-26T22:18:22.900801] [DEBUG] [MAIN ] BOX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:22.903043] [INFO ] [MAIN ] BOX: Generated 1820 derivative records from 51017 primary records. [2025-09-26T22:18:22.904700] [DEBUG] [LOCAL ] BOX: Saving derivative data. [2025-09-26T22:18:22.931470] [DEBUG] [LOCAL ] BOX: Derivative data saved (1820 records). [2025-09-26T22:18:22.931758] [INFO ] [MAIN ] BOX: Successfully saved derivative data. [2025-09-26T22:18:22.935219] [INFO ] [MAIN ] Derivative Progress: 274/2074 symbols completed. BOX took 1.3s. Estimated remaining: 12m 35s. Rate: 143.1 symbols/min [2025-09-26T22:18:22.936214] [INFO ] [MAIN ] BRBR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:22.952676] [DEBUG] [MAIN ] BP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:22.954470] [INFO ] [MAIN ] BP: Generated 1820 derivative records from 54491 primary records. [2025-09-26T22:18:22.954587] [DEBUG] [LOCAL ] BP: Saving derivative data. [2025-09-26T22:18:22.968301] [DEBUG] [MAIN ] BR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:22.981080] [INFO ] [MAIN ] BR: Generated 1820 derivative records from 35251 primary records. [2025-09-26T22:18:22.982767] [DEBUG] [LOCAL ] BR: Saving derivative data. [2025-09-26T22:18:23.010497] [DEBUG] [LOCAL ] BP: Derivative data saved (1820 records). [2025-09-26T22:18:23.015701] [INFO ] [MAIN ] BP: Successfully saved derivative data. [2025-09-26T22:18:23.015885] [DEBUG] [LOCAL ] BR: Derivative data saved (1820 records). [2025-09-26T22:18:23.016132] [INFO ] [MAIN ] BR: Successfully saved derivative data. [2025-09-26T22:18:23.019316] [INFO ] [MAIN ] Derivative Progress: 275/2074 symbols completed. BP took 1.3s. Estimated remaining: 12m 32s. Rate: 143.5 symbols/min [2025-09-26T22:18:23.024547] [INFO ] [MAIN ] Derivative Progress: 276/2074 symbols completed. BR took 1.3s. Estimated remaining: 12m 29s. Rate: 144.0 symbols/min [2025-09-26T22:18:23.024788] [INFO ] [MAIN ] BRC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:23.025359] [INFO ] [MAIN ] BRCC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:23.066715] [DEBUG] [LOCAL ] BRBR: Loaded 51987 existing records from primary storage. [2025-09-26T22:18:23.067110] [INFO ] [MAIN ] BRBR: Loaded 51987 primary data records. [2025-09-26T22:18:23.229179] [DEBUG] [LOCAL ] BRC: Loaded 19567 existing records from primary storage. [2025-09-26T22:18:23.245023] [INFO ] [MAIN ] BRC: Loaded 19567 primary data records. [2025-09-26T22:18:23.283117] [DEBUG] [LOCAL ] BRCC: Loaded 40896 existing records from primary storage. [2025-09-26T22:18:23.348685] [INFO ] [MAIN ] BRCC: Loaded 40896 primary data records. [2025-09-26T22:18:24.242454] [DEBUG] [MAIN ] BRBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:24.244582] [INFO ] [MAIN ] BRBR: Generated 1820 derivative records from 51987 primary records. [2025-09-26T22:18:24.245012] [DEBUG] [LOCAL ] BRBR: Saving derivative data. [2025-09-26T22:18:24.265701] [DEBUG] [LOCAL ] BRBR: Derivative data saved (1820 records). [2025-09-26T22:18:24.266876] [INFO ] [MAIN ] BRBR: Successfully saved derivative data. [2025-09-26T22:18:24.269441] [INFO ] [MAIN ] Derivative Progress: 277/2074 symbols completed. BRBR took 1.3s. Estimated remaining: 12m 34s. Rate: 143.0 symbols/min [2025-09-26T22:18:24.270765] [INFO ] [MAIN ] BRO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:24.286782] [DEBUG] [MAIN ] BRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:24.287638] [INFO ] [MAIN ] BRC: Generated 1820 derivative records from 19567 primary records. [2025-09-26T22:18:24.287842] [DEBUG] [LOCAL ] BRC: Saving derivative data. [2025-09-26T22:18:24.319273] [DEBUG] [MAIN ] BRCC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:24.321258] [INFO ] [MAIN ] BRCC: Generated 1820 derivative records from 40896 primary records. [2025-09-26T22:18:24.321383] [DEBUG] [LOCAL ] BRC: Derivative data saved (1820 records). [2025-09-26T22:18:24.321473] [DEBUG] [LOCAL ] BRCC: Saving derivative data. [2025-09-26T22:18:24.321556] [INFO ] [MAIN ] BRC: Successfully saved derivative data. [2025-09-26T22:18:24.326337] [INFO ] [MAIN ] Derivative Progress: 278/2074 symbols completed. BRC took 1.3s. Estimated remaining: 12m 31s. Rate: 143.4 symbols/min [2025-09-26T22:18:24.334909] [INFO ] [MAIN ] BROS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:24.343793] [DEBUG] [LOCAL ] BRCC: Derivative data saved (1820 records). [2025-09-26T22:18:24.343894] [INFO ] [MAIN ] BRCC: Successfully saved derivative data. [2025-09-26T22:18:24.347105] [INFO ] [MAIN ] Derivative Progress: 279/2074 symbols completed. BRCC took 1.3s. Estimated remaining: 12m 28s. Rate: 143.9 symbols/min [2025-09-26T22:18:24.347714] [INFO ] [MAIN ] BRSP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:24.395933] [DEBUG] [LOCAL ] BRO: Loaded 52664 existing records from primary storage. [2025-09-26T22:18:24.403914] [INFO ] [MAIN ] BRO: Loaded 52664 primary data records. [2025-09-26T22:18:24.561637] [DEBUG] [LOCAL ] BRSP: Loaded 37442 existing records from primary storage. [2025-09-26T22:18:24.578342] [DEBUG] [LOCAL ] BROS: Loaded 54067 existing records from primary storage. [2025-09-26T22:18:24.588749] [INFO ] [MAIN ] BROS: Loaded 54067 primary data records. [2025-09-26T22:18:24.655379] [INFO ] [MAIN ] BRSP: Loaded 37442 primary data records. [2025-09-26T22:18:25.490938] [DEBUG] [MAIN ] BRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:25.492744] [INFO ] [MAIN ] BRO: Generated 1820 derivative records from 52664 primary records. [2025-09-26T22:18:25.493463] [DEBUG] [LOCAL ] BRO: Saving derivative data. [2025-09-26T22:18:25.514197] [DEBUG] [LOCAL ] BRO: Derivative data saved (1820 records). [2025-09-26T22:18:25.514612] [INFO ] [MAIN ] BRO: Successfully saved derivative data. [2025-09-26T22:18:25.518232] [INFO ] [MAIN ] Derivative Progress: 280/2074 symbols completed. BRO took 1.2s. Estimated remaining: 12m 33s. Rate: 143.0 symbols/min [2025-09-26T22:18:25.518724] [INFO ] [MAIN ] BRT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:25.540430] [DEBUG] [MAIN ] BROS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:25.544612] [INFO ] [MAIN ] BROS: Generated 1820 derivative records from 54067 primary records. [2025-09-26T22:18:25.545182] [DEBUG] [LOCAL ] BROS: Saving derivative data. [2025-09-26T22:18:25.544951] [DEBUG] [LOCAL ] BRT: Loaded 5034 existing records from primary storage. [2025-09-26T22:18:25.547299] [INFO ] [MAIN ] BRT: Loaded 5034 primary data records. [2025-09-26T22:18:25.637395] [DEBUG] [LOCAL ] BROS: Derivative data saved (1820 records). [2025-09-26T22:18:25.653294] [INFO ] [MAIN ] BROS: Successfully saved derivative data. [2025-09-26T22:18:25.676203] [INFO ] [MAIN ] Derivative Progress: 281/2074 symbols completed. BROS took 1.3s. Estimated remaining: 12m 31s. Rate: 143.3 symbols/min [2025-09-26T22:18:25.698475] [INFO ] [MAIN ] BRW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:25.724471] [DEBUG] [MAIN ] BRSP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:25.741555] [INFO ] [MAIN ] BRSP: Generated 1820 derivative records from 37442 primary records. [2025-09-26T22:18:25.762825] [DEBUG] [LOCAL ] BRSP: Saving derivative data. [2025-09-26T22:18:25.971142] [DEBUG] [LOCAL ] BRW: Loaded 19862 existing records from primary storage. [2025-09-26T22:18:25.974577] [DEBUG] [LOCAL ] BRSP: Derivative data saved (1820 records). [2025-09-26T22:18:25.973554] [INFO ] [MAIN ] BRW: Loaded 19862 primary data records. [2025-09-26T22:18:25.986900] [INFO ] [MAIN ] BRSP: Successfully saved derivative data. [2025-09-26T22:18:26.054715] [INFO ] [MAIN ] Derivative Progress: 282/2074 symbols completed. BRSP took 1.7s. Estimated remaining: 12m 30s. Rate: 143.4 symbols/min [2025-09-26T22:18:26.074149] [INFO ] [MAIN ] BRX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:26.339405] [DEBUG] [MAIN ] BRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:26.340395] [INFO ] [MAIN ] BRT: Generated 1820 derivative records from 5034 primary records. [2025-09-26T22:18:26.340673] [DEBUG] [LOCAL ] BRT: Saving derivative data. [2025-09-26T22:18:26.371109] [DEBUG] [LOCAL ] BRT: Derivative data saved (1820 records). [2025-09-26T22:18:26.371227] [INFO ] [MAIN ] BRT: Successfully saved derivative data. [2025-09-26T22:18:26.373682] [INFO ] [MAIN ] Derivative Progress: 283/2074 symbols completed. BRT took 0.9s. Estimated remaining: 12m 29s. Rate: 143.5 symbols/min [2025-09-26T22:18:26.403177] [DEBUG] [LOCAL ] BRX: Loaded 52462 existing records from primary storage. [2025-09-26T22:18:26.412734] [INFO ] [MAIN ] BRX: Loaded 52462 primary data records. [2025-09-26T22:18:26.413048] [DEBUG] [MAIN ] BRW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:26.414075] [INFO ] [MAIN ] BRW: Generated 1820 derivative records from 19862 primary records. [2025-09-26T22:18:26.461032] [DEBUG] [LOCAL ] BRW: Saving derivative data. [2025-09-26T22:18:26.552073] [DEBUG] [LOCAL ] BRW: Derivative data saved (1820 records). [2025-09-26T22:18:26.567702] [INFO ] [MAIN ] BRW: Successfully saved derivative data. [2025-09-26T22:18:26.607031] [INFO ] [MAIN ] Derivative Progress: 284/2074 symbols completed. BRW took 0.9s. Estimated remaining: 12m 27s. Rate: 143.7 symbols/min [2025-09-26T22:18:26.807219] [DEBUG] [MAIN ] BRX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:26.807934] [INFO ] [MAIN ] BRX: Generated 1820 derivative records from 52462 primary records. [2025-09-26T22:18:26.808001] [DEBUG] [LOCAL ] BRX: Saving derivative data. [2025-09-26T22:18:26.823872] [DEBUG] [LOCAL ] BRX: Derivative data saved (1820 records). [2025-09-26T22:18:26.823935] [INFO ] [MAIN ] BRX: Successfully saved derivative data. [2025-09-26T22:18:26.826306] [INFO ] [MAIN ] Derivative Progress: 285/2074 symbols completed. BRX took 0.8s. Estimated remaining: 12m 26s. Rate: 143.9 symbols/min [2025-09-26T22:18:26.827487] [INFO ] [MAIN ] BSAC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:26.827781] [INFO ] [MAIN ] BSBR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:26.828116] [INFO ] [MAIN ] BST: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:26.855963] [DEBUG] [LOCAL ] BST: Loaded 19385 existing records from primary storage. [2025-09-26T22:18:26.856302] [INFO ] [MAIN ] BST: Loaded 19385 primary data records. [2025-09-26T22:18:27.032981] [DEBUG] [LOCAL ] BSAC: Loaded 33389 existing records from primary storage. [2025-09-26T22:18:27.056432] [INFO ] [MAIN ] BSAC: Loaded 33389 primary data records. [2025-09-26T22:18:27.062416] [DEBUG] [LOCAL ] BSBR: Loaded 35731 existing records from primary storage. [2025-09-26T22:18:27.140490] [INFO ] [MAIN ] BSBR: Loaded 35731 primary data records. [2025-09-26T22:18:28.250176] [DEBUG] [MAIN ] BST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:28.251993] [INFO ] [MAIN ] BST: Generated 1820 derivative records from 19385 primary records. [2025-09-26T22:18:28.252270] [DEBUG] [LOCAL ] BST: Saving derivative data. [2025-09-26T22:18:28.273907] [DEBUG] [LOCAL ] BST: Derivative data saved (1820 records). [2025-09-26T22:18:28.274478] [INFO ] [MAIN ] BST: Successfully saved derivative data. [2025-09-26T22:18:28.277625] [INFO ] [MAIN ] Derivative Progress: 286/2074 symbols completed. BST took 1.5s. Estimated remaining: 12m 32s. Rate: 142.7 symbols/min [2025-09-26T22:18:28.280494] [INFO ] [MAIN ] BSX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:28.303427] [DEBUG] [MAIN ] BSAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:28.304351] [INFO ] [MAIN ] BSAC: Generated 1820 derivative records from 33389 primary records. [2025-09-26T22:18:28.304608] [DEBUG] [LOCAL ] BSAC: Saving derivative data. [2025-09-26T22:18:28.320725] [DEBUG] [MAIN ] BSBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:28.333355] [INFO ] [MAIN ] BSBR: Generated 1820 derivative records from 35731 primary records. [2025-09-26T22:18:28.337823] [DEBUG] [LOCAL ] BSBR: Saving derivative data. [2025-09-26T22:18:28.357073] [DEBUG] [LOCAL ] BSAC: Derivative data saved (1820 records). [2025-09-26T22:18:28.357735] [INFO ] [MAIN ] BSAC: Successfully saved derivative data. [2025-09-26T22:18:28.360978] [INFO ] [MAIN ] Derivative Progress: 287/2074 symbols completed. BSAC took 1.5s. Estimated remaining: 12m 29s. Rate: 143.1 symbols/min [2025-09-26T22:18:28.362081] [INFO ] [MAIN ] BTA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:28.364366] [DEBUG] [LOCAL ] BSBR: Derivative data saved (1820 records). [2025-09-26T22:18:28.364517] [INFO ] [MAIN ] BSBR: Successfully saved derivative data. [2025-09-26T22:18:28.367454] [INFO ] [MAIN ] Derivative Progress: 288/2074 symbols completed. BSBR took 1.5s. Estimated remaining: 12m 26s. Rate: 143.6 symbols/min [2025-09-26T22:18:28.382140] [INFO ] [MAIN ] BTCM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:28.390267] [DEBUG] [LOCAL ] BTA: Loaded 5464 existing records from primary storage. [2025-09-26T22:18:28.390505] [INFO ] [MAIN ] BTA: Loaded 5464 primary data records. [2025-09-26T22:18:28.508551] [DEBUG] [LOCAL ] BSX: Loaded 54468 existing records from primary storage. [2025-09-26T22:18:28.533633] [DEBUG] [LOCAL ] BTCM: Loaded 15122 existing records from primary storage. [2025-09-26T22:18:28.533291] [INFO ] [MAIN ] BSX: Loaded 54468 primary data records. [2025-09-26T22:18:28.533917] [INFO ] [MAIN ] BTCM: Loaded 15122 primary data records. [2025-09-26T22:18:29.457823] [DEBUG] [MAIN ] BTA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:29.459036] [INFO ] [MAIN ] BTA: Generated 1820 derivative records from 5464 primary records. [2025-09-26T22:18:29.459491] [DEBUG] [LOCAL ] BTA: Saving derivative data. [2025-09-26T22:18:29.507404] [DEBUG] [MAIN ] BTCM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:29.509273] [INFO ] [MAIN ] BTCM: Generated 1820 derivative records from 15122 primary records. [2025-09-26T22:18:29.512005] [DEBUG] [LOCAL ] BTCM: Saving derivative data. [2025-09-26T22:18:29.511883] [DEBUG] [MAIN ] BSX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:29.512693] [INFO ] [MAIN ] BSX: Generated 1820 derivative records from 54468 primary records. [2025-09-26T22:18:29.513118] [DEBUG] [LOCAL ] BTA: Derivative data saved (1820 records). [2025-09-26T22:18:29.513851] [DEBUG] [LOCAL ] BSX: Saving derivative data. [2025-09-26T22:18:29.514236] [INFO ] [MAIN ] BTA: Successfully saved derivative data. [2025-09-26T22:18:29.517407] [INFO ] [MAIN ] Derivative Progress: 289/2074 symbols completed. BTA took 1.2s. Estimated remaining: 12m 30s. Rate: 142.7 symbols/min [2025-09-26T22:18:29.525054] [INFO ] [MAIN ] BTE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:29.549288] [DEBUG] [LOCAL ] BTCM: Derivative data saved (1820 records). [2025-09-26T22:18:29.551161] [DEBUG] [LOCAL ] BSX: Derivative data saved (1820 records). [2025-09-26T22:18:29.551393] [INFO ] [MAIN ] BTCM: Successfully saved derivative data. [2025-09-26T22:18:29.554890] [INFO ] [MAIN ] BSX: Successfully saved derivative data. [2025-09-26T22:18:29.554775] [INFO ] [MAIN ] Derivative Progress: 290/2074 symbols completed. BTCM took 1.2s. Estimated remaining: 12m 28s. Rate: 143.2 symbols/min [2025-09-26T22:18:29.558447] [INFO ] [MAIN ] Derivative Progress: 291/2074 symbols completed. BSX took 1.3s. Estimated remaining: 12m 25s. Rate: 143.7 symbols/min [2025-09-26T22:18:29.558888] [INFO ] [MAIN ] BTO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:29.559469] [INFO ] [MAIN ] BTT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:29.571274] [DEBUG] [LOCAL ] BTO: Loaded 8982 existing records from primary storage. [2025-09-26T22:18:29.571535] [INFO ] [MAIN ] BTO: Loaded 8982 primary data records. [2025-09-26T22:18:29.648974] [DEBUG] [LOCAL ] BTT: Loaded 16126 existing records from primary storage. [2025-09-26T22:18:29.670998] [INFO ] [MAIN ] BTT: Loaded 16126 primary data records. [2025-09-26T22:18:30.089171] [DEBUG] [LOCAL ] BTE: Loaded 53505 existing records from primary storage. [2025-09-26T22:18:30.101091] [INFO ] [MAIN ] BTE: Loaded 53505 primary data records. [2025-09-26T22:18:30.672768] [DEBUG] [MAIN ] BTO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:30.674077] [INFO ] [MAIN ] BTO: Generated 1820 derivative records from 8982 primary records. [2025-09-26T22:18:30.674287] [DEBUG] [LOCAL ] BTO: Saving derivative data. [2025-09-26T22:18:30.695069] [DEBUG] [LOCAL ] BTO: Derivative data saved (1820 records). [2025-09-26T22:18:30.695772] [INFO ] [MAIN ] BTO: Successfully saved derivative data. [2025-09-26T22:18:30.698789] [INFO ] [MAIN ] Derivative Progress: 292/2074 symbols completed. BTO took 1.1s. Estimated remaining: 12m 29s. Rate: 142.8 symbols/min [2025-09-26T22:18:30.699866] [INFO ] [MAIN ] BTU: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:30.717870] [DEBUG] [MAIN ] BTT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:30.720277] [INFO ] [MAIN ] BTT: Generated 1820 derivative records from 16126 primary records. [2025-09-26T22:18:30.721322] [DEBUG] [LOCAL ] BTT: Saving derivative data. [2025-09-26T22:18:30.747172] [DEBUG] [MAIN ] BTE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:30.748708] [INFO ] [MAIN ] BTE: Generated 1820 derivative records from 53505 primary records. [2025-09-26T22:18:30.749181] [DEBUG] [LOCAL ] BTE: Saving derivative data. [2025-09-26T22:18:30.770022] [DEBUG] [LOCAL ] BTT: Derivative data saved (1820 records). [2025-09-26T22:18:30.771416] [INFO ] [MAIN ] BTT: Successfully saved derivative data. [2025-09-26T22:18:30.775254] [INFO ] [MAIN ] Derivative Progress: 293/2074 symbols completed. BTT took 1.2s. Estimated remaining: 12m 26s. Rate: 143.2 symbols/min [2025-09-26T22:18:30.776524] [DEBUG] [LOCAL ] BTE: Derivative data saved (1820 records). [2025-09-26T22:18:30.776435] [INFO ] [MAIN ] BUD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:30.777036] [INFO ] [MAIN ] BTE: Successfully saved derivative data. [2025-09-26T22:18:30.783552] [INFO ] [MAIN ] Derivative Progress: 294/2074 symbols completed. BTE took 1.3s. Estimated remaining: 12m 23s. Rate: 143.7 symbols/min [2025-09-26T22:18:30.784025] [INFO ] [MAIN ] BUI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:30.813094] [DEBUG] [LOCAL ] BUI: Loaded 11615 existing records from primary storage. [2025-09-26T22:18:30.813264] [INFO ] [MAIN ] BUI: Loaded 11615 primary data records. [2025-09-26T22:18:30.995463] [DEBUG] [LOCAL ] BTU: Loaded 54082 existing records from primary storage. [2025-09-26T22:18:31.034155] [INFO ] [MAIN ] BTU: Loaded 54082 primary data records. [2025-09-26T22:18:31.233888] [DEBUG] [LOCAL ] BUD: Loaded 53504 existing records from primary storage. [2025-09-26T22:18:31.250345] [INFO ] [MAIN ] BUD: Loaded 53504 primary data records. [2025-09-26T22:18:31.950128] [DEBUG] [MAIN ] BUI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:31.952248] [INFO ] [MAIN ] BUI: Generated 1820 derivative records from 11615 primary records. [2025-09-26T22:18:31.953185] [DEBUG] [LOCAL ] BUI: Saving derivative data. [2025-09-26T22:18:31.978906] [DEBUG] [LOCAL ] BUI: Derivative data saved (1820 records). [2025-09-26T22:18:31.979398] [INFO ] [MAIN ] BUI: Successfully saved derivative data. [2025-09-26T22:18:31.982826] [INFO ] [MAIN ] Derivative Progress: 295/2074 symbols completed. BUI took 1.2s. Estimated remaining: 12m 28s. Rate: 142.8 symbols/min [2025-09-26T22:18:31.983739] [INFO ] [MAIN ] BURL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:32.005811] [DEBUG] [MAIN ] BUD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:32.024102] [INFO ] [MAIN ] BUD: Generated 1820 derivative records from 53504 primary records. [2025-09-26T22:18:32.024524] [DEBUG] [MAIN ] BTU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:32.024782] [DEBUG] [LOCAL ] BUD: Saving derivative data. [2025-09-26T22:18:32.026192] [INFO ] [MAIN ] BTU: Generated 1820 derivative records from 54082 primary records. [2025-09-26T22:18:32.026865] [DEBUG] [LOCAL ] BTU: Saving derivative data. [2025-09-26T22:18:32.058608] [DEBUG] [LOCAL ] BUD: Derivative data saved (1820 records). [2025-09-26T22:18:32.059156] [INFO ] [MAIN ] BUD: Successfully saved derivative data. [2025-09-26T22:18:32.062605] [INFO ] [MAIN ] Derivative Progress: 296/2074 symbols completed. BUD took 1.3s. Estimated remaining: 12m 25s. Rate: 143.2 symbols/min [2025-09-26T22:18:32.065029] [INFO ] [MAIN ] BUXX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:32.065785] [DEBUG] [LOCAL ] BTU: Derivative data saved (1820 records). [2025-09-26T22:18:32.066062] [INFO ] [MAIN ] BTU: Successfully saved derivative data. [2025-09-26T22:18:32.068943] [INFO ] [MAIN ] Derivative Progress: 297/2074 symbols completed. BTU took 1.4s. Estimated remaining: 12m 22s. Rate: 143.7 symbols/min [2025-09-26T22:18:32.069373] [INFO ] [MAIN ] BV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:32.099699] [DEBUG] [LOCAL ] BUXX: Loaded 15364 existing records from primary storage. [2025-09-26T22:18:32.113356] [INFO ] [MAIN ] BUXX: Loaded 15364 primary data records. [2025-09-26T22:18:32.114285] [DEBUG] [LOCAL ] BURL: Loaded 46896 existing records from primary storage. [2025-09-26T22:18:32.147959] [INFO ] [MAIN ] BURL: Loaded 46896 primary data records. [2025-09-26T22:18:32.290708] [DEBUG] [LOCAL ] BV: Loaded 39048 existing records from primary storage. [2025-09-26T22:18:32.335183] [INFO ] [MAIN ] BV: Loaded 39048 primary data records. [2025-09-26T22:18:33.228199] [DEBUG] [MAIN ] BURL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:33.227934] [DEBUG] [MAIN ] BUXX: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:18:33.230189] [INFO ] [MAIN ] BURL: Generated 1820 derivative records from 46896 primary records. [2025-09-26T22:18:33.230286] [DEBUG] [LOCAL ] BURL: Saving derivative data. [2025-09-26T22:18:33.229582] [INFO ] [MAIN ] BUXX: Generated 1819 derivative records from 15364 primary records. [2025-09-26T22:18:33.232081] [DEBUG] [LOCAL ] BUXX: Saving derivative data. [2025-09-26T22:18:33.266103] [DEBUG] [LOCAL ] BURL: Derivative data saved (1820 records). [2025-09-26T22:18:33.266843] [INFO ] [MAIN ] BURL: Successfully saved derivative data. [2025-09-26T22:18:33.280448] [DEBUG] [LOCAL ] BUXX: Derivative data saved (1819 records). [2025-09-26T22:18:33.280286] [INFO ] [MAIN ] Derivative Progress: 298/2074 symbols completed. BURL took 1.3s. Estimated remaining: 12m 26s. Rate: 142.8 symbols/min [2025-09-26T22:18:33.287260] [INFO ] [MAIN ] BUXX: Successfully saved derivative data. [2025-09-26T22:18:33.290044] [INFO ] [MAIN ] Derivative Progress: 299/2074 symbols completed. BUXX took 1.2s. Estimated remaining: 12m 24s. Rate: 143.2 symbols/min [2025-09-26T22:18:33.290528] [DEBUG] [MAIN ] BV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:33.291380] [INFO ] [MAIN ] BV: Generated 1820 derivative records from 39048 primary records. [2025-09-26T22:18:33.291444] [DEBUG] [LOCAL ] BV: Saving derivative data. [2025-09-26T22:18:33.313075] [DEBUG] [LOCAL ] BV: Derivative data saved (1820 records). [2025-09-26T22:18:33.313247] [INFO ] [MAIN ] BV: Successfully saved derivative data. [2025-09-26T22:18:33.316625] [INFO ] [MAIN ] Derivative Progress: 300/2074 symbols completed. BV took 1.2s. Estimated remaining: 12m 21s. Rate: 143.7 symbols/min [2025-09-26T22:18:33.317289] [INFO ] [MAIN ] BVN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:33.317358] [INFO ] [MAIN ] BWG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:33.317472] [INFO ] [MAIN ] BW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:33.334022] [DEBUG] [LOCAL ] BWG: Loaded 12478 existing records from primary storage. [2025-09-26T22:18:33.334175] [INFO ] [MAIN ] BWG: Loaded 12478 primary data records. [2025-09-26T22:18:33.531076] [DEBUG] [LOCAL ] BW: Loaded 40297 existing records from primary storage. [2025-09-26T22:18:33.573148] [INFO ] [MAIN ] BW: Loaded 40297 primary data records. [2025-09-26T22:18:33.787223] [DEBUG] [LOCAL ] BVN: Loaded 44520 existing records from primary storage. [2025-09-26T22:18:33.807018] [INFO ] [MAIN ] BVN: Loaded 44520 primary data records. [2025-09-26T22:18:34.443526] [DEBUG] [MAIN ] BWG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:34.444954] [INFO ] [MAIN ] BWG: Generated 1820 derivative records from 12478 primary records. [2025-09-26T22:18:34.446544] [DEBUG] [LOCAL ] BWG: Saving derivative data. [2025-09-26T22:18:34.464761] [DEBUG] [LOCAL ] BWG: Derivative data saved (1820 records). [2025-09-26T22:18:34.466534] [INFO ] [MAIN ] BWG: Successfully saved derivative data. [2025-09-26T22:18:34.469734] [INFO ] [MAIN ] Derivative Progress: 301/2074 symbols completed. BWG took 1.2s. Estimated remaining: 12m 25s. Rate: 142.8 symbols/min [2025-09-26T22:18:34.470543] [INFO ] [MAIN ] BWLP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:34.490523] [DEBUG] [MAIN ] BW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:34.494438] [INFO ] [MAIN ] BW: Generated 1820 derivative records from 40297 primary records. [2025-09-26T22:18:34.494739] [DEBUG] [LOCAL ] BW: Saving derivative data. [2025-09-26T22:18:34.509019] [DEBUG] [MAIN ] BVN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:34.520828] [INFO ] [MAIN ] BVN: Generated 1820 derivative records from 44520 primary records. [2025-09-26T22:18:34.521312] [DEBUG] [LOCAL ] BVN: Saving derivative data. [2025-09-26T22:18:34.525832] [DEBUG] [LOCAL ] BW: Derivative data saved (1820 records). [2025-09-26T22:18:34.527174] [INFO ] [MAIN ] BW: Successfully saved derivative data. [2025-09-26T22:18:34.529872] [INFO ] [MAIN ] Derivative Progress: 302/2074 symbols completed. BW took 1.2s. Estimated remaining: 12m 22s. Rate: 143.2 symbols/min [2025-09-26T22:18:34.530512] [INFO ] [MAIN ] BWMX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:34.562152] [DEBUG] [LOCAL ] BWMX: Loaded 7676 existing records from primary storage. [2025-09-26T22:18:34.562949] [DEBUG] [LOCAL ] BVN: Derivative data saved (1820 records). [2025-09-26T22:18:34.563133] [INFO ] [MAIN ] BWMX: Loaded 7676 primary data records. [2025-09-26T22:18:34.579388] [INFO ] [MAIN ] BVN: Successfully saved derivative data. [2025-09-26T22:18:34.657863] [INFO ] [MAIN ] Derivative Progress: 303/2074 symbols completed. BVN took 1.3s. Estimated remaining: 12m 20s. Rate: 143.6 symbols/min [2025-09-26T22:18:34.666549] [DEBUG] [LOCAL ] BWLP: Loaded 33185 existing records from primary storage. [2025-09-26T22:18:34.682462] [INFO ] [MAIN ] BWLP: Loaded 33185 primary data records. [2025-09-26T22:18:34.692995] [INFO ] [MAIN ] BWNB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:34.910465] [DEBUG] [LOCAL ] BWNB: Loaded 4468 existing records from primary storage. [2025-09-26T22:18:35.034570] [INFO ] [MAIN ] BWNB: Loaded 4468 primary data records. [2025-09-26T22:18:35.604082] [DEBUG] [MAIN ] BWMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:35.605854] [INFO ] [MAIN ] BWMX: Generated 1820 derivative records from 7676 primary records. [2025-09-26T22:18:35.606303] [DEBUG] [LOCAL ] BWMX: Saving derivative data. [2025-09-26T22:18:35.651182] [DEBUG] [MAIN ] BWLP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:35.650392] [DEBUG] [LOCAL ] BWMX: Derivative data saved (1820 records). [2025-09-26T22:18:35.651347] [INFO ] [MAIN ] BWMX: Successfully saved derivative data. [2025-09-26T22:18:35.655476] [INFO ] [MAIN ] Derivative Progress: 304/2074 symbols completed. BWMX took 1.1s. Estimated remaining: 12m 23s. Rate: 142.9 symbols/min [2025-09-26T22:18:35.652151] [INFO ] [MAIN ] BWLP: Generated 1820 derivative records from 33185 primary records. [2025-09-26T22:18:35.656198] [INFO ] [MAIN ] BWSN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:35.656273] [DEBUG] [LOCAL ] BWLP: Saving derivative data. [2025-09-26T22:18:35.680497] [DEBUG] [LOCAL ] BWLP: Derivative data saved (1820 records). [2025-09-26T22:18:35.680924] [INFO ] [MAIN ] BWLP: Successfully saved derivative data. [2025-09-26T22:18:35.689739] [DEBUG] [LOCAL ] BWSN: Loaded 5130 existing records from primary storage. [2025-09-26T22:18:35.689367] [INFO ] [MAIN ] Derivative Progress: 305/2074 symbols completed. BWLP took 1.2s. Estimated remaining: 12m 20s. Rate: 143.3 symbols/min [2025-09-26T22:18:35.690008] [INFO ] [MAIN ] BWSN: Loaded 5130 primary data records. [2025-09-26T22:18:35.695688] [INFO ] [MAIN ] BWXT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:35.751196] [DEBUG] [MAIN ] BWNB: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:18:35.765998] [INFO ] [MAIN ] BWNB: Generated 1819 derivative records from 4468 primary records. [2025-09-26T22:18:35.798975] [DEBUG] [LOCAL ] BWNB: Saving derivative data. [2025-09-26T22:18:36.076378] [DEBUG] [LOCAL ] BWNB: Derivative data saved (1819 records). [2025-09-26T22:18:36.091585] [INFO ] [MAIN ] BWNB: Successfully saved derivative data. [2025-09-26T22:18:36.104843] [INFO ] [MAIN ] Derivative Progress: 306/2074 symbols completed. BWNB took 1.4s. Estimated remaining: 12m 20s. Rate: 143.4 symbols/min [2025-09-26T22:18:36.105919] [INFO ] [MAIN ] BX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:36.123569] [DEBUG] [LOCAL ] BWXT: Loaded 47442 existing records from primary storage. [2025-09-26T22:18:36.124386] [INFO ] [MAIN ] BWXT: Loaded 47442 primary data records. [2025-09-26T22:18:36.497986] [DEBUG] [MAIN ] BWSN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:36.500030] [INFO ] [MAIN ] BWSN: Generated 1820 derivative records from 5130 primary records. [2025-09-26T22:18:36.500472] [DEBUG] [LOCAL ] BWSN: Saving derivative data. [2025-09-26T22:18:36.544165] [DEBUG] [LOCAL ] BX: Loaded 54270 existing records from primary storage. [2025-09-26T22:18:36.546320] [INFO ] [MAIN ] BX: Loaded 54270 primary data records. [2025-09-26T22:18:36.545925] [DEBUG] [LOCAL ] BWSN: Derivative data saved (1820 records). [2025-09-26T22:18:36.552082] [INFO ] [MAIN ] BWSN: Successfully saved derivative data. [2025-09-26T22:18:36.562807] [INFO ] [MAIN ] Derivative Progress: 307/2074 symbols completed. BWSN took 0.9s. Estimated remaining: 12m 20s. Rate: 143.3 symbols/min [2025-09-26T22:18:36.590140] [INFO ] [MAIN ] BXC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:36.740491] [DEBUG] [MAIN ] BWXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:36.852831] [INFO ] [MAIN ] BWXT: Generated 1820 derivative records from 47442 primary records. [2025-09-26T22:18:36.883999] [DEBUG] [LOCAL ] BXC: Loaded 13880 existing records from primary storage. [2025-09-26T22:18:36.903368] [DEBUG] [LOCAL ] BWXT: Saving derivative data. [2025-09-26T22:18:36.903267] [INFO ] [MAIN ] BXC: Loaded 13880 primary data records. [2025-09-26T22:18:36.980543] [DEBUG] [LOCAL ] BWXT: Derivative data saved (1820 records). [2025-09-26T22:18:36.999805] [INFO ] [MAIN ] BWXT: Successfully saved derivative data. [2025-09-26T22:18:37.017770] [INFO ] [MAIN ] Derivative Progress: 308/2074 symbols completed. BWXT took 1.3s. Estimated remaining: 12m 20s. Rate: 143.3 symbols/min [2025-09-26T22:18:37.050790] [INFO ] [MAIN ] BXMT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:37.290526] [DEBUG] [MAIN ] BX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:37.292216] [INFO ] [MAIN ] BX: Generated 1820 derivative records from 54270 primary records. [2025-09-26T22:18:37.292622] [DEBUG] [LOCAL ] BX: Saving derivative data. [2025-09-26T22:18:37.324079] [DEBUG] [LOCAL ] BX: Derivative data saved (1820 records). [2025-09-26T22:18:37.324593] [INFO ] [MAIN ] BX: Successfully saved derivative data. [2025-09-26T22:18:37.327310] [INFO ] [MAIN ] Derivative Progress: 309/2074 symbols completed. BX took 1.2s. Estimated remaining: 12m 19s. Rate: 143.4 symbols/min [2025-09-26T22:18:37.328371] [INFO ] [MAIN ] BXMX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:37.348791] [DEBUG] [LOCAL ] BXMT: Loaded 47994 existing records from primary storage. [2025-09-26T22:18:37.361418] [INFO ] [MAIN ] BXMT: Loaded 47994 primary data records. [2025-09-26T22:18:37.362705] [DEBUG] [MAIN ] BXC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:37.408295] [INFO ] [MAIN ] BXC: Generated 1820 derivative records from 13880 primary records. [2025-09-26T22:18:37.418526] [DEBUG] [LOCAL ] BXC: Saving derivative data. [2025-09-26T22:18:37.493064] [DEBUG] [LOCAL ] BXMX: Loaded 19855 existing records from primary storage. [2025-09-26T22:18:37.493907] [INFO ] [MAIN ] BXMX: Loaded 19855 primary data records. [2025-09-26T22:18:37.504262] [DEBUG] [LOCAL ] BXC: Derivative data saved (1820 records). [2025-09-26T22:18:37.519420] [INFO ] [MAIN ] BXC: Successfully saved derivative data. [2025-09-26T22:18:37.532408] [INFO ] [MAIN ] Derivative Progress: 310/2074 symbols completed. BXC took 0.9s. Estimated remaining: 12m 17s. Rate: 143.6 symbols/min [2025-09-26T22:18:37.597874] [INFO ] [MAIN ] BXP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:38.087886] [DEBUG] [MAIN ] BXMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:38.104307] [INFO ] [MAIN ] BXMT: Generated 1820 derivative records from 47994 primary records. [2025-09-26T22:18:38.104689] [DEBUG] [LOCAL ] BXMT: Saving derivative data. [2025-09-26T22:18:38.106537] [DEBUG] [LOCAL ] BXP: Loaded 50577 existing records from primary storage. [2025-09-26T22:18:38.107562] [INFO ] [MAIN ] BXP: Loaded 50577 primary data records. [2025-09-26T22:18:38.243796] [DEBUG] [LOCAL ] BXMT: Derivative data saved (1820 records). [2025-09-26T22:18:38.260323] [INFO ] [MAIN ] BXMT: Successfully saved derivative data. [2025-09-26T22:18:38.287782] [INFO ] [MAIN ] Derivative Progress: 311/2074 symbols completed. BXMT took 1.3s. Estimated remaining: 12m 18s. Rate: 143.3 symbols/min [2025-09-26T22:18:38.315741] [DEBUG] [MAIN ] BXMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:38.338771] [INFO ] [MAIN ] BXSL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:38.341920] [INFO ] [MAIN ] BXMX: Generated 1820 derivative records from 19855 primary records. [2025-09-26T22:18:38.346211] [DEBUG] [LOCAL ] BXMX: Saving derivative data. [2025-09-26T22:18:38.539076] [DEBUG] [LOCAL ] BXMX: Derivative data saved (1820 records). [2025-09-26T22:18:38.539958] [INFO ] [MAIN ] BXMX: Successfully saved derivative data. [2025-09-26T22:18:38.542847] [INFO ] [MAIN ] Derivative Progress: 312/2074 symbols completed. BXMX took 1.2s. Estimated remaining: 12m 17s. Rate: 143.4 symbols/min [2025-09-26T22:18:38.543786] [INFO ] [MAIN ] BY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:38.569053] [DEBUG] [MAIN ] BXP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:38.585191] [INFO ] [MAIN ] BXP: Generated 1820 derivative records from 50577 primary records. [2025-09-26T22:18:38.586811] [DEBUG] [LOCAL ] BXP: Saving derivative data. [2025-09-26T22:18:38.597463] [DEBUG] [LOCAL ] BY: Loaded 21895 existing records from primary storage. [2025-09-26T22:18:38.628291] [DEBUG] [LOCAL ] BXSL: Loaded 48276 existing records from primary storage. [2025-09-26T22:18:38.628420] [INFO ] [MAIN ] BXSL: Loaded 48276 primary data records. [2025-09-26T22:18:38.626616] [INFO ] [MAIN ] BY: Loaded 21895 primary data records. [2025-09-26T22:18:38.742487] [DEBUG] [LOCAL ] BXP: Derivative data saved (1820 records). [2025-09-26T22:18:38.776625] [INFO ] [MAIN ] BXP: Successfully saved derivative data. [2025-09-26T22:18:38.792116] [INFO ] [MAIN ] Derivative Progress: 313/2074 symbols completed. BXP took 1.2s. Estimated remaining: 12m 16s. Rate: 143.6 symbols/min [2025-09-26T22:18:39.323105] [DEBUG] [MAIN ] BY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:39.322856] [DEBUG] [MAIN ] BXSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:39.323931] [INFO ] [MAIN ] BXSL: Generated 1820 derivative records from 48276 primary records. [2025-09-26T22:18:39.324523] [INFO ] [MAIN ] BY: Generated 1820 derivative records from 21895 primary records. [2025-09-26T22:18:39.324720] [DEBUG] [LOCAL ] BY: Saving derivative data. [2025-09-26T22:18:39.324664] [DEBUG] [LOCAL ] BXSL: Saving derivative data. [2025-09-26T22:18:39.355355] [DEBUG] [LOCAL ] BY: Derivative data saved (1820 records). [2025-09-26T22:18:39.355933] [INFO ] [MAIN ] BY: Successfully saved derivative data. [2025-09-26T22:18:39.358737] [INFO ] [MAIN ] Derivative Progress: 314/2074 symbols completed. BY took 0.8s. Estimated remaining: 12m 16s. Rate: 143.5 symbols/min [2025-09-26T22:18:39.360472] [DEBUG] [LOCAL ] BXSL: Derivative data saved (1820 records). [2025-09-26T22:18:39.360559] [INFO ] [MAIN ] BXSL: Successfully saved derivative data. [2025-09-26T22:18:39.362986] [INFO ] [MAIN ] Derivative Progress: 315/2074 symbols completed. BXSL took 1.1s. Estimated remaining: 12m 13s. Rate: 143.9 symbols/min [2025-09-26T22:18:39.363798] [INFO ] [MAIN ] BYM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:39.363890] [INFO ] [MAIN ] BZH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:39.363614] [INFO ] [MAIN ] BYD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:39.380567] [DEBUG] [LOCAL ] BYM: Loaded 12225 existing records from primary storage. [2025-09-26T22:18:39.381792] [INFO ] [MAIN ] BYM: Loaded 12225 primary data records. [2025-09-26T22:18:39.611836] [DEBUG] [LOCAL ] BZH: Loaded 33088 existing records from primary storage. [2025-09-26T22:18:39.740347] [INFO ] [MAIN ] BZH: Loaded 33088 primary data records. [2025-09-26T22:18:39.802981] [DEBUG] [LOCAL ] BYD: Loaded 45804 existing records from primary storage. [2025-09-26T22:18:39.817012] [INFO ] [MAIN ] BYD: Loaded 45804 primary data records. [2025-09-26T22:18:40.504473] [DEBUG] [MAIN ] BYM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:40.505960] [INFO ] [MAIN ] BYM: Generated 1820 derivative records from 12225 primary records. [2025-09-26T22:18:40.506379] [DEBUG] [LOCAL ] BYM: Saving derivative data. [2025-09-26T22:18:40.526707] [DEBUG] [LOCAL ] BYM: Derivative data saved (1820 records). [2025-09-26T22:18:40.527286] [INFO ] [MAIN ] BYM: Successfully saved derivative data. [2025-09-26T22:18:40.529802] [INFO ] [MAIN ] Derivative Progress: 316/2074 symbols completed. BYM took 1.2s. Estimated remaining: 12m 17s. Rate: 143.1 symbols/min [2025-09-26T22:18:40.530208] [INFO ] [MAIN ] C: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:40.560340] [DEBUG] [MAIN ] BZH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:40.561696] [INFO ] [MAIN ] BZH: Generated 1820 derivative records from 33088 primary records. [2025-09-26T22:18:40.561893] [DEBUG] [LOCAL ] BZH: Saving derivative data. [2025-09-26T22:18:40.597557] [DEBUG] [MAIN ] BYD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:40.598113] [DEBUG] [LOCAL ] BZH: Derivative data saved (1820 records). [2025-09-26T22:18:40.599469] [INFO ] [MAIN ] BYD: Generated 1820 derivative records from 45804 primary records. [2025-09-26T22:18:40.599600] [INFO ] [MAIN ] BZH: Successfully saved derivative data. [2025-09-26T22:18:40.599686] [DEBUG] [LOCAL ] BYD: Saving derivative data. [2025-09-26T22:18:40.602196] [INFO ] [MAIN ] Derivative Progress: 317/2074 symbols completed. BZH took 1.2s. Estimated remaining: 12m 15s. Rate: 143.5 symbols/min [2025-09-26T22:18:40.603701] [INFO ] [MAIN ] CAAP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:40.637300] [DEBUG] [LOCAL ] BYD: Derivative data saved (1820 records). [2025-09-26T22:18:40.637676] [INFO ] [MAIN ] BYD: Successfully saved derivative data. [2025-09-26T22:18:40.640754] [INFO ] [MAIN ] Derivative Progress: 318/2074 symbols completed. BYD took 1.3s. Estimated remaining: 12m 12s. Rate: 143.9 symbols/min [2025-09-26T22:18:40.646927] [INFO ] [MAIN ] CABO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:40.664575] [DEBUG] [LOCAL ] C: Loaded 54521 existing records from primary storage. [2025-09-26T22:18:40.664813] [INFO ] [MAIN ] C: Loaded 54521 primary data records. [2025-09-26T22:18:40.725539] [DEBUG] [LOCAL ] CAAP: Loaded 20021 existing records from primary storage. [2025-09-26T22:18:40.774288] [INFO ] [MAIN ] CAAP: Loaded 20021 primary data records. [2025-09-26T22:18:40.822116] [DEBUG] [LOCAL ] CABO: Loaded 17549 existing records from primary storage. [2025-09-26T22:18:40.908375] [INFO ] [MAIN ] CABO: Loaded 17549 primary data records. [2025-09-26T22:18:41.700039] [DEBUG] [MAIN ] C: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:41.701259] [INFO ] [MAIN ] C: Generated 1820 derivative records from 54521 primary records. [2025-09-26T22:18:41.701379] [DEBUG] [LOCAL ] C: Saving derivative data. [2025-09-26T22:18:41.735534] [DEBUG] [LOCAL ] C: Derivative data saved (1820 records). [2025-09-26T22:18:41.736031] [DEBUG] [MAIN ] CAAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:41.736836] [INFO ] [MAIN ] CAAP: Generated 1820 derivative records from 20021 primary records. [2025-09-26T22:18:41.737042] [DEBUG] [LOCAL ] CAAP: Saving derivative data. [2025-09-26T22:18:41.737151] [INFO ] [MAIN ] C: Successfully saved derivative data. [2025-09-26T22:18:41.740308] [INFO ] [MAIN ] Derivative Progress: 319/2074 symbols completed. C took 1.2s. Estimated remaining: 12m 16s. Rate: 143.1 symbols/min [2025-09-26T22:18:41.740616] [INFO ] [MAIN ] CACI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:41.760042] [DEBUG] [LOCAL ] CAAP: Derivative data saved (1820 records). [2025-09-26T22:18:41.762012] [INFO ] [MAIN ] CAAP: Successfully saved derivative data. [2025-09-26T22:18:41.765146] [INFO ] [MAIN ] Derivative Progress: 320/2074 symbols completed. CAAP took 1.2s. Estimated remaining: 12m 13s. Rate: 143.6 symbols/min [2025-09-26T22:18:41.765698] [INFO ] [MAIN ] CAE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:41.780132] [DEBUG] [MAIN ] CABO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:41.788530] [INFO ] [MAIN ] CABO: Generated 1820 derivative records from 17549 primary records. [2025-09-26T22:18:41.788724] [DEBUG] [LOCAL ] CABO: Saving derivative data. [2025-09-26T22:18:41.811624] [DEBUG] [LOCAL ] CACI: Loaded 25384 existing records from primary storage. [2025-09-26T22:18:41.812334] [INFO ] [MAIN ] CACI: Loaded 25384 primary data records. [2025-09-26T22:18:41.902297] [DEBUG] [LOCAL ] CABO: Derivative data saved (1820 records). [2025-09-26T22:18:41.914669] [INFO ] [MAIN ] CABO: Successfully saved derivative data. [2025-09-26T22:18:41.938193] [INFO ] [MAIN ] Derivative Progress: 321/2074 symbols completed. CABO took 1.3s. Estimated remaining: 12m 11s. Rate: 143.8 symbols/min [2025-09-26T22:18:41.943194] [INFO ] [MAIN ] CAF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:42.039748] [DEBUG] [LOCAL ] CAE: Loaded 39622 existing records from primary storage. [2025-09-26T22:18:42.049296] [INFO ] [MAIN ] CAE: Loaded 39622 primary data records. [2025-09-26T22:18:42.045246] [DEBUG] [LOCAL ] CAF: Loaded 3471 existing records from primary storage. [2025-09-26T22:18:42.049622] [INFO ] [MAIN ] CAF: Loaded 3471 primary data records. [2025-09-26T22:18:42.892484] [DEBUG] [MAIN ] CACI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:42.894312] [INFO ] [MAIN ] CACI: Generated 1820 derivative records from 25384 primary records. [2025-09-26T22:18:42.894592] [DEBUG] [LOCAL ] CACI: Saving derivative data. [2025-09-26T22:18:42.919311] [DEBUG] [LOCAL ] CACI: Derivative data saved (1820 records). [2025-09-26T22:18:42.919597] [INFO ] [MAIN ] CACI: Successfully saved derivative data. [2025-09-26T22:18:42.922112] [INFO ] [MAIN ] Derivative Progress: 322/2074 symbols completed. CACI took 1.2s. Estimated remaining: 12m 14s. Rate: 143.2 symbols/min [2025-09-26T22:18:42.922726] [INFO ] [MAIN ] CAG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:42.937056] [DEBUG] [MAIN ] CAE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:42.937942] [INFO ] [MAIN ] CAE: Generated 1820 derivative records from 39622 primary records. [2025-09-26T22:18:42.938284] [DEBUG] [LOCAL ] CAE: Saving derivative data. [2025-09-26T22:18:42.971088] [DEBUG] [MAIN ] CAF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:42.973050] [INFO ] [MAIN ] CAF: Generated 1820 derivative records from 3471 primary records. [2025-09-26T22:18:42.976442] [DEBUG] [LOCAL ] CAF: Saving derivative data. [2025-09-26T22:18:42.977279] [DEBUG] [LOCAL ] CAE: Derivative data saved (1820 records). [2025-09-26T22:18:42.978531] [INFO ] [MAIN ] CAE: Successfully saved derivative data. [2025-09-26T22:18:42.981906] [INFO ] [MAIN ] Derivative Progress: 323/2074 symbols completed. CAE took 1.2s. Estimated remaining: 12m 12s. Rate: 143.6 symbols/min [2025-09-26T22:18:42.982350] [INFO ] [MAIN ] CAH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:43.000747] [DEBUG] [LOCAL ] CAF: Derivative data saved (1820 records). [2025-09-26T22:18:43.001029] [INFO ] [MAIN ] CAF: Successfully saved derivative data. [2025-09-26T22:18:43.003826] [INFO ] [MAIN ] Derivative Progress: 324/2074 symbols completed. CAF took 1.1s. Estimated remaining: 12m 9s. Rate: 144.0 symbols/min [2025-09-26T22:18:43.004205] [INFO ] [MAIN ] CAL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:43.045863] [DEBUG] [LOCAL ] CAG: Loaded 54439 existing records from primary storage. [2025-09-26T22:18:43.046057] [INFO ] [MAIN ] CAG: Loaded 54439 primary data records. [2025-09-26T22:18:43.221005] [DEBUG] [LOCAL ] CAH: Loaded 52209 existing records from primary storage. [2025-09-26T22:18:43.256436] [INFO ] [MAIN ] CAH: Loaded 52209 primary data records. [2025-09-26T22:18:43.288976] [DEBUG] [LOCAL ] CAL: Loaded 43833 existing records from primary storage. [2025-09-26T22:18:43.322721] [INFO ] [MAIN ] CAL: Loaded 43833 primary data records. [2025-09-26T22:18:44.105041] [DEBUG] [MAIN ] CAG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:44.106733] [INFO ] [MAIN ] CAG: Generated 1820 derivative records from 54439 primary records. [2025-09-26T22:18:44.106972] [DEBUG] [LOCAL ] CAG: Saving derivative data. [2025-09-26T22:18:44.130996] [DEBUG] [LOCAL ] CAG: Derivative data saved (1820 records). [2025-09-26T22:18:44.131393] [INFO ] [MAIN ] CAG: Successfully saved derivative data. [2025-09-26T22:18:44.135026] [INFO ] [MAIN ] Derivative Progress: 325/2074 symbols completed. CAG took 1.2s. Estimated remaining: 12m 12s. Rate: 143.3 symbols/min [2025-09-26T22:18:44.149174] [INFO ] [MAIN ] CALX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:44.148778] [DEBUG] [MAIN ] CAH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:44.151035] [INFO ] [MAIN ] CAH: Generated 1820 derivative records from 52209 primary records. [2025-09-26T22:18:44.151283] [DEBUG] [LOCAL ] CAH: Saving derivative data. [2025-09-26T22:18:44.184412] [DEBUG] [MAIN ] CAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:44.186055] [INFO ] [MAIN ] CAL: Generated 1820 derivative records from 43833 primary records. [2025-09-26T22:18:44.191411] [DEBUG] [LOCAL ] CAL: Saving derivative data. [2025-09-26T22:18:44.191495] [DEBUG] [LOCAL ] CAH: Derivative data saved (1820 records). [2025-09-26T22:18:44.191638] [INFO ] [MAIN ] CAH: Successfully saved derivative data. [2025-09-26T22:18:44.195376] [INFO ] [MAIN ] Derivative Progress: 326/2074 symbols completed. CAH took 1.2s. Estimated remaining: 12m 10s. Rate: 143.6 symbols/min [2025-09-26T22:18:44.196472] [INFO ] [MAIN ] CANG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:44.224834] [DEBUG] [LOCAL ] CAL: Derivative data saved (1820 records). [2025-09-26T22:18:44.225833] [INFO ] [MAIN ] CAL: Successfully saved derivative data. [2025-09-26T22:18:44.228813] [INFO ] [MAIN ] Derivative Progress: 327/2074 symbols completed. CAL took 1.2s. Estimated remaining: 12m 8s. Rate: 144.1 symbols/min [2025-09-26T22:18:44.240840] [INFO ] [MAIN ] CAPL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:44.241612] [DEBUG] [LOCAL ] CALX: Loaded 38931 existing records from primary storage. [2025-09-26T22:18:44.251191] [INFO ] [MAIN ] CALX: Loaded 38931 primary data records. [2025-09-26T22:18:44.354028] [DEBUG] [LOCAL ] CAPL: Loaded 5930 existing records from primary storage. [2025-09-26T22:18:44.374678] [DEBUG] [LOCAL ] CANG: Loaded 27132 existing records from primary storage. [2025-09-26T22:18:44.365782] [INFO ] [MAIN ] CAPL: Loaded 5930 primary data records. [2025-09-26T22:18:44.383769] [INFO ] [MAIN ] CANG: Loaded 27132 primary data records. [2025-09-26T22:18:45.400439] [DEBUG] [MAIN ] CAPL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:45.401115] [DEBUG] [MAIN ] CALX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:45.403945] [INFO ] [MAIN ] CALX: Generated 1820 derivative records from 38931 primary records. [2025-09-26T22:18:45.404228] [DEBUG] [LOCAL ] CALX: Saving derivative data. [2025-09-26T22:18:45.402687] [INFO ] [MAIN ] CAPL: Generated 1820 derivative records from 5930 primary records. [2025-09-26T22:18:45.407503] [DEBUG] [LOCAL ] CAPL: Saving derivative data. [2025-09-26T22:18:45.452689] [DEBUG] [MAIN ] CANG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:45.455367] [INFO ] [MAIN ] CANG: Generated 1820 derivative records from 27132 primary records. [2025-09-26T22:18:45.455805] [DEBUG] [LOCAL ] CANG: Saving derivative data. [2025-09-26T22:18:45.476156] [DEBUG] [LOCAL ] CAPL: Derivative data saved (1820 records). [2025-09-26T22:18:45.478484] [INFO ] [MAIN ] CAPL: Successfully saved derivative data. [2025-09-26T22:18:45.481948] [INFO ] [MAIN ] Derivative Progress: 328/2074 symbols completed. CAPL took 1.2s. Estimated remaining: 12m 12s. Rate: 143.2 symbols/min [2025-09-26T22:18:45.484034] [DEBUG] [LOCAL ] CALX: Derivative data saved (1820 records). [2025-09-26T22:18:45.485169] [INFO ] [MAIN ] CALX: Successfully saved derivative data. [2025-09-26T22:18:45.488328] [INFO ] [MAIN ] Derivative Progress: 329/2074 symbols completed. CALX took 1.3s. Estimated remaining: 12m 9s. Rate: 143.6 symbols/min [2025-09-26T22:18:45.490202] [DEBUG] [LOCAL ] CANG: Derivative data saved (1820 records). [2025-09-26T22:18:45.490280] [INFO ] [MAIN ] CANG: Successfully saved derivative data. [2025-09-26T22:18:45.493917] [INFO ] [MAIN ] Derivative Progress: 330/2074 symbols completed. CANG took 1.3s. Estimated remaining: 12m 6s. Rate: 144.0 symbols/min [2025-09-26T22:18:45.494963] [INFO ] [MAIN ] CARS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:45.494753] [INFO ] [MAIN ] CARR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:45.495116] [INFO ] [MAIN ] CAT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:45.558060] [DEBUG] [LOCAL ] CARS: Loaded 40616 existing records from primary storage. [2025-09-26T22:18:45.558503] [INFO ] [MAIN ] CARS: Loaded 40616 primary data records. [2025-09-26T22:18:45.721214] [DEBUG] [LOCAL ] CARR: Loaded 54374 existing records from primary storage. [2025-09-26T22:18:45.728481] [DEBUG] [LOCAL ] CAT: Loaded 53693 existing records from primary storage. [2025-09-26T22:18:45.757735] [INFO ] [MAIN ] CARR: Loaded 54374 primary data records. [2025-09-26T22:18:45.766782] [INFO ] [MAIN ] CAT: Loaded 53693 primary data records. [2025-09-26T22:18:46.657877] [DEBUG] [MAIN ] CARS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:46.660044] [INFO ] [MAIN ] CARS: Generated 1820 derivative records from 40616 primary records. [2025-09-26T22:18:46.660568] [DEBUG] [LOCAL ] CARS: Saving derivative data. [2025-09-26T22:18:46.702941] [DEBUG] [MAIN ] CAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:46.704584] [INFO ] [MAIN ] CAT: Generated 1820 derivative records from 53693 primary records. [2025-09-26T22:18:46.712858] [DEBUG] [LOCAL ] CARS: Derivative data saved (1820 records). [2025-09-26T22:18:46.718055] [INFO ] [MAIN ] CARS: Successfully saved derivative data. [2025-09-26T22:18:46.717923] [DEBUG] [LOCAL ] CAT: Saving derivative data. [2025-09-26T22:18:46.728137] [DEBUG] [MAIN ] CARR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:46.728689] [INFO ] [MAIN ] Derivative Progress: 331/2074 symbols completed. CARS took 1.2s. Estimated remaining: 12m 10s. Rate: 143.2 symbols/min [2025-09-26T22:18:46.729939] [INFO ] [MAIN ] CARR: Generated 1820 derivative records from 54374 primary records. [2025-09-26T22:18:46.737891] [INFO ] [MAIN ] CATO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:46.737589] [DEBUG] [LOCAL ] CARR: Saving derivative data. [2025-09-26T22:18:46.766483] [DEBUG] [LOCAL ] CAT: Derivative data saved (1820 records). [2025-09-26T22:18:46.770049] [INFO ] [MAIN ] CAT: Successfully saved derivative data. [2025-09-26T22:18:46.774253] [INFO ] [MAIN ] Derivative Progress: 332/2074 symbols completed. CAT took 1.3s. Estimated remaining: 12m 8s. Rate: 143.6 symbols/min [2025-09-26T22:18:46.779532] [DEBUG] [LOCAL ] CARR: Derivative data saved (1820 records). [2025-09-26T22:18:46.780043] [INFO ] [MAIN ] CAVA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:46.779678] [INFO ] [MAIN ] CARR: Successfully saved derivative data. [2025-09-26T22:18:46.784263] [INFO ] [MAIN ] Derivative Progress: 333/2074 symbols completed. CARR took 1.3s. Estimated remaining: 12m 5s. Rate: 144.0 symbols/min [2025-09-26T22:18:46.785007] [INFO ] [MAIN ] CB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:46.779954] [DEBUG] [LOCAL ] CATO: Loaded 7286 existing records from primary storage. [2025-09-26T22:18:46.785471] [INFO ] [MAIN ] CATO: Loaded 7286 primary data records. [2025-09-26T22:18:47.203499] [DEBUG] [LOCAL ] CAVA: Loaded 54330 existing records from primary storage. [2025-09-26T22:18:47.204133] [INFO ] [MAIN ] CAVA: Loaded 54330 primary data records. [2025-09-26T22:18:47.335501] [DEBUG] [LOCAL ] CB: Loaded 50773 existing records from primary storage. [2025-09-26T22:18:47.350753] [INFO ] [MAIN ] CB: Loaded 50773 primary data records. [2025-09-26T22:18:47.797608] [DEBUG] [MAIN ] CATO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:47.911060] [INFO ] [MAIN ] CATO: Generated 1820 derivative records from 7286 primary records. [2025-09-26T22:18:47.921457] [DEBUG] [LOCAL ] CATO: Saving derivative data. [2025-09-26T22:18:47.941371] [DEBUG] [LOCAL ] CATO: Derivative data saved (1820 records). [2025-09-26T22:18:47.942966] [INFO ] [MAIN ] CATO: Successfully saved derivative data. [2025-09-26T22:18:47.946274] [INFO ] [MAIN ] Derivative Progress: 334/2074 symbols completed. CATO took 1.2s. Estimated remaining: 12m 9s. Rate: 143.2 symbols/min [2025-09-26T22:18:47.947745] [INFO ] [MAIN ] CBAN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:47.973256] [DEBUG] [MAIN ] CAVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:47.976126] [INFO ] [MAIN ] CAVA: Generated 1820 derivative records from 54330 primary records. [2025-09-26T22:18:47.980767] [DEBUG] [LOCAL ] CAVA: Saving derivative data. [2025-09-26T22:18:47.982525] [DEBUG] [LOCAL ] CBAN: Loaded 11141 existing records from primary storage. [2025-09-26T22:18:47.984218] [INFO ] [MAIN ] CBAN: Loaded 11141 primary data records. [2025-09-26T22:18:48.095417] [DEBUG] [MAIN ] CB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:48.113861] [INFO ] [MAIN ] CB: Generated 1820 derivative records from 50773 primary records. [2025-09-26T22:18:48.125422] [DEBUG] [LOCAL ] CB: Saving derivative data. [2025-09-26T22:18:48.114038] [DEBUG] [LOCAL ] CAVA: Derivative data saved (1820 records). [2025-09-26T22:18:48.145267] [INFO ] [MAIN ] CAVA: Successfully saved derivative data. [2025-09-26T22:18:48.168068] [INFO ] [MAIN ] Derivative Progress: 335/2074 symbols completed. CAVA took 1.4s. Estimated remaining: 12m 7s. Rate: 143.4 symbols/min [2025-09-26T22:18:48.195155] [INFO ] [MAIN ] CBL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:48.355968] [DEBUG] [LOCAL ] CB: Derivative data saved (1820 records). [2025-09-26T22:18:48.356156] [INFO ] [MAIN ] CB: Successfully saved derivative data. [2025-09-26T22:18:48.360597] [INFO ] [MAIN ] Derivative Progress: 336/2074 symbols completed. CB took 1.6s. Estimated remaining: 12m 6s. Rate: 143.7 symbols/min [2025-09-26T22:18:48.362356] [INFO ] [MAIN ] CBNA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:48.375109] [DEBUG] [LOCAL ] CBNA: Loaded 2923 existing records from primary storage. [2025-09-26T22:18:48.376802] [INFO ] [MAIN ] CBNA: Loaded 2923 primary data records. [2025-09-26T22:18:48.421564] [DEBUG] [LOCAL ] CBL: Loaded 16862 existing records from primary storage. [2025-09-26T22:18:48.456668] [INFO ] [MAIN ] CBL: Loaded 16862 primary data records. [2025-09-26T22:18:48.858365] [DEBUG] [MAIN ] CBAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:48.880060] [INFO ] [MAIN ] CBAN: Generated 1820 derivative records from 11141 primary records. [2025-09-26T22:18:48.897174] [DEBUG] [LOCAL ] CBAN: Saving derivative data. [2025-09-26T22:18:49.123909] [DEBUG] [LOCAL ] CBAN: Derivative data saved (1820 records). [2025-09-26T22:18:49.124282] [INFO ] [MAIN ] CBAN: Successfully saved derivative data. [2025-09-26T22:18:49.126797] [INFO ] [MAIN ] Derivative Progress: 337/2074 symbols completed. CBAN took 1.2s. Estimated remaining: 12m 7s. Rate: 143.3 symbols/min [2025-09-26T22:18:49.128980] [INFO ] [MAIN ] CBRE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:49.157076] [DEBUG] [MAIN ] CBNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:49.158037] [INFO ] [MAIN ] CBNA: Generated 1820 derivative records from 2923 primary records. [2025-09-26T22:18:49.158468] [DEBUG] [LOCAL ] CBNA: Saving derivative data. [2025-09-26T22:18:49.206307] [DEBUG] [LOCAL ] CBNA: Derivative data saved (1820 records). [2025-09-26T22:18:49.206425] [INFO ] [MAIN ] CBNA: Successfully saved derivative data. [2025-09-26T22:18:49.205729] [DEBUG] [MAIN ] CBL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:49.209595] [INFO ] [MAIN ] Derivative Progress: 338/2074 symbols completed. CBNA took 0.8s. Estimated remaining: 12m 5s. Rate: 143.6 symbols/min [2025-09-26T22:18:49.210957] [INFO ] [MAIN ] CBL: Generated 1820 derivative records from 16862 primary records. [2025-09-26T22:18:49.211081] [DEBUG] [LOCAL ] CBL: Saving derivative data. [2025-09-26T22:18:49.212690] [INFO ] [MAIN ] CBT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:49.247080] [DEBUG] [LOCAL ] CBRE: Loaded 51366 existing records from primary storage. [2025-09-26T22:18:49.248143] [INFO ] [MAIN ] CBRE: Loaded 51366 primary data records. [2025-09-26T22:18:49.271708] [DEBUG] [LOCAL ] CBL: Derivative data saved (1820 records). [2025-09-26T22:18:49.288277] [INFO ] [MAIN ] CBL: Successfully saved derivative data. [2025-09-26T22:18:49.300733] [INFO ] [MAIN ] Derivative Progress: 339/2074 symbols completed. CBL took 1.1s. Estimated remaining: 12m 3s. Rate: 144.0 symbols/min [2025-09-26T22:18:49.348751] [INFO ] [MAIN ] CBU: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:49.464963] [DEBUG] [LOCAL ] CBT: Loaded 31567 existing records from primary storage. [2025-09-26T22:18:49.495189] [INFO ] [MAIN ] CBT: Loaded 31567 primary data records. [2025-09-26T22:18:49.750578] [DEBUG] [LOCAL ] CBU: Loaded 23130 existing records from primary storage. [2025-09-26T22:18:49.751494] [INFO ] [MAIN ] CBU: Loaded 23130 primary data records. [2025-09-26T22:18:50.322523] [DEBUG] [MAIN ] CBRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:50.323693] [INFO ] [MAIN ] CBRE: Generated 1820 derivative records from 51366 primary records. [2025-09-26T22:18:50.323932] [DEBUG] [LOCAL ] CBRE: Saving derivative data. [2025-09-26T22:18:50.343580] [DEBUG] [LOCAL ] CBRE: Derivative data saved (1820 records). [2025-09-26T22:18:50.343940] [INFO ] [MAIN ] CBRE: Successfully saved derivative data. [2025-09-26T22:18:50.347922] [INFO ] [MAIN ] Derivative Progress: 340/2074 symbols completed. CBRE took 1.2s. Estimated remaining: 12m 6s. Rate: 143.3 symbols/min [2025-09-26T22:18:50.348674] [INFO ] [MAIN ] CBZ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:50.369923] [DEBUG] [MAIN ] CBT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:50.371011] [INFO ] [MAIN ] CBT: Generated 1820 derivative records from 31567 primary records. [2025-09-26T22:18:50.371426] [DEBUG] [LOCAL ] CBT: Saving derivative data. [2025-09-26T22:18:50.415470] [DEBUG] [LOCAL ] CBT: Derivative data saved (1820 records). [2025-09-26T22:18:50.416045] [INFO ] [MAIN ] CBT: Successfully saved derivative data. [2025-09-26T22:18:50.419974] [INFO ] [MAIN ] Derivative Progress: 341/2074 symbols completed. CBT took 1.2s. Estimated remaining: 12m 4s. Rate: 143.7 symbols/min [2025-09-26T22:18:50.416490] [DEBUG] [MAIN ] CBU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:50.421701] [INFO ] [MAIN ] CC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:50.421259] [INFO ] [MAIN ] CBU: Generated 1820 derivative records from 23130 primary records. [2025-09-26T22:18:50.422662] [DEBUG] [LOCAL ] CBU: Saving derivative data. [2025-09-26T22:18:50.436460] [DEBUG] [LOCAL ] CBZ: Loaded 34130 existing records from primary storage. [2025-09-26T22:18:50.443833] [INFO ] [MAIN ] CBZ: Loaded 34130 primary data records. [2025-09-26T22:18:50.589332] [DEBUG] [LOCAL ] CBU: Derivative data saved (1820 records). [2025-09-26T22:18:50.616922] [INFO ] [MAIN ] CBU: Successfully saved derivative data. [2025-09-26T22:18:50.628771] [INFO ] [MAIN ] Derivative Progress: 342/2074 symbols completed. CBU took 1.3s. Estimated remaining: 12m 2s. Rate: 143.9 symbols/min [2025-09-26T22:18:50.646251] [INFO ] [MAIN ] CCI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:50.816849] [DEBUG] [LOCAL ] CC: Loaded 53801 existing records from primary storage. [2025-09-26T22:18:50.817214] [INFO ] [MAIN ] CC: Loaded 53801 primary data records. [2025-09-26T22:18:51.244688] [DEBUG] [LOCAL ] CCI: Loaded 53922 existing records from primary storage. [2025-09-26T22:18:51.246054] [INFO ] [MAIN ] CCI: Loaded 53922 primary data records. [2025-09-26T22:18:51.272957] [DEBUG] [MAIN ] CBZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:51.309228] [INFO ] [MAIN ] CBZ: Generated 1820 derivative records from 34130 primary records. [2025-09-26T22:18:51.314732] [DEBUG] [LOCAL ] CBZ: Saving derivative data. [2025-09-26T22:18:51.442334] [DEBUG] [LOCAL ] CBZ: Derivative data saved (1820 records). [2025-09-26T22:18:51.482866] [INFO ] [MAIN ] CBZ: Successfully saved derivative data. [2025-09-26T22:18:51.593037] [INFO ] [MAIN ] Derivative Progress: 343/2074 symbols completed. CBZ took 1.2s. Estimated remaining: 12m 5s. Rate: 143.4 symbols/min [2025-09-26T22:18:51.631258] [DEBUG] [MAIN ] CC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:51.632621] [INFO ] [MAIN ] CC: Generated 1820 derivative records from 53801 primary records. [2025-09-26T22:18:51.632932] [DEBUG] [LOCAL ] CC: Saving derivative data. [2025-09-26T22:18:51.652086] [DEBUG] [LOCAL ] CC: Derivative data saved (1820 records). [2025-09-26T22:18:51.652339] [INFO ] [MAIN ] CC: Successfully saved derivative data. [2025-09-26T22:18:51.655788] [INFO ] [MAIN ] Derivative Progress: 344/2074 symbols completed. CC took 1.2s. Estimated remaining: 12m 2s. Rate: 143.7 symbols/min [2025-09-26T22:18:51.673793] [DEBUG] [MAIN ] CCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:51.674537] [INFO ] [MAIN ] CCI: Generated 1820 derivative records from 53922 primary records. [2025-09-26T22:18:51.674600] [DEBUG] [LOCAL ] CCI: Saving derivative data. [2025-09-26T22:18:51.690559] [DEBUG] [LOCAL ] CCI: Derivative data saved (1820 records). [2025-09-26T22:18:51.690619] [INFO ] [MAIN ] CCI: Successfully saved derivative data. [2025-09-26T22:18:51.693791] [INFO ] [MAIN ] Derivative Progress: 345/2074 symbols completed. CCI took 1.0s. Estimated remaining: 11m 60s. Rate: 144.1 symbols/min [2025-09-26T22:18:51.694433] [INFO ] [MAIN ] CCK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:51.694373] [INFO ] [MAIN ] CCJ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:51.695281] [INFO ] [MAIN ] CCIF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:51.714680] [DEBUG] [LOCAL ] CCIF: Loaded 15698 existing records from primary storage. [2025-09-26T22:18:51.715007] [INFO ] [MAIN ] CCIF: Loaded 15698 primary data records. [2025-09-26T22:18:52.107535] [DEBUG] [LOCAL ] CCJ: Loaded 54453 existing records from primary storage. [2025-09-26T22:18:52.107403] [DEBUG] [LOCAL ] CCK: Loaded 47083 existing records from primary storage. [2025-09-26T22:18:52.107850] [INFO ] [MAIN ] CCJ: Loaded 54453 primary data records. [2025-09-26T22:18:52.108083] [INFO ] [MAIN ] CCK: Loaded 47083 primary data records. [2025-09-26T22:18:52.794494] [DEBUG] [MAIN ] CCIF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:52.796052] [INFO ] [MAIN ] CCIF: Generated 1820 derivative records from 15698 primary records. [2025-09-26T22:18:52.796701] [DEBUG] [LOCAL ] CCIF: Saving derivative data. [2025-09-26T22:18:52.819230] [DEBUG] [LOCAL ] CCIF: Derivative data saved (1820 records). [2025-09-26T22:18:52.819838] [INFO ] [MAIN ] CCIF: Successfully saved derivative data. [2025-09-26T22:18:52.822392] [INFO ] [MAIN ] Derivative Progress: 346/2074 symbols completed. CCIF took 1.1s. Estimated remaining: 12m 3s. Rate: 143.4 symbols/min [2025-09-26T22:18:52.823200] [INFO ] [MAIN ] CCL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:52.866970] [DEBUG] [MAIN ] CCJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:52.868521] [INFO ] [MAIN ] CCJ: Generated 1820 derivative records from 54453 primary records. [2025-09-26T22:18:52.867697] [DEBUG] [MAIN ] CCK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:52.869188] [INFO ] [MAIN ] CCK: Generated 1820 derivative records from 47083 primary records. [2025-09-26T22:18:52.869339] [DEBUG] [LOCAL ] CCK: Saving derivative data. [2025-09-26T22:18:52.869280] [DEBUG] [LOCAL ] CCJ: Saving derivative data. [2025-09-26T22:18:52.900088] [DEBUG] [LOCAL ] CCK: Derivative data saved (1820 records). [2025-09-26T22:18:52.903399] [INFO ] [MAIN ] CCK: Successfully saved derivative data. [2025-09-26T22:18:52.903497] [DEBUG] [LOCAL ] CCJ: Derivative data saved (1820 records). [2025-09-26T22:18:52.903610] [INFO ] [MAIN ] CCJ: Successfully saved derivative data. [2025-09-26T22:18:52.906640] [INFO ] [MAIN ] Derivative Progress: 347/2074 symbols completed. CCJ took 1.2s. Estimated remaining: 12m 1s. Rate: 143.7 symbols/min [2025-09-26T22:18:52.910936] [INFO ] [MAIN ] Derivative Progress: 348/2074 symbols completed. CCK took 1.2s. Estimated remaining: 11m 59s. Rate: 144.1 symbols/min [2025-09-26T22:18:52.911419] [INFO ] [MAIN ] CCS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:52.911052] [INFO ] [MAIN ] CCO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:52.961824] [DEBUG] [LOCAL ] CCL: Loaded 54580 existing records from primary storage. [2025-09-26T22:18:52.962077] [INFO ] [MAIN ] CCL: Loaded 54580 primary data records. [2025-09-26T22:18:53.100118] [DEBUG] [LOCAL ] CCS: Loaded 31155 existing records from primary storage. [2025-09-26T22:18:53.129467] [INFO ] [MAIN ] CCS: Loaded 31155 primary data records. [2025-09-26T22:18:53.203761] [DEBUG] [LOCAL ] CCO: Loaded 48387 existing records from primary storage. [2025-09-26T22:18:53.230034] [INFO ] [MAIN ] CCO: Loaded 48387 primary data records. [2025-09-26T22:18:54.062999] [DEBUG] [MAIN ] CCL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:54.065425] [INFO ] [MAIN ] CCL: Generated 1820 derivative records from 54580 primary records. [2025-09-26T22:18:54.066059] [DEBUG] [LOCAL ] CCL: Saving derivative data. [2025-09-26T22:18:54.088200] [DEBUG] [LOCAL ] CCL: Derivative data saved (1820 records). [2025-09-26T22:18:54.102146] [INFO ] [MAIN ] CCL: Successfully saved derivative data. [2025-09-26T22:18:54.105243] [INFO ] [MAIN ] Derivative Progress: 349/2074 symbols completed. CCL took 1.3s. Estimated remaining: 12m 2s. Rate: 143.4 symbols/min [2025-09-26T22:18:54.105786] [INFO ] [MAIN ] CCU: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:54.106282] [DEBUG] [MAIN ] CCS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:54.107387] [INFO ] [MAIN ] CCS: Generated 1820 derivative records from 31155 primary records. [2025-09-26T22:18:54.107570] [DEBUG] [LOCAL ] CCS: Saving derivative data. [2025-09-26T22:18:54.129045] [DEBUG] [LOCAL ] CCS: Derivative data saved (1820 records). [2025-09-26T22:18:54.129154] [INFO ] [MAIN ] CCS: Successfully saved derivative data. [2025-09-26T22:18:54.132304] [INFO ] [MAIN ] Derivative Progress: 350/2074 symbols completed. CCS took 1.2s. Estimated remaining: 11m 60s. Rate: 143.7 symbols/min [2025-09-26T22:18:54.144961] [INFO ] [MAIN ] CDE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:54.146933] [DEBUG] [MAIN ] CCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:54.156294] [INFO ] [MAIN ] CCO: Generated 1820 derivative records from 48387 primary records. [2025-09-26T22:18:54.156429] [DEBUG] [LOCAL ] CCO: Saving derivative data. [2025-09-26T22:18:54.181298] [DEBUG] [LOCAL ] CCO: Derivative data saved (1820 records). [2025-09-26T22:18:54.181842] [DEBUG] [LOCAL ] CCU: Loaded 23800 existing records from primary storage. [2025-09-26T22:18:54.181432] [INFO ] [MAIN ] CCO: Successfully saved derivative data. [2025-09-26T22:18:54.185789] [INFO ] [MAIN ] Derivative Progress: 351/2074 symbols completed. CCO took 1.3s. Estimated remaining: 11m 57s. Rate: 144.1 symbols/min [2025-09-26T22:18:54.186244] [INFO ] [MAIN ] CDLR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:54.182028] [INFO ] [MAIN ] CCU: Loaded 23800 primary data records. [2025-09-26T22:18:54.357273] [DEBUG] [LOCAL ] CDLR: Loaded 9966 existing records from primary storage. [2025-09-26T22:18:54.389728] [INFO ] [MAIN ] CDLR: Loaded 9966 primary data records. [2025-09-26T22:18:54.655858] [DEBUG] [LOCAL ] CDE: Loaded 54421 existing records from primary storage. [2025-09-26T22:18:54.680687] [INFO ] [MAIN ] CDE: Loaded 54421 primary data records. [2025-09-26T22:18:55.273885] [DEBUG] [MAIN ] CCU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:55.275590] [INFO ] [MAIN ] CCU: Generated 1820 derivative records from 23800 primary records. [2025-09-26T22:18:55.276081] [DEBUG] [LOCAL ] CCU: Saving derivative data. [2025-09-26T22:18:55.299795] [DEBUG] [LOCAL ] CCU: Derivative data saved (1820 records). [2025-09-26T22:18:55.301193] [INFO ] [MAIN ] CCU: Successfully saved derivative data. [2025-09-26T22:18:55.304461] [INFO ] [MAIN ] Derivative Progress: 352/2074 symbols completed. CCU took 1.2s. Estimated remaining: 12m 0s. Rate: 143.4 symbols/min [2025-09-26T22:18:55.305080] [INFO ] [MAIN ] CDP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:55.320914] [DEBUG] [MAIN ] CDLR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:55.325166] [INFO ] [MAIN ] CDLR: Generated 1820 derivative records from 9966 primary records. [2025-09-26T22:18:55.325538] [DEBUG] [LOCAL ] CDLR: Saving derivative data. [2025-09-26T22:18:55.348137] [DEBUG] [MAIN ] CDE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:55.354848] [INFO ] [MAIN ] CDE: Generated 1820 derivative records from 54421 primary records. [2025-09-26T22:18:55.356186] [DEBUG] [LOCAL ] CDE: Saving derivative data. [2025-09-26T22:18:55.374595] [DEBUG] [LOCAL ] CDLR: Derivative data saved (1820 records). [2025-09-26T22:18:55.375300] [INFO ] [MAIN ] CDLR: Successfully saved derivative data. [2025-09-26T22:18:55.377988] [INFO ] [MAIN ] Derivative Progress: 353/2074 symbols completed. CDLR took 1.2s. Estimated remaining: 11m 58s. Rate: 143.7 symbols/min [2025-09-26T22:18:55.389244] [INFO ] [MAIN ] CDRE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:55.392164] [DEBUG] [LOCAL ] CDE: Derivative data saved (1820 records). [2025-09-26T22:18:55.392270] [INFO ] [MAIN ] CDE: Successfully saved derivative data. [2025-09-26T22:18:55.396317] [INFO ] [MAIN ] Derivative Progress: 354/2074 symbols completed. CDE took 1.3s. Estimated remaining: 11m 56s. Rate: 144.1 symbols/min [2025-09-26T22:18:55.396791] [INFO ] [MAIN ] CE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:55.414333] [DEBUG] [LOCAL ] CDP: Loaded 43357 existing records from primary storage. [2025-09-26T22:18:55.414914] [INFO ] [MAIN ] CDP: Loaded 43357 primary data records. [2025-09-26T22:18:55.545765] [DEBUG] [LOCAL ] CDRE: Loaded 25747 existing records from primary storage. [2025-09-26T22:18:55.550354] [INFO ] [MAIN ] CDRE: Loaded 25747 primary data records. [2025-09-26T22:18:55.992298] [DEBUG] [LOCAL ] CE: Loaded 52316 existing records from primary storage. [2025-09-26T22:18:55.998788] [INFO ] [MAIN ] CE: Loaded 52316 primary data records. [2025-09-26T22:18:56.595491] [DEBUG] [MAIN ] CDP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:56.597850] [INFO ] [MAIN ] CDP: Generated 1820 derivative records from 43357 primary records. [2025-09-26T22:18:56.598229] [DEBUG] [LOCAL ] CDP: Saving derivative data. [2025-09-26T22:18:56.624775] [DEBUG] [LOCAL ] CDP: Derivative data saved (1820 records). [2025-09-26T22:18:56.625779] [INFO ] [MAIN ] CDP: Successfully saved derivative data. [2025-09-26T22:18:56.629199] [INFO ] [MAIN ] Derivative Progress: 355/2074 symbols completed. CDP took 1.3s. Estimated remaining: 11m 60s. Rate: 143.3 symbols/min [2025-09-26T22:18:56.630526] [INFO ] [MAIN ] CEE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:56.645892] [DEBUG] [MAIN ] CDRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:56.650494] [INFO ] [MAIN ] CDRE: Generated 1820 derivative records from 25747 primary records. [2025-09-26T22:18:56.653002] [DEBUG] [LOCAL ] CDRE: Saving derivative data. [2025-09-26T22:18:56.683681] [DEBUG] [MAIN ] CE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:56.688539] [INFO ] [MAIN ] CE: Generated 1820 derivative records from 52316 primary records. [2025-09-26T22:18:56.689838] [DEBUG] [LOCAL ] CE: Saving derivative data. [2025-09-26T22:18:56.689317] [DEBUG] [LOCAL ] CEE: Loaded 6697 existing records from primary storage. [2025-09-26T22:18:56.700886] [INFO ] [MAIN ] CEE: Loaded 6697 primary data records. [2025-09-26T22:18:56.764271] [DEBUG] [LOCAL ] CDRE: Derivative data saved (1820 records). [2025-09-26T22:18:56.770370] [INFO ] [MAIN ] CDRE: Successfully saved derivative data. [2025-09-26T22:18:56.781992] [INFO ] [MAIN ] Derivative Progress: 356/2074 symbols completed. CDRE took 1.4s. Estimated remaining: 11m 58s. Rate: 143.6 symbols/min [2025-09-26T22:18:56.810056] [DEBUG] [LOCAL ] CE: Derivative data saved (1820 records). [2025-09-26T22:18:56.799531] [INFO ] [MAIN ] CEPU: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:56.833766] [INFO ] [MAIN ] CE: Successfully saved derivative data. [2025-09-26T22:18:56.862285] [INFO ] [MAIN ] Derivative Progress: 357/2074 symbols completed. CE took 1.5s. Estimated remaining: 11m 56s. Rate: 143.9 symbols/min [2025-09-26T22:18:56.863943] [INFO ] [MAIN ] CF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:57.094870] [DEBUG] [LOCAL ] CEPU: Loaded 26454 existing records from primary storage. [2025-09-26T22:18:57.095786] [INFO ] [MAIN ] CEPU: Loaded 26454 primary data records. [2025-09-26T22:18:57.462603] [DEBUG] [LOCAL ] CF: Loaded 52983 existing records from primary storage. [2025-09-26T22:18:57.477693] [INFO ] [MAIN ] CF: Loaded 52983 primary data records. [2025-09-26T22:18:57.478303] [DEBUG] [MAIN ] CEE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:57.494263] [INFO ] [MAIN ] CEE: Generated 1820 derivative records from 6697 primary records. [2025-09-26T22:18:57.505424] [DEBUG] [LOCAL ] CEE: Saving derivative data. [2025-09-26T22:18:57.688881] [DEBUG] [LOCAL ] CEE: Derivative data saved (1820 records). [2025-09-26T22:18:57.694281] [INFO ] [MAIN ] CEE: Successfully saved derivative data. [2025-09-26T22:18:57.713375] [INFO ] [MAIN ] Derivative Progress: 358/2074 symbols completed. CEE took 1.1s. Estimated remaining: 11m 57s. Rate: 143.5 symbols/min [2025-09-26T22:18:57.917179] [DEBUG] [MAIN ] CEPU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:57.918957] [INFO ] [MAIN ] CEPU: Generated 1820 derivative records from 26454 primary records. [2025-09-26T22:18:57.919338] [DEBUG] [LOCAL ] CEPU: Saving derivative data. [2025-09-26T22:18:57.940991] [DEBUG] [LOCAL ] CEPU: Derivative data saved (1820 records). [2025-09-26T22:18:57.941433] [INFO ] [MAIN ] CEPU: Successfully saved derivative data. [2025-09-26T22:18:57.944586] [INFO ] [MAIN ] Derivative Progress: 359/2074 symbols completed. CEPU took 1.2s. Estimated remaining: 11m 56s. Rate: 143.7 symbols/min [2025-09-26T22:18:57.960972] [DEBUG] [MAIN ] CF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:57.961879] [INFO ] [MAIN ] CF: Generated 1820 derivative records from 52983 primary records. [2025-09-26T22:18:57.961950] [DEBUG] [LOCAL ] CF: Saving derivative data. [2025-09-26T22:18:57.978477] [DEBUG] [LOCAL ] CF: Derivative data saved (1820 records). [2025-09-26T22:18:57.978579] [INFO ] [MAIN ] CF: Successfully saved derivative data. [2025-09-26T22:18:57.981363] [INFO ] [MAIN ] Derivative Progress: 360/2074 symbols completed. CF took 1.1s. Estimated remaining: 11m 54s. Rate: 144.0 symbols/min [2025-09-26T22:18:57.982580] [INFO ] [MAIN ] CFR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:57.982401] [INFO ] [MAIN ] CFG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:57.982312] [INFO ] [MAIN ] CGAU: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:58.061400] [DEBUG] [LOCAL ] CGAU: Loaded 43406 existing records from primary storage. [2025-09-26T22:18:58.061738] [INFO ] [MAIN ] CGAU: Loaded 43406 primary data records. [2025-09-26T22:18:58.062360] [DEBUG] [LOCAL ] CFR: Loaded 33971 existing records from primary storage. [2025-09-26T22:18:58.068128] [INFO ] [MAIN ] CFR: Loaded 33971 primary data records. [2025-09-26T22:18:58.238947] [DEBUG] [LOCAL ] CFG: Loaded 54404 existing records from primary storage. [2025-09-26T22:18:58.275847] [INFO ] [MAIN ] CFG: Loaded 54404 primary data records. [2025-09-26T22:18:59.129941] [DEBUG] [MAIN ] CGAU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:59.130553] [DEBUG] [MAIN ] CFR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:59.132183] [INFO ] [MAIN ] CFR: Generated 1820 derivative records from 33971 primary records. [2025-09-26T22:18:59.132361] [DEBUG] [LOCAL ] CFR: Saving derivative data. [2025-09-26T22:18:59.133471] [INFO ] [MAIN ] CGAU: Generated 1820 derivative records from 43406 primary records. [2025-09-26T22:18:59.135521] [DEBUG] [LOCAL ] CGAU: Saving derivative data. [2025-09-26T22:18:59.172057] [DEBUG] [LOCAL ] CGAU: Derivative data saved (1820 records). [2025-09-26T22:18:59.173052] [INFO ] [MAIN ] CGAU: Successfully saved derivative data. [2025-09-26T22:18:59.177998] [INFO ] [MAIN ] Derivative Progress: 361/2074 symbols completed. CGAU took 1.2s. Estimated remaining: 11m 57s. Rate: 143.3 symbols/min [2025-09-26T22:18:59.192946] [DEBUG] [MAIN ] CFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:18:59.192461] [INFO ] [MAIN ] CHCT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:59.196272] [INFO ] [MAIN ] CFG: Generated 1820 derivative records from 54404 primary records. [2025-09-26T22:18:59.196550] [DEBUG] [LOCAL ] CFG: Saving derivative data. [2025-09-26T22:18:59.196744] [DEBUG] [LOCAL ] CFR: Derivative data saved (1820 records). [2025-09-26T22:18:59.198097] [INFO ] [MAIN ] CFR: Successfully saved derivative data. [2025-09-26T22:18:59.201138] [INFO ] [MAIN ] Derivative Progress: 362/2074 symbols completed. CFR took 1.2s. Estimated remaining: 11m 55s. Rate: 143.7 symbols/min [2025-09-26T22:18:59.202106] [INFO ] [MAIN ] CHD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:59.219431] [DEBUG] [LOCAL ] CFG: Derivative data saved (1820 records). [2025-09-26T22:18:59.219570] [INFO ] [MAIN ] CFG: Successfully saved derivative data. [2025-09-26T22:18:59.223584] [INFO ] [MAIN ] Derivative Progress: 363/2074 symbols completed. CFG took 1.2s. Estimated remaining: 11m 53s. Rate: 144.1 symbols/min [2025-09-26T22:18:59.231483] [INFO ] [MAIN ] CHE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:18:59.244223] [DEBUG] [LOCAL ] CHCT: Loaded 24309 existing records from primary storage. [2025-09-26T22:18:59.244482] [INFO ] [MAIN ] CHCT: Loaded 24309 primary data records. [2025-09-26T22:18:59.387904] [DEBUG] [LOCAL ] CHE: Loaded 14983 existing records from primary storage. [2025-09-26T22:18:59.399103] [INFO ] [MAIN ] CHE: Loaded 14983 primary data records. [2025-09-26T22:18:59.578116] [DEBUG] [LOCAL ] CHD: Loaded 52767 existing records from primary storage. [2025-09-26T22:18:59.694089] [INFO ] [MAIN ] CHD: Loaded 52767 primary data records. [2025-09-26T22:19:00.387792] [DEBUG] [MAIN ] CHCT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:00.389468] [INFO ] [MAIN ] CHCT: Generated 1820 derivative records from 24309 primary records. [2025-09-26T22:19:00.389612] [DEBUG] [LOCAL ] CHCT: Saving derivative data. [2025-09-26T22:19:00.408990] [DEBUG] [LOCAL ] CHCT: Derivative data saved (1820 records). [2025-09-26T22:19:00.409808] [INFO ] [MAIN ] CHCT: Successfully saved derivative data. [2025-09-26T22:19:00.414322] [INFO ] [MAIN ] Derivative Progress: 364/2074 symbols completed. CHCT took 1.2s. Estimated remaining: 11m 56s. Rate: 143.3 symbols/min [2025-09-26T22:19:00.424516] [INFO ] [MAIN ] CHGG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:00.430604] [DEBUG] [MAIN ] CHE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:00.432132] [INFO ] [MAIN ] CHE: Generated 1820 derivative records from 14983 primary records. [2025-09-26T22:19:00.432570] [DEBUG] [LOCAL ] CHE: Saving derivative data. [2025-09-26T22:19:00.454176] [DEBUG] [LOCAL ] CHE: Derivative data saved (1820 records). [2025-09-26T22:19:00.454402] [INFO ] [MAIN ] CHE: Successfully saved derivative data. [2025-09-26T22:19:00.457507] [INFO ] [MAIN ] Derivative Progress: 365/2074 symbols completed. CHE took 1.2s. Estimated remaining: 11m 54s. Rate: 143.7 symbols/min [2025-09-26T22:19:00.471563] [INFO ] [MAIN ] CHH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:00.471437] [DEBUG] [MAIN ] CHD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:00.472932] [INFO ] [MAIN ] CHD: Generated 1820 derivative records from 52767 primary records. [2025-09-26T22:19:00.473635] [DEBUG] [LOCAL ] CHD: Saving derivative data. [2025-09-26T22:19:00.503520] [DEBUG] [LOCAL ] CHD: Derivative data saved (1820 records). [2025-09-26T22:19:00.503730] [INFO ] [MAIN ] CHD: Successfully saved derivative data. [2025-09-26T22:19:00.506633] [INFO ] [MAIN ] Derivative Progress: 366/2074 symbols completed. CHD took 1.3s. Estimated remaining: 11m 52s. Rate: 144.0 symbols/min [2025-09-26T22:19:00.507143] [INFO ] [MAIN ] CHMI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:00.535322] [DEBUG] [LOCAL ] CHGG: Loaded 48434 existing records from primary storage. [2025-09-26T22:19:00.535728] [INFO ] [MAIN ] CHGG: Loaded 48434 primary data records. [2025-09-26T22:19:00.681493] [DEBUG] [LOCAL ] CHMI: Loaded 22359 existing records from primary storage. [2025-09-26T22:19:00.681358] [DEBUG] [LOCAL ] CHH: Loaded 32744 existing records from primary storage. [2025-09-26T22:19:00.682394] [INFO ] [MAIN ] CHMI: Loaded 22359 primary data records. [2025-09-26T22:19:00.741312] [INFO ] [MAIN ] CHH: Loaded 32744 primary data records. [2025-09-26T22:19:01.607695] [DEBUG] [MAIN ] CHGG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:01.609318] [INFO ] [MAIN ] CHGG: Generated 1820 derivative records from 48434 primary records. [2025-09-26T22:19:01.609476] [DEBUG] [LOCAL ] CHGG: Saving derivative data. [2025-09-26T22:19:01.630134] [DEBUG] [LOCAL ] CHGG: Derivative data saved (1820 records). [2025-09-26T22:19:01.630791] [INFO ] [MAIN ] CHGG: Successfully saved derivative data. [2025-09-26T22:19:01.633113] [INFO ] [MAIN ] Derivative Progress: 367/2074 symbols completed. CHGG took 1.2s. Estimated remaining: 11m 54s. Rate: 143.4 symbols/min [2025-09-26T22:19:01.633630] [INFO ] [MAIN ] CHN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:01.657015] [DEBUG] [LOCAL ] CHN: Loaded 4900 existing records from primary storage. [2025-09-26T22:19:01.656824] [DEBUG] [MAIN ] CHMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:01.657181] [INFO ] [MAIN ] CHN: Loaded 4900 primary data records. [2025-09-26T22:19:01.670705] [INFO ] [MAIN ] CHMI: Generated 1820 derivative records from 22359 primary records. [2025-09-26T22:19:01.707789] [DEBUG] [LOCAL ] CHMI: Saving derivative data. [2025-09-26T22:19:01.795276] [DEBUG] [MAIN ] CHH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:01.818967] [INFO ] [MAIN ] CHH: Generated 1820 derivative records from 32744 primary records. [2025-09-26T22:19:01.830372] [DEBUG] [LOCAL ] CHH: Saving derivative data. [2025-09-26T22:19:01.885870] [DEBUG] [LOCAL ] CHMI: Derivative data saved (1820 records). [2025-09-26T22:19:02.021506] [INFO ] [MAIN ] CHMI: Successfully saved derivative data. [2025-09-26T22:19:02.036801] [INFO ] [MAIN ] Derivative Progress: 368/2074 symbols completed. CHMI took 1.5s. Estimated remaining: 11m 54s. Rate: 143.4 symbols/min [2025-09-26T22:19:02.039564] [INFO ] [MAIN ] CHPT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:02.045826] [DEBUG] [LOCAL ] CHH: Derivative data saved (1820 records). [2025-09-26T22:19:02.047400] [INFO ] [MAIN ] CHH: Successfully saved derivative data. [2025-09-26T22:19:02.051157] [INFO ] [MAIN ] Derivative Progress: 369/2074 symbols completed. CHH took 1.6s. Estimated remaining: 11m 52s. Rate: 143.7 symbols/min [2025-09-26T22:19:02.051904] [INFO ] [MAIN ] CHT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:02.074761] [DEBUG] [MAIN ] CHN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:02.075563] [INFO ] [MAIN ] CHN: Generated 1820 derivative records from 4900 primary records. [2025-09-26T22:19:02.075708] [DEBUG] [LOCAL ] CHN: Saving derivative data. [2025-09-26T22:19:02.098070] [DEBUG] [LOCAL ] CHN: Derivative data saved (1820 records). [2025-09-26T22:19:02.108404] [INFO ] [MAIN ] CHN: Successfully saved derivative data. [2025-09-26T22:19:02.110777] [INFO ] [MAIN ] Derivative Progress: 370/2074 symbols completed. CHN took 0.5s. Estimated remaining: 11m 50s. Rate: 144.1 symbols/min [2025-09-26T22:19:02.121359] [INFO ] [MAIN ] CHWY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:02.122740] [DEBUG] [LOCAL ] CHT: Loaded 19816 existing records from primary storage. [2025-09-26T22:19:02.122999] [INFO ] [MAIN ] CHT: Loaded 19816 primary data records. [2025-09-26T22:19:02.247973] [DEBUG] [LOCAL ] CHPT: Loaded 49765 existing records from primary storage. [2025-09-26T22:19:02.248543] [INFO ] [MAIN ] CHPT: Loaded 49765 primary data records. [2025-09-26T22:19:02.637090] [DEBUG] [LOCAL ] CHWY: Loaded 54434 existing records from primary storage. [2025-09-26T22:19:02.665849] [INFO ] [MAIN ] CHWY: Loaded 54434 primary data records. [2025-09-26T22:19:03.210461] [DEBUG] [MAIN ] CHT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:03.212029] [INFO ] [MAIN ] CHT: Generated 1820 derivative records from 19816 primary records. [2025-09-26T22:19:03.212132] [DEBUG] [LOCAL ] CHT: Saving derivative data. [2025-09-26T22:19:03.251989] [DEBUG] [MAIN ] CHPT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:03.255985] [DEBUG] [LOCAL ] CHT: Derivative data saved (1820 records). [2025-09-26T22:19:03.256182] [INFO ] [MAIN ] CHT: Successfully saved derivative data. [2025-09-26T22:19:03.257612] [INFO ] [MAIN ] CHPT: Generated 1820 derivative records from 49765 primary records. [2025-09-26T22:19:03.260180] [INFO ] [MAIN ] Derivative Progress: 371/2074 symbols completed. CHT took 1.2s. Estimated remaining: 11m 53s. Rate: 143.4 symbols/min [2025-09-26T22:19:03.260357] [DEBUG] [LOCAL ] CHPT: Saving derivative data. [2025-09-26T22:19:03.273827] [INFO ] [MAIN ] CI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:03.289190] [DEBUG] [MAIN ] CHWY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:03.291690] [INFO ] [MAIN ] CHWY: Generated 1820 derivative records from 54434 primary records. [2025-09-26T22:19:03.292547] [DEBUG] [LOCAL ] CHWY: Saving derivative data. [2025-09-26T22:19:03.304847] [DEBUG] [LOCAL ] CHPT: Derivative data saved (1820 records). [2025-09-26T22:19:03.305001] [INFO ] [MAIN ] CHPT: Successfully saved derivative data. [2025-09-26T22:19:03.309329] [INFO ] [MAIN ] Derivative Progress: 372/2074 symbols completed. CHPT took 1.3s. Estimated remaining: 11m 50s. Rate: 143.7 symbols/min [2025-09-26T22:19:03.312745] [INFO ] [MAIN ] CIA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:03.317527] [DEBUG] [LOCAL ] CHWY: Derivative data saved (1820 records). [2025-09-26T22:19:03.317688] [INFO ] [MAIN ] CHWY: Successfully saved derivative data. [2025-09-26T22:19:03.320570] [INFO ] [MAIN ] Derivative Progress: 373/2074 symbols completed. CHWY took 1.2s. Estimated remaining: 11m 48s. Rate: 144.1 symbols/min [2025-09-26T22:19:03.340402] [DEBUG] [LOCAL ] CIA: Loaded 17213 existing records from primary storage. [2025-09-26T22:19:03.340555] [INFO ] [MAIN ] CIA: Loaded 17213 primary data records. [2025-09-26T22:19:03.530028] [DEBUG] [LOCAL ] CI: Loaded 50561 existing records from primary storage. [2025-09-26T22:19:03.549915] [INFO ] [MAIN ] CI: Loaded 50561 primary data records. [2025-09-26T22:19:04.075435] [DEBUG] [MAIN ] CIA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:04.076237] [INFO ] [MAIN ] CIA: Generated 1820 derivative records from 17213 primary records. [2025-09-26T22:19:04.076564] [DEBUG] [LOCAL ] CIA: Saving derivative data. [2025-09-26T22:19:04.092896] [DEBUG] [LOCAL ] CIA: Derivative data saved (1820 records). [2025-09-26T22:19:04.093296] [INFO ] [MAIN ] CIA: Successfully saved derivative data. [2025-09-26T22:19:04.095632] [INFO ] [MAIN ] Derivative Progress: 374/2074 symbols completed. CIA took 0.8s. Estimated remaining: 11m 49s. Rate: 143.8 symbols/min [2025-09-26T22:19:04.119841] [DEBUG] [MAIN ] CI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:04.120914] [INFO ] [MAIN ] CI: Generated 1820 derivative records from 50561 primary records. [2025-09-26T22:19:04.120996] [DEBUG] [LOCAL ] CI: Saving derivative data. [2025-09-26T22:19:04.139720] [DEBUG] [LOCAL ] CI: Derivative data saved (1820 records). [2025-09-26T22:19:04.139872] [INFO ] [MAIN ] CI: Successfully saved derivative data. [2025-09-26T22:19:04.142301] [INFO ] [MAIN ] Derivative Progress: 375/2074 symbols completed. CI took 0.9s. Estimated remaining: 11m 47s. Rate: 144.1 symbols/min [2025-09-26T22:19:04.143471] [INFO ] [MAIN ] CIB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:04.143372] [INFO ] [MAIN ] CIF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:04.144239] [INFO ] [MAIN ] CIEN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:04.154189] [DEBUG] [LOCAL ] CIF: Loaded 4396 existing records from primary storage. [2025-09-26T22:19:04.154449] [INFO ] [MAIN ] CIF: Loaded 4396 primary data records. [2025-09-26T22:19:04.453904] [DEBUG] [LOCAL ] CIB: Loaded 31435 existing records from primary storage. [2025-09-26T22:19:04.532438] [INFO ] [MAIN ] CIB: Loaded 31435 primary data records. [2025-09-26T22:19:04.593949] [DEBUG] [LOCAL ] CIEN: Loaded 52854 existing records from primary storage. [2025-09-26T22:19:04.607805] [INFO ] [MAIN ] CIEN: Loaded 52854 primary data records. [2025-09-26T22:19:05.249516] [DEBUG] [MAIN ] CIF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:05.251262] [INFO ] [MAIN ] CIF: Generated 1820 derivative records from 4396 primary records. [2025-09-26T22:19:05.255605] [DEBUG] [LOCAL ] CIF: Saving derivative data. [2025-09-26T22:19:05.285370] [DEBUG] [LOCAL ] CIF: Derivative data saved (1820 records). [2025-09-26T22:19:05.286528] [INFO ] [MAIN ] CIF: Successfully saved derivative data. [2025-09-26T22:19:05.289419] [INFO ] [MAIN ] Derivative Progress: 376/2074 symbols completed. CIF took 1.1s. Estimated remaining: 11m 50s. Rate: 143.5 symbols/min [2025-09-26T22:19:05.286439] [DEBUG] [MAIN ] CIB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:05.290414] [INFO ] [MAIN ] CIG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:05.291345] [INFO ] [MAIN ] CIB: Generated 1820 derivative records from 31435 primary records. [2025-09-26T22:19:05.291568] [DEBUG] [LOCAL ] CIB: Saving derivative data. [2025-09-26T22:19:05.324541] [DEBUG] [MAIN ] CIEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:05.325976] [INFO ] [MAIN ] CIEN: Generated 1820 derivative records from 52854 primary records. [2025-09-26T22:19:05.326903] [DEBUG] [LOCAL ] CIEN: Saving derivative data. [2025-09-26T22:19:05.336960] [DEBUG] [LOCAL ] CIB: Derivative data saved (1820 records). [2025-09-26T22:19:05.343822] [INFO ] [MAIN ] CIB: Successfully saved derivative data. [2025-09-26T22:19:05.346948] [INFO ] [MAIN ] Derivative Progress: 377/2074 symbols completed. CIB took 1.2s. Estimated remaining: 11m 48s. Rate: 143.8 symbols/min [2025-09-26T22:19:05.347847] [INFO ] [MAIN ] CII: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:05.351552] [DEBUG] [LOCAL ] CIEN: Derivative data saved (1820 records). [2025-09-26T22:19:05.351849] [INFO ] [MAIN ] CIEN: Successfully saved derivative data. [2025-09-26T22:19:05.355478] [INFO ] [MAIN ] Derivative Progress: 378/2074 symbols completed. CIEN took 1.2s. Estimated remaining: 11m 46s. Rate: 144.2 symbols/min [2025-09-26T22:19:05.356173] [INFO ] [MAIN ] CIM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:05.384849] [DEBUG] [LOCAL ] CII: Loaded 15638 existing records from primary storage. [2025-09-26T22:19:05.385119] [INFO ] [MAIN ] CII: Loaded 15638 primary data records. [2025-09-26T22:19:05.438776] [DEBUG] [LOCAL ] CIG: Loaded 44447 existing records from primary storage. [2025-09-26T22:19:05.474732] [INFO ] [MAIN ] CIG: Loaded 44447 primary data records. [2025-09-26T22:19:05.731842] [DEBUG] [LOCAL ] CIM: Loaded 37858 existing records from primary storage. [2025-09-26T22:19:05.732482] [INFO ] [MAIN ] CIM: Loaded 37858 primary data records. [2025-09-26T22:19:06.488511] [DEBUG] [MAIN ] CII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:06.491423] [INFO ] [MAIN ] CII: Generated 1820 derivative records from 15638 primary records. [2025-09-26T22:19:06.491769] [DEBUG] [LOCAL ] CII: Saving derivative data. [2025-09-26T22:19:06.507301] [DEBUG] [MAIN ] CIG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:06.518923] [INFO ] [MAIN ] CIG: Generated 1820 derivative records from 44447 primary records. [2025-09-26T22:19:06.522165] [DEBUG] [LOCAL ] CIG: Saving derivative data. [2025-09-26T22:19:06.548834] [DEBUG] [LOCAL ] CII: Derivative data saved (1820 records). [2025-09-26T22:19:06.550218] [INFO ] [MAIN ] CII: Successfully saved derivative data. [2025-09-26T22:19:06.552874] [INFO ] [MAIN ] Derivative Progress: 379/2074 symbols completed. CII took 1.2s. Estimated remaining: 11m 49s. Rate: 143.4 symbols/min [2025-09-26T22:19:06.554049] [DEBUG] [LOCAL ] CIG: Derivative data saved (1820 records). [2025-09-26T22:19:06.553270] [INFO ] [MAIN ] CIMN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:06.563095] [INFO ] [MAIN ] CIG: Successfully saved derivative data. [2025-09-26T22:19:06.571411] [INFO ] [MAIN ] Derivative Progress: 380/2074 symbols completed. CIG took 1.3s. Estimated remaining: 11m 47s. Rate: 143.8 symbols/min [2025-09-26T22:19:06.573074] [INFO ] [MAIN ] CION: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:06.572965] [DEBUG] [MAIN ] CIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:06.575196] [INFO ] [MAIN ] CIM: Generated 1820 derivative records from 37858 primary records. [2025-09-26T22:19:06.578013] [DEBUG] [LOCAL ] CIM: Saving derivative data. [2025-09-26T22:19:06.578234] [DEBUG] [LOCAL ] CIMN: Loaded 2697 existing records from primary storage. [2025-09-26T22:19:06.579286] [INFO ] [MAIN ] CIMN: Loaded 2697 primary data records. [2025-09-26T22:19:06.673713] [DEBUG] [LOCAL ] CIM: Derivative data saved (1820 records). [2025-09-26T22:19:06.711633] [INFO ] [MAIN ] CIM: Successfully saved derivative data. [2025-09-26T22:19:06.727461] [INFO ] [MAIN ] Derivative Progress: 381/2074 symbols completed. CIM took 1.4s. Estimated remaining: 11m 45s. Rate: 144.0 symbols/min [2025-09-26T22:19:06.747610] [INFO ] [MAIN ] CIVI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:06.819680] [DEBUG] [LOCAL ] CION: Loaded 29661 existing records from primary storage. [2025-09-26T22:19:06.826970] [INFO ] [MAIN ] CION: Loaded 29661 primary data records. [2025-09-26T22:19:07.313867] [DEBUG] [LOCAL ] CIVI: Loaded 53363 existing records from primary storage. [2025-09-26T22:19:07.315767] [INFO ] [MAIN ] CIVI: Loaded 53363 primary data records. [2025-09-26T22:19:07.524841] [DEBUG] [MAIN ] CIMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:07.555416] [INFO ] [MAIN ] CIMN: Generated 1820 derivative records from 2697 primary records. [2025-09-26T22:19:07.562782] [DEBUG] [LOCAL ] CIMN: Saving derivative data. [2025-09-26T22:19:07.707956] [DEBUG] [LOCAL ] CIMN: Derivative data saved (1820 records). [2025-09-26T22:19:07.710686] [INFO ] [MAIN ] CIMN: Successfully saved derivative data. [2025-09-26T22:19:07.717943] [INFO ] [MAIN ] Derivative Progress: 382/2074 symbols completed. CIMN took 1.2s. Estimated remaining: 11m 47s. Rate: 143.5 symbols/min [2025-09-26T22:19:07.718943] [INFO ] [MAIN ] CL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:07.736472] [DEBUG] [MAIN ] CION: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:07.737416] [INFO ] [MAIN ] CION: Generated 1820 derivative records from 29661 primary records. [2025-09-26T22:19:07.738228] [DEBUG] [LOCAL ] CION: Saving derivative data. [2025-09-26T22:19:07.760179] [DEBUG] [LOCAL ] CION: Derivative data saved (1820 records). [2025-09-26T22:19:07.760403] [INFO ] [MAIN ] CION: Successfully saved derivative data. [2025-09-26T22:19:07.763187] [INFO ] [MAIN ] Derivative Progress: 383/2074 symbols completed. CION took 1.2s. Estimated remaining: 11m 45s. Rate: 143.9 symbols/min [2025-09-26T22:19:07.763931] [INFO ] [MAIN ] CLB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:07.782848] [DEBUG] [MAIN ] CIVI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:07.783813] [INFO ] [MAIN ] CIVI: Generated 1820 derivative records from 53363 primary records. [2025-09-26T22:19:07.783954] [DEBUG] [LOCAL ] CIVI: Saving derivative data. [2025-09-26T22:19:07.802499] [DEBUG] [LOCAL ] CIVI: Derivative data saved (1820 records). [2025-09-26T22:19:07.802746] [INFO ] [MAIN ] CIVI: Successfully saved derivative data. [2025-09-26T22:19:07.805256] [INFO ] [MAIN ] Derivative Progress: 384/2074 symbols completed. CIVI took 1.1s. Estimated remaining: 11m 43s. Rate: 144.2 symbols/min [2025-09-26T22:19:07.805826] [INFO ] [MAIN ] CLCO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:07.843301] [DEBUG] [LOCAL ] CLCO: Loaded 13189 existing records from primary storage. [2025-09-26T22:19:07.844381] [INFO ] [MAIN ] CLCO: Loaded 13189 primary data records. [2025-09-26T22:19:07.957467] [DEBUG] [LOCAL ] CL: Loaded 54424 existing records from primary storage. [2025-09-26T22:19:07.978004] [INFO ] [MAIN ] CL: Loaded 54424 primary data records. [2025-09-26T22:19:08.304217] [DEBUG] [LOCAL ] CLB: Loaded 33475 existing records from primary storage. [2025-09-26T22:19:08.319802] [INFO ] [MAIN ] CLB: Loaded 33475 primary data records. [2025-09-26T22:19:08.966776] [DEBUG] [MAIN ] CLCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:08.969062] [INFO ] [MAIN ] CLCO: Generated 1820 derivative records from 13189 primary records. [2025-09-26T22:19:08.970744] [DEBUG] [LOCAL ] CLCO: Saving derivative data. [2025-09-26T22:19:08.997520] [DEBUG] [LOCAL ] CLCO: Derivative data saved (1820 records). [2025-09-26T22:19:09.003911] [DEBUG] [MAIN ] CL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:09.004038] [INFO ] [MAIN ] CLCO: Successfully saved derivative data. [2025-09-26T22:19:09.005054] [INFO ] [MAIN ] CL: Generated 1820 derivative records from 54424 primary records. [2025-09-26T22:19:09.007515] [DEBUG] [LOCAL ] CL: Saving derivative data. [2025-09-26T22:19:09.007418] [INFO ] [MAIN ] Derivative Progress: 385/2074 symbols completed. CLCO took 1.2s. Estimated remaining: 11m 46s. Rate: 143.5 symbols/min [2025-09-26T22:19:09.009695] [INFO ] [MAIN ] CLDT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:09.027179] [DEBUG] [LOCAL ] CL: Derivative data saved (1820 records). [2025-09-26T22:19:09.027393] [INFO ] [MAIN ] CL: Successfully saved derivative data. [2025-09-26T22:19:09.029903] [INFO ] [MAIN ] Derivative Progress: 386/2074 symbols completed. CL took 1.3s. Estimated remaining: 11m 44s. Rate: 143.9 symbols/min [2025-09-26T22:19:09.030363] [INFO ] [MAIN ] CLF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:09.048526] [DEBUG] [MAIN ] CLB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:09.049321] [INFO ] [MAIN ] CLB: Generated 1820 derivative records from 33475 primary records. [2025-09-26T22:19:09.049460] [DEBUG] [LOCAL ] CLB: Saving derivative data. [2025-09-26T22:19:09.084006] [DEBUG] [LOCAL ] CLDT: Loaded 26082 existing records from primary storage. [2025-09-26T22:19:09.084637] [INFO ] [MAIN ] CLDT: Loaded 26082 primary data records. [2025-09-26T22:19:09.121022] [DEBUG] [LOCAL ] CLB: Derivative data saved (1820 records). [2025-09-26T22:19:09.150880] [INFO ] [MAIN ] CLB: Successfully saved derivative data. [2025-09-26T22:19:09.189203] [INFO ] [MAIN ] Derivative Progress: 387/2074 symbols completed. CLB took 1.4s. Estimated remaining: 11m 43s. Rate: 144.1 symbols/min [2025-09-26T22:19:09.224306] [INFO ] [MAIN ] CLPR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:09.437946] [DEBUG] [LOCAL ] CLF: Loaded 54521 existing records from primary storage. [2025-09-26T22:19:09.452967] [INFO ] [MAIN ] CLF: Loaded 54521 primary data records. [2025-09-26T22:19:09.457793] [DEBUG] [LOCAL ] CLPR: Loaded 11615 existing records from primary storage. [2025-09-26T22:19:09.491602] [INFO ] [MAIN ] CLPR: Loaded 11615 primary data records. [2025-09-26T22:19:10.130747] [DEBUG] [MAIN ] CLDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:10.132570] [INFO ] [MAIN ] CLDT: Generated 1820 derivative records from 26082 primary records. [2025-09-26T22:19:10.133083] [DEBUG] [LOCAL ] CLDT: Saving derivative data. [2025-09-26T22:19:10.153294] [DEBUG] [LOCAL ] CLDT: Derivative data saved (1820 records). [2025-09-26T22:19:10.153685] [INFO ] [MAIN ] CLDT: Successfully saved derivative data. [2025-09-26T22:19:10.157311] [INFO ] [MAIN ] Derivative Progress: 388/2074 symbols completed. CLDT took 1.1s. Estimated remaining: 11m 45s. Rate: 143.6 symbols/min [2025-09-26T22:19:10.179179] [DEBUG] [MAIN ] CLF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:10.180228] [INFO ] [MAIN ] CLF: Generated 1820 derivative records from 54521 primary records. [2025-09-26T22:19:10.180317] [DEBUG] [LOCAL ] CLF: Saving derivative data. [2025-09-26T22:19:10.194276] [DEBUG] [MAIN ] CLPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:10.204330] [INFO ] [MAIN ] CLPR: Generated 1820 derivative records from 11615 primary records. [2025-09-26T22:19:10.209425] [DEBUG] [LOCAL ] CLPR: Saving derivative data. [2025-09-26T22:19:10.212425] [DEBUG] [LOCAL ] CLF: Derivative data saved (1820 records). [2025-09-26T22:19:10.223425] [INFO ] [MAIN ] CLF: Successfully saved derivative data. [2025-09-26T22:19:10.226373] [INFO ] [MAIN ] Derivative Progress: 389/2074 symbols completed. CLF took 1.2s. Estimated remaining: 11m 43s. Rate: 143.9 symbols/min [2025-09-26T22:19:10.230323] [DEBUG] [LOCAL ] CLPR: Derivative data saved (1820 records). [2025-09-26T22:19:10.230427] [INFO ] [MAIN ] CLPR: Successfully saved derivative data. [2025-09-26T22:19:10.233403] [INFO ] [MAIN ] Derivative Progress: 390/2074 symbols completed. CLPR took 1.0s. Estimated remaining: 11m 40s. Rate: 144.3 symbols/min [2025-09-26T22:19:10.234298] [INFO ] [MAIN ] CLVT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:10.234414] [INFO ] [MAIN ] CLS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:10.234543] [INFO ] [MAIN ] CLW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:10.267029] [DEBUG] [LOCAL ] CLW: Loaded 22226 existing records from primary storage. [2025-09-26T22:19:10.267300] [INFO ] [MAIN ] CLW: Loaded 22226 primary data records. [2025-09-26T22:19:10.638879] [DEBUG] [LOCAL ] CLVT: Loaded 52713 existing records from primary storage. [2025-09-26T22:19:10.639191] [INFO ] [MAIN ] CLVT: Loaded 52713 primary data records. [2025-09-26T22:19:10.640372] [DEBUG] [LOCAL ] CLS: Loaded 54412 existing records from primary storage. [2025-09-26T22:19:10.659332] [INFO ] [MAIN ] CLS: Loaded 54412 primary data records. [2025-09-26T22:19:11.392747] [DEBUG] [MAIN ] CLW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:11.394399] [INFO ] [MAIN ] CLW: Generated 1820 derivative records from 22226 primary records. [2025-09-26T22:19:11.394849] [DEBUG] [LOCAL ] CLW: Saving derivative data. [2025-09-26T22:19:11.417716] [DEBUG] [LOCAL ] CLW: Derivative data saved (1820 records). [2025-09-26T22:19:11.417879] [INFO ] [MAIN ] CLW: Successfully saved derivative data. [2025-09-26T22:19:11.420689] [INFO ] [MAIN ] Derivative Progress: 391/2074 symbols completed. CLW took 1.2s. Estimated remaining: 11m 43s. Rate: 143.6 symbols/min [2025-09-26T22:19:11.421439] [INFO ] [MAIN ] CLX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:11.444539] [DEBUG] [MAIN ] CLVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:11.447619] [INFO ] [MAIN ] CLVT: Generated 1820 derivative records from 52713 primary records. [2025-09-26T22:19:11.447978] [DEBUG] [LOCAL ] CLVT: Saving derivative data. [2025-09-26T22:19:11.471601] [DEBUG] [MAIN ] CLS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:11.476419] [INFO ] [MAIN ] CLS: Generated 1820 derivative records from 54412 primary records. [2025-09-26T22:19:11.477167] [DEBUG] [LOCAL ] CLS: Saving derivative data. [2025-09-26T22:19:11.495042] [DEBUG] [LOCAL ] CLVT: Derivative data saved (1820 records). [2025-09-26T22:19:11.495785] [INFO ] [MAIN ] CLVT: Successfully saved derivative data. [2025-09-26T22:19:11.499243] [INFO ] [MAIN ] Derivative Progress: 392/2074 symbols completed. CLVT took 1.3s. Estimated remaining: 11m 41s. Rate: 143.9 symbols/min [2025-09-26T22:19:11.500039] [INFO ] [MAIN ] CM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:11.504526] [DEBUG] [LOCAL ] CLS: Derivative data saved (1820 records). [2025-09-26T22:19:11.504805] [INFO ] [MAIN ] CLS: Successfully saved derivative data. [2025-09-26T22:19:11.507032] [INFO ] [MAIN ] Derivative Progress: 393/2074 symbols completed. CLS took 1.3s. Estimated remaining: 11m 39s. Rate: 144.2 symbols/min [2025-09-26T22:19:11.527023] [INFO ] [MAIN ] CMBT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:11.569473] [DEBUG] [LOCAL ] CMBT: Loaded 22911 existing records from primary storage. [2025-09-26T22:19:11.568979] [DEBUG] [LOCAL ] CLX: Loaded 52189 existing records from primary storage. [2025-09-26T22:19:11.569663] [INFO ] [MAIN ] CLX: Loaded 52189 primary data records. [2025-09-26T22:19:11.569819] [INFO ] [MAIN ] CMBT: Loaded 22911 primary data records. [2025-09-26T22:19:11.844732] [DEBUG] [LOCAL ] CM: Loaded 49317 existing records from primary storage. [2025-09-26T22:19:11.877182] [INFO ] [MAIN ] CM: Loaded 49317 primary data records. [2025-09-26T22:19:12.664355] [DEBUG] [MAIN ] CMBT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:12.666140] [INFO ] [MAIN ] CMBT: Generated 1820 derivative records from 22911 primary records. [2025-09-26T22:19:12.666374] [DEBUG] [LOCAL ] CMBT: Saving derivative data. [2025-09-26T22:19:12.689585] [DEBUG] [MAIN ] CLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:12.694858] [INFO ] [MAIN ] CLX: Generated 1820 derivative records from 52189 primary records. [2025-09-26T22:19:12.695770] [DEBUG] [LOCAL ] CLX: Saving derivative data. [2025-09-26T22:19:12.714303] [DEBUG] [LOCAL ] CMBT: Derivative data saved (1820 records). [2025-09-26T22:19:12.715944] [INFO ] [MAIN ] CMBT: Successfully saved derivative data. [2025-09-26T22:19:12.719445] [INFO ] [MAIN ] Derivative Progress: 394/2074 symbols completed. CMBT took 1.2s. Estimated remaining: 11m 42s. Rate: 143.5 symbols/min [2025-09-26T22:19:12.721832] [INFO ] [MAIN ] CMC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:12.722590] [DEBUG] [LOCAL ] CLX: Derivative data saved (1820 records). [2025-09-26T22:19:12.724395] [INFO ] [MAIN ] CLX: Successfully saved derivative data. [2025-09-26T22:19:12.730301] [INFO ] [MAIN ] Derivative Progress: 395/2074 symbols completed. CLX took 1.3s. Estimated remaining: 11m 40s. Rate: 143.9 symbols/min [2025-09-26T22:19:12.732861] [INFO ] [MAIN ] CMCM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:12.747985] [DEBUG] [MAIN ] CM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:12.748887] [INFO ] [MAIN ] CM: Generated 1820 derivative records from 49317 primary records. [2025-09-26T22:19:12.750141] [DEBUG] [LOCAL ] CM: Saving derivative data. [2025-09-26T22:19:12.754251] [DEBUG] [LOCAL ] CMCM: Loaded 4834 existing records from primary storage. [2025-09-26T22:19:12.763419] [INFO ] [MAIN ] CMCM: Loaded 4834 primary data records. [2025-09-26T22:19:12.897003] [DEBUG] [LOCAL ] CM: Derivative data saved (1820 records). [2025-09-26T22:19:12.902777] [INFO ] [MAIN ] CM: Successfully saved derivative data. [2025-09-26T22:19:12.911880] [INFO ] [MAIN ] Derivative Progress: 396/2074 symbols completed. CM took 1.4s. Estimated remaining: 11m 39s. Rate: 144.1 symbols/min [2025-09-26T22:19:12.940022] [INFO ] [MAIN ] CMG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:12.987238] [DEBUG] [LOCAL ] CMC: Loaded 46311 existing records from primary storage. [2025-09-26T22:19:13.011277] [INFO ] [MAIN ] CMC: Loaded 46311 primary data records. [2025-09-26T22:19:13.549140] [DEBUG] [LOCAL ] CMG: Loaded 54501 existing records from primary storage. [2025-09-26T22:19:13.550639] [INFO ] [MAIN ] CMG: Loaded 54501 primary data records. [2025-09-26T22:19:13.720835] [DEBUG] [MAIN ] CMCM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:13.745788] [INFO ] [MAIN ] CMCM: Generated 1820 derivative records from 4834 primary records. [2025-09-26T22:19:13.784218] [DEBUG] [LOCAL ] CMCM: Saving derivative data. [2025-09-26T22:19:13.957802] [DEBUG] [LOCAL ] CMCM: Derivative data saved (1820 records). [2025-09-26T22:19:13.958481] [DEBUG] [MAIN ] CMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:13.960225] [INFO ] [MAIN ] CMC: Generated 1820 derivative records from 46311 primary records. [2025-09-26T22:19:13.961200] [DEBUG] [LOCAL ] CMC: Saving derivative data. [2025-09-26T22:19:13.961107] [INFO ] [MAIN ] CMCM: Successfully saved derivative data. [2025-09-26T22:19:13.963776] [INFO ] [MAIN ] Derivative Progress: 397/2074 symbols completed. CMCM took 1.2s. Estimated remaining: 11m 41s. Rate: 143.6 symbols/min [2025-09-26T22:19:13.965494] [INFO ] [MAIN ] CMI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:13.986691] [DEBUG] [LOCAL ] CMC: Derivative data saved (1820 records). [2025-09-26T22:19:13.987088] [INFO ] [MAIN ] CMC: Successfully saved derivative data. [2025-09-26T22:19:13.989816] [INFO ] [MAIN ] Derivative Progress: 398/2074 symbols completed. CMC took 1.3s. Estimated remaining: 11m 39s. Rate: 143.9 symbols/min [2025-09-26T22:19:13.990144] [INFO ] [MAIN ] CMPO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:14.008893] [DEBUG] [MAIN ] CMG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:14.009765] [INFO ] [MAIN ] CMG: Generated 1820 derivative records from 54501 primary records. [2025-09-26T22:19:14.009835] [DEBUG] [LOCAL ] CMG: Saving derivative data. [2025-09-26T22:19:14.044286] [DEBUG] [LOCAL ] CMG: Derivative data saved (1820 records). [2025-09-26T22:19:14.044449] [INFO ] [MAIN ] CMG: Successfully saved derivative data. [2025-09-26T22:19:14.047585] [INFO ] [MAIN ] Derivative Progress: 399/2074 symbols completed. CMG took 1.1s. Estimated remaining: 11m 37s. Rate: 144.2 symbols/min [2025-09-26T22:19:14.048144] [INFO ] [MAIN ] CMS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:14.073401] [DEBUG] [LOCAL ] CMI: Loaded 42484 existing records from primary storage. [2025-09-26T22:19:14.073605] [INFO ] [MAIN ] CMI: Loaded 42484 primary data records. [2025-09-26T22:19:14.199148] [DEBUG] [LOCAL ] CMPO: Loaded 40071 existing records from primary storage. [2025-09-26T22:19:14.211416] [INFO ] [MAIN ] CMPO: Loaded 40071 primary data records. [2025-09-26T22:19:14.608340] [DEBUG] [LOCAL ] CMS: Loaded 53371 existing records from primary storage. [2025-09-26T22:19:14.635225] [INFO ] [MAIN ] CMS: Loaded 53371 primary data records. [2025-09-26T22:19:15.260602] [DEBUG] [MAIN ] CMI: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:19:15.263002] [INFO ] [MAIN ] CMI: Generated 1819 derivative records from 42484 primary records. [2025-09-26T22:19:15.263442] [DEBUG] [LOCAL ] CMI: Saving derivative data. [2025-09-26T22:19:15.297874] [DEBUG] [LOCAL ] CMI: Derivative data saved (1819 records). [2025-09-26T22:19:15.298446] [DEBUG] [MAIN ] CMPO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:15.299377] [INFO ] [MAIN ] CMPO: Generated 1820 derivative records from 40071 primary records. [2025-09-26T22:19:15.299587] [DEBUG] [LOCAL ] CMPO: Saving derivative data. [2025-09-26T22:19:15.300117] [INFO ] [MAIN ] CMI: Successfully saved derivative data. [2025-09-26T22:19:15.303450] [INFO ] [MAIN ] Derivative Progress: 400/2074 symbols completed. CMI took 1.3s. Estimated remaining: 11m 40s. Rate: 143.5 symbols/min [2025-09-26T22:19:15.318937] [INFO ] [MAIN ] CMSA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:15.325089] [DEBUG] [LOCAL ] CMPO: Derivative data saved (1820 records). [2025-09-26T22:19:15.333195] [INFO ] [MAIN ] CMPO: Successfully saved derivative data. [2025-09-26T22:19:15.335998] [INFO ] [MAIN ] Derivative Progress: 401/2074 symbols completed. CMPO took 1.3s. Estimated remaining: 11m 38s. Rate: 143.8 symbols/min [2025-09-26T22:19:15.343276] [DEBUG] [MAIN ] CMS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:15.344258] [INFO ] [MAIN ] CMS: Generated 1820 derivative records from 53371 primary records. [2025-09-26T22:19:15.347609] [DEBUG] [LOCAL ] CMS: Saving derivative data. [2025-09-26T22:19:15.347527] [DEBUG] [LOCAL ] CMSA: Loaded 3421 existing records from primary storage. [2025-09-26T22:19:15.348108] [INFO ] [MAIN ] CMSC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:15.348569] [INFO ] [MAIN ] CMSA: Loaded 3421 primary data records. [2025-09-26T22:19:15.470981] [DEBUG] [LOCAL ] CMSC: Loaded 5131 existing records from primary storage. [2025-09-26T22:19:15.486005] [INFO ] [MAIN ] CMSC: Loaded 5131 primary data records. [2025-09-26T22:19:15.503491] [DEBUG] [LOCAL ] CMS: Derivative data saved (1820 records). [2025-09-26T22:19:15.513790] [INFO ] [MAIN ] CMS: Successfully saved derivative data. [2025-09-26T22:19:15.532276] [INFO ] [MAIN ] Derivative Progress: 402/2074 symbols completed. CMS took 1.5s. Estimated remaining: 11m 37s. Rate: 144.0 symbols/min [2025-09-26T22:19:15.578188] [INFO ] [MAIN ] CMSD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:15.904814] [DEBUG] [LOCAL ] CMSD: Loaded 8184 existing records from primary storage. [2025-09-26T22:19:16.019313] [INFO ] [MAIN ] CMSD: Loaded 8184 primary data records. [2025-09-26T22:19:16.397314] [DEBUG] [MAIN ] CMSA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:16.399477] [INFO ] [MAIN ] CMSA: Generated 1820 derivative records from 3421 primary records. [2025-09-26T22:19:16.401051] [DEBUG] [LOCAL ] CMSA: Saving derivative data. [2025-09-26T22:19:16.424606] [DEBUG] [LOCAL ] CMSA: Derivative data saved (1820 records). [2025-09-26T22:19:16.424747] [INFO ] [MAIN ] CMSA: Successfully saved derivative data. [2025-09-26T22:19:16.440804] [INFO ] [MAIN ] Derivative Progress: 403/2074 symbols completed. CMSA took 1.1s. Estimated remaining: 11m 38s. Rate: 143.6 symbols/min [2025-09-26T22:19:16.441718] [DEBUG] [MAIN ] CMSC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:16.442996] [INFO ] [MAIN ] CMSC: Generated 1820 derivative records from 5131 primary records. [2025-09-26T22:19:16.443290] [DEBUG] [LOCAL ] CMSC: Saving derivative data. [2025-09-26T22:19:16.465261] [DEBUG] [LOCAL ] CMSC: Derivative data saved (1820 records). [2025-09-26T22:19:16.465733] [INFO ] [MAIN ] CMSC: Successfully saved derivative data. [2025-09-26T22:19:16.469491] [INFO ] [MAIN ] Derivative Progress: 404/2074 symbols completed. CMSC took 1.1s. Estimated remaining: 11m 36s. Rate: 143.9 symbols/min [2025-09-26T22:19:16.483425] [DEBUG] [MAIN ] CMSD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:16.484274] [INFO ] [MAIN ] CMSD: Generated 1820 derivative records from 8184 primary records. [2025-09-26T22:19:16.484355] [DEBUG] [LOCAL ] CMSD: Saving derivative data. [2025-09-26T22:19:16.503281] [DEBUG] [LOCAL ] CMSD: Derivative data saved (1820 records). [2025-09-26T22:19:16.503444] [INFO ] [MAIN ] CMSD: Successfully saved derivative data. [2025-09-26T22:19:16.506908] [INFO ] [MAIN ] Derivative Progress: 405/2074 symbols completed. CMSD took 0.9s. Estimated remaining: 11m 34s. Rate: 144.2 symbols/min [2025-09-26T22:19:16.508219] [INFO ] [MAIN ] CNA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:16.507762] [INFO ] [MAIN ] CMTG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:16.508136] [INFO ] [MAIN ] CMU: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:16.520722] [DEBUG] [LOCAL ] CMU: Loaded 7303 existing records from primary storage. [2025-09-26T22:19:16.520978] [INFO ] [MAIN ] CMU: Loaded 7303 primary data records. [2025-09-26T22:19:16.660638] [DEBUG] [LOCAL ] CNA: Loaded 33235 existing records from primary storage. [2025-09-26T22:19:16.677229] [INFO ] [MAIN ] CNA: Loaded 33235 primary data records. [2025-09-26T22:19:16.777368] [DEBUG] [LOCAL ] CMTG: Loaded 37931 existing records from primary storage. [2025-09-26T22:19:16.823236] [INFO ] [MAIN ] CMTG: Loaded 37931 primary data records. [2025-09-26T22:19:17.640676] [DEBUG] [MAIN ] CMU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:17.643038] [INFO ] [MAIN ] CMU: Generated 1820 derivative records from 7303 primary records. [2025-09-26T22:19:17.644035] [DEBUG] [LOCAL ] CMU: Saving derivative data. [2025-09-26T22:19:17.663670] [DEBUG] [LOCAL ] CMU: Derivative data saved (1820 records). [2025-09-26T22:19:17.664145] [INFO ] [MAIN ] CMU: Successfully saved derivative data. [2025-09-26T22:19:17.667202] [INFO ] [MAIN ] Derivative Progress: 406/2074 symbols completed. CMU took 1.2s. Estimated remaining: 11m 37s. Rate: 143.6 symbols/min [2025-09-26T22:19:17.668054] [INFO ] [MAIN ] CNF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:17.700877] [DEBUG] [LOCAL ] CNF: Loaded 11166 existing records from primary storage. [2025-09-26T22:19:17.702154] [INFO ] [MAIN ] CNF: Loaded 11166 primary data records. [2025-09-26T22:19:17.708099] [DEBUG] [MAIN ] CNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:17.727075] [INFO ] [MAIN ] CNA: Generated 1820 derivative records from 33235 primary records. [2025-09-26T22:19:17.737711] [DEBUG] [LOCAL ] CNA: Saving derivative data. [2025-09-26T22:19:17.766519] [DEBUG] [MAIN ] CMTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:17.781583] [INFO ] [MAIN ] CMTG: Generated 1820 derivative records from 37931 primary records. [2025-09-26T22:19:17.827618] [DEBUG] [LOCAL ] CMTG: Saving derivative data. [2025-09-26T22:19:17.917623] [DEBUG] [LOCAL ] CNA: Derivative data saved (1820 records). [2025-09-26T22:19:17.892842] [DEBUG] [LOCAL ] CMTG: Derivative data saved (1820 records). [2025-09-26T22:19:17.973747] [INFO ] [MAIN ] CNA: Successfully saved derivative data. [2025-09-26T22:19:17.974054] [INFO ] [MAIN ] CMTG: Successfully saved derivative data. [2025-09-26T22:19:18.091407] [INFO ] [MAIN ] Derivative Progress: 407/2074 symbols completed. CNA took 1.6s. Estimated remaining: 11m 37s. Rate: 143.6 symbols/min [2025-09-26T22:19:18.104724] [INFO ] [MAIN ] CNH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:18.104836] [INFO ] [MAIN ] Derivative Progress: 408/2074 symbols completed. CMTG took 1.6s. Estimated remaining: 11m 34s. Rate: 143.9 symbols/min [2025-09-26T22:19:18.107386] [INFO ] [MAIN ] CNI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:18.135828] [DEBUG] [MAIN ] CNF: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:19:18.136844] [INFO ] [MAIN ] CNF: Generated 1819 derivative records from 11166 primary records. [2025-09-26T22:19:18.136979] [DEBUG] [LOCAL ] CNF: Saving derivative data. [2025-09-26T22:19:18.152704] [DEBUG] [LOCAL ] CNF: Derivative data saved (1819 records). [2025-09-26T22:19:18.167632] [INFO ] [MAIN ] CNF: Successfully saved derivative data. [2025-09-26T22:19:18.170167] [INFO ] [MAIN ] Derivative Progress: 409/2074 symbols completed. CNF took 0.5s. Estimated remaining: 11m 33s. Rate: 144.2 symbols/min [2025-09-26T22:19:18.170710] [INFO ] [MAIN ] CNM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:18.224130] [DEBUG] [LOCAL ] CNH: Loaded 54337 existing records from primary storage. [2025-09-26T22:19:18.226063] [INFO ] [MAIN ] CNH: Loaded 54337 primary data records. [2025-09-26T22:19:18.227311] [DEBUG] [LOCAL ] CNI: Loaded 52419 existing records from primary storage. [2025-09-26T22:19:18.249405] [INFO ] [MAIN ] CNI: Loaded 52419 primary data records. [2025-09-26T22:19:18.751618] [DEBUG] [LOCAL ] CNM: Loaded 51747 existing records from primary storage. [2025-09-26T22:19:18.794633] [INFO ] [MAIN ] CNM: Loaded 51747 primary data records. [2025-09-26T22:19:19.308986] [DEBUG] [MAIN ] CNH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:19.323787] [INFO ] [MAIN ] CNH: Generated 1820 derivative records from 54337 primary records. [2025-09-26T22:19:19.325317] [DEBUG] [LOCAL ] CNH: Saving derivative data. [2025-09-26T22:19:19.325117] [DEBUG] [MAIN ] CNI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:19.328025] [INFO ] [MAIN ] CNI: Generated 1820 derivative records from 52419 primary records. [2025-09-26T22:19:19.329992] [DEBUG] [LOCAL ] CNI: Saving derivative data. [2025-09-26T22:19:19.365696] [DEBUG] [LOCAL ] CNH: Derivative data saved (1820 records). [2025-09-26T22:19:19.367042] [INFO ] [MAIN ] CNH: Successfully saved derivative data. [2025-09-26T22:19:19.368523] [DEBUG] [LOCAL ] CNI: Derivative data saved (1820 records). [2025-09-26T22:19:19.371540] [INFO ] [MAIN ] CNI: Successfully saved derivative data. [2025-09-26T22:19:19.371220] [INFO ] [MAIN ] Derivative Progress: 410/2074 symbols completed. CNH took 1.3s. Estimated remaining: 11m 35s. Rate: 143.6 symbols/min [2025-09-26T22:19:19.378929] [INFO ] [MAIN ] Derivative Progress: 411/2074 symbols completed. CNI took 1.3s. Estimated remaining: 11m 33s. Rate: 143.9 symbols/min [2025-09-26T22:19:19.379217] [INFO ] [MAIN ] CNMD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:19.379559] [INFO ] [MAIN ] CNNE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:19.397672] [DEBUG] [MAIN ] CNM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:19.398710] [INFO ] [MAIN ] CNM: Generated 1820 derivative records from 51747 primary records. [2025-09-26T22:19:19.399049] [DEBUG] [LOCAL ] CNM: Saving derivative data. [2025-09-26T22:19:19.418255] [DEBUG] [LOCAL ] CNM: Derivative data saved (1820 records). [2025-09-26T22:19:19.418492] [INFO ] [MAIN ] CNM: Successfully saved derivative data. [2025-09-26T22:19:19.423043] [INFO ] [MAIN ] Derivative Progress: 412/2074 symbols completed. CNM took 1.3s. Estimated remaining: 11m 31s. Rate: 144.2 symbols/min [2025-09-26T22:19:19.423514] [INFO ] [MAIN ] CNO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:19.457573] [DEBUG] [LOCAL ] CNMD: Loaded 32884 existing records from primary storage. [2025-09-26T22:19:19.457822] [INFO ] [MAIN ] CNMD: Loaded 32884 primary data records. [2025-09-26T22:19:19.585861] [DEBUG] [LOCAL ] CNNE: Loaded 37257 existing records from primary storage. [2025-09-26T22:19:19.598111] [INFO ] [MAIN ] CNNE: Loaded 37257 primary data records. [2025-09-26T22:19:19.828065] [DEBUG] [LOCAL ] CNO: Loaded 41901 existing records from primary storage. [2025-09-26T22:19:19.836275] [INFO ] [MAIN ] CNO: Loaded 41901 primary data records. [2025-09-26T22:19:20.790910] [DEBUG] [MAIN ] CNMD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:20.793009] [INFO ] [MAIN ] CNMD: Generated 1820 derivative records from 32884 primary records. [2025-09-26T22:19:20.793779] [DEBUG] [LOCAL ] CNMD: Saving derivative data. [2025-09-26T22:19:20.831595] [DEBUG] [LOCAL ] CNMD: Derivative data saved (1820 records). [2025-09-26T22:19:20.832207] [INFO ] [MAIN ] CNMD: Successfully saved derivative data. [2025-09-26T22:19:20.851524] [INFO ] [MAIN ] Derivative Progress: 413/2074 symbols completed. CNMD took 1.5s. Estimated remaining: 11m 35s. Rate: 143.4 symbols/min [2025-09-26T22:19:20.852521] [INFO ] [MAIN ] CNP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:20.848249] [DEBUG] [MAIN ] CNNE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:20.854696] [INFO ] [MAIN ] CNNE: Generated 1820 derivative records from 37257 primary records. [2025-09-26T22:19:20.854952] [DEBUG] [LOCAL ] CNNE: Saving derivative data. [2025-09-26T22:19:20.885695] [DEBUG] [LOCAL ] CNNE: Derivative data saved (1820 records). [2025-09-26T22:19:20.886576] [INFO ] [MAIN ] CNNE: Successfully saved derivative data. [2025-09-26T22:19:20.890173] [INFO ] [MAIN ] Derivative Progress: 414/2074 symbols completed. CNNE took 1.5s. Estimated remaining: 11m 33s. Rate: 143.7 symbols/min [2025-09-26T22:19:20.890867] [INFO ] [MAIN ] CNQ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:20.911367] [DEBUG] [MAIN ] CNO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:20.912451] [INFO ] [MAIN ] CNO: Generated 1820 derivative records from 41901 primary records. [2025-09-26T22:19:20.912607] [DEBUG] [LOCAL ] CNO: Saving derivative data. [2025-09-26T22:19:20.933508] [DEBUG] [LOCAL ] CNO: Derivative data saved (1820 records). [2025-09-26T22:19:20.950381] [INFO ] [MAIN ] CNO: Successfully saved derivative data. [2025-09-26T22:19:20.954023] [INFO ] [MAIN ] Derivative Progress: 415/2074 symbols completed. CNO took 1.5s. Estimated remaining: 11m 31s. Rate: 144.0 symbols/min [2025-09-26T22:19:20.954690] [INFO ] [MAIN ] CNS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:21.007522] [DEBUG] [LOCAL ] CNP: Loaded 54249 existing records from primary storage. [2025-09-26T22:19:21.007887] [INFO ] [MAIN ] CNP: Loaded 54249 primary data records. [2025-09-26T22:19:21.069075] [DEBUG] [LOCAL ] CNS: Loaded 21245 existing records from primary storage. [2025-09-26T22:19:21.088318] [INFO ] [MAIN ] CNS: Loaded 21245 primary data records. [2025-09-26T22:19:21.188462] [DEBUG] [LOCAL ] CNQ: Loaded 54361 existing records from primary storage. [2025-09-26T22:19:21.259073] [INFO ] [MAIN ] CNQ: Loaded 54361 primary data records. [2025-09-26T22:19:22.167742] [DEBUG] [MAIN ] CNS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:22.173548] [DEBUG] [MAIN ] CNP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:22.174703] [INFO ] [MAIN ] CNS: Generated 1820 derivative records from 21245 primary records. [2025-09-26T22:19:22.175857] [INFO ] [MAIN ] CNP: Generated 1820 derivative records from 54249 primary records. [2025-09-26T22:19:22.174949] [DEBUG] [LOCAL ] CNS: Saving derivative data. [2025-09-26T22:19:22.176473] [DEBUG] [LOCAL ] CNP: Saving derivative data. [2025-09-26T22:19:22.203829] [DEBUG] [LOCAL ] CNS: Derivative data saved (1820 records). [2025-09-26T22:19:22.205362] [INFO ] [MAIN ] CNS: Successfully saved derivative data. [2025-09-26T22:19:22.208208] [INFO ] [MAIN ] Derivative Progress: 416/2074 symbols completed. CNS took 1.3s. Estimated remaining: 11m 34s. Rate: 143.3 symbols/min [2025-09-26T22:19:22.226104] [INFO ] [MAIN ] CNX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:22.226566] [DEBUG] [MAIN ] CNQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:22.230166] [INFO ] [MAIN ] CNQ: Generated 1820 derivative records from 54361 primary records. [2025-09-26T22:19:22.230381] [DEBUG] [LOCAL ] CNQ: Saving derivative data. [2025-09-26T22:19:22.231596] [DEBUG] [LOCAL ] CNP: Derivative data saved (1820 records). [2025-09-26T22:19:22.232634] [INFO ] [MAIN ] CNP: Successfully saved derivative data. [2025-09-26T22:19:22.234910] [INFO ] [MAIN ] Derivative Progress: 417/2074 symbols completed. CNP took 1.4s. Estimated remaining: 11m 32s. Rate: 143.6 symbols/min [2025-09-26T22:19:22.246925] [INFO ] [MAIN ] CODI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:22.252101] [DEBUG] [LOCAL ] CNQ: Derivative data saved (1820 records). [2025-09-26T22:19:22.252362] [INFO ] [MAIN ] CNQ: Successfully saved derivative data. [2025-09-26T22:19:22.256044] [INFO ] [MAIN ] Derivative Progress: 418/2074 symbols completed. CNQ took 1.4s. Estimated remaining: 11m 30s. Rate: 144.0 symbols/min [2025-09-26T22:19:22.320353] [DEBUG] [LOCAL ] CNX: Loaded 52150 existing records from primary storage. [2025-09-26T22:19:22.321830] [INFO ] [MAIN ] CNX: Loaded 52150 primary data records. [2025-09-26T22:19:22.322591] [DEBUG] [LOCAL ] CODI: Loaded 40312 existing records from primary storage. [2025-09-26T22:19:22.355563] [INFO ] [MAIN ] CODI: Loaded 40312 primary data records. [2025-09-26T22:19:23.029513] [DEBUG] [MAIN ] CNX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:23.032426] [INFO ] [MAIN ] CNX: Generated 1820 derivative records from 52150 primary records. [2025-09-26T22:19:23.032722] [DEBUG] [LOCAL ] CNX: Saving derivative data. [2025-09-26T22:19:23.054495] [DEBUG] [MAIN ] CODI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:23.060498] [INFO ] [MAIN ] CODI: Generated 1820 derivative records from 40312 primary records. [2025-09-26T22:19:23.061682] [DEBUG] [LOCAL ] CODI: Saving derivative data. [2025-09-26T22:19:23.064687] [DEBUG] [LOCAL ] CNX: Derivative data saved (1820 records). [2025-09-26T22:19:23.065115] [INFO ] [MAIN ] CNX: Successfully saved derivative data. [2025-09-26T22:19:23.067321] [INFO ] [MAIN ] Derivative Progress: 419/2074 symbols completed. CNX took 0.8s. Estimated remaining: 11m 31s. Rate: 143.6 symbols/min [2025-09-26T22:19:23.083119] [DEBUG] [LOCAL ] CODI: Derivative data saved (1820 records). [2025-09-26T22:19:23.083243] [INFO ] [MAIN ] CODI: Successfully saved derivative data. [2025-09-26T22:19:23.085852] [INFO ] [MAIN ] Derivative Progress: 420/2074 symbols completed. CODI took 0.8s. Estimated remaining: 11m 29s. Rate: 144.0 symbols/min [2025-09-26T22:19:23.086763] [INFO ] [MAIN ] COLD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:23.087033] [INFO ] [MAIN ] COHR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:23.087220] [INFO ] [MAIN ] COF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:23.192907] [DEBUG] [LOCAL ] COLD: Loaded 52785 existing records from primary storage. [2025-09-26T22:19:23.195301] [INFO ] [MAIN ] COLD: Loaded 52785 primary data records. [2025-09-26T22:19:23.196477] [DEBUG] [LOCAL ] COHR: Loaded 54144 existing records from primary storage. [2025-09-26T22:19:23.201864] [INFO ] [MAIN ] COHR: Loaded 54144 primary data records. [2025-09-26T22:19:23.300704] [DEBUG] [LOCAL ] COF: Loaded 54389 existing records from primary storage. [2025-09-26T22:19:23.309966] [INFO ] [MAIN ] COF: Loaded 54389 primary data records. [2025-09-26T22:19:24.316775] [DEBUG] [MAIN ] COLD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:24.319293] [INFO ] [MAIN ] COLD: Generated 1820 derivative records from 52785 primary records. [2025-09-26T22:19:24.320690] [DEBUG] [LOCAL ] COLD: Saving derivative data. [2025-09-26T22:19:24.352988] [DEBUG] [MAIN ] COHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:24.368277] [INFO ] [MAIN ] COHR: Generated 1820 derivative records from 54144 primary records. [2025-09-26T22:19:24.368834] [DEBUG] [LOCAL ] COHR: Saving derivative data. [2025-09-26T22:19:24.371542] [DEBUG] [MAIN ] COF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:24.372729] [INFO ] [MAIN ] COF: Generated 1820 derivative records from 54389 primary records. [2025-09-26T22:19:24.374194] [DEBUG] [LOCAL ] COF: Saving derivative data. [2025-09-26T22:19:24.393912] [DEBUG] [LOCAL ] COLD: Derivative data saved (1820 records). [2025-09-26T22:19:24.398372] [DEBUG] [LOCAL ] COHR: Derivative data saved (1820 records). [2025-09-26T22:19:24.398941] [INFO ] [MAIN ] COHR: Successfully saved derivative data. [2025-09-26T22:19:24.408571] [INFO ] [MAIN ] Derivative Progress: 421/2074 symbols completed. COHR took 1.3s. Estimated remaining: 11m 33s. Rate: 143.2 symbols/min [2025-09-26T22:19:24.412938] [INFO ] [MAIN ] COLD: Successfully saved derivative data. [2025-09-26T22:19:24.416403] [INFO ] [MAIN ] COMP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:24.415745] [INFO ] [MAIN ] Derivative Progress: 422/2074 symbols completed. COLD took 1.3s. Estimated remaining: 11m 30s. Rate: 143.5 symbols/min [2025-09-26T22:19:24.416875] [INFO ] [MAIN ] CON: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:24.422879] [DEBUG] [LOCAL ] COF: Derivative data saved (1820 records). [2025-09-26T22:19:24.423433] [INFO ] [MAIN ] COF: Successfully saved derivative data. [2025-09-26T22:19:24.426906] [INFO ] [MAIN ] Derivative Progress: 423/2074 symbols completed. COF took 1.3s. Estimated remaining: 11m 28s. Rate: 143.9 symbols/min [2025-09-26T22:19:24.428271] [INFO ] [MAIN ] COOK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:24.476599] [DEBUG] [LOCAL ] COOK: Loaded 24850 existing records from primary storage. [2025-09-26T22:19:24.484824] [INFO ] [MAIN ] COOK: Loaded 24850 primary data records. [2025-09-26T22:19:24.641066] [DEBUG] [LOCAL ] CON: Loaded 39289 existing records from primary storage. [2025-09-26T22:19:24.647536] [DEBUG] [LOCAL ] COMP: Loaded 54166 existing records from primary storage. [2025-09-26T22:19:24.652824] [INFO ] [MAIN ] CON: Loaded 39289 primary data records. [2025-09-26T22:19:24.652977] [INFO ] [MAIN ] COMP: Loaded 54166 primary data records. [2025-09-26T22:19:25.576260] [DEBUG] [MAIN ] COOK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:25.578176] [INFO ] [MAIN ] COOK: Generated 1820 derivative records from 24850 primary records. [2025-09-26T22:19:25.578548] [DEBUG] [LOCAL ] COOK: Saving derivative data. [2025-09-26T22:19:25.618957] [DEBUG] [LOCAL ] COOK: Derivative data saved (1820 records). [2025-09-26T22:19:25.620790] [DEBUG] [MAIN ] COMP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:25.620200] [INFO ] [MAIN ] COOK: Successfully saved derivative data. [2025-09-26T22:19:25.621739] [INFO ] [MAIN ] COMP: Generated 1820 derivative records from 54166 primary records. [2025-09-26T22:19:25.624639] [DEBUG] [LOCAL ] COMP: Saving derivative data. [2025-09-26T22:19:25.624382] [INFO ] [MAIN ] Derivative Progress: 424/2074 symbols completed. COOK took 1.2s. Estimated remaining: 11m 31s. Rate: 143.2 symbols/min [2025-09-26T22:19:25.626377] [INFO ] [MAIN ] COR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:25.652603] [DEBUG] [MAIN ] CON: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:25.653955] [INFO ] [MAIN ] CON: Generated 1820 derivative records from 39289 primary records. [2025-09-26T22:19:25.654930] [DEBUG] [LOCAL ] CON: Saving derivative data. [2025-09-26T22:19:25.671986] [DEBUG] [LOCAL ] COMP: Derivative data saved (1820 records). [2025-09-26T22:19:25.673159] [INFO ] [MAIN ] COMP: Successfully saved derivative data. [2025-09-26T22:19:25.676001] [INFO ] [MAIN ] Derivative Progress: 425/2074 symbols completed. COMP took 1.3s. Estimated remaining: 11m 29s. Rate: 143.5 symbols/min [2025-09-26T22:19:25.677031] [INFO ] [MAIN ] COTY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:25.682826] [DEBUG] [LOCAL ] CON: Derivative data saved (1820 records). [2025-09-26T22:19:25.682999] [INFO ] [MAIN ] CON: Successfully saved derivative data. [2025-09-26T22:19:25.686081] [INFO ] [MAIN ] Derivative Progress: 426/2074 symbols completed. CON took 1.3s. Estimated remaining: 11m 27s. Rate: 143.9 symbols/min [2025-09-26T22:19:25.686598] [INFO ] [MAIN ] COUR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:25.759891] [DEBUG] [LOCAL ] COR: Loaded 47937 existing records from primary storage. [2025-09-26T22:19:25.760260] [INFO ] [MAIN ] COR: Loaded 47937 primary data records. [2025-09-26T22:19:25.905366] [DEBUG] [LOCAL ] COTY: Loaded 54014 existing records from primary storage. [2025-09-26T22:19:25.905683] [INFO ] [MAIN ] COTY: Loaded 54014 primary data records. [2025-09-26T22:19:25.906838] [DEBUG] [LOCAL ] COUR: Loaded 49636 existing records from primary storage. [2025-09-26T22:19:25.917427] [INFO ] [MAIN ] COUR: Loaded 49636 primary data records. [2025-09-26T22:19:26.891765] [DEBUG] [MAIN ] COR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:26.893623] [INFO ] [MAIN ] COR: Generated 1820 derivative records from 47937 primary records. [2025-09-26T22:19:26.894591] [DEBUG] [LOCAL ] COR: Saving derivative data. [2025-09-26T22:19:26.919524] [DEBUG] [LOCAL ] COR: Derivative data saved (1820 records). [2025-09-26T22:19:26.920556] [INFO ] [MAIN ] COR: Successfully saved derivative data. [2025-09-26T22:19:26.923101] [INFO ] [MAIN ] Derivative Progress: 427/2074 symbols completed. COR took 1.3s. Estimated remaining: 11m 30s. Rate: 143.2 symbols/min [2025-09-26T22:19:26.923614] [INFO ] [MAIN ] CP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:26.937175] [DEBUG] [MAIN ] COUR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:26.938444] [INFO ] [MAIN ] COUR: Generated 1820 derivative records from 49636 primary records. [2025-09-26T22:19:26.939047] [DEBUG] [LOCAL ] COUR: Saving derivative data. [2025-09-26T22:19:26.954638] [DEBUG] [MAIN ] COTY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:26.956572] [INFO ] [MAIN ] COTY: Generated 1820 derivative records from 54014 primary records. [2025-09-26T22:19:26.957092] [DEBUG] [LOCAL ] COTY: Saving derivative data. [2025-09-26T22:19:26.989313] [DEBUG] [LOCAL ] COTY: Derivative data saved (1820 records). [2025-09-26T22:19:26.990470] [INFO ] [MAIN ] COTY: Successfully saved derivative data. [2025-09-26T22:19:26.993539] [INFO ] [MAIN ] Derivative Progress: 428/2074 symbols completed. COTY took 1.3s. Estimated remaining: 11m 28s. Rate: 143.5 symbols/min [2025-09-26T22:19:26.994161] [INFO ] [MAIN ] CPAY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:26.995850] [DEBUG] [LOCAL ] COUR: Derivative data saved (1820 records). [2025-09-26T22:19:26.996119] [INFO ] [MAIN ] COUR: Successfully saved derivative data. [2025-09-26T22:19:26.999098] [INFO ] [MAIN ] Derivative Progress: 429/2074 symbols completed. COUR took 1.3s. Estimated remaining: 11m 26s. Rate: 143.8 symbols/min [2025-09-26T22:19:26.999882] [INFO ] [MAIN ] CPF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:27.042029] [DEBUG] [LOCAL ] CPF: Loaded 15618 existing records from primary storage. [2025-09-26T22:19:27.042699] [INFO ] [MAIN ] CPF: Loaded 15618 primary data records. [2025-09-26T22:19:27.148012] [DEBUG] [LOCAL ] CPAY: Loaded 31286 existing records from primary storage. [2025-09-26T22:19:27.171743] [INFO ] [MAIN ] CPAY: Loaded 31286 primary data records. [2025-09-26T22:19:27.353037] [DEBUG] [LOCAL ] CP: Loaded 54051 existing records from primary storage. [2025-09-26T22:19:27.409209] [INFO ] [MAIN ] CP: Loaded 54051 primary data records. [2025-09-26T22:19:28.140325] [DEBUG] [MAIN ] CPF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:28.142109] [INFO ] [MAIN ] CPF: Generated 1820 derivative records from 15618 primary records. [2025-09-26T22:19:28.142549] [DEBUG] [LOCAL ] CPF: Saving derivative data. [2025-09-26T22:19:28.183620] [DEBUG] [MAIN ] CPAY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:28.184160] [DEBUG] [LOCAL ] CPF: Derivative data saved (1820 records). [2025-09-26T22:19:28.184478] [INFO ] [MAIN ] CPF: Successfully saved derivative data. [2025-09-26T22:19:28.187224] [INFO ] [MAIN ] Derivative Progress: 430/2074 symbols completed. CPF took 1.2s. Estimated remaining: 11m 29s. Rate: 143.2 symbols/min [2025-09-26T22:19:28.188107] [INFO ] [MAIN ] CPAY: Generated 1820 derivative records from 31286 primary records. [2025-09-26T22:19:28.188586] [DEBUG] [LOCAL ] CPAY: Saving derivative data. [2025-09-26T22:19:28.189953] [INFO ] [MAIN ] CPNG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:28.224616] [DEBUG] [MAIN ] CP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:28.226521] [INFO ] [MAIN ] CP: Generated 1820 derivative records from 54051 primary records. [2025-09-26T22:19:28.227055] [DEBUG] [LOCAL ] CP: Saving derivative data. [2025-09-26T22:19:28.229541] [DEBUG] [LOCAL ] CPAY: Derivative data saved (1820 records). [2025-09-26T22:19:28.230045] [INFO ] [MAIN ] CPAY: Successfully saved derivative data. [2025-09-26T22:19:28.240841] [INFO ] [MAIN ] Derivative Progress: 431/2074 symbols completed. CPAY took 1.2s. Estimated remaining: 11m 27s. Rate: 143.5 symbols/min [2025-09-26T22:19:28.246231] [INFO ] [MAIN ] CPRI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:28.254084] [DEBUG] [LOCAL ] CP: Derivative data saved (1820 records). [2025-09-26T22:19:28.254345] [INFO ] [MAIN ] CP: Successfully saved derivative data. [2025-09-26T22:19:28.257588] [INFO ] [MAIN ] Derivative Progress: 432/2074 symbols completed. CP took 1.3s. Estimated remaining: 11m 25s. Rate: 143.8 symbols/min [2025-09-26T22:19:28.258043] [INFO ] [MAIN ] CPS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:28.323613] [DEBUG] [LOCAL ] CPNG: Loaded 54450 existing records from primary storage. [2025-09-26T22:19:28.350150] [DEBUG] [LOCAL ] CPS: Loaded 26476 existing records from primary storage. [2025-09-26T22:19:28.349576] [INFO ] [MAIN ] CPNG: Loaded 54450 primary data records. [2025-09-26T22:19:28.350542] [INFO ] [MAIN ] CPS: Loaded 26476 primary data records. [2025-09-26T22:19:28.618538] [DEBUG] [LOCAL ] CPRI: Loaded 53326 existing records from primary storage. [2025-09-26T22:19:28.640020] [INFO ] [MAIN ] CPRI: Loaded 53326 primary data records. [2025-09-26T22:19:29.509542] [DEBUG] [MAIN ] CPS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:29.523389] [DEBUG] [MAIN ] CPNG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:29.524474] [INFO ] [MAIN ] CPS: Generated 1820 derivative records from 26476 primary records. [2025-09-26T22:19:29.524680] [DEBUG] [LOCAL ] CPS: Saving derivative data. [2025-09-26T22:19:29.526415] [INFO ] [MAIN ] CPNG: Generated 1820 derivative records from 54450 primary records. [2025-09-26T22:19:29.535746] [DEBUG] [LOCAL ] CPNG: Saving derivative data. [2025-09-26T22:19:29.575165] [DEBUG] [MAIN ] CPRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:29.574849] [DEBUG] [LOCAL ] CPS: Derivative data saved (1820 records). [2025-09-26T22:19:29.577376] [INFO ] [MAIN ] CPRI: Generated 1820 derivative records from 53326 primary records. [2025-09-26T22:19:29.576668] [INFO ] [MAIN ] CPS: Successfully saved derivative data. [2025-09-26T22:19:29.581204] [INFO ] [MAIN ] Derivative Progress: 433/2074 symbols completed. CPS took 1.3s. Estimated remaining: 11m 28s. Rate: 143.1 symbols/min [2025-09-26T22:19:29.581671] [DEBUG] [LOCAL ] CPRI: Saving derivative data. [2025-09-26T22:19:29.600279] [DEBUG] [LOCAL ] CPNG: Derivative data saved (1820 records). [2025-09-26T22:19:29.601022] [INFO ] [MAIN ] CPNG: Successfully saved derivative data. [2025-09-26T22:19:29.603438] [INFO ] [MAIN ] Derivative Progress: 434/2074 symbols completed. CPNG took 1.4s. Estimated remaining: 11m 26s. Rate: 143.4 symbols/min [2025-09-26T22:19:29.607587] [DEBUG] [LOCAL ] CPRI: Derivative data saved (1820 records). [2025-09-26T22:19:29.607678] [INFO ] [MAIN ] CPRI: Successfully saved derivative data. [2025-09-26T22:19:29.610443] [INFO ] [MAIN ] Derivative Progress: 435/2074 symbols completed. CPRI took 1.4s. Estimated remaining: 11m 24s. Rate: 143.7 symbols/min [2025-09-26T22:19:29.611096] [INFO ] [MAIN ] CPT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:29.611334] [INFO ] [MAIN ] CQP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:29.611268] [INFO ] [MAIN ] CR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:29.654441] [DEBUG] [LOCAL ] CR: Loaded 25019 existing records from primary storage. [2025-09-26T22:19:29.654963] [DEBUG] [LOCAL ] CQP: Loaded 20033 existing records from primary storage. [2025-09-26T22:19:29.655061] [INFO ] [MAIN ] CR: Loaded 25019 primary data records. [2025-09-26T22:19:29.655150] [INFO ] [MAIN ] CQP: Loaded 20033 primary data records. [2025-09-26T22:19:29.983987] [DEBUG] [LOCAL ] CPT: Loaded 45034 existing records from primary storage. [2025-09-26T22:19:30.061022] [INFO ] [MAIN ] CPT: Loaded 45034 primary data records. [2025-09-26T22:19:30.756471] [DEBUG] [MAIN ] CR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:30.771449] [INFO ] [MAIN ] CR: Generated 1820 derivative records from 25019 primary records. [2025-09-26T22:19:30.771927] [DEBUG] [LOCAL ] CR: Saving derivative data. [2025-09-26T22:19:30.773409] [DEBUG] [MAIN ] CQP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:30.774400] [INFO ] [MAIN ] CQP: Generated 1820 derivative records from 20033 primary records. [2025-09-26T22:19:30.774683] [DEBUG] [LOCAL ] CQP: Saving derivative data. [2025-09-26T22:19:30.810023] [DEBUG] [LOCAL ] CR: Derivative data saved (1820 records). [2025-09-26T22:19:30.810758] [INFO ] [MAIN ] CR: Successfully saved derivative data. [2025-09-26T22:19:30.813383] [INFO ] [MAIN ] Derivative Progress: 436/2074 symbols completed. CR took 1.2s. Estimated remaining: 11m 27s. Rate: 143.1 symbols/min [2025-09-26T22:19:30.826897] [INFO ] [MAIN ] CRBD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:30.828980] [DEBUG] [MAIN ] CPT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:30.829973] [INFO ] [MAIN ] CPT: Generated 1820 derivative records from 45034 primary records. [2025-09-26T22:19:30.830232] [DEBUG] [LOCAL ] CPT: Saving derivative data. [2025-09-26T22:19:30.830093] [DEBUG] [LOCAL ] CQP: Derivative data saved (1820 records). [2025-09-26T22:19:30.830427] [INFO ] [MAIN ] CQP: Successfully saved derivative data. [2025-09-26T22:19:30.834053] [INFO ] [MAIN ] Derivative Progress: 437/2074 symbols completed. CQP took 1.2s. Estimated remaining: 11m 25s. Rate: 143.4 symbols/min [2025-09-26T22:19:30.849271] [INFO ] [MAIN ] CRC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:30.857092] [DEBUG] [LOCAL ] CRBD: Loaded 9131 existing records from primary storage. [2025-09-26T22:19:30.857974] [INFO ] [MAIN ] CRBD: Loaded 9131 primary data records. [2025-09-26T22:19:30.971131] [DEBUG] [LOCAL ] CPT: Derivative data saved (1820 records). [2025-09-26T22:19:30.975442] [INFO ] [MAIN ] CPT: Successfully saved derivative data. [2025-09-26T22:19:30.978984] [INFO ] [MAIN ] Derivative Progress: 438/2074 symbols completed. CPT took 1.4s. Estimated remaining: 11m 23s. Rate: 143.6 symbols/min [2025-09-26T22:19:30.990328] [INFO ] [MAIN ] CRGY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:31.240674] [DEBUG] [LOCAL ] CRC: Loaded 44946 existing records from primary storage. [2025-09-26T22:19:31.241550] [INFO ] [MAIN ] CRC: Loaded 44946 primary data records. [2025-09-26T22:19:31.606168] [DEBUG] [LOCAL ] CRGY: Loaded 53290 existing records from primary storage. [2025-09-26T22:19:31.626785] [INFO ] [MAIN ] CRGY: Loaded 53290 primary data records. [2025-09-26T22:19:31.807291] [DEBUG] [MAIN ] CRBD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:31.855119] [INFO ] [MAIN ] CRBD: Generated 1820 derivative records from 9131 primary records. [2025-09-26T22:19:31.855221] [DEBUG] [LOCAL ] CRBD: Saving derivative data. [2025-09-26T22:19:32.004721] [DEBUG] [LOCAL ] CRBD: Derivative data saved (1820 records). [2025-09-26T22:19:32.005902] [INFO ] [MAIN ] CRBD: Successfully saved derivative data. [2025-09-26T22:19:32.009885] [INFO ] [MAIN ] Derivative Progress: 439/2074 symbols completed. CRBD took 1.2s. Estimated remaining: 11m 25s. Rate: 143.2 symbols/min [2025-09-26T22:19:32.010400] [INFO ] [MAIN ] CRK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:32.028061] [DEBUG] [MAIN ] CRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:32.029223] [INFO ] [MAIN ] CRC: Generated 1820 derivative records from 44946 primary records. [2025-09-26T22:19:32.029517] [DEBUG] [LOCAL ] CRC: Saving derivative data. [2025-09-26T22:19:32.053165] [DEBUG] [LOCAL ] CRC: Derivative data saved (1820 records). [2025-09-26T22:19:32.066667] [INFO ] [MAIN ] CRC: Successfully saved derivative data. [2025-09-26T22:19:32.066973] [DEBUG] [MAIN ] CRGY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:32.067856] [INFO ] [MAIN ] CRGY: Generated 1820 derivative records from 53290 primary records. [2025-09-26T22:19:32.070719] [INFO ] [MAIN ] Derivative Progress: 440/2074 symbols completed. CRC took 1.2s. Estimated remaining: 11m 23s. Rate: 143.4 symbols/min [2025-09-26T22:19:32.071001] [INFO ] [MAIN ] CRL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:32.071276] [DEBUG] [LOCAL ] CRGY: Saving derivative data. [2025-09-26T22:19:32.103166] [DEBUG] [LOCAL ] CRGY: Derivative data saved (1820 records). [2025-09-26T22:19:32.103375] [INFO ] [MAIN ] CRGY: Successfully saved derivative data. [2025-09-26T22:19:32.106120] [INFO ] [MAIN ] Derivative Progress: 441/2074 symbols completed. CRGY took 1.1s. Estimated remaining: 11m 22s. Rate: 143.7 symbols/min [2025-09-26T22:19:32.106524] [INFO ] [MAIN ] CRM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:32.127371] [DEBUG] [LOCAL ] CRK: Loaded 52891 existing records from primary storage. [2025-09-26T22:19:32.127708] [INFO ] [MAIN ] CRK: Loaded 52891 primary data records. [2025-09-26T22:19:32.359636] [DEBUG] [LOCAL ] CRL: Loaded 43853 existing records from primary storage. [2025-09-26T22:19:32.380136] [INFO ] [MAIN ] CRL: Loaded 43853 primary data records. [2025-09-26T22:19:32.642305] [DEBUG] [LOCAL ] CRM: Loaded 54550 existing records from primary storage. [2025-09-26T22:19:32.643284] [INFO ] [MAIN ] CRM: Loaded 54550 primary data records. [2025-09-26T22:19:33.269434] [DEBUG] [MAIN ] CRK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:33.270950] [INFO ] [MAIN ] CRK: Generated 1820 derivative records from 52891 primary records. [2025-09-26T22:19:33.272120] [DEBUG] [LOCAL ] CRK: Saving derivative data. [2025-09-26T22:19:33.291178] [DEBUG] [LOCAL ] CRK: Derivative data saved (1820 records). [2025-09-26T22:19:33.291771] [INFO ] [MAIN ] CRK: Successfully saved derivative data. [2025-09-26T22:19:33.294369] [INFO ] [MAIN ] Derivative Progress: 442/2074 symbols completed. CRK took 1.3s. Estimated remaining: 11m 24s. Rate: 143.1 symbols/min [2025-09-26T22:19:33.295178] [INFO ] [MAIN ] CRS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:33.313953] [DEBUG] [MAIN ] CRL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:33.314807] [INFO ] [MAIN ] CRL: Generated 1820 derivative records from 43853 primary records. [2025-09-26T22:19:33.314976] [DEBUG] [LOCAL ] CRL: Saving derivative data. [2025-09-26T22:19:33.333979] [DEBUG] [LOCAL ] CRL: Derivative data saved (1820 records). [2025-09-26T22:19:33.334364] [INFO ] [MAIN ] CRL: Successfully saved derivative data. [2025-09-26T22:19:33.337296] [INFO ] [MAIN ] Derivative Progress: 443/2074 symbols completed. CRL took 1.3s. Estimated remaining: 11m 22s. Rate: 143.4 symbols/min [2025-09-26T22:19:33.340563] [INFO ] [MAIN ] CRT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:33.358074] [DEBUG] [MAIN ] CRM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:33.359295] [INFO ] [MAIN ] CRM: Generated 1820 derivative records from 54550 primary records. [2025-09-26T22:19:33.359552] [DEBUG] [LOCAL ] CRM: Saving derivative data. [2025-09-26T22:19:33.363321] [DEBUG] [LOCAL ] CRT: Loaded 5018 existing records from primary storage. [2025-09-26T22:19:33.364219] [INFO ] [MAIN ] CRT: Loaded 5018 primary data records. [2025-09-26T22:19:33.540371] [DEBUG] [LOCAL ] CRM: Derivative data saved (1820 records). [2025-09-26T22:19:33.545728] [INFO ] [MAIN ] CRM: Successfully saved derivative data. [2025-09-26T22:19:33.535167] [DEBUG] [LOCAL ] CRS: Loaded 43928 existing records from primary storage. [2025-09-26T22:19:33.573692] [INFO ] [MAIN ] CRS: Loaded 43928 primary data records. [2025-09-26T22:19:33.573504] [INFO ] [MAIN ] Derivative Progress: 444/2074 symbols completed. CRM took 1.5s. Estimated remaining: 11m 21s. Rate: 143.6 symbols/min [2025-09-26T22:19:33.581594] [INFO ] [MAIN ] CSAN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:34.105345] [DEBUG] [LOCAL ] CSAN: Loaded 42951 existing records from primary storage. [2025-09-26T22:19:34.120549] [INFO ] [MAIN ] CSAN: Loaded 42951 primary data records. [2025-09-26T22:19:34.121354] [DEBUG] [MAIN ] CRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:34.122603] [INFO ] [MAIN ] CRT: Generated 1820 derivative records from 5018 primary records. [2025-09-26T22:19:34.128368] [DEBUG] [LOCAL ] CRT: Saving derivative data. [2025-09-26T22:19:34.271971] [DEBUG] [LOCAL ] CRT: Derivative data saved (1820 records). [2025-09-26T22:19:34.306171] [INFO ] [MAIN ] CRT: Successfully saved derivative data. [2025-09-26T22:19:34.342239] [INFO ] [MAIN ] Derivative Progress: 445/2074 symbols completed. CRT took 1.0s. Estimated remaining: 11m 22s. Rate: 143.3 symbols/min [2025-09-26T22:19:34.456486] [INFO ] [MAIN ] CSL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:34.487434] [DEBUG] [MAIN ] CRS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:34.488459] [INFO ] [MAIN ] CRS: Generated 1820 derivative records from 43928 primary records. [2025-09-26T22:19:34.488677] [DEBUG] [LOCAL ] CRS: Saving derivative data. [2025-09-26T22:19:34.522437] [DEBUG] [LOCAL ] CRS: Derivative data saved (1820 records). [2025-09-26T22:19:34.522707] [INFO ] [MAIN ] CRS: Successfully saved derivative data. [2025-09-26T22:19:34.534384] [INFO ] [MAIN ] Derivative Progress: 446/2074 symbols completed. CRS took 1.2s. Estimated remaining: 11m 21s. Rate: 143.5 symbols/min [2025-09-26T22:19:34.535785] [INFO ] [MAIN ] CSR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:34.555492] [DEBUG] [LOCAL ] CSL: Loaded 32100 existing records from primary storage. [2025-09-26T22:19:34.556096] [INFO ] [MAIN ] CSL: Loaded 32100 primary data records. [2025-09-26T22:19:34.660365] [DEBUG] [LOCAL ] CSR: Loaded 12808 existing records from primary storage. [2025-09-26T22:19:34.671620] [INFO ] [MAIN ] CSR: Loaded 12808 primary data records. [2025-09-26T22:19:34.783833] [DEBUG] [MAIN ] CSAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:34.867587] [INFO ] [MAIN ] CSAN: Generated 1820 derivative records from 42951 primary records. [2025-09-26T22:19:34.911838] [DEBUG] [LOCAL ] CSAN: Saving derivative data. [2025-09-26T22:19:35.326142] [DEBUG] [LOCAL ] CSAN: Derivative data saved (1820 records). [2025-09-26T22:19:35.326571] [INFO ] [MAIN ] CSAN: Successfully saved derivative data. [2025-09-26T22:19:35.328985] [INFO ] [MAIN ] Derivative Progress: 447/2074 symbols completed. CSAN took 1.7s. Estimated remaining: 11m 22s. Rate: 143.2 symbols/min [2025-09-26T22:19:35.329326] [INFO ] [MAIN ] CSTM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:35.358409] [DEBUG] [MAIN ] CSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:35.359436] [INFO ] [MAIN ] CSL: Generated 1820 derivative records from 32100 primary records. [2025-09-26T22:19:35.359706] [DEBUG] [LOCAL ] CSL: Saving derivative data. [2025-09-26T22:19:35.378859] [DEBUG] [LOCAL ] CSL: Derivative data saved (1820 records). [2025-09-26T22:19:35.402106] [INFO ] [MAIN ] CSL: Successfully saved derivative data. [2025-09-26T22:19:35.402705] [DEBUG] [MAIN ] CSR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:35.403442] [INFO ] [MAIN ] CSR: Generated 1820 derivative records from 12808 primary records. [2025-09-26T22:19:35.405927] [INFO ] [MAIN ] Derivative Progress: 448/2074 symbols completed. CSL took 1.0s. Estimated remaining: 11m 20s. Rate: 143.5 symbols/min [2025-09-26T22:19:35.406065] [DEBUG] [LOCAL ] CSR: Saving derivative data. [2025-09-26T22:19:35.437688] [DEBUG] [LOCAL ] CSR: Derivative data saved (1820 records). [2025-09-26T22:19:35.437574] [DEBUG] [LOCAL ] CSTM: Loaded 48360 existing records from primary storage. [2025-09-26T22:19:35.437842] [INFO ] [MAIN ] CSR: Successfully saved derivative data. [2025-09-26T22:19:35.437917] [INFO ] [MAIN ] CSTM: Loaded 48360 primary data records. [2025-09-26T22:19:35.440815] [INFO ] [MAIN ] Derivative Progress: 449/2074 symbols completed. CSR took 0.9s. Estimated remaining: 11m 18s. Rate: 143.7 symbols/min [2025-09-26T22:19:35.769405] [DEBUG] [MAIN ] CSTM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:35.770071] [INFO ] [MAIN ] CSTM: Generated 1820 derivative records from 48360 primary records. [2025-09-26T22:19:35.770135] [DEBUG] [LOCAL ] CSTM: Saving derivative data. [2025-09-26T22:19:35.786557] [DEBUG] [LOCAL ] CSTM: Derivative data saved (1820 records). [2025-09-26T22:19:35.786848] [INFO ] [MAIN ] CSTM: Successfully saved derivative data. [2025-09-26T22:19:35.789505] [INFO ] [MAIN ] Derivative Progress: 450/2074 symbols completed. CSTM took 0.5s. Estimated remaining: 11m 18s. Rate: 143.8 symbols/min [2025-09-26T22:19:35.790350] [INFO ] [MAIN ] CTDD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:35.790763] [INFO ] [MAIN ] CTBB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:35.790429] [INFO ] [MAIN ] CSV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:35.801804] [DEBUG] [LOCAL ] CTDD: Loaded 5947 existing records from primary storage. [2025-09-26T22:19:35.802144] [INFO ] [MAIN ] CTDD: Loaded 5947 primary data records. [2025-09-26T22:19:35.860415] [DEBUG] [LOCAL ] CTBB: Loaded 7168 existing records from primary storage. [2025-09-26T22:19:35.906114] [INFO ] [MAIN ] CTBB: Loaded 7168 primary data records. [2025-09-26T22:19:35.906017] [DEBUG] [LOCAL ] CSV: Loaded 13198 existing records from primary storage. [2025-09-26T22:19:35.946479] [INFO ] [MAIN ] CSV: Loaded 13198 primary data records. [2025-09-26T22:19:36.797395] [DEBUG] [MAIN ] CTDD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:36.798224] [INFO ] [MAIN ] CTDD: Generated 1820 derivative records from 5947 primary records. [2025-09-26T22:19:36.798538] [DEBUG] [LOCAL ] CTDD: Saving derivative data. [2025-09-26T22:19:36.839730] [DEBUG] [LOCAL ] CTDD: Derivative data saved (1820 records). [2025-09-26T22:19:36.844632] [INFO ] [MAIN ] CTDD: Successfully saved derivative data. [2025-09-26T22:19:36.845265] [DEBUG] [MAIN ] CSV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:36.847682] [INFO ] [MAIN ] Derivative Progress: 451/2074 symbols completed. CTDD took 1.1s. Estimated remaining: 11m 19s. Rate: 143.3 symbols/min [2025-09-26T22:19:36.844951] [DEBUG] [MAIN ] CTBB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:36.848011] [INFO ] [MAIN ] CTO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:36.848978] [INFO ] [MAIN ] CTBB: Generated 1820 derivative records from 7168 primary records. [2025-09-26T22:19:36.849765] [DEBUG] [LOCAL ] CTBB: Saving derivative data. [2025-09-26T22:19:36.849684] [INFO ] [MAIN ] CSV: Generated 1820 derivative records from 13198 primary records. [2025-09-26T22:19:36.850080] [DEBUG] [LOCAL ] CSV: Saving derivative data. [2025-09-26T22:19:36.878287] [DEBUG] [LOCAL ] CTBB: Derivative data saved (1820 records). [2025-09-26T22:19:36.878710] [INFO ] [MAIN ] CTBB: Successfully saved derivative data. [2025-09-26T22:19:36.882941] [INFO ] [MAIN ] Derivative Progress: 452/2074 symbols completed. CTBB took 1.1s. Estimated remaining: 11m 18s. Rate: 143.6 symbols/min [2025-09-26T22:19:36.883834] [INFO ] [MAIN ] CTOS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:36.889797] [DEBUG] [LOCAL ] CSV: Derivative data saved (1820 records). [2025-09-26T22:19:36.897382] [INFO ] [MAIN ] CSV: Successfully saved derivative data. [2025-09-26T22:19:36.899912] [INFO ] [MAIN ] Derivative Progress: 453/2074 symbols completed. CSV took 1.1s. Estimated remaining: 11m 16s. Rate: 143.9 symbols/min [2025-09-26T22:19:36.900304] [INFO ] [MAIN ] CTRA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:36.913841] [DEBUG] [LOCAL ] CTO: Loaded 28661 existing records from primary storage. [2025-09-26T22:19:36.914122] [INFO ] [MAIN ] CTO: Loaded 28661 primary data records. [2025-09-26T22:19:37.136011] [DEBUG] [LOCAL ] CTOS: Loaded 37246 existing records from primary storage. [2025-09-26T22:19:37.142621] [INFO ] [MAIN ] CTOS: Loaded 37246 primary data records. [2025-09-26T22:19:37.367871] [DEBUG] [LOCAL ] CTRA: Loaded 54428 existing records from primary storage. [2025-09-26T22:19:37.378973] [INFO ] [MAIN ] CTRA: Loaded 54428 primary data records. [2025-09-26T22:19:38.066963] [DEBUG] [MAIN ] CTO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:38.068207] [INFO ] [MAIN ] CTO: Generated 1820 derivative records from 28661 primary records. [2025-09-26T22:19:38.068619] [DEBUG] [LOCAL ] CTO: Saving derivative data. [2025-09-26T22:19:38.091716] [DEBUG] [LOCAL ] CTO: Derivative data saved (1820 records). [2025-09-26T22:19:38.092378] [INFO ] [MAIN ] CTO: Successfully saved derivative data. [2025-09-26T22:19:38.095266] [INFO ] [MAIN ] Derivative Progress: 454/2074 symbols completed. CTO took 1.2s. Estimated remaining: 11m 18s. Rate: 143.3 symbols/min [2025-09-26T22:19:38.096229] [INFO ] [MAIN ] CTRE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:38.117360] [DEBUG] [MAIN ] CTOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:38.131691] [DEBUG] [MAIN ] CTRA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:38.131356] [INFO ] [MAIN ] CTOS: Generated 1820 derivative records from 37246 primary records. [2025-09-26T22:19:38.132536] [INFO ] [MAIN ] CTRA: Generated 1820 derivative records from 54428 primary records. [2025-09-26T22:19:38.132671] [DEBUG] [LOCAL ] CTRA: Saving derivative data. [2025-09-26T22:19:38.131967] [DEBUG] [LOCAL ] CTOS: Saving derivative data. [2025-09-26T22:19:38.162432] [DEBUG] [LOCAL ] CTRA: Derivative data saved (1820 records). [2025-09-26T22:19:38.166075] [INFO ] [MAIN ] CTRA: Successfully saved derivative data. [2025-09-26T22:19:38.169376] [INFO ] [MAIN ] Derivative Progress: 455/2074 symbols completed. CTRA took 1.3s. Estimated remaining: 11m 17s. Rate: 143.6 symbols/min [2025-09-26T22:19:38.171786] [INFO ] [MAIN ] CTRI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:38.176170] [DEBUG] [LOCAL ] CTOS: Derivative data saved (1820 records). [2025-09-26T22:19:38.176266] [INFO ] [MAIN ] CTOS: Successfully saved derivative data. [2025-09-26T22:19:38.178871] [INFO ] [MAIN ] Derivative Progress: 456/2074 symbols completed. CTOS took 1.3s. Estimated remaining: 11m 15s. Rate: 143.9 symbols/min [2025-09-26T22:19:38.179520] [INFO ] [MAIN ] CTS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:38.221148] [DEBUG] [LOCAL ] CTRE: Loaded 49964 existing records from primary storage. [2025-09-26T22:19:38.221505] [INFO ] [MAIN ] CTRE: Loaded 49964 primary data records. [2025-09-26T22:19:38.298671] [DEBUG] [LOCAL ] CTS: Loaded 19637 existing records from primary storage. [2025-09-26T22:19:38.306913] [INFO ] [MAIN ] CTS: Loaded 19637 primary data records. [2025-09-26T22:19:38.367263] [DEBUG] [LOCAL ] CTRI: Loaded 38571 existing records from primary storage. [2025-09-26T22:19:38.389270] [INFO ] [MAIN ] CTRI: Loaded 38571 primary data records. [2025-09-26T22:19:39.294749] [DEBUG] [MAIN ] CTRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:39.305050] [DEBUG] [MAIN ] CTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:39.303605] [INFO ] [MAIN ] CTRE: Generated 1820 derivative records from 49964 primary records. [2025-09-26T22:19:39.306033] [INFO ] [MAIN ] CTS: Generated 1820 derivative records from 19637 primary records. [2025-09-26T22:19:39.306200] [DEBUG] [LOCAL ] CTS: Saving derivative data. [2025-09-26T22:19:39.306486] [DEBUG] [LOCAL ] CTRE: Saving derivative data. [2025-09-26T22:19:39.324970] [DEBUG] [MAIN ] CTRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:39.350138] [INFO ] [MAIN ] CTRI: Generated 1820 derivative records from 38571 primary records. [2025-09-26T22:19:39.355174] [DEBUG] [LOCAL ] CTRI: Saving derivative data. [2025-09-26T22:19:39.356411] [DEBUG] [LOCAL ] CTRE: Derivative data saved (1820 records). [2025-09-26T22:19:39.358927] [INFO ] [MAIN ] CTRE: Successfully saved derivative data. [2025-09-26T22:19:39.362493] [INFO ] [MAIN ] Derivative Progress: 457/2074 symbols completed. CTRE took 1.3s. Estimated remaining: 11m 17s. Rate: 143.3 symbols/min [2025-09-26T22:19:39.371338] [INFO ] [MAIN ] CTVA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:39.381362] [DEBUG] [LOCAL ] CTS: Derivative data saved (1820 records). [2025-09-26T22:19:39.381994] [INFO ] [MAIN ] CTS: Successfully saved derivative data. [2025-09-26T22:19:39.382076] [DEBUG] [LOCAL ] CTRI: Derivative data saved (1820 records). [2025-09-26T22:19:39.385535] [INFO ] [MAIN ] Derivative Progress: 458/2074 symbols completed. CTS took 1.2s. Estimated remaining: 11m 15s. Rate: 143.6 symbols/min [2025-09-26T22:19:39.385695] [INFO ] [MAIN ] CTRI: Successfully saved derivative data. [2025-09-26T22:19:39.388896] [INFO ] [MAIN ] CUBE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:39.389066] [INFO ] [MAIN ] Derivative Progress: 459/2074 symbols completed. CTRI took 1.2s. Estimated remaining: 11m 13s. Rate: 143.9 symbols/min [2025-09-26T22:19:39.389585] [INFO ] [MAIN ] CUBI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:39.441692] [DEBUG] [LOCAL ] CUBI: Loaded 27667 existing records from primary storage. [2025-09-26T22:19:39.442040] [INFO ] [MAIN ] CUBI: Loaded 27667 primary data records. [2025-09-26T22:19:39.599011] [DEBUG] [LOCAL ] CTVA: Loaded 54002 existing records from primary storage. [2025-09-26T22:19:39.644478] [DEBUG] [LOCAL ] CUBE: Loaded 51391 existing records from primary storage. [2025-09-26T22:19:39.649807] [INFO ] [MAIN ] CTVA: Loaded 54002 primary data records. [2025-09-26T22:19:39.674729] [INFO ] [MAIN ] CUBE: Loaded 51391 primary data records. [2025-09-26T22:19:40.572171] [DEBUG] [MAIN ] CUBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:40.573209] [INFO ] [MAIN ] CUBI: Generated 1820 derivative records from 27667 primary records. [2025-09-26T22:19:40.573394] [DEBUG] [LOCAL ] CUBI: Saving derivative data. [2025-09-26T22:19:40.596034] [DEBUG] [LOCAL ] CUBI: Derivative data saved (1820 records). [2025-09-26T22:19:40.597052] [INFO ] [MAIN ] CUBI: Successfully saved derivative data. [2025-09-26T22:19:40.599353] [INFO ] [MAIN ] Derivative Progress: 460/2074 symbols completed. CUBI took 1.2s. Estimated remaining: 11m 16s. Rate: 143.3 symbols/min [2025-09-26T22:19:40.600966] [INFO ] [MAIN ] CUK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:40.616843] [DEBUG] [MAIN ] CTVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:40.618218] [INFO ] [MAIN ] CTVA: Generated 1820 derivative records from 54002 primary records. [2025-09-26T22:19:40.618581] [DEBUG] [LOCAL ] CTVA: Saving derivative data. [2025-09-26T22:19:40.640852] [DEBUG] [MAIN ] CUBE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:40.642872] [INFO ] [MAIN ] CUBE: Generated 1820 derivative records from 51391 primary records. [2025-09-26T22:19:40.647824] [DEBUG] [LOCAL ] CUBE: Saving derivative data. [2025-09-26T22:19:40.666795] [DEBUG] [LOCAL ] CTVA: Derivative data saved (1820 records). [2025-09-26T22:19:40.667474] [INFO ] [MAIN ] CTVA: Successfully saved derivative data. [2025-09-26T22:19:40.670667] [INFO ] [MAIN ] Derivative Progress: 461/2074 symbols completed. CTVA took 1.3s. Estimated remaining: 11m 14s. Rate: 143.6 symbols/min [2025-09-26T22:19:40.671538] [INFO ] [MAIN ] CULP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:40.673039] [DEBUG] [LOCAL ] CUBE: Derivative data saved (1820 records). [2025-09-26T22:19:40.673280] [INFO ] [MAIN ] CUBE: Successfully saved derivative data. [2025-09-26T22:19:40.676599] [INFO ] [MAIN ] Derivative Progress: 462/2074 symbols completed. CUBE took 1.3s. Estimated remaining: 11m 12s. Rate: 143.9 symbols/min [2025-09-26T22:19:40.677941] [INFO ] [MAIN ] CURB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:40.680958] [DEBUG] [LOCAL ] CULP: Loaded 3111 existing records from primary storage. [2025-09-26T22:19:40.681151] [INFO ] [MAIN ] CULP: Loaded 3111 primary data records. [2025-09-26T22:19:40.899807] [DEBUG] [LOCAL ] CUK: Loaded 51762 existing records from primary storage. [2025-09-26T22:19:40.903638] [INFO ] [MAIN ] CUK: Loaded 51762 primary data records. [2025-09-26T22:19:40.968228] [DEBUG] [LOCAL ] CURB: Loaded 33350 existing records from primary storage. [2025-09-26T22:19:41.103117] [INFO ] [MAIN ] CURB: Loaded 33350 primary data records. [2025-09-26T22:19:41.838104] [DEBUG] [MAIN ] CULP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:41.839724] [INFO ] [MAIN ] CULP: Generated 1820 derivative records from 3111 primary records. [2025-09-26T22:19:41.840004] [DEBUG] [LOCAL ] CULP: Saving derivative data. [2025-09-26T22:19:41.859251] [DEBUG] [LOCAL ] CULP: Derivative data saved (1820 records). [2025-09-26T22:19:41.859597] [INFO ] [MAIN ] CULP: Successfully saved derivative data. [2025-09-26T22:19:41.861979] [INFO ] [MAIN ] Derivative Progress: 463/2074 symbols completed. CULP took 1.2s. Estimated remaining: 11m 14s. Rate: 143.3 symbols/min [2025-09-26T22:19:41.883714] [DEBUG] [MAIN ] CUK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:41.884830] [INFO ] [MAIN ] CUK: Generated 1820 derivative records from 51762 primary records. [2025-09-26T22:19:41.884990] [DEBUG] [LOCAL ] CUK: Saving derivative data. [2025-09-26T22:19:41.908120] [DEBUG] [MAIN ] CURB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:41.917208] [INFO ] [MAIN ] CURB: Generated 1820 derivative records from 33350 primary records. [2025-09-26T22:19:41.918881] [DEBUG] [LOCAL ] CUK: Derivative data saved (1820 records). [2025-09-26T22:19:41.919132] [INFO ] [MAIN ] CUK: Successfully saved derivative data. [2025-09-26T22:19:41.919227] [DEBUG] [LOCAL ] CURB: Saving derivative data. [2025-09-26T22:19:41.923032] [INFO ] [MAIN ] Derivative Progress: 464/2074 symbols completed. CUK took 1.3s. Estimated remaining: 11m 13s. Rate: 143.6 symbols/min [2025-09-26T22:19:41.939828] [DEBUG] [LOCAL ] CURB: Derivative data saved (1820 records). [2025-09-26T22:19:41.939966] [INFO ] [MAIN ] CURB: Successfully saved derivative data. [2025-09-26T22:19:41.942923] [INFO ] [MAIN ] Derivative Progress: 465/2074 symbols completed. CURB took 1.3s. Estimated remaining: 11m 11s. Rate: 143.9 symbols/min [2025-09-26T22:19:41.943885] [INFO ] [MAIN ] CURV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:41.943951] [INFO ] [MAIN ] CUZ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:41.944083] [INFO ] [MAIN ] CVE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:41.972943] [DEBUG] [LOCAL ] CURV: Loaded 26933 existing records from primary storage. [2025-09-26T22:19:41.973280] [INFO ] [MAIN ] CURV: Loaded 26933 primary data records. [2025-09-26T22:19:42.212577] [DEBUG] [LOCAL ] CUZ: Loaded 50140 existing records from primary storage. [2025-09-26T22:19:42.340569] [INFO ] [MAIN ] CUZ: Loaded 50140 primary data records. [2025-09-26T22:19:42.398048] [DEBUG] [LOCAL ] CVE: Loaded 54336 existing records from primary storage. [2025-09-26T22:19:42.423368] [INFO ] [MAIN ] CVE: Loaded 54336 primary data records. [2025-09-26T22:19:43.083931] [DEBUG] [MAIN ] CURV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:43.085247] [INFO ] [MAIN ] CURV: Generated 1820 derivative records from 26933 primary records. [2025-09-26T22:19:43.086286] [DEBUG] [LOCAL ] CURV: Saving derivative data. [2025-09-26T22:19:43.109849] [DEBUG] [LOCAL ] CURV: Derivative data saved (1820 records). [2025-09-26T22:19:43.111451] [INFO ] [MAIN ] CURV: Successfully saved derivative data. [2025-09-26T22:19:43.116227] [INFO ] [MAIN ] Derivative Progress: 466/2074 symbols completed. CURV took 1.2s. Estimated remaining: 11m 13s. Rate: 143.3 symbols/min [2025-09-26T22:19:43.116983] [INFO ] [MAIN ] CVEO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:43.133793] [DEBUG] [MAIN ] CUZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:43.135916] [INFO ] [MAIN ] CUZ: Generated 1820 derivative records from 50140 primary records. [2025-09-26T22:19:43.136102] [DEBUG] [LOCAL ] CUZ: Saving derivative data. [2025-09-26T22:19:43.166904] [DEBUG] [MAIN ] CVE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:43.169310] [INFO ] [MAIN ] CVE: Generated 1820 derivative records from 54336 primary records. [2025-09-26T22:19:43.172258] [DEBUG] [LOCAL ] CUZ: Derivative data saved (1820 records). [2025-09-26T22:19:43.172378] [DEBUG] [LOCAL ] CVE: Saving derivative data. [2025-09-26T22:19:43.172468] [INFO ] [MAIN ] CUZ: Successfully saved derivative data. [2025-09-26T22:19:43.175596] [INFO ] [MAIN ] Derivative Progress: 467/2074 symbols completed. CUZ took 1.2s. Estimated remaining: 11m 12s. Rate: 143.6 symbols/min [2025-09-26T22:19:43.176222] [INFO ] [MAIN ] CVI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:43.197208] [DEBUG] [LOCAL ] CVEO: Loaded 15402 existing records from primary storage. [2025-09-26T22:19:43.200890] [DEBUG] [LOCAL ] CVE: Derivative data saved (1820 records). [2025-09-26T22:19:43.201209] [INFO ] [MAIN ] CVEO: Loaded 15402 primary data records. [2025-09-26T22:19:43.201106] [INFO ] [MAIN ] CVE: Successfully saved derivative data. [2025-09-26T22:19:43.209718] [INFO ] [MAIN ] Derivative Progress: 468/2074 symbols completed. CVE took 1.3s. Estimated remaining: 11m 10s. Rate: 143.9 symbols/min [2025-09-26T22:19:43.217093] [INFO ] [MAIN ] CVLG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:43.391546] [DEBUG] [LOCAL ] CVLG: Loaded 15730 existing records from primary storage. [2025-09-26T22:19:43.432789] [INFO ] [MAIN ] CVLG: Loaded 15730 primary data records. [2025-09-26T22:19:43.650146] [DEBUG] [LOCAL ] CVI: Loaded 47160 existing records from primary storage. [2025-09-26T22:19:43.681224] [INFO ] [MAIN ] CVI: Loaded 47160 primary data records. [2025-09-26T22:19:44.337114] [DEBUG] [MAIN ] CVEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:44.338002] [INFO ] [MAIN ] CVEO: Generated 1820 derivative records from 15402 primary records. [2025-09-26T22:19:44.338279] [DEBUG] [LOCAL ] CVEO: Saving derivative data. [2025-09-26T22:19:44.361822] [DEBUG] [LOCAL ] CVEO: Derivative data saved (1820 records). [2025-09-26T22:19:44.362415] [INFO ] [MAIN ] CVEO: Successfully saved derivative data. [2025-09-26T22:19:44.366025] [INFO ] [MAIN ] Derivative Progress: 469/2074 symbols completed. CVEO took 1.2s. Estimated remaining: 11m 12s. Rate: 143.3 symbols/min [2025-09-26T22:19:44.368769] [INFO ] [MAIN ] CVNA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:44.385801] [DEBUG] [MAIN ] CVLG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:44.387256] [INFO ] [MAIN ] CVLG: Generated 1820 derivative records from 15730 primary records. [2025-09-26T22:19:44.389816] [DEBUG] [LOCAL ] CVLG: Saving derivative data. [2025-09-26T22:19:44.416956] [DEBUG] [MAIN ] CVI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:44.420102] [INFO ] [MAIN ] CVI: Generated 1820 derivative records from 47160 primary records. [2025-09-26T22:19:44.420792] [DEBUG] [LOCAL ] CVI: Saving derivative data. [2025-09-26T22:19:44.423616] [DEBUG] [LOCAL ] CVLG: Derivative data saved (1820 records). [2025-09-26T22:19:44.423778] [INFO ] [MAIN ] CVLG: Successfully saved derivative data. [2025-09-26T22:19:44.426750] [INFO ] [MAIN ] Derivative Progress: 470/2074 symbols completed. CVLG took 1.2s. Estimated remaining: 11m 10s. Rate: 143.6 symbols/min [2025-09-26T22:19:44.427086] [INFO ] [MAIN ] CVS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:44.445936] [DEBUG] [LOCAL ] CVI: Derivative data saved (1820 records). [2025-09-26T22:19:44.446155] [INFO ] [MAIN ] CVI: Successfully saved derivative data. [2025-09-26T22:19:44.449678] [INFO ] [MAIN ] Derivative Progress: 471/2074 symbols completed. CVI took 1.3s. Estimated remaining: 11m 8s. Rate: 143.9 symbols/min [2025-09-26T22:19:44.450163] [INFO ] [MAIN ] CVX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:44.511896] [DEBUG] [LOCAL ] CVNA: Loaded 53766 existing records from primary storage. [2025-09-26T22:19:44.512220] [INFO ] [MAIN ] CVNA: Loaded 53766 primary data records. [2025-09-26T22:19:44.657031] [DEBUG] [LOCAL ] CVS: Loaded 54476 existing records from primary storage. [2025-09-26T22:19:44.661584] [INFO ] [MAIN ] CVS: Loaded 54476 primary data records. [2025-09-26T22:19:44.974149] [DEBUG] [LOCAL ] CVX: Loaded 54540 existing records from primary storage. [2025-09-26T22:19:45.001863] [INFO ] [MAIN ] CVX: Loaded 54540 primary data records. [2025-09-26T22:19:45.582998] [DEBUG] [MAIN ] CVNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:45.584742] [INFO ] [MAIN ] CVNA: Generated 1820 derivative records from 53766 primary records. [2025-09-26T22:19:45.585272] [DEBUG] [LOCAL ] CVNA: Saving derivative data. [2025-09-26T22:19:45.606827] [DEBUG] [LOCAL ] CVNA: Derivative data saved (1820 records). [2025-09-26T22:19:45.608951] [INFO ] [MAIN ] CVNA: Successfully saved derivative data. [2025-09-26T22:19:45.611740] [INFO ] [MAIN ] Derivative Progress: 472/2074 symbols completed. CVNA took 1.2s. Estimated remaining: 11m 11s. Rate: 143.3 symbols/min [2025-09-26T22:19:45.615525] [INFO ] [MAIN ] CW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:45.639069] [DEBUG] [MAIN ] CVS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:45.641695] [INFO ] [MAIN ] CVS: Generated 1820 derivative records from 54476 primary records. [2025-09-26T22:19:45.643298] [DEBUG] [LOCAL ] CVS: Saving derivative data. [2025-09-26T22:19:45.683360] [DEBUG] [MAIN ] CVX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:45.692426] [INFO ] [MAIN ] CVX: Generated 1820 derivative records from 54540 primary records. [2025-09-26T22:19:45.695966] [DEBUG] [LOCAL ] CVX: Saving derivative data. [2025-09-26T22:19:45.695827] [DEBUG] [LOCAL ] CVS: Derivative data saved (1820 records). [2025-09-26T22:19:45.697467] [DEBUG] [LOCAL ] CW: Loaded 22705 existing records from primary storage. [2025-09-26T22:19:45.698934] [INFO ] [MAIN ] CVS: Successfully saved derivative data. [2025-09-26T22:19:45.701911] [INFO ] [MAIN ] CW: Loaded 22705 primary data records. [2025-09-26T22:19:45.701805] [INFO ] [MAIN ] Derivative Progress: 473/2074 symbols completed. CVS took 1.3s. Estimated remaining: 11m 9s. Rate: 143.6 symbols/min [2025-09-26T22:19:45.722224] [INFO ] [MAIN ] CWEN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:45.784514] [DEBUG] [LOCAL ] CVX: Derivative data saved (1820 records). [2025-09-26T22:19:45.809841] [INFO ] [MAIN ] CVX: Successfully saved derivative data. [2025-09-26T22:19:45.844284] [INFO ] [MAIN ] Derivative Progress: 474/2074 symbols completed. CVX took 1.4s. Estimated remaining: 11m 8s. Rate: 143.8 symbols/min [2025-09-26T22:19:45.851099] [INFO ] [MAIN ] CWH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:46.095390] [DEBUG] [LOCAL ] CWEN: Loaded 45717 existing records from primary storage. [2025-09-26T22:19:46.096450] [INFO ] [MAIN ] CWEN: Loaded 45717 primary data records. [2025-09-26T22:19:46.158560] [DEBUG] [MAIN ] CW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:46.198986] [INFO ] [MAIN ] CW: Generated 1820 derivative records from 22705 primary records. [2025-09-26T22:19:46.224331] [DEBUG] [LOCAL ] CW: Saving derivative data. [2025-09-26T22:19:46.339054] [DEBUG] [LOCAL ] CWH: Loaded 52151 existing records from primary storage. [2025-09-26T22:19:46.396065] [INFO ] [MAIN ] CWH: Loaded 52151 primary data records. [2025-09-26T22:19:46.620296] [DEBUG] [LOCAL ] CW: Derivative data saved (1820 records). [2025-09-26T22:19:46.639857] [INFO ] [MAIN ] CW: Successfully saved derivative data. [2025-09-26T22:19:46.650749] [INFO ] [MAIN ] Derivative Progress: 475/2074 symbols completed. CW took 1.0s. Estimated remaining: 11m 9s. Rate: 143.5 symbols/min [2025-09-26T22:19:46.656268] [INFO ] [MAIN ] CWK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:46.887966] [DEBUG] [MAIN ] CWEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:46.889115] [INFO ] [MAIN ] CWEN: Generated 1820 derivative records from 45717 primary records. [2025-09-26T22:19:46.889212] [DEBUG] [LOCAL ] CWEN: Saving derivative data. [2025-09-26T22:19:46.918510] [DEBUG] [LOCAL ] CWEN: Derivative data saved (1820 records). [2025-09-26T22:19:46.918838] [INFO ] [MAIN ] CWEN: Successfully saved derivative data. [2025-09-26T22:19:46.921795] [INFO ] [MAIN ] Derivative Progress: 476/2074 symbols completed. CWEN took 1.2s. Estimated remaining: 11m 8s. Rate: 143.6 symbols/min [2025-09-26T22:19:46.922177] [INFO ] [MAIN ] CWT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:46.941638] [DEBUG] [LOCAL ] CWK: Loaded 50158 existing records from primary storage. [2025-09-26T22:19:46.942010] [INFO ] [MAIN ] CWK: Loaded 50158 primary data records. [2025-09-26T22:19:47.015122] [DEBUG] [MAIN ] CWH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:47.051469] [INFO ] [MAIN ] CWH: Generated 1820 derivative records from 52151 primary records. [2025-09-26T22:19:47.077941] [DEBUG] [LOCAL ] CWH: Saving derivative data. [2025-09-26T22:19:47.299012] [DEBUG] [LOCAL ] CWT: Loaded 28294 existing records from primary storage. [2025-09-26T22:19:47.313811] [INFO ] [MAIN ] CWT: Loaded 28294 primary data records. [2025-09-26T22:19:47.315597] [DEBUG] [LOCAL ] CWH: Derivative data saved (1820 records). [2025-09-26T22:19:47.315829] [INFO ] [MAIN ] CWH: Successfully saved derivative data. [2025-09-26T22:19:47.318301] [INFO ] [MAIN ] Derivative Progress: 477/2074 symbols completed. CWH took 1.5s. Estimated remaining: 11m 7s. Rate: 143.6 symbols/min [2025-09-26T22:19:47.358919] [INFO ] [MAIN ] CX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:47.715886] [DEBUG] [MAIN ] CWK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:47.717485] [INFO ] [MAIN ] CWK: Generated 1820 derivative records from 50158 primary records. [2025-09-26T22:19:47.717769] [DEBUG] [LOCAL ] CWK: Saving derivative data. [2025-09-26T22:19:47.737025] [DEBUG] [LOCAL ] CWK: Derivative data saved (1820 records). [2025-09-26T22:19:47.738003] [INFO ] [MAIN ] CWK: Successfully saved derivative data. [2025-09-26T22:19:47.740717] [INFO ] [MAIN ] Derivative Progress: 478/2074 symbols completed. CWK took 1.1s. Estimated remaining: 11m 7s. Rate: 143.6 symbols/min [2025-09-26T22:19:47.766947] [DEBUG] [LOCAL ] CX: Loaded 53603 existing records from primary storage. [2025-09-26T22:19:47.767538] [INFO ] [MAIN ] CX: Loaded 53603 primary data records. [2025-09-26T22:19:47.969733] [DEBUG] [MAIN ] CWT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:47.984832] [INFO ] [MAIN ] CWT: Generated 1820 derivative records from 28294 primary records. [2025-09-26T22:19:48.006721] [DEBUG] [LOCAL ] CWT: Saving derivative data. [2025-09-26T22:19:48.157075] [DEBUG] [LOCAL ] CWT: Derivative data saved (1820 records). [2025-09-26T22:19:48.157226] [INFO ] [MAIN ] CWT: Successfully saved derivative data. [2025-09-26T22:19:48.159504] [INFO ] [MAIN ] Derivative Progress: 479/2074 symbols completed. CWT took 1.2s. Estimated remaining: 11m 6s. Rate: 143.6 symbols/min [2025-09-26T22:19:48.181499] [DEBUG] [MAIN ] CX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:48.182217] [INFO ] [MAIN ] CX: Generated 1820 derivative records from 53603 primary records. [2025-09-26T22:19:48.182283] [DEBUG] [LOCAL ] CX: Saving derivative data. [2025-09-26T22:19:48.198225] [DEBUG] [LOCAL ] CX: Derivative data saved (1820 records). [2025-09-26T22:19:48.198302] [INFO ] [MAIN ] CX: Successfully saved derivative data. [2025-09-26T22:19:48.200582] [INFO ] [MAIN ] Derivative Progress: 480/2074 symbols completed. CX took 0.8s. Estimated remaining: 11m 5s. Rate: 143.9 symbols/min [2025-09-26T22:19:48.201377] [INFO ] [MAIN ] CXE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:48.201868] [INFO ] [MAIN ] CXH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:48.201540] [INFO ] [MAIN ] CXM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:48.212105] [DEBUG] [LOCAL ] CXH: Loaded 4436 existing records from primary storage. [2025-09-26T22:19:48.212337] [INFO ] [MAIN ] CXH: Loaded 4436 primary data records. [2025-09-26T22:19:48.296689] [DEBUG] [LOCAL ] CXE: Loaded 7247 existing records from primary storage. [2025-09-26T22:19:48.307292] [INFO ] [MAIN ] CXE: Loaded 7247 primary data records. [2025-09-26T22:19:48.820877] [DEBUG] [LOCAL ] CXM: Loaded 48607 existing records from primary storage. [2025-09-26T22:19:48.946553] [INFO ] [MAIN ] CXM: Loaded 48607 primary data records. [2025-09-26T22:19:49.298561] [DEBUG] [MAIN ] CXH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:49.300888] [INFO ] [MAIN ] CXH: Generated 1820 derivative records from 4436 primary records. [2025-09-26T22:19:49.303100] [DEBUG] [LOCAL ] CXH: Saving derivative data. [2025-09-26T22:19:49.330995] [DEBUG] [MAIN ] CXE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:49.333883] [DEBUG] [LOCAL ] CXH: Derivative data saved (1820 records). [2025-09-26T22:19:49.334789] [INFO ] [MAIN ] CXE: Generated 1820 derivative records from 7247 primary records. [2025-09-26T22:19:49.335213] [DEBUG] [LOCAL ] CXE: Saving derivative data. [2025-09-26T22:19:49.335015] [INFO ] [MAIN ] CXH: Successfully saved derivative data. [2025-09-26T22:19:49.337931] [INFO ] [MAIN ] Derivative Progress: 481/2074 symbols completed. CXH took 1.1s. Estimated remaining: 11m 7s. Rate: 143.4 symbols/min [2025-09-26T22:19:49.350291] [INFO ] [MAIN ] CXW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:49.359483] [DEBUG] [LOCAL ] CXE: Derivative data saved (1820 records). [2025-09-26T22:19:49.359996] [INFO ] [MAIN ] CXE: Successfully saved derivative data. [2025-09-26T22:19:49.362637] [INFO ] [MAIN ] Derivative Progress: 482/2074 symbols completed. CXE took 1.2s. Estimated remaining: 11m 5s. Rate: 143.6 symbols/min [2025-09-26T22:19:49.363208] [INFO ] [MAIN ] CYD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:49.377043] [DEBUG] [MAIN ] CXM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:49.377939] [INFO ] [MAIN ] CXM: Generated 1820 derivative records from 48607 primary records. [2025-09-26T22:19:49.378078] [DEBUG] [LOCAL ] CXM: Saving derivative data. [2025-09-26T22:19:49.396041] [DEBUG] [LOCAL ] CXM: Derivative data saved (1820 records). [2025-09-26T22:19:49.396176] [INFO ] [MAIN ] CXM: Successfully saved derivative data. [2025-09-26T22:19:49.398976] [INFO ] [MAIN ] Derivative Progress: 483/2074 symbols completed. CXM took 1.2s. Estimated remaining: 11m 3s. Rate: 143.9 symbols/min [2025-09-26T22:19:49.399288] [INFO ] [MAIN ] CYH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:49.435876] [DEBUG] [LOCAL ] CYD: Loaded 27145 existing records from primary storage. [2025-09-26T22:19:49.449142] [INFO ] [MAIN ] CYD: Loaded 27145 primary data records. [2025-09-26T22:19:49.450515] [DEBUG] [LOCAL ] CXW: Loaded 44899 existing records from primary storage. [2025-09-26T22:19:49.468444] [INFO ] [MAIN ] CXW: Loaded 44899 primary data records. [2025-09-26T22:19:49.780754] [DEBUG] [LOCAL ] CYH: Loaded 48352 existing records from primary storage. [2025-09-26T22:19:49.856413] [INFO ] [MAIN ] CYH: Loaded 48352 primary data records. [2025-09-26T22:19:50.537517] [DEBUG] [MAIN ] CXW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:50.538457] [DEBUG] [MAIN ] CYD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:50.539373] [INFO ] [MAIN ] CYD: Generated 1820 derivative records from 27145 primary records. [2025-09-26T22:19:50.539623] [DEBUG] [LOCAL ] CYD: Saving derivative data. [2025-09-26T22:19:50.541000] [INFO ] [MAIN ] CXW: Generated 1820 derivative records from 44899 primary records. [2025-09-26T22:19:50.541920] [DEBUG] [LOCAL ] CXW: Saving derivative data. [2025-09-26T22:19:50.575981] [DEBUG] [LOCAL ] CYD: Derivative data saved (1820 records). [2025-09-26T22:19:50.580155] [INFO ] [MAIN ] CYD: Successfully saved derivative data. [2025-09-26T22:19:50.580068] [DEBUG] [LOCAL ] CXW: Derivative data saved (1820 records). [2025-09-26T22:19:50.582816] [INFO ] [MAIN ] Derivative Progress: 484/2074 symbols completed. CYD took 1.2s. Estimated remaining: 11m 5s. Rate: 143.4 symbols/min [2025-09-26T22:19:50.580458] [INFO ] [MAIN ] CXW: Successfully saved derivative data. [2025-09-26T22:19:50.586208] [INFO ] [MAIN ] Derivative Progress: 485/2074 symbols completed. CXW took 1.2s. Estimated remaining: 11m 4s. Rate: 143.7 symbols/min [2025-09-26T22:19:50.586678] [INFO ] [MAIN ] DAL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:50.587686] [INFO ] [MAIN ] D: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:50.604490] [DEBUG] [MAIN ] CYH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:50.605763] [INFO ] [MAIN ] CYH: Generated 1820 derivative records from 48352 primary records. [2025-09-26T22:19:50.605828] [DEBUG] [LOCAL ] CYH: Saving derivative data. [2025-09-26T22:19:50.622204] [DEBUG] [LOCAL ] CYH: Derivative data saved (1820 records). [2025-09-26T22:19:50.622284] [INFO ] [MAIN ] CYH: Successfully saved derivative data. [2025-09-26T22:19:50.625037] [INFO ] [MAIN ] Derivative Progress: 486/2074 symbols completed. CYH took 1.2s. Estimated remaining: 11m 2s. Rate: 143.9 symbols/min [2025-09-26T22:19:50.625538] [INFO ] [MAIN ] DAN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:50.700138] [DEBUG] [LOCAL ] DAL: Loaded 54533 existing records from primary storage. [2025-09-26T22:19:50.700392] [INFO ] [MAIN ] DAL: Loaded 54533 primary data records. [2025-09-26T22:19:50.846808] [DEBUG] [LOCAL ] D: Loaded 54426 existing records from primary storage. [2025-09-26T22:19:50.847201] [INFO ] [MAIN ] D: Loaded 54426 primary data records. [2025-09-26T22:19:50.853535] [DEBUG] [LOCAL ] DAN: Loaded 49753 existing records from primary storage. [2025-09-26T22:19:50.869175] [INFO ] [MAIN ] DAN: Loaded 49753 primary data records. [2025-09-26T22:19:51.717345] [DEBUG] [MAIN ] DAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:51.718534] [INFO ] [MAIN ] DAL: Generated 1820 derivative records from 54533 primary records. [2025-09-26T22:19:51.719109] [DEBUG] [LOCAL ] DAL: Saving derivative data. [2025-09-26T22:19:51.740582] [DEBUG] [LOCAL ] DAL: Derivative data saved (1820 records). [2025-09-26T22:19:51.742334] [INFO ] [MAIN ] DAL: Successfully saved derivative data. [2025-09-26T22:19:51.744814] [INFO ] [MAIN ] Derivative Progress: 487/2074 symbols completed. DAL took 1.2s. Estimated remaining: 11m 4s. Rate: 143.4 symbols/min [2025-09-26T22:19:51.771053] [INFO ] [MAIN ] DAO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:51.771715] [DEBUG] [MAIN ] DAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:51.772198] [DEBUG] [MAIN ] D: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:51.773506] [INFO ] [MAIN ] DAN: Generated 1820 derivative records from 49753 primary records. [2025-09-26T22:19:51.773777] [DEBUG] [LOCAL ] DAN: Saving derivative data. [2025-09-26T22:19:51.774384] [INFO ] [MAIN ] D: Generated 1820 derivative records from 54426 primary records. [2025-09-26T22:19:51.774467] [DEBUG] [LOCAL ] D: Saving derivative data. [2025-09-26T22:19:51.808931] [DEBUG] [LOCAL ] DAN: Derivative data saved (1820 records). [2025-09-26T22:19:51.808342] [DEBUG] [LOCAL ] D: Derivative data saved (1820 records). [2025-09-26T22:19:51.809103] [INFO ] [MAIN ] D: Successfully saved derivative data. [2025-09-26T22:19:51.809194] [INFO ] [MAIN ] DAN: Successfully saved derivative data. [2025-09-26T22:19:51.813300] [INFO ] [MAIN ] Derivative Progress: 488/2074 symbols completed. D took 1.2s. Estimated remaining: 11m 2s. Rate: 143.7 symbols/min [2025-09-26T22:19:51.822289] [INFO ] [MAIN ] Derivative Progress: 489/2074 symbols completed. DAN took 1.2s. Estimated remaining: 11m 1s. Rate: 144.0 symbols/min [2025-09-26T22:19:51.822537] [INFO ] [MAIN ] DAR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:51.822772] [INFO ] [MAIN ] DAVA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:51.832924] [DEBUG] [LOCAL ] DAO: Loaded 21546 existing records from primary storage. [2025-09-26T22:19:51.833273] [INFO ] [MAIN ] DAO: Loaded 21546 primary data records. [2025-09-26T22:19:52.209367] [DEBUG] [LOCAL ] DAVA: Loaded 41308 existing records from primary storage. [2025-09-26T22:19:52.209784] [INFO ] [MAIN ] DAVA: Loaded 41308 primary data records. [2025-09-26T22:19:52.294323] [DEBUG] [LOCAL ] DAR: Loaded 52603 existing records from primary storage. [2025-09-26T22:19:52.310150] [INFO ] [MAIN ] DAR: Loaded 52603 primary data records. [2025-09-26T22:19:52.965913] [DEBUG] [MAIN ] DAO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:52.967482] [INFO ] [MAIN ] DAO: Generated 1820 derivative records from 21546 primary records. [2025-09-26T22:19:52.968337] [DEBUG] [LOCAL ] DAO: Saving derivative data. [2025-09-26T22:19:52.987326] [DEBUG] [LOCAL ] DAO: Derivative data saved (1820 records). [2025-09-26T22:19:52.987802] [INFO ] [MAIN ] DAO: Successfully saved derivative data. [2025-09-26T22:19:52.991018] [INFO ] [MAIN ] Derivative Progress: 490/2074 symbols completed. DAO took 1.2s. Estimated remaining: 11m 3s. Rate: 143.4 symbols/min [2025-09-26T22:19:52.991971] [INFO ] [MAIN ] DAY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:53.010591] [DEBUG] [MAIN ] DAVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:53.013426] [INFO ] [MAIN ] DAVA: Generated 1820 derivative records from 41308 primary records. [2025-09-26T22:19:53.013686] [DEBUG] [LOCAL ] DAVA: Saving derivative data. [2025-09-26T22:19:53.027711] [DEBUG] [MAIN ] DAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:53.040761] [INFO ] [MAIN ] DAR: Generated 1820 derivative records from 52603 primary records. [2025-09-26T22:19:53.042034] [DEBUG] [LOCAL ] DAR: Saving derivative data. [2025-09-26T22:19:53.076567] [DEBUG] [LOCAL ] DAVA: Derivative data saved (1820 records). [2025-09-26T22:19:53.075785] [DEBUG] [LOCAL ] DAR: Derivative data saved (1820 records). [2025-09-26T22:19:53.076851] [INFO ] [MAIN ] DAR: Successfully saved derivative data. [2025-09-26T22:19:53.080042] [INFO ] [MAIN ] Derivative Progress: 491/2074 symbols completed. DAR took 1.3s. Estimated remaining: 11m 1s. Rate: 143.7 symbols/min [2025-09-26T22:19:53.076729] [INFO ] [MAIN ] DAVA: Successfully saved derivative data. [2025-09-26T22:19:53.083168] [INFO ] [MAIN ] DB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:53.082890] [INFO ] [MAIN ] Derivative Progress: 492/2074 symbols completed. DAVA took 1.3s. Estimated remaining: 10m 59s. Rate: 144.0 symbols/min [2025-09-26T22:19:53.083918] [INFO ] [MAIN ] DBI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:53.101898] [DEBUG] [LOCAL ] DAY: Loaded 50491 existing records from primary storage. [2025-09-26T22:19:53.102134] [INFO ] [MAIN ] DAY: Loaded 50491 primary data records. [2025-09-26T22:19:53.470421] [DEBUG] [LOCAL ] DBI: Loaded 45524 existing records from primary storage. [2025-09-26T22:19:53.471343] [INFO ] [MAIN ] DBI: Loaded 45524 primary data records. [2025-09-26T22:19:53.540671] [DEBUG] [LOCAL ] DB: Loaded 53377 existing records from primary storage. [2025-09-26T22:19:53.560608] [INFO ] [MAIN ] DB: Loaded 53377 primary data records. [2025-09-26T22:19:54.188882] [DEBUG] [MAIN ] DAY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:54.190509] [INFO ] [MAIN ] DAY: Generated 1820 derivative records from 50491 primary records. [2025-09-26T22:19:54.190830] [DEBUG] [LOCAL ] DAY: Saving derivative data. [2025-09-26T22:19:54.211715] [DEBUG] [LOCAL ] DAY: Derivative data saved (1820 records). [2025-09-26T22:19:54.211999] [INFO ] [MAIN ] DAY: Successfully saved derivative data. [2025-09-26T22:19:54.215069] [INFO ] [MAIN ] Derivative Progress: 493/2074 symbols completed. DAY took 1.2s. Estimated remaining: 11m 1s. Rate: 143.5 symbols/min [2025-09-26T22:19:54.236326] [DEBUG] [MAIN ] DBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:54.237429] [INFO ] [MAIN ] DBI: Generated 1820 derivative records from 45524 primary records. [2025-09-26T22:19:54.237521] [DEBUG] [LOCAL ] DBI: Saving derivative data. [2025-09-26T22:19:54.256738] [DEBUG] [LOCAL ] DBI: Derivative data saved (1820 records). [2025-09-26T22:19:54.258757] [INFO ] [MAIN ] DBI: Successfully saved derivative data. [2025-09-26T22:19:54.261496] [INFO ] [MAIN ] Derivative Progress: 494/2074 symbols completed. DBI took 1.2s. Estimated remaining: 10m 60s. Rate: 143.7 symbols/min [2025-09-26T22:19:54.275196] [DEBUG] [MAIN ] DB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:54.276050] [INFO ] [MAIN ] DB: Generated 1820 derivative records from 53377 primary records. [2025-09-26T22:19:54.276122] [DEBUG] [LOCAL ] DB: Saving derivative data. [2025-09-26T22:19:54.293499] [DEBUG] [LOCAL ] DB: Derivative data saved (1820 records). [2025-09-26T22:19:54.293604] [INFO ] [MAIN ] DB: Successfully saved derivative data. [2025-09-26T22:19:54.296388] [INFO ] [MAIN ] Derivative Progress: 495/2074 symbols completed. DB took 1.2s. Estimated remaining: 10m 58s. Rate: 144.0 symbols/min [2025-09-26T22:19:54.297390] [INFO ] [MAIN ] DCI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:54.297167] [INFO ] [MAIN ] DBRG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:54.297910] [INFO ] [MAIN ] DBL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:54.313888] [DEBUG] [LOCAL ] DBL: Loaded 9259 existing records from primary storage. [2025-09-26T22:19:54.314160] [INFO ] [MAIN ] DBL: Loaded 9259 primary data records. [2025-09-26T22:19:54.513475] [DEBUG] [LOCAL ] DCI: Loaded 38065 existing records from primary storage. [2025-09-26T22:19:54.531494] [INFO ] [MAIN ] DCI: Loaded 38065 primary data records. [2025-09-26T22:19:54.754514] [DEBUG] [LOCAL ] DBRG: Loaded 50526 existing records from primary storage. [2025-09-26T22:19:54.779277] [INFO ] [MAIN ] DBRG: Loaded 50526 primary data records. [2025-09-26T22:19:55.432543] [DEBUG] [MAIN ] DBL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:55.434107] [INFO ] [MAIN ] DBL: Generated 1820 derivative records from 9259 primary records. [2025-09-26T22:19:55.434569] [DEBUG] [LOCAL ] DBL: Saving derivative data. [2025-09-26T22:19:55.455174] [DEBUG] [LOCAL ] DBL: Derivative data saved (1820 records). [2025-09-26T22:19:55.456824] [INFO ] [MAIN ] DBL: Successfully saved derivative data. [2025-09-26T22:19:55.459494] [INFO ] [MAIN ] Derivative Progress: 496/2074 symbols completed. DBL took 1.2s. Estimated remaining: 10m 60s. Rate: 143.5 symbols/min [2025-09-26T22:19:55.461925] [INFO ] [MAIN ] DCO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:55.476104] [DEBUG] [MAIN ] DCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:55.477006] [INFO ] [MAIN ] DCI: Generated 1820 derivative records from 38065 primary records. [2025-09-26T22:19:55.477179] [DEBUG] [LOCAL ] DCI: Saving derivative data. [2025-09-26T22:19:55.501787] [DEBUG] [LOCAL ] DCI: Derivative data saved (1820 records). [2025-09-26T22:19:55.519574] [INFO ] [MAIN ] DCI: Successfully saved derivative data. [2025-09-26T22:19:55.522475] [INFO ] [MAIN ] Derivative Progress: 497/2074 symbols completed. DCI took 1.2s. Estimated remaining: 10m 58s. Rate: 143.7 symbols/min [2025-09-26T22:19:55.523723] [INFO ] [MAIN ] DD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:55.523521] [DEBUG] [MAIN ] DBRG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:55.525350] [INFO ] [MAIN ] DBRG: Generated 1820 derivative records from 50526 primary records. [2025-09-26T22:19:55.525475] [DEBUG] [LOCAL ] DBRG: Saving derivative data. [2025-09-26T22:19:55.524341] [DEBUG] [LOCAL ] DCO: Loaded 14003 existing records from primary storage. [2025-09-26T22:19:55.527068] [INFO ] [MAIN ] DCO: Loaded 14003 primary data records. [2025-09-26T22:19:55.665287] [DEBUG] [LOCAL ] DBRG: Derivative data saved (1820 records). [2025-09-26T22:19:55.682597] [INFO ] [MAIN ] DBRG: Successfully saved derivative data. [2025-09-26T22:19:55.766751] [INFO ] [MAIN ] Derivative Progress: 498/2074 symbols completed. DBRG took 1.5s. Estimated remaining: 10m 57s. Rate: 143.8 symbols/min [2025-09-26T22:19:55.774163] [INFO ] [MAIN ] DDD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:55.923467] [DEBUG] [LOCAL ] DD: Loaded 53595 existing records from primary storage. [2025-09-26T22:19:55.923953] [INFO ] [MAIN ] DD: Loaded 53595 primary data records. [2025-09-26T22:19:56.307980] [DEBUG] [LOCAL ] DDD: Loaded 51647 existing records from primary storage. [2025-09-26T22:19:56.310849] [INFO ] [MAIN ] DDD: Loaded 51647 primary data records. [2025-09-26T22:19:56.310544] [DEBUG] [MAIN ] DCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:56.324600] [INFO ] [MAIN ] DCO: Generated 1820 derivative records from 14003 primary records. [2025-09-26T22:19:56.365951] [DEBUG] [LOCAL ] DCO: Saving derivative data. [2025-09-26T22:19:56.444542] [DEBUG] [LOCAL ] DCO: Derivative data saved (1820 records). [2025-09-26T22:19:56.444766] [INFO ] [MAIN ] DCO: Successfully saved derivative data. [2025-09-26T22:19:56.447661] [INFO ] [MAIN ] Derivative Progress: 499/2074 symbols completed. DCO took 1.0s. Estimated remaining: 10m 58s. Rate: 143.7 symbols/min [2025-09-26T22:19:56.456062] [INFO ] [MAIN ] DDL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:56.697070] [DEBUG] [MAIN ] DD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:56.698580] [INFO ] [MAIN ] DD: Generated 1820 derivative records from 53595 primary records. [2025-09-26T22:19:56.699514] [DEBUG] [LOCAL ] DD: Saving derivative data. [2025-09-26T22:19:56.731382] [DEBUG] [LOCAL ] DDL: Loaded 37016 existing records from primary storage. [2025-09-26T22:19:56.733229] [INFO ] [MAIN ] DDL: Loaded 37016 primary data records. [2025-09-26T22:19:56.733003] [DEBUG] [LOCAL ] DD: Derivative data saved (1820 records). [2025-09-26T22:19:56.733704] [INFO ] [MAIN ] DD: Successfully saved derivative data. [2025-09-26T22:19:56.761775] [INFO ] [MAIN ] Derivative Progress: 500/2074 symbols completed. DD took 1.2s. Estimated remaining: 10m 57s. Rate: 143.7 symbols/min [2025-09-26T22:19:56.825906] [INFO ] [MAIN ] DDS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:57.148400] [DEBUG] [MAIN ] DDD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:57.155992] [INFO ] [MAIN ] DDD: Generated 1820 derivative records from 51647 primary records. [2025-09-26T22:19:57.156184] [DEBUG] [LOCAL ] DDD: Saving derivative data. [2025-09-26T22:19:57.156849] [DEBUG] [LOCAL ] DDS: Loaded 13374 existing records from primary storage. [2025-09-26T22:19:57.157974] [INFO ] [MAIN ] DDS: Loaded 13374 primary data records. [2025-09-26T22:19:57.317805] [DEBUG] [LOCAL ] DDD: Derivative data saved (1820 records). [2025-09-26T22:19:57.328702] [INFO ] [MAIN ] DDD: Successfully saved derivative data. [2025-09-26T22:19:57.348146] [INFO ] [MAIN ] Derivative Progress: 501/2074 symbols completed. DDD took 1.6s. Estimated remaining: 10m 57s. Rate: 143.6 symbols/min [2025-09-26T22:19:57.366985] [INFO ] [MAIN ] DDT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:57.516976] [DEBUG] [LOCAL ] DDT: Loaded 2117 existing records from primary storage. [2025-09-26T22:19:57.517418] [INFO ] [MAIN ] DDT: Loaded 2117 primary data records. [2025-09-26T22:19:57.677862] [DEBUG] [MAIN ] DDL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:57.717838] [INFO ] [MAIN ] DDL: Generated 1820 derivative records from 37016 primary records. [2025-09-26T22:19:57.742303] [DEBUG] [LOCAL ] DDL: Saving derivative data. [2025-09-26T22:19:57.885618] [DEBUG] [LOCAL ] DDL: Derivative data saved (1820 records). [2025-09-26T22:19:57.885983] [INFO ] [MAIN ] DDL: Successfully saved derivative data. [2025-09-26T22:19:57.888622] [INFO ] [MAIN ] Derivative Progress: 502/2074 symbols completed. DDL took 1.4s. Estimated remaining: 10m 57s. Rate: 143.5 symbols/min [2025-09-26T22:19:57.890068] [INFO ] [MAIN ] DE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:57.910763] [DEBUG] [MAIN ] DDS: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:19:57.911761] [INFO ] [MAIN ] DDS: Generated 1819 derivative records from 13374 primary records. [2025-09-26T22:19:57.911906] [DEBUG] [LOCAL ] DDS: Saving derivative data. [2025-09-26T22:19:57.931835] [DEBUG] [LOCAL ] DDS: Derivative data saved (1819 records). [2025-09-26T22:19:57.932319] [INFO ] [MAIN ] DDS: Successfully saved derivative data. [2025-09-26T22:19:57.935031] [INFO ] [MAIN ] Derivative Progress: 503/2074 symbols completed. DDS took 1.1s. Estimated remaining: 10m 56s. Rate: 143.8 symbols/min [2025-09-26T22:19:57.935500] [INFO ] [MAIN ] DEA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:57.965909] [DEBUG] [MAIN ] DDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:57.967004] [INFO ] [MAIN ] DDT: Generated 1820 derivative records from 2117 primary records. [2025-09-26T22:19:57.967241] [DEBUG] [LOCAL ] DDT: Saving derivative data. [2025-09-26T22:19:57.982269] [DEBUG] [LOCAL ] DDT: Derivative data saved (1820 records). [2025-09-26T22:19:57.983347] [INFO ] [MAIN ] DDT: Successfully saved derivative data. [2025-09-26T22:19:57.986319] [INFO ] [MAIN ] Derivative Progress: 504/2074 symbols completed. DDT took 0.6s. Estimated remaining: 10m 54s. Rate: 144.0 symbols/min [2025-09-26T22:19:58.000453] [INFO ] [MAIN ] DEC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:58.001809] [DEBUG] [LOCAL ] DE: Loaded 48397 existing records from primary storage. [2025-09-26T22:19:58.002064] [INFO ] [MAIN ] DE: Loaded 48397 primary data records. [2025-09-26T22:19:58.151423] [DEBUG] [LOCAL ] DEA: Loaded 41860 existing records from primary storage. [2025-09-26T22:19:58.156936] [INFO ] [MAIN ] DEA: Loaded 41860 primary data records. [2025-09-26T22:19:58.443011] [DEBUG] [LOCAL ] DEC: Loaded 31121 existing records from primary storage. [2025-09-26T22:19:58.482042] [INFO ] [MAIN ] DEC: Loaded 31121 primary data records. [2025-09-26T22:19:59.148613] [DEBUG] [MAIN ] DE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:59.150341] [INFO ] [MAIN ] DE: Generated 1820 derivative records from 48397 primary records. [2025-09-26T22:19:59.150482] [DEBUG] [LOCAL ] DE: Saving derivative data. [2025-09-26T22:19:59.194415] [DEBUG] [LOCAL ] DE: Derivative data saved (1820 records). [2025-09-26T22:19:59.193305] [DEBUG] [MAIN ] DEA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:59.194592] [INFO ] [MAIN ] DE: Successfully saved derivative data. [2025-09-26T22:19:59.198466] [INFO ] [MAIN ] DEA: Generated 1820 derivative records from 41860 primary records. [2025-09-26T22:19:59.197448] [INFO ] [MAIN ] Derivative Progress: 505/2074 symbols completed. DE took 1.3s. Estimated remaining: 10m 56s. Rate: 143.5 symbols/min [2025-09-26T22:19:59.198670] [DEBUG] [LOCAL ] DEA: Saving derivative data. [2025-09-26T22:19:59.199970] [INFO ] [MAIN ] DECK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:59.221108] [DEBUG] [LOCAL ] DEA: Derivative data saved (1820 records). [2025-09-26T22:19:59.221422] [INFO ] [MAIN ] DEA: Successfully saved derivative data. [2025-09-26T22:19:59.249042] [INFO ] [MAIN ] Derivative Progress: 506/2074 symbols completed. DEA took 1.3s. Estimated remaining: 10m 55s. Rate: 143.7 symbols/min [2025-09-26T22:19:59.250811] [INFO ] [MAIN ] DELL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:59.252568] [DEBUG] [MAIN ] DEC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:19:59.253924] [INFO ] [MAIN ] DEC: Generated 1820 derivative records from 31121 primary records. [2025-09-26T22:19:59.256435] [DEBUG] [LOCAL ] DEC: Saving derivative data. [2025-09-26T22:19:59.275728] [DEBUG] [LOCAL ] DEC: Derivative data saved (1820 records). [2025-09-26T22:19:59.275864] [INFO ] [MAIN ] DEC: Successfully saved derivative data. [2025-09-26T22:19:59.279670] [INFO ] [MAIN ] Derivative Progress: 507/2074 symbols completed. DEC took 1.3s. Estimated remaining: 10m 53s. Rate: 144.0 symbols/min [2025-09-26T22:19:59.280027] [INFO ] [MAIN ] DEO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:19:59.363416] [DEBUG] [LOCAL ] DECK: Loaded 54078 existing records from primary storage. [2025-09-26T22:19:59.363821] [INFO ] [MAIN ] DECK: Loaded 54078 primary data records. [2025-09-26T22:19:59.531219] [DEBUG] [LOCAL ] DELL: Loaded 54515 existing records from primary storage. [2025-09-26T22:19:59.537156] [INFO ] [MAIN ] DELL: Loaded 54515 primary data records. [2025-09-26T22:19:59.553611] [DEBUG] [LOCAL ] DEO: Loaded 49777 existing records from primary storage. [2025-09-26T22:19:59.647715] [INFO ] [MAIN ] DEO: Loaded 49777 primary data records. [2025-09-26T22:20:00.433724] [DEBUG] [MAIN ] DECK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:00.435006] [INFO ] [MAIN ] DECK: Generated 1820 derivative records from 54078 primary records. [2025-09-26T22:20:00.435720] [DEBUG] [LOCAL ] DECK: Saving derivative data. [2025-09-26T22:20:00.465155] [DEBUG] [LOCAL ] DECK: Derivative data saved (1820 records). [2025-09-26T22:20:00.470597] [INFO ] [MAIN ] DECK: Successfully saved derivative data. [2025-09-26T22:20:00.471157] [DEBUG] [MAIN ] DELL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:00.474492] [INFO ] [MAIN ] DELL: Generated 1820 derivative records from 54515 primary records. [2025-09-26T22:20:00.473481] [INFO ] [MAIN ] Derivative Progress: 508/2074 symbols completed. DECK took 1.3s. Estimated remaining: 10m 55s. Rate: 143.5 symbols/min [2025-09-26T22:20:00.475179] [DEBUG] [LOCAL ] DELL: Saving derivative data. [2025-09-26T22:20:00.510012] [DEBUG] [LOCAL ] DELL: Derivative data saved (1820 records). [2025-09-26T22:20:00.509841] [DEBUG] [MAIN ] DEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:00.510249] [INFO ] [MAIN ] DELL: Successfully saved derivative data. [2025-09-26T22:20:00.513733] [INFO ] [MAIN ] Derivative Progress: 509/2074 symbols completed. DELL took 1.3s. Estimated remaining: 10m 53s. Rate: 143.7 symbols/min [2025-09-26T22:20:00.514711] [INFO ] [MAIN ] DEO: Generated 1820 derivative records from 49777 primary records. [2025-09-26T22:20:00.514998] [DEBUG] [LOCAL ] DEO: Saving derivative data. [2025-09-26T22:20:00.532404] [DEBUG] [LOCAL ] DEO: Derivative data saved (1820 records). [2025-09-26T22:20:00.532506] [INFO ] [MAIN ] DEO: Successfully saved derivative data. [2025-09-26T22:20:00.536429] [INFO ] [MAIN ] Derivative Progress: 510/2074 symbols completed. DEO took 1.3s. Estimated remaining: 10m 52s. Rate: 144.0 symbols/min [2025-09-26T22:20:00.537580] [INFO ] [MAIN ] DG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:00.538330] [INFO ] [MAIN ] DGX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:00.537411] [INFO ] [MAIN ] DFH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:00.587237] [DEBUG] [LOCAL ] DFH: Loaded 33106 existing records from primary storage. [2025-09-26T22:20:00.587425] [INFO ] [MAIN ] DFH: Loaded 33106 primary data records. [2025-09-26T22:20:00.757372] [DEBUG] [LOCAL ] DGX: Loaded 45736 existing records from primary storage. [2025-09-26T22:20:00.784444] [DEBUG] [LOCAL ] DG: Loaded 54068 existing records from primary storage. [2025-09-26T22:20:00.816817] [INFO ] [MAIN ] DGX: Loaded 45736 primary data records. [2025-09-26T22:20:00.838164] [INFO ] [MAIN ] DG: Loaded 54068 primary data records. [2025-09-26T22:20:01.710960] [DEBUG] [MAIN ] DFH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:01.712719] [INFO ] [MAIN ] DFH: Generated 1820 derivative records from 33106 primary records. [2025-09-26T22:20:01.712939] [DEBUG] [LOCAL ] DFH: Saving derivative data. [2025-09-26T22:20:01.733890] [DEBUG] [LOCAL ] DFH: Derivative data saved (1820 records). [2025-09-26T22:20:01.734227] [INFO ] [MAIN ] DFH: Successfully saved derivative data. [2025-09-26T22:20:01.736501] [INFO ] [MAIN ] Derivative Progress: 511/2074 symbols completed. DFH took 1.2s. Estimated remaining: 10m 54s. Rate: 143.5 symbols/min [2025-09-26T22:20:01.737018] [INFO ] [MAIN ] DHR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:01.774190] [DEBUG] [MAIN ] DG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:01.775794] [INFO ] [MAIN ] DG: Generated 1820 derivative records from 54068 primary records. [2025-09-26T22:20:01.776438] [DEBUG] [LOCAL ] DG: Saving derivative data. [2025-09-26T22:20:01.776313] [DEBUG] [MAIN ] DGX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:01.777424] [INFO ] [MAIN ] DGX: Generated 1820 derivative records from 45736 primary records. [2025-09-26T22:20:01.778940] [DEBUG] [LOCAL ] DGX: Saving derivative data. [2025-09-26T22:20:01.820726] [DEBUG] [LOCAL ] DGX: Derivative data saved (1820 records). [2025-09-26T22:20:01.822281] [INFO ] [MAIN ] DGX: Successfully saved derivative data. [2025-09-26T22:20:01.825957] [INFO ] [MAIN ] Derivative Progress: 512/2074 symbols completed. DGX took 1.3s. Estimated remaining: 10m 52s. Rate: 143.7 symbols/min [2025-09-26T22:20:01.827199] [INFO ] [MAIN ] DHT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:01.830184] [DEBUG] [LOCAL ] DG: Derivative data saved (1820 records). [2025-09-26T22:20:01.830906] [INFO ] [MAIN ] DG: Successfully saved derivative data. [2025-09-26T22:20:01.848510] [INFO ] [MAIN ] Derivative Progress: 513/2074 symbols completed. DG took 1.3s. Estimated remaining: 10m 51s. Rate: 144.0 symbols/min [2025-09-26T22:20:01.849199] [INFO ] [MAIN ] DHX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:01.868839] [DEBUG] [LOCAL ] DHX: Loaded 13404 existing records from primary storage. [2025-09-26T22:20:01.888506] [INFO ] [MAIN ] DHX: Loaded 13404 primary data records. [2025-09-26T22:20:01.913394] [DEBUG] [LOCAL ] DHR: Loaded 54139 existing records from primary storage. [2025-09-26T22:20:01.944121] [INFO ] [MAIN ] DHR: Loaded 54139 primary data records. [2025-09-26T22:20:02.409892] [DEBUG] [LOCAL ] DHT: Loaded 48583 existing records from primary storage. [2025-09-26T22:20:02.426123] [INFO ] [MAIN ] DHT: Loaded 48583 primary data records. [2025-09-26T22:20:03.020456] [DEBUG] [MAIN ] DHX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:03.023409] [INFO ] [MAIN ] DHX: Generated 1820 derivative records from 13404 primary records. [2025-09-26T22:20:03.024271] [DEBUG] [LOCAL ] DHX: Saving derivative data. [2025-09-26T22:20:03.052156] [DEBUG] [LOCAL ] DHX: Derivative data saved (1820 records). [2025-09-26T22:20:03.065943] [INFO ] [MAIN ] DHX: Successfully saved derivative data. [2025-09-26T22:20:03.066635] [DEBUG] [MAIN ] DHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:03.070125] [INFO ] [MAIN ] Derivative Progress: 514/2074 symbols completed. DHX took 1.2s. Estimated remaining: 10m 53s. Rate: 143.4 symbols/min [2025-09-26T22:20:03.067528] [INFO ] [MAIN ] DHR: Generated 1820 derivative records from 54139 primary records. [2025-09-26T22:20:03.071182] [DEBUG] [LOCAL ] DHR: Saving derivative data. [2025-09-26T22:20:03.071079] [INFO ] [MAIN ] DIAX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:03.110037] [DEBUG] [LOCAL ] DIAX: Loaded 12780 existing records from primary storage. [2025-09-26T22:20:03.119469] [INFO ] [MAIN ] DIAX: Loaded 12780 primary data records. [2025-09-26T22:20:03.124947] [DEBUG] [MAIN ] DHT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:03.133115] [INFO ] [MAIN ] DHT: Generated 1820 derivative records from 48583 primary records. [2025-09-26T22:20:03.132194] [DEBUG] [LOCAL ] DHR: Derivative data saved (1820 records). [2025-09-26T22:20:03.152337] [DEBUG] [LOCAL ] DHT: Saving derivative data. [2025-09-26T22:20:03.165237] [INFO ] [MAIN ] DHR: Successfully saved derivative data. [2025-09-26T22:20:03.247567] [INFO ] [MAIN ] Derivative Progress: 515/2074 symbols completed. DHR took 1.5s. Estimated remaining: 10m 52s. Rate: 143.6 symbols/min [2025-09-26T22:20:03.253043] [INFO ] [MAIN ] DIN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:03.354680] [DEBUG] [LOCAL ] DHT: Derivative data saved (1820 records). [2025-09-26T22:20:03.467052] [INFO ] [MAIN ] DHT: Successfully saved derivative data. [2025-09-26T22:20:03.479250] [INFO ] [MAIN ] Derivative Progress: 516/2074 symbols completed. DHT took 1.7s. Estimated remaining: 10m 51s. Rate: 143.7 symbols/min [2025-09-26T22:20:03.479819] [INFO ] [MAIN ] DINO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:03.533227] [DEBUG] [LOCAL ] DIN: Loaded 37823 existing records from primary storage. [2025-09-26T22:20:03.533532] [DEBUG] [MAIN ] DIAX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:03.533895] [INFO ] [MAIN ] DIN: Loaded 37823 primary data records. [2025-09-26T22:20:03.534745] [INFO ] [MAIN ] DIAX: Generated 1820 derivative records from 12780 primary records. [2025-09-26T22:20:03.535021] [DEBUG] [LOCAL ] DIAX: Saving derivative data. [2025-09-26T22:20:03.708033] [DEBUG] [LOCAL ] DIAX: Derivative data saved (1820 records). [2025-09-26T22:20:03.710490] [INFO ] [MAIN ] DIAX: Successfully saved derivative data. [2025-09-26T22:20:03.718277] [INFO ] [MAIN ] Derivative Progress: 517/2074 symbols completed. DIAX took 0.6s. Estimated remaining: 10m 50s. Rate: 143.8 symbols/min [2025-09-26T22:20:03.709756] [DEBUG] [LOCAL ] DINO: Loaded 53729 existing records from primary storage. [2025-09-26T22:20:03.718691] [INFO ] [MAIN ] DINO: Loaded 53729 primary data records. [2025-09-26T22:20:03.734500] [INFO ] [MAIN ] DIS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:04.353449] [DEBUG] [MAIN ] DIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:04.371219] [INFO ] [MAIN ] DIN: Generated 1820 derivative records from 37823 primary records. [2025-09-26T22:20:04.371489] [DEBUG] [LOCAL ] DIN: Saving derivative data. [2025-09-26T22:20:04.373459] [DEBUG] [LOCAL ] DIS: Loaded 54568 existing records from primary storage. [2025-09-26T22:20:04.375255] [INFO ] [MAIN ] DIS: Loaded 54568 primary data records. [2025-09-26T22:20:04.537901] [DEBUG] [LOCAL ] DIN: Derivative data saved (1820 records). [2025-09-26T22:20:04.543267] [INFO ] [MAIN ] DIN: Successfully saved derivative data. [2025-09-26T22:20:04.545818] [INFO ] [MAIN ] Derivative Progress: 518/2074 symbols completed. DIN took 1.3s. Estimated remaining: 10m 50s. Rate: 143.5 symbols/min [2025-09-26T22:20:04.570386] [INFO ] [MAIN ] DKS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:04.581889] [DEBUG] [MAIN ] DINO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:04.606589] [INFO ] [MAIN ] DINO: Generated 1820 derivative records from 53729 primary records. [2025-09-26T22:20:04.642355] [DEBUG] [LOCAL ] DINO: Saving derivative data. [2025-09-26T22:20:04.793138] [DEBUG] [LOCAL ] DINO: Derivative data saved (1820 records). [2025-09-26T22:20:04.793576] [INFO ] [MAIN ] DINO: Successfully saved derivative data. [2025-09-26T22:20:04.796878] [INFO ] [MAIN ] Derivative Progress: 519/2074 symbols completed. DINO took 1.3s. Estimated remaining: 10m 49s. Rate: 143.7 symbols/min [2025-09-26T22:20:04.798346] [INFO ] [MAIN ] DLB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:04.847154] [DEBUG] [MAIN ] DIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:04.848364] [INFO ] [MAIN ] DIS: Generated 1820 derivative records from 54568 primary records. [2025-09-26T22:20:04.848632] [DEBUG] [LOCAL ] DIS: Saving derivative data. [2025-09-26T22:20:04.879363] [DEBUG] [LOCAL ] DIS: Derivative data saved (1820 records). [2025-09-26T22:20:04.879764] [INFO ] [MAIN ] DIS: Successfully saved derivative data. [2025-09-26T22:20:04.897161] [DEBUG] [LOCAL ] DLB: Loaded 32601 existing records from primary storage. [2025-09-26T22:20:04.899583] [INFO ] [MAIN ] Derivative Progress: 520/2074 symbols completed. DIS took 1.2s. Estimated remaining: 10m 48s. Rate: 143.9 symbols/min [2025-09-26T22:20:04.901281] [DEBUG] [LOCAL ] DKS: Loaded 50579 existing records from primary storage. [2025-09-26T22:20:04.901671] [INFO ] [MAIN ] DLB: Loaded 32601 primary data records. [2025-09-26T22:20:04.900056] [INFO ] [MAIN ] DLX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:04.901529] [INFO ] [MAIN ] DKS: Loaded 50579 primary data records. [2025-09-26T22:20:05.250455] [DEBUG] [LOCAL ] DLX: Loaded 29284 existing records from primary storage. [2025-09-26T22:20:05.313680] [INFO ] [MAIN ] DLX: Loaded 29284 primary data records. [2025-09-26T22:20:06.083775] [DEBUG] [MAIN ] DKS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:06.086231] [INFO ] [MAIN ] DKS: Generated 1820 derivative records from 50579 primary records. [2025-09-26T22:20:06.086407] [DEBUG] [LOCAL ] DKS: Saving derivative data. [2025-09-26T22:20:06.113891] [DEBUG] [MAIN ] DLB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:06.115424] [INFO ] [MAIN ] DLB: Generated 1820 derivative records from 32601 primary records. [2025-09-26T22:20:06.116170] [DEBUG] [LOCAL ] DLB: Saving derivative data. [2025-09-26T22:20:06.136071] [DEBUG] [LOCAL ] DLB: Derivative data saved (1820 records). [2025-09-26T22:20:06.137608] [INFO ] [MAIN ] DLB: Successfully saved derivative data. [2025-09-26T22:20:06.142565] [INFO ] [MAIN ] Derivative Progress: 521/2074 symbols completed. DLB took 1.3s. Estimated remaining: 10m 50s. Rate: 143.3 symbols/min [2025-09-26T22:20:06.139165] [DEBUG] [LOCAL ] DKS: Derivative data saved (1820 records). [2025-09-26T22:20:06.145480] [INFO ] [MAIN ] DKS: Successfully saved derivative data. [2025-09-26T22:20:06.148172] [INFO ] [MAIN ] DLY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:06.148084] [INFO ] [MAIN ] Derivative Progress: 522/2074 symbols completed. DKS took 1.6s. Estimated remaining: 10m 49s. Rate: 143.6 symbols/min [2025-09-26T22:20:06.148962] [INFO ] [MAIN ] DMB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:06.172929] [DEBUG] [MAIN ] DLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:06.174345] [INFO ] [MAIN ] DLX: Generated 1820 derivative records from 29284 primary records. [2025-09-26T22:20:06.177336] [DEBUG] [LOCAL ] DLX: Saving derivative data. [2025-09-26T22:20:06.198155] [DEBUG] [LOCAL ] DMB: Loaded 10254 existing records from primary storage. [2025-09-26T22:20:06.201694] [INFO ] [MAIN ] DMB: Loaded 10254 primary data records. [2025-09-26T22:20:06.210984] [DEBUG] [LOCAL ] DLX: Derivative data saved (1820 records). [2025-09-26T22:20:06.223761] [INFO ] [MAIN ] DLX: Successfully saved derivative data. [2025-09-26T22:20:06.255213] [INFO ] [MAIN ] Derivative Progress: 523/2074 symbols completed. DLX took 1.4s. Estimated remaining: 10m 47s. Rate: 143.8 symbols/min [2025-09-26T22:20:06.333690] [DEBUG] [LOCAL ] DLY: Loaded 19800 existing records from primary storage. [2025-09-26T22:20:06.336626] [INFO ] [MAIN ] DLY: Loaded 19800 primary data records. [2025-09-26T22:20:06.900685] [DEBUG] [MAIN ] DMB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:06.901712] [INFO ] [MAIN ] DMB: Generated 1820 derivative records from 10254 primary records. [2025-09-26T22:20:06.902083] [DEBUG] [LOCAL ] DMB: Saving derivative data. [2025-09-26T22:20:06.921193] [DEBUG] [LOCAL ] DMB: Derivative data saved (1820 records). [2025-09-26T22:20:06.922032] [INFO ] [MAIN ] DMB: Successfully saved derivative data. [2025-09-26T22:20:06.924398] [INFO ] [MAIN ] Derivative Progress: 524/2074 symbols completed. DMB took 0.8s. Estimated remaining: 10m 47s. Rate: 143.6 symbols/min [2025-09-26T22:20:06.938221] [DEBUG] [MAIN ] DLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:06.939015] [INFO ] [MAIN ] DLY: Generated 1820 derivative records from 19800 primary records. [2025-09-26T22:20:06.939081] [DEBUG] [LOCAL ] DLY: Saving derivative data. [2025-09-26T22:20:06.954872] [DEBUG] [LOCAL ] DLY: Derivative data saved (1820 records). [2025-09-26T22:20:06.954954] [INFO ] [MAIN ] DLY: Successfully saved derivative data. [2025-09-26T22:20:06.957326] [INFO ] [MAIN ] Derivative Progress: 525/2074 symbols completed. DLY took 0.8s. Estimated remaining: 10m 46s. Rate: 143.9 symbols/min [2025-09-26T22:20:06.958079] [INFO ] [MAIN ] DMO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:06.958602] [INFO ] [MAIN ] DNOW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:06.958493] [INFO ] [MAIN ] DNP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:06.974290] [DEBUG] [LOCAL ] DMO: Loaded 9981 existing records from primary storage. [2025-09-26T22:20:06.974527] [INFO ] [MAIN ] DMO: Loaded 9981 primary data records. [2025-09-26T22:20:07.156927] [DEBUG] [LOCAL ] DNP: Loaded 33786 existing records from primary storage. [2025-09-26T22:20:07.214507] [INFO ] [MAIN ] DNP: Loaded 33786 primary data records. [2025-09-26T22:20:07.399957] [DEBUG] [LOCAL ] DNOW: Loaded 44205 existing records from primary storage. [2025-09-26T22:20:07.425294] [INFO ] [MAIN ] DNOW: Loaded 44205 primary data records. [2025-09-26T22:20:08.091997] [DEBUG] [MAIN ] DMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:08.093509] [INFO ] [MAIN ] DMO: Generated 1820 derivative records from 9981 primary records. [2025-09-26T22:20:08.093851] [DEBUG] [LOCAL ] DMO: Saving derivative data. [2025-09-26T22:20:08.112470] [DEBUG] [LOCAL ] DMO: Derivative data saved (1820 records). [2025-09-26T22:20:08.112598] [INFO ] [MAIN ] DMO: Successfully saved derivative data. [2025-09-26T22:20:08.115160] [INFO ] [MAIN ] Derivative Progress: 526/2074 symbols completed. DMO took 1.2s. Estimated remaining: 10m 48s. Rate: 143.4 symbols/min [2025-09-26T22:20:08.116430] [INFO ] [MAIN ] DOC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:08.138350] [DEBUG] [MAIN ] DNP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:08.139519] [INFO ] [MAIN ] DNP: Generated 1820 derivative records from 33786 primary records. [2025-09-26T22:20:08.139953] [DEBUG] [LOCAL ] DNP: Saving derivative data. [2025-09-26T22:20:08.160222] [DEBUG] [LOCAL ] DNP: Derivative data saved (1820 records). [2025-09-26T22:20:08.160424] [INFO ] [MAIN ] DNP: Successfully saved derivative data. [2025-09-26T22:20:08.162777] [INFO ] [MAIN ] Derivative Progress: 527/2074 symbols completed. DNP took 1.2s. Estimated remaining: 10m 46s. Rate: 143.6 symbols/min [2025-09-26T22:20:08.175610] [INFO ] [MAIN ] DOCN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:08.176679] [DEBUG] [MAIN ] DNOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:08.177906] [INFO ] [MAIN ] DNOW: Generated 1820 derivative records from 44205 primary records. [2025-09-26T22:20:08.178096] [DEBUG] [LOCAL ] DNOW: Saving derivative data. [2025-09-26T22:20:08.195001] [DEBUG] [LOCAL ] DNOW: Derivative data saved (1820 records). [2025-09-26T22:20:08.208812] [INFO ] [MAIN ] DNOW: Successfully saved derivative data. [2025-09-26T22:20:08.211661] [INFO ] [MAIN ] Derivative Progress: 528/2074 symbols completed. DNOW took 1.3s. Estimated remaining: 10m 45s. Rate: 143.9 symbols/min [2025-09-26T22:20:08.212201] [INFO ] [MAIN ] DOCS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:08.235676] [DEBUG] [LOCAL ] DOC: Loaded 54317 existing records from primary storage. [2025-09-26T22:20:08.236031] [INFO ] [MAIN ] DOC: Loaded 54317 primary data records. [2025-09-26T22:20:08.434425] [DEBUG] [LOCAL ] DOCN: Loaded 51245 existing records from primary storage. [2025-09-26T22:20:08.476941] [INFO ] [MAIN ] DOCN: Loaded 51245 primary data records. [2025-09-26T22:20:08.662453] [DEBUG] [LOCAL ] DOCS: Loaded 51956 existing records from primary storage. [2025-09-26T22:20:08.681388] [INFO ] [MAIN ] DOCS: Loaded 51956 primary data records. [2025-09-26T22:20:09.304020] [DEBUG] [MAIN ] DOC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:09.304997] [INFO ] [MAIN ] DOC: Generated 1820 derivative records from 54317 primary records. [2025-09-26T22:20:09.305106] [DEBUG] [LOCAL ] DOC: Saving derivative data. [2025-09-26T22:20:09.327629] [DEBUG] [LOCAL ] DOC: Derivative data saved (1820 records). [2025-09-26T22:20:09.328846] [INFO ] [MAIN ] DOC: Successfully saved derivative data. [2025-09-26T22:20:09.331569] [INFO ] [MAIN ] Derivative Progress: 529/2074 symbols completed. DOC took 1.2s. Estimated remaining: 10m 46s. Rate: 143.4 symbols/min [2025-09-26T22:20:09.332434] [INFO ] [MAIN ] DOLE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:09.346277] [DEBUG] [MAIN ] DOCN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:09.347438] [INFO ] [MAIN ] DOCN: Generated 1820 derivative records from 51245 primary records. [2025-09-26T22:20:09.347697] [DEBUG] [LOCAL ] DOCN: Saving derivative data. [2025-09-26T22:20:09.366635] [DEBUG] [LOCAL ] DOCN: Derivative data saved (1820 records). [2025-09-26T22:20:09.380297] [INFO ] [MAIN ] DOCN: Successfully saved derivative data. [2025-09-26T22:20:09.380232] [DEBUG] [MAIN ] DOCS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:09.382863] [INFO ] [MAIN ] Derivative Progress: 530/2074 symbols completed. DOCN took 1.2s. Estimated remaining: 10m 45s. Rate: 143.7 symbols/min [2025-09-26T22:20:09.383329] [INFO ] [MAIN ] DOUG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:09.384620] [INFO ] [MAIN ] DOCS: Generated 1820 derivative records from 51956 primary records. [2025-09-26T22:20:09.385156] [DEBUG] [LOCAL ] DOCS: Saving derivative data. [2025-09-26T22:20:09.415550] [DEBUG] [LOCAL ] DOCS: Derivative data saved (1820 records). [2025-09-26T22:20:09.415873] [INFO ] [MAIN ] DOCS: Successfully saved derivative data. [2025-09-26T22:20:09.418730] [INFO ] [MAIN ] Derivative Progress: 531/2074 symbols completed. DOCS took 1.2s. Estimated remaining: 10m 43s. Rate: 143.9 symbols/min [2025-09-26T22:20:09.419231] [INFO ] [MAIN ] DOV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:09.433082] [DEBUG] [LOCAL ] DOLE: Loaded 38568 existing records from primary storage. [2025-09-26T22:20:09.441833] [INFO ] [MAIN ] DOLE: Loaded 38568 primary data records. [2025-09-26T22:20:09.581966] [DEBUG] [LOCAL ] DOUG: Loaded 35254 existing records from primary storage. [2025-09-26T22:20:09.582230] [INFO ] [MAIN ] DOUG: Loaded 35254 primary data records. [2025-09-26T22:20:09.943184] [DEBUG] [LOCAL ] DOV: Loaded 46376 existing records from primary storage. [2025-09-26T22:20:09.974255] [INFO ] [MAIN ] DOV: Loaded 46376 primary data records. [2025-09-26T22:20:10.530509] [DEBUG] [MAIN ] DOLE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:10.532065] [INFO ] [MAIN ] DOLE: Generated 1820 derivative records from 38568 primary records. [2025-09-26T22:20:10.532487] [DEBUG] [LOCAL ] DOLE: Saving derivative data. [2025-09-26T22:20:10.551160] [DEBUG] [LOCAL ] DOLE: Derivative data saved (1820 records). [2025-09-26T22:20:10.553880] [INFO ] [MAIN ] DOLE: Successfully saved derivative data. [2025-09-26T22:20:10.556438] [INFO ] [MAIN ] Derivative Progress: 532/2074 symbols completed. DOLE took 1.2s. Estimated remaining: 10m 45s. Rate: 143.4 symbols/min [2025-09-26T22:20:10.556939] [INFO ] [MAIN ] DOW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:10.571410] [DEBUG] [MAIN ] DOUG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:10.572377] [INFO ] [MAIN ] DOUG: Generated 1820 derivative records from 35254 primary records. [2025-09-26T22:20:10.572503] [DEBUG] [LOCAL ] DOUG: Saving derivative data. [2025-09-26T22:20:10.589573] [DEBUG] [LOCAL ] DOUG: Derivative data saved (1820 records). [2025-09-26T22:20:10.589722] [INFO ] [MAIN ] DOUG: Successfully saved derivative data. [2025-09-26T22:20:10.592100] [INFO ] [MAIN ] Derivative Progress: 533/2074 symbols completed. DOUG took 1.2s. Estimated remaining: 10m 43s. Rate: 143.7 symbols/min [2025-09-26T22:20:10.592680] [INFO ] [MAIN ] DPG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:10.609726] [DEBUG] [MAIN ] DOV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:10.610488] [INFO ] [MAIN ] DOV: Generated 1820 derivative records from 46376 primary records. [2025-09-26T22:20:10.610636] [DEBUG] [LOCAL ] DOV: Saving derivative data. [2025-09-26T22:20:10.631483] [DEBUG] [LOCAL ] DOV: Derivative data saved (1820 records). [2025-09-26T22:20:10.631759] [INFO ] [MAIN ] DOV: Successfully saved derivative data. [2025-09-26T22:20:10.636224] [INFO ] [MAIN ] Derivative Progress: 534/2074 symbols completed. DOV took 1.2s. Estimated remaining: 10m 42s. Rate: 143.9 symbols/min [2025-09-26T22:20:10.636639] [INFO ] [MAIN ] DQ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:10.642818] [DEBUG] [LOCAL ] DPG: Loaded 13683 existing records from primary storage. [2025-09-26T22:20:10.643038] [INFO ] [MAIN ] DPG: Loaded 13683 primary data records. [2025-09-26T22:20:10.833054] [DEBUG] [LOCAL ] DOW: Loaded 54513 existing records from primary storage. [2025-09-26T22:20:10.852898] [INFO ] [MAIN ] DOW: Loaded 54513 primary data records. [2025-09-26T22:20:11.093510] [DEBUG] [LOCAL ] DQ: Loaded 43880 existing records from primary storage. [2025-09-26T22:20:11.109092] [INFO ] [MAIN ] DQ: Loaded 43880 primary data records. [2025-09-26T22:20:11.737543] [DEBUG] [MAIN ] DPG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:11.739181] [INFO ] [MAIN ] DPG: Generated 1820 derivative records from 13683 primary records. [2025-09-26T22:20:11.739397] [DEBUG] [LOCAL ] DPG: Saving derivative data. [2025-09-26T22:20:11.758419] [DEBUG] [LOCAL ] DPG: Derivative data saved (1820 records). [2025-09-26T22:20:11.758555] [INFO ] [MAIN ] DPG: Successfully saved derivative data. [2025-09-26T22:20:11.760771] [INFO ] [MAIN ] Derivative Progress: 535/2074 symbols completed. DPG took 1.2s. Estimated remaining: 10m 44s. Rate: 143.5 symbols/min [2025-09-26T22:20:11.762160] [INFO ] [MAIN ] DRD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:11.781665] [DEBUG] [MAIN ] DOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:11.782578] [INFO ] [MAIN ] DOW: Generated 1820 derivative records from 54513 primary records. [2025-09-26T22:20:11.782863] [DEBUG] [LOCAL ] DOW: Saving derivative data. [2025-09-26T22:20:11.816547] [DEBUG] [MAIN ] DQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:11.817919] [INFO ] [MAIN ] DQ: Generated 1820 derivative records from 43880 primary records. [2025-09-26T22:20:11.819576] [DEBUG] [LOCAL ] DQ: Saving derivative data. [2025-09-26T22:20:11.819379] [DEBUG] [LOCAL ] DOW: Derivative data saved (1820 records). [2025-09-26T22:20:11.819793] [INFO ] [MAIN ] DOW: Successfully saved derivative data. [2025-09-26T22:20:11.822557] [INFO ] [MAIN ] Derivative Progress: 536/2074 symbols completed. DOW took 1.3s. Estimated remaining: 10m 42s. Rate: 143.7 symbols/min [2025-09-26T22:20:11.823078] [INFO ] [MAIN ] DRH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:11.849808] [DEBUG] [LOCAL ] DQ: Derivative data saved (1820 records). [2025-09-26T22:20:11.850685] [INFO ] [MAIN ] DQ: Successfully saved derivative data. [2025-09-26T22:20:11.853694] [INFO ] [MAIN ] Derivative Progress: 537/2074 symbols completed. DQ took 1.2s. Estimated remaining: 10m 41s. Rate: 144.0 symbols/min [2025-09-26T22:20:11.865172] [INFO ] [MAIN ] DRI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:11.866714] [DEBUG] [LOCAL ] DRD: Loaded 37397 existing records from primary storage. [2025-09-26T22:20:11.866977] [INFO ] [MAIN ] DRD: Loaded 37397 primary data records. [2025-09-26T22:20:12.225412] [DEBUG] [LOCAL ] DRH: Loaded 51205 existing records from primary storage. [2025-09-26T22:20:12.226503] [INFO ] [MAIN ] DRH: Loaded 51205 primary data records. [2025-09-26T22:20:12.355382] [DEBUG] [LOCAL ] DRI: Loaded 48554 existing records from primary storage. [2025-09-26T22:20:12.359733] [INFO ] [MAIN ] DRI: Loaded 48554 primary data records. [2025-09-26T22:20:12.959400] [DEBUG] [MAIN ] DRD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:12.961220] [INFO ] [MAIN ] DRD: Generated 1820 derivative records from 37397 primary records. [2025-09-26T22:20:12.961340] [DEBUG] [LOCAL ] DRD: Saving derivative data. [2025-09-26T22:20:12.981851] [DEBUG] [LOCAL ] DRD: Derivative data saved (1820 records). [2025-09-26T22:20:12.982299] [INFO ] [MAIN ] DRD: Successfully saved derivative data. [2025-09-26T22:20:12.985834] [INFO ] [MAIN ] Derivative Progress: 538/2074 symbols completed. DRD took 1.2s. Estimated remaining: 10m 42s. Rate: 143.5 symbols/min [2025-09-26T22:20:13.007443] [DEBUG] [MAIN ] DRH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:13.008621] [INFO ] [MAIN ] DRH: Generated 1820 derivative records from 51205 primary records. [2025-09-26T22:20:13.008744] [DEBUG] [LOCAL ] DRH: Saving derivative data. [2025-09-26T22:20:13.027722] [DEBUG] [LOCAL ] DRH: Derivative data saved (1820 records). [2025-09-26T22:20:13.028767] [INFO ] [MAIN ] DRH: Successfully saved derivative data. [2025-09-26T22:20:13.031775] [INFO ] [MAIN ] Derivative Progress: 539/2074 symbols completed. DRH took 1.2s. Estimated remaining: 10m 41s. Rate: 143.7 symbols/min [2025-09-26T22:20:13.044671] [DEBUG] [MAIN ] DRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:13.045375] [INFO ] [MAIN ] DRI: Generated 1820 derivative records from 48554 primary records. [2025-09-26T22:20:13.045442] [DEBUG] [LOCAL ] DRI: Saving derivative data. [2025-09-26T22:20:13.062163] [DEBUG] [LOCAL ] DRI: Derivative data saved (1820 records). [2025-09-26T22:20:13.062227] [INFO ] [MAIN ] DRI: Successfully saved derivative data. [2025-09-26T22:20:13.065118] [INFO ] [MAIN ] Derivative Progress: 540/2074 symbols completed. DRI took 1.2s. Estimated remaining: 10m 39s. Rate: 144.0 symbols/min [2025-09-26T22:20:13.066355] [INFO ] [MAIN ] DSM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:13.066196] [INFO ] [MAIN ] DSL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:13.066902] [INFO ] [MAIN ] DRLL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:13.084250] [DEBUG] [LOCAL ] DRLL: Loaded 9737 existing records from primary storage. [2025-09-26T22:20:13.084491] [INFO ] [MAIN ] DRLL: Loaded 9737 primary data records. [2025-09-26T22:20:13.144907] [DEBUG] [LOCAL ] DSM: Loaded 15895 existing records from primary storage. [2025-09-26T22:20:13.150350] [INFO ] [MAIN ] DSM: Loaded 15895 primary data records. [2025-09-26T22:20:13.330932] [DEBUG] [LOCAL ] DSL: Loaded 28651 existing records from primary storage. [2025-09-26T22:20:13.342755] [INFO ] [MAIN ] DSL: Loaded 28651 primary data records. [2025-09-26T22:20:14.222350] [DEBUG] [MAIN ] DRLL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:14.224779] [INFO ] [MAIN ] DRLL: Generated 1820 derivative records from 9737 primary records. [2025-09-26T22:20:14.225043] [DEBUG] [LOCAL ] DRLL: Saving derivative data. [2025-09-26T22:20:14.247228] [DEBUG] [MAIN ] DSM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:14.253042] [INFO ] [MAIN ] DSM: Generated 1820 derivative records from 15895 primary records. [2025-09-26T22:20:14.257623] [DEBUG] [LOCAL ] DRLL: Derivative data saved (1820 records). [2025-09-26T22:20:14.257946] [DEBUG] [LOCAL ] DSM: Saving derivative data. [2025-09-26T22:20:14.258300] [INFO ] [MAIN ] DRLL: Successfully saved derivative data. [2025-09-26T22:20:14.260481] [INFO ] [MAIN ] Derivative Progress: 541/2074 symbols completed. DRLL took 1.2s. Estimated remaining: 10m 41s. Rate: 143.5 symbols/min [2025-09-26T22:20:14.262567] [INFO ] [MAIN ] DSU: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:14.294987] [DEBUG] [LOCAL ] DSM: Derivative data saved (1820 records). [2025-09-26T22:20:14.296110] [INFO ] [MAIN ] DSM: Successfully saved derivative data. [2025-09-26T22:20:14.296017] [DEBUG] [MAIN ] DSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:14.299340] [INFO ] [MAIN ] Derivative Progress: 542/2074 symbols completed. DSM took 1.2s. Estimated remaining: 10m 40s. Rate: 143.7 symbols/min [2025-09-26T22:20:14.300559] [INFO ] [MAIN ] DSL: Generated 1820 derivative records from 28651 primary records. [2025-09-26T22:20:14.301064] [DEBUG] [LOCAL ] DSL: Saving derivative data. [2025-09-26T22:20:14.300891] [INFO ] [MAIN ] DSX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:14.324947] [DEBUG] [LOCAL ] DSL: Derivative data saved (1820 records). [2025-09-26T22:20:14.325264] [INFO ] [MAIN ] DSL: Successfully saved derivative data. [2025-09-26T22:20:14.328896] [INFO ] [MAIN ] Derivative Progress: 543/2074 symbols completed. DSL took 1.3s. Estimated remaining: 10m 38s. Rate: 144.0 symbols/min [2025-09-26T22:20:14.329342] [INFO ] [MAIN ] DTB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:14.346833] [DEBUG] [LOCAL ] DSU: Loaded 22684 existing records from primary storage. [2025-09-26T22:20:14.347101] [INFO ] [MAIN ] DSU: Loaded 22684 primary data records. [2025-09-26T22:20:14.350561] [DEBUG] [LOCAL ] DTB: Loaded 4817 existing records from primary storage. [2025-09-26T22:20:14.374070] [INFO ] [MAIN ] DTB: Loaded 4817 primary data records. [2025-09-26T22:20:14.539204] [DEBUG] [LOCAL ] DSX: Loaded 24642 existing records from primary storage. [2025-09-26T22:20:14.592424] [INFO ] [MAIN ] DSX: Loaded 24642 primary data records. [2025-09-26T22:20:15.406454] [DEBUG] [MAIN ] DSU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:15.408918] [INFO ] [MAIN ] DSU: Generated 1820 derivative records from 22684 primary records. [2025-09-26T22:20:15.409176] [DEBUG] [LOCAL ] DSU: Saving derivative data. [2025-09-26T22:20:15.432176] [DEBUG] [MAIN ] DTB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:15.442054] [INFO ] [MAIN ] DTB: Generated 1820 derivative records from 4817 primary records. [2025-09-26T22:20:15.443180] [DEBUG] [LOCAL ] DTB: Saving derivative data. [2025-09-26T22:20:15.443052] [DEBUG] [LOCAL ] DSU: Derivative data saved (1820 records). [2025-09-26T22:20:15.444672] [INFO ] [MAIN ] DSU: Successfully saved derivative data. [2025-09-26T22:20:15.447539] [INFO ] [MAIN ] Derivative Progress: 544/2074 symbols completed. DSU took 1.2s. Estimated remaining: 10m 40s. Rate: 143.5 symbols/min [2025-09-26T22:20:15.457155] [INFO ] [MAIN ] DTE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:15.466760] [DEBUG] [LOCAL ] DTB: Derivative data saved (1820 records). [2025-09-26T22:20:15.466984] [INFO ] [MAIN ] DTB: Successfully saved derivative data. [2025-09-26T22:20:15.470241] [INFO ] [MAIN ] Derivative Progress: 545/2074 symbols completed. DTB took 1.1s. Estimated remaining: 10m 38s. Rate: 143.8 symbols/min [2025-09-26T22:20:15.470681] [INFO ] [MAIN ] DTG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:15.489473] [DEBUG] [MAIN ] DSX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:15.491008] [INFO ] [MAIN ] DSX: Generated 1820 derivative records from 24642 primary records. [2025-09-26T22:20:15.491482] [DEBUG] [LOCAL ] DSX: Saving derivative data. [2025-09-26T22:20:15.514818] [DEBUG] [LOCAL ] DTG: Loaded 5952 existing records from primary storage. [2025-09-26T22:20:15.516065] [INFO ] [MAIN ] DTG: Loaded 5952 primary data records. [2025-09-26T22:20:15.540076] [DEBUG] [LOCAL ] DSX: Derivative data saved (1820 records). [2025-09-26T22:20:15.556302] [INFO ] [MAIN ] DSX: Successfully saved derivative data. [2025-09-26T22:20:15.566440] [INFO ] [MAIN ] Derivative Progress: 546/2074 symbols completed. DSX took 1.3s. Estimated remaining: 10m 37s. Rate: 144.0 symbols/min [2025-09-26T22:20:15.579799] [INFO ] [MAIN ] DTM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:15.867395] [DEBUG] [LOCAL ] DTE: Loaded 48557 existing records from primary storage. [2025-09-26T22:20:15.868753] [INFO ] [MAIN ] DTE: Loaded 48557 primary data records. [2025-09-26T22:20:16.101672] [DEBUG] [LOCAL ] DTM: Loaded 45043 existing records from primary storage. [2025-09-26T22:20:16.218427] [INFO ] [MAIN ] DTM: Loaded 45043 primary data records. [2025-09-26T22:20:16.405505] [DEBUG] [MAIN ] DTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:16.446403] [INFO ] [MAIN ] DTG: Generated 1820 derivative records from 5952 primary records. [2025-09-26T22:20:16.446714] [DEBUG] [LOCAL ] DTG: Saving derivative data. [2025-09-26T22:20:16.643981] [DEBUG] [LOCAL ] DTG: Derivative data saved (1820 records). [2025-09-26T22:20:16.645053] [INFO ] [MAIN ] DTG: Successfully saved derivative data. [2025-09-26T22:20:16.647769] [INFO ] [MAIN ] Derivative Progress: 547/2074 symbols completed. DTG took 1.2s. Estimated remaining: 10m 38s. Rate: 143.6 symbols/min [2025-09-26T22:20:16.649899] [INFO ] [MAIN ] DTW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:16.664601] [DEBUG] [MAIN ] DTE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:16.665420] [INFO ] [MAIN ] DTE: Generated 1820 derivative records from 48557 primary records. [2025-09-26T22:20:16.665616] [DEBUG] [LOCAL ] DTE: Saving derivative data. [2025-09-26T22:20:16.689761] [DEBUG] [LOCAL ] DTW: Loaded 4923 existing records from primary storage. [2025-09-26T22:20:16.692000] [INFO ] [MAIN ] DTW: Loaded 4923 primary data records. [2025-09-26T22:20:16.774873] [DEBUG] [LOCAL ] DTE: Derivative data saved (1820 records). [2025-09-26T22:20:16.793314] [INFO ] [MAIN ] DTE: Successfully saved derivative data. [2025-09-26T22:20:16.817380] [INFO ] [MAIN ] Derivative Progress: 548/2074 symbols completed. DTE took 1.4s. Estimated remaining: 10m 37s. Rate: 143.7 symbols/min [2025-09-26T22:20:16.824710] [INFO ] [MAIN ] DUK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:16.921334] [DEBUG] [MAIN ] DTM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:17.051323] [INFO ] [MAIN ] DTM: Generated 1820 derivative records from 45043 primary records. [2025-09-26T22:20:17.051731] [DEBUG] [LOCAL ] DTM: Saving derivative data. [2025-09-26T22:20:17.074951] [DEBUG] [LOCAL ] DTM: Derivative data saved (1820 records). [2025-09-26T22:20:17.075143] [INFO ] [MAIN ] DTM: Successfully saved derivative data. [2025-09-26T22:20:17.078268] [INFO ] [MAIN ] Derivative Progress: 549/2074 symbols completed. DTM took 1.5s. Estimated remaining: 10m 36s. Rate: 143.8 symbols/min [2025-09-26T22:20:17.078819] [INFO ] [MAIN ] DUKB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:17.111283] [DEBUG] [LOCAL ] DUKB: Loaded 6414 existing records from primary storage. [2025-09-26T22:20:17.113399] [INFO ] [MAIN ] DUKB: Loaded 6414 primary data records. [2025-09-26T22:20:17.132671] [DEBUG] [MAIN ] DTW: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:20:17.187953] [INFO ] [MAIN ] DTW: Generated 1819 derivative records from 4923 primary records. [2025-09-26T22:20:17.224706] [DEBUG] [LOCAL ] DUK: Loaded 54238 existing records from primary storage. [2025-09-26T22:20:17.218370] [DEBUG] [LOCAL ] DTW: Saving derivative data. [2025-09-26T22:20:17.249331] [INFO ] [MAIN ] DUK: Loaded 54238 primary data records. [2025-09-26T22:20:17.584813] [DEBUG] [LOCAL ] DTW: Derivative data saved (1819 records). [2025-09-26T22:20:17.593481] [INFO ] [MAIN ] DTW: Successfully saved derivative data. [2025-09-26T22:20:17.596609] [INFO ] [MAIN ] Derivative Progress: 550/2074 symbols completed. DTW took 0.9s. Estimated remaining: 10m 36s. Rate: 143.7 symbols/min [2025-09-26T22:20:17.609552] [INFO ] [MAIN ] DV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:17.874716] [DEBUG] [MAIN ] DUKB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:17.875904] [INFO ] [MAIN ] DUKB: Generated 1820 derivative records from 6414 primary records. [2025-09-26T22:20:17.876022] [DEBUG] [LOCAL ] DUKB: Saving derivative data. [2025-09-26T22:20:17.913580] [DEBUG] [LOCAL ] DV: Loaded 52038 existing records from primary storage. [2025-09-26T22:20:17.914694] [INFO ] [MAIN ] DV: Loaded 52038 primary data records. [2025-09-26T22:20:17.915946] [DEBUG] [LOCAL ] DUKB: Derivative data saved (1820 records). [2025-09-26T22:20:17.928134] [INFO ] [MAIN ] DUKB: Successfully saved derivative data. [2025-09-26T22:20:17.960490] [INFO ] [MAIN ] Derivative Progress: 551/2074 symbols completed. DUKB took 0.9s. Estimated remaining: 10m 36s. Rate: 143.8 symbols/min [2025-09-26T22:20:18.001116] [DEBUG] [MAIN ] DUK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:17.991141] [INFO ] [MAIN ] DVA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:18.046211] [INFO ] [MAIN ] DUK: Generated 1820 derivative records from 54238 primary records. [2025-09-26T22:20:18.046413] [DEBUG] [LOCAL ] DUK: Saving derivative data. [2025-09-26T22:20:18.274831] [DEBUG] [LOCAL ] DUK: Derivative data saved (1820 records). [2025-09-26T22:20:18.275118] [INFO ] [MAIN ] DUK: Successfully saved derivative data. [2025-09-26T22:20:18.277687] [INFO ] [MAIN ] Derivative Progress: 552/2074 symbols completed. DUK took 1.5s. Estimated remaining: 10m 35s. Rate: 143.8 symbols/min [2025-09-26T22:20:18.278316] [INFO ] [MAIN ] DVN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:18.317968] [DEBUG] [LOCAL ] DVA: Loaded 41877 existing records from primary storage. [2025-09-26T22:20:18.319805] [INFO ] [MAIN ] DVA: Loaded 41877 primary data records. [2025-09-26T22:20:18.437048] [DEBUG] [MAIN ] DV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:18.465745] [INFO ] [MAIN ] DV: Generated 1820 derivative records from 52038 primary records. [2025-09-26T22:20:18.480241] [DEBUG] [LOCAL ] DV: Saving derivative data. [2025-09-26T22:20:18.775701] [DEBUG] [LOCAL ] DVN: Loaded 54479 existing records from primary storage. [2025-09-26T22:20:18.777151] [INFO ] [MAIN ] DVN: Loaded 54479 primary data records. [2025-09-26T22:20:18.854516] [DEBUG] [LOCAL ] DV: Derivative data saved (1820 records). [2025-09-26T22:20:18.878090] [INFO ] [MAIN ] DV: Successfully saved derivative data. [2025-09-26T22:20:18.896099] [INFO ] [MAIN ] Derivative Progress: 553/2074 symbols completed. DV took 1.3s. Estimated remaining: 10m 35s. Rate: 143.7 symbols/min [2025-09-26T22:20:19.122621] [DEBUG] [MAIN ] DVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:19.123769] [INFO ] [MAIN ] DVA: Generated 1820 derivative records from 41877 primary records. [2025-09-26T22:20:19.123979] [DEBUG] [LOCAL ] DVA: Saving derivative data. [2025-09-26T22:20:19.142619] [DEBUG] [LOCAL ] DVA: Derivative data saved (1820 records). [2025-09-26T22:20:19.142814] [INFO ] [MAIN ] DVA: Successfully saved derivative data. [2025-09-26T22:20:19.145158] [INFO ] [MAIN ] Derivative Progress: 554/2074 symbols completed. DVA took 1.2s. Estimated remaining: 10m 34s. Rate: 143.8 symbols/min [2025-09-26T22:20:19.161301] [DEBUG] [MAIN ] DVN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:19.161911] [INFO ] [MAIN ] DVN: Generated 1820 derivative records from 54479 primary records. [2025-09-26T22:20:19.161975] [DEBUG] [LOCAL ] DVN: Saving derivative data. [2025-09-26T22:20:19.178417] [DEBUG] [LOCAL ] DVN: Derivative data saved (1820 records). [2025-09-26T22:20:19.178530] [INFO ] [MAIN ] DVN: Successfully saved derivative data. [2025-09-26T22:20:19.181064] [INFO ] [MAIN ] Derivative Progress: 555/2074 symbols completed. DVN took 0.9s. Estimated remaining: 10m 33s. Rate: 144.1 symbols/min [2025-09-26T22:20:19.182419] [INFO ] [MAIN ] DXC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:19.182771] [INFO ] [MAIN ] DXYZ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:19.182579] [INFO ] [MAIN ] DX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:19.232225] [DEBUG] [LOCAL ] DXYZ: Loaded 37246 existing records from primary storage. [2025-09-26T22:20:19.248384] [INFO ] [MAIN ] DXYZ: Loaded 37246 primary data records. [2025-09-26T22:20:19.378466] [DEBUG] [LOCAL ] DXC: Loaded 50456 existing records from primary storage. [2025-09-26T22:20:19.398365] [INFO ] [MAIN ] DXC: Loaded 50456 primary data records. [2025-09-26T22:20:19.405450] [DEBUG] [LOCAL ] DX: Loaded 53228 existing records from primary storage. [2025-09-26T22:20:19.430968] [INFO ] [MAIN ] DX: Loaded 53228 primary data records. [2025-09-26T22:20:20.362150] [DEBUG] [MAIN ] DXYZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:20.363724] [INFO ] [MAIN ] DXYZ: Generated 1820 derivative records from 37246 primary records. [2025-09-26T22:20:20.364177] [DEBUG] [LOCAL ] DXYZ: Saving derivative data. [2025-09-26T22:20:20.406259] [DEBUG] [MAIN ] DXC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:20.413451] [DEBUG] [MAIN ] DX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:20.414451] [INFO ] [MAIN ] DXC: Generated 1820 derivative records from 50456 primary records. [2025-09-26T22:20:20.415355] [DEBUG] [LOCAL ] DXC: Saving derivative data. [2025-09-26T22:20:20.417631] [INFO ] [MAIN ] DX: Generated 1820 derivative records from 53228 primary records. [2025-09-26T22:20:20.417767] [DEBUG] [LOCAL ] DX: Saving derivative data. [2025-09-26T22:20:20.420967] [DEBUG] [LOCAL ] DXYZ: Derivative data saved (1820 records). [2025-09-26T22:20:20.440472] [INFO ] [MAIN ] DXYZ: Successfully saved derivative data. [2025-09-26T22:20:20.442932] [INFO ] [MAIN ] Derivative Progress: 556/2074 symbols completed. DXYZ took 1.3s. Estimated remaining: 10m 35s. Rate: 143.5 symbols/min [2025-09-26T22:20:20.445288] [INFO ] [MAIN ] DY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:20.456759] [DEBUG] [LOCAL ] DX: Derivative data saved (1820 records). [2025-09-26T22:20:20.457450] [INFO ] [MAIN ] DX: Successfully saved derivative data. [2025-09-26T22:20:20.460698] [INFO ] [MAIN ] Derivative Progress: 557/2074 symbols completed. DX took 1.3s. Estimated remaining: 10m 33s. Rate: 143.8 symbols/min [2025-09-26T22:20:20.462019] [INFO ] [MAIN ] E: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:20.461559] [DEBUG] [LOCAL ] DXC: Derivative data saved (1820 records). [2025-09-26T22:20:20.462192] [INFO ] [MAIN ] DXC: Successfully saved derivative data. [2025-09-26T22:20:20.465269] [INFO ] [MAIN ] Derivative Progress: 558/2074 symbols completed. DXC took 1.3s. Estimated remaining: 10m 31s. Rate: 144.0 symbols/min [2025-09-26T22:20:20.465625] [INFO ] [MAIN ] EAF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:20.493032] [DEBUG] [LOCAL ] DY: Loaded 30160 existing records from primary storage. [2025-09-26T22:20:20.497180] [INFO ] [MAIN ] DY: Loaded 30160 primary data records. [2025-09-26T22:20:20.645607] [DEBUG] [LOCAL ] E: Loaded 33848 existing records from primary storage. [2025-09-26T22:20:20.650567] [INFO ] [MAIN ] E: Loaded 33848 primary data records. [2025-09-26T22:20:20.801016] [DEBUG] [LOCAL ] EAF: Loaded 44158 existing records from primary storage. [2025-09-26T22:20:20.816774] [INFO ] [MAIN ] EAF: Loaded 44158 primary data records. [2025-09-26T22:20:21.626514] [DEBUG] [MAIN ] DY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:21.628622] [INFO ] [MAIN ] DY: Generated 1820 derivative records from 30160 primary records. [2025-09-26T22:20:21.628768] [DEBUG] [LOCAL ] DY: Saving derivative data. [2025-09-26T22:20:21.651038] [DEBUG] [MAIN ] E: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:21.657163] [INFO ] [MAIN ] E: Generated 1820 derivative records from 33848 primary records. [2025-09-26T22:20:21.657490] [DEBUG] [LOCAL ] E: Saving derivative data. [2025-09-26T22:20:21.692217] [DEBUG] [MAIN ] EAF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:21.694146] [INFO ] [MAIN ] EAF: Generated 1820 derivative records from 44158 primary records. [2025-09-26T22:20:21.695608] [DEBUG] [LOCAL ] EAF: Saving derivative data. [2025-09-26T22:20:21.695183] [DEBUG] [LOCAL ] DY: Derivative data saved (1820 records). [2025-09-26T22:20:21.697908] [DEBUG] [LOCAL ] E: Derivative data saved (1820 records). [2025-09-26T22:20:21.698210] [INFO ] [MAIN ] E: Successfully saved derivative data. [2025-09-26T22:20:21.698311] [INFO ] [MAIN ] DY: Successfully saved derivative data. [2025-09-26T22:20:21.701400] [INFO ] [MAIN ] Derivative Progress: 559/2074 symbols completed. E took 1.2s. Estimated remaining: 10m 33s. Rate: 143.5 symbols/min [2025-09-26T22:20:21.704434] [INFO ] [MAIN ] EAI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:21.704530] [INFO ] [MAIN ] Derivative Progress: 560/2074 symbols completed. DY took 1.3s. Estimated remaining: 10m 32s. Rate: 143.8 symbols/min [2025-09-26T22:20:21.712889] [INFO ] [MAIN ] EARN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:21.729379] [DEBUG] [LOCAL ] EAI: Loaded 4008 existing records from primary storage. [2025-09-26T22:20:21.730256] [INFO ] [MAIN ] EAI: Loaded 4008 primary data records. [2025-09-26T22:20:21.786004] [DEBUG] [LOCAL ] EAF: Derivative data saved (1820 records). [2025-09-26T22:20:21.786711] [INFO ] [MAIN ] EAF: Successfully saved derivative data. [2025-09-26T22:20:21.797438] [INFO ] [MAIN ] Derivative Progress: 561/2074 symbols completed. EAF took 1.3s. Estimated remaining: 10m 30s. Rate: 144.0 symbols/min [2025-09-26T22:20:21.831707] [INFO ] [MAIN ] EAT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:21.918836] [DEBUG] [LOCAL ] EARN: Loaded 30576 existing records from primary storage. [2025-09-26T22:20:21.974529] [INFO ] [MAIN ] EARN: Loaded 30576 primary data records. [2025-09-26T22:20:22.497793] [DEBUG] [LOCAL ] EAT: Loaded 50542 existing records from primary storage. [2025-09-26T22:20:22.498270] [INFO ] [MAIN ] EAT: Loaded 50542 primary data records. [2025-09-26T22:20:22.716320] [DEBUG] [MAIN ] EAI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:22.723914] [INFO ] [MAIN ] EAI: Generated 1820 derivative records from 4008 primary records. [2025-09-26T22:20:22.724123] [DEBUG] [LOCAL ] EAI: Saving derivative data. [2025-09-26T22:20:22.866288] [DEBUG] [LOCAL ] EAI: Derivative data saved (1820 records). [2025-09-26T22:20:22.866862] [INFO ] [MAIN ] EAI: Successfully saved derivative data. [2025-09-26T22:20:22.869100] [INFO ] [MAIN ] Derivative Progress: 562/2074 symbols completed. EAI took 1.2s. Estimated remaining: 10m 32s. Rate: 143.6 symbols/min [2025-09-26T22:20:22.871037] [INFO ] [MAIN ] EBR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:22.889278] [DEBUG] [MAIN ] EARN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:22.890149] [INFO ] [MAIN ] EARN: Generated 1820 derivative records from 30576 primary records. [2025-09-26T22:20:22.890332] [DEBUG] [LOCAL ] EARN: Saving derivative data. [2025-09-26T22:20:22.912003] [DEBUG] [LOCAL ] EARN: Derivative data saved (1820 records). [2025-09-26T22:20:22.925125] [DEBUG] [MAIN ] EAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:22.925197] [INFO ] [MAIN ] EARN: Successfully saved derivative data. [2025-09-26T22:20:22.929006] [INFO ] [MAIN ] EAT: Generated 1820 derivative records from 50542 primary records. [2025-09-26T22:20:22.929137] [DEBUG] [LOCAL ] EAT: Saving derivative data. [2025-09-26T22:20:22.928095] [INFO ] [MAIN ] Derivative Progress: 563/2074 symbols completed. EARN took 1.2s. Estimated remaining: 10m 30s. Rate: 143.8 symbols/min [2025-09-26T22:20:22.929972] [INFO ] [MAIN ] EBS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:22.957823] [DEBUG] [LOCAL ] EAT: Derivative data saved (1820 records). [2025-09-26T22:20:22.958086] [INFO ] [MAIN ] EAT: Successfully saved derivative data. [2025-09-26T22:20:22.961470] [INFO ] [MAIN ] Derivative Progress: 564/2074 symbols completed. EAT took 1.1s. Estimated remaining: 10m 29s. Rate: 144.0 symbols/min [2025-09-26T22:20:22.974388] [INFO ] [MAIN ] ECAT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:22.975856] [DEBUG] [LOCAL ] EBR: Loaded 43731 existing records from primary storage. [2025-09-26T22:20:22.976124] [INFO ] [MAIN ] EBR: Loaded 43731 primary data records. [2025-09-26T22:20:23.158632] [DEBUG] [LOCAL ] EBS: Loaded 47455 existing records from primary storage. [2025-09-26T22:20:23.200861] [INFO ] [MAIN ] EBS: Loaded 47455 primary data records. [2025-09-26T22:20:23.240596] [DEBUG] [LOCAL ] ECAT: Loaded 30092 existing records from primary storage. [2025-09-26T22:20:23.345742] [INFO ] [MAIN ] ECAT: Loaded 30092 primary data records. [2025-09-26T22:20:24.114165] [DEBUG] [MAIN ] EBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:24.115234] [INFO ] [MAIN ] EBR: Generated 1820 derivative records from 43731 primary records. [2025-09-26T22:20:24.115524] [DEBUG] [LOCAL ] EBR: Saving derivative data. [2025-09-26T22:20:24.138538] [DEBUG] [LOCAL ] EBR: Derivative data saved (1820 records). [2025-09-26T22:20:24.139229] [INFO ] [MAIN ] EBR: Successfully saved derivative data. [2025-09-26T22:20:24.141328] [INFO ] [MAIN ] Derivative Progress: 565/2074 symbols completed. EBR took 1.3s. Estimated remaining: 10m 31s. Rate: 143.6 symbols/min [2025-09-26T22:20:24.142258] [INFO ] [MAIN ] ECC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:24.163874] [DEBUG] [MAIN ] EBS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:24.165351] [INFO ] [MAIN ] EBS: Generated 1820 derivative records from 47455 primary records. [2025-09-26T22:20:24.168168] [DEBUG] [LOCAL ] EBS: Saving derivative data. [2025-09-26T22:20:24.200586] [DEBUG] [MAIN ] ECAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:24.202310] [INFO ] [MAIN ] ECAT: Generated 1820 derivative records from 30092 primary records. [2025-09-26T22:20:24.203271] [DEBUG] [LOCAL ] ECAT: Saving derivative data. [2025-09-26T22:20:24.220085] [DEBUG] [LOCAL ] EBS: Derivative data saved (1820 records). [2025-09-26T22:20:24.220784] [INFO ] [MAIN ] EBS: Successfully saved derivative data. [2025-09-26T22:20:24.223742] [INFO ] [MAIN ] Derivative Progress: 566/2074 symbols completed. EBS took 1.3s. Estimated remaining: 10m 29s. Rate: 143.8 symbols/min [2025-09-26T22:20:24.225352] [INFO ] [MAIN ] ECG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:24.237630] [DEBUG] [LOCAL ] ECAT: Derivative data saved (1820 records). [2025-09-26T22:20:24.237880] [INFO ] [MAIN ] ECAT: Successfully saved derivative data. [2025-09-26T22:20:24.240887] [INFO ] [MAIN ] Derivative Progress: 567/2074 symbols completed. ECAT took 1.3s. Estimated remaining: 10m 28s. Rate: 144.0 symbols/min [2025-09-26T22:20:24.241522] [INFO ] [MAIN ] ECL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:24.258279] [DEBUG] [LOCAL ] ECC: Loaded 44025 existing records from primary storage. [2025-09-26T22:20:24.258597] [INFO ] [MAIN ] ECC: Loaded 44025 primary data records. [2025-09-26T22:20:24.433639] [DEBUG] [LOCAL ] ECG: Loaded 34619 existing records from primary storage. [2025-09-26T22:20:24.472565] [INFO ] [MAIN ] ECG: Loaded 34619 primary data records. [2025-09-26T22:20:24.773059] [DEBUG] [LOCAL ] ECL: Loaded 47489 existing records from primary storage. [2025-09-26T22:20:24.773935] [INFO ] [MAIN ] ECL: Loaded 47489 primary data records. [2025-09-26T22:20:25.409468] [DEBUG] [MAIN ] ECC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:25.410624] [INFO ] [MAIN ] ECC: Generated 1820 derivative records from 44025 primary records. [2025-09-26T22:20:25.410772] [DEBUG] [LOCAL ] ECC: Saving derivative data. [2025-09-26T22:20:25.430952] [DEBUG] [LOCAL ] ECC: Derivative data saved (1820 records). [2025-09-26T22:20:25.431750] [INFO ] [MAIN ] ECC: Successfully saved derivative data. [2025-09-26T22:20:25.434829] [INFO ] [MAIN ] Derivative Progress: 568/2074 symbols completed. ECC took 1.3s. Estimated remaining: 10m 29s. Rate: 143.6 symbols/min [2025-09-26T22:20:25.456153] [DEBUG] [MAIN ] ECG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:25.457355] [INFO ] [MAIN ] ECG: Generated 1820 derivative records from 34619 primary records. [2025-09-26T22:20:25.457549] [DEBUG] [LOCAL ] ECG: Saving derivative data. [2025-09-26T22:20:25.489030] [DEBUG] [MAIN ] ECL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:25.490409] [INFO ] [MAIN ] ECL: Generated 1820 derivative records from 47489 primary records. [2025-09-26T22:20:25.491050] [DEBUG] [LOCAL ] ECL: Saving derivative data. [2025-09-26T22:20:25.500757] [DEBUG] [LOCAL ] ECG: Derivative data saved (1820 records). [2025-09-26T22:20:25.505006] [INFO ] [MAIN ] ECG: Successfully saved derivative data. [2025-09-26T22:20:25.507997] [INFO ] [MAIN ] Derivative Progress: 569/2074 symbols completed. ECG took 1.3s. Estimated remaining: 10m 28s. Rate: 143.8 symbols/min [2025-09-26T22:20:25.512882] [DEBUG] [LOCAL ] ECL: Derivative data saved (1820 records). [2025-09-26T22:20:25.513012] [INFO ] [MAIN ] ECL: Successfully saved derivative data. [2025-09-26T22:20:25.516054] [INFO ] [MAIN ] Derivative Progress: 570/2074 symbols completed. ECL took 1.3s. Estimated remaining: 10m 27s. Rate: 144.0 symbols/min [2025-09-26T22:20:25.516876] [INFO ] [MAIN ] ED: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:25.516780] [INFO ] [MAIN ] ECVT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:25.517056] [INFO ] [MAIN ] EDD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:25.549266] [DEBUG] [LOCAL ] EDD: Loaded 27470 existing records from primary storage. [2025-09-26T22:20:25.560289] [INFO ] [MAIN ] EDD: Loaded 27470 primary data records. [2025-09-26T22:20:25.707368] [DEBUG] [LOCAL ] ECVT: Loaded 43587 existing records from primary storage. [2025-09-26T22:20:25.718564] [INFO ] [MAIN ] ECVT: Loaded 43587 primary data records. [2025-09-26T22:20:25.800314] [DEBUG] [LOCAL ] ED: Loaded 53539 existing records from primary storage. [2025-09-26T22:20:25.834212] [INFO ] [MAIN ] ED: Loaded 53539 primary data records. [2025-09-26T22:20:26.631916] [DEBUG] [MAIN ] EDD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:26.632979] [INFO ] [MAIN ] EDD: Generated 1820 derivative records from 27470 primary records. [2025-09-26T22:20:26.633603] [DEBUG] [LOCAL ] EDD: Saving derivative data. [2025-09-26T22:20:26.666570] [DEBUG] [MAIN ] ECVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:26.668755] [INFO ] [MAIN ] ECVT: Generated 1820 derivative records from 43587 primary records. [2025-09-26T22:20:26.669478] [DEBUG] [LOCAL ] ECVT: Saving derivative data. [2025-09-26T22:20:26.686546] [DEBUG] [LOCAL ] EDD: Derivative data saved (1820 records). [2025-09-26T22:20:26.687126] [INFO ] [MAIN ] EDD: Successfully saved derivative data. [2025-09-26T22:20:26.690429] [INFO ] [MAIN ] Derivative Progress: 571/2074 symbols completed. EDD took 1.2s. Estimated remaining: 10m 28s. Rate: 143.6 symbols/min [2025-09-26T22:20:26.691363] [INFO ] [MAIN ] EDF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:26.707759] [DEBUG] [LOCAL ] ECVT: Derivative data saved (1820 records). [2025-09-26T22:20:26.708722] [INFO ] [MAIN ] ECVT: Successfully saved derivative data. [2025-09-26T22:20:26.708552] [DEBUG] [MAIN ] ED: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:26.711285] [INFO ] [MAIN ] Derivative Progress: 572/2074 symbols completed. ECVT took 1.2s. Estimated remaining: 10m 27s. Rate: 143.8 symbols/min [2025-09-26T22:20:26.712895] [INFO ] [MAIN ] EDN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:26.712476] [INFO ] [MAIN ] ED: Generated 1820 derivative records from 53539 primary records. [2025-09-26T22:20:26.713469] [DEBUG] [LOCAL ] ED: Saving derivative data. [2025-09-26T22:20:26.742981] [DEBUG] [LOCAL ] ED: Derivative data saved (1820 records). [2025-09-26T22:20:26.742368] [DEBUG] [LOCAL ] EDF: Loaded 13627 existing records from primary storage. [2025-09-26T22:20:26.743355] [INFO ] [MAIN ] ED: Successfully saved derivative data. [2025-09-26T22:20:26.743487] [INFO ] [MAIN ] EDF: Loaded 13627 primary data records. [2025-09-26T22:20:26.746534] [INFO ] [MAIN ] Derivative Progress: 573/2074 symbols completed. ED took 1.2s. Estimated remaining: 10m 25s. Rate: 144.0 symbols/min [2025-09-26T22:20:26.770898] [INFO ] [MAIN ] EDU: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:26.828006] [DEBUG] [LOCAL ] EDN: Loaded 18501 existing records from primary storage. [2025-09-26T22:20:26.862283] [INFO ] [MAIN ] EDN: Loaded 18501 primary data records. [2025-09-26T22:20:27.496169] [DEBUG] [LOCAL ] EDU: Loaded 45666 existing records from primary storage. [2025-09-26T22:20:27.497707] [INFO ] [MAIN ] EDU: Loaded 45666 primary data records. [2025-09-26T22:20:27.861987] [DEBUG] [MAIN ] EDF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:27.864701] [INFO ] [MAIN ] EDF: Generated 1820 derivative records from 13627 primary records. [2025-09-26T22:20:27.868544] [DEBUG] [LOCAL ] EDF: Saving derivative data. [2025-09-26T22:20:27.899202] [DEBUG] [MAIN ] EDN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:27.900965] [INFO ] [MAIN ] EDN: Generated 1820 derivative records from 18501 primary records. [2025-09-26T22:20:27.901071] [DEBUG] [LOCAL ] EDN: Saving derivative data. [2025-09-26T22:20:27.925075] [DEBUG] [LOCAL ] EDF: Derivative data saved (1820 records). [2025-09-26T22:20:27.926783] [INFO ] [MAIN ] EDF: Successfully saved derivative data. [2025-09-26T22:20:27.929298] [INFO ] [MAIN ] Derivative Progress: 574/2074 symbols completed. EDF took 1.2s. Estimated remaining: 10m 27s. Rate: 143.6 symbols/min [2025-09-26T22:20:27.930216] [INFO ] [MAIN ] EE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:27.931057] [DEBUG] [LOCAL ] EDN: Derivative data saved (1820 records). [2025-09-26T22:20:27.931301] [INFO ] [MAIN ] EDN: Successfully saved derivative data. [2025-09-26T22:20:27.934185] [INFO ] [MAIN ] Derivative Progress: 575/2074 symbols completed. EDN took 1.2s. Estimated remaining: 10m 25s. Rate: 143.8 symbols/min [2025-09-26T22:20:27.934984] [INFO ] [MAIN ] EEX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:27.953382] [DEBUG] [MAIN ] EDU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:27.963336] [INFO ] [MAIN ] EDU: Generated 1820 derivative records from 45666 primary records. [2025-09-26T22:20:27.968570] [DEBUG] [LOCAL ] EDU: Saving derivative data. [2025-09-26T22:20:27.969868] [DEBUG] [LOCAL ] EEX: Loaded 12042 existing records from primary storage. [2025-09-26T22:20:27.970041] [INFO ] [MAIN ] EEX: Loaded 12042 primary data records. [2025-09-26T22:20:28.111134] [DEBUG] [LOCAL ] EDU: Derivative data saved (1820 records). [2025-09-26T22:20:28.138678] [DEBUG] [LOCAL ] EE: Loaded 32973 existing records from primary storage. [2025-09-26T22:20:28.138040] [INFO ] [MAIN ] EDU: Successfully saved derivative data. [2025-09-26T22:20:28.139164] [INFO ] [MAIN ] EE: Loaded 32973 primary data records. [2025-09-26T22:20:28.153231] [INFO ] [MAIN ] Derivative Progress: 576/2074 symbols completed. EDU took 1.4s. Estimated remaining: 10m 24s. Rate: 143.9 symbols/min [2025-09-26T22:20:28.278093] [INFO ] [MAIN ] EFC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:28.724559] [DEBUG] [MAIN ] EEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:28.725480] [INFO ] [MAIN ] EEX: Generated 1820 derivative records from 12042 primary records. [2025-09-26T22:20:28.726563] [DEBUG] [LOCAL ] EEX: Saving derivative data. [2025-09-26T22:20:28.759479] [DEBUG] [LOCAL ] EFC: Loaded 46944 existing records from primary storage. [2025-09-26T22:20:28.760400] [INFO ] [MAIN ] EFC: Loaded 46944 primary data records. [2025-09-26T22:20:28.761244] [DEBUG] [LOCAL ] EEX: Derivative data saved (1820 records). [2025-09-26T22:20:28.761467] [INFO ] [MAIN ] EEX: Successfully saved derivative data. [2025-09-26T22:20:28.764039] [INFO ] [MAIN ] Derivative Progress: 577/2074 symbols completed. EEX took 0.8s. Estimated remaining: 10m 25s. Rate: 143.8 symbols/min [2025-09-26T22:20:28.781790] [INFO ] [MAIN ] EFX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:29.105224] [DEBUG] [MAIN ] EE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:29.115575] [INFO ] [MAIN ] EE: Generated 1820 derivative records from 32973 primary records. [2025-09-26T22:20:29.115818] [DEBUG] [LOCAL ] EE: Saving derivative data. [2025-09-26T22:20:29.149063] [DEBUG] [LOCAL ] EE: Derivative data saved (1820 records). [2025-09-26T22:20:29.149472] [INFO ] [MAIN ] EE: Successfully saved derivative data. [2025-09-26T22:20:29.152701] [INFO ] [MAIN ] Derivative Progress: 578/2074 symbols completed. EE took 1.2s. Estimated remaining: 10m 24s. Rate: 143.8 symbols/min [2025-09-26T22:20:29.153955] [INFO ] [MAIN ] EFXT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:29.169066] [DEBUG] [LOCAL ] EFX: Loaded 45419 existing records from primary storage. [2025-09-26T22:20:29.169462] [INFO ] [MAIN ] EFX: Loaded 45419 primary data records. [2025-09-26T22:20:29.310074] [DEBUG] [MAIN ] EFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:29.321566] [INFO ] [MAIN ] EFC: Generated 1820 derivative records from 46944 primary records. [2025-09-26T22:20:29.332091] [DEBUG] [LOCAL ] EFC: Saving derivative data. [2025-09-26T22:20:29.542039] [DEBUG] [LOCAL ] EFXT: Loaded 29755 existing records from primary storage. [2025-09-26T22:20:29.548177] [INFO ] [MAIN ] EFXT: Loaded 29755 primary data records. [2025-09-26T22:20:29.652859] [DEBUG] [LOCAL ] EFC: Derivative data saved (1820 records). [2025-09-26T22:20:29.665684] [INFO ] [MAIN ] EFC: Successfully saved derivative data. [2025-09-26T22:20:29.676608] [INFO ] [MAIN ] Derivative Progress: 579/2074 symbols completed. EFC took 1.4s. Estimated remaining: 10m 24s. Rate: 143.8 symbols/min [2025-09-26T22:20:29.681075] [INFO ] [MAIN ] EG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:29.971608] [DEBUG] [MAIN ] EFX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:29.972563] [INFO ] [MAIN ] EFX: Generated 1820 derivative records from 45419 primary records. [2025-09-26T22:20:29.972711] [DEBUG] [LOCAL ] EFX: Saving derivative data. [2025-09-26T22:20:29.996255] [DEBUG] [LOCAL ] EG: Loaded 29024 existing records from primary storage. [2025-09-26T22:20:29.998145] [INFO ] [MAIN ] EG: Loaded 29024 primary data records. [2025-09-26T22:20:30.099278] [DEBUG] [LOCAL ] EFX: Derivative data saved (1820 records). [2025-09-26T22:20:30.116521] [INFO ] [MAIN ] EFX: Successfully saved derivative data. [2025-09-26T22:20:30.124692] [INFO ] [MAIN ] Derivative Progress: 580/2074 symbols completed. EFX took 1.4s. Estimated remaining: 10m 24s. Rate: 143.7 symbols/min [2025-09-26T22:20:30.151880] [INFO ] [MAIN ] EGO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:30.347203] [DEBUG] [MAIN ] EFXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:30.348011] [INFO ] [MAIN ] EFXT: Generated 1820 derivative records from 29755 primary records. [2025-09-26T22:20:30.348214] [DEBUG] [LOCAL ] EFXT: Saving derivative data. [2025-09-26T22:20:30.370993] [DEBUG] [LOCAL ] EFXT: Derivative data saved (1820 records). [2025-09-26T22:20:30.371275] [INFO ] [MAIN ] EFXT: Successfully saved derivative data. [2025-09-26T22:20:30.373984] [INFO ] [MAIN ] Derivative Progress: 581/2074 symbols completed. EFXT took 1.2s. Estimated remaining: 10m 23s. Rate: 143.8 symbols/min [2025-09-26T22:20:30.374745] [INFO ] [MAIN ] EGP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:30.410853] [DEBUG] [MAIN ] EG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:30.412117] [INFO ] [MAIN ] EG: Generated 1820 derivative records from 29024 primary records. [2025-09-26T22:20:30.412398] [DEBUG] [LOCAL ] EG: Saving derivative data. [2025-09-26T22:20:30.429411] [DEBUG] [LOCAL ] EGO: Loaded 52295 existing records from primary storage. [2025-09-26T22:20:30.436929] [INFO ] [MAIN ] EGO: Loaded 52295 primary data records. [2025-09-26T22:20:30.572513] [DEBUG] [LOCAL ] EG: Derivative data saved (1820 records). [2025-09-26T22:20:30.577638] [INFO ] [MAIN ] EG: Successfully saved derivative data. [2025-09-26T22:20:30.581108] [INFO ] [MAIN ] Derivative Progress: 582/2074 symbols completed. EG took 0.9s. Estimated remaining: 10m 22s. Rate: 144.0 symbols/min [2025-09-26T22:20:30.578246] [DEBUG] [LOCAL ] EGP: Loaded 31536 existing records from primary storage. [2025-09-26T22:20:30.581399] [INFO ] [MAIN ] EGY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:30.582133] [INFO ] [MAIN ] EGP: Loaded 31536 primary data records. [2025-09-26T22:20:31.146784] [DEBUG] [LOCAL ] EGY: Loaded 42824 existing records from primary storage. [2025-09-26T22:20:31.147399] [INFO ] [MAIN ] EGY: Loaded 42824 primary data records. [2025-09-26T22:20:31.366118] [DEBUG] [MAIN ] EGO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:31.373369] [INFO ] [MAIN ] EGO: Generated 1820 derivative records from 52295 primary records. [2025-09-26T22:20:31.389719] [DEBUG] [LOCAL ] EGO: Saving derivative data. [2025-09-26T22:20:31.532708] [DEBUG] [LOCAL ] EGO: Derivative data saved (1820 records). [2025-09-26T22:20:31.533214] [INFO ] [MAIN ] EGO: Successfully saved derivative data. [2025-09-26T22:20:31.536509] [DEBUG] [MAIN ] EGP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:31.535988] [INFO ] [MAIN ] Derivative Progress: 583/2074 symbols completed. EGO took 1.4s. Estimated remaining: 10m 23s. Rate: 143.7 symbols/min [2025-09-26T22:20:31.538030] [INFO ] [MAIN ] EGP: Generated 1820 derivative records from 31536 primary records. [2025-09-26T22:20:31.538315] [DEBUG] [LOCAL ] EGP: Saving derivative data. [2025-09-26T22:20:31.558783] [DEBUG] [LOCAL ] EGP: Derivative data saved (1820 records). [2025-09-26T22:20:31.559075] [INFO ] [MAIN ] EGP: Successfully saved derivative data. [2025-09-26T22:20:31.562009] [INFO ] [MAIN ] Derivative Progress: 584/2074 symbols completed. EGP took 1.2s. Estimated remaining: 10m 21s. Rate: 143.9 symbols/min [2025-09-26T22:20:31.578241] [DEBUG] [MAIN ] EGY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:31.579008] [INFO ] [MAIN ] EGY: Generated 1820 derivative records from 42824 primary records. [2025-09-26T22:20:31.579074] [DEBUG] [LOCAL ] EGY: Saving derivative data. [2025-09-26T22:20:31.595970] [DEBUG] [LOCAL ] EGY: Derivative data saved (1820 records). [2025-09-26T22:20:31.596172] [INFO ] [MAIN ] EGY: Successfully saved derivative data. [2025-09-26T22:20:31.598884] [INFO ] [MAIN ] Derivative Progress: 585/2074 symbols completed. EGY took 1.0s. Estimated remaining: 10m 20s. Rate: 144.1 symbols/min [2025-09-26T22:20:31.599833] [INFO ] [MAIN ] EHC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:31.599558] [INFO ] [MAIN ] EHI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:31.600042] [INFO ] [MAIN ] EHAB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:31.615830] [DEBUG] [LOCAL ] EHI: Loaded 10472 existing records from primary storage. [2025-09-26T22:20:31.616162] [INFO ] [MAIN ] EHI: Loaded 10472 primary data records. [2025-09-26T22:20:31.760541] [DEBUG] [LOCAL ] EHAB: Loaded 30257 existing records from primary storage. [2025-09-26T22:20:31.771497] [INFO ] [MAIN ] EHAB: Loaded 30257 primary data records. [2025-09-26T22:20:32.137718] [DEBUG] [LOCAL ] EHC: Loaded 41849 existing records from primary storage. [2025-09-26T22:20:32.154756] [INFO ] [MAIN ] EHC: Loaded 41849 primary data records. [2025-09-26T22:20:32.761467] [DEBUG] [MAIN ] EHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:32.762424] [INFO ] [MAIN ] EHI: Generated 1820 derivative records from 10472 primary records. [2025-09-26T22:20:32.762752] [DEBUG] [LOCAL ] EHI: Saving derivative data. [2025-09-26T22:20:32.795184] [DEBUG] [LOCAL ] EHI: Derivative data saved (1820 records). [2025-09-26T22:20:32.801376] [INFO ] [MAIN ] EHI: Successfully saved derivative data. [2025-09-26T22:20:32.801801] [DEBUG] [MAIN ] EHAB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:32.805600] [INFO ] [MAIN ] Derivative Progress: 586/2074 symbols completed. EHI took 1.2s. Estimated remaining: 10m 22s. Rate: 143.6 symbols/min [2025-09-26T22:20:32.807426] [INFO ] [MAIN ] EHAB: Generated 1820 derivative records from 30257 primary records. [2025-09-26T22:20:32.807705] [DEBUG] [LOCAL ] EHAB: Saving derivative data. [2025-09-26T22:20:32.807972] [INFO ] [MAIN ] EIC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:32.829988] [DEBUG] [LOCAL ] EHAB: Derivative data saved (1820 records). [2025-09-26T22:20:32.830179] [INFO ] [MAIN ] EHAB: Successfully saved derivative data. [2025-09-26T22:20:32.832501] [INFO ] [MAIN ] Derivative Progress: 587/2074 symbols completed. EHAB took 1.2s. Estimated remaining: 10m 20s. Rate: 143.9 symbols/min [2025-09-26T22:20:32.833678] [INFO ] [MAIN ] EIG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:32.875163] [DEBUG] [MAIN ] EHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:32.883820] [DEBUG] [LOCAL ] EIC: Loaded 24238 existing records from primary storage. [2025-09-26T22:20:32.882583] [INFO ] [MAIN ] EHC: Generated 1820 derivative records from 41849 primary records. [2025-09-26T22:20:32.884010] [INFO ] [MAIN ] EIC: Loaded 24238 primary data records. [2025-09-26T22:20:32.884152] [DEBUG] [LOCAL ] EHC: Saving derivative data. [2025-09-26T22:20:32.937944] [DEBUG] [LOCAL ] EIG: Loaded 20519 existing records from primary storage. [2025-09-26T22:20:32.964724] [INFO ] [MAIN ] EIG: Loaded 20519 primary data records. [2025-09-26T22:20:33.260627] [DEBUG] [LOCAL ] EHC: Derivative data saved (1820 records). [2025-09-26T22:20:33.290002] [INFO ] [MAIN ] EHC: Successfully saved derivative data. [2025-09-26T22:20:33.327894] [INFO ] [MAIN ] Derivative Progress: 588/2074 symbols completed. EHC took 1.7s. Estimated remaining: 10m 20s. Rate: 143.8 symbols/min [2025-09-26T22:20:33.552670] [INFO ] [MAIN ] EL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:33.774854] [DEBUG] [MAIN ] EIG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:33.775406] [DEBUG] [MAIN ] EIC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:33.801760] [INFO ] [MAIN ] EIG: Generated 1820 derivative records from 20519 primary records. [2025-09-26T22:20:33.802841] [INFO ] [MAIN ] EIC: Generated 1820 derivative records from 24238 primary records. [2025-09-26T22:20:33.802964] [DEBUG] [LOCAL ] EIG: Saving derivative data. [2025-09-26T22:20:33.803041] [DEBUG] [LOCAL ] EIC: Saving derivative data. [2025-09-26T22:20:33.846052] [DEBUG] [LOCAL ] EIG: Derivative data saved (1820 records). [2025-09-26T22:20:33.871909] [INFO ] [MAIN ] EIG: Successfully saved derivative data. [2025-09-26T22:20:33.875085] [INFO ] [MAIN ] Derivative Progress: 589/2074 symbols completed. EIG took 1.0s. Estimated remaining: 10m 20s. Rate: 143.7 symbols/min [2025-09-26T22:20:33.878067] [INFO ] [MAIN ] ELAN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:33.877954] [DEBUG] [LOCAL ] EL: Loaded 54177 existing records from primary storage. [2025-09-26T22:20:33.879751] [INFO ] [MAIN ] EL: Loaded 54177 primary data records. [2025-09-26T22:20:33.911503] [DEBUG] [LOCAL ] EIC: Derivative data saved (1820 records). [2025-09-26T22:20:33.961917] [INFO ] [MAIN ] EIC: Successfully saved derivative data. [2025-09-26T22:20:33.986527] [INFO ] [MAIN ] Derivative Progress: 590/2074 symbols completed. EIC took 1.2s. Estimated remaining: 10m 19s. Rate: 143.9 symbols/min [2025-09-26T22:20:33.987219] [INFO ] [MAIN ] ELF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:34.346429] [DEBUG] [LOCAL ] ELAN: Loaded 53985 existing records from primary storage. [2025-09-26T22:20:34.347548] [INFO ] [MAIN ] ELAN: Loaded 53985 primary data records. [2025-09-26T22:20:34.567038] [DEBUG] [LOCAL ] ELF: Loaded 53037 existing records from primary storage. [2025-09-26T22:20:34.599128] [INFO ] [MAIN ] ELF: Loaded 53037 primary data records. [2025-09-26T22:20:34.970261] [DEBUG] [MAIN ] EL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:35.090070] [INFO ] [MAIN ] EL: Generated 1820 derivative records from 54177 primary records. [2025-09-26T22:20:35.091267] [DEBUG] [LOCAL ] EL: Saving derivative data. [2025-09-26T22:20:35.112612] [DEBUG] [LOCAL ] EL: Derivative data saved (1820 records). [2025-09-26T22:20:35.113423] [INFO ] [MAIN ] EL: Successfully saved derivative data. [2025-09-26T22:20:35.116230] [INFO ] [MAIN ] Derivative Progress: 591/2074 symbols completed. EL took 1.8s. Estimated remaining: 10m 20s. Rate: 143.5 symbols/min [2025-09-26T22:20:35.117400] [INFO ] [MAIN ] ELME: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:35.139895] [DEBUG] [MAIN ] ELAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:35.140879] [INFO ] [MAIN ] ELAN: Generated 1820 derivative records from 53985 primary records. [2025-09-26T22:20:35.141134] [DEBUG] [LOCAL ] ELAN: Saving derivative data. [2025-09-26T22:20:35.163193] [DEBUG] [LOCAL ] ELAN: Derivative data saved (1820 records). [2025-09-26T22:20:35.165197] [INFO ] [MAIN ] ELAN: Successfully saved derivative data. [2025-09-26T22:20:35.167956] [INFO ] [MAIN ] Derivative Progress: 592/2074 symbols completed. ELAN took 1.3s. Estimated remaining: 10m 19s. Rate: 143.7 symbols/min [2025-09-26T22:20:35.185637] [INFO ] [MAIN ] ELP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:35.191233] [DEBUG] [MAIN ] ELF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:35.192360] [INFO ] [MAIN ] ELF: Generated 1820 derivative records from 53037 primary records. [2025-09-26T22:20:35.192426] [DEBUG] [LOCAL ] ELF: Saving derivative data. [2025-09-26T22:20:35.224526] [DEBUG] [LOCAL ] ELME: Loaded 39817 existing records from primary storage. [2025-09-26T22:20:35.225443] [INFO ] [MAIN ] ELME: Loaded 39817 primary data records. [2025-09-26T22:20:35.238140] [DEBUG] [LOCAL ] ELF: Derivative data saved (1820 records). [2025-09-26T22:20:35.296275] [INFO ] [MAIN ] ELF: Successfully saved derivative data. [2025-09-26T22:20:35.322399] [INFO ] [MAIN ] Derivative Progress: 593/2074 symbols completed. ELF took 1.3s. Estimated remaining: 10m 18s. Rate: 143.9 symbols/min [2025-09-26T22:20:35.362141] [INFO ] [MAIN ] ELS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:35.363138] [DEBUG] [LOCAL ] ELP: Loaded 26107 existing records from primary storage. [2025-09-26T22:20:35.363258] [INFO ] [MAIN ] ELP: Loaded 26107 primary data records. [2025-09-26T22:20:35.943384] [DEBUG] [LOCAL ] ELS: Loaded 50110 existing records from primary storage. [2025-09-26T22:20:35.945477] [INFO ] [MAIN ] ELS: Loaded 50110 primary data records. [2025-09-26T22:20:36.079914] [DEBUG] [MAIN ] ELME: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:36.085765] [INFO ] [MAIN ] ELME: Generated 1820 derivative records from 39817 primary records. [2025-09-26T22:20:36.091710] [DEBUG] [LOCAL ] ELME: Saving derivative data. [2025-09-26T22:20:36.356384] [DEBUG] [MAIN ] ELP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:36.386103] [INFO ] [MAIN ] ELP: Generated 1820 derivative records from 26107 primary records. [2025-09-26T22:20:36.391146] [DEBUG] [LOCAL ] ELME: Derivative data saved (1820 records). [2025-09-26T22:20:36.390032] [DEBUG] [LOCAL ] ELP: Saving derivative data. [2025-09-26T22:20:36.393097] [INFO ] [MAIN ] ELME: Successfully saved derivative data. [2025-09-26T22:20:36.396182] [INFO ] [MAIN ] Derivative Progress: 594/2074 symbols completed. ELME took 1.3s. Estimated remaining: 10m 19s. Rate: 143.5 symbols/min [2025-09-26T22:20:36.409822] [INFO ] [MAIN ] ELV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:36.417118] [DEBUG] [LOCAL ] ELP: Derivative data saved (1820 records). [2025-09-26T22:20:36.417926] [INFO ] [MAIN ] ELP: Successfully saved derivative data. [2025-09-26T22:20:36.420546] [INFO ] [MAIN ] Derivative Progress: 595/2074 symbols completed. ELP took 1.2s. Estimated remaining: 10m 17s. Rate: 143.7 symbols/min [2025-09-26T22:20:36.422752] [INFO ] [MAIN ] EMD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:36.446666] [DEBUG] [MAIN ] ELS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:36.453133] [INFO ] [MAIN ] ELS: Generated 1820 derivative records from 50110 primary records. [2025-09-26T22:20:36.453405] [DEBUG] [LOCAL ] ELS: Saving derivative data. [2025-09-26T22:20:36.481603] [DEBUG] [LOCAL ] EMD: Loaded 21338 existing records from primary storage. [2025-09-26T22:20:36.482199] [INFO ] [MAIN ] EMD: Loaded 21338 primary data records. [2025-09-26T22:20:36.598334] [DEBUG] [LOCAL ] ELS: Derivative data saved (1820 records). [2025-09-26T22:20:36.623434] [INFO ] [MAIN ] ELS: Successfully saved derivative data. [2025-09-26T22:20:36.640631] [INFO ] [MAIN ] Derivative Progress: 596/2074 symbols completed. ELS took 1.3s. Estimated remaining: 10m 17s. Rate: 143.8 symbols/min [2025-09-26T22:20:36.657933] [DEBUG] [LOCAL ] ELV: Loaded 51334 existing records from primary storage. [2025-09-26T22:20:36.658173] [INFO ] [MAIN ] EME: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:36.668889] [INFO ] [MAIN ] ELV: Loaded 51334 primary data records. [2025-09-26T22:20:37.246370] [DEBUG] [LOCAL ] EME: Loaded 32035 existing records from primary storage. [2025-09-26T22:20:37.247004] [INFO ] [MAIN ] EME: Loaded 32035 primary data records. [2025-09-26T22:20:37.465363] [DEBUG] [MAIN ] EMD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:37.466410] [INFO ] [MAIN ] EMD: Generated 1820 derivative records from 21338 primary records. [2025-09-26T22:20:37.466773] [DEBUG] [LOCAL ] EMD: Saving derivative data. [2025-09-26T22:20:37.607992] [DEBUG] [LOCAL ] EMD: Derivative data saved (1820 records). [2025-09-26T22:20:37.608840] [INFO ] [MAIN ] EMD: Successfully saved derivative data. [2025-09-26T22:20:37.611667] [INFO ] [MAIN ] Derivative Progress: 597/2074 symbols completed. EMD took 1.2s. Estimated remaining: 10m 17s. Rate: 143.5 symbols/min [2025-09-26T22:20:37.612510] [INFO ] [MAIN ] EMF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:37.634188] [DEBUG] [LOCAL ] EMF: Loaded 3575 existing records from primary storage. [2025-09-26T22:20:37.631606] [DEBUG] [MAIN ] ELV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:37.635266] [INFO ] [MAIN ] ELV: Generated 1820 derivative records from 51334 primary records. [2025-09-26T22:20:37.635387] [INFO ] [MAIN ] EMF: Loaded 3575 primary data records. [2025-09-26T22:20:37.635473] [DEBUG] [LOCAL ] ELV: Saving derivative data. [2025-09-26T22:20:37.864182] [DEBUG] [LOCAL ] ELV: Derivative data saved (1820 records). [2025-09-26T22:20:37.973912] [INFO ] [MAIN ] ELV: Successfully saved derivative data. [2025-09-26T22:20:37.991691] [DEBUG] [MAIN ] EME: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:37.990963] [INFO ] [MAIN ] Derivative Progress: 598/2074 symbols completed. ELV took 1.6s. Estimated remaining: 10m 17s. Rate: 143.5 symbols/min [2025-09-26T22:20:37.992620] [INFO ] [MAIN ] EME: Generated 1820 derivative records from 32035 primary records. [2025-09-26T22:20:37.992840] [DEBUG] [LOCAL ] EME: Saving derivative data. [2025-09-26T22:20:38.012144] [DEBUG] [LOCAL ] EME: Derivative data saved (1820 records). [2025-09-26T22:20:38.012271] [INFO ] [MAIN ] EME: Successfully saved derivative data. [2025-09-26T22:20:38.015697] [INFO ] [MAIN ] Derivative Progress: 599/2074 symbols completed. EME took 1.4s. Estimated remaining: 10m 16s. Rate: 143.8 symbols/min [2025-09-26T22:20:38.034627] [DEBUG] [MAIN ] EMF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:38.035290] [INFO ] [MAIN ] EMF: Generated 1820 derivative records from 3575 primary records. [2025-09-26T22:20:38.035360] [DEBUG] [LOCAL ] EMF: Saving derivative data. [2025-09-26T22:20:38.049838] [DEBUG] [LOCAL ] EMF: Derivative data saved (1820 records). [2025-09-26T22:20:38.049904] [INFO ] [MAIN ] EMF: Successfully saved derivative data. [2025-09-26T22:20:38.052363] [INFO ] [MAIN ] Derivative Progress: 600/2074 symbols completed. EMF took 0.4s. Estimated remaining: 10m 14s. Rate: 144.0 symbols/min [2025-09-26T22:20:38.052932] [INFO ] [MAIN ] EMP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:38.052977] [INFO ] [MAIN ] EMN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:38.053103] [INFO ] [MAIN ] EMO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:38.059402] [DEBUG] [LOCAL ] EMP: Loaded 3062 existing records from primary storage. [2025-09-26T22:20:38.059567] [INFO ] [MAIN ] EMP: Loaded 3062 primary data records. [2025-09-26T22:20:38.172001] [DEBUG] [LOCAL ] EMO: Loaded 12656 existing records from primary storage. [2025-09-26T22:20:38.184687] [INFO ] [MAIN ] EMO: Loaded 12656 primary data records. [2025-09-26T22:20:38.580537] [DEBUG] [LOCAL ] EMN: Loaded 51117 existing records from primary storage. [2025-09-26T22:20:38.600067] [INFO ] [MAIN ] EMN: Loaded 51117 primary data records. [2025-09-26T22:20:39.161203] [DEBUG] [MAIN ] EMP: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:20:39.162179] [INFO ] [MAIN ] EMP: Generated 1819 derivative records from 3062 primary records. [2025-09-26T22:20:39.162477] [DEBUG] [LOCAL ] EMP: Saving derivative data. [2025-09-26T22:20:39.190103] [DEBUG] [LOCAL ] EMP: Derivative data saved (1819 records). [2025-09-26T22:20:39.190550] [DEBUG] [MAIN ] EMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:39.191450] [INFO ] [MAIN ] EMP: Successfully saved derivative data. [2025-09-26T22:20:39.191282] [INFO ] [MAIN ] EMO: Generated 1820 derivative records from 12656 primary records. [2025-09-26T22:20:39.194384] [INFO ] [MAIN ] Derivative Progress: 601/2074 symbols completed. EMP took 1.1s. Estimated remaining: 10m 16s. Rate: 143.6 symbols/min [2025-09-26T22:20:39.194937] [INFO ] [MAIN ] EMR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:39.194712] [DEBUG] [LOCAL ] EMO: Saving derivative data. [2025-09-26T22:20:39.216069] [DEBUG] [LOCAL ] EMO: Derivative data saved (1820 records). [2025-09-26T22:20:39.216248] [INFO ] [MAIN ] EMO: Successfully saved derivative data. [2025-09-26T22:20:39.218588] [INFO ] [MAIN ] Derivative Progress: 602/2074 symbols completed. EMO took 1.2s. Estimated remaining: 10m 14s. Rate: 143.8 symbols/min [2025-09-26T22:20:39.218905] [INFO ] [MAIN ] ENB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:39.232744] [DEBUG] [MAIN ] EMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:39.233827] [INFO ] [MAIN ] EMN: Generated 1820 derivative records from 51117 primary records. [2025-09-26T22:20:39.233919] [DEBUG] [LOCAL ] EMN: Saving derivative data. [2025-09-26T22:20:39.256839] [DEBUG] [LOCAL ] EMN: Derivative data saved (1820 records). [2025-09-26T22:20:39.257011] [INFO ] [MAIN ] EMN: Successfully saved derivative data. [2025-09-26T22:20:39.259887] [INFO ] [MAIN ] Derivative Progress: 603/2074 symbols completed. EMN took 1.2s. Estimated remaining: 10m 13s. Rate: 144.0 symbols/min [2025-09-26T22:20:39.260330] [INFO ] [MAIN ] ENFY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:39.266731] [DEBUG] [LOCAL ] ENFY: Loaded 3106 existing records from primary storage. [2025-09-26T22:20:39.266962] [INFO ] [MAIN ] ENFY: Loaded 3106 primary data records. [2025-09-26T22:20:39.432331] [DEBUG] [LOCAL ] ENB: Loaded 54295 existing records from primary storage. [2025-09-26T22:20:39.454208] [INFO ] [MAIN ] ENB: Loaded 54295 primary data records. [2025-09-26T22:20:39.741485] [DEBUG] [LOCAL ] EMR: Loaded 54027 existing records from primary storage. [2025-09-26T22:20:39.752863] [INFO ] [MAIN ] EMR: Loaded 54027 primary data records. [2025-09-26T22:20:40.328836] [DEBUG] [MAIN ] ENFY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:40.330699] [INFO ] [MAIN ] ENFY: Generated 1820 derivative records from 3106 primary records. [2025-09-26T22:20:40.330889] [DEBUG] [LOCAL ] ENFY: Saving derivative data. [2025-09-26T22:20:40.354720] [DEBUG] [LOCAL ] ENFY: Derivative data saved (1820 records). [2025-09-26T22:20:40.362971] [INFO ] [MAIN ] ENFY: Successfully saved derivative data. [2025-09-26T22:20:40.370570] [INFO ] [MAIN ] Derivative Progress: 604/2074 symbols completed. ENFY took 1.1s. Estimated remaining: 10m 14s. Rate: 143.6 symbols/min [2025-09-26T22:20:40.372020] [DEBUG] [MAIN ] ENB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:40.372396] [INFO ] [MAIN ] ENIC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:40.373503] [INFO ] [MAIN ] ENB: Generated 1820 derivative records from 54295 primary records. [2025-09-26T22:20:40.373756] [DEBUG] [LOCAL ] ENB: Saving derivative data. [2025-09-26T22:20:40.409250] [DEBUG] [MAIN ] EMR: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:20:40.411554] [INFO ] [MAIN ] EMR: Generated 1819 derivative records from 54027 primary records. [2025-09-26T22:20:40.412860] [DEBUG] [LOCAL ] ENB: Derivative data saved (1820 records). [2025-09-26T22:20:40.413219] [INFO ] [MAIN ] ENB: Successfully saved derivative data. [2025-09-26T22:20:40.416797] [DEBUG] [LOCAL ] EMR: Saving derivative data. [2025-09-26T22:20:40.416636] [INFO ] [MAIN ] Derivative Progress: 605/2074 symbols completed. ENB took 1.2s. Estimated remaining: 10m 13s. Rate: 143.8 symbols/min [2025-09-26T22:20:40.418501] [INFO ] [MAIN ] ENO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:40.447947] [DEBUG] [LOCAL ] ENO: Loaded 1952 existing records from primary storage. [2025-09-26T22:20:40.448161] [INFO ] [MAIN ] ENO: Loaded 1952 primary data records. [2025-09-26T22:20:40.486738] [DEBUG] [LOCAL ] EMR: Derivative data saved (1819 records). [2025-09-26T22:20:40.565846] [DEBUG] [LOCAL ] ENIC: Loaded 36910 existing records from primary storage. [2025-09-26T22:20:40.582375] [INFO ] [MAIN ] ENIC: Loaded 36910 primary data records. [2025-09-26T22:20:40.559603] [INFO ] [MAIN ] EMR: Successfully saved derivative data. [2025-09-26T22:20:40.589400] [INFO ] [MAIN ] Derivative Progress: 606/2074 symbols completed. EMR took 1.4s. Estimated remaining: 10m 12s. Rate: 144.0 symbols/min [2025-09-26T22:20:40.627530] [INFO ] [MAIN ] ENOV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:41.191981] [DEBUG] [LOCAL ] ENOV: Loaded 45799 existing records from primary storage. [2025-09-26T22:20:41.193526] [INFO ] [MAIN ] ENOV: Loaded 45799 primary data records. [2025-09-26T22:20:41.537126] [DEBUG] [MAIN ] ENO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:41.538296] [INFO ] [MAIN ] ENO: Generated 1820 derivative records from 1952 primary records. [2025-09-26T22:20:41.538679] [DEBUG] [LOCAL ] ENO: Saving derivative data. [2025-09-26T22:20:41.570232] [DEBUG] [MAIN ] ENIC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:41.572997] [INFO ] [MAIN ] ENIC: Generated 1820 derivative records from 36910 primary records. [2025-09-26T22:20:41.573593] [DEBUG] [LOCAL ] ENIC: Saving derivative data. [2025-09-26T22:20:41.574063] [DEBUG] [LOCAL ] ENO: Derivative data saved (1820 records). [2025-09-26T22:20:41.574175] [INFO ] [MAIN ] ENO: Successfully saved derivative data. [2025-09-26T22:20:41.577490] [INFO ] [MAIN ] Derivative Progress: 607/2074 symbols completed. ENO took 1.2s. Estimated remaining: 10m 13s. Rate: 143.6 symbols/min [2025-09-26T22:20:41.578021] [INFO ] [MAIN ] ENS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:41.599944] [DEBUG] [LOCAL ] ENIC: Derivative data saved (1820 records). [2025-09-26T22:20:41.600395] [INFO ] [MAIN ] ENIC: Successfully saved derivative data. [2025-09-26T22:20:41.606414] [INFO ] [MAIN ] Derivative Progress: 608/2074 symbols completed. ENIC took 1.2s. Estimated remaining: 10m 11s. Rate: 143.9 symbols/min [2025-09-26T22:20:41.615597] [INFO ] [MAIN ] ENVA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:41.630821] [DEBUG] [MAIN ] ENOV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:41.631810] [INFO ] [MAIN ] ENOV: Generated 1820 derivative records from 45799 primary records. [2025-09-26T22:20:41.632079] [DEBUG] [LOCAL ] ENOV: Saving derivative data. [2025-09-26T22:20:41.656872] [DEBUG] [LOCAL ] ENS: Loaded 29869 existing records from primary storage. [2025-09-26T22:20:41.657909] [INFO ] [MAIN ] ENS: Loaded 29869 primary data records. [2025-09-26T22:20:41.666693] [DEBUG] [LOCAL ] ENOV: Derivative data saved (1820 records). [2025-09-26T22:20:41.673980] [INFO ] [MAIN ] ENOV: Successfully saved derivative data. [2025-09-26T22:20:41.706145] [INFO ] [MAIN ] Derivative Progress: 609/2074 symbols completed. ENOV took 1.1s. Estimated remaining: 10m 10s. Rate: 144.0 symbols/min [2025-09-26T22:20:41.719913] [INFO ] [MAIN ] EOD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:41.797607] [DEBUG] [LOCAL ] ENVA: Loaded 25914 existing records from primary storage. [2025-09-26T22:20:41.802251] [INFO ] [MAIN ] ENVA: Loaded 25914 primary data records. [2025-09-26T22:20:41.981709] [DEBUG] [LOCAL ] EOD: Loaded 14232 existing records from primary storage. [2025-09-26T22:20:41.997165] [INFO ] [MAIN ] EOD: Loaded 14232 primary data records. [2025-09-26T22:20:42.759034] [DEBUG] [MAIN ] ENS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:42.760717] [INFO ] [MAIN ] ENS: Generated 1820 derivative records from 29869 primary records. [2025-09-26T22:20:42.760940] [DEBUG] [LOCAL ] ENS: Saving derivative data. [2025-09-26T22:20:42.792786] [DEBUG] [MAIN ] ENVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:42.794730] [INFO ] [MAIN ] ENVA: Generated 1820 derivative records from 25914 primary records. [2025-09-26T22:20:42.795331] [DEBUG] [LOCAL ] ENVA: Saving derivative data. [2025-09-26T22:20:42.812451] [DEBUG] [LOCAL ] ENS: Derivative data saved (1820 records). [2025-09-26T22:20:42.813502] [INFO ] [MAIN ] ENS: Successfully saved derivative data. [2025-09-26T22:20:42.816976] [INFO ] [MAIN ] Derivative Progress: 610/2074 symbols completed. ENS took 1.2s. Estimated remaining: 10m 11s. Rate: 143.6 symbols/min [2025-09-26T22:20:42.820039] [INFO ] [MAIN ] EOG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:42.823757] [DEBUG] [LOCAL ] ENVA: Derivative data saved (1820 records). [2025-09-26T22:20:42.823993] [INFO ] [MAIN ] ENVA: Successfully saved derivative data. [2025-09-26T22:20:42.826922] [INFO ] [MAIN ] Derivative Progress: 611/2074 symbols completed. ENVA took 1.2s. Estimated remaining: 10m 10s. Rate: 143.9 symbols/min [2025-09-26T22:20:42.827563] [INFO ] [MAIN ] EOI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:42.842961] [DEBUG] [MAIN ] EOD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:42.844066] [INFO ] [MAIN ] EOD: Generated 1820 derivative records from 14232 primary records. [2025-09-26T22:20:42.844303] [DEBUG] [LOCAL ] EOD: Saving derivative data. [2025-09-26T22:20:42.868617] [DEBUG] [LOCAL ] EOI: Loaded 10783 existing records from primary storage. [2025-09-26T22:20:42.869246] [DEBUG] [LOCAL ] EOD: Derivative data saved (1820 records). [2025-09-26T22:20:42.869527] [INFO ] [MAIN ] EOI: Loaded 10783 primary data records. [2025-09-26T22:20:42.869630] [INFO ] [MAIN ] EOD: Successfully saved derivative data. [2025-09-26T22:20:42.897234] [INFO ] [MAIN ] Derivative Progress: 612/2074 symbols completed. EOD took 1.2s. Estimated remaining: 10m 9s. Rate: 144.1 symbols/min [2025-09-26T22:20:42.929352] [INFO ] [MAIN ] EOT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:43.078510] [DEBUG] [LOCAL ] EOT: Loaded 6916 existing records from primary storage. [2025-09-26T22:20:43.121286] [INFO ] [MAIN ] EOT: Loaded 6916 primary data records. [2025-09-26T22:20:43.257105] [DEBUG] [LOCAL ] EOG: Loaded 54121 existing records from primary storage. [2025-09-26T22:20:43.279843] [INFO ] [MAIN ] EOG: Loaded 54121 primary data records. [2025-09-26T22:20:43.943886] [DEBUG] [MAIN ] EOI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:43.945132] [INFO ] [MAIN ] EOI: Generated 1820 derivative records from 10783 primary records. [2025-09-26T22:20:43.945301] [DEBUG] [LOCAL ] EOI: Saving derivative data. [2025-09-26T22:20:43.964730] [DEBUG] [LOCAL ] EOI: Derivative data saved (1820 records). [2025-09-26T22:20:43.965037] [INFO ] [MAIN ] EOI: Successfully saved derivative data. [2025-09-26T22:20:43.967662] [INFO ] [MAIN ] Derivative Progress: 613/2074 symbols completed. EOI took 1.1s. Estimated remaining: 10m 10s. Rate: 143.7 symbols/min [2025-09-26T22:20:44.012358] [DEBUG] [MAIN ] EOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:44.012795] [DEBUG] [MAIN ] EOG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:44.014811] [INFO ] [MAIN ] EOG: Generated 1820 derivative records from 54121 primary records. [2025-09-26T22:20:44.013947] [INFO ] [MAIN ] EOT: Generated 1820 derivative records from 6916 primary records. [2025-09-26T22:20:44.014957] [DEBUG] [LOCAL ] EOG: Saving derivative data. [2025-09-26T22:20:44.015028] [DEBUG] [LOCAL ] EOT: Saving derivative data. [2025-09-26T22:20:44.049102] [DEBUG] [LOCAL ] EOT: Derivative data saved (1820 records). [2025-09-26T22:20:44.050098] [DEBUG] [LOCAL ] EOG: Derivative data saved (1820 records). [2025-09-26T22:20:44.050297] [INFO ] [MAIN ] EOT: Successfully saved derivative data. [2025-09-26T22:20:44.053420] [INFO ] [MAIN ] Derivative Progress: 614/2074 symbols completed. EOT took 1.1s. Estimated remaining: 10m 9s. Rate: 143.9 symbols/min [2025-09-26T22:20:44.050444] [INFO ] [MAIN ] EOG: Successfully saved derivative data. [2025-09-26T22:20:44.056591] [INFO ] [MAIN ] Derivative Progress: 615/2074 symbols completed. EOG took 1.2s. Estimated remaining: 10m 7s. Rate: 144.1 symbols/min [2025-09-26T22:20:44.057201] [INFO ] [MAIN ] EPAC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:44.057880] [INFO ] [MAIN ] EPR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:44.058087] [INFO ] [MAIN ] EPC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:44.094542] [DEBUG] [LOCAL ] EPAC: Loaded 27416 existing records from primary storage. [2025-09-26T22:20:44.094770] [INFO ] [MAIN ] EPAC: Loaded 27416 primary data records. [2025-09-26T22:20:44.344549] [DEBUG] [LOCAL ] EPR: Loaded 44722 existing records from primary storage. [2025-09-26T22:20:44.349574] [DEBUG] [LOCAL ] EPC: Loaded 40383 existing records from primary storage. [2025-09-26T22:20:44.349885] [INFO ] [MAIN ] EPR: Loaded 44722 primary data records. [2025-09-26T22:20:44.350349] [INFO ] [MAIN ] EPC: Loaded 40383 primary data records. [2025-09-26T22:20:45.226537] [DEBUG] [MAIN ] EPAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:45.227959] [INFO ] [MAIN ] EPAC: Generated 1820 derivative records from 27416 primary records. [2025-09-26T22:20:45.228271] [DEBUG] [LOCAL ] EPAC: Saving derivative data. [2025-09-26T22:20:45.250218] [DEBUG] [LOCAL ] EPAC: Derivative data saved (1820 records). [2025-09-26T22:20:45.250517] [INFO ] [MAIN ] EPAC: Successfully saved derivative data. [2025-09-26T22:20:45.253147] [INFO ] [MAIN ] Derivative Progress: 616/2074 symbols completed. EPAC took 1.2s. Estimated remaining: 10m 9s. Rate: 143.7 symbols/min [2025-09-26T22:20:45.266954] [DEBUG] [MAIN ] EPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:45.267051] [INFO ] [MAIN ] EPRT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:45.269554] [INFO ] [MAIN ] EPR: Generated 1820 derivative records from 44722 primary records. [2025-09-26T22:20:45.269765] [DEBUG] [LOCAL ] EPR: Saving derivative data. [2025-09-26T22:20:45.297461] [DEBUG] [MAIN ] EPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:45.298278] [INFO ] [MAIN ] EPC: Generated 1820 derivative records from 40383 primary records. [2025-09-26T22:20:45.299780] [DEBUG] [LOCAL ] EPC: Saving derivative data. [2025-09-26T22:20:45.311199] [DEBUG] [LOCAL ] EPR: Derivative data saved (1820 records). [2025-09-26T22:20:45.312229] [INFO ] [MAIN ] EPR: Successfully saved derivative data. [2025-09-26T22:20:45.317638] [INFO ] [MAIN ] Derivative Progress: 617/2074 symbols completed. EPR took 1.3s. Estimated remaining: 10m 8s. Rate: 143.9 symbols/min [2025-09-26T22:20:45.318701] [INFO ] [MAIN ] EQBK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:45.327594] [DEBUG] [LOCAL ] EPC: Derivative data saved (1820 records). [2025-09-26T22:20:45.327878] [INFO ] [MAIN ] EPC: Successfully saved derivative data. [2025-09-26T22:20:45.330714] [INFO ] [MAIN ] Derivative Progress: 618/2074 symbols completed. EPC took 1.3s. Estimated remaining: 10m 6s. Rate: 144.1 symbols/min [2025-09-26T22:20:45.331202] [INFO ] [MAIN ] EQH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:45.336754] [DEBUG] [LOCAL ] EQBK: Loaded 11050 existing records from primary storage. [2025-09-26T22:20:45.336942] [INFO ] [MAIN ] EQBK: Loaded 11050 primary data records. [2025-09-26T22:20:45.506849] [DEBUG] [LOCAL ] EPRT: Loaded 49306 existing records from primary storage. [2025-09-26T22:20:45.541180] [INFO ] [MAIN ] EPRT: Loaded 49306 primary data records. [2025-09-26T22:20:45.845512] [DEBUG] [LOCAL ] EQH: Loaded 53435 existing records from primary storage. [2025-09-26T22:20:45.856432] [INFO ] [MAIN ] EQH: Loaded 53435 primary data records. [2025-09-26T22:20:46.404128] [DEBUG] [MAIN ] EQBK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:46.406594] [INFO ] [MAIN ] EQBK: Generated 1820 derivative records from 11050 primary records. [2025-09-26T22:20:46.407006] [DEBUG] [LOCAL ] EQBK: Saving derivative data. [2025-09-26T22:20:46.440164] [DEBUG] [MAIN ] EPRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:46.442424] [INFO ] [MAIN ] EPRT: Generated 1820 derivative records from 49306 primary records. [2025-09-26T22:20:46.443059] [DEBUG] [LOCAL ] EPRT: Saving derivative data. [2025-09-26T22:20:46.443518] [DEBUG] [LOCAL ] EQBK: Derivative data saved (1820 records). [2025-09-26T22:20:46.444682] [INFO ] [MAIN ] EQBK: Successfully saved derivative data. [2025-09-26T22:20:46.457183] [INFO ] [MAIN ] Derivative Progress: 619/2074 symbols completed. EQBK took 1.1s. Estimated remaining: 10m 7s. Rate: 143.7 symbols/min [2025-09-26T22:20:46.462733] [INFO ] [MAIN ] EQNR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:46.480338] [DEBUG] [MAIN ] EQH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:46.484311] [DEBUG] [LOCAL ] EPRT: Derivative data saved (1820 records). [2025-09-26T22:20:46.484499] [INFO ] [MAIN ] EPRT: Successfully saved derivative data. [2025-09-26T22:20:46.487247] [INFO ] [MAIN ] Derivative Progress: 620/2074 symbols completed. EPRT took 1.2s. Estimated remaining: 10m 6s. Rate: 143.9 symbols/min [2025-09-26T22:20:46.483870] [INFO ] [MAIN ] EQH: Generated 1820 derivative records from 53435 primary records. [2025-09-26T22:20:46.487544] [DEBUG] [LOCAL ] EQH: Saving derivative data. [2025-09-26T22:20:46.487791] [INFO ] [MAIN ] EQR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:46.512271] [DEBUG] [LOCAL ] EQH: Derivative data saved (1820 records). [2025-09-26T22:20:46.512510] [INFO ] [MAIN ] EQH: Successfully saved derivative data. [2025-09-26T22:20:46.515369] [INFO ] [MAIN ] Derivative Progress: 621/2074 symbols completed. EQH took 1.2s. Estimated remaining: 10m 5s. Rate: 144.1 symbols/min [2025-09-26T22:20:46.515856] [INFO ] [MAIN ] EQV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:46.524586] [DEBUG] [LOCAL ] EQV: Loaded 2840 existing records from primary storage. [2025-09-26T22:20:46.539135] [INFO ] [MAIN ] EQV: Loaded 2840 primary data records. [2025-09-26T22:20:46.695397] [DEBUG] [LOCAL ] EQNR: Loaded 53809 existing records from primary storage. [2025-09-26T22:20:46.711167] [INFO ] [MAIN ] EQNR: Loaded 53809 primary data records. [2025-09-26T22:20:46.889991] [DEBUG] [LOCAL ] EQR: Loaded 52190 existing records from primary storage. [2025-09-26T22:20:46.890225] [INFO ] [MAIN ] EQR: Loaded 52190 primary data records. [2025-09-26T22:20:47.678031] [DEBUG] [MAIN ] EQV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:47.679923] [INFO ] [MAIN ] EQV: Generated 1820 derivative records from 2840 primary records. [2025-09-26T22:20:47.680290] [DEBUG] [LOCAL ] EQV: Saving derivative data. [2025-09-26T22:20:47.726107] [DEBUG] [MAIN ] EQNR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:47.729596] [DEBUG] [LOCAL ] EQV: Derivative data saved (1820 records). [2025-09-26T22:20:47.728959] [INFO ] [MAIN ] EQNR: Generated 1820 derivative records from 53809 primary records. [2025-09-26T22:20:47.729831] [INFO ] [MAIN ] EQV: Successfully saved derivative data. [2025-09-26T22:20:47.733012] [INFO ] [MAIN ] Derivative Progress: 622/2074 symbols completed. EQV took 1.2s. Estimated remaining: 10m 6s. Rate: 143.7 symbols/min [2025-09-26T22:20:47.729932] [DEBUG] [LOCAL ] EQNR: Saving derivative data. [2025-09-26T22:20:47.733498] [INFO ] [MAIN ] ERJ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:47.757876] [DEBUG] [MAIN ] EQR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:47.767391] [INFO ] [MAIN ] EQR: Generated 1820 derivative records from 52190 primary records. [2025-09-26T22:20:47.769244] [DEBUG] [LOCAL ] EQNR: Derivative data saved (1820 records). [2025-09-26T22:20:47.769332] [DEBUG] [LOCAL ] EQR: Saving derivative data. [2025-09-26T22:20:47.769423] [INFO ] [MAIN ] EQNR: Successfully saved derivative data. [2025-09-26T22:20:47.772336] [INFO ] [MAIN ] Derivative Progress: 623/2074 symbols completed. EQNR took 1.3s. Estimated remaining: 10m 5s. Rate: 143.9 symbols/min [2025-09-26T22:20:47.772811] [INFO ] [MAIN ] ERO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:47.796121] [DEBUG] [LOCAL ] EQR: Derivative data saved (1820 records). [2025-09-26T22:20:47.796492] [INFO ] [MAIN ] EQR: Successfully saved derivative data. [2025-09-26T22:20:47.799457] [INFO ] [MAIN ] Derivative Progress: 624/2074 symbols completed. EQR took 1.3s. Estimated remaining: 10m 4s. Rate: 144.1 symbols/min [2025-09-26T22:20:47.799935] [INFO ] [MAIN ] ES: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:47.850979] [DEBUG] [LOCAL ] ERO: Loaded 41901 existing records from primary storage. [2025-09-26T22:20:47.851671] [INFO ] [MAIN ] ERO: Loaded 41901 primary data records. [2025-09-26T22:20:47.919700] [DEBUG] [LOCAL ] ERJ: Loaded 51477 existing records from primary storage. [2025-09-26T22:20:47.934735] [INFO ] [MAIN ] ERJ: Loaded 51477 primary data records. [2025-09-26T22:20:48.235716] [DEBUG] [LOCAL ] ES: Loaded 53309 existing records from primary storage. [2025-09-26T22:20:48.247719] [INFO ] [MAIN ] ES: Loaded 53309 primary data records. [2025-09-26T22:20:49.016638] [DEBUG] [MAIN ] ERO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:49.018021] [INFO ] [MAIN ] ERO: Generated 1820 derivative records from 41901 primary records. [2025-09-26T22:20:49.018524] [DEBUG] [LOCAL ] ERO: Saving derivative data. [2025-09-26T22:20:49.041842] [DEBUG] [LOCAL ] ERO: Derivative data saved (1820 records). [2025-09-26T22:20:49.042170] [INFO ] [MAIN ] ERO: Successfully saved derivative data. [2025-09-26T22:20:49.045146] [INFO ] [MAIN ] Derivative Progress: 625/2074 symbols completed. ERO took 1.3s. Estimated remaining: 10m 5s. Rate: 143.7 symbols/min [2025-09-26T22:20:49.059442] [INFO ] [MAIN ] ESAB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:49.060714] [DEBUG] [MAIN ] ERJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:49.063437] [INFO ] [MAIN ] ERJ: Generated 1820 derivative records from 51477 primary records. [2025-09-26T22:20:49.063956] [DEBUG] [LOCAL ] ERJ: Saving derivative data. [2025-09-26T22:20:49.098392] [DEBUG] [MAIN ] ES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:49.100319] [INFO ] [MAIN ] ES: Generated 1820 derivative records from 53309 primary records. [2025-09-26T22:20:49.100737] [DEBUG] [LOCAL ] ES: Saving derivative data. [2025-09-26T22:20:49.120945] [DEBUG] [LOCAL ] ERJ: Derivative data saved (1820 records). [2025-09-26T22:20:49.125458] [INFO ] [MAIN ] ERJ: Successfully saved derivative data. [2025-09-26T22:20:49.128479] [INFO ] [MAIN ] Derivative Progress: 626/2074 symbols completed. ERJ took 1.4s. Estimated remaining: 10m 4s. Rate: 143.9 symbols/min [2025-09-26T22:20:49.132760] [INFO ] [MAIN ] ESE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:49.132599] [DEBUG] [LOCAL ] ES: Derivative data saved (1820 records). [2025-09-26T22:20:49.133085] [INFO ] [MAIN ] ES: Successfully saved derivative data. [2025-09-26T22:20:49.136031] [INFO ] [MAIN ] Derivative Progress: 627/2074 symbols completed. ES took 1.3s. Estimated remaining: 10m 3s. Rate: 144.1 symbols/min [2025-09-26T22:20:49.137838] [INFO ] [MAIN ] ESI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:49.148073] [DEBUG] [LOCAL ] ESAB: Loaded 26683 existing records from primary storage. [2025-09-26T22:20:49.148435] [INFO ] [MAIN ] ESAB: Loaded 26683 primary data records. [2025-09-26T22:20:49.278112] [DEBUG] [LOCAL ] ESE: Loaded 16878 existing records from primary storage. [2025-09-26T22:20:49.290324] [INFO ] [MAIN ] ESE: Loaded 16878 primary data records. [2025-09-26T22:20:49.737461] [DEBUG] [LOCAL ] ESI: Loaded 51566 existing records from primary storage. [2025-09-26T22:20:49.766570] [INFO ] [MAIN ] ESI: Loaded 51566 primary data records. [2025-09-26T22:20:50.284022] [DEBUG] [MAIN ] ESAB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:50.286758] [INFO ] [MAIN ] ESAB: Generated 1820 derivative records from 26683 primary records. [2025-09-26T22:20:50.287392] [DEBUG] [LOCAL ] ESAB: Saving derivative data. [2025-09-26T22:20:50.323165] [DEBUG] [MAIN ] ESE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:50.325210] [INFO ] [MAIN ] ESE: Generated 1820 derivative records from 16878 primary records. [2025-09-26T22:20:50.325886] [DEBUG] [LOCAL ] ESE: Saving derivative data. [2025-09-26T22:20:50.346928] [DEBUG] [LOCAL ] ESE: Derivative data saved (1820 records). [2025-09-26T22:20:50.347778] [INFO ] [MAIN ] ESE: Successfully saved derivative data. [2025-09-26T22:20:50.353471] [INFO ] [MAIN ] Derivative Progress: 628/2074 symbols completed. ESE took 1.2s. Estimated remaining: 10m 4s. Rate: 143.6 symbols/min [2025-09-26T22:20:50.356957] [DEBUG] [LOCAL ] ESAB: Derivative data saved (1820 records). [2025-09-26T22:20:50.357360] [INFO ] [MAIN ] ESAB: Successfully saved derivative data. [2025-09-26T22:20:50.360139] [INFO ] [MAIN ] Derivative Progress: 629/2074 symbols completed. ESAB took 1.3s. Estimated remaining: 10m 3s. Rate: 143.9 symbols/min [2025-09-26T22:20:50.373879] [DEBUG] [MAIN ] ESI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:50.374672] [INFO ] [MAIN ] ESI: Generated 1820 derivative records from 51566 primary records. [2025-09-26T22:20:50.374746] [DEBUG] [LOCAL ] ESI: Saving derivative data. [2025-09-26T22:20:50.392573] [DEBUG] [LOCAL ] ESI: Derivative data saved (1820 records). [2025-09-26T22:20:50.392788] [INFO ] [MAIN ] ESI: Successfully saved derivative data. [2025-09-26T22:20:50.395774] [INFO ] [MAIN ] Derivative Progress: 630/2074 symbols completed. ESI took 1.3s. Estimated remaining: 10m 1s. Rate: 144.1 symbols/min [2025-09-26T22:20:50.397183] [INFO ] [MAIN ] ESS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:50.397058] [INFO ] [MAIN ] ESTC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:50.397373] [INFO ] [MAIN ] ESRT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:50.463057] [DEBUG] [LOCAL ] ESS: Loaded 30441 existing records from primary storage. [2025-09-26T22:20:50.463453] [INFO ] [MAIN ] ESS: Loaded 30441 primary data records. [2025-09-26T22:20:50.619305] [DEBUG] [LOCAL ] ESTC: Loaded 50744 existing records from primary storage. [2025-09-26T22:20:50.620710] [INFO ] [MAIN ] ESTC: Loaded 50744 primary data records. [2025-09-26T22:20:50.620557] [DEBUG] [LOCAL ] ESRT: Loaded 47104 existing records from primary storage. [2025-09-26T22:20:50.648821] [INFO ] [MAIN ] ESRT: Loaded 47104 primary data records. [2025-09-26T22:20:51.647910] [DEBUG] [MAIN ] ESS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:51.654096] [DEBUG] [MAIN ] ESTC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:51.656181] [INFO ] [MAIN ] ESTC: Generated 1820 derivative records from 50744 primary records. [2025-09-26T22:20:51.655060] [INFO ] [MAIN ] ESS: Generated 1820 derivative records from 30441 primary records. [2025-09-26T22:20:51.656458] [DEBUG] [LOCAL ] ESTC: Saving derivative data. [2025-09-26T22:20:51.660335] [DEBUG] [LOCAL ] ESS: Saving derivative data. [2025-09-26T22:20:51.697614] [DEBUG] [MAIN ] ESRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:51.703740] [INFO ] [MAIN ] ESRT: Generated 1820 derivative records from 47104 primary records. [2025-09-26T22:20:51.704203] [DEBUG] [LOCAL ] ESRT: Saving derivative data. [2025-09-26T22:20:51.712345] [DEBUG] [LOCAL ] ESTC: Derivative data saved (1820 records). [2025-09-26T22:20:51.713823] [DEBUG] [LOCAL ] ESS: Derivative data saved (1820 records). [2025-09-26T22:20:51.721614] [INFO ] [MAIN ] ESS: Successfully saved derivative data. [2025-09-26T22:20:51.714303] [INFO ] [MAIN ] ESTC: Successfully saved derivative data. [2025-09-26T22:20:51.724083] [INFO ] [MAIN ] Derivative Progress: 631/2074 symbols completed. ESS took 1.3s. Estimated remaining: 10m 3s. Rate: 143.6 symbols/min [2025-09-26T22:20:51.732547] [INFO ] [MAIN ] ET: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:51.732275] [INFO ] [MAIN ] Derivative Progress: 632/2074 symbols completed. ESTC took 1.3s. Estimated remaining: 10m 2s. Rate: 143.8 symbols/min [2025-09-26T22:20:51.734045] [INFO ] [MAIN ] ETB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:51.742356] [DEBUG] [LOCAL ] ESRT: Derivative data saved (1820 records). [2025-09-26T22:20:51.742486] [INFO ] [MAIN ] ESRT: Successfully saved derivative data. [2025-09-26T22:20:51.745569] [INFO ] [MAIN ] Derivative Progress: 633/2074 symbols completed. ESRT took 1.3s. Estimated remaining: 10m 0s. Rate: 144.0 symbols/min [2025-09-26T22:20:51.749791] [INFO ] [MAIN ] ETD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:51.759501] [DEBUG] [LOCAL ] ETB: Loaded 12181 existing records from primary storage. [2025-09-26T22:20:51.759817] [INFO ] [MAIN ] ETB: Loaded 12181 primary data records. [2025-09-26T22:20:52.023252] [DEBUG] [LOCAL ] ETD: Loaded 27661 existing records from primary storage. [2025-09-26T22:20:52.142116] [DEBUG] [LOCAL ] ET: Loaded 54569 existing records from primary storage. [2025-09-26T22:20:52.157214] [INFO ] [MAIN ] ET: Loaded 54569 primary data records. [2025-09-26T22:20:52.156756] [INFO ] [MAIN ] ETD: Loaded 27661 primary data records. [2025-09-26T22:20:52.852045] [DEBUG] [MAIN ] ETB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:52.852969] [INFO ] [MAIN ] ETB: Generated 1820 derivative records from 12181 primary records. [2025-09-26T22:20:52.853317] [DEBUG] [LOCAL ] ETB: Saving derivative data. [2025-09-26T22:20:52.873153] [DEBUG] [LOCAL ] ETB: Derivative data saved (1820 records). [2025-09-26T22:20:52.873418] [INFO ] [MAIN ] ETB: Successfully saved derivative data. [2025-09-26T22:20:52.875853] [INFO ] [MAIN ] Derivative Progress: 634/2074 symbols completed. ETB took 1.1s. Estimated remaining: 10m 2s. Rate: 143.6 symbols/min [2025-09-26T22:20:52.876289] [INFO ] [MAIN ] ETG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:52.896115] [DEBUG] [MAIN ] ETD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:52.897144] [INFO ] [MAIN ] ETD: Generated 1820 derivative records from 27661 primary records. [2025-09-26T22:20:52.897341] [DEBUG] [LOCAL ] ETD: Saving derivative data. [2025-09-26T22:20:52.923111] [DEBUG] [MAIN ] ET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:52.928114] [INFO ] [MAIN ] ET: Generated 1820 derivative records from 54569 primary records. [2025-09-26T22:20:52.929452] [DEBUG] [LOCAL ] ET: Saving derivative data. [2025-09-26T22:20:52.936912] [DEBUG] [LOCAL ] ETG: Loaded 16710 existing records from primary storage. [2025-09-26T22:20:52.945133] [INFO ] [MAIN ] ETG: Loaded 16710 primary data records. [2025-09-26T22:20:52.948764] [DEBUG] [LOCAL ] ETD: Derivative data saved (1820 records). [2025-09-26T22:20:52.951493] [INFO ] [MAIN ] ETD: Successfully saved derivative data. [2025-09-26T22:20:52.968163] [INFO ] [MAIN ] Derivative Progress: 635/2074 symbols completed. ETD took 1.2s. Estimated remaining: 10m 0s. Rate: 143.8 symbols/min [2025-09-26T22:20:53.005299] [DEBUG] [LOCAL ] ET: Derivative data saved (1820 records). [2025-09-26T22:20:52.998480] [INFO ] [MAIN ] ETJ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:53.032613] [INFO ] [MAIN ] ET: Successfully saved derivative data. [2025-09-26T22:20:53.077828] [INFO ] [MAIN ] Derivative Progress: 636/2074 symbols completed. ET took 1.3s. Estimated remaining: 9m 59s. Rate: 144.0 symbols/min [2025-09-26T22:20:53.082828] [INFO ] [MAIN ] ETN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:53.296450] [DEBUG] [LOCAL ] ETJ: Loaded 16938 existing records from primary storage. [2025-09-26T22:20:53.296678] [INFO ] [MAIN ] ETJ: Loaded 16938 primary data records. [2025-09-26T22:20:53.711556] [DEBUG] [LOCAL ] ETN: Loaded 53593 existing records from primary storage. [2025-09-26T22:20:53.713220] [INFO ] [MAIN ] ETN: Loaded 53593 primary data records. [2025-09-26T22:20:53.864384] [DEBUG] [MAIN ] ETG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:53.899568] [INFO ] [MAIN ] ETG: Generated 1820 derivative records from 16710 primary records. [2025-09-26T22:20:53.931450] [DEBUG] [LOCAL ] ETG: Saving derivative data. [2025-09-26T22:20:54.077547] [DEBUG] [LOCAL ] ETG: Derivative data saved (1820 records). [2025-09-26T22:20:54.078369] [INFO ] [MAIN ] ETG: Successfully saved derivative data. [2025-09-26T22:20:54.081570] [INFO ] [MAIN ] Derivative Progress: 637/2074 symbols completed. ETG took 1.2s. Estimated remaining: 10m 0s. Rate: 143.7 symbols/min [2025-09-26T22:20:54.095314] [INFO ] [MAIN ] ETO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:54.095626] [DEBUG] [MAIN ] ETJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:54.096736] [INFO ] [MAIN ] ETJ: Generated 1820 derivative records from 16938 primary records. [2025-09-26T22:20:54.096898] [DEBUG] [LOCAL ] ETJ: Saving derivative data. [2025-09-26T22:20:54.117545] [DEBUG] [LOCAL ] ETJ: Derivative data saved (1820 records). [2025-09-26T22:20:54.117872] [INFO ] [MAIN ] ETJ: Successfully saved derivative data. [2025-09-26T22:20:54.120918] [INFO ] [MAIN ] Derivative Progress: 638/2074 symbols completed. ETJ took 1.1s. Estimated remaining: 9m 59s. Rate: 143.9 symbols/min [2025-09-26T22:20:54.121680] [INFO ] [MAIN ] ETR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:54.125411] [DEBUG] [LOCAL ] ETO: Loaded 6600 existing records from primary storage. [2025-09-26T22:20:54.125681] [INFO ] [MAIN ] ETO: Loaded 6600 primary data records. [2025-09-26T22:20:54.297180] [DEBUG] [MAIN ] ETN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:54.334517] [INFO ] [MAIN ] ETN: Generated 1820 derivative records from 53593 primary records. [2025-09-26T22:20:54.383327] [DEBUG] [LOCAL ] ETN: Saving derivative data. [2025-09-26T22:20:54.550936] [DEBUG] [LOCAL ] ETN: Derivative data saved (1820 records). [2025-09-26T22:20:54.554088] [INFO ] [MAIN ] ETN: Successfully saved derivative data. [2025-09-26T22:20:54.553981] [DEBUG] [LOCAL ] ETR: Loaded 54001 existing records from primary storage. [2025-09-26T22:20:54.557299] [INFO ] [MAIN ] Derivative Progress: 639/2074 symbols completed. ETN took 1.5s. Estimated remaining: 9m 59s. Rate: 143.8 symbols/min [2025-09-26T22:20:54.557527] [INFO ] [MAIN ] ETR: Loaded 54001 primary data records. [2025-09-26T22:20:54.564252] [INFO ] [MAIN ] ETV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:54.881949] [DEBUG] [LOCAL ] ETV: Loaded 21729 existing records from primary storage. [2025-09-26T22:20:54.893003] [INFO ] [MAIN ] ETV: Loaded 21729 primary data records. [2025-09-26T22:20:55.010669] [DEBUG] [MAIN ] ETO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:55.023965] [INFO ] [MAIN ] ETO: Generated 1820 derivative records from 6600 primary records. [2025-09-26T22:20:55.024260] [DEBUG] [LOCAL ] ETO: Saving derivative data. [2025-09-26T22:20:55.247814] [DEBUG] [LOCAL ] ETO: Derivative data saved (1820 records). [2025-09-26T22:20:55.248678] [INFO ] [MAIN ] ETO: Successfully saved derivative data. [2025-09-26T22:20:55.251185] [INFO ] [MAIN ] Derivative Progress: 640/2074 symbols completed. ETO took 1.2s. Estimated remaining: 9m 59s. Rate: 143.7 symbols/min [2025-09-26T22:20:55.252080] [INFO ] [MAIN ] ETW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:55.272267] [DEBUG] [MAIN ] ETR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:55.273694] [INFO ] [MAIN ] ETR: Generated 1820 derivative records from 54001 primary records. [2025-09-26T22:20:55.274209] [DEBUG] [LOCAL ] ETR: Saving derivative data. [2025-09-26T22:20:55.299886] [DEBUG] [LOCAL ] ETR: Derivative data saved (1820 records). [2025-09-26T22:20:55.300503] [INFO ] [MAIN ] ETR: Successfully saved derivative data. [2025-09-26T22:20:55.302833] [INFO ] [MAIN ] Derivative Progress: 641/2074 symbols completed. ETR took 1.2s. Estimated remaining: 9m 58s. Rate: 143.9 symbols/min [2025-09-26T22:20:55.303527] [INFO ] [MAIN ] ETX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:55.321274] [DEBUG] [LOCAL ] ETX: Loaded 5028 existing records from primary storage. [2025-09-26T22:20:55.317456] [DEBUG] [LOCAL ] ETW: Loaded 25463 existing records from primary storage. [2025-09-26T22:20:55.322281] [INFO ] [MAIN ] ETX: Loaded 5028 primary data records. [2025-09-26T22:20:55.328489] [INFO ] [MAIN ] ETW: Loaded 25463 primary data records. [2025-09-26T22:20:55.434244] [DEBUG] [MAIN ] ETV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:55.483915] [INFO ] [MAIN ] ETV: Generated 1820 derivative records from 21729 primary records. [2025-09-26T22:20:55.544826] [DEBUG] [LOCAL ] ETV: Saving derivative data. [2025-09-26T22:20:55.940297] [DEBUG] [LOCAL ] ETV: Derivative data saved (1820 records). [2025-09-26T22:20:56.068717] [INFO ] [MAIN ] ETV: Successfully saved derivative data. [2025-09-26T22:20:56.087549] [INFO ] [MAIN ] Derivative Progress: 642/2074 symbols completed. ETV took 1.5s. Estimated remaining: 9m 58s. Rate: 143.7 symbols/min [2025-09-26T22:20:56.088726] [INFO ] [MAIN ] ETY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:56.122484] [DEBUG] [MAIN ] ETX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:56.123602] [INFO ] [MAIN ] ETX: Generated 1820 derivative records from 5028 primary records. [2025-09-26T22:20:56.123775] [DEBUG] [LOCAL ] ETX: Saving derivative data. [2025-09-26T22:20:56.150407] [DEBUG] [LOCAL ] ETY: Loaded 23078 existing records from primary storage. [2025-09-26T22:20:56.159007] [DEBUG] [LOCAL ] ETX: Derivative data saved (1820 records). [2025-09-26T22:20:56.163970] [INFO ] [MAIN ] ETX: Successfully saved derivative data. [2025-09-26T22:20:56.166553] [INFO ] [MAIN ] Derivative Progress: 643/2074 symbols completed. ETX took 0.9s. Estimated remaining: 9m 57s. Rate: 143.9 symbols/min [2025-09-26T22:20:56.164266] [INFO ] [MAIN ] ETY: Loaded 23078 primary data records. [2025-09-26T22:20:56.167414] [DEBUG] [MAIN ] ETW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:56.173530] [INFO ] [MAIN ] ETW: Generated 1820 derivative records from 25463 primary records. [2025-09-26T22:20:56.173619] [DEBUG] [LOCAL ] ETW: Saving derivative data. [2025-09-26T22:20:56.299311] [DEBUG] [LOCAL ] ETW: Derivative data saved (1820 records). [2025-09-26T22:20:56.303352] [INFO ] [MAIN ] ETW: Successfully saved derivative data. [2025-09-26T22:20:56.306271] [INFO ] [MAIN ] Derivative Progress: 644/2074 symbols completed. ETW took 1.1s. Estimated remaining: 9m 56s. Rate: 144.0 symbols/min [2025-09-26T22:20:56.526769] [DEBUG] [MAIN ] ETY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:56.527592] [INFO ] [MAIN ] ETY: Generated 1820 derivative records from 23078 primary records. [2025-09-26T22:20:56.527686] [DEBUG] [LOCAL ] ETY: Saving derivative data. [2025-09-26T22:20:56.544272] [DEBUG] [LOCAL ] ETY: Derivative data saved (1820 records). [2025-09-26T22:20:56.544413] [INFO ] [MAIN ] ETY: Successfully saved derivative data. [2025-09-26T22:20:56.546629] [INFO ] [MAIN ] Derivative Progress: 645/2074 symbols completed. ETY took 0.5s. Estimated remaining: 9m 55s. Rate: 144.1 symbols/min [2025-09-26T22:20:56.547834] [INFO ] [MAIN ] EVF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:56.547749] [INFO ] [MAIN ] EVC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:56.547608] [INFO ] [MAIN ] EVEX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:56.561341] [DEBUG] [LOCAL ] EVF: Loaded 9501 existing records from primary storage. [2025-09-26T22:20:56.561500] [INFO ] [MAIN ] EVF: Loaded 9501 primary data records. [2025-09-26T22:20:56.698746] [DEBUG] [LOCAL ] EVC: Loaded 19415 existing records from primary storage. [2025-09-26T22:20:56.707891] [INFO ] [MAIN ] EVC: Loaded 19415 primary data records. [2025-09-26T22:20:56.741288] [DEBUG] [LOCAL ] EVEX: Loaded 30549 existing records from primary storage. [2025-09-26T22:20:56.782496] [INFO ] [MAIN ] EVEX: Loaded 30549 primary data records. [2025-09-26T22:20:57.598999] [DEBUG] [MAIN ] EVF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:57.600583] [INFO ] [MAIN ] EVF: Generated 1820 derivative records from 9501 primary records. [2025-09-26T22:20:57.601061] [DEBUG] [LOCAL ] EVF: Saving derivative data. [2025-09-26T22:20:57.620779] [DEBUG] [LOCAL ] EVF: Derivative data saved (1820 records). [2025-09-26T22:20:57.620978] [INFO ] [MAIN ] EVF: Successfully saved derivative data. [2025-09-26T22:20:57.623196] [INFO ] [MAIN ] Derivative Progress: 646/2074 symbols completed. EVF took 1.1s. Estimated remaining: 9m 56s. Rate: 143.8 symbols/min [2025-09-26T22:20:57.624940] [INFO ] [MAIN ] EVG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:57.641841] [DEBUG] [MAIN ] EVC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:57.642839] [INFO ] [MAIN ] EVC: Generated 1820 derivative records from 19415 primary records. [2025-09-26T22:20:57.642935] [DEBUG] [LOCAL ] EVC: Saving derivative data. [2025-09-26T22:20:57.678238] [DEBUG] [LOCAL ] EVG: Loaded 5862 existing records from primary storage. [2025-09-26T22:20:57.677964] [DEBUG] [MAIN ] EVEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:57.678733] [INFO ] [MAIN ] EVG: Loaded 5862 primary data records. [2025-09-26T22:20:57.702285] [INFO ] [MAIN ] EVEX: Generated 1820 derivative records from 30549 primary records. [2025-09-26T22:20:57.715592] [DEBUG] [LOCAL ] EVEX: Saving derivative data. [2025-09-26T22:20:57.724282] [DEBUG] [LOCAL ] EVC: Derivative data saved (1820 records). [2025-09-26T22:20:57.762477] [INFO ] [MAIN ] EVC: Successfully saved derivative data. [2025-09-26T22:20:57.783623] [INFO ] [MAIN ] Derivative Progress: 647/2074 symbols completed. EVC took 1.2s. Estimated remaining: 9m 55s. Rate: 143.9 symbols/min [2025-09-26T22:20:57.789409] [INFO ] [MAIN ] EVH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:57.821330] [DEBUG] [LOCAL ] EVEX: Derivative data saved (1820 records). [2025-09-26T22:20:57.827414] [INFO ] [MAIN ] EVEX: Successfully saved derivative data. [2025-09-26T22:20:57.841050] [INFO ] [MAIN ] Derivative Progress: 648/2074 symbols completed. EVEX took 1.3s. Estimated remaining: 9m 54s. Rate: 144.1 symbols/min [2025-09-26T22:20:57.852000] [INFO ] [MAIN ] EVN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:58.092424] [DEBUG] [LOCAL ] EVN: Loaded 11217 existing records from primary storage. [2025-09-26T22:20:58.105104] [INFO ] [MAIN ] EVN: Loaded 11217 primary data records. [2025-09-26T22:20:58.248280] [DEBUG] [LOCAL ] EVH: Loaded 50111 existing records from primary storage. [2025-09-26T22:20:58.254296] [INFO ] [MAIN ] EVH: Loaded 50111 primary data records. [2025-09-26T22:20:58.812173] [DEBUG] [MAIN ] EVG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:58.831244] [INFO ] [MAIN ] EVG: Generated 1820 derivative records from 5862 primary records. [2025-09-26T22:20:58.831448] [DEBUG] [LOCAL ] EVG: Saving derivative data. [2025-09-26T22:20:58.851465] [DEBUG] [LOCAL ] EVG: Derivative data saved (1820 records). [2025-09-26T22:20:58.851954] [INFO ] [MAIN ] EVG: Successfully saved derivative data. [2025-09-26T22:20:58.854926] [INFO ] [MAIN ] Derivative Progress: 649/2074 symbols completed. EVG took 1.2s. Estimated remaining: 9m 55s. Rate: 143.8 symbols/min [2025-09-26T22:20:58.856257] [INFO ] [MAIN ] EVR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:58.878016] [DEBUG] [MAIN ] EVN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:58.879251] [INFO ] [MAIN ] EVN: Generated 1820 derivative records from 11217 primary records. [2025-09-26T22:20:58.879546] [DEBUG] [LOCAL ] EVN: Saving derivative data. [2025-09-26T22:20:58.924334] [DEBUG] [LOCAL ] EVN: Derivative data saved (1820 records). [2025-09-26T22:20:58.923633] [DEBUG] [MAIN ] EVH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:20:58.925375] [INFO ] [MAIN ] EVN: Successfully saved derivative data. [2025-09-26T22:20:58.928614] [INFO ] [MAIN ] Derivative Progress: 650/2074 symbols completed. EVN took 1.1s. Estimated remaining: 9m 53s. Rate: 144.0 symbols/min [2025-09-26T22:20:58.925281] [INFO ] [MAIN ] EVH: Generated 1820 derivative records from 50111 primary records. [2025-09-26T22:20:58.928971] [DEBUG] [LOCAL ] EVH: Saving derivative data. [2025-09-26T22:20:58.930174] [INFO ] [MAIN ] EVT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:58.956214] [DEBUG] [LOCAL ] EVR: Loaded 35882 existing records from primary storage. [2025-09-26T22:20:58.956871] [INFO ] [MAIN ] EVR: Loaded 35882 primary data records. [2025-09-26T22:20:59.031160] [DEBUG] [LOCAL ] EVH: Derivative data saved (1820 records). [2025-09-26T22:20:59.082472] [INFO ] [MAIN ] EVH: Successfully saved derivative data. [2025-09-26T22:20:59.074213] [DEBUG] [LOCAL ] EVT: Loaded 17270 existing records from primary storage. [2025-09-26T22:20:59.082725] [INFO ] [MAIN ] EVT: Loaded 17270 primary data records. [2025-09-26T22:20:59.105154] [INFO ] [MAIN ] Derivative Progress: 651/2074 symbols completed. EVH took 1.3s. Estimated remaining: 9m 53s. Rate: 144.1 symbols/min [2025-09-26T22:20:59.188927] [INFO ] [MAIN ] EVTR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:20:59.662004] [DEBUG] [LOCAL ] EVTR: Loaded 23675 existing records from primary storage. [2025-09-26T22:20:59.662316] [INFO ] [MAIN ] EVTR: Loaded 23675 primary data records. [2025-09-26T22:20:59.887690] [DEBUG] [MAIN ] EVR: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:21:00.070364] [INFO ] [MAIN ] EVR: Generated 1819 derivative records from 35882 primary records. [2025-09-26T22:21:00.071922] [DEBUG] [LOCAL ] EVR: Saving derivative data. [2025-09-26T22:21:00.109339] [DEBUG] [MAIN ] EVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:00.111091] [INFO ] [MAIN ] EVT: Generated 1820 derivative records from 17270 primary records. [2025-09-26T22:21:00.111740] [DEBUG] [LOCAL ] EVT: Saving derivative data. [2025-09-26T22:21:00.122201] [DEBUG] [LOCAL ] EVR: Derivative data saved (1819 records). [2025-09-26T22:21:00.128423] [INFO ] [MAIN ] EVR: Successfully saved derivative data. [2025-09-26T22:21:00.132560] [INFO ] [MAIN ] Derivative Progress: 652/2074 symbols completed. EVR took 1.3s. Estimated remaining: 9m 53s. Rate: 143.8 symbols/min [2025-09-26T22:21:00.134182] [INFO ] [MAIN ] EW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:00.139071] [DEBUG] [LOCAL ] EVT: Derivative data saved (1820 records). [2025-09-26T22:21:00.139524] [INFO ] [MAIN ] EVT: Successfully saved derivative data. [2025-09-26T22:21:00.142473] [INFO ] [MAIN ] Derivative Progress: 653/2074 symbols completed. EVT took 1.2s. Estimated remaining: 9m 52s. Rate: 144.0 symbols/min [2025-09-26T22:21:00.143332] [INFO ] [MAIN ] EXG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:00.163258] [DEBUG] [MAIN ] EVTR: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:21:00.164196] [INFO ] [MAIN ] EVTR: Generated 1819 derivative records from 23675 primary records. [2025-09-26T22:21:00.164269] [DEBUG] [LOCAL ] EVTR: Saving derivative data. [2025-09-26T22:21:00.185042] [DEBUG] [LOCAL ] EVTR: Derivative data saved (1819 records). [2025-09-26T22:21:00.185193] [INFO ] [MAIN ] EVTR: Successfully saved derivative data. [2025-09-26T22:21:00.188202] [INFO ] [MAIN ] Derivative Progress: 654/2074 symbols completed. EVTR took 1.0s. Estimated remaining: 9m 51s. Rate: 144.2 symbols/min [2025-09-26T22:21:00.198258] [INFO ] [MAIN ] EXK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:00.228181] [DEBUG] [LOCAL ] EXG: Loaded 34725 existing records from primary storage. [2025-09-26T22:21:00.228376] [INFO ] [MAIN ] EXG: Loaded 34725 primary data records. [2025-09-26T22:21:00.349027] [DEBUG] [LOCAL ] EW: Loaded 54176 existing records from primary storage. [2025-09-26T22:21:00.362184] [INFO ] [MAIN ] EW: Loaded 54176 primary data records. [2025-09-26T22:21:00.589027] [DEBUG] [LOCAL ] EXK: Loaded 53904 existing records from primary storage. [2025-09-26T22:21:00.732636] [INFO ] [MAIN ] EXK: Loaded 53904 primary data records. [2025-09-26T22:21:01.344495] [DEBUG] [MAIN ] EXG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:01.347588] [INFO ] [MAIN ] EXG: Generated 1820 derivative records from 34725 primary records. [2025-09-26T22:21:01.350055] [DEBUG] [LOCAL ] EXG: Saving derivative data. [2025-09-26T22:21:01.382587] [DEBUG] [MAIN ] EW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:01.385772] [INFO ] [MAIN ] EW: Generated 1820 derivative records from 54176 primary records. [2025-09-26T22:21:01.386842] [DEBUG] [LOCAL ] EXG: Derivative data saved (1820 records). [2025-09-26T22:21:01.386989] [INFO ] [MAIN ] EXG: Successfully saved derivative data. [2025-09-26T22:21:01.387261] [DEBUG] [LOCAL ] EW: Saving derivative data. [2025-09-26T22:21:01.392008] [INFO ] [MAIN ] Derivative Progress: 655/2074 symbols completed. EXG took 1.2s. Estimated remaining: 9m 52s. Rate: 143.8 symbols/min [2025-09-26T22:21:01.407383] [INFO ] [MAIN ] EXP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:01.427374] [DEBUG] [MAIN ] EXK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:01.428854] [INFO ] [MAIN ] EXK: Generated 1820 derivative records from 53904 primary records. [2025-09-26T22:21:01.429289] [DEBUG] [LOCAL ] EW: Derivative data saved (1820 records). [2025-09-26T22:21:01.429627] [DEBUG] [LOCAL ] EXK: Saving derivative data. [2025-09-26T22:21:01.429562] [INFO ] [MAIN ] EW: Successfully saved derivative data. [2025-09-26T22:21:01.433212] [INFO ] [MAIN ] Derivative Progress: 656/2074 symbols completed. EW took 1.3s. Estimated remaining: 9m 51s. Rate: 144.0 symbols/min [2025-09-26T22:21:01.433566] [INFO ] [MAIN ] EXPD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:01.462823] [DEBUG] [LOCAL ] EXK: Derivative data saved (1820 records). [2025-09-26T22:21:01.463007] [INFO ] [MAIN ] EXK: Successfully saved derivative data. [2025-09-26T22:21:01.466439] [INFO ] [MAIN ] Derivative Progress: 657/2074 symbols completed. EXK took 1.3s. Estimated remaining: 9m 50s. Rate: 144.2 symbols/min [2025-09-26T22:21:01.467014] [INFO ] [MAIN ] EXR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:01.481001] [DEBUG] [LOCAL ] EXP: Loaded 30275 existing records from primary storage. [2025-09-26T22:21:01.481157] [INFO ] [MAIN ] EXP: Loaded 30275 primary data records. [2025-09-26T22:21:01.731179] [DEBUG] [LOCAL ] EXPD: Loaded 48786 existing records from primary storage. [2025-09-26T22:21:01.858067] [INFO ] [MAIN ] EXPD: Loaded 48786 primary data records. [2025-09-26T22:21:01.996220] [DEBUG] [LOCAL ] EXR: Loaded 46080 existing records from primary storage. [2025-09-26T22:21:02.016898] [INFO ] [MAIN ] EXR: Loaded 46080 primary data records. [2025-09-26T22:21:02.625219] [DEBUG] [MAIN ] EXP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:02.626559] [INFO ] [MAIN ] EXP: Generated 1820 derivative records from 30275 primary records. [2025-09-26T22:21:02.627157] [DEBUG] [LOCAL ] EXP: Saving derivative data. [2025-09-26T22:21:02.651276] [DEBUG] [LOCAL ] EXP: Derivative data saved (1820 records). [2025-09-26T22:21:02.664939] [INFO ] [MAIN ] EXP: Successfully saved derivative data. [2025-09-26T22:21:02.666525] [DEBUG] [MAIN ] EXPD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:02.667292] [INFO ] [MAIN ] EXPD: Generated 1820 derivative records from 48786 primary records. [2025-09-26T22:21:02.669816] [INFO ] [MAIN ] Derivative Progress: 658/2074 symbols completed. EXP took 1.3s. Estimated remaining: 9m 51s. Rate: 143.8 symbols/min [2025-09-26T22:21:02.669958] [DEBUG] [LOCAL ] EXPD: Saving derivative data. [2025-09-26T22:21:02.697254] [DEBUG] [MAIN ] EXR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:02.698513] [INFO ] [MAIN ] EXR: Generated 1820 derivative records from 46080 primary records. [2025-09-26T22:21:02.698857] [DEBUG] [LOCAL ] EXR: Saving derivative data. [2025-09-26T22:21:02.718446] [DEBUG] [LOCAL ] EXR: Derivative data saved (1820 records). [2025-09-26T22:21:02.719229] [DEBUG] [LOCAL ] EXPD: Derivative data saved (1820 records). [2025-09-26T22:21:02.719280] [INFO ] [MAIN ] EXR: Successfully saved derivative data. [2025-09-26T22:21:02.722233] [INFO ] [MAIN ] Derivative Progress: 659/2074 symbols completed. EXR took 1.3s. Estimated remaining: 9m 50s. Rate: 143.9 symbols/min [2025-09-26T22:21:02.722381] [INFO ] [MAIN ] EXPD: Successfully saved derivative data. [2025-09-26T22:21:02.724927] [INFO ] [MAIN ] Derivative Progress: 660/2074 symbols completed. EXPD took 1.3s. Estimated remaining: 9m 49s. Rate: 144.2 symbols/min [2025-09-26T22:21:02.725559] [INFO ] [MAIN ] FBIN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:02.725703] [INFO ] [MAIN ] FAF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:02.725624] [INFO ] [MAIN ] F: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:02.791707] [DEBUG] [LOCAL ] FBIN: Loaded 51061 existing records from primary storage. [2025-09-26T22:21:02.792044] [INFO ] [MAIN ] FBIN: Loaded 51061 primary data records. [2025-09-26T22:21:02.943410] [DEBUG] [LOCAL ] F: Loaded 54600 existing records from primary storage. [2025-09-26T22:21:02.945153] [INFO ] [MAIN ] F: Loaded 54600 primary data records. [2025-09-26T22:21:02.962234] [DEBUG] [LOCAL ] FAF: Loaded 42474 existing records from primary storage. [2025-09-26T22:21:02.979303] [INFO ] [MAIN ] FAF: Loaded 42474 primary data records. [2025-09-26T22:21:03.852633] [DEBUG] [MAIN ] FBIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:03.853919] [INFO ] [MAIN ] FBIN: Generated 1820 derivative records from 51061 primary records. [2025-09-26T22:21:03.854143] [DEBUG] [LOCAL ] FBIN: Saving derivative data. [2025-09-26T22:21:03.892347] [DEBUG] [LOCAL ] FBIN: Derivative data saved (1820 records). [2025-09-26T22:21:03.891367] [DEBUG] [MAIN ] F: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:03.892602] [INFO ] [MAIN ] FBIN: Successfully saved derivative data. [2025-09-26T22:21:03.893400] [INFO ] [MAIN ] F: Generated 1820 derivative records from 54600 primary records. [2025-09-26T22:21:03.895810] [INFO ] [MAIN ] Derivative Progress: 661/2074 symbols completed. FBIN took 1.2s. Estimated remaining: 9m 50s. Rate: 143.8 symbols/min [2025-09-26T22:21:03.893622] [DEBUG] [LOCAL ] F: Saving derivative data. [2025-09-26T22:21:03.910188] [INFO ] [MAIN ] FBK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:03.926802] [DEBUG] [LOCAL ] F: Derivative data saved (1820 records). [2025-09-26T22:21:03.927221] [DEBUG] [MAIN ] FAF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:03.928424] [INFO ] [MAIN ] F: Successfully saved derivative data. [2025-09-26T22:21:03.928106] [INFO ] [MAIN ] FAF: Generated 1820 derivative records from 42474 primary records. [2025-09-26T22:21:03.932768] [DEBUG] [LOCAL ] FAF: Saving derivative data. [2025-09-26T22:21:03.932346] [INFO ] [MAIN ] Derivative Progress: 662/2074 symbols completed. F took 1.2s. Estimated remaining: 9m 48s. Rate: 144.0 symbols/min [2025-09-26T22:21:03.934183] [INFO ] [MAIN ] FBP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:03.951748] [DEBUG] [LOCAL ] FAF: Derivative data saved (1820 records). [2025-09-26T22:21:03.951949] [INFO ] [MAIN ] FAF: Successfully saved derivative data. [2025-09-26T22:21:03.959135] [INFO ] [MAIN ] Derivative Progress: 663/2074 symbols completed. FAF took 1.2s. Estimated remaining: 9m 47s. Rate: 144.2 symbols/min [2025-09-26T22:21:03.959577] [INFO ] [MAIN ] FBRT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:03.980541] [DEBUG] [LOCAL ] FBK: Loaded 26066 existing records from primary storage. [2025-09-26T22:21:03.980819] [INFO ] [MAIN ] FBK: Loaded 26066 primary data records. [2025-09-26T22:21:04.213453] [DEBUG] [LOCAL ] FBRT: Loaded 34985 existing records from primary storage. [2025-09-26T22:21:04.327714] [INFO ] [MAIN ] FBRT: Loaded 34985 primary data records. [2025-09-26T22:21:04.375674] [DEBUG] [LOCAL ] FBP: Loaded 46874 existing records from primary storage. [2025-09-26T22:21:04.396591] [INFO ] [MAIN ] FBP: Loaded 46874 primary data records. [2025-09-26T22:21:05.150381] [DEBUG] [MAIN ] FBK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:05.154015] [INFO ] [MAIN ] FBK: Generated 1820 derivative records from 26066 primary records. [2025-09-26T22:21:05.154369] [DEBUG] [LOCAL ] FBK: Saving derivative data. [2025-09-26T22:21:05.180020] [DEBUG] [LOCAL ] FBK: Derivative data saved (1820 records). [2025-09-26T22:21:05.180442] [INFO ] [MAIN ] FBK: Successfully saved derivative data. [2025-09-26T22:21:05.195769] [INFO ] [MAIN ] Derivative Progress: 664/2074 symbols completed. FBK took 1.3s. Estimated remaining: 9m 49s. Rate: 143.7 symbols/min [2025-09-26T22:21:05.196691] [DEBUG] [MAIN ] FBRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:05.197288] [INFO ] [MAIN ] FC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:05.198974] [INFO ] [MAIN ] FBRT: Generated 1820 derivative records from 34985 primary records. [2025-09-26T22:21:05.201208] [DEBUG] [LOCAL ] FBRT: Saving derivative data. [2025-09-26T22:21:05.237296] [DEBUG] [MAIN ] FBP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:05.239636] [INFO ] [MAIN ] FBP: Generated 1820 derivative records from 46874 primary records. [2025-09-26T22:21:05.238708] [DEBUG] [LOCAL ] FBRT: Derivative data saved (1820 records). [2025-09-26T22:21:05.245344] [DEBUG] [LOCAL ] FBP: Saving derivative data. [2025-09-26T22:21:05.245929] [INFO ] [MAIN ] FBRT: Successfully saved derivative data. [2025-09-26T22:21:05.248788] [INFO ] [MAIN ] Derivative Progress: 665/2074 symbols completed. FBRT took 1.3s. Estimated remaining: 9m 47s. Rate: 143.9 symbols/min [2025-09-26T22:21:05.250361] [DEBUG] [LOCAL ] FC: Loaded 15634 existing records from primary storage. [2025-09-26T22:21:05.251150] [INFO ] [MAIN ] FCF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:05.259605] [INFO ] [MAIN ] FC: Loaded 15634 primary data records. [2025-09-26T22:21:05.361533] [DEBUG] [LOCAL ] FBP: Derivative data saved (1820 records). [2025-09-26T22:21:05.384705] [INFO ] [MAIN ] FBP: Successfully saved derivative data. [2025-09-26T22:21:05.392759] [INFO ] [MAIN ] Derivative Progress: 666/2074 symbols completed. FBP took 1.5s. Estimated remaining: 9m 46s. Rate: 144.1 symbols/min [2025-09-26T22:21:05.419402] [INFO ] [MAIN ] FCN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:05.631544] [DEBUG] [LOCAL ] FCF: Loaded 40237 existing records from primary storage. [2025-09-26T22:21:05.631943] [INFO ] [MAIN ] FCF: Loaded 40237 primary data records. [2025-09-26T22:21:05.859253] [DEBUG] [LOCAL ] FCN: Loaded 26559 existing records from primary storage. [2025-09-26T22:21:05.897108] [INFO ] [MAIN ] FCN: Loaded 26559 primary data records. [2025-09-26T22:21:06.170186] [DEBUG] [MAIN ] FC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:06.175930] [INFO ] [MAIN ] FC: Generated 1820 derivative records from 15634 primary records. [2025-09-26T22:21:06.204089] [DEBUG] [LOCAL ] FC: Saving derivative data. [2025-09-26T22:21:06.417618] [DEBUG] [LOCAL ] FC: Derivative data saved (1820 records). [2025-09-26T22:21:06.417861] [INFO ] [MAIN ] FC: Successfully saved derivative data. [2025-09-26T22:21:06.420428] [INFO ] [MAIN ] Derivative Progress: 667/2074 symbols completed. FC took 1.2s. Estimated remaining: 9m 47s. Rate: 143.8 symbols/min [2025-09-26T22:21:06.423174] [INFO ] [MAIN ] FCPT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:06.446075] [DEBUG] [MAIN ] FCF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:06.447409] [INFO ] [MAIN ] FCF: Generated 1820 derivative records from 40237 primary records. [2025-09-26T22:21:06.447941] [DEBUG] [LOCAL ] FCF: Saving derivative data. [2025-09-26T22:21:06.469564] [DEBUG] [LOCAL ] FCF: Derivative data saved (1820 records). [2025-09-26T22:21:06.469864] [INFO ] [MAIN ] FCF: Successfully saved derivative data. [2025-09-26T22:21:06.473322] [INFO ] [MAIN ] Derivative Progress: 668/2074 symbols completed. FCF took 1.2s. Estimated remaining: 9m 46s. Rate: 143.9 symbols/min [2025-09-26T22:21:06.485816] [INFO ] [MAIN ] FCT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:06.505481] [DEBUG] [MAIN ] FCN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:06.507728] [INFO ] [MAIN ] FCN: Generated 1820 derivative records from 26559 primary records. [2025-09-26T22:21:06.518711] [DEBUG] [LOCAL ] FCN: Saving derivative data. [2025-09-26T22:21:06.521312] [DEBUG] [LOCAL ] FCPT: Loaded 37955 existing records from primary storage. [2025-09-26T22:21:06.536169] [INFO ] [MAIN ] FCPT: Loaded 37955 primary data records. [2025-09-26T22:21:06.589883] [DEBUG] [LOCAL ] FCN: Derivative data saved (1820 records). [2025-09-26T22:21:06.595806] [DEBUG] [LOCAL ] FCT: Loaded 14613 existing records from primary storage. [2025-09-26T22:21:06.595372] [INFO ] [MAIN ] FCN: Successfully saved derivative data. [2025-09-26T22:21:06.609376] [INFO ] [MAIN ] Derivative Progress: 669/2074 symbols completed. FCN took 1.2s. Estimated remaining: 9m 45s. Rate: 144.1 symbols/min [2025-09-26T22:21:06.609589] [INFO ] [MAIN ] FCT: Loaded 14613 primary data records. [2025-09-26T22:21:06.630392] [INFO ] [MAIN ] FCX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:07.322176] [DEBUG] [LOCAL ] FCX: Loaded 54480 existing records from primary storage. [2025-09-26T22:21:07.322818] [INFO ] [MAIN ] FCX: Loaded 54480 primary data records. [2025-09-26T22:21:07.700959] [DEBUG] [MAIN ] FCPT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:07.703557] [INFO ] [MAIN ] FCPT: Generated 1820 derivative records from 37955 primary records. [2025-09-26T22:21:07.703857] [DEBUG] [LOCAL ] FCPT: Saving derivative data. [2025-09-26T22:21:07.702400] [DEBUG] [MAIN ] FCT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:07.718263] [INFO ] [MAIN ] FCT: Generated 1820 derivative records from 14613 primary records. [2025-09-26T22:21:07.722153] [DEBUG] [LOCAL ] FCT: Saving derivative data. [2025-09-26T22:21:07.746401] [DEBUG] [LOCAL ] FCPT: Derivative data saved (1820 records). [2025-09-26T22:21:07.748256] [INFO ] [MAIN ] FCPT: Successfully saved derivative data. [2025-09-26T22:21:07.748152] [DEBUG] [LOCAL ] FCT: Derivative data saved (1820 records). [2025-09-26T22:21:07.751120] [INFO ] [MAIN ] Derivative Progress: 670/2074 symbols completed. FCPT took 1.3s. Estimated remaining: 9m 46s. Rate: 143.7 symbols/min [2025-09-26T22:21:07.751690] [INFO ] [MAIN ] FCT: Successfully saved derivative data. [2025-09-26T22:21:07.751992] [INFO ] [MAIN ] FDP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:07.756369] [INFO ] [MAIN ] Derivative Progress: 671/2074 symbols completed. FCT took 1.3s. Estimated remaining: 9m 45s. Rate: 143.9 symbols/min [2025-09-26T22:21:07.757171] [INFO ] [MAIN ] FDS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:07.773301] [DEBUG] [MAIN ] FCX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:07.774262] [INFO ] [MAIN ] FCX: Generated 1820 derivative records from 54480 primary records. [2025-09-26T22:21:07.774391] [DEBUG] [LOCAL ] FCX: Saving derivative data. [2025-09-26T22:21:07.793832] [DEBUG] [LOCAL ] FCX: Derivative data saved (1820 records). [2025-09-26T22:21:07.794307] [INFO ] [MAIN ] FCX: Successfully saved derivative data. [2025-09-26T22:21:07.806868] [INFO ] [MAIN ] Derivative Progress: 672/2074 symbols completed. FCX took 1.2s. Estimated remaining: 9m 44s. Rate: 144.1 symbols/min [2025-09-26T22:21:07.814148] [INFO ] [MAIN ] FDX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:07.837617] [DEBUG] [LOCAL ] FDS: Loaded 26759 existing records from primary storage. [2025-09-26T22:21:07.837865] [INFO ] [MAIN ] FDS: Loaded 26759 primary data records. [2025-09-26T22:21:07.850687] [DEBUG] [LOCAL ] FDP: Loaded 30760 existing records from primary storage. [2025-09-26T22:21:07.872168] [INFO ] [MAIN ] FDP: Loaded 30760 primary data records. [2025-09-26T22:21:08.401912] [DEBUG] [LOCAL ] FDX: Loaded 52362 existing records from primary storage. [2025-09-26T22:21:08.528732] [INFO ] [MAIN ] FDX: Loaded 52362 primary data records. [2025-09-26T22:21:08.989068] [DEBUG] [MAIN ] FDS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:08.989570] [DEBUG] [MAIN ] FDP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:08.990900] [INFO ] [MAIN ] FDP: Generated 1820 derivative records from 30760 primary records. [2025-09-26T22:21:08.993596] [DEBUG] [LOCAL ] FDP: Saving derivative data. [2025-09-26T22:21:08.993314] [INFO ] [MAIN ] FDS: Generated 1820 derivative records from 26759 primary records. [2025-09-26T22:21:08.994244] [DEBUG] [LOCAL ] FDS: Saving derivative data. [2025-09-26T22:21:09.043039] [DEBUG] [LOCAL ] FDS: Derivative data saved (1820 records). [2025-09-26T22:21:09.043792] [INFO ] [MAIN ] FDS: Successfully saved derivative data. [2025-09-26T22:21:09.040048] [DEBUG] [LOCAL ] FDP: Derivative data saved (1820 records). [2025-09-26T22:21:09.047970] [INFO ] [MAIN ] FDP: Successfully saved derivative data. [2025-09-26T22:21:09.047694] [INFO ] [MAIN ] Derivative Progress: 673/2074 symbols completed. FDS took 1.3s. Estimated remaining: 9m 45s. Rate: 143.7 symbols/min [2025-09-26T22:21:09.064573] [INFO ] [MAIN ] Derivative Progress: 674/2074 symbols completed. FDP took 1.3s. Estimated remaining: 9m 44s. Rate: 143.9 symbols/min [2025-09-26T22:21:09.065481] [DEBUG] [MAIN ] FDX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:09.066986] [INFO ] [MAIN ] FDX: Generated 1820 derivative records from 52362 primary records. [2025-09-26T22:21:09.067079] [DEBUG] [LOCAL ] FDX: Saving derivative data. [2025-09-26T22:21:09.093201] [DEBUG] [LOCAL ] FDX: Derivative data saved (1820 records). [2025-09-26T22:21:09.093368] [INFO ] [MAIN ] FDX: Successfully saved derivative data. [2025-09-26T22:21:09.096976] [INFO ] [MAIN ] Derivative Progress: 675/2074 symbols completed. FDX took 1.3s. Estimated remaining: 9m 43s. Rate: 144.1 symbols/min [2025-09-26T22:21:09.098125] [INFO ] [MAIN ] FERG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:09.098962] [INFO ] [MAIN ] FET: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:09.099137] [INFO ] [MAIN ] FE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:09.122728] [DEBUG] [LOCAL ] FET: Loaded 12984 existing records from primary storage. [2025-09-26T22:21:09.123042] [INFO ] [MAIN ] FET: Loaded 12984 primary data records. [2025-09-26T22:21:09.546505] [DEBUG] [LOCAL ] FERG: Loaded 49691 existing records from primary storage. [2025-09-26T22:21:09.547842] [INFO ] [MAIN ] FERG: Loaded 49691 primary data records. [2025-09-26T22:21:09.547635] [DEBUG] [LOCAL ] FE: Loaded 54208 existing records from primary storage. [2025-09-26T22:21:09.553589] [INFO ] [MAIN ] FE: Loaded 54208 primary data records. [2025-09-26T22:21:10.249444] [DEBUG] [MAIN ] FET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:10.251024] [INFO ] [MAIN ] FET: Generated 1820 derivative records from 12984 primary records. [2025-09-26T22:21:10.251407] [DEBUG] [LOCAL ] FET: Saving derivative data. [2025-09-26T22:21:10.277837] [DEBUG] [LOCAL ] FET: Derivative data saved (1820 records). [2025-09-26T22:21:10.278504] [INFO ] [MAIN ] FET: Successfully saved derivative data. [2025-09-26T22:21:10.281399] [INFO ] [MAIN ] Derivative Progress: 676/2074 symbols completed. FET took 1.2s. Estimated remaining: 9m 44s. Rate: 143.7 symbols/min [2025-09-26T22:21:10.281987] [INFO ] [MAIN ] FF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:10.327598] [DEBUG] [MAIN ] FERG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:10.326964] [DEBUG] [MAIN ] FE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:10.328617] [INFO ] [MAIN ] FERG: Generated 1820 derivative records from 49691 primary records. [2025-09-26T22:21:10.328887] [DEBUG] [LOCAL ] FERG: Saving derivative data. [2025-09-26T22:21:10.329467] [INFO ] [MAIN ] FE: Generated 1820 derivative records from 54208 primary records. [2025-09-26T22:21:10.330667] [DEBUG] [LOCAL ] FE: Saving derivative data. [2025-09-26T22:21:10.365085] [DEBUG] [LOCAL ] FF: Loaded 25768 existing records from primary storage. [2025-09-26T22:21:10.366450] [INFO ] [MAIN ] FF: Loaded 25768 primary data records. [2025-09-26T22:21:10.382811] [DEBUG] [LOCAL ] FERG: Derivative data saved (1820 records). [2025-09-26T22:21:10.405267] [INFO ] [MAIN ] FERG: Successfully saved derivative data. [2025-09-26T22:21:10.422218] [INFO ] [MAIN ] Derivative Progress: 677/2074 symbols completed. FERG took 1.3s. Estimated remaining: 9m 43s. Rate: 143.8 symbols/min [2025-09-26T22:21:10.428546] [INFO ] [MAIN ] FFA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:10.490887] [DEBUG] [LOCAL ] FE: Derivative data saved (1820 records). [2025-09-26T22:21:10.495122] [INFO ] [MAIN ] FE: Successfully saved derivative data. [2025-09-26T22:21:10.498291] [INFO ] [MAIN ] Derivative Progress: 678/2074 symbols completed. FE took 1.4s. Estimated remaining: 9m 42s. Rate: 144.0 symbols/min [2025-09-26T22:21:10.509147] [INFO ] [MAIN ] FFC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:10.549444] [DEBUG] [LOCAL ] FFA: Loaded 5800 existing records from primary storage. [2025-09-26T22:21:10.555322] [INFO ] [MAIN ] FFA: Loaded 5800 primary data records. [2025-09-26T22:21:10.824437] [DEBUG] [LOCAL ] FFC: Loaded 16899 existing records from primary storage. [2025-09-26T22:21:10.830719] [INFO ] [MAIN ] FFC: Loaded 16899 primary data records. [2025-09-26T22:21:11.498335] [DEBUG] [MAIN ] FF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:11.499460] [INFO ] [MAIN ] FF: Generated 1820 derivative records from 25768 primary records. [2025-09-26T22:21:11.500274] [DEBUG] [LOCAL ] FF: Saving derivative data. [2025-09-26T22:21:11.522606] [DEBUG] [LOCAL ] FF: Derivative data saved (1820 records). [2025-09-26T22:21:11.523994] [INFO ] [MAIN ] FF: Successfully saved derivative data. [2025-09-26T22:21:11.526532] [INFO ] [MAIN ] Derivative Progress: 679/2074 symbols completed. FF took 1.2s. Estimated remaining: 9m 42s. Rate: 143.7 symbols/min [2025-09-26T22:21:11.534940] [INFO ] [MAIN ] FG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:11.544462] [DEBUG] [MAIN ] FFA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:11.545917] [INFO ] [MAIN ] FFA: Generated 1820 derivative records from 5800 primary records. [2025-09-26T22:21:11.546146] [DEBUG] [LOCAL ] FFA: Saving derivative data. [2025-09-26T22:21:11.580192] [DEBUG] [MAIN ] FFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:11.581841] [INFO ] [MAIN ] FFC: Generated 1820 derivative records from 16899 primary records. [2025-09-26T22:21:11.582377] [DEBUG] [LOCAL ] FFC: Saving derivative data. [2025-09-26T22:21:11.600328] [DEBUG] [LOCAL ] FFA: Derivative data saved (1820 records). [2025-09-26T22:21:11.603359] [INFO ] [MAIN ] FFA: Successfully saved derivative data. [2025-09-26T22:21:11.607018] [INFO ] [MAIN ] Derivative Progress: 680/2074 symbols completed. FFA took 1.2s. Estimated remaining: 9m 41s. Rate: 143.9 symbols/min [2025-09-26T22:21:11.607695] [INFO ] [MAIN ] FGN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:11.621440] [DEBUG] [LOCAL ] FG: Loaded 22819 existing records from primary storage. [2025-09-26T22:21:11.622946] [INFO ] [MAIN ] FG: Loaded 22819 primary data records. [2025-09-26T22:21:11.629586] [DEBUG] [LOCAL ] FFC: Derivative data saved (1820 records). [2025-09-26T22:21:11.629883] [INFO ] [MAIN ] FFC: Successfully saved derivative data. [2025-09-26T22:21:11.667052] [INFO ] [MAIN ] Derivative Progress: 681/2074 symbols completed. FFC took 1.2s. Estimated remaining: 9m 40s. Rate: 144.1 symbols/min [2025-09-26T22:21:11.672816] [DEBUG] [LOCAL ] FGN: Loaded 3915 existing records from primary storage. [2025-09-26T22:21:11.709876] [INFO ] [MAIN ] FHI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:11.709741] [INFO ] [MAIN ] FGN: Loaded 3915 primary data records. [2025-09-26T22:21:12.353864] [DEBUG] [LOCAL ] FHI: Loaded 41203 existing records from primary storage. [2025-09-26T22:21:12.355051] [INFO ] [MAIN ] FHI: Loaded 41203 primary data records. [2025-09-26T22:21:12.719602] [DEBUG] [MAIN ] FG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:12.734823] [INFO ] [MAIN ] FG: Generated 1820 derivative records from 22819 primary records. [2025-09-26T22:21:12.734964] [DEBUG] [LOCAL ] FG: Saving derivative data. [2025-09-26T22:21:12.735469] [DEBUG] [MAIN ] FGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:12.737422] [INFO ] [MAIN ] FGN: Generated 1820 derivative records from 3915 primary records. [2025-09-26T22:21:12.737765] [DEBUG] [LOCAL ] FGN: Saving derivative data. [2025-09-26T22:21:12.775564] [DEBUG] [LOCAL ] FGN: Derivative data saved (1820 records). [2025-09-26T22:21:12.775969] [INFO ] [MAIN ] FGN: Successfully saved derivative data. [2025-09-26T22:21:12.771634] [DEBUG] [LOCAL ] FG: Derivative data saved (1820 records). [2025-09-26T22:21:12.779583] [INFO ] [MAIN ] FG: Successfully saved derivative data. [2025-09-26T22:21:12.779305] [INFO ] [MAIN ] Derivative Progress: 682/2074 symbols completed. FGN took 1.2s. Estimated remaining: 9m 41s. Rate: 143.7 symbols/min [2025-09-26T22:21:12.783438] [INFO ] [MAIN ] FHN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:12.783830] [INFO ] [MAIN ] Derivative Progress: 683/2074 symbols completed. FG took 1.3s. Estimated remaining: 9m 40s. Rate: 143.9 symbols/min [2025-09-26T22:21:12.784608] [INFO ] [MAIN ] FI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:12.804528] [DEBUG] [MAIN ] FHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:12.805576] [INFO ] [MAIN ] FHI: Generated 1820 derivative records from 41203 primary records. [2025-09-26T22:21:12.806064] [DEBUG] [LOCAL ] FHI: Saving derivative data. [2025-09-26T22:21:12.824948] [DEBUG] [LOCAL ] FHI: Derivative data saved (1820 records). [2025-09-26T22:21:12.825120] [INFO ] [MAIN ] FHI: Successfully saved derivative data. [2025-09-26T22:21:12.828031] [INFO ] [MAIN ] Derivative Progress: 684/2074 symbols completed. FHI took 1.1s. Estimated remaining: 9m 39s. Rate: 144.1 symbols/min [2025-09-26T22:21:12.828325] [INFO ] [MAIN ] FICO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:12.888304] [DEBUG] [LOCAL ] FICO: Loaded 20674 existing records from primary storage. [2025-09-26T22:21:12.888540] [INFO ] [MAIN ] FICO: Loaded 20674 primary data records. [2025-09-26T22:21:13.040760] [DEBUG] [LOCAL ] FI: Loaded 54281 existing records from primary storage. [2025-09-26T22:21:13.045504] [INFO ] [MAIN ] FI: Loaded 54281 primary data records. [2025-09-26T22:21:13.046793] [DEBUG] [LOCAL ] FHN: Loaded 54148 existing records from primary storage. [2025-09-26T22:21:13.080860] [INFO ] [MAIN ] FHN: Loaded 54148 primary data records. [2025-09-26T22:21:13.999378] [DEBUG] [MAIN ] FICO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:14.000821] [INFO ] [MAIN ] FICO: Generated 1820 derivative records from 20674 primary records. [2025-09-26T22:21:14.001036] [DEBUG] [LOCAL ] FICO: Saving derivative data. [2025-09-26T22:21:14.036898] [DEBUG] [MAIN ] FI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:14.039475] [INFO ] [MAIN ] FI: Generated 1820 derivative records from 54281 primary records. [2025-09-26T22:21:14.039819] [DEBUG] [LOCAL ] FI: Saving derivative data. [2025-09-26T22:21:14.043842] [DEBUG] [LOCAL ] FICO: Derivative data saved (1820 records). [2025-09-26T22:21:14.054370] [INFO ] [MAIN ] FICO: Successfully saved derivative data. [2025-09-26T22:21:14.059400] [INFO ] [MAIN ] Derivative Progress: 685/2074 symbols completed. FICO took 1.2s. Estimated remaining: 9m 40s. Rate: 143.7 symbols/min [2025-09-26T22:21:14.074780] [INFO ] [MAIN ] FIGS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:14.078804] [DEBUG] [LOCAL ] FI: Derivative data saved (1820 records). [2025-09-26T22:21:14.075192] [DEBUG] [MAIN ] FHN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:14.080575] [INFO ] [MAIN ] FHN: Generated 1820 derivative records from 54148 primary records. [2025-09-26T22:21:14.078993] [INFO ] [MAIN ] FI: Successfully saved derivative data. [2025-09-26T22:21:14.080771] [DEBUG] [LOCAL ] FHN: Saving derivative data. [2025-09-26T22:21:14.085521] [INFO ] [MAIN ] Derivative Progress: 686/2074 symbols completed. FI took 1.3s. Estimated remaining: 9m 39s. Rate: 143.9 symbols/min [2025-09-26T22:21:14.094733] [INFO ] [MAIN ] FIHL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:14.106295] [DEBUG] [LOCAL ] FHN: Derivative data saved (1820 records). [2025-09-26T22:21:14.106538] [INFO ] [MAIN ] FHN: Successfully saved derivative data. [2025-09-26T22:21:14.109581] [INFO ] [MAIN ] Derivative Progress: 687/2074 symbols completed. FHN took 1.3s. Estimated remaining: 9m 38s. Rate: 144.1 symbols/min [2025-09-26T22:21:14.110059] [INFO ] [MAIN ] FINS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:14.122846] [DEBUG] [LOCAL ] FINS: Loaded 8309 existing records from primary storage. [2025-09-26T22:21:14.123121] [INFO ] [MAIN ] FINS: Loaded 8309 primary data records. [2025-09-26T22:21:14.351822] [DEBUG] [LOCAL ] FIGS: Loaded 49651 existing records from primary storage. [2025-09-26T22:21:14.415184] [DEBUG] [LOCAL ] FIHL: Loaded 40851 existing records from primary storage. [2025-09-26T22:21:14.415485] [INFO ] [MAIN ] FIHL: Loaded 40851 primary data records. [2025-09-26T22:21:14.414529] [INFO ] [MAIN ] FIGS: Loaded 49651 primary data records. [2025-09-26T22:21:15.233504] [DEBUG] [MAIN ] FINS: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:21:15.234828] [INFO ] [MAIN ] FINS: Generated 1819 derivative records from 8309 primary records. [2025-09-26T22:21:15.235302] [DEBUG] [LOCAL ] FINS: Saving derivative data. [2025-09-26T22:21:15.256141] [DEBUG] [LOCAL ] FINS: Derivative data saved (1819 records). [2025-09-26T22:21:15.256621] [INFO ] [MAIN ] FINS: Successfully saved derivative data. [2025-09-26T22:21:15.259693] [INFO ] [MAIN ] Derivative Progress: 688/2074 symbols completed. FINS took 1.1s. Estimated remaining: 9m 39s. Rate: 143.7 symbols/min [2025-09-26T22:21:15.279095] [DEBUG] [MAIN ] FIGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:15.281725] [INFO ] [MAIN ] FIGS: Generated 1820 derivative records from 49651 primary records. [2025-09-26T22:21:15.281951] [DEBUG] [LOCAL ] FIGS: Saving derivative data. [2025-09-26T22:21:15.304034] [DEBUG] [MAIN ] FIHL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:15.309972] [INFO ] [MAIN ] FIHL: Generated 1820 derivative records from 40851 primary records. [2025-09-26T22:21:15.315024] [DEBUG] [LOCAL ] FIHL: Saving derivative data. [2025-09-26T22:21:15.314927] [DEBUG] [LOCAL ] FIGS: Derivative data saved (1820 records). [2025-09-26T22:21:15.315218] [INFO ] [MAIN ] FIGS: Successfully saved derivative data. [2025-09-26T22:21:15.318963] [INFO ] [MAIN ] Derivative Progress: 689/2074 symbols completed. FIGS took 1.2s. Estimated remaining: 9m 37s. Rate: 143.9 symbols/min [2025-09-26T22:21:15.335772] [DEBUG] [LOCAL ] FIHL: Derivative data saved (1820 records). [2025-09-26T22:21:15.335869] [INFO ] [MAIN ] FIHL: Successfully saved derivative data. [2025-09-26T22:21:15.338934] [INFO ] [MAIN ] Derivative Progress: 690/2074 symbols completed. FIHL took 1.2s. Estimated remaining: 9m 36s. Rate: 144.1 symbols/min [2025-09-26T22:21:15.340112] [INFO ] [MAIN ] FIS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:15.340050] [INFO ] [MAIN ] FIX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:15.340291] [INFO ] [MAIN ] FINV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:15.383437] [DEBUG] [LOCAL ] FIX: Loaded 30763 existing records from primary storage. [2025-09-26T22:21:15.401524] [INFO ] [MAIN ] FIX: Loaded 30763 primary data records. [2025-09-26T22:21:15.566697] [DEBUG] [LOCAL ] FINV: Loaded 45772 existing records from primary storage. [2025-09-26T22:21:15.565716] [DEBUG] [LOCAL ] FIS: Loaded 54144 existing records from primary storage. [2025-09-26T22:21:15.582810] [INFO ] [MAIN ] FIS: Loaded 54144 primary data records. [2025-09-26T22:21:15.588145] [INFO ] [MAIN ] FINV: Loaded 45772 primary data records. [2025-09-26T22:21:16.587727] [DEBUG] [MAIN ] FIX: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:21:16.588549] [INFO ] [MAIN ] FIX: Generated 1819 derivative records from 30763 primary records. [2025-09-26T22:21:16.588852] [DEBUG] [LOCAL ] FIX: Saving derivative data. [2025-09-26T22:21:16.625726] [DEBUG] [LOCAL ] FIX: Derivative data saved (1819 records). [2025-09-26T22:21:16.625526] [DEBUG] [MAIN ] FIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:16.626605] [INFO ] [MAIN ] FIS: Generated 1820 derivative records from 54144 primary records. [2025-09-26T22:21:16.626774] [DEBUG] [LOCAL ] FIS: Saving derivative data. [2025-09-26T22:21:16.626943] [INFO ] [MAIN ] FIX: Successfully saved derivative data. [2025-09-26T22:21:16.643860] [INFO ] [MAIN ] Derivative Progress: 691/2074 symbols completed. FIX took 1.3s. Estimated remaining: 9m 38s. Rate: 143.7 symbols/min [2025-09-26T22:21:16.641719] [DEBUG] [MAIN ] FINV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:16.658190] [INFO ] [MAIN ] FINV: Generated 1820 derivative records from 45772 primary records. [2025-09-26T22:21:16.659279] [DEBUG] [LOCAL ] FINV: Saving derivative data. [2025-09-26T22:21:16.656968] [INFO ] [MAIN ] FLC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:16.689448] [DEBUG] [LOCAL ] FLC: Loaded 5559 existing records from primary storage. [2025-09-26T22:21:16.689725] [DEBUG] [LOCAL ] FINV: Derivative data saved (1820 records). [2025-09-26T22:21:16.689621] [INFO ] [MAIN ] FLC: Loaded 5559 primary data records. [2025-09-26T22:21:16.687609] [DEBUG] [LOCAL ] FIS: Derivative data saved (1820 records). [2025-09-26T22:21:16.695245] [INFO ] [MAIN ] FIS: Successfully saved derivative data. [2025-09-26T22:21:16.689915] [INFO ] [MAIN ] FINV: Successfully saved derivative data. [2025-09-26T22:21:16.699489] [INFO ] [MAIN ] Derivative Progress: 692/2074 symbols completed. FIS took 1.4s. Estimated remaining: 9m 37s. Rate: 143.8 symbols/min [2025-09-26T22:21:16.726108] [INFO ] [MAIN ] FLG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:16.726272] [INFO ] [MAIN ] Derivative Progress: 693/2074 symbols completed. FINV took 1.4s. Estimated remaining: 9m 35s. Rate: 144.0 symbols/min [2025-09-26T22:21:16.766001] [INFO ] [MAIN ] FLNG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:17.079865] [DEBUG] [LOCAL ] FLNG: Loaded 34431 existing records from primary storage. [2025-09-26T22:21:17.095473] [INFO ] [MAIN ] FLNG: Loaded 34431 primary data records. [2025-09-26T22:21:17.096466] [DEBUG] [LOCAL ] FLG: Loaded 54105 existing records from primary storage. [2025-09-26T22:21:17.109183] [INFO ] [MAIN ] FLG: Loaded 54105 primary data records. [2025-09-26T22:21:17.410144] [DEBUG] [MAIN ] FLC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:17.452363] [INFO ] [MAIN ] FLC: Generated 1820 derivative records from 5559 primary records. [2025-09-26T22:21:17.478075] [DEBUG] [LOCAL ] FLC: Saving derivative data. [2025-09-26T22:21:17.880753] [DEBUG] [LOCAL ] FLC: Derivative data saved (1820 records). [2025-09-26T22:21:17.882135] [INFO ] [MAIN ] FLC: Successfully saved derivative data. [2025-09-26T22:21:17.884975] [INFO ] [MAIN ] Derivative Progress: 694/2074 symbols completed. FLC took 1.2s. Estimated remaining: 9m 36s. Rate: 143.7 symbols/min [2025-09-26T22:21:17.886141] [INFO ] [MAIN ] FLO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:17.913572] [DEBUG] [MAIN ] FLNG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:17.914713] [INFO ] [MAIN ] FLNG: Generated 1820 derivative records from 34431 primary records. [2025-09-26T22:21:17.915163] [DEBUG] [LOCAL ] FLNG: Saving derivative data. [2025-09-26T22:21:17.949859] [DEBUG] [MAIN ] FLG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:17.953934] [INFO ] [MAIN ] FLG: Generated 1820 derivative records from 54105 primary records. [2025-09-26T22:21:17.953005] [DEBUG] [LOCAL ] FLNG: Derivative data saved (1820 records). [2025-09-26T22:21:17.954285] [INFO ] [MAIN ] FLNG: Successfully saved derivative data. [2025-09-26T22:21:17.954406] [DEBUG] [LOCAL ] FLG: Saving derivative data. [2025-09-26T22:21:17.957775] [INFO ] [MAIN ] Derivative Progress: 695/2074 symbols completed. FLNG took 1.2s. Estimated remaining: 9m 35s. Rate: 143.8 symbols/min [2025-09-26T22:21:17.959070] [INFO ] [MAIN ] FLR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:17.992405] [DEBUG] [LOCAL ] FLG: Derivative data saved (1820 records). [2025-09-26T22:21:17.992685] [INFO ] [MAIN ] FLG: Successfully saved derivative data. [2025-09-26T22:21:17.995410] [INFO ] [MAIN ] Derivative Progress: 696/2074 symbols completed. FLG took 1.3s. Estimated remaining: 9m 34s. Rate: 144.0 symbols/min [2025-09-26T22:21:17.995792] [INFO ] [MAIN ] FLS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:18.020553] [DEBUG] [LOCAL ] FLO: Loaded 52656 existing records from primary storage. [2025-09-26T22:21:18.020813] [INFO ] [MAIN ] FLO: Loaded 52656 primary data records. [2025-09-26T22:21:18.280536] [DEBUG] [LOCAL ] FLR: Loaded 53892 existing records from primary storage. [2025-09-26T22:21:18.398752] [INFO ] [MAIN ] FLR: Loaded 53892 primary data records. [2025-09-26T22:21:18.541056] [DEBUG] [LOCAL ] FLS: Loaded 50934 existing records from primary storage. [2025-09-26T22:21:18.545152] [INFO ] [MAIN ] FLS: Loaded 50934 primary data records. [2025-09-26T22:21:19.134259] [DEBUG] [MAIN ] FLO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:19.135929] [INFO ] [MAIN ] FLO: Generated 1820 derivative records from 52656 primary records. [2025-09-26T22:21:19.136229] [DEBUG] [LOCAL ] FLO: Saving derivative data. [2025-09-26T22:21:19.159404] [DEBUG] [LOCAL ] FLO: Derivative data saved (1820 records). [2025-09-26T22:21:19.160415] [INFO ] [MAIN ] FLO: Successfully saved derivative data. [2025-09-26T22:21:19.163633] [INFO ] [MAIN ] Derivative Progress: 697/2074 symbols completed. FLO took 1.3s. Estimated remaining: 9m 35s. Rate: 143.6 symbols/min [2025-09-26T22:21:19.164204] [INFO ] [MAIN ] FLUT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:19.196205] [DEBUG] [MAIN ] FLR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:19.197502] [INFO ] [MAIN ] FLR: Generated 1820 derivative records from 53892 primary records. [2025-09-26T22:21:19.197756] [DEBUG] [LOCAL ] FLR: Saving derivative data. [2025-09-26T22:21:19.233963] [DEBUG] [MAIN ] FLS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:19.250495] [INFO ] [MAIN ] FLS: Generated 1820 derivative records from 50934 primary records. [2025-09-26T22:21:19.251044] [DEBUG] [LOCAL ] FLS: Saving derivative data. [2025-09-26T22:21:19.272174] [DEBUG] [LOCAL ] FLS: Derivative data saved (1820 records). [2025-09-26T22:21:19.272443] [INFO ] [MAIN ] FLS: Successfully saved derivative data. [2025-09-26T22:21:19.276715] [INFO ] [MAIN ] Derivative Progress: 698/2074 symbols completed. FLS took 1.3s. Estimated remaining: 9m 34s. Rate: 143.8 symbols/min [2025-09-26T22:21:19.271307] [DEBUG] [LOCAL ] FLR: Derivative data saved (1820 records). [2025-09-26T22:21:19.277109] [INFO ] [MAIN ] FLR: Successfully saved derivative data. [2025-09-26T22:21:19.280326] [INFO ] [MAIN ] FLXR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:19.280425] [INFO ] [MAIN ] Derivative Progress: 699/2074 symbols completed. FLR took 1.3s. Estimated remaining: 9m 33s. Rate: 144.0 symbols/min [2025-09-26T22:21:19.296674] [INFO ] [MAIN ] FMC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:19.298840] [DEBUG] [LOCAL ] FLUT: Loaded 51580 existing records from primary storage. [2025-09-26T22:21:19.299314] [INFO ] [MAIN ] FLUT: Loaded 51580 primary data records. [2025-09-26T22:21:19.437683] [DEBUG] [LOCAL ] FLXR: Loaded 20315 existing records from primary storage. [2025-09-26T22:21:19.449140] [INFO ] [MAIN ] FLXR: Loaded 20315 primary data records. [2025-09-26T22:21:19.826464] [DEBUG] [LOCAL ] FMC: Loaded 52560 existing records from primary storage. [2025-09-26T22:21:19.827474] [INFO ] [MAIN ] FMC: Loaded 52560 primary data records. [2025-09-26T22:21:20.464242] [DEBUG] [MAIN ] FLUT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:20.466094] [INFO ] [MAIN ] FLUT: Generated 1820 derivative records from 51580 primary records. [2025-09-26T22:21:20.466621] [DEBUG] [LOCAL ] FLUT: Saving derivative data. [2025-09-26T22:21:20.487237] [DEBUG] [LOCAL ] FLUT: Derivative data saved (1820 records). [2025-09-26T22:21:20.487687] [INFO ] [MAIN ] FLUT: Successfully saved derivative data. [2025-09-26T22:21:20.490140] [INFO ] [MAIN ] Derivative Progress: 700/2074 symbols completed. FLUT took 1.3s. Estimated remaining: 9m 34s. Rate: 143.6 symbols/min [2025-09-26T22:21:20.490699] [INFO ] [MAIN ] FMN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:20.512455] [DEBUG] [MAIN ] FLXR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:20.513988] [INFO ] [MAIN ] FLXR: Generated 1820 derivative records from 20315 primary records. [2025-09-26T22:21:20.514146] [DEBUG] [LOCAL ] FLXR: Saving derivative data. [2025-09-26T22:21:20.520300] [DEBUG] [LOCAL ] FMN: Loaded 6097 existing records from primary storage. [2025-09-26T22:21:20.521155] [INFO ] [MAIN ] FMN: Loaded 6097 primary data records. [2025-09-26T22:21:20.599020] [DEBUG] [LOCAL ] FLXR: Derivative data saved (1820 records). [2025-09-26T22:21:20.634454] [INFO ] [MAIN ] FLXR: Successfully saved derivative data. [2025-09-26T22:21:20.643010] [INFO ] [MAIN ] Derivative Progress: 701/2074 symbols completed. FLXR took 1.4s. Estimated remaining: 9m 33s. Rate: 143.7 symbols/min [2025-09-26T22:21:20.662596] [INFO ] [MAIN ] FMS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:20.700040] [DEBUG] [MAIN ] FMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:20.701435] [INFO ] [MAIN ] FMC: Generated 1820 derivative records from 52560 primary records. [2025-09-26T22:21:20.701742] [DEBUG] [LOCAL ] FMC: Saving derivative data. [2025-09-26T22:21:20.956627] [DEBUG] [LOCAL ] FMC: Derivative data saved (1820 records). [2025-09-26T22:21:20.957082] [INFO ] [MAIN ] FMC: Successfully saved derivative data. [2025-09-26T22:21:20.961125] [INFO ] [MAIN ] Derivative Progress: 702/2074 symbols completed. FMC took 1.7s. Estimated remaining: 9m 33s. Rate: 143.8 symbols/min [2025-09-26T22:21:20.963127] [INFO ] [MAIN ] FMX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:20.976963] [DEBUG] [LOCAL ] FMS: Loaded 30771 existing records from primary storage. [2025-09-26T22:21:20.978004] [INFO ] [MAIN ] FMS: Loaded 30771 primary data records. [2025-09-26T22:21:21.331370] [DEBUG] [LOCAL ] FMX: Loaded 41276 existing records from primary storage. [2025-09-26T22:21:21.340363] [INFO ] [MAIN ] FMX: Loaded 41276 primary data records. [2025-09-26T22:21:21.364576] [DEBUG] [MAIN ] FMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:21.387034] [INFO ] [MAIN ] FMN: Generated 1820 derivative records from 6097 primary records. [2025-09-26T22:21:21.415363] [DEBUG] [LOCAL ] FMN: Saving derivative data. [2025-09-26T22:21:21.482374] [DEBUG] [LOCAL ] FMN: Derivative data saved (1820 records). [2025-09-26T22:21:21.488178] [INFO ] [MAIN ] FMN: Successfully saved derivative data. [2025-09-26T22:21:21.495710] [INFO ] [MAIN ] Derivative Progress: 703/2074 symbols completed. FMN took 1.0s. Estimated remaining: 9m 32s. Rate: 143.7 symbols/min [2025-09-26T22:21:21.719334] [DEBUG] [MAIN ] FMS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:21.721839] [INFO ] [MAIN ] FMS: Generated 1820 derivative records from 30771 primary records. [2025-09-26T22:21:21.722167] [DEBUG] [LOCAL ] FMS: Saving derivative data. [2025-09-26T22:21:21.741240] [DEBUG] [LOCAL ] FMS: Derivative data saved (1820 records). [2025-09-26T22:21:21.741373] [INFO ] [MAIN ] FMS: Successfully saved derivative data. [2025-09-26T22:21:21.743726] [INFO ] [MAIN ] Derivative Progress: 704/2074 symbols completed. FMS took 1.1s. Estimated remaining: 9m 32s. Rate: 143.8 symbols/min [2025-09-26T22:21:21.762337] [DEBUG] [MAIN ] FMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:21.763014] [INFO ] [MAIN ] FMX: Generated 1820 derivative records from 41276 primary records. [2025-09-26T22:21:21.763077] [DEBUG] [LOCAL ] FMX: Saving derivative data. [2025-09-26T22:21:21.779155] [DEBUG] [LOCAL ] FMX: Derivative data saved (1820 records). [2025-09-26T22:21:21.779225] [INFO ] [MAIN ] FMX: Successfully saved derivative data. [2025-09-26T22:21:21.781439] [INFO ] [MAIN ] Derivative Progress: 705/2074 symbols completed. FMX took 0.8s. Estimated remaining: 9m 30s. Rate: 144.0 symbols/min [2025-09-26T22:21:21.782055] [INFO ] [MAIN ] FNB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:21.782445] [INFO ] [MAIN ] FN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:21.782121] [INFO ] [MAIN ] FND: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:21.855728] [DEBUG] [LOCAL ] FN: Loaded 39795 existing records from primary storage. [2025-09-26T22:21:21.855894] [INFO ] [MAIN ] FN: Loaded 39795 primary data records. [2025-09-26T22:21:22.019465] [DEBUG] [LOCAL ] FNB: Loaded 53226 existing records from primary storage. [2025-09-26T22:21:22.024344] [INFO ] [MAIN ] FNB: Loaded 53226 primary data records. [2025-09-26T22:21:22.011856] [DEBUG] [LOCAL ] FND: Loaded 52871 existing records from primary storage. [2025-09-26T22:21:22.029856] [INFO ] [MAIN ] FND: Loaded 52871 primary data records. [2025-09-26T22:21:22.984219] [DEBUG] [MAIN ] FN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:22.985553] [INFO ] [MAIN ] FN: Generated 1820 derivative records from 39795 primary records. [2025-09-26T22:21:22.985780] [DEBUG] [LOCAL ] FN: Saving derivative data. [2025-09-26T22:21:23.030223] [DEBUG] [MAIN ] FNB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:23.031112] [DEBUG] [LOCAL ] FN: Derivative data saved (1820 records). [2025-09-26T22:21:23.031689] [INFO ] [MAIN ] FN: Successfully saved derivative data. [2025-09-26T22:21:23.032574] [INFO ] [MAIN ] FNB: Generated 1820 derivative records from 53226 primary records. [2025-09-26T22:21:23.034631] [INFO ] [MAIN ] Derivative Progress: 706/2074 symbols completed. FN took 1.3s. Estimated remaining: 9m 32s. Rate: 143.6 symbols/min [2025-09-26T22:21:23.042889] [DEBUG] [LOCAL ] FNB: Saving derivative data. [2025-09-26T22:21:23.049800] [INFO ] [MAIN ] FNF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:23.050634] [DEBUG] [MAIN ] FND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:23.051667] [INFO ] [MAIN ] FND: Generated 1820 derivative records from 52871 primary records. [2025-09-26T22:21:23.051854] [DEBUG] [LOCAL ] FND: Saving derivative data. [2025-09-26T22:21:23.083022] [DEBUG] [LOCAL ] FNB: Derivative data saved (1820 records). [2025-09-26T22:21:23.086731] [INFO ] [MAIN ] FNB: Successfully saved derivative data. [2025-09-26T22:21:23.089376] [INFO ] [MAIN ] Derivative Progress: 707/2074 symbols completed. FNB took 1.3s. Estimated remaining: 9m 31s. Rate: 143.8 symbols/min [2025-09-26T22:21:23.092099] [INFO ] [MAIN ] FNV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:23.091849] [DEBUG] [LOCAL ] FND: Derivative data saved (1820 records). [2025-09-26T22:21:23.092862] [INFO ] [MAIN ] FND: Successfully saved derivative data. [2025-09-26T22:21:23.096032] [INFO ] [MAIN ] Derivative Progress: 708/2074 symbols completed. FND took 1.3s. Estimated remaining: 9m 29s. Rate: 144.0 symbols/min [2025-09-26T22:21:23.096818] [INFO ] [MAIN ] FOA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:23.122002] [DEBUG] [LOCAL ] FOA: Loaded 13484 existing records from primary storage. [2025-09-26T22:21:23.122313] [INFO ] [MAIN ] FOA: Loaded 13484 primary data records. [2025-09-26T22:21:23.354494] [DEBUG] [LOCAL ] FNF: Loaded 49871 existing records from primary storage. [2025-09-26T22:21:23.377486] [DEBUG] [LOCAL ] FNV: Loaded 47028 existing records from primary storage. [2025-09-26T22:21:23.376485] [INFO ] [MAIN ] FNF: Loaded 49871 primary data records. [2025-09-26T22:21:23.403675] [INFO ] [MAIN ] FNV: Loaded 47028 primary data records. [2025-09-26T22:21:24.241840] [DEBUG] [MAIN ] FOA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:24.243765] [INFO ] [MAIN ] FOA: Generated 1820 derivative records from 13484 primary records. [2025-09-26T22:21:24.243969] [DEBUG] [LOCAL ] FOA: Saving derivative data. [2025-09-26T22:21:24.280605] [DEBUG] [MAIN ] FNF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:24.282800] [INFO ] [MAIN ] FNF: Generated 1820 derivative records from 49871 primary records. [2025-09-26T22:21:24.283060] [DEBUG] [LOCAL ] FNF: Saving derivative data. [2025-09-26T22:21:24.282957] [DEBUG] [LOCAL ] FOA: Derivative data saved (1820 records). [2025-09-26T22:21:24.283782] [INFO ] [MAIN ] FOA: Successfully saved derivative data. [2025-09-26T22:21:24.286294] [INFO ] [MAIN ] Derivative Progress: 709/2074 symbols completed. FOA took 1.2s. Estimated remaining: 9m 30s. Rate: 143.6 symbols/min [2025-09-26T22:21:24.294395] [INFO ] [MAIN ] FOF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:24.305133] [DEBUG] [LOCAL ] FNF: Derivative data saved (1820 records). [2025-09-26T22:21:24.308067] [INFO ] [MAIN ] FNF: Successfully saved derivative data. [2025-09-26T22:21:24.311162] [INFO ] [MAIN ] Derivative Progress: 710/2074 symbols completed. FNF took 1.3s. Estimated remaining: 9m 29s. Rate: 143.8 symbols/min [2025-09-26T22:21:24.311811] [INFO ] [MAIN ] FOR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:24.322478] [DEBUG] [LOCAL ] FOF: Loaded 8510 existing records from primary storage. [2025-09-26T22:21:24.322964] [INFO ] [MAIN ] FOF: Loaded 8510 primary data records. [2025-09-26T22:21:24.341352] [DEBUG] [MAIN ] FNV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:24.385254] [INFO ] [MAIN ] FNV: Generated 1820 derivative records from 47028 primary records. [2025-09-26T22:21:24.420111] [DEBUG] [LOCAL ] FNV: Saving derivative data. [2025-09-26T22:21:24.488047] [DEBUG] [LOCAL ] FOR: Loaded 20362 existing records from primary storage. [2025-09-26T22:21:24.496888] [DEBUG] [LOCAL ] FNV: Derivative data saved (1820 records). [2025-09-26T22:21:24.502415] [INFO ] [MAIN ] FOR: Loaded 20362 primary data records. [2025-09-26T22:21:24.507670] [INFO ] [MAIN ] FNV: Successfully saved derivative data. [2025-09-26T22:21:24.561927] [INFO ] [MAIN ] Derivative Progress: 711/2074 symbols completed. FNV took 1.5s. Estimated remaining: 9m 28s. Rate: 143.9 symbols/min [2025-09-26T22:21:24.617000] [INFO ] [MAIN ] FOUR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:25.135244] [DEBUG] [LOCAL ] FOUR: Loaded 50306 existing records from primary storage. [2025-09-26T22:21:25.150069] [INFO ] [MAIN ] FOUR: Loaded 50306 primary data records. [2025-09-26T22:21:25.150458] [DEBUG] [MAIN ] FOF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:25.185707] [INFO ] [MAIN ] FOF: Generated 1820 derivative records from 8510 primary records. [2025-09-26T22:21:25.203909] [DEBUG] [LOCAL ] FOF: Saving derivative data. [2025-09-26T22:21:25.330625] [DEBUG] [MAIN ] FOR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:25.390142] [DEBUG] [LOCAL ] FOF: Derivative data saved (1820 records). [2025-09-26T22:21:25.395250] [INFO ] [MAIN ] FOR: Generated 1820 derivative records from 20362 primary records. [2025-09-26T22:21:25.395687] [INFO ] [MAIN ] FOF: Successfully saved derivative data. [2025-09-26T22:21:25.398143] [DEBUG] [LOCAL ] FOR: Saving derivative data. [2025-09-26T22:21:25.397998] [INFO ] [MAIN ] Derivative Progress: 712/2074 symbols completed. FOF took 1.1s. Estimated remaining: 9m 29s. Rate: 143.7 symbols/min [2025-09-26T22:21:25.399778] [INFO ] [MAIN ] FPF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:25.539241] [DEBUG] [LOCAL ] FOR: Derivative data saved (1820 records). [2025-09-26T22:21:25.539927] [INFO ] [MAIN ] FOR: Successfully saved derivative data. [2025-09-26T22:21:25.542823] [INFO ] [MAIN ] Derivative Progress: 713/2074 symbols completed. FOR took 1.2s. Estimated remaining: 9m 28s. Rate: 143.8 symbols/min [2025-09-26T22:21:25.543807] [INFO ] [MAIN ] FPH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:25.568128] [DEBUG] [LOCAL ] FPF: Loaded 17998 existing records from primary storage. [2025-09-26T22:21:25.568699] [INFO ] [MAIN ] FPF: Loaded 17998 primary data records. [2025-09-26T22:21:25.725741] [DEBUG] [MAIN ] FOUR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:25.726781] [DEBUG] [LOCAL ] FPH: Loaded 19890 existing records from primary storage. [2025-09-26T22:21:25.733518] [INFO ] [MAIN ] FPH: Loaded 19890 primary data records. [2025-09-26T22:21:25.728153] [INFO ] [MAIN ] FOUR: Generated 1820 derivative records from 50306 primary records. [2025-09-26T22:21:25.749248] [DEBUG] [LOCAL ] FOUR: Saving derivative data. [2025-09-26T22:21:26.091149] [DEBUG] [LOCAL ] FOUR: Derivative data saved (1820 records). [2025-09-26T22:21:26.102887] [INFO ] [MAIN ] FOUR: Successfully saved derivative data. [2025-09-26T22:21:26.116046] [INFO ] [MAIN ] Derivative Progress: 714/2074 symbols completed. FOUR took 1.5s. Estimated remaining: 9m 28s. Rate: 143.7 symbols/min [2025-09-26T22:21:26.144920] [INFO ] [MAIN ] FPI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:26.430954] [DEBUG] [MAIN ] FPF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:26.432158] [INFO ] [MAIN ] FPF: Generated 1820 derivative records from 17998 primary records. [2025-09-26T22:21:26.433283] [DEBUG] [LOCAL ] FPF: Saving derivative data. [2025-09-26T22:21:26.458536] [DEBUG] [LOCAL ] FPI: Loaded 31525 existing records from primary storage. [2025-09-26T22:21:26.459076] [INFO ] [MAIN ] FPI: Loaded 31525 primary data records. [2025-09-26T22:21:26.609792] [DEBUG] [LOCAL ] FPF: Derivative data saved (1820 records). [2025-09-26T22:21:26.620774] [INFO ] [MAIN ] FPF: Successfully saved derivative data. [2025-09-26T22:21:26.651964] [DEBUG] [MAIN ] FPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:26.664122] [INFO ] [MAIN ] FPH: Generated 1820 derivative records from 19890 primary records. [2025-09-26T22:21:26.686009] [DEBUG] [LOCAL ] FPH: Saving derivative data. [2025-09-26T22:21:26.686183] [INFO ] [MAIN ] Derivative Progress: 715/2074 symbols completed. FPF took 1.3s. Estimated remaining: 9m 28s. Rate: 143.6 symbols/min [2025-09-26T22:21:26.696734] [INFO ] [MAIN ] FR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:26.856815] [DEBUG] [LOCAL ] FPH: Derivative data saved (1820 records). [2025-09-26T22:21:27.040137] [INFO ] [MAIN ] FPH: Successfully saved derivative data. [2025-09-26T22:21:27.044736] [INFO ] [MAIN ] Derivative Progress: 716/2074 symbols completed. FPH took 1.5s. Estimated remaining: 9m 27s. Rate: 143.7 symbols/min [2025-09-26T22:21:27.045388] [INFO ] [MAIN ] FRA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:27.096821] [DEBUG] [LOCAL ] FRA: Loaded 14717 existing records from primary storage. [2025-09-26T22:21:27.098959] [INFO ] [MAIN ] FRA: Loaded 14717 primary data records. [2025-09-26T22:21:27.114328] [DEBUG] [LOCAL ] FR: Loaded 47174 existing records from primary storage. [2025-09-26T22:21:27.147908] [INFO ] [MAIN ] FR: Loaded 47174 primary data records. [2025-09-26T22:21:27.335314] [DEBUG] [MAIN ] FPI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:27.395492] [INFO ] [MAIN ] FPI: Generated 1820 derivative records from 31525 primary records. [2025-09-26T22:21:27.430727] [DEBUG] [LOCAL ] FPI: Saving derivative data. [2025-09-26T22:21:27.871711] [DEBUG] [LOCAL ] FPI: Derivative data saved (1820 records). [2025-09-26T22:21:27.871914] [INFO ] [MAIN ] FPI: Successfully saved derivative data. [2025-09-26T22:21:27.875137] [INFO ] [MAIN ] Derivative Progress: 717/2074 symbols completed. FPI took 1.7s. Estimated remaining: 9m 27s. Rate: 143.5 symbols/min [2025-09-26T22:21:27.877148] [INFO ] [MAIN ] FRGE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:27.908253] [DEBUG] [LOCAL ] FRGE: Loaded 18571 existing records from primary storage. [2025-09-26T22:21:27.910554] [INFO ] [MAIN ] FRGE: Loaded 18571 primary data records. [2025-09-26T22:21:27.967453] [DEBUG] [MAIN ] FRA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:27.985101] [INFO ] [MAIN ] FRA: Generated 1820 derivative records from 14717 primary records. [2025-09-26T22:21:28.005168] [DEBUG] [LOCAL ] FRA: Saving derivative data. [2025-09-26T22:21:28.040238] [DEBUG] [MAIN ] FR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:28.046971] [INFO ] [MAIN ] FR: Generated 1820 derivative records from 47174 primary records. [2025-09-26T22:21:28.063062] [DEBUG] [LOCAL ] FR: Saving derivative data. [2025-09-26T22:21:28.328523] [DEBUG] [LOCAL ] FR: Derivative data saved (1820 records). [2025-09-26T22:21:28.328618] [DEBUG] [LOCAL ] FRA: Derivative data saved (1820 records). [2025-09-26T22:21:28.328802] [INFO ] [MAIN ] FR: Successfully saved derivative data. [2025-09-26T22:21:28.331724] [INFO ] [MAIN ] Derivative Progress: 718/2074 symbols completed. FR took 1.6s. Estimated remaining: 9m 27s. Rate: 143.5 symbols/min [2025-09-26T22:21:28.331860] [INFO ] [MAIN ] FRA: Successfully saved derivative data. [2025-09-26T22:21:28.334510] [INFO ] [MAIN ] Derivative Progress: 719/2074 symbols completed. FRA took 1.3s. Estimated remaining: 9m 26s. Rate: 143.7 symbols/min [2025-09-26T22:21:28.357245] [DEBUG] [MAIN ] FRGE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:28.357929] [INFO ] [MAIN ] FRGE: Generated 1820 derivative records from 18571 primary records. [2025-09-26T22:21:28.357995] [DEBUG] [LOCAL ] FRGE: Saving derivative data. [2025-09-26T22:21:28.373429] [DEBUG] [LOCAL ] FRGE: Derivative data saved (1820 records). [2025-09-26T22:21:28.373496] [INFO ] [MAIN ] FRGE: Successfully saved derivative data. [2025-09-26T22:21:28.376168] [INFO ] [MAIN ] Derivative Progress: 720/2074 symbols completed. FRGE took 0.5s. Estimated remaining: 9m 25s. Rate: 143.8 symbols/min [2025-09-26T22:21:28.376867] [INFO ] [MAIN ] FRO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:28.377097] [INFO ] [MAIN ] FRT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:28.377173] [INFO ] [MAIN ] FSCO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:28.445362] [DEBUG] [LOCAL ] FRT: Loaded 42808 existing records from primary storage. [2025-09-26T22:21:28.456850] [INFO ] [MAIN ] FRT: Loaded 42808 primary data records. [2025-09-26T22:21:28.457431] [DEBUG] [LOCAL ] FSCO: Loaded 37725 existing records from primary storage. [2025-09-26T22:21:28.462924] [INFO ] [MAIN ] FSCO: Loaded 37725 primary data records. [2025-09-26T22:21:28.626687] [DEBUG] [LOCAL ] FRO: Loaded 52603 existing records from primary storage. [2025-09-26T22:21:28.649773] [INFO ] [MAIN ] FRO: Loaded 52603 primary data records. [2025-09-26T22:21:29.541873] [DEBUG] [MAIN ] FRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:29.543229] [INFO ] [MAIN ] FRT: Generated 1820 derivative records from 42808 primary records. [2025-09-26T22:21:29.543348] [DEBUG] [LOCAL ] FRT: Saving derivative data. [2025-09-26T22:21:29.562305] [DEBUG] [MAIN ] FSCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:29.583744] [INFO ] [MAIN ] FSCO: Generated 1820 derivative records from 37725 primary records. [2025-09-26T22:21:29.588532] [DEBUG] [LOCAL ] FSCO: Saving derivative data. [2025-09-26T22:21:29.593768] [DEBUG] [MAIN ] FRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:29.593290] [DEBUG] [LOCAL ] FRT: Derivative data saved (1820 records). [2025-09-26T22:21:29.594017] [INFO ] [MAIN ] FRT: Successfully saved derivative data. [2025-09-26T22:21:29.599164] [INFO ] [MAIN ] Derivative Progress: 721/2074 symbols completed. FRT took 1.2s. Estimated remaining: 9m 26s. Rate: 143.4 symbols/min [2025-09-26T22:21:29.595609] [INFO ] [MAIN ] FRO: Generated 1820 derivative records from 52603 primary records. [2025-09-26T22:21:29.599758] [DEBUG] [LOCAL ] FRO: Saving derivative data. [2025-09-26T22:21:29.599965] [INFO ] [MAIN ] FSK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:29.627295] [DEBUG] [LOCAL ] FSCO: Derivative data saved (1820 records). [2025-09-26T22:21:29.633110] [INFO ] [MAIN ] FSCO: Successfully saved derivative data. [2025-09-26T22:21:29.638841] [DEBUG] [LOCAL ] FRO: Derivative data saved (1820 records). [2025-09-26T22:21:29.638705] [INFO ] [MAIN ] Derivative Progress: 722/2074 symbols completed. FSCO took 1.3s. Estimated remaining: 9m 25s. Rate: 143.6 symbols/min [2025-09-26T22:21:29.639083] [INFO ] [MAIN ] FRO: Successfully saved derivative data. [2025-09-26T22:21:29.639395] [INFO ] [MAIN ] FSLY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:29.642709] [INFO ] [MAIN ] Derivative Progress: 723/2074 symbols completed. FRO took 1.3s. Estimated remaining: 9m 24s. Rate: 143.8 symbols/min [2025-09-26T22:21:29.643134] [INFO ] [MAIN ] FSM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:29.736781] [DEBUG] [LOCAL ] FSK: Loaded 50173 existing records from primary storage. [2025-09-26T22:21:29.738698] [INFO ] [MAIN ] FSK: Loaded 50173 primary data records. [2025-09-26T22:21:29.758343] [DEBUG] [LOCAL ] FSM: Loaded 54065 existing records from primary storage. [2025-09-26T22:21:29.765041] [INFO ] [MAIN ] FSM: Loaded 54065 primary data records. [2025-09-26T22:21:29.912412] [DEBUG] [LOCAL ] FSLY: Loaded 51989 existing records from primary storage. [2025-09-26T22:21:29.961071] [INFO ] [MAIN ] FSLY: Loaded 51989 primary data records. [2025-09-26T22:21:30.805523] [DEBUG] [MAIN ] FSK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:30.819507] [INFO ] [MAIN ] FSK: Generated 1820 derivative records from 50173 primary records. [2025-09-26T22:21:30.818702] [DEBUG] [MAIN ] FSM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:30.819615] [DEBUG] [LOCAL ] FSK: Saving derivative data. [2025-09-26T22:21:30.820414] [INFO ] [MAIN ] FSM: Generated 1820 derivative records from 54065 primary records. [2025-09-26T22:21:30.820962] [DEBUG] [LOCAL ] FSM: Saving derivative data. [2025-09-26T22:21:30.852768] [DEBUG] [LOCAL ] FSM: Derivative data saved (1820 records). [2025-09-26T22:21:30.855320] [INFO ] [MAIN ] FSM: Successfully saved derivative data. [2025-09-26T22:21:30.858937] [INFO ] [MAIN ] Derivative Progress: 724/2074 symbols completed. FSM took 1.2s. Estimated remaining: 9m 25s. Rate: 143.4 symbols/min [2025-09-26T22:21:30.869187] [DEBUG] [LOCAL ] FSK: Derivative data saved (1820 records). [2025-09-26T22:21:30.874706] [INFO ] [MAIN ] FSS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:30.874990] [INFO ] [MAIN ] FSK: Successfully saved derivative data. [2025-09-26T22:21:30.877341] [INFO ] [MAIN ] Derivative Progress: 725/2074 symbols completed. FSK took 1.3s. Estimated remaining: 9m 24s. Rate: 143.6 symbols/min [2025-09-26T22:21:30.878190] [DEBUG] [MAIN ] FSLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:30.877991] [INFO ] [MAIN ] FT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:30.879113] [INFO ] [MAIN ] FSLY: Generated 1820 derivative records from 51989 primary records. [2025-09-26T22:21:30.879333] [DEBUG] [LOCAL ] FSLY: Saving derivative data. [2025-09-26T22:21:30.898572] [DEBUG] [LOCAL ] FSLY: Derivative data saved (1820 records). [2025-09-26T22:21:30.898789] [INFO ] [MAIN ] FSLY: Successfully saved derivative data. [2025-09-26T22:21:30.901285] [INFO ] [MAIN ] Derivative Progress: 726/2074 symbols completed. FSLY took 1.3s. Estimated remaining: 9m 22s. Rate: 143.8 symbols/min [2025-09-26T22:21:30.901742] [INFO ] [MAIN ] FTHY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:30.906449] [DEBUG] [LOCAL ] FT: Loaded 6432 existing records from primary storage. [2025-09-26T22:21:30.906700] [INFO ] [MAIN ] FT: Loaded 6432 primary data records. [2025-09-26T22:21:31.043963] [DEBUG] [LOCAL ] FTHY: Loaded 11947 existing records from primary storage. [2025-09-26T22:21:31.044212] [INFO ] [MAIN ] FTHY: Loaded 11947 primary data records. [2025-09-26T22:21:31.251088] [DEBUG] [LOCAL ] FSS: Loaded 34888 existing records from primary storage. [2025-09-26T22:21:31.373082] [INFO ] [MAIN ] FSS: Loaded 34888 primary data records. [2025-09-26T22:21:32.067514] [DEBUG] [MAIN ] FT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:32.068719] [INFO ] [MAIN ] FT: Generated 1820 derivative records from 6432 primary records. [2025-09-26T22:21:32.068972] [DEBUG] [LOCAL ] FT: Saving derivative data. [2025-09-26T22:21:32.090909] [DEBUG] [LOCAL ] FT: Derivative data saved (1820 records). [2025-09-26T22:21:32.094119] [INFO ] [MAIN ] FT: Successfully saved derivative data. [2025-09-26T22:21:32.100305] [INFO ] [MAIN ] Derivative Progress: 727/2074 symbols completed. FT took 1.2s. Estimated remaining: 9m 23s. Rate: 143.5 symbols/min [2025-09-26T22:21:32.113927] [INFO ] [MAIN ] FTI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:32.116410] [DEBUG] [MAIN ] FTHY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:32.119156] [INFO ] [MAIN ] FTHY: Generated 1820 derivative records from 11947 primary records. [2025-09-26T22:21:32.122039] [DEBUG] [LOCAL ] FTHY: Saving derivative data. [2025-09-26T22:21:32.157241] [DEBUG] [LOCAL ] FTHY: Derivative data saved (1820 records). [2025-09-26T22:21:32.158057] [INFO ] [MAIN ] FTHY: Successfully saved derivative data. [2025-09-26T22:21:32.161438] [INFO ] [MAIN ] Derivative Progress: 728/2074 symbols completed. FTHY took 1.3s. Estimated remaining: 9m 22s. Rate: 143.6 symbols/min [2025-09-26T22:21:32.162056] [INFO ] [MAIN ] FTK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:32.181330] [DEBUG] [MAIN ] FSS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:32.182380] [INFO ] [MAIN ] FSS: Generated 1820 derivative records from 34888 primary records. [2025-09-26T22:21:32.182594] [DEBUG] [LOCAL ] FSS: Saving derivative data. [2025-09-26T22:21:32.218912] [DEBUG] [LOCAL ] FSS: Derivative data saved (1820 records). [2025-09-26T22:21:32.219275] [INFO ] [MAIN ] FSS: Successfully saved derivative data. [2025-09-26T22:21:32.223200] [INFO ] [MAIN ] Derivative Progress: 729/2074 symbols completed. FSS took 1.3s. Estimated remaining: 9m 21s. Rate: 143.8 symbols/min [2025-09-26T22:21:32.223932] [INFO ] [MAIN ] FTS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:32.252084] [DEBUG] [LOCAL ] FTI: Loaded 54078 existing records from primary storage. [2025-09-26T22:21:32.252473] [INFO ] [MAIN ] FTI: Loaded 54078 primary data records. [2025-09-26T22:21:32.329705] [DEBUG] [LOCAL ] FTK: Loaded 32755 existing records from primary storage. [2025-09-26T22:21:32.381108] [INFO ] [MAIN ] FTK: Loaded 32755 primary data records. [2025-09-26T22:21:32.823028] [DEBUG] [LOCAL ] FTS: Loaded 42695 existing records from primary storage. [2025-09-26T22:21:32.845669] [INFO ] [MAIN ] FTS: Loaded 42695 primary data records. [2025-09-26T22:21:33.350105] [DEBUG] [MAIN ] FTI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:33.365432] [DEBUG] [MAIN ] FTK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:33.365079] [INFO ] [MAIN ] FTI: Generated 1820 derivative records from 54078 primary records. [2025-09-26T22:21:33.366244] [INFO ] [MAIN ] FTK: Generated 1820 derivative records from 32755 primary records. [2025-09-26T22:21:33.365608] [DEBUG] [LOCAL ] FTI: Saving derivative data. [2025-09-26T22:21:33.367865] [DEBUG] [LOCAL ] FTK: Saving derivative data. [2025-09-26T22:21:33.415818] [DEBUG] [LOCAL ] FTK: Derivative data saved (1820 records). [2025-09-26T22:21:33.412482] [DEBUG] [LOCAL ] FTI: Derivative data saved (1820 records). [2025-09-26T22:21:33.416244] [INFO ] [MAIN ] FTI: Successfully saved derivative data. [2025-09-26T22:21:33.419075] [INFO ] [MAIN ] Derivative Progress: 730/2074 symbols completed. FTI took 1.3s. Estimated remaining: 9m 22s. Rate: 143.4 symbols/min [2025-09-26T22:21:33.416481] [INFO ] [MAIN ] FTK: Successfully saved derivative data. [2025-09-26T22:21:33.419540] [INFO ] [MAIN ] FTV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:33.423058] [INFO ] [MAIN ] Derivative Progress: 731/2074 symbols completed. FTK took 1.3s. Estimated remaining: 9m 21s. Rate: 143.6 symbols/min [2025-09-26T22:21:33.424570] [INFO ] [MAIN ] FTWO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:33.431933] [DEBUG] [LOCAL ] FTWO: Loaded 1837 existing records from primary storage. [2025-09-26T22:21:33.433281] [INFO ] [MAIN ] FTWO: Loaded 1837 primary data records. [2025-09-26T22:21:33.495693] [DEBUG] [MAIN ] FTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:33.521681] [INFO ] [MAIN ] FTS: Generated 1820 derivative records from 42695 primary records. [2025-09-26T22:21:33.545678] [DEBUG] [LOCAL ] FTS: Saving derivative data. [2025-09-26T22:21:33.695903] [DEBUG] [LOCAL ] FTS: Derivative data saved (1820 records). [2025-09-26T22:21:33.696285] [INFO ] [MAIN ] FTS: Successfully saved derivative data. [2025-09-26T22:21:33.710724] [INFO ] [MAIN ] Derivative Progress: 732/2074 symbols completed. FTS took 1.5s. Estimated remaining: 9m 20s. Rate: 143.7 symbols/min [2025-09-26T22:21:33.904181] [INFO ] [MAIN ] FUBO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:33.938152] [DEBUG] [LOCAL ] FTV: Loaded 53686 existing records from primary storage. [2025-09-26T22:21:33.938956] [INFO ] [MAIN ] FTV: Loaded 53686 primary data records. [2025-09-26T22:21:34.317578] [DEBUG] [MAIN ] FTWO: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:21:34.320698] [INFO ] [MAIN ] FTWO: Generated 1819 derivative records from 1837 primary records. [2025-09-26T22:21:34.321216] [DEBUG] [LOCAL ] FTWO: Saving derivative data. [2025-09-26T22:21:34.319618] [DEBUG] [LOCAL ] FUBO: Loaded 54476 existing records from primary storage. [2025-09-26T22:21:34.323909] [INFO ] [MAIN ] FUBO: Loaded 54476 primary data records. [2025-09-26T22:21:34.377260] [DEBUG] [LOCAL ] FTWO: Derivative data saved (1819 records). [2025-09-26T22:21:34.395799] [INFO ] [MAIN ] FTWO: Successfully saved derivative data. [2025-09-26T22:21:34.406021] [INFO ] [MAIN ] Derivative Progress: 733/2074 symbols completed. FTWO took 1.0s. Estimated remaining: 9m 21s. Rate: 143.5 symbols/min [2025-09-26T22:21:34.692095] [DEBUG] [MAIN ] FTV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:34.693455] [INFO ] [MAIN ] FTV: Generated 1820 derivative records from 53686 primary records. [2025-09-26T22:21:34.693912] [DEBUG] [LOCAL ] FTV: Saving derivative data. [2025-09-26T22:21:34.713305] [DEBUG] [LOCAL ] FTV: Derivative data saved (1820 records). [2025-09-26T22:21:34.713624] [INFO ] [MAIN ] FTV: Successfully saved derivative data. [2025-09-26T22:21:34.716533] [INFO ] [MAIN ] Derivative Progress: 734/2074 symbols completed. FTV took 1.3s. Estimated remaining: 9m 20s. Rate: 143.6 symbols/min [2025-09-26T22:21:34.734349] [DEBUG] [MAIN ] FUBO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:34.735171] [INFO ] [MAIN ] FUBO: Generated 1820 derivative records from 54476 primary records. [2025-09-26T22:21:34.735239] [DEBUG] [LOCAL ] FUBO: Saving derivative data. [2025-09-26T22:21:34.751885] [DEBUG] [LOCAL ] FUBO: Derivative data saved (1820 records). [2025-09-26T22:21:34.751981] [INFO ] [MAIN ] FUBO: Successfully saved derivative data. [2025-09-26T22:21:34.754103] [INFO ] [MAIN ] Derivative Progress: 735/2074 symbols completed. FUBO took 0.9s. Estimated remaining: 9m 19s. Rate: 143.8 symbols/min [2025-09-26T22:21:34.755037] [INFO ] [MAIN ] FUL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:34.755141] [INFO ] [MAIN ] FUN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:34.755858] [INFO ] [MAIN ] FVR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:34.790079] [DEBUG] [LOCAL ] FVR: Loaded 22328 existing records from primary storage. [2025-09-26T22:21:34.790411] [INFO ] [MAIN ] FVR: Loaded 22328 primary data records. [2025-09-26T22:21:34.878445] [DEBUG] [LOCAL ] FUL: Loaded 33570 existing records from primary storage. [2025-09-26T22:21:34.894408] [INFO ] [MAIN ] FUL: Loaded 33570 primary data records. [2025-09-26T22:21:35.072163] [DEBUG] [LOCAL ] FUN: Loaded 52349 existing records from primary storage. [2025-09-26T22:21:35.145326] [INFO ] [MAIN ] FUN: Loaded 52349 primary data records. [2025-09-26T22:21:35.981834] [DEBUG] [MAIN ] FVR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:35.986881] [INFO ] [MAIN ] FVR: Generated 1820 derivative records from 22328 primary records. [2025-09-26T22:21:35.987336] [DEBUG] [LOCAL ] FVR: Saving derivative data. [2025-09-26T22:21:36.017329] [DEBUG] [MAIN ] FUL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:36.019732] [INFO ] [MAIN ] FUL: Generated 1820 derivative records from 33570 primary records. [2025-09-26T22:21:36.020226] [DEBUG] [LOCAL ] FUL: Saving derivative data. [2025-09-26T22:21:36.039251] [DEBUG] [LOCAL ] FVR: Derivative data saved (1820 records). [2025-09-26T22:21:36.041316] [INFO ] [MAIN ] FVR: Successfully saved derivative data. [2025-09-26T22:21:36.043784] [INFO ] [MAIN ] Derivative Progress: 736/2074 symbols completed. FVR took 1.3s. Estimated remaining: 9m 20s. Rate: 143.4 symbols/min [2025-09-26T22:21:36.045726] [INFO ] [MAIN ] FVRR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:36.049395] [DEBUG] [LOCAL ] FUL: Derivative data saved (1820 records). [2025-09-26T22:21:36.049575] [INFO ] [MAIN ] FUL: Successfully saved derivative data. [2025-09-26T22:21:36.052922] [INFO ] [MAIN ] Derivative Progress: 737/2074 symbols completed. FUL took 1.3s. Estimated remaining: 9m 19s. Rate: 143.6 symbols/min [2025-09-26T22:21:36.053631] [INFO ] [MAIN ] FXED: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:36.068920] [DEBUG] [MAIN ] FUN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:36.070614] [INFO ] [MAIN ] FUN: Generated 1820 derivative records from 52349 primary records. [2025-09-26T22:21:36.071017] [DEBUG] [LOCAL ] FUN: Saving derivative data. [2025-09-26T22:21:36.074068] [DEBUG] [LOCAL ] FXED: Loaded 1259 existing records from primary storage. [2025-09-26T22:21:36.074994] [INFO ] [MAIN ] FXED: Loaded 1259 primary data records. [2025-09-26T22:21:36.209825] [DEBUG] [LOCAL ] FUN: Derivative data saved (1820 records). [2025-09-26T22:21:36.220518] [INFO ] [MAIN ] FUN: Successfully saved derivative data. [2025-09-26T22:21:36.233813] [INFO ] [MAIN ] Derivative Progress: 738/2074 symbols completed. FUN took 1.5s. Estimated remaining: 9m 18s. Rate: 143.7 symbols/min [2025-09-26T22:21:36.278532] [INFO ] [MAIN ] G: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:36.325206] [DEBUG] [LOCAL ] FVRR: Loaded 40749 existing records from primary storage. [2025-09-26T22:21:36.438979] [INFO ] [MAIN ] FVRR: Loaded 40749 primary data records. [2025-09-26T22:21:36.831606] [DEBUG] [LOCAL ] G: Loaded 50547 existing records from primary storage. [2025-09-26T22:21:36.832798] [INFO ] [MAIN ] G: Loaded 50547 primary data records. [2025-09-26T22:21:36.915319] [DEBUG] [MAIN ] FXED: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:21:36.937279] [INFO ] [MAIN ] FXED: Generated 1819 derivative records from 1259 primary records. [2025-09-26T22:21:36.960721] [DEBUG] [LOCAL ] FXED: Saving derivative data. [2025-09-26T22:21:37.048068] [DEBUG] [LOCAL ] FXED: Derivative data saved (1819 records). [2025-09-26T22:21:37.076450] [INFO ] [MAIN ] FXED: Successfully saved derivative data. [2025-09-26T22:21:37.085814] [INFO ] [MAIN ] Derivative Progress: 739/2074 symbols completed. FXED took 1.0s. Estimated remaining: 9m 18s. Rate: 143.5 symbols/min [2025-09-26T22:21:37.086535] [INFO ] [MAIN ] GAB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:37.238896] [DEBUG] [MAIN ] FVRR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:37.240999] [INFO ] [MAIN ] FVRR: Generated 1820 derivative records from 40749 primary records. [2025-09-26T22:21:37.241698] [DEBUG] [LOCAL ] FVRR: Saving derivative data. [2025-09-26T22:21:37.269080] [DEBUG] [LOCAL ] FVRR: Derivative data saved (1820 records). [2025-09-26T22:21:37.269478] [INFO ] [MAIN ] FVRR: Successfully saved derivative data. [2025-09-26T22:21:37.272012] [INFO ] [MAIN ] Derivative Progress: 740/2074 symbols completed. FVRR took 1.2s. Estimated remaining: 9m 17s. Rate: 143.6 symbols/min [2025-09-26T22:21:37.272565] [INFO ] [MAIN ] GAM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:37.285336] [DEBUG] [LOCAL ] GAB: Loaded 28493 existing records from primary storage. [2025-09-26T22:21:37.286002] [INFO ] [MAIN ] GAB: Loaded 28493 primary data records. [2025-09-26T22:21:37.344042] [DEBUG] [LOCAL ] GAM: Loaded 4174 existing records from primary storage. [2025-09-26T22:21:37.377199] [INFO ] [MAIN ] GAM: Loaded 4174 primary data records. [2025-09-26T22:21:37.517393] [DEBUG] [MAIN ] G: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:37.545085] [INFO ] [MAIN ] G: Generated 1820 derivative records from 50547 primary records. [2025-09-26T22:21:37.624499] [DEBUG] [LOCAL ] G: Saving derivative data. [2025-09-26T22:21:38.059258] [DEBUG] [LOCAL ] G: Derivative data saved (1820 records). [2025-09-26T22:21:38.060042] [INFO ] [MAIN ] G: Successfully saved derivative data. [2025-09-26T22:21:38.062308] [INFO ] [MAIN ] Derivative Progress: 741/2074 symbols completed. G took 1.8s. Estimated remaining: 9m 18s. Rate: 143.4 symbols/min [2025-09-26T22:21:38.063110] [INFO ] [MAIN ] GBAB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:38.084550] [DEBUG] [LOCAL ] GBAB: Loaded 13142 existing records from primary storage. [2025-09-26T22:21:38.084949] [INFO ] [MAIN ] GBAB: Loaded 13142 primary data records. [2025-09-26T22:21:38.226566] [DEBUG] [MAIN ] GAB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:38.241222] [INFO ] [MAIN ] GAB: Generated 1820 derivative records from 28493 primary records. [2025-09-26T22:21:38.241705] [DEBUG] [LOCAL ] GAB: Saving derivative data. [2025-09-26T22:21:38.242749] [DEBUG] [MAIN ] GAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:38.249797] [INFO ] [MAIN ] GAM: Generated 1820 derivative records from 4174 primary records. [2025-09-26T22:21:38.266974] [DEBUG] [LOCAL ] GAM: Saving derivative data. [2025-09-26T22:21:38.509545] [DEBUG] [LOCAL ] GAM: Derivative data saved (1820 records). [2025-09-26T22:21:38.509449] [DEBUG] [LOCAL ] GAB: Derivative data saved (1820 records). [2025-09-26T22:21:38.509752] [INFO ] [MAIN ] GAM: Successfully saved derivative data. [2025-09-26T22:21:38.510038] [INFO ] [MAIN ] GAB: Successfully saved derivative data. [2025-09-26T22:21:38.512970] [INFO ] [MAIN ] Derivative Progress: 742/2074 symbols completed. GAM took 1.2s. Estimated remaining: 9m 17s. Rate: 143.4 symbols/min [2025-09-26T22:21:38.516827] [INFO ] [MAIN ] Derivative Progress: 743/2074 symbols completed. GAB took 1.4s. Estimated remaining: 9m 16s. Rate: 143.6 symbols/min [2025-09-26T22:21:38.517369] [INFO ] [MAIN ] GBX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:38.516016] [INFO ] [MAIN ] GBTG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:38.543490] [DEBUG] [MAIN ] GBAB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:38.545076] [INFO ] [MAIN ] GBAB: Generated 1820 derivative records from 13142 primary records. [2025-09-26T22:21:38.545248] [DEBUG] [LOCAL ] GBAB: Saving derivative data. [2025-09-26T22:21:38.580499] [DEBUG] [LOCAL ] GBAB: Derivative data saved (1820 records). [2025-09-26T22:21:38.580681] [INFO ] [MAIN ] GBAB: Successfully saved derivative data. [2025-09-26T22:21:38.582922] [INFO ] [MAIN ] Derivative Progress: 744/2074 symbols completed. GBAB took 0.5s. Estimated remaining: 9m 15s. Rate: 143.7 symbols/min [2025-09-26T22:21:38.584097] [INFO ] [MAIN ] GCI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:38.595633] [DEBUG] [LOCAL ] GBX: Loaded 29497 existing records from primary storage. [2025-09-26T22:21:38.595856] [INFO ] [MAIN ] GBX: Loaded 29497 primary data records. [2025-09-26T22:21:38.721583] [DEBUG] [LOCAL ] GBTG: Loaded 40807 existing records from primary storage. [2025-09-26T22:21:38.784270] [INFO ] [MAIN ] GBTG: Loaded 40807 primary data records. [2025-09-26T22:21:39.046145] [DEBUG] [LOCAL ] GCI: Loaded 44828 existing records from primary storage. [2025-09-26T22:21:39.062608] [INFO ] [MAIN ] GCI: Loaded 44828 primary data records. [2025-09-26T22:21:39.722509] [DEBUG] [MAIN ] GBX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:39.724197] [INFO ] [MAIN ] GBX: Generated 1820 derivative records from 29497 primary records. [2025-09-26T22:21:39.724600] [DEBUG] [LOCAL ] GBX: Saving derivative data. [2025-09-26T22:21:39.745098] [DEBUG] [LOCAL ] GBX: Derivative data saved (1820 records). [2025-09-26T22:21:39.745352] [INFO ] [MAIN ] GBX: Successfully saved derivative data. [2025-09-26T22:21:39.747677] [INFO ] [MAIN ] Derivative Progress: 745/2074 symbols completed. GBX took 1.2s. Estimated remaining: 9m 16s. Rate: 143.4 symbols/min [2025-09-26T22:21:39.749719] [INFO ] [MAIN ] GCO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:39.767493] [DEBUG] [MAIN ] GBTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:39.768544] [INFO ] [MAIN ] GBTG: Generated 1820 derivative records from 40807 primary records. [2025-09-26T22:21:39.768868] [DEBUG] [LOCAL ] GBTG: Saving derivative data. [2025-09-26T22:21:39.819314] [DEBUG] [LOCAL ] GBTG: Derivative data saved (1820 records). [2025-09-26T22:21:39.820081] [DEBUG] [LOCAL ] GCO: Loaded 25686 existing records from primary storage. [2025-09-26T22:21:39.820481] [INFO ] [MAIN ] GBTG: Successfully saved derivative data. [2025-09-26T22:21:39.820541] [INFO ] [MAIN ] GCO: Loaded 25686 primary data records. [2025-09-26T22:21:39.826142] [DEBUG] [MAIN ] GCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:39.828505] [INFO ] [MAIN ] Derivative Progress: 746/2074 symbols completed. GBTG took 1.3s. Estimated remaining: 9m 15s. Rate: 143.6 symbols/min [2025-09-26T22:21:39.835964] [INFO ] [MAIN ] GCI: Generated 1820 derivative records from 44828 primary records. [2025-09-26T22:21:39.847401] [DEBUG] [LOCAL ] GCI: Saving derivative data. [2025-09-26T22:21:39.864820] [INFO ] [MAIN ] GCTS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:40.051745] [DEBUG] [LOCAL ] GCI: Derivative data saved (1820 records). [2025-09-26T22:21:40.173615] [DEBUG] [LOCAL ] GCTS: Loaded 20060 existing records from primary storage. [2025-09-26T22:21:40.183411] [INFO ] [MAIN ] GCI: Successfully saved derivative data. [2025-09-26T22:21:40.182781] [INFO ] [MAIN ] GCTS: Loaded 20060 primary data records. [2025-09-26T22:21:40.186481] [INFO ] [MAIN ] Derivative Progress: 747/2074 symbols completed. GCI took 1.6s. Estimated remaining: 9m 15s. Rate: 143.6 symbols/min [2025-09-26T22:21:40.192094] [INFO ] [MAIN ] GD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:40.667050] [DEBUG] [MAIN ] GCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:40.668198] [INFO ] [MAIN ] GCO: Generated 1820 derivative records from 25686 primary records. [2025-09-26T22:21:40.668538] [DEBUG] [LOCAL ] GCO: Saving derivative data. [2025-09-26T22:21:40.670329] [DEBUG] [LOCAL ] GD: Loaded 47940 existing records from primary storage. [2025-09-26T22:21:40.670481] [INFO ] [MAIN ] GD: Loaded 47940 primary data records. [2025-09-26T22:21:40.790893] [DEBUG] [LOCAL ] GCO: Derivative data saved (1820 records). [2025-09-26T22:21:40.796528] [INFO ] [MAIN ] GCO: Successfully saved derivative data. [2025-09-26T22:21:40.798869] [INFO ] [MAIN ] Derivative Progress: 748/2074 symbols completed. GCO took 1.0s. Estimated remaining: 9m 14s. Rate: 143.5 symbols/min [2025-09-26T22:21:40.946944] [DEBUG] [MAIN ] GCTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:41.050479] [INFO ] [MAIN ] GCTS: Generated 1820 derivative records from 20060 primary records. [2025-09-26T22:21:41.059446] [DEBUG] [LOCAL ] GCTS: Saving derivative data. [2025-09-26T22:21:41.078057] [DEBUG] [LOCAL ] GCTS: Derivative data saved (1820 records). [2025-09-26T22:21:41.078301] [INFO ] [MAIN ] GCTS: Successfully saved derivative data. [2025-09-26T22:21:41.080984] [INFO ] [MAIN ] Derivative Progress: 749/2074 symbols completed. GCTS took 1.2s. Estimated remaining: 9m 14s. Rate: 143.6 symbols/min [2025-09-26T22:21:41.101603] [DEBUG] [MAIN ] GD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:41.102248] [INFO ] [MAIN ] GD: Generated 1820 derivative records from 47940 primary records. [2025-09-26T22:21:41.102310] [DEBUG] [LOCAL ] GD: Saving derivative data. [2025-09-26T22:21:41.118430] [DEBUG] [LOCAL ] GD: Derivative data saved (1820 records). [2025-09-26T22:21:41.118526] [INFO ] [MAIN ] GD: Successfully saved derivative data. [2025-09-26T22:21:41.120937] [INFO ] [MAIN ] Derivative Progress: 750/2074 symbols completed. GD took 0.9s. Estimated remaining: 9m 13s. Rate: 143.7 symbols/min [2025-09-26T22:21:41.121609] [INFO ] [MAIN ] GDL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:41.121696] [INFO ] [MAIN ] GDIV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:41.121489] [INFO ] [MAIN ] GDDY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:41.128431] [DEBUG] [LOCAL ] GDL: Loaded 2572 existing records from primary storage. [2025-09-26T22:21:41.130833] [INFO ] [MAIN ] GDL: Loaded 2572 primary data records. [2025-09-26T22:21:41.130764] [DEBUG] [LOCAL ] GDIV: Loaded 3724 existing records from primary storage. [2025-09-26T22:21:41.136172] [INFO ] [MAIN ] GDIV: Loaded 3724 primary data records. [2025-09-26T22:21:41.823035] [DEBUG] [LOCAL ] GDDY: Loaded 50449 existing records from primary storage. [2025-09-26T22:21:41.824409] [INFO ] [MAIN ] GDDY: Loaded 50449 primary data records. [2025-09-26T22:21:42.188999] [DEBUG] [MAIN ] GDL: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:21:42.192490] [INFO ] [MAIN ] GDL: Generated 1819 derivative records from 2572 primary records. [2025-09-26T22:21:42.192874] [DEBUG] [LOCAL ] GDL: Saving derivative data. [2025-09-26T22:21:42.222305] [DEBUG] [MAIN ] GDIV: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:21:42.224910] [INFO ] [MAIN ] GDIV: Generated 1819 derivative records from 3724 primary records. [2025-09-26T22:21:42.225877] [DEBUG] [LOCAL ] GDL: Derivative data saved (1819 records). [2025-09-26T22:21:42.226199] [INFO ] [MAIN ] GDL: Successfully saved derivative data. [2025-09-26T22:21:42.226126] [DEBUG] [LOCAL ] GDIV: Saving derivative data. [2025-09-26T22:21:42.229378] [INFO ] [MAIN ] Derivative Progress: 751/2074 symbols completed. GDL took 1.1s. Estimated remaining: 9m 14s. Rate: 143.4 symbols/min [2025-09-26T22:21:42.230043] [INFO ] [MAIN ] GDO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:42.249087] [DEBUG] [LOCAL ] GDIV: Derivative data saved (1819 records). [2025-09-26T22:21:42.251479] [INFO ] [MAIN ] GDIV: Successfully saved derivative data. [2025-09-26T22:21:42.254183] [INFO ] [MAIN ] Derivative Progress: 752/2074 symbols completed. GDIV took 1.1s. Estimated remaining: 9m 12s. Rate: 143.6 symbols/min [2025-09-26T22:21:42.254565] [INFO ] [MAIN ] GDOT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:42.259002] [DEBUG] [LOCAL ] GDO: Loaded 6076 existing records from primary storage. [2025-09-26T22:21:42.259680] [INFO ] [MAIN ] GDO: Loaded 6076 primary data records. [2025-09-26T22:21:42.418219] [DEBUG] [MAIN ] GDDY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:42.442216] [INFO ] [MAIN ] GDDY: Generated 1820 derivative records from 50449 primary records. [2025-09-26T22:21:42.451367] [DEBUG] [LOCAL ] GDDY: Saving derivative data. [2025-09-26T22:21:42.694737] [DEBUG] [LOCAL ] GDDY: Derivative data saved (1820 records). [2025-09-26T22:21:42.695503] [INFO ] [MAIN ] GDDY: Successfully saved derivative data. [2025-09-26T22:21:42.699827] [INFO ] [MAIN ] Derivative Progress: 753/2074 symbols completed. GDDY took 1.6s. Estimated remaining: 9m 12s. Rate: 143.6 symbols/min [2025-09-26T22:21:42.700687] [INFO ] [MAIN ] GDV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:42.697319] [DEBUG] [LOCAL ] GDOT: Loaded 39279 existing records from primary storage. [2025-09-26T22:21:42.700940] [INFO ] [MAIN ] GDOT: Loaded 39279 primary data records. [2025-09-26T22:21:42.879761] [DEBUG] [LOCAL ] GDV: Loaded 19971 existing records from primary storage. [2025-09-26T22:21:42.912229] [INFO ] [MAIN ] GDV: Loaded 19971 primary data records. [2025-09-26T22:21:43.151913] [DEBUG] [MAIN ] GDO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:43.165323] [INFO ] [MAIN ] GDO: Generated 1820 derivative records from 6076 primary records. [2025-09-26T22:21:43.166194] [DEBUG] [LOCAL ] GDO: Saving derivative data. [2025-09-26T22:21:43.424150] [DEBUG] [LOCAL ] GDO: Derivative data saved (1820 records). [2025-09-26T22:21:43.425119] [INFO ] [MAIN ] GDO: Successfully saved derivative data. [2025-09-26T22:21:43.428754] [INFO ] [MAIN ] Derivative Progress: 754/2074 symbols completed. GDO took 1.2s. Estimated remaining: 9m 12s. Rate: 143.4 symbols/min [2025-09-26T22:21:43.429412] [INFO ] [MAIN ] GE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:43.450905] [DEBUG] [MAIN ] GDOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:43.452151] [INFO ] [MAIN ] GDOT: Generated 1820 derivative records from 39279 primary records. [2025-09-26T22:21:43.452732] [DEBUG] [LOCAL ] GDOT: Saving derivative data. [2025-09-26T22:21:43.486783] [DEBUG] [MAIN ] GDV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:43.488129] [INFO ] [MAIN ] GDV: Generated 1820 derivative records from 19971 primary records. [2025-09-26T22:21:43.488259] [DEBUG] [LOCAL ] GDOT: Derivative data saved (1820 records). [2025-09-26T22:21:43.488496] [INFO ] [MAIN ] GDOT: Successfully saved derivative data. [2025-09-26T22:21:43.488418] [DEBUG] [LOCAL ] GDV: Saving derivative data. [2025-09-26T22:21:43.490813] [INFO ] [MAIN ] Derivative Progress: 755/2074 symbols completed. GDOT took 1.2s. Estimated remaining: 9m 11s. Rate: 143.6 symbols/min [2025-09-26T22:21:43.491175] [INFO ] [MAIN ] GEF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:43.530566] [DEBUG] [LOCAL ] GDV: Derivative data saved (1820 records). [2025-09-26T22:21:43.535330] [INFO ] [MAIN ] GDV: Successfully saved derivative data. [2025-09-26T22:21:43.538162] [INFO ] [MAIN ] Derivative Progress: 756/2074 symbols completed. GDV took 0.8s. Estimated remaining: 9m 10s. Rate: 143.8 symbols/min [2025-09-26T22:21:43.538801] [INFO ] [MAIN ] GEL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:43.550872] [DEBUG] [LOCAL ] GEF: Loaded 20965 existing records from primary storage. [2025-09-26T22:21:43.568145] [INFO ] [MAIN ] GEF: Loaded 20965 primary data records. [2025-09-26T22:21:43.582115] [DEBUG] [LOCAL ] GE: Loaded 54493 existing records from primary storage. [2025-09-26T22:21:43.606217] [INFO ] [MAIN ] GE: Loaded 54493 primary data records. [2025-09-26T22:21:43.937764] [DEBUG] [LOCAL ] GEL: Loaded 34252 existing records from primary storage. [2025-09-26T22:21:44.115261] [INFO ] [MAIN ] GEL: Loaded 34252 primary data records. [2025-09-26T22:21:44.683996] [DEBUG] [MAIN ] GEF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:44.686581] [INFO ] [MAIN ] GEF: Generated 1820 derivative records from 20965 primary records. [2025-09-26T22:21:44.687011] [DEBUG] [LOCAL ] GEF: Saving derivative data. [2025-09-26T22:21:44.702527] [DEBUG] [MAIN ] GE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:44.703505] [INFO ] [MAIN ] GE: Generated 1820 derivative records from 54493 primary records. [2025-09-26T22:21:44.704032] [DEBUG] [LOCAL ] GE: Saving derivative data. [2025-09-26T22:21:44.730178] [DEBUG] [LOCAL ] GEF: Derivative data saved (1820 records). [2025-09-26T22:21:44.733447] [INFO ] [MAIN ] GEF: Successfully saved derivative data. [2025-09-26T22:21:44.736541] [INFO ] [MAIN ] Derivative Progress: 757/2074 symbols completed. GEF took 1.2s. Estimated remaining: 9m 11s. Rate: 143.4 symbols/min [2025-09-26T22:21:44.737760] [INFO ] [MAIN ] GENI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:44.742559] [DEBUG] [LOCAL ] GE: Derivative data saved (1820 records). [2025-09-26T22:21:44.742836] [INFO ] [MAIN ] GE: Successfully saved derivative data. [2025-09-26T22:21:44.746636] [INFO ] [MAIN ] Derivative Progress: 758/2074 symbols completed. GE took 1.3s. Estimated remaining: 9m 10s. Rate: 143.6 symbols/min [2025-09-26T22:21:44.746943] [INFO ] [MAIN ] GEO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:44.763129] [DEBUG] [MAIN ] GEL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:44.763996] [INFO ] [MAIN ] GEL: Generated 1820 derivative records from 34252 primary records. [2025-09-26T22:21:44.764111] [DEBUG] [LOCAL ] GEL: Saving derivative data. [2025-09-26T22:21:44.781093] [DEBUG] [LOCAL ] GEL: Derivative data saved (1820 records). [2025-09-26T22:21:44.781352] [INFO ] [MAIN ] GEL: Successfully saved derivative data. [2025-09-26T22:21:44.785092] [INFO ] [MAIN ] Derivative Progress: 759/2074 symbols completed. GEL took 1.2s. Estimated remaining: 9m 9s. Rate: 143.8 symbols/min [2025-09-26T22:21:44.785549] [INFO ] [MAIN ] GES: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:44.844154] [DEBUG] [LOCAL ] GENI: Loaded 53679 existing records from primary storage. [2025-09-26T22:21:44.854819] [INFO ] [MAIN ] GENI: Loaded 53679 primary data records. [2025-09-26T22:21:44.979585] [DEBUG] [LOCAL ] GEO: Loaded 52812 existing records from primary storage. [2025-09-26T22:21:45.004065] [INFO ] [MAIN ] GEO: Loaded 52812 primary data records. [2025-09-26T22:21:45.005290] [DEBUG] [LOCAL ] GES: Loaded 40424 existing records from primary storage. [2025-09-26T22:21:45.005543] [INFO ] [MAIN ] GES: Loaded 40424 primary data records. [2025-09-26T22:21:45.955047] [DEBUG] [MAIN ] GENI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:45.956829] [INFO ] [MAIN ] GENI: Generated 1820 derivative records from 53679 primary records. [2025-09-26T22:21:45.957418] [DEBUG] [LOCAL ] GENI: Saving derivative data. [2025-09-26T22:21:46.006269] [DEBUG] [LOCAL ] GENI: Derivative data saved (1820 records). [2025-09-26T22:21:46.007065] [DEBUG] [MAIN ] GES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:46.007872] [INFO ] [MAIN ] GES: Generated 1820 derivative records from 40424 primary records. [2025-09-26T22:21:46.008470] [DEBUG] [MAIN ] GEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:46.007961] [INFO ] [MAIN ] GENI: Successfully saved derivative data. [2025-09-26T22:21:46.008208] [DEBUG] [LOCAL ] GES: Saving derivative data. [2025-09-26T22:21:46.012342] [INFO ] [MAIN ] GEO: Generated 1820 derivative records from 52812 primary records. [2025-09-26T22:21:46.011362] [INFO ] [MAIN ] Derivative Progress: 760/2074 symbols completed. GENI took 1.3s. Estimated remaining: 9m 10s. Rate: 143.4 symbols/min [2025-09-26T22:21:46.012546] [DEBUG] [LOCAL ] GEO: Saving derivative data. [2025-09-26T22:21:46.020637] [INFO ] [MAIN ] GETY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:46.045337] [DEBUG] [LOCAL ] GEO: Derivative data saved (1820 records). [2025-09-26T22:21:46.046406] [INFO ] [MAIN ] GEO: Successfully saved derivative data. [2025-09-26T22:21:46.049700] [INFO ] [MAIN ] Derivative Progress: 761/2074 symbols completed. GEO took 1.3s. Estimated remaining: 9m 9s. Rate: 143.6 symbols/min [2025-09-26T22:21:46.050573] [INFO ] [MAIN ] GEV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:46.054470] [DEBUG] [LOCAL ] GES: Derivative data saved (1820 records). [2025-09-26T22:21:46.054695] [INFO ] [MAIN ] GES: Successfully saved derivative data. [2025-09-26T22:21:46.057442] [INFO ] [MAIN ] Derivative Progress: 762/2074 symbols completed. GES took 1.3s. Estimated remaining: 9m 8s. Rate: 143.8 symbols/min [2025-09-26T22:21:46.057886] [INFO ] [MAIN ] GF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:46.073356] [DEBUG] [LOCAL ] GF: Loaded 3220 existing records from primary storage. [2025-09-26T22:21:46.073505] [INFO ] [MAIN ] GF: Loaded 3220 primary data records. [2025-09-26T22:21:46.199807] [DEBUG] [LOCAL ] GETY: Loaded 36378 existing records from primary storage. [2025-09-26T22:21:46.204269] [INFO ] [MAIN ] GETY: Loaded 36378 primary data records. [2025-09-26T22:21:46.645676] [DEBUG] [LOCAL ] GEV: Loaded 53878 existing records from primary storage. [2025-09-26T22:21:46.646046] [INFO ] [MAIN ] GEV: Loaded 53878 primary data records. [2025-09-26T22:21:47.204171] [DEBUG] [MAIN ] GF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:47.206155] [INFO ] [MAIN ] GF: Generated 1820 derivative records from 3220 primary records. [2025-09-26T22:21:47.206468] [DEBUG] [LOCAL ] GF: Saving derivative data. [2025-09-26T22:21:47.226808] [DEBUG] [LOCAL ] GF: Derivative data saved (1820 records). [2025-09-26T22:21:47.227260] [INFO ] [MAIN ] GF: Successfully saved derivative data. [2025-09-26T22:21:47.229677] [INFO ] [MAIN ] Derivative Progress: 763/2074 symbols completed. GF took 1.2s. Estimated remaining: 9m 8s. Rate: 143.4 symbols/min [2025-09-26T22:21:47.244811] [DEBUG] [MAIN ] GETY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:47.245812] [INFO ] [MAIN ] GETY: Generated 1820 derivative records from 36378 primary records. [2025-09-26T22:21:47.246049] [DEBUG] [LOCAL ] GETY: Saving derivative data. [2025-09-26T22:21:47.281217] [DEBUG] [LOCAL ] GETY: Derivative data saved (1820 records). [2025-09-26T22:21:47.281481] [DEBUG] [MAIN ] GEV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:47.281701] [INFO ] [MAIN ] GETY: Successfully saved derivative data. [2025-09-26T22:21:47.284092] [INFO ] [MAIN ] Derivative Progress: 764/2074 symbols completed. GETY took 1.3s. Estimated remaining: 9m 7s. Rate: 143.6 symbols/min [2025-09-26T22:21:47.285121] [INFO ] [MAIN ] GEV: Generated 1820 derivative records from 53878 primary records. [2025-09-26T22:21:47.285357] [DEBUG] [LOCAL ] GEV: Saving derivative data. [2025-09-26T22:21:47.301588] [DEBUG] [LOCAL ] GEV: Derivative data saved (1820 records). [2025-09-26T22:21:47.301677] [INFO ] [MAIN ] GEV: Successfully saved derivative data. [2025-09-26T22:21:47.304507] [INFO ] [MAIN ] Derivative Progress: 765/2074 symbols completed. GEV took 1.3s. Estimated remaining: 9m 6s. Rate: 143.8 symbols/min [2025-09-26T22:21:47.305186] [INFO ] [MAIN ] GFL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:47.305355] [INFO ] [MAIN ] GFI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:47.305263] [INFO ] [MAIN ] GFF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:47.366772] [DEBUG] [LOCAL ] GFF: Loaded 31088 existing records from primary storage. [2025-09-26T22:21:47.392374] [INFO ] [MAIN ] GFF: Loaded 31088 primary data records. [2025-09-26T22:21:47.399861] [DEBUG] [LOCAL ] GFL: Loaded 48755 existing records from primary storage. [2025-09-26T22:21:47.417746] [INFO ] [MAIN ] GFL: Loaded 48755 primary data records. [2025-09-26T22:21:47.623752] [DEBUG] [LOCAL ] GFI: Loaded 53887 existing records from primary storage. [2025-09-26T22:21:47.674603] [INFO ] [MAIN ] GFI: Loaded 53887 primary data records. [2025-09-26T22:21:48.478518] [DEBUG] [MAIN ] GFF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:48.480013] [INFO ] [MAIN ] GFF: Generated 1820 derivative records from 31088 primary records. [2025-09-26T22:21:48.480406] [DEBUG] [MAIN ] GFL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:48.480527] [DEBUG] [LOCAL ] GFF: Saving derivative data. [2025-09-26T22:21:48.481293] [INFO ] [MAIN ] GFL: Generated 1820 derivative records from 48755 primary records. [2025-09-26T22:21:48.484693] [DEBUG] [LOCAL ] GFL: Saving derivative data. [2025-09-26T22:21:48.522295] [DEBUG] [MAIN ] GFI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:48.524295] [INFO ] [MAIN ] GFI: Generated 1820 derivative records from 53887 primary records. [2025-09-26T22:21:48.524930] [DEBUG] [LOCAL ] GFI: Saving derivative data. [2025-09-26T22:21:48.545634] [DEBUG] [LOCAL ] GFL: Derivative data saved (1820 records). [2025-09-26T22:21:48.546633] [DEBUG] [LOCAL ] GFF: Derivative data saved (1820 records). [2025-09-26T22:21:48.546771] [INFO ] [MAIN ] GFF: Successfully saved derivative data. [2025-09-26T22:21:48.549350] [INFO ] [MAIN ] Derivative Progress: 766/2074 symbols completed. GFF took 1.2s. Estimated remaining: 9m 7s. Rate: 143.4 symbols/min [2025-09-26T22:21:48.549930] [INFO ] [MAIN ] GFR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:48.546846] [INFO ] [MAIN ] GFL: Successfully saved derivative data. [2025-09-26T22:21:48.553121] [INFO ] [MAIN ] Derivative Progress: 767/2074 symbols completed. GFL took 1.2s. Estimated remaining: 9m 6s. Rate: 143.6 symbols/min [2025-09-26T22:21:48.553808] [INFO ] [MAIN ] GGB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:48.556765] [DEBUG] [LOCAL ] GFI: Derivative data saved (1820 records). [2025-09-26T22:21:48.556855] [INFO ] [MAIN ] GFI: Successfully saved derivative data. [2025-09-26T22:21:48.559605] [INFO ] [MAIN ] Derivative Progress: 768/2074 symbols completed. GFI took 1.3s. Estimated remaining: 9m 5s. Rate: 143.8 symbols/min [2025-09-26T22:21:48.559940] [INFO ] [MAIN ] GGT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:48.567629] [DEBUG] [LOCAL ] GFR: Loaded 8572 existing records from primary storage. [2025-09-26T22:21:48.567839] [INFO ] [MAIN ] GFR: Loaded 8572 primary data records. [2025-09-26T22:21:48.687132] [DEBUG] [LOCAL ] GGT: Loaded 14309 existing records from primary storage. [2025-09-26T22:21:48.693048] [INFO ] [MAIN ] GGT: Loaded 14309 primary data records. [2025-09-26T22:21:49.070471] [DEBUG] [LOCAL ] GGB: Loaded 51813 existing records from primary storage. [2025-09-26T22:21:49.085900] [INFO ] [MAIN ] GGB: Loaded 51813 primary data records. [2025-09-26T22:21:49.642142] [DEBUG] [MAIN ] GFR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:49.644046] [INFO ] [MAIN ] GFR: Generated 1820 derivative records from 8572 primary records. [2025-09-26T22:21:49.644182] [DEBUG] [LOCAL ] GFR: Saving derivative data. [2025-09-26T22:21:49.675870] [DEBUG] [MAIN ] GGT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:49.677772] [INFO ] [MAIN ] GGT: Generated 1820 derivative records from 14309 primary records. [2025-09-26T22:21:49.678195] [DEBUG] [LOCAL ] GGT: Saving derivative data. [2025-09-26T22:21:49.680958] [DEBUG] [LOCAL ] GFR: Derivative data saved (1820 records). [2025-09-26T22:21:49.692314] [INFO ] [MAIN ] GFR: Successfully saved derivative data. [2025-09-26T22:21:49.695114] [INFO ] [MAIN ] Derivative Progress: 769/2074 symbols completed. GFR took 1.1s. Estimated remaining: 9m 6s. Rate: 143.4 symbols/min [2025-09-26T22:21:49.696549] [INFO ] [MAIN ] GGZ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:49.718949] [DEBUG] [MAIN ] GGB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:49.718267] [DEBUG] [LOCAL ] GGZ: Loaded 2465 existing records from primary storage. [2025-09-26T22:21:49.721088] [INFO ] [MAIN ] GGB: Generated 1820 derivative records from 51813 primary records. [2025-09-26T22:21:49.721562] [INFO ] [MAIN ] GGZ: Loaded 2465 primary data records. [2025-09-26T22:21:49.721487] [DEBUG] [LOCAL ] GGB: Saving derivative data. [2025-09-26T22:21:49.730246] [DEBUG] [LOCAL ] GGT: Derivative data saved (1820 records). [2025-09-26T22:21:49.736029] [INFO ] [MAIN ] GGT: Successfully saved derivative data. [2025-09-26T22:21:49.766335] [INFO ] [MAIN ] Derivative Progress: 770/2074 symbols completed. GGT took 1.2s. Estimated remaining: 9m 5s. Rate: 143.6 symbols/min [2025-09-26T22:21:49.792476] [INFO ] [MAIN ] GHC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:49.874305] [DEBUG] [LOCAL ] GHC: Loaded 2664 existing records from primary storage. [2025-09-26T22:21:49.886535] [DEBUG] [LOCAL ] GGB: Derivative data saved (1820 records). [2025-09-26T22:21:49.885569] [INFO ] [MAIN ] GHC: Loaded 2664 primary data records. [2025-09-26T22:21:49.897076] [INFO ] [MAIN ] GGB: Successfully saved derivative data. [2025-09-26T22:21:49.933092] [INFO ] [MAIN ] Derivative Progress: 771/2074 symbols completed. GGB took 1.4s. Estimated remaining: 9m 4s. Rate: 143.7 symbols/min [2025-09-26T22:21:49.978091] [INFO ] [MAIN ] GHG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:50.229041] [DEBUG] [LOCAL ] GHG: Loaded 3226 existing records from primary storage. [2025-09-26T22:21:50.234977] [INFO ] [MAIN ] GHG: Loaded 3226 primary data records. [2025-09-26T22:21:50.779814] [DEBUG] [MAIN ] GGZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:50.781494] [INFO ] [MAIN ] GGZ: Generated 1820 derivative records from 2465 primary records. [2025-09-26T22:21:50.781797] [DEBUG] [LOCAL ] GGZ: Saving derivative data. [2025-09-26T22:21:50.815227] [DEBUG] [LOCAL ] GGZ: Derivative data saved (1820 records). [2025-09-26T22:21:50.815850] [DEBUG] [MAIN ] GHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:50.817376] [INFO ] [MAIN ] GHC: Generated 1820 derivative records from 2664 primary records. [2025-09-26T22:21:50.817669] [INFO ] [MAIN ] GGZ: Successfully saved derivative data. [2025-09-26T22:21:50.820144] [INFO ] [MAIN ] Derivative Progress: 772/2074 symbols completed. GGZ took 1.1s. Estimated remaining: 9m 4s. Rate: 143.5 symbols/min [2025-09-26T22:21:50.820557] [INFO ] [MAIN ] GHI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:50.821756] [DEBUG] [LOCAL ] GHC: Saving derivative data. [2025-09-26T22:21:50.851485] [DEBUG] [MAIN ] GHG: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:21:50.856402] [DEBUG] [LOCAL ] GHI: Loaded 6963 existing records from primary storage. [2025-09-26T22:21:50.857163] [INFO ] [MAIN ] GHG: Generated 1819 derivative records from 3226 primary records. [2025-09-26T22:21:50.858043] [DEBUG] [LOCAL ] GHG: Saving derivative data. [2025-09-26T22:21:50.859331] [DEBUG] [LOCAL ] GHC: Derivative data saved (1820 records). [2025-09-26T22:21:50.858109] [INFO ] [MAIN ] GHI: Loaded 6963 primary data records. [2025-09-26T22:21:50.859611] [INFO ] [MAIN ] GHC: Successfully saved derivative data. [2025-09-26T22:21:50.879385] [INFO ] [MAIN ] Derivative Progress: 773/2074 symbols completed. GHC took 1.1s. Estimated remaining: 9m 3s. Rate: 143.7 symbols/min [2025-09-26T22:21:50.910466] [INFO ] [MAIN ] GHLD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:50.990289] [DEBUG] [LOCAL ] GHLD: Loaded 4168 existing records from primary storage. [2025-09-26T22:21:51.001970] [INFO ] [MAIN ] GHLD: Loaded 4168 primary data records. [2025-09-26T22:21:51.007959] [DEBUG] [LOCAL ] GHG: Derivative data saved (1819 records). [2025-09-26T22:21:51.021439] [INFO ] [MAIN ] GHG: Successfully saved derivative data. [2025-09-26T22:21:51.139361] [INFO ] [MAIN ] Derivative Progress: 774/2074 symbols completed. GHG took 1.2s. Estimated remaining: 9m 3s. Rate: 143.7 symbols/min [2025-09-26T22:21:51.148332] [INFO ] [MAIN ] GHM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:51.475341] [DEBUG] [LOCAL ] GHM: Loaded 14350 existing records from primary storage. [2025-09-26T22:21:51.577063] [INFO ] [MAIN ] GHM: Loaded 14350 primary data records. [2025-09-26T22:21:51.931770] [DEBUG] [MAIN ] GHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:51.932864] [INFO ] [MAIN ] GHI: Generated 1820 derivative records from 6963 primary records. [2025-09-26T22:21:51.933700] [DEBUG] [LOCAL ] GHI: Saving derivative data. [2025-09-26T22:21:51.967366] [DEBUG] [MAIN ] GHLD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:51.969237] [INFO ] [MAIN ] GHLD: Generated 1820 derivative records from 4168 primary records. [2025-09-26T22:21:51.969606] [DEBUG] [LOCAL ] GHLD: Saving derivative data. [2025-09-26T22:21:51.982913] [DEBUG] [LOCAL ] GHI: Derivative data saved (1820 records). [2025-09-26T22:21:51.983882] [INFO ] [MAIN ] GHI: Successfully saved derivative data. [2025-09-26T22:21:51.986769] [INFO ] [MAIN ] Derivative Progress: 775/2074 symbols completed. GHI took 1.2s. Estimated remaining: 9m 3s. Rate: 143.5 symbols/min [2025-09-26T22:21:51.988284] [INFO ] [MAIN ] GHY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:51.992574] [DEBUG] [LOCAL ] GHLD: Derivative data saved (1820 records). [2025-09-26T22:21:51.992692] [INFO ] [MAIN ] GHLD: Successfully saved derivative data. [2025-09-26T22:21:51.995773] [INFO ] [MAIN ] Derivative Progress: 776/2074 symbols completed. GHLD took 1.1s. Estimated remaining: 9m 2s. Rate: 143.7 symbols/min [2025-09-26T22:21:51.996269] [INFO ] [MAIN ] GIB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:52.016713] [DEBUG] [MAIN ] GHM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:52.022926] [INFO ] [MAIN ] GHM: Generated 1820 derivative records from 14350 primary records. [2025-09-26T22:21:52.023171] [DEBUG] [LOCAL ] GHM: Saving derivative data. [2025-09-26T22:21:52.056162] [DEBUG] [LOCAL ] GHY: Loaded 21190 existing records from primary storage. [2025-09-26T22:21:52.057162] [INFO ] [MAIN ] GHY: Loaded 21190 primary data records. [2025-09-26T22:21:52.134711] [DEBUG] [LOCAL ] GHM: Derivative data saved (1820 records). [2025-09-26T22:21:52.143943] [INFO ] [MAIN ] GHM: Successfully saved derivative data. [2025-09-26T22:21:52.153396] [INFO ] [MAIN ] Derivative Progress: 777/2074 symbols completed. GHM took 1.0s. Estimated remaining: 9m 1s. Rate: 143.8 symbols/min [2025-09-26T22:21:52.167877] [INFO ] [MAIN ] GIC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:52.194946] [DEBUG] [LOCAL ] GIB: Loaded 32653 existing records from primary storage. [2025-09-26T22:21:52.196069] [INFO ] [MAIN ] GIB: Loaded 32653 primary data records. [2025-09-26T22:21:52.519080] [DEBUG] [LOCAL ] GIC: Loaded 13796 existing records from primary storage. [2025-09-26T22:21:52.528848] [INFO ] [MAIN ] GIC: Loaded 13796 primary data records. [2025-09-26T22:21:53.156987] [DEBUG] [MAIN ] GHY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:53.158352] [INFO ] [MAIN ] GHY: Generated 1820 derivative records from 21190 primary records. [2025-09-26T22:21:53.158613] [DEBUG] [LOCAL ] GHY: Saving derivative data. [2025-09-26T22:21:53.198481] [DEBUG] [MAIN ] GIB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:53.200079] [INFO ] [MAIN ] GIB: Generated 1820 derivative records from 32653 primary records. [2025-09-26T22:21:53.200437] [DEBUG] [LOCAL ] GIB: Saving derivative data. [2025-09-26T22:21:53.199176] [DEBUG] [LOCAL ] GHY: Derivative data saved (1820 records). [2025-09-26T22:21:53.203630] [INFO ] [MAIN ] GHY: Successfully saved derivative data. [2025-09-26T22:21:53.214253] [INFO ] [MAIN ] Derivative Progress: 778/2074 symbols completed. GHY took 1.2s. Estimated remaining: 9m 2s. Rate: 143.5 symbols/min [2025-09-26T22:21:53.233230] [DEBUG] [MAIN ] GIC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:53.234848] [INFO ] [MAIN ] GIC: Generated 1820 derivative records from 13796 primary records. [2025-09-26T22:21:53.235172] [DEBUG] [LOCAL ] GIC: Saving derivative data. [2025-09-26T22:21:53.247215] [DEBUG] [LOCAL ] GIB: Derivative data saved (1820 records). [2025-09-26T22:21:53.249939] [INFO ] [MAIN ] GIB: Successfully saved derivative data. [2025-09-26T22:21:53.252873] [INFO ] [MAIN ] Derivative Progress: 779/2074 symbols completed. GIB took 1.3s. Estimated remaining: 9m 1s. Rate: 143.7 symbols/min [2025-09-26T22:21:53.258372] [DEBUG] [LOCAL ] GIC: Derivative data saved (1820 records). [2025-09-26T22:21:53.258513] [INFO ] [MAIN ] GIC: Successfully saved derivative data. [2025-09-26T22:21:53.261193] [INFO ] [MAIN ] Derivative Progress: 780/2074 symbols completed. GIC took 1.1s. Estimated remaining: 8m 60s. Rate: 143.9 symbols/min [2025-09-26T22:21:53.261870] [INFO ] [MAIN ] GIS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:53.262138] [INFO ] [MAIN ] GIL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:53.262063] [INFO ] [MAIN ] GKOS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:53.341689] [DEBUG] [LOCAL ] GKOS: Loaded 43585 existing records from primary storage. [2025-09-26T22:21:53.340539] [DEBUG] [LOCAL ] GIL: Loaded 43906 existing records from primary storage. [2025-09-26T22:21:53.342526] [INFO ] [MAIN ] GKOS: Loaded 43585 primary data records. [2025-09-26T22:21:53.370618] [INFO ] [MAIN ] GIL: Loaded 43906 primary data records. [2025-09-26T22:21:53.410327] [DEBUG] [LOCAL ] GIS: Loaded 54455 existing records from primary storage. [2025-09-26T22:21:53.451810] [INFO ] [MAIN ] GIS: Loaded 54455 primary data records. [2025-09-26T22:21:54.400205] [DEBUG] [MAIN ] GIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:54.398707] [DEBUG] [MAIN ] GKOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:54.403867] [INFO ] [MAIN ] GIS: Generated 1820 derivative records from 54455 primary records. [2025-09-26T22:21:54.402188] [INFO ] [MAIN ] GKOS: Generated 1820 derivative records from 43585 primary records. [2025-09-26T22:21:54.404227] [DEBUG] [LOCAL ] GKOS: Saving derivative data. [2025-09-26T22:21:54.404323] [DEBUG] [LOCAL ] GIS: Saving derivative data. [2025-09-26T22:21:54.458113] [DEBUG] [LOCAL ] GKOS: Derivative data saved (1820 records). [2025-09-26T22:21:54.456456] [DEBUG] [MAIN ] GIL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:54.458283] [INFO ] [MAIN ] GKOS: Successfully saved derivative data. [2025-09-26T22:21:54.461834] [INFO ] [MAIN ] GIL: Generated 1820 derivative records from 43906 primary records. [2025-09-26T22:21:54.460350] [INFO ] [MAIN ] Derivative Progress: 781/2074 symbols completed. GKOS took 1.2s. Estimated remaining: 9m 0s. Rate: 143.6 symbols/min [2025-09-26T22:21:54.462016] [DEBUG] [LOCAL ] GIL: Saving derivative data. [2025-09-26T22:21:54.464053] [INFO ] [MAIN ] GL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:54.484537] [DEBUG] [LOCAL ] GIS: Derivative data saved (1820 records). [2025-09-26T22:21:54.485796] [INFO ] [MAIN ] GIS: Successfully saved derivative data. [2025-09-26T22:21:54.489086] [INFO ] [MAIN ] Derivative Progress: 782/2074 symbols completed. GIS took 1.2s. Estimated remaining: 8m 59s. Rate: 143.7 symbols/min [2025-09-26T22:21:54.490391] [INFO ] [MAIN ] GLOB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:54.493627] [DEBUG] [LOCAL ] GIL: Derivative data saved (1820 records). [2025-09-26T22:21:54.497312] [INFO ] [MAIN ] GIL: Successfully saved derivative data. [2025-09-26T22:21:54.500426] [INFO ] [MAIN ] Derivative Progress: 783/2074 symbols completed. GIL took 1.2s. Estimated remaining: 8m 58s. Rate: 143.9 symbols/min [2025-09-26T22:21:54.500901] [INFO ] [MAIN ] GLP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:54.535380] [DEBUG] [LOCAL ] GLP: Loaded 9585 existing records from primary storage. [2025-09-26T22:21:54.536219] [INFO ] [MAIN ] GLP: Loaded 9585 primary data records. [2025-09-26T22:21:54.647686] [DEBUG] [LOCAL ] GL: Loaded 38382 existing records from primary storage. [2025-09-26T22:21:54.666597] [INFO ] [MAIN ] GL: Loaded 38382 primary data records. [2025-09-26T22:21:54.897890] [DEBUG] [LOCAL ] GLOB: Loaded 48111 existing records from primary storage. [2025-09-26T22:21:55.026670] [INFO ] [MAIN ] GLOB: Loaded 48111 primary data records. [2025-09-26T22:21:55.700169] [DEBUG] [MAIN ] GLP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:55.701275] [INFO ] [MAIN ] GLP: Generated 1820 derivative records from 9585 primary records. [2025-09-26T22:21:55.701416] [DEBUG] [LOCAL ] GLP: Saving derivative data. [2025-09-26T22:21:55.740085] [DEBUG] [MAIN ] GL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:55.743200] [DEBUG] [LOCAL ] GLP: Derivative data saved (1820 records). [2025-09-26T22:21:55.741748] [INFO ] [MAIN ] GL: Generated 1820 derivative records from 38382 primary records. [2025-09-26T22:21:55.744366] [INFO ] [MAIN ] GLP: Successfully saved derivative data. [2025-09-26T22:21:55.744447] [DEBUG] [LOCAL ] GL: Saving derivative data. [2025-09-26T22:21:55.747451] [INFO ] [MAIN ] Derivative Progress: 784/2074 symbols completed. GLP took 1.2s. Estimated remaining: 8m 59s. Rate: 143.5 symbols/min [2025-09-26T22:21:55.748942] [INFO ] [MAIN ] GLW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:55.781696] [DEBUG] [LOCAL ] GL: Derivative data saved (1820 records). [2025-09-26T22:21:55.781799] [DEBUG] [MAIN ] GLOB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:55.782030] [INFO ] [MAIN ] GL: Successfully saved derivative data. [2025-09-26T22:21:55.785963] [INFO ] [MAIN ] GLOB: Generated 1820 derivative records from 48111 primary records. [2025-09-26T22:21:55.785055] [INFO ] [MAIN ] Derivative Progress: 785/2074 symbols completed. GL took 1.3s. Estimated remaining: 8m 58s. Rate: 143.7 symbols/min [2025-09-26T22:21:55.786225] [DEBUG] [LOCAL ] GLOB: Saving derivative data. [2025-09-26T22:21:55.786957] [INFO ] [MAIN ] GM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:55.815046] [DEBUG] [LOCAL ] GLOB: Derivative data saved (1820 records). [2025-09-26T22:21:55.815270] [INFO ] [MAIN ] GLOB: Successfully saved derivative data. [2025-09-26T22:21:55.820390] [INFO ] [MAIN ] Derivative Progress: 786/2074 symbols completed. GLOB took 1.3s. Estimated remaining: 8m 57s. Rate: 143.9 symbols/min [2025-09-26T22:21:55.821498] [INFO ] [MAIN ] GME: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:55.892072] [DEBUG] [LOCAL ] GLW: Loaded 54415 existing records from primary storage. [2025-09-26T22:21:55.892477] [INFO ] [MAIN ] GLW: Loaded 54415 primary data records. [2025-09-26T22:21:56.052251] [DEBUG] [LOCAL ] GM: Loaded 54508 existing records from primary storage. [2025-09-26T22:21:56.072446] [INFO ] [MAIN ] GM: Loaded 54508 primary data records. [2025-09-26T22:21:56.193781] [DEBUG] [LOCAL ] GME: Loaded 54540 existing records from primary storage. [2025-09-26T22:21:56.271275] [INFO ] [MAIN ] GME: Loaded 54540 primary data records. [2025-09-26T22:21:56.989587] [DEBUG] [MAIN ] GLW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:56.990922] [INFO ] [MAIN ] GLW: Generated 1820 derivative records from 54415 primary records. [2025-09-26T22:21:56.991200] [DEBUG] [LOCAL ] GLW: Saving derivative data. [2025-09-26T22:21:57.029085] [DEBUG] [MAIN ] GM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:57.028882] [DEBUG] [LOCAL ] GLW: Derivative data saved (1820 records). [2025-09-26T22:21:57.029971] [INFO ] [MAIN ] GM: Generated 1820 derivative records from 54508 primary records. [2025-09-26T22:21:57.030254] [DEBUG] [LOCAL ] GM: Saving derivative data. [2025-09-26T22:21:57.030309] [INFO ] [MAIN ] GLW: Successfully saved derivative data. [2025-09-26T22:21:57.034538] [INFO ] [MAIN ] Derivative Progress: 787/2074 symbols completed. GLW took 1.3s. Estimated remaining: 8m 58s. Rate: 143.5 symbols/min [2025-09-26T22:21:57.035588] [INFO ] [MAIN ] GMED: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:57.069866] [DEBUG] [MAIN ] GME: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:57.071443] [INFO ] [MAIN ] GME: Generated 1820 derivative records from 54540 primary records. [2025-09-26T22:21:57.072131] [DEBUG] [LOCAL ] GME: Saving derivative data. [2025-09-26T22:21:57.091737] [DEBUG] [LOCAL ] GM: Derivative data saved (1820 records). [2025-09-26T22:21:57.091850] [INFO ] [MAIN ] GM: Successfully saved derivative data. [2025-09-26T22:21:57.091553] [DEBUG] [LOCAL ] GME: Derivative data saved (1820 records). [2025-09-26T22:21:57.094907] [INFO ] [MAIN ] Derivative Progress: 788/2074 symbols completed. GM took 1.3s. Estimated remaining: 8m 57s. Rate: 143.7 symbols/min [2025-09-26T22:21:57.095266] [INFO ] [MAIN ] GMRE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:57.095061] [INFO ] [MAIN ] GME: Successfully saved derivative data. [2025-09-26T22:21:57.098312] [INFO ] [MAIN ] Derivative Progress: 789/2074 symbols completed. GME took 1.3s. Estimated remaining: 8m 56s. Rate: 143.9 symbols/min [2025-09-26T22:21:57.099013] [INFO ] [MAIN ] GNE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:57.133481] [DEBUG] [LOCAL ] GNE: Loaded 17940 existing records from primary storage. [2025-09-26T22:21:57.133757] [INFO ] [MAIN ] GNE: Loaded 17940 primary data records. [2025-09-26T22:21:57.255961] [DEBUG] [LOCAL ] GMED: Loaded 49096 existing records from primary storage. [2025-09-26T22:21:57.310931] [INFO ] [MAIN ] GMED: Loaded 49096 primary data records. [2025-09-26T22:21:57.317306] [DEBUG] [LOCAL ] GMRE: Loaded 38133 existing records from primary storage. [2025-09-26T22:21:57.333086] [INFO ] [MAIN ] GMRE: Loaded 38133 primary data records. [2025-09-26T22:21:58.267801] [DEBUG] [MAIN ] GNE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:58.269453] [INFO ] [MAIN ] GNE: Generated 1820 derivative records from 17940 primary records. [2025-09-26T22:21:58.270037] [DEBUG] [LOCAL ] GNE: Saving derivative data. [2025-09-26T22:21:58.306349] [DEBUG] [MAIN ] GMED: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:58.306490] [DEBUG] [LOCAL ] GNE: Derivative data saved (1820 records). [2025-09-26T22:21:58.307837] [INFO ] [MAIN ] GMED: Generated 1820 derivative records from 49096 primary records. [2025-09-26T22:21:58.307981] [INFO ] [MAIN ] GNE: Successfully saved derivative data. [2025-09-26T22:21:58.310331] [INFO ] [MAIN ] Derivative Progress: 790/2074 symbols completed. GNE took 1.2s. Estimated remaining: 8m 57s. Rate: 143.5 symbols/min [2025-09-26T22:21:58.311673] [DEBUG] [LOCAL ] GMED: Saving derivative data. [2025-09-26T22:21:58.314963] [INFO ] [MAIN ] GNK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:58.342802] [DEBUG] [MAIN ] GMRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:58.344744] [INFO ] [MAIN ] GMRE: Generated 1820 derivative records from 38133 primary records. [2025-09-26T22:21:58.344830] [DEBUG] [LOCAL ] GMRE: Saving derivative data. [2025-09-26T22:21:58.360710] [DEBUG] [LOCAL ] GMED: Derivative data saved (1820 records). [2025-09-26T22:21:58.362007] [INFO ] [MAIN ] GMED: Successfully saved derivative data. [2025-09-26T22:21:58.365801] [INFO ] [MAIN ] Derivative Progress: 791/2074 symbols completed. GMED took 1.3s. Estimated remaining: 8m 56s. Rate: 143.7 symbols/min [2025-09-26T22:21:58.367566] [INFO ] [MAIN ] GNL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:58.370774] [DEBUG] [LOCAL ] GMRE: Derivative data saved (1820 records). [2025-09-26T22:21:58.371004] [INFO ] [MAIN ] GMRE: Successfully saved derivative data. [2025-09-26T22:21:58.373894] [INFO ] [MAIN ] Derivative Progress: 792/2074 symbols completed. GMRE took 1.3s. Estimated remaining: 8m 55s. Rate: 143.8 symbols/min [2025-09-26T22:21:58.374250] [INFO ] [MAIN ] GNRC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:58.406055] [DEBUG] [LOCAL ] GNK: Loaded 41039 existing records from primary storage. [2025-09-26T22:21:58.406209] [INFO ] [MAIN ] GNK: Loaded 41039 primary data records. [2025-09-26T22:21:58.601754] [DEBUG] [LOCAL ] GNL: Loaded 47785 existing records from primary storage. [2025-09-26T22:21:58.655850] [INFO ] [MAIN ] GNL: Loaded 47785 primary data records. [2025-09-26T22:21:58.793267] [DEBUG] [LOCAL ] GNRC: Loaded 45886 existing records from primary storage. [2025-09-26T22:21:58.805197] [INFO ] [MAIN ] GNRC: Loaded 45886 primary data records. [2025-09-26T22:21:59.507425] [DEBUG] [MAIN ] GNK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:59.509926] [INFO ] [MAIN ] GNK: Generated 1820 derivative records from 41039 primary records. [2025-09-26T22:21:59.510023] [DEBUG] [LOCAL ] GNK: Saving derivative data. [2025-09-26T22:21:59.530394] [DEBUG] [LOCAL ] GNK: Derivative data saved (1820 records). [2025-09-26T22:21:59.531067] [INFO ] [MAIN ] GNK: Successfully saved derivative data. [2025-09-26T22:21:59.533944] [INFO ] [MAIN ] Derivative Progress: 793/2074 symbols completed. GNK took 1.2s. Estimated remaining: 8m 56s. Rate: 143.5 symbols/min [2025-09-26T22:21:59.563583] [DEBUG] [MAIN ] GNL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:59.576584] [DEBUG] [MAIN ] GNRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:21:59.577528] [INFO ] [MAIN ] GNRC: Generated 1820 derivative records from 45886 primary records. [2025-09-26T22:21:59.579037] [DEBUG] [LOCAL ] GNRC: Saving derivative data. [2025-09-26T22:21:59.578941] [INFO ] [MAIN ] GNL: Generated 1820 derivative records from 47785 primary records. [2025-09-26T22:21:59.579958] [DEBUG] [LOCAL ] GNL: Saving derivative data. [2025-09-26T22:21:59.609903] [DEBUG] [LOCAL ] GNL: Derivative data saved (1820 records). [2025-09-26T22:21:59.610958] [INFO ] [MAIN ] GNL: Successfully saved derivative data. [2025-09-26T22:21:59.614073] [INFO ] [MAIN ] Derivative Progress: 794/2074 symbols completed. GNL took 1.2s. Estimated remaining: 8m 55s. Rate: 143.7 symbols/min [2025-09-26T22:21:59.616376] [DEBUG] [LOCAL ] GNRC: Derivative data saved (1820 records). [2025-09-26T22:21:59.616503] [INFO ] [MAIN ] GNRC: Successfully saved derivative data. [2025-09-26T22:21:59.619535] [INFO ] [MAIN ] Derivative Progress: 795/2074 symbols completed. GNRC took 1.2s. Estimated remaining: 8m 53s. Rate: 143.9 symbols/min [2025-09-26T22:21:59.620710] [INFO ] [MAIN ] GNTY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:59.620560] [INFO ] [MAIN ] GNW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:59.620311] [INFO ] [MAIN ] GNT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:21:59.634064] [DEBUG] [LOCAL ] GNT: Loaded 8177 existing records from primary storage. [2025-09-26T22:21:59.637907] [INFO ] [MAIN ] GNT: Loaded 8177 primary data records. [2025-09-26T22:21:59.638142] [DEBUG] [LOCAL ] GNTY: Loaded 7353 existing records from primary storage. [2025-09-26T22:21:59.662107] [INFO ] [MAIN ] GNTY: Loaded 7353 primary data records. [2025-09-26T22:21:59.961016] [DEBUG] [LOCAL ] GNW: Loaded 52086 existing records from primary storage. [2025-09-26T22:22:00.038028] [INFO ] [MAIN ] GNW: Loaded 52086 primary data records. [2025-09-26T22:22:00.764390] [DEBUG] [MAIN ] GNTY: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:22:00.765748] [INFO ] [MAIN ] GNTY: Generated 1819 derivative records from 7353 primary records. [2025-09-26T22:22:00.766129] [DEBUG] [LOCAL ] GNTY: Saving derivative data. [2025-09-26T22:22:00.791281] [DEBUG] [MAIN ] GNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:00.796614] [INFO ] [MAIN ] GNT: Generated 1820 derivative records from 8177 primary records. [2025-09-26T22:22:00.796858] [DEBUG] [LOCAL ] GNT: Saving derivative data. [2025-09-26T22:22:00.817391] [DEBUG] [LOCAL ] GNTY: Derivative data saved (1819 records). [2025-09-26T22:22:00.819577] [INFO ] [MAIN ] GNTY: Successfully saved derivative data. [2025-09-26T22:22:00.822886] [INFO ] [MAIN ] Derivative Progress: 796/2074 symbols completed. GNTY took 1.2s. Estimated remaining: 8m 54s. Rate: 143.5 symbols/min [2025-09-26T22:22:00.824303] [DEBUG] [LOCAL ] GNT: Derivative data saved (1820 records). [2025-09-26T22:22:00.825010] [INFO ] [MAIN ] GNT: Successfully saved derivative data. [2025-09-26T22:22:00.824758] [INFO ] [MAIN ] GOF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:00.838236] [INFO ] [MAIN ] Derivative Progress: 797/2074 symbols completed. GNT took 1.2s. Estimated remaining: 8m 53s. Rate: 143.7 symbols/min [2025-09-26T22:22:00.846558] [INFO ] [MAIN ] GOLF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:00.847355] [DEBUG] [MAIN ] GNW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:00.848686] [INFO ] [MAIN ] GNW: Generated 1820 derivative records from 52086 primary records. [2025-09-26T22:22:00.848895] [DEBUG] [LOCAL ] GNW: Saving derivative data. [2025-09-26T22:22:00.870091] [DEBUG] [LOCAL ] GNW: Derivative data saved (1820 records). [2025-09-26T22:22:00.870229] [INFO ] [MAIN ] GNW: Successfully saved derivative data. [2025-09-26T22:22:00.873408] [INFO ] [MAIN ] Derivative Progress: 798/2074 symbols completed. GNW took 1.3s. Estimated remaining: 8m 52s. Rate: 143.9 symbols/min [2025-09-26T22:22:00.873828] [INFO ] [MAIN ] GOOS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:00.929376] [DEBUG] [LOCAL ] GOLF: Loaded 32049 existing records from primary storage. [2025-09-26T22:22:00.930438] [DEBUG] [LOCAL ] GOF: Loaded 43374 existing records from primary storage. [2025-09-26T22:22:00.930681] [INFO ] [MAIN ] GOF: Loaded 43374 primary data records. [2025-09-26T22:22:00.930592] [INFO ] [MAIN ] GOLF: Loaded 32049 primary data records. [2025-09-26T22:22:01.227539] [DEBUG] [LOCAL ] GOOS: Loaded 46008 existing records from primary storage. [2025-09-26T22:22:01.254541] [INFO ] [MAIN ] GOOS: Loaded 46008 primary data records. [2025-09-26T22:22:02.141025] [DEBUG] [MAIN ] GOF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:02.153628] [INFO ] [MAIN ] GOF: Generated 1820 derivative records from 43374 primary records. [2025-09-26T22:22:02.154805] [DEBUG] [MAIN ] GOLF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:02.154600] [DEBUG] [LOCAL ] GOF: Saving derivative data. [2025-09-26T22:22:02.156399] [INFO ] [MAIN ] GOLF: Generated 1820 derivative records from 32049 primary records. [2025-09-26T22:22:02.168270] [DEBUG] [LOCAL ] GOLF: Saving derivative data. [2025-09-26T22:22:02.189399] [DEBUG] [LOCAL ] GOF: Derivative data saved (1820 records). [2025-09-26T22:22:02.190490] [INFO ] [MAIN ] GOF: Successfully saved derivative data. [2025-09-26T22:22:02.194325] [INFO ] [MAIN ] Derivative Progress: 799/2074 symbols completed. GOF took 1.4s. Estimated remaining: 8m 53s. Rate: 143.5 symbols/min [2025-09-26T22:22:02.194896] [INFO ] [MAIN ] GOTU: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:02.209873] [DEBUG] [LOCAL ] GOLF: Derivative data saved (1820 records). [2025-09-26T22:22:02.210264] [INFO ] [MAIN ] GOLF: Successfully saved derivative data. [2025-09-26T22:22:02.212853] [DEBUG] [MAIN ] GOOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:02.213758] [INFO ] [MAIN ] GOOS: Generated 1820 derivative records from 46008 primary records. [2025-09-26T22:22:02.212442] [INFO ] [MAIN ] Derivative Progress: 800/2074 symbols completed. GOLF took 1.4s. Estimated remaining: 8m 52s. Rate: 143.6 symbols/min [2025-09-26T22:22:02.214002] [DEBUG] [LOCAL ] GOOS: Saving derivative data. [2025-09-26T22:22:02.214723] [INFO ] [MAIN ] GPC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:02.232007] [DEBUG] [LOCAL ] GOOS: Derivative data saved (1820 records). [2025-09-26T22:22:02.232204] [INFO ] [MAIN ] GOOS: Successfully saved derivative data. [2025-09-26T22:22:02.235008] [INFO ] [MAIN ] Derivative Progress: 801/2074 symbols completed. GOOS took 1.4s. Estimated remaining: 8m 51s. Rate: 143.8 symbols/min [2025-09-26T22:22:02.235422] [INFO ] [MAIN ] GPI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:02.264429] [DEBUG] [LOCAL ] GPI: Loaded 15126 existing records from primary storage. [2025-09-26T22:22:02.264829] [INFO ] [MAIN ] GPI: Loaded 15126 primary data records. [2025-09-26T22:22:02.351519] [DEBUG] [LOCAL ] GOTU: Loaded 39533 existing records from primary storage. [2025-09-26T22:22:02.392911] [INFO ] [MAIN ] GOTU: Loaded 39533 primary data records. [2025-09-26T22:22:02.584280] [DEBUG] [LOCAL ] GPC: Loaded 47289 existing records from primary storage. [2025-09-26T22:22:02.723549] [INFO ] [MAIN ] GPC: Loaded 47289 primary data records. [2025-09-26T22:22:03.305280] [DEBUG] [MAIN ] GPI: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:22:03.314546] [INFO ] [MAIN ] GPI: Generated 1819 derivative records from 15126 primary records. [2025-09-26T22:22:03.319848] [DEBUG] [LOCAL ] GPI: Saving derivative data. [2025-09-26T22:22:03.320149] [DEBUG] [MAIN ] GOTU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:03.322454] [INFO ] [MAIN ] GOTU: Generated 1820 derivative records from 39533 primary records. [2025-09-26T22:22:03.331079] [DEBUG] [LOCAL ] GOTU: Saving derivative data. [2025-09-26T22:22:03.349593] [DEBUG] [LOCAL ] GPI: Derivative data saved (1819 records). [2025-09-26T22:22:03.350697] [INFO ] [MAIN ] GPI: Successfully saved derivative data. [2025-09-26T22:22:03.355937] [INFO ] [MAIN ] Derivative Progress: 802/2074 symbols completed. GPI took 1.1s. Estimated remaining: 8m 52s. Rate: 143.5 symbols/min [2025-09-26T22:22:03.357212] [INFO ] [MAIN ] GPJA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:03.376978] [DEBUG] [MAIN ] GPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:03.381727] [INFO ] [MAIN ] GPC: Generated 1820 derivative records from 47289 primary records. [2025-09-26T22:22:03.382184] [DEBUG] [LOCAL ] GPC: Saving derivative data. [2025-09-26T22:22:03.383943] [DEBUG] [LOCAL ] GOTU: Derivative data saved (1820 records). [2025-09-26T22:22:03.384126] [INFO ] [MAIN ] GOTU: Successfully saved derivative data. [2025-09-26T22:22:03.382559] [DEBUG] [LOCAL ] GPJA: Loaded 4140 existing records from primary storage. [2025-09-26T22:22:03.388111] [INFO ] [MAIN ] GPJA: Loaded 4140 primary data records. [2025-09-26T22:22:03.388017] [INFO ] [MAIN ] Derivative Progress: 803/2074 symbols completed. GOTU took 1.2s. Estimated remaining: 8m 51s. Rate: 143.7 symbols/min [2025-09-26T22:22:03.393718] [INFO ] [MAIN ] GPK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:03.514266] [DEBUG] [LOCAL ] GPC: Derivative data saved (1820 records). [2025-09-26T22:22:03.525307] [INFO ] [MAIN ] GPC: Successfully saved derivative data. [2025-09-26T22:22:03.539776] [INFO ] [MAIN ] Derivative Progress: 804/2074 symbols completed. GPC took 1.3s. Estimated remaining: 8m 50s. Rate: 143.8 symbols/min [2025-09-26T22:22:03.566803] [INFO ] [MAIN ] GPMT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:03.765487] [DEBUG] [LOCAL ] GPMT: Loaded 26788 existing records from primary storage. [2025-09-26T22:22:03.780495] [INFO ] [MAIN ] GPMT: Loaded 26788 primary data records. [2025-09-26T22:22:03.795659] [DEBUG] [LOCAL ] GPK: Loaded 53441 existing records from primary storage. [2025-09-26T22:22:03.818006] [INFO ] [MAIN ] GPK: Loaded 53441 primary data records. [2025-09-26T22:22:03.993414] [DEBUG] [MAIN ] GPJA: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-09-26T22:22:04.011791] [INFO ] [MAIN ] GPJA: Generated 1818 derivative records from 4140 primary records. [2025-09-26T22:22:04.049080] [DEBUG] [LOCAL ] GPJA: Saving derivative data. [2025-09-26T22:22:04.516916] [DEBUG] [LOCAL ] GPJA: Derivative data saved (1818 records). [2025-09-26T22:22:04.517060] [INFO ] [MAIN ] GPJA: Successfully saved derivative data. [2025-09-26T22:22:04.519243] [INFO ] [MAIN ] Derivative Progress: 805/2074 symbols completed. GPJA took 1.2s. Estimated remaining: 8m 50s. Rate: 143.5 symbols/min [2025-09-26T22:22:04.521852] [INFO ] [MAIN ] GPN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:04.565390] [DEBUG] [MAIN ] GPMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:04.571348] [INFO ] [MAIN ] GPMT: Generated 1820 derivative records from 26788 primary records. [2025-09-26T22:22:04.572137] [DEBUG] [MAIN ] GPK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:04.571715] [DEBUG] [LOCAL ] GPMT: Saving derivative data. [2025-09-26T22:22:04.573144] [INFO ] [MAIN ] GPK: Generated 1820 derivative records from 53441 primary records. [2025-09-26T22:22:04.574324] [DEBUG] [LOCAL ] GPK: Saving derivative data. [2025-09-26T22:22:04.619269] [DEBUG] [LOCAL ] GPMT: Derivative data saved (1820 records). [2025-09-26T22:22:04.620057] [INFO ] [MAIN ] GPMT: Successfully saved derivative data. [2025-09-26T22:22:04.623315] [INFO ] [MAIN ] Derivative Progress: 806/2074 symbols completed. GPMT took 1.1s. Estimated remaining: 8m 50s. Rate: 143.7 symbols/min [2025-09-26T22:22:04.623692] [INFO ] [MAIN ] GPOR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:04.644051] [DEBUG] [LOCAL ] GPN: Loaded 52822 existing records from primary storage. [2025-09-26T22:22:04.644840] [INFO ] [MAIN ] GPN: Loaded 52822 primary data records. [2025-09-26T22:22:04.669020] [DEBUG] [LOCAL ] GPK: Derivative data saved (1820 records). [2025-09-26T22:22:04.686353] [INFO ] [MAIN ] GPK: Successfully saved derivative data. [2025-09-26T22:22:04.710524] [INFO ] [MAIN ] Derivative Progress: 807/2074 symbols completed. GPK took 1.3s. Estimated remaining: 8m 49s. Rate: 143.8 symbols/min [2025-09-26T22:22:04.766599] [INFO ] [MAIN ] GPRK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:04.801017] [DEBUG] [LOCAL ] GPOR: Loaded 23328 existing records from primary storage. [2025-09-26T22:22:04.806923] [INFO ] [MAIN ] GPOR: Loaded 23328 primary data records. [2025-09-26T22:22:05.359577] [DEBUG] [LOCAL ] GPRK: Loaded 39841 existing records from primary storage. [2025-09-26T22:22:05.361120] [INFO ] [MAIN ] GPRK: Loaded 39841 primary data records. [2025-09-26T22:22:05.602476] [DEBUG] [MAIN ] GPN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:05.632173] [INFO ] [MAIN ] GPN: Generated 1820 derivative records from 52822 primary records. [2025-09-26T22:22:05.632310] [DEBUG] [LOCAL ] GPN: Saving derivative data. [2025-09-26T22:22:05.789597] [DEBUG] [LOCAL ] GPN: Derivative data saved (1820 records). [2025-09-26T22:22:05.803524] [INFO ] [MAIN ] GPN: Successfully saved derivative data. [2025-09-26T22:22:05.808071] [DEBUG] [MAIN ] GPOR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:05.807135] [INFO ] [MAIN ] Derivative Progress: 808/2074 symbols completed. GPN took 1.3s. Estimated remaining: 8m 49s. Rate: 143.5 symbols/min [2025-09-26T22:22:05.809293] [INFO ] [MAIN ] GPOR: Generated 1820 derivative records from 23328 primary records. [2025-09-26T22:22:05.809674] [DEBUG] [LOCAL ] GPOR: Saving derivative data. [2025-09-26T22:22:05.828520] [DEBUG] [LOCAL ] GPOR: Derivative data saved (1820 records). [2025-09-26T22:22:05.828795] [INFO ] [MAIN ] GPOR: Successfully saved derivative data. [2025-09-26T22:22:05.831853] [INFO ] [MAIN ] Derivative Progress: 809/2074 symbols completed. GPOR took 1.2s. Estimated remaining: 8m 48s. Rate: 143.7 symbols/min [2025-09-26T22:22:05.850167] [DEBUG] [MAIN ] GPRK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:05.850886] [INFO ] [MAIN ] GPRK: Generated 1820 derivative records from 39841 primary records. [2025-09-26T22:22:05.850958] [DEBUG] [LOCAL ] GPRK: Saving derivative data. [2025-09-26T22:22:05.867555] [DEBUG] [LOCAL ] GPRK: Derivative data saved (1820 records). [2025-09-26T22:22:05.867703] [INFO ] [MAIN ] GPRK: Successfully saved derivative data. [2025-09-26T22:22:05.870336] [INFO ] [MAIN ] Derivative Progress: 810/2074 symbols completed. GPRK took 1.1s. Estimated remaining: 8m 47s. Rate: 143.9 symbols/min [2025-09-26T22:22:05.871176] [INFO ] [MAIN ] GRDN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:05.871422] [INFO ] [MAIN ] GRBK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:05.871066] [INFO ] [MAIN ] GRC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:05.889924] [DEBUG] [LOCAL ] GRC: Loaded 9061 existing records from primary storage. [2025-09-26T22:22:05.890205] [INFO ] [MAIN ] GRC: Loaded 9061 primary data records. [2025-09-26T22:22:05.997462] [DEBUG] [LOCAL ] GRDN: Loaded 20178 existing records from primary storage. [2025-09-26T22:22:06.020766] [INFO ] [MAIN ] GRDN: Loaded 20178 primary data records. [2025-09-26T22:22:06.079353] [DEBUG] [LOCAL ] GRBK: Loaded 27375 existing records from primary storage. [2025-09-26T22:22:06.101615] [INFO ] [MAIN ] GRBK: Loaded 27375 primary data records. [2025-09-26T22:22:07.026776] [DEBUG] [MAIN ] GRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:07.027822] [INFO ] [MAIN ] GRC: Generated 1820 derivative records from 9061 primary records. [2025-09-26T22:22:07.028107] [DEBUG] [LOCAL ] GRC: Saving derivative data. [2025-09-26T22:22:07.068273] [DEBUG] [LOCAL ] GRC: Derivative data saved (1820 records). [2025-09-26T22:22:07.069386] [INFO ] [MAIN ] GRC: Successfully saved derivative data. [2025-09-26T22:22:07.072722] [INFO ] [MAIN ] Derivative Progress: 811/2074 symbols completed. GRC took 1.2s. Estimated remaining: 8m 48s. Rate: 143.5 symbols/min [2025-09-26T22:22:07.073962] [INFO ] [MAIN ] GRMN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:07.073414] [DEBUG] [MAIN ] GRDN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:07.075383] [INFO ] [MAIN ] GRDN: Generated 1820 derivative records from 20178 primary records. [2025-09-26T22:22:07.075582] [DEBUG] [LOCAL ] GRDN: Saving derivative data. [2025-09-26T22:22:07.091315] [DEBUG] [MAIN ] GRBK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:07.092299] [INFO ] [MAIN ] GRBK: Generated 1820 derivative records from 27375 primary records. [2025-09-26T22:22:07.092609] [DEBUG] [LOCAL ] GRBK: Saving derivative data. [2025-09-26T22:22:07.124488] [DEBUG] [LOCAL ] GRBK: Derivative data saved (1820 records). [2025-09-26T22:22:07.124993] [INFO ] [MAIN ] GRBK: Successfully saved derivative data. [2025-09-26T22:22:07.128302] [INFO ] [MAIN ] Derivative Progress: 812/2074 symbols completed. GRBK took 1.3s. Estimated remaining: 8m 47s. Rate: 143.7 symbols/min [2025-09-26T22:22:07.128951] [INFO ] [MAIN ] GRND: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:07.133135] [DEBUG] [LOCAL ] GRDN: Derivative data saved (1820 records). [2025-09-26T22:22:07.133308] [INFO ] [MAIN ] GRDN: Successfully saved derivative data. [2025-09-26T22:22:07.136828] [INFO ] [MAIN ] Derivative Progress: 813/2074 symbols completed. GRDN took 1.3s. Estimated remaining: 8m 46s. Rate: 143.8 symbols/min [2025-09-26T22:22:07.137350] [INFO ] [MAIN ] GRNT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:07.181313] [DEBUG] [LOCAL ] GRMN: Loaded 41798 existing records from primary storage. [2025-09-26T22:22:07.189806] [INFO ] [MAIN ] GRMN: Loaded 41798 primary data records. [2025-09-26T22:22:07.336878] [DEBUG] [LOCAL ] GRNT: Loaded 34235 existing records from primary storage. [2025-09-26T22:22:07.351069] [INFO ] [MAIN ] GRNT: Loaded 34235 primary data records. [2025-09-26T22:22:07.377837] [DEBUG] [LOCAL ] GRND: Loaded 50744 existing records from primary storage. [2025-09-26T22:22:07.396210] [INFO ] [MAIN ] GRND: Loaded 50744 primary data records. [2025-09-26T22:22:08.291365] [DEBUG] [MAIN ] GRMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:08.293161] [INFO ] [MAIN ] GRMN: Generated 1820 derivative records from 41798 primary records. [2025-09-26T22:22:08.293503] [DEBUG] [LOCAL ] GRMN: Saving derivative data. [2025-09-26T22:22:08.342303] [DEBUG] [MAIN ] GRNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:08.344331] [INFO ] [MAIN ] GRNT: Generated 1820 derivative records from 34235 primary records. [2025-09-26T22:22:08.345204] [DEBUG] [LOCAL ] GRNT: Saving derivative data. [2025-09-26T22:22:08.345113] [DEBUG] [MAIN ] GRND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:08.348239] [INFO ] [MAIN ] GRND: Generated 1820 derivative records from 50744 primary records. [2025-09-26T22:22:08.346893] [DEBUG] [LOCAL ] GRMN: Derivative data saved (1820 records). [2025-09-26T22:22:08.348406] [DEBUG] [LOCAL ] GRND: Saving derivative data. [2025-09-26T22:22:08.348554] [INFO ] [MAIN ] GRMN: Successfully saved derivative data. [2025-09-26T22:22:08.359135] [INFO ] [MAIN ] Derivative Progress: 814/2074 symbols completed. GRMN took 1.3s. Estimated remaining: 8m 47s. Rate: 143.5 symbols/min [2025-09-26T22:22:08.360676] [INFO ] [MAIN ] GROV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:08.383839] [DEBUG] [LOCAL ] GRND: Derivative data saved (1820 records). [2025-09-26T22:22:08.387509] [INFO ] [MAIN ] GRND: Successfully saved derivative data. [2025-09-26T22:22:08.390572] [INFO ] [MAIN ] Derivative Progress: 815/2074 symbols completed. GRND took 1.3s. Estimated remaining: 8m 46s. Rate: 143.7 symbols/min [2025-09-26T22:22:08.392323] [INFO ] [MAIN ] GRX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:08.391988] [DEBUG] [LOCAL ] GRNT: Derivative data saved (1820 records). [2025-09-26T22:22:08.393109] [INFO ] [MAIN ] GRNT: Successfully saved derivative data. [2025-09-26T22:22:08.395909] [INFO ] [MAIN ] Derivative Progress: 816/2074 symbols completed. GRNT took 1.3s. Estimated remaining: 8m 45s. Rate: 143.8 symbols/min [2025-09-26T22:22:08.396968] [INFO ] [MAIN ] GS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:08.401362] [DEBUG] [LOCAL ] GROV: Loaded 9240 existing records from primary storage. [2025-09-26T22:22:08.402070] [INFO ] [MAIN ] GROV: Loaded 9240 primary data records. [2025-09-26T22:22:08.466076] [DEBUG] [LOCAL ] GRX: Loaded 4547 existing records from primary storage. [2025-09-26T22:22:08.496898] [INFO ] [MAIN ] GRX: Loaded 4547 primary data records. [2025-09-26T22:22:09.134091] [DEBUG] [LOCAL ] GS: Loaded 52736 existing records from primary storage. [2025-09-26T22:22:09.135391] [INFO ] [MAIN ] GS: Loaded 52736 primary data records. [2025-09-26T22:22:09.493009] [DEBUG] [MAIN ] GROV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:09.507266] [INFO ] [MAIN ] GROV: Generated 1820 derivative records from 9240 primary records. [2025-09-26T22:22:09.508168] [DEBUG] [MAIN ] GRX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:09.509274] [INFO ] [MAIN ] GRX: Generated 1820 derivative records from 4547 primary records. [2025-09-26T22:22:09.508393] [DEBUG] [LOCAL ] GROV: Saving derivative data. [2025-09-26T22:22:09.509915] [DEBUG] [LOCAL ] GRX: Saving derivative data. [2025-09-26T22:22:09.540519] [DEBUG] [LOCAL ] GRX: Derivative data saved (1820 records). [2025-09-26T22:22:09.540949] [INFO ] [MAIN ] GRX: Successfully saved derivative data. [2025-09-26T22:22:09.544412] [INFO ] [MAIN ] Derivative Progress: 817/2074 symbols completed. GRX took 1.2s. Estimated remaining: 8m 45s. Rate: 143.5 symbols/min [2025-09-26T22:22:09.545581] [INFO ] [MAIN ] GSBD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:09.552375] [DEBUG] [LOCAL ] GROV: Derivative data saved (1820 records). [2025-09-26T22:22:09.552781] [INFO ] [MAIN ] GROV: Successfully saved derivative data. [2025-09-26T22:22:09.556073] [INFO ] [MAIN ] Derivative Progress: 818/2074 symbols completed. GROV took 1.2s. Estimated remaining: 8m 44s. Rate: 143.7 symbols/min [2025-09-26T22:22:09.557032] [INFO ] [MAIN ] GSK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:09.573721] [DEBUG] [MAIN ] GS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:09.574637] [INFO ] [MAIN ] GS: Generated 1820 derivative records from 52736 primary records. [2025-09-26T22:22:09.574949] [DEBUG] [LOCAL ] GS: Saving derivative data. [2025-09-26T22:22:09.593342] [DEBUG] [LOCAL ] GS: Derivative data saved (1820 records). [2025-09-26T22:22:09.593754] [INFO ] [MAIN ] GS: Successfully saved derivative data. [2025-09-26T22:22:09.596832] [INFO ] [MAIN ] Derivative Progress: 819/2074 symbols completed. GS took 1.2s. Estimated remaining: 8m 43s. Rate: 143.9 symbols/min [2025-09-26T22:22:09.597551] [INFO ] [MAIN ] GSL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:09.646508] [DEBUG] [LOCAL ] GSBD: Loaded 39756 existing records from primary storage. [2025-09-26T22:22:09.646885] [INFO ] [MAIN ] GSBD: Loaded 39756 primary data records. [2025-09-26T22:22:09.761352] [DEBUG] [LOCAL ] GSK: Loaded 54272 existing records from primary storage. [2025-09-26T22:22:09.804028] [INFO ] [MAIN ] GSK: Loaded 54272 primary data records. [2025-09-26T22:22:09.803893] [DEBUG] [LOCAL ] GSL: Loaded 33824 existing records from primary storage. [2025-09-26T22:22:09.804366] [INFO ] [MAIN ] GSL: Loaded 33824 primary data records. [2025-09-26T22:22:10.803127] [DEBUG] [MAIN ] GSBD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:10.806063] [INFO ] [MAIN ] GSBD: Generated 1820 derivative records from 39756 primary records. [2025-09-26T22:22:10.806498] [DEBUG] [LOCAL ] GSBD: Saving derivative data. [2025-09-26T22:22:10.841493] [DEBUG] [MAIN ] GSK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:10.846163] [DEBUG] [LOCAL ] GSBD: Derivative data saved (1820 records). [2025-09-26T22:22:10.846683] [INFO ] [MAIN ] GSBD: Successfully saved derivative data. [2025-09-26T22:22:10.847603] [INFO ] [MAIN ] GSK: Generated 1820 derivative records from 54272 primary records. [2025-09-26T22:22:10.858762] [INFO ] [MAIN ] Derivative Progress: 820/2074 symbols completed. GSBD took 1.3s. Estimated remaining: 8m 44s. Rate: 143.5 symbols/min [2025-09-26T22:22:10.863544] [DEBUG] [LOCAL ] GSK: Saving derivative data. [2025-09-26T22:22:10.865160] [DEBUG] [MAIN ] GSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:10.867344] [INFO ] [MAIN ] GSL: Generated 1820 derivative records from 33824 primary records. [2025-09-26T22:22:10.865755] [INFO ] [MAIN ] GTES: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:10.876170] [DEBUG] [LOCAL ] GSL: Saving derivative data. [2025-09-26T22:22:10.903473] [DEBUG] [LOCAL ] GSK: Derivative data saved (1820 records). [2025-09-26T22:22:10.904282] [INFO ] [MAIN ] GSK: Successfully saved derivative data. [2025-09-26T22:22:10.909567] [INFO ] [MAIN ] Derivative Progress: 821/2074 symbols completed. GSK took 1.4s. Estimated remaining: 8m 43s. Rate: 143.7 symbols/min [2025-09-26T22:22:10.910227] [INFO ] [MAIN ] GTLS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:10.912594] [DEBUG] [LOCAL ] GSL: Derivative data saved (1820 records). [2025-09-26T22:22:10.912696] [INFO ] [MAIN ] GSL: Successfully saved derivative data. [2025-09-26T22:22:10.916862] [INFO ] [MAIN ] Derivative Progress: 822/2074 symbols completed. GSL took 1.3s. Estimated remaining: 8m 42s. Rate: 143.8 symbols/min [2025-09-26T22:22:10.917373] [INFO ] [MAIN ] GTN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:10.973906] [DEBUG] [LOCAL ] GTES: Loaded 51399 existing records from primary storage. [2025-09-26T22:22:10.974458] [INFO ] [MAIN ] GTES: Loaded 51399 primary data records. [2025-09-26T22:22:11.133262] [DEBUG] [LOCAL ] GTLS: Loaded 43461 existing records from primary storage. [2025-09-26T22:22:11.150097] [INFO ] [MAIN ] GTLS: Loaded 43461 primary data records. [2025-09-26T22:22:11.335123] [DEBUG] [LOCAL ] GTN: Loaded 46301 existing records from primary storage. [2025-09-26T22:22:11.349256] [INFO ] [MAIN ] GTN: Loaded 46301 primary data records. [2025-09-26T22:22:12.131010] [DEBUG] [MAIN ] GTES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:12.133165] [INFO ] [MAIN ] GTES: Generated 1820 derivative records from 51399 primary records. [2025-09-26T22:22:12.133302] [DEBUG] [LOCAL ] GTES: Saving derivative data. [2025-09-26T22:22:12.154189] [DEBUG] [LOCAL ] GTES: Derivative data saved (1820 records). [2025-09-26T22:22:12.154632] [INFO ] [MAIN ] GTES: Successfully saved derivative data. [2025-09-26T22:22:12.157182] [INFO ] [MAIN ] Derivative Progress: 823/2074 symbols completed. GTES took 1.3s. Estimated remaining: 8m 43s. Rate: 143.5 symbols/min [2025-09-26T22:22:12.179245] [DEBUG] [MAIN ] GTN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:12.180280] [INFO ] [MAIN ] GTN: Generated 1820 derivative records from 46301 primary records. [2025-09-26T22:22:12.192891] [DEBUG] [LOCAL ] GTN: Saving derivative data. [2025-09-26T22:22:12.194275] [DEBUG] [MAIN ] GTLS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:12.195473] [INFO ] [MAIN ] GTLS: Generated 1820 derivative records from 43461 primary records. [2025-09-26T22:22:12.195605] [DEBUG] [LOCAL ] GTLS: Saving derivative data. [2025-09-26T22:22:12.223845] [DEBUG] [LOCAL ] GTN: Derivative data saved (1820 records). [2025-09-26T22:22:12.224723] [INFO ] [MAIN ] GTN: Successfully saved derivative data. [2025-09-26T22:22:12.227595] [INFO ] [MAIN ] Derivative Progress: 824/2074 symbols completed. GTN took 1.3s. Estimated remaining: 8m 42s. Rate: 143.6 symbols/min [2025-09-26T22:22:12.231862] [DEBUG] [LOCAL ] GTLS: Derivative data saved (1820 records). [2025-09-26T22:22:12.231997] [INFO ] [MAIN ] GTLS: Successfully saved derivative data. [2025-09-26T22:22:12.234784] [INFO ] [MAIN ] Derivative Progress: 825/2074 symbols completed. GTLS took 1.3s. Estimated remaining: 8m 41s. Rate: 143.8 symbols/min [2025-09-26T22:22:12.235452] [INFO ] [MAIN ] GTY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:12.235762] [INFO ] [MAIN ] GUT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:12.235868] [INFO ] [MAIN ] GUG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:12.264709] [DEBUG] [LOCAL ] GUG: Loaded 12138 existing records from primary storage. [2025-09-26T22:22:12.265292] [DEBUG] [LOCAL ] GUT: Loaded 15560 existing records from primary storage. [2025-09-26T22:22:12.273724] [INFO ] [MAIN ] GUT: Loaded 15560 primary data records. [2025-09-26T22:22:12.286091] [INFO ] [MAIN ] GUG: Loaded 12138 primary data records. [2025-09-26T22:22:12.450088] [DEBUG] [LOCAL ] GTY: Loaded 30796 existing records from primary storage. [2025-09-26T22:22:12.475774] [INFO ] [MAIN ] GTY: Loaded 30796 primary data records. [2025-09-26T22:22:13.417255] [DEBUG] [MAIN ] GUT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:13.418936] [INFO ] [MAIN ] GUT: Generated 1820 derivative records from 15560 primary records. [2025-09-26T22:22:13.420303] [DEBUG] [LOCAL ] GUT: Saving derivative data. [2025-09-26T22:22:13.449804] [DEBUG] [LOCAL ] GUT: Derivative data saved (1820 records). [2025-09-26T22:22:13.454512] [INFO ] [MAIN ] GUT: Successfully saved derivative data. [2025-09-26T22:22:13.458068] [INFO ] [MAIN ] Derivative Progress: 826/2074 symbols completed. GUT took 1.2s. Estimated remaining: 8m 42s. Rate: 143.5 symbols/min [2025-09-26T22:22:13.459444] [INFO ] [MAIN ] GVA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:13.459830] [DEBUG] [MAIN ] GUG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:13.461065] [INFO ] [MAIN ] GUG: Generated 1820 derivative records from 12138 primary records. [2025-09-26T22:22:13.462403] [DEBUG] [LOCAL ] GUG: Saving derivative data. [2025-09-26T22:22:13.494307] [DEBUG] [LOCAL ] GUG: Derivative data saved (1820 records). [2025-09-26T22:22:13.494594] [DEBUG] [MAIN ] GTY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:13.494731] [INFO ] [MAIN ] GUG: Successfully saved derivative data. [2025-09-26T22:22:13.497914] [INFO ] [MAIN ] Derivative Progress: 827/2074 symbols completed. GUG took 1.3s. Estimated remaining: 8m 41s. Rate: 143.6 symbols/min [2025-09-26T22:22:13.498819] [INFO ] [MAIN ] GTY: Generated 1820 derivative records from 30796 primary records. [2025-09-26T22:22:13.499178] [DEBUG] [LOCAL ] GTY: Saving derivative data. [2025-09-26T22:22:13.500087] [INFO ] [MAIN ] GWH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:13.523025] [DEBUG] [LOCAL ] GTY: Derivative data saved (1820 records). [2025-09-26T22:22:13.523171] [INFO ] [MAIN ] GTY: Successfully saved derivative data. [2025-09-26T22:22:13.526101] [INFO ] [MAIN ] Derivative Progress: 828/2074 symbols completed. GTY took 1.3s. Estimated remaining: 8m 40s. Rate: 143.8 symbols/min [2025-09-26T22:22:13.526638] [INFO ] [MAIN ] GWRE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:13.534472] [DEBUG] [LOCAL ] GWH: Loaded 15825 existing records from primary storage. [2025-09-26T22:22:13.545371] [INFO ] [MAIN ] GWH: Loaded 15825 primary data records. [2025-09-26T22:22:13.679015] [DEBUG] [LOCAL ] GVA: Loaded 34030 existing records from primary storage. [2025-09-26T22:22:13.690281] [INFO ] [MAIN ] GVA: Loaded 34030 primary data records. [2025-09-26T22:22:14.051469] [DEBUG] [LOCAL ] GWRE: Loaded 41564 existing records from primary storage. [2025-09-26T22:22:14.057743] [INFO ] [MAIN ] GWRE: Loaded 41564 primary data records. [2025-09-26T22:22:14.640334] [DEBUG] [MAIN ] GWH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:14.642446] [INFO ] [MAIN ] GWH: Generated 1820 derivative records from 15825 primary records. [2025-09-26T22:22:14.642694] [DEBUG] [LOCAL ] GWH: Saving derivative data. [2025-09-26T22:22:14.679505] [DEBUG] [LOCAL ] GWH: Derivative data saved (1820 records). [2025-09-26T22:22:14.679625] [INFO ] [MAIN ] GWH: Successfully saved derivative data. [2025-09-26T22:22:14.679415] [DEBUG] [MAIN ] GVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:14.680575] [INFO ] [MAIN ] GVA: Generated 1820 derivative records from 34030 primary records. [2025-09-26T22:22:14.681120] [DEBUG] [LOCAL ] GVA: Saving derivative data. [2025-09-26T22:22:14.683474] [INFO ] [MAIN ] Derivative Progress: 829/2074 symbols completed. GWH took 1.2s. Estimated remaining: 8m 41s. Rate: 143.5 symbols/min [2025-09-26T22:22:14.684809] [INFO ] [MAIN ] GWW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:14.717425] [DEBUG] [MAIN ] GWRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:14.719432] [INFO ] [MAIN ] GWRE: Generated 1820 derivative records from 41564 primary records. [2025-09-26T22:22:14.719636] [DEBUG] [LOCAL ] GWRE: Saving derivative data. [2025-09-26T22:22:14.738920] [DEBUG] [LOCAL ] GVA: Derivative data saved (1820 records). [2025-09-26T22:22:14.746303] [INFO ] [MAIN ] GVA: Successfully saved derivative data. [2025-09-26T22:22:14.747033] [DEBUG] [LOCAL ] GWW: Loaded 20108 existing records from primary storage. [2025-09-26T22:22:14.751347] [INFO ] [MAIN ] Derivative Progress: 830/2074 symbols completed. GVA took 1.3s. Estimated remaining: 8m 40s. Rate: 143.6 symbols/min [2025-09-26T22:22:14.754464] [DEBUG] [LOCAL ] GWRE: Derivative data saved (1820 records). [2025-09-26T22:22:14.748574] [INFO ] [MAIN ] GWW: Loaded 20108 primary data records. [2025-09-26T22:22:14.754629] [INFO ] [MAIN ] GWRE: Successfully saved derivative data. [2025-09-26T22:22:14.754886] [INFO ] [MAIN ] GXO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:14.758008] [INFO ] [MAIN ] Derivative Progress: 831/2074 symbols completed. GWRE took 1.2s. Estimated remaining: 8m 39s. Rate: 143.8 symbols/min [2025-09-26T22:22:14.763688] [INFO ] [MAIN ] GYLD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:14.858915] [DEBUG] [LOCAL ] GYLD: Loaded 1569 existing records from primary storage. [2025-09-26T22:22:14.881530] [INFO ] [MAIN ] GYLD: Loaded 1569 primary data records. [2025-09-26T22:22:15.297045] [DEBUG] [LOCAL ] GXO: Loaded 48260 existing records from primary storage. [2025-09-26T22:22:15.319306] [INFO ] [MAIN ] GXO: Loaded 48260 primary data records. [2025-09-26T22:22:15.874289] [DEBUG] [MAIN ] GWW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:15.875724] [INFO ] [MAIN ] GWW: Generated 1820 derivative records from 20108 primary records. [2025-09-26T22:22:15.875924] [DEBUG] [LOCAL ] GWW: Saving derivative data. [2025-09-26T22:22:15.898564] [DEBUG] [LOCAL ] GWW: Derivative data saved (1820 records). [2025-09-26T22:22:15.906823] [INFO ] [MAIN ] GWW: Successfully saved derivative data. [2025-09-26T22:22:15.914151] [INFO ] [MAIN ] Derivative Progress: 832/2074 symbols completed. GWW took 1.2s. Estimated remaining: 8m 39s. Rate: 143.5 symbols/min [2025-09-26T22:22:15.915245] [DEBUG] [MAIN ] GYLD: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-09-26T22:22:15.914903] [INFO ] [MAIN ] H: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:15.916739] [INFO ] [MAIN ] GYLD: Generated 1818 derivative records from 1569 primary records. [2025-09-26T22:22:15.916870] [DEBUG] [LOCAL ] GYLD: Saving derivative data. [2025-09-26T22:22:15.932477] [DEBUG] [LOCAL ] GYLD: Derivative data saved (1818 records). [2025-09-26T22:22:15.932745] [INFO ] [MAIN ] GYLD: Successfully saved derivative data. [2025-09-26T22:22:15.935500] [INFO ] [MAIN ] Derivative Progress: 833/2074 symbols completed. GYLD took 1.2s. Estimated remaining: 8m 38s. Rate: 143.7 symbols/min [2025-09-26T22:22:15.936194] [INFO ] [MAIN ] HAE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:15.957920] [DEBUG] [MAIN ] GXO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:15.959023] [INFO ] [MAIN ] GXO: Generated 1820 derivative records from 48260 primary records. [2025-09-26T22:22:15.959232] [DEBUG] [LOCAL ] GXO: Saving derivative data. [2025-09-26T22:22:15.978217] [DEBUG] [LOCAL ] GXO: Derivative data saved (1820 records). [2025-09-26T22:22:15.978684] [INFO ] [MAIN ] GXO: Successfully saved derivative data. [2025-09-26T22:22:15.981834] [INFO ] [MAIN ] Derivative Progress: 834/2074 symbols completed. GXO took 1.2s. Estimated remaining: 8m 37s. Rate: 143.8 symbols/min [2025-09-26T22:22:15.992939] [INFO ] [MAIN ] HAFN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:16.019613] [DEBUG] [LOCAL ] HAE: Loaded 40176 existing records from primary storage. [2025-09-26T22:22:16.020613] [INFO ] [MAIN ] HAE: Loaded 40176 primary data records. [2025-09-26T22:22:16.107680] [DEBUG] [LOCAL ] H: Loaded 45492 existing records from primary storage. [2025-09-26T22:22:16.132168] [INFO ] [MAIN ] H: Loaded 45492 primary data records. [2025-09-26T22:22:16.361075] [DEBUG] [LOCAL ] HAFN: Loaded 44189 existing records from primary storage. [2025-09-26T22:22:16.368516] [INFO ] [MAIN ] HAFN: Loaded 44189 primary data records. [2025-09-26T22:22:17.112884] [DEBUG] [MAIN ] HAE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:17.115356] [INFO ] [MAIN ] HAE: Generated 1820 derivative records from 40176 primary records. [2025-09-26T22:22:17.116562] [DEBUG] [LOCAL ] HAE: Saving derivative data. [2025-09-26T22:22:17.144014] [DEBUG] [MAIN ] H: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:17.145735] [INFO ] [MAIN ] H: Generated 1820 derivative records from 45492 primary records. [2025-09-26T22:22:17.150067] [DEBUG] [LOCAL ] H: Saving derivative data. [2025-09-26T22:22:17.161411] [DEBUG] [LOCAL ] HAE: Derivative data saved (1820 records). [2025-09-26T22:22:17.162403] [INFO ] [MAIN ] HAE: Successfully saved derivative data. [2025-09-26T22:22:17.164985] [INFO ] [MAIN ] Derivative Progress: 835/2074 symbols completed. HAE took 1.2s. Estimated remaining: 8m 38s. Rate: 143.5 symbols/min [2025-09-26T22:22:17.171273] [INFO ] [MAIN ] HAL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:17.173290] [DEBUG] [LOCAL ] H: Derivative data saved (1820 records). [2025-09-26T22:22:17.173397] [INFO ] [MAIN ] H: Successfully saved derivative data. [2025-09-26T22:22:17.184560] [INFO ] [MAIN ] Derivative Progress: 836/2074 symbols completed. H took 1.3s. Estimated remaining: 8m 37s. Rate: 143.7 symbols/min [2025-09-26T22:22:17.189497] [INFO ] [MAIN ] HASI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:17.190700] [DEBUG] [MAIN ] HAFN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:17.191609] [INFO ] [MAIN ] HAFN: Generated 1820 derivative records from 44189 primary records. [2025-09-26T22:22:17.191808] [DEBUG] [LOCAL ] HAFN: Saving derivative data. [2025-09-26T22:22:17.208918] [DEBUG] [LOCAL ] HAFN: Derivative data saved (1820 records). [2025-09-26T22:22:17.208985] [INFO ] [MAIN ] HAFN: Successfully saved derivative data. [2025-09-26T22:22:17.211881] [INFO ] [MAIN ] Derivative Progress: 837/2074 symbols completed. HAFN took 1.2s. Estimated remaining: 8m 36s. Rate: 143.8 symbols/min [2025-09-26T22:22:17.212248] [INFO ] [MAIN ] HAYW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:17.263802] [DEBUG] [LOCAL ] HASI: Loaded 47868 existing records from primary storage. [2025-09-26T22:22:17.264190] [INFO ] [MAIN ] HASI: Loaded 47868 primary data records. [2025-09-26T22:22:17.408609] [DEBUG] [LOCAL ] HAL: Loaded 54498 existing records from primary storage. [2025-09-26T22:22:17.422334] [INFO ] [MAIN ] HAL: Loaded 54498 primary data records. [2025-09-26T22:22:17.467790] [DEBUG] [LOCAL ] HAYW: Loaded 49444 existing records from primary storage. [2025-09-26T22:22:17.506268] [INFO ] [MAIN ] HAYW: Loaded 49444 primary data records. [2025-09-26T22:22:18.436706] [DEBUG] [MAIN ] HASI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:18.446244] [INFO ] [MAIN ] HASI: Generated 1820 derivative records from 47868 primary records. [2025-09-26T22:22:18.452271] [DEBUG] [MAIN ] HAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:18.453299] [INFO ] [MAIN ] HAL: Generated 1820 derivative records from 54498 primary records. [2025-09-26T22:22:18.453605] [DEBUG] [LOCAL ] HAL: Saving derivative data. [2025-09-26T22:22:18.454492] [DEBUG] [LOCAL ] HASI: Saving derivative data. [2025-09-26T22:22:18.493681] [DEBUG] [LOCAL ] HAL: Derivative data saved (1820 records). [2025-09-26T22:22:18.490977] [DEBUG] [LOCAL ] HASI: Derivative data saved (1820 records). [2025-09-26T22:22:18.493902] [INFO ] [MAIN ] HAL: Successfully saved derivative data. [2025-09-26T22:22:18.494363] [INFO ] [MAIN ] HASI: Successfully saved derivative data. [2025-09-26T22:22:18.497093] [INFO ] [MAIN ] Derivative Progress: 838/2074 symbols completed. HASI took 1.3s. Estimated remaining: 8m 37s. Rate: 143.5 symbols/min [2025-09-26T22:22:18.516304] [DEBUG] [MAIN ] HAYW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:18.517163] [INFO ] [MAIN ] HAYW: Generated 1820 derivative records from 49444 primary records. [2025-09-26T22:22:18.515996] [INFO ] [MAIN ] Derivative Progress: 839/2074 symbols completed. HAL took 1.3s. Estimated remaining: 8m 36s. Rate: 143.6 symbols/min [2025-09-26T22:22:18.517352] [DEBUG] [LOCAL ] HAYW: Saving derivative data. [2025-09-26T22:22:18.534422] [DEBUG] [LOCAL ] HAYW: Derivative data saved (1820 records). [2025-09-26T22:22:18.534529] [INFO ] [MAIN ] HAYW: Successfully saved derivative data. [2025-09-26T22:22:18.537404] [INFO ] [MAIN ] Derivative Progress: 840/2074 symbols completed. HAYW took 1.3s. Estimated remaining: 8m 35s. Rate: 143.8 symbols/min [2025-09-26T22:22:18.538197] [INFO ] [MAIN ] HBM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:18.538060] [INFO ] [MAIN ] HBB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:18.538358] [INFO ] [MAIN ] HBI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:18.552469] [DEBUG] [LOCAL ] HBB: Loaded 6912 existing records from primary storage. [2025-09-26T22:22:18.552722] [INFO ] [MAIN ] HBB: Loaded 6912 primary data records. [2025-09-26T22:22:19.003416] [DEBUG] [LOCAL ] HBI: Loaded 53769 existing records from primary storage. [2025-09-26T22:22:19.003741] [INFO ] [MAIN ] HBI: Loaded 53769 primary data records. [2025-09-26T22:22:19.010104] [DEBUG] [LOCAL ] HBM: Loaded 53683 existing records from primary storage. [2025-09-26T22:22:19.023881] [INFO ] [MAIN ] HBM: Loaded 53683 primary data records. [2025-09-26T22:22:19.780264] [DEBUG] [MAIN ] HBB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:19.928539] [INFO ] [MAIN ] HBB: Generated 1820 derivative records from 6912 primary records. [2025-09-26T22:22:19.930362] [DEBUG] [LOCAL ] HBB: Saving derivative data. [2025-09-26T22:22:19.955675] [DEBUG] [LOCAL ] HBB: Derivative data saved (1820 records). [2025-09-26T22:22:19.955867] [INFO ] [MAIN ] HBB: Successfully saved derivative data. [2025-09-26T22:22:19.960225] [INFO ] [MAIN ] Derivative Progress: 841/2074 symbols completed. HBB took 1.4s. Estimated remaining: 8m 36s. Rate: 143.4 symbols/min [2025-09-26T22:22:19.962966] [INFO ] [MAIN ] HCA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:19.982784] [DEBUG] [MAIN ] HBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:19.983824] [INFO ] [MAIN ] HBI: Generated 1820 derivative records from 53769 primary records. [2025-09-26T22:22:19.984100] [DEBUG] [LOCAL ] HBI: Saving derivative data. [2025-09-26T22:22:20.005066] [DEBUG] [LOCAL ] HBI: Derivative data saved (1820 records). [2025-09-26T22:22:20.012920] [INFO ] [MAIN ] HBI: Successfully saved derivative data. [2025-09-26T22:22:20.016184] [INFO ] [MAIN ] Derivative Progress: 842/2074 symbols completed. HBI took 1.5s. Estimated remaining: 8m 35s. Rate: 143.5 symbols/min [2025-09-26T22:22:20.024765] [INFO ] [MAIN ] HCC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:20.030598] [DEBUG] [MAIN ] HBM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:20.032107] [INFO ] [MAIN ] HBM: Generated 1820 derivative records from 53683 primary records. [2025-09-26T22:22:20.032357] [DEBUG] [LOCAL ] HBM: Saving derivative data. [2025-09-26T22:22:20.064759] [DEBUG] [LOCAL ] HBM: Derivative data saved (1820 records). [2025-09-26T22:22:20.064933] [INFO ] [MAIN ] HBM: Successfully saved derivative data. [2025-09-26T22:22:20.068024] [INFO ] [MAIN ] Derivative Progress: 843/2074 symbols completed. HBM took 1.5s. Estimated remaining: 8m 34s. Rate: 143.7 symbols/min [2025-09-26T22:22:20.068708] [INFO ] [MAIN ] HCI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:20.095479] [DEBUG] [LOCAL ] HCA: Loaded 47781 existing records from primary storage. [2025-09-26T22:22:20.095786] [INFO ] [MAIN ] HCA: Loaded 47781 primary data records. [2025-09-26T22:22:20.168317] [DEBUG] [LOCAL ] HCI: Loaded 14126 existing records from primary storage. [2025-09-26T22:22:20.182996] [INFO ] [MAIN ] HCI: Loaded 14126 primary data records. [2025-09-26T22:22:20.324401] [DEBUG] [LOCAL ] HCC: Loaded 46057 existing records from primary storage. [2025-09-26T22:22:20.436554] [INFO ] [MAIN ] HCC: Loaded 46057 primary data records. [2025-09-26T22:22:21.166619] [DEBUG] [MAIN ] HCA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:21.167747] [INFO ] [MAIN ] HCA: Generated 1820 derivative records from 47781 primary records. [2025-09-26T22:22:21.168071] [DEBUG] [LOCAL ] HCA: Saving derivative data. [2025-09-26T22:22:21.202342] [DEBUG] [MAIN ] HCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:21.204612] [INFO ] [MAIN ] HCI: Generated 1820 derivative records from 14126 primary records. [2025-09-26T22:22:21.205676] [DEBUG] [LOCAL ] HCI: Saving derivative data. [2025-09-26T22:22:21.222202] [DEBUG] [LOCAL ] HCA: Derivative data saved (1820 records). [2025-09-26T22:22:21.223111] [INFO ] [MAIN ] HCA: Successfully saved derivative data. [2025-09-26T22:22:21.225949] [INFO ] [MAIN ] Derivative Progress: 844/2074 symbols completed. HCA took 1.3s. Estimated remaining: 8m 35s. Rate: 143.4 symbols/min [2025-09-26T22:22:21.226417] [INFO ] [MAIN ] HD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:21.249028] [DEBUG] [MAIN ] HCC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:21.248511] [DEBUG] [LOCAL ] HCI: Derivative data saved (1820 records). [2025-09-26T22:22:21.250064] [INFO ] [MAIN ] HCI: Successfully saved derivative data. [2025-09-26T22:22:21.249976] [INFO ] [MAIN ] HCC: Generated 1820 derivative records from 46057 primary records. [2025-09-26T22:22:21.250197] [DEBUG] [LOCAL ] HCC: Saving derivative data. [2025-09-26T22:22:21.254021] [INFO ] [MAIN ] Derivative Progress: 845/2074 symbols completed. HCI took 1.2s. Estimated remaining: 8m 34s. Rate: 143.5 symbols/min [2025-09-26T22:22:21.254378] [INFO ] [MAIN ] HDB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:21.274633] [DEBUG] [LOCAL ] HCC: Derivative data saved (1820 records). [2025-09-26T22:22:21.274845] [INFO ] [MAIN ] HCC: Successfully saved derivative data. [2025-09-26T22:22:21.278265] [INFO ] [MAIN ] Derivative Progress: 846/2074 symbols completed. HCC took 1.3s. Estimated remaining: 8m 33s. Rate: 143.7 symbols/min [2025-09-26T22:22:21.278790] [INFO ] [MAIN ] HE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:21.352480] [DEBUG] [LOCAL ] HD: Loaded 54283 existing records from primary storage. [2025-09-26T22:22:21.353263] [INFO ] [MAIN ] HD: Loaded 54283 primary data records. [2025-09-26T22:22:21.455117] [DEBUG] [LOCAL ] HDB: Loaded 52695 existing records from primary storage. [2025-09-26T22:22:21.486547] [INFO ] [MAIN ] HDB: Loaded 52695 primary data records. [2025-09-26T22:22:21.631218] [DEBUG] [LOCAL ] HE: Loaded 49870 existing records from primary storage. [2025-09-26T22:22:21.649679] [INFO ] [MAIN ] HE: Loaded 49870 primary data records. [2025-09-26T22:22:22.491160] [DEBUG] [MAIN ] HD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:22.491373] [DEBUG] [MAIN ] HDB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:22.492880] [INFO ] [MAIN ] HDB: Generated 1820 derivative records from 52695 primary records. [2025-09-26T22:22:22.493617] [INFO ] [MAIN ] HD: Generated 1820 derivative records from 54283 primary records. [2025-09-26T22:22:22.493867] [DEBUG] [LOCAL ] HD: Saving derivative data. [2025-09-26T22:22:22.495146] [DEBUG] [LOCAL ] HDB: Saving derivative data. [2025-09-26T22:22:22.540417] [DEBUG] [MAIN ] HE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:22.542945] [INFO ] [MAIN ] HE: Generated 1820 derivative records from 49870 primary records. [2025-09-26T22:22:22.543555] [DEBUG] [LOCAL ] HE: Saving derivative data. [2025-09-26T22:22:22.561525] [DEBUG] [LOCAL ] HD: Derivative data saved (1820 records). [2025-09-26T22:22:22.561607] [DEBUG] [LOCAL ] HDB: Derivative data saved (1820 records). [2025-09-26T22:22:22.561798] [INFO ] [MAIN ] HD: Successfully saved derivative data. [2025-09-26T22:22:22.563850] [INFO ] [MAIN ] Derivative Progress: 847/2074 symbols completed. HD took 1.3s. Estimated remaining: 8m 34s. Rate: 143.3 symbols/min [2025-09-26T22:22:22.564454] [INFO ] [MAIN ] HDB: Successfully saved derivative data. [2025-09-26T22:22:22.566934] [DEBUG] [LOCAL ] HE: Derivative data saved (1820 records). [2025-09-26T22:22:22.570338] [INFO ] [MAIN ] Derivative Progress: 848/2074 symbols completed. HDB took 1.3s. Estimated remaining: 8m 33s. Rate: 143.5 symbols/min [2025-09-26T22:22:22.570460] [INFO ] [MAIN ] HE: Successfully saved derivative data. [2025-09-26T22:22:22.573706] [INFO ] [MAIN ] Derivative Progress: 849/2074 symbols completed. HE took 1.3s. Estimated remaining: 8m 32s. Rate: 143.7 symbols/min [2025-09-26T22:22:22.570240] [INFO ] [MAIN ] HEI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:22.573823] [INFO ] [MAIN ] HEQ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:22.574080] [INFO ] [MAIN ] HESM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:22.583814] [DEBUG] [LOCAL ] HEQ: Loaded 6236 existing records from primary storage. [2025-09-26T22:22:22.583938] [INFO ] [MAIN ] HEQ: Loaded 6236 primary data records. [2025-09-26T22:22:22.940739] [DEBUG] [LOCAL ] HEI: Loaded 32846 existing records from primary storage. [2025-09-26T22:22:22.957586] [INFO ] [MAIN ] HEI: Loaded 32846 primary data records. [2025-09-26T22:22:22.964070] [DEBUG] [LOCAL ] HESM: Loaded 48879 existing records from primary storage. [2025-09-26T22:22:22.984519] [INFO ] [MAIN ] HESM: Loaded 48879 primary data records. [2025-09-26T22:22:23.687713] [DEBUG] [MAIN ] HEQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:23.688879] [INFO ] [MAIN ] HEQ: Generated 1820 derivative records from 6236 primary records. [2025-09-26T22:22:23.689434] [DEBUG] [LOCAL ] HEQ: Saving derivative data. [2025-09-26T22:22:23.712341] [DEBUG] [LOCAL ] HEQ: Derivative data saved (1820 records). [2025-09-26T22:22:23.712928] [INFO ] [MAIN ] HEQ: Successfully saved derivative data. [2025-09-26T22:22:23.715607] [INFO ] [MAIN ] Derivative Progress: 850/2074 symbols completed. HEQ took 1.1s. Estimated remaining: 8m 32s. Rate: 143.4 symbols/min [2025-09-26T22:22:23.718364] [INFO ] [MAIN ] HFRO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:23.750111] [DEBUG] [MAIN ] HESM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:23.751463] [INFO ] [MAIN ] HESM: Generated 1820 derivative records from 48879 primary records. [2025-09-26T22:22:23.750480] [DEBUG] [MAIN ] HEI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:23.751784] [DEBUG] [LOCAL ] HESM: Saving derivative data. [2025-09-26T22:22:23.752717] [INFO ] [MAIN ] HEI: Generated 1820 derivative records from 32846 primary records. [2025-09-26T22:22:23.753758] [DEBUG] [LOCAL ] HEI: Saving derivative data. [2025-09-26T22:22:23.796566] [DEBUG] [LOCAL ] HFRO: Loaded 17798 existing records from primary storage. [2025-09-26T22:22:23.796980] [INFO ] [MAIN ] HFRO: Loaded 17798 primary data records. [2025-09-26T22:22:23.796199] [DEBUG] [LOCAL ] HEI: Derivative data saved (1820 records). [2025-09-26T22:22:23.799171] [INFO ] [MAIN ] HEI: Successfully saved derivative data. [2025-09-26T22:22:23.807209] [INFO ] [MAIN ] Derivative Progress: 851/2074 symbols completed. HEI took 1.2s. Estimated remaining: 8m 31s. Rate: 143.5 symbols/min [2025-09-26T22:22:23.814572] [INFO ] [MAIN ] HGER: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:23.814471] [DEBUG] [LOCAL ] HESM: Derivative data saved (1820 records). [2025-09-26T22:22:23.842341] [INFO ] [MAIN ] HESM: Successfully saved derivative data. [2025-09-26T22:22:23.858817] [INFO ] [MAIN ] Derivative Progress: 852/2074 symbols completed. HESM took 1.3s. Estimated remaining: 8m 30s. Rate: 143.7 symbols/min [2025-09-26T22:22:23.882213] [INFO ] [MAIN ] HGLB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:23.940936] [DEBUG] [LOCAL ] HGER: Loaded 13428 existing records from primary storage. [2025-09-26T22:22:23.956542] [INFO ] [MAIN ] HGER: Loaded 13428 primary data records. [2025-09-26T22:22:24.193225] [DEBUG] [LOCAL ] HGLB: Loaded 9836 existing records from primary storage. [2025-09-26T22:22:24.229294] [INFO ] [MAIN ] HGLB: Loaded 9836 primary data records. [2025-09-26T22:22:24.895938] [DEBUG] [MAIN ] HFRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:24.897375] [INFO ] [MAIN ] HFRO: Generated 1820 derivative records from 17798 primary records. [2025-09-26T22:22:24.897852] [DEBUG] [LOCAL ] HFRO: Saving derivative data. [2025-09-26T22:22:24.937067] [DEBUG] [LOCAL ] HFRO: Derivative data saved (1820 records). [2025-09-26T22:22:24.938132] [DEBUG] [MAIN ] HGER: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:24.939192] [INFO ] [MAIN ] HGER: Generated 1820 derivative records from 13428 primary records. [2025-09-26T22:22:24.939302] [INFO ] [MAIN ] HFRO: Successfully saved derivative data. [2025-09-26T22:22:24.949666] [DEBUG] [LOCAL ] HGER: Saving derivative data. [2025-09-26T22:22:24.941797] [INFO ] [MAIN ] Derivative Progress: 853/2074 symbols completed. HFRO took 1.2s. Estimated remaining: 8m 31s. Rate: 143.4 symbols/min [2025-09-26T22:22:24.956203] [DEBUG] [MAIN ] HGLB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:24.957458] [INFO ] [MAIN ] HGLB: Generated 1820 derivative records from 9836 primary records. [2025-09-26T22:22:24.957850] [DEBUG] [LOCAL ] HGLB: Saving derivative data. [2025-09-26T22:22:24.986373] [DEBUG] [LOCAL ] HGER: Derivative data saved (1820 records). [2025-09-26T22:22:24.990131] [INFO ] [MAIN ] HGER: Successfully saved derivative data. [2025-09-26T22:22:24.993261] [INFO ] [MAIN ] Derivative Progress: 854/2074 symbols completed. HGER took 1.2s. Estimated remaining: 8m 30s. Rate: 143.5 symbols/min [2025-09-26T22:22:24.994434] [DEBUG] [LOCAL ] HGLB: Derivative data saved (1820 records). [2025-09-26T22:22:24.994697] [INFO ] [MAIN ] HGLB: Successfully saved derivative data. [2025-09-26T22:22:24.997962] [INFO ] [MAIN ] Derivative Progress: 855/2074 symbols completed. HGLB took 1.1s. Estimated remaining: 8m 29s. Rate: 143.7 symbols/min [2025-09-26T22:22:24.998712] [INFO ] [MAIN ] HHH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:24.998837] [INFO ] [MAIN ] HGV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:24.998632] [INFO ] [MAIN ] HGTY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:25.016411] [DEBUG] [LOCAL ] HGTY: Loaded 13290 existing records from primary storage. [2025-09-26T22:22:25.016669] [INFO ] [MAIN ] HGTY: Loaded 13290 primary data records. [2025-09-26T22:22:25.200192] [DEBUG] [LOCAL ] HHH: Loaded 33042 existing records from primary storage. [2025-09-26T22:22:25.376677] [INFO ] [MAIN ] HHH: Loaded 33042 primary data records. [2025-09-26T22:22:25.404562] [DEBUG] [LOCAL ] HGV: Loaded 47426 existing records from primary storage. [2025-09-26T22:22:25.427374] [INFO ] [MAIN ] HGV: Loaded 47426 primary data records. [2025-09-26T22:22:26.118207] [DEBUG] [MAIN ] HGTY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:26.120260] [INFO ] [MAIN ] HGTY: Generated 1820 derivative records from 13290 primary records. [2025-09-26T22:22:26.120697] [DEBUG] [LOCAL ] HGTY: Saving derivative data. [2025-09-26T22:22:26.146590] [DEBUG] [LOCAL ] HGTY: Derivative data saved (1820 records). [2025-09-26T22:22:26.148136] [INFO ] [MAIN ] HGTY: Successfully saved derivative data. [2025-09-26T22:22:26.150891] [INFO ] [MAIN ] Derivative Progress: 856/2074 symbols completed. HGTY took 1.2s. Estimated remaining: 8m 30s. Rate: 143.4 symbols/min [2025-09-26T22:22:26.151430] [INFO ] [MAIN ] HI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:26.168615] [DEBUG] [MAIN ] HHH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:26.170386] [INFO ] [MAIN ] HHH: Generated 1820 derivative records from 33042 primary records. [2025-09-26T22:22:26.184202] [DEBUG] [LOCAL ] HHH: Saving derivative data. [2025-09-26T22:22:26.185269] [DEBUG] [MAIN ] HGV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:26.186551] [INFO ] [MAIN ] HGV: Generated 1820 derivative records from 47426 primary records. [2025-09-26T22:22:26.186765] [DEBUG] [LOCAL ] HGV: Saving derivative data. [2025-09-26T22:22:26.216997] [DEBUG] [LOCAL ] HHH: Derivative data saved (1820 records). [2025-09-26T22:22:26.225984] [INFO ] [MAIN ] HHH: Successfully saved derivative data. [2025-09-26T22:22:26.229732] [INFO ] [MAIN ] Derivative Progress: 857/2074 symbols completed. HHH took 1.2s. Estimated remaining: 8m 29s. Rate: 143.6 symbols/min [2025-09-26T22:22:26.230742] [INFO ] [MAIN ] HIG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:26.234343] [DEBUG] [LOCAL ] HGV: Derivative data saved (1820 records). [2025-09-26T22:22:26.243812] [INFO ] [MAIN ] HGV: Successfully saved derivative data. [2025-09-26T22:22:26.248206] [INFO ] [MAIN ] Derivative Progress: 858/2074 symbols completed. HGV took 1.2s. Estimated remaining: 8m 28s. Rate: 143.7 symbols/min [2025-09-26T22:22:26.249060] [DEBUG] [LOCAL ] HI: Loaded 35713 existing records from primary storage. [2025-09-26T22:22:26.249492] [INFO ] [MAIN ] HII: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:26.249702] [INFO ] [MAIN ] HI: Loaded 35713 primary data records. [2025-09-26T22:22:26.691775] [DEBUG] [LOCAL ] HIG: Loaded 51962 existing records from primary storage. [2025-09-26T22:22:26.692918] [INFO ] [MAIN ] HIG: Loaded 51962 primary data records. [2025-09-26T22:22:26.692703] [DEBUG] [LOCAL ] HII: Loaded 35728 existing records from primary storage. [2025-09-26T22:22:26.694924] [INFO ] [MAIN ] HII: Loaded 35728 primary data records. [2025-09-26T22:22:27.391775] [DEBUG] [MAIN ] HI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:27.392835] [INFO ] [MAIN ] HI: Generated 1820 derivative records from 35713 primary records. [2025-09-26T22:22:27.393076] [DEBUG] [LOCAL ] HI: Saving derivative data. [2025-09-26T22:22:27.416220] [DEBUG] [LOCAL ] HI: Derivative data saved (1820 records). [2025-09-26T22:22:27.416973] [INFO ] [MAIN ] HI: Successfully saved derivative data. [2025-09-26T22:22:27.419879] [INFO ] [MAIN ] Derivative Progress: 859/2074 symbols completed. HI took 1.3s. Estimated remaining: 8m 28s. Rate: 143.4 symbols/min [2025-09-26T22:22:27.423698] [INFO ] [MAIN ] HIMS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:27.439750] [DEBUG] [MAIN ] HIG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:27.442407] [INFO ] [MAIN ] HIG: Generated 1820 derivative records from 51962 primary records. [2025-09-26T22:22:27.442743] [DEBUG] [LOCAL ] HIG: Saving derivative data. [2025-09-26T22:22:27.471106] [DEBUG] [MAIN ] HII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:27.472993] [INFO ] [MAIN ] HII: Generated 1820 derivative records from 35728 primary records. [2025-09-26T22:22:27.473157] [DEBUG] [LOCAL ] HII: Saving derivative data. [2025-09-26T22:22:27.475745] [DEBUG] [LOCAL ] HIG: Derivative data saved (1820 records). [2025-09-26T22:22:27.476253] [INFO ] [MAIN ] HIG: Successfully saved derivative data. [2025-09-26T22:22:27.478751] [INFO ] [MAIN ] Derivative Progress: 860/2074 symbols completed. HIG took 1.2s. Estimated remaining: 8m 27s. Rate: 143.6 symbols/min [2025-09-26T22:22:27.479247] [INFO ] [MAIN ] HIO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:27.497566] [DEBUG] [LOCAL ] HII: Derivative data saved (1820 records). [2025-09-26T22:22:27.497756] [INFO ] [MAIN ] HII: Successfully saved derivative data. [2025-09-26T22:22:27.501943] [INFO ] [MAIN ] Derivative Progress: 861/2074 symbols completed. HII took 1.3s. Estimated remaining: 8m 26s. Rate: 143.7 symbols/min [2025-09-26T22:22:27.502347] [INFO ] [MAIN ] HIPO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:27.538686] [DEBUG] [LOCAL ] HIO: Loaded 24107 existing records from primary storage. [2025-09-26T22:22:27.538924] [INFO ] [MAIN ] HIO: Loaded 24107 primary data records. [2025-09-26T22:22:27.674510] [DEBUG] [LOCAL ] HIMS: Loaded 54597 existing records from primary storage. [2025-09-26T22:22:27.688060] [INFO ] [MAIN ] HIMS: Loaded 54597 primary data records. [2025-09-26T22:22:27.687936] [DEBUG] [LOCAL ] HIPO: Loaded 22774 existing records from primary storage. [2025-09-26T22:22:27.688224] [INFO ] [MAIN ] HIPO: Loaded 22774 primary data records. [2025-09-26T22:22:28.615000] [DEBUG] [MAIN ] HIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:28.617261] [INFO ] [MAIN ] HIO: Generated 1820 derivative records from 24107 primary records. [2025-09-26T22:22:28.619696] [DEBUG] [LOCAL ] HIO: Saving derivative data. [2025-09-26T22:22:28.635224] [DEBUG] [MAIN ] HIMS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:28.648151] [INFO ] [MAIN ] HIMS: Generated 1820 derivative records from 54597 primary records. [2025-09-26T22:22:28.650592] [DEBUG] [LOCAL ] HIMS: Saving derivative data. [2025-09-26T22:22:28.664466] [DEBUG] [LOCAL ] HIO: Derivative data saved (1820 records). [2025-09-26T22:22:28.667464] [INFO ] [MAIN ] HIO: Successfully saved derivative data. [2025-09-26T22:22:28.673073] [INFO ] [MAIN ] Derivative Progress: 862/2074 symbols completed. HIO took 1.2s. Estimated remaining: 8m 27s. Rate: 143.4 symbols/min [2025-09-26T22:22:28.677327] [INFO ] [MAIN ] HIW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:28.677125] [DEBUG] [LOCAL ] HIMS: Derivative data saved (1820 records). [2025-09-26T22:22:28.678022] [INFO ] [MAIN ] HIMS: Successfully saved derivative data. [2025-09-26T22:22:28.681318] [INFO ] [MAIN ] Derivative Progress: 863/2074 symbols completed. HIMS took 1.3s. Estimated remaining: 8m 26s. Rate: 143.6 symbols/min [2025-09-26T22:22:28.681602] [INFO ] [MAIN ] HIX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:28.695946] [DEBUG] [MAIN ] HIPO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:28.696720] [INFO ] [MAIN ] HIPO: Generated 1820 derivative records from 22774 primary records. [2025-09-26T22:22:28.696997] [DEBUG] [LOCAL ] HIPO: Saving derivative data. [2025-09-26T22:22:28.715711] [DEBUG] [LOCAL ] HIPO: Derivative data saved (1820 records). [2025-09-26T22:22:28.720713] [INFO ] [MAIN ] HIPO: Successfully saved derivative data. [2025-09-26T22:22:28.723610] [INFO ] [MAIN ] Derivative Progress: 864/2074 symbols completed. HIPO took 1.2s. Estimated remaining: 8m 25s. Rate: 143.7 symbols/min [2025-09-26T22:22:28.724113] [INFO ] [MAIN ] HKD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:28.734973] [DEBUG] [LOCAL ] HIX: Loaded 20714 existing records from primary storage. [2025-09-26T22:22:28.735194] [INFO ] [MAIN ] HIX: Loaded 20714 primary data records. [2025-09-26T22:22:28.869213] [DEBUG] [LOCAL ] HKD: Loaded 18654 existing records from primary storage. [2025-09-26T22:22:28.914107] [DEBUG] [LOCAL ] HIW: Loaded 45329 existing records from primary storage. [2025-09-26T22:22:28.930286] [INFO ] [MAIN ] HIW: Loaded 45329 primary data records. [2025-09-26T22:22:28.930421] [INFO ] [MAIN ] HKD: Loaded 18654 primary data records. [2025-09-26T22:22:29.923296] [DEBUG] [MAIN ] HIX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:29.926049] [INFO ] [MAIN ] HIX: Generated 1820 derivative records from 20714 primary records. [2025-09-26T22:22:29.927478] [DEBUG] [LOCAL ] HIX: Saving derivative data. [2025-09-26T22:22:29.951332] [DEBUG] [MAIN ] HKD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:29.967217] [INFO ] [MAIN ] HKD: Generated 1820 derivative records from 18654 primary records. [2025-09-26T22:22:29.975294] [DEBUG] [LOCAL ] HKD: Saving derivative data. [2025-09-26T22:22:29.975108] [DEBUG] [LOCAL ] HIX: Derivative data saved (1820 records). [2025-09-26T22:22:29.976390] [DEBUG] [MAIN ] HIW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:29.977040] [INFO ] [MAIN ] HIX: Successfully saved derivative data. [2025-09-26T22:22:29.977909] [INFO ] [MAIN ] HIW: Generated 1820 derivative records from 45329 primary records. [2025-09-26T22:22:29.980116] [INFO ] [MAIN ] Derivative Progress: 865/2074 symbols completed. HIX took 1.3s. Estimated remaining: 8m 26s. Rate: 143.4 symbols/min [2025-09-26T22:22:29.980249] [DEBUG] [LOCAL ] HIW: Saving derivative data. [2025-09-26T22:22:29.980543] [INFO ] [MAIN ] HL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:30.011909] [DEBUG] [LOCAL ] HIW: Derivative data saved (1820 records). [2025-09-26T22:22:30.012462] [INFO ] [MAIN ] HIW: Successfully saved derivative data. [2025-09-26T22:22:30.015544] [INFO ] [MAIN ] Derivative Progress: 866/2074 symbols completed. HIW took 1.3s. Estimated remaining: 8m 25s. Rate: 143.5 symbols/min [2025-09-26T22:22:30.017242] [INFO ] [MAIN ] HLF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:30.021214] [DEBUG] [LOCAL ] HKD: Derivative data saved (1820 records). [2025-09-26T22:22:30.021527] [INFO ] [MAIN ] HKD: Successfully saved derivative data. [2025-09-26T22:22:30.024863] [INFO ] [MAIN ] Derivative Progress: 867/2074 symbols completed. HKD took 1.3s. Estimated remaining: 8m 24s. Rate: 143.7 symbols/min [2025-09-26T22:22:30.025218] [INFO ] [MAIN ] HLI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:30.114348] [DEBUG] [LOCAL ] HLI: Loaded 31573 existing records from primary storage. [2025-09-26T22:22:30.112353] [DEBUG] [LOCAL ] HLF: Loaded 49357 existing records from primary storage. [2025-09-26T22:22:30.114701] [INFO ] [MAIN ] HLI: Loaded 31573 primary data records. [2025-09-26T22:22:30.114941] [INFO ] [MAIN ] HLF: Loaded 49357 primary data records. [2025-09-26T22:22:30.138547] [DEBUG] [LOCAL ] HL: Loaded 54451 existing records from primary storage. [2025-09-26T22:22:30.203554] [INFO ] [MAIN ] HL: Loaded 54451 primary data records. [2025-09-26T22:22:31.242262] [DEBUG] [MAIN ] HLI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:31.256736] [INFO ] [MAIN ] HLI: Generated 1820 derivative records from 31573 primary records. [2025-09-26T22:22:31.257601] [DEBUG] [LOCAL ] HLI: Saving derivative data. [2025-09-26T22:22:31.257496] [DEBUG] [MAIN ] HLF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:31.259737] [INFO ] [MAIN ] HLF: Generated 1820 derivative records from 49357 primary records. [2025-09-26T22:22:31.260233] [DEBUG] [LOCAL ] HLF: Saving derivative data. [2025-09-26T22:22:31.295464] [DEBUG] [MAIN ] HL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:31.301429] [INFO ] [MAIN ] HL: Generated 1820 derivative records from 54451 primary records. [2025-09-26T22:22:31.301883] [DEBUG] [LOCAL ] HL: Saving derivative data. [2025-09-26T22:22:31.323832] [DEBUG] [LOCAL ] HLI: Derivative data saved (1820 records). [2025-09-26T22:22:31.324887] [INFO ] [MAIN ] HLI: Successfully saved derivative data. [2025-09-26T22:22:31.331818] [INFO ] [MAIN ] Derivative Progress: 868/2074 symbols completed. HLI took 1.3s. Estimated remaining: 8m 25s. Rate: 143.4 symbols/min [2025-09-26T22:22:31.326203] [DEBUG] [LOCAL ] HLF: Derivative data saved (1820 records). [2025-09-26T22:22:31.329680] [DEBUG] [LOCAL ] HL: Derivative data saved (1820 records). [2025-09-26T22:22:31.332171] [INFO ] [MAIN ] HLF: Successfully saved derivative data. [2025-09-26T22:22:31.332105] [INFO ] [MAIN ] HL: Successfully saved derivative data. [2025-09-26T22:22:31.336021] [INFO ] [MAIN ] Derivative Progress: 869/2074 symbols completed. HLF took 1.3s. Estimated remaining: 8m 24s. Rate: 143.5 symbols/min [2025-09-26T22:22:31.339489] [INFO ] [MAIN ] Derivative Progress: 870/2074 symbols completed. HL took 1.4s. Estimated remaining: 8m 23s. Rate: 143.7 symbols/min [2025-09-26T22:22:31.340118] [INFO ] [MAIN ] HLIO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:31.340301] [INFO ] [MAIN ] HLLY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:31.341071] [INFO ] [MAIN ] HLN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:31.379599] [DEBUG] [LOCAL ] HLIO: Loaded 28490 existing records from primary storage. [2025-09-26T22:22:31.379865] [INFO ] [MAIN ] HLIO: Loaded 28490 primary data records. [2025-09-26T22:22:31.520232] [DEBUG] [LOCAL ] HLLY: Loaded 33911 existing records from primary storage. [2025-09-26T22:22:31.533448] [INFO ] [MAIN ] HLLY: Loaded 33911 primary data records. [2025-09-26T22:22:31.731867] [DEBUG] [LOCAL ] HLN: Loaded 53861 existing records from primary storage. [2025-09-26T22:22:31.885583] [INFO ] [MAIN ] HLN: Loaded 53861 primary data records. [2025-09-26T22:22:32.462702] [DEBUG] [MAIN ] HLIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:32.464193] [INFO ] [MAIN ] HLIO: Generated 1820 derivative records from 28490 primary records. [2025-09-26T22:22:32.464518] [DEBUG] [LOCAL ] HLIO: Saving derivative data. [2025-09-26T22:22:32.486346] [DEBUG] [LOCAL ] HLIO: Derivative data saved (1820 records). [2025-09-26T22:22:32.487194] [INFO ] [MAIN ] HLIO: Successfully saved derivative data. [2025-09-26T22:22:32.489478] [INFO ] [MAIN ] Derivative Progress: 871/2074 symbols completed. HLIO took 1.1s. Estimated remaining: 8m 23s. Rate: 143.4 symbols/min [2025-09-26T22:22:32.490047] [INFO ] [MAIN ] HLT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:32.506713] [DEBUG] [MAIN ] HLLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:32.508058] [INFO ] [MAIN ] HLLY: Generated 1820 derivative records from 33911 primary records. [2025-09-26T22:22:32.508192] [DEBUG] [LOCAL ] HLLY: Saving derivative data. [2025-09-26T22:22:32.551606] [DEBUG] [MAIN ] HLN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:32.553772] [INFO ] [MAIN ] HLN: Generated 1820 derivative records from 53861 primary records. [2025-09-26T22:22:32.554197] [DEBUG] [LOCAL ] HLN: Saving derivative data. [2025-09-26T22:22:32.573760] [DEBUG] [LOCAL ] HLLY: Derivative data saved (1820 records). [2025-09-26T22:22:32.575589] [INFO ] [MAIN ] HLLY: Successfully saved derivative data. [2025-09-26T22:22:32.581225] [INFO ] [MAIN ] Derivative Progress: 872/2074 symbols completed. HLLY took 1.2s. Estimated remaining: 8m 23s. Rate: 143.5 symbols/min [2025-09-26T22:22:32.582352] [INFO ] [MAIN ] HLX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:32.583899] [DEBUG] [LOCAL ] HLN: Derivative data saved (1820 records). [2025-09-26T22:22:32.584517] [INFO ] [MAIN ] HLN: Successfully saved derivative data. [2025-09-26T22:22:32.587879] [INFO ] [MAIN ] Derivative Progress: 873/2074 symbols completed. HLN took 1.2s. Estimated remaining: 8m 22s. Rate: 143.7 symbols/min [2025-09-26T22:22:32.588401] [INFO ] [MAIN ] HMC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:32.628622] [DEBUG] [LOCAL ] HLT: Loaded 51450 existing records from primary storage. [2025-09-26T22:22:32.628964] [INFO ] [MAIN ] HLT: Loaded 51450 primary data records. [2025-09-26T22:22:32.872203] [DEBUG] [LOCAL ] HLX: Loaded 48650 existing records from primary storage. [2025-09-26T22:22:32.868380] [DEBUG] [LOCAL ] HMC: Loaded 47500 existing records from primary storage. [2025-09-26T22:22:32.984568] [INFO ] [MAIN ] HLX: Loaded 48650 primary data records. [2025-09-26T22:22:32.990196] [INFO ] [MAIN ] HMC: Loaded 47500 primary data records. [2025-09-26T22:22:33.743308] [DEBUG] [MAIN ] HLT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:33.745558] [INFO ] [MAIN ] HLT: Generated 1820 derivative records from 51450 primary records. [2025-09-26T22:22:33.745793] [DEBUG] [LOCAL ] HLT: Saving derivative data. [2025-09-26T22:22:33.765329] [DEBUG] [LOCAL ] HLT: Derivative data saved (1820 records). [2025-09-26T22:22:33.765702] [INFO ] [MAIN ] HLT: Successfully saved derivative data. [2025-09-26T22:22:33.767956] [INFO ] [MAIN ] Derivative Progress: 874/2074 symbols completed. HLT took 1.3s. Estimated remaining: 8m 22s. Rate: 143.4 symbols/min [2025-09-26T22:22:33.768574] [INFO ] [MAIN ] HMN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:33.795439] [DEBUG] [MAIN ] HLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:33.800827] [DEBUG] [MAIN ] HMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:33.801738] [INFO ] [MAIN ] HLX: Generated 1820 derivative records from 48650 primary records. [2025-09-26T22:22:33.802456] [INFO ] [MAIN ] HMC: Generated 1820 derivative records from 47500 primary records. [2025-09-26T22:22:33.802677] [DEBUG] [LOCAL ] HLX: Saving derivative data. [2025-09-26T22:22:33.802616] [DEBUG] [LOCAL ] HMC: Saving derivative data. [2025-09-26T22:22:33.848155] [DEBUG] [LOCAL ] HMN: Loaded 23671 existing records from primary storage. [2025-09-26T22:22:33.849028] [INFO ] [MAIN ] HMN: Loaded 23671 primary data records. [2025-09-26T22:22:33.892888] [DEBUG] [LOCAL ] HMC: Derivative data saved (1820 records). [2025-09-26T22:22:33.898157] [INFO ] [MAIN ] HMC: Successfully saved derivative data. [2025-09-26T22:22:33.881783] [DEBUG] [LOCAL ] HLX: Derivative data saved (1820 records). [2025-09-26T22:22:33.938595] [INFO ] [MAIN ] HLX: Successfully saved derivative data. [2025-09-26T22:22:33.927228] [INFO ] [MAIN ] Derivative Progress: 875/2074 symbols completed. HMC took 1.3s. Estimated remaining: 8m 21s. Rate: 143.5 symbols/min [2025-09-26T22:22:33.956939] [INFO ] [MAIN ] Derivative Progress: 876/2074 symbols completed. HLX took 1.4s. Estimated remaining: 8m 20s. Rate: 143.6 symbols/min [2025-09-26T22:22:33.962266] [INFO ] [MAIN ] HMY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:33.993929] [INFO ] [MAIN ] HNI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:34.249140] [DEBUG] [LOCAL ] HNI: Loaded 29386 existing records from primary storage. [2025-09-26T22:22:34.249407] [INFO ] [MAIN ] HNI: Loaded 29386 primary data records. [2025-09-26T22:22:34.407707] [DEBUG] [LOCAL ] HMY: Loaded 53914 existing records from primary storage. [2025-09-26T22:22:34.424736] [INFO ] [MAIN ] HMY: Loaded 53914 primary data records. [2025-09-26T22:22:34.719600] [DEBUG] [MAIN ] HMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:34.740982] [INFO ] [MAIN ] HMN: Generated 1820 derivative records from 23671 primary records. [2025-09-26T22:22:34.762409] [DEBUG] [LOCAL ] HMN: Saving derivative data. [2025-09-26T22:22:34.865721] [DEBUG] [LOCAL ] HMN: Derivative data saved (1820 records). [2025-09-26T22:22:34.866050] [INFO ] [MAIN ] HMN: Successfully saved derivative data. [2025-09-26T22:22:34.868979] [INFO ] [MAIN ] Derivative Progress: 877/2074 symbols completed. HMN took 1.1s. Estimated remaining: 8m 21s. Rate: 143.4 symbols/min [2025-09-26T22:22:34.870542] [INFO ] [MAIN ] HOG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:35.022425] [DEBUG] [MAIN ] HNI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:35.024482] [INFO ] [MAIN ] HNI: Generated 1820 derivative records from 29386 primary records. [2025-09-26T22:22:35.024716] [DEBUG] [LOCAL ] HNI: Saving derivative data. [2025-09-26T22:22:35.061050] [DEBUG] [LOCAL ] HNI: Derivative data saved (1820 records). [2025-09-26T22:22:35.062933] [INFO ] [MAIN ] HNI: Successfully saved derivative data. [2025-09-26T22:22:35.065612] [INFO ] [MAIN ] Derivative Progress: 878/2074 symbols completed. HNI took 1.1s. Estimated remaining: 8m 20s. Rate: 143.5 symbols/min [2025-09-26T22:22:35.079353] [INFO ] [MAIN ] HOMB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:35.080122] [DEBUG] [MAIN ] HMY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:35.082279] [INFO ] [MAIN ] HMY: Generated 1820 derivative records from 53914 primary records. [2025-09-26T22:22:35.095792] [DEBUG] [LOCAL ] HMY: Saving derivative data. [2025-09-26T22:22:35.099239] [DEBUG] [LOCAL ] HOG: Loaded 51958 existing records from primary storage. [2025-09-26T22:22:35.107138] [INFO ] [MAIN ] HOG: Loaded 51958 primary data records. [2025-09-26T22:22:35.254889] [DEBUG] [LOCAL ] HMY: Derivative data saved (1820 records). [2025-09-26T22:22:35.279671] [INFO ] [MAIN ] HMY: Successfully saved derivative data. [2025-09-26T22:22:35.324446] [INFO ] [MAIN ] Derivative Progress: 879/2074 symbols completed. HMY took 1.4s. Estimated remaining: 8m 19s. Rate: 143.6 symbols/min [2025-09-26T22:22:35.481759] [INFO ] [MAIN ] HOUS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:35.495460] [DEBUG] [LOCAL ] HOMB: Loaded 44272 existing records from primary storage. [2025-09-26T22:22:35.495818] [INFO ] [MAIN ] HOMB: Loaded 44272 primary data records. [2025-09-26T22:22:35.896894] [DEBUG] [LOCAL ] HOUS: Loaded 44903 existing records from primary storage. [2025-09-26T22:22:35.897471] [INFO ] [MAIN ] HOUS: Loaded 44903 primary data records. [2025-09-26T22:22:36.002367] [DEBUG] [MAIN ] HOG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:36.034250] [INFO ] [MAIN ] HOG: Generated 1820 derivative records from 51958 primary records. [2025-09-26T22:22:36.066370] [DEBUG] [LOCAL ] HOG: Saving derivative data. [2025-09-26T22:22:36.276209] [DEBUG] [LOCAL ] HOG: Derivative data saved (1820 records). [2025-09-26T22:22:36.277619] [INFO ] [MAIN ] HOG: Successfully saved derivative data. [2025-09-26T22:22:36.280080] [INFO ] [MAIN ] Derivative Progress: 880/2074 symbols completed. HOG took 1.4s. Estimated remaining: 8m 20s. Rate: 143.4 symbols/min [2025-09-26T22:22:36.281626] [INFO ] [MAIN ] HOV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:36.301179] [DEBUG] [MAIN ] HOMB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:36.302228] [INFO ] [MAIN ] HOMB: Generated 1820 derivative records from 44272 primary records. [2025-09-26T22:22:36.302421] [DEBUG] [LOCAL ] HOMB: Saving derivative data. [2025-09-26T22:22:36.326445] [DEBUG] [LOCAL ] HOV: Loaded 13975 existing records from primary storage. [2025-09-26T22:22:36.327331] [INFO ] [MAIN ] HOV: Loaded 13975 primary data records. [2025-09-26T22:22:36.420230] [DEBUG] [LOCAL ] HOMB: Derivative data saved (1820 records). [2025-09-26T22:22:36.433184] [INFO ] [MAIN ] HOMB: Successfully saved derivative data. [2025-09-26T22:22:36.435764] [INFO ] [MAIN ] Derivative Progress: 881/2074 symbols completed. HOMB took 1.4s. Estimated remaining: 8m 19s. Rate: 143.5 symbols/min [2025-09-26T22:22:36.462086] [INFO ] [MAIN ] HP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:36.463064] [DEBUG] [MAIN ] HOUS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:36.480170] [INFO ] [MAIN ] HOUS: Generated 1820 derivative records from 44903 primary records. [2025-09-26T22:22:36.492002] [DEBUG] [LOCAL ] HOUS: Saving derivative data. [2025-09-26T22:22:36.697813] [DEBUG] [LOCAL ] HOUS: Derivative data saved (1820 records). [2025-09-26T22:22:36.698032] [INFO ] [MAIN ] HOUS: Successfully saved derivative data. [2025-09-26T22:22:36.700968] [INFO ] [MAIN ] Derivative Progress: 882/2074 symbols completed. HOUS took 1.2s. Estimated remaining: 8m 18s. Rate: 143.5 symbols/min [2025-09-26T22:22:36.701607] [INFO ] [MAIN ] HPE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:36.744744] [DEBUG] [MAIN ] HOV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:36.760619] [INFO ] [MAIN ] HOV: Generated 1820 derivative records from 13975 primary records. [2025-09-26T22:22:36.760901] [DEBUG] [LOCAL ] HOV: Saving derivative data. [2025-09-26T22:22:36.763096] [DEBUG] [LOCAL ] HP: Loaded 52313 existing records from primary storage. [2025-09-26T22:22:36.763362] [INFO ] [MAIN ] HP: Loaded 52313 primary data records. [2025-09-26T22:22:36.950941] [DEBUG] [LOCAL ] HPE: Loaded 54477 existing records from primary storage. [2025-09-26T22:22:36.972025] [INFO ] [MAIN ] HPE: Loaded 54477 primary data records. [2025-09-26T22:22:36.981248] [DEBUG] [LOCAL ] HOV: Derivative data saved (1820 records). [2025-09-26T22:22:37.052390] [INFO ] [MAIN ] HOV: Successfully saved derivative data. [2025-09-26T22:22:37.055543] [INFO ] [MAIN ] Derivative Progress: 883/2074 symbols completed. HOV took 0.8s. Estimated remaining: 8m 18s. Rate: 143.6 symbols/min [2025-09-26T22:22:37.546022] [DEBUG] [MAIN ] HP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:37.548003] [INFO ] [MAIN ] HP: Generated 1820 derivative records from 52313 primary records. [2025-09-26T22:22:37.548123] [DEBUG] [LOCAL ] HP: Saving derivative data. [2025-09-26T22:22:37.570108] [DEBUG] [LOCAL ] HP: Derivative data saved (1820 records). [2025-09-26T22:22:37.570362] [INFO ] [MAIN ] HP: Successfully saved derivative data. [2025-09-26T22:22:37.573051] [INFO ] [MAIN ] Derivative Progress: 884/2074 symbols completed. HP took 1.1s. Estimated remaining: 8m 17s. Rate: 143.5 symbols/min [2025-09-26T22:22:37.587480] [DEBUG] [MAIN ] HPE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:37.588340] [INFO ] [MAIN ] HPE: Generated 1820 derivative records from 54477 primary records. [2025-09-26T22:22:37.588407] [DEBUG] [LOCAL ] HPE: Saving derivative data. [2025-09-26T22:22:37.606430] [DEBUG] [LOCAL ] HPE: Derivative data saved (1820 records). [2025-09-26T22:22:37.606636] [INFO ] [MAIN ] HPE: Successfully saved derivative data. [2025-09-26T22:22:37.611122] [INFO ] [MAIN ] Derivative Progress: 885/2074 symbols completed. HPE took 0.9s. Estimated remaining: 8m 17s. Rate: 143.7 symbols/min [2025-09-26T22:22:37.612320] [INFO ] [MAIN ] HPI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:37.611944] [INFO ] [MAIN ] HPF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:37.612173] [INFO ] [MAIN ] HPP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:37.626174] [DEBUG] [LOCAL ] HPF: Loaded 7388 existing records from primary storage. [2025-09-26T22:22:37.626391] [INFO ] [MAIN ] HPF: Loaded 7388 primary data records. [2025-09-26T22:22:37.677277] [DEBUG] [LOCAL ] HPI: Loaded 10339 existing records from primary storage. [2025-09-26T22:22:37.707039] [INFO ] [MAIN ] HPI: Loaded 10339 primary data records. [2025-09-26T22:22:37.991605] [DEBUG] [LOCAL ] HPP: Loaded 51595 existing records from primary storage. [2025-09-26T22:22:38.151808] [INFO ] [MAIN ] HPP: Loaded 51595 primary data records. [2025-09-26T22:22:38.732457] [DEBUG] [MAIN ] HPF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:38.735325] [INFO ] [MAIN ] HPF: Generated 1820 derivative records from 7388 primary records. [2025-09-26T22:22:38.737066] [DEBUG] [LOCAL ] HPF: Saving derivative data. [2025-09-26T22:22:38.766953] [DEBUG] [MAIN ] HPI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:38.768889] [INFO ] [MAIN ] HPI: Generated 1820 derivative records from 10339 primary records. [2025-09-26T22:22:38.769277] [DEBUG] [LOCAL ] HPI: Saving derivative data. [2025-09-26T22:22:38.790168] [DEBUG] [LOCAL ] HPF: Derivative data saved (1820 records). [2025-09-26T22:22:38.790891] [INFO ] [MAIN ] HPF: Successfully saved derivative data. [2025-09-26T22:22:38.790579] [DEBUG] [LOCAL ] HPI: Derivative data saved (1820 records). [2025-09-26T22:22:38.793262] [INFO ] [MAIN ] Derivative Progress: 886/2074 symbols completed. HPF took 1.2s. Estimated remaining: 8m 17s. Rate: 143.4 symbols/min [2025-09-26T22:22:38.793923] [INFO ] [MAIN ] HPI: Successfully saved derivative data. [2025-09-26T22:22:38.793740] [INFO ] [MAIN ] HPQ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:38.796805] [INFO ] [MAIN ] Derivative Progress: 887/2074 symbols completed. HPI took 1.2s. Estimated remaining: 8m 16s. Rate: 143.5 symbols/min [2025-09-26T22:22:38.797368] [INFO ] [MAIN ] HPS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:38.815636] [DEBUG] [MAIN ] HPP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:38.816522] [INFO ] [MAIN ] HPP: Generated 1820 derivative records from 51595 primary records. [2025-09-26T22:22:38.816594] [DEBUG] [LOCAL ] HPP: Saving derivative data. [2025-09-26T22:22:38.836922] [DEBUG] [LOCAL ] HPP: Derivative data saved (1820 records). [2025-09-26T22:22:38.837069] [INFO ] [MAIN ] HPP: Successfully saved derivative data. [2025-09-26T22:22:38.839989] [INFO ] [MAIN ] Derivative Progress: 888/2074 symbols completed. HPP took 1.2s. Estimated remaining: 8m 15s. Rate: 143.7 symbols/min [2025-09-26T22:22:38.841113] [INFO ] [MAIN ] HQH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:38.847273] [DEBUG] [LOCAL ] HPS: Loaded 10277 existing records from primary storage. [2025-09-26T22:22:38.847519] [INFO ] [MAIN ] HPS: Loaded 10277 primary data records. [2025-09-26T22:22:39.129129] [DEBUG] [LOCAL ] HQH: Loaded 25387 existing records from primary storage. [2025-09-26T22:22:39.130939] [DEBUG] [LOCAL ] HPQ: Loaded 54448 existing records from primary storage. [2025-09-26T22:22:39.131126] [INFO ] [MAIN ] HQH: Loaded 25387 primary data records. [2025-09-26T22:22:39.131279] [INFO ] [MAIN ] HPQ: Loaded 54448 primary data records. [2025-09-26T22:22:39.984256] [DEBUG] [MAIN ] HPS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:39.985739] [INFO ] [MAIN ] HPS: Generated 1820 derivative records from 10277 primary records. [2025-09-26T22:22:39.986134] [DEBUG] [LOCAL ] HPS: Saving derivative data. [2025-09-26T22:22:40.022459] [DEBUG] [MAIN ] HPQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:40.024303] [INFO ] [MAIN ] HPQ: Generated 1820 derivative records from 54448 primary records. [2025-09-26T22:22:40.024602] [DEBUG] [LOCAL ] HPQ: Saving derivative data. [2025-09-26T22:22:40.026998] [DEBUG] [LOCAL ] HPS: Derivative data saved (1820 records). [2025-09-26T22:22:40.043399] [INFO ] [MAIN ] HPS: Successfully saved derivative data. [2025-09-26T22:22:40.046105] [INFO ] [MAIN ] Derivative Progress: 889/2074 symbols completed. HPS took 1.2s. Estimated remaining: 8m 16s. Rate: 143.4 symbols/min [2025-09-26T22:22:40.047616] [INFO ] [MAIN ] HQL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:40.057217] [DEBUG] [LOCAL ] HPQ: Derivative data saved (1820 records). [2025-09-26T22:22:40.061698] [INFO ] [MAIN ] HPQ: Successfully saved derivative data. [2025-09-26T22:22:40.064851] [INFO ] [MAIN ] Derivative Progress: 890/2074 symbols completed. HPQ took 1.3s. Estimated remaining: 8m 15s. Rate: 143.5 symbols/min [2025-09-26T22:22:40.065570] [INFO ] [MAIN ] HR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:40.066857] [DEBUG] [MAIN ] HQH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:40.067672] [INFO ] [MAIN ] HQH: Generated 1820 derivative records from 25387 primary records. [2025-09-26T22:22:40.067913] [DEBUG] [LOCAL ] HQH: Saving derivative data. [2025-09-26T22:22:40.089402] [DEBUG] [LOCAL ] HQH: Derivative data saved (1820 records). [2025-09-26T22:22:40.089571] [INFO ] [MAIN ] HQH: Successfully saved derivative data. [2025-09-26T22:22:40.092422] [INFO ] [MAIN ] Derivative Progress: 891/2074 symbols completed. HQH took 1.3s. Estimated remaining: 8m 14s. Rate: 143.7 symbols/min [2025-09-26T22:22:40.093222] [INFO ] [MAIN ] HRB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:40.099332] [DEBUG] [LOCAL ] HQL: Loaded 16206 existing records from primary storage. [2025-09-26T22:22:40.099406] [INFO ] [MAIN ] HQL: Loaded 16206 primary data records. [2025-09-26T22:22:40.469049] [DEBUG] [LOCAL ] HR: Loaded 52716 existing records from primary storage. [2025-09-26T22:22:40.469933] [INFO ] [MAIN ] HR: Loaded 52716 primary data records. [2025-09-26T22:22:40.527068] [DEBUG] [LOCAL ] HRB: Loaded 49275 existing records from primary storage. [2025-09-26T22:22:40.558009] [INFO ] [MAIN ] HRB: Loaded 49275 primary data records. [2025-09-26T22:22:41.161101] [DEBUG] [MAIN ] HQL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:41.163338] [INFO ] [MAIN ] HQL: Generated 1820 derivative records from 16206 primary records. [2025-09-26T22:22:41.164169] [DEBUG] [LOCAL ] HQL: Saving derivative data. [2025-09-26T22:22:41.190865] [DEBUG] [LOCAL ] HQL: Derivative data saved (1820 records). [2025-09-26T22:22:41.203974] [DEBUG] [MAIN ] HR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:41.203683] [INFO ] [MAIN ] HQL: Successfully saved derivative data. [2025-09-26T22:22:41.206929] [INFO ] [MAIN ] Derivative Progress: 892/2074 symbols completed. HQL took 1.2s. Estimated remaining: 8m 15s. Rate: 143.4 symbols/min [2025-09-26T22:22:41.208201] [INFO ] [MAIN ] HR: Generated 1820 derivative records from 52716 primary records. [2025-09-26T22:22:41.208567] [DEBUG] [LOCAL ] HR: Saving derivative data. [2025-09-26T22:22:41.208614] [INFO ] [MAIN ] HRI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:41.229166] [DEBUG] [LOCAL ] HR: Derivative data saved (1820 records). [2025-09-26T22:22:41.229586] [INFO ] [MAIN ] HR: Successfully saved derivative data. [2025-09-26T22:22:41.231712] [INFO ] [MAIN ] Derivative Progress: 893/2074 symbols completed. HR took 1.2s. Estimated remaining: 8m 14s. Rate: 143.6 symbols/min [2025-09-26T22:22:41.232171] [INFO ] [MAIN ] HRL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:41.246804] [DEBUG] [MAIN ] HRB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:41.247596] [INFO ] [MAIN ] HRB: Generated 1820 derivative records from 49275 primary records. [2025-09-26T22:22:41.247742] [DEBUG] [LOCAL ] HRB: Saving derivative data. [2025-09-26T22:22:41.273423] [DEBUG] [LOCAL ] HRB: Derivative data saved (1820 records). [2025-09-26T22:22:41.273678] [INFO ] [MAIN ] HRB: Successfully saved derivative data. [2025-09-26T22:22:41.276605] [INFO ] [MAIN ] Derivative Progress: 894/2074 symbols completed. HRB took 1.2s. Estimated remaining: 8m 13s. Rate: 143.7 symbols/min [2025-09-26T22:22:41.277726] [INFO ] [MAIN ] HRTG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:41.288933] [DEBUG] [LOCAL ] HRI: Loaded 33507 existing records from primary storage. [2025-09-26T22:22:41.289210] [INFO ] [MAIN ] HRI: Loaded 33507 primary data records. [2025-09-26T22:22:41.648758] [DEBUG] [LOCAL ] HRL: Loaded 53855 existing records from primary storage. [2025-09-26T22:22:41.649047] [INFO ] [MAIN ] HRL: Loaded 53855 primary data records. [2025-09-26T22:22:41.703843] [DEBUG] [LOCAL ] HRTG: Loaded 33658 existing records from primary storage. [2025-09-26T22:22:41.736165] [INFO ] [MAIN ] HRTG: Loaded 33658 primary data records. [2025-09-26T22:22:42.418308] [DEBUG] [MAIN ] HRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:42.420422] [INFO ] [MAIN ] HRI: Generated 1820 derivative records from 33507 primary records. [2025-09-26T22:22:42.420541] [DEBUG] [LOCAL ] HRI: Saving derivative data. [2025-09-26T22:22:42.453199] [DEBUG] [LOCAL ] HRI: Derivative data saved (1820 records). [2025-09-26T22:22:42.453933] [INFO ] [MAIN ] HRI: Successfully saved derivative data. [2025-09-26T22:22:42.465742] [INFO ] [MAIN ] Derivative Progress: 895/2074 symbols completed. HRI took 1.3s. Estimated remaining: 8m 13s. Rate: 143.4 symbols/min [2025-09-26T22:22:42.473129] [DEBUG] [MAIN ] HRL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:42.473864] [INFO ] [MAIN ] HSBC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:42.475544] [INFO ] [MAIN ] HRL: Generated 1820 derivative records from 53855 primary records. [2025-09-26T22:22:42.477093] [DEBUG] [LOCAL ] HRL: Saving derivative data. [2025-09-26T22:22:42.511256] [DEBUG] [MAIN ] HRTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:42.513598] [INFO ] [MAIN ] HRTG: Generated 1820 derivative records from 33658 primary records. [2025-09-26T22:22:42.514284] [DEBUG] [LOCAL ] HRTG: Saving derivative data. [2025-09-26T22:22:42.529578] [DEBUG] [LOCAL ] HRL: Derivative data saved (1820 records). [2025-09-26T22:22:42.530347] [INFO ] [MAIN ] HRL: Successfully saved derivative data. [2025-09-26T22:22:42.532620] [INFO ] [MAIN ] Derivative Progress: 896/2074 symbols completed. HRL took 1.3s. Estimated remaining: 8m 12s. Rate: 143.6 symbols/min [2025-09-26T22:22:42.533386] [INFO ] [MAIN ] HSHP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:42.553082] [DEBUG] [LOCAL ] HRTG: Derivative data saved (1820 records). [2025-09-26T22:22:42.553234] [INFO ] [MAIN ] HRTG: Successfully saved derivative data. [2025-09-26T22:22:42.557132] [INFO ] [MAIN ] Derivative Progress: 897/2074 symbols completed. HRTG took 1.3s. Estimated remaining: 8m 11s. Rate: 143.7 symbols/min [2025-09-26T22:22:42.557709] [INFO ] [MAIN ] HSY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:42.586174] [DEBUG] [LOCAL ] HSHP: Loaded 15773 existing records from primary storage. [2025-09-26T22:22:42.587958] [INFO ] [MAIN ] HSHP: Loaded 15773 primary data records. [2025-09-26T22:22:42.588923] [DEBUG] [LOCAL ] HSBC: Loaded 51868 existing records from primary storage. [2025-09-26T22:22:42.601144] [INFO ] [MAIN ] HSBC: Loaded 51868 primary data records. [2025-09-26T22:22:43.280746] [DEBUG] [LOCAL ] HSY: Loaded 51161 existing records from primary storage. [2025-09-26T22:22:43.291687] [INFO ] [MAIN ] HSY: Loaded 51161 primary data records. [2025-09-26T22:22:43.654005] [DEBUG] [MAIN ] HSBC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:43.668170] [INFO ] [MAIN ] HSBC: Generated 1820 derivative records from 51868 primary records. [2025-09-26T22:22:43.668277] [DEBUG] [LOCAL ] HSBC: Saving derivative data. [2025-09-26T22:22:43.669902] [DEBUG] [MAIN ] HSHP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:43.677882] [INFO ] [MAIN ] HSHP: Generated 1820 derivative records from 15773 primary records. [2025-09-26T22:22:43.682114] [DEBUG] [LOCAL ] HSHP: Saving derivative data. [2025-09-26T22:22:43.688607] [DEBUG] [LOCAL ] HSBC: Derivative data saved (1820 records). [2025-09-26T22:22:43.689060] [INFO ] [MAIN ] HSBC: Successfully saved derivative data. [2025-09-26T22:22:43.692933] [INFO ] [MAIN ] Derivative Progress: 898/2074 symbols completed. HSBC took 1.2s. Estimated remaining: 8m 12s. Rate: 143.4 symbols/min [2025-09-26T22:22:43.710528] [DEBUG] [LOCAL ] HSHP: Derivative data saved (1820 records). [2025-09-26T22:22:43.710816] [INFO ] [MAIN ] HSHP: Successfully saved derivative data. [2025-09-26T22:22:43.713770] [INFO ] [MAIN ] Derivative Progress: 899/2074 symbols completed. HSHP took 1.2s. Estimated remaining: 8m 11s. Rate: 143.6 symbols/min [2025-09-26T22:22:43.730976] [DEBUG] [MAIN ] HSY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:43.731836] [INFO ] [MAIN ] HSY: Generated 1820 derivative records from 51161 primary records. [2025-09-26T22:22:43.731907] [DEBUG] [LOCAL ] HSY: Saving derivative data. [2025-09-26T22:22:43.748265] [DEBUG] [LOCAL ] HSY: Derivative data saved (1820 records). [2025-09-26T22:22:43.748330] [INFO ] [MAIN ] HSY: Successfully saved derivative data. [2025-09-26T22:22:43.751854] [INFO ] [MAIN ] Derivative Progress: 900/2074 symbols completed. HSY took 1.2s. Estimated remaining: 8m 10s. Rate: 143.7 symbols/min [2025-09-26T22:22:43.752586] [INFO ] [MAIN ] HTGC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:43.753543] [INFO ] [MAIN ] HTD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:43.753437] [INFO ] [MAIN ] HTH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:43.771918] [DEBUG] [LOCAL ] HTD: Loaded 13754 existing records from primary storage. [2025-09-26T22:22:43.772228] [INFO ] [MAIN ] HTD: Loaded 13754 primary data records. [2025-09-26T22:22:43.928088] [DEBUG] [LOCAL ] HTH: Loaded 32696 existing records from primary storage. [2025-09-26T22:22:43.933690] [INFO ] [MAIN ] HTH: Loaded 32696 primary data records. [2025-09-26T22:22:44.308679] [DEBUG] [LOCAL ] HTGC: Loaded 48222 existing records from primary storage. [2025-09-26T22:22:44.309863] [INFO ] [MAIN ] HTGC: Loaded 48222 primary data records. [2025-09-26T22:22:44.886422] [DEBUG] [MAIN ] HTD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:44.888291] [INFO ] [MAIN ] HTD: Generated 1820 derivative records from 13754 primary records. [2025-09-26T22:22:44.888574] [DEBUG] [LOCAL ] HTD: Saving derivative data. [2025-09-26T22:22:44.925197] [DEBUG] [MAIN ] HTH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:44.927072] [INFO ] [MAIN ] HTH: Generated 1820 derivative records from 32696 primary records. [2025-09-26T22:22:44.927733] [DEBUG] [LOCAL ] HTH: Saving derivative data. [2025-09-26T22:22:44.946919] [DEBUG] [LOCAL ] HTD: Derivative data saved (1820 records). [2025-09-26T22:22:44.950523] [DEBUG] [LOCAL ] HTH: Derivative data saved (1820 records). [2025-09-26T22:22:44.947347] [INFO ] [MAIN ] HTD: Successfully saved derivative data. [2025-09-26T22:22:44.950626] [INFO ] [MAIN ] HTH: Successfully saved derivative data. [2025-09-26T22:22:44.962385] [INFO ] [MAIN ] Derivative Progress: 901/2074 symbols completed. HTD took 1.2s. Estimated remaining: 8m 11s. Rate: 143.4 symbols/min [2025-09-26T22:22:44.971030] [INFO ] [MAIN ] Derivative Progress: 902/2074 symbols completed. HTH took 1.2s. Estimated remaining: 8m 10s. Rate: 143.6 symbols/min [2025-09-26T22:22:44.971826] [INFO ] [MAIN ] HUBS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:44.971930] [INFO ] [MAIN ] HUBB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:44.971510] [DEBUG] [MAIN ] HTGC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:44.974164] [INFO ] [MAIN ] HTGC: Generated 1820 derivative records from 48222 primary records. [2025-09-26T22:22:44.974382] [DEBUG] [LOCAL ] HTGC: Saving derivative data. [2025-09-26T22:22:44.994402] [DEBUG] [LOCAL ] HTGC: Derivative data saved (1820 records). [2025-09-26T22:22:44.994567] [INFO ] [MAIN ] HTGC: Successfully saved derivative data. [2025-09-26T22:22:44.998025] [INFO ] [MAIN ] Derivative Progress: 903/2074 symbols completed. HTGC took 1.2s. Estimated remaining: 8m 9s. Rate: 143.7 symbols/min [2025-09-26T22:22:44.998701] [INFO ] [MAIN ] HUM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:45.036822] [DEBUG] [LOCAL ] HUBB: Loaded 37650 existing records from primary storage. [2025-09-26T22:22:45.047565] [INFO ] [MAIN ] HUBB: Loaded 37650 primary data records. [2025-09-26T22:22:45.055205] [DEBUG] [LOCAL ] HUBS: Loaded 39953 existing records from primary storage. [2025-09-26T22:22:45.073214] [INFO ] [MAIN ] HUBS: Loaded 39953 primary data records. [2025-09-26T22:22:45.745745] [DEBUG] [LOCAL ] HUM: Loaded 49568 existing records from primary storage. [2025-09-26T22:22:45.747323] [INFO ] [MAIN ] HUM: Loaded 49568 primary data records. [2025-09-26T22:22:46.125666] [DEBUG] [MAIN ] HUBS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:46.126490] [DEBUG] [MAIN ] HUBB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:46.127679] [INFO ] [MAIN ] HUBB: Generated 1820 derivative records from 37650 primary records. [2025-09-26T22:22:46.127946] [DEBUG] [LOCAL ] HUBB: Saving derivative data. [2025-09-26T22:22:46.129246] [INFO ] [MAIN ] HUBS: Generated 1820 derivative records from 39953 primary records. [2025-09-26T22:22:46.129338] [DEBUG] [LOCAL ] HUBS: Saving derivative data. [2025-09-26T22:22:46.166487] [DEBUG] [LOCAL ] HUBB: Derivative data saved (1820 records). [2025-09-26T22:22:46.167714] [DEBUG] [LOCAL ] HUBS: Derivative data saved (1820 records). [2025-09-26T22:22:46.167796] [INFO ] [MAIN ] HUBB: Successfully saved derivative data. [2025-09-26T22:22:46.167927] [INFO ] [MAIN ] HUBS: Successfully saved derivative data. [2025-09-26T22:22:46.171095] [INFO ] [MAIN ] Derivative Progress: 904/2074 symbols completed. HUBB took 1.2s. Estimated remaining: 8m 9s. Rate: 143.4 symbols/min [2025-09-26T22:22:46.174937] [INFO ] [MAIN ] Derivative Progress: 905/2074 symbols completed. HUBS took 1.2s. Estimated remaining: 8m 8s. Rate: 143.6 symbols/min [2025-09-26T22:22:46.175342] [INFO ] [MAIN ] HUN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:46.175146] [INFO ] [MAIN ] HUYA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:46.192276] [DEBUG] [MAIN ] HUM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:46.193194] [INFO ] [MAIN ] HUM: Generated 1820 derivative records from 49568 primary records. [2025-09-26T22:22:46.193308] [DEBUG] [LOCAL ] HUM: Saving derivative data. [2025-09-26T22:22:46.210292] [DEBUG] [LOCAL ] HUM: Derivative data saved (1820 records). [2025-09-26T22:22:46.210454] [INFO ] [MAIN ] HUM: Successfully saved derivative data. [2025-09-26T22:22:46.213072] [INFO ] [MAIN ] Derivative Progress: 906/2074 symbols completed. HUM took 1.2s. Estimated remaining: 8m 8s. Rate: 143.7 symbols/min [2025-09-26T22:22:46.213438] [INFO ] [MAIN ] HVT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:46.240533] [DEBUG] [LOCAL ] HVT: Loaded 16133 existing records from primary storage. [2025-09-26T22:22:46.240796] [INFO ] [MAIN ] HVT: Loaded 16133 primary data records. [2025-09-26T22:22:46.391142] [DEBUG] [LOCAL ] HUYA: Loaded 44956 existing records from primary storage. [2025-09-26T22:22:46.401971] [INFO ] [MAIN ] HUYA: Loaded 44956 primary data records. [2025-09-26T22:22:46.486117] [DEBUG] [LOCAL ] HUN: Loaded 53976 existing records from primary storage. [2025-09-26T22:22:46.520402] [INFO ] [MAIN ] HUN: Loaded 53976 primary data records. [2025-09-26T22:22:47.358605] [DEBUG] [MAIN ] HVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:47.359930] [INFO ] [MAIN ] HVT: Generated 1820 derivative records from 16133 primary records. [2025-09-26T22:22:47.361449] [DEBUG] [LOCAL ] HVT: Saving derivative data. [2025-09-26T22:22:47.381012] [DEBUG] [LOCAL ] HVT: Derivative data saved (1820 records). [2025-09-26T22:22:47.384755] [INFO ] [MAIN ] HVT: Successfully saved derivative data. [2025-09-26T22:22:47.387074] [INFO ] [MAIN ] Derivative Progress: 907/2074 symbols completed. HVT took 1.2s. Estimated remaining: 8m 8s. Rate: 143.5 symbols/min [2025-09-26T22:22:47.400009] [INFO ] [MAIN ] HWM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:47.402191] [DEBUG] [MAIN ] HUYA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:47.404035] [INFO ] [MAIN ] HUYA: Generated 1820 derivative records from 44956 primary records. [2025-09-26T22:22:47.405161] [DEBUG] [LOCAL ] HUYA: Saving derivative data. [2025-09-26T22:22:47.433928] [DEBUG] [MAIN ] HUN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:47.435671] [INFO ] [MAIN ] HUN: Generated 1820 derivative records from 53976 primary records. [2025-09-26T22:22:47.435881] [DEBUG] [LOCAL ] HUN: Saving derivative data. [2025-09-26T22:22:47.453849] [DEBUG] [LOCAL ] HUYA: Derivative data saved (1820 records). [2025-09-26T22:22:47.454474] [INFO ] [MAIN ] HUYA: Successfully saved derivative data. [2025-09-26T22:22:47.457993] [INFO ] [MAIN ] Derivative Progress: 908/2074 symbols completed. HUYA took 1.3s. Estimated remaining: 8m 7s. Rate: 143.6 symbols/min [2025-09-26T22:22:47.458547] [INFO ] [MAIN ] HXL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:47.462264] [DEBUG] [LOCAL ] HUN: Derivative data saved (1820 records). [2025-09-26T22:22:47.462425] [INFO ] [MAIN ] HUN: Successfully saved derivative data. [2025-09-26T22:22:47.464979] [INFO ] [MAIN ] Derivative Progress: 909/2074 symbols completed. HUN took 1.3s. Estimated remaining: 8m 6s. Rate: 143.7 symbols/min [2025-09-26T22:22:47.465403] [INFO ] [MAIN ] HY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:47.492049] [DEBUG] [LOCAL ] HY: Loaded 10192 existing records from primary storage. [2025-09-26T22:22:47.492192] [INFO ] [MAIN ] HY: Loaded 10192 primary data records. [2025-09-26T22:22:47.650949] [DEBUG] [LOCAL ] HWM: Loaded 53767 existing records from primary storage. [2025-09-26T22:22:47.651740] [INFO ] [MAIN ] HWM: Loaded 53767 primary data records. [2025-09-26T22:22:47.954594] [DEBUG] [LOCAL ] HXL: Loaded 46661 existing records from primary storage. [2025-09-26T22:22:47.975530] [INFO ] [MAIN ] HXL: Loaded 46661 primary data records. [2025-09-26T22:22:48.650264] [DEBUG] [MAIN ] HY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:48.651715] [INFO ] [MAIN ] HY: Generated 1820 derivative records from 10192 primary records. [2025-09-26T22:22:48.651967] [DEBUG] [LOCAL ] HY: Saving derivative data. [2025-09-26T22:22:48.675952] [DEBUG] [LOCAL ] HY: Derivative data saved (1820 records). [2025-09-26T22:22:48.676245] [INFO ] [MAIN ] HY: Successfully saved derivative data. [2025-09-26T22:22:48.679130] [INFO ] [MAIN ] Derivative Progress: 910/2074 symbols completed. HY took 1.2s. Estimated remaining: 8m 7s. Rate: 143.4 symbols/min [2025-09-26T22:22:48.679626] [INFO ] [MAIN ] HYI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:48.694104] [DEBUG] [MAIN ] HWM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:48.695068] [INFO ] [MAIN ] HWM: Generated 1820 derivative records from 53767 primary records. [2025-09-26T22:22:48.695240] [DEBUG] [LOCAL ] HWM: Saving derivative data. [2025-09-26T22:22:48.729620] [DEBUG] [MAIN ] HXL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:48.731410] [DEBUG] [LOCAL ] HWM: Derivative data saved (1820 records). [2025-09-26T22:22:48.731638] [INFO ] [MAIN ] HWM: Successfully saved derivative data. [2025-09-26T22:22:48.735221] [INFO ] [MAIN ] Derivative Progress: 911/2074 symbols completed. HWM took 1.3s. Estimated remaining: 8m 6s. Rate: 143.6 symbols/min [2025-09-26T22:22:48.732605] [INFO ] [MAIN ] HXL: Generated 1820 derivative records from 46661 primary records. [2025-09-26T22:22:48.736060] [DEBUG] [LOCAL ] HXL: Saving derivative data. [2025-09-26T22:22:48.741668] [INFO ] [MAIN ] HYT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:48.744007] [DEBUG] [LOCAL ] HYI: Loaded 9254 existing records from primary storage. [2025-09-26T22:22:48.744193] [INFO ] [MAIN ] HYI: Loaded 9254 primary data records. [2025-09-26T22:22:48.813959] [DEBUG] [LOCAL ] HXL: Derivative data saved (1820 records). [2025-09-26T22:22:48.819385] [INFO ] [MAIN ] HXL: Successfully saved derivative data. [2025-09-26T22:22:48.833699] [INFO ] [MAIN ] Derivative Progress: 912/2074 symbols completed. HXL took 1.4s. Estimated remaining: 8m 5s. Rate: 143.7 symbols/min [2025-09-26T22:22:48.844398] [INFO ] [MAIN ] HYTR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:48.924412] [DEBUG] [LOCAL ] HYTR: Loaded 3208 existing records from primary storage. [2025-09-26T22:22:48.970813] [INFO ] [MAIN ] HYTR: Loaded 3208 primary data records. [2025-09-26T22:22:48.990383] [DEBUG] [LOCAL ] HYT: Loaded 33853 existing records from primary storage. [2025-09-26T22:22:49.155281] [INFO ] [MAIN ] HYT: Loaded 33853 primary data records. [2025-09-26T22:22:49.863697] [DEBUG] [MAIN ] HYI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:49.865251] [INFO ] [MAIN ] HYI: Generated 1820 derivative records from 9254 primary records. [2025-09-26T22:22:49.865665] [DEBUG] [LOCAL ] HYI: Saving derivative data. [2025-09-26T22:22:49.908499] [DEBUG] [LOCAL ] HYI: Derivative data saved (1820 records). [2025-09-26T22:22:49.910275] [INFO ] [MAIN ] HYI: Successfully saved derivative data. [2025-09-26T22:22:49.914630] [INFO ] [MAIN ] Derivative Progress: 913/2074 symbols completed. HYI took 1.2s. Estimated remaining: 8m 6s. Rate: 143.4 symbols/min [2025-09-26T22:22:49.910740] [DEBUG] [MAIN ] HYT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:49.916121] [INFO ] [MAIN ] HYT: Generated 1820 derivative records from 33853 primary records. [2025-09-26T22:22:49.916861] [DEBUG] [LOCAL ] HYT: Saving derivative data. [2025-09-26T22:22:49.930515] [DEBUG] [MAIN ] HYTR: Filtered 7001 bins outside market hours, 7801 incomplete bins [2025-09-26T22:22:49.932388] [INFO ] [MAIN ] HYTR: Generated 1813 derivative records from 3208 primary records. [2025-09-26T22:22:49.932480] [DEBUG] [LOCAL ] HYTR: Saving derivative data. [2025-09-26T22:22:49.965180] [DEBUG] [LOCAL ] HYTR: Derivative data saved (1813 records). [2025-09-26T22:22:49.965796] [DEBUG] [LOCAL ] HYT: Derivative data saved (1820 records). [2025-09-26T22:22:49.965990] [INFO ] [MAIN ] HYTR: Successfully saved derivative data. [2025-09-26T22:22:49.970520] [INFO ] [MAIN ] HYT: Successfully saved derivative data. [2025-09-26T22:22:49.970344] [INFO ] [MAIN ] Derivative Progress: 914/2074 symbols completed. HYTR took 1.1s. Estimated remaining: 8m 5s. Rate: 143.6 symbols/min [2025-09-26T22:22:49.974136] [INFO ] [MAIN ] Derivative Progress: 915/2074 symbols completed. HYT took 1.2s. Estimated remaining: 8m 4s. Rate: 143.7 symbols/min [2025-09-26T22:22:49.975043] [INFO ] [MAIN ] HZO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:49.975203] [INFO ] [MAIN ] IAG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:49.975428] [INFO ] [MAIN ] IAE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:49.987463] [DEBUG] [LOCAL ] IAE: Loaded 6104 existing records from primary storage. [2025-09-26T22:22:49.987832] [INFO ] [MAIN ] IAE: Loaded 6104 primary data records. [2025-09-26T22:22:50.119569] [DEBUG] [LOCAL ] HZO: Loaded 29733 existing records from primary storage. [2025-09-26T22:22:50.124415] [INFO ] [MAIN ] HZO: Loaded 29733 primary data records. [2025-09-26T22:22:50.537288] [DEBUG] [LOCAL ] IAG: Loaded 54225 existing records from primary storage. [2025-09-26T22:22:50.677282] [INFO ] [MAIN ] IAG: Loaded 54225 primary data records. [2025-09-26T22:22:51.106494] [DEBUG] [MAIN ] IAE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:51.107560] [INFO ] [MAIN ] IAE: Generated 1820 derivative records from 6104 primary records. [2025-09-26T22:22:51.107809] [DEBUG] [LOCAL ] IAE: Saving derivative data. [2025-09-26T22:22:51.131019] [DEBUG] [LOCAL ] IAE: Derivative data saved (1820 records). [2025-09-26T22:22:51.131568] [INFO ] [MAIN ] IAE: Successfully saved derivative data. [2025-09-26T22:22:51.147915] [INFO ] [MAIN ] Derivative Progress: 916/2074 symbols completed. IAE took 1.2s. Estimated remaining: 8m 4s. Rate: 143.5 symbols/min [2025-09-26T22:22:51.149282] [INFO ] [MAIN ] IBM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:51.149148] [DEBUG] [MAIN ] HZO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:51.150984] [INFO ] [MAIN ] HZO: Generated 1820 derivative records from 29733 primary records. [2025-09-26T22:22:51.151348] [DEBUG] [LOCAL ] HZO: Saving derivative data. [2025-09-26T22:22:51.173057] [DEBUG] [LOCAL ] HZO: Derivative data saved (1820 records). [2025-09-26T22:22:51.173822] [INFO ] [MAIN ] HZO: Successfully saved derivative data. [2025-09-26T22:22:51.178146] [INFO ] [MAIN ] Derivative Progress: 917/2074 symbols completed. HZO took 1.2s. Estimated remaining: 8m 3s. Rate: 143.6 symbols/min [2025-09-26T22:22:51.179385] [INFO ] [MAIN ] IBN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:51.195329] [DEBUG] [MAIN ] IAG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:51.196348] [INFO ] [MAIN ] IAG: Generated 1820 derivative records from 54225 primary records. [2025-09-26T22:22:51.196496] [DEBUG] [LOCAL ] IAG: Saving derivative data. [2025-09-26T22:22:51.214525] [DEBUG] [LOCAL ] IAG: Derivative data saved (1820 records). [2025-09-26T22:22:51.214820] [INFO ] [MAIN ] IAG: Successfully saved derivative data. [2025-09-26T22:22:51.217835] [INFO ] [MAIN ] Derivative Progress: 918/2074 symbols completed. IAG took 1.2s. Estimated remaining: 8m 3s. Rate: 143.7 symbols/min [2025-09-26T22:22:51.218279] [INFO ] [MAIN ] IBP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:51.284808] [DEBUG] [LOCAL ] IBM: Loaded 54416 existing records from primary storage. [2025-09-26T22:22:51.285148] [INFO ] [MAIN ] IBM: Loaded 54416 primary data records. [2025-09-26T22:22:51.393376] [DEBUG] [LOCAL ] IBP: Loaded 29584 existing records from primary storage. [2025-09-26T22:22:51.429925] [INFO ] [MAIN ] IBP: Loaded 29584 primary data records. [2025-09-26T22:22:51.435147] [DEBUG] [LOCAL ] IBN: Loaded 53654 existing records from primary storage. [2025-09-26T22:22:51.459836] [INFO ] [MAIN ] IBN: Loaded 53654 primary data records. [2025-09-26T22:22:52.338089] [DEBUG] [MAIN ] IBM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:52.339144] [INFO ] [MAIN ] IBM: Generated 1820 derivative records from 54416 primary records. [2025-09-26T22:22:52.339672] [DEBUG] [LOCAL ] IBM: Saving derivative data. [2025-09-26T22:22:52.379123] [DEBUG] [LOCAL ] IBM: Derivative data saved (1820 records). [2025-09-26T22:22:52.379008] [DEBUG] [MAIN ] IBP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:52.379461] [INFO ] [MAIN ] IBM: Successfully saved derivative data. [2025-09-26T22:22:52.393402] [INFO ] [MAIN ] IBP: Generated 1820 derivative records from 29584 primary records. [2025-09-26T22:22:52.394240] [DEBUG] [LOCAL ] IBP: Saving derivative data. [2025-09-26T22:22:52.396765] [INFO ] [MAIN ] Derivative Progress: 919/2074 symbols completed. IBM took 1.2s. Estimated remaining: 8m 3s. Rate: 143.5 symbols/min [2025-09-26T22:22:52.394066] [DEBUG] [MAIN ] IBN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:52.405862] [INFO ] [MAIN ] IBTA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:52.408525] [INFO ] [MAIN ] IBN: Generated 1820 derivative records from 53654 primary records. [2025-09-26T22:22:52.412084] [DEBUG] [LOCAL ] IBN: Saving derivative data. [2025-09-26T22:22:52.434089] [DEBUG] [LOCAL ] IBP: Derivative data saved (1820 records). [2025-09-26T22:22:52.434343] [INFO ] [MAIN ] IBP: Successfully saved derivative data. [2025-09-26T22:22:52.438055] [INFO ] [MAIN ] Derivative Progress: 920/2074 symbols completed. IBP took 1.2s. Estimated remaining: 8m 2s. Rate: 143.6 symbols/min [2025-09-26T22:22:52.438760] [INFO ] [MAIN ] ICE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:52.441410] [DEBUG] [LOCAL ] IBN: Derivative data saved (1820 records). [2025-09-26T22:22:52.441678] [INFO ] [MAIN ] IBN: Successfully saved derivative data. [2025-09-26T22:22:52.444870] [INFO ] [MAIN ] Derivative Progress: 921/2074 symbols completed. IBN took 1.3s. Estimated remaining: 8m 1s. Rate: 143.8 symbols/min [2025-09-26T22:22:52.457384] [INFO ] [MAIN ] ICL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:52.474309] [DEBUG] [LOCAL ] IBTA: Loaded 38445 existing records from primary storage. [2025-09-26T22:22:52.474695] [INFO ] [MAIN ] IBTA: Loaded 38445 primary data records. [2025-09-26T22:22:52.862106] [DEBUG] [LOCAL ] ICL: Loaded 39135 existing records from primary storage. [2025-09-26T22:22:52.888412] [INFO ] [MAIN ] ICL: Loaded 39135 primary data records. [2025-09-26T22:22:52.898884] [DEBUG] [LOCAL ] ICE: Loaded 53800 existing records from primary storage. [2025-09-26T22:22:52.933176] [INFO ] [MAIN ] ICE: Loaded 53800 primary data records. [2025-09-26T22:22:53.596195] [DEBUG] [MAIN ] IBTA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:53.597735] [INFO ] [MAIN ] IBTA: Generated 1820 derivative records from 38445 primary records. [2025-09-26T22:22:53.597870] [DEBUG] [LOCAL ] IBTA: Saving derivative data. [2025-09-26T22:22:53.622097] [DEBUG] [LOCAL ] IBTA: Derivative data saved (1820 records). [2025-09-26T22:22:53.622261] [INFO ] [MAIN ] IBTA: Successfully saved derivative data. [2025-09-26T22:22:53.625322] [INFO ] [MAIN ] Derivative Progress: 922/2074 symbols completed. IBTA took 1.2s. Estimated remaining: 8m 2s. Rate: 143.5 symbols/min [2025-09-26T22:22:53.626038] [INFO ] [MAIN ] IDA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:53.661782] [DEBUG] [MAIN ] ICL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:53.663673] [INFO ] [MAIN ] ICL: Generated 1820 derivative records from 39135 primary records. [2025-09-26T22:22:53.662611] [DEBUG] [MAIN ] ICE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:53.664001] [DEBUG] [LOCAL ] ICL: Saving derivative data. [2025-09-26T22:22:53.665036] [INFO ] [MAIN ] ICE: Generated 1820 derivative records from 53800 primary records. [2025-09-26T22:22:53.665878] [DEBUG] [LOCAL ] ICE: Saving derivative data. [2025-09-26T22:22:53.723546] [DEBUG] [LOCAL ] ICE: Derivative data saved (1820 records). [2025-09-26T22:22:53.724768] [INFO ] [MAIN ] ICE: Successfully saved derivative data. [2025-09-26T22:22:53.728234] [INFO ] [MAIN ] Derivative Progress: 923/2074 symbols completed. ICE took 1.3s. Estimated remaining: 8m 1s. Rate: 143.6 symbols/min [2025-09-26T22:22:53.724516] [DEBUG] [LOCAL ] IDA: Loaded 32398 existing records from primary storage. [2025-09-26T22:22:53.729076] [INFO ] [MAIN ] IDE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:53.728983] [INFO ] [MAIN ] IDA: Loaded 32398 primary data records. [2025-09-26T22:22:53.724873] [DEBUG] [LOCAL ] ICL: Derivative data saved (1820 records). [2025-09-26T22:22:53.734722] [INFO ] [MAIN ] ICL: Successfully saved derivative data. [2025-09-26T22:22:53.744230] [INFO ] [MAIN ] Derivative Progress: 924/2074 symbols completed. ICL took 1.3s. Estimated remaining: 8m 0s. Rate: 143.7 symbols/min [2025-09-26T22:22:53.755702] [INFO ] [MAIN ] IDT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:53.865588] [DEBUG] [LOCAL ] IDE: Loaded 8755 existing records from primary storage. [2025-09-26T22:22:53.891436] [INFO ] [MAIN ] IDE: Loaded 8755 primary data records. [2025-09-26T22:22:54.005151] [DEBUG] [LOCAL ] IDT: Loaded 17885 existing records from primary storage. [2025-09-26T22:22:54.078885] [INFO ] [MAIN ] IDT: Loaded 17885 primary data records. [2025-09-26T22:22:54.793591] [DEBUG] [MAIN ] IDA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:54.794810] [INFO ] [MAIN ] IDA: Generated 1820 derivative records from 32398 primary records. [2025-09-26T22:22:54.795266] [DEBUG] [LOCAL ] IDA: Saving derivative data. [2025-09-26T22:22:54.818568] [DEBUG] [MAIN ] IDE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:54.823693] [INFO ] [MAIN ] IDE: Generated 1820 derivative records from 8755 primary records. [2025-09-26T22:22:54.827161] [DEBUG] [LOCAL ] IDA: Derivative data saved (1820 records). [2025-09-26T22:22:54.827232] [DEBUG] [LOCAL ] IDE: Saving derivative data. [2025-09-26T22:22:54.827998] [INFO ] [MAIN ] IDA: Successfully saved derivative data. [2025-09-26T22:22:54.830394] [INFO ] [MAIN ] Derivative Progress: 925/2074 symbols completed. IDA took 1.2s. Estimated remaining: 8m 0s. Rate: 143.5 symbols/min [2025-09-26T22:22:54.838395] [INFO ] [MAIN ] IEX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:54.847220] [DEBUG] [LOCAL ] IDE: Derivative data saved (1820 records). [2025-09-26T22:22:54.847480] [INFO ] [MAIN ] IDE: Successfully saved derivative data. [2025-09-26T22:22:54.850745] [INFO ] [MAIN ] Derivative Progress: 926/2074 symbols completed. IDE took 1.1s. Estimated remaining: 7m 60s. Rate: 143.6 symbols/min [2025-09-26T22:22:54.854207] [INFO ] [MAIN ] IFF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:54.868712] [DEBUG] [MAIN ] IDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:54.869667] [INFO ] [MAIN ] IDT: Generated 1820 derivative records from 17885 primary records. [2025-09-26T22:22:54.869885] [DEBUG] [LOCAL ] IDT: Saving derivative data. [2025-09-26T22:22:54.888133] [DEBUG] [LOCAL ] IDT: Derivative data saved (1820 records). [2025-09-26T22:22:54.888291] [INFO ] [MAIN ] IDT: Successfully saved derivative data. [2025-09-26T22:22:54.892760] [INFO ] [MAIN ] Derivative Progress: 927/2074 symbols completed. IDT took 1.1s. Estimated remaining: 7m 59s. Rate: 143.8 symbols/min [2025-09-26T22:22:54.893596] [INFO ] [MAIN ] IFN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:54.939065] [DEBUG] [LOCAL ] IEX: Loaded 38978 existing records from primary storage. [2025-09-26T22:22:54.939381] [INFO ] [MAIN ] IEX: Loaded 38978 primary data records. [2025-09-26T22:22:55.022270] [DEBUG] [LOCAL ] IFN: Loaded 18475 existing records from primary storage. [2025-09-26T22:22:55.073789] [INFO ] [MAIN ] IFN: Loaded 18475 primary data records. [2025-09-26T22:22:55.074612] [DEBUG] [LOCAL ] IFF: Loaded 51727 existing records from primary storage. [2025-09-26T22:22:55.074855] [INFO ] [MAIN ] IFF: Loaded 51727 primary data records. [2025-09-26T22:22:56.017436] [DEBUG] [MAIN ] IEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:56.020977] [INFO ] [MAIN ] IEX: Generated 1820 derivative records from 38978 primary records. [2025-09-26T22:22:56.035014] [DEBUG] [LOCAL ] IEX: Saving derivative data. [2025-09-26T22:22:56.035776] [DEBUG] [MAIN ] IFF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:56.037908] [INFO ] [MAIN ] IFF: Generated 1820 derivative records from 51727 primary records. [2025-09-26T22:22:56.038303] [DEBUG] [LOCAL ] IFF: Saving derivative data. [2025-09-26T22:22:56.072995] [DEBUG] [MAIN ] IFN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:56.080490] [INFO ] [MAIN ] IFN: Generated 1820 derivative records from 18475 primary records. [2025-09-26T22:22:56.082020] [DEBUG] [LOCAL ] IFN: Saving derivative data. [2025-09-26T22:22:56.085218] [DEBUG] [LOCAL ] IFF: Derivative data saved (1820 records). [2025-09-26T22:22:56.085599] [INFO ] [MAIN ] IFF: Successfully saved derivative data. [2025-09-26T22:22:56.089577] [INFO ] [MAIN ] Derivative Progress: 928/2074 symbols completed. IFF took 1.2s. Estimated remaining: 7m 59s. Rate: 143.5 symbols/min [2025-09-26T22:22:56.091230] [DEBUG] [LOCAL ] IEX: Derivative data saved (1820 records). [2025-09-26T22:22:56.091555] [INFO ] [MAIN ] IEX: Successfully saved derivative data. [2025-09-26T22:22:56.094218] [INFO ] [MAIN ] Derivative Progress: 929/2074 symbols completed. IEX took 1.3s. Estimated remaining: 7m 58s. Rate: 143.6 symbols/min [2025-09-26T22:22:56.111321] [DEBUG] [LOCAL ] IFN: Derivative data saved (1820 records). [2025-09-26T22:22:56.111442] [INFO ] [MAIN ] IFN: Successfully saved derivative data. [2025-09-26T22:22:56.115761] [INFO ] [MAIN ] Derivative Progress: 930/2074 symbols completed. IFN took 1.2s. Estimated remaining: 7m 57s. Rate: 143.8 symbols/min [2025-09-26T22:22:56.116594] [INFO ] [MAIN ] IFS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:56.116988] [INFO ] [MAIN ] IGA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:56.117157] [INFO ] [MAIN ] IGD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:56.137587] [DEBUG] [LOCAL ] IGA: Loaded 9779 existing records from primary storage. [2025-09-26T22:22:56.137819] [INFO ] [MAIN ] IGA: Loaded 9779 primary data records. [2025-09-26T22:22:56.173223] [DEBUG] [LOCAL ] IGD: Loaded 19170 existing records from primary storage. [2025-09-26T22:22:56.213539] [INFO ] [MAIN ] IGD: Loaded 19170 primary data records. [2025-09-26T22:22:56.301796] [DEBUG] [LOCAL ] IFS: Loaded 23359 existing records from primary storage. [2025-09-26T22:22:56.338484] [INFO ] [MAIN ] IFS: Loaded 23359 primary data records. [2025-09-26T22:22:57.271722] [DEBUG] [MAIN ] IGA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:57.274869] [INFO ] [MAIN ] IGA: Generated 1820 derivative records from 9779 primary records. [2025-09-26T22:22:57.275120] [DEBUG] [LOCAL ] IGA: Saving derivative data. [2025-09-26T22:22:57.302811] [DEBUG] [MAIN ] IGD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:57.308619] [INFO ] [MAIN ] IGD: Generated 1820 derivative records from 19170 primary records. [2025-09-26T22:22:57.309071] [DEBUG] [LOCAL ] IGD: Saving derivative data. [2025-09-26T22:22:57.312752] [DEBUG] [LOCAL ] IGA: Derivative data saved (1820 records). [2025-09-26T22:22:57.323493] [INFO ] [MAIN ] IGA: Successfully saved derivative data. [2025-09-26T22:22:57.328298] [INFO ] [MAIN ] Derivative Progress: 931/2074 symbols completed. IGA took 1.2s. Estimated remaining: 7m 58s. Rate: 143.5 symbols/min [2025-09-26T22:22:57.329099] [INFO ] [MAIN ] IGI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:57.345200] [DEBUG] [LOCAL ] IGD: Derivative data saved (1820 records). [2025-09-26T22:22:57.345721] [INFO ] [MAIN ] IGD: Successfully saved derivative data. [2025-09-26T22:22:57.349437] [INFO ] [MAIN ] Derivative Progress: 932/2074 symbols completed. IGD took 1.2s. Estimated remaining: 7m 57s. Rate: 143.6 symbols/min [2025-09-26T22:22:57.346159] [DEBUG] [MAIN ] IFS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:57.351425] [INFO ] [MAIN ] IFS: Generated 1820 derivative records from 23359 primary records. [2025-09-26T22:22:57.350154] [INFO ] [MAIN ] IGR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:57.353567] [DEBUG] [LOCAL ] IFS: Saving derivative data. [2025-09-26T22:22:57.370093] [DEBUG] [LOCAL ] IGI: Loaded 3756 existing records from primary storage. [2025-09-26T22:22:57.370850] [INFO ] [MAIN ] IGI: Loaded 3756 primary data records. [2025-09-26T22:22:57.510546] [DEBUG] [LOCAL ] IFS: Derivative data saved (1820 records). [2025-09-26T22:22:57.530357] [INFO ] [MAIN ] IFS: Successfully saved derivative data. [2025-09-26T22:22:57.541181] [INFO ] [MAIN ] Derivative Progress: 933/2074 symbols completed. IFS took 1.4s. Estimated remaining: 7m 56s. Rate: 143.7 symbols/min [2025-09-26T22:22:57.571690] [INFO ] [MAIN ] IH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:57.573177] [DEBUG] [LOCAL ] IGR: Loaded 30882 existing records from primary storage. [2025-09-26T22:22:57.605231] [INFO ] [MAIN ] IGR: Loaded 30882 primary data records. [2025-09-26T22:22:57.835613] [DEBUG] [LOCAL ] IH: Loaded 3450 existing records from primary storage. [2025-09-26T22:22:57.848679] [INFO ] [MAIN ] IH: Loaded 3450 primary data records. [2025-09-26T22:22:58.449253] [DEBUG] [MAIN ] IGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:58.451511] [INFO ] [MAIN ] IGI: Generated 1820 derivative records from 3756 primary records. [2025-09-26T22:22:58.451994] [DEBUG] [LOCAL ] IGI: Saving derivative data. [2025-09-26T22:22:58.486294] [DEBUG] [LOCAL ] IGI: Derivative data saved (1820 records). [2025-09-26T22:22:58.486048] [DEBUG] [MAIN ] IGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:58.487537] [INFO ] [MAIN ] IGR: Generated 1820 derivative records from 30882 primary records. [2025-09-26T22:22:58.486683] [INFO ] [MAIN ] IGI: Successfully saved derivative data. [2025-09-26T22:22:58.487932] [DEBUG] [LOCAL ] IGR: Saving derivative data. [2025-09-26T22:22:58.490503] [INFO ] [MAIN ] Derivative Progress: 934/2074 symbols completed. IGI took 1.2s. Estimated remaining: 7m 57s. Rate: 143.5 symbols/min [2025-09-26T22:22:58.492747] [INFO ] [MAIN ] IHD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:58.513713] [DEBUG] [LOCAL ] IGR: Derivative data saved (1820 records). [2025-09-26T22:22:58.514019] [INFO ] [MAIN ] IGR: Successfully saved derivative data. [2025-09-26T22:22:58.517133] [INFO ] [MAIN ] Derivative Progress: 935/2074 symbols completed. IGR took 1.2s. Estimated remaining: 7m 56s. Rate: 143.7 symbols/min [2025-09-26T22:22:58.534407] [DEBUG] [MAIN ] IH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:58.536080] [INFO ] [MAIN ] IH: Generated 1820 derivative records from 3450 primary records. [2025-09-26T22:22:58.534698] [INFO ] [MAIN ] IHG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:58.540399] [DEBUG] [LOCAL ] IH: Saving derivative data. [2025-09-26T22:22:58.541799] [DEBUG] [LOCAL ] IHD: Loaded 7225 existing records from primary storage. [2025-09-26T22:22:58.549187] [INFO ] [MAIN ] IHD: Loaded 7225 primary data records. [2025-09-26T22:22:58.563348] [DEBUG] [LOCAL ] IH: Derivative data saved (1820 records). [2025-09-26T22:22:58.571036] [INFO ] [MAIN ] IH: Successfully saved derivative data. [2025-09-26T22:22:58.579219] [INFO ] [MAIN ] Derivative Progress: 936/2074 symbols completed. IH took 1.0s. Estimated remaining: 7m 55s. Rate: 143.8 symbols/min [2025-09-26T22:22:58.597296] [INFO ] [MAIN ] IHS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:58.787164] [DEBUG] [LOCAL ] IHG: Loaded 24977 existing records from primary storage. [2025-09-26T22:22:58.899502] [INFO ] [MAIN ] IHG: Loaded 24977 primary data records. [2025-09-26T22:22:59.014004] [DEBUG] [LOCAL ] IHS: Loaded 39400 existing records from primary storage. [2025-09-26T22:22:59.032409] [INFO ] [MAIN ] IHS: Loaded 39400 primary data records. [2025-09-26T22:22:59.651550] [DEBUG] [MAIN ] IHD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:59.653978] [INFO ] [MAIN ] IHD: Generated 1820 derivative records from 7225 primary records. [2025-09-26T22:22:59.654491] [DEBUG] [LOCAL ] IHD: Saving derivative data. [2025-09-26T22:22:59.677164] [DEBUG] [LOCAL ] IHD: Derivative data saved (1820 records). [2025-09-26T22:22:59.677776] [INFO ] [MAIN ] IHD: Successfully saved derivative data. [2025-09-26T22:22:59.680527] [INFO ] [MAIN ] Derivative Progress: 937/2074 symbols completed. IHD took 1.2s. Estimated remaining: 7m 55s. Rate: 143.5 symbols/min [2025-09-26T22:22:59.688630] [INFO ] [MAIN ] IIF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:22:59.695378] [DEBUG] [MAIN ] IHG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:59.697146] [INFO ] [MAIN ] IHG: Generated 1820 derivative records from 24977 primary records. [2025-09-26T22:22:59.697499] [DEBUG] [LOCAL ] IHG: Saving derivative data. [2025-09-26T22:22:59.724787] [DEBUG] [LOCAL ] IIF: Loaded 5787 existing records from primary storage. [2025-09-26T22:22:59.725589] [INFO ] [MAIN ] IIF: Loaded 5787 primary data records. [2025-09-26T22:22:59.776800] [DEBUG] [MAIN ] IHS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:22:59.822408] [INFO ] [MAIN ] IHS: Generated 1820 derivative records from 39400 primary records. [2025-09-26T22:22:59.850173] [DEBUG] [LOCAL ] IHS: Saving derivative data. [2025-09-26T22:22:59.865568] [DEBUG] [LOCAL ] IHG: Derivative data saved (1820 records). [2025-09-26T22:22:59.866142] [INFO ] [MAIN ] IHG: Successfully saved derivative data. [2025-09-26T22:22:59.869601] [INFO ] [MAIN ] Derivative Progress: 938/2074 symbols completed. IHG took 1.3s. Estimated remaining: 7m 55s. Rate: 143.6 symbols/min [2025-09-26T22:22:59.896911] [INFO ] [MAIN ] IIIN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:00.101499] [DEBUG] [LOCAL ] IHS: Derivative data saved (1820 records). [2025-09-26T22:23:00.101819] [INFO ] [MAIN ] IHS: Successfully saved derivative data. [2025-09-26T22:23:00.107461] [INFO ] [MAIN ] Derivative Progress: 939/2074 symbols completed. IHS took 1.5s. Estimated remaining: 7m 54s. Rate: 143.7 symbols/min [2025-09-26T22:23:00.108081] [INFO ] [MAIN ] IIM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:00.118033] [DEBUG] [LOCAL ] IIIN: Loaded 16828 existing records from primary storage. [2025-09-26T22:23:00.118777] [INFO ] [MAIN ] IIIN: Loaded 16828 primary data records. [2025-09-26T22:23:00.261282] [DEBUG] [LOCAL ] IIM: Loaded 16102 existing records from primary storage. [2025-09-26T22:23:00.271959] [INFO ] [MAIN ] IIM: Loaded 16102 primary data records. [2025-09-26T22:23:00.825359] [DEBUG] [MAIN ] IIF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:00.828024] [INFO ] [MAIN ] IIF: Generated 1820 derivative records from 5787 primary records. [2025-09-26T22:23:00.828204] [DEBUG] [LOCAL ] IIF: Saving derivative data. [2025-09-26T22:23:00.852591] [DEBUG] [LOCAL ] IIF: Derivative data saved (1820 records). [2025-09-26T22:23:00.853000] [INFO ] [MAIN ] IIF: Successfully saved derivative data. [2025-09-26T22:23:00.856216] [INFO ] [MAIN ] Derivative Progress: 940/2074 symbols completed. IIF took 1.2s. Estimated remaining: 7m 54s. Rate: 143.6 symbols/min [2025-09-26T22:23:00.856881] [INFO ] [MAIN ] IIPR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:00.878081] [DEBUG] [MAIN ] IIIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:00.879422] [INFO ] [MAIN ] IIIN: Generated 1820 derivative records from 16828 primary records. [2025-09-26T22:23:00.879777] [DEBUG] [LOCAL ] IIIN: Saving derivative data. [2025-09-26T22:23:00.909850] [DEBUG] [LOCAL ] IIIN: Derivative data saved (1820 records). [2025-09-26T22:23:00.910247] [INFO ] [MAIN ] IIIN: Successfully saved derivative data. [2025-09-26T22:23:00.913238] [INFO ] [MAIN ] Derivative Progress: 941/2074 symbols completed. IIIN took 1.0s. Estimated remaining: 7m 53s. Rate: 143.7 symbols/min [2025-09-26T22:23:00.927973] [INFO ] [MAIN ] IMAX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:00.927797] [DEBUG] [MAIN ] IIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:00.929329] [INFO ] [MAIN ] IIM: Generated 1820 derivative records from 16102 primary records. [2025-09-26T22:23:00.929443] [DEBUG] [LOCAL ] IIM: Saving derivative data. [2025-09-26T22:23:00.957446] [DEBUG] [LOCAL ] IIPR: Loaded 30052 existing records from primary storage. [2025-09-26T22:23:00.958300] [INFO ] [MAIN ] IIPR: Loaded 30052 primary data records. [2025-09-26T22:23:00.994961] [DEBUG] [LOCAL ] IIM: Derivative data saved (1820 records). [2025-09-26T22:23:01.001692] [INFO ] [MAIN ] IIM: Successfully saved derivative data. [2025-09-26T22:23:01.011529] [INFO ] [MAIN ] Derivative Progress: 942/2074 symbols completed. IIM took 0.9s. Estimated remaining: 7m 52s. Rate: 143.8 symbols/min [2025-09-26T22:23:01.052864] [INFO ] [MAIN ] INFA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:01.362431] [DEBUG] [LOCAL ] IMAX: Loaded 43382 existing records from primary storage. [2025-09-26T22:23:01.363836] [INFO ] [MAIN ] IMAX: Loaded 43382 primary data records. [2025-09-26T22:23:01.618840] [DEBUG] [LOCAL ] INFA: Loaded 50602 existing records from primary storage. [2025-09-26T22:23:01.631823] [INFO ] [MAIN ] INFA: Loaded 50602 primary data records. [2025-09-26T22:23:01.994851] [DEBUG] [MAIN ] IIPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:01.996200] [INFO ] [MAIN ] IIPR: Generated 1820 derivative records from 30052 primary records. [2025-09-26T22:23:02.107676] [DEBUG] [LOCAL ] IIPR: Saving derivative data. [2025-09-26T22:23:02.160271] [DEBUG] [LOCAL ] IIPR: Derivative data saved (1820 records). [2025-09-26T22:23:02.160799] [DEBUG] [MAIN ] IMAX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:02.161030] [INFO ] [MAIN ] IIPR: Successfully saved derivative data. [2025-09-26T22:23:02.163496] [INFO ] [MAIN ] Derivative Progress: 943/2074 symbols completed. IIPR took 1.3s. Estimated remaining: 7m 53s. Rate: 143.6 symbols/min [2025-09-26T22:23:02.164365] [INFO ] [MAIN ] IMAX: Generated 1820 derivative records from 43382 primary records. [2025-09-26T22:23:02.164515] [DEBUG] [LOCAL ] IMAX: Saving derivative data. [2025-09-26T22:23:02.183720] [DEBUG] [LOCAL ] IMAX: Derivative data saved (1820 records). [2025-09-26T22:23:02.183961] [INFO ] [MAIN ] IMAX: Successfully saved derivative data. [2025-09-26T22:23:02.186683] [INFO ] [MAIN ] Derivative Progress: 944/2074 symbols completed. IMAX took 1.3s. Estimated remaining: 7m 52s. Rate: 143.7 symbols/min [2025-09-26T22:23:02.207077] [DEBUG] [MAIN ] INFA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:02.207817] [INFO ] [MAIN ] INFA: Generated 1820 derivative records from 50602 primary records. [2025-09-26T22:23:02.207882] [DEBUG] [LOCAL ] INFA: Saving derivative data. [2025-09-26T22:23:02.225095] [DEBUG] [LOCAL ] INFA: Derivative data saved (1820 records). [2025-09-26T22:23:02.225212] [INFO ] [MAIN ] INFA: Successfully saved derivative data. [2025-09-26T22:23:02.228126] [INFO ] [MAIN ] Derivative Progress: 945/2074 symbols completed. INFA took 1.2s. Estimated remaining: 7m 51s. Rate: 143.8 symbols/min [2025-09-26T22:23:02.228922] [INFO ] [MAIN ] INFY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:02.229109] [INFO ] [MAIN ] INGM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:02.229803] [INFO ] [MAIN ] ING: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:02.262103] [DEBUG] [LOCAL ] INGM: Loaded 29224 existing records from primary storage. [2025-09-26T22:23:02.262372] [INFO ] [MAIN ] INGM: Loaded 29224 primary data records. [2025-09-26T22:23:02.441873] [DEBUG] [LOCAL ] ING: Loaded 51537 existing records from primary storage. [2025-09-26T22:23:02.454485] [DEBUG] [LOCAL ] INFY: Loaded 54378 existing records from primary storage. [2025-09-26T22:23:02.454613] [INFO ] [MAIN ] ING: Loaded 51537 primary data records. [2025-09-26T22:23:02.470679] [INFO ] [MAIN ] INFY: Loaded 54378 primary data records. [2025-09-26T22:23:03.392669] [DEBUG] [MAIN ] INGM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:03.394145] [INFO ] [MAIN ] INGM: Generated 1820 derivative records from 29224 primary records. [2025-09-26T22:23:03.394601] [DEBUG] [LOCAL ] INGM: Saving derivative data. [2025-09-26T22:23:03.433165] [DEBUG] [LOCAL ] INGM: Derivative data saved (1820 records). [2025-09-26T22:23:03.442421] [INFO ] [MAIN ] INGM: Successfully saved derivative data. [2025-09-26T22:23:03.450402] [INFO ] [MAIN ] Derivative Progress: 946/2074 symbols completed. INGM took 1.2s. Estimated remaining: 7m 51s. Rate: 143.5 symbols/min [2025-09-26T22:23:03.448362] [DEBUG] [MAIN ] ING: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:03.450851] [DEBUG] [MAIN ] INFY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:03.452194] [INFO ] [MAIN ] ING: Generated 1820 derivative records from 51537 primary records. [2025-09-26T22:23:03.453342] [INFO ] [MAIN ] INFY: Generated 1820 derivative records from 54378 primary records. [2025-09-26T22:23:03.452326] [DEBUG] [LOCAL ] ING: Saving derivative data. [2025-09-26T22:23:03.452393] [INFO ] [MAIN ] INGR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:03.454884] [DEBUG] [LOCAL ] INFY: Saving derivative data. [2025-09-26T22:23:03.484066] [DEBUG] [LOCAL ] ING: Derivative data saved (1820 records). [2025-09-26T22:23:03.484548] [INFO ] [MAIN ] ING: Successfully saved derivative data. [2025-09-26T22:23:03.488114] [INFO ] [MAIN ] Derivative Progress: 947/2074 symbols completed. ING took 1.3s. Estimated remaining: 7m 51s. Rate: 143.7 symbols/min [2025-09-26T22:23:03.488446] [INFO ] [MAIN ] INN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:03.493451] [DEBUG] [LOCAL ] INFY: Derivative data saved (1820 records). [2025-09-26T22:23:03.493607] [INFO ] [MAIN ] INFY: Successfully saved derivative data. [2025-09-26T22:23:03.496550] [INFO ] [MAIN ] Derivative Progress: 948/2074 symbols completed. INFY took 1.3s. Estimated remaining: 7m 50s. Rate: 143.8 symbols/min [2025-09-26T22:23:03.496891] [INFO ] [MAIN ] INSP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:03.560634] [DEBUG] [LOCAL ] INN: Loaded 42433 existing records from primary storage. [2025-09-26T22:23:03.562120] [INFO ] [MAIN ] INN: Loaded 42433 primary data records. [2025-09-26T22:23:03.561469] [DEBUG] [LOCAL ] INGR: Loaded 33913 existing records from primary storage. [2025-09-26T22:23:03.577255] [INFO ] [MAIN ] INGR: Loaded 33913 primary data records. [2025-09-26T22:23:03.664789] [DEBUG] [LOCAL ] INSP: Loaded 37492 existing records from primary storage. [2025-09-26T22:23:03.698197] [INFO ] [MAIN ] INSP: Loaded 37492 primary data records. [2025-09-26T22:23:04.643587] [DEBUG] [MAIN ] INGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:04.646407] [INFO ] [MAIN ] INGR: Generated 1820 derivative records from 33913 primary records. [2025-09-26T22:23:04.646622] [DEBUG] [LOCAL ] INGR: Saving derivative data. [2025-09-26T22:23:04.674576] [DEBUG] [MAIN ] INN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:04.679217] [INFO ] [MAIN ] INN: Generated 1820 derivative records from 42433 primary records. [2025-09-26T22:23:04.680638] [DEBUG] [LOCAL ] INN: Saving derivative data. [2025-09-26T22:23:04.710698] [DEBUG] [LOCAL ] INGR: Derivative data saved (1820 records). [2025-09-26T22:23:04.714508] [DEBUG] [MAIN ] INSP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:04.716874] [INFO ] [MAIN ] INSP: Generated 1820 derivative records from 37492 primary records. [2025-09-26T22:23:04.715048] [INFO ] [MAIN ] INGR: Successfully saved derivative data. [2025-09-26T22:23:04.719986] [INFO ] [MAIN ] Derivative Progress: 949/2074 symbols completed. INGR took 1.3s. Estimated remaining: 7m 50s. Rate: 143.5 symbols/min [2025-09-26T22:23:04.717297] [DEBUG] [LOCAL ] INN: Derivative data saved (1820 records). [2025-09-26T22:23:04.720527] [INFO ] [MAIN ] INN: Successfully saved derivative data. [2025-09-26T22:23:04.717379] [DEBUG] [LOCAL ] INSP: Saving derivative data. [2025-09-26T22:23:04.725184] [INFO ] [MAIN ] INSW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:04.725019] [INFO ] [MAIN ] Derivative Progress: 950/2074 symbols completed. INN took 1.2s. Estimated remaining: 7m 49s. Rate: 143.7 symbols/min [2025-09-26T22:23:04.735154] [INFO ] [MAIN ] INVH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:04.746203] [DEBUG] [LOCAL ] INSP: Derivative data saved (1820 records). [2025-09-26T22:23:04.746343] [INFO ] [MAIN ] INSP: Successfully saved derivative data. [2025-09-26T22:23:04.750797] [INFO ] [MAIN ] Derivative Progress: 951/2074 symbols completed. INSP took 1.3s. Estimated remaining: 7m 48s. Rate: 143.8 symbols/min [2025-09-26T22:23:04.751269] [INFO ] [MAIN ] INVX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:04.817611] [DEBUG] [LOCAL ] INSW: Loaded 40831 existing records from primary storage. [2025-09-26T22:23:04.819165] [INFO ] [MAIN ] INSW: Loaded 40831 primary data records. [2025-09-26T22:23:04.833097] [DEBUG] [LOCAL ] INVX: Loaded 29366 existing records from primary storage. [2025-09-26T22:23:04.844503] [INFO ] [MAIN ] INVX: Loaded 29366 primary data records. [2025-09-26T22:23:04.935614] [DEBUG] [LOCAL ] INVH: Loaded 53918 existing records from primary storage. [2025-09-26T22:23:04.991589] [INFO ] [MAIN ] INVH: Loaded 53918 primary data records. [2025-09-26T22:23:05.923917] [DEBUG] [MAIN ] INSW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:05.926880] [INFO ] [MAIN ] INSW: Generated 1820 derivative records from 40831 primary records. [2025-09-26T22:23:05.929012] [DEBUG] [LOCAL ] INSW: Saving derivative data. [2025-09-26T22:23:05.973710] [DEBUG] [MAIN ] INVX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:05.975505] [INFO ] [MAIN ] INVX: Generated 1820 derivative records from 29366 primary records. [2025-09-26T22:23:05.975992] [DEBUG] [LOCAL ] INVX: Saving derivative data. [2025-09-26T22:23:05.974609] [DEBUG] [MAIN ] INVH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:05.977518] [INFO ] [MAIN ] INVH: Generated 1820 derivative records from 53918 primary records. [2025-09-26T22:23:05.979271] [DEBUG] [LOCAL ] INVH: Saving derivative data. [2025-09-26T22:23:06.010246] [DEBUG] [LOCAL ] INSW: Derivative data saved (1820 records). [2025-09-26T22:23:06.011383] [INFO ] [MAIN ] INSW: Successfully saved derivative data. [2025-09-26T22:23:06.013863] [INFO ] [MAIN ] Derivative Progress: 952/2074 symbols completed. INSW took 1.3s. Estimated remaining: 7m 49s. Rate: 143.5 symbols/min [2025-09-26T22:23:06.014835] [INFO ] [MAIN ] IONQ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:06.020570] [DEBUG] [LOCAL ] INVX: Derivative data saved (1820 records). [2025-09-26T22:23:06.020834] [INFO ] [MAIN ] INVX: Successfully saved derivative data. [2025-09-26T22:23:06.024716] [INFO ] [MAIN ] Derivative Progress: 953/2074 symbols completed. INVX took 1.3s. Estimated remaining: 7m 48s. Rate: 143.7 symbols/min [2025-09-26T22:23:06.020230] [DEBUG] [LOCAL ] INVH: Derivative data saved (1820 records). [2025-09-26T22:23:06.025183] [INFO ] [MAIN ] IOT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:06.025298] [INFO ] [MAIN ] INVH: Successfully saved derivative data. [2025-09-26T22:23:06.029599] [INFO ] [MAIN ] Derivative Progress: 954/2074 symbols completed. INVH took 1.3s. Estimated remaining: 7m 47s. Rate: 143.8 symbols/min [2025-09-26T22:23:06.030043] [INFO ] [MAIN ] IP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:06.113690] [DEBUG] [LOCAL ] IONQ: Loaded 54568 existing records from primary storage. [2025-09-26T22:23:06.128177] [INFO ] [MAIN ] IONQ: Loaded 54568 primary data records. [2025-09-26T22:23:06.186242] [DEBUG] [LOCAL ] IP: Loaded 54093 existing records from primary storage. [2025-09-26T22:23:06.200410] [DEBUG] [LOCAL ] IOT: Loaded 54249 existing records from primary storage. [2025-09-26T22:23:06.210086] [INFO ] [MAIN ] IP: Loaded 54093 primary data records. [2025-09-26T22:23:06.210251] [INFO ] [MAIN ] IOT: Loaded 54249 primary data records. [2025-09-26T22:23:07.183233] [DEBUG] [MAIN ] IONQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:07.184318] [INFO ] [MAIN ] IONQ: Generated 1820 derivative records from 54568 primary records. [2025-09-26T22:23:07.184785] [DEBUG] [LOCAL ] IONQ: Saving derivative data. [2025-09-26T22:23:07.203223] [DEBUG] [LOCAL ] IONQ: Derivative data saved (1820 records). [2025-09-26T22:23:07.204430] [INFO ] [MAIN ] IONQ: Successfully saved derivative data. [2025-09-26T22:23:07.207220] [INFO ] [MAIN ] Derivative Progress: 955/2074 symbols completed. IONQ took 1.2s. Estimated remaining: 7m 48s. Rate: 143.5 symbols/min [2025-09-26T22:23:07.209008] [INFO ] [MAIN ] IPG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:07.225092] [DEBUG] [MAIN ] IP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:07.226238] [INFO ] [MAIN ] IP: Generated 1820 derivative records from 54093 primary records. [2025-09-26T22:23:07.238433] [DEBUG] [LOCAL ] IP: Saving derivative data. [2025-09-26T22:23:07.240223] [DEBUG] [MAIN ] IOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:07.241733] [INFO ] [MAIN ] IOT: Generated 1820 derivative records from 54249 primary records. [2025-09-26T22:23:07.249103] [DEBUG] [LOCAL ] IOT: Saving derivative data. [2025-09-26T22:23:07.272933] [DEBUG] [LOCAL ] IP: Derivative data saved (1820 records). [2025-09-26T22:23:07.274278] [INFO ] [MAIN ] IP: Successfully saved derivative data. [2025-09-26T22:23:07.279079] [INFO ] [MAIN ] Derivative Progress: 956/2074 symbols completed. IP took 1.2s. Estimated remaining: 7m 47s. Rate: 143.7 symbols/min [2025-09-26T22:23:07.280435] [INFO ] [MAIN ] IPI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:07.284359] [DEBUG] [LOCAL ] IOT: Derivative data saved (1820 records). [2025-09-26T22:23:07.284547] [INFO ] [MAIN ] IOT: Successfully saved derivative data. [2025-09-26T22:23:07.287176] [INFO ] [MAIN ] Derivative Progress: 957/2074 symbols completed. IOT took 1.3s. Estimated remaining: 7m 46s. Rate: 143.8 symbols/min [2025-09-26T22:23:07.287562] [INFO ] [MAIN ] IQI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:07.326225] [DEBUG] [LOCAL ] IPI: Loaded 21704 existing records from primary storage. [2025-09-26T22:23:07.326467] [INFO ] [MAIN ] IPI: Loaded 21704 primary data records. [2025-09-26T22:23:07.430281] [DEBUG] [LOCAL ] IQI: Loaded 18161 existing records from primary storage. [2025-09-26T22:23:07.470563] [INFO ] [MAIN ] IQI: Loaded 18161 primary data records. [2025-09-26T22:23:07.470023] [DEBUG] [LOCAL ] IPG: Loaded 54110 existing records from primary storage. [2025-09-26T22:23:07.481579] [INFO ] [MAIN ] IPG: Loaded 54110 primary data records. [2025-09-26T22:23:08.412724] [DEBUG] [MAIN ] IPI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:08.414852] [INFO ] [MAIN ] IPI: Generated 1820 derivative records from 21704 primary records. [2025-09-26T22:23:08.415733] [DEBUG] [LOCAL ] IPI: Saving derivative data. [2025-09-26T22:23:08.467153] [DEBUG] [MAIN ] IPG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:08.469259] [DEBUG] [MAIN ] IQI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:08.471194] [INFO ] [MAIN ] IPG: Generated 1820 derivative records from 54110 primary records. [2025-09-26T22:23:08.473796] [INFO ] [MAIN ] IQI: Generated 1820 derivative records from 18161 primary records. [2025-09-26T22:23:08.474378] [DEBUG] [LOCAL ] IQI: Saving derivative data. [2025-09-26T22:23:08.474458] [DEBUG] [LOCAL ] IPG: Saving derivative data. [2025-09-26T22:23:08.486823] [DEBUG] [LOCAL ] IPI: Derivative data saved (1820 records). [2025-09-26T22:23:08.499502] [INFO ] [MAIN ] IPI: Successfully saved derivative data. [2025-09-26T22:23:08.504388] [INFO ] [MAIN ] Derivative Progress: 958/2074 symbols completed. IPI took 1.2s. Estimated remaining: 7m 47s. Rate: 143.5 symbols/min [2025-09-26T22:23:08.513268] [DEBUG] [LOCAL ] IPG: Derivative data saved (1820 records). [2025-09-26T22:23:08.514063] [INFO ] [MAIN ] IPG: Successfully saved derivative data. [2025-09-26T22:23:08.517177] [INFO ] [MAIN ] Derivative Progress: 959/2074 symbols completed. IPG took 1.3s. Estimated remaining: 7m 46s. Rate: 143.7 symbols/min [2025-09-26T22:23:08.522354] [DEBUG] [LOCAL ] IQI: Derivative data saved (1820 records). [2025-09-26T22:23:08.522524] [INFO ] [MAIN ] IQI: Successfully saved derivative data. [2025-09-26T22:23:08.525406] [INFO ] [MAIN ] Derivative Progress: 960/2074 symbols completed. IQI took 1.2s. Estimated remaining: 7m 45s. Rate: 143.8 symbols/min [2025-09-26T22:23:08.526202] [INFO ] [MAIN ] IQV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:08.527241] [INFO ] [MAIN ] IRM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:08.527143] [INFO ] [MAIN ] IR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:08.635562] [DEBUG] [LOCAL ] IRM: Loaded 50159 existing records from primary storage. [2025-09-26T22:23:08.638158] [INFO ] [MAIN ] IRM: Loaded 50159 primary data records. [2025-09-26T22:23:08.644909] [DEBUG] [LOCAL ] IR: Loaded 53470 existing records from primary storage. [2025-09-26T22:23:08.670438] [INFO ] [MAIN ] IR: Loaded 53470 primary data records. [2025-09-26T22:23:08.830816] [DEBUG] [LOCAL ] IQV: Loaded 50895 existing records from primary storage. [2025-09-26T22:23:08.869590] [INFO ] [MAIN ] IQV: Loaded 50895 primary data records. [2025-09-26T22:23:09.767327] [DEBUG] [MAIN ] IRM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:09.768377] [DEBUG] [MAIN ] IR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:09.770052] [INFO ] [MAIN ] IRM: Generated 1820 derivative records from 50159 primary records. [2025-09-26T22:23:09.770193] [DEBUG] [LOCAL ] IRM: Saving derivative data. [2025-09-26T22:23:09.774053] [INFO ] [MAIN ] IR: Generated 1820 derivative records from 53470 primary records. [2025-09-26T22:23:09.782812] [DEBUG] [LOCAL ] IR: Saving derivative data. [2025-09-26T22:23:09.816351] [DEBUG] [MAIN ] IQV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:09.820684] [INFO ] [MAIN ] IQV: Generated 1820 derivative records from 50895 primary records. [2025-09-26T22:23:09.821072] [DEBUG] [LOCAL ] IQV: Saving derivative data. [2025-09-26T22:23:09.826009] [DEBUG] [LOCAL ] IR: Derivative data saved (1820 records). [2025-09-26T22:23:09.826279] [INFO ] [MAIN ] IR: Successfully saved derivative data. [2025-09-26T22:23:09.828239] [INFO ] [MAIN ] Derivative Progress: 961/2074 symbols completed. IR took 1.3s. Estimated remaining: 7m 45s. Rate: 143.5 symbols/min [2025-09-26T22:23:09.837079] [INFO ] [MAIN ] IRS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:09.845297] [DEBUG] [LOCAL ] IRM: Derivative data saved (1820 records). [2025-09-26T22:23:09.847622] [DEBUG] [LOCAL ] IQV: Derivative data saved (1820 records). [2025-09-26T22:23:09.847885] [INFO ] [MAIN ] IRM: Successfully saved derivative data. [2025-09-26T22:23:09.848015] [INFO ] [MAIN ] IQV: Successfully saved derivative data. [2025-09-26T22:23:09.850886] [INFO ] [MAIN ] Derivative Progress: 962/2074 symbols completed. IRM took 1.3s. Estimated remaining: 7m 44s. Rate: 143.6 symbols/min [2025-09-26T22:23:09.855972] [INFO ] [MAIN ] Derivative Progress: 963/2074 symbols completed. IQV took 1.3s. Estimated remaining: 7m 44s. Rate: 143.8 symbols/min [2025-09-26T22:23:09.856117] [INFO ] [MAIN ] IRT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:09.856862] [INFO ] [MAIN ] ISD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:09.895610] [DEBUG] [LOCAL ] IRS: Loaded 22136 existing records from primary storage. [2025-09-26T22:23:09.896487] [DEBUG] [LOCAL ] ISD: Loaded 15803 existing records from primary storage. [2025-09-26T22:23:09.896792] [INFO ] [MAIN ] IRS: Loaded 22136 primary data records. [2025-09-26T22:23:09.896935] [INFO ] [MAIN ] ISD: Loaded 15803 primary data records. [2025-09-26T22:23:10.292136] [DEBUG] [LOCAL ] IRT: Loaded 51146 existing records from primary storage. [2025-09-26T22:23:10.612515] [INFO ] [MAIN ] IRT: Loaded 51146 primary data records. [2025-09-26T22:23:10.997027] [DEBUG] [MAIN ] IRS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:10.996484] [DEBUG] [MAIN ] ISD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:10.999608] [INFO ] [MAIN ] IRS: Generated 1820 derivative records from 22136 primary records. [2025-09-26T22:23:11.000409] [INFO ] [MAIN ] ISD: Generated 1820 derivative records from 15803 primary records. [2025-09-26T22:23:11.000605] [DEBUG] [LOCAL ] ISD: Saving derivative data. [2025-09-26T22:23:11.001829] [DEBUG] [LOCAL ] IRS: Saving derivative data. [2025-09-26T22:23:11.038184] [DEBUG] [LOCAL ] ISD: Derivative data saved (1820 records). [2025-09-26T22:23:11.038884] [INFO ] [MAIN ] ISD: Successfully saved derivative data. [2025-09-26T22:23:11.040778] [INFO ] [MAIN ] Derivative Progress: 964/2074 symbols completed. ISD took 1.2s. Estimated remaining: 7m 44s. Rate: 143.5 symbols/min [2025-09-26T22:23:11.042385] [DEBUG] [LOCAL ] IRS: Derivative data saved (1820 records). [2025-09-26T22:23:11.043442] [INFO ] [MAIN ] IRS: Successfully saved derivative data. [2025-09-26T22:23:11.043107] [INFO ] [MAIN ] IT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:11.046495] [INFO ] [MAIN ] Derivative Progress: 965/2074 symbols completed. IRS took 1.2s. Estimated remaining: 7m 43s. Rate: 143.7 symbols/min [2025-09-26T22:23:11.048519] [INFO ] [MAIN ] ITGR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:11.066228] [DEBUG] [MAIN ] IRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:11.067128] [INFO ] [MAIN ] IRT: Generated 1820 derivative records from 51146 primary records. [2025-09-26T22:23:11.067285] [DEBUG] [LOCAL ] IRT: Saving derivative data. [2025-09-26T22:23:11.086360] [DEBUG] [LOCAL ] IRT: Derivative data saved (1820 records). [2025-09-26T22:23:11.098717] [INFO ] [MAIN ] IRT: Successfully saved derivative data. [2025-09-26T22:23:11.101680] [INFO ] [MAIN ] Derivative Progress: 966/2074 symbols completed. IRT took 1.2s. Estimated remaining: 7m 42s. Rate: 143.8 symbols/min [2025-09-26T22:23:11.110628] [INFO ] [MAIN ] ITT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:11.137494] [DEBUG] [LOCAL ] ITGR: Loaded 31996 existing records from primary storage. [2025-09-26T22:23:11.139381] [INFO ] [MAIN ] ITGR: Loaded 31996 primary data records. [2025-09-26T22:23:11.140121] [DEBUG] [LOCAL ] IT: Loaded 42234 existing records from primary storage. [2025-09-26T22:23:11.140354] [INFO ] [MAIN ] IT: Loaded 42234 primary data records. [2025-09-26T22:23:11.454575] [DEBUG] [LOCAL ] ITT: Loaded 33511 existing records from primary storage. [2025-09-26T22:23:11.491749] [INFO ] [MAIN ] ITT: Loaded 33511 primary data records. [2025-09-26T22:23:12.425848] [DEBUG] [MAIN ] ITGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:12.427258] [INFO ] [MAIN ] ITGR: Generated 1820 derivative records from 31996 primary records. [2025-09-26T22:23:12.428410] [DEBUG] [MAIN ] IT: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:23:12.430930] [INFO ] [MAIN ] IT: Generated 1819 derivative records from 42234 primary records. [2025-09-26T22:23:12.431235] [DEBUG] [LOCAL ] IT: Saving derivative data. [2025-09-26T22:23:12.429855] [DEBUG] [LOCAL ] ITGR: Saving derivative data. [2025-09-26T22:23:12.476391] [DEBUG] [LOCAL ] ITGR: Derivative data saved (1820 records). [2025-09-26T22:23:12.477039] [INFO ] [MAIN ] ITGR: Successfully saved derivative data. [2025-09-26T22:23:12.480158] [INFO ] [MAIN ] Derivative Progress: 967/2074 symbols completed. ITGR took 1.4s. Estimated remaining: 7m 43s. Rate: 143.5 symbols/min [2025-09-26T22:23:12.482132] [INFO ] [MAIN ] ITUB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:12.483837] [DEBUG] [LOCAL ] IT: Derivative data saved (1819 records). [2025-09-26T22:23:12.484264] [INFO ] [MAIN ] IT: Successfully saved derivative data. [2025-09-26T22:23:12.487950] [INFO ] [MAIN ] Derivative Progress: 968/2074 symbols completed. IT took 1.4s. Estimated remaining: 7m 42s. Rate: 143.6 symbols/min [2025-09-26T22:23:12.488918] [INFO ] [MAIN ] ITW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:12.516372] [DEBUG] [MAIN ] ITT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:12.517547] [INFO ] [MAIN ] ITT: Generated 1820 derivative records from 33511 primary records. [2025-09-26T22:23:12.517834] [DEBUG] [LOCAL ] ITT: Saving derivative data. [2025-09-26T22:23:12.549093] [DEBUG] [LOCAL ] ITT: Derivative data saved (1820 records). [2025-09-26T22:23:12.549407] [INFO ] [MAIN ] ITT: Successfully saved derivative data. [2025-09-26T22:23:12.552693] [INFO ] [MAIN ] Derivative Progress: 969/2074 symbols completed. ITT took 1.5s. Estimated remaining: 7m 41s. Rate: 143.7 symbols/min [2025-09-26T22:23:12.553413] [INFO ] [MAIN ] IVR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:12.605876] [DEBUG] [LOCAL ] ITUB: Loaded 54084 existing records from primary storage. [2025-09-26T22:23:12.617927] [INFO ] [MAIN ] ITUB: Loaded 54084 primary data records. [2025-09-26T22:23:12.638797] [DEBUG] [LOCAL ] ITW: Loaded 46782 existing records from primary storage. [2025-09-26T22:23:12.663202] [INFO ] [MAIN ] ITW: Loaded 46782 primary data records. [2025-09-26T22:23:13.006259] [DEBUG] [LOCAL ] IVR: Loaded 48557 existing records from primary storage. [2025-09-26T22:23:13.026751] [INFO ] [MAIN ] IVR: Loaded 48557 primary data records. [2025-09-26T22:23:13.782106] [DEBUG] [MAIN ] ITUB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:13.783257] [INFO ] [MAIN ] ITUB: Generated 1820 derivative records from 54084 primary records. [2025-09-26T22:23:13.783512] [DEBUG] [LOCAL ] ITUB: Saving derivative data. [2025-09-26T22:23:13.809681] [DEBUG] [MAIN ] ITW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:13.817008] [INFO ] [MAIN ] ITW: Generated 1820 derivative records from 46782 primary records. [2025-09-26T22:23:13.827381] [DEBUG] [LOCAL ] ITUB: Derivative data saved (1820 records). [2025-09-26T22:23:13.832365] [DEBUG] [LOCAL ] ITW: Saving derivative data. [2025-09-26T22:23:13.832466] [INFO ] [MAIN ] ITUB: Successfully saved derivative data. [2025-09-26T22:23:13.834944] [INFO ] [MAIN ] Derivative Progress: 970/2074 symbols completed. ITUB took 1.4s. Estimated remaining: 7m 42s. Rate: 143.4 symbols/min [2025-09-26T22:23:13.836111] [INFO ] [MAIN ] IVT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:13.836968] [DEBUG] [MAIN ] IVR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:13.847006] [INFO ] [MAIN ] IVR: Generated 1820 derivative records from 48557 primary records. [2025-09-26T22:23:13.851712] [DEBUG] [LOCAL ] IVR: Saving derivative data. [2025-09-26T22:23:13.873857] [DEBUG] [LOCAL ] ITW: Derivative data saved (1820 records). [2025-09-26T22:23:13.874392] [INFO ] [MAIN ] ITW: Successfully saved derivative data. [2025-09-26T22:23:13.878393] [INFO ] [MAIN ] Derivative Progress: 971/2074 symbols completed. ITW took 1.4s. Estimated remaining: 7m 41s. Rate: 143.6 symbols/min [2025-09-26T22:23:13.879363] [INFO ] [MAIN ] IVZ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:13.880671] [DEBUG] [LOCAL ] IVR: Derivative data saved (1820 records). [2025-09-26T22:23:13.881037] [INFO ] [MAIN ] IVR: Successfully saved derivative data. [2025-09-26T22:23:13.884183] [INFO ] [MAIN ] Derivative Progress: 972/2074 symbols completed. IVR took 1.3s. Estimated remaining: 7m 40s. Rate: 143.7 symbols/min [2025-09-26T22:23:13.884821] [INFO ] [MAIN ] IX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:13.909887] [DEBUG] [LOCAL ] IVT: Loaded 31325 existing records from primary storage. [2025-09-26T22:23:13.911182] [INFO ] [MAIN ] IVT: Loaded 31325 primary data records. [2025-09-26T22:23:14.020220] [DEBUG] [LOCAL ] IX: Loaded 22926 existing records from primary storage. [2025-09-26T22:23:14.033527] [INFO ] [MAIN ] IX: Loaded 22926 primary data records. [2025-09-26T22:23:14.370493] [DEBUG] [LOCAL ] IVZ: Loaded 53908 existing records from primary storage. [2025-09-26T22:23:14.458736] [INFO ] [MAIN ] IVZ: Loaded 53908 primary data records. [2025-09-26T22:23:15.114676] [DEBUG] [MAIN ] IVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:15.116521] [INFO ] [MAIN ] IVT: Generated 1820 derivative records from 31325 primary records. [2025-09-26T22:23:15.117046] [DEBUG] [LOCAL ] IVT: Saving derivative data. [2025-09-26T22:23:15.167713] [DEBUG] [LOCAL ] IVT: Derivative data saved (1820 records). [2025-09-26T22:23:15.166815] [DEBUG] [MAIN ] IX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:15.169266] [INFO ] [MAIN ] IX: Generated 1820 derivative records from 22926 primary records. [2025-09-26T22:23:15.168109] [INFO ] [MAIN ] IVT: Successfully saved derivative data. [2025-09-26T22:23:15.171665] [INFO ] [MAIN ] Derivative Progress: 973/2074 symbols completed. IVT took 1.3s. Estimated remaining: 7m 41s. Rate: 143.4 symbols/min [2025-09-26T22:23:15.171853] [DEBUG] [LOCAL ] IX: Saving derivative data. [2025-09-26T22:23:15.214564] [DEBUG] [MAIN ] IVZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:15.215386] [INFO ] [MAIN ] IVZ: Generated 1820 derivative records from 53908 primary records. [2025-09-26T22:23:15.215505] [DEBUG] [LOCAL ] IVZ: Saving derivative data. [2025-09-26T22:23:15.214173] [DEBUG] [LOCAL ] IX: Derivative data saved (1820 records). [2025-09-26T22:23:15.215944] [INFO ] [MAIN ] IX: Successfully saved derivative data. [2025-09-26T22:23:15.219134] [INFO ] [MAIN ] Derivative Progress: 974/2074 symbols completed. IX took 1.3s. Estimated remaining: 7m 40s. Rate: 143.5 symbols/min [2025-09-26T22:23:15.239838] [DEBUG] [LOCAL ] IVZ: Derivative data saved (1820 records). [2025-09-26T22:23:15.240041] [INFO ] [MAIN ] IVZ: Successfully saved derivative data. [2025-09-26T22:23:15.242934] [INFO ] [MAIN ] Derivative Progress: 975/2074 symbols completed. IVZ took 1.4s. Estimated remaining: 7m 39s. Rate: 143.7 symbols/min [2025-09-26T22:23:15.243915] [INFO ] [MAIN ] JBGS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:15.244085] [INFO ] [MAIN ] JBI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:15.244196] [INFO ] [MAIN ] J: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:15.307546] [DEBUG] [LOCAL ] JBGS: Loaded 43089 existing records from primary storage. [2025-09-26T22:23:15.320793] [INFO ] [MAIN ] JBGS: Loaded 43089 primary data records. [2025-09-26T22:23:15.350244] [DEBUG] [LOCAL ] JBI: Loaded 44362 existing records from primary storage. [2025-09-26T22:23:15.374319] [INFO ] [MAIN ] JBI: Loaded 44362 primary data records. [2025-09-26T22:23:15.412556] [DEBUG] [LOCAL ] J: Loaded 40873 existing records from primary storage. [2025-09-26T22:23:15.433242] [INFO ] [MAIN ] J: Loaded 40873 primary data records. [2025-09-26T22:23:16.428914] [DEBUG] [MAIN ] JBGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:16.430289] [INFO ] [MAIN ] JBGS: Generated 1820 derivative records from 43089 primary records. [2025-09-26T22:23:16.430983] [DEBUG] [LOCAL ] JBGS: Saving derivative data. [2025-09-26T22:23:16.469431] [DEBUG] [MAIN ] J: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:16.485610] [INFO ] [MAIN ] J: Generated 1820 derivative records from 40873 primary records. [2025-09-26T22:23:16.487261] [DEBUG] [LOCAL ] J: Saving derivative data. [2025-09-26T22:23:16.487786] [DEBUG] [MAIN ] JBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:16.489678] [DEBUG] [LOCAL ] JBGS: Derivative data saved (1820 records). [2025-09-26T22:23:16.498873] [INFO ] [MAIN ] JBGS: Successfully saved derivative data. [2025-09-26T22:23:16.491006] [INFO ] [MAIN ] JBI: Generated 1820 derivative records from 44362 primary records. [2025-09-26T22:23:16.505602] [DEBUG] [LOCAL ] JBI: Saving derivative data. [2025-09-26T22:23:16.505220] [INFO ] [MAIN ] Derivative Progress: 976/2074 symbols completed. JBGS took 1.3s. Estimated remaining: 7m 40s. Rate: 143.4 symbols/min [2025-09-26T22:23:16.522604] [INFO ] [MAIN ] JBL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:16.528995] [DEBUG] [LOCAL ] J: Derivative data saved (1820 records). [2025-09-26T22:23:16.530155] [INFO ] [MAIN ] J: Successfully saved derivative data. [2025-09-26T22:23:16.529837] [DEBUG] [LOCAL ] JBI: Derivative data saved (1820 records). [2025-09-26T22:23:16.533068] [INFO ] [MAIN ] Derivative Progress: 977/2074 symbols completed. J took 1.3s. Estimated remaining: 7m 39s. Rate: 143.5 symbols/min [2025-09-26T22:23:16.533726] [INFO ] [MAIN ] JBND: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:16.533461] [INFO ] [MAIN ] JBI: Successfully saved derivative data. [2025-09-26T22:23:16.536971] [INFO ] [MAIN ] Derivative Progress: 978/2074 symbols completed. JBI took 1.3s. Estimated remaining: 7m 38s. Rate: 143.6 symbols/min [2025-09-26T22:23:16.538062] [INFO ] [MAIN ] JCE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:16.550123] [DEBUG] [LOCAL ] JCE: Loaded 6591 existing records from primary storage. [2025-09-26T22:23:16.550358] [INFO ] [MAIN ] JCE: Loaded 6591 primary data records. [2025-09-26T22:23:16.710097] [DEBUG] [LOCAL ] JBND: Loaded 26051 existing records from primary storage. [2025-09-26T22:23:16.716473] [INFO ] [MAIN ] JBND: Loaded 26051 primary data records. [2025-09-26T22:23:16.980104] [DEBUG] [LOCAL ] JBL: Loaded 49145 existing records from primary storage. [2025-09-26T22:23:17.009531] [INFO ] [MAIN ] JBL: Loaded 49145 primary data records. [2025-09-26T22:23:17.688676] [DEBUG] [MAIN ] JCE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:17.689902] [INFO ] [MAIN ] JCE: Generated 1820 derivative records from 6591 primary records. [2025-09-26T22:23:17.690024] [DEBUG] [LOCAL ] JCE: Saving derivative data. [2025-09-26T22:23:17.710333] [DEBUG] [LOCAL ] JCE: Derivative data saved (1820 records). [2025-09-26T22:23:17.710953] [INFO ] [MAIN ] JCE: Successfully saved derivative data. [2025-09-26T22:23:17.713815] [INFO ] [MAIN ] Derivative Progress: 979/2074 symbols completed. JCE took 1.2s. Estimated remaining: 7m 38s. Rate: 143.4 symbols/min [2025-09-26T22:23:17.715121] [INFO ] [MAIN ] JCI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:17.738899] [DEBUG] [MAIN ] JBND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:17.740011] [INFO ] [MAIN ] JBND: Generated 1820 derivative records from 26051 primary records. [2025-09-26T22:23:17.740318] [DEBUG] [LOCAL ] JBND: Saving derivative data. [2025-09-26T22:23:17.755747] [DEBUG] [MAIN ] JBL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:17.764116] [INFO ] [MAIN ] JBL: Generated 1820 derivative records from 49145 primary records. [2025-09-26T22:23:17.770141] [DEBUG] [LOCAL ] JBL: Saving derivative data. [2025-09-26T22:23:17.782709] [DEBUG] [LOCAL ] JBND: Derivative data saved (1820 records). [2025-09-26T22:23:17.785807] [INFO ] [MAIN ] JBND: Successfully saved derivative data. [2025-09-26T22:23:17.788438] [INFO ] [MAIN ] Derivative Progress: 980/2074 symbols completed. JBND took 1.3s. Estimated remaining: 7m 37s. Rate: 143.5 symbols/min [2025-09-26T22:23:17.791552] [INFO ] [MAIN ] JEF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:17.793111] [DEBUG] [LOCAL ] JBL: Derivative data saved (1820 records). [2025-09-26T22:23:17.793274] [INFO ] [MAIN ] JBL: Successfully saved derivative data. [2025-09-26T22:23:17.796158] [INFO ] [MAIN ] Derivative Progress: 981/2074 symbols completed. JBL took 1.3s. Estimated remaining: 7m 37s. Rate: 143.6 symbols/min [2025-09-26T22:23:17.797255] [INFO ] [MAIN ] JELD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:17.838422] [DEBUG] [LOCAL ] JCI: Loaded 54327 existing records from primary storage. [2025-09-26T22:23:17.838716] [INFO ] [MAIN ] JCI: Loaded 54327 primary data records. [2025-09-26T22:23:18.093497] [DEBUG] [LOCAL ] JELD: Loaded 46791 existing records from primary storage. [2025-09-26T22:23:18.205950] [DEBUG] [LOCAL ] JEF: Loaded 50763 existing records from primary storage. [2025-09-26T22:23:18.142144] [INFO ] [MAIN ] JELD: Loaded 46791 primary data records. [2025-09-26T22:23:18.220450] [INFO ] [MAIN ] JEF: Loaded 50763 primary data records. [2025-09-26T22:23:18.899696] [DEBUG] [MAIN ] JCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:18.901525] [INFO ] [MAIN ] JCI: Generated 1820 derivative records from 54327 primary records. [2025-09-26T22:23:18.902055] [DEBUG] [LOCAL ] JCI: Saving derivative data. [2025-09-26T22:23:18.922992] [DEBUG] [LOCAL ] JCI: Derivative data saved (1820 records). [2025-09-26T22:23:18.923736] [INFO ] [MAIN ] JCI: Successfully saved derivative data. [2025-09-26T22:23:18.926205] [INFO ] [MAIN ] Derivative Progress: 982/2074 symbols completed. JCI took 1.2s. Estimated remaining: 7m 37s. Rate: 143.4 symbols/min [2025-09-26T22:23:18.926690] [INFO ] [MAIN ] JEQ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:18.940508] [DEBUG] [LOCAL ] JEQ: Loaded 9336 existing records from primary storage. [2025-09-26T22:23:18.943417] [INFO ] [MAIN ] JEQ: Loaded 9336 primary data records. [2025-09-26T22:23:18.996050] [DEBUG] [MAIN ] JELD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:19.066212] [INFO ] [MAIN ] JELD: Generated 1820 derivative records from 46791 primary records. [2025-09-26T22:23:19.071775] [DEBUG] [MAIN ] JEF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:19.081120] [INFO ] [MAIN ] JEF: Generated 1820 derivative records from 50763 primary records. [2025-09-26T22:23:19.096203] [DEBUG] [LOCAL ] JEF: Saving derivative data. [2025-09-26T22:23:19.096072] [DEBUG] [LOCAL ] JELD: Saving derivative data. [2025-09-26T22:23:19.388431] [DEBUG] [LOCAL ] JELD: Derivative data saved (1820 records). [2025-09-26T22:23:19.390140] [INFO ] [MAIN ] JELD: Successfully saved derivative data. [2025-09-26T22:23:19.390973] [DEBUG] [LOCAL ] JEF: Derivative data saved (1820 records). [2025-09-26T22:23:19.410072] [INFO ] [MAIN ] Derivative Progress: 983/2074 symbols completed. JELD took 1.6s. Estimated remaining: 7m 37s. Rate: 143.4 symbols/min [2025-09-26T22:23:19.410535] [INFO ] [MAIN ] JFR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:19.410974] [INFO ] [MAIN ] JEF: Successfully saved derivative data. [2025-09-26T22:23:19.414501] [INFO ] [MAIN ] Derivative Progress: 984/2074 symbols completed. JEF took 1.6s. Estimated remaining: 7m 36s. Rate: 143.5 symbols/min [2025-09-26T22:23:19.415164] [INFO ] [MAIN ] JGH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:19.432073] [DEBUG] [LOCAL ] JGH: Loaded 11064 existing records from primary storage. [2025-09-26T22:23:19.432588] [INFO ] [MAIN ] JGH: Loaded 11064 primary data records. [2025-09-26T22:23:19.600387] [DEBUG] [LOCAL ] JFR: Loaded 30975 existing records from primary storage. [2025-09-26T22:23:19.767550] [INFO ] [MAIN ] JFR: Loaded 30975 primary data records. [2025-09-26T22:23:19.807909] [DEBUG] [MAIN ] JEQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:19.835920] [INFO ] [MAIN ] JEQ: Generated 1820 derivative records from 9336 primary records. [2025-09-26T22:23:19.844792] [DEBUG] [LOCAL ] JEQ: Saving derivative data. [2025-09-26T22:23:20.013483] [DEBUG] [LOCAL ] JEQ: Derivative data saved (1820 records). [2025-09-26T22:23:20.127037] [INFO ] [MAIN ] JEQ: Successfully saved derivative data. [2025-09-26T22:23:20.139758] [INFO ] [MAIN ] Derivative Progress: 985/2074 symbols completed. JEQ took 1.2s. Estimated remaining: 7m 36s. Rate: 143.4 symbols/min [2025-09-26T22:23:20.140676] [INFO ] [MAIN ] JHG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:20.163697] [DEBUG] [MAIN ] JGH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:20.165111] [INFO ] [MAIN ] JGH: Generated 1820 derivative records from 11064 primary records. [2025-09-26T22:23:20.165230] [DEBUG] [LOCAL ] JGH: Saving derivative data. [2025-09-26T22:23:20.184705] [DEBUG] [LOCAL ] JGH: Derivative data saved (1820 records). [2025-09-26T22:23:20.185161] [INFO ] [MAIN ] JGH: Successfully saved derivative data. [2025-09-26T22:23:20.187913] [INFO ] [MAIN ] Derivative Progress: 986/2074 symbols completed. JGH took 0.8s. Estimated remaining: 7m 35s. Rate: 143.5 symbols/min [2025-09-26T22:23:20.188200] [INFO ] [MAIN ] JHI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:20.206438] [DEBUG] [LOCAL ] JHI: Loaded 3641 existing records from primary storage. [2025-09-26T22:23:20.206818] [INFO ] [MAIN ] JHI: Loaded 3641 primary data records. [2025-09-26T22:23:20.339757] [DEBUG] [MAIN ] JFR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:20.362330] [DEBUG] [LOCAL ] JHG: Loaded 48497 existing records from primary storage. [2025-09-26T22:23:20.374154] [INFO ] [MAIN ] JFR: Generated 1820 derivative records from 30975 primary records. [2025-09-26T22:23:20.374294] [INFO ] [MAIN ] JHG: Loaded 48497 primary data records. [2025-09-26T22:23:20.374495] [DEBUG] [LOCAL ] JFR: Saving derivative data. [2025-09-26T22:23:20.729304] [DEBUG] [LOCAL ] JFR: Derivative data saved (1820 records). [2025-09-26T22:23:20.729628] [INFO ] [MAIN ] JFR: Successfully saved derivative data. [2025-09-26T22:23:20.743401] [INFO ] [MAIN ] Derivative Progress: 987/2074 symbols completed. JFR took 1.3s. Estimated remaining: 7m 35s. Rate: 143.5 symbols/min [2025-09-26T22:23:20.755150] [INFO ] [MAIN ] JHS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:20.951543] [DEBUG] [LOCAL ] JHS: Loaded 2878 existing records from primary storage. [2025-09-26T22:23:20.951908] [INFO ] [MAIN ] JHS: Loaded 2878 primary data records. [2025-09-26T22:23:21.358824] [DEBUG] [MAIN ] JHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:21.359998] [INFO ] [MAIN ] JHI: Generated 1820 derivative records from 3641 primary records. [2025-09-26T22:23:21.360178] [DEBUG] [LOCAL ] JHI: Saving derivative data. [2025-09-26T22:23:21.379254] [DEBUG] [LOCAL ] JHI: Derivative data saved (1820 records). [2025-09-26T22:23:21.379667] [INFO ] [MAIN ] JHI: Successfully saved derivative data. [2025-09-26T22:23:21.382159] [INFO ] [MAIN ] Derivative Progress: 988/2074 symbols completed. JHI took 1.2s. Estimated remaining: 7m 34s. Rate: 143.4 symbols/min [2025-09-26T22:23:21.402234] [DEBUG] [MAIN ] JHG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:21.403235] [INFO ] [MAIN ] JHG: Generated 1820 derivative records from 48497 primary records. [2025-09-26T22:23:21.403564] [DEBUG] [LOCAL ] JHG: Saving derivative data. [2025-09-26T22:23:21.425451] [DEBUG] [LOCAL ] JHG: Derivative data saved (1820 records). [2025-09-26T22:23:21.438520] [INFO ] [MAIN ] JHG: Successfully saved derivative data. [2025-09-26T22:23:21.442058] [DEBUG] [MAIN ] JHS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:21.441720] [INFO ] [MAIN ] Derivative Progress: 989/2074 symbols completed. JHG took 1.3s. Estimated remaining: 7m 34s. Rate: 143.5 symbols/min [2025-09-26T22:23:21.443145] [INFO ] [MAIN ] JHS: Generated 1820 derivative records from 2878 primary records. [2025-09-26T22:23:21.443219] [DEBUG] [LOCAL ] JHS: Saving derivative data. [2025-09-26T22:23:21.457615] [DEBUG] [LOCAL ] JHS: Derivative data saved (1820 records). [2025-09-26T22:23:21.457708] [INFO ] [MAIN ] JHS: Successfully saved derivative data. [2025-09-26T22:23:21.460502] [INFO ] [MAIN ] Derivative Progress: 990/2074 symbols completed. JHS took 0.7s. Estimated remaining: 7m 33s. Rate: 143.7 symbols/min [2025-09-26T22:23:21.461217] [INFO ] [MAIN ] JHX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:21.461826] [INFO ] [MAIN ] JKS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:21.461728] [INFO ] [MAIN ] JILL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:21.485463] [DEBUG] [LOCAL ] JILL: Loaded 16931 existing records from primary storage. [2025-09-26T22:23:21.485810] [INFO ] [MAIN ] JILL: Loaded 16931 primary data records. [2025-09-26T22:23:21.703880] [DEBUG] [LOCAL ] JKS: Loaded 40672 existing records from primary storage. [2025-09-26T22:23:21.716551] [DEBUG] [LOCAL ] JHX: Loaded 51216 existing records from primary storage. [2025-09-26T22:23:21.733304] [INFO ] [MAIN ] JKS: Loaded 40672 primary data records. [2025-09-26T22:23:21.853865] [INFO ] [MAIN ] JHX: Loaded 51216 primary data records. [2025-09-26T22:23:22.603066] [DEBUG] [MAIN ] JILL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:22.605113] [INFO ] [MAIN ] JILL: Generated 1820 derivative records from 16931 primary records. [2025-09-26T22:23:22.605297] [DEBUG] [LOCAL ] JILL: Saving derivative data. [2025-09-26T22:23:22.643183] [DEBUG] [MAIN ] JKS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:22.643263] [DEBUG] [LOCAL ] JILL: Derivative data saved (1820 records). [2025-09-26T22:23:22.643637] [INFO ] [MAIN ] JILL: Successfully saved derivative data. [2025-09-26T22:23:22.644471] [INFO ] [MAIN ] JKS: Generated 1820 derivative records from 40672 primary records. [2025-09-26T22:23:22.644841] [DEBUG] [LOCAL ] JKS: Saving derivative data. [2025-09-26T22:23:22.650488] [INFO ] [MAIN ] Derivative Progress: 991/2074 symbols completed. JILL took 1.2s. Estimated remaining: 7m 33s. Rate: 143.4 symbols/min [2025-09-26T22:23:22.652250] [INFO ] [MAIN ] JLL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:22.674910] [DEBUG] [LOCAL ] JKS: Derivative data saved (1820 records). [2025-09-26T22:23:22.675150] [INFO ] [MAIN ] JKS: Successfully saved derivative data. [2025-09-26T22:23:22.678028] [INFO ] [MAIN ] Derivative Progress: 992/2074 symbols completed. JKS took 1.2s. Estimated remaining: 7m 32s. Rate: 143.5 symbols/min [2025-09-26T22:23:22.692088] [DEBUG] [MAIN ] JHX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:22.692362] [INFO ] [MAIN ] JLS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:22.693402] [INFO ] [MAIN ] JHX: Generated 1820 derivative records from 51216 primary records. [2025-09-26T22:23:22.694030] [DEBUG] [LOCAL ] JHX: Saving derivative data. [2025-09-26T22:23:22.732257] [DEBUG] [LOCAL ] JLS: Loaded 4142 existing records from primary storage. [2025-09-26T22:23:22.732973] [INFO ] [MAIN ] JLS: Loaded 4142 primary data records. [2025-09-26T22:23:22.818707] [DEBUG] [LOCAL ] JLL: Loaded 32458 existing records from primary storage. [2025-09-26T22:23:22.837357] [INFO ] [MAIN ] JLL: Loaded 32458 primary data records. [2025-09-26T22:23:22.818811] [DEBUG] [LOCAL ] JHX: Derivative data saved (1820 records). [2025-09-26T22:23:22.850995] [INFO ] [MAIN ] JHX: Successfully saved derivative data. [2025-09-26T22:23:22.862361] [INFO ] [MAIN ] Derivative Progress: 993/2074 symbols completed. JHX took 1.4s. Estimated remaining: 7m 32s. Rate: 143.6 symbols/min [2025-09-26T22:23:22.922787] [INFO ] [MAIN ] JMIA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:23.448459] [DEBUG] [MAIN ] JLS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:23.463527] [INFO ] [MAIN ] JLS: Generated 1820 derivative records from 4142 primary records. [2025-09-26T22:23:23.465372] [DEBUG] [LOCAL ] JLS: Saving derivative data. [2025-09-26T22:23:23.468087] [DEBUG] [LOCAL ] JMIA: Loaded 51279 existing records from primary storage. [2025-09-26T22:23:23.468588] [INFO ] [MAIN ] JMIA: Loaded 51279 primary data records. [2025-09-26T22:23:23.606629] [DEBUG] [LOCAL ] JLS: Derivative data saved (1820 records). [2025-09-26T22:23:23.679393] [INFO ] [MAIN ] JLS: Successfully saved derivative data. [2025-09-26T22:23:23.689531] [INFO ] [MAIN ] Derivative Progress: 994/2074 symbols completed. JLS took 1.0s. Estimated remaining: 7m 32s. Rate: 143.5 symbols/min [2025-09-26T22:23:23.874149] [INFO ] [MAIN ] JNJ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:23.889942] [DEBUG] [MAIN ] JLL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:23.891449] [INFO ] [MAIN ] JLL: Generated 1820 derivative records from 32458 primary records. [2025-09-26T22:23:23.891591] [DEBUG] [LOCAL ] JLL: Saving derivative data. [2025-09-26T22:23:23.912539] [DEBUG] [LOCAL ] JLL: Derivative data saved (1820 records). [2025-09-26T22:23:23.912699] [INFO ] [MAIN ] JLL: Successfully saved derivative data. [2025-09-26T22:23:23.915621] [INFO ] [MAIN ] Derivative Progress: 995/2074 symbols completed. JLL took 1.3s. Estimated remaining: 7m 31s. Rate: 143.5 symbols/min [2025-09-26T22:23:23.920771] [INFO ] [MAIN ] JOBY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:23.941589] [DEBUG] [MAIN ] JMIA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:23.942437] [INFO ] [MAIN ] JMIA: Generated 1820 derivative records from 51279 primary records. [2025-09-26T22:23:23.942584] [DEBUG] [LOCAL ] JMIA: Saving derivative data. [2025-09-26T22:23:23.975431] [DEBUG] [LOCAL ] JMIA: Derivative data saved (1820 records). [2025-09-26T22:23:23.975579] [INFO ] [MAIN ] JMIA: Successfully saved derivative data. [2025-09-26T22:23:23.977887] [INFO ] [MAIN ] Derivative Progress: 996/2074 symbols completed. JMIA took 1.1s. Estimated remaining: 7m 30s. Rate: 143.7 symbols/min [2025-09-26T22:23:23.978414] [INFO ] [MAIN ] JOE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:24.012680] [DEBUG] [LOCAL ] JNJ: Loaded 54533 existing records from primary storage. [2025-09-26T22:23:24.013026] [INFO ] [MAIN ] JNJ: Loaded 54533 primary data records. [2025-09-26T22:23:24.139285] [DEBUG] [LOCAL ] JOBY: Loaded 54579 existing records from primary storage. [2025-09-26T22:23:24.161285] [INFO ] [MAIN ] JOBY: Loaded 54579 primary data records. [2025-09-26T22:23:24.178026] [DEBUG] [LOCAL ] JOE: Loaded 24860 existing records from primary storage. [2025-09-26T22:23:24.194857] [INFO ] [MAIN ] JOE: Loaded 24860 primary data records. [2025-09-26T22:23:25.097040] [DEBUG] [MAIN ] JNJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:25.098232] [INFO ] [MAIN ] JNJ: Generated 1820 derivative records from 54533 primary records. [2025-09-26T22:23:25.098348] [DEBUG] [LOCAL ] JNJ: Saving derivative data. [2025-09-26T22:23:25.133090] [DEBUG] [MAIN ] JOE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:25.135607] [INFO ] [MAIN ] JOE: Generated 1820 derivative records from 24860 primary records. [2025-09-26T22:23:25.137002] [DEBUG] [LOCAL ] JOE: Saving derivative data. [2025-09-26T22:23:25.139634] [DEBUG] [LOCAL ] JNJ: Derivative data saved (1820 records). [2025-09-26T22:23:25.140163] [INFO ] [MAIN ] JNJ: Successfully saved derivative data. [2025-09-26T22:23:25.150508] [INFO ] [MAIN ] Derivative Progress: 997/2074 symbols completed. JNJ took 1.3s. Estimated remaining: 7m 31s. Rate: 143.4 symbols/min [2025-09-26T22:23:25.171127] [DEBUG] [MAIN ] JOBY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:25.169088] [INFO ] [MAIN ] JOF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:25.173671] [INFO ] [MAIN ] JOBY: Generated 1820 derivative records from 54579 primary records. [2025-09-26T22:23:25.173921] [DEBUG] [LOCAL ] JOBY: Saving derivative data. [2025-09-26T22:23:25.185591] [DEBUG] [LOCAL ] JOE: Derivative data saved (1820 records). [2025-09-26T22:23:25.198546] [INFO ] [MAIN ] JOE: Successfully saved derivative data. [2025-09-26T22:23:25.201365] [INFO ] [MAIN ] Derivative Progress: 998/2074 symbols completed. JOE took 1.2s. Estimated remaining: 7m 30s. Rate: 143.5 symbols/min [2025-09-26T22:23:25.201765] [INFO ] [MAIN ] JPC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:25.208012] [DEBUG] [LOCAL ] JOF: Loaded 7177 existing records from primary storage. [2025-09-26T22:23:25.209443] [INFO ] [MAIN ] JOF: Loaded 7177 primary data records. [2025-09-26T22:23:25.209618] [DEBUG] [LOCAL ] JOBY: Derivative data saved (1820 records). [2025-09-26T22:23:25.215036] [INFO ] [MAIN ] JOBY: Successfully saved derivative data. [2025-09-26T22:23:25.218846] [INFO ] [MAIN ] Derivative Progress: 999/2074 symbols completed. JOBY took 1.3s. Estimated remaining: 7m 29s. Rate: 143.7 symbols/min [2025-09-26T22:23:25.236327] [INFO ] [MAIN ] JPM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:25.589954] [DEBUG] [LOCAL ] JPC: Loaded 37620 existing records from primary storage. [2025-09-26T22:23:25.590830] [INFO ] [MAIN ] JPC: Loaded 37620 primary data records. [2025-09-26T22:23:25.845165] [DEBUG] [LOCAL ] JPM: Loaded 54574 existing records from primary storage. [2025-09-26T22:23:25.938442] [INFO ] [MAIN ] JPM: Loaded 54574 primary data records. [2025-09-26T22:23:26.150814] [DEBUG] [MAIN ] JOF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:26.163019] [INFO ] [MAIN ] JOF: Generated 1820 derivative records from 7177 primary records. [2025-09-26T22:23:26.164164] [DEBUG] [LOCAL ] JOF: Saving derivative data. [2025-09-26T22:23:26.392540] [DEBUG] [LOCAL ] JOF: Derivative data saved (1820 records). [2025-09-26T22:23:26.393328] [INFO ] [MAIN ] JOF: Successfully saved derivative data. [2025-09-26T22:23:26.395959] [INFO ] [MAIN ] Derivative Progress: 1000/2074 symbols completed. JOF took 1.2s. Estimated remaining: 7m 29s. Rate: 143.4 symbols/min [2025-09-26T22:23:26.399014] [INFO ] [MAIN ] JQC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:26.417082] [DEBUG] [MAIN ] JPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:26.418007] [INFO ] [MAIN ] JPC: Generated 1820 derivative records from 37620 primary records. [2025-09-26T22:23:26.418734] [DEBUG] [LOCAL ] JPC: Saving derivative data. [2025-09-26T22:23:26.466097] [DEBUG] [LOCAL ] JPC: Derivative data saved (1820 records). [2025-09-26T22:23:26.467359] [INFO ] [MAIN ] JPC: Successfully saved derivative data. [2025-09-26T22:23:26.471499] [INFO ] [MAIN ] Derivative Progress: 1001/2074 symbols completed. JPC took 1.3s. Estimated remaining: 7m 29s. Rate: 143.5 symbols/min [2025-09-26T22:23:26.473134] [INFO ] [MAIN ] JRI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:26.501317] [DEBUG] [MAIN ] JPM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:26.500904] [DEBUG] [LOCAL ] JQC: Loaded 34194 existing records from primary storage. [2025-09-26T22:23:26.501525] [INFO ] [MAIN ] JQC: Loaded 34194 primary data records. [2025-09-26T22:23:26.502566] [INFO ] [MAIN ] JPM: Generated 1820 derivative records from 54574 primary records. [2025-09-26T22:23:26.507839] [DEBUG] [LOCAL ] JPM: Saving derivative data. [2025-09-26T22:23:26.622672] [DEBUG] [LOCAL ] JRI: Loaded 15068 existing records from primary storage. [2025-09-26T22:23:26.648882] [INFO ] [MAIN ] JRI: Loaded 15068 primary data records. [2025-09-26T22:23:26.648414] [DEBUG] [LOCAL ] JPM: Derivative data saved (1820 records). [2025-09-26T22:23:26.655281] [INFO ] [MAIN ] JPM: Successfully saved derivative data. [2025-09-26T22:23:26.658236] [INFO ] [MAIN ] Derivative Progress: 1002/2074 symbols completed. JPM took 1.4s. Estimated remaining: 7m 28s. Rate: 143.6 symbols/min [2025-09-26T22:23:26.681683] [INFO ] [MAIN ] JRS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:27.007013] [DEBUG] [LOCAL ] JRS: Loaded 11250 existing records from primary storage. [2025-09-26T22:23:27.028259] [INFO ] [MAIN ] JRS: Loaded 11250 primary data records. [2025-09-26T22:23:27.598771] [DEBUG] [MAIN ] JQC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:27.600407] [INFO ] [MAIN ] JQC: Generated 1820 derivative records from 34194 primary records. [2025-09-26T22:23:27.600690] [DEBUG] [LOCAL ] JQC: Saving derivative data. [2025-09-26T22:23:27.625292] [DEBUG] [LOCAL ] JQC: Derivative data saved (1820 records). [2025-09-26T22:23:27.637668] [INFO ] [MAIN ] JQC: Successfully saved derivative data. [2025-09-26T22:23:27.641206] [DEBUG] [MAIN ] JRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:27.640776] [INFO ] [MAIN ] Derivative Progress: 1003/2074 symbols completed. JQC took 1.2s. Estimated remaining: 7m 28s. Rate: 143.4 symbols/min [2025-09-26T22:23:27.642755] [INFO ] [MAIN ] JRI: Generated 1820 derivative records from 15068 primary records. [2025-09-26T22:23:27.643005] [DEBUG] [LOCAL ] JRI: Saving derivative data. [2025-09-26T22:23:27.673009] [DEBUG] [MAIN ] JRS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:27.674281] [INFO ] [MAIN ] JRS: Generated 1820 derivative records from 11250 primary records. [2025-09-26T22:23:27.674533] [DEBUG] [LOCAL ] JRS: Saving derivative data. [2025-09-26T22:23:27.689914] [DEBUG] [LOCAL ] JRI: Derivative data saved (1820 records). [2025-09-26T22:23:27.691848] [INFO ] [MAIN ] JRI: Successfully saved derivative data. [2025-09-26T22:23:27.694872] [INFO ] [MAIN ] Derivative Progress: 1004/2074 symbols completed. JRI took 1.2s. Estimated remaining: 7m 27s. Rate: 143.5 symbols/min [2025-09-26T22:23:27.696361] [DEBUG] [LOCAL ] JRS: Derivative data saved (1820 records). [2025-09-26T22:23:27.696430] [INFO ] [MAIN ] JRS: Successfully saved derivative data. [2025-09-26T22:23:27.699292] [INFO ] [MAIN ] Derivative Progress: 1005/2074 symbols completed. JRS took 1.0s. Estimated remaining: 7m 26s. Rate: 143.7 symbols/min [2025-09-26T22:23:27.699984] [INFO ] [MAIN ] KAI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:27.699915] [INFO ] [MAIN ] JXN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:27.700204] [INFO ] [MAIN ] K: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:27.718732] [DEBUG] [LOCAL ] KAI: Loaded 13729 existing records from primary storage. [2025-09-26T22:23:27.719061] [INFO ] [MAIN ] KAI: Loaded 13729 primary data records. [2025-09-26T22:23:28.048142] [DEBUG] [LOCAL ] JXN: Loaded 46558 existing records from primary storage. [2025-09-26T22:23:28.096275] [INFO ] [MAIN ] JXN: Loaded 46558 primary data records. [2025-09-26T22:23:28.133883] [DEBUG] [LOCAL ] K: Loaded 50637 existing records from primary storage. [2025-09-26T22:23:28.143811] [INFO ] [MAIN ] K: Loaded 50637 primary data records. [2025-09-26T22:23:28.876207] [DEBUG] [MAIN ] KAI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:28.878055] [INFO ] [MAIN ] KAI: Generated 1820 derivative records from 13729 primary records. [2025-09-26T22:23:28.878213] [DEBUG] [LOCAL ] KAI: Saving derivative data. [2025-09-26T22:23:28.902240] [DEBUG] [LOCAL ] KAI: Derivative data saved (1820 records). [2025-09-26T22:23:28.902775] [INFO ] [MAIN ] KAI: Successfully saved derivative data. [2025-09-26T22:23:28.907608] [INFO ] [MAIN ] Derivative Progress: 1006/2074 symbols completed. KAI took 1.2s. Estimated remaining: 7m 27s. Rate: 143.4 symbols/min [2025-09-26T22:23:28.908890] [INFO ] [MAIN ] KAR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:28.925556] [DEBUG] [MAIN ] JXN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:28.933708] [INFO ] [MAIN ] JXN: Generated 1820 derivative records from 46558 primary records. [2025-09-26T22:23:28.933871] [DEBUG] [LOCAL ] JXN: Saving derivative data. [2025-09-26T22:23:28.957329] [DEBUG] [MAIN ] K: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:28.967901] [INFO ] [MAIN ] K: Generated 1820 derivative records from 50637 primary records. [2025-09-26T22:23:28.971518] [DEBUG] [LOCAL ] K: Saving derivative data. [2025-09-26T22:23:28.971361] [DEBUG] [LOCAL ] JXN: Derivative data saved (1820 records). [2025-09-26T22:23:28.972265] [INFO ] [MAIN ] JXN: Successfully saved derivative data. [2025-09-26T22:23:28.975670] [INFO ] [MAIN ] Derivative Progress: 1007/2074 symbols completed. JXN took 1.3s. Estimated remaining: 7m 26s. Rate: 143.5 symbols/min [2025-09-26T22:23:28.992956] [INFO ] [MAIN ] KB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:29.003784] [DEBUG] [LOCAL ] K: Derivative data saved (1820 records). [2025-09-26T22:23:29.016598] [INFO ] [MAIN ] K: Successfully saved derivative data. [2025-09-26T22:23:29.019091] [INFO ] [MAIN ] Derivative Progress: 1008/2074 symbols completed. K took 1.3s. Estimated remaining: 7m 25s. Rate: 143.7 symbols/min [2025-09-26T22:23:29.019490] [INFO ] [MAIN ] KBH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:29.021208] [DEBUG] [LOCAL ] KAR: Loaded 40411 existing records from primary storage. [2025-09-26T22:23:29.021702] [INFO ] [MAIN ] KAR: Loaded 40411 primary data records. [2025-09-26T22:23:29.193387] [DEBUG] [LOCAL ] KB: Loaded 24453 existing records from primary storage. [2025-09-26T22:23:29.212797] [INFO ] [MAIN ] KB: Loaded 24453 primary data records. [2025-09-26T22:23:29.555563] [DEBUG] [LOCAL ] KBH: Loaded 49678 existing records from primary storage. [2025-09-26T22:23:29.608348] [INFO ] [MAIN ] KBH: Loaded 49678 primary data records. [2025-09-26T22:23:30.182635] [DEBUG] [MAIN ] KAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:30.183862] [INFO ] [MAIN ] KAR: Generated 1820 derivative records from 40411 primary records. [2025-09-26T22:23:30.184141] [DEBUG] [LOCAL ] KAR: Saving derivative data. [2025-09-26T22:23:30.205799] [DEBUG] [LOCAL ] KAR: Derivative data saved (1820 records). [2025-09-26T22:23:30.206398] [INFO ] [MAIN ] KAR: Successfully saved derivative data. [2025-09-26T22:23:30.208887] [INFO ] [MAIN ] Derivative Progress: 1009/2074 symbols completed. KAR took 1.3s. Estimated remaining: 7m 26s. Rate: 143.4 symbols/min [2025-09-26T22:23:30.209514] [INFO ] [MAIN ] KBR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:30.229916] [DEBUG] [MAIN ] KB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:30.230750] [INFO ] [MAIN ] KB: Generated 1820 derivative records from 24453 primary records. [2025-09-26T22:23:30.231019] [DEBUG] [LOCAL ] KB: Saving derivative data. [2025-09-26T22:23:30.251727] [DEBUG] [LOCAL ] KB: Derivative data saved (1820 records). [2025-09-26T22:23:30.252949] [INFO ] [MAIN ] KB: Successfully saved derivative data. [2025-09-26T22:23:30.255896] [INFO ] [MAIN ] Derivative Progress: 1010/2074 symbols completed. KB took 1.3s. Estimated remaining: 7m 25s. Rate: 143.5 symbols/min [2025-09-26T22:23:30.258221] [INFO ] [MAIN ] KD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:30.273520] [DEBUG] [MAIN ] KBH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:30.274405] [INFO ] [MAIN ] KBH: Generated 1820 derivative records from 49678 primary records. [2025-09-26T22:23:30.274613] [DEBUG] [LOCAL ] KBH: Saving derivative data. [2025-09-26T22:23:30.304324] [DEBUG] [LOCAL ] KBH: Derivative data saved (1820 records). [2025-09-26T22:23:30.304693] [INFO ] [MAIN ] KBH: Successfully saved derivative data. [2025-09-26T22:23:30.307718] [INFO ] [MAIN ] Derivative Progress: 1011/2074 symbols completed. KBH took 1.3s. Estimated remaining: 7m 24s. Rate: 143.6 symbols/min [2025-09-26T22:23:30.308068] [INFO ] [MAIN ] KEN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:30.324019] [DEBUG] [LOCAL ] KBR: Loaded 48899 existing records from primary storage. [2025-09-26T22:23:30.324341] [INFO ] [MAIN ] KBR: Loaded 48899 primary data records. [2025-09-26T22:23:30.426882] [DEBUG] [LOCAL ] KEN: Loaded 4784 existing records from primary storage. [2025-09-26T22:23:30.432374] [INFO ] [MAIN ] KEN: Loaded 4784 primary data records. [2025-09-26T22:23:30.536918] [DEBUG] [LOCAL ] KD: Loaded 53068 existing records from primary storage. [2025-09-26T22:23:30.580719] [INFO ] [MAIN ] KD: Loaded 53068 primary data records. [2025-09-26T22:23:31.386528] [DEBUG] [MAIN ] KBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:31.388077] [INFO ] [MAIN ] KBR: Generated 1820 derivative records from 48899 primary records. [2025-09-26T22:23:31.388226] [DEBUG] [LOCAL ] KBR: Saving derivative data. [2025-09-26T22:23:31.430170] [DEBUG] [MAIN ] KEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:31.436596] [DEBUG] [MAIN ] KD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:31.438540] [INFO ] [MAIN ] KD: Generated 1820 derivative records from 53068 primary records. [2025-09-26T22:23:31.439151] [DEBUG] [LOCAL ] KD: Saving derivative data. [2025-09-26T22:23:31.437382] [INFO ] [MAIN ] KEN: Generated 1820 derivative records from 4784 primary records. [2025-09-26T22:23:31.441301] [DEBUG] [LOCAL ] KEN: Saving derivative data. [2025-09-26T22:23:31.442016] [DEBUG] [LOCAL ] KBR: Derivative data saved (1820 records). [2025-09-26T22:23:31.442149] [INFO ] [MAIN ] KBR: Successfully saved derivative data. [2025-09-26T22:23:31.444595] [INFO ] [MAIN ] Derivative Progress: 1012/2074 symbols completed. KBR took 1.2s. Estimated remaining: 7m 24s. Rate: 143.4 symbols/min [2025-09-26T22:23:31.460350] [INFO ] [MAIN ] KEP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:31.480126] [DEBUG] [LOCAL ] KD: Derivative data saved (1820 records). [2025-09-26T22:23:31.481042] [INFO ] [MAIN ] KD: Successfully saved derivative data. [2025-09-26T22:23:31.484144] [INFO ] [MAIN ] Derivative Progress: 1013/2074 symbols completed. KD took 1.2s. Estimated remaining: 7m 24s. Rate: 143.5 symbols/min [2025-09-26T22:23:31.484856] [INFO ] [MAIN ] KEX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:31.485400] [DEBUG] [LOCAL ] KEN: Derivative data saved (1820 records). [2025-09-26T22:23:31.486065] [INFO ] [MAIN ] KEN: Successfully saved derivative data. [2025-09-26T22:23:31.488453] [INFO ] [MAIN ] Derivative Progress: 1014/2074 symbols completed. KEN took 1.2s. Estimated remaining: 7m 23s. Rate: 143.7 symbols/min [2025-09-26T22:23:31.489383] [INFO ] [MAIN ] KEYS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:31.551167] [DEBUG] [LOCAL ] KEP: Loaded 31169 existing records from primary storage. [2025-09-26T22:23:31.561755] [INFO ] [MAIN ] KEP: Loaded 31169 primary data records. [2025-09-26T22:23:31.662924] [DEBUG] [LOCAL ] KEX: Loaded 38712 existing records from primary storage. [2025-09-26T22:23:31.688587] [INFO ] [MAIN ] KEX: Loaded 38712 primary data records. [2025-09-26T22:23:31.735738] [DEBUG] [LOCAL ] KEYS: Loaded 43955 existing records from primary storage. [2025-09-26T22:23:31.757104] [INFO ] [MAIN ] KEYS: Loaded 43955 primary data records. [2025-09-26T22:23:32.728213] [DEBUG] [MAIN ] KEP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:32.731167] [INFO ] [MAIN ] KEP: Generated 1820 derivative records from 31169 primary records. [2025-09-26T22:23:32.731286] [DEBUG] [LOCAL ] KEP: Saving derivative data. [2025-09-26T22:23:32.752009] [DEBUG] [LOCAL ] KEP: Derivative data saved (1820 records). [2025-09-26T22:23:32.754673] [INFO ] [MAIN ] KEP: Successfully saved derivative data. [2025-09-26T22:23:32.757257] [INFO ] [MAIN ] Derivative Progress: 1015/2074 symbols completed. KEP took 1.3s. Estimated remaining: 7m 23s. Rate: 143.4 symbols/min [2025-09-26T22:23:32.761069] [INFO ] [MAIN ] KF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:32.790191] [DEBUG] [MAIN ] KEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:32.791010] [DEBUG] [MAIN ] KEYS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:32.792148] [INFO ] [MAIN ] KEX: Generated 1820 derivative records from 38712 primary records. [2025-09-26T22:23:32.793457] [INFO ] [MAIN ] KEYS: Generated 1820 derivative records from 43955 primary records. [2025-09-26T22:23:32.793731] [DEBUG] [LOCAL ] KEX: Saving derivative data. [2025-09-26T22:23:32.793849] [DEBUG] [LOCAL ] KEYS: Saving derivative data. [2025-09-26T22:23:32.798271] [DEBUG] [LOCAL ] KF: Loaded 2486 existing records from primary storage. [2025-09-26T22:23:32.806295] [INFO ] [MAIN ] KF: Loaded 2486 primary data records. [2025-09-26T22:23:32.916592] [DEBUG] [LOCAL ] KEX: Derivative data saved (1820 records). [2025-09-26T22:23:32.923214] [INFO ] [MAIN ] KEX: Successfully saved derivative data. [2025-09-26T22:23:32.945096] [INFO ] [MAIN ] Derivative Progress: 1016/2074 symbols completed. KEX took 1.5s. Estimated remaining: 7m 22s. Rate: 143.5 symbols/min [2025-09-26T22:23:32.950261] [INFO ] [MAIN ] KFRC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:32.963775] [DEBUG] [LOCAL ] KEYS: Derivative data saved (1820 records). [2025-09-26T22:23:32.974554] [INFO ] [MAIN ] KEYS: Successfully saved derivative data. [2025-09-26T22:23:33.008883] [INFO ] [MAIN ] Derivative Progress: 1017/2074 symbols completed. KEYS took 1.5s. Estimated remaining: 7m 22s. Rate: 143.6 symbols/min [2025-09-26T22:23:33.044505] [INFO ] [MAIN ] KFS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:33.200708] [DEBUG] [LOCAL ] KFRC: Loaded 19766 existing records from primary storage. [2025-09-26T22:23:33.202120] [INFO ] [MAIN ] KFRC: Loaded 19766 primary data records. [2025-09-26T22:23:33.229499] [DEBUG] [LOCAL ] KFS: Loaded 8471 existing records from primary storage. [2025-09-26T22:23:33.254388] [INFO ] [MAIN ] KFS: Loaded 8471 primary data records. [2025-09-26T22:23:33.890594] [DEBUG] [MAIN ] KF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:33.891541] [INFO ] [MAIN ] KF: Generated 1820 derivative records from 2486 primary records. [2025-09-26T22:23:33.891780] [DEBUG] [LOCAL ] KF: Saving derivative data. [2025-09-26T22:23:33.914408] [DEBUG] [LOCAL ] KF: Derivative data saved (1820 records). [2025-09-26T22:23:33.914705] [INFO ] [MAIN ] KF: Successfully saved derivative data. [2025-09-26T22:23:33.917016] [INFO ] [MAIN ] Derivative Progress: 1018/2074 symbols completed. KF took 1.2s. Estimated remaining: 7m 22s. Rate: 143.4 symbols/min [2025-09-26T22:23:33.944340] [DEBUG] [MAIN ] KFS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:33.945505] [INFO ] [MAIN ] KFS: Generated 1820 derivative records from 8471 primary records. [2025-09-26T22:23:33.958425] [DEBUG] [LOCAL ] KFS: Saving derivative data. [2025-09-26T22:23:33.958822] [DEBUG] [MAIN ] KFRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:33.960681] [INFO ] [MAIN ] KFRC: Generated 1820 derivative records from 19766 primary records. [2025-09-26T22:23:33.960769] [DEBUG] [LOCAL ] KFRC: Saving derivative data. [2025-09-26T22:23:33.991211] [DEBUG] [LOCAL ] KFRC: Derivative data saved (1820 records). [2025-09-26T22:23:33.991326] [INFO ] [MAIN ] KFRC: Successfully saved derivative data. [2025-09-26T22:23:33.994328] [INFO ] [MAIN ] Derivative Progress: 1019/2074 symbols completed. KFRC took 1.0s. Estimated remaining: 7m 21s. Rate: 143.5 symbols/min [2025-09-26T22:23:33.996366] [DEBUG] [LOCAL ] KFS: Derivative data saved (1820 records). [2025-09-26T22:23:33.996503] [INFO ] [MAIN ] KFS: Successfully saved derivative data. [2025-09-26T22:23:33.999248] [INFO ] [MAIN ] Derivative Progress: 1020/2074 symbols completed. KFS took 1.0s. Estimated remaining: 7m 20s. Rate: 143.7 symbols/min [2025-09-26T22:23:33.999999] [INFO ] [MAIN ] KFY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:33.999918] [INFO ] [MAIN ] KGC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:34.000722] [INFO ] [MAIN ] KGS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:34.041397] [DEBUG] [LOCAL ] KFY: Loaded 31057 existing records from primary storage. [2025-09-26T22:23:34.041733] [INFO ] [MAIN ] KFY: Loaded 31057 primary data records. [2025-09-26T22:23:34.263401] [DEBUG] [LOCAL ] KGS: Loaded 46487 existing records from primary storage. [2025-09-26T22:23:34.306183] [INFO ] [MAIN ] KGS: Loaded 46487 primary data records. [2025-09-26T22:23:34.307156] [DEBUG] [LOCAL ] KGC: Loaded 54479 existing records from primary storage. [2025-09-26T22:23:34.307314] [INFO ] [MAIN ] KGC: Loaded 54479 primary data records. [2025-09-26T22:23:35.177455] [DEBUG] [MAIN ] KFY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:35.178567] [INFO ] [MAIN ] KFY: Generated 1820 derivative records from 31057 primary records. [2025-09-26T22:23:35.181133] [DEBUG] [LOCAL ] KFY: Saving derivative data. [2025-09-26T22:23:35.201590] [DEBUG] [LOCAL ] KFY: Derivative data saved (1820 records). [2025-09-26T22:23:35.202349] [INFO ] [MAIN ] KFY: Successfully saved derivative data. [2025-09-26T22:23:35.204505] [INFO ] [MAIN ] Derivative Progress: 1021/2074 symbols completed. KFY took 1.2s. Estimated remaining: 7m 21s. Rate: 143.4 symbols/min [2025-09-26T22:23:35.205599] [INFO ] [MAIN ] KIM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:35.242250] [DEBUG] [MAIN ] KGC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:35.244427] [INFO ] [MAIN ] KGC: Generated 1820 derivative records from 54479 primary records. [2025-09-26T22:23:35.244612] [DEBUG] [LOCAL ] KGC: Saving derivative data. [2025-09-26T22:23:35.243216] [DEBUG] [MAIN ] KGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:35.246518] [INFO ] [MAIN ] KGS: Generated 1820 derivative records from 46487 primary records. [2025-09-26T22:23:35.247517] [DEBUG] [LOCAL ] KGS: Saving derivative data. [2025-09-26T22:23:35.289269] [DEBUG] [LOCAL ] KGS: Derivative data saved (1820 records). [2025-09-26T22:23:35.290235] [INFO ] [MAIN ] KGS: Successfully saved derivative data. [2025-09-26T22:23:35.293605] [INFO ] [MAIN ] Derivative Progress: 1022/2074 symbols completed. KGS took 1.3s. Estimated remaining: 7m 20s. Rate: 143.5 symbols/min [2025-09-26T22:23:35.295133] [INFO ] [MAIN ] KIO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:35.311524] [DEBUG] [LOCAL ] KGC: Derivative data saved (1820 records). [2025-09-26T22:23:35.312025] [INFO ] [MAIN ] KGC: Successfully saved derivative data. [2025-09-26T22:23:35.315186] [INFO ] [MAIN ] Derivative Progress: 1023/2074 symbols completed. KGC took 1.3s. Estimated remaining: 7m 19s. Rate: 143.7 symbols/min [2025-09-26T22:23:35.315635] [INFO ] [MAIN ] KKR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:35.347334] [DEBUG] [LOCAL ] KIM: Loaded 53831 existing records from primary storage. [2025-09-26T22:23:35.347757] [INFO ] [MAIN ] KIM: Loaded 53831 primary data records. [2025-09-26T22:23:35.418227] [DEBUG] [LOCAL ] KIO: Loaded 21625 existing records from primary storage. [2025-09-26T22:23:35.442353] [INFO ] [MAIN ] KIO: Loaded 21625 primary data records. [2025-09-26T22:23:35.736791] [DEBUG] [LOCAL ] KKR: Loaded 54281 existing records from primary storage. [2025-09-26T22:23:35.906032] [INFO ] [MAIN ] KKR: Loaded 54281 primary data records. [2025-09-26T22:23:36.420168] [DEBUG] [MAIN ] KIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:36.422513] [INFO ] [MAIN ] KIM: Generated 1820 derivative records from 53831 primary records. [2025-09-26T22:23:36.423802] [DEBUG] [LOCAL ] KIM: Saving derivative data. [2025-09-26T22:23:36.454340] [DEBUG] [MAIN ] KIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:36.456738] [INFO ] [MAIN ] KIO: Generated 1820 derivative records from 21625 primary records. [2025-09-26T22:23:36.458393] [DEBUG] [LOCAL ] KIO: Saving derivative data. [2025-09-26T22:23:36.460816] [DEBUG] [LOCAL ] KIM: Derivative data saved (1820 records). [2025-09-26T22:23:36.462263] [INFO ] [MAIN ] KIM: Successfully saved derivative data. [2025-09-26T22:23:36.464687] [INFO ] [MAIN ] Derivative Progress: 1024/2074 symbols completed. KIM took 1.3s. Estimated remaining: 7m 19s. Rate: 143.4 symbols/min [2025-09-26T22:23:36.472671] [INFO ] [MAIN ] KKRS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:36.483243] [DEBUG] [LOCAL ] KIO: Derivative data saved (1820 records). [2025-09-26T22:23:36.484457] [INFO ] [MAIN ] KIO: Successfully saved derivative data. [2025-09-26T22:23:36.487344] [INFO ] [MAIN ] Derivative Progress: 1025/2074 symbols completed. KIO took 1.2s. Estimated remaining: 7m 18s. Rate: 143.5 symbols/min [2025-09-26T22:23:36.491003] [INFO ] [MAIN ] KLC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:36.495682] [DEBUG] [LOCAL ] KKRS: Loaded 5801 existing records from primary storage. [2025-09-26T22:23:36.509183] [INFO ] [MAIN ] KKRS: Loaded 5801 primary data records. [2025-09-26T22:23:36.514960] [DEBUG] [MAIN ] KKR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:36.558789] [INFO ] [MAIN ] KKR: Generated 1820 derivative records from 54281 primary records. [2025-09-26T22:23:36.581132] [DEBUG] [LOCAL ] KKR: Saving derivative data. [2025-09-26T22:23:36.757574] [DEBUG] [LOCAL ] KKR: Derivative data saved (1820 records). [2025-09-26T22:23:36.757091] [DEBUG] [LOCAL ] KLC: Loaded 37107 existing records from primary storage. [2025-09-26T22:23:36.757967] [INFO ] [MAIN ] KLC: Loaded 37107 primary data records. [2025-09-26T22:23:36.925552] [INFO ] [MAIN ] KKR: Successfully saved derivative data. [2025-09-26T22:23:36.943316] [INFO ] [MAIN ] Derivative Progress: 1026/2074 symbols completed. KKR took 1.6s. Estimated remaining: 7m 18s. Rate: 143.5 symbols/min [2025-09-26T22:23:36.949535] [INFO ] [MAIN ] KMI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:37.340391] [DEBUG] [MAIN ] KKRS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:37.361559] [INFO ] [MAIN ] KKRS: Generated 1820 derivative records from 5801 primary records. [2025-09-26T22:23:37.364215] [DEBUG] [LOCAL ] KKRS: Saving derivative data. [2025-09-26T22:23:37.366752] [DEBUG] [LOCAL ] KMI: Loaded 54473 existing records from primary storage. [2025-09-26T22:23:37.367371] [INFO ] [MAIN ] KMI: Loaded 54473 primary data records. [2025-09-26T22:23:37.383461] [DEBUG] [LOCAL ] KKRS: Derivative data saved (1820 records). [2025-09-26T22:23:37.396286] [INFO ] [MAIN ] KKRS: Successfully saved derivative data. [2025-09-26T22:23:37.440669] [INFO ] [MAIN ] Derivative Progress: 1027/2074 symbols completed. KKRS took 1.0s. Estimated remaining: 7m 18s. Rate: 143.5 symbols/min [2025-09-26T22:23:37.479060] [INFO ] [MAIN ] KMPB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:37.722460] [DEBUG] [LOCAL ] KMPB: Loaded 3646 existing records from primary storage. [2025-09-26T22:23:37.737291] [INFO ] [MAIN ] KMPB: Loaded 3646 primary data records. [2025-09-26T22:23:37.772469] [DEBUG] [MAIN ] KLC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:37.780509] [INFO ] [MAIN ] KLC: Generated 1820 derivative records from 37107 primary records. [2025-09-26T22:23:37.806995] [DEBUG] [LOCAL ] KLC: Saving derivative data. [2025-09-26T22:23:38.149446] [DEBUG] [LOCAL ] KLC: Derivative data saved (1820 records). [2025-09-26T22:23:38.149768] [INFO ] [MAIN ] KLC: Successfully saved derivative data. [2025-09-26T22:23:38.152557] [INFO ] [MAIN ] Derivative Progress: 1028/2074 symbols completed. KLC took 1.7s. Estimated remaining: 7m 18s. Rate: 143.4 symbols/min [2025-09-26T22:23:38.153774] [INFO ] [MAIN ] KMPR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:38.176369] [DEBUG] [MAIN ] KMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:38.177578] [INFO ] [MAIN ] KMI: Generated 1820 derivative records from 54473 primary records. [2025-09-26T22:23:38.177834] [DEBUG] [LOCAL ] KMI: Saving derivative data. [2025-09-26T22:23:38.200461] [DEBUG] [LOCAL ] KMI: Derivative data saved (1820 records). [2025-09-26T22:23:38.208708] [INFO ] [MAIN ] KMI: Successfully saved derivative data. [2025-09-26T22:23:38.216604] [INFO ] [MAIN ] Derivative Progress: 1029/2074 symbols completed. KMI took 1.3s. Estimated remaining: 7m 17s. Rate: 143.5 symbols/min [2025-09-26T22:23:38.217035] [DEBUG] [MAIN ] KMPB: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:23:38.218235] [INFO ] [MAIN ] KMPB: Generated 1819 derivative records from 3646 primary records. [2025-09-26T22:23:38.218466] [INFO ] [MAIN ] KMT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:38.218682] [DEBUG] [LOCAL ] KMPB: Saving derivative data. [2025-09-26T22:23:38.244035] [DEBUG] [LOCAL ] KMPB: Derivative data saved (1819 records). [2025-09-26T22:23:38.244239] [INFO ] [MAIN ] KMPB: Successfully saved derivative data. [2025-09-26T22:23:38.246953] [INFO ] [MAIN ] Derivative Progress: 1030/2074 symbols completed. KMPB took 0.8s. Estimated remaining: 7m 16s. Rate: 143.6 symbols/min [2025-09-26T22:23:38.247359] [INFO ] [MAIN ] KMX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:38.263315] [DEBUG] [LOCAL ] KMPR: Loaded 39117 existing records from primary storage. [2025-09-26T22:23:38.263559] [INFO ] [MAIN ] KMPR: Loaded 39117 primary data records. [2025-09-26T22:23:38.429806] [DEBUG] [LOCAL ] KMT: Loaded 43687 existing records from primary storage. [2025-09-26T22:23:38.459103] [INFO ] [MAIN ] KMT: Loaded 43687 primary data records. [2025-09-26T22:23:38.777666] [DEBUG] [LOCAL ] KMX: Loaded 53897 existing records from primary storage. [2025-09-26T22:23:38.778834] [INFO ] [MAIN ] KMX: Loaded 53897 primary data records. [2025-09-26T22:23:39.431534] [DEBUG] [MAIN ] KMPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:39.433021] [INFO ] [MAIN ] KMPR: Generated 1820 derivative records from 39117 primary records. [2025-09-26T22:23:39.433177] [DEBUG] [LOCAL ] KMPR: Saving derivative data. [2025-09-26T22:23:39.457758] [DEBUG] [LOCAL ] KMPR: Derivative data saved (1820 records). [2025-09-26T22:23:39.458057] [INFO ] [MAIN ] KMPR: Successfully saved derivative data. [2025-09-26T22:23:39.460538] [INFO ] [MAIN ] Derivative Progress: 1031/2074 symbols completed. KMPR took 1.3s. Estimated remaining: 7m 16s. Rate: 143.4 symbols/min [2025-09-26T22:23:39.469490] [INFO ] [MAIN ] KN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:39.476009] [DEBUG] [MAIN ] KMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:39.477414] [INFO ] [MAIN ] KMT: Generated 1820 derivative records from 43687 primary records. [2025-09-26T22:23:39.477730] [DEBUG] [LOCAL ] KMT: Saving derivative data. [2025-09-26T22:23:39.498969] [DEBUG] [LOCAL ] KMT: Derivative data saved (1820 records). [2025-09-26T22:23:39.507254] [INFO ] [MAIN ] KMT: Successfully saved derivative data. [2025-09-26T22:23:39.513441] [DEBUG] [MAIN ] KMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:39.515956] [INFO ] [MAIN ] Derivative Progress: 1032/2074 symbols completed. KMT took 1.3s. Estimated remaining: 7m 16s. Rate: 143.5 symbols/min [2025-09-26T22:23:39.516495] [INFO ] [MAIN ] KNF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:39.518292] [INFO ] [MAIN ] KMX: Generated 1820 derivative records from 53897 primary records. [2025-09-26T22:23:39.518473] [DEBUG] [LOCAL ] KMX: Saving derivative data. [2025-09-26T22:23:39.550012] [DEBUG] [LOCAL ] KMX: Derivative data saved (1820 records). [2025-09-26T22:23:39.550173] [INFO ] [MAIN ] KMX: Successfully saved derivative data. [2025-09-26T22:23:39.553121] [INFO ] [MAIN ] Derivative Progress: 1033/2074 symbols completed. KMX took 1.3s. Estimated remaining: 7m 15s. Rate: 143.6 symbols/min [2025-09-26T22:23:39.568351] [DEBUG] [LOCAL ] KN: Loaded 39393 existing records from primary storage. [2025-09-26T22:23:39.568524] [INFO ] [MAIN ] KN: Loaded 39393 primary data records. [2025-09-26T22:23:39.740192] [DEBUG] [LOCAL ] KNF: Loaded 36435 existing records from primary storage. [2025-09-26T22:23:39.752000] [INFO ] [MAIN ] KNF: Loaded 36435 primary data records. [2025-09-26T22:23:40.255419] [DEBUG] [MAIN ] KN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:40.256332] [INFO ] [MAIN ] KN: Generated 1820 derivative records from 39393 primary records. [2025-09-26T22:23:40.256598] [DEBUG] [LOCAL ] KN: Saving derivative data. [2025-09-26T22:23:40.289760] [DEBUG] [LOCAL ] KN: Derivative data saved (1820 records). [2025-09-26T22:23:40.289673] [DEBUG] [MAIN ] KNF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:40.289908] [INFO ] [MAIN ] KN: Successfully saved derivative data. [2025-09-26T22:23:40.292968] [INFO ] [MAIN ] Derivative Progress: 1034/2074 symbols completed. KN took 0.8s. Estimated remaining: 7m 15s. Rate: 143.5 symbols/min [2025-09-26T22:23:40.290668] [INFO ] [MAIN ] KNF: Generated 1820 derivative records from 36435 primary records. [2025-09-26T22:23:40.293100] [DEBUG] [LOCAL ] KNF: Saving derivative data. [2025-09-26T22:23:40.309469] [DEBUG] [LOCAL ] KNF: Derivative data saved (1820 records). [2025-09-26T22:23:40.309589] [INFO ] [MAIN ] KNF: Successfully saved derivative data. [2025-09-26T22:23:40.312139] [INFO ] [MAIN ] Derivative Progress: 1035/2074 symbols completed. KNF took 0.8s. Estimated remaining: 7m 14s. Rate: 143.7 symbols/min [2025-09-26T22:23:40.312759] [INFO ] [MAIN ] KNOP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:40.313052] [INFO ] [MAIN ] KNSL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:40.313000] [INFO ] [MAIN ] KNTK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:40.326002] [DEBUG] [LOCAL ] KNOP: Loaded 10274 existing records from primary storage. [2025-09-26T22:23:40.326145] [INFO ] [MAIN ] KNOP: Loaded 10274 primary data records. [2025-09-26T22:23:40.434831] [DEBUG] [LOCAL ] KNSL: Loaded 18372 existing records from primary storage. [2025-09-26T22:23:40.464410] [INFO ] [MAIN ] KNSL: Loaded 18372 primary data records. [2025-09-26T22:23:40.809748] [DEBUG] [LOCAL ] KNTK: Loaded 46794 existing records from primary storage. [2025-09-26T22:23:40.826187] [INFO ] [MAIN ] KNTK: Loaded 46794 primary data records. [2025-09-26T22:23:41.430524] [DEBUG] [MAIN ] KNOP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:41.432698] [INFO ] [MAIN ] KNOP: Generated 1820 derivative records from 10274 primary records. [2025-09-26T22:23:41.433833] [DEBUG] [LOCAL ] KNOP: Saving derivative data. [2025-09-26T22:23:41.461838] [DEBUG] [MAIN ] KNSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:41.463066] [INFO ] [MAIN ] KNSL: Generated 1820 derivative records from 18372 primary records. [2025-09-26T22:23:41.463789] [DEBUG] [LOCAL ] KNSL: Saving derivative data. [2025-09-26T22:23:41.483356] [DEBUG] [LOCAL ] KNOP: Derivative data saved (1820 records). [2025-09-26T22:23:41.484006] [INFO ] [MAIN ] KNOP: Successfully saved derivative data. [2025-09-26T22:23:41.487459] [INFO ] [MAIN ] Derivative Progress: 1036/2074 symbols completed. KNOP took 1.2s. Estimated remaining: 7m 14s. Rate: 143.4 symbols/min [2025-09-26T22:23:41.488290] [INFO ] [MAIN ] KNX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:41.503593] [DEBUG] [MAIN ] KNTK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:41.505389] [INFO ] [MAIN ] KNTK: Generated 1820 derivative records from 46794 primary records. [2025-09-26T22:23:41.505512] [DEBUG] [LOCAL ] KNSL: Derivative data saved (1820 records). [2025-09-26T22:23:41.505753] [DEBUG] [LOCAL ] KNTK: Saving derivative data. [2025-09-26T22:23:41.505826] [INFO ] [MAIN ] KNSL: Successfully saved derivative data. [2025-09-26T22:23:41.509116] [INFO ] [MAIN ] Derivative Progress: 1037/2074 symbols completed. KNSL took 1.2s. Estimated remaining: 7m 13s. Rate: 143.5 symbols/min [2025-09-26T22:23:41.509514] [INFO ] [MAIN ] KODK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:41.527123] [DEBUG] [LOCAL ] KNTK: Derivative data saved (1820 records). [2025-09-26T22:23:41.527267] [INFO ] [MAIN ] KNTK: Successfully saved derivative data. [2025-09-26T22:23:41.530353] [INFO ] [MAIN ] Derivative Progress: 1038/2074 symbols completed. KNTK took 1.2s. Estimated remaining: 7m 13s. Rate: 143.7 symbols/min [2025-09-26T22:23:41.530974] [INFO ] [MAIN ] KOF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:41.586858] [DEBUG] [LOCAL ] KOF: Loaded 26219 existing records from primary storage. [2025-09-26T22:23:41.587078] [INFO ] [MAIN ] KOF: Loaded 26219 primary data records. [2025-09-26T22:23:41.742230] [DEBUG] [LOCAL ] KODK: Loaded 44025 existing records from primary storage. [2025-09-26T22:23:41.708060] [DEBUG] [LOCAL ] KNX: Loaded 53363 existing records from primary storage. [2025-09-26T22:23:41.746792] [INFO ] [MAIN ] KODK: Loaded 44025 primary data records. [2025-09-26T22:23:41.746272] [INFO ] [MAIN ] KNX: Loaded 53363 primary data records. [2025-09-26T22:23:42.635237] [DEBUG] [MAIN ] KOF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:42.637905] [INFO ] [MAIN ] KOF: Generated 1820 derivative records from 26219 primary records. [2025-09-26T22:23:42.638096] [DEBUG] [LOCAL ] KOF: Saving derivative data. [2025-09-26T22:23:42.679357] [DEBUG] [MAIN ] KODK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:42.687293] [INFO ] [MAIN ] KODK: Generated 1820 derivative records from 44025 primary records. [2025-09-26T22:23:42.687756] [DEBUG] [LOCAL ] KODK: Saving derivative data. [2025-09-26T22:23:42.685750] [DEBUG] [MAIN ] KNX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:42.689930] [INFO ] [MAIN ] KNX: Generated 1820 derivative records from 53363 primary records. [2025-09-26T22:23:42.691110] [DEBUG] [LOCAL ] KNX: Saving derivative data. [2025-09-26T22:23:42.714336] [DEBUG] [LOCAL ] KOF: Derivative data saved (1820 records). [2025-09-26T22:23:42.720334] [INFO ] [MAIN ] KOF: Successfully saved derivative data. [2025-09-26T22:23:42.723610] [INFO ] [MAIN ] Derivative Progress: 1039/2074 symbols completed. KOF took 1.2s. Estimated remaining: 7m 13s. Rate: 143.4 symbols/min [2025-09-26T22:23:42.724740] [INFO ] [MAIN ] KOP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:42.728108] [DEBUG] [LOCAL ] KODK: Derivative data saved (1820 records). [2025-09-26T22:23:42.728438] [INFO ] [MAIN ] KODK: Successfully saved derivative data. [2025-09-26T22:23:42.731567] [INFO ] [MAIN ] Derivative Progress: 1040/2074 symbols completed. KODK took 1.2s. Estimated remaining: 7m 12s. Rate: 143.5 symbols/min [2025-09-26T22:23:42.732885] [INFO ] [MAIN ] KORE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:42.735915] [DEBUG] [LOCAL ] KNX: Derivative data saved (1820 records). [2025-09-26T22:23:42.736623] [INFO ] [MAIN ] KNX: Successfully saved derivative data. [2025-09-26T22:23:42.739580] [INFO ] [MAIN ] Derivative Progress: 1041/2074 symbols completed. KNX took 1.3s. Estimated remaining: 7m 11s. Rate: 143.7 symbols/min [2025-09-26T22:23:42.740231] [INFO ] [MAIN ] KOS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:42.747667] [DEBUG] [LOCAL ] KORE: Loaded 2010 existing records from primary storage. [2025-09-26T22:23:42.747931] [INFO ] [MAIN ] KORE: Loaded 2010 primary data records. [2025-09-26T22:23:42.809691] [DEBUG] [LOCAL ] KOP: Loaded 18066 existing records from primary storage. [2025-09-26T22:23:42.834817] [INFO ] [MAIN ] KOP: Loaded 18066 primary data records. [2025-09-26T22:23:43.478206] [DEBUG] [LOCAL ] KOS: Loaded 53828 existing records from primary storage. [2025-09-26T22:23:43.492448] [INFO ] [MAIN ] KOS: Loaded 53828 primary data records. [2025-09-26T22:23:43.818472] [DEBUG] [MAIN ] KORE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:43.834136] [INFO ] [MAIN ] KORE: Generated 1820 derivative records from 2010 primary records. [2025-09-26T22:23:43.835381] [DEBUG] [LOCAL ] KORE: Saving derivative data. [2025-09-26T22:23:43.858153] [DEBUG] [LOCAL ] KORE: Derivative data saved (1820 records). [2025-09-26T22:23:43.858985] [INFO ] [MAIN ] KORE: Successfully saved derivative data. [2025-09-26T22:23:43.862283] [INFO ] [MAIN ] Derivative Progress: 1042/2074 symbols completed. KORE took 1.1s. Estimated remaining: 7m 12s. Rate: 143.4 symbols/min [2025-09-26T22:23:43.862719] [INFO ] [MAIN ] KR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:43.879076] [DEBUG] [MAIN ] KOP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:43.880300] [INFO ] [MAIN ] KOP: Generated 1820 derivative records from 18066 primary records. [2025-09-26T22:23:43.880467] [DEBUG] [LOCAL ] KOP: Saving derivative data. [2025-09-26T22:23:43.901087] [DEBUG] [LOCAL ] KOP: Derivative data saved (1820 records). [2025-09-26T22:23:43.902759] [INFO ] [MAIN ] KOP: Successfully saved derivative data. [2025-09-26T22:23:43.905387] [INFO ] [MAIN ] Derivative Progress: 1043/2074 symbols completed. KOP took 1.2s. Estimated remaining: 7m 11s. Rate: 143.6 symbols/min [2025-09-26T22:23:43.907996] [INFO ] [MAIN ] KRC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:43.923867] [DEBUG] [MAIN ] KOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:43.925468] [INFO ] [MAIN ] KOS: Generated 1820 derivative records from 53828 primary records. [2025-09-26T22:23:43.925635] [DEBUG] [LOCAL ] KOS: Saving derivative data. [2025-09-26T22:23:43.959229] [DEBUG] [LOCAL ] KOS: Derivative data saved (1820 records). [2025-09-26T22:23:43.959400] [INFO ] [MAIN ] KOS: Successfully saved derivative data. [2025-09-26T22:23:43.962076] [INFO ] [MAIN ] Derivative Progress: 1044/2074 symbols completed. KOS took 1.2s. Estimated remaining: 7m 10s. Rate: 143.7 symbols/min [2025-09-26T22:23:43.962473] [INFO ] [MAIN ] KREF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:44.000114] [DEBUG] [LOCAL ] KR: Loaded 54461 existing records from primary storage. [2025-09-26T22:23:44.000441] [INFO ] [MAIN ] KR: Loaded 54461 primary data records. [2025-09-26T22:23:44.124484] [DEBUG] [LOCAL ] KRC: Loaded 49114 existing records from primary storage. [2025-09-26T22:23:44.136868] [INFO ] [MAIN ] KRC: Loaded 49114 primary data records. [2025-09-26T22:23:44.330389] [DEBUG] [LOCAL ] KREF: Loaded 37767 existing records from primary storage. [2025-09-26T22:23:44.357030] [INFO ] [MAIN ] KREF: Loaded 37767 primary data records. [2025-09-26T22:23:45.055707] [DEBUG] [MAIN ] KR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:45.058187] [INFO ] [MAIN ] KR: Generated 1820 derivative records from 54461 primary records. [2025-09-26T22:23:45.066096] [DEBUG] [LOCAL ] KR: Saving derivative data. [2025-09-26T22:23:45.074165] [DEBUG] [MAIN ] KRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:45.090074] [INFO ] [MAIN ] KRC: Generated 1820 derivative records from 49114 primary records. [2025-09-26T22:23:45.091442] [DEBUG] [LOCAL ] KRC: Saving derivative data. [2025-09-26T22:23:45.121327] [DEBUG] [MAIN ] KREF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:45.123862] [INFO ] [MAIN ] KREF: Generated 1820 derivative records from 37767 primary records. [2025-09-26T22:23:45.127288] [DEBUG] [LOCAL ] KRC: Derivative data saved (1820 records). [2025-09-26T22:23:45.127871] [DEBUG] [LOCAL ] KREF: Saving derivative data. [2025-09-26T22:23:45.128023] [INFO ] [MAIN ] KRC: Successfully saved derivative data. [2025-09-26T22:23:45.132175] [INFO ] [MAIN ] Derivative Progress: 1045/2074 symbols completed. KRC took 1.2s. Estimated remaining: 7m 10s. Rate: 143.4 symbols/min [2025-09-26T22:23:45.143520] [DEBUG] [LOCAL ] KR: Derivative data saved (1820 records). [2025-09-26T22:23:45.143736] [INFO ] [MAIN ] KR: Successfully saved derivative data. [2025-09-26T22:23:45.151332] [INFO ] [MAIN ] Derivative Progress: 1046/2074 symbols completed. KR took 1.3s. Estimated remaining: 7m 10s. Rate: 143.6 symbols/min [2025-09-26T22:23:45.152475] [INFO ] [MAIN ] KRO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:45.152592] [INFO ] [MAIN ] KRG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:45.160890] [DEBUG] [LOCAL ] KREF: Derivative data saved (1820 records). [2025-09-26T22:23:45.161087] [INFO ] [MAIN ] KREF: Successfully saved derivative data. [2025-09-26T22:23:45.164111] [INFO ] [MAIN ] Derivative Progress: 1047/2074 symbols completed. KREF took 1.2s. Estimated remaining: 7m 9s. Rate: 143.7 symbols/min [2025-09-26T22:23:45.164593] [INFO ] [MAIN ] KRP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:45.187957] [DEBUG] [LOCAL ] KRO: Loaded 26448 existing records from primary storage. [2025-09-26T22:23:45.188198] [INFO ] [MAIN ] KRO: Loaded 26448 primary data records. [2025-09-26T22:23:45.413558] [DEBUG] [LOCAL ] KRG: Loaded 49859 existing records from primary storage. [2025-09-26T22:23:45.437245] [INFO ] [MAIN ] KRG: Loaded 49859 primary data records. [2025-09-26T22:23:45.631525] [DEBUG] [LOCAL ] KRP: Loaded 37947 existing records from primary storage. [2025-09-26T22:23:45.664368] [INFO ] [MAIN ] KRP: Loaded 37947 primary data records. [2025-09-26T22:23:46.297625] [DEBUG] [MAIN ] KRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:46.299542] [INFO ] [MAIN ] KRO: Generated 1820 derivative records from 26448 primary records. [2025-09-26T22:23:46.299787] [DEBUG] [LOCAL ] KRO: Saving derivative data. [2025-09-26T22:23:46.317823] [DEBUG] [LOCAL ] KRO: Derivative data saved (1820 records). [2025-09-26T22:23:46.318172] [INFO ] [MAIN ] KRO: Successfully saved derivative data. [2025-09-26T22:23:46.320972] [INFO ] [MAIN ] Derivative Progress: 1048/2074 symbols completed. KRO took 1.2s. Estimated remaining: 7m 9s. Rate: 143.5 symbols/min [2025-09-26T22:23:46.338572] [DEBUG] [MAIN ] KRG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:46.339376] [INFO ] [MAIN ] KRG: Generated 1820 derivative records from 49859 primary records. [2025-09-26T22:23:46.339668] [DEBUG] [LOCAL ] KRG: Saving derivative data. [2025-09-26T22:23:46.357363] [DEBUG] [LOCAL ] KRG: Derivative data saved (1820 records). [2025-09-26T22:23:46.358960] [INFO ] [MAIN ] KRG: Successfully saved derivative data. [2025-09-26T22:23:46.361405] [INFO ] [MAIN ] Derivative Progress: 1049/2074 symbols completed. KRG took 1.2s. Estimated remaining: 7m 8s. Rate: 143.6 symbols/min [2025-09-26T22:23:46.374715] [DEBUG] [MAIN ] KRP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:46.375364] [INFO ] [MAIN ] KRP: Generated 1820 derivative records from 37947 primary records. [2025-09-26T22:23:46.375429] [DEBUG] [LOCAL ] KRP: Saving derivative data. [2025-09-26T22:23:46.392166] [DEBUG] [LOCAL ] KRP: Derivative data saved (1820 records). [2025-09-26T22:23:46.392286] [INFO ] [MAIN ] KRP: Successfully saved derivative data. [2025-09-26T22:23:46.394803] [INFO ] [MAIN ] Derivative Progress: 1050/2074 symbols completed. KRP took 1.2s. Estimated remaining: 7m 8s. Rate: 143.7 symbols/min [2025-09-26T22:23:46.395372] [INFO ] [MAIN ] KSS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:46.395695] [INFO ] [MAIN ] KTB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:46.395534] [INFO ] [MAIN ] KT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:46.461186] [DEBUG] [LOCAL ] KTB: Loaded 41738 existing records from primary storage. [2025-09-26T22:23:46.461459] [INFO ] [MAIN ] KTB: Loaded 41738 primary data records. [2025-09-26T22:23:46.535923] [DEBUG] [LOCAL ] KT: Loaded 46336 existing records from primary storage. [2025-09-26T22:23:46.550714] [INFO ] [MAIN ] KT: Loaded 46336 primary data records. [2025-09-26T22:23:46.611512] [DEBUG] [LOCAL ] KSS: Loaded 54385 existing records from primary storage. [2025-09-26T22:23:46.646680] [INFO ] [MAIN ] KSS: Loaded 54385 primary data records. [2025-09-26T22:23:47.498813] [DEBUG] [MAIN ] KTB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:47.513329] [DEBUG] [MAIN ] KT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:47.513014] [INFO ] [MAIN ] KTB: Generated 1820 derivative records from 41738 primary records. [2025-09-26T22:23:47.513572] [DEBUG] [LOCAL ] KTB: Saving derivative data. [2025-09-26T22:23:47.515959] [INFO ] [MAIN ] KT: Generated 1820 derivative records from 46336 primary records. [2025-09-26T22:23:47.517100] [DEBUG] [LOCAL ] KT: Saving derivative data. [2025-09-26T22:23:47.560604] [DEBUG] [MAIN ] KSS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:47.562592] [INFO ] [MAIN ] KSS: Generated 1820 derivative records from 54385 primary records. [2025-09-26T22:23:47.563378] [DEBUG] [LOCAL ] KSS: Saving derivative data. [2025-09-26T22:23:47.564120] [DEBUG] [LOCAL ] KTB: Derivative data saved (1820 records). [2025-09-26T22:23:47.564474] [INFO ] [MAIN ] KTB: Successfully saved derivative data. [2025-09-26T22:23:47.567391] [INFO ] [MAIN ] Derivative Progress: 1051/2074 symbols completed. KTB took 1.2s. Estimated remaining: 7m 8s. Rate: 143.5 symbols/min [2025-09-26T22:23:47.567954] [INFO ] [MAIN ] KTF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:47.581836] [DEBUG] [LOCAL ] KT: Derivative data saved (1820 records). [2025-09-26T22:23:47.582522] [INFO ] [MAIN ] KT: Successfully saved derivative data. [2025-09-26T22:23:47.585567] [INFO ] [MAIN ] Derivative Progress: 1052/2074 symbols completed. KT took 1.2s. Estimated remaining: 7m 7s. Rate: 143.6 symbols/min [2025-09-26T22:23:47.586134] [INFO ] [MAIN ] KVUE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:47.590961] [DEBUG] [LOCAL ] KSS: Derivative data saved (1820 records). [2025-09-26T22:23:47.591220] [INFO ] [MAIN ] KSS: Successfully saved derivative data. [2025-09-26T22:23:47.593798] [INFO ] [MAIN ] Derivative Progress: 1053/2074 symbols completed. KSS took 1.2s. Estimated remaining: 7m 6s. Rate: 143.7 symbols/min [2025-09-26T22:23:47.597717] [INFO ] [MAIN ] KVYO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:47.604899] [DEBUG] [LOCAL ] KTF: Loaded 13065 existing records from primary storage. [2025-09-26T22:23:47.605030] [INFO ] [MAIN ] KTF: Loaded 13065 primary data records. [2025-09-26T22:23:48.009546] [DEBUG] [LOCAL ] KVUE: Loaded 54447 existing records from primary storage. [2025-09-26T22:23:48.024601] [INFO ] [MAIN ] KVUE: Loaded 54447 primary data records. [2025-09-26T22:23:48.026045] [DEBUG] [LOCAL ] KVYO: Loaded 50696 existing records from primary storage. [2025-09-26T22:23:48.031888] [INFO ] [MAIN ] KVYO: Loaded 50696 primary data records. [2025-09-26T22:23:48.707176] [DEBUG] [MAIN ] KTF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:48.709045] [INFO ] [MAIN ] KTF: Generated 1820 derivative records from 13065 primary records. [2025-09-26T22:23:48.709532] [DEBUG] [LOCAL ] KTF: Saving derivative data. [2025-09-26T22:23:48.732352] [DEBUG] [LOCAL ] KTF: Derivative data saved (1820 records). [2025-09-26T22:23:48.733063] [INFO ] [MAIN ] KTF: Successfully saved derivative data. [2025-09-26T22:23:48.735865] [INFO ] [MAIN ] Derivative Progress: 1054/2074 symbols completed. KTF took 1.2s. Estimated remaining: 7m 6s. Rate: 143.5 symbols/min [2025-09-26T22:23:48.736615] [INFO ] [MAIN ] KW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:48.772240] [DEBUG] [MAIN ] KVUE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:48.772020] [DEBUG] [MAIN ] KVYO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:48.774215] [INFO ] [MAIN ] KVUE: Generated 1820 derivative records from 54447 primary records. [2025-09-26T22:23:48.774411] [DEBUG] [LOCAL ] KVUE: Saving derivative data. [2025-09-26T22:23:48.773363] [INFO ] [MAIN ] KVYO: Generated 1820 derivative records from 50696 primary records. [2025-09-26T22:23:48.775067] [DEBUG] [LOCAL ] KVYO: Saving derivative data. [2025-09-26T22:23:48.809230] [DEBUG] [LOCAL ] KVYO: Derivative data saved (1820 records). [2025-09-26T22:23:48.810185] [INFO ] [MAIN ] KVYO: Successfully saved derivative data. [2025-09-26T22:23:48.813184] [INFO ] [MAIN ] Derivative Progress: 1055/2074 symbols completed. KVYO took 1.2s. Estimated remaining: 7m 6s. Rate: 143.6 symbols/min [2025-09-26T22:23:48.813861] [INFO ] [MAIN ] KWR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:48.827719] [DEBUG] [LOCAL ] KVUE: Derivative data saved (1820 records). [2025-09-26T22:23:48.827909] [INFO ] [MAIN ] KVUE: Successfully saved derivative data. [2025-09-26T22:23:48.830629] [INFO ] [MAIN ] Derivative Progress: 1056/2074 symbols completed. KVUE took 1.2s. Estimated remaining: 7m 5s. Rate: 143.7 symbols/min [2025-09-26T22:23:48.831083] [INFO ] [MAIN ] KYN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:48.851865] [DEBUG] [LOCAL ] KW: Loaded 41236 existing records from primary storage. [2025-09-26T22:23:48.852087] [INFO ] [MAIN ] KW: Loaded 41236 primary data records. [2025-09-26T22:23:48.900610] [DEBUG] [LOCAL ] KWR: Loaded 16931 existing records from primary storage. [2025-09-26T22:23:48.931299] [INFO ] [MAIN ] KWR: Loaded 16931 primary data records. [2025-09-26T22:23:49.121698] [DEBUG] [LOCAL ] KYN: Loaded 30432 existing records from primary storage. [2025-09-26T22:23:49.163382] [INFO ] [MAIN ] KYN: Loaded 30432 primary data records. [2025-09-26T22:23:50.001890] [DEBUG] [MAIN ] KW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:50.003984] [INFO ] [MAIN ] KW: Generated 1820 derivative records from 41236 primary records. [2025-09-26T22:23:50.004159] [DEBUG] [LOCAL ] KW: Saving derivative data. [2025-09-26T22:23:50.042737] [DEBUG] [LOCAL ] KW: Derivative data saved (1820 records). [2025-09-26T22:23:50.043668] [INFO ] [MAIN ] KW: Successfully saved derivative data. [2025-09-26T22:23:50.043575] [DEBUG] [MAIN ] KWR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:50.045743] [INFO ] [MAIN ] Derivative Progress: 1057/2074 symbols completed. KW took 1.3s. Estimated remaining: 7m 5s. Rate: 143.5 symbols/min [2025-09-26T22:23:50.047370] [INFO ] [MAIN ] KWR: Generated 1820 derivative records from 16931 primary records. [2025-09-26T22:23:50.046466] [INFO ] [MAIN ] L: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:50.047599] [DEBUG] [LOCAL ] KWR: Saving derivative data. [2025-09-26T22:23:50.070274] [DEBUG] [LOCAL ] KWR: Derivative data saved (1820 records). [2025-09-26T22:23:50.070787] [INFO ] [MAIN ] KWR: Successfully saved derivative data. [2025-09-26T22:23:50.087369] [INFO ] [MAIN ] Derivative Progress: 1058/2074 symbols completed. KWR took 1.3s. Estimated remaining: 7m 5s. Rate: 143.6 symbols/min [2025-09-26T22:23:50.087876] [DEBUG] [MAIN ] KYN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:50.088402] [INFO ] [MAIN ] LAC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:50.089685] [INFO ] [MAIN ] KYN: Generated 1820 derivative records from 30432 primary records. [2025-09-26T22:23:50.090038] [DEBUG] [LOCAL ] KYN: Saving derivative data. [2025-09-26T22:23:50.118673] [DEBUG] [LOCAL ] KYN: Derivative data saved (1820 records). [2025-09-26T22:23:50.118971] [INFO ] [MAIN ] KYN: Successfully saved derivative data. [2025-09-26T22:23:50.121782] [INFO ] [MAIN ] Derivative Progress: 1059/2074 symbols completed. KYN took 1.3s. Estimated remaining: 7m 4s. Rate: 143.7 symbols/min [2025-09-26T22:23:50.122283] [INFO ] [MAIN ] LAD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:50.137219] [DEBUG] [LOCAL ] L: Loaded 41562 existing records from primary storage. [2025-09-26T22:23:50.137574] [INFO ] [MAIN ] L: Loaded 41562 primary data records. [2025-09-26T22:23:50.292826] [DEBUG] [LOCAL ] LAD: Loaded 24089 existing records from primary storage. [2025-09-26T22:23:50.308858] [INFO ] [MAIN ] LAD: Loaded 24089 primary data records. [2025-09-26T22:23:50.581967] [DEBUG] [LOCAL ] LAC: Loaded 53091 existing records from primary storage. [2025-09-26T22:23:50.595907] [INFO ] [MAIN ] LAC: Loaded 53091 primary data records. [2025-09-26T22:23:51.227494] [DEBUG] [MAIN ] L: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:51.229014] [INFO ] [MAIN ] L: Generated 1820 derivative records from 41562 primary records. [2025-09-26T22:23:51.229682] [DEBUG] [LOCAL ] L: Saving derivative data. [2025-09-26T22:23:51.252759] [DEBUG] [LOCAL ] L: Derivative data saved (1820 records). [2025-09-26T22:23:51.253109] [INFO ] [MAIN ] L: Successfully saved derivative data. [2025-09-26T22:23:51.255698] [INFO ] [MAIN ] Derivative Progress: 1060/2074 symbols completed. L took 1.2s. Estimated remaining: 7m 4s. Rate: 143.5 symbols/min [2025-09-26T22:23:51.270202] [DEBUG] [MAIN ] LAD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:51.271165] [INFO ] [MAIN ] LAD: Generated 1820 derivative records from 24089 primary records. [2025-09-26T22:23:51.270337] [INFO ] [MAIN ] LADR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:51.271658] [DEBUG] [LOCAL ] LAD: Saving derivative data. [2025-09-26T22:23:51.296421] [DEBUG] [LOCAL ] LAD: Derivative data saved (1820 records). [2025-09-26T22:23:51.296682] [INFO ] [MAIN ] LAD: Successfully saved derivative data. [2025-09-26T22:23:51.299367] [INFO ] [MAIN ] Derivative Progress: 1061/2074 symbols completed. LAD took 1.2s. Estimated remaining: 7m 3s. Rate: 143.6 symbols/min [2025-09-26T22:23:51.300024] [INFO ] [MAIN ] LANV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:51.314223] [DEBUG] [MAIN ] LAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:51.315678] [INFO ] [MAIN ] LAC: Generated 1820 derivative records from 53091 primary records. [2025-09-26T22:23:51.315860] [DEBUG] [LOCAL ] LAC: Saving derivative data. [2025-09-26T22:23:51.344789] [DEBUG] [LOCAL ] LANV: Loaded 2851 existing records from primary storage. [2025-09-26T22:23:51.347535] [INFO ] [MAIN ] LANV: Loaded 2851 primary data records. [2025-09-26T22:23:51.347427] [DEBUG] [LOCAL ] LAC: Derivative data saved (1820 records). [2025-09-26T22:23:51.373978] [INFO ] [MAIN ] LAC: Successfully saved derivative data. [2025-09-26T22:23:51.396405] [INFO ] [MAIN ] Derivative Progress: 1062/2074 symbols completed. LAC took 1.3s. Estimated remaining: 7m 2s. Rate: 143.7 symbols/min [2025-09-26T22:23:51.411489] [INFO ] [MAIN ] LAW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:51.477867] [DEBUG] [LOCAL ] LADR: Loaded 39204 existing records from primary storage. [2025-09-26T22:23:51.498023] [INFO ] [MAIN ] LADR: Loaded 39204 primary data records. [2025-09-26T22:23:51.649526] [DEBUG] [LOCAL ] LAW: Loaded 14171 existing records from primary storage. [2025-09-26T22:23:51.841446] [INFO ] [MAIN ] LAW: Loaded 14171 primary data records. [2025-09-26T22:23:52.506340] [DEBUG] [MAIN ] LANV: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-09-26T22:23:52.508894] [INFO ] [MAIN ] LANV: Generated 1818 derivative records from 2851 primary records. [2025-09-26T22:23:52.509280] [DEBUG] [LOCAL ] LANV: Saving derivative data. [2025-09-26T22:23:52.525509] [DEBUG] [LOCAL ] LANV: Derivative data saved (1818 records). [2025-09-26T22:23:52.526154] [INFO ] [MAIN ] LANV: Successfully saved derivative data. [2025-09-26T22:23:52.529957] [INFO ] [MAIN ] Derivative Progress: 1063/2074 symbols completed. LANV took 1.2s. Estimated remaining: 7m 3s. Rate: 143.5 symbols/min [2025-09-26T22:23:52.549418] [DEBUG] [MAIN ] LADR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:52.553283] [INFO ] [MAIN ] LADR: Generated 1820 derivative records from 39204 primary records. [2025-09-26T22:23:52.553597] [DEBUG] [LOCAL ] LADR: Saving derivative data. [2025-09-26T22:23:52.578767] [DEBUG] [MAIN ] LAW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:52.584175] [INFO ] [MAIN ] LAW: Generated 1820 derivative records from 14171 primary records. [2025-09-26T22:23:52.584941] [DEBUG] [LOCAL ] LAW: Saving derivative data. [2025-09-26T22:23:52.590809] [DEBUG] [LOCAL ] LADR: Derivative data saved (1820 records). [2025-09-26T22:23:52.598918] [INFO ] [MAIN ] LADR: Successfully saved derivative data. [2025-09-26T22:23:52.604525] [INFO ] [MAIN ] Derivative Progress: 1064/2074 symbols completed. LADR took 1.3s. Estimated remaining: 7m 2s. Rate: 143.6 symbols/min [2025-09-26T22:23:52.609273] [DEBUG] [LOCAL ] LAW: Derivative data saved (1820 records). [2025-09-26T22:23:52.609347] [INFO ] [MAIN ] LAW: Successfully saved derivative data. [2025-09-26T22:23:52.611950] [INFO ] [MAIN ] Derivative Progress: 1065/2074 symbols completed. LAW took 1.2s. Estimated remaining: 7m 1s. Rate: 143.7 symbols/min [2025-09-26T22:23:52.612737] [INFO ] [MAIN ] LB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:52.612860] [INFO ] [MAIN ] LAZ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:52.613445] [INFO ] [MAIN ] LBRT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:52.680692] [DEBUG] [LOCAL ] LB: Loaded 38116 existing records from primary storage. [2025-09-26T22:23:52.680969] [INFO ] [MAIN ] LB: Loaded 38116 primary data records. [2025-09-26T22:23:52.772841] [DEBUG] [LOCAL ] LAZ: Loaded 45784 existing records from primary storage. [2025-09-26T22:23:52.808066] [INFO ] [MAIN ] LAZ: Loaded 45784 primary data records. [2025-09-26T22:23:52.850844] [DEBUG] [LOCAL ] LBRT: Loaded 53695 existing records from primary storage. [2025-09-26T22:23:52.868477] [INFO ] [MAIN ] LBRT: Loaded 53695 primary data records. [2025-09-26T22:23:53.748849] [DEBUG] [MAIN ] LB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:53.749791] [INFO ] [MAIN ] LB: Generated 1820 derivative records from 38116 primary records. [2025-09-26T22:23:53.750007] [DEBUG] [LOCAL ] LB: Saving derivative data. [2025-09-26T22:23:53.772225] [DEBUG] [LOCAL ] LB: Derivative data saved (1820 records). [2025-09-26T22:23:53.787063] [INFO ] [MAIN ] LB: Successfully saved derivative data. [2025-09-26T22:23:53.790122] [INFO ] [MAIN ] Derivative Progress: 1066/2074 symbols completed. LB took 1.2s. Estimated remaining: 7m 2s. Rate: 143.5 symbols/min [2025-09-26T22:23:53.791066] [DEBUG] [MAIN ] LAZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:53.791394] [INFO ] [MAIN ] LC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:53.800145] [INFO ] [MAIN ] LAZ: Generated 1820 derivative records from 45784 primary records. [2025-09-26T22:23:53.805410] [DEBUG] [LOCAL ] LAZ: Saving derivative data. [2025-09-26T22:23:53.806730] [DEBUG] [MAIN ] LBRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:53.820804] [INFO ] [MAIN ] LBRT: Generated 1820 derivative records from 53695 primary records. [2025-09-26T22:23:53.821484] [DEBUG] [LOCAL ] LBRT: Saving derivative data. [2025-09-26T22:23:53.826196] [DEBUG] [LOCAL ] LAZ: Derivative data saved (1820 records). [2025-09-26T22:23:53.826423] [INFO ] [MAIN ] LAZ: Successfully saved derivative data. [2025-09-26T22:23:53.829463] [INFO ] [MAIN ] Derivative Progress: 1067/2074 symbols completed. LAZ took 1.2s. Estimated remaining: 7m 1s. Rate: 143.6 symbols/min [2025-09-26T22:23:53.838138] [INFO ] [MAIN ] LCII: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:53.850595] [DEBUG] [LOCAL ] LBRT: Derivative data saved (1820 records). [2025-09-26T22:23:53.850932] [INFO ] [MAIN ] LBRT: Successfully saved derivative data. [2025-09-26T22:23:53.853815] [INFO ] [MAIN ] Derivative Progress: 1068/2074 symbols completed. LBRT took 1.2s. Estimated remaining: 6m 60s. Rate: 143.7 symbols/min [2025-09-26T22:23:53.854320] [INFO ] [MAIN ] LDI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:53.897449] [DEBUG] [LOCAL ] LC: Loaded 48605 existing records from primary storage. [2025-09-26T22:23:53.897739] [INFO ] [MAIN ] LC: Loaded 48605 primary data records. [2025-09-26T22:23:54.043496] [DEBUG] [LOCAL ] LCII: Loaded 28900 existing records from primary storage. [2025-09-26T22:23:54.072616] [INFO ] [MAIN ] LCII: Loaded 28900 primary data records. [2025-09-26T22:23:54.288087] [DEBUG] [LOCAL ] LDI: Loaded 44776 existing records from primary storage. [2025-09-26T22:23:54.345751] [INFO ] [MAIN ] LDI: Loaded 44776 primary data records. [2025-09-26T22:23:54.981764] [DEBUG] [MAIN ] LC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:54.983272] [INFO ] [MAIN ] LC: Generated 1820 derivative records from 48605 primary records. [2025-09-26T22:23:54.984049] [DEBUG] [LOCAL ] LC: Saving derivative data. [2025-09-26T22:23:55.008482] [DEBUG] [LOCAL ] LC: Derivative data saved (1820 records). [2025-09-26T22:23:55.009943] [INFO ] [MAIN ] LC: Successfully saved derivative data. [2025-09-26T22:23:55.012032] [INFO ] [MAIN ] Derivative Progress: 1069/2074 symbols completed. LC took 1.2s. Estimated remaining: 7m 0s. Rate: 143.5 symbols/min [2025-09-26T22:23:55.020619] [INFO ] [MAIN ] LDOS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:55.029351] [DEBUG] [MAIN ] LCII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:55.030711] [INFO ] [MAIN ] LCII: Generated 1820 derivative records from 28900 primary records. [2025-09-26T22:23:55.031003] [DEBUG] [LOCAL ] LCII: Saving derivative data. [2025-09-26T22:23:55.045898] [DEBUG] [MAIN ] LDI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:55.054750] [INFO ] [MAIN ] LDI: Generated 1820 derivative records from 44776 primary records. [2025-09-26T22:23:55.059114] [DEBUG] [LOCAL ] LDI: Saving derivative data. [2025-09-26T22:23:55.078870] [DEBUG] [LOCAL ] LCII: Derivative data saved (1820 records). [2025-09-26T22:23:55.081692] [INFO ] [MAIN ] LCII: Successfully saved derivative data. [2025-09-26T22:23:55.085252] [INFO ] [MAIN ] Derivative Progress: 1070/2074 symbols completed. LCII took 1.2s. Estimated remaining: 6m 59s. Rate: 143.6 symbols/min [2025-09-26T22:23:55.088317] [INFO ] [MAIN ] LDP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:55.087960] [DEBUG] [LOCAL ] LDI: Derivative data saved (1820 records). [2025-09-26T22:23:55.088594] [INFO ] [MAIN ] LDI: Successfully saved derivative data. [2025-09-26T22:23:55.091851] [INFO ] [MAIN ] Derivative Progress: 1071/2074 symbols completed. LDI took 1.2s. Estimated remaining: 6m 59s. Rate: 143.7 symbols/min [2025-09-26T22:23:55.092455] [INFO ] [MAIN ] LEA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:55.122823] [DEBUG] [LOCAL ] LDP: Loaded 13128 existing records from primary storage. [2025-09-26T22:23:55.137488] [INFO ] [MAIN ] LDP: Loaded 13128 primary data records. [2025-09-26T22:23:55.155831] [DEBUG] [LOCAL ] LDOS: Loaded 46407 existing records from primary storage. [2025-09-26T22:23:55.193714] [INFO ] [MAIN ] LDOS: Loaded 46407 primary data records. [2025-09-26T22:23:55.482172] [DEBUG] [LOCAL ] LEA: Loaded 42464 existing records from primary storage. [2025-09-26T22:23:55.600766] [INFO ] [MAIN ] LEA: Loaded 42464 primary data records. [2025-09-26T22:23:56.172976] [DEBUG] [MAIN ] LDP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:56.174294] [INFO ] [MAIN ] LDP: Generated 1820 derivative records from 13128 primary records. [2025-09-26T22:23:56.174741] [DEBUG] [LOCAL ] LDP: Saving derivative data. [2025-09-26T22:23:56.198666] [DEBUG] [LOCAL ] LDP: Derivative data saved (1820 records). [2025-09-26T22:23:56.210180] [INFO ] [MAIN ] LDP: Successfully saved derivative data. [2025-09-26T22:23:56.217929] [INFO ] [MAIN ] Derivative Progress: 1072/2074 symbols completed. LDP took 1.1s. Estimated remaining: 6m 59s. Rate: 143.5 symbols/min [2025-09-26T22:23:56.219184] [INFO ] [MAIN ] LEG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:56.218602] [DEBUG] [MAIN ] LDOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:56.220541] [INFO ] [MAIN ] LDOS: Generated 1820 derivative records from 46407 primary records. [2025-09-26T22:23:56.221046] [DEBUG] [LOCAL ] LDOS: Saving derivative data. [2025-09-26T22:23:56.252327] [DEBUG] [MAIN ] LEA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:56.253784] [INFO ] [MAIN ] LEA: Generated 1820 derivative records from 42464 primary records. [2025-09-26T22:23:56.255017] [DEBUG] [LOCAL ] LEA: Saving derivative data. [2025-09-26T22:23:56.272115] [DEBUG] [LOCAL ] LDOS: Derivative data saved (1820 records). [2025-09-26T22:23:56.272903] [INFO ] [MAIN ] LDOS: Successfully saved derivative data. [2025-09-26T22:23:56.275439] [INFO ] [MAIN ] Derivative Progress: 1073/2074 symbols completed. LDOS took 1.3s. Estimated remaining: 6m 58s. Rate: 143.6 symbols/min [2025-09-26T22:23:56.278942] [DEBUG] [LOCAL ] LEA: Derivative data saved (1820 records). [2025-09-26T22:23:56.279297] [INFO ] [MAIN ] LEA: Successfully saved derivative data. [2025-09-26T22:23:56.279371] [INFO ] [MAIN ] LEN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:56.282232] [INFO ] [MAIN ] Derivative Progress: 1074/2074 symbols completed. LEA took 1.2s. Estimated remaining: 6m 57s. Rate: 143.8 symbols/min [2025-09-26T22:23:56.282807] [INFO ] [MAIN ] LEO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:56.332939] [DEBUG] [LOCAL ] LEO: Loaded 17785 existing records from primary storage. [2025-09-26T22:23:56.333263] [INFO ] [MAIN ] LEO: Loaded 17785 primary data records. [2025-09-26T22:23:56.339772] [DEBUG] [LOCAL ] LEG: Loaded 51130 existing records from primary storage. [2025-09-26T22:23:56.357383] [INFO ] [MAIN ] LEG: Loaded 51130 primary data records. [2025-09-26T22:23:56.657518] [DEBUG] [LOCAL ] LEN: Loaded 53967 existing records from primary storage. [2025-09-26T22:23:56.676538] [INFO ] [MAIN ] LEN: Loaded 53967 primary data records. [2025-09-26T22:23:57.441115] [DEBUG] [MAIN ] LEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:57.442176] [INFO ] [MAIN ] LEO: Generated 1820 derivative records from 17785 primary records. [2025-09-26T22:23:57.442300] [DEBUG] [LOCAL ] LEO: Saving derivative data. [2025-09-26T22:23:57.480373] [DEBUG] [LOCAL ] LEO: Derivative data saved (1820 records). [2025-09-26T22:23:57.480832] [INFO ] [MAIN ] LEO: Successfully saved derivative data. [2025-09-26T22:23:57.483026] [INFO ] [MAIN ] Derivative Progress: 1075/2074 symbols completed. LEO took 1.2s. Estimated remaining: 6m 58s. Rate: 143.5 symbols/min [2025-09-26T22:23:57.483766] [DEBUG] [MAIN ] LEG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:57.485032] [INFO ] [MAIN ] LEG: Generated 1820 derivative records from 51130 primary records. [2025-09-26T22:23:57.485551] [DEBUG] [LOCAL ] LEG: Saving derivative data. [2025-09-26T22:23:57.486337] [INFO ] [MAIN ] LEVI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:57.515865] [DEBUG] [LOCAL ] LEG: Derivative data saved (1820 records). [2025-09-26T22:23:57.530719] [INFO ] [MAIN ] LEG: Successfully saved derivative data. [2025-09-26T22:23:57.533972] [INFO ] [MAIN ] Derivative Progress: 1076/2074 symbols completed. LEG took 1.3s. Estimated remaining: 6m 57s. Rate: 143.6 symbols/min [2025-09-26T22:23:57.530582] [DEBUG] [MAIN ] LEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:57.534565] [INFO ] [MAIN ] LFT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:57.535726] [INFO ] [MAIN ] LEN: Generated 1820 derivative records from 53967 primary records. [2025-09-26T22:23:57.536155] [DEBUG] [LOCAL ] LEN: Saving derivative data. [2025-09-26T22:23:57.556875] [DEBUG] [LOCAL ] LEN: Derivative data saved (1820 records). [2025-09-26T22:23:57.557205] [INFO ] [MAIN ] LEN: Successfully saved derivative data. [2025-09-26T22:23:57.560031] [INFO ] [MAIN ] Derivative Progress: 1077/2074 symbols completed. LEN took 1.3s. Estimated remaining: 6m 56s. Rate: 143.7 symbols/min [2025-09-26T22:23:57.560437] [INFO ] [MAIN ] LGI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:57.593010] [DEBUG] [LOCAL ] LFT: Loaded 18286 existing records from primary storage. [2025-09-26T22:23:57.593254] [INFO ] [MAIN ] LFT: Loaded 18286 primary data records. [2025-09-26T22:23:57.636711] [DEBUG] [LOCAL ] LGI: Loaded 10137 existing records from primary storage. [2025-09-26T22:23:57.679966] [INFO ] [MAIN ] LGI: Loaded 10137 primary data records. [2025-09-26T22:23:57.876074] [DEBUG] [LOCAL ] LEVI: Loaded 52306 existing records from primary storage. [2025-09-26T22:23:57.918402] [INFO ] [MAIN ] LEVI: Loaded 52306 primary data records. [2025-09-26T22:23:58.740807] [DEBUG] [MAIN ] LFT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:58.742545] [INFO ] [MAIN ] LFT: Generated 1820 derivative records from 18286 primary records. [2025-09-26T22:23:58.742713] [DEBUG] [LOCAL ] LFT: Saving derivative data. [2025-09-26T22:23:58.775919] [DEBUG] [MAIN ] LGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:58.778257] [INFO ] [MAIN ] LGI: Generated 1820 derivative records from 10137 primary records. [2025-09-26T22:23:58.778612] [DEBUG] [LOCAL ] LGI: Saving derivative data. [2025-09-26T22:23:58.783526] [DEBUG] [LOCAL ] LFT: Derivative data saved (1820 records). [2025-09-26T22:23:58.792547] [INFO ] [MAIN ] LFT: Successfully saved derivative data. [2025-09-26T22:23:58.795259] [INFO ] [MAIN ] Derivative Progress: 1078/2074 symbols completed. LFT took 1.3s. Estimated remaining: 6m 56s. Rate: 143.5 symbols/min [2025-09-26T22:23:58.811800] [DEBUG] [MAIN ] LEVI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:58.814299] [INFO ] [MAIN ] LEVI: Generated 1820 derivative records from 52306 primary records. [2025-09-26T22:23:58.816679] [DEBUG] [LOCAL ] LEVI: Saving derivative data. [2025-09-26T22:23:58.817321] [DEBUG] [LOCAL ] LGI: Derivative data saved (1820 records). [2025-09-26T22:23:58.818381] [INFO ] [MAIN ] LGI: Successfully saved derivative data. [2025-09-26T22:23:58.821929] [INFO ] [MAIN ] Derivative Progress: 1079/2074 symbols completed. LGI took 1.3s. Estimated remaining: 6m 56s. Rate: 143.6 symbols/min [2025-09-26T22:23:58.838791] [DEBUG] [LOCAL ] LEVI: Derivative data saved (1820 records). [2025-09-26T22:23:58.838894] [INFO ] [MAIN ] LEVI: Successfully saved derivative data. [2025-09-26T22:23:58.841955] [INFO ] [MAIN ] Derivative Progress: 1080/2074 symbols completed. LEVI took 1.4s. Estimated remaining: 6m 55s. Rate: 143.7 symbols/min [2025-09-26T22:23:58.843074] [INFO ] [MAIN ] LHX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:58.842732] [INFO ] [MAIN ] LH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:58.842856] [INFO ] [MAIN ] LII: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:58.883983] [DEBUG] [LOCAL ] LII: Loaded 28648 existing records from primary storage. [2025-09-26T22:23:58.884222] [INFO ] [MAIN ] LII: Loaded 28648 primary data records. [2025-09-26T22:23:59.026010] [DEBUG] [LOCAL ] LH: Loaded 38660 existing records from primary storage. [2025-09-26T22:23:59.040932] [INFO ] [MAIN ] LH: Loaded 38660 primary data records. [2025-09-26T22:23:59.095940] [DEBUG] [LOCAL ] LHX: Loaded 49413 existing records from primary storage. [2025-09-26T22:23:59.166987] [INFO ] [MAIN ] LHX: Loaded 49413 primary data records. [2025-09-26T22:23:59.933672] [DEBUG] [MAIN ] LII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:59.935057] [INFO ] [MAIN ] LII: Generated 1820 derivative records from 28648 primary records. [2025-09-26T22:23:59.935318] [DEBUG] [LOCAL ] LII: Saving derivative data. [2025-09-26T22:23:59.957705] [DEBUG] [LOCAL ] LII: Derivative data saved (1820 records). [2025-09-26T22:23:59.958246] [INFO ] [MAIN ] LII: Successfully saved derivative data. [2025-09-26T22:23:59.968468] [INFO ] [MAIN ] Derivative Progress: 1081/2074 symbols completed. LII took 1.1s. Estimated remaining: 6m 55s. Rate: 143.5 symbols/min [2025-09-26T22:23:59.973576] [INFO ] [MAIN ] LION: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:23:59.974740] [DEBUG] [MAIN ] LH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:23:59.976386] [INFO ] [MAIN ] LH: Generated 1820 derivative records from 38660 primary records. [2025-09-26T22:23:59.977591] [DEBUG] [LOCAL ] LH: Saving derivative data. [2025-09-26T22:24:00.010758] [DEBUG] [MAIN ] LHX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:00.014882] [INFO ] [MAIN ] LHX: Generated 1820 derivative records from 49413 primary records. [2025-09-26T22:24:00.016918] [DEBUG] [LOCAL ] LHX: Saving derivative data. [2025-09-26T22:24:00.019163] [DEBUG] [LOCAL ] LH: Derivative data saved (1820 records). [2025-09-26T22:24:00.020131] [INFO ] [MAIN ] LH: Successfully saved derivative data. [2025-09-26T22:24:00.034103] [INFO ] [MAIN ] Derivative Progress: 1082/2074 symbols completed. LH took 1.2s. Estimated remaining: 6m 54s. Rate: 143.6 symbols/min [2025-09-26T22:24:00.035279] [INFO ] [MAIN ] LITB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:00.041856] [DEBUG] [LOCAL ] LHX: Derivative data saved (1820 records). [2025-09-26T22:24:00.054130] [INFO ] [MAIN ] LHX: Successfully saved derivative data. [2025-09-26T22:24:00.058159] [INFO ] [MAIN ] Derivative Progress: 1083/2074 symbols completed. LHX took 1.2s. Estimated remaining: 6m 54s. Rate: 143.8 symbols/min [2025-09-26T22:24:00.058751] [INFO ] [MAIN ] LLY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:00.062915] [DEBUG] [LOCAL ] LITB: Loaded 4436 existing records from primary storage. [2025-09-26T22:24:00.063229] [INFO ] [MAIN ] LITB: Loaded 4436 primary data records. [2025-09-26T22:24:00.170788] [DEBUG] [LOCAL ] LION: Loaded 43950 existing records from primary storage. [2025-09-26T22:24:00.192567] [INFO ] [MAIN ] LION: Loaded 43950 primary data records. [2025-09-26T22:24:00.804751] [DEBUG] [LOCAL ] LLY: Loaded 54064 existing records from primary storage. [2025-09-26T22:24:00.805223] [INFO ] [MAIN ] LLY: Loaded 54064 primary data records. [2025-09-26T22:24:01.155400] [DEBUG] [MAIN ] LITB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:01.169191] [DEBUG] [MAIN ] LION: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:01.168666] [INFO ] [MAIN ] LITB: Generated 1820 derivative records from 4436 primary records. [2025-09-26T22:24:01.169402] [DEBUG] [LOCAL ] LITB: Saving derivative data. [2025-09-26T22:24:01.170360] [INFO ] [MAIN ] LION: Generated 1820 derivative records from 43950 primary records. [2025-09-26T22:24:01.171574] [DEBUG] [LOCAL ] LION: Saving derivative data. [2025-09-26T22:24:01.202530] [DEBUG] [LOCAL ] LITB: Derivative data saved (1820 records). [2025-09-26T22:24:01.205632] [DEBUG] [LOCAL ] LION: Derivative data saved (1820 records). [2025-09-26T22:24:01.204595] [INFO ] [MAIN ] LITB: Successfully saved derivative data. [2025-09-26T22:24:01.205776] [INFO ] [MAIN ] LION: Successfully saved derivative data. [2025-09-26T22:24:01.207987] [INFO ] [MAIN ] Derivative Progress: 1084/2074 symbols completed. LITB took 1.2s. Estimated remaining: 6m 54s. Rate: 143.5 symbols/min [2025-09-26T22:24:01.211324] [INFO ] [MAIN ] Derivative Progress: 1085/2074 symbols completed. LION took 1.2s. Estimated remaining: 6m 53s. Rate: 143.7 symbols/min [2025-09-26T22:24:01.211465] [INFO ] [MAIN ] LMND: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:01.212590] [INFO ] [MAIN ] LNC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:01.230199] [DEBUG] [MAIN ] LLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:01.231062] [INFO ] [MAIN ] LLY: Generated 1820 derivative records from 54064 primary records. [2025-09-26T22:24:01.231245] [DEBUG] [LOCAL ] LLY: Saving derivative data. [2025-09-26T22:24:01.263887] [DEBUG] [LOCAL ] LLY: Derivative data saved (1820 records). [2025-09-26T22:24:01.264123] [INFO ] [MAIN ] LLY: Successfully saved derivative data. [2025-09-26T22:24:01.266616] [INFO ] [MAIN ] Derivative Progress: 1086/2074 symbols completed. LLY took 1.2s. Estimated remaining: 6m 52s. Rate: 143.8 symbols/min [2025-09-26T22:24:01.267069] [INFO ] [MAIN ] LND: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:01.274210] [DEBUG] [LOCAL ] LND: Loaded 5013 existing records from primary storage. [2025-09-26T22:24:01.274381] [INFO ] [MAIN ] LND: Loaded 5013 primary data records. [2025-09-26T22:24:01.481185] [DEBUG] [LOCAL ] LMND: Loaded 52647 existing records from primary storage. [2025-09-26T22:24:01.544891] [DEBUG] [LOCAL ] LNC: Loaded 52369 existing records from primary storage. [2025-09-26T22:24:01.540165] [INFO ] [MAIN ] LMND: Loaded 52647 primary data records. [2025-09-26T22:24:01.666391] [INFO ] [MAIN ] LNC: Loaded 52369 primary data records. [2025-09-26T22:24:02.351475] [DEBUG] [MAIN ] LND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:02.352951] [INFO ] [MAIN ] LND: Generated 1820 derivative records from 5013 primary records. [2025-09-26T22:24:02.353247] [DEBUG] [LOCAL ] LND: Saving derivative data. [2025-09-26T22:24:02.371910] [DEBUG] [LOCAL ] LND: Derivative data saved (1820 records). [2025-09-26T22:24:02.372371] [INFO ] [MAIN ] LND: Successfully saved derivative data. [2025-09-26T22:24:02.374496] [INFO ] [MAIN ] Derivative Progress: 1087/2074 symbols completed. LND took 1.1s. Estimated remaining: 6m 53s. Rate: 143.5 symbols/min [2025-09-26T22:24:02.374806] [INFO ] [MAIN ] LNG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:02.395627] [DEBUG] [MAIN ] LNC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:02.408569] [INFO ] [MAIN ] LNC: Generated 1820 derivative records from 52369 primary records. [2025-09-26T22:24:02.408883] [DEBUG] [LOCAL ] LNC: Saving derivative data. [2025-09-26T22:24:02.409136] [DEBUG] [MAIN ] LMND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:02.410565] [INFO ] [MAIN ] LMND: Generated 1820 derivative records from 52647 primary records. [2025-09-26T22:24:02.410957] [DEBUG] [LOCAL ] LMND: Saving derivative data. [2025-09-26T22:24:02.438294] [DEBUG] [LOCAL ] LNC: Derivative data saved (1820 records). [2025-09-26T22:24:02.438846] [INFO ] [MAIN ] LNC: Successfully saved derivative data. [2025-09-26T22:24:02.441687] [INFO ] [MAIN ] Derivative Progress: 1088/2074 symbols completed. LNC took 1.2s. Estimated remaining: 6m 52s. Rate: 143.7 symbols/min [2025-09-26T22:24:02.444229] [INFO ] [MAIN ] LNN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:02.445887] [DEBUG] [LOCAL ] LMND: Derivative data saved (1820 records). [2025-09-26T22:24:02.446091] [INFO ] [MAIN ] LMND: Successfully saved derivative data. [2025-09-26T22:24:02.449267] [INFO ] [MAIN ] Derivative Progress: 1089/2074 symbols completed. LMND took 1.2s. Estimated remaining: 6m 51s. Rate: 143.8 symbols/min [2025-09-26T22:24:02.449724] [INFO ] [MAIN ] LOAR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:02.474322] [DEBUG] [LOCAL ] LNN: Loaded 11404 existing records from primary storage. [2025-09-26T22:24:02.474455] [INFO ] [MAIN ] LNN: Loaded 11404 primary data records. [2025-09-26T22:24:02.598351] [DEBUG] [LOCAL ] LNG: Loaded 52224 existing records from primary storage. [2025-09-26T22:24:02.613237] [INFO ] [MAIN ] LNG: Loaded 52224 primary data records. [2025-09-26T22:24:02.925971] [DEBUG] [LOCAL ] LOAR: Loaded 42150 existing records from primary storage. [2025-09-26T22:24:02.946169] [INFO ] [MAIN ] LOAR: Loaded 42150 primary data records. [2025-09-26T22:24:03.535921] [DEBUG] [MAIN ] LNN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:03.537874] [INFO ] [MAIN ] LNN: Generated 1820 derivative records from 11404 primary records. [2025-09-26T22:24:03.538129] [DEBUG] [LOCAL ] LNN: Saving derivative data. [2025-09-26T22:24:03.556520] [DEBUG] [LOCAL ] LNN: Derivative data saved (1820 records). [2025-09-26T22:24:03.556940] [INFO ] [MAIN ] LNN: Successfully saved derivative data. [2025-09-26T22:24:03.559259] [INFO ] [MAIN ] Derivative Progress: 1090/2074 symbols completed. LNN took 1.1s. Estimated remaining: 6m 51s. Rate: 143.6 symbols/min [2025-09-26T22:24:03.559513] [INFO ] [MAIN ] LOB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:03.578814] [DEBUG] [MAIN ] LNG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:03.579629] [INFO ] [MAIN ] LNG: Generated 1820 derivative records from 52224 primary records. [2025-09-26T22:24:03.579878] [DEBUG] [LOCAL ] LNG: Saving derivative data. [2025-09-26T22:24:03.599511] [DEBUG] [LOCAL ] LNG: Derivative data saved (1820 records). [2025-09-26T22:24:03.599786] [INFO ] [MAIN ] LNG: Successfully saved derivative data. [2025-09-26T22:24:03.602679] [INFO ] [MAIN ] Derivative Progress: 1091/2074 symbols completed. LNG took 1.2s. Estimated remaining: 6m 50s. Rate: 143.7 symbols/min [2025-09-26T22:24:03.603226] [INFO ] [MAIN ] LOCL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:03.625133] [DEBUG] [MAIN ] LOAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:03.627054] [INFO ] [MAIN ] LOAR: Generated 1820 derivative records from 42150 primary records. [2025-09-26T22:24:03.627256] [DEBUG] [LOCAL ] LOAR: Saving derivative data. [2025-09-26T22:24:03.631079] [DEBUG] [LOCAL ] LOCL: Loaded 3644 existing records from primary storage. [2025-09-26T22:24:03.652515] [INFO ] [MAIN ] LOCL: Loaded 3644 primary data records. [2025-09-26T22:24:03.656028] [DEBUG] [LOCAL ] LOAR: Derivative data saved (1820 records). [2025-09-26T22:24:03.656236] [INFO ] [MAIN ] LOAR: Successfully saved derivative data. [2025-09-26T22:24:03.655590] [DEBUG] [LOCAL ] LOB: Loaded 27886 existing records from primary storage. [2025-09-26T22:24:03.656407] [INFO ] [MAIN ] LOB: Loaded 27886 primary data records. [2025-09-26T22:24:03.664336] [INFO ] [MAIN ] Derivative Progress: 1092/2074 symbols completed. LOAR took 1.2s. Estimated remaining: 6m 50s. Rate: 143.8 symbols/min [2025-09-26T22:24:03.676060] [INFO ] [MAIN ] LOMA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:04.331570] [DEBUG] [LOCAL ] LOMA: Loaded 32576 existing records from primary storage. [2025-09-26T22:24:04.332100] [INFO ] [MAIN ] LOMA: Loaded 32576 primary data records. [2025-09-26T22:24:04.679305] [DEBUG] [MAIN ] LOB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:04.692873] [INFO ] [MAIN ] LOB: Generated 1820 derivative records from 27886 primary records. [2025-09-26T22:24:04.694494] [DEBUG] [MAIN ] LOCL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:04.695634] [INFO ] [MAIN ] LOCL: Generated 1820 derivative records from 3644 primary records. [2025-09-26T22:24:04.695722] [DEBUG] [LOCAL ] LOB: Saving derivative data. [2025-09-26T22:24:04.695848] [DEBUG] [LOCAL ] LOCL: Saving derivative data. [2025-09-26T22:24:04.720502] [DEBUG] [LOCAL ] LOB: Derivative data saved (1820 records). [2025-09-26T22:24:04.726822] [INFO ] [MAIN ] LOB: Successfully saved derivative data. [2025-09-26T22:24:04.726969] [DEBUG] [LOCAL ] LOCL: Derivative data saved (1820 records). [2025-09-26T22:24:04.729296] [INFO ] [MAIN ] Derivative Progress: 1093/2074 symbols completed. LOB took 1.2s. Estimated remaining: 6m 50s. Rate: 143.6 symbols/min [2025-09-26T22:24:04.729491] [INFO ] [MAIN ] LOCL: Successfully saved derivative data. [2025-09-26T22:24:04.732731] [INFO ] [MAIN ] Derivative Progress: 1094/2074 symbols completed. LOCL took 1.1s. Estimated remaining: 6m 49s. Rate: 143.7 symbols/min [2025-09-26T22:24:04.753553] [DEBUG] [MAIN ] LOMA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:04.754550] [INFO ] [MAIN ] LOMA: Generated 1820 derivative records from 32576 primary records. [2025-09-26T22:24:04.754631] [DEBUG] [LOCAL ] LOMA: Saving derivative data. [2025-09-26T22:24:04.776708] [DEBUG] [LOCAL ] LOMA: Derivative data saved (1820 records). [2025-09-26T22:24:04.776858] [INFO ] [MAIN ] LOMA: Successfully saved derivative data. [2025-09-26T22:24:04.780233] [INFO ] [MAIN ] Derivative Progress: 1095/2074 symbols completed. LOMA took 1.1s. Estimated remaining: 6m 48s. Rate: 143.8 symbols/min [2025-09-26T22:24:04.780797] [INFO ] [MAIN ] LOW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:04.781143] [INFO ] [MAIN ] LPL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:04.781048] [INFO ] [MAIN ] LPG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:04.824352] [DEBUG] [LOCAL ] LPL: Loaded 26305 existing records from primary storage. [2025-09-26T22:24:04.824542] [INFO ] [MAIN ] LPL: Loaded 26305 primary data records. [2025-09-26T22:24:04.967066] [DEBUG] [LOCAL ] LPG: Loaded 40536 existing records from primary storage. [2025-09-26T22:24:04.986508] [INFO ] [MAIN ] LPG: Loaded 40536 primary data records. [2025-09-26T22:24:05.085213] [DEBUG] [LOCAL ] LOW: Loaded 53721 existing records from primary storage. [2025-09-26T22:24:05.124160] [INFO ] [MAIN ] LOW: Loaded 53721 primary data records. [2025-09-26T22:24:05.900197] [DEBUG] [MAIN ] LPL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:05.901524] [INFO ] [MAIN ] LPL: Generated 1820 derivative records from 26305 primary records. [2025-09-26T22:24:05.902021] [DEBUG] [LOCAL ] LPL: Saving derivative data. [2025-09-26T22:24:05.921857] [DEBUG] [LOCAL ] LPL: Derivative data saved (1820 records). [2025-09-26T22:24:05.922036] [INFO ] [MAIN ] LPL: Successfully saved derivative data. [2025-09-26T22:24:05.924665] [INFO ] [MAIN ] Derivative Progress: 1096/2074 symbols completed. LPL took 1.1s. Estimated remaining: 6m 49s. Rate: 143.6 symbols/min [2025-09-26T22:24:05.926586] [INFO ] [MAIN ] LPX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:05.945845] [DEBUG] [MAIN ] LPG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:05.947338] [INFO ] [MAIN ] LPG: Generated 1820 derivative records from 40536 primary records. [2025-09-26T22:24:05.947507] [DEBUG] [LOCAL ] LPG: Saving derivative data. [2025-09-26T22:24:05.975706] [DEBUG] [MAIN ] LOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:05.983005] [DEBUG] [LOCAL ] LPG: Derivative data saved (1820 records). [2025-09-26T22:24:05.984150] [INFO ] [MAIN ] LOW: Generated 1820 derivative records from 53721 primary records. [2025-09-26T22:24:05.984357] [DEBUG] [LOCAL ] LOW: Saving derivative data. [2025-09-26T22:24:05.984277] [INFO ] [MAIN ] LPG: Successfully saved derivative data. [2025-09-26T22:24:05.988237] [INFO ] [MAIN ] Derivative Progress: 1097/2074 symbols completed. LPG took 1.2s. Estimated remaining: 6m 48s. Rate: 143.7 symbols/min [2025-09-26T22:24:05.988926] [INFO ] [MAIN ] LRN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:06.017127] [DEBUG] [LOCAL ] LOW: Derivative data saved (1820 records). [2025-09-26T22:24:06.017520] [INFO ] [MAIN ] LOW: Successfully saved derivative data. [2025-09-26T22:24:06.020537] [INFO ] [MAIN ] Derivative Progress: 1098/2074 symbols completed. LOW took 1.2s. Estimated remaining: 6m 47s. Rate: 143.8 symbols/min [2025-09-26T22:24:06.021973] [INFO ] [MAIN ] LSPD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:06.037800] [DEBUG] [LOCAL ] LPX: Loaded 40311 existing records from primary storage. [2025-09-26T22:24:06.038483] [INFO ] [MAIN ] LPX: Loaded 40311 primary data records. [2025-09-26T22:24:06.212341] [DEBUG] [LOCAL ] LRN: Loaded 40503 existing records from primary storage. [2025-09-26T22:24:06.263512] [INFO ] [MAIN ] LRN: Loaded 40503 primary data records. [2025-09-26T22:24:06.442530] [DEBUG] [LOCAL ] LSPD: Loaded 43782 existing records from primary storage. [2025-09-26T22:24:06.468032] [INFO ] [MAIN ] LSPD: Loaded 43782 primary data records. [2025-09-26T22:24:07.112361] [DEBUG] [MAIN ] LPX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:07.113600] [INFO ] [MAIN ] LPX: Generated 1820 derivative records from 40311 primary records. [2025-09-26T22:24:07.113947] [DEBUG] [LOCAL ] LPX: Saving derivative data. [2025-09-26T22:24:07.134612] [DEBUG] [LOCAL ] LPX: Derivative data saved (1820 records). [2025-09-26T22:24:07.134792] [INFO ] [MAIN ] LPX: Successfully saved derivative data. [2025-09-26T22:24:07.137998] [INFO ] [MAIN ] Derivative Progress: 1099/2074 symbols completed. LPX took 1.2s. Estimated remaining: 6m 47s. Rate: 143.6 symbols/min [2025-09-26T22:24:07.139210] [INFO ] [MAIN ] LTC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:07.159002] [DEBUG] [MAIN ] LRN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:07.159931] [INFO ] [MAIN ] LRN: Generated 1820 derivative records from 40503 primary records. [2025-09-26T22:24:07.160049] [DEBUG] [LOCAL ] LRN: Saving derivative data. [2025-09-26T22:24:07.200110] [DEBUG] [MAIN ] LSPD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:07.202453] [INFO ] [MAIN ] LSPD: Generated 1820 derivative records from 43782 primary records. [2025-09-26T22:24:07.201599] [DEBUG] [LOCAL ] LRN: Derivative data saved (1820 records). [2025-09-26T22:24:07.203253] [INFO ] [MAIN ] LRN: Successfully saved derivative data. [2025-09-26T22:24:07.203161] [DEBUG] [LOCAL ] LSPD: Saving derivative data. [2025-09-26T22:24:07.206562] [INFO ] [MAIN ] Derivative Progress: 1100/2074 symbols completed. LRN took 1.2s. Estimated remaining: 6m 47s. Rate: 143.7 symbols/min [2025-09-26T22:24:07.216543] [INFO ] [MAIN ] LTH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:07.228858] [DEBUG] [LOCAL ] LTC: Loaded 30478 existing records from primary storage. [2025-09-26T22:24:07.232230] [INFO ] [MAIN ] LTC: Loaded 30478 primary data records. [2025-09-26T22:24:07.287550] [DEBUG] [LOCAL ] LSPD: Derivative data saved (1820 records). [2025-09-26T22:24:07.304888] [INFO ] [MAIN ] LSPD: Successfully saved derivative data. [2025-09-26T22:24:07.308020] [INFO ] [MAIN ] Derivative Progress: 1101/2074 symbols completed. LSPD took 1.3s. Estimated remaining: 6m 46s. Rate: 143.8 symbols/min [2025-09-26T22:24:07.326040] [INFO ] [MAIN ] LTM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:07.611745] [DEBUG] [LOCAL ] LTH: Loaded 52563 existing records from primary storage. [2025-09-26T22:24:07.613944] [INFO ] [MAIN ] LTH: Loaded 52563 primary data records. [2025-09-26T22:24:07.614581] [DEBUG] [LOCAL ] LTM: Loaded 37076 existing records from primary storage. [2025-09-26T22:24:07.620163] [INFO ] [MAIN ] LTM: Loaded 37076 primary data records. [2025-09-26T22:24:08.021577] [DEBUG] [MAIN ] LTC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:08.259529] [INFO ] [MAIN ] LTC: Generated 1820 derivative records from 30478 primary records. [2025-09-26T22:24:08.270219] [DEBUG] [LOCAL ] LTC: Saving derivative data. [2025-09-26T22:24:08.292606] [DEBUG] [LOCAL ] LTC: Derivative data saved (1820 records). [2025-09-26T22:24:08.293495] [INFO ] [MAIN ] LTC: Successfully saved derivative data. [2025-09-26T22:24:08.296840] [INFO ] [MAIN ] Derivative Progress: 1102/2074 symbols completed. LTC took 1.2s. Estimated remaining: 6m 46s. Rate: 143.7 symbols/min [2025-09-26T22:24:08.297631] [INFO ] [MAIN ] LU: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:08.325230] [DEBUG] [MAIN ] LTH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:08.326745] [INFO ] [MAIN ] LTH: Generated 1820 derivative records from 52563 primary records. [2025-09-26T22:24:08.326985] [DEBUG] [LOCAL ] LTH: Saving derivative data. [2025-09-26T22:24:08.348569] [DEBUG] [MAIN ] LTM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:08.356590] [INFO ] [MAIN ] LTM: Generated 1820 derivative records from 37076 primary records. [2025-09-26T22:24:08.357213] [DEBUG] [LOCAL ] LTM: Saving derivative data. [2025-09-26T22:24:08.358083] [DEBUG] [LOCAL ] LTH: Derivative data saved (1820 records). [2025-09-26T22:24:08.359140] [INFO ] [MAIN ] LTH: Successfully saved derivative data. [2025-09-26T22:24:08.361313] [INFO ] [MAIN ] Derivative Progress: 1103/2074 symbols completed. LTH took 1.1s. Estimated remaining: 6m 45s. Rate: 143.8 symbols/min [2025-09-26T22:24:08.381233] [INFO ] [MAIN ] LUMN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:08.389705] [DEBUG] [LOCAL ] LTM: Derivative data saved (1820 records). [2025-09-26T22:24:08.389912] [INFO ] [MAIN ] LTM: Successfully saved derivative data. [2025-09-26T22:24:08.392584] [INFO ] [MAIN ] Derivative Progress: 1104/2074 symbols completed. LTM took 1.1s. Estimated remaining: 6m 44s. Rate: 143.9 symbols/min [2025-09-26T22:24:08.393057] [INFO ] [MAIN ] LUV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:08.412290] [DEBUG] [LOCAL ] LU: Loaded 49679 existing records from primary storage. [2025-09-26T22:24:08.412561] [INFO ] [MAIN ] LU: Loaded 49679 primary data records. [2025-09-26T22:24:08.787050] [DEBUG] [LOCAL ] LUMN: Loaded 54414 existing records from primary storage. [2025-09-26T22:24:08.801528] [INFO ] [MAIN ] LUMN: Loaded 54414 primary data records. [2025-09-26T22:24:08.808282] [DEBUG] [LOCAL ] LUV: Loaded 54469 existing records from primary storage. [2025-09-26T22:24:08.825514] [INFO ] [MAIN ] LUV: Loaded 54469 primary data records. [2025-09-26T22:24:09.513056] [DEBUG] [MAIN ] LU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:09.514278] [INFO ] [MAIN ] LU: Generated 1820 derivative records from 49679 primary records. [2025-09-26T22:24:09.514402] [DEBUG] [LOCAL ] LU: Saving derivative data. [2025-09-26T22:24:09.533457] [DEBUG] [LOCAL ] LU: Derivative data saved (1820 records). [2025-09-26T22:24:09.534035] [INFO ] [MAIN ] LU: Successfully saved derivative data. [2025-09-26T22:24:09.536588] [INFO ] [MAIN ] Derivative Progress: 1105/2074 symbols completed. LU took 1.2s. Estimated remaining: 6m 45s. Rate: 143.7 symbols/min [2025-09-26T22:24:09.537231] [INFO ] [MAIN ] LVS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:09.556726] [DEBUG] [MAIN ] LUV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:09.557779] [INFO ] [MAIN ] LUV: Generated 1820 derivative records from 54469 primary records. [2025-09-26T22:24:09.560296] [DEBUG] [LOCAL ] LUV: Saving derivative data. [2025-09-26T22:24:09.592205] [DEBUG] [LOCAL ] LUV: Derivative data saved (1820 records). [2025-09-26T22:24:09.592377] [INFO ] [MAIN ] LUV: Successfully saved derivative data. [2025-09-26T22:24:09.589836] [DEBUG] [MAIN ] LUMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:09.595268] [INFO ] [MAIN ] Derivative Progress: 1106/2074 symbols completed. LUV took 1.2s. Estimated remaining: 6m 44s. Rate: 143.8 symbols/min [2025-09-26T22:24:09.596840] [INFO ] [MAIN ] LUMN: Generated 1820 derivative records from 54414 primary records. [2025-09-26T22:24:09.595811] [INFO ] [MAIN ] LVWR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:09.597157] [DEBUG] [LOCAL ] LUMN: Saving derivative data. [2025-09-26T22:24:09.614697] [DEBUG] [LOCAL ] LUMN: Derivative data saved (1820 records). [2025-09-26T22:24:09.614930] [INFO ] [MAIN ] LUMN: Successfully saved derivative data. [2025-09-26T22:24:09.617504] [INFO ] [MAIN ] Derivative Progress: 1107/2074 symbols completed. LUMN took 1.2s. Estimated remaining: 6m 43s. Rate: 143.9 symbols/min [2025-09-26T22:24:09.617832] [INFO ] [MAIN ] LW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:09.653594] [DEBUG] [LOCAL ] LVWR: Loaded 17668 existing records from primary storage. [2025-09-26T22:24:09.653855] [INFO ] [MAIN ] LVWR: Loaded 17668 primary data records. [2025-09-26T22:24:09.762384] [DEBUG] [LOCAL ] LVS: Loaded 54342 existing records from primary storage. [2025-09-26T22:24:09.794789] [INFO ] [MAIN ] LVS: Loaded 54342 primary data records. [2025-09-26T22:24:10.132516] [DEBUG] [LOCAL ] LW: Loaded 51915 existing records from primary storage. [2025-09-26T22:24:10.132971] [INFO ] [MAIN ] LW: Loaded 51915 primary data records. [2025-09-26T22:24:10.700177] [DEBUG] [MAIN ] LVWR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:10.701987] [INFO ] [MAIN ] LVWR: Generated 1820 derivative records from 17668 primary records. [2025-09-26T22:24:10.702259] [DEBUG] [LOCAL ] LVWR: Saving derivative data. [2025-09-26T22:24:10.722713] [DEBUG] [LOCAL ] LVWR: Derivative data saved (1820 records). [2025-09-26T22:24:10.723215] [INFO ] [MAIN ] LVWR: Successfully saved derivative data. [2025-09-26T22:24:10.725626] [INFO ] [MAIN ] Derivative Progress: 1108/2074 symbols completed. LVWR took 1.1s. Estimated remaining: 6m 43s. Rate: 143.7 symbols/min [2025-09-26T22:24:10.739122] [DEBUG] [MAIN ] LVS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:10.740085] [INFO ] [MAIN ] LVS: Generated 1820 derivative records from 54342 primary records. [2025-09-26T22:24:10.740165] [DEBUG] [LOCAL ] LVS: Saving derivative data. [2025-09-26T22:24:10.760382] [DEBUG] [LOCAL ] LVS: Derivative data saved (1820 records). [2025-09-26T22:24:10.778921] [INFO ] [MAIN ] LVS: Successfully saved derivative data. [2025-09-26T22:24:10.782162] [INFO ] [MAIN ] Derivative Progress: 1109/2074 symbols completed. LVS took 1.2s. Estimated remaining: 6m 43s. Rate: 143.8 symbols/min [2025-09-26T22:24:10.783456] [DEBUG] [MAIN ] LW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:10.784314] [INFO ] [MAIN ] LW: Generated 1820 derivative records from 51915 primary records. [2025-09-26T22:24:10.784390] [DEBUG] [LOCAL ] LW: Saving derivative data. [2025-09-26T22:24:10.807591] [DEBUG] [LOCAL ] LW: Derivative data saved (1820 records). [2025-09-26T22:24:10.807696] [INFO ] [MAIN ] LW: Successfully saved derivative data. [2025-09-26T22:24:10.810308] [INFO ] [MAIN ] Derivative Progress: 1110/2074 symbols completed. LW took 1.2s. Estimated remaining: 6m 42s. Rate: 143.9 symbols/min [2025-09-26T22:24:10.811066] [INFO ] [MAIN ] LXFR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:10.811243] [INFO ] [MAIN ] LXP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:10.811429] [INFO ] [MAIN ] LXU: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:10.843769] [DEBUG] [LOCAL ] LXFR: Loaded 17259 existing records from primary storage. [2025-09-26T22:24:10.843920] [INFO ] [MAIN ] LXFR: Loaded 17259 primary data records. [2025-09-26T22:24:10.961222] [DEBUG] [LOCAL ] LXU: Loaded 32354 existing records from primary storage. [2025-09-26T22:24:10.983944] [INFO ] [MAIN ] LXU: Loaded 32354 primary data records. [2025-09-26T22:24:11.150362] [DEBUG] [LOCAL ] LXP: Loaded 51361 existing records from primary storage. [2025-09-26T22:24:11.157789] [INFO ] [MAIN ] LXP: Loaded 51361 primary data records. [2025-09-26T22:24:12.040864] [DEBUG] [MAIN ] LXFR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:12.042262] [INFO ] [MAIN ] LXFR: Generated 1820 derivative records from 17259 primary records. [2025-09-26T22:24:12.043621] [DEBUG] [LOCAL ] LXFR: Saving derivative data. [2025-09-26T22:24:12.066034] [DEBUG] [LOCAL ] LXFR: Derivative data saved (1820 records). [2025-09-26T22:24:12.074096] [INFO ] [MAIN ] LXFR: Successfully saved derivative data. [2025-09-26T22:24:12.093396] [INFO ] [MAIN ] Derivative Progress: 1111/2074 symbols completed. LXFR took 1.3s. Estimated remaining: 6m 42s. Rate: 143.6 symbols/min [2025-09-26T22:24:12.094633] [INFO ] [MAIN ] LYB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:12.094939] [DEBUG] [MAIN ] LXU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:12.094196] [DEBUG] [MAIN ] LXP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:12.096512] [INFO ] [MAIN ] LXP: Generated 1820 derivative records from 51361 primary records. [2025-09-26T22:24:12.097310] [DEBUG] [LOCAL ] LXP: Saving derivative data. [2025-09-26T22:24:12.097246] [INFO ] [MAIN ] LXU: Generated 1820 derivative records from 32354 primary records. [2025-09-26T22:24:12.098190] [DEBUG] [LOCAL ] LXU: Saving derivative data. [2025-09-26T22:24:12.125762] [DEBUG] [LOCAL ] LXP: Derivative data saved (1820 records). [2025-09-26T22:24:12.130173] [DEBUG] [LOCAL ] LXU: Derivative data saved (1820 records). [2025-09-26T22:24:12.130482] [INFO ] [MAIN ] LXP: Successfully saved derivative data. [2025-09-26T22:24:12.130412] [INFO ] [MAIN ] LXU: Successfully saved derivative data. [2025-09-26T22:24:12.133296] [INFO ] [MAIN ] Derivative Progress: 1112/2074 symbols completed. LXU took 1.3s. Estimated remaining: 6m 42s. Rate: 143.8 symbols/min [2025-09-26T22:24:12.136738] [INFO ] [MAIN ] LYG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:12.136664] [INFO ] [MAIN ] Derivative Progress: 1113/2074 symbols completed. LXP took 1.3s. Estimated remaining: 6m 41s. Rate: 143.9 symbols/min [2025-09-26T22:24:12.137928] [INFO ] [MAIN ] LYV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:12.200616] [DEBUG] [LOCAL ] LYB: Loaded 54379 existing records from primary storage. [2025-09-26T22:24:12.201077] [INFO ] [MAIN ] LYB: Loaded 54379 primary data records. [2025-09-26T22:24:12.350379] [DEBUG] [LOCAL ] LYG: Loaded 53606 existing records from primary storage. [2025-09-26T22:24:12.370784] [INFO ] [MAIN ] LYG: Loaded 53606 primary data records. [2025-09-26T22:24:12.392806] [DEBUG] [LOCAL ] LYV: Loaded 51906 existing records from primary storage. [2025-09-26T22:24:12.468114] [INFO ] [MAIN ] LYV: Loaded 51906 primary data records. [2025-09-26T22:24:13.262137] [DEBUG] [MAIN ] LYB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:13.262960] [INFO ] [MAIN ] LYB: Generated 1820 derivative records from 54379 primary records. [2025-09-26T22:24:13.263231] [DEBUG] [LOCAL ] LYB: Saving derivative data. [2025-09-26T22:24:13.281219] [DEBUG] [LOCAL ] LYB: Derivative data saved (1820 records). [2025-09-26T22:24:13.281755] [INFO ] [MAIN ] LYB: Successfully saved derivative data. [2025-09-26T22:24:13.285629] [INFO ] [MAIN ] Derivative Progress: 1114/2074 symbols completed. LYB took 1.2s. Estimated remaining: 6m 41s. Rate: 143.7 symbols/min [2025-09-26T22:24:13.287074] [INFO ] [MAIN ] LZB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:13.304702] [DEBUG] [MAIN ] LYG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:13.313040] [INFO ] [MAIN ] LYG: Generated 1820 derivative records from 53606 primary records. [2025-09-26T22:24:13.318459] [DEBUG] [MAIN ] LYV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:13.318201] [DEBUG] [LOCAL ] LYG: Saving derivative data. [2025-09-26T22:24:13.319193] [INFO ] [MAIN ] LYV: Generated 1820 derivative records from 51906 primary records. [2025-09-26T22:24:13.319275] [DEBUG] [LOCAL ] LYV: Saving derivative data. [2025-09-26T22:24:13.350205] [DEBUG] [LOCAL ] LYV: Derivative data saved (1820 records). [2025-09-26T22:24:13.353806] [INFO ] [MAIN ] LYV: Successfully saved derivative data. [2025-09-26T22:24:13.353736] [DEBUG] [LOCAL ] LYG: Derivative data saved (1820 records). [2025-09-26T22:24:13.356693] [INFO ] [MAIN ] Derivative Progress: 1115/2074 symbols completed. LYV took 1.2s. Estimated remaining: 6m 40s. Rate: 143.8 symbols/min [2025-09-26T22:24:13.357030] [INFO ] [MAIN ] LYG: Successfully saved derivative data. [2025-09-26T22:24:13.360344] [INFO ] [MAIN ] LZM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:13.360459] [INFO ] [MAIN ] Derivative Progress: 1116/2074 symbols completed. LYG took 1.2s. Estimated remaining: 6m 39s. Rate: 143.9 symbols/min [2025-09-26T22:24:13.361061] [INFO ] [MAIN ] M: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:13.383223] [DEBUG] [LOCAL ] LZM: Loaded 13905 existing records from primary storage. [2025-09-26T22:24:13.383363] [INFO ] [MAIN ] LZM: Loaded 13905 primary data records. [2025-09-26T22:24:13.505254] [DEBUG] [LOCAL ] LZB: Loaded 36113 existing records from primary storage. [2025-09-26T22:24:13.514831] [INFO ] [MAIN ] LZB: Loaded 36113 primary data records. [2025-09-26T22:24:14.062926] [DEBUG] [LOCAL ] M: Loaded 54315 existing records from primary storage. [2025-09-26T22:24:14.113054] [INFO ] [MAIN ] M: Loaded 54315 primary data records. [2025-09-26T22:24:14.462774] [DEBUG] [MAIN ] LZM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:14.463873] [INFO ] [MAIN ] LZM: Generated 1820 derivative records from 13905 primary records. [2025-09-26T22:24:14.464054] [DEBUG] [LOCAL ] LZM: Saving derivative data. [2025-09-26T22:24:14.497920] [DEBUG] [MAIN ] LZB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:14.497565] [DEBUG] [LOCAL ] LZM: Derivative data saved (1820 records). [2025-09-26T22:24:14.498723] [INFO ] [MAIN ] LZB: Generated 1820 derivative records from 36113 primary records. [2025-09-26T22:24:14.498915] [INFO ] [MAIN ] LZM: Successfully saved derivative data. [2025-09-26T22:24:14.499018] [DEBUG] [LOCAL ] LZB: Saving derivative data. [2025-09-26T22:24:14.501327] [INFO ] [MAIN ] Derivative Progress: 1117/2074 symbols completed. LZM took 1.1s. Estimated remaining: 6m 40s. Rate: 143.7 symbols/min [2025-09-26T22:24:14.502451] [INFO ] [MAIN ] MA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:14.521505] [DEBUG] [LOCAL ] LZB: Derivative data saved (1820 records). [2025-09-26T22:24:14.521671] [INFO ] [MAIN ] LZB: Successfully saved derivative data. [2025-09-26T22:24:14.524269] [INFO ] [MAIN ] Derivative Progress: 1118/2074 symbols completed. LZB took 1.2s. Estimated remaining: 6m 39s. Rate: 143.8 symbols/min [2025-09-26T22:24:14.524840] [INFO ] [MAIN ] MAA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:14.542332] [DEBUG] [MAIN ] M: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:14.543240] [INFO ] [MAIN ] M: Generated 1820 derivative records from 54315 primary records. [2025-09-26T22:24:14.543362] [DEBUG] [LOCAL ] M: Saving derivative data. [2025-09-26T22:24:14.562113] [DEBUG] [LOCAL ] M: Derivative data saved (1820 records). [2025-09-26T22:24:14.562430] [INFO ] [MAIN ] M: Successfully saved derivative data. [2025-09-26T22:24:14.565261] [INFO ] [MAIN ] Derivative Progress: 1119/2074 symbols completed. M took 1.2s. Estimated remaining: 6m 38s. Rate: 143.9 symbols/min [2025-09-26T22:24:14.565784] [INFO ] [MAIN ] MAC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:14.617884] [DEBUG] [LOCAL ] MA: Loaded 53329 existing records from primary storage. [2025-09-26T22:24:14.630399] [INFO ] [MAIN ] MA: Loaded 53329 primary data records. [2025-09-26T22:24:14.631289] [DEBUG] [LOCAL ] MAA: Loaded 43354 existing records from primary storage. [2025-09-26T22:24:14.670516] [INFO ] [MAIN ] MAA: Loaded 43354 primary data records. [2025-09-26T22:24:15.018630] [DEBUG] [LOCAL ] MAC: Loaded 50469 existing records from primary storage. [2025-09-26T22:24:15.075570] [INFO ] [MAIN ] MAC: Loaded 50469 primary data records. [2025-09-26T22:24:15.760003] [DEBUG] [MAIN ] MA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:15.761967] [INFO ] [MAIN ] MA: Generated 1820 derivative records from 53329 primary records. [2025-09-26T22:24:15.762107] [DEBUG] [LOCAL ] MA: Saving derivative data. [2025-09-26T22:24:15.789357] [DEBUG] [MAIN ] MAA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:15.793686] [INFO ] [MAIN ] MAA: Generated 1820 derivative records from 43354 primary records. [2025-09-26T22:24:15.794336] [DEBUG] [LOCAL ] MAA: Saving derivative data. [2025-09-26T22:24:15.795389] [DEBUG] [LOCAL ] MA: Derivative data saved (1820 records). [2025-09-26T22:24:15.796620] [INFO ] [MAIN ] MA: Successfully saved derivative data. [2025-09-26T22:24:15.798821] [INFO ] [MAIN ] Derivative Progress: 1120/2074 symbols completed. MA took 1.3s. Estimated remaining: 6m 38s. Rate: 143.7 symbols/min [2025-09-26T22:24:15.799531] [INFO ] [MAIN ] MAGN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:15.835093] [DEBUG] [MAIN ] MAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:15.835298] [DEBUG] [LOCAL ] MAA: Derivative data saved (1820 records). [2025-09-26T22:24:15.836271] [INFO ] [MAIN ] MAC: Generated 1820 derivative records from 50469 primary records. [2025-09-26T22:24:15.836449] [DEBUG] [LOCAL ] MAC: Saving derivative data. [2025-09-26T22:24:15.836542] [INFO ] [MAIN ] MAA: Successfully saved derivative data. [2025-09-26T22:24:15.852041] [INFO ] [MAIN ] Derivative Progress: 1121/2074 symbols completed. MAA took 1.3s. Estimated remaining: 6m 38s. Rate: 143.8 symbols/min [2025-09-26T22:24:15.857053] [INFO ] [MAIN ] MAIN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:15.872203] [DEBUG] [LOCAL ] MAC: Derivative data saved (1820 records). [2025-09-26T22:24:15.872433] [INFO ] [MAIN ] MAC: Successfully saved derivative data. [2025-09-26T22:24:15.875397] [INFO ] [MAIN ] Derivative Progress: 1122/2074 symbols completed. MAC took 1.3s. Estimated remaining: 6m 37s. Rate: 143.9 symbols/min [2025-09-26T22:24:15.876571] [INFO ] [MAIN ] MAN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:15.887769] [DEBUG] [LOCAL ] MAGN: Loaded 35466 existing records from primary storage. [2025-09-26T22:24:15.887973] [INFO ] [MAIN ] MAGN: Loaded 35466 primary data records. [2025-09-26T22:24:16.253883] [DEBUG] [LOCAL ] MAIN: Loaded 41929 existing records from primary storage. [2025-09-26T22:24:16.254162] [INFO ] [MAIN ] MAIN: Loaded 41929 primary data records. [2025-09-26T22:24:16.389591] [DEBUG] [LOCAL ] MAN: Loaded 44216 existing records from primary storage. [2025-09-26T22:24:16.410948] [INFO ] [MAIN ] MAN: Loaded 44216 primary data records. [2025-09-26T22:24:16.953864] [DEBUG] [MAIN ] MAGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:16.954987] [INFO ] [MAIN ] MAGN: Generated 1820 derivative records from 35466 primary records. [2025-09-26T22:24:16.955168] [DEBUG] [LOCAL ] MAGN: Saving derivative data. [2025-09-26T22:24:16.974828] [DEBUG] [LOCAL ] MAGN: Derivative data saved (1820 records). [2025-09-26T22:24:16.975579] [INFO ] [MAIN ] MAGN: Successfully saved derivative data. [2025-09-26T22:24:16.978326] [INFO ] [MAIN ] Derivative Progress: 1123/2074 symbols completed. MAGN took 1.2s. Estimated remaining: 6m 37s. Rate: 143.7 symbols/min [2025-09-26T22:24:16.998530] [DEBUG] [MAIN ] MAIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:16.999524] [INFO ] [MAIN ] MAIN: Generated 1820 derivative records from 41929 primary records. [2025-09-26T22:24:16.999777] [DEBUG] [LOCAL ] MAIN: Saving derivative data. [2025-09-26T22:24:17.017689] [DEBUG] [LOCAL ] MAIN: Derivative data saved (1820 records). [2025-09-26T22:24:17.017956] [INFO ] [MAIN ] MAIN: Successfully saved derivative data. [2025-09-26T22:24:17.020392] [INFO ] [MAIN ] Derivative Progress: 1124/2074 symbols completed. MAIN took 1.2s. Estimated remaining: 6m 36s. Rate: 143.8 symbols/min [2025-09-26T22:24:17.036159] [DEBUG] [MAIN ] MAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:17.036893] [INFO ] [MAIN ] MAN: Generated 1820 derivative records from 44216 primary records. [2025-09-26T22:24:17.036959] [DEBUG] [LOCAL ] MAN: Saving derivative data. [2025-09-26T22:24:17.052909] [DEBUG] [LOCAL ] MAN: Derivative data saved (1820 records). [2025-09-26T22:24:17.052996] [INFO ] [MAIN ] MAN: Successfully saved derivative data. [2025-09-26T22:24:17.055743] [INFO ] [MAIN ] Derivative Progress: 1125/2074 symbols completed. MAN took 1.2s. Estimated remaining: 6m 36s. Rate: 143.9 symbols/min [2025-09-26T22:24:17.056578] [INFO ] [MAIN ] MANU: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:17.056705] [INFO ] [MAIN ] MAS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:17.056979] [INFO ] [MAIN ] MATV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:17.088288] [DEBUG] [LOCAL ] MANU: Loaded 27544 existing records from primary storage. [2025-09-26T22:24:17.088436] [INFO ] [MAIN ] MANU: Loaded 27544 primary data records. [2025-09-26T22:24:17.262170] [DEBUG] [LOCAL ] MATV: Loaded 37964 existing records from primary storage. [2025-09-26T22:24:17.292345] [INFO ] [MAIN ] MATV: Loaded 37964 primary data records. [2025-09-26T22:24:17.561291] [DEBUG] [LOCAL ] MAS: Loaded 53102 existing records from primary storage. [2025-09-26T22:24:17.579703] [INFO ] [MAIN ] MAS: Loaded 53102 primary data records. [2025-09-26T22:24:18.279273] [DEBUG] [MAIN ] MANU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:18.280604] [INFO ] [MAIN ] MANU: Generated 1820 derivative records from 27544 primary records. [2025-09-26T22:24:18.281247] [DEBUG] [LOCAL ] MANU: Saving derivative data. [2025-09-26T22:24:18.301255] [DEBUG] [LOCAL ] MANU: Derivative data saved (1820 records). [2025-09-26T22:24:18.301516] [INFO ] [MAIN ] MANU: Successfully saved derivative data. [2025-09-26T22:24:18.304377] [INFO ] [MAIN ] Derivative Progress: 1126/2074 symbols completed. MANU took 1.2s. Estimated remaining: 6m 36s. Rate: 143.7 symbols/min [2025-09-26T22:24:18.305811] [INFO ] [MAIN ] MATX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:18.322073] [DEBUG] [MAIN ] MATV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:18.323006] [INFO ] [MAIN ] MATV: Generated 1820 derivative records from 37964 primary records. [2025-09-26T22:24:18.323189] [DEBUG] [LOCAL ] MATV: Saving derivative data. [2025-09-26T22:24:18.342720] [DEBUG] [LOCAL ] MATV: Derivative data saved (1820 records). [2025-09-26T22:24:18.342932] [INFO ] [MAIN ] MATV: Successfully saved derivative data. [2025-09-26T22:24:18.345338] [INFO ] [MAIN ] Derivative Progress: 1127/2074 symbols completed. MATV took 1.3s. Estimated remaining: 6m 35s. Rate: 143.8 symbols/min [2025-09-26T22:24:18.358683] [INFO ] [MAIN ] MAX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:18.358989] [DEBUG] [MAIN ] MAS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:18.359947] [INFO ] [MAIN ] MAS: Generated 1820 derivative records from 53102 primary records. [2025-09-26T22:24:18.360352] [DEBUG] [LOCAL ] MAS: Saving derivative data. [2025-09-26T22:24:18.379405] [DEBUG] [LOCAL ] MAS: Derivative data saved (1820 records). [2025-09-26T22:24:18.387596] [INFO ] [MAIN ] MAS: Successfully saved derivative data. [2025-09-26T22:24:18.390760] [INFO ] [MAIN ] Derivative Progress: 1128/2074 symbols completed. MAS took 1.3s. Estimated remaining: 6m 34s. Rate: 143.9 symbols/min [2025-09-26T22:24:18.391226] [INFO ] [MAIN ] MBC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:18.417808] [DEBUG] [LOCAL ] MATX: Loaded 31851 existing records from primary storage. [2025-09-26T22:24:18.418036] [INFO ] [MAIN ] MATX: Loaded 31851 primary data records. [2025-09-26T22:24:18.530123] [DEBUG] [LOCAL ] MAX: Loaded 31209 existing records from primary storage. [2025-09-26T22:24:18.542058] [INFO ] [MAIN ] MAX: Loaded 31209 primary data records. [2025-09-26T22:24:18.751560] [DEBUG] [LOCAL ] MBC: Loaded 43803 existing records from primary storage. [2025-09-26T22:24:18.906639] [INFO ] [MAIN ] MBC: Loaded 43803 primary data records. [2025-09-26T22:24:19.462251] [DEBUG] [MAIN ] MATX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:19.463327] [INFO ] [MAIN ] MATX: Generated 1820 derivative records from 31851 primary records. [2025-09-26T22:24:19.463469] [DEBUG] [LOCAL ] MATX: Saving derivative data. [2025-09-26T22:24:19.484734] [DEBUG] [LOCAL ] MATX: Derivative data saved (1820 records). [2025-09-26T22:24:19.485380] [INFO ] [MAIN ] MATX: Successfully saved derivative data. [2025-09-26T22:24:19.487785] [INFO ] [MAIN ] Derivative Progress: 1129/2074 symbols completed. MATX took 1.2s. Estimated remaining: 6m 35s. Rate: 143.7 symbols/min [2025-09-26T22:24:19.502846] [INFO ] [MAIN ] MBI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:19.503771] [DEBUG] [MAIN ] MAX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:19.504727] [INFO ] [MAIN ] MAX: Generated 1820 derivative records from 31209 primary records. [2025-09-26T22:24:19.505170] [DEBUG] [LOCAL ] MAX: Saving derivative data. [2025-09-26T22:24:19.522244] [DEBUG] [LOCAL ] MAX: Derivative data saved (1820 records). [2025-09-26T22:24:19.524973] [INFO ] [MAIN ] MAX: Successfully saved derivative data. [2025-09-26T22:24:19.527862] [INFO ] [MAIN ] Derivative Progress: 1130/2074 symbols completed. MAX took 1.2s. Estimated remaining: 6m 34s. Rate: 143.8 symbols/min [2025-09-26T22:24:19.528374] [INFO ] [MAIN ] MC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:19.547858] [DEBUG] [MAIN ] MBC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:19.548753] [INFO ] [MAIN ] MBC: Generated 1820 derivative records from 43803 primary records. [2025-09-26T22:24:19.548965] [DEBUG] [LOCAL ] MBC: Saving derivative data. [2025-09-26T22:24:19.572529] [DEBUG] [LOCAL ] MBI: Loaded 24930 existing records from primary storage. [2025-09-26T22:24:19.573554] [INFO ] [MAIN ] MBI: Loaded 24930 primary data records. [2025-09-26T22:24:19.648898] [DEBUG] [LOCAL ] MBC: Derivative data saved (1820 records). [2025-09-26T22:24:19.668142] [INFO ] [MAIN ] MBC: Successfully saved derivative data. [2025-09-26T22:24:19.678815] [INFO ] [MAIN ] Derivative Progress: 1131/2074 symbols completed. MBC took 1.3s. Estimated remaining: 6m 33s. Rate: 143.9 symbols/min [2025-09-26T22:24:19.710585] [INFO ] [MAIN ] MCB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:19.986165] [DEBUG] [LOCAL ] MCB: Loaded 11834 existing records from primary storage. [2025-09-26T22:24:19.987342] [DEBUG] [LOCAL ] MC: Loaded 44878 existing records from primary storage. [2025-09-26T22:24:19.987514] [INFO ] [MAIN ] MCB: Loaded 11834 primary data records. [2025-09-26T22:24:19.987627] [INFO ] [MAIN ] MC: Loaded 44878 primary data records. [2025-09-26T22:24:20.643248] [DEBUG] [MAIN ] MBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:20.644921] [INFO ] [MAIN ] MBI: Generated 1820 derivative records from 24930 primary records. [2025-09-26T22:24:20.645043] [DEBUG] [LOCAL ] MBI: Saving derivative data. [2025-09-26T22:24:20.663724] [DEBUG] [LOCAL ] MBI: Derivative data saved (1820 records). [2025-09-26T22:24:20.663999] [INFO ] [MAIN ] MBI: Successfully saved derivative data. [2025-09-26T22:24:20.668197] [INFO ] [MAIN ] Derivative Progress: 1132/2074 symbols completed. MBI took 1.2s. Estimated remaining: 6m 33s. Rate: 143.7 symbols/min [2025-09-26T22:24:20.668721] [INFO ] [MAIN ] MCI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:20.681964] [DEBUG] [LOCAL ] MCI: Loaded 6477 existing records from primary storage. [2025-09-26T22:24:20.692221] [INFO ] [MAIN ] MCI: Loaded 6477 primary data records. [2025-09-26T22:24:20.703151] [DEBUG] [MAIN ] MC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:20.757978] [INFO ] [MAIN ] MC: Generated 1820 derivative records from 44878 primary records. [2025-09-26T22:24:20.772079] [DEBUG] [MAIN ] MCB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:20.781686] [DEBUG] [LOCAL ] MC: Saving derivative data. [2025-09-26T22:24:20.787586] [INFO ] [MAIN ] MCB: Generated 1820 derivative records from 11834 primary records. [2025-09-26T22:24:20.806228] [DEBUG] [LOCAL ] MCB: Saving derivative data. [2025-09-26T22:24:20.861691] [DEBUG] [LOCAL ] MCB: Derivative data saved (1820 records). [2025-09-26T22:24:20.861588] [DEBUG] [LOCAL ] MC: Derivative data saved (1820 records). [2025-09-26T22:24:20.866941] [INFO ] [MAIN ] MC: Successfully saved derivative data. [2025-09-26T22:24:20.872122] [INFO ] [MAIN ] MCB: Successfully saved derivative data. [2025-09-26T22:24:20.884915] [INFO ] [MAIN ] Derivative Progress: 1133/2074 symbols completed. MC took 1.4s. Estimated remaining: 6m 33s. Rate: 143.8 symbols/min [2025-09-26T22:24:20.938428] [INFO ] [MAIN ] MCK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:20.921699] [INFO ] [MAIN ] Derivative Progress: 1134/2074 symbols completed. MCB took 1.2s. Estimated remaining: 6m 32s. Rate: 143.9 symbols/min [2025-09-26T22:24:21.063995] [INFO ] [MAIN ] MCN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:21.075398] [DEBUG] [LOCAL ] MCN: Loaded 8231 existing records from primary storage. [2025-09-26T22:24:21.075552] [INFO ] [MAIN ] MCN: Loaded 8231 primary data records. [2025-09-26T22:24:21.431363] [DEBUG] [LOCAL ] MCK: Loaded 39985 existing records from primary storage. [2025-09-26T22:24:21.432492] [INFO ] [MAIN ] MCK: Loaded 39985 primary data records. [2025-09-26T22:24:21.452939] [DEBUG] [MAIN ] MCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:21.461348] [INFO ] [MAIN ] MCI: Generated 1820 derivative records from 6477 primary records. [2025-09-26T22:24:21.496614] [DEBUG] [LOCAL ] MCI: Saving derivative data. [2025-09-26T22:24:21.651201] [DEBUG] [LOCAL ] MCI: Derivative data saved (1820 records). [2025-09-26T22:24:21.677447] [INFO ] [MAIN ] MCI: Successfully saved derivative data. [2025-09-26T22:24:21.680102] [INFO ] [MAIN ] Derivative Progress: 1135/2074 symbols completed. MCI took 1.0s. Estimated remaining: 6m 32s. Rate: 143.8 symbols/min [2025-09-26T22:24:21.789971] [INFO ] [MAIN ] MCO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:21.825823] [DEBUG] [MAIN ] MCN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:21.827295] [INFO ] [MAIN ] MCN: Generated 1820 derivative records from 8231 primary records. [2025-09-26T22:24:21.827485] [DEBUG] [LOCAL ] MCN: Saving derivative data. [2025-09-26T22:24:21.847224] [DEBUG] [LOCAL ] MCN: Derivative data saved (1820 records). [2025-09-26T22:24:21.847724] [INFO ] [MAIN ] MCN: Successfully saved derivative data. [2025-09-26T22:24:21.850444] [INFO ] [MAIN ] Derivative Progress: 1136/2074 symbols completed. MCN took 0.8s. Estimated remaining: 6m 31s. Rate: 143.9 symbols/min [2025-09-26T22:24:21.850832] [INFO ] [MAIN ] MCR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:21.873749] [DEBUG] [LOCAL ] MCR: Loaded 8858 existing records from primary storage. [2025-09-26T22:24:21.874127] [INFO ] [MAIN ] MCR: Loaded 8858 primary data records. [2025-09-26T22:24:21.934001] [DEBUG] [MAIN ] MCK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:21.954712] [INFO ] [MAIN ] MCK: Generated 1820 derivative records from 39985 primary records. [2025-09-26T22:24:21.986419] [DEBUG] [LOCAL ] MCK: Saving derivative data. [2025-09-26T22:24:21.953775] [DEBUG] [LOCAL ] MCO: Loaded 40102 existing records from primary storage. [2025-09-26T22:24:21.991830] [INFO ] [MAIN ] MCO: Loaded 40102 primary data records. [2025-09-26T22:24:22.374210] [DEBUG] [LOCAL ] MCK: Derivative data saved (1820 records). [2025-09-26T22:24:22.411859] [INFO ] [MAIN ] MCK: Successfully saved derivative data. [2025-09-26T22:24:22.420133] [INFO ] [MAIN ] Derivative Progress: 1137/2074 symbols completed. MCK took 1.5s. Estimated remaining: 6m 31s. Rate: 143.8 symbols/min [2025-09-26T22:24:22.437064] [INFO ] [MAIN ] MCS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:22.659285] [DEBUG] [LOCAL ] MCS: Loaded 21454 existing records from primary storage. [2025-09-26T22:24:22.661598] [INFO ] [MAIN ] MCS: Loaded 21454 primary data records. [2025-09-26T22:24:22.725494] [DEBUG] [MAIN ] MCR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:22.737480] [INFO ] [MAIN ] MCR: Generated 1820 derivative records from 8858 primary records. [2025-09-26T22:24:22.771747] [DEBUG] [LOCAL ] MCR: Saving derivative data. [2025-09-26T22:24:22.847685] [DEBUG] [LOCAL ] MCR: Derivative data saved (1820 records). [2025-09-26T22:24:22.884095] [DEBUG] [MAIN ] MCO: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:24:22.895400] [INFO ] [MAIN ] MCO: Generated 1819 derivative records from 40102 primary records. [2025-09-26T22:24:22.900719] [DEBUG] [LOCAL ] MCO: Saving derivative data. [2025-09-26T22:24:22.867906] [INFO ] [MAIN ] MCR: Successfully saved derivative data. [2025-09-26T22:24:22.919144] [INFO ] [MAIN ] Derivative Progress: 1138/2074 symbols completed. MCR took 1.1s. Estimated remaining: 6m 31s. Rate: 143.8 symbols/min [2025-09-26T22:24:23.104000] [DEBUG] [LOCAL ] MCO: Derivative data saved (1819 records). [2025-09-26T22:24:23.104159] [INFO ] [MAIN ] MCO: Successfully saved derivative data. [2025-09-26T22:24:23.106876] [INFO ] [MAIN ] Derivative Progress: 1139/2074 symbols completed. MCO took 1.3s. Estimated remaining: 6m 30s. Rate: 143.9 symbols/min [2025-09-26T22:24:23.133874] [DEBUG] [MAIN ] MCS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:23.134525] [INFO ] [MAIN ] MCS: Generated 1820 derivative records from 21454 primary records. [2025-09-26T22:24:23.134588] [DEBUG] [LOCAL ] MCS: Saving derivative data. [2025-09-26T22:24:23.150307] [DEBUG] [LOCAL ] MCS: Derivative data saved (1820 records). [2025-09-26T22:24:23.150394] [INFO ] [MAIN ] MCS: Successfully saved derivative data. [2025-09-26T22:24:23.153061] [INFO ] [MAIN ] Derivative Progress: 1140/2074 symbols completed. MCS took 0.7s. Estimated remaining: 6m 29s. Rate: 144.0 symbols/min [2025-09-26T22:24:23.153703] [INFO ] [MAIN ] MCY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:23.153930] [INFO ] [MAIN ] MDST: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:23.153877] [INFO ] [MAIN ] MD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:23.163695] [DEBUG] [LOCAL ] MDST: Loaded 5688 existing records from primary storage. [2025-09-26T22:24:23.163847] [INFO ] [MAIN ] MDST: Loaded 5688 primary data records. [2025-09-26T22:24:23.375524] [DEBUG] [LOCAL ] MCY: Loaded 25345 existing records from primary storage. [2025-09-26T22:24:23.381692] [INFO ] [MAIN ] MCY: Loaded 25345 primary data records. [2025-09-26T22:24:23.567741] [DEBUG] [LOCAL ] MD: Loaded 39064 existing records from primary storage. [2025-09-26T22:24:23.582551] [INFO ] [MAIN ] MD: Loaded 39064 primary data records. [2025-09-26T22:24:24.313531] [DEBUG] [MAIN ] MDST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:24.314858] [INFO ] [MAIN ] MDST: Generated 1820 derivative records from 5688 primary records. [2025-09-26T22:24:24.315684] [DEBUG] [LOCAL ] MDST: Saving derivative data. [2025-09-26T22:24:24.339131] [DEBUG] [LOCAL ] MDST: Derivative data saved (1820 records). [2025-09-26T22:24:24.339702] [INFO ] [MAIN ] MDST: Successfully saved derivative data. [2025-09-26T22:24:24.342167] [INFO ] [MAIN ] Derivative Progress: 1141/2074 symbols completed. MDST took 1.2s. Estimated remaining: 6m 29s. Rate: 143.7 symbols/min [2025-09-26T22:24:24.355920] [INFO ] [MAIN ] MDT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:24.356621] [DEBUG] [MAIN ] MCY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:24.357741] [INFO ] [MAIN ] MCY: Generated 1820 derivative records from 25345 primary records. [2025-09-26T22:24:24.357969] [DEBUG] [LOCAL ] MCY: Saving derivative data. [2025-09-26T22:24:24.379208] [DEBUG] [LOCAL ] MCY: Derivative data saved (1820 records). [2025-09-26T22:24:24.387721] [INFO ] [MAIN ] MCY: Successfully saved derivative data. [2025-09-26T22:24:24.395961] [INFO ] [MAIN ] Derivative Progress: 1142/2074 symbols completed. MCY took 1.2s. Estimated remaining: 6m 29s. Rate: 143.8 symbols/min [2025-09-26T22:24:24.396574] [DEBUG] [MAIN ] MD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:24.398022] [INFO ] [MAIN ] MDU: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:24.397880] [INFO ] [MAIN ] MD: Generated 1820 derivative records from 39064 primary records. [2025-09-26T22:24:24.398306] [DEBUG] [LOCAL ] MD: Saving derivative data. [2025-09-26T22:24:24.419898] [DEBUG] [LOCAL ] MD: Derivative data saved (1820 records). [2025-09-26T22:24:24.420052] [INFO ] [MAIN ] MD: Successfully saved derivative data. [2025-09-26T22:24:24.423033] [INFO ] [MAIN ] Derivative Progress: 1143/2074 symbols completed. MD took 1.3s. Estimated remaining: 6m 28s. Rate: 144.0 symbols/min [2025-09-26T22:24:24.423734] [INFO ] [MAIN ] MDV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:24.453030] [DEBUG] [LOCAL ] MDV: Loaded 8733 existing records from primary storage. [2025-09-26T22:24:24.453404] [INFO ] [MAIN ] MDV: Loaded 8733 primary data records. [2025-09-26T22:24:24.564620] [DEBUG] [LOCAL ] MDT: Loaded 54458 existing records from primary storage. [2025-09-26T22:24:24.600195] [INFO ] [MAIN ] MDT: Loaded 54458 primary data records. [2025-09-26T22:24:24.730639] [DEBUG] [LOCAL ] MDU: Loaded 48643 existing records from primary storage. [2025-09-26T22:24:24.759788] [INFO ] [MAIN ] MDU: Loaded 48643 primary data records. [2025-09-26T22:24:25.739099] [DEBUG] [MAIN ] MDV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:25.740479] [INFO ] [MAIN ] MDV: Generated 1820 derivative records from 8733 primary records. [2025-09-26T22:24:25.740724] [DEBUG] [LOCAL ] MDV: Saving derivative data. [2025-09-26T22:24:25.779942] [DEBUG] [MAIN ] MDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:25.780043] [DEBUG] [LOCAL ] MDV: Derivative data saved (1820 records). [2025-09-26T22:24:25.780472] [INFO ] [MAIN ] MDV: Successfully saved derivative data. [2025-09-26T22:24:25.782787] [INFO ] [MAIN ] Derivative Progress: 1144/2074 symbols completed. MDV took 1.4s. Estimated remaining: 6m 28s. Rate: 143.7 symbols/min [2025-09-26T22:24:25.783700] [INFO ] [MAIN ] MDT: Generated 1820 derivative records from 54458 primary records. [2025-09-26T22:24:25.784127] [INFO ] [MAIN ] MEC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:25.784769] [DEBUG] [LOCAL ] MDT: Saving derivative data. [2025-09-26T22:24:25.806368] [DEBUG] [LOCAL ] MDT: Derivative data saved (1820 records). [2025-09-26T22:24:25.806891] [INFO ] [MAIN ] MDT: Successfully saved derivative data. [2025-09-26T22:24:25.809599] [INFO ] [MAIN ] Derivative Progress: 1145/2074 symbols completed. MDT took 1.5s. Estimated remaining: 6m 28s. Rate: 143.8 symbols/min [2025-09-26T22:24:25.818537] [INFO ] [MAIN ] MED: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:25.829291] [DEBUG] [MAIN ] MDU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:25.830907] [INFO ] [MAIN ] MDU: Generated 1820 derivative records from 48643 primary records. [2025-09-26T22:24:25.831168] [DEBUG] [LOCAL ] MDU: Saving derivative data. [2025-09-26T22:24:25.847384] [DEBUG] [LOCAL ] MEC: Loaded 16695 existing records from primary storage. [2025-09-26T22:24:25.853139] [INFO ] [MAIN ] MEC: Loaded 16695 primary data records. [2025-09-26T22:24:25.856385] [DEBUG] [LOCAL ] MDU: Derivative data saved (1820 records). [2025-09-26T22:24:25.869128] [INFO ] [MAIN ] MDU: Successfully saved derivative data. [2025-09-26T22:24:25.906849] [INFO ] [MAIN ] Derivative Progress: 1146/2074 symbols completed. MDU took 1.5s. Estimated remaining: 6m 27s. Rate: 143.9 symbols/min [2025-09-26T22:24:25.940177] [INFO ] [MAIN ] MEG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:25.982721] [DEBUG] [LOCAL ] MED: Loaded 22043 existing records from primary storage. [2025-09-26T22:24:25.993345] [INFO ] [MAIN ] MED: Loaded 22043 primary data records. [2025-09-26T22:24:26.465478] [DEBUG] [LOCAL ] MEG: Loaded 32426 existing records from primary storage. [2025-09-26T22:24:26.466465] [INFO ] [MAIN ] MEG: Loaded 32426 primary data records. [2025-09-26T22:24:27.012443] [DEBUG] [MAIN ] MEC: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:24:27.015176] [INFO ] [MAIN ] MEC: Generated 1819 derivative records from 16695 primary records. [2025-09-26T22:24:27.015849] [DEBUG] [LOCAL ] MEC: Saving derivative data. [2025-09-26T22:24:27.034761] [DEBUG] [LOCAL ] MEC: Derivative data saved (1819 records). [2025-09-26T22:24:27.036184] [INFO ] [MAIN ] MEC: Successfully saved derivative data. [2025-09-26T22:24:27.039521] [INFO ] [MAIN ] Derivative Progress: 1147/2074 symbols completed. MEC took 1.3s. Estimated remaining: 6m 27s. Rate: 143.7 symbols/min [2025-09-26T22:24:27.041637] [INFO ] [MAIN ] MEGI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:27.055622] [DEBUG] [MAIN ] MED: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:27.056690] [INFO ] [MAIN ] MED: Generated 1820 derivative records from 22043 primary records. [2025-09-26T22:24:27.057010] [DEBUG] [LOCAL ] MED: Saving derivative data. [2025-09-26T22:24:27.076024] [DEBUG] [LOCAL ] MED: Derivative data saved (1820 records). [2025-09-26T22:24:27.076492] [INFO ] [MAIN ] MED: Successfully saved derivative data. [2025-09-26T22:24:27.079118] [INFO ] [MAIN ] Derivative Progress: 1148/2074 symbols completed. MED took 1.3s. Estimated remaining: 6m 26s. Rate: 143.8 symbols/min [2025-09-26T22:24:27.079924] [INFO ] [MAIN ] MEI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:27.103469] [DEBUG] [MAIN ] MEG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:27.111361] [DEBUG] [LOCAL ] MEGI: Loaded 20630 existing records from primary storage. [2025-09-26T22:24:27.110994] [INFO ] [MAIN ] MEG: Generated 1820 derivative records from 32426 primary records. [2025-09-26T22:24:27.111547] [DEBUG] [LOCAL ] MEG: Saving derivative data. [2025-09-26T22:24:27.111690] [INFO ] [MAIN ] MEGI: Loaded 20630 primary data records. [2025-09-26T22:24:27.220862] [DEBUG] [LOCAL ] MEG: Derivative data saved (1820 records). [2025-09-26T22:24:27.231918] [INFO ] [MAIN ] MEG: Successfully saved derivative data. [2025-09-26T22:24:27.263846] [INFO ] [MAIN ] Derivative Progress: 1149/2074 symbols completed. MEG took 1.3s. Estimated remaining: 6m 26s. Rate: 143.9 symbols/min [2025-09-26T22:24:27.280136] [INFO ] [MAIN ] MET: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:27.281293] [DEBUG] [LOCAL ] MEI: Loaded 32933 existing records from primary storage. [2025-09-26T22:24:27.291965] [INFO ] [MAIN ] MEI: Loaded 32933 primary data records. [2025-09-26T22:24:27.903484] [DEBUG] [LOCAL ] MET: Loaded 54089 existing records from primary storage. [2025-09-26T22:24:27.904029] [INFO ] [MAIN ] MET: Loaded 54089 primary data records. [2025-09-26T22:24:28.039531] [DEBUG] [MAIN ] MEGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:28.040510] [INFO ] [MAIN ] MEGI: Generated 1820 derivative records from 20630 primary records. [2025-09-26T22:24:28.046370] [DEBUG] [LOCAL ] MEGI: Saving derivative data. [2025-09-26T22:24:28.265090] [DEBUG] [LOCAL ] MEGI: Derivative data saved (1820 records). [2025-09-26T22:24:28.265680] [INFO ] [MAIN ] MEGI: Successfully saved derivative data. [2025-09-26T22:24:28.268475] [INFO ] [MAIN ] Derivative Progress: 1150/2074 symbols completed. MEGI took 1.2s. Estimated remaining: 6m 26s. Rate: 143.7 symbols/min [2025-09-26T22:24:28.268893] [INFO ] [MAIN ] MFA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:28.290425] [DEBUG] [MAIN ] MEI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:28.291405] [INFO ] [MAIN ] MEI: Generated 1820 derivative records from 32933 primary records. [2025-09-26T22:24:28.291663] [DEBUG] [LOCAL ] MEI: Saving derivative data. [2025-09-26T22:24:28.311886] [DEBUG] [LOCAL ] MEI: Derivative data saved (1820 records). [2025-09-26T22:24:28.313217] [INFO ] [MAIN ] MEI: Successfully saved derivative data. [2025-09-26T22:24:28.316203] [INFO ] [MAIN ] Derivative Progress: 1151/2074 symbols completed. MEI took 1.2s. Estimated remaining: 6m 25s. Rate: 143.8 symbols/min [2025-09-26T22:24:28.316569] [INFO ] [MAIN ] MFAN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:28.344920] [DEBUG] [MAIN ] MET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:28.346000] [INFO ] [MAIN ] MET: Generated 1820 derivative records from 54089 primary records. [2025-09-26T22:24:28.346238] [DEBUG] [LOCAL ] MET: Saving derivative data. [2025-09-26T22:24:28.350338] [DEBUG] [LOCAL ] MFAN: Loaded 4331 existing records from primary storage. [2025-09-26T22:24:28.351215] [INFO ] [MAIN ] MFAN: Loaded 4331 primary data records. [2025-09-26T22:24:28.470007] [DEBUG] [LOCAL ] MFA: Loaded 46019 existing records from primary storage. [2025-09-26T22:24:28.485334] [INFO ] [MAIN ] MFA: Loaded 46019 primary data records. [2025-09-26T22:24:28.494426] [DEBUG] [LOCAL ] MET: Derivative data saved (1820 records). [2025-09-26T22:24:28.498761] [INFO ] [MAIN ] MET: Successfully saved derivative data. [2025-09-26T22:24:28.524774] [INFO ] [MAIN ] Derivative Progress: 1152/2074 symbols completed. MET took 1.2s. Estimated remaining: 6m 25s. Rate: 143.9 symbols/min [2025-09-26T22:24:28.535542] [INFO ] [MAIN ] MFAO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:28.848121] [DEBUG] [LOCAL ] MFAO: Loaded 3853 existing records from primary storage. [2025-09-26T22:24:28.868623] [INFO ] [MAIN ] MFAO: Loaded 3853 primary data records. [2025-09-26T22:24:29.469185] [DEBUG] [MAIN ] MFAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:29.470519] [INFO ] [MAIN ] MFAN: Generated 1820 derivative records from 4331 primary records. [2025-09-26T22:24:29.469756] [DEBUG] [MAIN ] MFA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:29.470807] [DEBUG] [LOCAL ] MFAN: Saving derivative data. [2025-09-26T22:24:29.471693] [INFO ] [MAIN ] MFA: Generated 1820 derivative records from 46019 primary records. [2025-09-26T22:24:29.471964] [DEBUG] [LOCAL ] MFA: Saving derivative data. [2025-09-26T22:24:29.497895] [DEBUG] [LOCAL ] MFAN: Derivative data saved (1820 records). [2025-09-26T22:24:29.505336] [DEBUG] [LOCAL ] MFA: Derivative data saved (1820 records). [2025-09-26T22:24:29.505453] [INFO ] [MAIN ] MFA: Successfully saved derivative data. [2025-09-26T22:24:29.508549] [INFO ] [MAIN ] Derivative Progress: 1153/2074 symbols completed. MFA took 1.2s. Estimated remaining: 6m 25s. Rate: 143.7 symbols/min [2025-09-26T22:24:29.498189] [INFO ] [MAIN ] MFAN: Successfully saved derivative data. [2025-09-26T22:24:29.511960] [INFO ] [MAIN ] Derivative Progress: 1154/2074 symbols completed. MFAN took 1.2s. Estimated remaining: 6m 24s. Rate: 143.8 symbols/min [2025-09-26T22:24:29.527196] [DEBUG] [MAIN ] MFAO: Filtered 7001 bins outside market hours, 7797 incomplete bins [2025-09-26T22:24:29.527970] [INFO ] [MAIN ] MFAO: Generated 1817 derivative records from 3853 primary records. [2025-09-26T22:24:29.528035] [DEBUG] [LOCAL ] MFAO: Saving derivative data. [2025-09-26T22:24:29.544362] [DEBUG] [LOCAL ] MFAO: Derivative data saved (1817 records). [2025-09-26T22:24:29.544589] [INFO ] [MAIN ] MFAO: Successfully saved derivative data. [2025-09-26T22:24:29.549478] [INFO ] [MAIN ] Derivative Progress: 1155/2074 symbols completed. MFAO took 1.0s. Estimated remaining: 6m 23s. Rate: 143.9 symbols/min [2025-09-26T22:24:29.550398] [INFO ] [MAIN ] MFC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:29.550697] [INFO ] [MAIN ] MFM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:29.550794] [INFO ] [MAIN ] MFG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:29.572785] [DEBUG] [LOCAL ] MFM: Loaded 14390 existing records from primary storage. [2025-09-26T22:24:29.573005] [INFO ] [MAIN ] MFM: Loaded 14390 primary data records. [2025-09-26T22:24:29.807726] [DEBUG] [LOCAL ] MFG: Loaded 49748 existing records from primary storage. [2025-09-26T22:24:29.840808] [INFO ] [MAIN ] MFG: Loaded 49748 primary data records. [2025-09-26T22:24:29.928337] [DEBUG] [LOCAL ] MFC: Loaded 52000 existing records from primary storage. [2025-09-26T22:24:30.049752] [INFO ] [MAIN ] MFC: Loaded 52000 primary data records. [2025-09-26T22:24:30.680761] [DEBUG] [MAIN ] MFM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:30.682414] [INFO ] [MAIN ] MFM: Generated 1820 derivative records from 14390 primary records. [2025-09-26T22:24:30.682734] [DEBUG] [LOCAL ] MFM: Saving derivative data. [2025-09-26T22:24:30.707889] [DEBUG] [LOCAL ] MFM: Derivative data saved (1820 records). [2025-09-26T22:24:30.708450] [INFO ] [MAIN ] MFM: Successfully saved derivative data. [2025-09-26T22:24:30.727785] [INFO ] [MAIN ] Derivative Progress: 1156/2074 symbols completed. MFM took 1.2s. Estimated remaining: 6m 23s. Rate: 143.7 symbols/min [2025-09-26T22:24:30.729051] [INFO ] [MAIN ] MFSG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:30.729500] [DEBUG] [MAIN ] MFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:30.731409] [INFO ] [MAIN ] MFG: Generated 1820 derivative records from 49748 primary records. [2025-09-26T22:24:30.731516] [DEBUG] [LOCAL ] MFG: Saving derivative data. [2025-09-26T22:24:30.759072] [DEBUG] [LOCAL ] MFSG: Loaded 5267 existing records from primary storage. [2025-09-26T22:24:30.760009] [INFO ] [MAIN ] MFSG: Loaded 5267 primary data records. [2025-09-26T22:24:30.795130] [DEBUG] [LOCAL ] MFG: Derivative data saved (1820 records). [2025-09-26T22:24:30.823620] [INFO ] [MAIN ] MFG: Successfully saved derivative data. [2025-09-26T22:24:30.863306] [INFO ] [MAIN ] Derivative Progress: 1157/2074 symbols completed. MFG took 1.3s. Estimated remaining: 6m 23s. Rate: 143.8 symbols/min [2025-09-26T22:24:30.888077] [INFO ] [MAIN ] MFSI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:30.933976] [DEBUG] [MAIN ] MFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:30.949972] [INFO ] [MAIN ] MFC: Generated 1820 derivative records from 52000 primary records. [2025-09-26T22:24:30.971183] [DEBUG] [LOCAL ] MFC: Saving derivative data. [2025-09-26T22:24:31.042501] [DEBUG] [LOCAL ] MFSI: Loaded 11358 existing records from primary storage. [2025-09-26T22:24:31.113445] [INFO ] [MAIN ] MFSI: Loaded 11358 primary data records. [2025-09-26T22:24:31.363856] [DEBUG] [LOCAL ] MFC: Derivative data saved (1820 records). [2025-09-26T22:24:31.368065] [INFO ] [MAIN ] MFC: Successfully saved derivative data. [2025-09-26T22:24:31.371298] [INFO ] [MAIN ] Derivative Progress: 1158/2074 symbols completed. MFC took 1.8s. Estimated remaining: 6m 22s. Rate: 143.7 symbols/min [2025-09-26T22:24:31.372195] [INFO ] [MAIN ] MFSV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:31.469186] [DEBUG] [LOCAL ] MFSV: Loaded 2514 existing records from primary storage. [2025-09-26T22:24:31.544786] [INFO ] [MAIN ] MFSV: Loaded 2514 primary data records. [2025-09-26T22:24:31.813789] [DEBUG] [MAIN ] MFSG: Filtered 7001 bins outside market hours, 7800 incomplete bins [2025-09-26T22:24:31.839336] [INFO ] [MAIN ] MFSG: Generated 1814 derivative records from 5267 primary records. [2025-09-26T22:24:31.858701] [DEBUG] [LOCAL ] MFSG: Saving derivative data. [2025-09-26T22:24:32.021786] [DEBUG] [LOCAL ] MFSG: Derivative data saved (1814 records). [2025-09-26T22:24:32.022285] [INFO ] [MAIN ] MFSG: Successfully saved derivative data. [2025-09-26T22:24:32.038217] [DEBUG] [MAIN ] MFSI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:32.039170] [INFO ] [MAIN ] MFSI: Generated 1820 derivative records from 11358 primary records. [2025-09-26T22:24:32.037782] [INFO ] [MAIN ] Derivative Progress: 1159/2074 symbols completed. MFSG took 1.3s. Estimated remaining: 6m 22s. Rate: 143.7 symbols/min [2025-09-26T22:24:32.039555] [INFO ] [MAIN ] MG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:32.041457] [DEBUG] [LOCAL ] MFSI: Saving derivative data. [2025-09-26T22:24:32.059800] [DEBUG] [LOCAL ] MFSI: Derivative data saved (1820 records). [2025-09-26T22:24:32.060009] [INFO ] [MAIN ] MFSI: Successfully saved derivative data. [2025-09-26T22:24:32.062638] [INFO ] [MAIN ] Derivative Progress: 1160/2074 symbols completed. MFSI took 1.2s. Estimated remaining: 6m 21s. Rate: 143.8 symbols/min [2025-09-26T22:24:32.068741] [INFO ] [MAIN ] MGA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:32.079614] [DEBUG] [LOCAL ] MG: Loaded 16832 existing records from primary storage. [2025-09-26T22:24:32.080014] [INFO ] [MAIN ] MG: Loaded 16832 primary data records. [2025-09-26T22:24:32.116715] [DEBUG] [MAIN ] MFSV: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:24:32.166478] [INFO ] [MAIN ] MFSV: Generated 1819 derivative records from 2514 primary records. [2025-09-26T22:24:32.187737] [DEBUG] [LOCAL ] MFSV: Saving derivative data. [2025-09-26T22:24:32.461573] [DEBUG] [LOCAL ] MFSV: Derivative data saved (1819 records). [2025-09-26T22:24:32.461852] [INFO ] [MAIN ] MFSV: Successfully saved derivative data. [2025-09-26T22:24:32.465127] [INFO ] [MAIN ] Derivative Progress: 1161/2074 symbols completed. MFSV took 1.1s. Estimated remaining: 6m 21s. Rate: 143.8 symbols/min [2025-09-26T22:24:32.465755] [INFO ] [MAIN ] MGF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:32.488221] [DEBUG] [LOCAL ] MGA: Loaded 51414 existing records from primary storage. [2025-09-26T22:24:32.491609] [DEBUG] [LOCAL ] MGF: Loaded 4186 existing records from primary storage. [2025-09-26T22:24:32.491938] [INFO ] [MAIN ] MGA: Loaded 51414 primary data records. [2025-09-26T22:24:32.492132] [INFO ] [MAIN ] MGF: Loaded 4186 primary data records. [2025-09-26T22:24:33.225709] [DEBUG] [MAIN ] MG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:33.228198] [INFO ] [MAIN ] MG: Generated 1820 derivative records from 16832 primary records. [2025-09-26T22:24:33.228817] [DEBUG] [LOCAL ] MG: Saving derivative data. [2025-09-26T22:24:33.251193] [DEBUG] [LOCAL ] MG: Derivative data saved (1820 records). [2025-09-26T22:24:33.251899] [INFO ] [MAIN ] MG: Successfully saved derivative data. [2025-09-26T22:24:33.254494] [INFO ] [MAIN ] Derivative Progress: 1162/2074 symbols completed. MG took 1.2s. Estimated remaining: 6m 21s. Rate: 143.7 symbols/min [2025-09-26T22:24:33.255240] [INFO ] [MAIN ] MGM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:33.292910] [DEBUG] [MAIN ] MGF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:33.295801] [INFO ] [MAIN ] MGF: Generated 1820 derivative records from 4186 primary records. [2025-09-26T22:24:33.294869] [DEBUG] [MAIN ] MGA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:33.295957] [DEBUG] [LOCAL ] MGF: Saving derivative data. [2025-09-26T22:24:33.296770] [INFO ] [MAIN ] MGA: Generated 1820 derivative records from 51414 primary records. [2025-09-26T22:24:33.303624] [DEBUG] [LOCAL ] MGA: Saving derivative data. [2025-09-26T22:24:33.350744] [DEBUG] [LOCAL ] MGF: Derivative data saved (1820 records). [2025-09-26T22:24:33.351387] [INFO ] [MAIN ] MGF: Successfully saved derivative data. [2025-09-26T22:24:33.357610] [INFO ] [MAIN ] Derivative Progress: 1163/2074 symbols completed. MGF took 0.9s. Estimated remaining: 6m 20s. Rate: 143.8 symbols/min [2025-09-26T22:24:33.357852] [DEBUG] [LOCAL ] MGA: Derivative data saved (1820 records). [2025-09-26T22:24:33.358311] [INFO ] [MAIN ] MGA: Successfully saved derivative data. [2025-09-26T22:24:33.361263] [INFO ] [MAIN ] Derivative Progress: 1164/2074 symbols completed. MGA took 1.3s. Estimated remaining: 6m 19s. Rate: 143.9 symbols/min [2025-09-26T22:24:33.358445] [INFO ] [MAIN ] MGR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:33.361843] [INFO ] [MAIN ] MGRB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:33.388130] [DEBUG] [LOCAL ] MGRB: Loaded 4102 existing records from primary storage. [2025-09-26T22:24:33.388443] [INFO ] [MAIN ] MGRB: Loaded 4102 primary data records. [2025-09-26T22:24:33.389595] [DEBUG] [LOCAL ] MGM: Loaded 54388 existing records from primary storage. [2025-09-26T22:24:33.412290] [INFO ] [MAIN ] MGM: Loaded 54388 primary data records. [2025-09-26T22:24:33.440458] [DEBUG] [LOCAL ] MGR: Loaded 5675 existing records from primary storage. [2025-09-26T22:24:33.503276] [INFO ] [MAIN ] MGR: Loaded 5675 primary data records. [2025-09-26T22:24:34.471033] [DEBUG] [MAIN ] MGRB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:34.473195] [INFO ] [MAIN ] MGRB: Generated 1820 derivative records from 4102 primary records. [2025-09-26T22:24:34.475292] [DEBUG] [LOCAL ] MGRB: Saving derivative data. [2025-09-26T22:24:34.520033] [DEBUG] [MAIN ] MGM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:34.520980] [DEBUG] [MAIN ] MGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:34.522915] [INFO ] [MAIN ] MGM: Generated 1820 derivative records from 54388 primary records. [2025-09-26T22:24:34.524773] [INFO ] [MAIN ] MGR: Generated 1820 derivative records from 5675 primary records. [2025-09-26T22:24:34.525731] [DEBUG] [LOCAL ] MGRB: Derivative data saved (1820 records). [2025-09-26T22:24:34.523290] [DEBUG] [LOCAL ] MGM: Saving derivative data. [2025-09-26T22:24:34.525956] [DEBUG] [LOCAL ] MGR: Saving derivative data. [2025-09-26T22:24:34.526121] [INFO ] [MAIN ] MGRB: Successfully saved derivative data. [2025-09-26T22:24:34.531274] [INFO ] [MAIN ] Derivative Progress: 1165/2074 symbols completed. MGRB took 1.2s. Estimated remaining: 6m 20s. Rate: 143.7 symbols/min [2025-09-26T22:24:34.545856] [INFO ] [MAIN ] MGRD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:34.564429] [DEBUG] [LOCAL ] MGRD: Loaded 2231 existing records from primary storage. [2025-09-26T22:24:34.566548] [INFO ] [MAIN ] MGRD: Loaded 2231 primary data records. [2025-09-26T22:24:34.579201] [DEBUG] [LOCAL ] MGR: Derivative data saved (1820 records). [2025-09-26T22:24:34.600353] [INFO ] [MAIN ] MGR: Successfully saved derivative data. [2025-09-26T22:24:34.606806] [DEBUG] [LOCAL ] MGM: Derivative data saved (1820 records). [2025-09-26T22:24:34.623492] [INFO ] [MAIN ] MGM: Successfully saved derivative data. [2025-09-26T22:24:34.618183] [INFO ] [MAIN ] Derivative Progress: 1166/2074 symbols completed. MGR took 1.3s. Estimated remaining: 6m 19s. Rate: 143.8 symbols/min [2025-09-26T22:24:34.657853] [INFO ] [MAIN ] Derivative Progress: 1167/2074 symbols completed. MGM took 1.4s. Estimated remaining: 6m 18s. Rate: 143.9 symbols/min [2025-09-26T22:24:34.657475] [INFO ] [MAIN ] MGRE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:34.675687] [INFO ] [MAIN ] MGY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:34.778987] [DEBUG] [LOCAL ] MGRE: Loaded 6684 existing records from primary storage. [2025-09-26T22:24:34.909466] [INFO ] [MAIN ] MGRE: Loaded 6684 primary data records. [2025-09-26T22:24:35.146736] [DEBUG] [LOCAL ] MGY: Loaded 53195 existing records from primary storage. [2025-09-26T22:24:35.189634] [INFO ] [MAIN ] MGY: Loaded 53195 primary data records. [2025-09-26T22:24:35.558347] [DEBUG] [MAIN ] MGRD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:35.586706] [INFO ] [MAIN ] MGRD: Generated 1820 derivative records from 2231 primary records. [2025-09-26T22:24:35.717925] [DEBUG] [LOCAL ] MGRD: Saving derivative data. [2025-09-26T22:24:35.754967] [DEBUG] [LOCAL ] MGRD: Derivative data saved (1820 records). [2025-09-26T22:24:35.755283] [INFO ] [MAIN ] MGRD: Successfully saved derivative data. [2025-09-26T22:24:35.755935] [DEBUG] [MAIN ] MGRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:35.758202] [INFO ] [MAIN ] Derivative Progress: 1168/2074 symbols completed. MGRD took 1.2s. Estimated remaining: 6m 18s. Rate: 143.7 symbols/min [2025-09-26T22:24:35.759618] [INFO ] [MAIN ] MGRE: Generated 1820 derivative records from 6684 primary records. [2025-09-26T22:24:35.760681] [DEBUG] [LOCAL ] MGRE: Saving derivative data. [2025-09-26T22:24:35.777923] [DEBUG] [LOCAL ] MGRE: Derivative data saved (1820 records). [2025-09-26T22:24:35.779828] [INFO ] [MAIN ] MGRE: Successfully saved derivative data. [2025-09-26T22:24:35.783443] [INFO ] [MAIN ] Derivative Progress: 1169/2074 symbols completed. MGRE took 1.1s. Estimated remaining: 6m 18s. Rate: 143.8 symbols/min [2025-09-26T22:24:35.796571] [DEBUG] [MAIN ] MGY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:35.797373] [INFO ] [MAIN ] MGY: Generated 1820 derivative records from 53195 primary records. [2025-09-26T22:24:35.797439] [DEBUG] [LOCAL ] MGY: Saving derivative data. [2025-09-26T22:24:35.814033] [DEBUG] [LOCAL ] MGY: Derivative data saved (1820 records). [2025-09-26T22:24:35.814121] [INFO ] [MAIN ] MGY: Successfully saved derivative data. [2025-09-26T22:24:35.816941] [INFO ] [MAIN ] Derivative Progress: 1170/2074 symbols completed. MGY took 1.1s. Estimated remaining: 6m 17s. Rate: 143.9 symbols/min [2025-09-26T22:24:35.817685] [INFO ] [MAIN ] MHK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:35.817861] [INFO ] [MAIN ] MHF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:35.817613] [INFO ] [MAIN ] MHD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:35.832490] [DEBUG] [LOCAL ] MHF: Loaded 8713 existing records from primary storage. [2025-09-26T22:24:35.832816] [INFO ] [MAIN ] MHF: Loaded 8713 primary data records. [2025-09-26T22:24:35.914546] [DEBUG] [LOCAL ] MHD: Loaded 12297 existing records from primary storage. [2025-09-26T22:24:35.933891] [INFO ] [MAIN ] MHD: Loaded 12297 primary data records. [2025-09-26T22:24:36.180861] [DEBUG] [LOCAL ] MHK: Loaded 43076 existing records from primary storage. [2025-09-26T22:24:36.305885] [INFO ] [MAIN ] MHK: Loaded 43076 primary data records. [2025-09-26T22:24:36.918933] [DEBUG] [MAIN ] MHF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:36.920954] [INFO ] [MAIN ] MHF: Generated 1820 derivative records from 8713 primary records. [2025-09-26T22:24:36.921566] [DEBUG] [LOCAL ] MHF: Saving derivative data. [2025-09-26T22:24:36.956125] [DEBUG] [MAIN ] MHD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:36.957896] [INFO ] [MAIN ] MHD: Generated 1820 derivative records from 12297 primary records. [2025-09-26T22:24:36.958282] [DEBUG] [LOCAL ] MHD: Saving derivative data. [2025-09-26T22:24:36.960039] [DEBUG] [LOCAL ] MHF: Derivative data saved (1820 records). [2025-09-26T22:24:36.972186] [INFO ] [MAIN ] MHF: Successfully saved derivative data. [2025-09-26T22:24:36.975478] [INFO ] [MAIN ] Derivative Progress: 1171/2074 symbols completed. MHF took 1.2s. Estimated remaining: 6m 17s. Rate: 143.7 symbols/min [2025-09-26T22:24:36.975809] [INFO ] [MAIN ] MHN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:36.998808] [DEBUG] [MAIN ] MHK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:36.999693] [DEBUG] [LOCAL ] MHD: Derivative data saved (1820 records). [2025-09-26T22:24:37.000689] [INFO ] [MAIN ] MHK: Generated 1820 derivative records from 43076 primary records. [2025-09-26T22:24:36.999927] [INFO ] [MAIN ] MHD: Successfully saved derivative data. [2025-09-26T22:24:37.000947] [DEBUG] [LOCAL ] MHK: Saving derivative data. [2025-09-26T22:24:37.003820] [INFO ] [MAIN ] Derivative Progress: 1172/2074 symbols completed. MHD took 1.2s. Estimated remaining: 6m 16s. Rate: 143.8 symbols/min [2025-09-26T22:24:37.016520] [DEBUG] [LOCAL ] MHN: Loaded 7867 existing records from primary storage. [2025-09-26T22:24:37.016266] [INFO ] [MAIN ] MHO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:37.020152] [INFO ] [MAIN ] MHN: Loaded 7867 primary data records. [2025-09-26T22:24:37.148344] [DEBUG] [LOCAL ] MHK: Derivative data saved (1820 records). [2025-09-26T22:24:37.159168] [INFO ] [MAIN ] MHK: Successfully saved derivative data. [2025-09-26T22:24:37.204198] [INFO ] [MAIN ] Derivative Progress: 1173/2074 symbols completed. MHK took 1.4s. Estimated remaining: 6m 16s. Rate: 143.9 symbols/min [2025-09-26T22:24:37.236594] [INFO ] [MAIN ] MIN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:37.406283] [DEBUG] [LOCAL ] MHO: Loaded 24650 existing records from primary storage. [2025-09-26T22:24:37.407243] [INFO ] [MAIN ] MHO: Loaded 24650 primary data records. [2025-09-26T22:24:37.534542] [DEBUG] [LOCAL ] MIN: Loaded 13224 existing records from primary storage. [2025-09-26T22:24:37.546547] [INFO ] [MAIN ] MIN: Loaded 13224 primary data records. [2025-09-26T22:24:38.183215] [DEBUG] [MAIN ] MHN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:38.184618] [INFO ] [MAIN ] MHN: Generated 1820 derivative records from 7867 primary records. [2025-09-26T22:24:38.184891] [DEBUG] [LOCAL ] MHN: Saving derivative data. [2025-09-26T22:24:38.206906] [DEBUG] [LOCAL ] MHN: Derivative data saved (1820 records). [2025-09-26T22:24:38.207376] [INFO ] [MAIN ] MHN: Successfully saved derivative data. [2025-09-26T22:24:38.209898] [INFO ] [MAIN ] Derivative Progress: 1174/2074 symbols completed. MHN took 1.2s. Estimated remaining: 6m 16s. Rate: 143.7 symbols/min [2025-09-26T22:24:38.210342] [INFO ] [MAIN ] MIR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:38.228320] [DEBUG] [MAIN ] MHO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:38.229106] [INFO ] [MAIN ] MHO: Generated 1820 derivative records from 24650 primary records. [2025-09-26T22:24:38.229393] [DEBUG] [LOCAL ] MHO: Saving derivative data. [2025-09-26T22:24:38.259822] [DEBUG] [MAIN ] MIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:38.261088] [INFO ] [MAIN ] MIN: Generated 1820 derivative records from 13224 primary records. [2025-09-26T22:24:38.261441] [DEBUG] [LOCAL ] MIN: Saving derivative data. [2025-09-26T22:24:38.276202] [DEBUG] [LOCAL ] MHO: Derivative data saved (1820 records). [2025-09-26T22:24:38.276840] [INFO ] [MAIN ] MHO: Successfully saved derivative data. [2025-09-26T22:24:38.280565] [INFO ] [MAIN ] Derivative Progress: 1175/2074 symbols completed. MHO took 1.3s. Estimated remaining: 6m 15s. Rate: 143.8 symbols/min [2025-09-26T22:24:38.281480] [INFO ] [MAIN ] MITP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:38.285038] [DEBUG] [LOCAL ] MIN: Derivative data saved (1820 records). [2025-09-26T22:24:38.285193] [INFO ] [MAIN ] MIN: Successfully saved derivative data. [2025-09-26T22:24:38.288121] [INFO ] [MAIN ] Derivative Progress: 1176/2074 symbols completed. MIN took 1.1s. Estimated remaining: 6m 14s. Rate: 143.9 symbols/min [2025-09-26T22:24:38.290776] [DEBUG] [LOCAL ] MITP: Loaded 2467 existing records from primary storage. [2025-09-26T22:24:38.291177] [INFO ] [MAIN ] MITP: Loaded 2467 primary data records. [2025-09-26T22:24:38.291039] [INFO ] [MAIN ] MITT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:38.448715] [DEBUG] [LOCAL ] MIR: Loaded 51622 existing records from primary storage. [2025-09-26T22:24:38.448956] [INFO ] [MAIN ] MIR: Loaded 51622 primary data records. [2025-09-26T22:24:38.546211] [DEBUG] [LOCAL ] MITT: Loaded 23379 existing records from primary storage. [2025-09-26T22:24:38.602173] [INFO ] [MAIN ] MITT: Loaded 23379 primary data records. [2025-09-26T22:24:39.353404] [DEBUG] [MAIN ] MITP: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-09-26T22:24:39.354629] [INFO ] [MAIN ] MITP: Generated 1818 derivative records from 2467 primary records. [2025-09-26T22:24:39.354900] [DEBUG] [LOCAL ] MITP: Saving derivative data. [2025-09-26T22:24:39.375499] [DEBUG] [LOCAL ] MITP: Derivative data saved (1818 records). [2025-09-26T22:24:39.388680] [INFO ] [MAIN ] MITP: Successfully saved derivative data. [2025-09-26T22:24:39.389686] [DEBUG] [MAIN ] MIR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:39.391890] [INFO ] [MAIN ] Derivative Progress: 1177/2074 symbols completed. MITP took 1.1s. Estimated remaining: 6m 14s. Rate: 143.7 symbols/min [2025-09-26T22:24:39.393924] [INFO ] [MAIN ] MIR: Generated 1820 derivative records from 51622 primary records. [2025-09-26T22:24:39.394987] [DEBUG] [LOCAL ] MIR: Saving derivative data. [2025-09-26T22:24:39.396043] [INFO ] [MAIN ] MIY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:39.422556] [DEBUG] [MAIN ] MITT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:39.426223] [INFO ] [MAIN ] MITT: Generated 1820 derivative records from 23379 primary records. [2025-09-26T22:24:39.427354] [DEBUG] [LOCAL ] MITT: Saving derivative data. [2025-09-26T22:24:39.433260] [DEBUG] [LOCAL ] MIY: Loaded 6084 existing records from primary storage. [2025-09-26T22:24:39.433387] [INFO ] [MAIN ] MIY: Loaded 6084 primary data records. [2025-09-26T22:24:39.439486] [DEBUG] [LOCAL ] MIR: Derivative data saved (1820 records). [2025-09-26T22:24:39.468107] [INFO ] [MAIN ] MIR: Successfully saved derivative data. [2025-09-26T22:24:39.476055] [INFO ] [MAIN ] Derivative Progress: 1178/2074 symbols completed. MIR took 1.3s. Estimated remaining: 6m 14s. Rate: 143.8 symbols/min [2025-09-26T22:24:39.509942] [INFO ] [MAIN ] MKC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:39.661672] [DEBUG] [LOCAL ] MITT: Derivative data saved (1820 records). [2025-09-26T22:24:39.703475] [INFO ] [MAIN ] MITT: Successfully saved derivative data. [2025-09-26T22:24:39.827970] [INFO ] [MAIN ] Derivative Progress: 1179/2074 symbols completed. MITT took 1.5s. Estimated remaining: 6m 13s. Rate: 143.8 symbols/min [2025-09-26T22:24:39.829300] [INFO ] [MAIN ] MKL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:39.889947] [DEBUG] [LOCAL ] MKC: Loaded 53204 existing records from primary storage. [2025-09-26T22:24:39.897753] [DEBUG] [MAIN ] MIY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:39.898897] [INFO ] [MAIN ] MIY: Generated 1820 derivative records from 6084 primary records. [2025-09-26T22:24:39.899007] [INFO ] [MAIN ] MKC: Loaded 53204 primary data records. [2025-09-26T22:24:39.899121] [DEBUG] [LOCAL ] MIY: Saving derivative data. [2025-09-26T22:24:40.027430] [DEBUG] [LOCAL ] MKL: Loaded 34588 existing records from primary storage. [2025-09-26T22:24:40.041027] [INFO ] [MAIN ] MKL: Loaded 34588 primary data records. [2025-09-26T22:24:40.063008] [DEBUG] [LOCAL ] MIY: Derivative data saved (1820 records). [2025-09-26T22:24:40.120759] [INFO ] [MAIN ] MIY: Successfully saved derivative data. [2025-09-26T22:24:40.189006] [INFO ] [MAIN ] Derivative Progress: 1180/2074 symbols completed. MIY took 0.8s. Estimated remaining: 6m 13s. Rate: 143.9 symbols/min [2025-09-26T22:24:40.327424] [INFO ] [MAIN ] MLI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:40.622380] [DEBUG] [MAIN ] MKC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:40.623263] [INFO ] [MAIN ] MKC: Generated 1820 derivative records from 53204 primary records. [2025-09-26T22:24:40.623456] [DEBUG] [LOCAL ] MKC: Saving derivative data. [2025-09-26T22:24:40.650494] [DEBUG] [LOCAL ] MLI: Loaded 44447 existing records from primary storage. [2025-09-26T22:24:40.651853] [INFO ] [MAIN ] MLI: Loaded 44447 primary data records. [2025-09-26T22:24:40.746073] [DEBUG] [LOCAL ] MKC: Derivative data saved (1820 records). [2025-09-26T22:24:40.756870] [DEBUG] [MAIN ] MKL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:40.768704] [INFO ] [MAIN ] MKC: Successfully saved derivative data. [2025-09-26T22:24:40.783393] [INFO ] [MAIN ] Derivative Progress: 1181/2074 symbols completed. MKC took 1.3s. Estimated remaining: 6m 13s. Rate: 143.8 symbols/min [2025-09-26T22:24:40.780999] [INFO ] [MAIN ] MKL: Generated 1820 derivative records from 34588 primary records. [2025-09-26T22:24:40.783750] [INFO ] [MAIN ] MLM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:40.783887] [DEBUG] [LOCAL ] MKL: Saving derivative data. [2025-09-26T22:24:41.008301] [DEBUG] [LOCAL ] MKL: Derivative data saved (1820 records). [2025-09-26T22:24:41.009309] [INFO ] [MAIN ] MKL: Successfully saved derivative data. [2025-09-26T22:24:41.012518] [INFO ] [MAIN ] Derivative Progress: 1182/2074 symbols completed. MKL took 1.2s. Estimated remaining: 6m 12s. Rate: 143.9 symbols/min [2025-09-26T22:24:41.013288] [INFO ] [MAIN ] MLNK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:41.038863] [DEBUG] [LOCAL ] MLM: Loaded 31068 existing records from primary storage. [2025-09-26T22:24:41.039339] [INFO ] [MAIN ] MLM: Loaded 31068 primary data records. [2025-09-26T22:24:41.168132] [DEBUG] [LOCAL ] MLNK: Loaded 25921 existing records from primary storage. [2025-09-26T22:24:41.180112] [INFO ] [MAIN ] MLNK: Loaded 25921 primary data records. [2025-09-26T22:24:41.201523] [DEBUG] [MAIN ] MLI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:41.224952] [INFO ] [MAIN ] MLI: Generated 1820 derivative records from 44447 primary records. [2025-09-26T22:24:41.248502] [DEBUG] [LOCAL ] MLI: Saving derivative data. [2025-09-26T22:24:41.699632] [DEBUG] [LOCAL ] MLI: Derivative data saved (1820 records). [2025-09-26T22:24:41.778014] [INFO ] [MAIN ] MLI: Successfully saved derivative data. [2025-09-26T22:24:41.794115] [INFO ] [MAIN ] Derivative Progress: 1183/2074 symbols completed. MLI took 1.6s. Estimated remaining: 6m 12s. Rate: 143.8 symbols/min [2025-09-26T22:24:41.825733] [DEBUG] [MAIN ] MLM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:41.827615] [INFO ] [MAIN ] MLM: Generated 1820 derivative records from 31068 primary records. [2025-09-26T22:24:41.827846] [DEBUG] [LOCAL ] MLM: Saving derivative data. [2025-09-26T22:24:41.858515] [DEBUG] [MAIN ] MLNK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:41.860352] [INFO ] [MAIN ] MLNK: Generated 1820 derivative records from 25921 primary records. [2025-09-26T22:24:41.860705] [DEBUG] [LOCAL ] MLNK: Saving derivative data. [2025-09-26T22:24:41.870423] [DEBUG] [LOCAL ] MLM: Derivative data saved (1820 records). [2025-09-26T22:24:41.875066] [INFO ] [MAIN ] MLM: Successfully saved derivative data. [2025-09-26T22:24:41.879113] [INFO ] [MAIN ] Derivative Progress: 1184/2074 symbols completed. MLM took 1.1s. Estimated remaining: 6m 11s. Rate: 143.8 symbols/min [2025-09-26T22:24:41.882786] [DEBUG] [LOCAL ] MLNK: Derivative data saved (1820 records). [2025-09-26T22:24:41.882894] [INFO ] [MAIN ] MLNK: Successfully saved derivative data. [2025-09-26T22:24:41.885901] [INFO ] [MAIN ] Derivative Progress: 1185/2074 symbols completed. MLNK took 0.9s. Estimated remaining: 6m 10s. Rate: 144.0 symbols/min [2025-09-26T22:24:41.886910] [INFO ] [MAIN ] MMC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:41.886696] [INFO ] [MAIN ] MLP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:41.886615] [INFO ] [MAIN ] MLR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:41.893858] [DEBUG] [LOCAL ] MLP: Loaded 3120 existing records from primary storage. [2025-09-26T22:24:41.894156] [INFO ] [MAIN ] MLP: Loaded 3120 primary data records. [2025-09-26T22:24:41.993676] [DEBUG] [LOCAL ] MLR: Loaded 12982 existing records from primary storage. [2025-09-26T22:24:42.008911] [INFO ] [MAIN ] MLR: Loaded 12982 primary data records. [2025-09-26T22:24:42.588193] [DEBUG] [LOCAL ] MMC: Loaded 52551 existing records from primary storage. [2025-09-26T22:24:42.589719] [INFO ] [MAIN ] MMC: Loaded 52551 primary data records. [2025-09-26T22:24:42.812077] [DEBUG] [MAIN ] MLP: Filtered 7001 bins outside market hours, 7797 incomplete bins [2025-09-26T22:24:42.819977] [INFO ] [MAIN ] MLP: Generated 1817 derivative records from 3120 primary records. [2025-09-26T22:24:42.925050] [DEBUG] [LOCAL ] MLP: Saving derivative data. [2025-09-26T22:24:42.981071] [DEBUG] [LOCAL ] MLP: Derivative data saved (1817 records). [2025-09-26T22:24:42.981248] [INFO ] [MAIN ] MLP: Successfully saved derivative data. [2025-09-26T22:24:42.980467] [DEBUG] [MAIN ] MLR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:42.983924] [INFO ] [MAIN ] Derivative Progress: 1186/2074 symbols completed. MLP took 1.1s. Estimated remaining: 6m 11s. Rate: 143.8 symbols/min [2025-09-26T22:24:42.985225] [INFO ] [MAIN ] MMD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:42.984776] [INFO ] [MAIN ] MLR: Generated 1820 derivative records from 12982 primary records. [2025-09-26T22:24:42.985806] [DEBUG] [LOCAL ] MLR: Saving derivative data. [2025-09-26T22:24:43.011240] [DEBUG] [LOCAL ] MLR: Derivative data saved (1820 records). [2025-09-26T22:24:43.016846] [INFO ] [MAIN ] MLR: Successfully saved derivative data. [2025-09-26T22:24:43.017200] [DEBUG] [LOCAL ] MMD: Loaded 11435 existing records from primary storage. [2025-09-26T22:24:43.021423] [INFO ] [MAIN ] MMD: Loaded 11435 primary data records. [2025-09-26T22:24:43.020191] [INFO ] [MAIN ] Derivative Progress: 1187/2074 symbols completed. MLR took 1.1s. Estimated remaining: 6m 10s. Rate: 143.9 symbols/min [2025-09-26T22:24:43.033571] [INFO ] [MAIN ] MMI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:43.128788] [DEBUG] [MAIN ] MMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:43.136330] [INFO ] [MAIN ] MMC: Generated 1820 derivative records from 52551 primary records. [2025-09-26T22:24:43.136582] [DEBUG] [LOCAL ] MMC: Saving derivative data. [2025-09-26T22:24:43.214378] [DEBUG] [LOCAL ] MMI: Loaded 15452 existing records from primary storage. [2025-09-26T22:24:43.238774] [INFO ] [MAIN ] MMI: Loaded 15452 primary data records. [2025-09-26T22:24:43.434038] [DEBUG] [LOCAL ] MMC: Derivative data saved (1820 records). [2025-09-26T22:24:43.448594] [INFO ] [MAIN ] MMC: Successfully saved derivative data. [2025-09-26T22:24:43.465681] [INFO ] [MAIN ] Derivative Progress: 1188/2074 symbols completed. MMC took 1.6s. Estimated remaining: 6m 9s. Rate: 143.9 symbols/min [2025-09-26T22:24:43.490310] [INFO ] [MAIN ] MMM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:43.820145] [DEBUG] [MAIN ] MMD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:43.820962] [INFO ] [MAIN ] MMD: Generated 1820 derivative records from 11435 primary records. [2025-09-26T22:24:43.821336] [DEBUG] [LOCAL ] MMD: Saving derivative data. [2025-09-26T22:24:43.858194] [DEBUG] [LOCAL ] MMM: Loaded 53995 existing records from primary storage. [2025-09-26T22:24:43.866563] [INFO ] [MAIN ] MMM: Loaded 53995 primary data records. [2025-09-26T22:24:43.872195] [DEBUG] [LOCAL ] MMD: Derivative data saved (1820 records). [2025-09-26T22:24:43.872686] [INFO ] [MAIN ] MMD: Successfully saved derivative data. [2025-09-26T22:24:43.873137] [DEBUG] [MAIN ] MMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:43.875612] [INFO ] [MAIN ] Derivative Progress: 1189/2074 symbols completed. MMD took 0.9s. Estimated remaining: 6m 9s. Rate: 143.9 symbols/min [2025-09-26T22:24:43.887537] [INFO ] [MAIN ] MMS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:43.909801] [INFO ] [MAIN ] MMI: Generated 1820 derivative records from 15452 primary records. [2025-09-26T22:24:43.938682] [DEBUG] [LOCAL ] MMI: Saving derivative data. [2025-09-26T22:24:44.211177] [DEBUG] [LOCAL ] MMI: Derivative data saved (1820 records). [2025-09-26T22:24:44.219318] [INFO ] [MAIN ] MMI: Successfully saved derivative data. [2025-09-26T22:24:44.222096] [INFO ] [MAIN ] Derivative Progress: 1190/2074 symbols completed. MMI took 1.2s. Estimated remaining: 6m 9s. Rate: 143.9 symbols/min [2025-09-26T22:24:44.222494] [INFO ] [MAIN ] MMT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:44.237747] [DEBUG] [LOCAL ] MMS: Loaded 34398 existing records from primary storage. [2025-09-26T22:24:44.241041] [INFO ] [MAIN ] MMS: Loaded 34398 primary data records. [2025-09-26T22:24:44.335128] [DEBUG] [LOCAL ] MMT: Loaded 10987 existing records from primary storage. [2025-09-26T22:24:44.356043] [INFO ] [MAIN ] MMT: Loaded 10987 primary data records. [2025-09-26T22:24:44.725679] [DEBUG] [MAIN ] MMM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:44.760714] [INFO ] [MAIN ] MMM: Generated 1820 derivative records from 53995 primary records. [2025-09-26T22:24:44.792697] [DEBUG] [LOCAL ] MMM: Saving derivative data. [2025-09-26T22:24:44.945707] [DEBUG] [LOCAL ] MMM: Derivative data saved (1820 records). [2025-09-26T22:24:44.946671] [INFO ] [MAIN ] MMM: Successfully saved derivative data. [2025-09-26T22:24:44.950183] [INFO ] [MAIN ] Derivative Progress: 1191/2074 symbols completed. MMM took 1.5s. Estimated remaining: 6m 8s. Rate: 143.8 symbols/min [2025-09-26T22:24:44.953537] [INFO ] [MAIN ] MMU: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:44.971951] [DEBUG] [MAIN ] MMS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:44.972760] [INFO ] [MAIN ] MMS: Generated 1820 derivative records from 34398 primary records. [2025-09-26T22:24:44.973010] [DEBUG] [LOCAL ] MMS: Saving derivative data. [2025-09-26T22:24:45.018736] [DEBUG] [MAIN ] MMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:45.018124] [DEBUG] [LOCAL ] MMU: Loaded 17156 existing records from primary storage. [2025-09-26T22:24:45.020845] [INFO ] [MAIN ] MMU: Loaded 17156 primary data records. [2025-09-26T22:24:45.020768] [INFO ] [MAIN ] MMT: Generated 1820 derivative records from 10987 primary records. [2025-09-26T22:24:45.020975] [DEBUG] [LOCAL ] MMT: Saving derivative data. [2025-09-26T22:24:45.019914] [DEBUG] [LOCAL ] MMS: Derivative data saved (1820 records). [2025-09-26T22:24:45.026927] [INFO ] [MAIN ] MMS: Successfully saved derivative data. [2025-09-26T22:24:45.029848] [INFO ] [MAIN ] Derivative Progress: 1192/2074 symbols completed. MMS took 1.1s. Estimated remaining: 6m 8s. Rate: 143.9 symbols/min [2025-09-26T22:24:45.067303] [INFO ] [MAIN ] MNR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:45.179410] [DEBUG] [LOCAL ] MMT: Derivative data saved (1820 records). [2025-09-26T22:24:45.234454] [INFO ] [MAIN ] MMT: Successfully saved derivative data. [2025-09-26T22:24:45.354803] [INFO ] [MAIN ] Derivative Progress: 1193/2074 symbols completed. MMT took 1.1s. Estimated remaining: 6m 7s. Rate: 143.9 symbols/min [2025-09-26T22:24:45.365064] [INFO ] [MAIN ] MNSO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:45.376714] [DEBUG] [LOCAL ] MNR: Loaded 24918 existing records from primary storage. [2025-09-26T22:24:45.377701] [INFO ] [MAIN ] MNR: Loaded 24918 primary data records. [2025-09-26T22:24:45.788174] [DEBUG] [LOCAL ] MNSO: Loaded 45049 existing records from primary storage. [2025-09-26T22:24:45.788638] [INFO ] [MAIN ] MNSO: Loaded 45049 primary data records. [2025-09-26T22:24:45.942759] [DEBUG] [MAIN ] MMU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:45.987338] [INFO ] [MAIN ] MMU: Generated 1820 derivative records from 17156 primary records. [2025-09-26T22:24:46.017711] [DEBUG] [LOCAL ] MMU: Saving derivative data. [2025-09-26T22:24:46.181984] [DEBUG] [LOCAL ] MMU: Derivative data saved (1820 records). [2025-09-26T22:24:46.182319] [DEBUG] [MAIN ] MNR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:46.182494] [INFO ] [MAIN ] MMU: Successfully saved derivative data. [2025-09-26T22:24:46.183302] [INFO ] [MAIN ] MNR: Generated 1820 derivative records from 24918 primary records. [2025-09-26T22:24:46.185940] [INFO ] [MAIN ] Derivative Progress: 1194/2074 symbols completed. MMU took 1.2s. Estimated remaining: 6m 7s. Rate: 143.8 symbols/min [2025-09-26T22:24:46.186151] [DEBUG] [LOCAL ] MNR: Saving derivative data. [2025-09-26T22:24:46.187467] [INFO ] [MAIN ] MOD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:46.207671] [DEBUG] [LOCAL ] MNR: Derivative data saved (1820 records). [2025-09-26T22:24:46.208020] [INFO ] [MAIN ] MNR: Successfully saved derivative data. [2025-09-26T22:24:46.210804] [INFO ] [MAIN ] Derivative Progress: 1195/2074 symbols completed. MNR took 1.2s. Estimated remaining: 6m 6s. Rate: 143.9 symbols/min [2025-09-26T22:24:46.211237] [INFO ] [MAIN ] MODG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:46.230210] [DEBUG] [MAIN ] MNSO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:46.231479] [INFO ] [MAIN ] MNSO: Generated 1820 derivative records from 45049 primary records. [2025-09-26T22:24:46.231687] [DEBUG] [LOCAL ] MNSO: Saving derivative data. [2025-09-26T22:24:46.276608] [DEBUG] [LOCAL ] MNSO: Derivative data saved (1820 records). [2025-09-26T22:24:46.276876] [INFO ] [MAIN ] MNSO: Successfully saved derivative data. [2025-09-26T22:24:46.279608] [INFO ] [MAIN ] Derivative Progress: 1196/2074 symbols completed. MNSO took 0.9s. Estimated remaining: 6m 6s. Rate: 144.0 symbols/min [2025-09-26T22:24:46.280136] [INFO ] [MAIN ] MOH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:46.315769] [DEBUG] [LOCAL ] MODG: Loaded 52353 existing records from primary storage. [2025-09-26T22:24:46.314789] [DEBUG] [LOCAL ] MOD: Loaded 46169 existing records from primary storage. [2025-09-26T22:24:46.315983] [INFO ] [MAIN ] MODG: Loaded 52353 primary data records. [2025-09-26T22:24:46.316060] [INFO ] [MAIN ] MOD: Loaded 46169 primary data records. [2025-09-26T22:24:46.644157] [DEBUG] [LOCAL ] MOH: Loaded 42444 existing records from primary storage. [2025-09-26T22:24:46.668317] [INFO ] [MAIN ] MOH: Loaded 42444 primary data records. [2025-09-26T22:24:47.410824] [DEBUG] [MAIN ] MODG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:47.411241] [DEBUG] [MAIN ] MOD: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:24:47.412498] [INFO ] [MAIN ] MODG: Generated 1820 derivative records from 52353 primary records. [2025-09-26T22:24:47.414046] [INFO ] [MAIN ] MOD: Generated 1819 derivative records from 46169 primary records. [2025-09-26T22:24:47.413190] [DEBUG] [LOCAL ] MODG: Saving derivative data. [2025-09-26T22:24:47.414393] [DEBUG] [LOCAL ] MOD: Saving derivative data. [2025-09-26T22:24:47.453056] [DEBUG] [LOCAL ] MODG: Derivative data saved (1820 records). [2025-09-26T22:24:47.453306] [INFO ] [MAIN ] MODG: Successfully saved derivative data. [2025-09-26T22:24:47.469036] [INFO ] [MAIN ] Derivative Progress: 1197/2074 symbols completed. MODG took 1.3s. Estimated remaining: 6m 6s. Rate: 143.8 symbols/min [2025-09-26T22:24:47.470475] [INFO ] [MAIN ] MOS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:47.470215] [DEBUG] [MAIN ] MOH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:47.471345] [DEBUG] [LOCAL ] MOD: Derivative data saved (1819 records). [2025-09-26T22:24:47.472440] [INFO ] [MAIN ] MOH: Generated 1820 derivative records from 42444 primary records. [2025-09-26T22:24:47.472836] [INFO ] [MAIN ] MOD: Successfully saved derivative data. [2025-09-26T22:24:47.475833] [INFO ] [MAIN ] Derivative Progress: 1198/2074 symbols completed. MOD took 1.3s. Estimated remaining: 6m 5s. Rate: 143.9 symbols/min [2025-09-26T22:24:47.472747] [DEBUG] [LOCAL ] MOH: Saving derivative data. [2025-09-26T22:24:47.493312] [DEBUG] [LOCAL ] MOH: Derivative data saved (1820 records). [2025-09-26T22:24:47.493454] [INFO ] [MAIN ] MOH: Successfully saved derivative data. [2025-09-26T22:24:47.496815] [INFO ] [MAIN ] Derivative Progress: 1199/2074 symbols completed. MOH took 1.2s. Estimated remaining: 6m 4s. Rate: 144.0 symbols/min [2025-09-26T22:24:47.542466] [DEBUG] [LOCAL ] MOS: Loaded 54284 existing records from primary storage. [2025-09-26T22:24:47.542664] [INFO ] [MAIN ] MOS: Loaded 54284 primary data records. [2025-09-26T22:24:47.873721] [DEBUG] [MAIN ] MOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:47.874577] [INFO ] [MAIN ] MOS: Generated 1820 derivative records from 54284 primary records. [2025-09-26T22:24:47.874670] [DEBUG] [LOCAL ] MOS: Saving derivative data. [2025-09-26T22:24:47.891309] [DEBUG] [LOCAL ] MOS: Derivative data saved (1820 records). [2025-09-26T22:24:47.891392] [INFO ] [MAIN ] MOS: Successfully saved derivative data. [2025-09-26T22:24:47.895202] [INFO ] [MAIN ] Derivative Progress: 1200/2074 symbols completed. MOS took 0.4s. Estimated remaining: 6m 4s. Rate: 144.0 symbols/min [2025-09-26T22:24:47.896638] [INFO ] [MAIN ] MOV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:47.896193] [INFO ] [MAIN ] MPA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:47.896363] [INFO ] [MAIN ] MP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:47.906241] [DEBUG] [LOCAL ] MPA: Loaded 5268 existing records from primary storage. [2025-09-26T22:24:47.906416] [INFO ] [MAIN ] MPA: Loaded 5268 primary data records. [2025-09-26T22:24:48.043806] [DEBUG] [LOCAL ] MOV: Loaded 22417 existing records from primary storage. [2025-09-26T22:24:48.044525] [INFO ] [MAIN ] MOV: Loaded 22417 primary data records. [2025-09-26T22:24:48.477330] [DEBUG] [LOCAL ] MP: Loaded 54444 existing records from primary storage. [2025-09-26T22:24:48.494836] [INFO ] [MAIN ] MP: Loaded 54444 primary data records. [2025-09-26T22:24:49.065672] [DEBUG] [MAIN ] MPA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:49.067531] [INFO ] [MAIN ] MPA: Generated 1820 derivative records from 5268 primary records. [2025-09-26T22:24:49.068056] [DEBUG] [LOCAL ] MPA: Saving derivative data. [2025-09-26T22:24:49.108087] [DEBUG] [LOCAL ] MPA: Derivative data saved (1820 records). [2025-09-26T22:24:49.109135] [INFO ] [MAIN ] MPA: Successfully saved derivative data. [2025-09-26T22:24:49.109007] [DEBUG] [MAIN ] MOV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:49.112550] [INFO ] [MAIN ] Derivative Progress: 1201/2074 symbols completed. MPA took 1.2s. Estimated remaining: 6m 4s. Rate: 143.8 symbols/min [2025-09-26T22:24:49.113331] [INFO ] [MAIN ] MPC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:49.114336] [INFO ] [MAIN ] MOV: Generated 1820 derivative records from 22417 primary records. [2025-09-26T22:24:49.115495] [DEBUG] [LOCAL ] MOV: Saving derivative data. [2025-09-26T22:24:49.148620] [DEBUG] [MAIN ] MP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:49.150350] [INFO ] [MAIN ] MP: Generated 1820 derivative records from 54444 primary records. [2025-09-26T22:24:49.151243] [DEBUG] [LOCAL ] MP: Saving derivative data. [2025-09-26T22:24:49.164292] [DEBUG] [LOCAL ] MOV: Derivative data saved (1820 records). [2025-09-26T22:24:49.167429] [INFO ] [MAIN ] MOV: Successfully saved derivative data. [2025-09-26T22:24:49.170339] [INFO ] [MAIN ] Derivative Progress: 1202/2074 symbols completed. MOV took 1.3s. Estimated remaining: 6m 4s. Rate: 143.9 symbols/min [2025-09-26T22:24:49.171626] [INFO ] [MAIN ] MPLX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:49.176852] [DEBUG] [LOCAL ] MP: Derivative data saved (1820 records). [2025-09-26T22:24:49.176964] [INFO ] [MAIN ] MP: Successfully saved derivative data. [2025-09-26T22:24:49.179816] [INFO ] [MAIN ] Derivative Progress: 1203/2074 symbols completed. MP took 1.3s. Estimated remaining: 6m 3s. Rate: 144.0 symbols/min [2025-09-26T22:24:49.180200] [INFO ] [MAIN ] MPV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:49.204259] [DEBUG] [LOCAL ] MPV: Loaded 5098 existing records from primary storage. [2025-09-26T22:24:49.204636] [INFO ] [MAIN ] MPV: Loaded 5098 primary data records. [2025-09-26T22:24:49.355917] [DEBUG] [LOCAL ] MPC: Loaded 52889 existing records from primary storage. [2025-09-26T22:24:49.362449] [INFO ] [MAIN ] MPC: Loaded 52889 primary data records. [2025-09-26T22:24:49.678917] [DEBUG] [LOCAL ] MPLX: Loaded 51491 existing records from primary storage. [2025-09-26T22:24:49.706924] [INFO ] [MAIN ] MPLX: Loaded 51491 primary data records. [2025-09-26T22:24:50.349049] [DEBUG] [MAIN ] MPV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:50.350356] [INFO ] [MAIN ] MPV: Generated 1820 derivative records from 5098 primary records. [2025-09-26T22:24:50.350771] [DEBUG] [LOCAL ] MPV: Saving derivative data. [2025-09-26T22:24:50.385740] [DEBUG] [MAIN ] MPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:50.388060] [INFO ] [MAIN ] MPC: Generated 1820 derivative records from 52889 primary records. [2025-09-26T22:24:50.389105] [DEBUG] [LOCAL ] MPV: Derivative data saved (1820 records). [2025-09-26T22:24:50.389343] [INFO ] [MAIN ] MPV: Successfully saved derivative data. [2025-09-26T22:24:50.389022] [DEBUG] [LOCAL ] MPC: Saving derivative data. [2025-09-26T22:24:50.391696] [INFO ] [MAIN ] Derivative Progress: 1204/2074 symbols completed. MPV took 1.2s. Estimated remaining: 6m 3s. Rate: 143.8 symbols/min [2025-09-26T22:24:50.393140] [INFO ] [MAIN ] MPW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:50.425870] [DEBUG] [MAIN ] MPLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:50.427336] [INFO ] [MAIN ] MPLX: Generated 1820 derivative records from 51491 primary records. [2025-09-26T22:24:50.428322] [DEBUG] [LOCAL ] MPLX: Saving derivative data. [2025-09-26T22:24:50.430027] [DEBUG] [LOCAL ] MPC: Derivative data saved (1820 records). [2025-09-26T22:24:50.441671] [INFO ] [MAIN ] MPC: Successfully saved derivative data. [2025-09-26T22:24:50.444392] [INFO ] [MAIN ] Derivative Progress: 1205/2074 symbols completed. MPC took 1.3s. Estimated remaining: 6m 2s. Rate: 143.9 symbols/min [2025-09-26T22:24:50.445336] [INFO ] [MAIN ] MPX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:50.452097] [DEBUG] [LOCAL ] MPLX: Derivative data saved (1820 records). [2025-09-26T22:24:50.452245] [INFO ] [MAIN ] MPLX: Successfully saved derivative data. [2025-09-26T22:24:50.455182] [INFO ] [MAIN ] Derivative Progress: 1206/2074 symbols completed. MPLX took 1.3s. Estimated remaining: 6m 2s. Rate: 144.0 symbols/min [2025-09-26T22:24:50.458325] [DEBUG] [LOCAL ] MPX: Loaded 4213 existing records from primary storage. [2025-09-26T22:24:50.458819] [INFO ] [MAIN ] MPX: Loaded 4213 primary data records. [2025-09-26T22:24:50.458889] [INFO ] [MAIN ] MQT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:50.587529] [DEBUG] [LOCAL ] MQT: Loaded 8523 existing records from primary storage. [2025-09-26T22:24:50.626264] [INFO ] [MAIN ] MQT: Loaded 8523 primary data records. [2025-09-26T22:24:50.689969] [DEBUG] [LOCAL ] MPW: Loaded 54275 existing records from primary storage. [2025-09-26T22:24:50.734862] [INFO ] [MAIN ] MPW: Loaded 54275 primary data records. [2025-09-26T22:24:51.561390] [DEBUG] [MAIN ] MPX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:51.562500] [INFO ] [MAIN ] MPX: Generated 1820 derivative records from 4213 primary records. [2025-09-26T22:24:51.562886] [DEBUG] [LOCAL ] MPX: Saving derivative data. [2025-09-26T22:24:51.598773] [DEBUG] [MAIN ] MQT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:51.601023] [INFO ] [MAIN ] MQT: Generated 1820 derivative records from 8523 primary records. [2025-09-26T22:24:51.602277] [DEBUG] [LOCAL ] MQT: Saving derivative data. [2025-09-26T22:24:51.603006] [DEBUG] [LOCAL ] MPX: Derivative data saved (1820 records). [2025-09-26T22:24:51.604346] [INFO ] [MAIN ] MPX: Successfully saved derivative data. [2025-09-26T22:24:51.606986] [INFO ] [MAIN ] Derivative Progress: 1207/2074 symbols completed. MPX took 1.2s. Estimated remaining: 6m 2s. Rate: 143.8 symbols/min [2025-09-26T22:24:51.614263] [INFO ] [MAIN ] MQY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:51.646409] [DEBUG] [MAIN ] MPW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:51.647456] [DEBUG] [LOCAL ] MQT: Derivative data saved (1820 records). [2025-09-26T22:24:51.647905] [INFO ] [MAIN ] MQT: Successfully saved derivative data. [2025-09-26T22:24:51.652033] [INFO ] [MAIN ] MPW: Generated 1820 derivative records from 54275 primary records. [2025-09-26T22:24:51.651084] [INFO ] [MAIN ] Derivative Progress: 1208/2074 symbols completed. MQT took 1.2s. Estimated remaining: 6m 1s. Rate: 143.9 symbols/min [2025-09-26T22:24:51.652464] [DEBUG] [LOCAL ] MPW: Saving derivative data. [2025-09-26T22:24:51.653041] [INFO ] [MAIN ] MRC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:51.680032] [DEBUG] [LOCAL ] MQY: Loaded 16979 existing records from primary storage. [2025-09-26T22:24:51.681181] [INFO ] [MAIN ] MQY: Loaded 16979 primary data records. [2025-09-26T22:24:51.760446] [DEBUG] [LOCAL ] MPW: Derivative data saved (1820 records). [2025-09-26T22:24:51.806322] [INFO ] [MAIN ] MPW: Successfully saved derivative data. [2025-09-26T22:24:51.829875] [INFO ] [MAIN ] Derivative Progress: 1209/2074 symbols completed. MPW took 1.4s. Estimated remaining: 6m 0s. Rate: 144.0 symbols/min [2025-09-26T22:24:51.846912] [INFO ] [MAIN ] MRK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:51.866319] [DEBUG] [LOCAL ] MRC: Loaded 38128 existing records from primary storage. [2025-09-26T22:24:51.867165] [INFO ] [MAIN ] MRC: Loaded 38128 primary data records. [2025-09-26T22:24:52.492843] [DEBUG] [LOCAL ] MRK: Loaded 54569 existing records from primary storage. [2025-09-26T22:24:52.493103] [INFO ] [MAIN ] MRK: Loaded 54569 primary data records. [2025-09-26T22:24:52.549114] [DEBUG] [MAIN ] MQY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:52.566588] [INFO ] [MAIN ] MQY: Generated 1820 derivative records from 16979 primary records. [2025-09-26T22:24:52.572464] [DEBUG] [LOCAL ] MQY: Saving derivative data. [2025-09-26T22:24:52.706038] [DEBUG] [MAIN ] MRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:52.718115] [INFO ] [MAIN ] MRC: Generated 1820 derivative records from 38128 primary records. [2025-09-26T22:24:52.738584] [DEBUG] [LOCAL ] MRC: Saving derivative data. [2025-09-26T22:24:52.750028] [DEBUG] [LOCAL ] MQY: Derivative data saved (1820 records). [2025-09-26T22:24:52.785621] [INFO ] [MAIN ] MQY: Successfully saved derivative data. [2025-09-26T22:24:52.910228] [INFO ] [MAIN ] Derivative Progress: 1210/2074 symbols completed. MQY took 1.3s. Estimated remaining: 6m 1s. Rate: 143.8 symbols/min [2025-09-26T22:24:52.920622] [INFO ] [MAIN ] MS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:52.926777] [DEBUG] [LOCAL ] MRC: Derivative data saved (1820 records). [2025-09-26T22:24:52.927196] [INFO ] [MAIN ] MRC: Successfully saved derivative data. [2025-09-26T22:24:52.930172] [INFO ] [MAIN ] Derivative Progress: 1211/2074 symbols completed. MRC took 1.3s. Estimated remaining: 5m 60s. Rate: 143.9 symbols/min [2025-09-26T22:24:52.930691] [INFO ] [MAIN ] MSA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:52.961083] [DEBUG] [LOCAL ] MSA: Loaded 18988 existing records from primary storage. [2025-09-26T22:24:52.961516] [INFO ] [MAIN ] MSA: Loaded 18988 primary data records. [2025-09-26T22:24:52.995134] [DEBUG] [MAIN ] MRK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:53.003252] [INFO ] [MAIN ] MRK: Generated 1820 derivative records from 54569 primary records. [2025-09-26T22:24:53.025387] [DEBUG] [LOCAL ] MRK: Saving derivative data. [2025-09-26T22:24:53.120332] [DEBUG] [LOCAL ] MS: Loaded 54472 existing records from primary storage. [2025-09-26T22:24:53.136615] [INFO ] [MAIN ] MS: Loaded 54472 primary data records. [2025-09-26T22:24:53.286139] [DEBUG] [LOCAL ] MRK: Derivative data saved (1820 records). [2025-09-26T22:24:53.403249] [INFO ] [MAIN ] MRK: Successfully saved derivative data. [2025-09-26T22:24:53.439504] [INFO ] [MAIN ] Derivative Progress: 1212/2074 symbols completed. MRK took 1.6s. Estimated remaining: 5m 59s. Rate: 143.9 symbols/min [2025-09-26T22:24:53.453297] [INFO ] [MAIN ] MSB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:53.690347] [DEBUG] [LOCAL ] MSB: Loaded 7895 existing records from primary storage. [2025-09-26T22:24:53.690628] [INFO ] [MAIN ] MSB: Loaded 7895 primary data records. [2025-09-26T22:24:54.042937] [DEBUG] [MAIN ] MSA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:54.045012] [INFO ] [MAIN ] MSA: Generated 1820 derivative records from 18988 primary records. [2025-09-26T22:24:54.045266] [DEBUG] [LOCAL ] MSA: Saving derivative data. [2025-09-26T22:24:54.083669] [DEBUG] [MAIN ] MS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:54.085694] [INFO ] [MAIN ] MS: Generated 1820 derivative records from 54472 primary records. [2025-09-26T22:24:54.086957] [DEBUG] [LOCAL ] MS: Saving derivative data. [2025-09-26T22:24:54.086836] [DEBUG] [LOCAL ] MSA: Derivative data saved (1820 records). [2025-09-26T22:24:54.088398] [INFO ] [MAIN ] MSA: Successfully saved derivative data. [2025-09-26T22:24:54.090750] [INFO ] [MAIN ] Derivative Progress: 1213/2074 symbols completed. MSA took 1.2s. Estimated remaining: 5m 59s. Rate: 143.8 symbols/min [2025-09-26T22:24:54.113739] [DEBUG] [LOCAL ] MS: Derivative data saved (1820 records). [2025-09-26T22:24:54.127147] [INFO ] [MAIN ] MS: Successfully saved derivative data. [2025-09-26T22:24:54.130205] [INFO ] [MAIN ] Derivative Progress: 1214/2074 symbols completed. MS took 1.2s. Estimated remaining: 5m 59s. Rate: 143.9 symbols/min [2025-09-26T22:24:54.127523] [DEBUG] [MAIN ] MSB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:54.131482] [INFO ] [MAIN ] MSB: Generated 1820 derivative records from 7895 primary records. [2025-09-26T22:24:54.131600] [DEBUG] [LOCAL ] MSB: Saving derivative data. [2025-09-26T22:24:54.147578] [DEBUG] [LOCAL ] MSB: Derivative data saved (1820 records). [2025-09-26T22:24:54.147691] [INFO ] [MAIN ] MSB: Successfully saved derivative data. [2025-09-26T22:24:54.150675] [INFO ] [MAIN ] Derivative Progress: 1215/2074 symbols completed. MSB took 0.7s. Estimated remaining: 5m 58s. Rate: 144.0 symbols/min [2025-09-26T22:24:54.151362] [INFO ] [MAIN ] MSDL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:54.151591] [INFO ] [MAIN ] MSCI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:54.152186] [INFO ] [MAIN ] MSD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:54.174243] [DEBUG] [LOCAL ] MSD: Loaded 15775 existing records from primary storage. [2025-09-26T22:24:54.174435] [INFO ] [MAIN ] MSD: Loaded 15775 primary data records. [2025-09-26T22:24:54.352788] [DEBUG] [LOCAL ] MSDL: Loaded 38645 existing records from primary storage. [2025-09-26T22:24:54.413254] [INFO ] [MAIN ] MSDL: Loaded 38645 primary data records. [2025-09-26T22:24:54.413142] [DEBUG] [LOCAL ] MSCI: Loaded 35351 existing records from primary storage. [2025-09-26T22:24:54.571890] [INFO ] [MAIN ] MSCI: Loaded 35351 primary data records. [2025-09-26T22:24:55.281858] [DEBUG] [MAIN ] MSD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:55.284034] [INFO ] [MAIN ] MSD: Generated 1820 derivative records from 15775 primary records. [2025-09-26T22:24:55.284343] [DEBUG] [LOCAL ] MSD: Saving derivative data. [2025-09-26T22:24:55.307007] [DEBUG] [LOCAL ] MSD: Derivative data saved (1820 records). [2025-09-26T22:24:55.307528] [INFO ] [MAIN ] MSD: Successfully saved derivative data. [2025-09-26T22:24:55.322435] [INFO ] [MAIN ] Derivative Progress: 1216/2074 symbols completed. MSD took 1.2s. Estimated remaining: 5m 58s. Rate: 143.8 symbols/min [2025-09-26T22:24:55.323429] [DEBUG] [MAIN ] MSDL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:55.324735] [INFO ] [MAIN ] MSGE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:55.324483] [INFO ] [MAIN ] MSDL: Generated 1820 derivative records from 38645 primary records. [2025-09-26T22:24:55.325011] [DEBUG] [LOCAL ] MSDL: Saving derivative data. [2025-09-26T22:24:55.358443] [DEBUG] [MAIN ] MSCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:55.360388] [INFO ] [MAIN ] MSCI: Generated 1820 derivative records from 35351 primary records. [2025-09-26T22:24:55.360807] [DEBUG] [LOCAL ] MSCI: Saving derivative data. [2025-09-26T22:24:55.362328] [DEBUG] [LOCAL ] MSDL: Derivative data saved (1820 records). [2025-09-26T22:24:55.362785] [INFO ] [MAIN ] MSDL: Successfully saved derivative data. [2025-09-26T22:24:55.365908] [INFO ] [MAIN ] Derivative Progress: 1217/2074 symbols completed. MSDL took 1.2s. Estimated remaining: 5m 57s. Rate: 143.9 symbols/min [2025-09-26T22:24:55.373708] [INFO ] [MAIN ] MSGS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:55.401042] [DEBUG] [LOCAL ] MSCI: Derivative data saved (1820 records). [2025-09-26T22:24:55.401276] [INFO ] [MAIN ] MSCI: Successfully saved derivative data. [2025-09-26T22:24:55.404166] [INFO ] [MAIN ] Derivative Progress: 1218/2074 symbols completed. MSCI took 1.3s. Estimated remaining: 5m 57s. Rate: 144.0 symbols/min [2025-09-26T22:24:55.410034] [INFO ] [MAIN ] MSI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:55.405292] [DEBUG] [LOCAL ] MSGE: Loaded 27513 existing records from primary storage. [2025-09-26T22:24:55.410554] [INFO ] [MAIN ] MSGE: Loaded 27513 primary data records. [2025-09-26T22:24:55.491219] [DEBUG] [LOCAL ] MSGS: Loaded 17318 existing records from primary storage. [2025-09-26T22:24:55.503744] [INFO ] [MAIN ] MSGS: Loaded 17318 primary data records. [2025-09-26T22:24:55.934545] [DEBUG] [LOCAL ] MSI: Loaded 41128 existing records from primary storage. [2025-09-26T22:24:55.938106] [INFO ] [MAIN ] MSI: Loaded 41128 primary data records. [2025-09-26T22:24:56.449406] [DEBUG] [MAIN ] MSGE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:56.452006] [INFO ] [MAIN ] MSGE: Generated 1820 derivative records from 27513 primary records. [2025-09-26T22:24:56.453225] [DEBUG] [LOCAL ] MSGE: Saving derivative data. [2025-09-26T22:24:56.499780] [DEBUG] [MAIN ] MSGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:56.499082] [DEBUG] [LOCAL ] MSGE: Derivative data saved (1820 records). [2025-09-26T22:24:56.501332] [INFO ] [MAIN ] MSGS: Generated 1820 derivative records from 17318 primary records. [2025-09-26T22:24:56.501584] [DEBUG] [LOCAL ] MSGS: Saving derivative data. [2025-09-26T22:24:56.501840] [INFO ] [MAIN ] MSGE: Successfully saved derivative data. [2025-09-26T22:24:56.508446] [INFO ] [MAIN ] Derivative Progress: 1219/2074 symbols completed. MSGE took 1.2s. Estimated remaining: 5m 57s. Rate: 143.8 symbols/min [2025-09-26T22:24:56.508774] [INFO ] [MAIN ] MSM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:56.544125] [DEBUG] [MAIN ] MSI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:56.545913] [INFO ] [MAIN ] MSI: Generated 1820 derivative records from 41128 primary records. [2025-09-26T22:24:56.546376] [DEBUG] [LOCAL ] MSI: Saving derivative data. [2025-09-26T22:24:56.563396] [DEBUG] [LOCAL ] MSGS: Derivative data saved (1820 records). [2025-09-26T22:24:56.564680] [INFO ] [MAIN ] MSGS: Successfully saved derivative data. [2025-09-26T22:24:56.568218] [INFO ] [MAIN ] Derivative Progress: 1220/2074 symbols completed. MSGS took 1.2s. Estimated remaining: 5m 56s. Rate: 143.9 symbols/min [2025-09-26T22:24:56.569328] [INFO ] [MAIN ] MT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:56.581970] [DEBUG] [LOCAL ] MSI: Derivative data saved (1820 records). [2025-09-26T22:24:56.582260] [INFO ] [MAIN ] MSI: Successfully saved derivative data. [2025-09-26T22:24:56.585180] [INFO ] [MAIN ] Derivative Progress: 1221/2074 symbols completed. MSI took 1.2s. Estimated remaining: 5m 55s. Rate: 144.1 symbols/min [2025-09-26T22:24:56.585736] [INFO ] [MAIN ] MTAL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:56.600006] [DEBUG] [LOCAL ] MSM: Loaded 36004 existing records from primary storage. [2025-09-26T22:24:56.600157] [INFO ] [MAIN ] MSM: Loaded 36004 primary data records. [2025-09-26T22:24:56.829817] [DEBUG] [LOCAL ] MTAL: Loaded 37002 existing records from primary storage. [2025-09-26T22:24:56.975446] [INFO ] [MAIN ] MTAL: Loaded 37002 primary data records. [2025-09-26T22:24:57.014394] [DEBUG] [LOCAL ] MT: Loaded 51417 existing records from primary storage. [2025-09-26T22:24:57.031413] [INFO ] [MAIN ] MT: Loaded 51417 primary data records. [2025-09-26T22:24:57.687189] [DEBUG] [MAIN ] MSM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:57.688828] [INFO ] [MAIN ] MSM: Generated 1820 derivative records from 36004 primary records. [2025-09-26T22:24:57.689143] [DEBUG] [LOCAL ] MSM: Saving derivative data. [2025-09-26T22:24:57.729663] [DEBUG] [MAIN ] MT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:57.730204] [DEBUG] [LOCAL ] MSM: Derivative data saved (1820 records). [2025-09-26T22:24:57.732483] [INFO ] [MAIN ] MT: Generated 1820 derivative records from 51417 primary records. [2025-09-26T22:24:57.733916] [DEBUG] [LOCAL ] MT: Saving derivative data. [2025-09-26T22:24:57.732598] [INFO ] [MAIN ] MSM: Successfully saved derivative data. [2025-09-26T22:24:57.738985] [INFO ] [MAIN ] Derivative Progress: 1222/2074 symbols completed. MSM took 1.2s. Estimated remaining: 5m 55s. Rate: 143.8 symbols/min [2025-09-26T22:24:57.757242] [INFO ] [MAIN ] MTB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:57.767820] [DEBUG] [MAIN ] MTAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:57.769299] [INFO ] [MAIN ] MTAL: Generated 1820 derivative records from 37002 primary records. [2025-09-26T22:24:57.769897] [DEBUG] [LOCAL ] MTAL: Saving derivative data. [2025-09-26T22:24:57.788016] [DEBUG] [LOCAL ] MT: Derivative data saved (1820 records). [2025-09-26T22:24:57.788608] [INFO ] [MAIN ] MT: Successfully saved derivative data. [2025-09-26T22:24:57.791825] [INFO ] [MAIN ] Derivative Progress: 1223/2074 symbols completed. MT took 1.2s. Estimated remaining: 5m 55s. Rate: 143.9 symbols/min [2025-09-26T22:24:57.793463] [INFO ] [MAIN ] MTD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:57.795325] [DEBUG] [LOCAL ] MTAL: Derivative data saved (1820 records). [2025-09-26T22:24:57.795565] [INFO ] [MAIN ] MTAL: Successfully saved derivative data. [2025-09-26T22:24:57.798207] [INFO ] [MAIN ] Derivative Progress: 1224/2074 symbols completed. MTAL took 1.2s. Estimated remaining: 5m 54s. Rate: 144.1 symbols/min [2025-09-26T22:24:57.798799] [INFO ] [MAIN ] MTDR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:57.825952] [DEBUG] [LOCAL ] MTD: Loaded 15342 existing records from primary storage. [2025-09-26T22:24:57.826164] [INFO ] [MAIN ] MTD: Loaded 15342 primary data records. [2025-09-26T22:24:57.981367] [DEBUG] [LOCAL ] MTB: Loaded 47562 existing records from primary storage. [2025-09-26T22:24:57.992679] [INFO ] [MAIN ] MTB: Loaded 47562 primary data records. [2025-09-26T22:24:58.320162] [DEBUG] [LOCAL ] MTDR: Loaded 52316 existing records from primary storage. [2025-09-26T22:24:58.335285] [INFO ] [MAIN ] MTDR: Loaded 52316 primary data records. [2025-09-26T22:24:58.962059] [DEBUG] [MAIN ] MTD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:58.963506] [INFO ] [MAIN ] MTD: Generated 1820 derivative records from 15342 primary records. [2025-09-26T22:24:58.963789] [DEBUG] [LOCAL ] MTD: Saving derivative data. [2025-09-26T22:24:59.000391] [DEBUG] [MAIN ] MTB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:59.002821] [INFO ] [MAIN ] MTB: Generated 1820 derivative records from 47562 primary records. [2025-09-26T22:24:59.003756] [DEBUG] [LOCAL ] MTB: Saving derivative data. [2025-09-26T22:24:59.004328] [DEBUG] [LOCAL ] MTD: Derivative data saved (1820 records). [2025-09-26T22:24:59.005701] [INFO ] [MAIN ] MTD: Successfully saved derivative data. [2025-09-26T22:24:59.008237] [INFO ] [MAIN ] Derivative Progress: 1225/2074 symbols completed. MTD took 1.2s. Estimated remaining: 5m 54s. Rate: 143.8 symbols/min [2025-09-26T22:24:59.025856] [INFO ] [MAIN ] MTG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:59.026956] [DEBUG] [LOCAL ] MTB: Derivative data saved (1820 records). [2025-09-26T22:24:59.027274] [INFO ] [MAIN ] MTB: Successfully saved derivative data. [2025-09-26T22:24:59.030053] [INFO ] [MAIN ] Derivative Progress: 1226/2074 symbols completed. MTB took 1.3s. Estimated remaining: 5m 53s. Rate: 144.0 symbols/min [2025-09-26T22:24:59.030585] [INFO ] [MAIN ] MTH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:59.045450] [DEBUG] [MAIN ] MTDR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:24:59.046283] [INFO ] [MAIN ] MTDR: Generated 1820 derivative records from 52316 primary records. [2025-09-26T22:24:59.046436] [DEBUG] [LOCAL ] MTDR: Saving derivative data. [2025-09-26T22:24:59.066034] [DEBUG] [LOCAL ] MTDR: Derivative data saved (1820 records). [2025-09-26T22:24:59.066894] [INFO ] [MAIN ] MTDR: Successfully saved derivative data. [2025-09-26T22:24:59.069862] [INFO ] [MAIN ] Derivative Progress: 1227/2074 symbols completed. MTDR took 1.3s. Estimated remaining: 5m 53s. Rate: 144.1 symbols/min [2025-09-26T22:24:59.070423] [INFO ] [MAIN ] MTN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:24:59.138549] [DEBUG] [LOCAL ] MTG: Loaded 52091 existing records from primary storage. [2025-09-26T22:24:59.138823] [INFO ] [MAIN ] MTG: Loaded 52091 primary data records. [2025-09-26T22:24:59.139667] [DEBUG] [LOCAL ] MTH: Loaded 44547 existing records from primary storage. [2025-09-26T22:24:59.145706] [INFO ] [MAIN ] MTH: Loaded 44547 primary data records. [2025-09-26T22:24:59.413605] [DEBUG] [LOCAL ] MTN: Loaded 39607 existing records from primary storage. [2025-09-26T22:24:59.440166] [INFO ] [MAIN ] MTN: Loaded 39607 primary data records. [2025-09-26T22:25:00.207982] [DEBUG] [MAIN ] MTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:00.218515] [INFO ] [MAIN ] MTG: Generated 1820 derivative records from 52091 primary records. [2025-09-26T22:25:00.223609] [DEBUG] [LOCAL ] MTG: Saving derivative data. [2025-09-26T22:25:00.223931] [DEBUG] [MAIN ] MTH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:00.225938] [INFO ] [MAIN ] MTH: Generated 1820 derivative records from 44547 primary records. [2025-09-26T22:25:00.226939] [DEBUG] [LOCAL ] MTH: Saving derivative data. [2025-09-26T22:25:00.272337] [DEBUG] [LOCAL ] MTH: Derivative data saved (1820 records). [2025-09-26T22:25:00.273255] [INFO ] [MAIN ] MTH: Successfully saved derivative data. [2025-09-26T22:25:00.276111] [INFO ] [MAIN ] Derivative Progress: 1228/2074 symbols completed. MTH took 1.2s. Estimated remaining: 5m 53s. Rate: 143.8 symbols/min [2025-09-26T22:25:00.272666] [DEBUG] [MAIN ] MTN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:00.278733] [DEBUG] [LOCAL ] MTG: Derivative data saved (1820 records). [2025-09-26T22:25:00.278634] [INFO ] [MAIN ] MTN: Generated 1820 derivative records from 39607 primary records. [2025-09-26T22:25:00.278833] [DEBUG] [LOCAL ] MTN: Saving derivative data. [2025-09-26T22:25:00.278919] [INFO ] [MAIN ] MTG: Successfully saved derivative data. [2025-09-26T22:25:00.281735] [INFO ] [MAIN ] Derivative Progress: 1229/2074 symbols completed. MTG took 1.3s. Estimated remaining: 5m 52s. Rate: 144.0 symbols/min [2025-09-26T22:25:00.297260] [DEBUG] [LOCAL ] MTN: Derivative data saved (1820 records). [2025-09-26T22:25:00.297335] [INFO ] [MAIN ] MTN: Successfully saved derivative data. [2025-09-26T22:25:00.300323] [INFO ] [MAIN ] Derivative Progress: 1230/2074 symbols completed. MTN took 1.2s. Estimated remaining: 5m 52s. Rate: 144.1 symbols/min [2025-09-26T22:25:00.301085] [INFO ] [MAIN ] MTW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:00.301200] [INFO ] [MAIN ] MTUS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:00.301298] [INFO ] [MAIN ] MTRN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:00.335931] [DEBUG] [LOCAL ] MTRN: Loaded 18303 existing records from primary storage. [2025-09-26T22:25:00.336260] [INFO ] [MAIN ] MTRN: Loaded 18303 primary data records. [2025-09-26T22:25:00.438723] [DEBUG] [LOCAL ] MTUS: Loaded 28984 existing records from primary storage. [2025-09-26T22:25:00.416116] [DEBUG] [LOCAL ] MTW: Loaded 26888 existing records from primary storage. [2025-09-26T22:25:00.468610] [INFO ] [MAIN ] MTUS: Loaded 28984 primary data records. [2025-09-26T22:25:00.456430] [INFO ] [MAIN ] MTW: Loaded 26888 primary data records. [2025-09-26T22:25:01.409625] [DEBUG] [MAIN ] MTRN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:01.411375] [INFO ] [MAIN ] MTRN: Generated 1820 derivative records from 18303 primary records. [2025-09-26T22:25:01.411703] [DEBUG] [LOCAL ] MTRN: Saving derivative data. [2025-09-26T22:25:01.435097] [DEBUG] [MAIN ] MTUS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:01.439135] [INFO ] [MAIN ] MTUS: Generated 1820 derivative records from 28984 primary records. [2025-09-26T22:25:01.439239] [DEBUG] [LOCAL ] MTUS: Saving derivative data. [2025-09-26T22:25:01.476902] [DEBUG] [LOCAL ] MTRN: Derivative data saved (1820 records). [2025-09-26T22:25:01.478166] [DEBUG] [LOCAL ] MTUS: Derivative data saved (1820 records). [2025-09-26T22:25:01.478868] [DEBUG] [MAIN ] MTW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:01.478364] [INFO ] [MAIN ] MTRN: Successfully saved derivative data. [2025-09-26T22:25:01.481163] [INFO ] [MAIN ] Derivative Progress: 1231/2074 symbols completed. MTRN took 1.2s. Estimated remaining: 5m 52s. Rate: 143.8 symbols/min [2025-09-26T22:25:01.482006] [INFO ] [MAIN ] MTW: Generated 1820 derivative records from 26888 primary records. [2025-09-26T22:25:01.482323] [INFO ] [MAIN ] MTX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:01.478954] [INFO ] [MAIN ] MTUS: Successfully saved derivative data. [2025-09-26T22:25:01.482479] [DEBUG] [LOCAL ] MTW: Saving derivative data. [2025-09-26T22:25:01.485927] [INFO ] [MAIN ] Derivative Progress: 1232/2074 symbols completed. MTUS took 1.2s. Estimated remaining: 5m 51s. Rate: 144.0 symbols/min [2025-09-26T22:25:01.487443] [INFO ] [MAIN ] MTZ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:01.511121] [DEBUG] [LOCAL ] MTW: Derivative data saved (1820 records). [2025-09-26T22:25:01.511339] [INFO ] [MAIN ] MTW: Successfully saved derivative data. [2025-09-26T22:25:01.514330] [INFO ] [MAIN ] Derivative Progress: 1233/2074 symbols completed. MTW took 1.2s. Estimated remaining: 5m 50s. Rate: 144.1 symbols/min [2025-09-26T22:25:01.514851] [INFO ] [MAIN ] MUA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:01.525088] [DEBUG] [LOCAL ] MTX: Loaded 23150 existing records from primary storage. [2025-09-26T22:25:01.525324] [INFO ] [MAIN ] MTX: Loaded 23150 primary data records. [2025-09-26T22:25:01.662573] [DEBUG] [LOCAL ] MUA: Loaded 12391 existing records from primary storage. [2025-09-26T22:25:01.679609] [INFO ] [MAIN ] MUA: Loaded 12391 primary data records. [2025-09-26T22:25:01.814599] [DEBUG] [LOCAL ] MTZ: Loaded 43922 existing records from primary storage. [2025-09-26T22:25:01.977336] [INFO ] [MAIN ] MTZ: Loaded 43922 primary data records. [2025-09-26T22:25:02.602746] [DEBUG] [MAIN ] MTX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:02.604132] [INFO ] [MAIN ] MTX: Generated 1820 derivative records from 23150 primary records. [2025-09-26T22:25:02.604300] [DEBUG] [LOCAL ] MTX: Saving derivative data. [2025-09-26T22:25:02.636001] [DEBUG] [MAIN ] MUA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:02.637878] [INFO ] [MAIN ] MUA: Generated 1820 derivative records from 12391 primary records. [2025-09-26T22:25:02.638574] [DEBUG] [LOCAL ] MUA: Saving derivative data. [2025-09-26T22:25:02.653496] [DEBUG] [LOCAL ] MTX: Derivative data saved (1820 records). [2025-09-26T22:25:02.654480] [INFO ] [MAIN ] MTX: Successfully saved derivative data. [2025-09-26T22:25:02.656793] [INFO ] [MAIN ] Derivative Progress: 1234/2074 symbols completed. MTX took 1.2s. Estimated remaining: 5m 50s. Rate: 143.9 symbols/min [2025-09-26T22:25:02.657301] [INFO ] [MAIN ] MUC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:02.677832] [DEBUG] [LOCAL ] MUA: Derivative data saved (1820 records). [2025-09-26T22:25:02.677709] [DEBUG] [MAIN ] MTZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:02.677968] [INFO ] [MAIN ] MUA: Successfully saved derivative data. [2025-09-26T22:25:02.678765] [INFO ] [MAIN ] MTZ: Generated 1820 derivative records from 43922 primary records. [2025-09-26T22:25:02.678935] [DEBUG] [LOCAL ] MTZ: Saving derivative data. [2025-09-26T22:25:02.681884] [INFO ] [MAIN ] Derivative Progress: 1235/2074 symbols completed. MUA took 1.2s. Estimated remaining: 5m 50s. Rate: 144.0 symbols/min [2025-09-26T22:25:02.683305] [INFO ] [MAIN ] MUE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:02.713091] [DEBUG] [LOCAL ] MUC: Loaded 20721 existing records from primary storage. [2025-09-26T22:25:02.705522] [DEBUG] [LOCAL ] MTZ: Derivative data saved (1820 records). [2025-09-26T22:25:02.713350] [INFO ] [MAIN ] MTZ: Successfully saved derivative data. [2025-09-26T22:25:02.713432] [INFO ] [MAIN ] MUC: Loaded 20721 primary data records. [2025-09-26T22:25:02.716575] [INFO ] [MAIN ] Derivative Progress: 1236/2074 symbols completed. MTZ took 1.2s. Estimated remaining: 5m 49s. Rate: 144.1 symbols/min [2025-09-26T22:25:02.731942] [INFO ] [MAIN ] MUFG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:02.786448] [DEBUG] [LOCAL ] MUE: Loaded 12092 existing records from primary storage. [2025-09-26T22:25:02.803195] [INFO ] [MAIN ] MUE: Loaded 12092 primary data records. [2025-09-26T22:25:03.456395] [DEBUG] [LOCAL ] MUFG: Loaded 53341 existing records from primary storage. [2025-09-26T22:25:03.458301] [INFO ] [MAIN ] MUFG: Loaded 53341 primary data records. [2025-09-26T22:25:03.802130] [DEBUG] [MAIN ] MUC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:03.804173] [INFO ] [MAIN ] MUC: Generated 1820 derivative records from 20721 primary records. [2025-09-26T22:25:03.804379] [DEBUG] [LOCAL ] MUC: Saving derivative data. [2025-09-26T22:25:03.837378] [DEBUG] [MAIN ] MUE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:03.838434] [INFO ] [MAIN ] MUE: Generated 1820 derivative records from 12092 primary records. [2025-09-26T22:25:03.838876] [DEBUG] [LOCAL ] MUE: Saving derivative data. [2025-09-26T22:25:03.859888] [DEBUG] [LOCAL ] MUC: Derivative data saved (1820 records). [2025-09-26T22:25:03.861306] [INFO ] [MAIN ] MUC: Successfully saved derivative data. [2025-09-26T22:25:03.864898] [INFO ] [MAIN ] Derivative Progress: 1237/2074 symbols completed. MUC took 1.2s. Estimated remaining: 5m 49s. Rate: 143.9 symbols/min [2025-09-26T22:25:03.866038] [DEBUG] [LOCAL ] MUE: Derivative data saved (1820 records). [2025-09-26T22:25:03.866207] [INFO ] [MAIN ] MUE: Successfully saved derivative data. [2025-09-26T22:25:03.869875] [INFO ] [MAIN ] Derivative Progress: 1238/2074 symbols completed. MUE took 1.2s. Estimated remaining: 5m 48s. Rate: 144.0 symbols/min [2025-09-26T22:25:03.866519] [INFO ] [MAIN ] MUJ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:03.870468] [INFO ] [MAIN ] MUR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:03.892600] [DEBUG] [MAIN ] MUFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:03.893529] [INFO ] [MAIN ] MUFG: Generated 1820 derivative records from 53341 primary records. [2025-09-26T22:25:03.893725] [DEBUG] [LOCAL ] MUFG: Saving derivative data. [2025-09-26T22:25:03.916079] [DEBUG] [LOCAL ] MUJ: Loaded 13473 existing records from primary storage. [2025-09-26T22:25:03.916279] [INFO ] [MAIN ] MUJ: Loaded 13473 primary data records. [2025-09-26T22:25:03.915792] [DEBUG] [LOCAL ] MUFG: Derivative data saved (1820 records). [2025-09-26T22:25:03.921613] [INFO ] [MAIN ] MUFG: Successfully saved derivative data. [2025-09-26T22:25:03.931497] [INFO ] [MAIN ] Derivative Progress: 1239/2074 symbols completed. MUFG took 1.2s. Estimated remaining: 5m 48s. Rate: 144.1 symbols/min [2025-09-26T22:25:03.952846] [INFO ] [MAIN ] MUSA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:04.292241] [DEBUG] [LOCAL ] MUR: Loaded 53705 existing records from primary storage. [2025-09-26T22:25:04.292901] [DEBUG] [LOCAL ] MUSA: Loaded 25221 existing records from primary storage. [2025-09-26T22:25:04.293696] [INFO ] [MAIN ] MUR: Loaded 53705 primary data records. [2025-09-26T22:25:04.294065] [INFO ] [MAIN ] MUSA: Loaded 25221 primary data records. [2025-09-26T22:25:04.995117] [DEBUG] [MAIN ] MUJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:04.996835] [INFO ] [MAIN ] MUJ: Generated 1820 derivative records from 13473 primary records. [2025-09-26T22:25:04.998260] [DEBUG] [LOCAL ] MUJ: Saving derivative data. [2025-09-26T22:25:05.019205] [DEBUG] [LOCAL ] MUJ: Derivative data saved (1820 records). [2025-09-26T22:25:05.019676] [INFO ] [MAIN ] MUJ: Successfully saved derivative data. [2025-09-26T22:25:05.022081] [INFO ] [MAIN ] Derivative Progress: 1240/2074 symbols completed. MUJ took 1.2s. Estimated remaining: 5m 48s. Rate: 143.9 symbols/min [2025-09-26T22:25:05.022535] [INFO ] [MAIN ] MUX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:05.040664] [DEBUG] [MAIN ] MUR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:05.042633] [INFO ] [MAIN ] MUR: Generated 1820 derivative records from 53705 primary records. [2025-09-26T22:25:05.043721] [DEBUG] [LOCAL ] MUR: Saving derivative data. [2025-09-26T22:25:05.072466] [DEBUG] [MAIN ] MUSA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:05.074116] [INFO ] [MAIN ] MUSA: Generated 1820 derivative records from 25221 primary records. [2025-09-26T22:25:05.074462] [DEBUG] [LOCAL ] MUSA: Saving derivative data. [2025-09-26T22:25:05.092372] [DEBUG] [LOCAL ] MUR: Derivative data saved (1820 records). [2025-09-26T22:25:05.102306] [INFO ] [MAIN ] MUR: Successfully saved derivative data. [2025-09-26T22:25:05.103308] [DEBUG] [LOCAL ] MUSA: Derivative data saved (1820 records). [2025-09-26T22:25:05.103516] [INFO ] [MAIN ] MUSA: Successfully saved derivative data. [2025-09-26T22:25:05.106269] [INFO ] [MAIN ] Derivative Progress: 1241/2074 symbols completed. MUR took 1.2s. Estimated remaining: 5m 47s. Rate: 144.0 symbols/min [2025-09-26T22:25:05.109621] [INFO ] [MAIN ] MVF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:05.109759] [INFO ] [MAIN ] Derivative Progress: 1242/2074 symbols completed. MUSA took 1.2s. Estimated remaining: 5m 46s. Rate: 144.1 symbols/min [2025-09-26T22:25:05.110460] [INFO ] [MAIN ] MVO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:05.137351] [DEBUG] [LOCAL ] MVO: Loaded 9140 existing records from primary storage. [2025-09-26T22:25:05.138425] [DEBUG] [LOCAL ] MUX: Loaded 43253 existing records from primary storage. [2025-09-26T22:25:05.138638] [INFO ] [MAIN ] MUX: Loaded 43253 primary data records. [2025-09-26T22:25:05.138747] [INFO ] [MAIN ] MVO: Loaded 9140 primary data records. [2025-09-26T22:25:05.187141] [DEBUG] [LOCAL ] MVF: Loaded 12921 existing records from primary storage. [2025-09-26T22:25:05.225842] [INFO ] [MAIN ] MVF: Loaded 12921 primary data records. [2025-09-26T22:25:06.194906] [DEBUG] [MAIN ] MUX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:06.198504] [INFO ] [MAIN ] MUX: Generated 1820 derivative records from 43253 primary records. [2025-09-26T22:25:06.198981] [DEBUG] [LOCAL ] MUX: Saving derivative data. [2025-09-26T22:25:06.230730] [DEBUG] [MAIN ] MVO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:06.240686] [INFO ] [MAIN ] MVO: Generated 1820 derivative records from 9140 primary records. [2025-09-26T22:25:06.247558] [DEBUG] [LOCAL ] MVO: Saving derivative data. [2025-09-26T22:25:06.247163] [DEBUG] [MAIN ] MVF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:06.250080] [INFO ] [MAIN ] MVF: Generated 1820 derivative records from 12921 primary records. [2025-09-26T22:25:06.251061] [DEBUG] [LOCAL ] MVF: Saving derivative data. [2025-09-26T22:25:06.265587] [DEBUG] [LOCAL ] MUX: Derivative data saved (1820 records). [2025-09-26T22:25:06.272723] [INFO ] [MAIN ] MUX: Successfully saved derivative data. [2025-09-26T22:25:06.277057] [INFO ] [MAIN ] Derivative Progress: 1243/2074 symbols completed. MUX took 1.3s. Estimated remaining: 5m 46s. Rate: 143.9 symbols/min [2025-09-26T22:25:06.285992] [DEBUG] [LOCAL ] MVF: Derivative data saved (1820 records). [2025-09-26T22:25:06.286440] [INFO ] [MAIN ] MVF: Successfully saved derivative data. [2025-09-26T22:25:06.290102] [INFO ] [MAIN ] Derivative Progress: 1244/2074 symbols completed. MVF took 1.2s. Estimated remaining: 5m 46s. Rate: 144.0 symbols/min [2025-09-26T22:25:06.292599] [DEBUG] [LOCAL ] MVO: Derivative data saved (1820 records). [2025-09-26T22:25:06.292702] [INFO ] [MAIN ] MVO: Successfully saved derivative data. [2025-09-26T22:25:06.295513] [INFO ] [MAIN ] Derivative Progress: 1245/2074 symbols completed. MVO took 1.2s. Estimated remaining: 5m 45s. Rate: 144.1 symbols/min [2025-09-26T22:25:06.296219] [INFO ] [MAIN ] MVT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:06.296425] [INFO ] [MAIN ] MX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:06.297366] [INFO ] [MAIN ] MWA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:06.309424] [DEBUG] [LOCAL ] MVT: Loaded 10355 existing records from primary storage. [2025-09-26T22:25:06.309676] [INFO ] [MAIN ] MVT: Loaded 10355 primary data records. [2025-09-26T22:25:06.481937] [DEBUG] [LOCAL ] MX: Loaded 23379 existing records from primary storage. [2025-09-26T22:25:06.504680] [INFO ] [MAIN ] MX: Loaded 23379 primary data records. [2025-09-26T22:25:06.766761] [DEBUG] [LOCAL ] MWA: Loaded 47633 existing records from primary storage. [2025-09-26T22:25:06.780582] [INFO ] [MAIN ] MWA: Loaded 47633 primary data records. [2025-09-26T22:25:07.416685] [DEBUG] [MAIN ] MVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:07.418392] [INFO ] [MAIN ] MVT: Generated 1820 derivative records from 10355 primary records. [2025-09-26T22:25:07.418610] [DEBUG] [LOCAL ] MVT: Saving derivative data. [2025-09-26T22:25:07.454397] [DEBUG] [MAIN ] MX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:07.455780] [INFO ] [MAIN ] MX: Generated 1820 derivative records from 23379 primary records. [2025-09-26T22:25:07.455986] [DEBUG] [LOCAL ] MX: Saving derivative data. [2025-09-26T22:25:07.465381] [DEBUG] [LOCAL ] MVT: Derivative data saved (1820 records). [2025-09-26T22:25:07.465585] [INFO ] [MAIN ] MVT: Successfully saved derivative data. [2025-09-26T22:25:07.470687] [INFO ] [MAIN ] Derivative Progress: 1246/2074 symbols completed. MVT took 1.2s. Estimated remaining: 5m 45s. Rate: 143.9 symbols/min [2025-09-26T22:25:07.475085] [INFO ] [MAIN ] MXF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:07.494071] [DEBUG] [MAIN ] MWA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:07.495531] [INFO ] [MAIN ] MWA: Generated 1820 derivative records from 47633 primary records. [2025-09-26T22:25:07.495946] [DEBUG] [LOCAL ] MWA: Saving derivative data. [2025-09-26T22:25:07.500329] [DEBUG] [LOCAL ] MXF: Loaded 5984 existing records from primary storage. [2025-09-26T22:25:07.500687] [INFO ] [MAIN ] MXF: Loaded 5984 primary data records. [2025-09-26T22:25:07.497214] [DEBUG] [LOCAL ] MX: Derivative data saved (1820 records). [2025-09-26T22:25:07.505937] [INFO ] [MAIN ] MX: Successfully saved derivative data. [2025-09-26T22:25:07.515481] [INFO ] [MAIN ] Derivative Progress: 1247/2074 symbols completed. MX took 1.2s. Estimated remaining: 5m 45s. Rate: 144.0 symbols/min [2025-09-26T22:25:07.560177] [INFO ] [MAIN ] MYD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:07.631106] [DEBUG] [LOCAL ] MWA: Derivative data saved (1820 records). [2025-09-26T22:25:07.647331] [INFO ] [MAIN ] MWA: Successfully saved derivative data. [2025-09-26T22:25:07.652335] [INFO ] [MAIN ] Derivative Progress: 1248/2074 symbols completed. MWA took 1.4s. Estimated remaining: 5m 44s. Rate: 144.1 symbols/min [2025-09-26T22:25:07.663031] [INFO ] [MAIN ] MYI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:07.749186] [DEBUG] [LOCAL ] MYD: Loaded 13946 existing records from primary storage. [2025-09-26T22:25:07.871546] [INFO ] [MAIN ] MYD: Loaded 13946 primary data records. [2025-09-26T22:25:07.989006] [DEBUG] [LOCAL ] MYI: Loaded 19636 existing records from primary storage. [2025-09-26T22:25:08.001836] [INFO ] [MAIN ] MYI: Loaded 19636 primary data records. [2025-09-26T22:25:08.569254] [DEBUG] [MAIN ] MXF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:08.570818] [INFO ] [MAIN ] MXF: Generated 1820 derivative records from 5984 primary records. [2025-09-26T22:25:08.571125] [DEBUG] [LOCAL ] MXF: Saving derivative data. [2025-09-26T22:25:08.596517] [DEBUG] [LOCAL ] MXF: Derivative data saved (1820 records). [2025-09-26T22:25:08.596724] [INFO ] [MAIN ] MXF: Successfully saved derivative data. [2025-09-26T22:25:08.599070] [INFO ] [MAIN ] Derivative Progress: 1249/2074 symbols completed. MXF took 1.1s. Estimated remaining: 5m 44s. Rate: 144.0 symbols/min [2025-09-26T22:25:08.599787] [INFO ] [MAIN ] MYN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:08.614454] [DEBUG] [MAIN ] MYD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:08.615268] [INFO ] [MAIN ] MYD: Generated 1820 derivative records from 13946 primary records. [2025-09-26T22:25:08.615521] [DEBUG] [LOCAL ] MYD: Saving derivative data. [2025-09-26T22:25:08.656419] [DEBUG] [MAIN ] MYI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:08.656868] [DEBUG] [LOCAL ] MYN: Loaded 10324 existing records from primary storage. [2025-09-26T22:25:08.659385] [INFO ] [MAIN ] MYI: Generated 1820 derivative records from 19636 primary records. [2025-09-26T22:25:08.660283] [DEBUG] [LOCAL ] MYI: Saving derivative data. [2025-09-26T22:25:08.658188] [INFO ] [MAIN ] MYN: Loaded 10324 primary data records. [2025-09-26T22:25:08.661491] [DEBUG] [LOCAL ] MYD: Derivative data saved (1820 records). [2025-09-26T22:25:08.695421] [INFO ] [MAIN ] MYD: Successfully saved derivative data. [2025-09-26T22:25:08.722399] [INFO ] [MAIN ] Derivative Progress: 1250/2074 symbols completed. MYD took 1.2s. Estimated remaining: 5m 43s. Rate: 144.0 symbols/min [2025-09-26T22:25:08.750810] [INFO ] [MAIN ] NABL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:08.766670] [DEBUG] [LOCAL ] MYI: Derivative data saved (1820 records). [2025-09-26T22:25:08.773251] [INFO ] [MAIN ] MYI: Successfully saved derivative data. [2025-09-26T22:25:08.799161] [INFO ] [MAIN ] Derivative Progress: 1251/2074 symbols completed. MYI took 1.1s. Estimated remaining: 5m 43s. Rate: 144.1 symbols/min [2025-09-26T22:25:08.803818] [INFO ] [MAIN ] NAC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:09.044815] [DEBUG] [LOCAL ] NAC: Loaded 25076 existing records from primary storage. [2025-09-26T22:25:09.045564] [INFO ] [MAIN ] NAC: Loaded 25076 primary data records. [2025-09-26T22:25:09.156783] [DEBUG] [LOCAL ] NABL: Loaded 40294 existing records from primary storage. [2025-09-26T22:25:09.178849] [INFO ] [MAIN ] NABL: Loaded 40294 primary data records. [2025-09-26T22:25:09.675850] [DEBUG] [MAIN ] MYN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:09.715637] [INFO ] [MAIN ] MYN: Generated 1820 derivative records from 10324 primary records. [2025-09-26T22:25:09.801264] [DEBUG] [LOCAL ] MYN: Saving derivative data. [2025-09-26T22:25:09.825407] [DEBUG] [LOCAL ] MYN: Derivative data saved (1820 records). [2025-09-26T22:25:09.829077] [INFO ] [MAIN ] MYN: Successfully saved derivative data. [2025-09-26T22:25:09.832699] [INFO ] [MAIN ] Derivative Progress: 1252/2074 symbols completed. MYN took 1.2s. Estimated remaining: 5m 43s. Rate: 144.0 symbols/min [2025-09-26T22:25:09.833748] [INFO ] [MAIN ] NAD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:09.848381] [DEBUG] [MAIN ] NAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:09.849494] [INFO ] [MAIN ] NAC: Generated 1820 derivative records from 25076 primary records. [2025-09-26T22:25:09.849757] [DEBUG] [LOCAL ] NAC: Saving derivative data. [2025-09-26T22:25:09.871738] [DEBUG] [LOCAL ] NAC: Derivative data saved (1820 records). [2025-09-26T22:25:09.872099] [INFO ] [MAIN ] NAC: Successfully saved derivative data. [2025-09-26T22:25:09.875943] [INFO ] [MAIN ] Derivative Progress: 1253/2074 symbols completed. NAC took 1.1s. Estimated remaining: 5m 42s. Rate: 144.1 symbols/min [2025-09-26T22:25:09.888988] [INFO ] [MAIN ] NAN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:09.890539] [DEBUG] [MAIN ] NABL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:09.891516] [INFO ] [MAIN ] NABL: Generated 1820 derivative records from 40294 primary records. [2025-09-26T22:25:09.891714] [DEBUG] [LOCAL ] NABL: Saving derivative data. [2025-09-26T22:25:09.924341] [DEBUG] [LOCAL ] NAN: Loaded 9084 existing records from primary storage. [2025-09-26T22:25:09.939282] [INFO ] [MAIN ] NAN: Loaded 9084 primary data records. [2025-09-26T22:25:09.990321] [DEBUG] [LOCAL ] NAD: Loaded 34318 existing records from primary storage. [2025-09-26T22:25:09.989262] [DEBUG] [LOCAL ] NABL: Derivative data saved (1820 records). [2025-09-26T22:25:09.995673] [INFO ] [MAIN ] NAD: Loaded 34318 primary data records. [2025-09-26T22:25:09.995781] [INFO ] [MAIN ] NABL: Successfully saved derivative data. [2025-09-26T22:25:09.999215] [INFO ] [MAIN ] Derivative Progress: 1254/2074 symbols completed. NABL took 1.3s. Estimated remaining: 5m 41s. Rate: 144.1 symbols/min [2025-09-26T22:25:10.027191] [INFO ] [MAIN ] NAT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:10.647692] [DEBUG] [LOCAL ] NAT: Loaded 49859 existing records from primary storage. [2025-09-26T22:25:10.649350] [INFO ] [MAIN ] NAT: Loaded 49859 primary data records. [2025-09-26T22:25:11.023088] [DEBUG] [MAIN ] NAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:11.025674] [INFO ] [MAIN ] NAN: Generated 1820 derivative records from 9084 primary records. [2025-09-26T22:25:11.025929] [DEBUG] [LOCAL ] NAN: Saving derivative data. [2025-09-26T22:25:11.023832] [DEBUG] [MAIN ] NAD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:11.028184] [INFO ] [MAIN ] NAD: Generated 1820 derivative records from 34318 primary records. [2025-09-26T22:25:11.041994] [DEBUG] [LOCAL ] NAD: Saving derivative data. [2025-09-26T22:25:11.048278] [DEBUG] [LOCAL ] NAN: Derivative data saved (1820 records). [2025-09-26T22:25:11.048502] [INFO ] [MAIN ] NAN: Successfully saved derivative data. [2025-09-26T22:25:11.051217] [INFO ] [MAIN ] Derivative Progress: 1255/2074 symbols completed. NAN took 1.2s. Estimated remaining: 5m 41s. Rate: 144.0 symbols/min [2025-09-26T22:25:11.061678] [INFO ] [MAIN ] NATL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:11.074094] [DEBUG] [LOCAL ] NAD: Derivative data saved (1820 records). [2025-09-26T22:25:11.075303] [INFO ] [MAIN ] NAD: Successfully saved derivative data. [2025-09-26T22:25:11.079007] [INFO ] [MAIN ] Derivative Progress: 1256/2074 symbols completed. NAD took 1.2s. Estimated remaining: 5m 41s. Rate: 144.1 symbols/min [2025-09-26T22:25:11.079766] [INFO ] [MAIN ] NAZ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:11.093958] [DEBUG] [MAIN ] NAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:11.094860] [INFO ] [MAIN ] NAT: Generated 1820 derivative records from 49859 primary records. [2025-09-26T22:25:11.094989] [DEBUG] [LOCAL ] NAT: Saving derivative data. [2025-09-26T22:25:11.115802] [DEBUG] [LOCAL ] NAZ: Loaded 2703 existing records from primary storage. [2025-09-26T22:25:11.120072] [INFO ] [MAIN ] NAZ: Loaded 2703 primary data records. [2025-09-26T22:25:11.219427] [DEBUG] [LOCAL ] NATL: Loaded 33367 existing records from primary storage. [2025-09-26T22:25:11.228823] [INFO ] [MAIN ] NATL: Loaded 33367 primary data records. [2025-09-26T22:25:11.285397] [DEBUG] [LOCAL ] NAT: Derivative data saved (1820 records). [2025-09-26T22:25:11.318369] [INFO ] [MAIN ] NAT: Successfully saved derivative data. [2025-09-26T22:25:11.339275] [INFO ] [MAIN ] Derivative Progress: 1257/2074 symbols completed. NAT took 1.3s. Estimated remaining: 5m 40s. Rate: 144.1 symbols/min [2025-09-26T22:25:11.371917] [INFO ] [MAIN ] NBB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:11.718824] [DEBUG] [LOCAL ] NBB: Loaded 8967 existing records from primary storage. [2025-09-26T22:25:11.741020] [INFO ] [MAIN ] NBB: Loaded 8967 primary data records. [2025-09-26T22:25:12.223196] [DEBUG] [MAIN ] NAZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:12.225767] [INFO ] [MAIN ] NAZ: Generated 1820 derivative records from 2703 primary records. [2025-09-26T22:25:12.226453] [DEBUG] [LOCAL ] NAZ: Saving derivative data. [2025-09-26T22:25:12.261050] [DEBUG] [MAIN ] NATL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:12.262923] [INFO ] [MAIN ] NATL: Generated 1820 derivative records from 33367 primary records. [2025-09-26T22:25:12.263207] [DEBUG] [LOCAL ] NATL: Saving derivative data. [2025-09-26T22:25:12.274816] [DEBUG] [LOCAL ] NAZ: Derivative data saved (1820 records). [2025-09-26T22:25:12.278878] [INFO ] [MAIN ] NAZ: Successfully saved derivative data. [2025-09-26T22:25:12.283101] [INFO ] [MAIN ] Derivative Progress: 1258/2074 symbols completed. NAZ took 1.2s. Estimated remaining: 5m 40s. Rate: 144.0 symbols/min [2025-09-26T22:25:12.287501] [DEBUG] [LOCAL ] NATL: Derivative data saved (1820 records). [2025-09-26T22:25:12.288533] [INFO ] [MAIN ] NATL: Successfully saved derivative data. [2025-09-26T22:25:12.291278] [INFO ] [MAIN ] Derivative Progress: 1259/2074 symbols completed. NATL took 1.2s. Estimated remaining: 5m 39s. Rate: 144.1 symbols/min [2025-09-26T22:25:12.305593] [DEBUG] [MAIN ] NBB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:12.306266] [INFO ] [MAIN ] NBB: Generated 1820 derivative records from 8967 primary records. [2025-09-26T22:25:12.306363] [DEBUG] [LOCAL ] NBB: Saving derivative data. [2025-09-26T22:25:12.321984] [DEBUG] [LOCAL ] NBB: Derivative data saved (1820 records). [2025-09-26T22:25:12.322048] [INFO ] [MAIN ] NBB: Successfully saved derivative data. [2025-09-26T22:25:12.324704] [INFO ] [MAIN ] Derivative Progress: 1260/2074 symbols completed. NBB took 1.0s. Estimated remaining: 5m 39s. Rate: 144.2 symbols/min [2025-09-26T22:25:12.325693] [INFO ] [MAIN ] NBR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:12.325511] [INFO ] [MAIN ] NBHC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:12.325984] [INFO ] [MAIN ] NBXG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:12.381521] [DEBUG] [LOCAL ] NBXG: Loaded 22794 existing records from primary storage. [2025-09-26T22:25:12.383737] [DEBUG] [LOCAL ] NBHC: Loaded 23530 existing records from primary storage. [2025-09-26T22:25:12.384177] [INFO ] [MAIN ] NBHC: Loaded 23530 primary data records. [2025-09-26T22:25:12.384084] [INFO ] [MAIN ] NBXG: Loaded 22794 primary data records. [2025-09-26T22:25:12.384885] [DEBUG] [LOCAL ] NBR: Loaded 35286 existing records from primary storage. [2025-09-26T22:25:12.476723] [INFO ] [MAIN ] NBR: Loaded 35286 primary data records. [2025-09-26T22:25:13.397177] [DEBUG] [MAIN ] NBHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:13.398421] [INFO ] [MAIN ] NBHC: Generated 1820 derivative records from 23530 primary records. [2025-09-26T22:25:13.398540] [DEBUG] [LOCAL ] NBHC: Saving derivative data. [2025-09-26T22:25:13.420817] [DEBUG] [MAIN ] NBXG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:13.430495] [INFO ] [MAIN ] NBXG: Generated 1820 derivative records from 22794 primary records. [2025-09-26T22:25:13.431176] [DEBUG] [LOCAL ] NBXG: Saving derivative data. [2025-09-26T22:25:13.431086] [DEBUG] [LOCAL ] NBHC: Derivative data saved (1820 records). [2025-09-26T22:25:13.432165] [INFO ] [MAIN ] NBHC: Successfully saved derivative data. [2025-09-26T22:25:13.434410] [INFO ] [MAIN ] Derivative Progress: 1261/2074 symbols completed. NBHC took 1.1s. Estimated remaining: 5m 39s. Rate: 144.0 symbols/min [2025-09-26T22:25:13.435179] [INFO ] [MAIN ] NC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:13.467597] [DEBUG] [LOCAL ] NC: Loaded 1933 existing records from primary storage. [2025-09-26T22:25:13.465409] [DEBUG] [MAIN ] NBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:13.468975] [INFO ] [MAIN ] NC: Loaded 1933 primary data records. [2025-09-26T22:25:13.468637] [INFO ] [MAIN ] NBR: Generated 1820 derivative records from 35286 primary records. [2025-09-26T22:25:13.474750] [DEBUG] [LOCAL ] NBR: Saving derivative data. [2025-09-26T22:25:13.519846] [DEBUG] [LOCAL ] NBXG: Derivative data saved (1820 records). [2025-09-26T22:25:13.540925] [INFO ] [MAIN ] NBXG: Successfully saved derivative data. [2025-09-26T22:25:13.564887] [INFO ] [MAIN ] Derivative Progress: 1262/2074 symbols completed. NBXG took 1.2s. Estimated remaining: 5m 38s. Rate: 144.1 symbols/min [2025-09-26T22:25:13.593526] [INFO ] [MAIN ] NCA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:13.620236] [DEBUG] [LOCAL ] NBR: Derivative data saved (1820 records). [2025-09-26T22:25:13.620679] [INFO ] [MAIN ] NBR: Successfully saved derivative data. [2025-09-26T22:25:13.634478] [INFO ] [MAIN ] Derivative Progress: 1263/2074 symbols completed. NBR took 1.3s. Estimated remaining: 5m 38s. Rate: 144.2 symbols/min [2025-09-26T22:25:13.669086] [INFO ] [MAIN ] NCDL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:13.875387] [DEBUG] [LOCAL ] NCA: Loaded 10178 existing records from primary storage. [2025-09-26T22:25:13.875845] [INFO ] [MAIN ] NCA: Loaded 10178 primary data records. [2025-09-26T22:25:14.048893] [DEBUG] [LOCAL ] NCDL: Loaded 21828 existing records from primary storage. [2025-09-26T22:25:14.068696] [INFO ] [MAIN ] NCDL: Loaded 21828 primary data records. [2025-09-26T22:25:14.386509] [DEBUG] [MAIN ] NC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:14.420209] [INFO ] [MAIN ] NC: Generated 1820 derivative records from 1933 primary records. [2025-09-26T22:25:14.443333] [DEBUG] [LOCAL ] NC: Saving derivative data. [2025-09-26T22:25:14.582264] [DEBUG] [LOCAL ] NC: Derivative data saved (1820 records). [2025-09-26T22:25:14.582515] [INFO ] [MAIN ] NC: Successfully saved derivative data. [2025-09-26T22:25:14.584933] [INFO ] [MAIN ] Derivative Progress: 1264/2074 symbols completed. NC took 1.1s. Estimated remaining: 5m 37s. Rate: 144.0 symbols/min [2025-09-26T22:25:14.585556] [INFO ] [MAIN ] NCLH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:14.606328] [DEBUG] [MAIN ] NCA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:14.608143] [INFO ] [MAIN ] NCA: Generated 1820 derivative records from 10178 primary records. [2025-09-26T22:25:14.608347] [DEBUG] [LOCAL ] NCA: Saving derivative data. [2025-09-26T22:25:14.627429] [DEBUG] [LOCAL ] NCA: Derivative data saved (1820 records). [2025-09-26T22:25:14.627626] [INFO ] [MAIN ] NCA: Successfully saved derivative data. [2025-09-26T22:25:14.631389] [INFO ] [MAIN ] Derivative Progress: 1265/2074 symbols completed. NCA took 1.0s. Estimated remaining: 5m 37s. Rate: 144.1 symbols/min [2025-09-26T22:25:14.631856] [INFO ] [MAIN ] NCV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:14.647673] [DEBUG] [MAIN ] NCDL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:14.662703] [INFO ] [MAIN ] NCDL: Generated 1820 derivative records from 21828 primary records. [2025-09-26T22:25:14.662937] [DEBUG] [LOCAL ] NCDL: Saving derivative data. [2025-09-26T22:25:14.688146] [DEBUG] [LOCAL ] NCDL: Derivative data saved (1820 records). [2025-09-26T22:25:14.688496] [DEBUG] [LOCAL ] NCV: Loaded 13602 existing records from primary storage. [2025-09-26T22:25:14.688678] [INFO ] [MAIN ] NCV: Loaded 13602 primary data records. [2025-09-26T22:25:14.688612] [INFO ] [MAIN ] NCDL: Successfully saved derivative data. [2025-09-26T22:25:14.692461] [INFO ] [MAIN ] Derivative Progress: 1266/2074 symbols completed. NCDL took 1.0s. Estimated remaining: 5m 36s. Rate: 144.2 symbols/min [2025-09-26T22:25:14.709867] [INFO ] [MAIN ] NCZ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:14.762723] [DEBUG] [LOCAL ] NCLH: Loaded 54533 existing records from primary storage. [2025-09-26T22:25:14.781118] [INFO ] [MAIN ] NCLH: Loaded 54533 primary data records. [2025-09-26T22:25:14.913225] [DEBUG] [LOCAL ] NCZ: Loaded 11998 existing records from primary storage. [2025-09-26T22:25:14.946602] [INFO ] [MAIN ] NCZ: Loaded 11998 primary data records. [2025-09-26T22:25:15.838900] [DEBUG] [MAIN ] NCLH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:15.841209] [INFO ] [MAIN ] NCLH: Generated 1820 derivative records from 54533 primary records. [2025-09-26T22:25:15.841891] [DEBUG] [LOCAL ] NCLH: Saving derivative data. [2025-09-26T22:25:15.859703] [DEBUG] [MAIN ] NCV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:15.861263] [INFO ] [MAIN ] NCV: Generated 1820 derivative records from 13602 primary records. [2025-09-26T22:25:15.877229] [DEBUG] [LOCAL ] NCLH: Derivative data saved (1820 records). [2025-09-26T22:25:15.872833] [DEBUG] [LOCAL ] NCV: Saving derivative data. [2025-09-26T22:25:15.878329] [INFO ] [MAIN ] NCLH: Successfully saved derivative data. [2025-09-26T22:25:15.881456] [INFO ] [MAIN ] Derivative Progress: 1267/2074 symbols completed. NCLH took 1.3s. Estimated remaining: 5m 36s. Rate: 144.0 symbols/min [2025-09-26T22:25:15.881900] [INFO ] [MAIN ] NDMO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:15.912861] [DEBUG] [MAIN ] NCZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:15.915611] [INFO ] [MAIN ] NCZ: Generated 1820 derivative records from 11998 primary records. [2025-09-26T22:25:15.914408] [DEBUG] [LOCAL ] NCV: Derivative data saved (1820 records). [2025-09-26T22:25:15.916063] [DEBUG] [LOCAL ] NCZ: Saving derivative data. [2025-09-26T22:25:15.915996] [INFO ] [MAIN ] NCV: Successfully saved derivative data. [2025-09-26T22:25:15.918517] [INFO ] [MAIN ] Derivative Progress: 1268/2074 symbols completed. NCV took 1.3s. Estimated remaining: 5m 36s. Rate: 144.1 symbols/min [2025-09-26T22:25:15.920210] [INFO ] [MAIN ] NE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:15.944769] [DEBUG] [LOCAL ] NCZ: Derivative data saved (1820 records). [2025-09-26T22:25:15.945044] [INFO ] [MAIN ] NCZ: Successfully saved derivative data. [2025-09-26T22:25:15.948668] [INFO ] [MAIN ] Derivative Progress: 1269/2074 symbols completed. NCZ took 1.2s. Estimated remaining: 5m 35s. Rate: 144.2 symbols/min [2025-09-26T22:25:15.949136] [INFO ] [MAIN ] NEA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:15.957017] [DEBUG] [LOCAL ] NDMO: Loaded 16978 existing records from primary storage. [2025-09-26T22:25:15.957169] [INFO ] [MAIN ] NDMO: Loaded 16978 primary data records. [2025-09-26T22:25:16.334305] [DEBUG] [LOCAL ] NEA: Loaded 35808 existing records from primary storage. [2025-09-26T22:25:16.346754] [INFO ] [MAIN ] NEA: Loaded 35808 primary data records. [2025-09-26T22:25:16.361022] [DEBUG] [LOCAL ] NE: Loaded 53157 existing records from primary storage. [2025-09-26T22:25:16.389561] [INFO ] [MAIN ] NE: Loaded 53157 primary data records. [2025-09-26T22:25:17.055143] [DEBUG] [MAIN ] NDMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:17.056233] [INFO ] [MAIN ] NDMO: Generated 1820 derivative records from 16978 primary records. [2025-09-26T22:25:17.056442] [DEBUG] [LOCAL ] NDMO: Saving derivative data. [2025-09-26T22:25:17.080711] [DEBUG] [LOCAL ] NDMO: Derivative data saved (1820 records). [2025-09-26T22:25:17.081052] [INFO ] [MAIN ] NDMO: Successfully saved derivative data. [2025-09-26T22:25:17.084021] [INFO ] [MAIN ] Derivative Progress: 1270/2074 symbols completed. NDMO took 1.2s. Estimated remaining: 5m 35s. Rate: 144.0 symbols/min [2025-09-26T22:25:17.084743] [INFO ] [MAIN ] NET: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:17.102517] [DEBUG] [MAIN ] NEA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:17.106365] [INFO ] [MAIN ] NEA: Generated 1820 derivative records from 35808 primary records. [2025-09-26T22:25:17.106776] [DEBUG] [LOCAL ] NEA: Saving derivative data. [2025-09-26T22:25:17.136901] [DEBUG] [LOCAL ] NEA: Derivative data saved (1820 records). [2025-09-26T22:25:17.135797] [DEBUG] [MAIN ] NE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:17.137852] [INFO ] [MAIN ] NE: Generated 1820 derivative records from 53157 primary records. [2025-09-26T22:25:17.138016] [DEBUG] [LOCAL ] NE: Saving derivative data. [2025-09-26T22:25:17.137090] [INFO ] [MAIN ] NEA: Successfully saved derivative data. [2025-09-26T22:25:17.140263] [INFO ] [MAIN ] Derivative Progress: 1271/2074 symbols completed. NEA took 1.2s. Estimated remaining: 5m 34s. Rate: 144.1 symbols/min [2025-09-26T22:25:17.142095] [INFO ] [MAIN ] NEU: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:17.160395] [DEBUG] [LOCAL ] NE: Derivative data saved (1820 records). [2025-09-26T22:25:17.162592] [INFO ] [MAIN ] NE: Successfully saved derivative data. [2025-09-26T22:25:17.165533] [INFO ] [MAIN ] Derivative Progress: 1272/2074 symbols completed. NE took 1.2s. Estimated remaining: 5m 34s. Rate: 144.2 symbols/min [2025-09-26T22:25:17.166164] [INFO ] [MAIN ] NEUE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:17.195755] [DEBUG] [LOCAL ] NEUE: Loaded 2271 existing records from primary storage. [2025-09-26T22:25:17.195980] [INFO ] [MAIN ] NEUE: Loaded 2271 primary data records. [2025-09-26T22:25:17.208592] [DEBUG] [LOCAL ] NEU: Loaded 8259 existing records from primary storage. [2025-09-26T22:25:17.250818] [INFO ] [MAIN ] NEU: Loaded 8259 primary data records. [2025-09-26T22:25:17.410262] [DEBUG] [LOCAL ] NET: Loaded 53808 existing records from primary storage. [2025-09-26T22:25:17.449268] [INFO ] [MAIN ] NET: Loaded 53808 primary data records. [2025-09-26T22:25:18.538242] [DEBUG] [MAIN ] NEU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:18.537860] [DEBUG] [MAIN ] NEUE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:18.540972] [INFO ] [MAIN ] NEUE: Generated 1820 derivative records from 2271 primary records. [2025-09-26T22:25:18.539250] [INFO ] [MAIN ] NEU: Generated 1820 derivative records from 8259 primary records. [2025-09-26T22:25:18.541946] [DEBUG] [LOCAL ] NEU: Saving derivative data. [2025-09-26T22:25:18.542088] [DEBUG] [LOCAL ] NEUE: Saving derivative data. [2025-09-26T22:25:18.581886] [DEBUG] [MAIN ] NET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:18.595811] [INFO ] [MAIN ] NET: Generated 1820 derivative records from 53808 primary records. [2025-09-26T22:25:18.595892] [DEBUG] [LOCAL ] NEU: Derivative data saved (1820 records). [2025-09-26T22:25:18.590099] [DEBUG] [LOCAL ] NEUE: Derivative data saved (1820 records). [2025-09-26T22:25:18.596109] [INFO ] [MAIN ] NEU: Successfully saved derivative data. [2025-09-26T22:25:18.596379] [INFO ] [MAIN ] NEUE: Successfully saved derivative data. [2025-09-26T22:25:18.596249] [DEBUG] [LOCAL ] NET: Saving derivative data. [2025-09-26T22:25:18.600825] [INFO ] [MAIN ] Derivative Progress: 1273/2074 symbols completed. NEUE took 1.4s. Estimated remaining: 5m 34s. Rate: 144.0 symbols/min [2025-09-26T22:25:18.605794] [INFO ] [MAIN ] Derivative Progress: 1274/2074 symbols completed. NEU took 1.5s. Estimated remaining: 5m 33s. Rate: 144.1 symbols/min [2025-09-26T22:25:18.625256] [DEBUG] [LOCAL ] NET: Derivative data saved (1820 records). [2025-09-26T22:25:18.625390] [INFO ] [MAIN ] NET: Successfully saved derivative data. [2025-09-26T22:25:18.628573] [INFO ] [MAIN ] Derivative Progress: 1275/2074 symbols completed. NET took 1.5s. Estimated remaining: 5m 33s. Rate: 144.2 symbols/min [2025-09-26T22:25:18.629477] [INFO ] [MAIN ] NEXA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:18.629589] [INFO ] [MAIN ] NFJ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:18.629734] [INFO ] [MAIN ] NFG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:18.638777] [DEBUG] [LOCAL ] NEXA: Loaded 4307 existing records from primary storage. [2025-09-26T22:25:18.639011] [INFO ] [MAIN ] NEXA: Loaded 4307 primary data records. [2025-09-26T22:25:18.786238] [DEBUG] [LOCAL ] NFJ: Loaded 20592 existing records from primary storage. [2025-09-26T22:25:18.786948] [INFO ] [MAIN ] NFJ: Loaded 20592 primary data records. [2025-09-26T22:25:18.977437] [DEBUG] [LOCAL ] NFG: Loaded 39084 existing records from primary storage. [2025-09-26T22:25:19.121048] [INFO ] [MAIN ] NFG: Loaded 39084 primary data records. [2025-09-26T22:25:19.740669] [DEBUG] [MAIN ] NEXA: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:25:19.742479] [INFO ] [MAIN ] NEXA: Generated 1819 derivative records from 4307 primary records. [2025-09-26T22:25:19.742638] [DEBUG] [LOCAL ] NEXA: Saving derivative data. [2025-09-26T22:25:19.760837] [DEBUG] [LOCAL ] NEXA: Derivative data saved (1819 records). [2025-09-26T22:25:19.761574] [INFO ] [MAIN ] NEXA: Successfully saved derivative data. [2025-09-26T22:25:19.764114] [INFO ] [MAIN ] Derivative Progress: 1276/2074 symbols completed. NEXA took 1.1s. Estimated remaining: 5m 33s. Rate: 144.0 symbols/min [2025-09-26T22:25:19.764829] [INFO ] [MAIN ] NGG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:19.785495] [DEBUG] [MAIN ] NFJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:19.786888] [INFO ] [MAIN ] NFJ: Generated 1820 derivative records from 20592 primary records. [2025-09-26T22:25:19.787201] [DEBUG] [LOCAL ] NFJ: Saving derivative data. [2025-09-26T22:25:19.810798] [DEBUG] [LOCAL ] NFJ: Derivative data saved (1820 records). [2025-09-26T22:25:19.811249] [INFO ] [MAIN ] NFJ: Successfully saved derivative data. [2025-09-26T22:25:19.814025] [INFO ] [MAIN ] Derivative Progress: 1277/2074 symbols completed. NFJ took 1.2s. Estimated remaining: 5m 32s. Rate: 144.1 symbols/min [2025-09-26T22:25:19.822074] [INFO ] [MAIN ] NGL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:19.827838] [DEBUG] [MAIN ] NFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:19.828519] [INFO ] [MAIN ] NFG: Generated 1820 derivative records from 39084 primary records. [2025-09-26T22:25:19.828710] [DEBUG] [LOCAL ] NFG: Saving derivative data. [2025-09-26T22:25:19.859553] [DEBUG] [LOCAL ] NFG: Derivative data saved (1820 records). [2025-09-26T22:25:19.881108] [INFO ] [MAIN ] NFG: Successfully saved derivative data. [2025-09-26T22:25:19.884368] [INFO ] [MAIN ] Derivative Progress: 1278/2074 symbols completed. NFG took 1.3s. Estimated remaining: 5m 31s. Rate: 144.2 symbols/min [2025-09-26T22:25:19.885806] [DEBUG] [LOCAL ] NGG: Loaded 46809 existing records from primary storage. [2025-09-26T22:25:19.886150] [INFO ] [MAIN ] NGS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:19.886253] [INFO ] [MAIN ] NGG: Loaded 46809 primary data records. [2025-09-26T22:25:20.035481] [DEBUG] [LOCAL ] NGS: Loaded 11682 existing records from primary storage. [2025-09-26T22:25:20.036183] [DEBUG] [LOCAL ] NGL: Loaded 30754 existing records from primary storage. [2025-09-26T22:25:20.036422] [INFO ] [MAIN ] NGL: Loaded 30754 primary data records. [2025-09-26T22:25:20.036355] [INFO ] [MAIN ] NGS: Loaded 11682 primary data records. [2025-09-26T22:25:20.996856] [DEBUG] [MAIN ] NGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:21.011093] [INFO ] [MAIN ] NGS: Generated 1820 derivative records from 11682 primary records. [2025-09-26T22:25:21.011323] [DEBUG] [LOCAL ] NGS: Saving derivative data. [2025-09-26T22:25:21.012680] [DEBUG] [MAIN ] NGG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:21.014958] [INFO ] [MAIN ] NGG: Generated 1820 derivative records from 46809 primary records. [2025-09-26T22:25:21.015565] [DEBUG] [LOCAL ] NGG: Saving derivative data. [2025-09-26T22:25:21.052026] [DEBUG] [LOCAL ] NGS: Derivative data saved (1820 records). [2025-09-26T22:25:21.059428] [DEBUG] [MAIN ] NGL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:21.059218] [INFO ] [MAIN ] NGS: Successfully saved derivative data. [2025-09-26T22:25:21.062010] [DEBUG] [LOCAL ] NGG: Derivative data saved (1820 records). [2025-09-26T22:25:21.065766] [INFO ] [MAIN ] Derivative Progress: 1279/2074 symbols completed. NGS took 1.2s. Estimated remaining: 5m 31s. Rate: 144.0 symbols/min [2025-09-26T22:25:21.062770] [INFO ] [MAIN ] NGL: Generated 1820 derivative records from 30754 primary records. [2025-09-26T22:25:21.065930] [INFO ] [MAIN ] NGG: Successfully saved derivative data. [2025-09-26T22:25:21.068502] [INFO ] [MAIN ] Derivative Progress: 1280/2074 symbols completed. NGG took 1.3s. Estimated remaining: 5m 31s. Rate: 144.1 symbols/min [2025-09-26T22:25:21.068600] [DEBUG] [LOCAL ] NGL: Saving derivative data. [2025-09-26T22:25:21.068807] [INFO ] [MAIN ] NGVC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:21.069263] [INFO ] [MAIN ] NGVT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:21.087425] [DEBUG] [LOCAL ] NGL: Derivative data saved (1820 records). [2025-09-26T22:25:21.087674] [INFO ] [MAIN ] NGL: Successfully saved derivative data. [2025-09-26T22:25:21.090535] [INFO ] [MAIN ] Derivative Progress: 1281/2074 symbols completed. NGL took 1.3s. Estimated remaining: 5m 30s. Rate: 144.2 symbols/min [2025-09-26T22:25:21.090909] [INFO ] [MAIN ] NHI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:21.115487] [DEBUG] [LOCAL ] NGVT: Loaded 24631 existing records from primary storage. [2025-09-26T22:25:21.115732] [INFO ] [MAIN ] NGVT: Loaded 24631 primary data records. [2025-09-26T22:25:21.180322] [DEBUG] [LOCAL ] NGVC: Loaded 22650 existing records from primary storage. [2025-09-26T22:25:21.235619] [DEBUG] [LOCAL ] NHI: Loaded 22283 existing records from primary storage. [2025-09-26T22:25:21.242972] [INFO ] [MAIN ] NHI: Loaded 22283 primary data records. [2025-09-26T22:25:21.242790] [INFO ] [MAIN ] NGVC: Loaded 22650 primary data records. [2025-09-26T22:25:22.164508] [DEBUG] [MAIN ] NGVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:22.166144] [INFO ] [MAIN ] NGVT: Generated 1820 derivative records from 24631 primary records. [2025-09-26T22:25:22.166917] [DEBUG] [LOCAL ] NGVT: Saving derivative data. [2025-09-26T22:25:22.190470] [DEBUG] [LOCAL ] NGVT: Derivative data saved (1820 records). [2025-09-26T22:25:22.190688] [INFO ] [MAIN ] NGVT: Successfully saved derivative data. [2025-09-26T22:25:22.193664] [INFO ] [MAIN ] Derivative Progress: 1282/2074 symbols completed. NGVT took 1.1s. Estimated remaining: 5m 30s. Rate: 144.0 symbols/min [2025-09-26T22:25:22.201987] [INFO ] [MAIN ] NIC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:22.209942] [DEBUG] [MAIN ] NHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:22.211876] [INFO ] [MAIN ] NHI: Generated 1820 derivative records from 22283 primary records. [2025-09-26T22:25:22.212248] [DEBUG] [LOCAL ] NHI: Saving derivative data. [2025-09-26T22:25:22.244503] [DEBUG] [LOCAL ] NHI: Derivative data saved (1820 records). [2025-09-26T22:25:22.244628] [INFO ] [MAIN ] NHI: Successfully saved derivative data. [2025-09-26T22:25:22.239322] [DEBUG] [MAIN ] NGVC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:22.248616] [INFO ] [MAIN ] NGVC: Generated 1820 derivative records from 22650 primary records. [2025-09-26T22:25:22.247499] [INFO ] [MAIN ] Derivative Progress: 1283/2074 symbols completed. NHI took 1.2s. Estimated remaining: 5m 29s. Rate: 144.1 symbols/min [2025-09-26T22:25:22.248994] [INFO ] [MAIN ] NIE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:22.249224] [DEBUG] [LOCAL ] NGVC: Saving derivative data. [2025-09-26T22:25:22.255411] [DEBUG] [LOCAL ] NIC: Loaded 9026 existing records from primary storage. [2025-09-26T22:25:22.262888] [INFO ] [MAIN ] NIC: Loaded 9026 primary data records. [2025-09-26T22:25:22.349535] [DEBUG] [LOCAL ] NIE: Loaded 11869 existing records from primary storage. [2025-09-26T22:25:22.370177] [INFO ] [MAIN ] NIE: Loaded 11869 primary data records. [2025-09-26T22:25:22.370393] [DEBUG] [LOCAL ] NGVC: Derivative data saved (1820 records). [2025-09-26T22:25:22.429247] [INFO ] [MAIN ] NGVC: Successfully saved derivative data. [2025-09-26T22:25:22.432288] [INFO ] [MAIN ] Derivative Progress: 1284/2074 symbols completed. NGVC took 1.4s. Estimated remaining: 5m 29s. Rate: 144.2 symbols/min [2025-09-26T22:25:22.443343] [INFO ] [MAIN ] NIM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:22.619191] [DEBUG] [LOCAL ] NIM: Loaded 4149 existing records from primary storage. [2025-09-26T22:25:22.858626] [INFO ] [MAIN ] NIM: Loaded 4149 primary data records. [2025-09-26T22:25:23.326236] [DEBUG] [MAIN ] NIC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:23.328476] [INFO ] [MAIN ] NIC: Generated 1820 derivative records from 9026 primary records. [2025-09-26T22:25:23.328610] [DEBUG] [LOCAL ] NIC: Saving derivative data. [2025-09-26T22:25:23.362176] [DEBUG] [MAIN ] NIE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:23.361846] [DEBUG] [LOCAL ] NIC: Derivative data saved (1820 records). [2025-09-26T22:25:23.362317] [INFO ] [MAIN ] NIC: Successfully saved derivative data. [2025-09-26T22:25:23.363077] [INFO ] [MAIN ] NIE: Generated 1820 derivative records from 11869 primary records. [2025-09-26T22:25:23.365811] [INFO ] [MAIN ] Derivative Progress: 1285/2074 symbols completed. NIC took 1.2s. Estimated remaining: 5m 29s. Rate: 144.0 symbols/min [2025-09-26T22:25:23.366168] [DEBUG] [LOCAL ] NIE: Saving derivative data. [2025-09-26T22:25:23.367580] [INFO ] [MAIN ] NINE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:23.385856] [DEBUG] [LOCAL ] NIE: Derivative data saved (1820 records). [2025-09-26T22:25:23.386086] [INFO ] [MAIN ] NIE: Successfully saved derivative data. [2025-09-26T22:25:23.389164] [INFO ] [MAIN ] Derivative Progress: 1286/2074 symbols completed. NIE took 1.1s. Estimated remaining: 5m 28s. Rate: 144.1 symbols/min [2025-09-26T22:25:23.389737] [INFO ] [MAIN ] NIO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:23.415219] [DEBUG] [MAIN ] NIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:23.416122] [INFO ] [MAIN ] NIM: Generated 1820 derivative records from 4149 primary records. [2025-09-26T22:25:23.416260] [DEBUG] [LOCAL ] NIM: Saving derivative data. [2025-09-26T22:25:23.439524] [DEBUG] [LOCAL ] NIM: Derivative data saved (1820 records). [2025-09-26T22:25:23.440753] [INFO ] [MAIN ] NIM: Successfully saved derivative data. [2025-09-26T22:25:23.445097] [DEBUG] [LOCAL ] NINE: Loaded 28624 existing records from primary storage. [2025-09-26T22:25:23.443972] [INFO ] [MAIN ] Derivative Progress: 1287/2074 symbols completed. NIM took 1.0s. Estimated remaining: 5m 27s. Rate: 144.2 symbols/min [2025-09-26T22:25:23.445404] [INFO ] [MAIN ] NJR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:23.445683] [INFO ] [MAIN ] NINE: Loaded 28624 primary data records. [2025-09-26T22:25:23.687815] [DEBUG] [LOCAL ] NIO: Loaded 54582 existing records from primary storage. [2025-09-26T22:25:23.700527] [INFO ] [MAIN ] NIO: Loaded 54582 primary data records. [2025-09-26T22:25:23.954130] [DEBUG] [LOCAL ] NJR: Loaded 38739 existing records from primary storage. [2025-09-26T22:25:23.970336] [INFO ] [MAIN ] NJR: Loaded 38739 primary data records. [2025-09-26T22:25:24.578512] [DEBUG] [MAIN ] NINE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:24.582100] [INFO ] [MAIN ] NINE: Generated 1820 derivative records from 28624 primary records. [2025-09-26T22:25:24.583394] [DEBUG] [LOCAL ] NINE: Saving derivative data. [2025-09-26T22:25:24.616459] [DEBUG] [LOCAL ] NINE: Derivative data saved (1820 records). [2025-09-26T22:25:24.619735] [INFO ] [MAIN ] NINE: Successfully saved derivative data. [2025-09-26T22:25:24.628130] [INFO ] [MAIN ] Derivative Progress: 1288/2074 symbols completed. NINE took 1.3s. Estimated remaining: 5m 27s. Rate: 144.0 symbols/min [2025-09-26T22:25:24.643770] [DEBUG] [MAIN ] NIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:24.645108] [INFO ] [MAIN ] NIO: Generated 1820 derivative records from 54582 primary records. [2025-09-26T22:25:24.645237] [DEBUG] [LOCAL ] NIO: Saving derivative data. [2025-09-26T22:25:24.680191] [DEBUG] [MAIN ] NJR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:24.682588] [INFO ] [MAIN ] NJR: Generated 1820 derivative records from 38739 primary records. [2025-09-26T22:25:24.684328] [DEBUG] [LOCAL ] NIO: Derivative data saved (1820 records). [2025-09-26T22:25:24.684497] [INFO ] [MAIN ] NIO: Successfully saved derivative data. [2025-09-26T22:25:24.684618] [DEBUG] [LOCAL ] NJR: Saving derivative data. [2025-09-26T22:25:24.693768] [INFO ] [MAIN ] Derivative Progress: 1289/2074 symbols completed. NIO took 1.3s. Estimated remaining: 5m 27s. Rate: 144.1 symbols/min [2025-09-26T22:25:24.714398] [DEBUG] [LOCAL ] NJR: Derivative data saved (1820 records). [2025-09-26T22:25:24.714669] [INFO ] [MAIN ] NJR: Successfully saved derivative data. [2025-09-26T22:25:24.725096] [INFO ] [MAIN ] Derivative Progress: 1290/2074 symbols completed. NJR took 1.3s. Estimated remaining: 5m 26s. Rate: 144.2 symbols/min [2025-09-26T22:25:24.726926] [INFO ] [MAIN ] NLY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:24.727277] [INFO ] [MAIN ] NLOP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:24.726609] [INFO ] [MAIN ] NKX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:24.755515] [DEBUG] [LOCAL ] NLOP: Loaded 11997 existing records from primary storage. [2025-09-26T22:25:24.760996] [INFO ] [MAIN ] NLOP: Loaded 11997 primary data records. [2025-09-26T22:25:24.861965] [DEBUG] [LOCAL ] NKX: Loaded 13801 existing records from primary storage. [2025-09-26T22:25:24.876728] [INFO ] [MAIN ] NKX: Loaded 13801 primary data records. [2025-09-26T22:25:25.288048] [DEBUG] [LOCAL ] NLY: Loaded 54358 existing records from primary storage. [2025-09-26T22:25:25.325859] [INFO ] [MAIN ] NLY: Loaded 54358 primary data records. [2025-09-26T22:25:25.865406] [DEBUG] [MAIN ] NLOP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:25.867684] [INFO ] [MAIN ] NLOP: Generated 1820 derivative records from 11997 primary records. [2025-09-26T22:25:25.869127] [DEBUG] [LOCAL ] NLOP: Saving derivative data. [2025-09-26T22:25:25.896717] [DEBUG] [MAIN ] NKX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:25.899110] [INFO ] [MAIN ] NKX: Generated 1820 derivative records from 13801 primary records. [2025-09-26T22:25:25.899806] [DEBUG] [LOCAL ] NKX: Saving derivative data. [2025-09-26T22:25:25.918037] [DEBUG] [LOCAL ] NLOP: Derivative data saved (1820 records). [2025-09-26T22:25:25.919528] [INFO ] [MAIN ] NLOP: Successfully saved derivative data. [2025-09-26T22:25:25.924633] [INFO ] [MAIN ] Derivative Progress: 1291/2074 symbols completed. NLOP took 1.2s. Estimated remaining: 5m 26s. Rate: 144.0 symbols/min [2025-09-26T22:25:25.925854] [INFO ] [MAIN ] NMAI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:25.931442] [DEBUG] [LOCAL ] NKX: Derivative data saved (1820 records). [2025-09-26T22:25:25.931583] [INFO ] [MAIN ] NKX: Successfully saved derivative data. [2025-09-26T22:25:25.934412] [INFO ] [MAIN ] Derivative Progress: 1292/2074 symbols completed. NKX took 1.2s. Estimated remaining: 5m 26s. Rate: 144.1 symbols/min [2025-09-26T22:25:25.934858] [INFO ] [MAIN ] NMCO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:25.956477] [DEBUG] [MAIN ] NLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:25.957688] [INFO ] [MAIN ] NLY: Generated 1820 derivative records from 54358 primary records. [2025-09-26T22:25:25.957956] [DEBUG] [LOCAL ] NLY: Saving derivative data. [2025-09-26T22:25:25.976235] [DEBUG] [LOCAL ] NMAI: Loaded 13181 existing records from primary storage. [2025-09-26T22:25:25.979443] [INFO ] [MAIN ] NMAI: Loaded 13181 primary data records. [2025-09-26T22:25:25.980916] [DEBUG] [LOCAL ] NLY: Derivative data saved (1820 records). [2025-09-26T22:25:26.004802] [INFO ] [MAIN ] NLY: Successfully saved derivative data. [2025-09-26T22:25:26.030725] [INFO ] [MAIN ] Derivative Progress: 1293/2074 symbols completed. NLY took 1.3s. Estimated remaining: 5m 25s. Rate: 144.2 symbols/min [2025-09-26T22:25:26.091035] [DEBUG] [LOCAL ] NMCO: Loaded 16803 existing records from primary storage. [2025-09-26T22:25:26.090359] [INFO ] [MAIN ] NMG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:26.104043] [INFO ] [MAIN ] NMCO: Loaded 16803 primary data records. [2025-09-26T22:25:26.434858] [DEBUG] [LOCAL ] NMG: Loaded 7913 existing records from primary storage. [2025-09-26T22:25:26.450528] [INFO ] [MAIN ] NMG: Loaded 7913 primary data records. [2025-09-26T22:25:27.101397] [DEBUG] [MAIN ] NMAI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:27.103144] [INFO ] [MAIN ] NMAI: Generated 1820 derivative records from 13181 primary records. [2025-09-26T22:25:27.104058] [DEBUG] [LOCAL ] NMAI: Saving derivative data. [2025-09-26T22:25:27.129402] [DEBUG] [MAIN ] NMCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:27.133067] [INFO ] [MAIN ] NMCO: Generated 1820 derivative records from 16803 primary records. [2025-09-26T22:25:27.134745] [DEBUG] [LOCAL ] NMCO: Saving derivative data. [2025-09-26T22:25:27.150611] [DEBUG] [LOCAL ] NMAI: Derivative data saved (1820 records). [2025-09-26T22:25:27.151206] [INFO ] [MAIN ] NMAI: Successfully saved derivative data. [2025-09-26T22:25:27.153876] [INFO ] [MAIN ] Derivative Progress: 1294/2074 symbols completed. NMAI took 1.2s. Estimated remaining: 5m 25s. Rate: 144.0 symbols/min [2025-09-26T22:25:27.154423] [INFO ] [MAIN ] NMI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:27.165900] [DEBUG] [LOCAL ] NMI: Loaded 4091 existing records from primary storage. [2025-09-26T22:25:27.167604] [DEBUG] [LOCAL ] NMCO: Derivative data saved (1820 records). [2025-09-26T22:25:27.167127] [INFO ] [MAIN ] NMI: Loaded 4091 primary data records. [2025-09-26T22:25:27.167801] [INFO ] [MAIN ] NMCO: Successfully saved derivative data. [2025-09-26T22:25:27.170826] [INFO ] [MAIN ] Derivative Progress: 1295/2074 symbols completed. NMCO took 1.2s. Estimated remaining: 5m 24s. Rate: 144.1 symbols/min [2025-09-26T22:25:27.184410] [INFO ] [MAIN ] NMM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:27.231048] [DEBUG] [MAIN ] NMG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:27.271157] [INFO ] [MAIN ] NMG: Generated 1820 derivative records from 7913 primary records. [2025-09-26T22:25:27.298834] [DEBUG] [LOCAL ] NMG: Saving derivative data. [2025-09-26T22:25:27.399821] [DEBUG] [LOCAL ] NMM: Loaded 14470 existing records from primary storage. [2025-09-26T22:25:27.410442] [INFO ] [MAIN ] NMM: Loaded 14470 primary data records. [2025-09-26T22:25:27.668162] [DEBUG] [LOCAL ] NMG: Derivative data saved (1820 records). [2025-09-26T22:25:27.679549] [INFO ] [MAIN ] NMG: Successfully saved derivative data. [2025-09-26T22:25:27.722068] [INFO ] [MAIN ] Derivative Progress: 1296/2074 symbols completed. NMG took 1.6s. Estimated remaining: 5m 24s. Rate: 144.1 symbols/min [2025-09-26T22:25:27.756578] [INFO ] [MAIN ] NMR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:27.912725] [DEBUG] [MAIN ] NMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:27.914121] [INFO ] [MAIN ] NMI: Generated 1820 derivative records from 4091 primary records. [2025-09-26T22:25:27.914445] [DEBUG] [LOCAL ] NMI: Saving derivative data. [2025-09-26T22:25:27.942758] [DEBUG] [LOCAL ] NMI: Derivative data saved (1820 records). [2025-09-26T22:25:27.943368] [INFO ] [MAIN ] NMI: Successfully saved derivative data. [2025-09-26T22:25:27.946705] [INFO ] [MAIN ] Derivative Progress: 1297/2074 symbols completed. NMI took 0.8s. Estimated remaining: 5m 23s. Rate: 144.1 symbols/min [2025-09-26T22:25:27.947398] [INFO ] [MAIN ] NMS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:27.953914] [DEBUG] [LOCAL ] NMS: Loaded 2893 existing records from primary storage. [2025-09-26T22:25:27.954540] [INFO ] [MAIN ] NMS: Loaded 2893 primary data records. [2025-09-26T22:25:28.008875] [DEBUG] [LOCAL ] NMR: Loaded 35569 existing records from primary storage. [2025-09-26T22:25:28.059275] [INFO ] [MAIN ] NMR: Loaded 35569 primary data records. [2025-09-26T22:25:28.123212] [DEBUG] [MAIN ] NMM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:28.156590] [INFO ] [MAIN ] NMM: Generated 1820 derivative records from 14470 primary records. [2025-09-26T22:25:28.180505] [DEBUG] [LOCAL ] NMM: Saving derivative data. [2025-09-26T22:25:28.544212] [DEBUG] [LOCAL ] NMM: Derivative data saved (1820 records). [2025-09-26T22:25:28.597308] [INFO ] [MAIN ] NMM: Successfully saved derivative data. [2025-09-26T22:25:28.603811] [INFO ] [MAIN ] Derivative Progress: 1298/2074 symbols completed. NMM took 1.4s. Estimated remaining: 5m 23s. Rate: 144.1 symbols/min [2025-09-26T22:25:28.797161] [INFO ] [MAIN ] NMT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:28.805125] [DEBUG] [LOCAL ] NMT: Loaded 2884 existing records from primary storage. [2025-09-26T22:25:28.806372] [INFO ] [MAIN ] NMT: Loaded 2884 primary data records. [2025-09-26T22:25:28.997349] [DEBUG] [MAIN ] NMS: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-09-26T22:25:29.023267] [INFO ] [MAIN ] NMS: Generated 1818 derivative records from 2893 primary records. [2025-09-26T22:25:29.025214] [DEBUG] [LOCAL ] NMS: Saving derivative data. [2025-09-26T22:25:29.178667] [DEBUG] [MAIN ] NMR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:29.180526] [INFO ] [MAIN ] NMR: Generated 1820 derivative records from 35569 primary records. [2025-09-26T22:25:29.181429] [DEBUG] [LOCAL ] NMR: Saving derivative data. [2025-09-26T22:25:29.201173] [DEBUG] [LOCAL ] NMR: Derivative data saved (1820 records). [2025-09-26T22:25:29.201931] [INFO ] [MAIN ] NMR: Successfully saved derivative data. [2025-09-26T22:25:29.204913] [INFO ] [MAIN ] Derivative Progress: 1299/2074 symbols completed. NMR took 1.4s. Estimated remaining: 5m 23s. Rate: 144.0 symbols/min [2025-09-26T22:25:29.202051] [DEBUG] [LOCAL ] NMS: Derivative data saved (1818 records). [2025-09-26T22:25:29.205481] [INFO ] [MAIN ] NMS: Successfully saved derivative data. [2025-09-26T22:25:29.205580] [INFO ] [MAIN ] NMZ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:29.208418] [INFO ] [MAIN ] Derivative Progress: 1300/2074 symbols completed. NMS took 1.3s. Estimated remaining: 5m 22s. Rate: 144.1 symbols/min [2025-09-26T22:25:29.211079] [INFO ] [MAIN ] NNI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:29.251035] [DEBUG] [LOCAL ] NNI: Loaded 10159 existing records from primary storage. [2025-09-26T22:25:29.250946] [DEBUG] [MAIN ] NMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:29.251861] [INFO ] [MAIN ] NMT: Generated 1820 derivative records from 2884 primary records. [2025-09-26T22:25:29.251953] [DEBUG] [LOCAL ] NMT: Saving derivative data. [2025-09-26T22:25:29.252026] [INFO ] [MAIN ] NNI: Loaded 10159 primary data records. [2025-09-26T22:25:29.324779] [DEBUG] [LOCAL ] NMZ: Loaded 21872 existing records from primary storage. [2025-09-26T22:25:29.343675] [INFO ] [MAIN ] NMZ: Loaded 21872 primary data records. [2025-09-26T22:25:29.478265] [DEBUG] [LOCAL ] NMT: Derivative data saved (1820 records). [2025-09-26T22:25:29.531760] [INFO ] [MAIN ] NMT: Successfully saved derivative data. [2025-09-26T22:25:29.597598] [INFO ] [MAIN ] Derivative Progress: 1301/2074 symbols completed. NMT took 0.8s. Estimated remaining: 5m 22s. Rate: 144.1 symbols/min [2025-09-26T22:25:29.748815] [INFO ] [MAIN ] NNN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:29.973311] [DEBUG] [MAIN ] NNI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:29.974260] [INFO ] [MAIN ] NNI: Generated 1820 derivative records from 10159 primary records. [2025-09-26T22:25:29.974693] [DEBUG] [LOCAL ] NNI: Saving derivative data. [2025-09-26T22:25:30.019765] [DEBUG] [MAIN ] NMZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:30.021530] [INFO ] [MAIN ] NMZ: Generated 1820 derivative records from 21872 primary records. [2025-09-26T22:25:30.021750] [DEBUG] [LOCAL ] NMZ: Saving derivative data. [2025-09-26T22:25:30.022182] [DEBUG] [LOCAL ] NNI: Derivative data saved (1820 records). [2025-09-26T22:25:30.022418] [INFO ] [MAIN ] NNI: Successfully saved derivative data. [2025-09-26T22:25:30.025052] [INFO ] [MAIN ] Derivative Progress: 1302/2074 symbols completed. NNI took 0.8s. Estimated remaining: 5m 21s. Rate: 144.1 symbols/min [2025-09-26T22:25:30.026380] [INFO ] [MAIN ] NNY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:30.055392] [DEBUG] [LOCAL ] NNN: Loaded 49151 existing records from primary storage. [2025-09-26T22:25:30.057398] [INFO ] [MAIN ] NNN: Loaded 49151 primary data records. [2025-09-26T22:25:30.085523] [DEBUG] [LOCAL ] NNY: Loaded 5750 existing records from primary storage. [2025-09-26T22:25:30.102297] [INFO ] [MAIN ] NNY: Loaded 5750 primary data records. [2025-09-26T22:25:30.194320] [DEBUG] [LOCAL ] NMZ: Derivative data saved (1820 records). [2025-09-26T22:25:30.229388] [INFO ] [MAIN ] NMZ: Successfully saved derivative data. [2025-09-26T22:25:30.278758] [INFO ] [MAIN ] Derivative Progress: 1303/2074 symbols completed. NMZ took 1.1s. Estimated remaining: 5m 21s. Rate: 144.2 symbols/min [2025-09-26T22:25:30.771098] [DEBUG] [MAIN ] NNN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:30.774012] [INFO ] [MAIN ] NNN: Generated 1820 derivative records from 49151 primary records. [2025-09-26T22:25:30.774349] [DEBUG] [LOCAL ] NNN: Saving derivative data. [2025-09-26T22:25:30.789595] [DEBUG] [MAIN ] NNY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:30.798381] [INFO ] [MAIN ] NNY: Generated 1820 derivative records from 5750 primary records. [2025-09-26T22:25:30.802516] [DEBUG] [LOCAL ] NNY: Saving derivative data. [2025-09-26T22:25:30.823766] [DEBUG] [LOCAL ] NNY: Derivative data saved (1820 records). [2025-09-26T22:25:30.824418] [INFO ] [MAIN ] NNY: Successfully saved derivative data. [2025-09-26T22:25:30.824235] [DEBUG] [LOCAL ] NNN: Derivative data saved (1820 records). [2025-09-26T22:25:30.831702] [INFO ] [MAIN ] NNN: Successfully saved derivative data. [2025-09-26T22:25:30.831578] [INFO ] [MAIN ] Derivative Progress: 1304/2074 symbols completed. NNY took 0.8s. Estimated remaining: 5m 21s. Rate: 144.1 symbols/min [2025-09-26T22:25:30.835043] [INFO ] [MAIN ] Derivative Progress: 1305/2074 symbols completed. NNN took 1.1s. Estimated remaining: 5m 20s. Rate: 144.3 symbols/min [2025-09-26T22:25:30.836141] [INFO ] [MAIN ] NOC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:30.835866] [INFO ] [MAIN ] NOA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:30.836932] [INFO ] [MAIN ] NOAH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:30.870427] [DEBUG] [LOCAL ] NOAH: Loaded 20358 existing records from primary storage. [2025-09-26T22:25:30.879165] [DEBUG] [LOCAL ] NOA: Loaded 16497 existing records from primary storage. [2025-09-26T22:25:30.879358] [INFO ] [MAIN ] NOAH: Loaded 20358 primary data records. [2025-09-26T22:25:30.880032] [INFO ] [MAIN ] NOA: Loaded 16497 primary data records. [2025-09-26T22:25:31.254020] [DEBUG] [LOCAL ] NOC: Loaded 43141 existing records from primary storage. [2025-09-26T22:25:31.359795] [INFO ] [MAIN ] NOC: Loaded 43141 primary data records. [2025-09-26T22:25:32.017706] [DEBUG] [MAIN ] NOA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:32.027400] [INFO ] [MAIN ] NOA: Generated 1820 derivative records from 16497 primary records. [2025-09-26T22:25:32.033453] [DEBUG] [MAIN ] NOAH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:32.034303] [DEBUG] [LOCAL ] NOA: Saving derivative data. [2025-09-26T22:25:32.034219] [INFO ] [MAIN ] NOAH: Generated 1820 derivative records from 20358 primary records. [2025-09-26T22:25:32.035330] [DEBUG] [LOCAL ] NOAH: Saving derivative data. [2025-09-26T22:25:32.071936] [DEBUG] [LOCAL ] NOAH: Derivative data saved (1820 records). [2025-09-26T22:25:32.073127] [INFO ] [MAIN ] NOAH: Successfully saved derivative data. [2025-09-26T22:25:32.076098] [INFO ] [MAIN ] Derivative Progress: 1306/2074 symbols completed. NOAH took 1.2s. Estimated remaining: 5m 20s. Rate: 144.0 symbols/min [2025-09-26T22:25:32.071835] [DEBUG] [LOCAL ] NOA: Derivative data saved (1820 records). [2025-09-26T22:25:32.077768] [INFO ] [MAIN ] NOA: Successfully saved derivative data. [2025-09-26T22:25:32.077670] [INFO ] [MAIN ] NOG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:32.080908] [INFO ] [MAIN ] Derivative Progress: 1307/2074 symbols completed. NOA took 1.2s. Estimated remaining: 5m 19s. Rate: 144.1 symbols/min [2025-09-26T22:25:32.082206] [INFO ] [MAIN ] NOK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:32.099214] [DEBUG] [MAIN ] NOC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:32.100227] [INFO ] [MAIN ] NOC: Generated 1820 derivative records from 43141 primary records. [2025-09-26T22:25:32.100367] [DEBUG] [LOCAL ] NOC: Saving derivative data. [2025-09-26T22:25:32.118296] [DEBUG] [LOCAL ] NOC: Derivative data saved (1820 records). [2025-09-26T22:25:32.118464] [INFO ] [MAIN ] NOC: Successfully saved derivative data. [2025-09-26T22:25:32.121483] [INFO ] [MAIN ] Derivative Progress: 1308/2074 symbols completed. NOC took 1.3s. Estimated remaining: 5m 19s. Rate: 144.2 symbols/min [2025-09-26T22:25:32.121943] [INFO ] [MAIN ] NOMD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:32.210103] [DEBUG] [LOCAL ] NOK: Loaded 54401 existing records from primary storage. [2025-09-26T22:25:32.211611] [INFO ] [MAIN ] NOK: Loaded 54401 primary data records. [2025-09-26T22:25:32.217788] [DEBUG] [LOCAL ] NOG: Loaded 51932 existing records from primary storage. [2025-09-26T22:25:32.225450] [INFO ] [MAIN ] NOG: Loaded 51932 primary data records. [2025-09-26T22:25:32.375000] [DEBUG] [LOCAL ] NOMD: Loaded 42016 existing records from primary storage. [2025-09-26T22:25:32.451915] [INFO ] [MAIN ] NOMD: Loaded 42016 primary data records. [2025-09-26T22:25:33.326360] [DEBUG] [MAIN ] NOK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:33.332534] [DEBUG] [MAIN ] NOG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:33.333472] [INFO ] [MAIN ] NOK: Generated 1820 derivative records from 54401 primary records. [2025-09-26T22:25:33.333772] [DEBUG] [LOCAL ] NOK: Saving derivative data. [2025-09-26T22:25:33.334626] [INFO ] [MAIN ] NOG: Generated 1820 derivative records from 51932 primary records. [2025-09-26T22:25:33.335600] [DEBUG] [LOCAL ] NOG: Saving derivative data. [2025-09-26T22:25:33.367748] [DEBUG] [LOCAL ] NOK: Derivative data saved (1820 records). [2025-09-26T22:25:33.370875] [DEBUG] [LOCAL ] NOG: Derivative data saved (1820 records). [2025-09-26T22:25:33.371928] [INFO ] [MAIN ] NOG: Successfully saved derivative data. [2025-09-26T22:25:33.374177] [INFO ] [MAIN ] NOK: Successfully saved derivative data. [2025-09-26T22:25:33.374069] [INFO ] [MAIN ] Derivative Progress: 1309/2074 symbols completed. NOG took 1.3s. Estimated remaining: 5m 19s. Rate: 144.0 symbols/min [2025-09-26T22:25:33.374515] [INFO ] [MAIN ] NOTE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:33.377392] [INFO ] [MAIN ] Derivative Progress: 1310/2074 symbols completed. NOK took 1.3s. Estimated remaining: 5m 18s. Rate: 144.1 symbols/min [2025-09-26T22:25:33.378169] [INFO ] [MAIN ] NOV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:33.393175] [DEBUG] [MAIN ] NOMD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:33.394207] [INFO ] [MAIN ] NOMD: Generated 1820 derivative records from 42016 primary records. [2025-09-26T22:25:33.394395] [DEBUG] [LOCAL ] NOMD: Saving derivative data. [2025-09-26T22:25:33.411997] [DEBUG] [LOCAL ] NOMD: Derivative data saved (1820 records). [2025-09-26T22:25:33.412185] [INFO ] [MAIN ] NOMD: Successfully saved derivative data. [2025-09-26T22:25:33.415040] [INFO ] [MAIN ] Derivative Progress: 1311/2074 symbols completed. NOMD took 1.3s. Estimated remaining: 5m 17s. Rate: 144.2 symbols/min [2025-09-26T22:25:33.415596] [INFO ] [MAIN ] NPCT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:33.437709] [DEBUG] [LOCAL ] NPCT: Loaded 17114 existing records from primary storage. [2025-09-26T22:25:33.437853] [INFO ] [MAIN ] NPCT: Loaded 17114 primary data records. [2025-09-26T22:25:33.703183] [DEBUG] [LOCAL ] NOTE: Loaded 43143 existing records from primary storage. [2025-09-26T22:25:33.768740] [DEBUG] [LOCAL ] NOV: Loaded 53961 existing records from primary storage. [2025-09-26T22:25:33.823019] [INFO ] [MAIN ] NOTE: Loaded 43143 primary data records. [2025-09-26T22:25:33.823334] [INFO ] [MAIN ] NOV: Loaded 53961 primary data records. [2025-09-26T22:25:34.533068] [DEBUG] [MAIN ] NPCT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:34.534590] [INFO ] [MAIN ] NPCT: Generated 1820 derivative records from 17114 primary records. [2025-09-26T22:25:34.535273] [DEBUG] [LOCAL ] NPCT: Saving derivative data. [2025-09-26T22:25:34.557259] [DEBUG] [LOCAL ] NPCT: Derivative data saved (1820 records). [2025-09-26T22:25:34.557527] [INFO ] [MAIN ] NPCT: Successfully saved derivative data. [2025-09-26T22:25:34.559586] [INFO ] [MAIN ] Derivative Progress: 1312/2074 symbols completed. NPCT took 1.1s. Estimated remaining: 5m 17s. Rate: 144.0 symbols/min [2025-09-26T22:25:34.560194] [INFO ] [MAIN ] NPFD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:34.592203] [DEBUG] [MAIN ] NOTE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:34.591785] [DEBUG] [MAIN ] NOV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:34.595424] [INFO ] [MAIN ] NOTE: Generated 1820 derivative records from 43143 primary records. [2025-09-26T22:25:34.595528] [DEBUG] [LOCAL ] NOTE: Saving derivative data. [2025-09-26T22:25:34.596238] [INFO ] [MAIN ] NOV: Generated 1820 derivative records from 53961 primary records. [2025-09-26T22:25:34.597119] [DEBUG] [LOCAL ] NOV: Saving derivative data. [2025-09-26T22:25:34.630074] [DEBUG] [LOCAL ] NOTE: Derivative data saved (1820 records). [2025-09-26T22:25:34.630874] [INFO ] [MAIN ] NOTE: Successfully saved derivative data. [2025-09-26T22:25:34.626345] [DEBUG] [LOCAL ] NPFD: Loaded 9814 existing records from primary storage. [2025-09-26T22:25:34.631881] [DEBUG] [LOCAL ] NOV: Derivative data saved (1820 records). [2025-09-26T22:25:34.634139] [INFO ] [MAIN ] Derivative Progress: 1313/2074 symbols completed. NOTE took 1.3s. Estimated remaining: 5m 17s. Rate: 144.1 symbols/min [2025-09-26T22:25:34.634575] [INFO ] [MAIN ] NOV: Successfully saved derivative data. [2025-09-26T22:25:34.634500] [INFO ] [MAIN ] NPK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:34.634868] [INFO ] [MAIN ] NPFD: Loaded 9814 primary data records. [2025-09-26T22:25:34.637921] [INFO ] [MAIN ] Derivative Progress: 1314/2074 symbols completed. NOV took 1.3s. Estimated remaining: 5m 16s. Rate: 144.2 symbols/min [2025-09-26T22:25:34.672476] [INFO ] [MAIN ] NPO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:34.760469] [DEBUG] [LOCAL ] NPK: Loaded 8120 existing records from primary storage. [2025-09-26T22:25:34.760694] [INFO ] [MAIN ] NPK: Loaded 8120 primary data records. [2025-09-26T22:25:34.957456] [DEBUG] [LOCAL ] NPO: Loaded 13019 existing records from primary storage. [2025-09-26T22:25:35.131393] [INFO ] [MAIN ] NPO: Loaded 13019 primary data records. [2025-09-26T22:25:35.767242] [DEBUG] [MAIN ] NPFD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:35.768543] [INFO ] [MAIN ] NPFD: Generated 1820 derivative records from 9814 primary records. [2025-09-26T22:25:35.768742] [DEBUG] [LOCAL ] NPFD: Saving derivative data. [2025-09-26T22:25:35.787877] [DEBUG] [LOCAL ] NPFD: Derivative data saved (1820 records). [2025-09-26T22:25:35.788358] [INFO ] [MAIN ] NPFD: Successfully saved derivative data. [2025-09-26T22:25:35.791893] [INFO ] [MAIN ] Derivative Progress: 1315/2074 symbols completed. NPFD took 1.2s. Estimated remaining: 5m 16s. Rate: 144.0 symbols/min [2025-09-26T22:25:35.794114] [INFO ] [MAIN ] NPV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:35.809957] [DEBUG] [MAIN ] NPK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:35.813202] [INFO ] [MAIN ] NPK: Generated 1820 derivative records from 8120 primary records. [2025-09-26T22:25:35.813414] [DEBUG] [LOCAL ] NPK: Saving derivative data. [2025-09-26T22:25:35.830537] [DEBUG] [LOCAL ] NPV: Loaded 5070 existing records from primary storage. [2025-09-26T22:25:35.831055] [INFO ] [MAIN ] NPV: Loaded 5070 primary data records. [2025-09-26T22:25:35.884013] [DEBUG] [MAIN ] NPO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:35.898696] [INFO ] [MAIN ] NPO: Generated 1820 derivative records from 13019 primary records. [2025-09-26T22:25:35.917427] [DEBUG] [LOCAL ] NPO: Saving derivative data. [2025-09-26T22:25:35.975890] [DEBUG] [LOCAL ] NPK: Derivative data saved (1820 records). [2025-09-26T22:25:35.979207] [INFO ] [MAIN ] NPK: Successfully saved derivative data. [2025-09-26T22:25:35.981796] [INFO ] [MAIN ] Derivative Progress: 1316/2074 symbols completed. NPK took 1.3s. Estimated remaining: 5m 16s. Rate: 144.1 symbols/min [2025-09-26T22:25:35.983227] [DEBUG] [LOCAL ] NPO: Derivative data saved (1820 records). [2025-09-26T22:25:35.984028] [INFO ] [MAIN ] NPO: Successfully saved derivative data. [2025-09-26T22:25:35.989435] [INFO ] [MAIN ] NPWR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:35.997474] [INFO ] [MAIN ] Derivative Progress: 1317/2074 symbols completed. NPO took 1.3s. Estimated remaining: 5m 15s. Rate: 144.2 symbols/min [2025-09-26T22:25:36.008509] [INFO ] [MAIN ] NQP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:36.216466] [DEBUG] [LOCAL ] NQP: Loaded 9406 existing records from primary storage. [2025-09-26T22:25:36.217302] [INFO ] [MAIN ] NQP: Loaded 9406 primary data records. [2025-09-26T22:25:36.435296] [DEBUG] [LOCAL ] NPWR: Loaded 43857 existing records from primary storage. [2025-09-26T22:25:36.442407] [INFO ] [MAIN ] NPWR: Loaded 43857 primary data records. [2025-09-26T22:25:36.781215] [DEBUG] [MAIN ] NPV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:36.932678] [INFO ] [MAIN ] NPV: Generated 1820 derivative records from 5070 primary records. [2025-09-26T22:25:36.933469] [DEBUG] [LOCAL ] NPV: Saving derivative data. [2025-09-26T22:25:36.951688] [DEBUG] [LOCAL ] NPV: Derivative data saved (1820 records). [2025-09-26T22:25:36.952690] [INFO ] [MAIN ] NPV: Successfully saved derivative data. [2025-09-26T22:25:36.955429] [INFO ] [MAIN ] Derivative Progress: 1318/2074 symbols completed. NPV took 1.2s. Estimated remaining: 5m 15s. Rate: 144.1 symbols/min [2025-09-26T22:25:36.972911] [DEBUG] [MAIN ] NQP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:36.973845] [INFO ] [MAIN ] NQP: Generated 1820 derivative records from 9406 primary records. [2025-09-26T22:25:36.974394] [DEBUG] [LOCAL ] NQP: Saving derivative data. [2025-09-26T22:25:36.993994] [DEBUG] [LOCAL ] NQP: Derivative data saved (1820 records). [2025-09-26T22:25:36.994221] [INFO ] [MAIN ] NQP: Successfully saved derivative data. [2025-09-26T22:25:36.996931] [INFO ] [MAIN ] Derivative Progress: 1319/2074 symbols completed. NQP took 1.0s. Estimated remaining: 5m 14s. Rate: 144.2 symbols/min [2025-09-26T22:25:37.011438] [DEBUG] [MAIN ] NPWR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:37.012218] [INFO ] [MAIN ] NPWR: Generated 1820 derivative records from 43857 primary records. [2025-09-26T22:25:37.012298] [DEBUG] [LOCAL ] NPWR: Saving derivative data. [2025-09-26T22:25:37.028548] [DEBUG] [LOCAL ] NPWR: Derivative data saved (1820 records). [2025-09-26T22:25:37.028720] [INFO ] [MAIN ] NPWR: Successfully saved derivative data. [2025-09-26T22:25:37.031255] [INFO ] [MAIN ] Derivative Progress: 1320/2074 symbols completed. NPWR took 1.0s. Estimated remaining: 5m 14s. Rate: 144.3 symbols/min [2025-09-26T22:25:37.032233] [INFO ] [MAIN ] NREF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:37.032156] [INFO ] [MAIN ] NRDY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:37.033473] [INFO ] [MAIN ] NRGV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:37.044305] [DEBUG] [LOCAL ] NREF: Loaded 7957 existing records from primary storage. [2025-09-26T22:25:37.044442] [INFO ] [MAIN ] NREF: Loaded 7957 primary data records. [2025-09-26T22:25:37.299892] [DEBUG] [LOCAL ] NRDY: Loaded 33402 existing records from primary storage. [2025-09-26T22:25:37.465121] [INFO ] [MAIN ] NRDY: Loaded 33402 primary data records. [2025-09-26T22:25:37.485923] [DEBUG] [LOCAL ] NRGV: Loaded 43716 existing records from primary storage. [2025-09-26T22:25:37.506572] [INFO ] [MAIN ] NRGV: Loaded 43716 primary data records. [2025-09-26T22:25:38.217990] [DEBUG] [MAIN ] NREF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:38.219763] [INFO ] [MAIN ] NREF: Generated 1820 derivative records from 7957 primary records. [2025-09-26T22:25:38.219961] [DEBUG] [LOCAL ] NREF: Saving derivative data. [2025-09-26T22:25:38.247188] [DEBUG] [LOCAL ] NREF: Derivative data saved (1820 records). [2025-09-26T22:25:38.248187] [INFO ] [MAIN ] NREF: Successfully saved derivative data. [2025-09-26T22:25:38.251740] [INFO ] [MAIN ] Derivative Progress: 1321/2074 symbols completed. NREF took 1.2s. Estimated remaining: 5m 14s. Rate: 144.1 symbols/min [2025-09-26T22:25:38.254447] [INFO ] [MAIN ] NRK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:38.271797] [DEBUG] [MAIN ] NRDY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:38.273982] [INFO ] [MAIN ] NRDY: Generated 1820 derivative records from 33402 primary records. [2025-09-26T22:25:38.274177] [DEBUG] [LOCAL ] NRDY: Saving derivative data. [2025-09-26T22:25:38.313503] [DEBUG] [MAIN ] NRGV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:38.320049] [DEBUG] [LOCAL ] NRDY: Derivative data saved (1820 records). [2025-09-26T22:25:38.321251] [INFO ] [MAIN ] NRGV: Generated 1820 derivative records from 43716 primary records. [2025-09-26T22:25:38.321944] [INFO ] [MAIN ] NRDY: Successfully saved derivative data. [2025-09-26T22:25:38.329076] [DEBUG] [LOCAL ] NRGV: Saving derivative data. [2025-09-26T22:25:38.331732] [INFO ] [MAIN ] Derivative Progress: 1322/2074 symbols completed. NRDY took 1.3s. Estimated remaining: 5m 13s. Rate: 144.1 symbols/min [2025-09-26T22:25:38.334310] [DEBUG] [LOCAL ] NRK: Loaded 19991 existing records from primary storage. [2025-09-26T22:25:38.332180] [INFO ] [MAIN ] NRP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:38.334761] [INFO ] [MAIN ] NRK: Loaded 19991 primary data records. [2025-09-26T22:25:38.373472] [DEBUG] [LOCAL ] NRGV: Derivative data saved (1820 records). [2025-09-26T22:25:38.397963] [INFO ] [MAIN ] NRGV: Successfully saved derivative data. [2025-09-26T22:25:38.413822] [INFO ] [MAIN ] Derivative Progress: 1323/2074 symbols completed. NRGV took 1.4s. Estimated remaining: 5m 12s. Rate: 144.2 symbols/min [2025-09-26T22:25:38.449554] [DEBUG] [LOCAL ] NRP: Loaded 4114 existing records from primary storage. [2025-09-26T22:25:38.462959] [INFO ] [MAIN ] NRT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:38.478440] [INFO ] [MAIN ] NRP: Loaded 4114 primary data records. [2025-09-26T22:25:38.661970] [DEBUG] [LOCAL ] NRT: Loaded 4994 existing records from primary storage. [2025-09-26T22:25:38.843082] [INFO ] [MAIN ] NRT: Loaded 4994 primary data records. [2025-09-26T22:25:39.403663] [DEBUG] [MAIN ] NRK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:39.405150] [INFO ] [MAIN ] NRK: Generated 1820 derivative records from 19991 primary records. [2025-09-26T22:25:39.405916] [DEBUG] [LOCAL ] NRK: Saving derivative data. [2025-09-26T22:25:39.425461] [DEBUG] [LOCAL ] NRK: Derivative data saved (1820 records). [2025-09-26T22:25:39.429592] [INFO ] [MAIN ] NRK: Successfully saved derivative data. [2025-09-26T22:25:39.432085] [INFO ] [MAIN ] Derivative Progress: 1324/2074 symbols completed. NRK took 1.2s. Estimated remaining: 5m 12s. Rate: 144.1 symbols/min [2025-09-26T22:25:39.432723] [INFO ] [MAIN ] NRUC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:39.447200] [DEBUG] [MAIN ] NRP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:39.449395] [INFO ] [MAIN ] NRP: Generated 1820 derivative records from 4114 primary records. [2025-09-26T22:25:39.449573] [DEBUG] [LOCAL ] NRP: Saving derivative data. [2025-09-26T22:25:39.454139] [DEBUG] [LOCAL ] NRUC: Loaded 3136 existing records from primary storage. [2025-09-26T22:25:39.467259] [INFO ] [MAIN ] NRUC: Loaded 3136 primary data records. [2025-09-26T22:25:39.492197] [DEBUG] [LOCAL ] NRP: Derivative data saved (1820 records). [2025-09-26T22:25:39.492572] [INFO ] [MAIN ] NRP: Successfully saved derivative data. [2025-09-26T22:25:39.508050] [INFO ] [MAIN ] Derivative Progress: 1325/2074 symbols completed. NRP took 1.2s. Estimated remaining: 5m 12s. Rate: 144.2 symbols/min [2025-09-26T22:25:39.521952] [INFO ] [MAIN ] NSA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:39.555483] [DEBUG] [MAIN ] NRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:39.583163] [INFO ] [MAIN ] NRT: Generated 1820 derivative records from 4994 primary records. [2025-09-26T22:25:39.595996] [DEBUG] [LOCAL ] NRT: Saving derivative data. [2025-09-26T22:25:39.904374] [DEBUG] [LOCAL ] NRT: Derivative data saved (1820 records). [2025-09-26T22:25:39.904552] [INFO ] [MAIN ] NRT: Successfully saved derivative data. [2025-09-26T22:25:39.908553] [INFO ] [MAIN ] Derivative Progress: 1326/2074 symbols completed. NRT took 1.4s. Estimated remaining: 5m 11s. Rate: 144.2 symbols/min [2025-09-26T22:25:39.909210] [INFO ] [MAIN ] NSP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:39.929268] [DEBUG] [LOCAL ] NSA: Loaded 45528 existing records from primary storage. [2025-09-26T22:25:39.929817] [INFO ] [MAIN ] NSA: Loaded 45528 primary data records. [2025-09-26T22:25:40.131731] [DEBUG] [LOCAL ] NSP: Loaded 35480 existing records from primary storage. [2025-09-26T22:25:40.182915] [INFO ] [MAIN ] NSP: Loaded 35480 primary data records. [2025-09-26T22:25:40.190958] [DEBUG] [MAIN ] NRUC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:40.312914] [INFO ] [MAIN ] NRUC: Generated 1820 derivative records from 3136 primary records. [2025-09-26T22:25:40.319008] [DEBUG] [LOCAL ] NRUC: Saving derivative data. [2025-09-26T22:25:40.446764] [DEBUG] [LOCAL ] NRUC: Derivative data saved (1820 records). [2025-09-26T22:25:40.452179] [INFO ] [MAIN ] NRUC: Successfully saved derivative data. [2025-09-26T22:25:40.469796] [INFO ] [MAIN ] Derivative Progress: 1327/2074 symbols completed. NRUC took 1.0s. Estimated remaining: 5m 11s. Rate: 144.1 symbols/min [2025-09-26T22:25:40.475237] [INFO ] [MAIN ] NTB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:40.712172] [DEBUG] [MAIN ] NSA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:40.712677] [DEBUG] [LOCAL ] NTB: Loaded 20927 existing records from primary storage. [2025-09-26T22:25:40.713815] [INFO ] [MAIN ] NSA: Generated 1820 derivative records from 45528 primary records. [2025-09-26T22:25:40.714297] [DEBUG] [LOCAL ] NSA: Saving derivative data. [2025-09-26T22:25:40.715380] [INFO ] [MAIN ] NTB: Loaded 20927 primary data records. [2025-09-26T22:25:40.852022] [DEBUG] [LOCAL ] NSA: Derivative data saved (1820 records). [2025-09-26T22:25:40.856134] [INFO ] [MAIN ] NSA: Successfully saved derivative data. [2025-09-26T22:25:40.858782] [INFO ] [MAIN ] Derivative Progress: 1328/2074 symbols completed. NSA took 1.4s. Estimated remaining: 5m 11s. Rate: 144.1 symbols/min [2025-09-26T22:25:40.875447] [INFO ] [MAIN ] NTR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:41.083548] [DEBUG] [MAIN ] NSP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:41.084401] [INFO ] [MAIN ] NSP: Generated 1820 derivative records from 35480 primary records. [2025-09-26T22:25:41.085021] [DEBUG] [LOCAL ] NSP: Saving derivative data. [2025-09-26T22:25:41.107008] [DEBUG] [LOCAL ] NSP: Derivative data saved (1820 records). [2025-09-26T22:25:41.107439] [INFO ] [MAIN ] NSP: Successfully saved derivative data. [2025-09-26T22:25:41.109634] [INFO ] [MAIN ] Derivative Progress: 1329/2074 symbols completed. NSP took 1.2s. Estimated remaining: 5m 10s. Rate: 144.2 symbols/min [2025-09-26T22:25:41.110394] [INFO ] [MAIN ] NTST: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:41.143292] [DEBUG] [MAIN ] NTB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:41.144091] [INFO ] [MAIN ] NTB: Generated 1820 derivative records from 20927 primary records. [2025-09-26T22:25:41.144215] [DEBUG] [LOCAL ] NTB: Saving derivative data. [2025-09-26T22:25:41.178091] [DEBUG] [LOCAL ] NTB: Derivative data saved (1820 records). [2025-09-26T22:25:41.178217] [INFO ] [MAIN ] NTB: Successfully saved derivative data. [2025-09-26T22:25:41.181000] [INFO ] [MAIN ] Derivative Progress: 1330/2074 symbols completed. NTB took 0.7s. Estimated remaining: 5m 9s. Rate: 144.3 symbols/min [2025-09-26T22:25:41.182357] [DEBUG] [LOCAL ] NTR: Loaded 53356 existing records from primary storage. [2025-09-26T22:25:41.182584] [INFO ] [MAIN ] NTR: Loaded 53356 primary data records. [2025-09-26T22:25:41.182824] [INFO ] [MAIN ] NU: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:41.352603] [DEBUG] [LOCAL ] NTST: Loaded 44211 existing records from primary storage. [2025-09-26T22:25:41.412901] [INFO ] [MAIN ] NTST: Loaded 44211 primary data records. [2025-09-26T22:25:41.701804] [DEBUG] [LOCAL ] NU: Loaded 54526 existing records from primary storage. [2025-09-26T22:25:41.720518] [INFO ] [MAIN ] NU: Loaded 54526 primary data records. [2025-09-26T22:25:42.368394] [DEBUG] [MAIN ] NTR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:42.370373] [INFO ] [MAIN ] NTR: Generated 1820 derivative records from 53356 primary records. [2025-09-26T22:25:42.370596] [DEBUG] [LOCAL ] NTR: Saving derivative data. [2025-09-26T22:25:42.391392] [DEBUG] [LOCAL ] NTR: Derivative data saved (1820 records). [2025-09-26T22:25:42.391851] [INFO ] [MAIN ] NTR: Successfully saved derivative data. [2025-09-26T22:25:42.394572] [INFO ] [MAIN ] Derivative Progress: 1331/2074 symbols completed. NTR took 1.5s. Estimated remaining: 5m 9s. Rate: 144.1 symbols/min [2025-09-26T22:25:42.396205] [INFO ] [MAIN ] NUS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:42.417854] [DEBUG] [MAIN ] NTST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:42.418695] [INFO ] [MAIN ] NTST: Generated 1820 derivative records from 44211 primary records. [2025-09-26T22:25:42.419026] [DEBUG] [LOCAL ] NTST: Saving derivative data. [2025-09-26T22:25:42.463701] [DEBUG] [MAIN ] NU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:42.463874] [DEBUG] [LOCAL ] NTST: Derivative data saved (1820 records). [2025-09-26T22:25:42.464765] [INFO ] [MAIN ] NTST: Successfully saved derivative data. [2025-09-26T22:25:42.464693] [INFO ] [MAIN ] NU: Generated 1820 derivative records from 54526 primary records. [2025-09-26T22:25:42.468077] [DEBUG] [LOCAL ] NU: Saving derivative data. [2025-09-26T22:25:42.467950] [INFO ] [MAIN ] Derivative Progress: 1332/2074 symbols completed. NTST took 1.4s. Estimated remaining: 5m 9s. Rate: 144.1 symbols/min [2025-09-26T22:25:42.469604] [INFO ] [MAIN ] NUV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:42.495467] [DEBUG] [LOCAL ] NUS: Loaded 37005 existing records from primary storage. [2025-09-26T22:25:42.497087] [INFO ] [MAIN ] NUS: Loaded 37005 primary data records. [2025-09-26T22:25:42.523145] [DEBUG] [LOCAL ] NU: Derivative data saved (1820 records). [2025-09-26T22:25:42.534591] [INFO ] [MAIN ] NU: Successfully saved derivative data. [2025-09-26T22:25:42.548255] [INFO ] [MAIN ] Derivative Progress: 1333/2074 symbols completed. NU took 1.4s. Estimated remaining: 5m 8s. Rate: 144.2 symbols/min [2025-09-26T22:25:42.680077] [DEBUG] [LOCAL ] NUV: Loaded 23576 existing records from primary storage. [2025-09-26T22:25:42.680277] [INFO ] [MAIN ] NUV: Loaded 23576 primary data records. [2025-09-26T22:25:43.273507] [DEBUG] [MAIN ] NUS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:43.274677] [INFO ] [MAIN ] NUS: Generated 1820 derivative records from 37005 primary records. [2025-09-26T22:25:43.274883] [DEBUG] [LOCAL ] NUS: Saving derivative data. [2025-09-26T22:25:43.308171] [DEBUG] [LOCAL ] NUS: Derivative data saved (1820 records). [2025-09-26T22:25:43.308538] [INFO ] [MAIN ] NUS: Successfully saved derivative data. [2025-09-26T22:25:43.310859] [INFO ] [MAIN ] Derivative Progress: 1334/2074 symbols completed. NUS took 0.9s. Estimated remaining: 5m 8s. Rate: 144.1 symbols/min [2025-09-26T22:25:43.308405] [DEBUG] [MAIN ] NUV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:43.311951] [INFO ] [MAIN ] NUV: Generated 1820 derivative records from 23576 primary records. [2025-09-26T22:25:43.312033] [DEBUG] [LOCAL ] NUV: Saving derivative data. [2025-09-26T22:25:43.329390] [DEBUG] [LOCAL ] NUV: Derivative data saved (1820 records). [2025-09-26T22:25:43.329547] [INFO ] [MAIN ] NUV: Successfully saved derivative data. [2025-09-26T22:25:43.332516] [INFO ] [MAIN ] Derivative Progress: 1335/2074 symbols completed. NUV took 0.9s. Estimated remaining: 5m 7s. Rate: 144.2 symbols/min [2025-09-26T22:25:43.333333] [INFO ] [MAIN ] NVG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:43.333142] [INFO ] [MAIN ] NUVB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:43.333515] [INFO ] [MAIN ] NUW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:43.345172] [DEBUG] [LOCAL ] NUW: Loaded 7512 existing records from primary storage. [2025-09-26T22:25:43.345400] [INFO ] [MAIN ] NUW: Loaded 7512 primary data records. [2025-09-26T22:25:43.558605] [DEBUG] [LOCAL ] NVG: Loaded 27703 existing records from primary storage. [2025-09-26T22:25:43.678831] [INFO ] [MAIN ] NVG: Loaded 27703 primary data records. [2025-09-26T22:25:43.743711] [DEBUG] [LOCAL ] NUVB: Loaded 51998 existing records from primary storage. [2025-09-26T22:25:43.781035] [INFO ] [MAIN ] NUVB: Loaded 51998 primary data records. [2025-09-26T22:25:44.478942] [DEBUG] [MAIN ] NUW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:44.480677] [INFO ] [MAIN ] NUW: Generated 1820 derivative records from 7512 primary records. [2025-09-26T22:25:44.481223] [DEBUG] [LOCAL ] NUW: Saving derivative data. [2025-09-26T22:25:44.502351] [DEBUG] [LOCAL ] NUW: Derivative data saved (1820 records). [2025-09-26T22:25:44.503090] [INFO ] [MAIN ] NUW: Successfully saved derivative data. [2025-09-26T22:25:44.506888] [INFO ] [MAIN ] Derivative Progress: 1336/2074 symbols completed. NUW took 1.2s. Estimated remaining: 5m 7s. Rate: 144.0 symbols/min [2025-09-26T22:25:44.507965] [INFO ] [MAIN ] NVGS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:44.536669] [DEBUG] [MAIN ] NUVB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:44.546523] [INFO ] [MAIN ] NUVB: Generated 1820 derivative records from 51998 primary records. [2025-09-26T22:25:44.546918] [DEBUG] [LOCAL ] NUVB: Saving derivative data. [2025-09-26T22:25:44.563105] [DEBUG] [MAIN ] NVG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:44.571267] [INFO ] [MAIN ] NVG: Generated 1820 derivative records from 27703 primary records. [2025-09-26T22:25:44.575540] [DEBUG] [LOCAL ] NVG: Saving derivative data. [2025-09-26T22:25:44.605605] [DEBUG] [LOCAL ] NVGS: Loaded 31403 existing records from primary storage. [2025-09-26T22:25:44.608112] [INFO ] [MAIN ] NVGS: Loaded 31403 primary data records. [2025-09-26T22:25:44.621961] [DEBUG] [LOCAL ] NUVB: Derivative data saved (1820 records). [2025-09-26T22:25:44.644823] [INFO ] [MAIN ] NUVB: Successfully saved derivative data. [2025-09-26T22:25:44.661852] [INFO ] [MAIN ] Derivative Progress: 1337/2074 symbols completed. NUVB took 1.3s. Estimated remaining: 5m 7s. Rate: 144.1 symbols/min [2025-09-26T22:25:44.693401] [DEBUG] [LOCAL ] NVG: Derivative data saved (1820 records). [2025-09-26T22:25:44.701992] [INFO ] [MAIN ] NVO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:44.722849] [INFO ] [MAIN ] NVG: Successfully saved derivative data. [2025-09-26T22:25:44.736541] [INFO ] [MAIN ] Derivative Progress: 1338/2074 symbols completed. NVG took 1.4s. Estimated remaining: 5m 6s. Rate: 144.2 symbols/min [2025-09-26T22:25:44.743500] [INFO ] [MAIN ] NVR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:44.967430] [DEBUG] [LOCAL ] NVR: Loaded 19323 existing records from primary storage. [2025-09-26T22:25:44.968635] [INFO ] [MAIN ] NVR: Loaded 19323 primary data records. [2025-09-26T22:25:45.338901] [DEBUG] [LOCAL ] NVO: Loaded 54564 existing records from primary storage. [2025-09-26T22:25:45.339637] [INFO ] [MAIN ] NVO: Loaded 54564 primary data records. [2025-09-26T22:25:45.430312] [DEBUG] [MAIN ] NVGS: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:25:45.445348] [INFO ] [MAIN ] NVGS: Generated 1819 derivative records from 31403 primary records. [2025-09-26T22:25:45.455098] [DEBUG] [LOCAL ] NVGS: Saving derivative data. [2025-09-26T22:25:45.527743] [DEBUG] [LOCAL ] NVGS: Derivative data saved (1819 records). [2025-09-26T22:25:45.532202] [INFO ] [MAIN ] NVGS: Successfully saved derivative data. [2025-09-26T22:25:45.534278] [INFO ] [MAIN ] Derivative Progress: 1339/2074 symbols completed. NVGS took 1.0s. Estimated remaining: 5m 6s. Rate: 144.1 symbols/min [2025-09-26T22:25:45.534880] [INFO ] [MAIN ] NVRI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:45.781093] [DEBUG] [MAIN ] NVR: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:25:45.782537] [INFO ] [MAIN ] NVR: Generated 1819 derivative records from 19323 primary records. [2025-09-26T22:25:45.783490] [DEBUG] [LOCAL ] NVR: Saving derivative data. [2025-09-26T22:25:45.808468] [DEBUG] [LOCAL ] NVRI: Loaded 39367 existing records from primary storage. [2025-09-26T22:25:45.809340] [INFO ] [MAIN ] NVRI: Loaded 39367 primary data records. [2025-09-26T22:25:45.885633] [DEBUG] [LOCAL ] NVR: Derivative data saved (1819 records). [2025-09-26T22:25:45.904572] [INFO ] [MAIN ] NVR: Successfully saved derivative data. [2025-09-26T22:25:45.907994] [INFO ] [MAIN ] Derivative Progress: 1340/2074 symbols completed. NVR took 1.2s. Estimated remaining: 5m 6s. Rate: 144.1 symbols/min [2025-09-26T22:25:45.922433] [INFO ] [MAIN ] NVS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:46.213773] [DEBUG] [MAIN ] NVO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:46.215230] [INFO ] [MAIN ] NVO: Generated 1820 derivative records from 54564 primary records. [2025-09-26T22:25:46.215521] [DEBUG] [LOCAL ] NVO: Saving derivative data. [2025-09-26T22:25:46.252595] [DEBUG] [LOCAL ] NVO: Derivative data saved (1820 records). [2025-09-26T22:25:46.252956] [INFO ] [MAIN ] NVO: Successfully saved derivative data. [2025-09-26T22:25:46.255146] [INFO ] [MAIN ] Derivative Progress: 1341/2074 symbols completed. NVO took 1.6s. Estimated remaining: 5m 5s. Rate: 144.1 symbols/min [2025-09-26T22:25:46.255966] [INFO ] [MAIN ] NVST: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:46.291711] [DEBUG] [LOCAL ] NVS: Loaded 52338 existing records from primary storage. [2025-09-26T22:25:46.292758] [INFO ] [MAIN ] NVS: Loaded 52338 primary data records. [2025-09-26T22:25:46.352735] [DEBUG] [MAIN ] NVRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:46.389544] [INFO ] [MAIN ] NVRI: Generated 1820 derivative records from 39367 primary records. [2025-09-26T22:25:46.410066] [DEBUG] [LOCAL ] NVRI: Saving derivative data. [2025-09-26T22:25:46.575252] [DEBUG] [LOCAL ] NVRI: Derivative data saved (1820 records). [2025-09-26T22:25:46.690929] [INFO ] [MAIN ] NVRI: Successfully saved derivative data. [2025-09-26T22:25:46.703289] [INFO ] [MAIN ] Derivative Progress: 1342/2074 symbols completed. NVRI took 1.2s. Estimated remaining: 5m 5s. Rate: 144.1 symbols/min [2025-09-26T22:25:46.719782] [INFO ] [MAIN ] NVT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:46.722155] [DEBUG] [LOCAL ] NVST: Loaded 52381 existing records from primary storage. [2025-09-26T22:25:46.723205] [INFO ] [MAIN ] NVST: Loaded 52381 primary data records. [2025-09-26T22:25:47.123118] [DEBUG] [MAIN ] NVS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:47.124828] [DEBUG] [LOCAL ] NVT: Loaded 52330 existing records from primary storage. [2025-09-26T22:25:47.126534] [INFO ] [MAIN ] NVS: Generated 1820 derivative records from 52338 primary records. [2025-09-26T22:25:47.126982] [DEBUG] [LOCAL ] NVS: Saving derivative data. [2025-09-26T22:25:47.126878] [INFO ] [MAIN ] NVT: Loaded 52330 primary data records. [2025-09-26T22:25:47.195076] [DEBUG] [LOCAL ] NVS: Derivative data saved (1820 records). [2025-09-26T22:25:47.208055] [INFO ] [MAIN ] NVS: Successfully saved derivative data. [2025-09-26T22:25:47.219305] [INFO ] [MAIN ] Derivative Progress: 1343/2074 symbols completed. NVS took 1.3s. Estimated remaining: 5m 4s. Rate: 144.1 symbols/min [2025-09-26T22:25:47.243590] [INFO ] [MAIN ] NWG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:47.518854] [DEBUG] [MAIN ] NVST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:47.520781] [INFO ] [MAIN ] NVST: Generated 1820 derivative records from 52381 primary records. [2025-09-26T22:25:47.522092] [DEBUG] [LOCAL ] NVST: Saving derivative data. [2025-09-26T22:25:47.580140] [DEBUG] [LOCAL ] NVST: Derivative data saved (1820 records). [2025-09-26T22:25:47.580664] [INFO ] [MAIN ] NVST: Successfully saved derivative data. [2025-09-26T22:25:47.583551] [INFO ] [MAIN ] Derivative Progress: 1344/2074 symbols completed. NVST took 1.3s. Estimated remaining: 5m 4s. Rate: 144.1 symbols/min [2025-09-26T22:25:47.585156] [DEBUG] [LOCAL ] NWG: Loaded 52318 existing records from primary storage. [2025-09-26T22:25:47.585583] [INFO ] [MAIN ] NWN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:47.585798] [INFO ] [MAIN ] NWG: Loaded 52318 primary data records. [2025-09-26T22:25:47.731287] [DEBUG] [MAIN ] NVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:47.746026] [INFO ] [MAIN ] NVT: Generated 1820 derivative records from 52330 primary records. [2025-09-26T22:25:47.771320] [DEBUG] [LOCAL ] NVT: Saving derivative data. [2025-09-26T22:25:47.772343] [DEBUG] [LOCAL ] NWN: Loaded 27222 existing records from primary storage. [2025-09-26T22:25:47.796920] [INFO ] [MAIN ] NWN: Loaded 27222 primary data records. [2025-09-26T22:25:48.067343] [DEBUG] [LOCAL ] NVT: Derivative data saved (1820 records). [2025-09-26T22:25:48.072787] [INFO ] [MAIN ] NVT: Successfully saved derivative data. [2025-09-26T22:25:48.080408] [INFO ] [MAIN ] Derivative Progress: 1345/2074 symbols completed. NVT took 1.4s. Estimated remaining: 5m 4s. Rate: 144.1 symbols/min [2025-09-26T22:25:48.103535] [INFO ] [MAIN ] NX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:48.362298] [DEBUG] [LOCAL ] NX: Loaded 33894 existing records from primary storage. [2025-09-26T22:25:48.363269] [INFO ] [MAIN ] NX: Loaded 33894 primary data records. [2025-09-26T22:25:48.363707] [DEBUG] [MAIN ] NWG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:48.364569] [INFO ] [MAIN ] NWG: Generated 1820 derivative records from 52318 primary records. [2025-09-26T22:25:48.364832] [DEBUG] [LOCAL ] NWG: Saving derivative data. [2025-09-26T22:25:48.448267] [DEBUG] [LOCAL ] NWG: Derivative data saved (1820 records). [2025-09-26T22:25:48.500150] [INFO ] [MAIN ] NWG: Successfully saved derivative data. [2025-09-26T22:25:48.515618] [INFO ] [MAIN ] Derivative Progress: 1346/2074 symbols completed. NWG took 1.3s. Estimated remaining: 5m 3s. Rate: 144.1 symbols/min [2025-09-26T22:25:48.565749] [INFO ] [MAIN ] NXC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:48.592892] [DEBUG] [MAIN ] NWN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:48.620130] [INFO ] [MAIN ] NWN: Generated 1820 derivative records from 27222 primary records. [2025-09-26T22:25:48.640830] [DEBUG] [LOCAL ] NWN: Saving derivative data. [2025-09-26T22:25:48.643923] [DEBUG] [LOCAL ] NXC: Loaded 4313 existing records from primary storage. [2025-09-26T22:25:48.666500] [INFO ] [MAIN ] NXC: Loaded 4313 primary data records. [2025-09-26T22:25:48.928567] [DEBUG] [LOCAL ] NWN: Derivative data saved (1820 records). [2025-09-26T22:25:48.934432] [INFO ] [MAIN ] NWN: Successfully saved derivative data. [2025-09-26T22:25:48.942206] [INFO ] [MAIN ] Derivative Progress: 1347/2074 symbols completed. NWN took 1.4s. Estimated remaining: 5m 3s. Rate: 144.1 symbols/min [2025-09-26T22:25:48.959685] [INFO ] [MAIN ] NXDT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:49.159451] [DEBUG] [LOCAL ] NXDT: Loaded 16531 existing records from primary storage. [2025-09-26T22:25:49.160023] [INFO ] [MAIN ] NXDT: Loaded 16531 primary data records. [2025-09-26T22:25:49.292353] [DEBUG] [MAIN ] NX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:49.309149] [INFO ] [MAIN ] NX: Generated 1820 derivative records from 33894 primary records. [2025-09-26T22:25:49.314682] [DEBUG] [LOCAL ] NX: Saving derivative data. [2025-09-26T22:25:49.401102] [DEBUG] [LOCAL ] NX: Derivative data saved (1820 records). [2025-09-26T22:25:49.530940] [INFO ] [MAIN ] NX: Successfully saved derivative data. [2025-09-26T22:25:49.534484] [INFO ] [MAIN ] Derivative Progress: 1348/2074 symbols completed. NX took 1.4s. Estimated remaining: 5m 2s. Rate: 144.0 symbols/min [2025-09-26T22:25:49.553454] [DEBUG] [MAIN ] NXC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:49.554487] [INFO ] [MAIN ] NXC: Generated 1820 derivative records from 4313 primary records. [2025-09-26T22:25:49.554942] [DEBUG] [LOCAL ] NXC: Saving derivative data. [2025-09-26T22:25:49.573328] [DEBUG] [LOCAL ] NXC: Derivative data saved (1820 records). [2025-09-26T22:25:49.573474] [INFO ] [MAIN ] NXC: Successfully saved derivative data. [2025-09-26T22:25:49.575981] [INFO ] [MAIN ] Derivative Progress: 1349/2074 symbols completed. NXC took 1.1s. Estimated remaining: 5m 2s. Rate: 144.1 symbols/min [2025-09-26T22:25:49.592701] [DEBUG] [MAIN ] NXDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:49.593287] [INFO ] [MAIN ] NXDT: Generated 1820 derivative records from 16531 primary records. [2025-09-26T22:25:49.593347] [DEBUG] [LOCAL ] NXDT: Saving derivative data. [2025-09-26T22:25:49.608906] [DEBUG] [LOCAL ] NXDT: Derivative data saved (1820 records). [2025-09-26T22:25:49.608975] [INFO ] [MAIN ] NXDT: Successfully saved derivative data. [2025-09-26T22:25:49.611418] [INFO ] [MAIN ] Derivative Progress: 1350/2074 symbols completed. NXDT took 0.7s. Estimated remaining: 5m 1s. Rate: 144.2 symbols/min [2025-09-26T22:25:49.612024] [INFO ] [MAIN ] NXG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:49.612395] [INFO ] [MAIN ] NXE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:49.612310] [INFO ] [MAIN ] NXJ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:49.636192] [DEBUG] [LOCAL ] NXG: Loaded 10647 existing records from primary storage. [2025-09-26T22:25:49.644585] [INFO ] [MAIN ] NXG: Loaded 10647 primary data records. [2025-09-26T22:25:49.645067] [DEBUG] [LOCAL ] NXJ: Loaded 15066 existing records from primary storage. [2025-09-26T22:25:49.651528] [INFO ] [MAIN ] NXJ: Loaded 15066 primary data records. [2025-09-26T22:25:49.995564] [DEBUG] [LOCAL ] NXE: Loaded 53762 existing records from primary storage. [2025-09-26T22:25:50.171762] [INFO ] [MAIN ] NXE: Loaded 53762 primary data records. [2025-09-26T22:25:50.743345] [DEBUG] [MAIN ] NXG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:50.744821] [INFO ] [MAIN ] NXG: Generated 1820 derivative records from 10647 primary records. [2025-09-26T22:25:50.745492] [DEBUG] [LOCAL ] NXG: Saving derivative data. [2025-09-26T22:25:50.760805] [DEBUG] [MAIN ] NXJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:50.762129] [INFO ] [MAIN ] NXJ: Generated 1820 derivative records from 15066 primary records. [2025-09-26T22:25:50.769799] [DEBUG] [LOCAL ] NXJ: Saving derivative data. [2025-09-26T22:25:50.786928] [DEBUG] [LOCAL ] NXG: Derivative data saved (1820 records). [2025-09-26T22:25:50.787045] [INFO ] [MAIN ] NXG: Successfully saved derivative data. [2025-09-26T22:25:50.789404] [INFO ] [MAIN ] Derivative Progress: 1351/2074 symbols completed. NXG took 1.2s. Estimated remaining: 5m 1s. Rate: 144.0 symbols/min [2025-09-26T22:25:50.796226] [INFO ] [MAIN ] NXN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:50.814994] [DEBUG] [MAIN ] NXE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:50.816410] [INFO ] [MAIN ] NXE: Generated 1820 derivative records from 53762 primary records. [2025-09-26T22:25:50.816765] [DEBUG] [LOCAL ] NXE: Saving derivative data. [2025-09-26T22:25:50.817345] [DEBUG] [LOCAL ] NXJ: Derivative data saved (1820 records). [2025-09-26T22:25:50.818213] [INFO ] [MAIN ] NXJ: Successfully saved derivative data. [2025-09-26T22:25:50.830703] [INFO ] [MAIN ] Derivative Progress: 1352/2074 symbols completed. NXJ took 1.2s. Estimated remaining: 5m 1s. Rate: 144.1 symbols/min [2025-09-26T22:25:50.820854] [DEBUG] [LOCAL ] NXN: Loaded 2376 existing records from primary storage. [2025-09-26T22:25:50.832082] [INFO ] [MAIN ] NXP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:50.836141] [INFO ] [MAIN ] NXN: Loaded 2376 primary data records. [2025-09-26T22:25:50.904998] [DEBUG] [LOCAL ] NXE: Derivative data saved (1820 records). [2025-09-26T22:25:50.937470] [INFO ] [MAIN ] NXE: Successfully saved derivative data. [2025-09-26T22:25:50.973047] [INFO ] [MAIN ] Derivative Progress: 1353/2074 symbols completed. NXE took 1.4s. Estimated remaining: 4m 60s. Rate: 144.2 symbols/min [2025-09-26T22:25:50.974167] [INFO ] [MAIN ] NXRT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:50.980200] [DEBUG] [LOCAL ] NXP: Loaded 12465 existing records from primary storage. [2025-09-26T22:25:50.985449] [INFO ] [MAIN ] NXP: Loaded 12465 primary data records. [2025-09-26T22:25:51.358232] [DEBUG] [LOCAL ] NXRT: Loaded 19307 existing records from primary storage. [2025-09-26T22:25:51.378532] [INFO ] [MAIN ] NXRT: Loaded 19307 primary data records. [2025-09-26T22:25:51.975900] [DEBUG] [MAIN ] NXN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:51.977132] [INFO ] [MAIN ] NXN: Generated 1820 derivative records from 2376 primary records. [2025-09-26T22:25:51.978781] [DEBUG] [LOCAL ] NXN: Saving derivative data. [2025-09-26T22:25:52.003391] [DEBUG] [LOCAL ] NXN: Derivative data saved (1820 records). [2025-09-26T22:25:52.004108] [INFO ] [MAIN ] NXN: Successfully saved derivative data. [2025-09-26T22:25:52.022715] [INFO ] [MAIN ] Derivative Progress: 1354/2074 symbols completed. NXN took 1.2s. Estimated remaining: 4m 60s. Rate: 144.0 symbols/min [2025-09-26T22:25:52.023821] [INFO ] [MAIN ] NYT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:52.023728] [DEBUG] [MAIN ] NXP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:52.025917] [INFO ] [MAIN ] NXP: Generated 1820 derivative records from 12465 primary records. [2025-09-26T22:25:52.027338] [DEBUG] [LOCAL ] NXP: Saving derivative data. [2025-09-26T22:25:52.062926] [DEBUG] [MAIN ] NXRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:52.064691] [INFO ] [MAIN ] NXRT: Generated 1820 derivative records from 19307 primary records. [2025-09-26T22:25:52.065840] [DEBUG] [LOCAL ] NXRT: Saving derivative data. [2025-09-26T22:25:52.068061] [DEBUG] [LOCAL ] NXP: Derivative data saved (1820 records). [2025-09-26T22:25:52.068304] [INFO ] [MAIN ] NXP: Successfully saved derivative data. [2025-09-26T22:25:52.078207] [INFO ] [MAIN ] Derivative Progress: 1355/2074 symbols completed. NXP took 1.2s. Estimated remaining: 4m 59s. Rate: 144.1 symbols/min [2025-09-26T22:25:52.082462] [INFO ] [MAIN ] NZF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:52.086826] [DEBUG] [LOCAL ] NXRT: Derivative data saved (1820 records). [2025-09-26T22:25:52.087321] [INFO ] [MAIN ] NXRT: Successfully saved derivative data. [2025-09-26T22:25:52.090382] [INFO ] [MAIN ] Derivative Progress: 1356/2074 symbols completed. NXRT took 1.1s. Estimated remaining: 4m 59s. Rate: 144.2 symbols/min [2025-09-26T22:25:52.090851] [INFO ] [MAIN ] OBDC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:52.146280] [DEBUG] [LOCAL ] NYT: Loaded 50645 existing records from primary storage. [2025-09-26T22:25:52.154740] [INFO ] [MAIN ] NYT: Loaded 50645 primary data records. [2025-09-26T22:25:52.169465] [DEBUG] [LOCAL ] NZF: Loaded 29361 existing records from primary storage. [2025-09-26T22:25:52.206826] [INFO ] [MAIN ] NZF: Loaded 29361 primary data records. [2025-09-26T22:25:52.469124] [DEBUG] [LOCAL ] OBDC: Loaded 52426 existing records from primary storage. [2025-09-26T22:25:52.478057] [INFO ] [MAIN ] OBDC: Loaded 52426 primary data records. [2025-09-26T22:25:53.282919] [DEBUG] [MAIN ] NYT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:53.284181] [INFO ] [MAIN ] NYT: Generated 1820 derivative records from 50645 primary records. [2025-09-26T22:25:53.284436] [DEBUG] [LOCAL ] NYT: Saving derivative data. [2025-09-26T22:25:53.321171] [DEBUG] [MAIN ] NZF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:53.322926] [INFO ] [MAIN ] NZF: Generated 1820 derivative records from 29361 primary records. [2025-09-26T22:25:53.324038] [DEBUG] [LOCAL ] NYT: Derivative data saved (1820 records). [2025-09-26T22:25:53.324164] [INFO ] [MAIN ] NYT: Successfully saved derivative data. [2025-09-26T22:25:53.323342] [DEBUG] [LOCAL ] NZF: Saving derivative data. [2025-09-26T22:25:53.328563] [INFO ] [MAIN ] Derivative Progress: 1357/2074 symbols completed. NYT took 1.3s. Estimated remaining: 4m 59s. Rate: 144.0 symbols/min [2025-09-26T22:25:53.331952] [INFO ] [MAIN ] OBK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:53.360094] [DEBUG] [MAIN ] OBDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:53.361759] [INFO ] [MAIN ] OBDC: Generated 1820 derivative records from 52426 primary records. [2025-09-26T22:25:53.361898] [DEBUG] [LOCAL ] OBDC: Saving derivative data. [2025-09-26T22:25:53.384082] [DEBUG] [LOCAL ] NZF: Derivative data saved (1820 records). [2025-09-26T22:25:53.384767] [INFO ] [MAIN ] NZF: Successfully saved derivative data. [2025-09-26T22:25:53.387869] [INFO ] [MAIN ] Derivative Progress: 1358/2074 symbols completed. NZF took 1.3s. Estimated remaining: 4m 58s. Rate: 144.1 symbols/min [2025-09-26T22:25:53.389024] [INFO ] [MAIN ] OC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:53.400675] [DEBUG] [LOCAL ] OBDC: Derivative data saved (1820 records). [2025-09-26T22:25:53.399938] [DEBUG] [LOCAL ] OBK: Loaded 16512 existing records from primary storage. [2025-09-26T22:25:53.400993] [INFO ] [MAIN ] OBDC: Successfully saved derivative data. [2025-09-26T22:25:53.401106] [INFO ] [MAIN ] OBK: Loaded 16512 primary data records. [2025-09-26T22:25:53.404763] [INFO ] [MAIN ] Derivative Progress: 1359/2074 symbols completed. OBDC took 1.3s. Estimated remaining: 4m 57s. Rate: 144.2 symbols/min [2025-09-26T22:25:53.434408] [INFO ] [MAIN ] OCFT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:53.583909] [DEBUG] [LOCAL ] OCFT: Loaded 8916 existing records from primary storage. [2025-09-26T22:25:53.609135] [INFO ] [MAIN ] OCFT: Loaded 8916 primary data records. [2025-09-26T22:25:53.895548] [DEBUG] [LOCAL ] OC: Loaded 45369 existing records from primary storage. [2025-09-26T22:25:53.911764] [INFO ] [MAIN ] OC: Loaded 45369 primary data records. [2025-09-26T22:25:54.496721] [DEBUG] [MAIN ] OBK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:54.497563] [INFO ] [MAIN ] OBK: Generated 1820 derivative records from 16512 primary records. [2025-09-26T22:25:54.497847] [DEBUG] [LOCAL ] OBK: Saving derivative data. [2025-09-26T22:25:54.533764] [DEBUG] [LOCAL ] OBK: Derivative data saved (1820 records). [2025-09-26T22:25:54.534430] [INFO ] [MAIN ] OBK: Successfully saved derivative data. [2025-09-26T22:25:54.537003] [INFO ] [MAIN ] Derivative Progress: 1360/2074 symbols completed. OBK took 1.2s. Estimated remaining: 4m 57s. Rate: 144.0 symbols/min [2025-09-26T22:25:54.534308] [DEBUG] [MAIN ] OCFT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:54.538786] [INFO ] [MAIN ] OCFT: Generated 1820 derivative records from 8916 primary records. [2025-09-26T22:25:54.537954] [INFO ] [MAIN ] ODC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:54.539478] [DEBUG] [LOCAL ] OCFT: Saving derivative data. [2025-09-26T22:25:54.557921] [DEBUG] [LOCAL ] OCFT: Derivative data saved (1820 records). [2025-09-26T22:25:54.558332] [INFO ] [MAIN ] OCFT: Successfully saved derivative data. [2025-09-26T22:25:54.560876] [INFO ] [MAIN ] Derivative Progress: 1361/2074 symbols completed. OCFT took 1.1s. Estimated remaining: 4m 57s. Rate: 144.1 symbols/min [2025-09-26T22:25:54.561673] [INFO ] [MAIN ] ODV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:54.567067] [DEBUG] [LOCAL ] ODC: Loaded 8633 existing records from primary storage. [2025-09-26T22:25:54.567538] [INFO ] [MAIN ] ODC: Loaded 8633 primary data records. [2025-09-26T22:25:54.714274] [DEBUG] [MAIN ] OC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:54.744485] [INFO ] [MAIN ] OC: Generated 1820 derivative records from 45369 primary records. [2025-09-26T22:25:54.800314] [DEBUG] [LOCAL ] OC: Saving derivative data. [2025-09-26T22:25:54.800237] [DEBUG] [LOCAL ] ODV: Loaded 26258 existing records from primary storage. [2025-09-26T22:25:54.970470] [INFO ] [MAIN ] ODV: Loaded 26258 primary data records. [2025-09-26T22:25:55.118764] [DEBUG] [LOCAL ] OC: Derivative data saved (1820 records). [2025-09-26T22:25:55.123101] [INFO ] [MAIN ] OC: Successfully saved derivative data. [2025-09-26T22:25:55.137935] [INFO ] [MAIN ] Derivative Progress: 1362/2074 symbols completed. OC took 1.7s. Estimated remaining: 4m 56s. Rate: 144.1 symbols/min [2025-09-26T22:25:55.148988] [INFO ] [MAIN ] OEC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:55.362450] [DEBUG] [MAIN ] ODC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:55.363872] [INFO ] [MAIN ] ODC: Generated 1820 derivative records from 8633 primary records. [2025-09-26T22:25:55.364009] [DEBUG] [LOCAL ] ODC: Saving derivative data. [2025-09-26T22:25:55.391858] [DEBUG] [LOCAL ] ODC: Derivative data saved (1820 records). [2025-09-26T22:25:55.392159] [INFO ] [MAIN ] ODC: Successfully saved derivative data. [2025-09-26T22:25:55.394413] [INFO ] [MAIN ] Derivative Progress: 1363/2074 symbols completed. ODC took 0.9s. Estimated remaining: 4m 56s. Rate: 144.1 symbols/min [2025-09-26T22:25:55.418564] [DEBUG] [LOCAL ] OEC: Loaded 37689 existing records from primary storage. [2025-09-26T22:25:55.432627] [INFO ] [MAIN ] OEC: Loaded 37689 primary data records. [2025-09-26T22:25:55.433217] [DEBUG] [MAIN ] ODV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:55.458080] [INFO ] [MAIN ] ODV: Generated 1820 derivative records from 26258 primary records. [2025-09-26T22:25:55.498342] [DEBUG] [LOCAL ] ODV: Saving derivative data. [2025-09-26T22:25:55.602617] [DEBUG] [LOCAL ] ODV: Derivative data saved (1820 records). [2025-09-26T22:25:55.624147] [INFO ] [MAIN ] ODV: Successfully saved derivative data. [2025-09-26T22:25:55.637351] [INFO ] [MAIN ] Derivative Progress: 1364/2074 symbols completed. ODV took 1.1s. Estimated remaining: 4m 55s. Rate: 144.2 symbols/min [2025-09-26T22:25:55.824016] [DEBUG] [MAIN ] OEC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:55.824849] [INFO ] [MAIN ] OEC: Generated 1820 derivative records from 37689 primary records. [2025-09-26T22:25:55.824923] [DEBUG] [LOCAL ] OEC: Saving derivative data. [2025-09-26T22:25:55.841750] [DEBUG] [LOCAL ] OEC: Derivative data saved (1820 records). [2025-09-26T22:25:55.841879] [INFO ] [MAIN ] OEC: Successfully saved derivative data. [2025-09-26T22:25:55.843979] [INFO ] [MAIN ] Derivative Progress: 1365/2074 symbols completed. OEC took 0.7s. Estimated remaining: 4m 55s. Rate: 144.2 symbols/min [2025-09-26T22:25:55.844866] [INFO ] [MAIN ] OGN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:55.844730] [INFO ] [MAIN ] OFG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:55.845711] [INFO ] [MAIN ] OGE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:55.868985] [DEBUG] [LOCAL ] OFG: Loaded 22393 existing records from primary storage. [2025-09-26T22:25:55.869199] [INFO ] [MAIN ] OFG: Loaded 22393 primary data records. [2025-09-26T22:25:56.234949] [DEBUG] [LOCAL ] OGE: Loaded 47046 existing records from primary storage. [2025-09-26T22:25:56.244814] [INFO ] [MAIN ] OGE: Loaded 47046 primary data records. [2025-09-26T22:25:56.244681] [DEBUG] [LOCAL ] OGN: Loaded 53882 existing records from primary storage. [2025-09-26T22:25:56.251122] [INFO ] [MAIN ] OGN: Loaded 53882 primary data records. [2025-09-26T22:25:56.998123] [DEBUG] [MAIN ] OFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:57.000047] [INFO ] [MAIN ] OFG: Generated 1820 derivative records from 22393 primary records. [2025-09-26T22:25:57.000405] [DEBUG] [LOCAL ] OFG: Saving derivative data. [2025-09-26T22:25:57.024889] [DEBUG] [LOCAL ] OFG: Derivative data saved (1820 records). [2025-09-26T22:25:57.025162] [INFO ] [MAIN ] OFG: Successfully saved derivative data. [2025-09-26T22:25:57.028264] [INFO ] [MAIN ] Derivative Progress: 1366/2074 symbols completed. OFG took 1.2s. Estimated remaining: 4m 55s. Rate: 144.0 symbols/min [2025-09-26T22:25:57.029140] [INFO ] [MAIN ] OGS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:57.048689] [DEBUG] [MAIN ] OGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:57.050131] [INFO ] [MAIN ] OGN: Generated 1820 derivative records from 53882 primary records. [2025-09-26T22:25:57.051228] [DEBUG] [LOCAL ] OGN: Saving derivative data. [2025-09-26T22:25:57.081538] [DEBUG] [MAIN ] OGE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:57.083370] [INFO ] [MAIN ] OGE: Generated 1820 derivative records from 47046 primary records. [2025-09-26T22:25:57.084238] [DEBUG] [LOCAL ] OGE: Saving derivative data. [2025-09-26T22:25:57.108251] [DEBUG] [LOCAL ] OGN: Derivative data saved (1820 records). [2025-09-26T22:25:57.111631] [INFO ] [MAIN ] OGN: Successfully saved derivative data. [2025-09-26T22:25:57.113869] [INFO ] [MAIN ] Derivative Progress: 1367/2074 symbols completed. OGN took 1.3s. Estimated remaining: 4m 54s. Rate: 144.1 symbols/min [2025-09-26T22:25:57.114562] [INFO ] [MAIN ] OHI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:57.117334] [DEBUG] [LOCAL ] OGE: Derivative data saved (1820 records). [2025-09-26T22:25:57.127359] [INFO ] [MAIN ] OGE: Successfully saved derivative data. [2025-09-26T22:25:57.130397] [INFO ] [MAIN ] Derivative Progress: 1368/2074 symbols completed. OGE took 1.3s. Estimated remaining: 4m 54s. Rate: 144.2 symbols/min [2025-09-26T22:25:57.130836] [INFO ] [MAIN ] OI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:57.131946] [DEBUG] [LOCAL ] OGS: Loaded 34591 existing records from primary storage. [2025-09-26T22:25:57.132300] [INFO ] [MAIN ] OGS: Loaded 34591 primary data records. [2025-09-26T22:25:57.494140] [DEBUG] [LOCAL ] OHI: Loaded 52824 existing records from primary storage. [2025-09-26T22:25:57.495787] [INFO ] [MAIN ] OHI: Loaded 52824 primary data records. [2025-09-26T22:25:57.625005] [DEBUG] [LOCAL ] OI: Loaded 48011 existing records from primary storage. [2025-09-26T22:25:57.666385] [INFO ] [MAIN ] OI: Loaded 48011 primary data records. [2025-09-26T22:25:57.947040] [DEBUG] [MAIN ] OGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:57.961386] [INFO ] [MAIN ] OGS: Generated 1820 derivative records from 34591 primary records. [2025-09-26T22:25:57.972376] [DEBUG] [LOCAL ] OGS: Saving derivative data. [2025-09-26T22:25:58.180477] [DEBUG] [LOCAL ] OGS: Derivative data saved (1820 records). [2025-09-26T22:25:58.181432] [INFO ] [MAIN ] OGS: Successfully saved derivative data. [2025-09-26T22:25:58.183734] [INFO ] [MAIN ] Derivative Progress: 1369/2074 symbols completed. OGS took 1.2s. Estimated remaining: 4m 54s. Rate: 144.1 symbols/min [2025-09-26T22:25:58.184101] [INFO ] [MAIN ] OIA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:58.211300] [DEBUG] [MAIN ] OHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:58.217888] [INFO ] [MAIN ] OHI: Generated 1820 derivative records from 52824 primary records. [2025-09-26T22:25:58.218000] [DEBUG] [LOCAL ] OHI: Saving derivative data. [2025-09-26T22:25:58.216921] [DEBUG] [LOCAL ] OIA: Loaded 14218 existing records from primary storage. [2025-09-26T22:25:58.219249] [INFO ] [MAIN ] OIA: Loaded 14218 primary data records. [2025-09-26T22:25:58.329267] [DEBUG] [LOCAL ] OHI: Derivative data saved (1820 records). [2025-09-26T22:25:58.348822] [INFO ] [MAIN ] OHI: Successfully saved derivative data. [2025-09-26T22:25:58.368438] [INFO ] [MAIN ] Derivative Progress: 1370/2074 symbols completed. OHI took 1.3s. Estimated remaining: 4m 53s. Rate: 144.1 symbols/min [2025-09-26T22:25:58.366096] [DEBUG] [MAIN ] OI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:58.389506] [INFO ] [MAIN ] OII: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:58.395616] [INFO ] [MAIN ] OI: Generated 1820 derivative records from 48011 primary records. [2025-09-26T22:25:58.449498] [DEBUG] [LOCAL ] OI: Saving derivative data. [2025-09-26T22:25:58.598064] [DEBUG] [LOCAL ] OI: Derivative data saved (1820 records). [2025-09-26T22:25:58.598297] [INFO ] [MAIN ] OI: Successfully saved derivative data. [2025-09-26T22:25:58.601798] [INFO ] [MAIN ] Derivative Progress: 1371/2074 symbols completed. OI took 1.5s. Estimated remaining: 4m 53s. Rate: 144.2 symbols/min [2025-09-26T22:25:58.602797] [INFO ] [MAIN ] OIS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:58.641964] [DEBUG] [MAIN ] OIA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:58.642892] [INFO ] [MAIN ] OIA: Generated 1820 derivative records from 14218 primary records. [2025-09-26T22:25:58.643076] [DEBUG] [LOCAL ] OIA: Saving derivative data. [2025-09-26T22:25:58.668161] [DEBUG] [LOCAL ] OIA: Derivative data saved (1820 records). [2025-09-26T22:25:58.681028] [INFO ] [MAIN ] OIA: Successfully saved derivative data. [2025-09-26T22:25:58.683313] [INFO ] [MAIN ] Derivative Progress: 1372/2074 symbols completed. OIA took 0.5s. Estimated remaining: 4m 52s. Rate: 144.3 symbols/min [2025-09-26T22:25:58.684470] [INFO ] [MAIN ] OKE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:58.684578] [DEBUG] [LOCAL ] OII: Loaded 43406 existing records from primary storage. [2025-09-26T22:25:58.685206] [INFO ] [MAIN ] OII: Loaded 43406 primary data records. [2025-09-26T22:25:58.771291] [DEBUG] [LOCAL ] OIS: Loaded 41135 existing records from primary storage. [2025-09-26T22:25:58.789440] [INFO ] [MAIN ] OIS: Loaded 41135 primary data records. [2025-09-26T22:25:59.378008] [DEBUG] [LOCAL ] OKE: Loaded 54316 existing records from primary storage. [2025-09-26T22:25:59.392459] [INFO ] [MAIN ] OKE: Loaded 54316 primary data records. [2025-09-26T22:25:59.739978] [DEBUG] [MAIN ] OII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:59.741679] [INFO ] [MAIN ] OII: Generated 1820 derivative records from 43406 primary records. [2025-09-26T22:25:59.742027] [DEBUG] [LOCAL ] OII: Saving derivative data. [2025-09-26T22:25:59.761747] [DEBUG] [LOCAL ] OII: Derivative data saved (1820 records). [2025-09-26T22:25:59.763416] [INFO ] [MAIN ] OII: Successfully saved derivative data. [2025-09-26T22:25:59.766350] [INFO ] [MAIN ] Derivative Progress: 1373/2074 symbols completed. OII took 1.4s. Estimated remaining: 4m 52s. Rate: 144.1 symbols/min [2025-09-26T22:25:59.767088] [INFO ] [MAIN ] OLN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:59.781352] [DEBUG] [MAIN ] OIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:59.782591] [INFO ] [MAIN ] OIS: Generated 1820 derivative records from 41135 primary records. [2025-09-26T22:25:59.782859] [DEBUG] [LOCAL ] OIS: Saving derivative data. [2025-09-26T22:25:59.801419] [DEBUG] [LOCAL ] OIS: Derivative data saved (1820 records). [2025-09-26T22:25:59.801679] [INFO ] [MAIN ] OIS: Successfully saved derivative data. [2025-09-26T22:25:59.804382] [INFO ] [MAIN ] Derivative Progress: 1374/2074 symbols completed. OIS took 1.2s. Estimated remaining: 4m 51s. Rate: 144.2 symbols/min [2025-09-26T22:25:59.806934] [INFO ] [MAIN ] OLP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:59.821745] [DEBUG] [MAIN ] OKE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:25:59.822565] [INFO ] [MAIN ] OKE: Generated 1820 derivative records from 54316 primary records. [2025-09-26T22:25:59.822763] [DEBUG] [LOCAL ] OKE: Saving derivative data. [2025-09-26T22:25:59.841563] [DEBUG] [LOCAL ] OKE: Derivative data saved (1820 records). [2025-09-26T22:25:59.841748] [INFO ] [MAIN ] OKE: Successfully saved derivative data. [2025-09-26T22:25:59.844209] [INFO ] [MAIN ] Derivative Progress: 1375/2074 symbols completed. OKE took 1.2s. Estimated remaining: 4m 51s. Rate: 144.3 symbols/min [2025-09-26T22:25:59.844591] [INFO ] [MAIN ] OMC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:25:59.849436] [DEBUG] [LOCAL ] OLP: Loaded 9963 existing records from primary storage. [2025-09-26T22:25:59.849950] [INFO ] [MAIN ] OLP: Loaded 9963 primary data records. [2025-09-26T22:26:00.041144] [DEBUG] [LOCAL ] OLN: Loaded 52512 existing records from primary storage. [2025-09-26T22:26:00.059511] [INFO ] [MAIN ] OLN: Loaded 52512 primary data records. [2025-09-26T22:26:00.403922] [DEBUG] [LOCAL ] OMC: Loaded 54068 existing records from primary storage. [2025-09-26T22:26:00.461737] [INFO ] [MAIN ] OMC: Loaded 54068 primary data records. [2025-09-26T22:26:00.977548] [DEBUG] [MAIN ] OLP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:00.979313] [INFO ] [MAIN ] OLP: Generated 1820 derivative records from 9963 primary records. [2025-09-26T22:26:00.980339] [DEBUG] [LOCAL ] OLP: Saving derivative data. [2025-09-26T22:26:01.001560] [DEBUG] [LOCAL ] OLP: Derivative data saved (1820 records). [2025-09-26T22:26:01.002293] [INFO ] [MAIN ] OLP: Successfully saved derivative data. [2025-09-26T22:26:01.005172] [INFO ] [MAIN ] Derivative Progress: 1376/2074 symbols completed. OLP took 1.2s. Estimated remaining: 4m 51s. Rate: 144.1 symbols/min [2025-09-26T22:26:01.020106] [INFO ] [MAIN ] OMF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:01.020831] [DEBUG] [MAIN ] OLN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:01.021681] [INFO ] [MAIN ] OLN: Generated 1820 derivative records from 52512 primary records. [2025-09-26T22:26:01.021876] [DEBUG] [LOCAL ] OLN: Saving derivative data. [2025-09-26T22:26:01.039451] [DEBUG] [LOCAL ] OLN: Derivative data saved (1820 records). [2025-09-26T22:26:01.039749] [INFO ] [MAIN ] OLN: Successfully saved derivative data. [2025-09-26T22:26:01.041798] [INFO ] [MAIN ] Derivative Progress: 1377/2074 symbols completed. OLN took 1.3s. Estimated remaining: 4m 50s. Rate: 144.2 symbols/min [2025-09-26T22:26:01.042667] [INFO ] [MAIN ] OMI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:01.060085] [DEBUG] [MAIN ] OMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:01.060885] [INFO ] [MAIN ] OMC: Generated 1820 derivative records from 54068 primary records. [2025-09-26T22:26:01.060993] [DEBUG] [LOCAL ] OMC: Saving derivative data. [2025-09-26T22:26:01.078290] [DEBUG] [LOCAL ] OMC: Derivative data saved (1820 records). [2025-09-26T22:26:01.078487] [INFO ] [MAIN ] OMC: Successfully saved derivative data. [2025-09-26T22:26:01.081246] [INFO ] [MAIN ] Derivative Progress: 1378/2074 symbols completed. OMC took 1.2s. Estimated remaining: 4m 49s. Rate: 144.3 symbols/min [2025-09-26T22:26:01.137044] [DEBUG] [LOCAL ] OMF: Loaded 46898 existing records from primary storage. [2025-09-26T22:26:01.138608] [INFO ] [MAIN ] OMF: Loaded 46898 primary data records. [2025-09-26T22:26:01.175968] [DEBUG] [LOCAL ] OMI: Loaded 46583 existing records from primary storage. [2025-09-26T22:26:01.202740] [INFO ] [MAIN ] OMI: Loaded 46583 primary data records. [2025-09-26T22:26:01.886359] [DEBUG] [MAIN ] OMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:01.899858] [INFO ] [MAIN ] OMI: Generated 1820 derivative records from 46583 primary records. [2025-09-26T22:26:01.900055] [DEBUG] [MAIN ] OMF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:01.900153] [DEBUG] [LOCAL ] OMI: Saving derivative data. [2025-09-26T22:26:01.901093] [INFO ] [MAIN ] OMF: Generated 1820 derivative records from 46898 primary records. [2025-09-26T22:26:01.901528] [DEBUG] [LOCAL ] OMF: Saving derivative data. [2025-09-26T22:26:01.931364] [DEBUG] [LOCAL ] OMF: Derivative data saved (1820 records). [2025-09-26T22:26:01.931981] [INFO ] [MAIN ] OMF: Successfully saved derivative data. [2025-09-26T22:26:01.934494] [INFO ] [MAIN ] Derivative Progress: 1379/2074 symbols completed. OMF took 0.9s. Estimated remaining: 4m 49s. Rate: 144.2 symbols/min [2025-09-26T22:26:01.935971] [DEBUG] [LOCAL ] OMI: Derivative data saved (1820 records). [2025-09-26T22:26:01.936039] [INFO ] [MAIN ] OMI: Successfully saved derivative data. [2025-09-26T22:26:01.938158] [INFO ] [MAIN ] Derivative Progress: 1380/2074 symbols completed. OMI took 0.9s. Estimated remaining: 4m 49s. Rate: 144.3 symbols/min [2025-09-26T22:26:01.938858] [INFO ] [MAIN ] ONON: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:01.938736] [INFO ] [MAIN ] ONL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:01.938951] [INFO ] [MAIN ] ONIT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:01.951024] [DEBUG] [LOCAL ] ONIT: Loaded 7871 existing records from primary storage. [2025-09-26T22:26:01.951157] [INFO ] [MAIN ] ONIT: Loaded 7871 primary data records. [2025-09-26T22:26:02.172435] [DEBUG] [LOCAL ] ONL: Loaded 31806 existing records from primary storage. [2025-09-26T22:26:02.193541] [INFO ] [MAIN ] ONL: Loaded 31806 primary data records. [2025-09-26T22:26:02.458590] [DEBUG] [LOCAL ] ONON: Loaded 54392 existing records from primary storage. [2025-09-26T22:26:02.480442] [INFO ] [MAIN ] ONON: Loaded 54392 primary data records. [2025-09-26T22:26:03.039766] [DEBUG] [MAIN ] ONIT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:03.041877] [INFO ] [MAIN ] ONIT: Generated 1820 derivative records from 7871 primary records. [2025-09-26T22:26:03.042173] [DEBUG] [LOCAL ] ONIT: Saving derivative data. [2025-09-26T22:26:03.061049] [DEBUG] [LOCAL ] ONIT: Derivative data saved (1820 records). [2025-09-26T22:26:03.061304] [INFO ] [MAIN ] ONIT: Successfully saved derivative data. [2025-09-26T22:26:03.063958] [INFO ] [MAIN ] Derivative Progress: 1381/2074 symbols completed. ONIT took 1.1s. Estimated remaining: 4m 49s. Rate: 144.1 symbols/min [2025-09-26T22:26:03.066594] [INFO ] [MAIN ] ONTF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:03.082150] [DEBUG] [MAIN ] ONL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:03.082958] [INFO ] [MAIN ] ONL: Generated 1820 derivative records from 31806 primary records. [2025-09-26T22:26:03.083093] [DEBUG] [LOCAL ] ONL: Saving derivative data. [2025-09-26T22:26:03.100624] [DEBUG] [LOCAL ] ONL: Derivative data saved (1820 records). [2025-09-26T22:26:03.109071] [INFO ] [MAIN ] ONL: Successfully saved derivative data. [2025-09-26T22:26:03.112029] [INFO ] [MAIN ] Derivative Progress: 1382/2074 symbols completed. ONL took 1.2s. Estimated remaining: 4m 48s. Rate: 144.2 symbols/min [2025-09-26T22:26:03.112702] [INFO ] [MAIN ] ONTO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:03.127104] [DEBUG] [MAIN ] ONON: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:03.135575] [INFO ] [MAIN ] ONON: Generated 1820 derivative records from 54392 primary records. [2025-09-26T22:26:03.135780] [DEBUG] [LOCAL ] ONON: Saving derivative data. [2025-09-26T22:26:03.136251] [DEBUG] [LOCAL ] ONTF: Loaded 23187 existing records from primary storage. [2025-09-26T22:26:03.137287] [INFO ] [MAIN ] ONTF: Loaded 23187 primary data records. [2025-09-26T22:26:03.270534] [DEBUG] [LOCAL ] ONON: Derivative data saved (1820 records). [2025-09-26T22:26:03.283822] [INFO ] [MAIN ] ONON: Successfully saved derivative data. [2025-09-26T22:26:03.286846] [INFO ] [MAIN ] Derivative Progress: 1383/2074 symbols completed. ONON took 1.3s. Estimated remaining: 4m 47s. Rate: 144.2 symbols/min [2025-09-26T22:26:03.297860] [INFO ] [MAIN ] OOMA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:03.387565] [DEBUG] [LOCAL ] ONTO: Loaded 47339 existing records from primary storage. [2025-09-26T22:26:03.544296] [INFO ] [MAIN ] ONTO: Loaded 47339 primary data records. [2025-09-26T22:26:03.617870] [DEBUG] [LOCAL ] OOMA: Loaded 19260 existing records from primary storage. [2025-09-26T22:26:03.652131] [INFO ] [MAIN ] OOMA: Loaded 19260 primary data records. [2025-09-26T22:26:04.240901] [DEBUG] [MAIN ] ONTF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:04.242743] [INFO ] [MAIN ] ONTF: Generated 1820 derivative records from 23187 primary records. [2025-09-26T22:26:04.243866] [DEBUG] [LOCAL ] ONTF: Saving derivative data. [2025-09-26T22:26:04.267167] [DEBUG] [LOCAL ] ONTF: Derivative data saved (1820 records). [2025-09-26T22:26:04.267416] [INFO ] [MAIN ] ONTF: Successfully saved derivative data. [2025-09-26T22:26:04.269834] [INFO ] [MAIN ] Derivative Progress: 1384/2074 symbols completed. ONTF took 1.2s. Estimated remaining: 4m 47s. Rate: 144.1 symbols/min [2025-09-26T22:26:04.270335] [INFO ] [MAIN ] OPAD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:04.290393] [DEBUG] [MAIN ] ONTO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:04.293937] [INFO ] [MAIN ] ONTO: Generated 1820 derivative records from 47339 primary records. [2025-09-26T22:26:04.300073] [DEBUG] [LOCAL ] ONTO: Saving derivative data. [2025-09-26T22:26:04.321820] [DEBUG] [MAIN ] OOMA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:04.337547] [INFO ] [MAIN ] OOMA: Generated 1820 derivative records from 19260 primary records. [2025-09-26T22:26:04.338731] [DEBUG] [LOCAL ] ONTO: Derivative data saved (1820 records). [2025-09-26T22:26:04.339615] [INFO ] [MAIN ] ONTO: Successfully saved derivative data. [2025-09-26T22:26:04.339318] [DEBUG] [LOCAL ] OPAD: Loaded 20793 existing records from primary storage. [2025-09-26T22:26:04.339533] [DEBUG] [LOCAL ] OOMA: Saving derivative data. [2025-09-26T22:26:04.342628] [INFO ] [MAIN ] OPAD: Loaded 20793 primary data records. [2025-09-26T22:26:04.342352] [INFO ] [MAIN ] Derivative Progress: 1385/2074 symbols completed. ONTO took 1.2s. Estimated remaining: 4m 47s. Rate: 144.2 symbols/min [2025-09-26T22:26:04.364226] [INFO ] [MAIN ] OPFI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:04.402782] [DEBUG] [LOCAL ] OOMA: Derivative data saved (1820 records). [2025-09-26T22:26:04.422751] [INFO ] [MAIN ] OOMA: Successfully saved derivative data. [2025-09-26T22:26:04.444904] [INFO ] [MAIN ] Derivative Progress: 1386/2074 symbols completed. OOMA took 1.1s. Estimated remaining: 4m 46s. Rate: 144.3 symbols/min [2025-09-26T22:26:04.463283] [INFO ] [MAIN ] OPP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:04.710876] [DEBUG] [LOCAL ] OPP: Loaded 11678 existing records from primary storage. [2025-09-26T22:26:04.711058] [INFO ] [MAIN ] OPP: Loaded 11678 primary data records. [2025-09-26T22:26:04.838877] [DEBUG] [LOCAL ] OPFI: Loaded 47258 existing records from primary storage. [2025-09-26T22:26:04.849104] [INFO ] [MAIN ] OPFI: Loaded 47258 primary data records. [2025-09-26T22:26:05.448330] [DEBUG] [MAIN ] OPAD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:05.451028] [INFO ] [MAIN ] OPAD: Generated 1820 derivative records from 20793 primary records. [2025-09-26T22:26:05.451226] [DEBUG] [LOCAL ] OPAD: Saving derivative data. [2025-09-26T22:26:05.470164] [DEBUG] [LOCAL ] OPAD: Derivative data saved (1820 records). [2025-09-26T22:26:05.470744] [INFO ] [MAIN ] OPAD: Successfully saved derivative data. [2025-09-26T22:26:05.473428] [INFO ] [MAIN ] Derivative Progress: 1387/2074 symbols completed. OPAD took 1.2s. Estimated remaining: 4m 46s. Rate: 144.1 symbols/min [2025-09-26T22:26:05.473832] [INFO ] [MAIN ] OR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:05.492572] [DEBUG] [MAIN ] OPP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:05.493479] [INFO ] [MAIN ] OPP: Generated 1820 derivative records from 11678 primary records. [2025-09-26T22:26:05.493608] [DEBUG] [LOCAL ] OPP: Saving derivative data. [2025-09-26T22:26:05.510964] [DEBUG] [LOCAL ] OPP: Derivative data saved (1820 records). [2025-09-26T22:26:05.511148] [INFO ] [MAIN ] OPP: Successfully saved derivative data. [2025-09-26T22:26:05.513455] [INFO ] [MAIN ] Derivative Progress: 1388/2074 symbols completed. OPP took 1.1s. Estimated remaining: 4m 45s. Rate: 144.2 symbols/min [2025-09-26T22:26:05.516496] [INFO ] [MAIN ] ORA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:05.530836] [DEBUG] [MAIN ] OPFI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:05.531624] [INFO ] [MAIN ] OPFI: Generated 1820 derivative records from 47258 primary records. [2025-09-26T22:26:05.542600] [DEBUG] [LOCAL ] OPFI: Saving derivative data. [2025-09-26T22:26:05.575760] [DEBUG] [LOCAL ] OR: Loaded 46786 existing records from primary storage. [2025-09-26T22:26:05.576500] [DEBUG] [LOCAL ] OPFI: Derivative data saved (1820 records). [2025-09-26T22:26:05.585337] [INFO ] [MAIN ] OR: Loaded 46786 primary data records. [2025-09-26T22:26:05.585199] [INFO ] [MAIN ] OPFI: Successfully saved derivative data. [2025-09-26T22:26:05.593600] [INFO ] [MAIN ] Derivative Progress: 1389/2074 symbols completed. OPFI took 1.2s. Estimated remaining: 4m 45s. Rate: 144.3 symbols/min [2025-09-26T22:26:05.646412] [INFO ] [MAIN ] ORC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:05.722424] [DEBUG] [LOCAL ] ORA: Loaded 33001 existing records from primary storage. [2025-09-26T22:26:05.723106] [INFO ] [MAIN ] ORA: Loaded 33001 primary data records. [2025-09-26T22:26:06.316305] [DEBUG] [LOCAL ] ORC: Loaded 53083 existing records from primary storage. [2025-09-26T22:26:06.316889] [INFO ] [MAIN ] ORC: Loaded 53083 primary data records. [2025-09-26T22:26:06.606271] [DEBUG] [MAIN ] OR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:06.663198] [INFO ] [MAIN ] OR: Generated 1820 derivative records from 46786 primary records. [2025-09-26T22:26:06.663779] [DEBUG] [LOCAL ] OR: Saving derivative data. [2025-09-26T22:26:06.682483] [DEBUG] [LOCAL ] OR: Derivative data saved (1820 records). [2025-09-26T22:26:06.683426] [INFO ] [MAIN ] OR: Successfully saved derivative data. [2025-09-26T22:26:06.685678] [INFO ] [MAIN ] Derivative Progress: 1390/2074 symbols completed. OR took 1.2s. Estimated remaining: 4m 45s. Rate: 144.1 symbols/min [2025-09-26T22:26:06.686447] [INFO ] [MAIN ] ORN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:06.705332] [DEBUG] [MAIN ] ORA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:06.707459] [INFO ] [MAIN ] ORA: Generated 1820 derivative records from 33001 primary records. [2025-09-26T22:26:06.707918] [DEBUG] [LOCAL ] ORA: Saving derivative data. [2025-09-26T22:26:06.734129] [DEBUG] [LOCAL ] ORA: Derivative data saved (1820 records). [2025-09-26T22:26:06.734612] [INFO ] [MAIN ] ORA: Successfully saved derivative data. [2025-09-26T22:26:06.737019] [INFO ] [MAIN ] Derivative Progress: 1391/2074 symbols completed. ORA took 1.2s. Estimated remaining: 4m 44s. Rate: 144.2 symbols/min [2025-09-26T22:26:06.738038] [INFO ] [MAIN ] OSCR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:06.756201] [DEBUG] [LOCAL ] ORN: Loaded 31979 existing records from primary storage. [2025-09-26T22:26:06.768964] [INFO ] [MAIN ] ORN: Loaded 31979 primary data records. [2025-09-26T22:26:06.770048] [DEBUG] [MAIN ] ORC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:06.776782] [INFO ] [MAIN ] ORC: Generated 1820 derivative records from 53083 primary records. [2025-09-26T22:26:06.821387] [DEBUG] [LOCAL ] ORC: Saving derivative data. [2025-09-26T22:26:07.137829] [DEBUG] [LOCAL ] ORC: Derivative data saved (1820 records). [2025-09-26T22:26:07.137985] [INFO ] [MAIN ] ORC: Successfully saved derivative data. [2025-09-26T22:26:07.140428] [INFO ] [MAIN ] Derivative Progress: 1392/2074 symbols completed. ORC took 1.5s. Estimated remaining: 4m 44s. Rate: 144.2 symbols/min [2025-09-26T22:26:07.141760] [INFO ] [MAIN ] OTIS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:07.162834] [DEBUG] [LOCAL ] OSCR: Loaded 54502 existing records from primary storage. [2025-09-26T22:26:07.163429] [INFO ] [MAIN ] OSCR: Loaded 54502 primary data records. [2025-09-26T22:26:07.550792] [DEBUG] [MAIN ] ORN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:07.552371] [INFO ] [MAIN ] ORN: Generated 1820 derivative records from 31979 primary records. [2025-09-26T22:26:07.553791] [DEBUG] [LOCAL ] OTIS: Loaded 53481 existing records from primary storage. [2025-09-26T22:26:07.553931] [INFO ] [MAIN ] OTIS: Loaded 53481 primary data records. [2025-09-26T22:26:07.554250] [DEBUG] [LOCAL ] ORN: Saving derivative data. [2025-09-26T22:26:07.727409] [DEBUG] [LOCAL ] ORN: Derivative data saved (1820 records). [2025-09-26T22:26:07.763680] [INFO ] [MAIN ] ORN: Successfully saved derivative data. [2025-09-26T22:26:07.771459] [INFO ] [MAIN ] Derivative Progress: 1393/2074 symbols completed. ORN took 1.1s. Estimated remaining: 4m 43s. Rate: 144.2 symbols/min [2025-09-26T22:26:07.990959] [DEBUG] [MAIN ] OSCR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:07.992439] [INFO ] [MAIN ] OSCR: Generated 1820 derivative records from 54502 primary records. [2025-09-26T22:26:07.992835] [DEBUG] [LOCAL ] OSCR: Saving derivative data. [2025-09-26T22:26:08.011032] [DEBUG] [LOCAL ] OSCR: Derivative data saved (1820 records). [2025-09-26T22:26:08.011203] [INFO ] [MAIN ] OSCR: Successfully saved derivative data. [2025-09-26T22:26:08.013575] [INFO ] [MAIN ] Derivative Progress: 1394/2074 symbols completed. OSCR took 1.3s. Estimated remaining: 4m 43s. Rate: 144.2 symbols/min [2025-09-26T22:26:08.033263] [DEBUG] [MAIN ] OTIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:08.033912] [INFO ] [MAIN ] OTIS: Generated 1820 derivative records from 53481 primary records. [2025-09-26T22:26:08.033975] [DEBUG] [LOCAL ] OTIS: Saving derivative data. [2025-09-26T22:26:08.050261] [DEBUG] [LOCAL ] OTIS: Derivative data saved (1820 records). [2025-09-26T22:26:08.050337] [INFO ] [MAIN ] OTIS: Successfully saved derivative data. [2025-09-26T22:26:08.052722] [INFO ] [MAIN ] Derivative Progress: 1395/2074 symbols completed. OTIS took 0.9s. Estimated remaining: 4m 42s. Rate: 144.3 symbols/min [2025-09-26T22:26:08.053409] [INFO ] [MAIN ] OUT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:08.053515] [INFO ] [MAIN ] OWL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:08.053734] [INFO ] [MAIN ] OVV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:08.164202] [DEBUG] [LOCAL ] OUT: Loaded 48630 existing records from primary storage. [2025-09-26T22:26:08.164975] [DEBUG] [LOCAL ] OVV: Loaded 54295 existing records from primary storage. [2025-09-26T22:26:08.165330] [INFO ] [MAIN ] OUT: Loaded 48630 primary data records. [2025-09-26T22:26:08.165276] [INFO ] [MAIN ] OVV: Loaded 54295 primary data records. [2025-09-26T22:26:08.400435] [DEBUG] [LOCAL ] OWL: Loaded 54335 existing records from primary storage. [2025-09-26T22:26:08.413443] [INFO ] [MAIN ] OWL: Loaded 54335 primary data records. [2025-09-26T22:26:09.206378] [DEBUG] [MAIN ] OUT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:09.207259] [DEBUG] [MAIN ] OVV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:09.208968] [INFO ] [MAIN ] OVV: Generated 1820 derivative records from 54295 primary records. [2025-09-26T22:26:09.208098] [INFO ] [MAIN ] OUT: Generated 1820 derivative records from 48630 primary records. [2025-09-26T22:26:09.209239] [DEBUG] [LOCAL ] OVV: Saving derivative data. [2025-09-26T22:26:09.209907] [DEBUG] [LOCAL ] OUT: Saving derivative data. [2025-09-26T22:26:09.241472] [DEBUG] [LOCAL ] OVV: Derivative data saved (1820 records). [2025-09-26T22:26:09.242756] [INFO ] [MAIN ] OVV: Successfully saved derivative data. [2025-09-26T22:26:09.248170] [INFO ] [MAIN ] Derivative Progress: 1396/2074 symbols completed. OVV took 1.2s. Estimated remaining: 4m 42s. Rate: 144.1 symbols/min [2025-09-26T22:26:09.249894] [INFO ] [MAIN ] OWLT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:09.249449] [DEBUG] [LOCAL ] OUT: Derivative data saved (1820 records). [2025-09-26T22:26:09.250779] [INFO ] [MAIN ] OUT: Successfully saved derivative data. [2025-09-26T22:26:09.258951] [INFO ] [MAIN ] Derivative Progress: 1397/2074 symbols completed. OUT took 1.2s. Estimated remaining: 4m 42s. Rate: 144.2 symbols/min [2025-09-26T22:26:09.269073] [INFO ] [MAIN ] OXM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:09.268720] [DEBUG] [MAIN ] OWL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:09.270026] [INFO ] [MAIN ] OWL: Generated 1820 derivative records from 54335 primary records. [2025-09-26T22:26:09.270544] [DEBUG] [LOCAL ] OWL: Saving derivative data. [2025-09-26T22:26:09.293502] [DEBUG] [LOCAL ] OWLT: Loaded 9099 existing records from primary storage. [2025-09-26T22:26:09.295497] [INFO ] [MAIN ] OWLT: Loaded 9099 primary data records. [2025-09-26T22:26:09.297144] [DEBUG] [LOCAL ] OWL: Derivative data saved (1820 records). [2025-09-26T22:26:09.297288] [INFO ] [MAIN ] OWL: Successfully saved derivative data. [2025-09-26T22:26:09.338734] [INFO ] [MAIN ] Derivative Progress: 1398/2074 symbols completed. OWL took 1.3s. Estimated remaining: 4m 41s. Rate: 144.3 symbols/min [2025-09-26T22:26:09.407736] [INFO ] [MAIN ] PAAS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:09.516489] [DEBUG] [LOCAL ] OXM: Loaded 33928 existing records from primary storage. [2025-09-26T22:26:09.614772] [INFO ] [MAIN ] OXM: Loaded 33928 primary data records. [2025-09-26T22:26:10.049828] [DEBUG] [LOCAL ] PAAS: Loaded 54383 existing records from primary storage. [2025-09-26T22:26:10.050353] [INFO ] [MAIN ] PAAS: Loaded 54383 primary data records. [2025-09-26T22:26:10.196822] [DEBUG] [MAIN ] OWLT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:10.272375] [INFO ] [MAIN ] OWLT: Generated 1820 derivative records from 9099 primary records. [2025-09-26T22:26:10.331292] [DEBUG] [LOCAL ] OWLT: Saving derivative data. [2025-09-26T22:26:10.429948] [DEBUG] [LOCAL ] OWLT: Derivative data saved (1820 records). [2025-09-26T22:26:10.431241] [INFO ] [MAIN ] OWLT: Successfully saved derivative data. [2025-09-26T22:26:10.436472] [INFO ] [MAIN ] Derivative Progress: 1399/2074 symbols completed. OWLT took 1.2s. Estimated remaining: 4m 41s. Rate: 144.1 symbols/min [2025-09-26T22:26:10.436977] [INFO ] [MAIN ] PAC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:10.463244] [DEBUG] [MAIN ] OXM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:10.464681] [INFO ] [MAIN ] OXM: Generated 1820 derivative records from 33928 primary records. [2025-09-26T22:26:10.465079] [DEBUG] [LOCAL ] OXM: Saving derivative data. [2025-09-26T22:26:10.472495] [DEBUG] [LOCAL ] PAC: Loaded 11725 existing records from primary storage. [2025-09-26T22:26:10.484880] [INFO ] [MAIN ] PAC: Loaded 11725 primary data records. [2025-09-26T22:26:10.489304] [DEBUG] [LOCAL ] OXM: Derivative data saved (1820 records). [2025-09-26T22:26:10.489726] [INFO ] [MAIN ] OXM: Successfully saved derivative data. [2025-09-26T22:26:10.492431] [INFO ] [MAIN ] Derivative Progress: 1400/2074 symbols completed. OXM took 1.2s. Estimated remaining: 4m 40s. Rate: 144.2 symbols/min [2025-09-26T22:26:10.527358] [INFO ] [MAIN ] PACK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:10.663118] [DEBUG] [MAIN ] PAAS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:10.692292] [INFO ] [MAIN ] PAAS: Generated 1820 derivative records from 54383 primary records. [2025-09-26T22:26:10.719391] [DEBUG] [LOCAL ] PAAS: Saving derivative data. [2025-09-26T22:26:10.907062] [DEBUG] [LOCAL ] PAAS: Derivative data saved (1820 records). [2025-09-26T22:26:10.906009] [DEBUG] [LOCAL ] PACK: Loaded 32471 existing records from primary storage. [2025-09-26T22:26:10.907860] [INFO ] [MAIN ] PACK: Loaded 32471 primary data records. [2025-09-26T22:26:10.907540] [INFO ] [MAIN ] PAAS: Successfully saved derivative data. [2025-09-26T22:26:10.910713] [INFO ] [MAIN ] Derivative Progress: 1401/2074 symbols completed. PAAS took 1.5s. Estimated remaining: 4m 40s. Rate: 144.2 symbols/min [2025-09-26T22:26:10.955910] [INFO ] [MAIN ] PACS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:11.364288] [DEBUG] [LOCAL ] PACS: Loaded 34761 existing records from primary storage. [2025-09-26T22:26:11.365533] [INFO ] [MAIN ] PACS: Loaded 34761 primary data records. [2025-09-26T22:26:11.442119] [DEBUG] [MAIN ] PAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:11.477158] [INFO ] [MAIN ] PAC: Generated 1820 derivative records from 11725 primary records. [2025-09-26T22:26:11.520607] [DEBUG] [LOCAL ] PAC: Saving derivative data. [2025-09-26T22:26:11.620105] [DEBUG] [LOCAL ] PAC: Derivative data saved (1820 records). [2025-09-26T22:26:11.634701] [INFO ] [MAIN ] PAC: Successfully saved derivative data. [2025-09-26T22:26:11.659600] [INFO ] [MAIN ] Derivative Progress: 1402/2074 symbols completed. PAC took 1.2s. Estimated remaining: 4m 40s. Rate: 144.1 symbols/min [2025-09-26T22:26:11.687418] [INFO ] [MAIN ] PAG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:11.861044] [DEBUG] [MAIN ] PACK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:11.862248] [INFO ] [MAIN ] PACK: Generated 1820 derivative records from 32471 primary records. [2025-09-26T22:26:11.863212] [DEBUG] [LOCAL ] PACK: Saving derivative data. [2025-09-26T22:26:11.887269] [DEBUG] [LOCAL ] PACK: Derivative data saved (1820 records). [2025-09-26T22:26:11.888246] [INFO ] [MAIN ] PACK: Successfully saved derivative data. [2025-09-26T22:26:11.891054] [INFO ] [MAIN ] Derivative Progress: 1403/2074 symbols completed. PACK took 1.4s. Estimated remaining: 4m 39s. Rate: 144.2 symbols/min [2025-09-26T22:26:11.899031] [INFO ] [MAIN ] PAI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:11.906062] [DEBUG] [LOCAL ] PAI: Loaded 2758 existing records from primary storage. [2025-09-26T22:26:11.914970] [INFO ] [MAIN ] PAI: Loaded 2758 primary data records. [2025-09-26T22:26:11.923930] [DEBUG] [LOCAL ] PAG: Loaded 22217 existing records from primary storage. [2025-09-26T22:26:11.962335] [INFO ] [MAIN ] PAG: Loaded 22217 primary data records. [2025-09-26T22:26:12.290006] [DEBUG] [MAIN ] PACS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:12.466817] [INFO ] [MAIN ] PACS: Generated 1820 derivative records from 34761 primary records. [2025-09-26T22:26:12.486633] [DEBUG] [LOCAL ] PACS: Saving derivative data. [2025-09-26T22:26:12.707760] [DEBUG] [LOCAL ] PACS: Derivative data saved (1820 records). [2025-09-26T22:26:12.708486] [INFO ] [MAIN ] PACS: Successfully saved derivative data. [2025-09-26T22:26:12.710996] [INFO ] [MAIN ] Derivative Progress: 1404/2074 symbols completed. PACS took 1.8s. Estimated remaining: 4m 39s. Rate: 144.1 symbols/min [2025-09-26T22:26:12.711492] [INFO ] [MAIN ] PAM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:12.748842] [DEBUG] [MAIN ] PAI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:12.749752] [INFO ] [MAIN ] PAI: Generated 1820 derivative records from 2758 primary records. [2025-09-26T22:26:12.757769] [DEBUG] [LOCAL ] PAI: Saving derivative data. [2025-09-26T22:26:12.760028] [DEBUG] [LOCAL ] PAM: Loaded 28420 existing records from primary storage. [2025-09-26T22:26:12.760235] [INFO ] [MAIN ] PAM: Loaded 28420 primary data records. [2025-09-26T22:26:12.890698] [DEBUG] [LOCAL ] PAI: Derivative data saved (1820 records). [2025-09-26T22:26:12.890574] [DEBUG] [MAIN ] PAG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:12.898885] [INFO ] [MAIN ] PAI: Successfully saved derivative data. [2025-09-26T22:26:12.905862] [INFO ] [MAIN ] Derivative Progress: 1405/2074 symbols completed. PAI took 1.0s. Estimated remaining: 4m 38s. Rate: 144.1 symbols/min [2025-09-26T22:26:12.906337] [INFO ] [MAIN ] PAR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:12.899619] [INFO ] [MAIN ] PAG: Generated 1820 derivative records from 22217 primary records. [2025-09-26T22:26:12.906881] [DEBUG] [LOCAL ] PAG: Saving derivative data. [2025-09-26T22:26:13.011901] [DEBUG] [LOCAL ] PAG: Derivative data saved (1820 records). [2025-09-26T22:26:13.142583] [INFO ] [MAIN ] PAG: Successfully saved derivative data. [2025-09-26T22:26:13.145246] [INFO ] [MAIN ] Derivative Progress: 1406/2074 symbols completed. PAG took 1.5s. Estimated remaining: 4m 38s. Rate: 144.2 symbols/min [2025-09-26T22:26:13.145756] [INFO ] [MAIN ] PARR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:13.165041] [DEBUG] [LOCAL ] PAR: Loaded 33188 existing records from primary storage. [2025-09-26T22:26:13.165699] [INFO ] [MAIN ] PAR: Loaded 33188 primary data records. [2025-09-26T22:26:13.522507] [DEBUG] [LOCAL ] PARR: Loaded 49062 existing records from primary storage. [2025-09-26T22:26:13.524903] [INFO ] [MAIN ] PARR: Loaded 49062 primary data records. [2025-09-26T22:26:13.631939] [DEBUG] [MAIN ] PAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:13.646521] [INFO ] [MAIN ] PAM: Generated 1820 derivative records from 28420 primary records. [2025-09-26T22:26:13.659083] [DEBUG] [LOCAL ] PAM: Saving derivative data. [2025-09-26T22:26:13.883625] [DEBUG] [LOCAL ] PAM: Derivative data saved (1820 records). [2025-09-26T22:26:13.883952] [INFO ] [MAIN ] PAM: Successfully saved derivative data. [2025-09-26T22:26:13.886541] [INFO ] [MAIN ] Derivative Progress: 1407/2074 symbols completed. PAM took 1.2s. Estimated remaining: 4m 38s. Rate: 144.1 symbols/min [2025-09-26T22:26:13.887787] [INFO ] [MAIN ] PATH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:13.911036] [DEBUG] [MAIN ] PAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:13.911862] [INFO ] [MAIN ] PAR: Generated 1820 derivative records from 33188 primary records. [2025-09-26T22:26:13.912040] [DEBUG] [LOCAL ] PAR: Saving derivative data. [2025-09-26T22:26:13.934158] [DEBUG] [LOCAL ] PAR: Derivative data saved (1820 records). [2025-09-26T22:26:13.934348] [INFO ] [MAIN ] PAR: Successfully saved derivative data. [2025-09-26T22:26:13.936893] [INFO ] [MAIN ] Derivative Progress: 1408/2074 symbols completed. PAR took 1.0s. Estimated remaining: 4m 37s. Rate: 144.2 symbols/min [2025-09-26T22:26:13.955870] [DEBUG] [MAIN ] PARR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:13.971261] [INFO ] [MAIN ] PARR: Generated 1820 derivative records from 49062 primary records. [2025-09-26T22:26:13.971381] [DEBUG] [LOCAL ] PARR: Saving derivative data. [2025-09-26T22:26:13.989693] [DEBUG] [LOCAL ] PARR: Derivative data saved (1820 records). [2025-09-26T22:26:13.989925] [INFO ] [MAIN ] PARR: Successfully saved derivative data. [2025-09-26T22:26:13.992284] [INFO ] [MAIN ] Derivative Progress: 1409/2074 symbols completed. PARR took 0.8s. Estimated remaining: 4m 37s. Rate: 144.3 symbols/min [2025-09-26T22:26:14.009282] [DEBUG] [LOCAL ] PATH: Loaded 54457 existing records from primary storage. [2025-09-26T22:26:14.009442] [INFO ] [MAIN ] PATH: Loaded 54457 primary data records. [2025-09-26T22:26:14.390284] [DEBUG] [MAIN ] PATH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:14.391147] [INFO ] [MAIN ] PATH: Generated 1820 derivative records from 54457 primary records. [2025-09-26T22:26:14.391216] [DEBUG] [LOCAL ] PATH: Saving derivative data. [2025-09-26T22:26:14.409186] [DEBUG] [LOCAL ] PATH: Derivative data saved (1820 records). [2025-09-26T22:26:14.409301] [INFO ] [MAIN ] PATH: Successfully saved derivative data. [2025-09-26T22:26:14.411492] [INFO ] [MAIN ] Derivative Progress: 1410/2074 symbols completed. PATH took 0.5s. Estimated remaining: 4m 36s. Rate: 144.3 symbols/min [2025-09-26T22:26:14.412252] [INFO ] [MAIN ] PAYC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:14.412127] [INFO ] [MAIN ] PAY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:14.412569] [INFO ] [MAIN ] PAXS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:14.440628] [DEBUG] [LOCAL ] PAXS: Loaded 21210 existing records from primary storage. [2025-09-26T22:26:14.440880] [INFO ] [MAIN ] PAXS: Loaded 21210 primary data records. [2025-09-26T22:26:14.635839] [DEBUG] [LOCAL ] PAY: Loaded 38892 existing records from primary storage. [2025-09-26T22:26:14.646437] [INFO ] [MAIN ] PAY: Loaded 38892 primary data records. [2025-09-26T22:26:14.662780] [DEBUG] [LOCAL ] PAYC: Loaded 36903 existing records from primary storage. [2025-09-26T22:26:14.773701] [INFO ] [MAIN ] PAYC: Loaded 36903 primary data records. [2025-09-26T22:26:15.516125] [DEBUG] [MAIN ] PAXS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:15.517191] [INFO ] [MAIN ] PAXS: Generated 1820 derivative records from 21210 primary records. [2025-09-26T22:26:15.517453] [DEBUG] [LOCAL ] PAXS: Saving derivative data. [2025-09-26T22:26:15.539467] [DEBUG] [LOCAL ] PAXS: Derivative data saved (1820 records). [2025-09-26T22:26:15.548042] [INFO ] [MAIN ] PAXS: Successfully saved derivative data. [2025-09-26T22:26:15.557058] [DEBUG] [MAIN ] PAY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:15.556082] [INFO ] [MAIN ] Derivative Progress: 1411/2074 symbols completed. PAXS took 1.1s. Estimated remaining: 4m 36s. Rate: 144.1 symbols/min [2025-09-26T22:26:15.559014] [INFO ] [MAIN ] PAY: Generated 1820 derivative records from 38892 primary records. [2025-09-26T22:26:15.559255] [INFO ] [MAIN ] PBA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:15.559398] [DEBUG] [LOCAL ] PAY: Saving derivative data. [2025-09-26T22:26:15.591875] [DEBUG] [LOCAL ] PAY: Derivative data saved (1820 records). [2025-09-26T22:26:15.592422] [INFO ] [MAIN ] PAY: Successfully saved derivative data. [2025-09-26T22:26:15.594866] [INFO ] [MAIN ] Derivative Progress: 1412/2074 symbols completed. PAY took 1.2s. Estimated remaining: 4m 35s. Rate: 144.2 symbols/min [2025-09-26T22:26:15.595291] [INFO ] [MAIN ] PBF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:15.592356] [DEBUG] [MAIN ] PAYC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:15.596346] [INFO ] [MAIN ] PAYC: Generated 1820 derivative records from 36903 primary records. [2025-09-26T22:26:15.596493] [DEBUG] [LOCAL ] PAYC: Saving derivative data. [2025-09-26T22:26:15.621972] [DEBUG] [LOCAL ] PAYC: Derivative data saved (1820 records). [2025-09-26T22:26:15.622177] [INFO ] [MAIN ] PAYC: Successfully saved derivative data. [2025-09-26T22:26:15.625579] [INFO ] [MAIN ] Derivative Progress: 1413/2074 symbols completed. PAYC took 1.2s. Estimated remaining: 4m 35s. Rate: 144.3 symbols/min [2025-09-26T22:26:15.626055] [INFO ] [MAIN ] PBH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:15.690575] [DEBUG] [LOCAL ] PBA: Loaded 49665 existing records from primary storage. [2025-09-26T22:26:15.700092] [INFO ] [MAIN ] PBA: Loaded 49665 primary data records. [2025-09-26T22:26:15.700739] [DEBUG] [LOCAL ] PBH: Loaded 32156 existing records from primary storage. [2025-09-26T22:26:15.743149] [INFO ] [MAIN ] PBH: Loaded 32156 primary data records. [2025-09-26T22:26:15.902703] [DEBUG] [LOCAL ] PBF: Loaded 53866 existing records from primary storage. [2025-09-26T22:26:15.949999] [INFO ] [MAIN ] PBF: Loaded 53866 primary data records. [2025-09-26T22:26:16.854127] [DEBUG] [MAIN ] PBA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:16.869808] [DEBUG] [MAIN ] PBH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:16.869101] [INFO ] [MAIN ] PBA: Generated 1820 derivative records from 49665 primary records. [2025-09-26T22:26:16.870144] [DEBUG] [LOCAL ] PBA: Saving derivative data. [2025-09-26T22:26:16.871086] [INFO ] [MAIN ] PBH: Generated 1820 derivative records from 32156 primary records. [2025-09-26T22:26:16.871634] [DEBUG] [LOCAL ] PBH: Saving derivative data. [2025-09-26T22:26:16.899849] [DEBUG] [LOCAL ] PBA: Derivative data saved (1820 records). [2025-09-26T22:26:16.905007] [INFO ] [MAIN ] PBA: Successfully saved derivative data. [2025-09-26T22:26:16.907606] [DEBUG] [LOCAL ] PBH: Derivative data saved (1820 records). [2025-09-26T22:26:16.910865] [INFO ] [MAIN ] Derivative Progress: 1414/2074 symbols completed. PBA took 1.4s. Estimated remaining: 4m 35s. Rate: 144.1 symbols/min [2025-09-26T22:26:16.912915] [INFO ] [MAIN ] PBH: Successfully saved derivative data. [2025-09-26T22:26:16.912128] [INFO ] [MAIN ] PBI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:16.915524] [INFO ] [MAIN ] Derivative Progress: 1415/2074 symbols completed. PBH took 1.3s. Estimated remaining: 4m 34s. Rate: 144.2 symbols/min [2025-09-26T22:26:16.916436] [INFO ] [MAIN ] PBR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:16.930247] [DEBUG] [MAIN ] PBF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:16.931227] [INFO ] [MAIN ] PBF: Generated 1820 derivative records from 53866 primary records. [2025-09-26T22:26:16.931419] [DEBUG] [LOCAL ] PBF: Saving derivative data. [2025-09-26T22:26:16.949981] [DEBUG] [LOCAL ] PBF: Derivative data saved (1820 records). [2025-09-26T22:26:16.950282] [INFO ] [MAIN ] PBF: Successfully saved derivative data. [2025-09-26T22:26:16.953004] [INFO ] [MAIN ] Derivative Progress: 1416/2074 symbols completed. PBF took 1.4s. Estimated remaining: 4m 34s. Rate: 144.3 symbols/min [2025-09-26T22:26:16.953505] [INFO ] [MAIN ] PBT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:16.974201] [DEBUG] [LOCAL ] PBT: Loaded 17533 existing records from primary storage. [2025-09-26T22:26:16.988226] [INFO ] [MAIN ] PBT: Loaded 17533 primary data records. [2025-09-26T22:26:17.175930] [DEBUG] [LOCAL ] PBI: Loaded 50788 existing records from primary storage. [2025-09-26T22:26:17.216327] [INFO ] [MAIN ] PBI: Loaded 50788 primary data records. [2025-09-26T22:26:17.216194] [DEBUG] [LOCAL ] PBR: Loaded 54492 existing records from primary storage. [2025-09-26T22:26:17.241247] [INFO ] [MAIN ] PBR: Loaded 54492 primary data records. [2025-09-26T22:26:18.069272] [DEBUG] [MAIN ] PBT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:18.071099] [INFO ] [MAIN ] PBT: Generated 1820 derivative records from 17533 primary records. [2025-09-26T22:26:18.071300] [DEBUG] [LOCAL ] PBT: Saving derivative data. [2025-09-26T22:26:18.091240] [DEBUG] [LOCAL ] PBT: Derivative data saved (1820 records). [2025-09-26T22:26:18.091695] [INFO ] [MAIN ] PBT: Successfully saved derivative data. [2025-09-26T22:26:18.094007] [INFO ] [MAIN ] Derivative Progress: 1417/2074 symbols completed. PBT took 1.1s. Estimated remaining: 4m 34s. Rate: 144.1 symbols/min [2025-09-26T22:26:18.094488] [INFO ] [MAIN ] PCF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:18.110414] [DEBUG] [LOCAL ] PCF: Loaded 8720 existing records from primary storage. [2025-09-26T22:26:18.124078] [INFO ] [MAIN ] PCF: Loaded 8720 primary data records. [2025-09-26T22:26:18.124431] [DEBUG] [MAIN ] PBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:18.150930] [INFO ] [MAIN ] PBR: Generated 1820 derivative records from 54492 primary records. [2025-09-26T22:26:18.173457] [DEBUG] [MAIN ] PBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:18.174264] [INFO ] [MAIN ] PBI: Generated 1820 derivative records from 50788 primary records. [2025-09-26T22:26:18.179512] [DEBUG] [LOCAL ] PBI: Saving derivative data. [2025-09-26T22:26:18.200540] [DEBUG] [LOCAL ] PBR: Saving derivative data. [2025-09-26T22:26:18.327801] [DEBUG] [LOCAL ] PBI: Derivative data saved (1820 records). [2025-09-26T22:26:18.347137] [DEBUG] [LOCAL ] PBR: Derivative data saved (1820 records). [2025-09-26T22:26:18.364435] [INFO ] [MAIN ] PBI: Successfully saved derivative data. [2025-09-26T22:26:18.372716] [INFO ] [MAIN ] Derivative Progress: 1418/2074 symbols completed. PBI took 1.5s. Estimated remaining: 4m 33s. Rate: 144.1 symbols/min [2025-09-26T22:26:18.370321] [INFO ] [MAIN ] PBR: Successfully saved derivative data. [2025-09-26T22:26:18.373009] [INFO ] [MAIN ] PCM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:18.375898] [INFO ] [MAIN ] Derivative Progress: 1419/2074 symbols completed. PBR took 1.5s. Estimated remaining: 4m 32s. Rate: 144.2 symbols/min [2025-09-26T22:26:18.494346] [INFO ] [MAIN ] PCN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:18.511928] [DEBUG] [LOCAL ] PCM: Loaded 6857 existing records from primary storage. [2025-09-26T22:26:18.513233] [INFO ] [MAIN ] PCM: Loaded 6857 primary data records. [2025-09-26T22:26:18.738313] [DEBUG] [LOCAL ] PCN: Loaded 24709 existing records from primary storage. [2025-09-26T22:26:18.739035] [INFO ] [MAIN ] PCN: Loaded 24709 primary data records. [2025-09-26T22:26:19.041452] [DEBUG] [MAIN ] PCF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:19.043199] [INFO ] [MAIN ] PCF: Generated 1820 derivative records from 8720 primary records. [2025-09-26T22:26:19.049181] [DEBUG] [LOCAL ] PCF: Saving derivative data. [2025-09-26T22:26:19.274315] [DEBUG] [LOCAL ] PCF: Derivative data saved (1820 records). [2025-09-26T22:26:19.275191] [INFO ] [MAIN ] PCF: Successfully saved derivative data. [2025-09-26T22:26:19.277339] [INFO ] [MAIN ] Derivative Progress: 1420/2074 symbols completed. PCF took 1.2s. Estimated remaining: 4m 32s. Rate: 144.1 symbols/min [2025-09-26T22:26:19.278020] [INFO ] [MAIN ] PCOR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:19.301295] [DEBUG] [MAIN ] PCM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:19.302267] [INFO ] [MAIN ] PCM: Generated 1820 derivative records from 6857 primary records. [2025-09-26T22:26:19.302476] [DEBUG] [LOCAL ] PCM: Saving derivative data. [2025-09-26T22:26:19.320426] [DEBUG] [LOCAL ] PCM: Derivative data saved (1820 records). [2025-09-26T22:26:19.321005] [INFO ] [MAIN ] PCM: Successfully saved derivative data. [2025-09-26T22:26:19.323521] [INFO ] [MAIN ] Derivative Progress: 1421/2074 symbols completed. PCM took 1.0s. Estimated remaining: 4m 32s. Rate: 144.2 symbols/min [2025-09-26T22:26:19.324115] [INFO ] [MAIN ] PCQ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:19.359458] [DEBUG] [MAIN ] PCN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:19.360567] [INFO ] [MAIN ] PCN: Generated 1820 derivative records from 24709 primary records. [2025-09-26T22:26:19.367238] [DEBUG] [LOCAL ] PCN: Saving derivative data. [2025-09-26T22:26:19.367127] [DEBUG] [LOCAL ] PCQ: Loaded 12298 existing records from primary storage. [2025-09-26T22:26:19.383703] [INFO ] [MAIN ] PCQ: Loaded 12298 primary data records. [2025-09-26T22:26:19.421560] [DEBUG] [LOCAL ] PCOR: Loaded 48849 existing records from primary storage. [2025-09-26T22:26:19.446951] [INFO ] [MAIN ] PCOR: Loaded 48849 primary data records. [2025-09-26T22:26:19.539233] [DEBUG] [LOCAL ] PCN: Derivative data saved (1820 records). [2025-09-26T22:26:19.577346] [INFO ] [MAIN ] PCN: Successfully saved derivative data. [2025-09-26T22:26:19.645549] [INFO ] [MAIN ] Derivative Progress: 1422/2074 symbols completed. PCN took 1.2s. Estimated remaining: 4m 31s. Rate: 144.2 symbols/min [2025-09-26T22:26:19.723022] [INFO ] [MAIN ] PD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:20.198878] [DEBUG] [MAIN ] PCQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:20.201003] [INFO ] [MAIN ] PCQ: Generated 1820 derivative records from 12298 primary records. [2025-09-26T22:26:20.200878] [DEBUG] [LOCAL ] PD: Loaded 48580 existing records from primary storage. [2025-09-26T22:26:20.201315] [DEBUG] [LOCAL ] PCQ: Saving derivative data. [2025-09-26T22:26:20.201393] [INFO ] [MAIN ] PD: Loaded 48580 primary data records. [2025-09-26T22:26:20.215988] [DEBUG] [MAIN ] PCOR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:20.264475] [INFO ] [MAIN ] PCOR: Generated 1820 derivative records from 48849 primary records. [2025-09-26T22:26:20.292551] [DEBUG] [LOCAL ] PCOR: Saving derivative data. [2025-09-26T22:26:20.303524] [DEBUG] [LOCAL ] PCQ: Derivative data saved (1820 records). [2025-09-26T22:26:20.322753] [INFO ] [MAIN ] PCQ: Successfully saved derivative data. [2025-09-26T22:26:20.330066] [INFO ] [MAIN ] Derivative Progress: 1423/2074 symbols completed. PCQ took 1.0s. Estimated remaining: 4m 31s. Rate: 144.1 symbols/min [2025-09-26T22:26:20.387677] [DEBUG] [LOCAL ] PCOR: Derivative data saved (1820 records). [2025-09-26T22:26:20.412745] [INFO ] [MAIN ] PCOR: Successfully saved derivative data. [2025-09-26T22:26:20.430384] [INFO ] [MAIN ] Derivative Progress: 1424/2074 symbols completed. PCOR took 1.2s. Estimated remaining: 4m 30s. Rate: 144.2 symbols/min [2025-09-26T22:26:20.598857] [DEBUG] [MAIN ] PD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:20.599585] [INFO ] [MAIN ] PD: Generated 1820 derivative records from 48580 primary records. [2025-09-26T22:26:20.599684] [DEBUG] [LOCAL ] PD: Saving derivative data. [2025-09-26T22:26:20.615616] [DEBUG] [LOCAL ] PD: Derivative data saved (1820 records). [2025-09-26T22:26:20.615730] [INFO ] [MAIN ] PD: Successfully saved derivative data. [2025-09-26T22:26:20.617827] [INFO ] [MAIN ] Derivative Progress: 1425/2074 symbols completed. PD took 0.9s. Estimated remaining: 4m 30s. Rate: 144.3 symbols/min [2025-09-26T22:26:20.618784] [INFO ] [MAIN ] PDO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:20.618939] [INFO ] [MAIN ] PDI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:20.618731] [INFO ] [MAIN ] PDM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:20.679957] [DEBUG] [LOCAL ] PDO: Loaded 32146 existing records from primary storage. [2025-09-26T22:26:20.680221] [INFO ] [MAIN ] PDO: Loaded 32146 primary data records. [2025-09-26T22:26:20.741724] [DEBUG] [LOCAL ] PDM: Loaded 40354 existing records from primary storage. [2025-09-26T22:26:20.741976] [INFO ] [MAIN ] PDM: Loaded 40354 primary data records. [2025-09-26T22:26:20.897054] [DEBUG] [LOCAL ] PDI: Loaded 50909 existing records from primary storage. [2025-09-26T22:26:20.914696] [INFO ] [MAIN ] PDI: Loaded 50909 primary data records. [2025-09-26T22:26:21.803125] [DEBUG] [MAIN ] PDM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:21.814045] [INFO ] [MAIN ] PDM: Generated 1820 derivative records from 40354 primary records. [2025-09-26T22:26:21.820154] [DEBUG] [LOCAL ] PDM: Saving derivative data. [2025-09-26T22:26:21.821955] [DEBUG] [MAIN ] PDO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:21.834925] [INFO ] [MAIN ] PDO: Generated 1820 derivative records from 32146 primary records. [2025-09-26T22:26:21.836679] [DEBUG] [LOCAL ] PDO: Saving derivative data. [2025-09-26T22:26:21.840273] [DEBUG] [LOCAL ] PDM: Derivative data saved (1820 records). [2025-09-26T22:26:21.840664] [INFO ] [MAIN ] PDM: Successfully saved derivative data. [2025-09-26T22:26:21.853959] [INFO ] [MAIN ] Derivative Progress: 1426/2074 symbols completed. PDM took 1.2s. Estimated remaining: 4m 30s. Rate: 144.1 symbols/min [2025-09-26T22:26:21.875462] [DEBUG] [LOCAL ] PDO: Derivative data saved (1820 records). [2025-09-26T22:26:21.875777] [INFO ] [MAIN ] PDS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:21.876263] [INFO ] [MAIN ] PDO: Successfully saved derivative data. [2025-09-26T22:26:21.878777] [INFO ] [MAIN ] Derivative Progress: 1427/2074 symbols completed. PDO took 1.3s. Estimated remaining: 4m 29s. Rate: 144.2 symbols/min [2025-09-26T22:26:21.879600] [INFO ] [MAIN ] PDT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:21.880081] [DEBUG] [MAIN ] PDI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:21.881504] [INFO ] [MAIN ] PDI: Generated 1820 derivative records from 50909 primary records. [2025-09-26T22:26:21.881837] [DEBUG] [LOCAL ] PDI: Saving derivative data. [2025-09-26T22:26:21.900173] [DEBUG] [LOCAL ] PDI: Derivative data saved (1820 records). [2025-09-26T22:26:21.900382] [INFO ] [MAIN ] PDI: Successfully saved derivative data. [2025-09-26T22:26:21.902850] [INFO ] [MAIN ] Derivative Progress: 1428/2074 symbols completed. PDI took 1.3s. Estimated remaining: 4m 29s. Rate: 144.3 symbols/min [2025-09-26T22:26:21.903428] [INFO ] [MAIN ] PDX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:21.920886] [DEBUG] [LOCAL ] PDS: Loaded 18297 existing records from primary storage. [2025-09-26T22:26:21.921077] [INFO ] [MAIN ] PDS: Loaded 18297 primary data records. [2025-09-26T22:26:21.991780] [DEBUG] [LOCAL ] PDT: Loaded 17549 existing records from primary storage. [2025-09-26T22:26:22.036865] [INFO ] [MAIN ] PDT: Loaded 17549 primary data records. [2025-09-26T22:26:22.037467] [DEBUG] [LOCAL ] PDX: Loaded 14514 existing records from primary storage. [2025-09-26T22:26:22.052328] [INFO ] [MAIN ] PDX: Loaded 14514 primary data records. [2025-09-26T22:26:23.064950] [DEBUG] [MAIN ] PDS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:23.066206] [INFO ] [MAIN ] PDS: Generated 1820 derivative records from 18297 primary records. [2025-09-26T22:26:23.066825] [DEBUG] [LOCAL ] PDS: Saving derivative data. [2025-09-26T22:26:23.092371] [DEBUG] [LOCAL ] PDS: Derivative data saved (1820 records). [2025-09-26T22:26:23.107310] [DEBUG] [MAIN ] PDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:23.109565] [INFO ] [MAIN ] PDT: Generated 1820 derivative records from 17549 primary records. [2025-09-26T22:26:23.109808] [DEBUG] [LOCAL ] PDT: Saving derivative data. [2025-09-26T22:26:23.107446] [INFO ] [MAIN ] PDS: Successfully saved derivative data. [2025-09-26T22:26:23.127378] [INFO ] [MAIN ] Derivative Progress: 1429/2074 symbols completed. PDS took 1.3s. Estimated remaining: 4m 29s. Rate: 144.1 symbols/min [2025-09-26T22:26:23.128341] [DEBUG] [MAIN ] PDX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:23.140687] [INFO ] [MAIN ] PEB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:23.141810] [INFO ] [MAIN ] PDX: Generated 1820 derivative records from 14514 primary records. [2025-09-26T22:26:23.145905] [DEBUG] [LOCAL ] PDX: Saving derivative data. [2025-09-26T22:26:23.146691] [DEBUG] [LOCAL ] PDT: Derivative data saved (1820 records). [2025-09-26T22:26:23.146860] [INFO ] [MAIN ] PDT: Successfully saved derivative data. [2025-09-26T22:26:23.150343] [INFO ] [MAIN ] Derivative Progress: 1430/2074 symbols completed. PDT took 1.3s. Estimated remaining: 4m 28s. Rate: 144.2 symbols/min [2025-09-26T22:26:23.151634] [INFO ] [MAIN ] PEN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:23.169487] [DEBUG] [LOCAL ] PDX: Derivative data saved (1820 records). [2025-09-26T22:26:23.169639] [INFO ] [MAIN ] PDX: Successfully saved derivative data. [2025-09-26T22:26:23.172371] [INFO ] [MAIN ] Derivative Progress: 1431/2074 symbols completed. PDX took 1.3s. Estimated remaining: 4m 27s. Rate: 144.3 symbols/min [2025-09-26T22:26:23.172861] [INFO ] [MAIN ] PEO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:23.190300] [DEBUG] [LOCAL ] PEO: Loaded 10999 existing records from primary storage. [2025-09-26T22:26:23.190518] [INFO ] [MAIN ] PEO: Loaded 10999 primary data records. [2025-09-26T22:26:23.396953] [DEBUG] [LOCAL ] PEN: Loaded 30842 existing records from primary storage. [2025-09-26T22:26:23.416220] [INFO ] [MAIN ] PEN: Loaded 30842 primary data records. [2025-09-26T22:26:23.464738] [DEBUG] [LOCAL ] PEB: Loaded 51448 existing records from primary storage. [2025-09-26T22:26:23.486277] [INFO ] [MAIN ] PEB: Loaded 51448 primary data records. [2025-09-26T22:26:24.432244] [DEBUG] [MAIN ] PEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:24.435872] [INFO ] [MAIN ] PEO: Generated 1820 derivative records from 10999 primary records. [2025-09-26T22:26:24.436360] [DEBUG] [LOCAL ] PEO: Saving derivative data. [2025-09-26T22:26:24.463429] [DEBUG] [LOCAL ] PEO: Derivative data saved (1820 records). [2025-09-26T22:26:24.463568] [INFO ] [MAIN ] PEO: Successfully saved derivative data. [2025-09-26T22:26:24.467926] [INFO ] [MAIN ] Derivative Progress: 1432/2074 symbols completed. PEO took 1.3s. Estimated remaining: 4m 27s. Rate: 144.1 symbols/min [2025-09-26T22:26:24.468877] [INFO ] [MAIN ] PERF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:24.501041] [DEBUG] [MAIN ] PEB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:24.502486] [INFO ] [MAIN ] PEB: Generated 1820 derivative records from 51448 primary records. [2025-09-26T22:26:24.502751] [DEBUG] [LOCAL ] PEB: Saving derivative data. [2025-09-26T22:26:24.517538] [DEBUG] [MAIN ] PEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:24.532139] [INFO ] [MAIN ] PEN: Generated 1820 derivative records from 30842 primary records. [2025-09-26T22:26:24.532326] [DEBUG] [LOCAL ] PEN: Saving derivative data. [2025-09-26T22:26:24.537239] [DEBUG] [LOCAL ] PERF: Loaded 14231 existing records from primary storage. [2025-09-26T22:26:24.540405] [INFO ] [MAIN ] PERF: Loaded 14231 primary data records. [2025-09-26T22:26:24.651925] [DEBUG] [LOCAL ] PEB: Derivative data saved (1820 records). [2025-09-26T22:26:24.665171] [INFO ] [MAIN ] PEB: Successfully saved derivative data. [2025-09-26T22:26:24.677943] [INFO ] [MAIN ] Derivative Progress: 1433/2074 symbols completed. PEB took 1.5s. Estimated remaining: 4m 27s. Rate: 144.1 symbols/min [2025-09-26T22:26:24.684032] [INFO ] [MAIN ] PFD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:24.703528] [DEBUG] [LOCAL ] PEN: Derivative data saved (1820 records). [2025-09-26T22:26:24.709080] [INFO ] [MAIN ] PEN: Successfully saved derivative data. [2025-09-26T22:26:24.742546] [INFO ] [MAIN ] Derivative Progress: 1434/2074 symbols completed. PEN took 1.6s. Estimated remaining: 4m 26s. Rate: 144.2 symbols/min [2025-09-26T22:26:24.778578] [INFO ] [MAIN ] PFGC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:24.920271] [DEBUG] [LOCAL ] PFD: Loaded 5199 existing records from primary storage. [2025-09-26T22:26:24.921568] [INFO ] [MAIN ] PFD: Loaded 5199 primary data records. [2025-09-26T22:26:25.340463] [DEBUG] [LOCAL ] PFGC: Loaded 47650 existing records from primary storage. [2025-09-26T22:26:25.342705] [INFO ] [MAIN ] PFGC: Loaded 47650 primary data records. [2025-09-26T22:26:25.445227] [DEBUG] [MAIN ] PERF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:25.458318] [INFO ] [MAIN ] PERF: Generated 1820 derivative records from 14231 primary records. [2025-09-26T22:26:25.470405] [DEBUG] [LOCAL ] PERF: Saving derivative data. [2025-09-26T22:26:25.804449] [DEBUG] [LOCAL ] PERF: Derivative data saved (1820 records). [2025-09-26T22:26:25.806481] [INFO ] [MAIN ] PERF: Successfully saved derivative data. [2025-09-26T22:26:25.809473] [INFO ] [MAIN ] Derivative Progress: 1435/2074 symbols completed. PERF took 1.3s. Estimated remaining: 4m 26s. Rate: 144.0 symbols/min [2025-09-26T22:26:25.810119] [INFO ] [MAIN ] PFH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:25.826588] [DEBUG] [MAIN ] PFD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:25.828042] [INFO ] [MAIN ] PFD: Generated 1820 derivative records from 5199 primary records. [2025-09-26T22:26:25.830490] [DEBUG] [LOCAL ] PFD: Saving derivative data. [2025-09-26T22:26:25.847695] [DEBUG] [LOCAL ] PFH: Loaded 6911 existing records from primary storage. [2025-09-26T22:26:25.849235] [INFO ] [MAIN ] PFH: Loaded 6911 primary data records. [2025-09-26T22:26:25.922618] [DEBUG] [LOCAL ] PFD: Derivative data saved (1820 records). [2025-09-26T22:26:25.935796] [INFO ] [MAIN ] PFD: Successfully saved derivative data. [2025-09-26T22:26:25.949292] [INFO ] [MAIN ] Derivative Progress: 1436/2074 symbols completed. PFD took 1.3s. Estimated remaining: 4m 26s. Rate: 144.1 symbols/min [2025-09-26T22:26:25.969449] [INFO ] [MAIN ] PFL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:26.084269] [DEBUG] [MAIN ] PFGC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:26.205229] [INFO ] [MAIN ] PFGC: Generated 1820 derivative records from 47650 primary records. [2025-09-26T22:26:26.220299] [DEBUG] [LOCAL ] PFGC: Saving derivative data. [2025-09-26T22:26:26.221631] [DEBUG] [LOCAL ] PFL: Loaded 13959 existing records from primary storage. [2025-09-26T22:26:26.221809] [INFO ] [MAIN ] PFL: Loaded 13959 primary data records. [2025-09-26T22:26:26.390322] [DEBUG] [LOCAL ] PFGC: Derivative data saved (1820 records). [2025-09-26T22:26:26.391748] [INFO ] [MAIN ] PFGC: Successfully saved derivative data. [2025-09-26T22:26:26.433930] [INFO ] [MAIN ] Derivative Progress: 1437/2074 symbols completed. PFGC took 1.7s. Estimated remaining: 4m 25s. Rate: 144.1 symbols/min [2025-09-26T22:26:26.487786] [INFO ] [MAIN ] PFLT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:26.615424] [DEBUG] [MAIN ] PFH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:26.616717] [INFO ] [MAIN ] PFH: Generated 1820 derivative records from 6911 primary records. [2025-09-26T22:26:26.618131] [DEBUG] [LOCAL ] PFH: Saving derivative data. [2025-09-26T22:26:26.664357] [DEBUG] [LOCAL ] PFH: Derivative data saved (1820 records). [2025-09-26T22:26:26.664997] [INFO ] [MAIN ] PFH: Successfully saved derivative data. [2025-09-26T22:26:26.668043] [INFO ] [MAIN ] Derivative Progress: 1438/2074 symbols completed. PFH took 0.9s. Estimated remaining: 4m 25s. Rate: 144.1 symbols/min [2025-09-26T22:26:26.682240] [DEBUG] [MAIN ] PFL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:26.683125] [INFO ] [MAIN ] PFL: Generated 1820 derivative records from 13959 primary records. [2025-09-26T22:26:26.683260] [DEBUG] [LOCAL ] PFL: Saving derivative data. [2025-09-26T22:26:26.712251] [DEBUG] [LOCAL ] PFLT: Loaded 44333 existing records from primary storage. [2025-09-26T22:26:26.712871] [INFO ] [MAIN ] PFLT: Loaded 44333 primary data records. [2025-09-26T22:26:26.773403] [DEBUG] [LOCAL ] PFL: Derivative data saved (1820 records). [2025-09-26T22:26:26.792874] [INFO ] [MAIN ] PFL: Successfully saved derivative data. [2025-09-26T22:26:26.800421] [INFO ] [MAIN ] Derivative Progress: 1439/2074 symbols completed. PFL took 0.8s. Estimated remaining: 4m 24s. Rate: 144.2 symbols/min [2025-09-26T22:26:27.235943] [DEBUG] [MAIN ] PFLT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:27.236967] [INFO ] [MAIN ] PFLT: Generated 1820 derivative records from 44333 primary records. [2025-09-26T22:26:27.237035] [DEBUG] [LOCAL ] PFLT: Saving derivative data. [2025-09-26T22:26:27.255384] [DEBUG] [LOCAL ] PFLT: Derivative data saved (1820 records). [2025-09-26T22:26:27.255561] [INFO ] [MAIN ] PFLT: Successfully saved derivative data. [2025-09-26T22:26:27.257789] [INFO ] [MAIN ] Derivative Progress: 1440/2074 symbols completed. PFLT took 0.8s. Estimated remaining: 4m 24s. Rate: 144.2 symbols/min [2025-09-26T22:26:27.258815] [INFO ] [MAIN ] PFN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:27.259040] [INFO ] [MAIN ] PFO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:27.259098] [INFO ] [MAIN ] PFS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:27.270279] [DEBUG] [LOCAL ] PFO: Loaded 5948 existing records from primary storage. [2025-09-26T22:26:27.270444] [INFO ] [MAIN ] PFO: Loaded 5948 primary data records. [2025-09-26T22:26:27.426521] [DEBUG] [LOCAL ] PFN: Loaded 21992 existing records from primary storage. [2025-09-26T22:26:27.480513] [INFO ] [MAIN ] PFN: Loaded 21992 primary data records. [2025-09-26T22:26:27.527555] [DEBUG] [LOCAL ] PFS: Loaded 36188 existing records from primary storage. [2025-09-26T22:26:27.532270] [INFO ] [MAIN ] PFS: Loaded 36188 primary data records. [2025-09-26T22:26:28.407935] [DEBUG] [MAIN ] PFO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:28.409469] [INFO ] [MAIN ] PFO: Generated 1820 derivative records from 5948 primary records. [2025-09-26T22:26:28.409845] [DEBUG] [LOCAL ] PFO: Saving derivative data. [2025-09-26T22:26:28.433990] [DEBUG] [LOCAL ] PFO: Derivative data saved (1820 records). [2025-09-26T22:26:28.434345] [INFO ] [MAIN ] PFO: Successfully saved derivative data. [2025-09-26T22:26:28.436581] [INFO ] [MAIN ] Derivative Progress: 1441/2074 symbols completed. PFO took 1.2s. Estimated remaining: 4m 24s. Rate: 144.0 symbols/min [2025-09-26T22:26:28.449720] [INFO ] [MAIN ] PFSI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:28.451522] [DEBUG] [MAIN ] PFN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:28.452539] [INFO ] [MAIN ] PFN: Generated 1820 derivative records from 21992 primary records. [2025-09-26T22:26:28.452912] [DEBUG] [LOCAL ] PFN: Saving derivative data. [2025-09-26T22:26:28.485557] [DEBUG] [MAIN ] PFS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:28.487598] [INFO ] [MAIN ] PFS: Generated 1820 derivative records from 36188 primary records. [2025-09-26T22:26:28.486638] [DEBUG] [LOCAL ] PFN: Derivative data saved (1820 records). [2025-09-26T22:26:28.487875] [INFO ] [MAIN ] PFN: Successfully saved derivative data. [2025-09-26T22:26:28.487789] [DEBUG] [LOCAL ] PFS: Saving derivative data. [2025-09-26T22:26:28.490515] [INFO ] [MAIN ] Derivative Progress: 1442/2074 symbols completed. PFN took 1.2s. Estimated remaining: 4m 23s. Rate: 144.1 symbols/min [2025-09-26T22:26:28.491636] [INFO ] [MAIN ] PGP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:28.519256] [DEBUG] [LOCAL ] PGP: Loaded 5515 existing records from primary storage. [2025-09-26T22:26:28.520360] [INFO ] [MAIN ] PGP: Loaded 5515 primary data records. [2025-09-26T22:26:28.592517] [DEBUG] [LOCAL ] PFS: Derivative data saved (1820 records). [2025-09-26T22:26:28.620897] [INFO ] [MAIN ] PFS: Successfully saved derivative data. [2025-09-26T22:26:28.629720] [INFO ] [MAIN ] Derivative Progress: 1443/2074 symbols completed. PFS took 1.4s. Estimated remaining: 4m 23s. Rate: 144.2 symbols/min [2025-09-26T22:26:28.621917] [DEBUG] [LOCAL ] PFSI: Loaded 29259 existing records from primary storage. [2025-09-26T22:26:28.637255] [INFO ] [MAIN ] PFSI: Loaded 29259 primary data records. [2025-09-26T22:26:28.649934] [INFO ] [MAIN ] PGRE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:29.218751] [DEBUG] [LOCAL ] PGRE: Loaded 47177 existing records from primary storage. [2025-09-26T22:26:29.219599] [INFO ] [MAIN ] PGRE: Loaded 47177 primary data records. [2025-09-26T22:26:29.434756] [DEBUG] [MAIN ] PGP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:29.556955] [INFO ] [MAIN ] PGP: Generated 1820 derivative records from 5515 primary records. [2025-09-26T22:26:29.558949] [DEBUG] [LOCAL ] PGP: Saving derivative data. [2025-09-26T22:26:29.589158] [DEBUG] [MAIN ] PFSI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:29.590572] [INFO ] [MAIN ] PFSI: Generated 1820 derivative records from 29259 primary records. [2025-09-26T22:26:29.591723] [DEBUG] [LOCAL ] PFSI: Saving derivative data. [2025-09-26T22:26:29.604881] [DEBUG] [LOCAL ] PGP: Derivative data saved (1820 records). [2025-09-26T22:26:29.607634] [INFO ] [MAIN ] PGP: Successfully saved derivative data. [2025-09-26T22:26:29.610113] [INFO ] [MAIN ] Derivative Progress: 1444/2074 symbols completed. PGP took 1.1s. Estimated remaining: 4m 22s. Rate: 144.0 symbols/min [2025-09-26T22:26:29.611215] [INFO ] [MAIN ] PGZ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:29.623751] [DEBUG] [LOCAL ] PFSI: Derivative data saved (1820 records). [2025-09-26T22:26:29.623160] [DEBUG] [LOCAL ] PGZ: Loaded 5440 existing records from primary storage. [2025-09-26T22:26:29.623900] [INFO ] [MAIN ] PGZ: Loaded 5440 primary data records. [2025-09-26T22:26:29.629455] [INFO ] [MAIN ] PFSI: Successfully saved derivative data. [2025-09-26T22:26:29.649535] [INFO ] [MAIN ] Derivative Progress: 1445/2074 symbols completed. PFSI took 1.2s. Estimated remaining: 4m 22s. Rate: 144.1 symbols/min [2025-09-26T22:26:29.675850] [INFO ] [MAIN ] PH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:29.879279] [DEBUG] [MAIN ] PGRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:30.022823] [INFO ] [MAIN ] PGRE: Generated 1820 derivative records from 47177 primary records. [2025-09-26T22:26:30.037304] [DEBUG] [LOCAL ] PGRE: Saving derivative data. [2025-09-26T22:26:30.060501] [DEBUG] [LOCAL ] PH: Loaded 39166 existing records from primary storage. [2025-09-26T22:26:30.064479] [INFO ] [MAIN ] PH: Loaded 39166 primary data records. [2025-09-26T22:26:30.194189] [DEBUG] [LOCAL ] PGRE: Derivative data saved (1820 records). [2025-09-26T22:26:30.194370] [INFO ] [MAIN ] PGRE: Successfully saved derivative data. [2025-09-26T22:26:30.196778] [INFO ] [MAIN ] Derivative Progress: 1446/2074 symbols completed. PGRE took 1.6s. Estimated remaining: 4m 22s. Rate: 144.1 symbols/min [2025-09-26T22:26:30.213629] [INFO ] [MAIN ] PHG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:30.425568] [DEBUG] [MAIN ] PGZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:30.426457] [INFO ] [MAIN ] PGZ: Generated 1820 derivative records from 5440 primary records. [2025-09-26T22:26:30.426579] [DEBUG] [LOCAL ] PGZ: Saving derivative data. [2025-09-26T22:26:30.456739] [DEBUG] [LOCAL ] PGZ: Derivative data saved (1820 records). [2025-09-26T22:26:30.457025] [INFO ] [MAIN ] PGZ: Successfully saved derivative data. [2025-09-26T22:26:30.459439] [INFO ] [MAIN ] Derivative Progress: 1447/2074 symbols completed. PGZ took 0.8s. Estimated remaining: 4m 21s. Rate: 144.1 symbols/min [2025-09-26T22:26:30.459906] [INFO ] [MAIN ] PHI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:30.477546] [DEBUG] [MAIN ] PH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:30.489955] [INFO ] [MAIN ] PH: Generated 1820 derivative records from 39166 primary records. [2025-09-26T22:26:30.490987] [DEBUG] [LOCAL ] PH: Saving derivative data. [2025-09-26T22:26:30.492965] [DEBUG] [LOCAL ] PHG: Loaded 46835 existing records from primary storage. [2025-09-26T22:26:30.500366] [INFO ] [MAIN ] PHG: Loaded 46835 primary data records. [2025-09-26T22:26:30.570033] [DEBUG] [LOCAL ] PHI: Loaded 15230 existing records from primary storage. [2025-09-26T22:26:30.571027] [INFO ] [MAIN ] PHI: Loaded 15230 primary data records. [2025-09-26T22:26:30.589698] [DEBUG] [LOCAL ] PH: Derivative data saved (1820 records). [2025-09-26T22:26:30.661019] [INFO ] [MAIN ] PH: Successfully saved derivative data. [2025-09-26T22:26:30.684221] [INFO ] [MAIN ] Derivative Progress: 1448/2074 symbols completed. PH took 1.0s. Estimated remaining: 4m 21s. Rate: 144.2 symbols/min [2025-09-26T22:26:30.754469] [INFO ] [MAIN ] PHIN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:31.204639] [DEBUG] [LOCAL ] PHIN: Loaded 33541 existing records from primary storage. [2025-09-26T22:26:31.205385] [INFO ] [MAIN ] PHIN: Loaded 33541 primary data records. [2025-09-26T22:26:31.362298] [DEBUG] [MAIN ] PHG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:31.363329] [INFO ] [MAIN ] PHG: Generated 1820 derivative records from 46835 primary records. [2025-09-26T22:26:31.364743] [DEBUG] [LOCAL ] PHG: Saving derivative data. [2025-09-26T22:26:31.488000] [DEBUG] [MAIN ] PHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:31.529495] [INFO ] [MAIN ] PHI: Generated 1820 derivative records from 15230 primary records. [2025-09-26T22:26:31.634898] [DEBUG] [LOCAL ] PHI: Saving derivative data. [2025-09-26T22:26:31.665905] [DEBUG] [LOCAL ] PHG: Derivative data saved (1820 records). [2025-09-26T22:26:31.667456] [INFO ] [MAIN ] PHG: Successfully saved derivative data. [2025-09-26T22:26:31.670502] [INFO ] [MAIN ] Derivative Progress: 1449/2074 symbols completed. PHG took 1.5s. Estimated remaining: 4m 20s. Rate: 144.0 symbols/min [2025-09-26T22:26:31.671950] [INFO ] [MAIN ] PHK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:31.673416] [DEBUG] [LOCAL ] PHI: Derivative data saved (1820 records). [2025-09-26T22:26:31.673955] [INFO ] [MAIN ] PHI: Successfully saved derivative data. [2025-09-26T22:26:31.676400] [INFO ] [MAIN ] Derivative Progress: 1450/2074 symbols completed. PHI took 1.2s. Estimated remaining: 4m 20s. Rate: 144.1 symbols/min [2025-09-26T22:26:31.677244] [INFO ] [MAIN ] PHR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:31.709619] [DEBUG] [MAIN ] PHIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:31.710683] [INFO ] [MAIN ] PHIN: Generated 1820 derivative records from 33541 primary records. [2025-09-26T22:26:31.710825] [DEBUG] [LOCAL ] PHIN: Saving derivative data. [2025-09-26T22:26:31.733935] [DEBUG] [LOCAL ] PHK: Loaded 26792 existing records from primary storage. [2025-09-26T22:26:31.747025] [INFO ] [MAIN ] PHK: Loaded 26792 primary data records. [2025-09-26T22:26:31.856926] [DEBUG] [LOCAL ] PHIN: Derivative data saved (1820 records). [2025-09-26T22:26:31.878239] [INFO ] [MAIN ] PHIN: Successfully saved derivative data. [2025-09-26T22:26:31.881190] [INFO ] [MAIN ] Derivative Progress: 1451/2074 symbols completed. PHIN took 1.1s. Estimated remaining: 4m 19s. Rate: 144.2 symbols/min [2025-09-26T22:26:31.881749] [INFO ] [MAIN ] PII: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:31.883285] [DEBUG] [LOCAL ] PHR: Loaded 38045 existing records from primary storage. [2025-09-26T22:26:31.895309] [INFO ] [MAIN ] PHR: Loaded 38045 primary data records. [2025-09-26T22:26:32.497351] [DEBUG] [LOCAL ] PII: Loaded 49815 existing records from primary storage. [2025-09-26T22:26:32.497605] [INFO ] [MAIN ] PII: Loaded 49815 primary data records. [2025-09-26T22:26:32.848922] [DEBUG] [MAIN ] PHK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:32.850414] [INFO ] [MAIN ] PHK: Generated 1820 derivative records from 26792 primary records. [2025-09-26T22:26:32.851834] [DEBUG] [LOCAL ] PHK: Saving derivative data. [2025-09-26T22:26:32.892964] [DEBUG] [MAIN ] PHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:32.895389] [INFO ] [MAIN ] PHR: Generated 1820 derivative records from 38045 primary records. [2025-09-26T22:26:32.896309] [DEBUG] [LOCAL ] PHK: Derivative data saved (1820 records). [2025-09-26T22:26:32.896535] [DEBUG] [LOCAL ] PHR: Saving derivative data. [2025-09-26T22:26:32.897065] [INFO ] [MAIN ] PHK: Successfully saved derivative data. [2025-09-26T22:26:32.899719] [INFO ] [MAIN ] Derivative Progress: 1452/2074 symbols completed. PHK took 1.2s. Estimated remaining: 4m 19s. Rate: 144.0 symbols/min [2025-09-26T22:26:32.900755] [INFO ] [MAIN ] PIM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:32.930418] [DEBUG] [LOCAL ] PIM: Loaded 4814 existing records from primary storage. [2025-09-26T22:26:32.931710] [INFO ] [MAIN ] PIM: Loaded 4814 primary data records. [2025-09-26T22:26:32.961438] [DEBUG] [LOCAL ] PHR: Derivative data saved (1820 records). [2025-09-26T22:26:32.974742] [DEBUG] [MAIN ] PII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:32.992795] [INFO ] [MAIN ] PHR: Successfully saved derivative data. [2025-09-26T22:26:32.995224] [INFO ] [MAIN ] Derivative Progress: 1453/2074 symbols completed. PHR took 1.3s. Estimated remaining: 4m 19s. Rate: 144.1 symbols/min [2025-09-26T22:26:33.019533] [INFO ] [MAIN ] PII: Generated 1820 derivative records from 49815 primary records. [2025-09-26T22:26:33.042196] [DEBUG] [LOCAL ] PII: Saving derivative data. [2025-09-26T22:26:33.192750] [DEBUG] [LOCAL ] PII: Derivative data saved (1820 records). [2025-09-26T22:26:33.210529] [INFO ] [MAIN ] PII: Successfully saved derivative data. [2025-09-26T22:26:33.221400] [INFO ] [MAIN ] Derivative Progress: 1454/2074 symbols completed. PII took 1.3s. Estimated remaining: 4m 18s. Rate: 144.2 symbols/min [2025-09-26T22:26:33.370431] [DEBUG] [MAIN ] PIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:33.371122] [INFO ] [MAIN ] PIM: Generated 1820 derivative records from 4814 primary records. [2025-09-26T22:26:33.371188] [DEBUG] [LOCAL ] PIM: Saving derivative data. [2025-09-26T22:26:33.386368] [DEBUG] [LOCAL ] PIM: Derivative data saved (1820 records). [2025-09-26T22:26:33.386485] [INFO ] [MAIN ] PIM: Successfully saved derivative data. [2025-09-26T22:26:33.388755] [INFO ] [MAIN ] Derivative Progress: 1455/2074 symbols completed. PIM took 0.5s. Estimated remaining: 4m 18s. Rate: 144.2 symbols/min [2025-09-26T22:26:33.389850] [INFO ] [MAIN ] PIPR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:33.390024] [INFO ] [MAIN ] PINS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:33.389718] [INFO ] [MAIN ] PINE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:33.414554] [DEBUG] [LOCAL ] PIPR: Loaded 15331 existing records from primary storage. [2025-09-26T22:26:33.421343] [INFO ] [MAIN ] PIPR: Loaded 15331 primary data records. [2025-09-26T22:26:33.457115] [DEBUG] [LOCAL ] PINE: Loaded 14365 existing records from primary storage. [2025-09-26T22:26:33.477806] [INFO ] [MAIN ] PINE: Loaded 14365 primary data records. [2025-09-26T22:26:33.831534] [DEBUG] [LOCAL ] PINS: Loaded 54473 existing records from primary storage. [2025-09-26T22:26:33.879847] [INFO ] [MAIN ] PINS: Loaded 54473 primary data records. [2025-09-26T22:26:34.600601] [DEBUG] [MAIN ] PIPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:34.602455] [INFO ] [MAIN ] PIPR: Generated 1820 derivative records from 15331 primary records. [2025-09-26T22:26:34.602769] [DEBUG] [LOCAL ] PIPR: Saving derivative data. [2025-09-26T22:26:34.630546] [DEBUG] [MAIN ] PINE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:34.631890] [INFO ] [MAIN ] PINE: Generated 1820 derivative records from 14365 primary records. [2025-09-26T22:26:34.632749] [DEBUG] [LOCAL ] PINE: Saving derivative data. [2025-09-26T22:26:34.652637] [DEBUG] [LOCAL ] PIPR: Derivative data saved (1820 records). [2025-09-26T22:26:34.653759] [INFO ] [MAIN ] PIPR: Successfully saved derivative data. [2025-09-26T22:26:34.657955] [INFO ] [MAIN ] Derivative Progress: 1456/2074 symbols completed. PIPR took 1.3s. Estimated remaining: 4m 17s. Rate: 144.0 symbols/min [2025-09-26T22:26:34.663969] [INFO ] [MAIN ] PJT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:34.677307] [DEBUG] [MAIN ] PINS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:34.679796] [INFO ] [MAIN ] PINS: Generated 1820 derivative records from 54473 primary records. [2025-09-26T22:26:34.680453] [DEBUG] [LOCAL ] PINS: Saving derivative data. [2025-09-26T22:26:34.681037] [DEBUG] [LOCAL ] PINE: Derivative data saved (1820 records). [2025-09-26T22:26:34.681879] [INFO ] [MAIN ] PINE: Successfully saved derivative data. [2025-09-26T22:26:34.684408] [INFO ] [MAIN ] Derivative Progress: 1457/2074 symbols completed. PINE took 1.3s. Estimated remaining: 4m 17s. Rate: 144.1 symbols/min [2025-09-26T22:26:34.684750] [INFO ] [MAIN ] PK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:34.709377] [DEBUG] [LOCAL ] PINS: Derivative data saved (1820 records). [2025-09-26T22:26:34.709554] [INFO ] [MAIN ] PINS: Successfully saved derivative data. [2025-09-26T22:26:34.713430] [INFO ] [MAIN ] Derivative Progress: 1458/2074 symbols completed. PINS took 1.3s. Estimated remaining: 4m 16s. Rate: 144.2 symbols/min [2025-09-26T22:26:34.713984] [INFO ] [MAIN ] PKE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:34.725057] [DEBUG] [LOCAL ] PJT: Loaded 22579 existing records from primary storage. [2025-09-26T22:26:34.725226] [INFO ] [MAIN ] PJT: Loaded 22579 primary data records. [2025-09-26T22:26:34.850414] [DEBUG] [LOCAL ] PKE: Loaded 12775 existing records from primary storage. [2025-09-26T22:26:34.863733] [INFO ] [MAIN ] PKE: Loaded 12775 primary data records. [2025-09-26T22:26:35.242494] [DEBUG] [LOCAL ] PK: Loaded 53626 existing records from primary storage. [2025-09-26T22:26:35.243609] [INFO ] [MAIN ] PK: Loaded 53626 primary data records. [2025-09-26T22:26:35.836136] [DEBUG] [MAIN ] PJT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:35.839683] [INFO ] [MAIN ] PJT: Generated 1820 derivative records from 22579 primary records. [2025-09-26T22:26:35.840538] [DEBUG] [LOCAL ] PJT: Saving derivative data. [2025-09-26T22:26:35.869845] [DEBUG] [LOCAL ] PJT: Derivative data saved (1820 records). [2025-09-26T22:26:35.871335] [INFO ] [MAIN ] PJT: Successfully saved derivative data. [2025-09-26T22:26:35.874855] [INFO ] [MAIN ] Derivative Progress: 1459/2074 symbols completed. PJT took 1.2s. Estimated remaining: 4m 16s. Rate: 144.0 symbols/min [2025-09-26T22:26:35.889372] [INFO ] [MAIN ] PKG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:35.898361] [DEBUG] [MAIN ] PKE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:35.905485] [INFO ] [MAIN ] PKE: Generated 1820 derivative records from 12775 primary records. [2025-09-26T22:26:35.905730] [DEBUG] [LOCAL ] PKE: Saving derivative data. [2025-09-26T22:26:35.906192] [DEBUG] [MAIN ] PK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:35.908438] [INFO ] [MAIN ] PK: Generated 1820 derivative records from 53626 primary records. [2025-09-26T22:26:35.916035] [DEBUG] [LOCAL ] PK: Saving derivative data. [2025-09-26T22:26:35.944420] [DEBUG] [LOCAL ] PKE: Derivative data saved (1820 records). [2025-09-26T22:26:35.944878] [INFO ] [MAIN ] PKE: Successfully saved derivative data. [2025-09-26T22:26:35.948040] [INFO ] [MAIN ] Derivative Progress: 1460/2074 symbols completed. PKE took 1.2s. Estimated remaining: 4m 16s. Rate: 144.1 symbols/min [2025-09-26T22:26:35.949207] [INFO ] [MAIN ] PKST: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:35.949465] [DEBUG] [LOCAL ] PK: Derivative data saved (1820 records). [2025-09-26T22:26:35.950426] [INFO ] [MAIN ] PK: Successfully saved derivative data. [2025-09-26T22:26:35.953687] [INFO ] [MAIN ] Derivative Progress: 1461/2074 symbols completed. PK took 1.3s. Estimated remaining: 4m 15s. Rate: 144.2 symbols/min [2025-09-26T22:26:35.954349] [INFO ] [MAIN ] PKX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:36.001277] [DEBUG] [LOCAL ] PKG: Loaded 39785 existing records from primary storage. [2025-09-26T22:26:36.008981] [INFO ] [MAIN ] PKG: Loaded 39785 primary data records. [2025-09-26T22:26:36.023599] [DEBUG] [LOCAL ] PKST: Loaded 19461 existing records from primary storage. [2025-09-26T22:26:36.037704] [INFO ] [MAIN ] PKST: Loaded 19461 primary data records. [2025-09-26T22:26:36.050286] [DEBUG] [LOCAL ] PKX: Loaded 25141 existing records from primary storage. [2025-09-26T22:26:36.064791] [INFO ] [MAIN ] PKX: Loaded 25141 primary data records. [2025-09-26T22:26:37.116378] [DEBUG] [MAIN ] PKG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:37.120637] [INFO ] [MAIN ] PKG: Generated 1820 derivative records from 39785 primary records. [2025-09-26T22:26:37.120962] [DEBUG] [LOCAL ] PKG: Saving derivative data. [2025-09-26T22:26:37.171197] [DEBUG] [MAIN ] PKST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:37.178843] [INFO ] [MAIN ] PKST: Generated 1820 derivative records from 19461 primary records. [2025-09-26T22:26:37.179234] [DEBUG] [MAIN ] PKX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:37.179846] [DEBUG] [LOCAL ] PKST: Saving derivative data. [2025-09-26T22:26:37.181528] [INFO ] [MAIN ] PKX: Generated 1820 derivative records from 25141 primary records. [2025-09-26T22:26:37.183274] [DEBUG] [LOCAL ] PKX: Saving derivative data. [2025-09-26T22:26:37.185076] [DEBUG] [LOCAL ] PKG: Derivative data saved (1820 records). [2025-09-26T22:26:37.186093] [INFO ] [MAIN ] PKG: Successfully saved derivative data. [2025-09-26T22:26:37.203434] [INFO ] [MAIN ] Derivative Progress: 1462/2074 symbols completed. PKG took 1.3s. Estimated remaining: 4m 15s. Rate: 144.0 symbols/min [2025-09-26T22:26:37.213105] [INFO ] [MAIN ] PL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:37.225260] [DEBUG] [LOCAL ] PKX: Derivative data saved (1820 records). [2025-09-26T22:26:37.225132] [DEBUG] [LOCAL ] PKST: Derivative data saved (1820 records). [2025-09-26T22:26:37.225709] [INFO ] [MAIN ] PKX: Successfully saved derivative data. [2025-09-26T22:26:37.225529] [INFO ] [MAIN ] PKST: Successfully saved derivative data. [2025-09-26T22:26:37.228555] [INFO ] [MAIN ] Derivative Progress: 1463/2074 symbols completed. PKX took 1.3s. Estimated remaining: 4m 14s. Rate: 144.1 symbols/min [2025-09-26T22:26:37.231827] [INFO ] [MAIN ] PLD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:37.231916] [INFO ] [MAIN ] Derivative Progress: 1464/2074 symbols completed. PKST took 1.3s. Estimated remaining: 4m 14s. Rate: 144.2 symbols/min [2025-09-26T22:26:37.232747] [INFO ] [MAIN ] PLNT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:37.290096] [DEBUG] [LOCAL ] PL: Loaded 53894 existing records from primary storage. [2025-09-26T22:26:37.290388] [INFO ] [MAIN ] PL: Loaded 53894 primary data records. [2025-09-26T22:26:37.476717] [DEBUG] [LOCAL ] PLD: Loaded 54226 existing records from primary storage. [2025-09-26T22:26:37.477719] [INFO ] [MAIN ] PLD: Loaded 54226 primary data records. [2025-09-26T22:26:37.483837] [DEBUG] [LOCAL ] PLNT: Loaded 49144 existing records from primary storage. [2025-09-26T22:26:37.507467] [INFO ] [MAIN ] PLNT: Loaded 49144 primary data records. [2025-09-26T22:26:38.463279] [DEBUG] [MAIN ] PLD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:38.462885] [DEBUG] [MAIN ] PL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:38.464501] [INFO ] [MAIN ] PL: Generated 1820 derivative records from 53894 primary records. [2025-09-26T22:26:38.464794] [DEBUG] [LOCAL ] PL: Saving derivative data. [2025-09-26T22:26:38.465526] [INFO ] [MAIN ] PLD: Generated 1820 derivative records from 54226 primary records. [2025-09-26T22:26:38.466467] [DEBUG] [LOCAL ] PLD: Saving derivative data. [2025-09-26T22:26:38.502669] [DEBUG] [LOCAL ] PL: Derivative data saved (1820 records). [2025-09-26T22:26:38.502591] [DEBUG] [LOCAL ] PLD: Derivative data saved (1820 records). [2025-09-26T22:26:38.515844] [INFO ] [MAIN ] PLD: Successfully saved derivative data. [2025-09-26T22:26:38.518715] [INFO ] [MAIN ] Derivative Progress: 1465/2074 symbols completed. PLD took 1.3s. Estimated remaining: 4m 14s. Rate: 144.0 symbols/min [2025-09-26T22:26:38.515922] [INFO ] [MAIN ] PL: Successfully saved derivative data. [2025-09-26T22:26:38.521373] [DEBUG] [MAIN ] PLNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:38.521625] [INFO ] [MAIN ] Derivative Progress: 1466/2074 symbols completed. PL took 1.3s. Estimated remaining: 4m 13s. Rate: 144.1 symbols/min [2025-09-26T22:26:38.522962] [INFO ] [MAIN ] PLYM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:38.523133] [INFO ] [MAIN ] PLOW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:38.522894] [INFO ] [MAIN ] PLNT: Generated 1820 derivative records from 49144 primary records. [2025-09-26T22:26:38.523828] [DEBUG] [LOCAL ] PLNT: Saving derivative data. [2025-09-26T22:26:38.545438] [DEBUG] [LOCAL ] PLNT: Derivative data saved (1820 records). [2025-09-26T22:26:38.550458] [INFO ] [MAIN ] PLNT: Successfully saved derivative data. [2025-09-26T22:26:38.553296] [INFO ] [MAIN ] Derivative Progress: 1467/2074 symbols completed. PLNT took 1.3s. Estimated remaining: 4m 13s. Rate: 144.2 symbols/min [2025-09-26T22:26:38.553732] [INFO ] [MAIN ] PML: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:38.564234] [DEBUG] [LOCAL ] PLOW: Loaded 20792 existing records from primary storage. [2025-09-26T22:26:38.564436] [INFO ] [MAIN ] PLOW: Loaded 20792 primary data records. [2025-09-26T22:26:38.719298] [DEBUG] [LOCAL ] PLYM: Loaded 33884 existing records from primary storage. [2025-09-26T22:26:38.718173] [DEBUG] [LOCAL ] PML: Loaded 20999 existing records from primary storage. [2025-09-26T22:26:38.724875] [INFO ] [MAIN ] PLYM: Loaded 33884 primary data records. [2025-09-26T22:26:38.735226] [INFO ] [MAIN ] PML: Loaded 20999 primary data records. [2025-09-26T22:26:39.644034] [DEBUG] [MAIN ] PLOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:39.645462] [INFO ] [MAIN ] PLOW: Generated 1820 derivative records from 20792 primary records. [2025-09-26T22:26:39.645938] [DEBUG] [LOCAL ] PLOW: Saving derivative data. [2025-09-26T22:26:39.666866] [DEBUG] [LOCAL ] PLOW: Derivative data saved (1820 records). [2025-09-26T22:26:39.675225] [INFO ] [MAIN ] PLOW: Successfully saved derivative data. [2025-09-26T22:26:39.682746] [INFO ] [MAIN ] Derivative Progress: 1468/2074 symbols completed. PLOW took 1.2s. Estimated remaining: 4m 12s. Rate: 144.0 symbols/min [2025-09-26T22:26:39.683390] [DEBUG] [MAIN ] PML: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:39.685447] [INFO ] [MAIN ] PML: Generated 1820 derivative records from 20999 primary records. [2025-09-26T22:26:39.686502] [DEBUG] [LOCAL ] PML: Saving derivative data. [2025-09-26T22:26:39.712414] [DEBUG] [MAIN ] PLYM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:39.713440] [INFO ] [MAIN ] PLYM: Generated 1820 derivative records from 33884 primary records. [2025-09-26T22:26:39.713771] [DEBUG] [LOCAL ] PLYM: Saving derivative data. [2025-09-26T22:26:39.732253] [DEBUG] [LOCAL ] PML: Derivative data saved (1820 records). [2025-09-26T22:26:39.733201] [INFO ] [MAIN ] PML: Successfully saved derivative data. [2025-09-26T22:26:39.735877] [INFO ] [MAIN ] Derivative Progress: 1469/2074 symbols completed. PML took 1.2s. Estimated remaining: 4m 12s. Rate: 144.1 symbols/min [2025-09-26T22:26:39.733284] [DEBUG] [LOCAL ] PLYM: Derivative data saved (1820 records). [2025-09-26T22:26:39.736132] [INFO ] [MAIN ] PLYM: Successfully saved derivative data. [2025-09-26T22:26:39.739109] [INFO ] [MAIN ] Derivative Progress: 1470/2074 symbols completed. PLYM took 1.2s. Estimated remaining: 4m 11s. Rate: 144.2 symbols/min [2025-09-26T22:26:39.739901] [INFO ] [MAIN ] PMT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:39.740080] [INFO ] [MAIN ] PMM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:39.740689] [INFO ] [MAIN ] PMO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:39.763335] [DEBUG] [LOCAL ] PMO: Loaded 10547 existing records from primary storage. [2025-09-26T22:26:39.764126] [INFO ] [MAIN ] PMO: Loaded 10547 primary data records. [2025-09-26T22:26:39.764026] [DEBUG] [LOCAL ] PMM: Loaded 10760 existing records from primary storage. [2025-09-26T22:26:39.776604] [INFO ] [MAIN ] PMM: Loaded 10760 primary data records. [2025-09-26T22:26:40.148045] [DEBUG] [LOCAL ] PMT: Loaded 40798 existing records from primary storage. [2025-09-26T22:26:40.225799] [INFO ] [MAIN ] PMT: Loaded 40798 primary data records. [2025-09-26T22:26:40.848442] [DEBUG] [MAIN ] PMM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:40.849913] [INFO ] [MAIN ] PMM: Generated 1820 derivative records from 10760 primary records. [2025-09-26T22:26:40.850918] [DEBUG] [LOCAL ] PMM: Saving derivative data. [2025-09-26T22:26:40.849061] [DEBUG] [MAIN ] PMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:40.852637] [INFO ] [MAIN ] PMO: Generated 1820 derivative records from 10547 primary records. [2025-09-26T22:26:40.853174] [DEBUG] [LOCAL ] PMO: Saving derivative data. [2025-09-26T22:26:40.868684] [DEBUG] [LOCAL ] PMM: Derivative data saved (1820 records). [2025-09-26T22:26:40.880088] [INFO ] [MAIN ] PMM: Successfully saved derivative data. [2025-09-26T22:26:40.882840] [INFO ] [MAIN ] Derivative Progress: 1471/2074 symbols completed. PMM took 1.1s. Estimated remaining: 4m 11s. Rate: 144.0 symbols/min [2025-09-26T22:26:40.883671] [INFO ] [MAIN ] PNI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:40.894391] [DEBUG] [LOCAL ] PMO: Derivative data saved (1820 records). [2025-09-26T22:26:40.894545] [INFO ] [MAIN ] PMO: Successfully saved derivative data. [2025-09-26T22:26:40.896844] [INFO ] [MAIN ] Derivative Progress: 1472/2074 symbols completed. PMO took 1.2s. Estimated remaining: 4m 11s. Rate: 144.1 symbols/min [2025-09-26T22:26:40.913106] [INFO ] [MAIN ] PNNT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:40.913749] [DEBUG] [MAIN ] PMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:40.913988] [DEBUG] [LOCAL ] PNI: Loaded 6782 existing records from primary storage. [2025-09-26T22:26:40.914481] [INFO ] [MAIN ] PNI: Loaded 6782 primary data records. [2025-09-26T22:26:40.915192] [INFO ] [MAIN ] PMT: Generated 1820 derivative records from 40798 primary records. [2025-09-26T22:26:40.920444] [DEBUG] [LOCAL ] PMT: Saving derivative data. [2025-09-26T22:26:41.024023] [DEBUG] [LOCAL ] PMT: Derivative data saved (1820 records). [2025-09-26T22:26:41.039535] [INFO ] [MAIN ] PMT: Successfully saved derivative data. [2025-09-26T22:26:41.045983] [INFO ] [MAIN ] Derivative Progress: 1473/2074 symbols completed. PMT took 1.3s. Estimated remaining: 4m 10s. Rate: 144.2 symbols/min [2025-09-26T22:26:41.055168] [INFO ] [MAIN ] PNW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:41.149436] [DEBUG] [LOCAL ] PNNT: Loaded 33337 existing records from primary storage. [2025-09-26T22:26:41.149701] [INFO ] [MAIN ] PNNT: Loaded 33337 primary data records. [2025-09-26T22:26:41.643050] [DEBUG] [LOCAL ] PNW: Loaded 46531 existing records from primary storage. [2025-09-26T22:26:41.646855] [INFO ] [MAIN ] PNW: Loaded 46531 primary data records. [2025-09-26T22:26:41.724823] [DEBUG] [MAIN ] PNI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:41.749752] [INFO ] [MAIN ] PNI: Generated 1820 derivative records from 6782 primary records. [2025-09-26T22:26:41.757746] [DEBUG] [LOCAL ] PNI: Saving derivative data. [2025-09-26T22:26:41.808332] [DEBUG] [LOCAL ] PNI: Derivative data saved (1820 records). [2025-09-26T22:26:41.810098] [INFO ] [MAIN ] PNI: Successfully saved derivative data. [2025-09-26T22:26:41.818510] [INFO ] [MAIN ] Derivative Progress: 1474/2074 symbols completed. PNI took 0.9s. Estimated remaining: 4m 10s. Rate: 144.1 symbols/min [2025-09-26T22:26:41.840185] [INFO ] [MAIN ] POR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:41.905892] [DEBUG] [MAIN ] PNNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:41.913790] [INFO ] [MAIN ] PNNT: Generated 1820 derivative records from 33337 primary records. [2025-09-26T22:26:41.914030] [DEBUG] [LOCAL ] PNNT: Saving derivative data. [2025-09-26T22:26:42.060050] [DEBUG] [LOCAL ] PNNT: Derivative data saved (1820 records). [2025-09-26T22:26:42.065028] [INFO ] [MAIN ] PNNT: Successfully saved derivative data. [2025-09-26T22:26:42.067879] [INFO ] [MAIN ] Derivative Progress: 1475/2074 symbols completed. PNNT took 1.2s. Estimated remaining: 4m 9s. Rate: 144.1 symbols/min [2025-09-26T22:26:42.069374] [INFO ] [MAIN ] POST: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:42.105489] [DEBUG] [MAIN ] PNW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:42.106861] [INFO ] [MAIN ] PNW: Generated 1820 derivative records from 46531 primary records. [2025-09-26T22:26:42.121410] [DEBUG] [LOCAL ] PNW: Saving derivative data. [2025-09-26T22:26:42.123107] [DEBUG] [LOCAL ] POR: Loaded 47706 existing records from primary storage. [2025-09-26T22:26:42.133911] [INFO ] [MAIN ] POR: Loaded 47706 primary data records. [2025-09-26T22:26:42.283139] [DEBUG] [LOCAL ] POST: Loaded 39494 existing records from primary storage. [2025-09-26T22:26:42.295065] [INFO ] [MAIN ] POST: Loaded 39494 primary data records. [2025-09-26T22:26:42.305896] [DEBUG] [LOCAL ] PNW: Derivative data saved (1820 records). [2025-09-26T22:26:42.406684] [INFO ] [MAIN ] PNW: Successfully saved derivative data. [2025-09-26T22:26:42.543974] [INFO ] [MAIN ] Derivative Progress: 1476/2074 symbols completed. PNW took 1.5s. Estimated remaining: 4m 9s. Rate: 144.1 symbols/min [2025-09-26T22:26:42.598304] [INFO ] [MAIN ] PPG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:42.894374] [DEBUG] [MAIN ] POR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:42.895415] [INFO ] [MAIN ] POR: Generated 1820 derivative records from 47706 primary records. [2025-09-26T22:26:42.895838] [DEBUG] [LOCAL ] POR: Saving derivative data. [2025-09-26T22:26:42.931520] [DEBUG] [LOCAL ] PPG: Loaded 51455 existing records from primary storage. [2025-09-26T22:26:42.929269] [DEBUG] [LOCAL ] POR: Derivative data saved (1820 records). [2025-09-26T22:26:42.932792] [INFO ] [MAIN ] POR: Successfully saved derivative data. [2025-09-26T22:26:42.933562] [INFO ] [MAIN ] PPG: Loaded 51455 primary data records. [2025-09-26T22:26:42.948635] [INFO ] [MAIN ] Derivative Progress: 1477/2074 symbols completed. POR took 1.1s. Estimated remaining: 4m 9s. Rate: 144.1 symbols/min [2025-09-26T22:26:42.981446] [INFO ] [MAIN ] PPT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:42.982259] [DEBUG] [MAIN ] POST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:43.021690] [INFO ] [MAIN ] POST: Generated 1820 derivative records from 39494 primary records. [2025-09-26T22:26:43.034772] [DEBUG] [LOCAL ] POST: Saving derivative data. [2025-09-26T22:26:43.339296] [DEBUG] [LOCAL ] PPT: Loaded 20342 existing records from primary storage. [2025-09-26T22:26:43.339783] [INFO ] [MAIN ] PPT: Loaded 20342 primary data records. [2025-09-26T22:26:43.388140] [DEBUG] [LOCAL ] POST: Derivative data saved (1820 records). [2025-09-26T22:26:43.429568] [INFO ] [MAIN ] POST: Successfully saved derivative data. [2025-09-26T22:26:43.442986] [INFO ] [MAIN ] Derivative Progress: 1478/2074 symbols completed. POST took 1.4s. Estimated remaining: 4m 8s. Rate: 144.1 symbols/min [2025-09-26T22:26:43.462675] [INFO ] [MAIN ] PR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:43.696399] [DEBUG] [MAIN ] PPG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:43.697587] [INFO ] [MAIN ] PPG: Generated 1820 derivative records from 51455 primary records. [2025-09-26T22:26:43.697813] [DEBUG] [LOCAL ] PPG: Saving derivative data. [2025-09-26T22:26:43.733974] [DEBUG] [LOCAL ] PPG: Derivative data saved (1820 records). [2025-09-26T22:26:43.734272] [INFO ] [MAIN ] PPG: Successfully saved derivative data. [2025-09-26T22:26:43.737556] [INFO ] [MAIN ] Derivative Progress: 1479/2074 symbols completed. PPG took 1.1s. Estimated remaining: 4m 8s. Rate: 144.1 symbols/min [2025-09-26T22:26:43.738239] [INFO ] [MAIN ] PRA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:43.775471] [DEBUG] [LOCAL ] PR: Loaded 54389 existing records from primary storage. [2025-09-26T22:26:43.775672] [INFO ] [MAIN ] PR: Loaded 54389 primary data records. [2025-09-26T22:26:43.774260] [DEBUG] [MAIN ] PPT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:43.776769] [INFO ] [MAIN ] PPT: Generated 1820 derivative records from 20342 primary records. [2025-09-26T22:26:43.776883] [DEBUG] [LOCAL ] PPT: Saving derivative data. [2025-09-26T22:26:43.872858] [DEBUG] [LOCAL ] PPT: Derivative data saved (1820 records). [2025-09-26T22:26:43.896071] [INFO ] [MAIN ] PPT: Successfully saved derivative data. [2025-09-26T22:26:43.930690] [INFO ] [MAIN ] Derivative Progress: 1480/2074 symbols completed. PPT took 1.0s. Estimated remaining: 4m 7s. Rate: 144.2 symbols/min [2025-09-26T22:26:43.962514] [INFO ] [MAIN ] PRG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:44.005812] [DEBUG] [LOCAL ] PRA: Loaded 35243 existing records from primary storage. [2025-09-26T22:26:44.153179] [INFO ] [MAIN ] PRA: Loaded 35243 primary data records. [2025-09-26T22:26:44.386944] [DEBUG] [LOCAL ] PRG: Loaded 30420 existing records from primary storage. [2025-09-26T22:26:44.505565] [INFO ] [MAIN ] PRG: Loaded 30420 primary data records. [2025-09-26T22:26:44.745120] [DEBUG] [MAIN ] PR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:44.889508] [INFO ] [MAIN ] PR: Generated 1820 derivative records from 54389 primary records. [2025-09-26T22:26:44.890096] [DEBUG] [LOCAL ] PR: Saving derivative data. [2025-09-26T22:26:44.934071] [DEBUG] [LOCAL ] PR: Derivative data saved (1820 records). [2025-09-26T22:26:44.933548] [DEBUG] [MAIN ] PRA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:44.934286] [INFO ] [MAIN ] PR: Successfully saved derivative data. [2025-09-26T22:26:44.935487] [INFO ] [MAIN ] PRA: Generated 1820 derivative records from 35243 primary records. [2025-09-26T22:26:44.938743] [DEBUG] [LOCAL ] PRA: Saving derivative data. [2025-09-26T22:26:44.938018] [INFO ] [MAIN ] Derivative Progress: 1481/2074 symbols completed. PR took 1.5s. Estimated remaining: 4m 7s. Rate: 144.0 symbols/min [2025-09-26T22:26:44.949087] [INFO ] [MAIN ] PRGO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:44.958781] [DEBUG] [LOCAL ] PRA: Derivative data saved (1820 records). [2025-09-26T22:26:44.959227] [INFO ] [MAIN ] PRA: Successfully saved derivative data. [2025-09-26T22:26:44.961561] [INFO ] [MAIN ] Derivative Progress: 1482/2074 symbols completed. PRA took 1.2s. Estimated remaining: 4m 6s. Rate: 144.1 symbols/min [2025-09-26T22:26:44.963066] [INFO ] [MAIN ] PRH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:44.973954] [DEBUG] [LOCAL ] PRH: Loaded 4908 existing records from primary storage. [2025-09-26T22:26:44.975020] [INFO ] [MAIN ] PRH: Loaded 4908 primary data records. [2025-09-26T22:26:45.040085] [DEBUG] [MAIN ] PRG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:45.066127] [INFO ] [MAIN ] PRG: Generated 1820 derivative records from 30420 primary records. [2025-09-26T22:26:45.080234] [DEBUG] [LOCAL ] PRG: Saving derivative data. [2025-09-26T22:26:45.413762] [DEBUG] [LOCAL ] PRG: Derivative data saved (1820 records). [2025-09-26T22:26:45.415101] [INFO ] [MAIN ] PRG: Successfully saved derivative data. [2025-09-26T22:26:45.403708] [DEBUG] [LOCAL ] PRGO: Loaded 47634 existing records from primary storage. [2025-09-26T22:26:45.418113] [INFO ] [MAIN ] Derivative Progress: 1483/2074 symbols completed. PRG took 1.5s. Estimated remaining: 4m 6s. Rate: 144.1 symbols/min [2025-09-26T22:26:45.418259] [INFO ] [MAIN ] PRGO: Loaded 47634 primary data records. [2025-09-26T22:26:45.786156] [DEBUG] [MAIN ] PRH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:45.787171] [INFO ] [MAIN ] PRH: Generated 1820 derivative records from 4908 primary records. [2025-09-26T22:26:45.787262] [DEBUG] [LOCAL ] PRH: Saving derivative data. [2025-09-26T22:26:45.805291] [DEBUG] [LOCAL ] PRH: Derivative data saved (1820 records). [2025-09-26T22:26:45.805392] [INFO ] [MAIN ] PRH: Successfully saved derivative data. [2025-09-26T22:26:45.807984] [INFO ] [MAIN ] Derivative Progress: 1484/2074 symbols completed. PRH took 0.8s. Estimated remaining: 4m 6s. Rate: 144.1 symbols/min [2025-09-26T22:26:45.828914] [DEBUG] [MAIN ] PRGO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:45.829637] [INFO ] [MAIN ] PRGO: Generated 1820 derivative records from 47634 primary records. [2025-09-26T22:26:45.829732] [DEBUG] [LOCAL ] PRGO: Saving derivative data. [2025-09-26T22:26:45.846734] [DEBUG] [LOCAL ] PRGO: Derivative data saved (1820 records). [2025-09-26T22:26:45.846824] [INFO ] [MAIN ] PRGO: Successfully saved derivative data. [2025-09-26T22:26:45.849069] [INFO ] [MAIN ] Derivative Progress: 1485/2074 symbols completed. PRGO took 0.9s. Estimated remaining: 4m 5s. Rate: 144.2 symbols/min [2025-09-26T22:26:45.850026] [INFO ] [MAIN ] PRI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:45.850126] [INFO ] [MAIN ] PRKS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:45.850338] [INFO ] [MAIN ] PRIM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:45.872562] [DEBUG] [LOCAL ] PRI: Loaded 18636 existing records from primary storage. [2025-09-26T22:26:45.872780] [INFO ] [MAIN ] PRI: Loaded 18636 primary data records. [2025-09-26T22:26:46.062002] [DEBUG] [LOCAL ] PRKS: Loaded 43308 existing records from primary storage. [2025-09-26T22:26:46.072005] [INFO ] [MAIN ] PRKS: Loaded 43308 primary data records. [2025-09-26T22:26:46.274442] [DEBUG] [LOCAL ] PRIM: Loaded 45072 existing records from primary storage. [2025-09-26T22:26:46.295207] [INFO ] [MAIN ] PRIM: Loaded 45072 primary data records. [2025-09-26T22:26:46.931853] [DEBUG] [MAIN ] PRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:46.934341] [INFO ] [MAIN ] PRI: Generated 1820 derivative records from 18636 primary records. [2025-09-26T22:26:46.934921] [DEBUG] [LOCAL ] PRI: Saving derivative data. [2025-09-26T22:26:46.954751] [DEBUG] [LOCAL ] PRI: Derivative data saved (1820 records). [2025-09-26T22:26:46.955265] [INFO ] [MAIN ] PRI: Successfully saved derivative data. [2025-09-26T22:26:46.957867] [INFO ] [MAIN ] Derivative Progress: 1486/2074 symbols completed. PRI took 1.1s. Estimated remaining: 4m 5s. Rate: 144.1 symbols/min [2025-09-26T22:26:46.958802] [INFO ] [MAIN ] PRLB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:46.976793] [DEBUG] [MAIN ] PRKS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:46.977741] [INFO ] [MAIN ] PRKS: Generated 1820 derivative records from 43308 primary records. [2025-09-26T22:26:46.977952] [DEBUG] [LOCAL ] PRKS: Saving derivative data. [2025-09-26T22:26:46.995315] [DEBUG] [LOCAL ] PRKS: Derivative data saved (1820 records). [2025-09-26T22:26:47.004882] [INFO ] [MAIN ] PRKS: Successfully saved derivative data. [2025-09-26T22:26:47.007576] [INFO ] [MAIN ] Derivative Progress: 1487/2074 symbols completed. PRKS took 1.2s. Estimated remaining: 4m 4s. Rate: 144.1 symbols/min [2025-09-26T22:26:47.028830] [INFO ] [MAIN ] PRM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:47.029419] [DEBUG] [MAIN ] PRIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:47.031451] [DEBUG] [LOCAL ] PRLB: Loaded 20919 existing records from primary storage. [2025-09-26T22:26:47.032581] [INFO ] [MAIN ] PRIM: Generated 1820 derivative records from 45072 primary records. [2025-09-26T22:26:47.032766] [INFO ] [MAIN ] PRLB: Loaded 20919 primary data records. [2025-09-26T22:26:47.032866] [DEBUG] [LOCAL ] PRIM: Saving derivative data. [2025-09-26T22:26:47.239116] [DEBUG] [LOCAL ] PRIM: Derivative data saved (1820 records). [2025-09-26T22:26:47.276874] [INFO ] [MAIN ] PRIM: Successfully saved derivative data. [2025-09-26T22:26:47.289803] [INFO ] [MAIN ] Derivative Progress: 1488/2074 symbols completed. PRIM took 1.4s. Estimated remaining: 4m 4s. Rate: 144.2 symbols/min [2025-09-26T22:26:47.395625] [INFO ] [MAIN ] PRMB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:47.474314] [DEBUG] [LOCAL ] PRM: Loaded 45298 existing records from primary storage. [2025-09-26T22:26:47.474794] [INFO ] [MAIN ] PRM: Loaded 45298 primary data records. [2025-09-26T22:26:47.857112] [DEBUG] [LOCAL ] PRMB: Loaded 53928 existing records from primary storage. [2025-09-26T22:26:47.858288] [INFO ] [MAIN ] PRMB: Loaded 53928 primary data records. [2025-09-26T22:26:47.858150] [DEBUG] [MAIN ] PRLB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:47.872348] [INFO ] [MAIN ] PRLB: Generated 1820 derivative records from 20919 primary records. [2025-09-26T22:26:47.889057] [DEBUG] [LOCAL ] PRLB: Saving derivative data. [2025-09-26T22:26:47.997672] [DEBUG] [LOCAL ] PRLB: Derivative data saved (1820 records). [2025-09-26T22:26:47.998504] [INFO ] [MAIN ] PRLB: Successfully saved derivative data. [2025-09-26T22:26:48.012073] [INFO ] [MAIN ] Derivative Progress: 1489/2074 symbols completed. PRLB took 1.1s. Estimated remaining: 4m 4s. Rate: 144.1 symbols/min [2025-09-26T22:26:48.041540] [INFO ] [MAIN ] PRO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:48.223630] [DEBUG] [MAIN ] PRM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:48.224830] [INFO ] [MAIN ] PRM: Generated 1820 derivative records from 45298 primary records. [2025-09-26T22:26:48.224921] [DEBUG] [LOCAL ] PRM: Saving derivative data. [2025-09-26T22:26:48.244888] [DEBUG] [LOCAL ] PRM: Derivative data saved (1820 records). [2025-09-26T22:26:48.245611] [INFO ] [MAIN ] PRM: Successfully saved derivative data. [2025-09-26T22:26:48.259320] [INFO ] [MAIN ] Derivative Progress: 1490/2074 symbols completed. PRM took 1.2s. Estimated remaining: 4m 3s. Rate: 144.1 symbols/min [2025-09-26T22:26:48.259844] [INFO ] [MAIN ] PRT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:48.280022] [DEBUG] [LOCAL ] PRO: Loaded 38444 existing records from primary storage. [2025-09-26T22:26:48.280585] [INFO ] [MAIN ] PRO: Loaded 38444 primary data records. [2025-09-26T22:26:48.284728] [DEBUG] [LOCAL ] PRT: Loaded 5402 existing records from primary storage. [2025-09-26T22:26:48.290158] [INFO ] [MAIN ] PRT: Loaded 5402 primary data records. [2025-09-26T22:26:48.574041] [DEBUG] [MAIN ] PRMB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:48.626159] [INFO ] [MAIN ] PRMB: Generated 1820 derivative records from 53928 primary records. [2025-09-26T22:26:48.657525] [DEBUG] [LOCAL ] PRMB: Saving derivative data. [2025-09-26T22:26:49.013843] [DEBUG] [LOCAL ] PRMB: Derivative data saved (1820 records). [2025-09-26T22:26:49.014491] [INFO ] [MAIN ] PRMB: Successfully saved derivative data. [2025-09-26T22:26:49.018159] [INFO ] [MAIN ] Derivative Progress: 1491/2074 symbols completed. PRMB took 1.6s. Estimated remaining: 4m 3s. Rate: 144.1 symbols/min [2025-09-26T22:26:49.018935] [INFO ] [MAIN ] PRU: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:49.041346] [DEBUG] [MAIN ] PRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:49.042378] [INFO ] [MAIN ] PRT: Generated 1820 derivative records from 5402 primary records. [2025-09-26T22:26:49.042498] [DEBUG] [LOCAL ] PRT: Saving derivative data. [2025-09-26T22:26:49.061095] [DEBUG] [LOCAL ] PRT: Derivative data saved (1820 records). [2025-09-26T22:26:49.061353] [INFO ] [MAIN ] PRT: Successfully saved derivative data. [2025-09-26T22:26:49.063827] [INFO ] [MAIN ] Derivative Progress: 1492/2074 symbols completed. PRT took 0.8s. Estimated remaining: 4m 2s. Rate: 144.1 symbols/min [2025-09-26T22:26:49.077718] [DEBUG] [MAIN ] PRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:49.078726] [INFO ] [MAIN ] PRO: Generated 1820 derivative records from 38444 primary records. [2025-09-26T22:26:49.077330] [INFO ] [MAIN ] PSA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:49.079225] [DEBUG] [LOCAL ] PRO: Saving derivative data. [2025-09-26T22:26:49.096734] [DEBUG] [LOCAL ] PRO: Derivative data saved (1820 records). [2025-09-26T22:26:49.110980] [INFO ] [MAIN ] PRO: Successfully saved derivative data. [2025-09-26T22:26:49.113899] [INFO ] [MAIN ] Derivative Progress: 1493/2074 symbols completed. PRO took 1.1s. Estimated remaining: 4m 2s. Rate: 144.2 symbols/min [2025-09-26T22:26:49.114462] [INFO ] [MAIN ] PSBD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:49.144511] [DEBUG] [LOCAL ] PSBD: Loaded 7130 existing records from primary storage. [2025-09-26T22:26:49.146016] [DEBUG] [LOCAL ] PRU: Loaded 52204 existing records from primary storage. [2025-09-26T22:26:49.146383] [INFO ] [MAIN ] PSBD: Loaded 7130 primary data records. [2025-09-26T22:26:49.151718] [INFO ] [MAIN ] PRU: Loaded 52204 primary data records. [2025-09-26T22:26:49.462941] [DEBUG] [LOCAL ] PSA: Loaded 42474 existing records from primary storage. [2025-09-26T22:26:49.563061] [INFO ] [MAIN ] PSA: Loaded 42474 primary data records. [2025-09-26T22:26:50.251134] [DEBUG] [MAIN ] PRU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:50.252971] [INFO ] [MAIN ] PRU: Generated 1820 derivative records from 52204 primary records. [2025-09-26T22:26:50.253406] [DEBUG] [LOCAL ] PRU: Saving derivative data. [2025-09-26T22:26:50.278215] [DEBUG] [MAIN ] PSBD: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:26:50.282467] [INFO ] [MAIN ] PSBD: Generated 1819 derivative records from 7130 primary records. [2025-09-26T22:26:50.283209] [DEBUG] [LOCAL ] PSBD: Saving derivative data. [2025-09-26T22:26:50.309472] [DEBUG] [LOCAL ] PSBD: Derivative data saved (1819 records). [2025-09-26T22:26:50.310442] [INFO ] [MAIN ] PSBD: Successfully saved derivative data. [2025-09-26T22:26:50.313753] [INFO ] [MAIN ] Derivative Progress: 1494/2074 symbols completed. PSBD took 1.2s. Estimated remaining: 4m 2s. Rate: 144.0 symbols/min [2025-09-26T22:26:50.315527] [DEBUG] [LOCAL ] PRU: Derivative data saved (1820 records). [2025-09-26T22:26:50.316568] [INFO ] [MAIN ] PSF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:50.316518] [INFO ] [MAIN ] PRU: Successfully saved derivative data. [2025-09-26T22:26:50.319797] [INFO ] [MAIN ] Derivative Progress: 1495/2074 symbols completed. PRU took 1.3s. Estimated remaining: 4m 1s. Rate: 144.1 symbols/min [2025-09-26T22:26:50.320222] [INFO ] [MAIN ] PSFE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:50.334870] [DEBUG] [LOCAL ] PSF: Loaded 6990 existing records from primary storage. [2025-09-26T22:26:50.335222] [INFO ] [MAIN ] PSF: Loaded 6990 primary data records. [2025-09-26T22:26:50.399514] [DEBUG] [MAIN ] PSA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:50.443210] [INFO ] [MAIN ] PSA: Generated 1820 derivative records from 42474 primary records. [2025-09-26T22:26:50.475233] [DEBUG] [LOCAL ] PSA: Saving derivative data. [2025-09-26T22:26:50.551708] [DEBUG] [LOCAL ] PSFE: Loaded 30702 existing records from primary storage. [2025-09-26T22:26:50.557417] [INFO ] [MAIN ] PSFE: Loaded 30702 primary data records. [2025-09-26T22:26:50.782797] [DEBUG] [LOCAL ] PSA: Derivative data saved (1820 records). [2025-09-26T22:26:50.843429] [INFO ] [MAIN ] PSA: Successfully saved derivative data. [2025-09-26T22:26:50.848218] [INFO ] [MAIN ] Derivative Progress: 1496/2074 symbols completed. PSA took 1.8s. Estimated remaining: 4m 1s. Rate: 144.1 symbols/min [2025-09-26T22:26:50.867709] [INFO ] [MAIN ] PSN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:51.095603] [DEBUG] [MAIN ] PSF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:51.096595] [INFO ] [MAIN ] PSF: Generated 1820 derivative records from 6990 primary records. [2025-09-26T22:26:51.096914] [DEBUG] [LOCAL ] PSF: Saving derivative data. [2025-09-26T22:26:51.131520] [DEBUG] [LOCAL ] PSF: Derivative data saved (1820 records). [2025-09-26T22:26:51.145816] [INFO ] [MAIN ] PSF: Successfully saved derivative data. [2025-09-26T22:26:51.148414] [INFO ] [MAIN ] Derivative Progress: 1497/2074 symbols completed. PSF took 0.8s. Estimated remaining: 4m 0s. Rate: 144.1 symbols/min [2025-09-26T22:26:51.149552] [DEBUG] [MAIN ] PSFE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:51.150309] [INFO ] [MAIN ] PSO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:51.166036] [INFO ] [MAIN ] PSFE: Generated 1820 derivative records from 30702 primary records. [2025-09-26T22:26:51.166445] [DEBUG] [LOCAL ] PSFE: Saving derivative data. [2025-09-26T22:26:51.168778] [DEBUG] [LOCAL ] PSN: Loaded 46808 existing records from primary storage. [2025-09-26T22:26:51.181109] [INFO ] [MAIN ] PSN: Loaded 46808 primary data records. [2025-09-26T22:26:51.185783] [DEBUG] [LOCAL ] PSFE: Derivative data saved (1820 records). [2025-09-26T22:26:51.191362] [INFO ] [MAIN ] PSFE: Successfully saved derivative data. [2025-09-26T22:26:51.211261] [INFO ] [MAIN ] Derivative Progress: 1498/2074 symbols completed. PSFE took 0.9s. Estimated remaining: 3m 60s. Rate: 144.2 symbols/min [2025-09-26T22:26:51.454839] [DEBUG] [LOCAL ] PSO: Loaded 37751 existing records from primary storage. [2025-09-26T22:26:51.461516] [INFO ] [MAIN ] PSO: Loaded 37751 primary data records. [2025-09-26T22:26:51.972968] [DEBUG] [MAIN ] PSN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:51.974214] [INFO ] [MAIN ] PSN: Generated 1820 derivative records from 46808 primary records. [2025-09-26T22:26:51.974899] [DEBUG] [LOCAL ] PSN: Saving derivative data. [2025-09-26T22:26:51.997558] [DEBUG] [LOCAL ] PSN: Derivative data saved (1820 records). [2025-09-26T22:26:51.999452] [INFO ] [MAIN ] PSN: Successfully saved derivative data. [2025-09-26T22:26:52.002887] [INFO ] [MAIN ] Derivative Progress: 1499/2074 symbols completed. PSN took 1.1s. Estimated remaining: 3m 59s. Rate: 144.1 symbols/min [2025-09-26T22:26:52.017278] [DEBUG] [MAIN ] PSO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:52.018158] [INFO ] [MAIN ] PSO: Generated 1820 derivative records from 37751 primary records. [2025-09-26T22:26:52.018228] [DEBUG] [LOCAL ] PSO: Saving derivative data. [2025-09-26T22:26:52.035815] [DEBUG] [LOCAL ] PSO: Derivative data saved (1820 records). [2025-09-26T22:26:52.035985] [INFO ] [MAIN ] PSO: Successfully saved derivative data. [2025-09-26T22:26:52.038429] [INFO ] [MAIN ] Derivative Progress: 1500/2074 symbols completed. PSO took 0.9s. Estimated remaining: 3m 59s. Rate: 144.2 symbols/min [2025-09-26T22:26:52.039567] [INFO ] [MAIN ] PSTL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:52.039928] [INFO ] [MAIN ] PSQH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:52.039795] [INFO ] [MAIN ] PSTG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:52.075081] [DEBUG] [LOCAL ] PSTL: Loaded 20585 existing records from primary storage. [2025-09-26T22:26:52.075354] [INFO ] [MAIN ] PSTL: Loaded 20585 primary data records. [2025-09-26T22:26:52.219196] [DEBUG] [LOCAL ] PSQH: Loaded 35426 existing records from primary storage. [2025-09-26T22:26:52.223844] [INFO ] [MAIN ] PSQH: Loaded 35426 primary data records. [2025-09-26T22:26:52.459041] [DEBUG] [LOCAL ] PSTG: Loaded 53626 existing records from primary storage. [2025-09-26T22:26:52.592715] [INFO ] [MAIN ] PSTG: Loaded 53626 primary data records. [2025-09-26T22:26:53.160954] [DEBUG] [MAIN ] PSTL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:53.162095] [INFO ] [MAIN ] PSTL: Generated 1820 derivative records from 20585 primary records. [2025-09-26T22:26:53.163041] [DEBUG] [LOCAL ] PSTL: Saving derivative data. [2025-09-26T22:26:53.196789] [DEBUG] [LOCAL ] PSTL: Derivative data saved (1820 records). [2025-09-26T22:26:53.197534] [DEBUG] [MAIN ] PSQH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:53.198582] [INFO ] [MAIN ] PSQH: Generated 1820 derivative records from 35426 primary records. [2025-09-26T22:26:53.197602] [INFO ] [MAIN ] PSTL: Successfully saved derivative data. [2025-09-26T22:26:53.201376] [INFO ] [MAIN ] Derivative Progress: 1501/2074 symbols completed. PSTL took 1.2s. Estimated remaining: 3m 59s. Rate: 144.1 symbols/min [2025-09-26T22:26:53.198806] [DEBUG] [LOCAL ] PSQH: Saving derivative data. [2025-09-26T22:26:53.202815] [INFO ] [MAIN ] PSX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:53.223306] [DEBUG] [LOCAL ] PSQH: Derivative data saved (1820 records). [2025-09-26T22:26:53.231827] [INFO ] [MAIN ] PSQH: Successfully saved derivative data. [2025-09-26T22:26:53.239471] [INFO ] [MAIN ] Derivative Progress: 1502/2074 symbols completed. PSQH took 1.2s. Estimated remaining: 3m 58s. Rate: 144.1 symbols/min [2025-09-26T22:26:53.240286] [DEBUG] [MAIN ] PSTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:53.241232] [INFO ] [MAIN ] PSTG: Generated 1820 derivative records from 53626 primary records. [2025-09-26T22:26:53.241387] [DEBUG] [LOCAL ] PSTG: Saving derivative data. [2025-09-26T22:26:53.240340] [INFO ] [MAIN ] PTA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:53.265242] [DEBUG] [LOCAL ] PSTG: Derivative data saved (1820 records). [2025-09-26T22:26:53.265388] [INFO ] [MAIN ] PSTG: Successfully saved derivative data. [2025-09-26T22:26:53.268508] [INFO ] [MAIN ] Derivative Progress: 1503/2074 symbols completed. PSTG took 1.2s. Estimated remaining: 3m 58s. Rate: 144.2 symbols/min [2025-09-26T22:26:53.268826] [INFO ] [MAIN ] PTY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:53.290753] [DEBUG] [LOCAL ] PTA: Loaded 15299 existing records from primary storage. [2025-09-26T22:26:53.290936] [INFO ] [MAIN ] PTA: Loaded 15299 primary data records. [2025-09-26T22:26:53.440536] [DEBUG] [LOCAL ] PSX: Loaded 53912 existing records from primary storage. [2025-09-26T22:26:53.462380] [INFO ] [MAIN ] PSX: Loaded 53912 primary data records. [2025-09-26T22:26:53.767066] [DEBUG] [LOCAL ] PTY: Loaded 37902 existing records from primary storage. [2025-09-26T22:26:53.767312] [INFO ] [MAIN ] PTY: Loaded 37902 primary data records. [2025-09-26T22:26:54.375364] [DEBUG] [MAIN ] PTA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:54.376444] [INFO ] [MAIN ] PTA: Generated 1820 derivative records from 15299 primary records. [2025-09-26T22:26:54.376550] [DEBUG] [LOCAL ] PTA: Saving derivative data. [2025-09-26T22:26:54.408251] [DEBUG] [MAIN ] PSX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:54.410666] [INFO ] [MAIN ] PSX: Generated 1820 derivative records from 53912 primary records. [2025-09-26T22:26:54.411501] [DEBUG] [LOCAL ] PSX: Saving derivative data. [2025-09-26T22:26:54.413823] [DEBUG] [LOCAL ] PTA: Derivative data saved (1820 records). [2025-09-26T22:26:54.422357] [INFO ] [MAIN ] PTA: Successfully saved derivative data. [2025-09-26T22:26:54.425048] [INFO ] [MAIN ] Derivative Progress: 1504/2074 symbols completed. PTA took 1.2s. Estimated remaining: 3m 57s. Rate: 144.1 symbols/min [2025-09-26T22:26:54.429279] [INFO ] [MAIN ] PUK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:54.438012] [DEBUG] [LOCAL ] PSX: Derivative data saved (1820 records). [2025-09-26T22:26:54.438264] [INFO ] [MAIN ] PSX: Successfully saved derivative data. [2025-09-26T22:26:54.440985] [INFO ] [MAIN ] Derivative Progress: 1505/2074 symbols completed. PSX took 1.2s. Estimated remaining: 3m 57s. Rate: 144.2 symbols/min [2025-09-26T22:26:54.441370] [INFO ] [MAIN ] PUMP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:54.454936] [DEBUG] [MAIN ] PTY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:54.455955] [INFO ] [MAIN ] PTY: Generated 1820 derivative records from 37902 primary records. [2025-09-26T22:26:54.456133] [DEBUG] [LOCAL ] PTY: Saving derivative data. [2025-09-26T22:26:54.480791] [DEBUG] [LOCAL ] PTY: Derivative data saved (1820 records). [2025-09-26T22:26:54.480945] [INFO ] [MAIN ] PTY: Successfully saved derivative data. [2025-09-26T22:26:54.483784] [INFO ] [MAIN ] Derivative Progress: 1506/2074 symbols completed. PTY took 1.2s. Estimated remaining: 3m 56s. Rate: 144.2 symbols/min [2025-09-26T22:26:54.484172] [INFO ] [MAIN ] PVH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:54.543997] [DEBUG] [LOCAL ] PUK: Loaded 45565 existing records from primary storage. [2025-09-26T22:26:54.557791] [INFO ] [MAIN ] PUK: Loaded 45565 primary data records. [2025-09-26T22:26:54.593940] [DEBUG] [LOCAL ] PUMP: Loaded 50160 existing records from primary storage. [2025-09-26T22:26:54.612672] [INFO ] [MAIN ] PUMP: Loaded 50160 primary data records. [2025-09-26T22:26:54.845602] [DEBUG] [LOCAL ] PVH: Loaded 51137 existing records from primary storage. [2025-09-26T22:26:54.851048] [INFO ] [MAIN ] PVH: Loaded 51137 primary data records. [2025-09-26T22:26:55.641753] [DEBUG] [MAIN ] PUK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:55.655880] [INFO ] [MAIN ] PUK: Generated 1820 derivative records from 45565 primary records. [2025-09-26T22:26:55.656235] [DEBUG] [MAIN ] PUMP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:55.657790] [DEBUG] [LOCAL ] PUK: Saving derivative data. [2025-09-26T22:26:55.657691] [INFO ] [MAIN ] PUMP: Generated 1820 derivative records from 50160 primary records. [2025-09-26T22:26:55.659126] [DEBUG] [LOCAL ] PUMP: Saving derivative data. [2025-09-26T22:26:55.694160] [DEBUG] [LOCAL ] PUK: Derivative data saved (1820 records). [2025-09-26T22:26:55.694763] [INFO ] [MAIN ] PUK: Successfully saved derivative data. [2025-09-26T22:26:55.697771] [INFO ] [MAIN ] Derivative Progress: 1507/2074 symbols completed. PUK took 1.3s. Estimated remaining: 3m 56s. Rate: 144.1 symbols/min [2025-09-26T22:26:55.698309] [INFO ] [MAIN ] PVL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:55.712899] [DEBUG] [MAIN ] PVH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:55.713807] [INFO ] [MAIN ] PVH: Generated 1820 derivative records from 51137 primary records. [2025-09-26T22:26:55.714054] [DEBUG] [LOCAL ] PVH: Saving derivative data. [2025-09-26T22:26:55.712976] [DEBUG] [LOCAL ] PUMP: Derivative data saved (1820 records). [2025-09-26T22:26:55.714554] [INFO ] [MAIN ] PUMP: Successfully saved derivative data. [2025-09-26T22:26:55.720636] [INFO ] [MAIN ] Derivative Progress: 1508/2074 symbols completed. PUMP took 1.3s. Estimated remaining: 3m 56s. Rate: 144.1 symbols/min [2025-09-26T22:26:55.734608] [INFO ] [MAIN ] PWR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:55.739036] [DEBUG] [LOCAL ] PVH: Derivative data saved (1820 records). [2025-09-26T22:26:55.739105] [INFO ] [MAIN ] PVH: Successfully saved derivative data. [2025-09-26T22:26:55.745319] [DEBUG] [LOCAL ] PVL: Loaded 4819 existing records from primary storage. [2025-09-26T22:26:55.745014] [INFO ] [MAIN ] Derivative Progress: 1509/2074 symbols completed. PVH took 1.3s. Estimated remaining: 3m 55s. Rate: 144.2 symbols/min [2025-09-26T22:26:55.746158] [INFO ] [MAIN ] QD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:55.746103] [INFO ] [MAIN ] PVL: Loaded 4819 primary data records. [2025-09-26T22:26:56.121579] [DEBUG] [LOCAL ] QD: Loaded 28475 existing records from primary storage. [2025-09-26T22:26:56.136187] [INFO ] [MAIN ] QD: Loaded 28475 primary data records. [2025-09-26T22:26:56.149242] [DEBUG] [LOCAL ] PWR: Loaded 48047 existing records from primary storage. [2025-09-26T22:26:56.189921] [INFO ] [MAIN ] PWR: Loaded 48047 primary data records. [2025-09-26T22:26:56.814788] [DEBUG] [MAIN ] PVL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:56.816502] [INFO ] [MAIN ] PVL: Generated 1820 derivative records from 4819 primary records. [2025-09-26T22:26:56.816778] [DEBUG] [LOCAL ] PVL: Saving derivative data. [2025-09-26T22:26:56.838459] [DEBUG] [LOCAL ] PVL: Derivative data saved (1820 records). [2025-09-26T22:26:56.838769] [INFO ] [MAIN ] PVL: Successfully saved derivative data. [2025-09-26T22:26:56.841497] [INFO ] [MAIN ] Derivative Progress: 1510/2074 symbols completed. PVL took 1.1s. Estimated remaining: 3m 55s. Rate: 144.1 symbols/min [2025-09-26T22:26:56.842462] [INFO ] [MAIN ] QGEN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:56.860845] [DEBUG] [MAIN ] QD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:56.861800] [INFO ] [MAIN ] QD: Generated 1820 derivative records from 28475 primary records. [2025-09-26T22:26:56.862218] [DEBUG] [LOCAL ] QD: Saving derivative data. [2025-09-26T22:26:56.882369] [DEBUG] [LOCAL ] QD: Derivative data saved (1820 records). [2025-09-26T22:26:56.882611] [INFO ] [MAIN ] QD: Successfully saved derivative data. [2025-09-26T22:26:56.885049] [INFO ] [MAIN ] Derivative Progress: 1511/2074 symbols completed. QD took 1.1s. Estimated remaining: 3m 54s. Rate: 144.2 symbols/min [2025-09-26T22:26:56.885485] [INFO ] [MAIN ] QS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:56.900951] [DEBUG] [MAIN ] PWR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:56.901985] [INFO ] [MAIN ] PWR: Generated 1820 derivative records from 48047 primary records. [2025-09-26T22:26:56.902271] [DEBUG] [LOCAL ] PWR: Saving derivative data. [2025-09-26T22:26:56.932816] [DEBUG] [LOCAL ] PWR: Derivative data saved (1820 records). [2025-09-26T22:26:56.947838] [INFO ] [MAIN ] PWR: Successfully saved derivative data. [2025-09-26T22:26:56.951991] [INFO ] [MAIN ] Derivative Progress: 1512/2074 symbols completed. PWR took 1.2s. Estimated remaining: 3m 54s. Rate: 144.2 symbols/min [2025-09-26T22:26:56.952365] [INFO ] [MAIN ] QSR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:56.953808] [DEBUG] [LOCAL ] QGEN: Loaded 49874 existing records from primary storage. [2025-09-26T22:26:56.954430] [INFO ] [MAIN ] QGEN: Loaded 49874 primary data records. [2025-09-26T22:26:57.192701] [DEBUG] [LOCAL ] QS: Loaded 54522 existing records from primary storage. [2025-09-26T22:26:57.318420] [INFO ] [MAIN ] QS: Loaded 54522 primary data records. [2025-09-26T22:26:57.466264] [DEBUG] [LOCAL ] QSR: Loaded 53178 existing records from primary storage. [2025-09-26T22:26:57.466794] [INFO ] [MAIN ] QSR: Loaded 53178 primary data records. [2025-09-26T22:26:58.068580] [DEBUG] [MAIN ] QGEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:58.069870] [INFO ] [MAIN ] QGEN: Generated 1820 derivative records from 49874 primary records. [2025-09-26T22:26:58.070593] [DEBUG] [LOCAL ] QGEN: Saving derivative data. [2025-09-26T22:26:58.090546] [DEBUG] [LOCAL ] QGEN: Derivative data saved (1820 records). [2025-09-26T22:26:58.091212] [INFO ] [MAIN ] QGEN: Successfully saved derivative data. [2025-09-26T22:26:58.093743] [INFO ] [MAIN ] Derivative Progress: 1513/2074 symbols completed. QGEN took 1.3s. Estimated remaining: 3m 54s. Rate: 144.1 symbols/min [2025-09-26T22:26:58.114358] [DEBUG] [MAIN ] QS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:58.115302] [INFO ] [MAIN ] QS: Generated 1820 derivative records from 54522 primary records. [2025-09-26T22:26:58.115610] [DEBUG] [LOCAL ] QS: Saving derivative data. [2025-09-26T22:26:58.136582] [DEBUG] [LOCAL ] QS: Derivative data saved (1820 records). [2025-09-26T22:26:58.136914] [INFO ] [MAIN ] QS: Successfully saved derivative data. [2025-09-26T22:26:58.139769] [INFO ] [MAIN ] Derivative Progress: 1514/2074 symbols completed. QS took 1.3s. Estimated remaining: 3m 53s. Rate: 144.2 symbols/min [2025-09-26T22:26:58.152557] [DEBUG] [MAIN ] QSR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:58.153452] [INFO ] [MAIN ] QSR: Generated 1820 derivative records from 53178 primary records. [2025-09-26T22:26:58.153517] [DEBUG] [LOCAL ] QSR: Saving derivative data. [2025-09-26T22:26:58.169357] [DEBUG] [LOCAL ] QSR: Derivative data saved (1820 records). [2025-09-26T22:26:58.169423] [INFO ] [MAIN ] QSR: Successfully saved derivative data. [2025-09-26T22:26:58.172391] [INFO ] [MAIN ] Derivative Progress: 1515/2074 symbols completed. QSR took 1.2s. Estimated remaining: 3m 53s. Rate: 144.3 symbols/min [2025-09-26T22:26:58.173247] [INFO ] [MAIN ] QVCC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:58.173478] [INFO ] [MAIN ] QUAD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:58.173067] [INFO ] [MAIN ] QTWO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:58.184941] [DEBUG] [LOCAL ] QVCC: Loaded 9018 existing records from primary storage. [2025-09-26T22:26:58.185101] [INFO ] [MAIN ] QVCC: Loaded 9018 primary data records. [2025-09-26T22:26:58.337224] [DEBUG] [LOCAL ] QUAD: Loaded 23938 existing records from primary storage. [2025-09-26T22:26:58.353554] [INFO ] [MAIN ] QUAD: Loaded 23938 primary data records. [2025-09-26T22:26:58.576039] [DEBUG] [LOCAL ] QTWO: Loaded 39754 existing records from primary storage. [2025-09-26T22:26:58.618621] [INFO ] [MAIN ] QTWO: Loaded 39754 primary data records. [2025-09-26T22:26:59.222189] [DEBUG] [MAIN ] QVCC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:59.223494] [INFO ] [MAIN ] QVCC: Generated 1820 derivative records from 9018 primary records. [2025-09-26T22:26:59.224321] [DEBUG] [LOCAL ] QVCC: Saving derivative data. [2025-09-26T22:26:59.245373] [DEBUG] [LOCAL ] QVCC: Derivative data saved (1820 records). [2025-09-26T22:26:59.246105] [INFO ] [MAIN ] QVCC: Successfully saved derivative data. [2025-09-26T22:26:59.249254] [INFO ] [MAIN ] Derivative Progress: 1516/2074 symbols completed. QVCC took 1.1s. Estimated remaining: 3m 52s. Rate: 144.1 symbols/min [2025-09-26T22:26:59.250084] [INFO ] [MAIN ] QVCD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:59.274222] [DEBUG] [MAIN ] QUAD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:59.274500] [DEBUG] [LOCAL ] QVCD: Loaded 4542 existing records from primary storage. [2025-09-26T22:26:59.275929] [INFO ] [MAIN ] QVCD: Loaded 4542 primary data records. [2025-09-26T22:26:59.276935] [INFO ] [MAIN ] QUAD: Generated 1820 derivative records from 23938 primary records. [2025-09-26T22:26:59.312530] [DEBUG] [LOCAL ] QUAD: Saving derivative data. [2025-09-26T22:26:59.415062] [DEBUG] [MAIN ] QTWO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:26:59.422506] [INFO ] [MAIN ] QTWO: Generated 1820 derivative records from 39754 primary records. [2025-09-26T22:26:59.428299] [DEBUG] [LOCAL ] QTWO: Saving derivative data. [2025-09-26T22:26:59.484086] [DEBUG] [LOCAL ] QUAD: Derivative data saved (1820 records). [2025-09-26T22:26:59.516588] [INFO ] [MAIN ] QUAD: Successfully saved derivative data. [2025-09-26T22:26:59.526536] [DEBUG] [LOCAL ] QTWO: Derivative data saved (1820 records). [2025-09-26T22:26:59.529208] [INFO ] [MAIN ] Derivative Progress: 1517/2074 symbols completed. QUAD took 1.4s. Estimated remaining: 3m 52s. Rate: 144.1 symbols/min [2025-09-26T22:26:59.634688] [INFO ] [MAIN ] QTWO: Successfully saved derivative data. [2025-09-26T22:26:59.652668] [INFO ] [MAIN ] Derivative Progress: 1518/2074 symbols completed. QTWO took 1.5s. Estimated remaining: 3m 51s. Rate: 144.2 symbols/min [2025-09-26T22:26:59.653071] [INFO ] [MAIN ] R: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:59.649785] [INFO ] [MAIN ] QXO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:59.694192] [DEBUG] [MAIN ] QVCD: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:26:59.695144] [INFO ] [MAIN ] QVCD: Generated 1819 derivative records from 4542 primary records. [2025-09-26T22:26:59.695334] [DEBUG] [LOCAL ] QVCD: Saving derivative data. [2025-09-26T22:26:59.720358] [DEBUG] [LOCAL ] R: Loaded 29775 existing records from primary storage. [2025-09-26T22:26:59.734566] [INFO ] [MAIN ] R: Loaded 29775 primary data records. [2025-09-26T22:26:59.799731] [DEBUG] [LOCAL ] QVCD: Derivative data saved (1819 records). [2025-09-26T22:26:59.800050] [INFO ] [MAIN ] QVCD: Successfully saved derivative data. [2025-09-26T22:26:59.802837] [INFO ] [MAIN ] Derivative Progress: 1519/2074 symbols completed. QVCD took 0.6s. Estimated remaining: 3m 51s. Rate: 144.3 symbols/min [2025-09-26T22:26:59.850273] [INFO ] [MAIN ] RA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:26:59.871243] [DEBUG] [LOCAL ] QXO: Loaded 53964 existing records from primary storage. [2025-09-26T22:26:59.883039] [INFO ] [MAIN ] QXO: Loaded 53964 primary data records. [2025-09-26T22:27:00.237415] [DEBUG] [LOCAL ] RA: Loaded 22045 existing records from primary storage. [2025-09-26T22:27:00.283458] [INFO ] [MAIN ] RA: Loaded 22045 primary data records. [2025-09-26T22:27:00.854478] [DEBUG] [MAIN ] R: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:00.855769] [INFO ] [MAIN ] R: Generated 1820 derivative records from 29775 primary records. [2025-09-26T22:27:00.855979] [DEBUG] [LOCAL ] R: Saving derivative data. [2025-09-26T22:27:00.876956] [DEBUG] [LOCAL ] R: Derivative data saved (1820 records). [2025-09-26T22:27:00.877788] [INFO ] [MAIN ] R: Successfully saved derivative data. [2025-09-26T22:27:00.880381] [INFO ] [MAIN ] Derivative Progress: 1520/2074 symbols completed. R took 1.2s. Estimated remaining: 3m 51s. Rate: 144.1 symbols/min [2025-09-26T22:27:00.881253] [INFO ] [MAIN ] RACE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:00.895974] [DEBUG] [MAIN ] QXO: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:27:00.896833] [INFO ] [MAIN ] QXO: Generated 1819 derivative records from 53964 primary records. [2025-09-26T22:27:00.897064] [DEBUG] [LOCAL ] QXO: Saving derivative data. [2025-09-26T22:27:00.915129] [DEBUG] [LOCAL ] QXO: Derivative data saved (1819 records). [2025-09-26T22:27:00.915520] [INFO ] [MAIN ] QXO: Successfully saved derivative data. [2025-09-26T22:27:00.918297] [INFO ] [MAIN ] Derivative Progress: 1521/2074 symbols completed. QXO took 1.3s. Estimated remaining: 3m 50s. Rate: 144.2 symbols/min [2025-09-26T22:27:00.918752] [INFO ] [MAIN ] RAMP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:00.936994] [DEBUG] [MAIN ] RA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:00.937895] [INFO ] [MAIN ] RA: Generated 1820 derivative records from 22045 primary records. [2025-09-26T22:27:00.938035] [DEBUG] [LOCAL ] RA: Saving derivative data. [2025-09-26T22:27:00.984055] [DEBUG] [LOCAL ] RA: Derivative data saved (1820 records). [2025-09-26T22:27:00.985207] [INFO ] [MAIN ] RA: Successfully saved derivative data. [2025-09-26T22:27:00.988102] [INFO ] [MAIN ] Derivative Progress: 1522/2074 symbols completed. RA took 1.1s. Estimated remaining: 3m 50s. Rate: 144.3 symbols/min [2025-09-26T22:27:00.985026] [DEBUG] [LOCAL ] RACE: Loaded 33300 existing records from primary storage. [2025-09-26T22:27:00.988472] [INFO ] [MAIN ] RBA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:00.988632] [INFO ] [MAIN ] RACE: Loaded 33300 primary data records. [2025-09-26T22:27:01.091484] [DEBUG] [LOCAL ] RAMP: Loaded 38208 existing records from primary storage. [2025-09-26T22:27:01.103700] [INFO ] [MAIN ] RAMP: Loaded 38208 primary data records. [2025-09-26T22:27:01.684317] [DEBUG] [LOCAL ] RBA: Loaded 46598 existing records from primary storage. [2025-09-26T22:27:01.686078] [INFO ] [MAIN ] RBA: Loaded 46598 primary data records. [2025-09-26T22:27:02.076387] [DEBUG] [MAIN ] RACE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:02.077317] [INFO ] [MAIN ] RACE: Generated 1820 derivative records from 33300 primary records. [2025-09-26T22:27:02.077780] [DEBUG] [LOCAL ] RACE: Saving derivative data. [2025-09-26T22:27:02.099421] [DEBUG] [LOCAL ] RACE: Derivative data saved (1820 records). [2025-09-26T22:27:02.101382] [INFO ] [MAIN ] RACE: Successfully saved derivative data. [2025-09-26T22:27:02.103973] [INFO ] [MAIN ] Derivative Progress: 1523/2074 symbols completed. RACE took 1.2s. Estimated remaining: 3m 49s. Rate: 144.1 symbols/min [2025-09-26T22:27:02.105180] [INFO ] [MAIN ] RBC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:02.120136] [DEBUG] [MAIN ] RAMP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:02.121060] [INFO ] [MAIN ] RAMP: Generated 1820 derivative records from 38208 primary records. [2025-09-26T22:27:02.121800] [DEBUG] [LOCAL ] RAMP: Saving derivative data. [2025-09-26T22:27:02.146032] [DEBUG] [LOCAL ] RAMP: Derivative data saved (1820 records). [2025-09-26T22:27:02.146397] [INFO ] [MAIN ] RAMP: Successfully saved derivative data. [2025-09-26T22:27:02.149106] [INFO ] [MAIN ] Derivative Progress: 1524/2074 symbols completed. RAMP took 1.2s. Estimated remaining: 3m 49s. Rate: 144.2 symbols/min [2025-09-26T22:27:02.149847] [INFO ] [MAIN ] RBLX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:02.157282] [DEBUG] [LOCAL ] RBC: Loaded 15326 existing records from primary storage. [2025-09-26T22:27:02.158472] [INFO ] [MAIN ] RBC: Loaded 15326 primary data records. [2025-09-26T22:27:02.265542] [DEBUG] [MAIN ] RBA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:02.280404] [INFO ] [MAIN ] RBA: Generated 1820 derivative records from 46598 primary records. [2025-09-26T22:27:02.294747] [DEBUG] [LOCAL ] RBA: Saving derivative data. [2025-09-26T22:27:02.586131] [DEBUG] [LOCAL ] RBA: Derivative data saved (1820 records). [2025-09-26T22:27:02.596005] [INFO ] [MAIN ] RBA: Successfully saved derivative data. [2025-09-26T22:27:02.598739] [INFO ] [MAIN ] Derivative Progress: 1525/2074 symbols completed. RBA took 1.6s. Estimated remaining: 3m 48s. Rate: 144.2 symbols/min [2025-09-26T22:27:02.600272] [INFO ] [MAIN ] RBOT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:02.623604] [DEBUG] [LOCAL ] RBLX: Loaded 54496 existing records from primary storage. [2025-09-26T22:27:02.625109] [INFO ] [MAIN ] RBLX: Loaded 54496 primary data records. [2025-09-26T22:27:02.664383] [DEBUG] [LOCAL ] RBOT: Loaded 5223 existing records from primary storage. [2025-09-26T22:27:02.701147] [INFO ] [MAIN ] RBOT: Loaded 5223 primary data records. [2025-09-26T22:27:03.292890] [DEBUG] [MAIN ] RBC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:03.294275] [INFO ] [MAIN ] RBC: Generated 1820 derivative records from 15326 primary records. [2025-09-26T22:27:03.294397] [DEBUG] [LOCAL ] RBC: Saving derivative data. [2025-09-26T22:27:03.319964] [DEBUG] [LOCAL ] RBC: Derivative data saved (1820 records). [2025-09-26T22:27:03.320479] [INFO ] [MAIN ] RBC: Successfully saved derivative data. [2025-09-26T22:27:03.323302] [INFO ] [MAIN ] Derivative Progress: 1526/2074 symbols completed. RBC took 1.2s. Estimated remaining: 3m 48s. Rate: 144.1 symbols/min [2025-09-26T22:27:03.324074] [INFO ] [MAIN ] RBRK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:03.342933] [DEBUG] [MAIN ] RBLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:03.344095] [INFO ] [MAIN ] RBLX: Generated 1820 derivative records from 54496 primary records. [2025-09-26T22:27:03.344232] [DEBUG] [LOCAL ] RBLX: Saving derivative data. [2025-09-26T22:27:03.377310] [DEBUG] [MAIN ] RBOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:03.378966] [INFO ] [MAIN ] RBOT: Generated 1820 derivative records from 5223 primary records. [2025-09-26T22:27:03.379765] [DEBUG] [LOCAL ] RBOT: Saving derivative data. [2025-09-26T22:27:03.382269] [DEBUG] [LOCAL ] RBLX: Derivative data saved (1820 records). [2025-09-26T22:27:03.393138] [INFO ] [MAIN ] RBLX: Successfully saved derivative data. [2025-09-26T22:27:03.398908] [INFO ] [MAIN ] Derivative Progress: 1527/2074 symbols completed. RBLX took 1.2s. Estimated remaining: 3m 48s. Rate: 144.2 symbols/min [2025-09-26T22:27:03.399686] [DEBUG] [LOCAL ] RBOT: Derivative data saved (1820 records). [2025-09-26T22:27:03.399978] [INFO ] [MAIN ] RC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:03.400332] [INFO ] [MAIN ] RBOT: Successfully saved derivative data. [2025-09-26T22:27:03.403523] [INFO ] [MAIN ] Derivative Progress: 1528/2074 symbols completed. RBOT took 0.8s. Estimated remaining: 3m 47s. Rate: 144.3 symbols/min [2025-09-26T22:27:03.444838] [DEBUG] [LOCAL ] RBRK: Loaded 53892 existing records from primary storage. [2025-09-26T22:27:03.445029] [INFO ] [MAIN ] RBRK: Loaded 53892 primary data records. [2025-09-26T22:27:03.654234] [DEBUG] [LOCAL ] RC: Loaded 49676 existing records from primary storage. [2025-09-26T22:27:03.690794] [INFO ] [MAIN ] RC: Loaded 49676 primary data records. [2025-09-26T22:27:04.295452] [DEBUG] [MAIN ] RBRK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:04.297294] [INFO ] [MAIN ] RBRK: Generated 1820 derivative records from 53892 primary records. [2025-09-26T22:27:04.297440] [DEBUG] [LOCAL ] RBRK: Saving derivative data. [2025-09-26T22:27:04.324577] [DEBUG] [LOCAL ] RBRK: Derivative data saved (1820 records). [2025-09-26T22:27:04.324807] [INFO ] [MAIN ] RBRK: Successfully saved derivative data. [2025-09-26T22:27:04.327673] [INFO ] [MAIN ] Derivative Progress: 1529/2074 symbols completed. RBRK took 1.0s. Estimated remaining: 3m 47s. Rate: 144.2 symbols/min [2025-09-26T22:27:04.345617] [DEBUG] [MAIN ] RC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:04.346571] [INFO ] [MAIN ] RC: Generated 1820 derivative records from 49676 primary records. [2025-09-26T22:27:04.346693] [DEBUG] [LOCAL ] RC: Saving derivative data. [2025-09-26T22:27:04.364270] [DEBUG] [LOCAL ] RC: Derivative data saved (1820 records). [2025-09-26T22:27:04.364413] [INFO ] [MAIN ] RC: Successfully saved derivative data. [2025-09-26T22:27:04.367369] [INFO ] [MAIN ] Derivative Progress: 1530/2074 symbols completed. RC took 1.0s. Estimated remaining: 3m 46s. Rate: 144.3 symbols/min [2025-09-26T22:27:04.368188] [INFO ] [MAIN ] RCUS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:04.368635] [INFO ] [MAIN ] RCI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:04.368485] [INFO ] [MAIN ] RCS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:04.387403] [DEBUG] [LOCAL ] RCS: Loaded 11593 existing records from primary storage. [2025-09-26T22:27:04.387696] [INFO ] [MAIN ] RCS: Loaded 11593 primary data records. [2025-09-26T22:27:04.631248] [DEBUG] [LOCAL ] RCI: Loaded 49383 existing records from primary storage. [2025-09-26T22:27:04.641893] [DEBUG] [LOCAL ] RCUS: Loaded 43206 existing records from primary storage. [2025-09-26T22:27:04.635533] [INFO ] [MAIN ] RCI: Loaded 49383 primary data records. [2025-09-26T22:27:04.668397] [INFO ] [MAIN ] RCUS: Loaded 43206 primary data records. [2025-09-26T22:27:05.533756] [DEBUG] [MAIN ] RCS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:05.535124] [INFO ] [MAIN ] RCS: Generated 1820 derivative records from 11593 primary records. [2025-09-26T22:27:05.536311] [DEBUG] [LOCAL ] RCS: Saving derivative data. [2025-09-26T22:27:05.562985] [DEBUG] [LOCAL ] RCS: Derivative data saved (1820 records). [2025-09-26T22:27:05.563147] [INFO ] [MAIN ] RCS: Successfully saved derivative data. [2025-09-26T22:27:05.565377] [INFO ] [MAIN ] Derivative Progress: 1531/2074 symbols completed. RCS took 1.2s. Estimated remaining: 3m 46s. Rate: 144.1 symbols/min [2025-09-26T22:27:05.566076] [INFO ] [MAIN ] RDDT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:05.585988] [DEBUG] [MAIN ] RCUS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:05.586926] [INFO ] [MAIN ] RCUS: Generated 1820 derivative records from 43206 primary records. [2025-09-26T22:27:05.599445] [DEBUG] [LOCAL ] RCUS: Saving derivative data. [2025-09-26T22:27:05.599759] [DEBUG] [MAIN ] RCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:05.601079] [INFO ] [MAIN ] RCI: Generated 1820 derivative records from 49383 primary records. [2025-09-26T22:27:05.608674] [DEBUG] [LOCAL ] RCI: Saving derivative data. [2025-09-26T22:27:05.625054] [DEBUG] [LOCAL ] RCUS: Derivative data saved (1820 records). [2025-09-26T22:27:05.629056] [INFO ] [MAIN ] RCUS: Successfully saved derivative data. [2025-09-26T22:27:05.635524] [INFO ] [MAIN ] Derivative Progress: 1532/2074 symbols completed. RCUS took 1.3s. Estimated remaining: 3m 46s. Rate: 144.2 symbols/min [2025-09-26T22:27:05.636637] [INFO ] [MAIN ] RDN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:05.641206] [DEBUG] [LOCAL ] RCI: Derivative data saved (1820 records). [2025-09-26T22:27:05.641319] [INFO ] [MAIN ] RCI: Successfully saved derivative data. [2025-09-26T22:27:05.644436] [INFO ] [MAIN ] Derivative Progress: 1533/2074 symbols completed. RCI took 1.3s. Estimated remaining: 3m 45s. Rate: 144.3 symbols/min [2025-09-26T22:27:05.659628] [INFO ] [MAIN ] RDW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:05.685512] [DEBUG] [LOCAL ] RDDT: Loaded 54563 existing records from primary storage. [2025-09-26T22:27:05.685834] [INFO ] [MAIN ] RDDT: Loaded 54563 primary data records. [2025-09-26T22:27:05.887438] [DEBUG] [LOCAL ] RDN: Loaded 45976 existing records from primary storage. [2025-09-26T22:27:05.942760] [INFO ] [MAIN ] RDN: Loaded 45976 primary data records. [2025-09-26T22:27:05.943605] [DEBUG] [LOCAL ] RDW: Loaded 52794 existing records from primary storage. [2025-09-26T22:27:06.067893] [INFO ] [MAIN ] RDW: Loaded 52794 primary data records. [2025-09-26T22:27:06.821201] [DEBUG] [MAIN ] RDDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:06.822681] [INFO ] [MAIN ] RDDT: Generated 1820 derivative records from 54563 primary records. [2025-09-26T22:27:06.822929] [DEBUG] [LOCAL ] RDDT: Saving derivative data. [2025-09-26T22:27:06.844952] [DEBUG] [LOCAL ] RDDT: Derivative data saved (1820 records). [2025-09-26T22:27:06.845288] [INFO ] [MAIN ] RDDT: Successfully saved derivative data. [2025-09-26T22:27:06.847550] [INFO ] [MAIN ] Derivative Progress: 1534/2074 symbols completed. RDDT took 1.3s. Estimated remaining: 3m 45s. Rate: 144.1 symbols/min [2025-09-26T22:27:06.848262] [INFO ] [MAIN ] RDY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:06.879451] [DEBUG] [MAIN ] RDN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:06.879946] [DEBUG] [MAIN ] RDW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:06.881390] [INFO ] [MAIN ] RDW: Generated 1820 derivative records from 52794 primary records. [2025-09-26T22:27:06.880785] [INFO ] [MAIN ] RDN: Generated 1820 derivative records from 45976 primary records. [2025-09-26T22:27:06.881515] [DEBUG] [LOCAL ] RDW: Saving derivative data. [2025-09-26T22:27:06.881813] [DEBUG] [LOCAL ] RDN: Saving derivative data. [2025-09-26T22:27:06.910232] [DEBUG] [LOCAL ] RDN: Derivative data saved (1820 records). [2025-09-26T22:27:06.910620] [INFO ] [MAIN ] RDN: Successfully saved derivative data. [2025-09-26T22:27:06.913794] [INFO ] [MAIN ] Derivative Progress: 1535/2074 symbols completed. RDN took 1.3s. Estimated remaining: 3m 44s. Rate: 144.2 symbols/min [2025-09-26T22:27:06.914826] [INFO ] [MAIN ] RELX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:06.920357] [DEBUG] [LOCAL ] RDW: Derivative data saved (1820 records). [2025-09-26T22:27:06.920493] [INFO ] [MAIN ] RDW: Successfully saved derivative data. [2025-09-26T22:27:06.923276] [INFO ] [MAIN ] Derivative Progress: 1536/2074 symbols completed. RDW took 1.3s. Estimated remaining: 3m 44s. Rate: 144.2 symbols/min [2025-09-26T22:27:06.923744] [INFO ] [MAIN ] RERE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:06.959036] [DEBUG] [LOCAL ] RDY: Loaded 47418 existing records from primary storage. [2025-09-26T22:27:06.959284] [INFO ] [MAIN ] RDY: Loaded 47418 primary data records. [2025-09-26T22:27:07.137795] [DEBUG] [LOCAL ] RELX: Loaded 48567 existing records from primary storage. [2025-09-26T22:27:07.149315] [DEBUG] [LOCAL ] RERE: Loaded 41690 existing records from primary storage. [2025-09-26T22:27:07.179679] [INFO ] [MAIN ] RERE: Loaded 41690 primary data records. [2025-09-26T22:27:07.175945] [INFO ] [MAIN ] RELX: Loaded 48567 primary data records. [2025-09-26T22:27:08.042573] [DEBUG] [MAIN ] RDY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:08.043928] [INFO ] [MAIN ] RDY: Generated 1820 derivative records from 47418 primary records. [2025-09-26T22:27:08.044173] [DEBUG] [LOCAL ] RDY: Saving derivative data. [2025-09-26T22:27:08.062583] [DEBUG] [LOCAL ] RDY: Derivative data saved (1820 records). [2025-09-26T22:27:08.062874] [INFO ] [MAIN ] RDY: Successfully saved derivative data. [2025-09-26T22:27:08.065459] [INFO ] [MAIN ] Derivative Progress: 1537/2074 symbols completed. RDY took 1.2s. Estimated remaining: 3m 44s. Rate: 144.1 symbols/min [2025-09-26T22:27:08.065819] [INFO ] [MAIN ] RES: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:08.086693] [DEBUG] [MAIN ] RELX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:08.100798] [INFO ] [MAIN ] RELX: Generated 1820 derivative records from 48567 primary records. [2025-09-26T22:27:08.101218] [DEBUG] [LOCAL ] RELX: Saving derivative data. [2025-09-26T22:27:08.101135] [DEBUG] [MAIN ] RERE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:08.102976] [INFO ] [MAIN ] RERE: Generated 1820 derivative records from 41690 primary records. [2025-09-26T22:27:08.103110] [DEBUG] [LOCAL ] RERE: Saving derivative data. [2025-09-26T22:27:08.132908] [DEBUG] [LOCAL ] RELX: Derivative data saved (1820 records). [2025-09-26T22:27:08.133468] [INFO ] [MAIN ] RELX: Successfully saved derivative data. [2025-09-26T22:27:08.136729] [INFO ] [MAIN ] Derivative Progress: 1538/2074 symbols completed. RELX took 1.2s. Estimated remaining: 3m 43s. Rate: 144.2 symbols/min [2025-09-26T22:27:08.137599] [INFO ] [MAIN ] REVG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:08.152605] [DEBUG] [LOCAL ] RERE: Derivative data saved (1820 records). [2025-09-26T22:27:08.152833] [INFO ] [MAIN ] RERE: Successfully saved derivative data. [2025-09-26T22:27:08.155579] [INFO ] [MAIN ] Derivative Progress: 1539/2074 symbols completed. RERE took 1.2s. Estimated remaining: 3m 43s. Rate: 144.3 symbols/min [2025-09-26T22:27:08.156110] [INFO ] [MAIN ] REX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:08.172306] [DEBUG] [LOCAL ] RES: Loaded 48190 existing records from primary storage. [2025-09-26T22:27:08.172506] [INFO ] [MAIN ] RES: Loaded 48190 primary data records. [2025-09-26T22:27:08.308964] [DEBUG] [LOCAL ] REX: Loaded 14221 existing records from primary storage. [2025-09-26T22:27:08.309246] [INFO ] [MAIN ] REX: Loaded 14221 primary data records. [2025-09-26T22:27:08.652610] [DEBUG] [LOCAL ] REVG: Loaded 41461 existing records from primary storage. [2025-09-26T22:27:08.653415] [INFO ] [MAIN ] REVG: Loaded 41461 primary data records. [2025-09-26T22:27:09.299195] [DEBUG] [MAIN ] RES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:09.300549] [INFO ] [MAIN ] RES: Generated 1820 derivative records from 48190 primary records. [2025-09-26T22:27:09.301960] [DEBUG] [LOCAL ] RES: Saving derivative data. [2025-09-26T22:27:09.322623] [DEBUG] [LOCAL ] RES: Derivative data saved (1820 records). [2025-09-26T22:27:09.323504] [INFO ] [MAIN ] RES: Successfully saved derivative data. [2025-09-26T22:27:09.331919] [INFO ] [MAIN ] Derivative Progress: 1540/2074 symbols completed. RES took 1.3s. Estimated remaining: 3m 42s. Rate: 144.1 symbols/min [2025-09-26T22:27:09.341324] [INFO ] [MAIN ] REXR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:09.341736] [DEBUG] [MAIN ] REX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:09.343365] [INFO ] [MAIN ] REX: Generated 1820 derivative records from 14221 primary records. [2025-09-26T22:27:09.344005] [DEBUG] [LOCAL ] REX: Saving derivative data. [2025-09-26T22:27:09.379791] [DEBUG] [MAIN ] REVG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:09.381681] [INFO ] [MAIN ] REVG: Generated 1820 derivative records from 41461 primary records. [2025-09-26T22:27:09.382081] [DEBUG] [LOCAL ] REVG: Saving derivative data. [2025-09-26T22:27:09.384322] [DEBUG] [LOCAL ] REX: Derivative data saved (1820 records). [2025-09-26T22:27:09.395937] [INFO ] [MAIN ] REX: Successfully saved derivative data. [2025-09-26T22:27:09.399348] [INFO ] [MAIN ] Derivative Progress: 1541/2074 symbols completed. REX took 1.2s. Estimated remaining: 3m 42s. Rate: 144.2 symbols/min [2025-09-26T22:27:09.400140] [INFO ] [MAIN ] REZI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:09.420226] [DEBUG] [LOCAL ] REVG: Derivative data saved (1820 records). [2025-09-26T22:27:09.420459] [INFO ] [MAIN ] REVG: Successfully saved derivative data. [2025-09-26T22:27:09.423487] [INFO ] [MAIN ] Derivative Progress: 1542/2074 symbols completed. REVG took 1.3s. Estimated remaining: 3m 41s. Rate: 144.2 symbols/min [2025-09-26T22:27:09.424101] [INFO ] [MAIN ] RF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:09.443787] [DEBUG] [LOCAL ] REXR: Loaded 52852 existing records from primary storage. [2025-09-26T22:27:09.444106] [INFO ] [MAIN ] REXR: Loaded 52852 primary data records. [2025-09-26T22:27:09.681099] [DEBUG] [LOCAL ] REZI: Loaded 47576 existing records from primary storage. [2025-09-26T22:27:09.792046] [INFO ] [MAIN ] REZI: Loaded 47576 primary data records. [2025-09-26T22:27:09.914346] [DEBUG] [LOCAL ] RF: Loaded 54410 existing records from primary storage. [2025-09-26T22:27:09.928736] [INFO ] [MAIN ] RF: Loaded 54410 primary data records. [2025-09-26T22:27:10.521578] [DEBUG] [MAIN ] REXR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:10.524575] [INFO ] [MAIN ] REXR: Generated 1820 derivative records from 52852 primary records. [2025-09-26T22:27:10.525234] [DEBUG] [LOCAL ] REXR: Saving derivative data. [2025-09-26T22:27:10.544635] [DEBUG] [LOCAL ] REXR: Derivative data saved (1820 records). [2025-09-26T22:27:10.544980] [INFO ] [MAIN ] REXR: Successfully saved derivative data. [2025-09-26T22:27:10.549598] [INFO ] [MAIN ] Derivative Progress: 1543/2074 symbols completed. REXR took 1.2s. Estimated remaining: 3m 41s. Rate: 144.1 symbols/min [2025-09-26T22:27:10.569147] [DEBUG] [MAIN ] REZI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:10.571942] [INFO ] [MAIN ] REZI: Generated 1820 derivative records from 47576 primary records. [2025-09-26T22:27:10.572626] [DEBUG] [LOCAL ] REZI: Saving derivative data. [2025-09-26T22:27:10.598850] [DEBUG] [MAIN ] RF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:10.600235] [INFO ] [MAIN ] RF: Generated 1820 derivative records from 54410 primary records. [2025-09-26T22:27:10.600571] [DEBUG] [LOCAL ] RF: Saving derivative data. [2025-09-26T22:27:10.619089] [DEBUG] [LOCAL ] REZI: Derivative data saved (1820 records). [2025-09-26T22:27:10.619841] [INFO ] [MAIN ] REZI: Successfully saved derivative data. [2025-09-26T22:27:10.623970] [INFO ] [MAIN ] Derivative Progress: 1544/2074 symbols completed. REZI took 1.2s. Estimated remaining: 3m 41s. Rate: 144.2 symbols/min [2025-09-26T22:27:10.626360] [DEBUG] [LOCAL ] RF: Derivative data saved (1820 records). [2025-09-26T22:27:10.626533] [INFO ] [MAIN ] RF: Successfully saved derivative data. [2025-09-26T22:27:10.629550] [INFO ] [MAIN ] Derivative Progress: 1545/2074 symbols completed. RF took 1.2s. Estimated remaining: 3m 40s. Rate: 144.3 symbols/min [2025-09-26T22:27:10.630359] [INFO ] [MAIN ] RFI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:10.630845] [INFO ] [MAIN ] RFL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:10.631298] [INFO ] [MAIN ] RFM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:10.639976] [DEBUG] [LOCAL ] RFM: Loaded 4196 existing records from primary storage. [2025-09-26T22:27:10.643282] [INFO ] [MAIN ] RFM: Loaded 4196 primary data records. [2025-09-26T22:27:10.729978] [DEBUG] [LOCAL ] RFL: Loaded 11051 existing records from primary storage. [2025-09-26T22:27:10.743328] [INFO ] [MAIN ] RFL: Loaded 11051 primary data records. [2025-09-26T22:27:10.782323] [DEBUG] [LOCAL ] RFI: Loaded 10550 existing records from primary storage. [2025-09-26T22:27:10.803748] [INFO ] [MAIN ] RFI: Loaded 10550 primary data records. [2025-09-26T22:27:11.732304] [DEBUG] [MAIN ] RFM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:11.733341] [INFO ] [MAIN ] RFM: Generated 1820 derivative records from 4196 primary records. [2025-09-26T22:27:11.733610] [DEBUG] [LOCAL ] RFM: Saving derivative data. [2025-09-26T22:27:11.753756] [DEBUG] [LOCAL ] RFM: Derivative data saved (1820 records). [2025-09-26T22:27:11.755885] [INFO ] [MAIN ] RFM: Successfully saved derivative data. [2025-09-26T22:27:11.759230] [INFO ] [MAIN ] Derivative Progress: 1546/2074 symbols completed. RFM took 1.1s. Estimated remaining: 3m 40s. Rate: 144.1 symbols/min [2025-09-26T22:27:11.773938] [INFO ] [MAIN ] RFMZ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:11.774346] [DEBUG] [MAIN ] RFI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:11.783900] [INFO ] [MAIN ] RFI: Generated 1820 derivative records from 10550 primary records. [2025-09-26T22:27:11.791633] [DEBUG] [MAIN ] RFL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:11.791213] [DEBUG] [LOCAL ] RFI: Saving derivative data. [2025-09-26T22:27:11.793711] [INFO ] [MAIN ] RFL: Generated 1820 derivative records from 11051 primary records. [2025-09-26T22:27:11.794143] [DEBUG] [LOCAL ] RFL: Saving derivative data. [2025-09-26T22:27:11.839219] [DEBUG] [LOCAL ] RFMZ: Loaded 8822 existing records from primary storage. [2025-09-26T22:27:11.841258] [INFO ] [MAIN ] RFMZ: Loaded 8822 primary data records. [2025-09-26T22:27:11.850310] [DEBUG] [LOCAL ] RFI: Derivative data saved (1820 records). [2025-09-26T22:27:11.851169] [INFO ] [MAIN ] RFI: Successfully saved derivative data. [2025-09-26T22:27:11.854917] [INFO ] [MAIN ] Derivative Progress: 1547/2074 symbols completed. RFI took 1.2s. Estimated remaining: 3m 39s. Rate: 144.2 symbols/min [2025-09-26T22:27:11.869701] [DEBUG] [LOCAL ] RFL: Derivative data saved (1820 records). [2025-09-26T22:27:11.877582] [INFO ] [MAIN ] RGA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:11.877790] [INFO ] [MAIN ] RFL: Successfully saved derivative data. [2025-09-26T22:27:11.886377] [INFO ] [MAIN ] Derivative Progress: 1548/2074 symbols completed. RFL took 1.3s. Estimated remaining: 3m 39s. Rate: 144.3 symbols/min [2025-09-26T22:27:11.897384] [INFO ] [MAIN ] RGR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:12.095453] [DEBUG] [LOCAL ] RGR: Loaded 20706 existing records from primary storage. [2025-09-26T22:27:12.098860] [INFO ] [MAIN ] RGR: Loaded 20706 primary data records. [2025-09-26T22:27:12.312359] [DEBUG] [LOCAL ] RGA: Loaded 30535 existing records from primary storage. [2025-09-26T22:27:12.318875] [INFO ] [MAIN ] RGA: Loaded 30535 primary data records. [2025-09-26T22:27:12.953906] [DEBUG] [MAIN ] RFMZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:12.955267] [INFO ] [MAIN ] RFMZ: Generated 1820 derivative records from 8822 primary records. [2025-09-26T22:27:12.955619] [DEBUG] [LOCAL ] RFMZ: Saving derivative data. [2025-09-26T22:27:12.974585] [DEBUG] [LOCAL ] RFMZ: Derivative data saved (1820 records). [2025-09-26T22:27:12.978291] [INFO ] [MAIN ] RFMZ: Successfully saved derivative data. [2025-09-26T22:27:12.981051] [INFO ] [MAIN ] Derivative Progress: 1549/2074 symbols completed. RFMZ took 1.2s. Estimated remaining: 3m 39s. Rate: 144.1 symbols/min [2025-09-26T22:27:12.981442] [INFO ] [MAIN ] RGT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:12.994688] [DEBUG] [MAIN ] RGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:12.995998] [INFO ] [MAIN ] RGR: Generated 1820 derivative records from 20706 primary records. [2025-09-26T22:27:12.996410] [DEBUG] [LOCAL ] RGR: Saving derivative data. [2025-09-26T22:27:13.015555] [DEBUG] [LOCAL ] RGT: Loaded 2885 existing records from primary storage. [2025-09-26T22:27:13.016236] [INFO ] [MAIN ] RGT: Loaded 2885 primary data records. [2025-09-26T22:27:13.127303] [DEBUG] [LOCAL ] RGR: Derivative data saved (1820 records). [2025-09-26T22:27:13.160419] [INFO ] [MAIN ] RGR: Successfully saved derivative data. [2025-09-26T22:27:13.163513] [INFO ] [MAIN ] Derivative Progress: 1550/2074 symbols completed. RGR took 1.3s. Estimated remaining: 3m 38s. Rate: 144.2 symbols/min [2025-09-26T22:27:13.164190] [DEBUG] [MAIN ] RGA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:13.165481] [INFO ] [MAIN ] RGA: Generated 1820 derivative records from 30535 primary records. [2025-09-26T22:27:13.171532] [INFO ] [MAIN ] RH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:13.165794] [DEBUG] [LOCAL ] RGA: Saving derivative data. [2025-09-26T22:27:13.442443] [DEBUG] [LOCAL ] RGA: Derivative data saved (1820 records). [2025-09-26T22:27:13.443268] [INFO ] [MAIN ] RGA: Successfully saved derivative data. [2025-09-26T22:27:13.446844] [INFO ] [MAIN ] Derivative Progress: 1551/2074 symbols completed. RGA took 1.6s. Estimated remaining: 3m 38s. Rate: 144.2 symbols/min [2025-09-26T22:27:13.447451] [INFO ] [MAIN ] RHI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:13.484461] [DEBUG] [MAIN ] RGT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:13.485208] [INFO ] [MAIN ] RGT: Generated 1820 derivative records from 2885 primary records. [2025-09-26T22:27:13.485335] [DEBUG] [LOCAL ] RGT: Saving derivative data. [2025-09-26T22:27:13.513844] [DEBUG] [LOCAL ] RH: Loaded 48340 existing records from primary storage. [2025-09-26T22:27:13.514955] [INFO ] [MAIN ] RH: Loaded 48340 primary data records. [2025-09-26T22:27:13.600230] [DEBUG] [LOCAL ] RGT: Derivative data saved (1820 records). [2025-09-26T22:27:13.628108] [INFO ] [MAIN ] RGT: Successfully saved derivative data. [2025-09-26T22:27:13.641061] [INFO ] [MAIN ] Derivative Progress: 1552/2074 symbols completed. RGT took 0.7s. Estimated remaining: 3m 37s. Rate: 144.2 symbols/min [2025-09-26T22:27:13.653471] [INFO ] [MAIN ] RHP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:13.676961] [DEBUG] [LOCAL ] RHI: Loaded 49995 existing records from primary storage. [2025-09-26T22:27:13.688483] [INFO ] [MAIN ] RHI: Loaded 49995 primary data records. [2025-09-26T22:27:14.202967] [DEBUG] [LOCAL ] RHP: Loaded 42305 existing records from primary storage. [2025-09-26T22:27:14.249232] [INFO ] [MAIN ] RHP: Loaded 42305 primary data records. [2025-09-26T22:27:14.611943] [DEBUG] [MAIN ] RH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:14.614263] [INFO ] [MAIN ] RH: Generated 1820 derivative records from 48340 primary records. [2025-09-26T22:27:14.614771] [DEBUG] [LOCAL ] RH: Saving derivative data. [2025-09-26T22:27:14.638385] [DEBUG] [LOCAL ] RH: Derivative data saved (1820 records). [2025-09-26T22:27:14.639027] [INFO ] [MAIN ] RH: Successfully saved derivative data. [2025-09-26T22:27:14.655964] [DEBUG] [MAIN ] RHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:14.655526] [INFO ] [MAIN ] Derivative Progress: 1553/2074 symbols completed. RH took 1.5s. Estimated remaining: 3m 37s. Rate: 144.1 symbols/min [2025-09-26T22:27:14.657532] [INFO ] [MAIN ] RHI: Generated 1820 derivative records from 49995 primary records. [2025-09-26T22:27:14.657854] [DEBUG] [LOCAL ] RHI: Saving derivative data. [2025-09-26T22:27:14.658339] [INFO ] [MAIN ] RIG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:14.693362] [DEBUG] [MAIN ] RHP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:14.694524] [DEBUG] [LOCAL ] RHI: Derivative data saved (1820 records). [2025-09-26T22:27:14.694834] [INFO ] [MAIN ] RHI: Successfully saved derivative data. [2025-09-26T22:27:14.696503] [INFO ] [MAIN ] RHP: Generated 1820 derivative records from 42305 primary records. [2025-09-26T22:27:14.696756] [DEBUG] [LOCAL ] RHP: Saving derivative data. [2025-09-26T22:27:14.699600] [INFO ] [MAIN ] Derivative Progress: 1554/2074 symbols completed. RHI took 1.3s. Estimated remaining: 3m 36s. Rate: 144.2 symbols/min [2025-09-26T22:27:14.700991] [INFO ] [MAIN ] RITM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:14.741110] [DEBUG] [LOCAL ] RHP: Derivative data saved (1820 records). [2025-09-26T22:27:14.741273] [INFO ] [MAIN ] RHP: Successfully saved derivative data. [2025-09-26T22:27:14.744252] [INFO ] [MAIN ] Derivative Progress: 1555/2074 symbols completed. RHP took 1.1s. Estimated remaining: 3m 36s. Rate: 144.3 symbols/min [2025-09-26T22:27:14.744981] [INFO ] [MAIN ] RIV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:14.777152] [DEBUG] [LOCAL ] RIG: Loaded 54449 existing records from primary storage. [2025-09-26T22:27:14.777428] [INFO ] [MAIN ] RIG: Loaded 54449 primary data records. [2025-09-26T22:27:14.879970] [DEBUG] [LOCAL ] RIV: Loaded 12193 existing records from primary storage. [2025-09-26T22:27:14.898521] [INFO ] [MAIN ] RIV: Loaded 12193 primary data records. [2025-09-26T22:27:15.085195] [DEBUG] [LOCAL ] RITM: Loaded 53589 existing records from primary storage. [2025-09-26T22:27:15.137616] [INFO ] [MAIN ] RITM: Loaded 53589 primary data records. [2025-09-26T22:27:15.900140] [DEBUG] [MAIN ] RIG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:15.901305] [INFO ] [MAIN ] RIG: Generated 1820 derivative records from 54449 primary records. [2025-09-26T22:27:15.902437] [DEBUG] [LOCAL ] RIG: Saving derivative data. [2025-09-26T22:27:15.931347] [DEBUG] [MAIN ] RIV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:15.932921] [INFO ] [MAIN ] RIV: Generated 1820 derivative records from 12193 primary records. [2025-09-26T22:27:15.933049] [DEBUG] [LOCAL ] RIV: Saving derivative data. [2025-09-26T22:27:15.951750] [DEBUG] [LOCAL ] RIG: Derivative data saved (1820 records). [2025-09-26T22:27:15.952782] [INFO ] [MAIN ] RIG: Successfully saved derivative data. [2025-09-26T22:27:15.956425] [INFO ] [MAIN ] Derivative Progress: 1556/2074 symbols completed. RIG took 1.3s. Estimated remaining: 3m 36s. Rate: 144.1 symbols/min [2025-09-26T22:27:15.958612] [INFO ] [MAIN ] RJF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:15.963235] [DEBUG] [LOCAL ] RIV: Derivative data saved (1820 records). [2025-09-26T22:27:15.964704] [INFO ] [MAIN ] RIV: Successfully saved derivative data. [2025-09-26T22:27:15.968600] [INFO ] [MAIN ] Derivative Progress: 1557/2074 symbols completed. RIV took 1.2s. Estimated remaining: 3m 35s. Rate: 144.2 symbols/min [2025-09-26T22:27:15.981977] [INFO ] [MAIN ] RKT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:15.982626] [DEBUG] [MAIN ] RITM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:15.984162] [INFO ] [MAIN ] RITM: Generated 1820 derivative records from 53589 primary records. [2025-09-26T22:27:15.984423] [DEBUG] [LOCAL ] RITM: Saving derivative data. [2025-09-26T22:27:16.005062] [DEBUG] [LOCAL ] RITM: Derivative data saved (1820 records). [2025-09-26T22:27:16.005266] [INFO ] [MAIN ] RITM: Successfully saved derivative data. [2025-09-26T22:27:16.008286] [INFO ] [MAIN ] Derivative Progress: 1558/2074 symbols completed. RITM took 1.3s. Estimated remaining: 3m 35s. Rate: 144.3 symbols/min [2025-09-26T22:27:16.055782] [DEBUG] [LOCAL ] RJF: Loaded 47804 existing records from primary storage. [2025-09-26T22:27:16.056026] [INFO ] [MAIN ] RJF: Loaded 47804 primary data records. [2025-09-26T22:27:16.202374] [DEBUG] [LOCAL ] RKT: Loaded 54501 existing records from primary storage. [2025-09-26T22:27:16.220563] [INFO ] [MAIN ] RKT: Loaded 54501 primary data records. [2025-09-26T22:27:16.725479] [DEBUG] [MAIN ] RJF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:16.726329] [INFO ] [MAIN ] RJF: Generated 1820 derivative records from 47804 primary records. [2025-09-26T22:27:16.726526] [DEBUG] [LOCAL ] RJF: Saving derivative data. [2025-09-26T22:27:16.758913] [DEBUG] [MAIN ] RKT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:16.760275] [INFO ] [MAIN ] RKT: Generated 1820 derivative records from 54501 primary records. [2025-09-26T22:27:16.759429] [DEBUG] [LOCAL ] RJF: Derivative data saved (1820 records). [2025-09-26T22:27:16.760514] [INFO ] [MAIN ] RJF: Successfully saved derivative data. [2025-09-26T22:27:16.762691] [INFO ] [MAIN ] Derivative Progress: 1559/2074 symbols completed. RJF took 0.8s. Estimated remaining: 3m 34s. Rate: 144.2 symbols/min [2025-09-26T22:27:16.760431] [DEBUG] [LOCAL ] RKT: Saving derivative data. [2025-09-26T22:27:16.779167] [DEBUG] [LOCAL ] RKT: Derivative data saved (1820 records). [2025-09-26T22:27:16.779233] [INFO ] [MAIN ] RKT: Successfully saved derivative data. [2025-09-26T22:27:16.781975] [INFO ] [MAIN ] Derivative Progress: 1560/2074 symbols completed. RKT took 0.8s. Estimated remaining: 3m 34s. Rate: 144.3 symbols/min [2025-09-26T22:27:16.782797] [INFO ] [MAIN ] RLI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:16.783055] [INFO ] [MAIN ] RL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:16.783244] [INFO ] [MAIN ] RLJ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:16.845277] [DEBUG] [LOCAL ] RLI: Loaded 33794 existing records from primary storage. [2025-09-26T22:27:16.846048] [INFO ] [MAIN ] RLI: Loaded 33794 primary data records. [2025-09-26T22:27:16.963895] [DEBUG] [LOCAL ] RL: Loaded 41998 existing records from primary storage. [2025-09-26T22:27:16.950153] [DEBUG] [LOCAL ] RLJ: Loaded 48922 existing records from primary storage. [2025-09-26T22:27:16.990538] [INFO ] [MAIN ] RLJ: Loaded 48922 primary data records. [2025-09-26T22:27:16.990368] [INFO ] [MAIN ] RL: Loaded 41998 primary data records. [2025-09-26T22:27:17.961817] [DEBUG] [MAIN ] RLI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:17.962721] [INFO ] [MAIN ] RLI: Generated 1820 derivative records from 33794 primary records. [2025-09-26T22:27:17.962987] [DEBUG] [LOCAL ] RLI: Saving derivative data. [2025-09-26T22:27:17.984812] [DEBUG] [LOCAL ] RLI: Derivative data saved (1820 records). [2025-09-26T22:27:17.985077] [INFO ] [MAIN ] RLI: Successfully saved derivative data. [2025-09-26T22:27:17.987141] [INFO ] [MAIN ] Derivative Progress: 1561/2074 symbols completed. RLI took 1.2s. Estimated remaining: 3m 34s. Rate: 144.1 symbols/min [2025-09-26T22:27:17.987554] [INFO ] [MAIN ] RLTY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:18.002431] [DEBUG] [MAIN ] RL: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:27:18.003997] [INFO ] [MAIN ] RL: Generated 1819 derivative records from 41998 primary records. [2025-09-26T22:27:18.004251] [DEBUG] [LOCAL ] RL: Saving derivative data. [2025-09-26T22:27:18.031430] [DEBUG] [MAIN ] RLJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:18.036590] [INFO ] [MAIN ] RLJ: Generated 1820 derivative records from 48922 primary records. [2025-09-26T22:27:18.037309] [DEBUG] [LOCAL ] RLJ: Saving derivative data. [2025-09-26T22:27:18.045036] [DEBUG] [LOCAL ] RL: Derivative data saved (1819 records). [2025-09-26T22:27:18.044941] [DEBUG] [LOCAL ] RLTY: Loaded 11255 existing records from primary storage. [2025-09-26T22:27:18.045163] [INFO ] [MAIN ] RL: Successfully saved derivative data. [2025-09-26T22:27:18.048829] [INFO ] [MAIN ] RLTY: Loaded 11255 primary data records. [2025-09-26T22:27:18.048705] [INFO ] [MAIN ] Derivative Progress: 1562/2074 symbols completed. RL took 1.3s. Estimated remaining: 3m 33s. Rate: 144.2 symbols/min [2025-09-26T22:27:18.071748] [INFO ] [MAIN ] RLX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:18.154609] [DEBUG] [LOCAL ] RLJ: Derivative data saved (1820 records). [2025-09-26T22:27:18.177004] [INFO ] [MAIN ] RLJ: Successfully saved derivative data. [2025-09-26T22:27:18.185200] [INFO ] [MAIN ] Derivative Progress: 1563/2074 symbols completed. RLJ took 1.4s. Estimated remaining: 3m 33s. Rate: 144.2 symbols/min [2025-09-26T22:27:18.202040] [INFO ] [MAIN ] RM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:18.409165] [DEBUG] [LOCAL ] RM: Loaded 7734 existing records from primary storage. [2025-09-26T22:27:18.410084] [INFO ] [MAIN ] RM: Loaded 7734 primary data records. [2025-09-26T22:27:18.501616] [DEBUG] [LOCAL ] RLX: Loaded 48987 existing records from primary storage. [2025-09-26T22:27:18.520774] [INFO ] [MAIN ] RLX: Loaded 48987 primary data records. [2025-09-26T22:27:19.110081] [DEBUG] [MAIN ] RLTY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:19.111724] [INFO ] [MAIN ] RLTY: Generated 1820 derivative records from 11255 primary records. [2025-09-26T22:27:19.112174] [DEBUG] [LOCAL ] RLTY: Saving derivative data. [2025-09-26T22:27:19.133680] [DEBUG] [LOCAL ] RLTY: Derivative data saved (1820 records). [2025-09-26T22:27:19.135579] [INFO ] [MAIN ] RLTY: Successfully saved derivative data. [2025-09-26T22:27:19.138189] [INFO ] [MAIN ] Derivative Progress: 1564/2074 symbols completed. RLTY took 1.2s. Estimated remaining: 3m 32s. Rate: 144.1 symbols/min [2025-09-26T22:27:19.138672] [INFO ] [MAIN ] RMAX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:19.154869] [DEBUG] [MAIN ] RM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:19.155997] [INFO ] [MAIN ] RM: Generated 1820 derivative records from 7734 primary records. [2025-09-26T22:27:19.169181] [DEBUG] [LOCAL ] RM: Saving derivative data. [2025-09-26T22:27:19.169982] [DEBUG] [MAIN ] RLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:19.171033] [INFO ] [MAIN ] RLX: Generated 1820 derivative records from 48987 primary records. [2025-09-26T22:27:19.171464] [DEBUG] [LOCAL ] RLX: Saving derivative data. [2025-09-26T22:27:19.211417] [DEBUG] [LOCAL ] RMAX: Loaded 22121 existing records from primary storage. [2025-09-26T22:27:19.212899] [INFO ] [MAIN ] RMAX: Loaded 22121 primary data records. [2025-09-26T22:27:19.225945] [DEBUG] [LOCAL ] RM: Derivative data saved (1820 records). [2025-09-26T22:27:19.226502] [INFO ] [MAIN ] RM: Successfully saved derivative data. [2025-09-26T22:27:19.234157] [INFO ] [MAIN ] Derivative Progress: 1565/2074 symbols completed. RM took 1.0s. Estimated remaining: 3m 32s. Rate: 144.2 symbols/min [2025-09-26T22:27:19.241950] [INFO ] [MAIN ] RMD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:19.291497] [DEBUG] [LOCAL ] RLX: Derivative data saved (1820 records). [2025-09-26T22:27:19.310371] [INFO ] [MAIN ] RLX: Successfully saved derivative data. [2025-09-26T22:27:19.334417] [INFO ] [MAIN ] Derivative Progress: 1566/2074 symbols completed. RLX took 1.3s. Estimated remaining: 3m 31s. Rate: 144.3 symbols/min [2025-09-26T22:27:19.338953] [INFO ] [MAIN ] RMI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:19.543591] [DEBUG] [LOCAL ] RMI: Loaded 4716 existing records from primary storage. [2025-09-26T22:27:19.557984] [INFO ] [MAIN ] RMI: Loaded 4716 primary data records. [2025-09-26T22:27:19.716138] [DEBUG] [LOCAL ] RMD: Loaded 42855 existing records from primary storage. [2025-09-26T22:27:19.732303] [INFO ] [MAIN ] RMD: Loaded 42855 primary data records. [2025-09-26T22:27:20.307158] [DEBUG] [MAIN ] RMAX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:20.308228] [INFO ] [MAIN ] RMAX: Generated 1820 derivative records from 22121 primary records. [2025-09-26T22:27:20.308449] [DEBUG] [LOCAL ] RMAX: Saving derivative data. [2025-09-26T22:27:20.327761] [DEBUG] [LOCAL ] RMAX: Derivative data saved (1820 records). [2025-09-26T22:27:20.328674] [INFO ] [MAIN ] RMAX: Successfully saved derivative data. [2025-09-26T22:27:20.330749] [INFO ] [MAIN ] Derivative Progress: 1567/2074 symbols completed. RMAX took 1.2s. Estimated remaining: 3m 31s. Rate: 144.1 symbols/min [2025-09-26T22:27:20.331281] [INFO ] [MAIN ] RMM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:20.354599] [DEBUG] [MAIN ] RMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:20.355985] [INFO ] [MAIN ] RMI: Generated 1820 derivative records from 4716 primary records. [2025-09-26T22:27:20.356157] [DEBUG] [LOCAL ] RMI: Saving derivative data. [2025-09-26T22:27:20.362294] [DEBUG] [LOCAL ] RMM: Loaded 10624 existing records from primary storage. [2025-09-26T22:27:20.369500] [INFO ] [MAIN ] RMM: Loaded 10624 primary data records. [2025-09-26T22:27:20.419450] [DEBUG] [LOCAL ] RMI: Derivative data saved (1820 records). [2025-09-26T22:27:20.455319] [INFO ] [MAIN ] RMI: Successfully saved derivative data. [2025-09-26T22:27:20.499454] [INFO ] [MAIN ] Derivative Progress: 1568/2074 symbols completed. RMI took 1.2s. Estimated remaining: 3m 31s. Rate: 144.2 symbols/min [2025-09-26T22:27:20.513772] [INFO ] [MAIN ] RMMZ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:20.514369] [DEBUG] [MAIN ] RMD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:20.515514] [INFO ] [MAIN ] RMD: Generated 1820 derivative records from 42855 primary records. [2025-09-26T22:27:20.520836] [DEBUG] [LOCAL ] RMD: Saving derivative data. [2025-09-26T22:27:20.758002] [DEBUG] [LOCAL ] RMD: Derivative data saved (1820 records). [2025-09-26T22:27:20.758243] [INFO ] [MAIN ] RMD: Successfully saved derivative data. [2025-09-26T22:27:20.761545] [INFO ] [MAIN ] Derivative Progress: 1569/2074 symbols completed. RMD took 1.5s. Estimated remaining: 3m 30s. Rate: 144.2 symbols/min [2025-09-26T22:27:20.762330] [INFO ] [MAIN ] RMT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:20.766941] [DEBUG] [LOCAL ] RMMZ: Loaded 4875 existing records from primary storage. [2025-09-26T22:27:20.767344] [INFO ] [MAIN ] RMMZ: Loaded 4875 primary data records. [2025-09-26T22:27:20.958401] [DEBUG] [LOCAL ] RMT: Loaded 17682 existing records from primary storage. [2025-09-26T22:27:20.986810] [INFO ] [MAIN ] RMT: Loaded 17682 primary data records. [2025-09-26T22:27:21.280569] [DEBUG] [MAIN ] RMM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:21.297244] [INFO ] [MAIN ] RMM: Generated 1820 derivative records from 10624 primary records. [2025-09-26T22:27:21.297855] [DEBUG] [LOCAL ] RMM: Saving derivative data. [2025-09-26T22:27:21.493884] [DEBUG] [LOCAL ] RMM: Derivative data saved (1820 records). [2025-09-26T22:27:21.494025] [INFO ] [MAIN ] RMM: Successfully saved derivative data. [2025-09-26T22:27:21.496212] [INFO ] [MAIN ] Derivative Progress: 1570/2074 symbols completed. RMM took 1.2s. Estimated remaining: 3m 30s. Rate: 144.2 symbols/min [2025-09-26T22:27:21.497840] [INFO ] [MAIN ] RNG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:21.518638] [DEBUG] [MAIN ] RMMZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:21.519678] [INFO ] [MAIN ] RMMZ: Generated 1820 derivative records from 4875 primary records. [2025-09-26T22:27:21.519897] [DEBUG] [LOCAL ] RMMZ: Saving derivative data. [2025-09-26T22:27:21.542777] [DEBUG] [LOCAL ] RMMZ: Derivative data saved (1820 records). [2025-09-26T22:27:21.543019] [INFO ] [MAIN ] RMMZ: Successfully saved derivative data. [2025-09-26T22:27:21.545589] [INFO ] [MAIN ] Derivative Progress: 1571/2074 symbols completed. RMMZ took 1.0s. Estimated remaining: 3m 29s. Rate: 144.2 symbols/min [2025-09-26T22:27:21.546257] [INFO ] [MAIN ] RNGR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:21.578523] [DEBUG] [MAIN ] RMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:21.579422] [INFO ] [MAIN ] RMT: Generated 1820 derivative records from 17682 primary records. [2025-09-26T22:27:21.579628] [DEBUG] [LOCAL ] RMT: Saving derivative data. [2025-09-26T22:27:21.608619] [DEBUG] [LOCAL ] RNG: Loaded 48830 existing records from primary storage. [2025-09-26T22:27:21.613611] [INFO ] [MAIN ] RNG: Loaded 48830 primary data records. [2025-09-26T22:27:21.664025] [DEBUG] [LOCAL ] RMT: Derivative data saved (1820 records). [2025-09-26T22:27:21.677064] [INFO ] [MAIN ] RMT: Successfully saved derivative data. [2025-09-26T22:27:21.716005] [DEBUG] [LOCAL ] RNGR: Loaded 20653 existing records from primary storage. [2025-09-26T22:27:21.709980] [INFO ] [MAIN ] Derivative Progress: 1572/2074 symbols completed. RMT took 0.9s. Estimated remaining: 3m 29s. Rate: 144.3 symbols/min [2025-09-26T22:27:21.735859] [INFO ] [MAIN ] RNP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:21.739919] [INFO ] [MAIN ] RNGR: Loaded 20653 primary data records. [2025-09-26T22:27:22.105831] [DEBUG] [LOCAL ] RNP: Loaded 15940 existing records from primary storage. [2025-09-26T22:27:22.115298] [INFO ] [MAIN ] RNP: Loaded 15940 primary data records. [2025-09-26T22:27:22.730914] [DEBUG] [MAIN ] RNG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:22.732409] [INFO ] [MAIN ] RNG: Generated 1820 derivative records from 48830 primary records. [2025-09-26T22:27:22.732822] [DEBUG] [LOCAL ] RNG: Saving derivative data. [2025-09-26T22:27:22.765929] [DEBUG] [MAIN ] RNGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:22.768251] [INFO ] [MAIN ] RNGR: Generated 1820 derivative records from 20653 primary records. [2025-09-26T22:27:22.768676] [DEBUG] [LOCAL ] RNGR: Saving derivative data. [2025-09-26T22:27:22.781169] [DEBUG] [LOCAL ] RNG: Derivative data saved (1820 records). [2025-09-26T22:27:22.784792] [INFO ] [MAIN ] RNG: Successfully saved derivative data. [2025-09-26T22:27:22.789233] [INFO ] [MAIN ] Derivative Progress: 1573/2074 symbols completed. RNG took 1.3s. Estimated remaining: 3m 29s. Rate: 144.1 symbols/min [2025-09-26T22:27:22.807178] [DEBUG] [MAIN ] RNP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:22.809361] [INFO ] [MAIN ] RNP: Generated 1820 derivative records from 15940 primary records. [2025-09-26T22:27:22.808599] [DEBUG] [LOCAL ] RNGR: Derivative data saved (1820 records). [2025-09-26T22:27:22.809531] [DEBUG] [LOCAL ] RNP: Saving derivative data. [2025-09-26T22:27:22.809637] [INFO ] [MAIN ] RNGR: Successfully saved derivative data. [2025-09-26T22:27:22.813124] [INFO ] [MAIN ] Derivative Progress: 1574/2074 symbols completed. RNGR took 1.3s. Estimated remaining: 3m 28s. Rate: 144.2 symbols/min [2025-09-26T22:27:22.829412] [DEBUG] [LOCAL ] RNP: Derivative data saved (1820 records). [2025-09-26T22:27:22.829499] [INFO ] [MAIN ] RNP: Successfully saved derivative data. [2025-09-26T22:27:22.832410] [INFO ] [MAIN ] Derivative Progress: 1575/2074 symbols completed. RNP took 1.1s. Estimated remaining: 3m 27s. Rate: 144.3 symbols/min [2025-09-26T22:27:22.833246] [INFO ] [MAIN ] RNST: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:22.833460] [INFO ] [MAIN ] RNR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:22.833184] [INFO ] [MAIN ] ROG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:22.868128] [DEBUG] [LOCAL ] ROG: Loaded 23367 existing records from primary storage. [2025-09-26T22:27:22.868267] [INFO ] [MAIN ] ROG: Loaded 23367 primary data records. [2025-09-26T22:27:23.045744] [DEBUG] [LOCAL ] RNR: Loaded 34623 existing records from primary storage. [2025-09-26T22:27:23.062512] [DEBUG] [LOCAL ] RNST: Loaded 37619 existing records from primary storage. [2025-09-26T22:27:23.056799] [INFO ] [MAIN ] RNR: Loaded 34623 primary data records. [2025-09-26T22:27:23.067999] [INFO ] [MAIN ] RNST: Loaded 37619 primary data records. [2025-09-26T22:27:24.020235] [DEBUG] [MAIN ] ROG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:24.021624] [INFO ] [MAIN ] ROG: Generated 1820 derivative records from 23367 primary records. [2025-09-26T22:27:24.022065] [DEBUG] [LOCAL ] ROG: Saving derivative data. [2025-09-26T22:27:24.044987] [DEBUG] [LOCAL ] ROG: Derivative data saved (1820 records). [2025-09-26T22:27:24.058423] [INFO ] [MAIN ] ROG: Successfully saved derivative data. [2025-09-26T22:27:24.061553] [INFO ] [MAIN ] Derivative Progress: 1576/2074 symbols completed. ROG took 1.2s. Estimated remaining: 3m 27s. Rate: 144.1 symbols/min [2025-09-26T22:27:24.063300] [DEBUG] [MAIN ] RNR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:24.064123] [INFO ] [MAIN ] RNR: Generated 1820 derivative records from 34623 primary records. [2025-09-26T22:27:24.062945] [INFO ] [MAIN ] ROK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:24.064726] [DEBUG] [LOCAL ] RNR: Saving derivative data. [2025-09-26T22:27:24.090571] [DEBUG] [MAIN ] RNST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:24.092275] [INFO ] [MAIN ] RNST: Generated 1820 derivative records from 37619 primary records. [2025-09-26T22:27:24.092375] [DEBUG] [LOCAL ] RNST: Saving derivative data. [2025-09-26T22:27:24.105456] [DEBUG] [LOCAL ] RNR: Derivative data saved (1820 records). [2025-09-26T22:27:24.108673] [INFO ] [MAIN ] RNR: Successfully saved derivative data. [2025-09-26T22:27:24.111613] [INFO ] [MAIN ] Derivative Progress: 1577/2074 symbols completed. RNR took 1.3s. Estimated remaining: 3m 27s. Rate: 144.2 symbols/min [2025-09-26T22:27:24.112477] [INFO ] [MAIN ] ROL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:24.117352] [DEBUG] [LOCAL ] RNST: Derivative data saved (1820 records). [2025-09-26T22:27:24.117468] [INFO ] [MAIN ] RNST: Successfully saved derivative data. [2025-09-26T22:27:24.120485] [INFO ] [MAIN ] Derivative Progress: 1578/2074 symbols completed. RNST took 1.3s. Estimated remaining: 3m 26s. Rate: 144.3 symbols/min [2025-09-26T22:27:24.120926] [INFO ] [MAIN ] RPM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:24.186623] [DEBUG] [LOCAL ] ROL: Loaded 51031 existing records from primary storage. [2025-09-26T22:27:24.186973] [INFO ] [MAIN ] ROL: Loaded 51031 primary data records. [2025-09-26T22:27:24.343080] [DEBUG] [LOCAL ] RPM: Loaded 41763 existing records from primary storage. [2025-09-26T22:27:24.338304] [DEBUG] [LOCAL ] ROK: Loaded 44522 existing records from primary storage. [2025-09-26T22:27:24.343360] [INFO ] [MAIN ] RPM: Loaded 41763 primary data records. [2025-09-26T22:27:24.354155] [INFO ] [MAIN ] ROK: Loaded 44522 primary data records. [2025-09-26T22:27:25.303288] [DEBUG] [MAIN ] ROL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:25.304853] [INFO ] [MAIN ] ROL: Generated 1820 derivative records from 51031 primary records. [2025-09-26T22:27:25.305256] [DEBUG] [LOCAL ] ROL: Saving derivative data. [2025-09-26T22:27:25.338929] [DEBUG] [MAIN ] RPM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:25.340385] [INFO ] [MAIN ] RPM: Generated 1820 derivative records from 41763 primary records. [2025-09-26T22:27:25.342780] [DEBUG] [LOCAL ] RPM: Saving derivative data. [2025-09-26T22:27:25.377976] [DEBUG] [LOCAL ] ROL: Derivative data saved (1820 records). [2025-09-26T22:27:25.381455] [DEBUG] [LOCAL ] RPM: Derivative data saved (1820 records). [2025-09-26T22:27:25.379490] [INFO ] [MAIN ] ROL: Successfully saved derivative data. [2025-09-26T22:27:25.379370] [DEBUG] [MAIN ] ROK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:25.383668] [INFO ] [MAIN ] Derivative Progress: 1579/2074 symbols completed. ROL took 1.3s. Estimated remaining: 3m 26s. Rate: 144.1 symbols/min [2025-09-26T22:27:25.383835] [INFO ] [MAIN ] RPM: Successfully saved derivative data. [2025-09-26T22:27:25.387100] [INFO ] [MAIN ] Derivative Progress: 1580/2074 symbols completed. RPM took 1.3s. Estimated remaining: 3m 26s. Rate: 144.2 symbols/min [2025-09-26T22:27:25.388788] [INFO ] [MAIN ] RQI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:25.388558] [INFO ] [MAIN ] ROK: Generated 1820 derivative records from 44522 primary records. [2025-09-26T22:27:25.387322] [INFO ] [MAIN ] RPT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:25.389126] [DEBUG] [LOCAL ] ROK: Saving derivative data. [2025-09-26T22:27:25.415839] [DEBUG] [LOCAL ] ROK: Derivative data saved (1820 records). [2025-09-26T22:27:25.416071] [INFO ] [MAIN ] ROK: Successfully saved derivative data. [2025-09-26T22:27:25.419247] [INFO ] [MAIN ] Derivative Progress: 1581/2074 symbols completed. ROK took 1.4s. Estimated remaining: 3m 25s. Rate: 144.3 symbols/min [2025-09-26T22:27:25.419786] [INFO ] [MAIN ] RRX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:25.428021] [DEBUG] [LOCAL ] RPT: Loaded 19767 existing records from primary storage. [2025-09-26T22:27:25.436788] [INFO ] [MAIN ] RPT: Loaded 19767 primary data records. [2025-09-26T22:27:25.565091] [DEBUG] [LOCAL ] RQI: Loaded 29573 existing records from primary storage. [2025-09-26T22:27:25.570881] [INFO ] [MAIN ] RQI: Loaded 29573 primary data records. [2025-09-26T22:27:25.983713] [DEBUG] [LOCAL ] RRX: Loaded 41752 existing records from primary storage. [2025-09-26T22:27:25.987609] [INFO ] [MAIN ] RRX: Loaded 41752 primary data records. [2025-09-26T22:27:26.630938] [DEBUG] [MAIN ] RPT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:26.632064] [INFO ] [MAIN ] RPT: Generated 1820 derivative records from 19767 primary records. [2025-09-26T22:27:26.632256] [DEBUG] [LOCAL ] RPT: Saving derivative data. [2025-09-26T22:27:26.655716] [DEBUG] [LOCAL ] RPT: Derivative data saved (1820 records). [2025-09-26T22:27:26.656001] [INFO ] [MAIN ] RPT: Successfully saved derivative data. [2025-09-26T22:27:26.660553] [INFO ] [MAIN ] Derivative Progress: 1582/2074 symbols completed. RPT took 1.3s. Estimated remaining: 3m 25s. Rate: 144.1 symbols/min [2025-09-26T22:27:26.663133] [INFO ] [MAIN ] RS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:26.687408] [DEBUG] [MAIN ] RQI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:26.688963] [INFO ] [MAIN ] RQI: Generated 1820 derivative records from 29573 primary records. [2025-09-26T22:27:26.689372] [DEBUG] [LOCAL ] RQI: Saving derivative data. [2025-09-26T22:27:26.715530] [DEBUG] [MAIN ] RRX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:26.724357] [INFO ] [MAIN ] RRX: Generated 1820 derivative records from 41752 primary records. [2025-09-26T22:27:26.725208] [DEBUG] [LOCAL ] RRX: Saving derivative data. [2025-09-26T22:27:26.749586] [DEBUG] [LOCAL ] RS: Loaded 25864 existing records from primary storage. [2025-09-26T22:27:26.750492] [DEBUG] [LOCAL ] RQI: Derivative data saved (1820 records). [2025-09-26T22:27:26.750862] [INFO ] [MAIN ] RQI: Successfully saved derivative data. [2025-09-26T22:27:26.750418] [INFO ] [MAIN ] RS: Loaded 25864 primary data records. [2025-09-26T22:27:26.754557] [INFO ] [MAIN ] Derivative Progress: 1583/2074 symbols completed. RQI took 1.4s. Estimated remaining: 3m 24s. Rate: 144.2 symbols/min [2025-09-26T22:27:26.755139] [INFO ] [MAIN ] RSF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:26.848688] [DEBUG] [LOCAL ] RSF: Loaded 4192 existing records from primary storage. [2025-09-26T22:27:26.860333] [INFO ] [MAIN ] RSF: Loaded 4192 primary data records. [2025-09-26T22:27:26.843258] [DEBUG] [LOCAL ] RRX: Derivative data saved (1820 records). [2025-09-26T22:27:26.877333] [INFO ] [MAIN ] RRX: Successfully saved derivative data. [2025-09-26T22:27:26.941601] [INFO ] [MAIN ] Derivative Progress: 1584/2074 symbols completed. RRX took 1.5s. Estimated remaining: 3m 24s. Rate: 144.2 symbols/min [2025-09-26T22:27:27.026025] [INFO ] [MAIN ] RSG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:27.481532] [DEBUG] [MAIN ] RS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:27.482730] [INFO ] [MAIN ] RS: Generated 1820 derivative records from 25864 primary records. [2025-09-26T22:27:27.482840] [DEBUG] [LOCAL ] RS: Saving derivative data. [2025-09-26T22:27:27.503406] [DEBUG] [LOCAL ] RS: Derivative data saved (1820 records). [2025-09-26T22:27:27.504479] [INFO ] [MAIN ] RS: Successfully saved derivative data. [2025-09-26T22:27:27.506748] [INFO ] [MAIN ] Derivative Progress: 1585/2074 symbols completed. RS took 0.8s. Estimated remaining: 3m 23s. Rate: 144.2 symbols/min [2025-09-26T22:27:27.521687] [INFO ] [MAIN ] RSI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:27.535922] [DEBUG] [LOCAL ] RSG: Loaded 48173 existing records from primary storage. [2025-09-26T22:27:27.536271] [DEBUG] [MAIN ] RSF: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:27:27.537231] [INFO ] [MAIN ] RSF: Generated 1819 derivative records from 4192 primary records. [2025-09-26T22:27:27.537411] [DEBUG] [LOCAL ] RSF: Saving derivative data. [2025-09-26T22:27:27.537934] [INFO ] [MAIN ] RSG: Loaded 48173 primary data records. [2025-09-26T22:27:27.760436] [DEBUG] [LOCAL ] RSF: Derivative data saved (1819 records). [2025-09-26T22:27:27.766120] [INFO ] [MAIN ] RSF: Successfully saved derivative data. [2025-09-26T22:27:27.873773] [INFO ] [MAIN ] Derivative Progress: 1586/2074 symbols completed. RSF took 1.1s. Estimated remaining: 3m 23s. Rate: 144.2 symbols/min [2025-09-26T22:27:27.889963] [INFO ] [MAIN ] RSKD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:27.906491] [DEBUG] [LOCAL ] RSI: Loaded 47695 existing records from primary storage. [2025-09-26T22:27:27.907264] [INFO ] [MAIN ] RSI: Loaded 47695 primary data records. [2025-09-26T22:27:28.264427] [DEBUG] [LOCAL ] RSKD: Loaded 34254 existing records from primary storage. [2025-09-26T22:27:28.276176] [INFO ] [MAIN ] RSKD: Loaded 34254 primary data records. [2025-09-26T22:27:28.450937] [DEBUG] [MAIN ] RSG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:28.486681] [INFO ] [MAIN ] RSG: Generated 1820 derivative records from 48173 primary records. [2025-09-26T22:27:28.641897] [DEBUG] [LOCAL ] RSG: Saving derivative data. [2025-09-26T22:27:28.768774] [DEBUG] [MAIN ] RSI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:28.768349] [DEBUG] [LOCAL ] RSG: Derivative data saved (1820 records). [2025-09-26T22:27:28.770830] [INFO ] [MAIN ] RSI: Generated 1820 derivative records from 47695 primary records. [2025-09-26T22:27:28.771115] [DEBUG] [LOCAL ] RSI: Saving derivative data. [2025-09-26T22:27:28.771329] [INFO ] [MAIN ] RSG: Successfully saved derivative data. [2025-09-26T22:27:28.773811] [INFO ] [MAIN ] Derivative Progress: 1587/2074 symbols completed. RSG took 1.8s. Estimated remaining: 3m 23s. Rate: 144.1 symbols/min [2025-09-26T22:27:28.775739] [INFO ] [MAIN ] RTO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:28.798171] [DEBUG] [LOCAL ] RSI: Derivative data saved (1820 records). [2025-09-26T22:27:28.798509] [INFO ] [MAIN ] RSI: Successfully saved derivative data. [2025-09-26T22:27:28.808771] [INFO ] [MAIN ] Derivative Progress: 1588/2074 symbols completed. RSI took 1.3s. Estimated remaining: 3m 22s. Rate: 144.2 symbols/min [2025-09-26T22:27:28.814922] [DEBUG] [MAIN ] RSKD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:28.815815] [INFO ] [MAIN ] RSKD: Generated 1820 derivative records from 34254 primary records. [2025-09-26T22:27:28.815881] [DEBUG] [LOCAL ] RSKD: Saving derivative data. [2025-09-26T22:27:28.842876] [DEBUG] [LOCAL ] RSKD: Derivative data saved (1820 records). [2025-09-26T22:27:28.843044] [INFO ] [MAIN ] RSKD: Successfully saved derivative data. [2025-09-26T22:27:28.846129] [INFO ] [MAIN ] Derivative Progress: 1589/2074 symbols completed. RSKD took 1.0s. Estimated remaining: 3m 22s. Rate: 144.3 symbols/min [2025-09-26T22:27:28.862873] [DEBUG] [LOCAL ] RTO: Loaded 40847 existing records from primary storage. [2025-09-26T22:27:28.863031] [INFO ] [MAIN ] RTO: Loaded 40847 primary data records. [2025-09-26T22:27:29.194129] [DEBUG] [MAIN ] RTO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:29.194872] [INFO ] [MAIN ] RTO: Generated 1820 derivative records from 40847 primary records. [2025-09-26T22:27:29.194942] [DEBUG] [LOCAL ] RTO: Saving derivative data. [2025-09-26T22:27:29.211704] [DEBUG] [LOCAL ] RTO: Derivative data saved (1820 records). [2025-09-26T22:27:29.211845] [INFO ] [MAIN ] RTO: Successfully saved derivative data. [2025-09-26T22:27:29.214101] [INFO ] [MAIN ] Derivative Progress: 1590/2074 symbols completed. RTO took 0.4s. Estimated remaining: 3m 21s. Rate: 144.3 symbols/min [2025-09-26T22:27:29.215280] [INFO ] [MAIN ] RVLV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:29.215451] [INFO ] [MAIN ] RVT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:29.215009] [INFO ] [MAIN ] RTX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:29.246943] [DEBUG] [LOCAL ] RVT: Loaded 27362 existing records from primary storage. [2025-09-26T22:27:29.247203] [INFO ] [MAIN ] RVT: Loaded 27362 primary data records. [2025-09-26T22:27:29.420205] [DEBUG] [LOCAL ] RVLV: Loaded 48453 existing records from primary storage. [2025-09-26T22:27:29.454928] [INFO ] [MAIN ] RVLV: Loaded 48453 primary data records. [2025-09-26T22:27:29.720478] [DEBUG] [LOCAL ] RTX: Loaded 54488 existing records from primary storage. [2025-09-26T22:27:29.739693] [INFO ] [MAIN ] RTX: Loaded 54488 primary data records. [2025-09-26T22:27:30.382358] [DEBUG] [MAIN ] RVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:30.384523] [INFO ] [MAIN ] RVT: Generated 1820 derivative records from 27362 primary records. [2025-09-26T22:27:30.385006] [DEBUG] [LOCAL ] RVT: Saving derivative data. [2025-09-26T22:27:30.421810] [DEBUG] [MAIN ] RVLV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:30.424346] [INFO ] [MAIN ] RVLV: Generated 1820 derivative records from 48453 primary records. [2025-09-26T22:27:30.424494] [DEBUG] [LOCAL ] RVLV: Saving derivative data. [2025-09-26T22:27:30.446596] [DEBUG] [LOCAL ] RVT: Derivative data saved (1820 records). [2025-09-26T22:27:30.448572] [INFO ] [MAIN ] RVT: Successfully saved derivative data. [2025-09-26T22:27:30.455600] [INFO ] [MAIN ] Derivative Progress: 1591/2074 symbols completed. RVT took 1.2s. Estimated remaining: 3m 21s. Rate: 144.1 symbols/min [2025-09-26T22:27:30.457876] [INFO ] [MAIN ] RVTY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:30.458682] [DEBUG] [LOCAL ] RVLV: Derivative data saved (1820 records). [2025-09-26T22:27:30.467468] [INFO ] [MAIN ] RVLV: Successfully saved derivative data. [2025-09-26T22:27:30.471350] [INFO ] [MAIN ] Derivative Progress: 1592/2074 symbols completed. RVLV took 1.3s. Estimated remaining: 3m 21s. Rate: 144.2 symbols/min [2025-09-26T22:27:30.476884] [INFO ] [MAIN ] RWT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:30.478590] [DEBUG] [MAIN ] RTX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:30.482035] [INFO ] [MAIN ] RTX: Generated 1820 derivative records from 54488 primary records. [2025-09-26T22:27:30.482307] [DEBUG] [LOCAL ] RTX: Saving derivative data. [2025-09-26T22:27:30.501262] [DEBUG] [LOCAL ] RTX: Derivative data saved (1820 records). [2025-09-26T22:27:30.501576] [INFO ] [MAIN ] RTX: Successfully saved derivative data. [2025-09-26T22:27:30.504748] [INFO ] [MAIN ] Derivative Progress: 1593/2074 symbols completed. RTX took 1.3s. Estimated remaining: 3m 20s. Rate: 144.3 symbols/min [2025-09-26T22:27:30.505243] [INFO ] [MAIN ] RXO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:30.557886] [DEBUG] [LOCAL ] RWT: Loaded 41352 existing records from primary storage. [2025-09-26T22:27:30.558265] [INFO ] [MAIN ] RWT: Loaded 41352 primary data records. [2025-09-26T22:27:30.700456] [DEBUG] [LOCAL ] RVTY: Loaded 48199 existing records from primary storage. [2025-09-26T22:27:30.702131] [INFO ] [MAIN ] RVTY: Loaded 48199 primary data records. [2025-09-26T22:27:30.856544] [DEBUG] [LOCAL ] RXO: Loaded 48520 existing records from primary storage. [2025-09-26T22:27:30.860935] [INFO ] [MAIN ] RXO: Loaded 48520 primary data records. [2025-09-26T22:27:31.696695] [DEBUG] [MAIN ] RWT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:31.698892] [INFO ] [MAIN ] RWT: Generated 1820 derivative records from 41352 primary records. [2025-09-26T22:27:31.699242] [DEBUG] [LOCAL ] RWT: Saving derivative data. [2025-09-26T22:27:31.737538] [DEBUG] [LOCAL ] RWT: Derivative data saved (1820 records). [2025-09-26T22:27:31.738772] [INFO ] [MAIN ] RWT: Successfully saved derivative data. [2025-09-26T22:27:31.738667] [DEBUG] [MAIN ] RVTY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:31.742048] [INFO ] [MAIN ] Derivative Progress: 1594/2074 symbols completed. RWT took 1.3s. Estimated remaining: 3m 20s. Rate: 144.1 symbols/min [2025-09-26T22:27:31.743331] [INFO ] [MAIN ] RVTY: Generated 1820 derivative records from 48199 primary records. [2025-09-26T22:27:31.743750] [DEBUG] [LOCAL ] RVTY: Saving derivative data. [2025-09-26T22:27:31.744882] [INFO ] [MAIN ] RY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:31.780193] [DEBUG] [MAIN ] RXO: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:27:31.781564] [INFO ] [MAIN ] RXO: Generated 1819 derivative records from 48520 primary records. [2025-09-26T22:27:31.782099] [DEBUG] [LOCAL ] RXO: Saving derivative data. [2025-09-26T22:27:31.794208] [DEBUG] [LOCAL ] RVTY: Derivative data saved (1820 records). [2025-09-26T22:27:31.797481] [INFO ] [MAIN ] RVTY: Successfully saved derivative data. [2025-09-26T22:27:31.800867] [INFO ] [MAIN ] Derivative Progress: 1595/2074 symbols completed. RVTY took 1.3s. Estimated remaining: 3m 19s. Rate: 144.2 symbols/min [2025-09-26T22:27:31.802786] [INFO ] [MAIN ] RYAM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:31.809031] [DEBUG] [LOCAL ] RXO: Derivative data saved (1819 records). [2025-09-26T22:27:31.809364] [INFO ] [MAIN ] RXO: Successfully saved derivative data. [2025-09-26T22:27:31.812313] [INFO ] [MAIN ] Derivative Progress: 1596/2074 symbols completed. RXO took 1.3s. Estimated remaining: 3m 19s. Rate: 144.3 symbols/min [2025-09-26T22:27:31.813453] [INFO ] [MAIN ] RYAN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:31.859939] [DEBUG] [LOCAL ] RYAM: Loaded 35709 existing records from primary storage. [2025-09-26T22:27:31.873795] [INFO ] [MAIN ] RYAM: Loaded 35709 primary data records. [2025-09-26T22:27:31.913104] [DEBUG] [LOCAL ] RY: Loaded 48606 existing records from primary storage. [2025-09-26T22:27:31.966494] [INFO ] [MAIN ] RY: Loaded 48606 primary data records. [2025-09-26T22:27:32.158232] [DEBUG] [LOCAL ] RYAN: Loaded 44960 existing records from primary storage. [2025-09-26T22:27:32.209224] [INFO ] [MAIN ] RYAN: Loaded 44960 primary data records. [2025-09-26T22:27:32.999507] [DEBUG] [MAIN ] RYAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:33.001874] [INFO ] [MAIN ] RYAM: Generated 1820 derivative records from 35709 primary records. [2025-09-26T22:27:33.002156] [DEBUG] [LOCAL ] RYAM: Saving derivative data. [2025-09-26T22:27:33.034006] [DEBUG] [MAIN ] RY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:33.035921] [INFO ] [MAIN ] RY: Generated 1820 derivative records from 48606 primary records. [2025-09-26T22:27:33.036475] [DEBUG] [LOCAL ] RY: Saving derivative data. [2025-09-26T22:27:33.059736] [DEBUG] [LOCAL ] RYAM: Derivative data saved (1820 records). [2025-09-26T22:27:33.062897] [INFO ] [MAIN ] RYAM: Successfully saved derivative data. [2025-09-26T22:27:33.065432] [INFO ] [MAIN ] Derivative Progress: 1597/2074 symbols completed. RYAM took 1.3s. Estimated remaining: 3m 19s. Rate: 144.1 symbols/min [2025-09-26T22:27:33.063220] [DEBUG] [LOCAL ] RY: Derivative data saved (1820 records). [2025-09-26T22:27:33.066226] [INFO ] [MAIN ] RYI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:33.074467] [INFO ] [MAIN ] RY: Successfully saved derivative data. [2025-09-26T22:27:33.084573] [DEBUG] [MAIN ] RYAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:33.084092] [INFO ] [MAIN ] Derivative Progress: 1598/2074 symbols completed. RY took 1.3s. Estimated remaining: 3m 18s. Rate: 144.2 symbols/min [2025-09-26T22:27:33.086175] [INFO ] [MAIN ] RYAN: Generated 1820 derivative records from 44960 primary records. [2025-09-26T22:27:33.086410] [DEBUG] [LOCAL ] RYAN: Saving derivative data. [2025-09-26T22:27:33.086737] [INFO ] [MAIN ] RYN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:33.112116] [DEBUG] [LOCAL ] RYAN: Derivative data saved (1820 records). [2025-09-26T22:27:33.112305] [INFO ] [MAIN ] RYAN: Successfully saved derivative data. [2025-09-26T22:27:33.115375] [INFO ] [MAIN ] Derivative Progress: 1599/2074 symbols completed. RYAN took 1.3s. Estimated remaining: 3m 18s. Rate: 144.3 symbols/min [2025-09-26T22:27:33.115815] [INFO ] [MAIN ] RZB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:33.125973] [DEBUG] [LOCAL ] RYI: Loaded 21835 existing records from primary storage. [2025-09-26T22:27:33.126335] [INFO ] [MAIN ] RYI: Loaded 21835 primary data records. [2025-09-26T22:27:33.180902] [DEBUG] [LOCAL ] RZB: Loaded 6291 existing records from primary storage. [2025-09-26T22:27:33.196763] [INFO ] [MAIN ] RZB: Loaded 6291 primary data records. [2025-09-26T22:27:33.446621] [DEBUG] [LOCAL ] RYN: Loaded 46335 existing records from primary storage. [2025-09-26T22:27:33.478542] [INFO ] [MAIN ] RYN: Loaded 46335 primary data records. [2025-09-26T22:27:34.170940] [DEBUG] [MAIN ] RYI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:34.175303] [INFO ] [MAIN ] RYI: Generated 1820 derivative records from 21835 primary records. [2025-09-26T22:27:34.176217] [DEBUG] [LOCAL ] RYI: Saving derivative data. [2025-09-26T22:27:34.204314] [DEBUG] [MAIN ] RZB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:34.206227] [INFO ] [MAIN ] RZB: Generated 1820 derivative records from 6291 primary records. [2025-09-26T22:27:34.207093] [DEBUG] [LOCAL ] RZB: Saving derivative data. [2025-09-26T22:27:34.228894] [DEBUG] [LOCAL ] RZB: Derivative data saved (1820 records). [2025-09-26T22:27:34.229514] [INFO ] [MAIN ] RZB: Successfully saved derivative data. [2025-09-26T22:27:34.232840] [INFO ] [MAIN ] Derivative Progress: 1600/2074 symbols completed. RZB took 1.1s. Estimated remaining: 3m 17s. Rate: 144.1 symbols/min [2025-09-26T22:27:34.233682] [INFO ] [MAIN ] RZC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:34.250061] [DEBUG] [LOCAL ] RYI: Derivative data saved (1820 records). [2025-09-26T22:27:34.251036] [INFO ] [MAIN ] RYI: Successfully saved derivative data. [2025-09-26T22:27:34.250916] [DEBUG] [MAIN ] RYN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:34.253260] [INFO ] [MAIN ] Derivative Progress: 1601/2074 symbols completed. RYI took 1.2s. Estimated remaining: 3m 17s. Rate: 144.2 symbols/min [2025-09-26T22:27:34.254929] [INFO ] [MAIN ] S: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:34.254502] [INFO ] [MAIN ] RYN: Generated 1820 derivative records from 46335 primary records. [2025-09-26T22:27:34.258117] [DEBUG] [LOCAL ] RYN: Saving derivative data. [2025-09-26T22:27:34.279068] [DEBUG] [LOCAL ] RZC: Loaded 6838 existing records from primary storage. [2025-09-26T22:27:34.281857] [DEBUG] [LOCAL ] RYN: Derivative data saved (1820 records). [2025-09-26T22:27:34.282005] [INFO ] [MAIN ] RZC: Loaded 6838 primary data records. [2025-09-26T22:27:34.282348] [INFO ] [MAIN ] RYN: Successfully saved derivative data. [2025-09-26T22:27:34.292196] [INFO ] [MAIN ] Derivative Progress: 1602/2074 symbols completed. RYN took 1.2s. Estimated remaining: 3m 16s. Rate: 144.3 symbols/min [2025-09-26T22:27:34.328493] [INFO ] [MAIN ] SA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:34.675387] [DEBUG] [LOCAL ] S: Loaded 54315 existing records from primary storage. [2025-09-26T22:27:34.676213] [INFO ] [MAIN ] S: Loaded 54315 primary data records. [2025-09-26T22:27:34.785423] [DEBUG] [LOCAL ] SA: Loaded 43820 existing records from primary storage. [2025-09-26T22:27:34.815553] [INFO ] [MAIN ] SA: Loaded 43820 primary data records. [2025-09-26T22:27:35.291821] [DEBUG] [MAIN ] RZC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:35.479070] [INFO ] [MAIN ] RZC: Generated 1820 derivative records from 6838 primary records. [2025-09-26T22:27:35.490319] [DEBUG] [LOCAL ] RZC: Saving derivative data. [2025-09-26T22:27:35.510673] [DEBUG] [LOCAL ] RZC: Derivative data saved (1820 records). [2025-09-26T22:27:35.510938] [INFO ] [MAIN ] RZC: Successfully saved derivative data. [2025-09-26T22:27:35.514506] [INFO ] [MAIN ] Derivative Progress: 1603/2074 symbols completed. RZC took 1.3s. Estimated remaining: 3m 16s. Rate: 144.1 symbols/min [2025-09-26T22:27:35.542371] [DEBUG] [MAIN ] S: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:35.554748] [DEBUG] [MAIN ] SA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:35.556178] [INFO ] [MAIN ] SA: Generated 1820 derivative records from 43820 primary records. [2025-09-26T22:27:35.556380] [DEBUG] [LOCAL ] SA: Saving derivative data. [2025-09-26T22:27:35.555575] [INFO ] [MAIN ] S: Generated 1820 derivative records from 54315 primary records. [2025-09-26T22:27:35.556809] [DEBUG] [LOCAL ] S: Saving derivative data. [2025-09-26T22:27:35.587197] [DEBUG] [LOCAL ] SA: Derivative data saved (1820 records). [2025-09-26T22:27:35.588780] [INFO ] [MAIN ] SA: Successfully saved derivative data. [2025-09-26T22:27:35.592962] [INFO ] [MAIN ] Derivative Progress: 1604/2074 symbols completed. SA took 1.3s. Estimated remaining: 3m 16s. Rate: 144.2 symbols/min [2025-09-26T22:27:35.596014] [DEBUG] [LOCAL ] S: Derivative data saved (1820 records). [2025-09-26T22:27:35.596124] [INFO ] [MAIN ] S: Successfully saved derivative data. [2025-09-26T22:27:35.598632] [INFO ] [MAIN ] Derivative Progress: 1605/2074 symbols completed. S took 1.3s. Estimated remaining: 3m 15s. Rate: 144.3 symbols/min [2025-09-26T22:27:35.599603] [INFO ] [MAIN ] SAFE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:35.599787] [INFO ] [MAIN ] SABA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:35.599977] [INFO ] [MAIN ] SAH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:35.612890] [DEBUG] [LOCAL ] SABA: Loaded 9306 existing records from primary storage. [2025-09-26T22:27:35.613138] [INFO ] [MAIN ] SABA: Loaded 9306 primary data records. [2025-09-26T22:27:35.792617] [DEBUG] [LOCAL ] SAH: Loaded 22368 existing records from primary storage. [2025-09-26T22:27:35.810784] [INFO ] [MAIN ] SAH: Loaded 22368 primary data records. [2025-09-26T22:27:36.002340] [DEBUG] [LOCAL ] SAFE: Loaded 30819 existing records from primary storage. [2025-09-26T22:27:36.031891] [INFO ] [MAIN ] SAFE: Loaded 30819 primary data records. [2025-09-26T22:27:36.674964] [DEBUG] [MAIN ] SABA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:36.676599] [INFO ] [MAIN ] SABA: Generated 1820 derivative records from 9306 primary records. [2025-09-26T22:27:36.677301] [DEBUG] [LOCAL ] SABA: Saving derivative data. [2025-09-26T22:27:36.700631] [DEBUG] [LOCAL ] SABA: Derivative data saved (1820 records). [2025-09-26T22:27:36.714868] [INFO ] [MAIN ] SABA: Successfully saved derivative data. [2025-09-26T22:27:36.718176] [INFO ] [MAIN ] Derivative Progress: 1606/2074 symbols completed. SABA took 1.1s. Estimated remaining: 3m 15s. Rate: 144.1 symbols/min [2025-09-26T22:27:36.715481] [DEBUG] [MAIN ] SAH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:36.719558] [INFO ] [MAIN ] SAH: Generated 1820 derivative records from 22368 primary records. [2025-09-26T22:27:36.719899] [DEBUG] [LOCAL ] SAH: Saving derivative data. [2025-09-26T22:27:36.720108] [INFO ] [MAIN ] SAM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:36.756979] [DEBUG] [MAIN ] SAFE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:36.764619] [INFO ] [MAIN ] SAFE: Generated 1820 derivative records from 30819 primary records. [2025-09-26T22:27:36.765108] [DEBUG] [LOCAL ] SAFE: Saving derivative data. [2025-09-26T22:27:36.775936] [DEBUG] [LOCAL ] SAH: Derivative data saved (1820 records). [2025-09-26T22:27:36.776301] [INFO ] [MAIN ] SAH: Successfully saved derivative data. [2025-09-26T22:27:36.780306] [INFO ] [MAIN ] Derivative Progress: 1607/2074 symbols completed. SAH took 1.2s. Estimated remaining: 3m 14s. Rate: 144.2 symbols/min [2025-09-26T22:27:36.785898] [INFO ] [MAIN ] SAN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:36.800136] [DEBUG] [LOCAL ] SAFE: Derivative data saved (1820 records). [2025-09-26T22:27:36.801050] [INFO ] [MAIN ] SAFE: Successfully saved derivative data. [2025-09-26T22:27:36.800684] [DEBUG] [LOCAL ] SAM: Loaded 21766 existing records from primary storage. [2025-09-26T22:27:36.803783] [INFO ] [MAIN ] Derivative Progress: 1608/2074 symbols completed. SAFE took 1.2s. Estimated remaining: 3m 14s. Rate: 144.3 symbols/min [2025-09-26T22:27:36.804466] [INFO ] [MAIN ] SAND: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:36.805007] [INFO ] [MAIN ] SAM: Loaded 21766 primary data records. [2025-09-26T22:27:37.207809] [DEBUG] [LOCAL ] SAN: Loaded 53774 existing records from primary storage. [2025-09-26T22:27:37.209560] [INFO ] [MAIN ] SAN: Loaded 53774 primary data records. [2025-09-26T22:27:37.215752] [DEBUG] [LOCAL ] SAND: Loaded 52527 existing records from primary storage. [2025-09-26T22:27:37.216764] [INFO ] [MAIN ] SAND: Loaded 52527 primary data records. [2025-09-26T22:27:37.963620] [DEBUG] [MAIN ] SAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:37.965911] [INFO ] [MAIN ] SAM: Generated 1820 derivative records from 21766 primary records. [2025-09-26T22:27:37.966172] [DEBUG] [LOCAL ] SAM: Saving derivative data. [2025-09-26T22:27:37.992256] [DEBUG] [LOCAL ] SAM: Derivative data saved (1820 records). [2025-09-26T22:27:37.992755] [INFO ] [MAIN ] SAM: Successfully saved derivative data. [2025-09-26T22:27:37.995853] [INFO ] [MAIN ] Derivative Progress: 1609/2074 symbols completed. SAM took 1.3s. Estimated remaining: 3m 14s. Rate: 144.1 symbols/min [2025-09-26T22:27:37.996370] [INFO ] [MAIN ] SAP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:38.022794] [DEBUG] [MAIN ] SAND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:38.024578] [INFO ] [MAIN ] SAND: Generated 1820 derivative records from 52527 primary records. [2025-09-26T22:27:38.024803] [DEBUG] [LOCAL ] SAND: Saving derivative data. [2025-09-26T22:27:38.023795] [DEBUG] [MAIN ] SAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:38.025850] [INFO ] [MAIN ] SAN: Generated 1820 derivative records from 53774 primary records. [2025-09-26T22:27:38.026389] [DEBUG] [LOCAL ] SAN: Saving derivative data. [2025-09-26T22:27:38.054950] [DEBUG] [LOCAL ] SAND: Derivative data saved (1820 records). [2025-09-26T22:27:38.055610] [INFO ] [MAIN ] SAND: Successfully saved derivative data. [2025-09-26T22:27:38.058767] [INFO ] [MAIN ] Derivative Progress: 1610/2074 symbols completed. SAND took 1.3s. Estimated remaining: 3m 13s. Rate: 144.2 symbols/min [2025-09-26T22:27:38.059873] [INFO ] [MAIN ] SAR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:38.065952] [DEBUG] [LOCAL ] SAN: Derivative data saved (1820 records). [2025-09-26T22:27:38.066093] [INFO ] [MAIN ] SAN: Successfully saved derivative data. [2025-09-26T22:27:38.068263] [INFO ] [MAIN ] Derivative Progress: 1611/2074 symbols completed. SAN took 1.3s. Estimated remaining: 3m 13s. Rate: 144.3 symbols/min [2025-09-26T22:27:38.068821] [INFO ] [MAIN ] SARO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:38.082892] [DEBUG] [LOCAL ] SAR: Loaded 16382 existing records from primary storage. [2025-09-26T22:27:38.083144] [INFO ] [MAIN ] SAR: Loaded 16382 primary data records. [2025-09-26T22:27:38.281452] [DEBUG] [LOCAL ] SAP: Loaded 50800 existing records from primary storage. [2025-09-26T22:27:38.326230] [INFO ] [MAIN ] SAP: Loaded 50800 primary data records. [2025-09-26T22:27:38.509526] [DEBUG] [LOCAL ] SARO: Loaded 49425 existing records from primary storage. [2025-09-26T22:27:38.525487] [INFO ] [MAIN ] SARO: Loaded 49425 primary data records. [2025-09-26T22:27:39.185425] [DEBUG] [MAIN ] SAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:39.186597] [INFO ] [MAIN ] SAR: Generated 1820 derivative records from 16382 primary records. [2025-09-26T22:27:39.186929] [DEBUG] [LOCAL ] SAR: Saving derivative data. [2025-09-26T22:27:39.210317] [DEBUG] [LOCAL ] SAR: Derivative data saved (1820 records). [2025-09-26T22:27:39.211815] [INFO ] [MAIN ] SAR: Successfully saved derivative data. [2025-09-26T22:27:39.216013] [INFO ] [MAIN ] Derivative Progress: 1612/2074 symbols completed. SAR took 1.2s. Estimated remaining: 3m 12s. Rate: 144.1 symbols/min [2025-09-26T22:27:39.218510] [INFO ] [MAIN ] SB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:39.250382] [DEBUG] [MAIN ] SAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:39.251062] [DEBUG] [MAIN ] SARO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:39.252123] [INFO ] [MAIN ] SAP: Generated 1820 derivative records from 50800 primary records. [2025-09-26T22:27:39.253101] [DEBUG] [LOCAL ] SAP: Saving derivative data. [2025-09-26T22:27:39.253020] [INFO ] [MAIN ] SARO: Generated 1820 derivative records from 49425 primary records. [2025-09-26T22:27:39.254117] [DEBUG] [LOCAL ] SARO: Saving derivative data. [2025-09-26T22:27:39.289875] [DEBUG] [LOCAL ] SARO: Derivative data saved (1820 records). [2025-09-26T22:27:39.298791] [INFO ] [MAIN ] SARO: Successfully saved derivative data. [2025-09-26T22:27:39.301998] [INFO ] [MAIN ] Derivative Progress: 1613/2074 symbols completed. SARO took 1.2s. Estimated remaining: 3m 12s. Rate: 144.2 symbols/min [2025-09-26T22:27:39.302931] [INFO ] [MAIN ] SBH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:39.303553] [DEBUG] [LOCAL ] SAP: Derivative data saved (1820 records). [2025-09-26T22:27:39.304278] [INFO ] [MAIN ] SAP: Successfully saved derivative data. [2025-09-26T22:27:39.307002] [INFO ] [MAIN ] Derivative Progress: 1614/2074 symbols completed. SAP took 1.3s. Estimated remaining: 3m 11s. Rate: 144.3 symbols/min [2025-09-26T22:27:39.307631] [INFO ] [MAIN ] SBI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:39.322613] [DEBUG] [LOCAL ] SB: Loaded 33735 existing records from primary storage. [2025-09-26T22:27:39.325108] [INFO ] [MAIN ] SB: Loaded 33735 primary data records. [2025-09-26T22:27:39.369530] [DEBUG] [LOCAL ] SBI: Loaded 7848 existing records from primary storage. [2025-09-26T22:27:39.385815] [INFO ] [MAIN ] SBI: Loaded 7848 primary data records. [2025-09-26T22:27:39.656967] [DEBUG] [LOCAL ] SBH: Loaded 50565 existing records from primary storage. [2025-09-26T22:27:39.690507] [INFO ] [MAIN ] SBH: Loaded 50565 primary data records. [2025-09-26T22:27:40.491230] [DEBUG] [MAIN ] SBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:40.490933] [DEBUG] [MAIN ] SB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:40.492147] [INFO ] [MAIN ] SBI: Generated 1820 derivative records from 7848 primary records. [2025-09-26T22:27:40.492980] [INFO ] [MAIN ] SB: Generated 1820 derivative records from 33735 primary records. [2025-09-26T22:27:40.492244] [DEBUG] [LOCAL ] SBI: Saving derivative data. [2025-09-26T22:27:40.494092] [DEBUG] [LOCAL ] SB: Saving derivative data. [2025-09-26T22:27:40.520908] [DEBUG] [LOCAL ] SBI: Derivative data saved (1820 records). [2025-09-26T22:27:40.525314] [DEBUG] [LOCAL ] SB: Derivative data saved (1820 records). [2025-09-26T22:27:40.525787] [INFO ] [MAIN ] SB: Successfully saved derivative data. [2025-09-26T22:27:40.525684] [INFO ] [MAIN ] SBI: Successfully saved derivative data. [2025-09-26T22:27:40.528492] [INFO ] [MAIN ] Derivative Progress: 1615/2074 symbols completed. SBI took 1.2s. Estimated remaining: 3m 11s. Rate: 144.1 symbols/min [2025-09-26T22:27:40.531399] [INFO ] [MAIN ] Derivative Progress: 1616/2074 symbols completed. SB took 1.3s. Estimated remaining: 3m 11s. Rate: 144.2 symbols/min [2025-09-26T22:27:40.532072] [INFO ] [MAIN ] SBS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:40.532012] [INFO ] [MAIN ] SBR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:40.551559] [DEBUG] [MAIN ] SBH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:40.552482] [INFO ] [MAIN ] SBH: Generated 1820 derivative records from 50565 primary records. [2025-09-26T22:27:40.555897] [DEBUG] [LOCAL ] SBH: Saving derivative data. [2025-09-26T22:27:40.556119] [DEBUG] [LOCAL ] SBR: Loaded 7350 existing records from primary storage. [2025-09-26T22:27:40.556991] [INFO ] [MAIN ] SBR: Loaded 7350 primary data records. [2025-09-26T22:27:40.782680] [DEBUG] [LOCAL ] SBH: Derivative data saved (1820 records). [2025-09-26T22:27:40.782867] [INFO ] [MAIN ] SBH: Successfully saved derivative data. [2025-09-26T22:27:40.905873] [INFO ] [MAIN ] Derivative Progress: 1617/2074 symbols completed. SBH took 1.6s. Estimated remaining: 3m 10s. Rate: 144.2 symbols/min [2025-09-26T22:27:40.921999] [INFO ] [MAIN ] SBSI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:40.923344] [DEBUG] [LOCAL ] SBS: Loaded 50166 existing records from primary storage. [2025-09-26T22:27:40.923589] [INFO ] [MAIN ] SBS: Loaded 50166 primary data records. [2025-09-26T22:27:41.055526] [DEBUG] [LOCAL ] SBSI: Loaded 14974 existing records from primary storage. [2025-09-26T22:27:41.072819] [INFO ] [MAIN ] SBSI: Loaded 14974 primary data records. [2025-09-26T22:27:41.672261] [DEBUG] [MAIN ] SBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:41.673182] [INFO ] [MAIN ] SBR: Generated 1820 derivative records from 7350 primary records. [2025-09-26T22:27:41.673433] [DEBUG] [LOCAL ] SBR: Saving derivative data. [2025-09-26T22:27:41.692700] [DEBUG] [LOCAL ] SBR: Derivative data saved (1820 records). [2025-09-26T22:27:41.693899] [INFO ] [MAIN ] SBR: Successfully saved derivative data. [2025-09-26T22:27:41.696694] [INFO ] [MAIN ] Derivative Progress: 1618/2074 symbols completed. SBR took 1.2s. Estimated remaining: 3m 10s. Rate: 144.1 symbols/min [2025-09-26T22:27:41.719350] [DEBUG] [MAIN ] SBS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:41.720593] [INFO ] [MAIN ] SBS: Generated 1820 derivative records from 50166 primary records. [2025-09-26T22:27:41.721174] [DEBUG] [LOCAL ] SBS: Saving derivative data. [2025-09-26T22:27:41.745225] [DEBUG] [LOCAL ] SBS: Derivative data saved (1820 records). [2025-09-26T22:27:41.745603] [INFO ] [MAIN ] SBS: Successfully saved derivative data. [2025-09-26T22:27:41.748251] [INFO ] [MAIN ] Derivative Progress: 1619/2074 symbols completed. SBS took 1.2s. Estimated remaining: 3m 9s. Rate: 144.2 symbols/min [2025-09-26T22:27:41.761862] [DEBUG] [MAIN ] SBSI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:41.762465] [INFO ] [MAIN ] SBSI: Generated 1820 derivative records from 14974 primary records. [2025-09-26T22:27:41.762595] [DEBUG] [LOCAL ] SBSI: Saving derivative data. [2025-09-26T22:27:41.780324] [DEBUG] [LOCAL ] SBSI: Derivative data saved (1820 records). [2025-09-26T22:27:41.780421] [INFO ] [MAIN ] SBSI: Successfully saved derivative data. [2025-09-26T22:27:41.783025] [INFO ] [MAIN ] Derivative Progress: 1620/2074 symbols completed. SBSI took 0.9s. Estimated remaining: 3m 9s. Rate: 144.3 symbols/min [2025-09-26T22:27:41.783741] [INFO ] [MAIN ] SCD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:41.783635] [INFO ] [MAIN ] SBSW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:41.783945] [INFO ] [MAIN ] SCCO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:41.812995] [DEBUG] [LOCAL ] SCD: Loaded 12749 existing records from primary storage. [2025-09-26T22:27:41.813184] [INFO ] [MAIN ] SCD: Loaded 12749 primary data records. [2025-09-26T22:27:42.063965] [DEBUG] [LOCAL ] SBSW: Loaded 53745 existing records from primary storage. [2025-09-26T22:27:42.089477] [INFO ] [MAIN ] SBSW: Loaded 53745 primary data records. [2025-09-26T22:27:42.210137] [DEBUG] [LOCAL ] SCCO: Loaded 50148 existing records from primary storage. [2025-09-26T22:27:42.256319] [INFO ] [MAIN ] SCCO: Loaded 50148 primary data records. [2025-09-26T22:27:42.932667] [DEBUG] [MAIN ] SCD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:42.934028] [INFO ] [MAIN ] SCD: Generated 1820 derivative records from 12749 primary records. [2025-09-26T22:27:42.934418] [DEBUG] [LOCAL ] SCD: Saving derivative data. [2025-09-26T22:27:42.958257] [DEBUG] [LOCAL ] SCD: Derivative data saved (1820 records). [2025-09-26T22:27:42.971408] [INFO ] [MAIN ] SCD: Successfully saved derivative data. [2025-09-26T22:27:42.971876] [DEBUG] [MAIN ] SBSW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:42.975014] [INFO ] [MAIN ] Derivative Progress: 1621/2074 symbols completed. SCD took 1.2s. Estimated remaining: 3m 9s. Rate: 144.1 symbols/min [2025-09-26T22:27:42.975591] [INFO ] [MAIN ] SCHW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:42.976799] [INFO ] [MAIN ] SBSW: Generated 1820 derivative records from 53745 primary records. [2025-09-26T22:27:42.977274] [DEBUG] [LOCAL ] SBSW: Saving derivative data. [2025-09-26T22:27:43.009149] [DEBUG] [MAIN ] SCCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:43.010798] [INFO ] [MAIN ] SCCO: Generated 1820 derivative records from 50148 primary records. [2025-09-26T22:27:43.011222] [DEBUG] [LOCAL ] SCCO: Saving derivative data. [2025-09-26T22:27:43.013775] [DEBUG] [LOCAL ] SBSW: Derivative data saved (1820 records). [2025-09-26T22:27:43.013915] [INFO ] [MAIN ] SBSW: Successfully saved derivative data. [2025-09-26T22:27:43.016468] [INFO ] [MAIN ] Derivative Progress: 1622/2074 symbols completed. SBSW took 1.2s. Estimated remaining: 3m 8s. Rate: 144.2 symbols/min [2025-09-26T22:27:43.024926] [INFO ] [MAIN ] SCI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:43.034993] [DEBUG] [LOCAL ] SCCO: Derivative data saved (1820 records). [2025-09-26T22:27:43.035192] [INFO ] [MAIN ] SCCO: Successfully saved derivative data. [2025-09-26T22:27:43.037992] [INFO ] [MAIN ] Derivative Progress: 1623/2074 symbols completed. SCCO took 1.3s. Estimated remaining: 3m 8s. Rate: 144.3 symbols/min [2025-09-26T22:27:43.038429] [INFO ] [MAIN ] SCL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:43.070811] [DEBUG] [LOCAL ] SCL: Loaded 15113 existing records from primary storage. [2025-09-26T22:27:43.070997] [INFO ] [MAIN ] SCL: Loaded 15113 primary data records. [2025-09-26T22:27:43.192281] [DEBUG] [LOCAL ] SCHW: Loaded 54465 existing records from primary storage. [2025-09-26T22:27:43.225402] [INFO ] [MAIN ] SCHW: Loaded 54465 primary data records. [2025-09-26T22:27:43.376816] [DEBUG] [LOCAL ] SCI: Loaded 47257 existing records from primary storage. [2025-09-26T22:27:43.458921] [INFO ] [MAIN ] SCI: Loaded 47257 primary data records. [2025-09-26T22:27:44.257841] [DEBUG] [MAIN ] SCL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:44.260061] [INFO ] [MAIN ] SCL: Generated 1820 derivative records from 15113 primary records. [2025-09-26T22:27:44.260499] [DEBUG] [LOCAL ] SCL: Saving derivative data. [2025-09-26T22:27:44.280447] [DEBUG] [LOCAL ] SCL: Derivative data saved (1820 records). [2025-09-26T22:27:44.280637] [INFO ] [MAIN ] SCL: Successfully saved derivative data. [2025-09-26T22:27:44.283099] [INFO ] [MAIN ] Derivative Progress: 1624/2074 symbols completed. SCL took 1.2s. Estimated remaining: 3m 7s. Rate: 144.1 symbols/min [2025-09-26T22:27:44.284067] [INFO ] [MAIN ] SCM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:44.302344] [DEBUG] [MAIN ] SCHW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:44.303230] [INFO ] [MAIN ] SCHW: Generated 1820 derivative records from 54465 primary records. [2025-09-26T22:27:44.303452] [DEBUG] [LOCAL ] SCHW: Saving derivative data. [2025-09-26T22:27:44.325240] [DEBUG] [LOCAL ] SCHW: Derivative data saved (1820 records). [2025-09-26T22:27:44.326630] [INFO ] [MAIN ] SCHW: Successfully saved derivative data. [2025-09-26T22:27:44.331984] [INFO ] [MAIN ] Derivative Progress: 1625/2074 symbols completed. SCHW took 1.4s. Estimated remaining: 3m 7s. Rate: 144.2 symbols/min [2025-09-26T22:27:44.332590] [INFO ] [MAIN ] SCS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:44.352252] [DEBUG] [MAIN ] SCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:44.353162] [INFO ] [MAIN ] SCI: Generated 1820 derivative records from 47257 primary records. [2025-09-26T22:27:44.353331] [DEBUG] [LOCAL ] SCI: Saving derivative data. [2025-09-26T22:27:44.378061] [DEBUG] [LOCAL ] SCM: Loaded 20163 existing records from primary storage. [2025-09-26T22:27:44.377471] [DEBUG] [LOCAL ] SCI: Derivative data saved (1820 records). [2025-09-26T22:27:44.378232] [INFO ] [MAIN ] SCI: Successfully saved derivative data. [2025-09-26T22:27:44.381374] [INFO ] [MAIN ] SCM: Loaded 20163 primary data records. [2025-09-26T22:27:44.381183] [INFO ] [MAIN ] Derivative Progress: 1626/2074 symbols completed. SCI took 1.4s. Estimated remaining: 3m 6s. Rate: 144.2 symbols/min [2025-09-26T22:27:44.381780] [INFO ] [MAIN ] SD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:44.651855] [DEBUG] [LOCAL ] SD: Loaded 29368 existing records from primary storage. [2025-09-26T22:27:44.653413] [DEBUG] [LOCAL ] SCS: Loaded 43834 existing records from primary storage. [2025-09-26T22:27:44.653771] [INFO ] [MAIN ] SD: Loaded 29368 primary data records. [2025-09-26T22:27:44.654027] [INFO ] [MAIN ] SCS: Loaded 43834 primary data records. [2025-09-26T22:27:45.457780] [DEBUG] [MAIN ] SCM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:45.458774] [INFO ] [MAIN ] SCM: Generated 1820 derivative records from 20163 primary records. [2025-09-26T22:27:45.460085] [DEBUG] [LOCAL ] SCM: Saving derivative data. [2025-09-26T22:27:45.482391] [DEBUG] [LOCAL ] SCM: Derivative data saved (1820 records). [2025-09-26T22:27:45.482730] [INFO ] [MAIN ] SCM: Successfully saved derivative data. [2025-09-26T22:27:45.487203] [INFO ] [MAIN ] Derivative Progress: 1627/2074 symbols completed. SCM took 1.2s. Estimated remaining: 3m 6s. Rate: 144.1 symbols/min [2025-09-26T22:27:45.491063] [INFO ] [MAIN ] SDHC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:45.518699] [DEBUG] [MAIN ] SD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:45.520235] [INFO ] [MAIN ] SD: Generated 1820 derivative records from 29368 primary records. [2025-09-26T22:27:45.519055] [DEBUG] [MAIN ] SCS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:45.521353] [INFO ] [MAIN ] SCS: Generated 1820 derivative records from 43834 primary records. [2025-09-26T22:27:45.521514] [DEBUG] [LOCAL ] SCS: Saving derivative data. [2025-09-26T22:27:45.520543] [DEBUG] [LOCAL ] SD: Saving derivative data. [2025-09-26T22:27:45.543376] [DEBUG] [LOCAL ] SCS: Derivative data saved (1820 records). [2025-09-26T22:27:45.548324] [INFO ] [MAIN ] SCS: Successfully saved derivative data. [2025-09-26T22:27:45.559338] [DEBUG] [LOCAL ] SDHC: Loaded 10686 existing records from primary storage. [2025-09-26T22:27:45.558763] [INFO ] [MAIN ] Derivative Progress: 1628/2074 symbols completed. SCS took 1.2s. Estimated remaining: 3m 6s. Rate: 144.2 symbols/min [2025-09-26T22:27:45.563812] [INFO ] [MAIN ] SDHC: Loaded 10686 primary data records. [2025-09-26T22:27:45.564594] [INFO ] [MAIN ] SDHY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:45.697182] [DEBUG] [LOCAL ] SD: Derivative data saved (1820 records). [2025-09-26T22:27:45.697706] [INFO ] [MAIN ] SD: Successfully saved derivative data. [2025-09-26T22:27:45.701221] [INFO ] [MAIN ] Derivative Progress: 1629/2074 symbols completed. SD took 1.3s. Estimated remaining: 3m 5s. Rate: 144.2 symbols/min [2025-09-26T22:27:45.697858] [DEBUG] [LOCAL ] SDHY: Loaded 10710 existing records from primary storage. [2025-09-26T22:27:45.707393] [INFO ] [MAIN ] SDRL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:45.712636] [INFO ] [MAIN ] SDHY: Loaded 10710 primary data records. [2025-09-26T22:27:46.317044] [DEBUG] [LOCAL ] SDRL: Loaded 42459 existing records from primary storage. [2025-09-26T22:27:46.318934] [INFO ] [MAIN ] SDRL: Loaded 42459 primary data records. [2025-09-26T22:27:46.377101] [DEBUG] [MAIN ] SDHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:46.390912] [INFO ] [MAIN ] SDHC: Generated 1820 derivative records from 10686 primary records. [2025-09-26T22:27:46.391517] [DEBUG] [LOCAL ] SDHC: Saving derivative data. [2025-09-26T22:27:46.468786] [DEBUG] [LOCAL ] SDHC: Derivative data saved (1820 records). [2025-09-26T22:27:46.469274] [INFO ] [MAIN ] SDHC: Successfully saved derivative data. [2025-09-26T22:27:46.471718] [INFO ] [MAIN ] Derivative Progress: 1630/2074 symbols completed. SDHC took 1.0s. Estimated remaining: 3m 5s. Rate: 144.2 symbols/min [2025-09-26T22:27:46.478040] [INFO ] [MAIN ] SEE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:46.696116] [DEBUG] [MAIN ] SDHY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:46.697033] [INFO ] [MAIN ] SDHY: Generated 1820 derivative records from 10710 primary records. [2025-09-26T22:27:46.697182] [DEBUG] [LOCAL ] SDHY: Saving derivative data. [2025-09-26T22:27:46.715479] [DEBUG] [LOCAL ] SDHY: Derivative data saved (1820 records). [2025-09-26T22:27:46.716207] [INFO ] [MAIN ] SDHY: Successfully saved derivative data. [2025-09-26T22:27:46.720019] [INFO ] [MAIN ] Derivative Progress: 1631/2074 symbols completed. SDHY took 1.2s. Estimated remaining: 3m 4s. Rate: 144.2 symbols/min [2025-09-26T22:27:46.720942] [INFO ] [MAIN ] SEG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:46.747847] [DEBUG] [LOCAL ] SEG: Loaded 13887 existing records from primary storage. [2025-09-26T22:27:46.748307] [INFO ] [MAIN ] SEG: Loaded 13887 primary data records. [2025-09-26T22:27:46.891938] [DEBUG] [LOCAL ] SEE: Loaded 49069 existing records from primary storage. [2025-09-26T22:27:46.908732] [DEBUG] [MAIN ] SDRL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:46.909621] [INFO ] [MAIN ] SDRL: Generated 1820 derivative records from 42459 primary records. [2025-09-26T22:27:46.908845] [INFO ] [MAIN ] SEE: Loaded 49069 primary data records. [2025-09-26T22:27:46.909734] [DEBUG] [LOCAL ] SDRL: Saving derivative data. [2025-09-26T22:27:47.294774] [DEBUG] [LOCAL ] SDRL: Derivative data saved (1820 records). [2025-09-26T22:27:47.330334] [INFO ] [MAIN ] SDRL: Successfully saved derivative data. [2025-09-26T22:27:47.421933] [INFO ] [MAIN ] Derivative Progress: 1632/2074 symbols completed. SDRL took 1.7s. Estimated remaining: 3m 4s. Rate: 144.1 symbols/min [2025-09-26T22:27:47.441120] [INFO ] [MAIN ] SEI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:47.479503] [DEBUG] [MAIN ] SEG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:47.480498] [INFO ] [MAIN ] SEG: Generated 1820 derivative records from 13887 primary records. [2025-09-26T22:27:47.480696] [DEBUG] [LOCAL ] SEG: Saving derivative data. [2025-09-26T22:27:47.498748] [DEBUG] [LOCAL ] SEG: Derivative data saved (1820 records). [2025-09-26T22:27:47.499064] [INFO ] [MAIN ] SEG: Successfully saved derivative data. [2025-09-26T22:27:47.501674] [INFO ] [MAIN ] Derivative Progress: 1633/2074 symbols completed. SEG took 0.8s. Estimated remaining: 3m 3s. Rate: 144.2 symbols/min [2025-09-26T22:27:47.531886] [DEBUG] [MAIN ] SEE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:47.532561] [INFO ] [MAIN ] SEE: Generated 1820 derivative records from 49069 primary records. [2025-09-26T22:27:47.532626] [DEBUG] [LOCAL ] SEE: Saving derivative data. [2025-09-26T22:27:47.560287] [DEBUG] [LOCAL ] SEI: Loaded 50411 existing records from primary storage. [2025-09-26T22:27:47.560876] [INFO ] [MAIN ] SEI: Loaded 50411 primary data records. [2025-09-26T22:27:47.667232] [DEBUG] [LOCAL ] SEE: Derivative data saved (1820 records). [2025-09-26T22:27:47.679000] [INFO ] [MAIN ] SEE: Successfully saved derivative data. [2025-09-26T22:27:47.681843] [INFO ] [MAIN ] Derivative Progress: 1634/2074 symbols completed. SEE took 1.2s. Estimated remaining: 3m 3s. Rate: 144.3 symbols/min [2025-09-26T22:27:47.906624] [DEBUG] [MAIN ] SEI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:47.907761] [INFO ] [MAIN ] SEI: Generated 1820 derivative records from 50411 primary records. [2025-09-26T22:27:47.907830] [DEBUG] [LOCAL ] SEI: Saving derivative data. [2025-09-26T22:27:47.924867] [DEBUG] [LOCAL ] SEI: Derivative data saved (1820 records). [2025-09-26T22:27:47.924950] [INFO ] [MAIN ] SEI: Successfully saved derivative data. [2025-09-26T22:27:47.927942] [INFO ] [MAIN ] Derivative Progress: 1635/2074 symbols completed. SEI took 0.5s. Estimated remaining: 3m 3s. Rate: 144.3 symbols/min [2025-09-26T22:27:47.928926] [INFO ] [MAIN ] SEM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:47.929296] [INFO ] [MAIN ] SEMR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:47.930341] [INFO ] [MAIN ] SES: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:48.011523] [DEBUG] [LOCAL ] SEMR: Loaded 42184 existing records from primary storage. [2025-09-26T22:27:48.028350] [DEBUG] [LOCAL ] SEM: Loaded 43533 existing records from primary storage. [2025-09-26T22:27:48.028543] [INFO ] [MAIN ] SEM: Loaded 43533 primary data records. [2025-09-26T22:27:48.026921] [INFO ] [MAIN ] SEMR: Loaded 42184 primary data records. [2025-09-26T22:27:48.037280] [DEBUG] [LOCAL ] SES: Loaded 52331 existing records from primary storage. [2025-09-26T22:27:48.042541] [INFO ] [MAIN ] SES: Loaded 52331 primary data records. [2025-09-26T22:27:49.102312] [DEBUG] [MAIN ] SES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:49.104727] [INFO ] [MAIN ] SES: Generated 1820 derivative records from 52331 primary records. [2025-09-26T22:27:49.102612] [DEBUG] [MAIN ] SEMR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:49.106386] [DEBUG] [LOCAL ] SES: Saving derivative data. [2025-09-26T22:27:49.107238] [INFO ] [MAIN ] SEMR: Generated 1820 derivative records from 42184 primary records. [2025-09-26T22:27:49.115769] [DEBUG] [LOCAL ] SEMR: Saving derivative data. [2025-09-26T22:27:49.144565] [DEBUG] [LOCAL ] SES: Derivative data saved (1820 records). [2025-09-26T22:27:49.149794] [INFO ] [MAIN ] SES: Successfully saved derivative data. [2025-09-26T22:27:49.155406] [INFO ] [MAIN ] Derivative Progress: 1636/2074 symbols completed. SES took 1.2s. Estimated remaining: 3m 2s. Rate: 144.1 symbols/min [2025-09-26T22:27:49.152847] [DEBUG] [LOCAL ] SEMR: Derivative data saved (1820 records). [2025-09-26T22:27:49.155567] [INFO ] [MAIN ] SEMR: Successfully saved derivative data. [2025-09-26T22:27:49.145913] [DEBUG] [MAIN ] SEM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:49.156890] [INFO ] [MAIN ] SEM: Generated 1820 derivative records from 43533 primary records. [2025-09-26T22:27:49.156049] [INFO ] [MAIN ] SF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:49.157105] [DEBUG] [LOCAL ] SEM: Saving derivative data. [2025-09-26T22:27:49.159590] [INFO ] [MAIN ] Derivative Progress: 1637/2074 symbols completed. SEMR took 1.2s. Estimated remaining: 3m 2s. Rate: 144.2 symbols/min [2025-09-26T22:27:49.161665] [INFO ] [MAIN ] SFB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:49.180815] [DEBUG] [LOCAL ] SFB: Loaded 4046 existing records from primary storage. [2025-09-26T22:27:49.181729] [INFO ] [MAIN ] SFB: Loaded 4046 primary data records. [2025-09-26T22:27:49.234496] [DEBUG] [LOCAL ] SEM: Derivative data saved (1820 records). [2025-09-26T22:27:49.249079] [INFO ] [MAIN ] SEM: Successfully saved derivative data. [2025-09-26T22:27:49.280628] [INFO ] [MAIN ] Derivative Progress: 1638/2074 symbols completed. SEM took 1.4s. Estimated remaining: 3m 1s. Rate: 144.3 symbols/min [2025-09-26T22:27:49.291399] [INFO ] [MAIN ] SFBS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:49.541594] [DEBUG] [LOCAL ] SF: Loaded 42360 existing records from primary storage. [2025-09-26T22:27:49.541818] [INFO ] [MAIN ] SF: Loaded 42360 primary data records. [2025-09-26T22:27:49.612055] [DEBUG] [LOCAL ] SFBS: Loaded 21483 existing records from primary storage. [2025-09-26T22:27:49.627525] [INFO ] [MAIN ] SFBS: Loaded 21483 primary data records. [2025-09-26T22:27:50.284957] [DEBUG] [MAIN ] SFB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:50.287863] [INFO ] [MAIN ] SFB: Generated 1820 derivative records from 4046 primary records. [2025-09-26T22:27:50.288354] [DEBUG] [LOCAL ] SFB: Saving derivative data. [2025-09-26T22:27:50.304869] [DEBUG] [LOCAL ] SFB: Derivative data saved (1820 records). [2025-09-26T22:27:50.305003] [INFO ] [MAIN ] SFB: Successfully saved derivative data. [2025-09-26T22:27:50.307039] [INFO ] [MAIN ] Derivative Progress: 1639/2074 symbols completed. SFB took 1.1s. Estimated remaining: 3m 1s. Rate: 144.1 symbols/min [2025-09-26T22:27:50.307881] [INFO ] [MAIN ] SFL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:50.328199] [DEBUG] [MAIN ] SF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:50.329214] [INFO ] [MAIN ] SF: Generated 1820 derivative records from 42360 primary records. [2025-09-26T22:27:50.329428] [DEBUG] [LOCAL ] SF: Saving derivative data. [2025-09-26T22:27:50.347904] [DEBUG] [LOCAL ] SF: Derivative data saved (1820 records). [2025-09-26T22:27:50.349965] [INFO ] [MAIN ] SF: Successfully saved derivative data. [2025-09-26T22:27:50.352405] [INFO ] [MAIN ] Derivative Progress: 1640/2074 symbols completed. SF took 1.2s. Estimated remaining: 3m 1s. Rate: 144.2 symbols/min [2025-09-26T22:27:50.352955] [INFO ] [MAIN ] SG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:50.366957] [DEBUG] [MAIN ] SFBS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:50.367909] [INFO ] [MAIN ] SFBS: Generated 1820 derivative records from 21483 primary records. [2025-09-26T22:27:50.368102] [DEBUG] [LOCAL ] SFBS: Saving derivative data. [2025-09-26T22:27:50.412408] [DEBUG] [LOCAL ] SFBS: Derivative data saved (1820 records). [2025-09-26T22:27:50.413722] [DEBUG] [LOCAL ] SFL: Loaded 46026 existing records from primary storage. [2025-09-26T22:27:50.414033] [INFO ] [MAIN ] SFBS: Successfully saved derivative data. [2025-09-26T22:27:50.414150] [INFO ] [MAIN ] SFL: Loaded 46026 primary data records. [2025-09-26T22:27:50.423300] [INFO ] [MAIN ] Derivative Progress: 1641/2074 symbols completed. SFBS took 1.1s. Estimated remaining: 3m 0s. Rate: 144.3 symbols/min [2025-09-26T22:27:50.456525] [INFO ] [MAIN ] SGHC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:50.760860] [DEBUG] [LOCAL ] SG: Loaded 54227 existing records from primary storage. [2025-09-26T22:27:50.761906] [INFO ] [MAIN ] SG: Loaded 54227 primary data records. [2025-09-26T22:27:50.955938] [DEBUG] [LOCAL ] SGHC: Loaded 46435 existing records from primary storage. [2025-09-26T22:27:50.992835] [INFO ] [MAIN ] SGHC: Loaded 46435 primary data records. [2025-09-26T22:27:51.331542] [DEBUG] [MAIN ] SFL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:51.332802] [INFO ] [MAIN ] SFL: Generated 1820 derivative records from 46026 primary records. [2025-09-26T22:27:51.332915] [DEBUG] [LOCAL ] SFL: Saving derivative data. [2025-09-26T22:27:51.477763] [DEBUG] [LOCAL ] SFL: Derivative data saved (1820 records). [2025-09-26T22:27:51.478315] [INFO ] [MAIN ] SFL: Successfully saved derivative data. [2025-09-26T22:27:51.480547] [INFO ] [MAIN ] Derivative Progress: 1642/2074 symbols completed. SFL took 1.2s. Estimated remaining: 2m 60s. Rate: 144.2 symbols/min [2025-09-26T22:27:51.481630] [INFO ] [MAIN ] SGU: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:51.504679] [DEBUG] [MAIN ] SG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:51.505691] [INFO ] [MAIN ] SG: Generated 1820 derivative records from 54227 primary records. [2025-09-26T22:27:51.506466] [DEBUG] [LOCAL ] SG: Saving derivative data. [2025-09-26T22:27:51.511043] [DEBUG] [LOCAL ] SGU: Loaded 6765 existing records from primary storage. [2025-09-26T22:27:51.512456] [INFO ] [MAIN ] SGU: Loaded 6765 primary data records. [2025-09-26T22:27:51.620014] [DEBUG] [LOCAL ] SG: Derivative data saved (1820 records). [2025-09-26T22:27:51.662236] [INFO ] [MAIN ] SG: Successfully saved derivative data. [2025-09-26T22:27:51.668436] [INFO ] [MAIN ] Derivative Progress: 1643/2074 symbols completed. SG took 1.3s. Estimated remaining: 2m 59s. Rate: 144.2 symbols/min [2025-09-26T22:27:51.670122] [INFO ] [MAIN ] SHAK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:51.746457] [DEBUG] [MAIN ] SGHC: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:27:51.785587] [INFO ] [MAIN ] SGHC: Generated 1819 derivative records from 46435 primary records. [2025-09-26T22:27:51.892372] [DEBUG] [LOCAL ] SGHC: Saving derivative data. [2025-09-26T22:27:51.914177] [DEBUG] [LOCAL ] SGHC: Derivative data saved (1819 records). [2025-09-26T22:27:51.924941] [INFO ] [MAIN ] SGHC: Successfully saved derivative data. [2025-09-26T22:27:51.927610] [INFO ] [MAIN ] Derivative Progress: 1644/2074 symbols completed. SGHC took 1.5s. Estimated remaining: 2m 59s. Rate: 144.2 symbols/min [2025-09-26T22:27:51.929302] [INFO ] [MAIN ] SHCO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:51.970993] [DEBUG] [LOCAL ] SHAK: Loaded 49831 existing records from primary storage. [2025-09-26T22:27:51.976595] [INFO ] [MAIN ] SHAK: Loaded 49831 primary data records. [2025-09-26T22:27:51.976519] [DEBUG] [MAIN ] SGU: Filtered 7001 bins outside market hours, 7799 incomplete bins [2025-09-26T22:27:51.982768] [INFO ] [MAIN ] SGU: Generated 1815 derivative records from 6765 primary records. [2025-09-26T22:27:51.982920] [DEBUG] [LOCAL ] SGU: Saving derivative data. [2025-09-26T22:27:52.031931] [DEBUG] [LOCAL ] SHCO: Loaded 26427 existing records from primary storage. [2025-09-26T22:27:52.045238] [INFO ] [MAIN ] SHCO: Loaded 26427 primary data records. [2025-09-26T22:27:52.320364] [DEBUG] [LOCAL ] SGU: Derivative data saved (1815 records). [2025-09-26T22:27:52.347168] [INFO ] [MAIN ] SGU: Successfully saved derivative data. [2025-09-26T22:27:52.387446] [INFO ] [MAIN ] Derivative Progress: 1645/2074 symbols completed. SGU took 0.9s. Estimated remaining: 2m 58s. Rate: 144.2 symbols/min [2025-09-26T22:27:52.515295] [INFO ] [MAIN ] SHEL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:52.716024] [DEBUG] [MAIN ] SHAK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:52.717466] [INFO ] [MAIN ] SHAK: Generated 1820 derivative records from 49831 primary records. [2025-09-26T22:27:52.717805] [DEBUG] [LOCAL ] SHAK: Saving derivative data. [2025-09-26T22:27:52.752921] [DEBUG] [LOCAL ] SHAK: Derivative data saved (1820 records). [2025-09-26T22:27:52.753317] [INFO ] [MAIN ] SHAK: Successfully saved derivative data. [2025-09-26T22:27:52.755765] [INFO ] [MAIN ] Derivative Progress: 1646/2074 symbols completed. SHAK took 1.1s. Estimated remaining: 2m 58s. Rate: 144.2 symbols/min [2025-09-26T22:27:52.764012] [INFO ] [MAIN ] SHG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:52.770824] [DEBUG] [MAIN ] SHCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:52.771844] [INFO ] [MAIN ] SHCO: Generated 1820 derivative records from 26427 primary records. [2025-09-26T22:27:52.771979] [DEBUG] [LOCAL ] SHCO: Saving derivative data. [2025-09-26T22:27:52.800804] [DEBUG] [LOCAL ] SHEL: Loaded 54451 existing records from primary storage. [2025-09-26T22:27:52.802282] [INFO ] [MAIN ] SHEL: Loaded 54451 primary data records. [2025-09-26T22:27:52.921884] [DEBUG] [LOCAL ] SHCO: Derivative data saved (1820 records). [2025-09-26T22:27:52.939498] [INFO ] [MAIN ] SHCO: Successfully saved derivative data. [2025-09-26T22:27:52.942215] [INFO ] [MAIN ] Derivative Progress: 1647/2074 symbols completed. SHCO took 1.0s. Estimated remaining: 2m 58s. Rate: 144.3 symbols/min [2025-09-26T22:27:52.943196] [DEBUG] [LOCAL ] SHG: Loaded 27307 existing records from primary storage. [2025-09-26T22:27:52.959515] [INFO ] [MAIN ] SHO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:52.959699] [INFO ] [MAIN ] SHG: Loaded 27307 primary data records. [2025-09-26T22:27:53.518431] [DEBUG] [LOCAL ] SHO: Loaded 50552 existing records from primary storage. [2025-09-26T22:27:53.518936] [INFO ] [MAIN ] SHO: Loaded 50552 primary data records. [2025-09-26T22:27:53.654882] [DEBUG] [MAIN ] SHEL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:53.675849] [INFO ] [MAIN ] SHEL: Generated 1820 derivative records from 54451 primary records. [2025-09-26T22:27:53.681947] [DEBUG] [LOCAL ] SHEL: Saving derivative data. [2025-09-26T22:27:53.930140] [DEBUG] [LOCAL ] SHEL: Derivative data saved (1820 records). [2025-09-26T22:27:53.930823] [INFO ] [MAIN ] SHEL: Successfully saved derivative data. [2025-09-26T22:27:53.930063] [DEBUG] [MAIN ] SHG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:53.934444] [INFO ] [MAIN ] SHG: Generated 1820 derivative records from 27307 primary records. [2025-09-26T22:27:53.934569] [DEBUG] [LOCAL ] SHG: Saving derivative data. [2025-09-26T22:27:53.933283] [INFO ] [MAIN ] Derivative Progress: 1648/2074 symbols completed. SHEL took 1.4s. Estimated remaining: 2m 57s. Rate: 144.2 symbols/min [2025-09-26T22:27:53.952874] [DEBUG] [LOCAL ] SHG: Derivative data saved (1820 records). [2025-09-26T22:27:53.953249] [INFO ] [MAIN ] SHG: Successfully saved derivative data. [2025-09-26T22:27:53.955549] [INFO ] [MAIN ] Derivative Progress: 1649/2074 symbols completed. SHG took 1.2s. Estimated remaining: 2m 57s. Rate: 144.2 symbols/min [2025-09-26T22:27:53.973854] [DEBUG] [MAIN ] SHO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:53.974504] [INFO ] [MAIN ] SHO: Generated 1820 derivative records from 50552 primary records. [2025-09-26T22:27:53.974567] [DEBUG] [LOCAL ] SHO: Saving derivative data. [2025-09-26T22:27:53.990807] [DEBUG] [LOCAL ] SHO: Derivative data saved (1820 records). [2025-09-26T22:27:53.990872] [INFO ] [MAIN ] SHO: Successfully saved derivative data. [2025-09-26T22:27:53.993358] [INFO ] [MAIN ] Derivative Progress: 1650/2074 symbols completed. SHO took 1.0s. Estimated remaining: 2m 56s. Rate: 144.3 symbols/min [2025-09-26T22:27:53.994005] [INFO ] [MAIN ] SHW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:53.994247] [INFO ] [MAIN ] SID: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:53.994143] [INFO ] [MAIN ] SHOC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:54.001459] [DEBUG] [LOCAL ] SHOC: Loaded 3747 existing records from primary storage. [2025-09-26T22:27:54.001605] [INFO ] [MAIN ] SHOC: Loaded 3747 primary data records. [2025-09-26T22:27:54.353539] [DEBUG] [LOCAL ] SID: Loaded 42834 existing records from primary storage. [2025-09-26T22:27:54.355966] [INFO ] [MAIN ] SID: Loaded 42834 primary data records. [2025-09-26T22:27:54.417437] [DEBUG] [LOCAL ] SHW: Loaded 51174 existing records from primary storage. [2025-09-26T22:27:54.431890] [INFO ] [MAIN ] SHW: Loaded 51174 primary data records. [2025-09-26T22:27:55.074977] [DEBUG] [MAIN ] SHOC: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:27:55.076702] [INFO ] [MAIN ] SHOC: Generated 1819 derivative records from 3747 primary records. [2025-09-26T22:27:55.076983] [DEBUG] [LOCAL ] SHOC: Saving derivative data. [2025-09-26T22:27:55.094520] [DEBUG] [LOCAL ] SHOC: Derivative data saved (1819 records). [2025-09-26T22:27:55.095825] [INFO ] [MAIN ] SHOC: Successfully saved derivative data. [2025-09-26T22:27:55.098399] [INFO ] [MAIN ] Derivative Progress: 1651/2074 symbols completed. SHOC took 1.1s. Estimated remaining: 2m 56s. Rate: 144.2 symbols/min [2025-09-26T22:27:55.098989] [INFO ] [MAIN ] SIG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:55.122270] [DEBUG] [MAIN ] SID: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:55.123363] [INFO ] [MAIN ] SID: Generated 1820 derivative records from 42834 primary records. [2025-09-26T22:27:55.131288] [DEBUG] [LOCAL ] SID: Saving derivative data. [2025-09-26T22:27:55.137603] [DEBUG] [MAIN ] SHW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:55.147424] [INFO ] [MAIN ] SHW: Generated 1820 derivative records from 51174 primary records. [2025-09-26T22:27:55.147571] [DEBUG] [LOCAL ] SHW: Saving derivative data. [2025-09-26T22:27:55.168894] [DEBUG] [LOCAL ] SHW: Derivative data saved (1820 records). [2025-09-26T22:27:55.169057] [INFO ] [MAIN ] SHW: Successfully saved derivative data. [2025-09-26T22:27:55.172444] [INFO ] [MAIN ] Derivative Progress: 1652/2074 symbols completed. SHW took 1.2s. Estimated remaining: 2m 56s. Rate: 144.2 symbols/min [2025-09-26T22:27:55.173780] [INFO ] [MAIN ] SII: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:55.186321] [DEBUG] [LOCAL ] SID: Derivative data saved (1820 records). [2025-09-26T22:27:55.186579] [INFO ] [MAIN ] SID: Successfully saved derivative data. [2025-09-26T22:27:55.188727] [INFO ] [MAIN ] Derivative Progress: 1653/2074 symbols completed. SID took 1.2s. Estimated remaining: 2m 55s. Rate: 144.3 symbols/min [2025-09-26T22:27:55.189200] [INFO ] [MAIN ] SILA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:55.205357] [DEBUG] [LOCAL ] SIG: Loaded 47111 existing records from primary storage. [2025-09-26T22:27:55.205707] [INFO ] [MAIN ] SIG: Loaded 47111 primary data records. [2025-09-26T22:27:55.346450] [DEBUG] [LOCAL ] SII: Loaded 23644 existing records from primary storage. [2025-09-26T22:27:55.357348] [INFO ] [MAIN ] SII: Loaded 23644 primary data records. [2025-09-26T22:27:55.476947] [DEBUG] [LOCAL ] SILA: Loaded 31635 existing records from primary storage. [2025-09-26T22:27:55.491057] [INFO ] [MAIN ] SILA: Loaded 31635 primary data records. [2025-09-26T22:27:56.280090] [DEBUG] [MAIN ] SIG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:56.281587] [INFO ] [MAIN ] SIG: Generated 1820 derivative records from 47111 primary records. [2025-09-26T22:27:56.282685] [DEBUG] [LOCAL ] SIG: Saving derivative data. [2025-09-26T22:27:56.301933] [DEBUG] [LOCAL ] SIG: Derivative data saved (1820 records). [2025-09-26T22:27:56.302250] [INFO ] [MAIN ] SIG: Successfully saved derivative data. [2025-09-26T22:27:56.304277] [INFO ] [MAIN ] Derivative Progress: 1654/2074 symbols completed. SIG took 1.2s. Estimated remaining: 2m 55s. Rate: 144.2 symbols/min [2025-09-26T22:27:56.305017] [INFO ] [MAIN ] SITC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:56.326852] [DEBUG] [MAIN ] SII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:56.328722] [INFO ] [MAIN ] SII: Generated 1820 derivative records from 23644 primary records. [2025-09-26T22:27:56.328810] [DEBUG] [LOCAL ] SII: Saving derivative data. [2025-09-26T22:27:56.359315] [DEBUG] [MAIN ] SILA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:56.361304] [INFO ] [MAIN ] SILA: Generated 1820 derivative records from 31635 primary records. [2025-09-26T22:27:56.361938] [DEBUG] [LOCAL ] SILA: Saving derivative data. [2025-09-26T22:27:56.395012] [DEBUG] [LOCAL ] SILA: Derivative data saved (1820 records). [2025-09-26T22:27:56.395213] [INFO ] [MAIN ] SILA: Successfully saved derivative data. [2025-09-26T22:27:56.398214] [INFO ] [MAIN ] Derivative Progress: 1655/2074 symbols completed. SILA took 1.2s. Estimated remaining: 2m 54s. Rate: 144.3 symbols/min [2025-09-26T22:27:56.394549] [DEBUG] [LOCAL ] SII: Derivative data saved (1820 records). [2025-09-26T22:27:56.398718] [INFO ] [MAIN ] SII: Successfully saved derivative data. [2025-09-26T22:27:56.401678] [INFO ] [MAIN ] Derivative Progress: 1656/2074 symbols completed. SII took 1.2s. Estimated remaining: 2m 54s. Rate: 144.3 symbols/min [2025-09-26T22:27:56.402203] [INFO ] [MAIN ] SJM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:56.402071] [INFO ] [MAIN ] SITE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:56.421016] [DEBUG] [LOCAL ] SITC: Loaded 42233 existing records from primary storage. [2025-09-26T22:27:56.421351] [INFO ] [MAIN ] SITC: Loaded 42233 primary data records. [2025-09-26T22:27:56.649804] [DEBUG] [LOCAL ] SITE: Loaded 35513 existing records from primary storage. [2025-09-26T22:27:56.802593] [INFO ] [MAIN ] SITE: Loaded 35513 primary data records. [2025-09-26T22:27:56.893345] [DEBUG] [LOCAL ] SJM: Loaded 50877 existing records from primary storage. [2025-09-26T22:27:56.912768] [INFO ] [MAIN ] SJM: Loaded 50877 primary data records. [2025-09-26T22:27:57.505925] [DEBUG] [MAIN ] SITC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:57.506975] [INFO ] [MAIN ] SITC: Generated 1820 derivative records from 42233 primary records. [2025-09-26T22:27:57.509060] [DEBUG] [LOCAL ] SITC: Saving derivative data. [2025-09-26T22:27:57.531393] [DEBUG] [LOCAL ] SITC: Derivative data saved (1820 records). [2025-09-26T22:27:57.532673] [INFO ] [MAIN ] SITC: Successfully saved derivative data. [2025-09-26T22:27:57.535375] [INFO ] [MAIN ] Derivative Progress: 1657/2074 symbols completed. SITC took 1.2s. Estimated remaining: 2m 54s. Rate: 144.2 symbols/min [2025-09-26T22:27:57.536255] [INFO ] [MAIN ] SJT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:57.558783] [DEBUG] [MAIN ] SITE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:57.559624] [INFO ] [MAIN ] SITE: Generated 1820 derivative records from 35513 primary records. [2025-09-26T22:27:57.559923] [DEBUG] [LOCAL ] SITE: Saving derivative data. [2025-09-26T22:27:57.604457] [DEBUG] [MAIN ] SJM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:57.605564] [DEBUG] [LOCAL ] SJT: Loaded 22419 existing records from primary storage. [2025-09-26T22:27:57.607912] [INFO ] [MAIN ] SJT: Loaded 22419 primary data records. [2025-09-26T22:27:57.607327] [INFO ] [MAIN ] SJM: Generated 1820 derivative records from 50877 primary records. [2025-09-26T22:27:57.614483] [DEBUG] [LOCAL ] SJM: Saving derivative data. [2025-09-26T22:27:57.634970] [DEBUG] [LOCAL ] SITE: Derivative data saved (1820 records). [2025-09-26T22:27:57.647819] [INFO ] [MAIN ] SITE: Successfully saved derivative data. [2025-09-26T22:27:57.662447] [INFO ] [MAIN ] Derivative Progress: 1658/2074 symbols completed. SITE took 1.3s. Estimated remaining: 2m 53s. Rate: 144.3 symbols/min [2025-09-26T22:27:57.682443] [INFO ] [MAIN ] SKE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:57.809344] [DEBUG] [LOCAL ] SJM: Derivative data saved (1820 records). [2025-09-26T22:27:57.860066] [INFO ] [MAIN ] SJM: Successfully saved derivative data. [2025-09-26T22:27:57.862938] [INFO ] [MAIN ] Derivative Progress: 1659/2074 symbols completed. SJM took 1.5s. Estimated remaining: 2m 53s. Rate: 144.3 symbols/min [2025-09-26T22:27:57.973840] [INFO ] [MAIN ] SKIL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:58.002241] [DEBUG] [LOCAL ] SKE: Loaded 36252 existing records from primary storage. [2025-09-26T22:27:58.002891] [INFO ] [MAIN ] SKE: Loaded 36252 primary data records. [2025-09-26T22:27:58.040882] [DEBUG] [LOCAL ] SKIL: Loaded 6395 existing records from primary storage. [2025-09-26T22:27:58.054932] [INFO ] [MAIN ] SKIL: Loaded 6395 primary data records. [2025-09-26T22:27:58.553895] [DEBUG] [MAIN ] SJT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:58.742118] [INFO ] [MAIN ] SJT: Generated 1820 derivative records from 22419 primary records. [2025-09-26T22:27:58.742494] [DEBUG] [LOCAL ] SJT: Saving derivative data. [2025-09-26T22:27:58.761608] [DEBUG] [LOCAL ] SJT: Derivative data saved (1820 records). [2025-09-26T22:27:58.761983] [INFO ] [MAIN ] SJT: Successfully saved derivative data. [2025-09-26T22:27:58.764491] [INFO ] [MAIN ] Derivative Progress: 1660/2074 symbols completed. SJT took 1.2s. Estimated remaining: 2m 52s. Rate: 144.2 symbols/min [2025-09-26T22:27:58.765973] [INFO ] [MAIN ] SKLZ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:58.784008] [DEBUG] [LOCAL ] SKLZ: Loaded 12122 existing records from primary storage. [2025-09-26T22:27:58.784666] [INFO ] [MAIN ] SKLZ: Loaded 12122 primary data records. [2025-09-26T22:27:58.926943] [DEBUG] [MAIN ] SKE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:58.927415] [DEBUG] [MAIN ] SKIL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:58.928197] [INFO ] [MAIN ] SKE: Generated 1820 derivative records from 36252 primary records. [2025-09-26T22:27:58.934617] [INFO ] [MAIN ] SKIL: Generated 1820 derivative records from 6395 primary records. [2025-09-26T22:27:58.945011] [DEBUG] [LOCAL ] SKIL: Saving derivative data. [2025-09-26T22:27:58.950215] [DEBUG] [LOCAL ] SKE: Saving derivative data. [2025-09-26T22:27:59.165624] [DEBUG] [LOCAL ] SKE: Derivative data saved (1820 records). [2025-09-26T22:27:59.166749] [INFO ] [MAIN ] SKE: Successfully saved derivative data. [2025-09-26T22:27:59.169464] [INFO ] [MAIN ] Derivative Progress: 1661/2074 symbols completed. SKE took 1.5s. Estimated remaining: 2m 52s. Rate: 144.2 symbols/min [2025-09-26T22:27:59.170836] [INFO ] [MAIN ] SKM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:59.174025] [DEBUG] [LOCAL ] SKIL: Derivative data saved (1820 records). [2025-09-26T22:27:59.174261] [INFO ] [MAIN ] SKIL: Successfully saved derivative data. [2025-09-26T22:27:59.177719] [INFO ] [MAIN ] Derivative Progress: 1662/2074 symbols completed. SKIL took 1.2s. Estimated remaining: 2m 51s. Rate: 144.3 symbols/min [2025-09-26T22:27:59.178450] [INFO ] [MAIN ] SKT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:27:59.216354] [DEBUG] [MAIN ] SKLZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:59.217422] [INFO ] [MAIN ] SKLZ: Generated 1820 derivative records from 12122 primary records. [2025-09-26T22:27:59.217611] [DEBUG] [LOCAL ] SKLZ: Saving derivative data. [2025-09-26T22:27:59.251882] [DEBUG] [LOCAL ] SKM: Loaded 35557 existing records from primary storage. [2025-09-26T22:27:59.252579] [INFO ] [MAIN ] SKM: Loaded 35557 primary data records. [2025-09-26T22:27:59.371342] [DEBUG] [LOCAL ] SKT: Loaded 43227 existing records from primary storage. [2025-09-26T22:27:59.363807] [DEBUG] [LOCAL ] SKLZ: Derivative data saved (1820 records). [2025-09-26T22:27:59.371713] [INFO ] [MAIN ] SKLZ: Successfully saved derivative data. [2025-09-26T22:27:59.371599] [INFO ] [MAIN ] SKT: Loaded 43227 primary data records. [2025-09-26T22:27:59.383957] [INFO ] [MAIN ] Derivative Progress: 1663/2074 symbols completed. SKLZ took 0.6s. Estimated remaining: 2m 51s. Rate: 144.3 symbols/min [2025-09-26T22:27:59.985110] [DEBUG] [MAIN ] SKM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:27:59.987564] [INFO ] [MAIN ] SKM: Generated 1820 derivative records from 35557 primary records. [2025-09-26T22:27:59.987768] [DEBUG] [LOCAL ] SKM: Saving derivative data. [2025-09-26T22:28:00.020898] [DEBUG] [LOCAL ] SKM: Derivative data saved (1820 records). [2025-09-26T22:28:00.019731] [DEBUG] [MAIN ] SKT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:00.021121] [INFO ] [MAIN ] SKM: Successfully saved derivative data. [2025-09-26T22:28:00.022039] [INFO ] [MAIN ] SKT: Generated 1820 derivative records from 43227 primary records. [2025-09-26T22:28:00.025188] [INFO ] [MAIN ] Derivative Progress: 1664/2074 symbols completed. SKM took 0.9s. Estimated remaining: 2m 51s. Rate: 144.3 symbols/min [2025-09-26T22:28:00.025390] [DEBUG] [LOCAL ] SKT: Saving derivative data. [2025-09-26T22:28:00.042425] [DEBUG] [LOCAL ] SKT: Derivative data saved (1820 records). [2025-09-26T22:28:00.042496] [INFO ] [MAIN ] SKT: Successfully saved derivative data. [2025-09-26T22:28:00.044694] [INFO ] [MAIN ] Derivative Progress: 1665/2074 symbols completed. SKT took 0.9s. Estimated remaining: 2m 50s. Rate: 144.4 symbols/min [2025-09-26T22:28:00.045868] [INFO ] [MAIN ] SLB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:00.046015] [INFO ] [MAIN ] SKY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:00.045699] [INFO ] [MAIN ] SKYH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:00.082365] [DEBUG] [LOCAL ] SKYH: Loaded 16851 existing records from primary storage. [2025-09-26T22:28:00.082701] [INFO ] [MAIN ] SKYH: Loaded 16851 primary data records. [2025-09-26T22:28:00.225334] [DEBUG] [LOCAL ] SKY: Loaded 38305 existing records from primary storage. [2025-09-26T22:28:00.230085] [INFO ] [MAIN ] SKY: Loaded 38305 primary data records. [2025-09-26T22:28:00.370742] [DEBUG] [LOCAL ] SLB: Loaded 54477 existing records from primary storage. [2025-09-26T22:28:00.371197] [INFO ] [MAIN ] SLB: Loaded 54477 primary data records. [2025-09-26T22:28:01.234231] [DEBUG] [MAIN ] SKYH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:01.238479] [INFO ] [MAIN ] SKYH: Generated 1820 derivative records from 16851 primary records. [2025-09-26T22:28:01.238906] [DEBUG] [LOCAL ] SKYH: Saving derivative data. [2025-09-26T22:28:01.258159] [DEBUG] [LOCAL ] SKYH: Derivative data saved (1820 records). [2025-09-26T22:28:01.258298] [INFO ] [MAIN ] SKYH: Successfully saved derivative data. [2025-09-26T22:28:01.260951] [INFO ] [MAIN ] Derivative Progress: 1666/2074 symbols completed. SKYH took 1.2s. Estimated remaining: 2m 50s. Rate: 144.2 symbols/min [2025-09-26T22:28:01.261802] [INFO ] [MAIN ] SLF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:01.283688] [DEBUG] [MAIN ] SLB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:01.292262] [INFO ] [MAIN ] SLB: Generated 1820 derivative records from 54477 primary records. [2025-09-26T22:28:01.297365] [DEBUG] [LOCAL ] SLB: Saving derivative data. [2025-09-26T22:28:01.298343] [DEBUG] [MAIN ] SKY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:01.299540] [INFO ] [MAIN ] SKY: Generated 1820 derivative records from 38305 primary records. [2025-09-26T22:28:01.310889] [DEBUG] [LOCAL ] SKY: Saving derivative data. [2025-09-26T22:28:01.333442] [DEBUG] [LOCAL ] SLB: Derivative data saved (1820 records). [2025-09-26T22:28:01.337476] [INFO ] [MAIN ] SLB: Successfully saved derivative data. [2025-09-26T22:28:01.338183] [DEBUG] [LOCAL ] SKY: Derivative data saved (1820 records). [2025-09-26T22:28:01.341562] [INFO ] [MAIN ] SKY: Successfully saved derivative data. [2025-09-26T22:28:01.341401] [INFO ] [MAIN ] Derivative Progress: 1667/2074 symbols completed. SLB took 1.3s. Estimated remaining: 2m 49s. Rate: 144.3 symbols/min [2025-09-26T22:28:01.344405] [INFO ] [MAIN ] SLG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:01.344307] [INFO ] [MAIN ] Derivative Progress: 1668/2074 symbols completed. SKY took 1.3s. Estimated remaining: 2m 49s. Rate: 144.3 symbols/min [2025-09-26T22:28:01.358323] [INFO ] [MAIN ] SLGN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:01.381686] [DEBUG] [LOCAL ] SLF: Loaded 39426 existing records from primary storage. [2025-09-26T22:28:01.382034] [INFO ] [MAIN ] SLF: Loaded 39426 primary data records. [2025-09-26T22:28:01.619303] [DEBUG] [LOCAL ] SLGN: Loaded 41039 existing records from primary storage. [2025-09-26T22:28:01.693536] [INFO ] [MAIN ] SLGN: Loaded 41039 primary data records. [2025-09-26T22:28:01.746484] [DEBUG] [LOCAL ] SLG: Loaded 46130 existing records from primary storage. [2025-09-26T22:28:01.756255] [INFO ] [MAIN ] SLG: Loaded 46130 primary data records. [2025-09-26T22:28:02.439367] [DEBUG] [MAIN ] SLF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:02.442919] [INFO ] [MAIN ] SLF: Generated 1820 derivative records from 39426 primary records. [2025-09-26T22:28:02.443485] [DEBUG] [LOCAL ] SLF: Saving derivative data. [2025-09-26T22:28:02.463583] [DEBUG] [LOCAL ] SLF: Derivative data saved (1820 records). [2025-09-26T22:28:02.467799] [INFO ] [MAIN ] SLF: Successfully saved derivative data. [2025-09-26T22:28:02.471728] [INFO ] [MAIN ] Derivative Progress: 1669/2074 symbols completed. SLF took 1.2s. Estimated remaining: 2m 49s. Rate: 144.2 symbols/min [2025-09-26T22:28:02.475485] [INFO ] [MAIN ] SLQT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:02.497505] [DEBUG] [MAIN ] SLGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:02.512681] [INFO ] [MAIN ] SLGN: Generated 1820 derivative records from 41039 primary records. [2025-09-26T22:28:02.512940] [DEBUG] [MAIN ] SLG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:02.513158] [DEBUG] [LOCAL ] SLGN: Saving derivative data. [2025-09-26T22:28:02.515620] [INFO ] [MAIN ] SLG: Generated 1820 derivative records from 46130 primary records. [2025-09-26T22:28:02.523152] [DEBUG] [LOCAL ] SLG: Saving derivative data. [2025-09-26T22:28:02.532284] [DEBUG] [LOCAL ] SLGN: Derivative data saved (1820 records). [2025-09-26T22:28:02.533050] [INFO ] [MAIN ] SLGN: Successfully saved derivative data. [2025-09-26T22:28:02.536535] [INFO ] [MAIN ] Derivative Progress: 1670/2074 symbols completed. SLGN took 1.2s. Estimated remaining: 2m 48s. Rate: 144.3 symbols/min [2025-09-26T22:28:02.548852] [INFO ] [MAIN ] SLVM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:02.553606] [DEBUG] [LOCAL ] SLG: Derivative data saved (1820 records). [2025-09-26T22:28:02.554328] [INFO ] [MAIN ] SLG: Successfully saved derivative data. [2025-09-26T22:28:02.556593] [INFO ] [MAIN ] Derivative Progress: 1671/2074 symbols completed. SLG took 1.2s. Estimated remaining: 2m 48s. Rate: 144.4 symbols/min [2025-09-26T22:28:02.557096] [INFO ] [MAIN ] SM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:02.612442] [DEBUG] [LOCAL ] SLQT: Loaded 44370 existing records from primary storage. [2025-09-26T22:28:02.610913] [DEBUG] [LOCAL ] SLVM: Loaded 28332 existing records from primary storage. [2025-09-26T22:28:02.612699] [INFO ] [MAIN ] SLQT: Loaded 44370 primary data records. [2025-09-26T22:28:02.612889] [INFO ] [MAIN ] SLVM: Loaded 28332 primary data records. [2025-09-26T22:28:03.346703] [DEBUG] [LOCAL ] SM: Loaded 53080 existing records from primary storage. [2025-09-26T22:28:03.347761] [INFO ] [MAIN ] SM: Loaded 53080 primary data records. [2025-09-26T22:28:03.731496] [DEBUG] [MAIN ] SLVM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:03.733378] [INFO ] [MAIN ] SLVM: Generated 1820 derivative records from 28332 primary records. [2025-09-26T22:28:03.732512] [DEBUG] [MAIN ] SLQT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:03.734389] [INFO ] [MAIN ] SLQT: Generated 1820 derivative records from 44370 primary records. [2025-09-26T22:28:03.734578] [DEBUG] [LOCAL ] SLVM: Saving derivative data. [2025-09-26T22:28:03.735058] [DEBUG] [LOCAL ] SLQT: Saving derivative data. [2025-09-26T22:28:03.769128] [DEBUG] [LOCAL ] SLQT: Derivative data saved (1820 records). [2025-09-26T22:28:03.770825] [INFO ] [MAIN ] SLQT: Successfully saved derivative data. [2025-09-26T22:28:03.771283] [DEBUG] [LOCAL ] SLVM: Derivative data saved (1820 records). [2025-09-26T22:28:03.771628] [INFO ] [MAIN ] SLVM: Successfully saved derivative data. [2025-09-26T22:28:03.773954] [INFO ] [MAIN ] Derivative Progress: 1672/2074 symbols completed. SLQT took 1.3s. Estimated remaining: 2m 47s. Rate: 144.2 symbols/min [2025-09-26T22:28:03.777197] [INFO ] [MAIN ] SMBK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:03.777263] [INFO ] [MAIN ] Derivative Progress: 1673/2074 symbols completed. SLVM took 1.2s. Estimated remaining: 2m 47s. Rate: 144.3 symbols/min [2025-09-26T22:28:03.778326] [INFO ] [MAIN ] SMC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:03.798980] [DEBUG] [MAIN ] SM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:03.802728] [INFO ] [MAIN ] SM: Generated 1820 derivative records from 53080 primary records. [2025-09-26T22:28:03.802929] [DEBUG] [LOCAL ] SM: Saving derivative data. [2025-09-26T22:28:03.807620] [DEBUG] [LOCAL ] SMBK: Loaded 8332 existing records from primary storage. [2025-09-26T22:28:03.821718] [INFO ] [MAIN ] SMBK: Loaded 8332 primary data records. [2025-09-26T22:28:03.824743] [DEBUG] [LOCAL ] SMC: Loaded 11630 existing records from primary storage. [2025-09-26T22:28:03.836880] [INFO ] [MAIN ] SMC: Loaded 11630 primary data records. [2025-09-26T22:28:03.929564] [DEBUG] [LOCAL ] SM: Derivative data saved (1820 records). [2025-09-26T22:28:03.976903] [INFO ] [MAIN ] SM: Successfully saved derivative data. [2025-09-26T22:28:04.015687] [INFO ] [MAIN ] Derivative Progress: 1674/2074 symbols completed. SM took 1.5s. Estimated remaining: 2m 46s. Rate: 144.3 symbols/min [2025-09-26T22:28:04.087925] [INFO ] [MAIN ] SMFG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:04.549880] [DEBUG] [LOCAL ] SMFG: Loaded 48771 existing records from primary storage. [2025-09-26T22:28:04.550458] [DEBUG] [MAIN ] SMBK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:04.559225] [INFO ] [MAIN ] SMBK: Generated 1820 derivative records from 8332 primary records. [2025-09-26T22:28:04.550937] [INFO ] [MAIN ] SMFG: Loaded 48771 primary data records. [2025-09-26T22:28:04.564233] [DEBUG] [LOCAL ] SMBK: Saving derivative data. [2025-09-26T22:28:04.565027] [DEBUG] [MAIN ] SMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:04.571268] [INFO ] [MAIN ] SMC: Generated 1820 derivative records from 11630 primary records. [2025-09-26T22:28:04.584286] [DEBUG] [LOCAL ] SMC: Saving derivative data. [2025-09-26T22:28:04.630254] [DEBUG] [LOCAL ] SMBK: Derivative data saved (1820 records). [2025-09-26T22:28:04.637506] [INFO ] [MAIN ] SMBK: Successfully saved derivative data. [2025-09-26T22:28:04.656799] [INFO ] [MAIN ] Derivative Progress: 1675/2074 symbols completed. SMBK took 0.9s. Estimated remaining: 2m 46s. Rate: 144.3 symbols/min [2025-09-26T22:28:04.666567] [INFO ] [MAIN ] SMG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:04.676035] [DEBUG] [LOCAL ] SMC: Derivative data saved (1820 records). [2025-09-26T22:28:04.688590] [INFO ] [MAIN ] SMC: Successfully saved derivative data. [2025-09-26T22:28:04.691428] [INFO ] [MAIN ] Derivative Progress: 1676/2074 symbols completed. SMC took 0.9s. Estimated remaining: 2m 45s. Rate: 144.3 symbols/min [2025-09-26T22:28:04.704595] [INFO ] [MAIN ] SMP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:04.932259] [DEBUG] [LOCAL ] SMP: Loaded 19999 existing records from primary storage. [2025-09-26T22:28:04.933170] [INFO ] [MAIN ] SMP: Loaded 19999 primary data records. [2025-09-26T22:28:05.112190] [DEBUG] [LOCAL ] SMG: Loaded 44546 existing records from primary storage. [2025-09-26T22:28:05.129988] [INFO ] [MAIN ] SMG: Loaded 44546 primary data records. [2025-09-26T22:28:05.643264] [DEBUG] [MAIN ] SMFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:05.658899] [INFO ] [MAIN ] SMFG: Generated 1820 derivative records from 48771 primary records. [2025-09-26T22:28:05.659200] [DEBUG] [LOCAL ] SMFG: Saving derivative data. [2025-09-26T22:28:05.680119] [DEBUG] [LOCAL ] SMFG: Derivative data saved (1820 records). [2025-09-26T22:28:05.680551] [INFO ] [MAIN ] SMFG: Successfully saved derivative data. [2025-09-26T22:28:05.683737] [INFO ] [MAIN ] Derivative Progress: 1677/2074 symbols completed. SMFG took 1.6s. Estimated remaining: 2m 45s. Rate: 144.2 symbols/min [2025-09-26T22:28:05.685848] [INFO ] [MAIN ] SMRT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:05.702469] [DEBUG] [MAIN ] SMP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:05.703580] [INFO ] [MAIN ] SMP: Generated 1820 derivative records from 19999 primary records. [2025-09-26T22:28:05.703704] [DEBUG] [LOCAL ] SMP: Saving derivative data. [2025-09-26T22:28:05.721093] [DEBUG] [LOCAL ] SMP: Derivative data saved (1820 records). [2025-09-26T22:28:05.721509] [INFO ] [MAIN ] SMP: Successfully saved derivative data. [2025-09-26T22:28:05.723825] [INFO ] [MAIN ] Derivative Progress: 1678/2074 symbols completed. SMP took 1.0s. Estimated remaining: 2m 45s. Rate: 144.3 symbols/min [2025-09-26T22:28:05.740838] [DEBUG] [MAIN ] SMG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:05.741555] [INFO ] [MAIN ] SMG: Generated 1820 derivative records from 44546 primary records. [2025-09-26T22:28:05.741747] [DEBUG] [LOCAL ] SMG: Saving derivative data. [2025-09-26T22:28:05.767676] [DEBUG] [LOCAL ] SMG: Derivative data saved (1820 records). [2025-09-26T22:28:05.767849] [INFO ] [MAIN ] SMG: Successfully saved derivative data. [2025-09-26T22:28:05.770558] [INFO ] [MAIN ] Derivative Progress: 1679/2074 symbols completed. SMG took 1.1s. Estimated remaining: 2m 44s. Rate: 144.4 symbols/min [2025-09-26T22:28:05.787012] [DEBUG] [LOCAL ] SMRT: Loaded 44707 existing records from primary storage. [2025-09-26T22:28:05.787170] [INFO ] [MAIN ] SMRT: Loaded 44707 primary data records. [2025-09-26T22:28:06.132934] [DEBUG] [MAIN ] SMRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:06.133715] [INFO ] [MAIN ] SMRT: Generated 1820 derivative records from 44707 primary records. [2025-09-26T22:28:06.133781] [DEBUG] [LOCAL ] SMRT: Saving derivative data. [2025-09-26T22:28:06.149168] [DEBUG] [LOCAL ] SMRT: Derivative data saved (1820 records). [2025-09-26T22:28:06.149260] [INFO ] [MAIN ] SMRT: Successfully saved derivative data. [2025-09-26T22:28:06.151344] [INFO ] [MAIN ] Derivative Progress: 1680/2074 symbols completed. SMRT took 0.5s. Estimated remaining: 2m 44s. Rate: 144.4 symbols/min [2025-09-26T22:28:06.152350] [INFO ] [MAIN ] SN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:06.152518] [INFO ] [MAIN ] SMWB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:06.152259] [INFO ] [MAIN ] SNA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:06.190045] [DEBUG] [LOCAL ] SNA: Loaded 26608 existing records from primary storage. [2025-09-26T22:28:06.190854] [INFO ] [MAIN ] SNA: Loaded 26608 primary data records. [2025-09-26T22:28:06.287925] [DEBUG] [LOCAL ] SMWB: Loaded 33137 existing records from primary storage. [2025-09-26T22:28:06.331034] [INFO ] [MAIN ] SMWB: Loaded 33137 primary data records. [2025-09-26T22:28:06.463103] [DEBUG] [LOCAL ] SN: Loaded 50487 existing records from primary storage. [2025-09-26T22:28:06.619198] [INFO ] [MAIN ] SN: Loaded 50487 primary data records. [2025-09-26T22:28:07.249346] [DEBUG] [MAIN ] SNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:07.250308] [INFO ] [MAIN ] SNA: Generated 1820 derivative records from 26608 primary records. [2025-09-26T22:28:07.250530] [DEBUG] [LOCAL ] SNA: Saving derivative data. [2025-09-26T22:28:07.285464] [DEBUG] [MAIN ] SMWB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:07.287911] [INFO ] [MAIN ] SMWB: Generated 1820 derivative records from 33137 primary records. [2025-09-26T22:28:07.288007] [DEBUG] [LOCAL ] SMWB: Saving derivative data. [2025-09-26T22:28:07.289462] [DEBUG] [LOCAL ] SNA: Derivative data saved (1820 records). [2025-09-26T22:28:07.290922] [INFO ] [MAIN ] SNA: Successfully saved derivative data. [2025-09-26T22:28:07.295125] [INFO ] [MAIN ] Derivative Progress: 1681/2074 symbols completed. SNA took 1.1s. Estimated remaining: 2m 43s. Rate: 144.2 symbols/min [2025-09-26T22:28:07.308155] [INFO ] [MAIN ] SNAP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:07.324973] [DEBUG] [MAIN ] SN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:07.328200] [INFO ] [MAIN ] SN: Generated 1820 derivative records from 50487 primary records. [2025-09-26T22:28:07.329639] [DEBUG] [LOCAL ] SMWB: Derivative data saved (1820 records). [2025-09-26T22:28:07.329852] [INFO ] [MAIN ] SMWB: Successfully saved derivative data. [2025-09-26T22:28:07.329772] [DEBUG] [LOCAL ] SN: Saving derivative data. [2025-09-26T22:28:07.333108] [INFO ] [MAIN ] Derivative Progress: 1682/2074 symbols completed. SMWB took 1.2s. Estimated remaining: 2m 43s. Rate: 144.3 symbols/min [2025-09-26T22:28:07.334081] [INFO ] [MAIN ] SNDA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:07.353609] [DEBUG] [LOCAL ] SN: Derivative data saved (1820 records). [2025-09-26T22:28:07.357434] [DEBUG] [LOCAL ] SNDA: Loaded 4732 existing records from primary storage. [2025-09-26T22:28:07.357818] [INFO ] [MAIN ] SN: Successfully saved derivative data. [2025-09-26T22:28:07.357908] [INFO ] [MAIN ] SNDA: Loaded 4732 primary data records. [2025-09-26T22:28:07.360685] [INFO ] [MAIN ] Derivative Progress: 1683/2074 symbols completed. SN took 1.2s. Estimated remaining: 2m 42s. Rate: 144.4 symbols/min [2025-09-26T22:28:07.361068] [INFO ] [MAIN ] SNDR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:07.631278] [DEBUG] [LOCAL ] SNAP: Loaded 54576 existing records from primary storage. [2025-09-26T22:28:07.764863] [INFO ] [MAIN ] SNAP: Loaded 54576 primary data records. [2025-09-26T22:28:07.888909] [DEBUG] [LOCAL ] SNDR: Loaded 41368 existing records from primary storage. [2025-09-26T22:28:07.908008] [INFO ] [MAIN ] SNDR: Loaded 41368 primary data records. [2025-09-26T22:28:08.462406] [DEBUG] [MAIN ] SNDA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:08.463438] [INFO ] [MAIN ] SNDA: Generated 1820 derivative records from 4732 primary records. [2025-09-26T22:28:08.463596] [DEBUG] [LOCAL ] SNDA: Saving derivative data. [2025-09-26T22:28:08.484624] [DEBUG] [LOCAL ] SNDA: Derivative data saved (1820 records). [2025-09-26T22:28:08.485567] [INFO ] [MAIN ] SNDA: Successfully saved derivative data. [2025-09-26T22:28:08.488271] [INFO ] [MAIN ] Derivative Progress: 1684/2074 symbols completed. SNDA took 1.2s. Estimated remaining: 2m 42s. Rate: 144.2 symbols/min [2025-09-26T22:28:08.489104] [INFO ] [MAIN ] SNOW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:08.511986] [DEBUG] [MAIN ] SNAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:08.512896] [INFO ] [MAIN ] SNAP: Generated 1820 derivative records from 54576 primary records. [2025-09-26T22:28:08.513331] [DEBUG] [LOCAL ] SNAP: Saving derivative data. [2025-09-26T22:28:08.534042] [DEBUG] [LOCAL ] SNAP: Derivative data saved (1820 records). [2025-09-26T22:28:08.535107] [INFO ] [MAIN ] SNAP: Successfully saved derivative data. [2025-09-26T22:28:08.537808] [INFO ] [MAIN ] Derivative Progress: 1685/2074 symbols completed. SNAP took 1.2s. Estimated remaining: 2m 42s. Rate: 144.3 symbols/min [2025-09-26T22:28:08.538314] [INFO ] [MAIN ] SNV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:08.552422] [DEBUG] [MAIN ] SNDR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:08.553296] [INFO ] [MAIN ] SNDR: Generated 1820 derivative records from 41368 primary records. [2025-09-26T22:28:08.553479] [DEBUG] [LOCAL ] SNDR: Saving derivative data. [2025-09-26T22:28:08.586886] [DEBUG] [LOCAL ] SNDR: Derivative data saved (1820 records). [2025-09-26T22:28:08.587189] [INFO ] [MAIN ] SNDR: Successfully saved derivative data. [2025-09-26T22:28:08.590373] [INFO ] [MAIN ] Derivative Progress: 1686/2074 symbols completed. SNDR took 1.2s. Estimated remaining: 2m 41s. Rate: 144.4 symbols/min [2025-09-26T22:28:08.591009] [INFO ] [MAIN ] SNX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:08.614971] [DEBUG] [LOCAL ] SNOW: Loaded 54371 existing records from primary storage. [2025-09-26T22:28:08.615250] [INFO ] [MAIN ] SNOW: Loaded 54371 primary data records. [2025-09-26T22:28:08.815865] [DEBUG] [LOCAL ] SNV: Loaded 49633 existing records from primary storage. [2025-09-26T22:28:08.869045] [INFO ] [MAIN ] SNV: Loaded 49633 primary data records. [2025-09-26T22:28:08.992542] [DEBUG] [LOCAL ] SNX: Loaded 40540 existing records from primary storage. [2025-09-26T22:28:09.026636] [INFO ] [MAIN ] SNX: Loaded 40540 primary data records. [2025-09-26T22:28:09.729837] [DEBUG] [MAIN ] SNOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:09.730986] [INFO ] [MAIN ] SNOW: Generated 1820 derivative records from 54371 primary records. [2025-09-26T22:28:09.731308] [DEBUG] [LOCAL ] SNOW: Saving derivative data. [2025-09-26T22:28:09.758499] [DEBUG] [LOCAL ] SNOW: Derivative data saved (1820 records). [2025-09-26T22:28:09.759310] [INFO ] [MAIN ] SNOW: Successfully saved derivative data. [2025-09-26T22:28:09.761875] [INFO ] [MAIN ] Derivative Progress: 1687/2074 symbols completed. SNOW took 1.3s. Estimated remaining: 2m 41s. Rate: 144.2 symbols/min [2025-09-26T22:28:09.762376] [INFO ] [MAIN ] SO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:09.778706] [DEBUG] [MAIN ] SNV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:09.787154] [INFO ] [MAIN ] SNV: Generated 1820 derivative records from 49633 primary records. [2025-09-26T22:28:09.791923] [DEBUG] [LOCAL ] SNV: Saving derivative data. [2025-09-26T22:28:09.793104] [DEBUG] [MAIN ] SNX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:09.793765] [INFO ] [MAIN ] SNX: Generated 1820 derivative records from 40540 primary records. [2025-09-26T22:28:09.794086] [DEBUG] [LOCAL ] SNX: Saving derivative data. [2025-09-26T22:28:09.819278] [DEBUG] [LOCAL ] SNV: Derivative data saved (1820 records). [2025-09-26T22:28:09.819527] [INFO ] [MAIN ] SNV: Successfully saved derivative data. [2025-09-26T22:28:09.824624] [INFO ] [MAIN ] Derivative Progress: 1688/2074 symbols completed. SNV took 1.3s. Estimated remaining: 2m 40s. Rate: 144.3 symbols/min [2025-09-26T22:28:09.827083] [INFO ] [MAIN ] SOBO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:09.830140] [DEBUG] [LOCAL ] SNX: Derivative data saved (1820 records). [2025-09-26T22:28:09.830453] [INFO ] [MAIN ] SNX: Successfully saved derivative data. [2025-09-26T22:28:09.833364] [INFO ] [MAIN ] Derivative Progress: 1689/2074 symbols completed. SNX took 1.2s. Estimated remaining: 2m 40s. Rate: 144.4 symbols/min [2025-09-26T22:28:09.833807] [INFO ] [MAIN ] SOC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:09.878345] [DEBUG] [LOCAL ] SO: Loaded 54383 existing records from primary storage. [2025-09-26T22:28:09.879913] [INFO ] [MAIN ] SO: Loaded 54383 primary data records. [2025-09-26T22:28:10.085319] [DEBUG] [LOCAL ] SOC: Loaded 51041 existing records from primary storage. [2025-09-26T22:28:10.090739] [INFO ] [MAIN ] SOC: Loaded 51041 primary data records. [2025-09-26T22:28:10.127747] [DEBUG] [LOCAL ] SOBO: Loaded 40211 existing records from primary storage. [2025-09-26T22:28:10.162444] [INFO ] [MAIN ] SOBO: Loaded 40211 primary data records. [2025-09-26T22:28:10.928097] [DEBUG] [MAIN ] SO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:10.929484] [INFO ] [MAIN ] SO: Generated 1820 derivative records from 54383 primary records. [2025-09-26T22:28:10.929808] [DEBUG] [LOCAL ] SO: Saving derivative data. [2025-09-26T22:28:10.950591] [DEBUG] [LOCAL ] SO: Derivative data saved (1820 records). [2025-09-26T22:28:10.951530] [INFO ] [MAIN ] SO: Successfully saved derivative data. [2025-09-26T22:28:10.954311] [INFO ] [MAIN ] Derivative Progress: 1690/2074 symbols completed. SO took 1.2s. Estimated remaining: 2m 40s. Rate: 144.3 symbols/min [2025-09-26T22:28:10.954835] [INFO ] [MAIN ] SOJC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:10.971950] [DEBUG] [MAIN ] SOC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:10.974399] [INFO ] [MAIN ] SOC: Generated 1820 derivative records from 51041 primary records. [2025-09-26T22:28:10.974579] [DEBUG] [LOCAL ] SOC: Saving derivative data. [2025-09-26T22:28:10.992756] [DEBUG] [MAIN ] SOBO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:10.992387] [DEBUG] [LOCAL ] SOJC: Loaded 5120 existing records from primary storage. [2025-09-26T22:28:11.004583] [INFO ] [MAIN ] SOJC: Loaded 5120 primary data records. [2025-09-26T22:28:11.005717] [INFO ] [MAIN ] SOBO: Generated 1820 derivative records from 40211 primary records. [2025-09-26T22:28:11.014976] [DEBUG] [LOCAL ] SOBO: Saving derivative data. [2025-09-26T22:28:11.082861] [DEBUG] [LOCAL ] SOBO: Derivative data saved (1820 records). [2025-09-26T22:28:11.101402] [INFO ] [MAIN ] SOBO: Successfully saved derivative data. [2025-09-26T22:28:11.107903] [DEBUG] [LOCAL ] SOC: Derivative data saved (1820 records). [2025-09-26T22:28:11.118460] [INFO ] [MAIN ] Derivative Progress: 1691/2074 symbols completed. SOBO took 1.3s. Estimated remaining: 2m 39s. Rate: 144.3 symbols/min [2025-09-26T22:28:11.118903] [INFO ] [MAIN ] SOJD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:11.124330] [INFO ] [MAIN ] SOC: Successfully saved derivative data. [2025-09-26T22:28:11.133129] [INFO ] [MAIN ] Derivative Progress: 1692/2074 symbols completed. SOC took 1.3s. Estimated remaining: 2m 39s. Rate: 144.4 symbols/min [2025-09-26T22:28:11.151788] [INFO ] [MAIN ] SOJE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:11.241887] [DEBUG] [LOCAL ] SOJD: Loaded 13180 existing records from primary storage. [2025-09-26T22:28:11.242105] [INFO ] [MAIN ] SOJD: Loaded 13180 primary data records. [2025-09-26T22:28:11.467854] [DEBUG] [LOCAL ] SOJE: Loaded 9408 existing records from primary storage. [2025-09-26T22:28:11.479237] [INFO ] [MAIN ] SOJE: Loaded 9408 primary data records. [2025-09-26T22:28:12.082151] [DEBUG] [MAIN ] SOJC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:12.083180] [INFO ] [MAIN ] SOJC: Generated 1820 derivative records from 5120 primary records. [2025-09-26T22:28:12.202039] [DEBUG] [LOCAL ] SOJC: Saving derivative data. [2025-09-26T22:28:12.230333] [DEBUG] [LOCAL ] SOJC: Derivative data saved (1820 records). [2025-09-26T22:28:12.230513] [INFO ] [MAIN ] SOJC: Successfully saved derivative data. [2025-09-26T22:28:12.232791] [INFO ] [MAIN ] Derivative Progress: 1693/2074 symbols completed. SOJC took 1.3s. Estimated remaining: 2m 38s. Rate: 144.2 symbols/min [2025-09-26T22:28:12.258992] [DEBUG] [MAIN ] SOJD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:12.260015] [INFO ] [MAIN ] SOJD: Generated 1820 derivative records from 13180 primary records. [2025-09-26T22:28:12.260108] [DEBUG] [LOCAL ] SOJD: Saving derivative data. [2025-09-26T22:28:12.278520] [DEBUG] [LOCAL ] SOJD: Derivative data saved (1820 records). [2025-09-26T22:28:12.278785] [INFO ] [MAIN ] SOJD: Successfully saved derivative data. [2025-09-26T22:28:12.282731] [INFO ] [MAIN ] Derivative Progress: 1694/2074 symbols completed. SOJD took 1.2s. Estimated remaining: 2m 38s. Rate: 144.3 symbols/min [2025-09-26T22:28:12.299463] [DEBUG] [MAIN ] SOJE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:12.300425] [INFO ] [MAIN ] SOJE: Generated 1820 derivative records from 9408 primary records. [2025-09-26T22:28:12.300499] [DEBUG] [LOCAL ] SOJE: Saving derivative data. [2025-09-26T22:28:12.317345] [DEBUG] [LOCAL ] SOJE: Derivative data saved (1820 records). [2025-09-26T22:28:12.317443] [INFO ] [MAIN ] SOJE: Successfully saved derivative data. [2025-09-26T22:28:12.320198] [INFO ] [MAIN ] Derivative Progress: 1695/2074 symbols completed. SOJE took 1.2s. Estimated remaining: 2m 37s. Rate: 144.4 symbols/min [2025-09-26T22:28:12.321363] [INFO ] [MAIN ] SOLV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:12.321299] [INFO ] [MAIN ] SOL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:12.321109] [INFO ] [MAIN ] SON: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:12.345432] [DEBUG] [LOCAL ] SOL: Loaded 13694 existing records from primary storage. [2025-09-26T22:28:12.346145] [INFO ] [MAIN ] SOL: Loaded 13694 primary data records. [2025-09-26T22:28:12.567718] [DEBUG] [LOCAL ] SON: Loaded 43596 existing records from primary storage. [2025-09-26T22:28:12.569981] [INFO ] [MAIN ] SON: Loaded 43596 primary data records. [2025-09-26T22:28:12.569805] [DEBUG] [LOCAL ] SOLV: Loaded 44791 existing records from primary storage. [2025-09-26T22:28:12.590289] [INFO ] [MAIN ] SOLV: Loaded 44791 primary data records. [2025-09-26T22:28:13.461954] [DEBUG] [MAIN ] SOL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:13.462774] [INFO ] [MAIN ] SOL: Generated 1820 derivative records from 13694 primary records. [2025-09-26T22:28:13.463088] [DEBUG] [LOCAL ] SOL: Saving derivative data. [2025-09-26T22:28:13.482990] [DEBUG] [LOCAL ] SOL: Derivative data saved (1820 records). [2025-09-26T22:28:13.484425] [INFO ] [MAIN ] SOL: Successfully saved derivative data. [2025-09-26T22:28:13.486751] [INFO ] [MAIN ] Derivative Progress: 1696/2074 symbols completed. SOL took 1.2s. Estimated remaining: 2m 37s. Rate: 144.2 symbols/min [2025-09-26T22:28:13.495014] [INFO ] [MAIN ] SONY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:13.500971] [DEBUG] [MAIN ] SON: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:13.502104] [INFO ] [MAIN ] SON: Generated 1820 derivative records from 43596 primary records. [2025-09-26T22:28:13.502299] [DEBUG] [LOCAL ] SON: Saving derivative data. [2025-09-26T22:28:13.530326] [DEBUG] [LOCAL ] SON: Derivative data saved (1820 records). [2025-09-26T22:28:13.536097] [INFO ] [MAIN ] SON: Successfully saved derivative data. [2025-09-26T22:28:13.535930] [DEBUG] [MAIN ] SOLV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:13.538959] [INFO ] [MAIN ] Derivative Progress: 1697/2074 symbols completed. SON took 1.2s. Estimated remaining: 2m 37s. Rate: 144.3 symbols/min [2025-09-26T22:28:13.540243] [INFO ] [MAIN ] SOLV: Generated 1820 derivative records from 44791 primary records. [2025-09-26T22:28:13.540486] [INFO ] [MAIN ] SOR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:13.540431] [DEBUG] [LOCAL ] SOLV: Saving derivative data. [2025-09-26T22:28:13.558738] [DEBUG] [LOCAL ] SOLV: Derivative data saved (1820 records). [2025-09-26T22:28:13.559015] [INFO ] [MAIN ] SOLV: Successfully saved derivative data. [2025-09-26T22:28:13.561810] [INFO ] [MAIN ] Derivative Progress: 1698/2074 symbols completed. SOLV took 1.2s. Estimated remaining: 2m 36s. Rate: 144.4 symbols/min [2025-09-26T22:28:13.562149] [INFO ] [MAIN ] SOS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:13.566034] [DEBUG] [LOCAL ] SOR: Loaded 2947 existing records from primary storage. [2025-09-26T22:28:13.566672] [INFO ] [MAIN ] SOR: Loaded 2947 primary data records. [2025-09-26T22:28:13.672123] [DEBUG] [LOCAL ] SOS: Loaded 8266 existing records from primary storage. [2025-09-26T22:28:13.718192] [INFO ] [MAIN ] SOS: Loaded 8266 primary data records. [2025-09-26T22:28:13.751413] [DEBUG] [LOCAL ] SONY: Loaded 54136 existing records from primary storage. [2025-09-26T22:28:14.007151] [INFO ] [MAIN ] SONY: Loaded 54136 primary data records. [2025-09-26T22:28:14.666399] [DEBUG] [MAIN ] SOR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:14.668769] [INFO ] [MAIN ] SOR: Generated 1820 derivative records from 2947 primary records. [2025-09-26T22:28:14.669072] [DEBUG] [LOCAL ] SOR: Saving derivative data. [2025-09-26T22:28:14.686632] [DEBUG] [LOCAL ] SOR: Derivative data saved (1820 records). [2025-09-26T22:28:14.687431] [INFO ] [MAIN ] SOR: Successfully saved derivative data. [2025-09-26T22:28:14.689919] [INFO ] [MAIN ] Derivative Progress: 1699/2074 symbols completed. SOR took 1.2s. Estimated remaining: 2m 36s. Rate: 144.3 symbols/min [2025-09-26T22:28:14.691347] [INFO ] [MAIN ] SPB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:14.711622] [DEBUG] [MAIN ] SOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:14.720536] [INFO ] [MAIN ] SOS: Generated 1820 derivative records from 8266 primary records. [2025-09-26T22:28:14.725726] [DEBUG] [LOCAL ] SOS: Saving derivative data. [2025-09-26T22:28:14.726016] [DEBUG] [MAIN ] SONY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:14.727863] [INFO ] [MAIN ] SONY: Generated 1820 derivative records from 54136 primary records. [2025-09-26T22:28:14.728275] [DEBUG] [LOCAL ] SONY: Saving derivative data. [2025-09-26T22:28:14.763292] [DEBUG] [LOCAL ] SONY: Derivative data saved (1820 records). [2025-09-26T22:28:14.764194] [DEBUG] [LOCAL ] SOS: Derivative data saved (1820 records). [2025-09-26T22:28:14.764519] [INFO ] [MAIN ] SOS: Successfully saved derivative data. [2025-09-26T22:28:14.767440] [INFO ] [MAIN ] Derivative Progress: 1700/2074 symbols completed. SOS took 1.2s. Estimated remaining: 2m 35s. Rate: 144.3 symbols/min [2025-09-26T22:28:14.767705] [INFO ] [MAIN ] SONY: Successfully saved derivative data. [2025-09-26T22:28:14.768094] [INFO ] [MAIN ] SPCE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:14.771148] [INFO ] [MAIN ] Derivative Progress: 1701/2074 symbols completed. SONY took 1.3s. Estimated remaining: 2m 35s. Rate: 144.4 symbols/min [2025-09-26T22:28:14.780898] [INFO ] [MAIN ] SPE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:14.797062] [DEBUG] [LOCAL ] SPB: Loaded 34677 existing records from primary storage. [2025-09-26T22:28:14.801132] [INFO ] [MAIN ] SPB: Loaded 34677 primary data records. [2025-09-26T22:28:14.801020] [DEBUG] [LOCAL ] SPE: Loaded 6441 existing records from primary storage. [2025-09-26T22:28:14.823381] [INFO ] [MAIN ] SPE: Loaded 6441 primary data records. [2025-09-26T22:28:15.166229] [DEBUG] [LOCAL ] SPCE: Loaded 50615 existing records from primary storage. [2025-09-26T22:28:15.208048] [INFO ] [MAIN ] SPCE: Loaded 50615 primary data records. [2025-09-26T22:28:16.188274] [DEBUG] [MAIN ] SPB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:16.209683] [DEBUG] [MAIN ] SPE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:16.210840] [INFO ] [MAIN ] SPB: Generated 1820 derivative records from 34677 primary records. [2025-09-26T22:28:16.211156] [DEBUG] [LOCAL ] SPB: Saving derivative data. [2025-09-26T22:28:16.212497] [INFO ] [MAIN ] SPE: Generated 1820 derivative records from 6441 primary records. [2025-09-26T22:28:16.213089] [DEBUG] [LOCAL ] SPE: Saving derivative data. [2025-09-26T22:28:16.256355] [DEBUG] [LOCAL ] SPE: Derivative data saved (1820 records). [2025-09-26T22:28:16.259896] [DEBUG] [LOCAL ] SPB: Derivative data saved (1820 records). [2025-09-26T22:28:16.257766] [INFO ] [MAIN ] SPE: Successfully saved derivative data. [2025-09-26T22:28:16.263152] [INFO ] [MAIN ] Derivative Progress: 1702/2074 symbols completed. SPE took 1.5s. Estimated remaining: 2m 35s. Rate: 144.2 symbols/min [2025-09-26T22:28:16.263482] [INFO ] [MAIN ] SPB: Successfully saved derivative data. [2025-09-26T22:28:16.266559] [INFO ] [MAIN ] Derivative Progress: 1703/2074 symbols completed. SPB took 1.6s. Estimated remaining: 2m 34s. Rate: 144.3 symbols/min [2025-09-26T22:28:16.267251] [INFO ] [MAIN ] SPG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:16.267510] [INFO ] [MAIN ] SPGI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:16.289150] [DEBUG] [MAIN ] SPCE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:16.290050] [INFO ] [MAIN ] SPCE: Generated 1820 derivative records from 50615 primary records. [2025-09-26T22:28:16.290248] [DEBUG] [LOCAL ] SPCE: Saving derivative data. [2025-09-26T22:28:16.308626] [DEBUG] [LOCAL ] SPCE: Derivative data saved (1820 records). [2025-09-26T22:28:16.308815] [INFO ] [MAIN ] SPCE: Successfully saved derivative data. [2025-09-26T22:28:16.311788] [INFO ] [MAIN ] Derivative Progress: 1704/2074 symbols completed. SPCE took 1.5s. Estimated remaining: 2m 34s. Rate: 144.3 symbols/min [2025-09-26T22:28:16.312953] [INFO ] [MAIN ] SPH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:16.385228] [DEBUG] [LOCAL ] SPH: Loaded 18213 existing records from primary storage. [2025-09-26T22:28:16.388426] [INFO ] [MAIN ] SPH: Loaded 18213 primary data records. [2025-09-26T22:28:16.390087] [DEBUG] [LOCAL ] SPG: Loaded 51134 existing records from primary storage. [2025-09-26T22:28:16.390513] [INFO ] [MAIN ] SPG: Loaded 51134 primary data records. [2025-09-26T22:28:16.470158] [DEBUG] [LOCAL ] SPGI: Loaded 46562 existing records from primary storage. [2025-09-26T22:28:16.514564] [INFO ] [MAIN ] SPGI: Loaded 46562 primary data records. [2025-09-26T22:28:17.438564] [DEBUG] [MAIN ] SPGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:17.452684] [INFO ] [MAIN ] SPGI: Generated 1820 derivative records from 46562 primary records. [2025-09-26T22:28:17.453050] [DEBUG] [MAIN ] SPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:17.451739] [DEBUG] [MAIN ] SPG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:17.454548] [INFO ] [MAIN ] SPH: Generated 1820 derivative records from 18213 primary records. [2025-09-26T22:28:17.454833] [DEBUG] [LOCAL ] SPH: Saving derivative data. [2025-09-26T22:28:17.454678] [INFO ] [MAIN ] SPG: Generated 1820 derivative records from 51134 primary records. [2025-09-26T22:28:17.454767] [DEBUG] [LOCAL ] SPGI: Saving derivative data. [2025-09-26T22:28:17.456021] [DEBUG] [LOCAL ] SPG: Saving derivative data. [2025-09-26T22:28:17.497333] [DEBUG] [LOCAL ] SPGI: Derivative data saved (1820 records). [2025-09-26T22:28:17.500729] [INFO ] [MAIN ] SPGI: Successfully saved derivative data. [2025-09-26T22:28:17.500814] [DEBUG] [LOCAL ] SPH: Derivative data saved (1820 records). [2025-09-26T22:28:17.507857] [INFO ] [MAIN ] SPH: Successfully saved derivative data. [2025-09-26T22:28:17.507457] [INFO ] [MAIN ] Derivative Progress: 1705/2074 symbols completed. SPGI took 1.2s. Estimated remaining: 2m 34s. Rate: 144.2 symbols/min [2025-09-26T22:28:17.511409] [DEBUG] [LOCAL ] SPG: Derivative data saved (1820 records). [2025-09-26T22:28:17.511706] [INFO ] [MAIN ] Derivative Progress: 1706/2074 symbols completed. SPH took 1.2s. Estimated remaining: 2m 33s. Rate: 144.3 symbols/min [2025-09-26T22:28:17.512049] [INFO ] [MAIN ] SPHR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:17.511985] [INFO ] [MAIN ] SPG: Successfully saved derivative data. [2025-09-26T22:28:17.512417] [INFO ] [MAIN ] SPIR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:17.517216] [INFO ] [MAIN ] Derivative Progress: 1707/2074 symbols completed. SPG took 1.3s. Estimated remaining: 2m 33s. Rate: 144.4 symbols/min [2025-09-26T22:28:17.517565] [INFO ] [MAIN ] SPMC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:17.529637] [DEBUG] [LOCAL ] SPMC: Loaded 5613 existing records from primary storage. [2025-09-26T22:28:17.529855] [INFO ] [MAIN ] SPMC: Loaded 5613 primary data records. [2025-09-26T22:28:17.717977] [DEBUG] [LOCAL ] SPIR: Loaded 37871 existing records from primary storage. [2025-09-26T22:28:17.728514] [INFO ] [MAIN ] SPIR: Loaded 37871 primary data records. [2025-09-26T22:28:17.760821] [DEBUG] [LOCAL ] SPHR: Loaded 40745 existing records from primary storage. [2025-09-26T22:28:17.847821] [INFO ] [MAIN ] SPHR: Loaded 40745 primary data records. [2025-09-26T22:28:18.678288] [DEBUG] [MAIN ] SPMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:18.679448] [INFO ] [MAIN ] SPMC: Generated 1820 derivative records from 5613 primary records. [2025-09-26T22:28:18.679832] [DEBUG] [LOCAL ] SPMC: Saving derivative data. [2025-09-26T22:28:18.697524] [DEBUG] [LOCAL ] SPMC: Derivative data saved (1820 records). [2025-09-26T22:28:18.697855] [INFO ] [MAIN ] SPMC: Successfully saved derivative data. [2025-09-26T22:28:18.699882] [INFO ] [MAIN ] Derivative Progress: 1708/2074 symbols completed. SPMC took 1.2s. Estimated remaining: 2m 32s. Rate: 144.2 symbols/min [2025-09-26T22:28:18.718585] [DEBUG] [MAIN ] SPIR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:18.719447] [INFO ] [MAIN ] SPIR: Generated 1820 derivative records from 37871 primary records. [2025-09-26T22:28:18.719683] [DEBUG] [LOCAL ] SPIR: Saving derivative data. [2025-09-26T22:28:18.740175] [DEBUG] [LOCAL ] SPIR: Derivative data saved (1820 records). [2025-09-26T22:28:18.740510] [INFO ] [MAIN ] SPIR: Successfully saved derivative data. [2025-09-26T22:28:18.755873] [INFO ] [MAIN ] Derivative Progress: 1709/2074 symbols completed. SPIR took 1.2s. Estimated remaining: 2m 32s. Rate: 144.3 symbols/min [2025-09-26T22:28:18.756465] [DEBUG] [MAIN ] SPHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:18.757428] [INFO ] [MAIN ] SPHR: Generated 1820 derivative records from 40745 primary records. [2025-09-26T22:28:18.757621] [DEBUG] [LOCAL ] SPHR: Saving derivative data. [2025-09-26T22:28:18.772913] [DEBUG] [LOCAL ] SPHR: Derivative data saved (1820 records). [2025-09-26T22:28:18.772985] [INFO ] [MAIN ] SPHR: Successfully saved derivative data. [2025-09-26T22:28:18.775860] [INFO ] [MAIN ] Derivative Progress: 1710/2074 symbols completed. SPHR took 1.3s. Estimated remaining: 2m 31s. Rate: 144.4 symbols/min [2025-09-26T22:28:18.776375] [INFO ] [MAIN ] SPNT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:18.776506] [INFO ] [MAIN ] SPOT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:18.777057] [INFO ] [MAIN ] SPR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:18.825410] [DEBUG] [LOCAL ] SPNT: Loaded 35342 existing records from primary storage. [2025-09-26T22:28:18.825555] [INFO ] [MAIN ] SPNT: Loaded 35342 primary data records. [2025-09-26T22:28:18.964125] [DEBUG] [LOCAL ] SPR: Loaded 41867 existing records from primary storage. [2025-09-26T22:28:18.999556] [INFO ] [MAIN ] SPR: Loaded 41867 primary data records. [2025-09-26T22:28:19.075692] [DEBUG] [LOCAL ] SPOT: Loaded 51481 existing records from primary storage. [2025-09-26T22:28:19.116401] [INFO ] [MAIN ] SPOT: Loaded 51481 primary data records. [2025-09-26T22:28:19.887695] [DEBUG] [MAIN ] SPNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:19.889132] [INFO ] [MAIN ] SPNT: Generated 1820 derivative records from 35342 primary records. [2025-09-26T22:28:19.889374] [DEBUG] [LOCAL ] SPNT: Saving derivative data. [2025-09-26T22:28:19.910888] [DEBUG] [LOCAL ] SPNT: Derivative data saved (1820 records). [2025-09-26T22:28:19.911288] [INFO ] [MAIN ] SPNT: Successfully saved derivative data. [2025-09-26T22:28:19.914164] [INFO ] [MAIN ] Derivative Progress: 1711/2074 symbols completed. SPNT took 1.1s. Estimated remaining: 2m 31s. Rate: 144.2 symbols/min [2025-09-26T22:28:19.917578] [INFO ] [MAIN ] SPRU: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:19.934314] [DEBUG] [MAIN ] SPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:19.942159] [INFO ] [MAIN ] SPR: Generated 1820 derivative records from 41867 primary records. [2025-09-26T22:28:19.942524] [DEBUG] [LOCAL ] SPR: Saving derivative data. [2025-09-26T22:28:19.975063] [DEBUG] [LOCAL ] SPRU: Loaded 8714 existing records from primary storage. [2025-09-26T22:28:19.974721] [DEBUG] [MAIN ] SPOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:19.977100] [INFO ] [MAIN ] SPRU: Loaded 8714 primary data records. [2025-09-26T22:28:19.977266] [INFO ] [MAIN ] SPOT: Generated 1820 derivative records from 51481 primary records. [2025-09-26T22:28:20.005352] [DEBUG] [LOCAL ] SPR: Derivative data saved (1820 records). [2025-09-26T22:28:20.021842] [INFO ] [MAIN ] SPR: Successfully saved derivative data. [2025-09-26T22:28:20.037378] [INFO ] [MAIN ] Derivative Progress: 1712/2074 symbols completed. SPR took 1.3s. Estimated remaining: 2m 31s. Rate: 144.3 symbols/min [2025-09-26T22:28:20.016366] [DEBUG] [LOCAL ] SPOT: Saving derivative data. [2025-09-26T22:28:20.056455] [INFO ] [MAIN ] SPXC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:20.119876] [DEBUG] [LOCAL ] SPOT: Derivative data saved (1820 records). [2025-09-26T22:28:20.125346] [INFO ] [MAIN ] SPOT: Successfully saved derivative data. [2025-09-26T22:28:20.128932] [INFO ] [MAIN ] Derivative Progress: 1713/2074 symbols completed. SPOT took 1.4s. Estimated remaining: 2m 30s. Rate: 144.3 symbols/min [2025-09-26T22:28:20.150823] [INFO ] [MAIN ] SPXX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:20.356719] [DEBUG] [LOCAL ] SPXX: Loaded 9166 existing records from primary storage. [2025-09-26T22:28:20.356978] [INFO ] [MAIN ] SPXX: Loaded 9166 primary data records. [2025-09-26T22:28:20.459924] [DEBUG] [LOCAL ] SPXC: Loaded 23666 existing records from primary storage. [2025-09-26T22:28:20.471182] [INFO ] [MAIN ] SPXC: Loaded 23666 primary data records. [2025-09-26T22:28:21.130191] [DEBUG] [MAIN ] SPRU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:21.131427] [INFO ] [MAIN ] SPRU: Generated 1820 derivative records from 8714 primary records. [2025-09-26T22:28:21.132366] [DEBUG] [LOCAL ] SPRU: Saving derivative data. [2025-09-26T22:28:21.154880] [DEBUG] [LOCAL ] SPRU: Derivative data saved (1820 records). [2025-09-26T22:28:21.155167] [INFO ] [MAIN ] SPRU: Successfully saved derivative data. [2025-09-26T22:28:21.158542] [INFO ] [MAIN ] Derivative Progress: 1714/2074 symbols completed. SPRU took 1.2s. Estimated remaining: 2m 30s. Rate: 144.2 symbols/min [2025-09-26T22:28:21.159399] [INFO ] [MAIN ] SQM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:21.178314] [DEBUG] [MAIN ] SPXX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:21.179130] [INFO ] [MAIN ] SPXX: Generated 1820 derivative records from 9166 primary records. [2025-09-26T22:28:21.179493] [DEBUG] [LOCAL ] SPXX: Saving derivative data. [2025-09-26T22:28:21.198833] [DEBUG] [LOCAL ] SPXX: Derivative data saved (1820 records). [2025-09-26T22:28:21.199589] [INFO ] [MAIN ] SPXX: Successfully saved derivative data. [2025-09-26T22:28:21.202683] [INFO ] [MAIN ] Derivative Progress: 1715/2074 symbols completed. SPXX took 1.1s. Estimated remaining: 2m 29s. Rate: 144.3 symbols/min [2025-09-26T22:28:21.216303] [INFO ] [MAIN ] SQNS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:21.216732] [DEBUG] [MAIN ] SPXC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:21.218025] [INFO ] [MAIN ] SPXC: Generated 1820 derivative records from 23666 primary records. [2025-09-26T22:28:21.218677] [DEBUG] [LOCAL ] SPXC: Saving derivative data. [2025-09-26T22:28:21.247039] [DEBUG] [LOCAL ] SPXC: Derivative data saved (1820 records). [2025-09-26T22:28:21.247195] [INFO ] [MAIN ] SPXC: Successfully saved derivative data. [2025-09-26T22:28:21.249910] [INFO ] [MAIN ] Derivative Progress: 1716/2074 symbols completed. SPXC took 1.2s. Estimated remaining: 2m 29s. Rate: 144.4 symbols/min [2025-09-26T22:28:21.250282] [INFO ] [MAIN ] SR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:21.284242] [DEBUG] [LOCAL ] SQNS: Loaded 26307 existing records from primary storage. [2025-09-26T22:28:21.284424] [INFO ] [MAIN ] SQNS: Loaded 26307 primary data records. [2025-09-26T22:28:21.285360] [DEBUG] [LOCAL ] SQM: Loaded 49278 existing records from primary storage. [2025-09-26T22:28:21.285504] [INFO ] [MAIN ] SQM: Loaded 49278 primary data records. [2025-09-26T22:28:21.709275] [DEBUG] [LOCAL ] SR: Loaded 33411 existing records from primary storage. [2025-09-26T22:28:21.850264] [INFO ] [MAIN ] SR: Loaded 33411 primary data records. [2025-09-26T22:28:22.434309] [DEBUG] [MAIN ] SQNS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:22.435378] [INFO ] [MAIN ] SQNS: Generated 1820 derivative records from 26307 primary records. [2025-09-26T22:28:22.433010] [DEBUG] [MAIN ] SQM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:22.435554] [DEBUG] [LOCAL ] SQNS: Saving derivative data. [2025-09-26T22:28:22.436227] [INFO ] [MAIN ] SQM: Generated 1820 derivative records from 49278 primary records. [2025-09-26T22:28:22.437217] [DEBUG] [LOCAL ] SQM: Saving derivative data. [2025-09-26T22:28:22.467243] [DEBUG] [LOCAL ] SQNS: Derivative data saved (1820 records). [2025-09-26T22:28:22.468021] [INFO ] [MAIN ] SQNS: Successfully saved derivative data. [2025-09-26T22:28:22.471697] [INFO ] [MAIN ] Derivative Progress: 1717/2074 symbols completed. SQNS took 1.3s. Estimated remaining: 2m 29s. Rate: 144.2 symbols/min [2025-09-26T22:28:22.472217] [INFO ] [MAIN ] SRE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:22.478195] [DEBUG] [LOCAL ] SQM: Derivative data saved (1820 records). [2025-09-26T22:28:22.478476] [INFO ] [MAIN ] SQM: Successfully saved derivative data. [2025-09-26T22:28:22.480721] [INFO ] [MAIN ] Derivative Progress: 1718/2074 symbols completed. SQM took 1.3s. Estimated remaining: 2m 28s. Rate: 144.3 symbols/min [2025-09-26T22:28:22.488970] [INFO ] [MAIN ] SREA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:22.494910] [DEBUG] [MAIN ] SR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:22.495769] [INFO ] [MAIN ] SR: Generated 1820 derivative records from 33411 primary records. [2025-09-26T22:28:22.495925] [DEBUG] [LOCAL ] SR: Saving derivative data. [2025-09-26T22:28:22.516419] [DEBUG] [LOCAL ] SR: Derivative data saved (1820 records). [2025-09-26T22:28:22.516571] [INFO ] [MAIN ] SR: Successfully saved derivative data. [2025-09-26T22:28:22.519489] [INFO ] [MAIN ] Derivative Progress: 1719/2074 symbols completed. SR took 1.3s. Estimated remaining: 2m 28s. Rate: 144.4 symbols/min [2025-09-26T22:28:22.519882] [INFO ] [MAIN ] SRFM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:22.525935] [DEBUG] [LOCAL ] SREA: Loaded 10561 existing records from primary storage. [2025-09-26T22:28:22.526255] [INFO ] [MAIN ] SREA: Loaded 10561 primary data records. [2025-09-26T22:28:22.887969] [DEBUG] [LOCAL ] SRFM: Loaded 36431 existing records from primary storage. [2025-09-26T22:28:22.935980] [INFO ] [MAIN ] SRFM: Loaded 36431 primary data records. [2025-09-26T22:28:22.950277] [DEBUG] [LOCAL ] SRE: Loaded 54202 existing records from primary storage. [2025-09-26T22:28:22.993016] [INFO ] [MAIN ] SRE: Loaded 54202 primary data records. [2025-09-26T22:28:23.655287] [DEBUG] [MAIN ] SREA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:23.656576] [INFO ] [MAIN ] SREA: Generated 1820 derivative records from 10561 primary records. [2025-09-26T22:28:23.656837] [DEBUG] [LOCAL ] SREA: Saving derivative data. [2025-09-26T22:28:23.680562] [DEBUG] [LOCAL ] SREA: Derivative data saved (1820 records). [2025-09-26T22:28:23.681111] [INFO ] [MAIN ] SREA: Successfully saved derivative data. [2025-09-26T22:28:23.683549] [INFO ] [MAIN ] Derivative Progress: 1720/2074 symbols completed. SREA took 1.2s. Estimated remaining: 2m 27s. Rate: 144.2 symbols/min [2025-09-26T22:28:23.684180] [INFO ] [MAIN ] SRI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:23.707864] [DEBUG] [MAIN ] SRFM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:23.721361] [INFO ] [MAIN ] SRFM: Generated 1820 derivative records from 36431 primary records. [2025-09-26T22:28:23.722518] [DEBUG] [LOCAL ] SRFM: Saving derivative data. [2025-09-26T22:28:23.722435] [DEBUG] [MAIN ] SRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:23.723981] [INFO ] [MAIN ] SRE: Generated 1820 derivative records from 54202 primary records. [2025-09-26T22:28:23.724308] [DEBUG] [LOCAL ] SRE: Saving derivative data. [2025-09-26T22:28:23.770934] [DEBUG] [LOCAL ] SRI: Loaded 27810 existing records from primary storage. [2025-09-26T22:28:23.772387] [INFO ] [MAIN ] SRI: Loaded 27810 primary data records. [2025-09-26T22:28:23.779321] [DEBUG] [LOCAL ] SRE: Derivative data saved (1820 records). [2025-09-26T22:28:23.786457] [INFO ] [MAIN ] SRE: Successfully saved derivative data. [2025-09-26T22:28:23.801050] [INFO ] [MAIN ] Derivative Progress: 1721/2074 symbols completed. SRE took 1.3s. Estimated remaining: 2m 27s. Rate: 144.3 symbols/min [2025-09-26T22:28:23.797865] [DEBUG] [LOCAL ] SRFM: Derivative data saved (1820 records). [2025-09-26T22:28:23.801493] [INFO ] [MAIN ] SRFM: Successfully saved derivative data. [2025-09-26T22:28:23.816104] [INFO ] [MAIN ] SRV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:23.815973] [INFO ] [MAIN ] Derivative Progress: 1722/2074 symbols completed. SRFM took 1.3s. Estimated remaining: 2m 26s. Rate: 144.3 symbols/min [2025-09-26T22:28:23.843807] [INFO ] [MAIN ] SSB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:23.980317] [DEBUG] [LOCAL ] SRV: Loaded 7631 existing records from primary storage. [2025-09-26T22:28:24.041314] [INFO ] [MAIN ] SRV: Loaded 7631 primary data records. [2025-09-26T22:28:24.466710] [DEBUG] [LOCAL ] SSB: Loaded 43377 existing records from primary storage. [2025-09-26T22:28:24.467364] [INFO ] [MAIN ] SSB: Loaded 43377 primary data records. [2025-09-26T22:28:24.701129] [DEBUG] [MAIN ] SRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:24.729007] [INFO ] [MAIN ] SRI: Generated 1820 derivative records from 27810 primary records. [2025-09-26T22:28:24.729534] [DEBUG] [LOCAL ] SRI: Saving derivative data. [2025-09-26T22:28:24.933594] [DEBUG] [LOCAL ] SRI: Derivative data saved (1820 records). [2025-09-26T22:28:24.934432] [INFO ] [MAIN ] SRI: Successfully saved derivative data. [2025-09-26T22:28:24.936879] [INFO ] [MAIN ] Derivative Progress: 1723/2074 symbols completed. SRI took 1.3s. Estimated remaining: 2m 26s. Rate: 144.2 symbols/min [2025-09-26T22:28:24.951708] [DEBUG] [MAIN ] SRV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:24.952922] [INFO ] [MAIN ] SRV: Generated 1820 derivative records from 7631 primary records. [2025-09-26T22:28:24.952987] [DEBUG] [LOCAL ] SRV: Saving derivative data. [2025-09-26T22:28:24.971101] [DEBUG] [LOCAL ] SRV: Derivative data saved (1820 records). [2025-09-26T22:28:24.971462] [INFO ] [MAIN ] SRV: Successfully saved derivative data. [2025-09-26T22:28:24.974458] [INFO ] [MAIN ] Derivative Progress: 1724/2074 symbols completed. SRV took 1.2s. Estimated remaining: 2m 26s. Rate: 144.3 symbols/min [2025-09-26T22:28:24.992285] [DEBUG] [MAIN ] SSB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:24.993036] [INFO ] [MAIN ] SSB: Generated 1820 derivative records from 43377 primary records. [2025-09-26T22:28:24.993100] [DEBUG] [LOCAL ] SSB: Saving derivative data. [2025-09-26T22:28:25.009635] [DEBUG] [LOCAL ] SSB: Derivative data saved (1820 records). [2025-09-26T22:28:25.009760] [INFO ] [MAIN ] SSB: Successfully saved derivative data. [2025-09-26T22:28:25.012300] [INFO ] [MAIN ] Derivative Progress: 1725/2074 symbols completed. SSB took 1.2s. Estimated remaining: 2m 25s. Rate: 144.4 symbols/min [2025-09-26T22:28:25.013167] [INFO ] [MAIN ] SSL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:25.013020] [INFO ] [MAIN ] SSD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:25.013530] [INFO ] [MAIN ] SST: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:25.029274] [DEBUG] [LOCAL ] SST: Loaded 12166 existing records from primary storage. [2025-09-26T22:28:25.029476] [INFO ] [MAIN ] SST: Loaded 12166 primary data records. [2025-09-26T22:28:25.178847] [DEBUG] [LOCAL ] SSD: Loaded 22631 existing records from primary storage. [2025-09-26T22:28:25.184425] [INFO ] [MAIN ] SSD: Loaded 22631 primary data records. [2025-09-26T22:28:25.241065] [DEBUG] [LOCAL ] SSL: Loaded 41830 existing records from primary storage. [2025-09-26T22:28:25.314476] [INFO ] [MAIN ] SSL: Loaded 41830 primary data records. [2025-09-26T22:28:26.100923] [DEBUG] [MAIN ] SST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:26.102271] [INFO ] [MAIN ] SST: Generated 1820 derivative records from 12166 primary records. [2025-09-26T22:28:26.102489] [DEBUG] [LOCAL ] SST: Saving derivative data. [2025-09-26T22:28:26.138201] [DEBUG] [MAIN ] SSD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:26.140130] [INFO ] [MAIN ] SSD: Generated 1820 derivative records from 22631 primary records. [2025-09-26T22:28:26.141277] [DEBUG] [LOCAL ] SSD: Saving derivative data. [2025-09-26T22:28:26.143440] [DEBUG] [LOCAL ] SST: Derivative data saved (1820 records). [2025-09-26T22:28:26.143814] [INFO ] [MAIN ] SST: Successfully saved derivative data. [2025-09-26T22:28:26.162738] [INFO ] [MAIN ] Derivative Progress: 1726/2074 symbols completed. SST took 1.1s. Estimated remaining: 2m 25s. Rate: 144.2 symbols/min [2025-09-26T22:28:26.164940] [INFO ] [MAIN ] SSTK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:26.170060] [DEBUG] [LOCAL ] SSD: Derivative data saved (1820 records). [2025-09-26T22:28:26.172076] [INFO ] [MAIN ] SSD: Successfully saved derivative data. [2025-09-26T22:28:26.175082] [INFO ] [MAIN ] Derivative Progress: 1727/2074 symbols completed. SSD took 1.2s. Estimated remaining: 2m 24s. Rate: 144.3 symbols/min [2025-09-26T22:28:26.175711] [INFO ] [MAIN ] ST: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:26.191557] [DEBUG] [MAIN ] SSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:26.192383] [INFO ] [MAIN ] SSL: Generated 1820 derivative records from 41830 primary records. [2025-09-26T22:28:26.192566] [DEBUG] [LOCAL ] SSL: Saving derivative data. [2025-09-26T22:28:26.210742] [DEBUG] [LOCAL ] SSL: Derivative data saved (1820 records). [2025-09-26T22:28:26.210918] [INFO ] [MAIN ] SSL: Successfully saved derivative data. [2025-09-26T22:28:26.214061] [INFO ] [MAIN ] Derivative Progress: 1728/2074 symbols completed. SSL took 1.2s. Estimated remaining: 2m 24s. Rate: 144.4 symbols/min [2025-09-26T22:28:26.215157] [INFO ] [MAIN ] STAG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:26.242863] [DEBUG] [LOCAL ] SSTK: Loaded 26762 existing records from primary storage. [2025-09-26T22:28:26.243093] [INFO ] [MAIN ] SSTK: Loaded 26762 primary data records. [2025-09-26T22:28:26.587709] [DEBUG] [LOCAL ] ST: Loaded 50505 existing records from primary storage. [2025-09-26T22:28:26.616825] [INFO ] [MAIN ] ST: Loaded 50505 primary data records. [2025-09-26T22:28:26.758905] [DEBUG] [LOCAL ] STAG: Loaded 50799 existing records from primary storage. [2025-09-26T22:28:26.764386] [INFO ] [MAIN ] STAG: Loaded 50799 primary data records. [2025-09-26T22:28:27.378005] [DEBUG] [MAIN ] SSTK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:27.379704] [INFO ] [MAIN ] SSTK: Generated 1820 derivative records from 26762 primary records. [2025-09-26T22:28:27.380110] [DEBUG] [LOCAL ] SSTK: Saving derivative data. [2025-09-26T22:28:27.421210] [DEBUG] [MAIN ] ST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:27.423188] [INFO ] [MAIN ] ST: Generated 1820 derivative records from 50505 primary records. [2025-09-26T22:28:27.422060] [DEBUG] [LOCAL ] SSTK: Derivative data saved (1820 records). [2025-09-26T22:28:27.423631] [INFO ] [MAIN ] SSTK: Successfully saved derivative data. [2025-09-26T22:28:27.423542] [DEBUG] [LOCAL ] ST: Saving derivative data. [2025-09-26T22:28:27.426365] [INFO ] [MAIN ] Derivative Progress: 1729/2074 symbols completed. SSTK took 1.3s. Estimated remaining: 2m 24s. Rate: 144.2 symbols/min [2025-09-26T22:28:27.442710] [INFO ] [MAIN ] STC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:27.450172] [DEBUG] [LOCAL ] ST: Derivative data saved (1820 records). [2025-09-26T22:28:27.450479] [INFO ] [MAIN ] ST: Successfully saved derivative data. [2025-09-26T22:28:27.453473] [INFO ] [MAIN ] Derivative Progress: 1730/2074 symbols completed. ST took 1.3s. Estimated remaining: 2m 23s. Rate: 144.3 symbols/min [2025-09-26T22:28:27.455008] [INFO ] [MAIN ] STE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:27.471003] [DEBUG] [MAIN ] STAG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:27.471766] [INFO ] [MAIN ] STAG: Generated 1820 derivative records from 50799 primary records. [2025-09-26T22:28:27.471896] [DEBUG] [LOCAL ] STAG: Saving derivative data. [2025-09-26T22:28:27.499223] [DEBUG] [LOCAL ] STAG: Derivative data saved (1820 records). [2025-09-26T22:28:27.500820] [INFO ] [MAIN ] STAG: Successfully saved derivative data. [2025-09-26T22:28:27.504509] [INFO ] [MAIN ] Derivative Progress: 1731/2074 symbols completed. STAG took 1.3s. Estimated remaining: 2m 23s. Rate: 144.4 symbols/min [2025-09-26T22:28:27.504930] [INFO ] [MAIN ] STEL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:27.501357] [DEBUG] [LOCAL ] STC: Loaded 17878 existing records from primary storage. [2025-09-26T22:28:27.505267] [INFO ] [MAIN ] STC: Loaded 17878 primary data records. [2025-09-26T22:28:27.659456] [DEBUG] [LOCAL ] STE: Loaded 35822 existing records from primary storage. [2025-09-26T22:28:27.671146] [INFO ] [MAIN ] STE: Loaded 35822 primary data records. [2025-09-26T22:28:27.770447] [DEBUG] [LOCAL ] STEL: Loaded 23823 existing records from primary storage. [2025-09-26T22:28:27.971416] [INFO ] [MAIN ] STEL: Loaded 23823 primary data records. [2025-09-26T22:28:28.568754] [DEBUG] [MAIN ] STC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:28.570111] [INFO ] [MAIN ] STC: Generated 1820 derivative records from 17878 primary records. [2025-09-26T22:28:28.570316] [DEBUG] [LOCAL ] STC: Saving derivative data. [2025-09-26T22:28:28.588418] [DEBUG] [LOCAL ] STC: Derivative data saved (1820 records). [2025-09-26T22:28:28.589593] [INFO ] [MAIN ] STC: Successfully saved derivative data. [2025-09-26T22:28:28.592130] [INFO ] [MAIN ] Derivative Progress: 1732/2074 symbols completed. STC took 1.2s. Estimated remaining: 2m 22s. Rate: 144.2 symbols/min [2025-09-26T22:28:28.592620] [INFO ] [MAIN ] STEM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:28.610292] [DEBUG] [MAIN ] STE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:28.611152] [INFO ] [MAIN ] STE: Generated 1820 derivative records from 35822 primary records. [2025-09-26T22:28:28.611323] [DEBUG] [LOCAL ] STE: Saving derivative data. [2025-09-26T22:28:28.631814] [DEBUG] [LOCAL ] STE: Derivative data saved (1820 records). [2025-09-26T22:28:28.644930] [INFO ] [MAIN ] STE: Successfully saved derivative data. [2025-09-26T22:28:28.645123] [DEBUG] [MAIN ] STEL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:28.646008] [INFO ] [MAIN ] STEL: Generated 1820 derivative records from 23823 primary records. [2025-09-26T22:28:28.648760] [INFO ] [MAIN ] Derivative Progress: 1733/2074 symbols completed. STE took 1.2s. Estimated remaining: 2m 22s. Rate: 144.3 symbols/min [2025-09-26T22:28:28.648837] [DEBUG] [LOCAL ] STEL: Saving derivative data. [2025-09-26T22:28:28.659063] [INFO ] [MAIN ] STEW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:28.675352] [DEBUG] [LOCAL ] STEL: Derivative data saved (1820 records). [2025-09-26T22:28:28.676309] [INFO ] [MAIN ] STEL: Successfully saved derivative data. [2025-09-26T22:28:28.679172] [INFO ] [MAIN ] Derivative Progress: 1734/2074 symbols completed. STEL took 1.2s. Estimated remaining: 2m 21s. Rate: 144.4 symbols/min [2025-09-26T22:28:28.691225] [INFO ] [MAIN ] STK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:28.696466] [DEBUG] [LOCAL ] STEM: Loaded 40374 existing records from primary storage. [2025-09-26T22:28:28.696743] [INFO ] [MAIN ] STEM: Loaded 40374 primary data records. [2025-09-26T22:28:28.793065] [DEBUG] [LOCAL ] STEW: Loaded 16354 existing records from primary storage. [2025-09-26T22:28:28.822882] [INFO ] [MAIN ] STEW: Loaded 16354 primary data records. [2025-09-26T22:28:28.822800] [DEBUG] [LOCAL ] STK: Loaded 9550 existing records from primary storage. [2025-09-26T22:28:28.844479] [INFO ] [MAIN ] STK: Loaded 9550 primary data records. [2025-09-26T22:28:29.762307] [DEBUG] [MAIN ] STEM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:29.763524] [INFO ] [MAIN ] STEM: Generated 1820 derivative records from 40374 primary records. [2025-09-26T22:28:29.763955] [DEBUG] [LOCAL ] STEM: Saving derivative data. [2025-09-26T22:28:29.785057] [DEBUG] [LOCAL ] STEM: Derivative data saved (1820 records). [2025-09-26T22:28:29.787885] [INFO ] [MAIN ] STEM: Successfully saved derivative data. [2025-09-26T22:28:29.791866] [INFO ] [MAIN ] Derivative Progress: 1735/2074 symbols completed. STEM took 1.2s. Estimated remaining: 2m 21s. Rate: 144.2 symbols/min [2025-09-26T22:28:29.800747] [INFO ] [MAIN ] STLA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:29.819334] [DEBUG] [MAIN ] STK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:29.819612] [DEBUG] [MAIN ] STEW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:29.820628] [INFO ] [MAIN ] STK: Generated 1820 derivative records from 9550 primary records. [2025-09-26T22:28:29.820936] [DEBUG] [LOCAL ] STK: Saving derivative data. [2025-09-26T22:28:29.822319] [INFO ] [MAIN ] STEW: Generated 1820 derivative records from 16354 primary records. [2025-09-26T22:28:29.823843] [DEBUG] [LOCAL ] STEW: Saving derivative data. [2025-09-26T22:28:29.854038] [DEBUG] [LOCAL ] STK: Derivative data saved (1820 records). [2025-09-26T22:28:29.858256] [INFO ] [MAIN ] STK: Successfully saved derivative data. [2025-09-26T22:28:29.861948] [DEBUG] [LOCAL ] STEW: Derivative data saved (1820 records). [2025-09-26T22:28:29.861546] [INFO ] [MAIN ] Derivative Progress: 1736/2074 symbols completed. STK took 1.2s. Estimated remaining: 2m 21s. Rate: 144.3 symbols/min [2025-09-26T22:28:29.862270] [INFO ] [MAIN ] STEW: Successfully saved derivative data. [2025-09-26T22:28:29.866963] [INFO ] [MAIN ] Derivative Progress: 1737/2074 symbols completed. STEW took 1.2s. Estimated remaining: 2m 20s. Rate: 144.4 symbols/min [2025-09-26T22:28:29.867725] [INFO ] [MAIN ] STN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:29.867326] [INFO ] [MAIN ] STM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:29.907374] [DEBUG] [LOCAL ] STN: Loaded 23436 existing records from primary storage. [2025-09-26T22:28:29.908455] [INFO ] [MAIN ] STN: Loaded 23436 primary data records. [2025-09-26T22:28:30.013665] [DEBUG] [LOCAL ] STLA: Loaded 54322 existing records from primary storage. [2025-09-26T22:28:30.040590] [INFO ] [MAIN ] STLA: Loaded 54322 primary data records. [2025-09-26T22:28:30.412722] [DEBUG] [LOCAL ] STM: Loaded 54362 existing records from primary storage. [2025-09-26T22:28:30.434404] [INFO ] [MAIN ] STM: Loaded 54362 primary data records. [2025-09-26T22:28:30.968043] [DEBUG] [MAIN ] STN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:30.970517] [INFO ] [MAIN ] STN: Generated 1820 derivative records from 23436 primary records. [2025-09-26T22:28:30.970943] [DEBUG] [LOCAL ] STN: Saving derivative data. [2025-09-26T22:28:30.995765] [DEBUG] [LOCAL ] STN: Derivative data saved (1820 records). [2025-09-26T22:28:30.996096] [INFO ] [MAIN ] STN: Successfully saved derivative data. [2025-09-26T22:28:30.998743] [INFO ] [MAIN ] Derivative Progress: 1738/2074 symbols completed. STN took 1.1s. Estimated remaining: 2m 20s. Rate: 144.2 symbols/min [2025-09-26T22:28:31.013571] [DEBUG] [MAIN ] STLA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:31.014897] [INFO ] [MAIN ] STLA: Generated 1820 derivative records from 54322 primary records. [2025-09-26T22:28:31.016110] [DEBUG] [LOCAL ] STLA: Saving derivative data. [2025-09-26T22:28:31.049954] [DEBUG] [MAIN ] STM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:31.050051] [DEBUG] [LOCAL ] STLA: Derivative data saved (1820 records). [2025-09-26T22:28:31.050308] [INFO ] [MAIN ] STLA: Successfully saved derivative data. [2025-09-26T22:28:31.053113] [INFO ] [MAIN ] Derivative Progress: 1739/2074 symbols completed. STLA took 1.3s. Estimated remaining: 2m 19s. Rate: 144.3 symbols/min [2025-09-26T22:28:31.054044] [INFO ] [MAIN ] STM: Generated 1820 derivative records from 54362 primary records. [2025-09-26T22:28:31.054372] [DEBUG] [LOCAL ] STM: Saving derivative data. [2025-09-26T22:28:31.072098] [DEBUG] [LOCAL ] STM: Derivative data saved (1820 records). [2025-09-26T22:28:31.072219] [INFO ] [MAIN ] STM: Successfully saved derivative data. [2025-09-26T22:28:31.075277] [INFO ] [MAIN ] Derivative Progress: 1740/2074 symbols completed. STM took 1.2s. Estimated remaining: 2m 19s. Rate: 144.4 symbols/min [2025-09-26T22:28:31.076422] [INFO ] [MAIN ] STRV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:31.076070] [INFO ] [MAIN ] STNG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:31.076607] [INFO ] [MAIN ] STT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:31.092142] [DEBUG] [LOCAL ] STRV: Loaded 11754 existing records from primary storage. [2025-09-26T22:28:31.092379] [INFO ] [MAIN ] STRV: Loaded 11754 primary data records. [2025-09-26T22:28:31.467115] [DEBUG] [LOCAL ] STNG: Loaded 44620 existing records from primary storage. [2025-09-26T22:28:31.496883] [INFO ] [MAIN ] STNG: Loaded 44620 primary data records. [2025-09-26T22:28:31.504007] [DEBUG] [LOCAL ] STT: Loaded 51793 existing records from primary storage. [2025-09-26T22:28:31.513467] [INFO ] [MAIN ] STT: Loaded 51793 primary data records. [2025-09-26T22:28:32.247149] [DEBUG] [MAIN ] STRV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:32.249057] [INFO ] [MAIN ] STRV: Generated 1820 derivative records from 11754 primary records. [2025-09-26T22:28:32.249847] [DEBUG] [LOCAL ] STRV: Saving derivative data. [2025-09-26T22:28:32.271545] [DEBUG] [LOCAL ] STRV: Derivative data saved (1820 records). [2025-09-26T22:28:32.271749] [INFO ] [MAIN ] STRV: Successfully saved derivative data. [2025-09-26T22:28:32.274729] [INFO ] [MAIN ] Derivative Progress: 1741/2074 symbols completed. STRV took 1.2s. Estimated remaining: 2m 19s. Rate: 144.2 symbols/min [2025-09-26T22:28:32.275157] [INFO ] [MAIN ] STVN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:32.327067] [DEBUG] [MAIN ] STNG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:32.327763] [DEBUG] [MAIN ] STT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:32.329002] [INFO ] [MAIN ] STNG: Generated 1820 derivative records from 44620 primary records. [2025-09-26T22:28:32.330136] [INFO ] [MAIN ] STT: Generated 1820 derivative records from 51793 primary records. [2025-09-26T22:28:32.339713] [DEBUG] [LOCAL ] STNG: Saving derivative data. [2025-09-26T22:28:32.339572] [DEBUG] [LOCAL ] STT: Saving derivative data. [2025-09-26T22:28:32.341321] [DEBUG] [LOCAL ] STVN: Loaded 26677 existing records from primary storage. [2025-09-26T22:28:32.350208] [INFO ] [MAIN ] STVN: Loaded 26677 primary data records. [2025-09-26T22:28:32.389228] [DEBUG] [LOCAL ] STNG: Derivative data saved (1820 records). [2025-09-26T22:28:32.418340] [INFO ] [MAIN ] STNG: Successfully saved derivative data. [2025-09-26T22:28:32.400989] [DEBUG] [LOCAL ] STT: Derivative data saved (1820 records). [2025-09-26T22:28:32.444167] [INFO ] [MAIN ] STT: Successfully saved derivative data. [2025-09-26T22:28:32.443981] [INFO ] [MAIN ] Derivative Progress: 1742/2074 symbols completed. STNG took 1.4s. Estimated remaining: 2m 18s. Rate: 144.3 symbols/min [2025-09-26T22:28:32.481304] [INFO ] [MAIN ] STWD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:32.486689] [INFO ] [MAIN ] Derivative Progress: 1743/2074 symbols completed. STT took 1.4s. Estimated remaining: 2m 18s. Rate: 144.4 symbols/min [2025-09-26T22:28:32.503164] [INFO ] [MAIN ] STXD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:32.557781] [DEBUG] [LOCAL ] STXD: Loaded 1341 existing records from primary storage. [2025-09-26T22:28:32.558023] [INFO ] [MAIN ] STXD: Loaded 1341 primary data records. [2025-09-26T22:28:33.070412] [DEBUG] [LOCAL ] STWD: Loaded 52643 existing records from primary storage. [2025-09-26T22:28:33.085778] [INFO ] [MAIN ] STWD: Loaded 52643 primary data records. [2025-09-26T22:28:33.508749] [DEBUG] [MAIN ] STVN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:33.509954] [INFO ] [MAIN ] STVN: Generated 1820 derivative records from 26677 primary records. [2025-09-26T22:28:33.510318] [DEBUG] [LOCAL ] STVN: Saving derivative data. [2025-09-26T22:28:33.536068] [DEBUG] [LOCAL ] STVN: Derivative data saved (1820 records). [2025-09-26T22:28:33.536372] [INFO ] [MAIN ] STVN: Successfully saved derivative data. [2025-09-26T22:28:33.539440] [INFO ] [MAIN ] Derivative Progress: 1744/2074 symbols completed. STVN took 1.3s. Estimated remaining: 2m 17s. Rate: 144.2 symbols/min [2025-09-26T22:28:33.540403] [INFO ] [MAIN ] STXE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:33.556157] [DEBUG] [MAIN ] STXD: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:28:33.558259] [INFO ] [MAIN ] STXD: Generated 1819 derivative records from 1341 primary records. [2025-09-26T22:28:33.558620] [DEBUG] [LOCAL ] STXD: Saving derivative data. [2025-09-26T22:28:33.567774] [DEBUG] [LOCAL ] STXE: Loaded 2234 existing records from primary storage. [2025-09-26T22:28:33.576009] [DEBUG] [LOCAL ] STXD: Derivative data saved (1819 records). [2025-09-26T22:28:33.572396] [INFO ] [MAIN ] STXE: Loaded 2234 primary data records. [2025-09-26T22:28:33.588315] [INFO ] [MAIN ] STXD: Successfully saved derivative data. [2025-09-26T22:28:33.649074] [INFO ] [MAIN ] Derivative Progress: 1745/2074 symbols completed. STXD took 1.1s. Estimated remaining: 2m 17s. Rate: 144.3 symbols/min [2025-09-26T22:28:33.672586] [INFO ] [MAIN ] STXG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:33.757918] [DEBUG] [MAIN ] STWD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:33.796246] [INFO ] [MAIN ] STWD: Generated 1820 derivative records from 52643 primary records. [2025-09-26T22:28:33.767582] [DEBUG] [LOCAL ] STXG: Loaded 2612 existing records from primary storage. [2025-09-26T22:28:33.803292] [DEBUG] [LOCAL ] STWD: Saving derivative data. [2025-09-26T22:28:33.804297] [INFO ] [MAIN ] STXG: Loaded 2612 primary data records. [2025-09-26T22:28:34.036359] [DEBUG] [LOCAL ] STWD: Derivative data saved (1820 records). [2025-09-26T22:28:34.056435] [INFO ] [MAIN ] STWD: Successfully saved derivative data. [2025-09-26T22:28:34.078540] [INFO ] [MAIN ] Derivative Progress: 1746/2074 symbols completed. STWD took 1.6s. Estimated remaining: 2m 16s. Rate: 144.3 symbols/min [2025-09-26T22:28:34.084786] [INFO ] [MAIN ] STXK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:34.311074] [DEBUG] [LOCAL ] STXK: Loaded 1535 existing records from primary storage. [2025-09-26T22:28:34.312539] [INFO ] [MAIN ] STXK: Loaded 1535 primary data records. [2025-09-26T22:28:34.405484] [DEBUG] [MAIN ] STXE: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:28:34.467272] [INFO ] [MAIN ] STXE: Generated 1819 derivative records from 2234 primary records. [2025-09-26T22:28:34.477878] [DEBUG] [LOCAL ] STXE: Saving derivative data. [2025-09-26T22:28:34.715531] [DEBUG] [LOCAL ] STXE: Derivative data saved (1819 records). [2025-09-26T22:28:34.717546] [INFO ] [MAIN ] STXE: Successfully saved derivative data. [2025-09-26T22:28:34.721536] [INFO ] [MAIN ] Derivative Progress: 1747/2074 symbols completed. STXE took 1.2s. Estimated remaining: 2m 16s. Rate: 144.2 symbols/min [2025-09-26T22:28:34.723413] [INFO ] [MAIN ] STXT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:34.742800] [DEBUG] [MAIN ] STXG: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:28:34.744829] [INFO ] [MAIN ] STXG: Generated 1819 derivative records from 2612 primary records. [2025-09-26T22:28:34.748135] [DEBUG] [LOCAL ] STXG: Saving derivative data. [2025-09-26T22:28:34.749421] [DEBUG] [LOCAL ] STXT: Loaded 2592 existing records from primary storage. [2025-09-26T22:28:34.755889] [INFO ] [MAIN ] STXT: Loaded 2592 primary data records. [2025-09-26T22:28:34.779540] [DEBUG] [LOCAL ] STXG: Derivative data saved (1819 records). [2025-09-26T22:28:34.789966] [INFO ] [MAIN ] STXG: Successfully saved derivative data. [2025-09-26T22:28:34.794168] [INFO ] [MAIN ] Derivative Progress: 1748/2074 symbols completed. STXG took 1.1s. Estimated remaining: 2m 16s. Rate: 144.3 symbols/min [2025-09-26T22:28:34.810617] [INFO ] [MAIN ] STXV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:34.891002] [DEBUG] [LOCAL ] STXV: Loaded 1648 existing records from primary storage. [2025-09-26T22:28:34.891810] [INFO ] [MAIN ] STXV: Loaded 1648 primary data records. [2025-09-26T22:28:35.240965] [DEBUG] [MAIN ] STXK: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:28:35.242786] [INFO ] [MAIN ] STXK: Generated 1819 derivative records from 1535 primary records. [2025-09-26T22:28:35.249172] [DEBUG] [LOCAL ] STXK: Saving derivative data. [2025-09-26T22:28:35.323112] [DEBUG] [LOCAL ] STXK: Derivative data saved (1819 records). [2025-09-26T22:28:35.346885] [INFO ] [MAIN ] STXK: Successfully saved derivative data. [2025-09-26T22:28:35.351237] [INFO ] [MAIN ] Derivative Progress: 1749/2074 symbols completed. STXK took 1.3s. Estimated remaining: 2m 15s. Rate: 144.3 symbols/min [2025-09-26T22:28:35.464758] [INFO ] [MAIN ] STZ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:35.520153] [DEBUG] [MAIN ] STXT: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:28:35.521793] [INFO ] [MAIN ] STXT: Generated 1819 derivative records from 2592 primary records. [2025-09-26T22:28:35.521986] [DEBUG] [LOCAL ] STXT: Saving derivative data. [2025-09-26T22:28:35.578604] [DEBUG] [MAIN ] STXV: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:28:35.580455] [INFO ] [MAIN ] STXV: Generated 1819 derivative records from 1648 primary records. [2025-09-26T22:28:35.580740] [DEBUG] [LOCAL ] STXV: Saving derivative data. [2025-09-26T22:28:35.615260] [DEBUG] [LOCAL ] STZ: Loaded 53035 existing records from primary storage. [2025-09-26T22:28:35.617343] [INFO ] [MAIN ] STZ: Loaded 53035 primary data records. [2025-09-26T22:28:35.616151] [DEBUG] [LOCAL ] STXT: Derivative data saved (1819 records). [2025-09-26T22:28:35.618345] [INFO ] [MAIN ] STXT: Successfully saved derivative data. [2025-09-26T22:28:35.628930] [INFO ] [MAIN ] Derivative Progress: 1750/2074 symbols completed. STXT took 0.9s. Estimated remaining: 2m 15s. Rate: 144.3 symbols/min [2025-09-26T22:28:35.658012] [INFO ] [MAIN ] SU: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:35.701562] [DEBUG] [LOCAL ] STXV: Derivative data saved (1819 records). [2025-09-26T22:28:35.739052] [INFO ] [MAIN ] STXV: Successfully saved derivative data. [2025-09-26T22:28:35.793432] [INFO ] [MAIN ] Derivative Progress: 1751/2074 symbols completed. STXV took 1.0s. Estimated remaining: 2m 14s. Rate: 144.4 symbols/min [2025-09-26T22:28:35.830557] [INFO ] [MAIN ] SUI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:36.038222] [DEBUG] [LOCAL ] SU: Loaded 54234 existing records from primary storage. [2025-09-26T22:28:36.038838] [INFO ] [MAIN ] SU: Loaded 54234 primary data records. [2025-09-26T22:28:36.192392] [DEBUG] [MAIN ] STZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:36.241435] [DEBUG] [LOCAL ] SUI: Loaded 42505 existing records from primary storage. [2025-09-26T22:28:36.218768] [INFO ] [MAIN ] STZ: Generated 1820 derivative records from 53035 primary records. [2025-09-26T22:28:36.275760] [INFO ] [MAIN ] SUI: Loaded 42505 primary data records. [2025-09-26T22:28:36.275895] [DEBUG] [LOCAL ] STZ: Saving derivative data. [2025-09-26T22:28:36.599541] [DEBUG] [LOCAL ] STZ: Derivative data saved (1820 records). [2025-09-26T22:28:36.610208] [INFO ] [MAIN ] STZ: Successfully saved derivative data. [2025-09-26T22:28:36.634993] [INFO ] [MAIN ] Derivative Progress: 1752/2074 symbols completed. STZ took 1.2s. Estimated remaining: 2m 14s. Rate: 144.3 symbols/min [2025-09-26T22:28:36.789521] [INFO ] [MAIN ] SUPV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:36.836988] [DEBUG] [MAIN ] SU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:36.838154] [INFO ] [MAIN ] SU: Generated 1820 derivative records from 54234 primary records. [2025-09-26T22:28:36.838465] [DEBUG] [LOCAL ] SU: Saving derivative data. [2025-09-26T22:28:36.857691] [DEBUG] [LOCAL ] SU: Derivative data saved (1820 records). [2025-09-26T22:28:36.869197] [INFO ] [MAIN ] SU: Successfully saved derivative data. [2025-09-26T22:28:36.872590] [INFO ] [MAIN ] Derivative Progress: 1753/2074 symbols completed. SU took 1.2s. Estimated remaining: 2m 13s. Rate: 144.3 symbols/min [2025-09-26T22:28:36.885869] [DEBUG] [MAIN ] SUI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:36.886693] [INFO ] [MAIN ] SUI: Generated 1820 derivative records from 42505 primary records. [2025-09-26T22:28:36.886761] [DEBUG] [LOCAL ] SUI: Saving derivative data. [2025-09-26T22:28:36.918199] [DEBUG] [LOCAL ] SUPV: Loaded 47961 existing records from primary storage. [2025-09-26T22:28:36.919348] [INFO ] [MAIN ] SUPV: Loaded 47961 primary data records. [2025-09-26T22:28:36.925882] [DEBUG] [LOCAL ] SUI: Derivative data saved (1820 records). [2025-09-26T22:28:36.955207] [INFO ] [MAIN ] SUI: Successfully saved derivative data. [2025-09-26T22:28:36.992705] [INFO ] [MAIN ] Derivative Progress: 1754/2074 symbols completed. SUI took 1.2s. Estimated remaining: 2m 13s. Rate: 144.4 symbols/min [2025-09-26T22:28:37.260916] [DEBUG] [MAIN ] SUPV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:37.261816] [INFO ] [MAIN ] SUPV: Generated 1820 derivative records from 47961 primary records. [2025-09-26T22:28:37.261888] [DEBUG] [LOCAL ] SUPV: Saving derivative data. [2025-09-26T22:28:37.279199] [DEBUG] [LOCAL ] SUPV: Derivative data saved (1820 records). [2025-09-26T22:28:37.279275] [INFO ] [MAIN ] SUPV: Successfully saved derivative data. [2025-09-26T22:28:37.281724] [INFO ] [MAIN ] Derivative Progress: 1755/2074 symbols completed. SUPV took 0.5s. Estimated remaining: 2m 13s. Rate: 144.4 symbols/min [2025-09-26T22:28:37.282432] [INFO ] [MAIN ] SW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:37.282828] [INFO ] [MAIN ] SVV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:37.282329] [INFO ] [MAIN ] SUZ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:37.390732] [DEBUG] [LOCAL ] SUZ: Loaded 46428 existing records from primary storage. [2025-09-26T22:28:37.389836] [DEBUG] [LOCAL ] SVV: Loaded 40221 existing records from primary storage. [2025-09-26T22:28:37.391090] [INFO ] [MAIN ] SUZ: Loaded 46428 primary data records. [2025-09-26T22:28:37.391208] [INFO ] [MAIN ] SVV: Loaded 40221 primary data records. [2025-09-26T22:28:37.392036] [DEBUG] [LOCAL ] SW: Loaded 53939 existing records from primary storage. [2025-09-26T22:28:37.392239] [INFO ] [MAIN ] SW: Loaded 53939 primary data records. [2025-09-26T22:28:38.452044] [DEBUG] [MAIN ] SUZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:38.457260] [INFO ] [MAIN ] SUZ: Generated 1820 derivative records from 46428 primary records. [2025-09-26T22:28:38.457364] [DEBUG] [LOCAL ] SUZ: Saving derivative data. [2025-09-26T22:28:38.485939] [DEBUG] [LOCAL ] SUZ: Derivative data saved (1820 records). [2025-09-26T22:28:38.505098] [INFO ] [MAIN ] SUZ: Successfully saved derivative data. [2025-09-26T22:28:38.507853] [INFO ] [MAIN ] Derivative Progress: 1756/2074 symbols completed. SUZ took 1.2s. Estimated remaining: 2m 12s. Rate: 144.2 symbols/min [2025-09-26T22:28:38.508400] [INFO ] [MAIN ] SWK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:38.509281] [DEBUG] [MAIN ] SW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:38.509880] [DEBUG] [MAIN ] SVV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:38.511875] [INFO ] [MAIN ] SVV: Generated 1820 derivative records from 40221 primary records. [2025-09-26T22:28:38.510997] [INFO ] [MAIN ] SW: Generated 1820 derivative records from 53939 primary records. [2025-09-26T22:28:38.512440] [DEBUG] [LOCAL ] SVV: Saving derivative data. [2025-09-26T22:28:38.512534] [DEBUG] [LOCAL ] SW: Saving derivative data. [2025-09-26T22:28:38.549747] [DEBUG] [LOCAL ] SVV: Derivative data saved (1820 records). [2025-09-26T22:28:38.550756] [INFO ] [MAIN ] SVV: Successfully saved derivative data. [2025-09-26T22:28:38.553812] [INFO ] [MAIN ] Derivative Progress: 1757/2074 symbols completed. SVV took 1.3s. Estimated remaining: 2m 12s. Rate: 144.3 symbols/min [2025-09-26T22:28:38.553956] [DEBUG] [LOCAL ] SW: Derivative data saved (1820 records). [2025-09-26T22:28:38.554473] [INFO ] [MAIN ] SWX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:38.554623] [INFO ] [MAIN ] SW: Successfully saved derivative data. [2025-09-26T22:28:38.556956] [INFO ] [MAIN ] Derivative Progress: 1758/2074 symbols completed. SW took 1.3s. Estimated remaining: 2m 11s. Rate: 144.4 symbols/min [2025-09-26T22:28:38.557851] [INFO ] [MAIN ] SWZ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:38.582242] [DEBUG] [LOCAL ] SWZ: Loaded 6074 existing records from primary storage. [2025-09-26T22:28:38.582417] [INFO ] [MAIN ] SWZ: Loaded 6074 primary data records. [2025-09-26T22:28:38.712510] [DEBUG] [LOCAL ] SWK: Loaded 53178 existing records from primary storage. [2025-09-26T22:28:38.722906] [INFO ] [MAIN ] SWK: Loaded 53178 primary data records. [2025-09-26T22:28:38.941198] [DEBUG] [LOCAL ] SWX: Loaded 31735 existing records from primary storage. [2025-09-26T22:28:38.968739] [INFO ] [MAIN ] SWX: Loaded 31735 primary data records. [2025-09-26T22:28:39.638353] [DEBUG] [MAIN ] SWZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:39.639484] [INFO ] [MAIN ] SWZ: Generated 1820 derivative records from 6074 primary records. [2025-09-26T22:28:39.639860] [DEBUG] [LOCAL ] SWZ: Saving derivative data. [2025-09-26T22:28:39.677205] [DEBUG] [LOCAL ] SWZ: Derivative data saved (1820 records). [2025-09-26T22:28:39.677376] [INFO ] [MAIN ] SWZ: Successfully saved derivative data. [2025-09-26T22:28:39.679553] [INFO ] [MAIN ] Derivative Progress: 1759/2074 symbols completed. SWZ took 1.1s. Estimated remaining: 2m 11s. Rate: 144.2 symbols/min [2025-09-26T22:28:39.674302] [DEBUG] [MAIN ] SWK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:39.681936] [INFO ] [MAIN ] SWK: Generated 1820 derivative records from 53178 primary records. [2025-09-26T22:28:39.682167] [INFO ] [MAIN ] SXC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:39.682620] [DEBUG] [LOCAL ] SWK: Saving derivative data. [2025-09-26T22:28:39.721215] [DEBUG] [MAIN ] SWX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:39.722908] [INFO ] [MAIN ] SWX: Generated 1820 derivative records from 31735 primary records. [2025-09-26T22:28:39.723831] [DEBUG] [LOCAL ] SWX: Saving derivative data. [2025-09-26T22:28:39.738684] [DEBUG] [LOCAL ] SWK: Derivative data saved (1820 records). [2025-09-26T22:28:39.739561] [INFO ] [MAIN ] SWK: Successfully saved derivative data. [2025-09-26T22:28:39.742038] [INFO ] [MAIN ] Derivative Progress: 1760/2074 symbols completed. SWK took 1.2s. Estimated remaining: 2m 11s. Rate: 144.3 symbols/min [2025-09-26T22:28:39.742980] [INFO ] [MAIN ] SXI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:39.757871] [DEBUG] [LOCAL ] SWX: Derivative data saved (1820 records). [2025-09-26T22:28:39.757961] [INFO ] [MAIN ] SWX: Successfully saved derivative data. [2025-09-26T22:28:39.761014] [INFO ] [MAIN ] Derivative Progress: 1761/2074 symbols completed. SWX took 1.2s. Estimated remaining: 2m 10s. Rate: 144.4 symbols/min [2025-09-26T22:28:39.764634] [INFO ] [MAIN ] SXT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:39.778491] [DEBUG] [LOCAL ] SXI: Loaded 11685 existing records from primary storage. [2025-09-26T22:28:39.791024] [INFO ] [MAIN ] SXI: Loaded 11685 primary data records. [2025-09-26T22:28:39.861446] [DEBUG] [LOCAL ] SXC: Loaded 42142 existing records from primary storage. [2025-09-26T22:28:39.901891] [INFO ] [MAIN ] SXC: Loaded 42142 primary data records. [2025-09-26T22:28:39.990997] [DEBUG] [LOCAL ] SXT: Loaded 29557 existing records from primary storage. [2025-09-26T22:28:40.015723] [INFO ] [MAIN ] SXT: Loaded 29557 primary data records. [2025-09-26T22:28:40.889155] [DEBUG] [MAIN ] SXI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:40.890471] [INFO ] [MAIN ] SXI: Generated 1820 derivative records from 11685 primary records. [2025-09-26T22:28:40.890831] [DEBUG] [LOCAL ] SXI: Saving derivative data. [2025-09-26T22:28:40.913747] [DEBUG] [LOCAL ] SXI: Derivative data saved (1820 records). [2025-09-26T22:28:40.927744] [INFO ] [MAIN ] SXI: Successfully saved derivative data. [2025-09-26T22:28:40.932068] [DEBUG] [MAIN ] SXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:40.929814] [INFO ] [MAIN ] Derivative Progress: 1762/2074 symbols completed. SXI took 1.2s. Estimated remaining: 2m 10s. Rate: 144.2 symbols/min [2025-09-26T22:28:40.932587] [INFO ] [MAIN ] SYF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:40.933362] [INFO ] [MAIN ] SXT: Generated 1820 derivative records from 29557 primary records. [2025-09-26T22:28:40.933926] [DEBUG] [LOCAL ] SXT: Saving derivative data. [2025-09-26T22:28:40.961222] [DEBUG] [MAIN ] SXC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:40.962926] [INFO ] [MAIN ] SXC: Generated 1820 derivative records from 42142 primary records. [2025-09-26T22:28:40.963697] [DEBUG] [LOCAL ] SXC: Saving derivative data. [2025-09-26T22:28:40.981382] [DEBUG] [LOCAL ] SXT: Derivative data saved (1820 records). [2025-09-26T22:28:40.982290] [INFO ] [MAIN ] SXT: Successfully saved derivative data. [2025-09-26T22:28:40.984920] [INFO ] [MAIN ] Derivative Progress: 1763/2074 symbols completed. SXT took 1.2s. Estimated remaining: 2m 9s. Rate: 144.3 symbols/min [2025-09-26T22:28:40.986508] [INFO ] [MAIN ] SYK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:40.991289] [DEBUG] [LOCAL ] SXC: Derivative data saved (1820 records). [2025-09-26T22:28:40.991440] [INFO ] [MAIN ] SXC: Successfully saved derivative data. [2025-09-26T22:28:40.994426] [INFO ] [MAIN ] Derivative Progress: 1764/2074 symbols completed. SXC took 1.3s. Estimated remaining: 2m 9s. Rate: 144.4 symbols/min [2025-09-26T22:28:40.994977] [INFO ] [MAIN ] SYY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:41.066819] [DEBUG] [LOCAL ] SYF: Loaded 54222 existing records from primary storage. [2025-09-26T22:28:41.068302] [INFO ] [MAIN ] SYF: Loaded 54222 primary data records. [2025-09-26T22:28:41.069254] [DEBUG] [LOCAL ] SYK: Loaded 47699 existing records from primary storage. [2025-09-26T22:28:41.074621] [INFO ] [MAIN ] SYK: Loaded 47699 primary data records. [2025-09-26T22:28:41.422025] [DEBUG] [LOCAL ] SYY: Loaded 54009 existing records from primary storage. [2025-09-26T22:28:41.439031] [INFO ] [MAIN ] SYY: Loaded 54009 primary data records. [2025-09-26T22:28:42.278816] [DEBUG] [MAIN ] SYF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:42.279192] [DEBUG] [MAIN ] SYK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:42.280215] [INFO ] [MAIN ] SYF: Generated 1820 derivative records from 54222 primary records. [2025-09-26T22:28:42.281250] [INFO ] [MAIN ] SYK: Generated 1820 derivative records from 47699 primary records. [2025-09-26T22:28:42.282277] [DEBUG] [LOCAL ] SYF: Saving derivative data. [2025-09-26T22:28:42.281463] [DEBUG] [LOCAL ] SYK: Saving derivative data. [2025-09-26T22:28:42.320762] [DEBUG] [LOCAL ] SYK: Derivative data saved (1820 records). [2025-09-26T22:28:42.322168] [INFO ] [MAIN ] SYK: Successfully saved derivative data. [2025-09-26T22:28:42.324980] [INFO ] [MAIN ] Derivative Progress: 1765/2074 symbols completed. SYK took 1.3s. Estimated remaining: 2m 9s. Rate: 144.2 symbols/min [2025-09-26T22:28:42.325534] [INFO ] [MAIN ] T: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:42.322291] [DEBUG] [LOCAL ] SYF: Derivative data saved (1820 records). [2025-09-26T22:28:42.326064] [INFO ] [MAIN ] SYF: Successfully saved derivative data. [2025-09-26T22:28:42.328198] [INFO ] [MAIN ] Derivative Progress: 1766/2074 symbols completed. SYF took 1.4s. Estimated remaining: 2m 8s. Rate: 144.3 symbols/min [2025-09-26T22:28:42.329230] [INFO ] [MAIN ] TAC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:42.351127] [DEBUG] [MAIN ] SYY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:42.352178] [INFO ] [MAIN ] SYY: Generated 1820 derivative records from 54009 primary records. [2025-09-26T22:28:42.352514] [DEBUG] [LOCAL ] SYY: Saving derivative data. [2025-09-26T22:28:42.379249] [DEBUG] [LOCAL ] SYY: Derivative data saved (1820 records). [2025-09-26T22:28:42.379448] [INFO ] [MAIN ] SYY: Successfully saved derivative data. [2025-09-26T22:28:42.382270] [INFO ] [MAIN ] Derivative Progress: 1767/2074 symbols completed. SYY took 1.4s. Estimated remaining: 2m 8s. Rate: 144.4 symbols/min [2025-09-26T22:28:42.393112] [INFO ] [MAIN ] TAK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:42.425865] [DEBUG] [LOCAL ] TAC: Loaded 43441 existing records from primary storage. [2025-09-26T22:28:42.426217] [INFO ] [MAIN ] TAC: Loaded 43441 primary data records. [2025-09-26T22:28:42.566843] [DEBUG] [LOCAL ] T: Loaded 54578 existing records from primary storage. [2025-09-26T22:28:42.596412] [INFO ] [MAIN ] T: Loaded 54578 primary data records. [2025-09-26T22:28:42.903336] [DEBUG] [LOCAL ] TAK: Loaded 50538 existing records from primary storage. [2025-09-26T22:28:42.917201] [INFO ] [MAIN ] TAK: Loaded 50538 primary data records. [2025-09-26T22:28:43.465985] [DEBUG] [MAIN ] TAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:43.467697] [INFO ] [MAIN ] TAC: Generated 1820 derivative records from 43441 primary records. [2025-09-26T22:28:43.467899] [DEBUG] [LOCAL ] TAC: Saving derivative data. [2025-09-26T22:28:43.502068] [DEBUG] [MAIN ] T: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:43.505049] [INFO ] [MAIN ] T: Generated 1820 derivative records from 54578 primary records. [2025-09-26T22:28:43.505672] [DEBUG] [LOCAL ] T: Saving derivative data. [2025-09-26T22:28:43.505489] [DEBUG] [LOCAL ] TAC: Derivative data saved (1820 records). [2025-09-26T22:28:43.506710] [INFO ] [MAIN ] TAC: Successfully saved derivative data. [2025-09-26T22:28:43.510121] [INFO ] [MAIN ] Derivative Progress: 1768/2074 symbols completed. TAC took 1.2s. Estimated remaining: 2m 7s. Rate: 144.2 symbols/min [2025-09-26T22:28:43.542808] [DEBUG] [MAIN ] TAK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:43.544751] [INFO ] [MAIN ] TAK: Generated 1820 derivative records from 50538 primary records. [2025-09-26T22:28:43.544840] [DEBUG] [LOCAL ] TAK: Saving derivative data. [2025-09-26T22:28:43.555731] [DEBUG] [LOCAL ] T: Derivative data saved (1820 records). [2025-09-26T22:28:43.560619] [INFO ] [MAIN ] T: Successfully saved derivative data. [2025-09-26T22:28:43.563575] [INFO ] [MAIN ] Derivative Progress: 1769/2074 symbols completed. T took 1.2s. Estimated remaining: 2m 7s. Rate: 144.3 symbols/min [2025-09-26T22:28:43.568450] [DEBUG] [LOCAL ] TAK: Derivative data saved (1820 records). [2025-09-26T22:28:43.568571] [INFO ] [MAIN ] TAK: Successfully saved derivative data. [2025-09-26T22:28:43.573130] [INFO ] [MAIN ] Derivative Progress: 1770/2074 symbols completed. TAK took 1.2s. Estimated remaining: 2m 6s. Rate: 144.4 symbols/min [2025-09-26T22:28:43.574021] [INFO ] [MAIN ] TALO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:43.574349] [INFO ] [MAIN ] TAL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:43.574609] [INFO ] [MAIN ] TAP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:43.673347] [DEBUG] [LOCAL ] TAP: Loaded 53648 existing records from primary storage. [2025-09-26T22:28:43.674230] [INFO ] [MAIN ] TAP: Loaded 53648 primary data records. [2025-09-26T22:28:43.740906] [DEBUG] [LOCAL ] TALO: Loaded 51575 existing records from primary storage. [2025-09-26T22:28:43.776298] [INFO ] [MAIN ] TALO: Loaded 51575 primary data records. [2025-09-26T22:28:43.882352] [DEBUG] [LOCAL ] TAL: Loaded 52783 existing records from primary storage. [2025-09-26T22:28:43.919121] [INFO ] [MAIN ] TAL: Loaded 52783 primary data records. [2025-09-26T22:28:44.792847] [DEBUG] [MAIN ] TAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:44.793980] [INFO ] [MAIN ] TAP: Generated 1820 derivative records from 53648 primary records. [2025-09-26T22:28:44.794229] [DEBUG] [LOCAL ] TAP: Saving derivative data. [2025-09-26T22:28:44.828885] [DEBUG] [MAIN ] TALO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:44.831175] [INFO ] [MAIN ] TALO: Generated 1820 derivative records from 51575 primary records. [2025-09-26T22:28:44.831325] [DEBUG] [LOCAL ] TALO: Saving derivative data. [2025-09-26T22:28:44.840604] [DEBUG] [LOCAL ] TAP: Derivative data saved (1820 records). [2025-09-26T22:28:44.859113] [INFO ] [MAIN ] TAP: Successfully saved derivative data. [2025-09-26T22:28:44.860848] [INFO ] [MAIN ] Derivative Progress: 1771/2074 symbols completed. TAP took 1.3s. Estimated remaining: 2m 6s. Rate: 144.2 symbols/min [2025-09-26T22:28:44.862902] [DEBUG] [MAIN ] TAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:44.863867] [INFO ] [MAIN ] TAL: Generated 1820 derivative records from 52783 primary records. [2025-09-26T22:28:44.865224] [DEBUG] [LOCAL ] TALO: Derivative data saved (1820 records). [2025-09-26T22:28:44.865334] [DEBUG] [LOCAL ] TAL: Saving derivative data. [2025-09-26T22:28:44.865922] [INFO ] [MAIN ] TALO: Successfully saved derivative data. [2025-09-26T22:28:44.864057] [INFO ] [MAIN ] TBB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:44.869210] [INFO ] [MAIN ] Derivative Progress: 1772/2074 symbols completed. TALO took 1.3s. Estimated remaining: 2m 6s. Rate: 144.3 symbols/min [2025-09-26T22:28:44.878688] [INFO ] [MAIN ] TBBB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:44.890198] [DEBUG] [LOCAL ] TAL: Derivative data saved (1820 records). [2025-09-26T22:28:44.890311] [INFO ] [MAIN ] TAL: Successfully saved derivative data. [2025-09-26T22:28:44.893026] [INFO ] [MAIN ] Derivative Progress: 1773/2074 symbols completed. TAL took 1.3s. Estimated remaining: 2m 5s. Rate: 144.4 symbols/min [2025-09-26T22:28:44.893376] [INFO ] [MAIN ] TBI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:44.899067] [DEBUG] [LOCAL ] TBB: Loaded 11828 existing records from primary storage. [2025-09-26T22:28:44.899156] [INFO ] [MAIN ] TBB: Loaded 11828 primary data records. [2025-09-26T22:28:45.220793] [DEBUG] [LOCAL ] TBI: Loaded 22937 existing records from primary storage. [2025-09-26T22:28:45.249001] [INFO ] [MAIN ] TBI: Loaded 22937 primary data records. [2025-09-26T22:28:45.248854] [DEBUG] [LOCAL ] TBBB: Loaded 36262 existing records from primary storage. [2025-09-26T22:28:45.249346] [INFO ] [MAIN ] TBBB: Loaded 36262 primary data records. [2025-09-26T22:28:45.944357] [DEBUG] [MAIN ] TBB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:45.946126] [INFO ] [MAIN ] TBB: Generated 1820 derivative records from 11828 primary records. [2025-09-26T22:28:45.946399] [DEBUG] [LOCAL ] TBB: Saving derivative data. [2025-09-26T22:28:45.969259] [DEBUG] [LOCAL ] TBB: Derivative data saved (1820 records). [2025-09-26T22:28:45.969663] [INFO ] [MAIN ] TBB: Successfully saved derivative data. [2025-09-26T22:28:45.972099] [INFO ] [MAIN ] Derivative Progress: 1774/2074 symbols completed. TBB took 1.1s. Estimated remaining: 2m 5s. Rate: 144.2 symbols/min [2025-09-26T22:28:45.975599] [INFO ] [MAIN ] TBN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:45.993093] [DEBUG] [MAIN ] TBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:45.994958] [INFO ] [MAIN ] TBI: Generated 1820 derivative records from 22937 primary records. [2025-09-26T22:28:46.008467] [DEBUG] [LOCAL ] TBI: Saving derivative data. [2025-09-26T22:28:46.008398] [DEBUG] [MAIN ] TBBB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:46.009432] [INFO ] [MAIN ] TBBB: Generated 1820 derivative records from 36262 primary records. [2025-09-26T22:28:46.011884] [DEBUG] [LOCAL ] TBBB: Saving derivative data. [2025-09-26T22:28:46.011790] [DEBUG] [LOCAL ] TBN: Loaded 3044 existing records from primary storage. [2025-09-26T22:28:46.013880] [INFO ] [MAIN ] TBN: Loaded 3044 primary data records. [2025-09-26T22:28:46.059027] [DEBUG] [LOCAL ] TBBB: Derivative data saved (1820 records). [2025-09-26T22:28:46.077566] [INFO ] [MAIN ] TBBB: Successfully saved derivative data. [2025-09-26T22:28:46.094183] [INFO ] [MAIN ] Derivative Progress: 1775/2074 symbols completed. TBBB took 1.2s. Estimated remaining: 2m 4s. Rate: 144.3 symbols/min [2025-09-26T22:28:46.108325] [INFO ] [MAIN ] TD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:46.144735] [DEBUG] [LOCAL ] TBI: Derivative data saved (1820 records). [2025-09-26T22:28:46.162703] [INFO ] [MAIN ] TBI: Successfully saved derivative data. [2025-09-26T22:28:46.165022] [INFO ] [MAIN ] Derivative Progress: 1776/2074 symbols completed. TBI took 1.3s. Estimated remaining: 2m 4s. Rate: 144.4 symbols/min [2025-09-26T22:28:46.187276] [INFO ] [MAIN ] TDC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:46.432972] [DEBUG] [LOCAL ] TD: Loaded 53036 existing records from primary storage. [2025-09-26T22:28:46.445775] [INFO ] [MAIN ] TD: Loaded 53036 primary data records. [2025-09-26T22:28:46.538106] [DEBUG] [MAIN ] TBN: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-09-26T22:28:46.571210] [INFO ] [MAIN ] TBN: Generated 1818 derivative records from 3044 primary records. [2025-09-26T22:28:46.600758] [DEBUG] [LOCAL ] TDC: Loaded 47501 existing records from primary storage. [2025-09-26T22:28:46.599393] [DEBUG] [LOCAL ] TBN: Saving derivative data. [2025-09-26T22:28:46.612753] [INFO ] [MAIN ] TDC: Loaded 47501 primary data records. [2025-09-26T22:28:46.991963] [DEBUG] [LOCAL ] TBN: Derivative data saved (1818 records). [2025-09-26T22:28:47.059292] [INFO ] [MAIN ] TBN: Successfully saved derivative data. [2025-09-26T22:28:47.180728] [INFO ] [MAIN ] Derivative Progress: 1777/2074 symbols completed. TBN took 1.2s. Estimated remaining: 2m 4s. Rate: 144.2 symbols/min [2025-09-26T22:28:47.182539] [INFO ] [MAIN ] TDF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:47.195951] [DEBUG] [LOCAL ] TDF: Loaded 6595 existing records from primary storage. [2025-09-26T22:28:47.196821] [INFO ] [MAIN ] TDF: Loaded 6595 primary data records. [2025-09-26T22:28:47.345077] [DEBUG] [MAIN ] TD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:47.356754] [INFO ] [MAIN ] TD: Generated 1820 derivative records from 53036 primary records. [2025-09-26T22:28:47.380622] [DEBUG] [LOCAL ] TD: Saving derivative data. [2025-09-26T22:28:47.576640] [DEBUG] [LOCAL ] TD: Derivative data saved (1820 records). [2025-09-26T22:28:47.576006] [DEBUG] [MAIN ] TDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:47.578213] [INFO ] [MAIN ] TDC: Generated 1820 derivative records from 47501 primary records. [2025-09-26T22:28:47.578873] [DEBUG] [LOCAL ] TDC: Saving derivative data. [2025-09-26T22:28:47.578567] [INFO ] [MAIN ] TD: Successfully saved derivative data. [2025-09-26T22:28:47.581834] [INFO ] [MAIN ] Derivative Progress: 1778/2074 symbols completed. TD took 1.5s. Estimated remaining: 2m 3s. Rate: 144.2 symbols/min [2025-09-26T22:28:47.583819] [INFO ] [MAIN ] TDG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:47.607406] [DEBUG] [LOCAL ] TDC: Derivative data saved (1820 records). [2025-09-26T22:28:47.607711] [INFO ] [MAIN ] TDC: Successfully saved derivative data. [2025-09-26T22:28:47.610859] [INFO ] [MAIN ] Derivative Progress: 1779/2074 symbols completed. TDC took 1.4s. Estimated remaining: 2m 3s. Rate: 144.3 symbols/min [2025-09-26T22:28:47.617074] [INFO ] [MAIN ] TDOC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:47.641183] [DEBUG] [MAIN ] TDF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:47.642752] [DEBUG] [LOCAL ] TDG: Loaded 22314 existing records from primary storage. [2025-09-26T22:28:47.643500] [INFO ] [MAIN ] TDF: Generated 1820 derivative records from 6595 primary records. [2025-09-26T22:28:47.643694] [INFO ] [MAIN ] TDG: Loaded 22314 primary data records. [2025-09-26T22:28:47.643605] [DEBUG] [LOCAL ] TDF: Saving derivative data. [2025-09-26T22:28:47.825807] [DEBUG] [LOCAL ] TDF: Derivative data saved (1820 records). [2025-09-26T22:28:47.853267] [INFO ] [MAIN ] TDF: Successfully saved derivative data. [2025-09-26T22:28:47.900293] [INFO ] [MAIN ] Derivative Progress: 1780/2074 symbols completed. TDF took 0.7s. Estimated remaining: 2m 2s. Rate: 144.3 symbols/min [2025-09-26T22:28:48.021092] [DEBUG] [LOCAL ] TDOC: Loaded 54125 existing records from primary storage. [2025-09-26T22:28:48.022205] [INFO ] [MAIN ] TDOC: Loaded 54125 primary data records. [2025-09-26T22:28:48.021237] [INFO ] [MAIN ] TDS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:48.379181] [DEBUG] [LOCAL ] TDS: Loaded 43435 existing records from primary storage. [2025-09-26T22:28:48.380307] [INFO ] [MAIN ] TDS: Loaded 43435 primary data records. [2025-09-26T22:28:48.455544] [DEBUG] [MAIN ] TDG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:48.480424] [INFO ] [MAIN ] TDG: Generated 1820 derivative records from 22314 primary records. [2025-09-26T22:28:48.509197] [DEBUG] [LOCAL ] TDG: Saving derivative data. [2025-09-26T22:28:48.604376] [DEBUG] [LOCAL ] TDG: Derivative data saved (1820 records). [2025-09-26T22:28:48.643762] [INFO ] [MAIN ] TDG: Successfully saved derivative data. [2025-09-26T22:28:48.681399] [DEBUG] [MAIN ] TDOC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:48.680940] [INFO ] [MAIN ] Derivative Progress: 1781/2074 symbols completed. TDG took 1.1s. Estimated remaining: 2m 2s. Rate: 144.3 symbols/min [2025-09-26T22:28:48.804892] [INFO ] [MAIN ] TDW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:48.804630] [INFO ] [MAIN ] TDOC: Generated 1820 derivative records from 54125 primary records. [2025-09-26T22:28:48.814587] [DEBUG] [LOCAL ] TDOC: Saving derivative data. [2025-09-26T22:28:48.836576] [DEBUG] [LOCAL ] TDOC: Derivative data saved (1820 records). [2025-09-26T22:28:48.836914] [INFO ] [MAIN ] TDOC: Successfully saved derivative data. [2025-09-26T22:28:48.839233] [INFO ] [MAIN ] Derivative Progress: 1782/2074 symbols completed. TDOC took 1.2s. Estimated remaining: 2m 1s. Rate: 144.3 symbols/min [2025-09-26T22:28:48.839676] [INFO ] [MAIN ] TDY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:48.889696] [DEBUG] [MAIN ] TDS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:48.899182] [DEBUG] [LOCAL ] TDY: Loaded 22979 existing records from primary storage. [2025-09-26T22:28:48.898774] [INFO ] [MAIN ] TDS: Generated 1820 derivative records from 43435 primary records. [2025-09-26T22:28:48.899418] [DEBUG] [LOCAL ] TDS: Saving derivative data. [2025-09-26T22:28:48.900158] [INFO ] [MAIN ] TDY: Loaded 22979 primary data records. [2025-09-26T22:28:48.907106] [DEBUG] [LOCAL ] TDW: Loaded 46091 existing records from primary storage. [2025-09-26T22:28:48.963148] [INFO ] [MAIN ] TDW: Loaded 46091 primary data records. [2025-09-26T22:28:49.349438] [DEBUG] [LOCAL ] TDS: Derivative data saved (1820 records). [2025-09-26T22:28:49.378194] [INFO ] [MAIN ] TDS: Successfully saved derivative data. [2025-09-26T22:28:49.405727] [INFO ] [MAIN ] Derivative Progress: 1783/2074 symbols completed. TDS took 1.4s. Estimated remaining: 2m 1s. Rate: 144.3 symbols/min [2025-09-26T22:28:49.596108] [DEBUG] [MAIN ] TDY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:49.597207] [INFO ] [MAIN ] TDY: Generated 1820 derivative records from 22979 primary records. [2025-09-26T22:28:49.597421] [DEBUG] [LOCAL ] TDY: Saving derivative data. [2025-09-26T22:28:49.630306] [DEBUG] [MAIN ] TDW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:49.631910] [INFO ] [MAIN ] TDW: Generated 1820 derivative records from 46091 primary records. [2025-09-26T22:28:49.632620] [DEBUG] [LOCAL ] TDW: Saving derivative data. [2025-09-26T22:28:49.632531] [DEBUG] [LOCAL ] TDY: Derivative data saved (1820 records). [2025-09-26T22:28:49.632838] [INFO ] [MAIN ] TDY: Successfully saved derivative data. [2025-09-26T22:28:49.635423] [INFO ] [MAIN ] Derivative Progress: 1784/2074 symbols completed. TDY took 0.8s. Estimated remaining: 2m 1s. Rate: 144.3 symbols/min [2025-09-26T22:28:49.651599] [DEBUG] [LOCAL ] TDW: Derivative data saved (1820 records). [2025-09-26T22:28:49.651711] [INFO ] [MAIN ] TDW: Successfully saved derivative data. [2025-09-26T22:28:49.655132] [INFO ] [MAIN ] Derivative Progress: 1785/2074 symbols completed. TDW took 0.9s. Estimated remaining: 2m 0s. Rate: 144.4 symbols/min [2025-09-26T22:28:49.655932] [INFO ] [MAIN ] TEF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:49.656108] [INFO ] [MAIN ] TEAF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:49.656633] [INFO ] [MAIN ] TECK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:49.669985] [DEBUG] [LOCAL ] TEAF: Loaded 7529 existing records from primary storage. [2025-09-26T22:28:49.670172] [INFO ] [MAIN ] TEAF: Loaded 7529 primary data records. [2025-09-26T22:28:50.030972] [DEBUG] [LOCAL ] TEF: Loaded 37944 existing records from primary storage. [2025-09-26T22:28:50.031461] [INFO ] [MAIN ] TEF: Loaded 37944 primary data records. [2025-09-26T22:28:50.175427] [DEBUG] [LOCAL ] TECK: Loaded 54216 existing records from primary storage. [2025-09-26T22:28:50.181502] [INFO ] [MAIN ] TECK: Loaded 54216 primary data records. [2025-09-26T22:28:50.830665] [DEBUG] [MAIN ] TEAF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:50.831980] [INFO ] [MAIN ] TEAF: Generated 1820 derivative records from 7529 primary records. [2025-09-26T22:28:50.832899] [DEBUG] [LOCAL ] TEAF: Saving derivative data. [2025-09-26T22:28:50.869142] [DEBUG] [MAIN ] TEF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:50.870201] [DEBUG] [LOCAL ] TEAF: Derivative data saved (1820 records). [2025-09-26T22:28:50.871512] [INFO ] [MAIN ] TEF: Generated 1820 derivative records from 37944 primary records. [2025-09-26T22:28:50.871634] [INFO ] [MAIN ] TEAF: Successfully saved derivative data. [2025-09-26T22:28:50.871775] [DEBUG] [LOCAL ] TEF: Saving derivative data. [2025-09-26T22:28:50.873925] [INFO ] [MAIN ] Derivative Progress: 1786/2074 symbols completed. TEAF took 1.2s. Estimated remaining: 1m 60s. Rate: 144.3 symbols/min [2025-09-26T22:28:50.875325] [INFO ] [MAIN ] TEI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:50.892219] [DEBUG] [LOCAL ] TEF: Derivative data saved (1820 records). [2025-09-26T22:28:50.892860] [INFO ] [MAIN ] TEF: Successfully saved derivative data. [2025-09-26T22:28:50.895050] [INFO ] [MAIN ] Derivative Progress: 1787/2074 symbols completed. TEF took 1.2s. Estimated remaining: 1m 59s. Rate: 144.3 symbols/min [2025-09-26T22:28:50.895505] [INFO ] [MAIN ] TEL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:50.912171] [DEBUG] [MAIN ] TECK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:50.918405] [INFO ] [MAIN ] TECK: Generated 1820 derivative records from 54216 primary records. [2025-09-26T22:28:50.918508] [DEBUG] [LOCAL ] TECK: Saving derivative data. [2025-09-26T22:28:50.941385] [DEBUG] [LOCAL ] TEI: Loaded 20910 existing records from primary storage. [2025-09-26T22:28:50.942946] [INFO ] [MAIN ] TEI: Loaded 20910 primary data records. [2025-09-26T22:28:51.016358] [DEBUG] [LOCAL ] TECK: Derivative data saved (1820 records). [2025-09-26T22:28:51.048638] [INFO ] [MAIN ] TECK: Successfully saved derivative data. [2025-09-26T22:28:51.072510] [INFO ] [MAIN ] Derivative Progress: 1788/2074 symbols completed. TECK took 1.4s. Estimated remaining: 1m 59s. Rate: 144.4 symbols/min [2025-09-26T22:28:51.082604] [INFO ] [MAIN ] TEN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:51.298278] [DEBUG] [LOCAL ] TEL: Loaded 51898 existing records from primary storage. [2025-09-26T22:28:51.298634] [INFO ] [MAIN ] TEL: Loaded 51898 primary data records. [2025-09-26T22:28:51.525114] [DEBUG] [LOCAL ] TEN: Loaded 31383 existing records from primary storage. [2025-09-26T22:28:51.636878] [INFO ] [MAIN ] TEN: Loaded 31383 primary data records. [2025-09-26T22:28:51.835339] [DEBUG] [MAIN ] TEI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:51.873470] [INFO ] [MAIN ] TEI: Generated 1820 derivative records from 20910 primary records. [2025-09-26T22:28:51.987403] [DEBUG] [LOCAL ] TEI: Saving derivative data. [2025-09-26T22:28:52.027601] [DEBUG] [LOCAL ] TEI: Derivative data saved (1820 records). [2025-09-26T22:28:52.029810] [INFO ] [MAIN ] TEI: Successfully saved derivative data. [2025-09-26T22:28:52.033123] [INFO ] [MAIN ] Derivative Progress: 1789/2074 symbols completed. TEI took 1.2s. Estimated remaining: 1m 59s. Rate: 144.3 symbols/min [2025-09-26T22:28:52.042361] [INFO ] [MAIN ] TEO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:52.049250] [DEBUG] [MAIN ] TEL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:52.050592] [INFO ] [MAIN ] TEL: Generated 1820 derivative records from 51898 primary records. [2025-09-26T22:28:52.050964] [DEBUG] [LOCAL ] TEL: Saving derivative data. [2025-09-26T22:28:52.069748] [DEBUG] [LOCAL ] TEL: Derivative data saved (1820 records). [2025-09-26T22:28:52.069973] [INFO ] [MAIN ] TEL: Successfully saved derivative data. [2025-09-26T22:28:52.073349] [INFO ] [MAIN ] Derivative Progress: 1790/2074 symbols completed. TEL took 1.2s. Estimated remaining: 1m 58s. Rate: 144.3 symbols/min [2025-09-26T22:28:52.073727] [INFO ] [MAIN ] TEVA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:52.095839] [DEBUG] [MAIN ] TEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:52.096927] [INFO ] [MAIN ] TEN: Generated 1820 derivative records from 31383 primary records. [2025-09-26T22:28:52.097164] [DEBUG] [LOCAL ] TEN: Saving derivative data. [2025-09-26T22:28:52.114493] [DEBUG] [LOCAL ] TEO: Loaded 22345 existing records from primary storage. [2025-09-26T22:28:52.120915] [INFO ] [MAIN ] TEO: Loaded 22345 primary data records. [2025-09-26T22:28:52.239067] [DEBUG] [LOCAL ] TEN: Derivative data saved (1820 records). [2025-09-26T22:28:52.254113] [INFO ] [MAIN ] TEN: Successfully saved derivative data. [2025-09-26T22:28:52.279193] [INFO ] [MAIN ] Derivative Progress: 1791/2074 symbols completed. TEN took 1.2s. Estimated remaining: 1m 58s. Rate: 144.4 symbols/min [2025-09-26T22:28:52.319826] [INFO ] [MAIN ] TEX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:52.480453] [DEBUG] [LOCAL ] TEVA: Loaded 54413 existing records from primary storage. [2025-09-26T22:28:52.481339] [INFO ] [MAIN ] TEVA: Loaded 54413 primary data records. [2025-09-26T22:28:52.900305] [DEBUG] [LOCAL ] TEX: Loaded 45170 existing records from primary storage. [2025-09-26T22:28:52.900988] [INFO ] [MAIN ] TEX: Loaded 45170 primary data records. [2025-09-26T22:28:53.033513] [DEBUG] [MAIN ] TEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:53.045797] [INFO ] [MAIN ] TEO: Generated 1820 derivative records from 22345 primary records. [2025-09-26T22:28:53.061343] [DEBUG] [LOCAL ] TEO: Saving derivative data. [2025-09-26T22:28:53.261279] [DEBUG] [LOCAL ] TEO: Derivative data saved (1820 records). [2025-09-26T22:28:53.261877] [INFO ] [MAIN ] TEO: Successfully saved derivative data. [2025-09-26T22:28:53.264179] [INFO ] [MAIN ] Derivative Progress: 1792/2074 symbols completed. TEO took 1.2s. Estimated remaining: 1m 57s. Rate: 144.3 symbols/min [2025-09-26T22:28:53.265464] [INFO ] [MAIN ] TFC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:53.286147] [DEBUG] [MAIN ] TEVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:53.287221] [INFO ] [MAIN ] TEVA: Generated 1820 derivative records from 54413 primary records. [2025-09-26T22:28:53.287444] [DEBUG] [LOCAL ] TEVA: Saving derivative data. [2025-09-26T22:28:53.317076] [DEBUG] [LOCAL ] TEVA: Derivative data saved (1820 records). [2025-09-26T22:28:53.322307] [INFO ] [MAIN ] TEVA: Successfully saved derivative data. [2025-09-26T22:28:53.322596] [DEBUG] [MAIN ] TEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:53.326333] [INFO ] [MAIN ] TEX: Generated 1820 derivative records from 45170 primary records. [2025-09-26T22:28:53.325404] [INFO ] [MAIN ] Derivative Progress: 1793/2074 symbols completed. TEVA took 1.3s. Estimated remaining: 1m 57s. Rate: 144.3 symbols/min [2025-09-26T22:28:53.326483] [DEBUG] [LOCAL ] TEX: Saving derivative data. [2025-09-26T22:28:53.327582] [INFO ] [MAIN ] TFII: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:53.343144] [DEBUG] [LOCAL ] TEX: Derivative data saved (1820 records). [2025-09-26T22:28:53.343302] [INFO ] [MAIN ] TEX: Successfully saved derivative data. [2025-09-26T22:28:53.346059] [INFO ] [MAIN ] Derivative Progress: 1794/2074 symbols completed. TEX took 1.0s. Estimated remaining: 1m 56s. Rate: 144.4 symbols/min [2025-09-26T22:28:53.346558] [INFO ] [MAIN ] TFIN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:53.397909] [DEBUG] [LOCAL ] TFC: Loaded 54447 existing records from primary storage. [2025-09-26T22:28:53.398177] [INFO ] [MAIN ] TFC: Loaded 54447 primary data records. [2025-09-26T22:28:53.462837] [DEBUG] [LOCAL ] TFIN: Loaded 23896 existing records from primary storage. [2025-09-26T22:28:53.471518] [INFO ] [MAIN ] TFIN: Loaded 23896 primary data records. [2025-09-26T22:28:53.628413] [DEBUG] [LOCAL ] TFII: Loaded 34733 existing records from primary storage. [2025-09-26T22:28:53.680279] [INFO ] [MAIN ] TFII: Loaded 34733 primary data records. [2025-09-26T22:28:54.437802] [DEBUG] [MAIN ] TFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:54.440269] [INFO ] [MAIN ] TFC: Generated 1820 derivative records from 54447 primary records. [2025-09-26T22:28:54.442319] [DEBUG] [LOCAL ] TFC: Saving derivative data. [2025-09-26T22:28:54.474797] [DEBUG] [LOCAL ] TFC: Derivative data saved (1820 records). [2025-09-26T22:28:54.475765] [INFO ] [MAIN ] TFC: Successfully saved derivative data. [2025-09-26T22:28:54.476200] [DEBUG] [MAIN ] TFIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:54.480186] [INFO ] [MAIN ] TFIN: Generated 1820 derivative records from 23896 primary records. [2025-09-26T22:28:54.480324] [DEBUG] [LOCAL ] TFIN: Saving derivative data. [2025-09-26T22:28:54.482705] [INFO ] [MAIN ] Derivative Progress: 1795/2074 symbols completed. TFC took 1.2s. Estimated remaining: 1m 56s. Rate: 144.3 symbols/min [2025-09-26T22:28:54.495857] [INFO ] [MAIN ] TFPM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:54.503694] [DEBUG] [LOCAL ] TFIN: Derivative data saved (1820 records). [2025-09-26T22:28:54.504095] [INFO ] [MAIN ] TFIN: Successfully saved derivative data. [2025-09-26T22:28:54.507794] [INFO ] [MAIN ] Derivative Progress: 1796/2074 symbols completed. TFIN took 1.2s. Estimated remaining: 1m 56s. Rate: 144.4 symbols/min [2025-09-26T22:28:54.521303] [INFO ] [MAIN ] TFX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:54.522696] [DEBUG] [MAIN ] TFII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:54.523907] [INFO ] [MAIN ] TFII: Generated 1820 derivative records from 34733 primary records. [2025-09-26T22:28:54.524140] [DEBUG] [LOCAL ] TFII: Saving derivative data. [2025-09-26T22:28:54.558228] [DEBUG] [LOCAL ] TFII: Derivative data saved (1820 records). [2025-09-26T22:28:54.558612] [INFO ] [MAIN ] TFII: Successfully saved derivative data. [2025-09-26T22:28:54.562537] [INFO ] [MAIN ] Derivative Progress: 1797/2074 symbols completed. TFII took 1.2s. Estimated remaining: 1m 55s. Rate: 144.4 symbols/min [2025-09-26T22:28:54.563234] [INFO ] [MAIN ] TG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:54.589160] [DEBUG] [LOCAL ] TFPM: Loaded 37997 existing records from primary storage. [2025-09-26T22:28:54.589364] [INFO ] [MAIN ] TFPM: Loaded 37997 primary data records. [2025-09-26T22:28:54.670062] [DEBUG] [LOCAL ] TG: Loaded 10581 existing records from primary storage. [2025-09-26T22:28:54.693522] [INFO ] [MAIN ] TG: Loaded 10581 primary data records. [2025-09-26T22:28:54.679950] [DEBUG] [LOCAL ] TFX: Loaded 37936 existing records from primary storage. [2025-09-26T22:28:54.742240] [INFO ] [MAIN ] TFX: Loaded 37936 primary data records. [2025-09-26T22:28:55.670031] [DEBUG] [MAIN ] TFPM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:55.683755] [INFO ] [MAIN ] TFPM: Generated 1820 derivative records from 37997 primary records. [2025-09-26T22:28:55.685032] [DEBUG] [LOCAL ] TFPM: Saving derivative data. [2025-09-26T22:28:55.688504] [DEBUG] [MAIN ] TG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:55.697230] [INFO ] [MAIN ] TG: Generated 1820 derivative records from 10581 primary records. [2025-09-26T22:28:55.718154] [DEBUG] [LOCAL ] TFPM: Derivative data saved (1820 records). [2025-09-26T22:28:55.716028] [DEBUG] [LOCAL ] TG: Saving derivative data. [2025-09-26T22:28:55.718299] [INFO ] [MAIN ] TFPM: Successfully saved derivative data. [2025-09-26T22:28:55.720768] [INFO ] [MAIN ] Derivative Progress: 1798/2074 symbols completed. TFPM took 1.2s. Estimated remaining: 1m 55s. Rate: 144.3 symbols/min [2025-09-26T22:28:55.729225] [DEBUG] [MAIN ] TFX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:55.735681] [INFO ] [MAIN ] TFX: Generated 1820 derivative records from 37936 primary records. [2025-09-26T22:28:55.740162] [DEBUG] [LOCAL ] TFX: Saving derivative data. [2025-09-26T22:28:55.740076] [DEBUG] [LOCAL ] TG: Derivative data saved (1820 records). [2025-09-26T22:28:55.741231] [INFO ] [MAIN ] TG: Successfully saved derivative data. [2025-09-26T22:28:55.744767] [INFO ] [MAIN ] Derivative Progress: 1799/2074 symbols completed. TG took 1.2s. Estimated remaining: 1m 54s. Rate: 144.4 symbols/min [2025-09-26T22:28:55.761298] [DEBUG] [LOCAL ] TFX: Derivative data saved (1820 records). [2025-09-26T22:28:55.761411] [INFO ] [MAIN ] TFX: Successfully saved derivative data. [2025-09-26T22:28:55.764712] [INFO ] [MAIN ] Derivative Progress: 1800/2074 symbols completed. TFX took 1.2s. Estimated remaining: 1m 54s. Rate: 144.4 symbols/min [2025-09-26T22:28:55.765666] [INFO ] [MAIN ] TGLS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:55.765545] [INFO ] [MAIN ] TGNA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:55.766187] [INFO ] [MAIN ] TGS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:55.807406] [DEBUG] [LOCAL ] TGLS: Loaded 28709 existing records from primary storage. [2025-09-26T22:28:55.819042] [INFO ] [MAIN ] TGLS: Loaded 28709 primary data records. [2025-09-26T22:28:55.866933] [DEBUG] [LOCAL ] TGS: Loaded 33072 existing records from primary storage. [2025-09-26T22:28:55.905837] [INFO ] [MAIN ] TGS: Loaded 33072 primary data records. [2025-09-26T22:28:56.055373] [DEBUG] [LOCAL ] TGNA: Loaded 49444 existing records from primary storage. [2025-09-26T22:28:56.097894] [INFO ] [MAIN ] TGNA: Loaded 49444 primary data records. [2025-09-26T22:28:56.884871] [DEBUG] [MAIN ] TGLS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:56.885999] [INFO ] [MAIN ] TGLS: Generated 1820 derivative records from 28709 primary records. [2025-09-26T22:28:56.886529] [DEBUG] [LOCAL ] TGLS: Saving derivative data. [2025-09-26T22:28:56.908791] [DEBUG] [LOCAL ] TGLS: Derivative data saved (1820 records). [2025-09-26T22:28:56.926487] [INFO ] [MAIN ] TGLS: Successfully saved derivative data. [2025-09-26T22:28:56.929459] [INFO ] [MAIN ] Derivative Progress: 1801/2074 symbols completed. TGLS took 1.2s. Estimated remaining: 1m 54s. Rate: 144.3 symbols/min [2025-09-26T22:28:56.930622] [INFO ] [MAIN ] TGT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:56.930433] [DEBUG] [MAIN ] TGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:56.931826] [INFO ] [MAIN ] TGS: Generated 1820 derivative records from 33072 primary records. [2025-09-26T22:28:56.931932] [DEBUG] [LOCAL ] TGS: Saving derivative data. [2025-09-26T22:28:56.955553] [DEBUG] [MAIN ] TGNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:56.960439] [INFO ] [MAIN ] TGNA: Generated 1820 derivative records from 49444 primary records. [2025-09-26T22:28:56.961493] [DEBUG] [LOCAL ] TGNA: Saving derivative data. [2025-09-26T22:28:56.981141] [DEBUG] [LOCAL ] TGNA: Derivative data saved (1820 records). [2025-09-26T22:28:56.981236] [INFO ] [MAIN ] TGNA: Successfully saved derivative data. [2025-09-26T22:28:56.984204] [INFO ] [MAIN ] Derivative Progress: 1802/2074 symbols completed. TGNA took 1.2s. Estimated remaining: 1m 53s. Rate: 144.4 symbols/min [2025-09-26T22:28:56.979034] [DEBUG] [LOCAL ] TGS: Derivative data saved (1820 records). [2025-09-26T22:28:56.984830] [INFO ] [MAIN ] TGS: Successfully saved derivative data. [2025-09-26T22:28:56.984569] [INFO ] [MAIN ] THC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:56.988090] [INFO ] [MAIN ] Derivative Progress: 1803/2074 symbols completed. TGS took 1.2s. Estimated remaining: 1m 53s. Rate: 144.4 symbols/min [2025-09-26T22:28:56.989045] [INFO ] [MAIN ] THG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:57.030719] [DEBUG] [LOCAL ] THG: Loaded 22081 existing records from primary storage. [2025-09-26T22:28:57.046468] [INFO ] [MAIN ] THG: Loaded 22081 primary data records. [2025-09-26T22:28:57.066016] [DEBUG] [LOCAL ] TGT: Loaded 54558 existing records from primary storage. [2025-09-26T22:28:57.090150] [INFO ] [MAIN ] TGT: Loaded 54558 primary data records. [2025-09-26T22:28:57.301185] [DEBUG] [LOCAL ] THC: Loaded 48617 existing records from primary storage. [2025-09-26T22:28:57.314580] [INFO ] [MAIN ] THC: Loaded 48617 primary data records. [2025-09-26T22:28:58.147709] [DEBUG] [MAIN ] TGT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:58.149411] [INFO ] [MAIN ] TGT: Generated 1820 derivative records from 54558 primary records. [2025-09-26T22:28:58.149959] [DEBUG] [LOCAL ] TGT: Saving derivative data. [2025-09-26T22:28:58.183301] [DEBUG] [LOCAL ] TGT: Derivative data saved (1820 records). [2025-09-26T22:28:58.183455] [INFO ] [MAIN ] TGT: Successfully saved derivative data. [2025-09-26T22:28:58.172755] [DEBUG] [MAIN ] THG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:58.186792] [INFO ] [MAIN ] THG: Generated 1820 derivative records from 22081 primary records. [2025-09-26T22:28:58.185915] [INFO ] [MAIN ] Derivative Progress: 1804/2074 symbols completed. TGT took 1.3s. Estimated remaining: 1m 52s. Rate: 144.3 symbols/min [2025-09-26T22:28:58.186948] [DEBUG] [LOCAL ] THG: Saving derivative data. [2025-09-26T22:28:58.187300] [INFO ] [MAIN ] THIR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:58.214009] [DEBUG] [MAIN ] THC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:58.215239] [INFO ] [MAIN ] THC: Generated 1820 derivative records from 48617 primary records. [2025-09-26T22:28:58.215577] [DEBUG] [LOCAL ] THC: Saving derivative data. [2025-09-26T22:28:58.237809] [DEBUG] [LOCAL ] THC: Derivative data saved (1820 records). [2025-09-26T22:28:58.237920] [INFO ] [MAIN ] THC: Successfully saved derivative data. [2025-09-26T22:28:58.241233] [INFO ] [MAIN ] Derivative Progress: 1805/2074 symbols completed. THC took 1.3s. Estimated remaining: 1m 52s. Rate: 144.4 symbols/min [2025-09-26T22:28:58.242080] [INFO ] [MAIN ] THLV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:58.235328] [DEBUG] [LOCAL ] THIR: Loaded 2238 existing records from primary storage. [2025-09-26T22:28:58.243125] [DEBUG] [LOCAL ] THG: Derivative data saved (1820 records). [2025-09-26T22:28:58.243565] [INFO ] [MAIN ] THG: Successfully saved derivative data. [2025-09-26T22:28:58.246310] [INFO ] [MAIN ] Derivative Progress: 1806/2074 symbols completed. THG took 1.3s. Estimated remaining: 1m 51s. Rate: 144.4 symbols/min [2025-09-26T22:28:58.246463] [INFO ] [MAIN ] THIR: Loaded 2238 primary data records. [2025-09-26T22:28:58.246821] [INFO ] [MAIN ] THO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:58.296677] [DEBUG] [LOCAL ] THLV: Loaded 1614 existing records from primary storage. [2025-09-26T22:28:58.302194] [INFO ] [MAIN ] THLV: Loaded 1614 primary data records. [2025-09-26T22:28:58.874117] [DEBUG] [LOCAL ] THO: Loaded 42957 existing records from primary storage. [2025-09-26T22:28:58.924039] [INFO ] [MAIN ] THO: Loaded 42957 primary data records. [2025-09-26T22:28:59.339159] [DEBUG] [MAIN ] THIR: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:28:59.341371] [INFO ] [MAIN ] THIR: Generated 1819 derivative records from 2238 primary records. [2025-09-26T22:28:59.340223] [DEBUG] [MAIN ] THLV: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-09-26T22:28:59.342628] [INFO ] [MAIN ] THLV: Generated 1818 derivative records from 1614 primary records. [2025-09-26T22:28:59.342939] [DEBUG] [LOCAL ] THLV: Saving derivative data. [2025-09-26T22:28:59.342875] [DEBUG] [LOCAL ] THIR: Saving derivative data. [2025-09-26T22:28:59.372590] [DEBUG] [LOCAL ] THIR: Derivative data saved (1819 records). [2025-09-26T22:28:59.373267] [INFO ] [MAIN ] THIR: Successfully saved derivative data. [2025-09-26T22:28:59.377167] [INFO ] [MAIN ] Derivative Progress: 1807/2074 symbols completed. THIR took 1.2s. Estimated remaining: 1m 51s. Rate: 144.3 symbols/min [2025-09-26T22:28:59.378829] [DEBUG] [LOCAL ] THLV: Derivative data saved (1818 records). [2025-09-26T22:28:59.378930] [INFO ] [MAIN ] THLV: Successfully saved derivative data. [2025-09-26T22:28:59.378608] [INFO ] [MAIN ] THQ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:59.381697] [INFO ] [MAIN ] Derivative Progress: 1808/2074 symbols completed. THLV took 1.1s. Estimated remaining: 1m 51s. Rate: 144.4 symbols/min [2025-09-26T22:28:59.382761] [INFO ] [MAIN ] THR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:28:59.413196] [DEBUG] [MAIN ] THO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:28:59.414031] [INFO ] [MAIN ] THO: Generated 1820 derivative records from 42957 primary records. [2025-09-26T22:28:59.414272] [DEBUG] [LOCAL ] THO: Saving derivative data. [2025-09-26T22:28:59.443075] [DEBUG] [LOCAL ] THR: Loaded 20218 existing records from primary storage. [2025-09-26T22:28:59.444695] [DEBUG] [LOCAL ] THQ: Loaded 24879 existing records from primary storage. [2025-09-26T22:28:59.444863] [INFO ] [MAIN ] THR: Loaded 20218 primary data records. [2025-09-26T22:28:59.444923] [INFO ] [MAIN ] THQ: Loaded 24879 primary data records. [2025-09-26T22:28:59.575931] [DEBUG] [LOCAL ] THO: Derivative data saved (1820 records). [2025-09-26T22:28:59.591215] [INFO ] [MAIN ] THO: Successfully saved derivative data. [2025-09-26T22:28:59.654815] [INFO ] [MAIN ] Derivative Progress: 1809/2074 symbols completed. THO took 1.4s. Estimated remaining: 1m 50s. Rate: 144.4 symbols/min [2025-09-26T22:28:59.730559] [INFO ] [MAIN ] THS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:00.153328] [DEBUG] [LOCAL ] THS: Loaded 38565 existing records from primary storage. [2025-09-26T22:29:00.162364] [INFO ] [MAIN ] THS: Loaded 38565 primary data records. [2025-09-26T22:29:00.169638] [DEBUG] [MAIN ] THR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:00.220611] [INFO ] [MAIN ] THR: Generated 1820 derivative records from 20218 primary records. [2025-09-26T22:29:00.251626] [DEBUG] [LOCAL ] THR: Saving derivative data. [2025-09-26T22:29:00.315637] [DEBUG] [MAIN ] THQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:00.337748] [INFO ] [MAIN ] THQ: Generated 1820 derivative records from 24879 primary records. [2025-09-26T22:29:00.367520] [DEBUG] [LOCAL ] THQ: Saving derivative data. [2025-09-26T22:29:00.331163] [DEBUG] [LOCAL ] THR: Derivative data saved (1820 records). [2025-09-26T22:29:00.390152] [INFO ] [MAIN ] THR: Successfully saved derivative data. [2025-09-26T22:29:00.408033] [INFO ] [MAIN ] Derivative Progress: 1810/2074 symbols completed. THR took 1.0s. Estimated remaining: 1m 50s. Rate: 144.3 symbols/min [2025-09-26T22:29:00.408442] [INFO ] [MAIN ] THW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:00.566077] [DEBUG] [LOCAL ] THQ: Derivative data saved (1820 records). [2025-09-26T22:29:00.566483] [INFO ] [MAIN ] THQ: Successfully saved derivative data. [2025-09-26T22:29:00.569367] [INFO ] [MAIN ] Derivative Progress: 1811/2074 symbols completed. THQ took 1.2s. Estimated remaining: 1m 49s. Rate: 144.4 symbols/min [2025-09-26T22:29:00.569749] [INFO ] [MAIN ] TIMB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:00.593181] [DEBUG] [LOCAL ] THW: Loaded 19392 existing records from primary storage. [2025-09-26T22:29:00.593548] [INFO ] [MAIN ] THW: Loaded 19392 primary data records. [2025-09-26T22:29:00.781999] [DEBUG] [LOCAL ] TIMB: Loaded 36983 existing records from primary storage. [2025-09-26T22:29:00.826386] [INFO ] [MAIN ] TIMB: Loaded 36983 primary data records. [2025-09-26T22:29:00.933308] [DEBUG] [MAIN ] THS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:00.965463] [INFO ] [MAIN ] THS: Generated 1820 derivative records from 38565 primary records. [2025-09-26T22:29:00.973841] [DEBUG] [LOCAL ] THS: Saving derivative data. [2025-09-26T22:29:01.076829] [DEBUG] [LOCAL ] THS: Derivative data saved (1820 records). [2025-09-26T22:29:01.085802] [INFO ] [MAIN ] THS: Successfully saved derivative data. [2025-09-26T22:29:01.092608] [INFO ] [MAIN ] Derivative Progress: 1812/2074 symbols completed. THS took 1.4s. Estimated remaining: 1m 49s. Rate: 144.4 symbols/min [2025-09-26T22:29:01.098560] [INFO ] [MAIN ] TISI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:01.356576] [DEBUG] [LOCAL ] TISI: Loaded 3805 existing records from primary storage. [2025-09-26T22:29:01.356847] [INFO ] [MAIN ] TISI: Loaded 3805 primary data records. [2025-09-26T22:29:01.546139] [DEBUG] [MAIN ] THW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:01.567729] [INFO ] [MAIN ] THW: Generated 1820 derivative records from 19392 primary records. [2025-09-26T22:29:01.567843] [DEBUG] [LOCAL ] THW: Saving derivative data. [2025-09-26T22:29:01.737964] [DEBUG] [LOCAL ] THW: Derivative data saved (1820 records). [2025-09-26T22:29:01.738725] [INFO ] [MAIN ] THW: Successfully saved derivative data. [2025-09-26T22:29:01.741342] [INFO ] [MAIN ] Derivative Progress: 1813/2074 symbols completed. THW took 1.3s. Estimated remaining: 1m 49s. Rate: 144.3 symbols/min [2025-09-26T22:29:01.759459] [DEBUG] [MAIN ] TIMB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:01.760320] [INFO ] [MAIN ] TIMB: Generated 1820 derivative records from 36983 primary records. [2025-09-26T22:29:01.761274] [DEBUG] [LOCAL ] TIMB: Saving derivative data. [2025-09-26T22:29:01.778495] [DEBUG] [LOCAL ] TIMB: Derivative data saved (1820 records). [2025-09-26T22:29:01.778716] [INFO ] [MAIN ] TIMB: Successfully saved derivative data. [2025-09-26T22:29:01.781000] [INFO ] [MAIN ] Derivative Progress: 1814/2074 symbols completed. TIMB took 1.2s. Estimated remaining: 1m 48s. Rate: 144.4 symbols/min [2025-09-26T22:29:01.798230] [DEBUG] [MAIN ] TISI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:01.798984] [INFO ] [MAIN ] TISI: Generated 1820 derivative records from 3805 primary records. [2025-09-26T22:29:01.799048] [DEBUG] [LOCAL ] TISI: Saving derivative data. [2025-09-26T22:29:01.813407] [DEBUG] [LOCAL ] TISI: Derivative data saved (1820 records). [2025-09-26T22:29:01.813497] [INFO ] [MAIN ] TISI: Successfully saved derivative data. [2025-09-26T22:29:01.816567] [INFO ] [MAIN ] Derivative Progress: 1815/2074 symbols completed. TISI took 0.7s. Estimated remaining: 1m 48s. Rate: 144.5 symbols/min [2025-09-26T22:29:01.817497] [INFO ] [MAIN ] TK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:01.817673] [INFO ] [MAIN ] TIXT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:01.817811] [INFO ] [MAIN ] TJX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:01.859040] [DEBUG] [LOCAL ] TIXT: Loaded 31824 existing records from primary storage. [2025-09-26T22:29:01.859371] [INFO ] [MAIN ] TIXT: Loaded 31824 primary data records. [2025-09-26T22:29:01.993422] [DEBUG] [LOCAL ] TK: Loaded 40151 existing records from primary storage. [2025-09-26T22:29:01.993683] [INFO ] [MAIN ] TK: Loaded 40151 primary data records. [2025-09-26T22:29:02.362484] [DEBUG] [LOCAL ] TJX: Loaded 54449 existing records from primary storage. [2025-09-26T22:29:02.368818] [INFO ] [MAIN ] TJX: Loaded 54449 primary data records. [2025-09-26T22:29:02.930609] [DEBUG] [MAIN ] TIXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:02.932284] [INFO ] [MAIN ] TIXT: Generated 1820 derivative records from 31824 primary records. [2025-09-26T22:29:02.932406] [DEBUG] [LOCAL ] TIXT: Saving derivative data. [2025-09-26T22:29:02.964818] [DEBUG] [MAIN ] TK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:02.966555] [INFO ] [MAIN ] TK: Generated 1820 derivative records from 40151 primary records. [2025-09-26T22:29:02.967188] [DEBUG] [LOCAL ] TK: Saving derivative data. [2025-09-26T22:29:02.969200] [DEBUG] [LOCAL ] TIXT: Derivative data saved (1820 records). [2025-09-26T22:29:02.970561] [INFO ] [MAIN ] TIXT: Successfully saved derivative data. [2025-09-26T22:29:02.980112] [INFO ] [MAIN ] Derivative Progress: 1816/2074 symbols completed. TIXT took 1.2s. Estimated remaining: 1m 47s. Rate: 144.3 symbols/min [2025-09-26T22:29:02.988826] [DEBUG] [LOCAL ] TK: Derivative data saved (1820 records). [2025-09-26T22:29:02.989060] [INFO ] [MAIN ] TK: Successfully saved derivative data. [2025-09-26T22:29:02.987830] [INFO ] [MAIN ] TKC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:02.991914] [INFO ] [MAIN ] Derivative Progress: 1817/2074 symbols completed. TK took 1.2s. Estimated remaining: 1m 47s. Rate: 144.4 symbols/min [2025-09-26T22:29:02.993175] [INFO ] [MAIN ] TKO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:03.010071] [DEBUG] [MAIN ] TJX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:03.010868] [INFO ] [MAIN ] TJX: Generated 1820 derivative records from 54449 primary records. [2025-09-26T22:29:03.010980] [DEBUG] [LOCAL ] TJX: Saving derivative data. [2025-09-26T22:29:03.027728] [DEBUG] [LOCAL ] TJX: Derivative data saved (1820 records). [2025-09-26T22:29:03.027857] [INFO ] [MAIN ] TJX: Successfully saved derivative data. [2025-09-26T22:29:03.030725] [INFO ] [MAIN ] Derivative Progress: 1818/2074 symbols completed. TJX took 1.2s. Estimated remaining: 1m 46s. Rate: 144.5 symbols/min [2025-09-26T22:29:03.030992] [INFO ] [MAIN ] TKR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:03.072832] [DEBUG] [LOCAL ] TKC: Loaded 39062 existing records from primary storage. [2025-09-26T22:29:03.073172] [INFO ] [MAIN ] TKC: Loaded 39062 primary data records. [2025-09-26T22:29:03.207282] [DEBUG] [LOCAL ] TKO: Loaded 44814 existing records from primary storage. [2025-09-26T22:29:03.211929] [INFO ] [MAIN ] TKO: Loaded 44814 primary data records. [2025-09-26T22:29:03.298423] [DEBUG] [LOCAL ] TKR: Loaded 40832 existing records from primary storage. [2025-09-26T22:29:03.352692] [INFO ] [MAIN ] TKR: Loaded 40832 primary data records. [2025-09-26T22:29:04.134611] [DEBUG] [MAIN ] TKC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:04.136263] [INFO ] [MAIN ] TKC: Generated 1820 derivative records from 39062 primary records. [2025-09-26T22:29:04.137741] [DEBUG] [LOCAL ] TKC: Saving derivative data. [2025-09-26T22:29:04.161221] [DEBUG] [LOCAL ] TKC: Derivative data saved (1820 records). [2025-09-26T22:29:04.161363] [INFO ] [MAIN ] TKC: Successfully saved derivative data. [2025-09-26T22:29:04.163818] [INFO ] [MAIN ] Derivative Progress: 1819/2074 symbols completed. TKC took 1.2s. Estimated remaining: 1m 46s. Rate: 144.3 symbols/min [2025-09-26T22:29:04.164579] [INFO ] [MAIN ] TLYS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:04.178897] [DEBUG] [MAIN ] TKO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:04.180062] [INFO ] [MAIN ] TKO: Generated 1820 derivative records from 44814 primary records. [2025-09-26T22:29:04.180396] [DEBUG] [LOCAL ] TKO: Saving derivative data. [2025-09-26T22:29:04.200553] [DEBUG] [LOCAL ] TKO: Derivative data saved (1820 records). [2025-09-26T22:29:04.200977] [INFO ] [MAIN ] TKO: Successfully saved derivative data. [2025-09-26T22:29:04.204832] [INFO ] [MAIN ] Derivative Progress: 1820/2074 symbols completed. TKO took 1.2s. Estimated remaining: 1m 46s. Rate: 144.4 symbols/min [2025-09-26T22:29:04.209384] [INFO ] [MAIN ] TM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:04.224364] [DEBUG] [MAIN ] TKR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:04.225400] [INFO ] [MAIN ] TKR: Generated 1820 derivative records from 40832 primary records. [2025-09-26T22:29:04.231843] [DEBUG] [LOCAL ] TKR: Saving derivative data. [2025-09-26T22:29:04.233245] [DEBUG] [LOCAL ] TLYS: Loaded 17064 existing records from primary storage. [2025-09-26T22:29:04.233665] [INFO ] [MAIN ] TLYS: Loaded 17064 primary data records. [2025-09-26T22:29:04.320722] [DEBUG] [LOCAL ] TKR: Derivative data saved (1820 records). [2025-09-26T22:29:04.347743] [INFO ] [MAIN ] TKR: Successfully saved derivative data. [2025-09-26T22:29:04.357253] [INFO ] [MAIN ] Derivative Progress: 1821/2074 symbols completed. TKR took 1.3s. Estimated remaining: 1m 45s. Rate: 144.5 symbols/min [2025-09-26T22:29:04.372567] [INFO ] [MAIN ] TME: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:04.475795] [DEBUG] [LOCAL ] TM: Loaded 36992 existing records from primary storage. [2025-09-26T22:29:04.506731] [INFO ] [MAIN ] TM: Loaded 36992 primary data records. [2025-09-26T22:29:04.974959] [DEBUG] [LOCAL ] TME: Loaded 53979 existing records from primary storage. [2025-09-26T22:29:04.976824] [INFO ] [MAIN ] TME: Loaded 53979 primary data records. [2025-09-26T22:29:05.059616] [DEBUG] [MAIN ] TLYS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:05.071449] [INFO ] [MAIN ] TLYS: Generated 1820 derivative records from 17064 primary records. [2025-09-26T22:29:05.094988] [DEBUG] [LOCAL ] TLYS: Saving derivative data. [2025-09-26T22:29:05.231373] [DEBUG] [LOCAL ] TLYS: Derivative data saved (1820 records). [2025-09-26T22:29:05.352092] [INFO ] [MAIN ] TLYS: Successfully saved derivative data. [2025-09-26T22:29:05.364251] [INFO ] [MAIN ] Derivative Progress: 1822/2074 symbols completed. TLYS took 1.2s. Estimated remaining: 1m 45s. Rate: 144.3 symbols/min [2025-09-26T22:29:05.367018] [INFO ] [MAIN ] TMHC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:05.381945] [DEBUG] [MAIN ] TM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:05.382869] [INFO ] [MAIN ] TM: Generated 1820 derivative records from 36992 primary records. [2025-09-26T22:29:05.383257] [DEBUG] [LOCAL ] TM: Saving derivative data. [2025-09-26T22:29:05.405075] [DEBUG] [LOCAL ] TM: Derivative data saved (1820 records). [2025-09-26T22:29:05.405222] [INFO ] [MAIN ] TM: Successfully saved derivative data. [2025-09-26T22:29:05.408347] [INFO ] [MAIN ] Derivative Progress: 1823/2074 symbols completed. TM took 1.2s. Estimated remaining: 1m 44s. Rate: 144.4 symbols/min [2025-09-26T22:29:05.408850] [INFO ] [MAIN ] TMO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:05.439283] [DEBUG] [MAIN ] TME: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:05.440108] [INFO ] [MAIN ] TME: Generated 1820 derivative records from 53979 primary records. [2025-09-26T22:29:05.440309] [DEBUG] [LOCAL ] TME: Saving derivative data. [2025-09-26T22:29:05.457772] [DEBUG] [LOCAL ] TME: Derivative data saved (1820 records). [2025-09-26T22:29:05.457879] [INFO ] [MAIN ] TME: Successfully saved derivative data. [2025-09-26T22:29:05.460490] [INFO ] [MAIN ] Derivative Progress: 1824/2074 symbols completed. TME took 1.1s. Estimated remaining: 1m 44s. Rate: 144.5 symbols/min [2025-09-26T22:29:05.460814] [INFO ] [MAIN ] TNC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:05.477038] [DEBUG] [LOCAL ] TMHC: Loaded 46274 existing records from primary storage. [2025-09-26T22:29:05.477326] [INFO ] [MAIN ] TMHC: Loaded 46274 primary data records. [2025-09-26T22:29:05.647712] [DEBUG] [LOCAL ] TNC: Loaded 15334 existing records from primary storage. [2025-09-26T22:29:05.653835] [INFO ] [MAIN ] TNC: Loaded 15334 primary data records. [2025-09-26T22:29:05.907136] [DEBUG] [LOCAL ] TMO: Loaded 53089 existing records from primary storage. [2025-09-26T22:29:05.936488] [INFO ] [MAIN ] TMO: Loaded 53089 primary data records. [2025-09-26T22:29:06.591582] [DEBUG] [MAIN ] TMHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:06.593410] [INFO ] [MAIN ] TMHC: Generated 1820 derivative records from 46274 primary records. [2025-09-26T22:29:06.594188] [DEBUG] [LOCAL ] TMHC: Saving derivative data. [2025-09-26T22:29:06.616775] [DEBUG] [LOCAL ] TMHC: Derivative data saved (1820 records). [2025-09-26T22:29:06.618041] [INFO ] [MAIN ] TMHC: Successfully saved derivative data. [2025-09-26T22:29:06.621451] [INFO ] [MAIN ] Derivative Progress: 1825/2074 symbols completed. TMHC took 1.3s. Estimated remaining: 1m 44s. Rate: 144.3 symbols/min [2025-09-26T22:29:06.622298] [INFO ] [MAIN ] TNET: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:06.642156] [DEBUG] [MAIN ] TNC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:06.643547] [INFO ] [MAIN ] TNC: Generated 1820 derivative records from 15334 primary records. [2025-09-26T22:29:06.643748] [DEBUG] [LOCAL ] TNC: Saving derivative data. [2025-09-26T22:29:06.665356] [DEBUG] [LOCAL ] TNC: Derivative data saved (1820 records). [2025-09-26T22:29:06.665847] [INFO ] [MAIN ] TNC: Successfully saved derivative data. [2025-09-26T22:29:06.670464] [INFO ] [MAIN ] Derivative Progress: 1826/2074 symbols completed. TNC took 1.2s. Estimated remaining: 1m 43s. Rate: 144.4 symbols/min [2025-09-26T22:29:06.682152] [INFO ] [MAIN ] TNK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:06.697477] [DEBUG] [MAIN ] TMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:06.699404] [INFO ] [MAIN ] TMO: Generated 1820 derivative records from 53089 primary records. [2025-09-26T22:29:06.707557] [DEBUG] [LOCAL ] TMO: Saving derivative data. [2025-09-26T22:29:06.710681] [DEBUG] [LOCAL ] TNET: Loaded 29247 existing records from primary storage. [2025-09-26T22:29:06.711308] [INFO ] [MAIN ] TNET: Loaded 29247 primary data records. [2025-09-26T22:29:06.860601] [DEBUG] [LOCAL ] TMO: Derivative data saved (1820 records). [2025-09-26T22:29:06.877705] [INFO ] [MAIN ] TMO: Successfully saved derivative data. [2025-09-26T22:29:06.932066] [INFO ] [MAIN ] Derivative Progress: 1827/2074 symbols completed. TMO took 1.5s. Estimated remaining: 1m 43s. Rate: 144.4 symbols/min [2025-09-26T22:29:06.965971] [INFO ] [MAIN ] TNL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:06.960041] [DEBUG] [LOCAL ] TNK: Loaded 35701 existing records from primary storage. [2025-09-26T22:29:07.085957] [INFO ] [MAIN ] TNK: Loaded 35701 primary data records. [2025-09-26T22:29:07.458397] [DEBUG] [LOCAL ] TNL: Loaded 42474 existing records from primary storage. [2025-09-26T22:29:07.459902] [INFO ] [MAIN ] TNL: Loaded 42474 primary data records. [2025-09-26T22:29:07.602333] [DEBUG] [MAIN ] TNET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:07.614879] [INFO ] [MAIN ] TNET: Generated 1820 derivative records from 29247 primary records. [2025-09-26T22:29:07.615208] [DEBUG] [LOCAL ] TNET: Saving derivative data. [2025-09-26T22:29:07.921031] [DEBUG] [LOCAL ] TNET: Derivative data saved (1820 records). [2025-09-26T22:29:07.921762] [INFO ] [MAIN ] TNET: Successfully saved derivative data. [2025-09-26T22:29:07.926362] [INFO ] [MAIN ] Derivative Progress: 1828/2074 symbols completed. TNET took 1.3s. Estimated remaining: 1m 42s. Rate: 144.3 symbols/min [2025-09-26T22:29:07.948499] [DEBUG] [MAIN ] TNK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:07.950092] [INFO ] [MAIN ] TNK: Generated 1820 derivative records from 35701 primary records. [2025-09-26T22:29:07.950344] [DEBUG] [LOCAL ] TNK: Saving derivative data. [2025-09-26T22:29:07.970906] [DEBUG] [LOCAL ] TNK: Derivative data saved (1820 records). [2025-09-26T22:29:07.971254] [INFO ] [MAIN ] TNK: Successfully saved derivative data. [2025-09-26T22:29:07.975797] [INFO ] [MAIN ] Derivative Progress: 1829/2074 symbols completed. TNK took 1.3s. Estimated remaining: 1m 42s. Rate: 144.4 symbols/min [2025-09-26T22:29:07.998253] [DEBUG] [MAIN ] TNL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:08.000474] [INFO ] [MAIN ] TNL: Generated 1820 derivative records from 42474 primary records. [2025-09-26T22:29:08.000587] [DEBUG] [LOCAL ] TNL: Saving derivative data. [2025-09-26T22:29:08.024250] [DEBUG] [LOCAL ] TNL: Derivative data saved (1820 records). [2025-09-26T22:29:08.024476] [INFO ] [MAIN ] TNL: Successfully saved derivative data. [2025-09-26T22:29:08.029043] [INFO ] [MAIN ] Derivative Progress: 1830/2074 symbols completed. TNL took 1.1s. Estimated remaining: 1m 41s. Rate: 144.5 symbols/min [2025-09-26T22:29:08.030536] [INFO ] [MAIN ] TOST: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:08.031214] [INFO ] [MAIN ] TPB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:08.030875] [INFO ] [MAIN ] TOL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:08.124249] [DEBUG] [LOCAL ] TPB: Loaded 25409 existing records from primary storage. [2025-09-26T22:29:08.141159] [INFO ] [MAIN ] TPB: Loaded 25409 primary data records. [2025-09-26T22:29:08.161541] [DEBUG] [LOCAL ] TOST: Loaded 54461 existing records from primary storage. [2025-09-26T22:29:08.241914] [INFO ] [MAIN ] TOST: Loaded 54461 primary data records. [2025-09-26T22:29:08.254050] [DEBUG] [LOCAL ] TOL: Loaded 51738 existing records from primary storage. [2025-09-26T22:29:08.343742] [INFO ] [MAIN ] TOL: Loaded 51738 primary data records. [2025-09-26T22:29:09.487876] [DEBUG] [MAIN ] TPB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:09.489263] [INFO ] [MAIN ] TPB: Generated 1820 derivative records from 25409 primary records. [2025-09-26T22:29:09.498962] [DEBUG] [LOCAL ] TPB: Saving derivative data. [2025-09-26T22:29:09.505048] [DEBUG] [MAIN ] TOST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:09.517498] [INFO ] [MAIN ] TOST: Generated 1820 derivative records from 54461 primary records. [2025-09-26T22:29:09.522564] [DEBUG] [LOCAL ] TOST: Saving derivative data. [2025-09-26T22:29:09.557042] [DEBUG] [LOCAL ] TPB: Derivative data saved (1820 records). [2025-09-26T22:29:09.566422] [INFO ] [MAIN ] TPB: Successfully saved derivative data. [2025-09-26T22:29:09.567415] [DEBUG] [MAIN ] TOL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:09.571392] [INFO ] [MAIN ] Derivative Progress: 1831/2074 symbols completed. TPB took 1.5s. Estimated remaining: 1m 41s. Rate: 144.3 symbols/min [2025-09-26T22:29:09.572154] [INFO ] [MAIN ] TPC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:09.573215] [INFO ] [MAIN ] TOL: Generated 1820 derivative records from 51738 primary records. [2025-09-26T22:29:09.575754] [DEBUG] [LOCAL ] TOL: Saving derivative data. [2025-09-26T22:29:09.575265] [DEBUG] [LOCAL ] TOST: Derivative data saved (1820 records). [2025-09-26T22:29:09.576792] [INFO ] [MAIN ] TOST: Successfully saved derivative data. [2025-09-26T22:29:09.579538] [INFO ] [MAIN ] Derivative Progress: 1832/2074 symbols completed. TOST took 1.5s. Estimated remaining: 1m 41s. Rate: 144.3 symbols/min [2025-09-26T22:29:09.589295] [INFO ] [MAIN ] TPH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:09.597575] [DEBUG] [LOCAL ] TOL: Derivative data saved (1820 records). [2025-09-26T22:29:09.598054] [INFO ] [MAIN ] TOL: Successfully saved derivative data. [2025-09-26T22:29:09.601522] [INFO ] [MAIN ] Derivative Progress: 1833/2074 symbols completed. TOL took 1.6s. Estimated remaining: 1m 40s. Rate: 144.4 symbols/min [2025-09-26T22:29:09.602025] [INFO ] [MAIN ] TPL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:09.628235] [DEBUG] [LOCAL ] TPL: Loaded 12533 existing records from primary storage. [2025-09-26T22:29:09.628373] [INFO ] [MAIN ] TPL: Loaded 12533 primary data records. [2025-09-26T22:29:09.775893] [DEBUG] [LOCAL ] TPC: Loaded 39311 existing records from primary storage. [2025-09-26T22:29:09.781590] [INFO ] [MAIN ] TPC: Loaded 39311 primary data records. [2025-09-26T22:29:09.928362] [DEBUG] [LOCAL ] TPH: Loaded 45821 existing records from primary storage. [2025-09-26T22:29:09.957124] [INFO ] [MAIN ] TPH: Loaded 45821 primary data records. [2025-09-26T22:29:10.748056] [DEBUG] [MAIN ] TPL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:10.749343] [INFO ] [MAIN ] TPL: Generated 1820 derivative records from 12533 primary records. [2025-09-26T22:29:10.750987] [DEBUG] [LOCAL ] TPL: Saving derivative data. [2025-09-26T22:29:10.772456] [DEBUG] [LOCAL ] TPL: Derivative data saved (1820 records). [2025-09-26T22:29:10.786240] [DEBUG] [MAIN ] TPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:10.785931] [INFO ] [MAIN ] TPL: Successfully saved derivative data. [2025-09-26T22:29:10.787383] [INFO ] [MAIN ] TPC: Generated 1820 derivative records from 39311 primary records. [2025-09-26T22:29:10.789804] [DEBUG] [LOCAL ] TPC: Saving derivative data. [2025-09-26T22:29:10.789718] [INFO ] [MAIN ] Derivative Progress: 1834/2074 symbols completed. TPL took 1.2s. Estimated remaining: 1m 40s. Rate: 144.3 symbols/min [2025-09-26T22:29:10.791162] [INFO ] [MAIN ] TPR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:10.808216] [DEBUG] [LOCAL ] TPC: Derivative data saved (1820 records). [2025-09-26T22:29:10.809243] [INFO ] [MAIN ] TPC: Successfully saved derivative data. [2025-09-26T22:29:10.812372] [INFO ] [MAIN ] Derivative Progress: 1835/2074 symbols completed. TPC took 1.2s. Estimated remaining: 1m 39s. Rate: 144.3 symbols/min [2025-09-26T22:29:10.812808] [INFO ] [MAIN ] TPVG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:10.829011] [DEBUG] [MAIN ] TPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:10.830087] [INFO ] [MAIN ] TPH: Generated 1820 derivative records from 45821 primary records. [2025-09-26T22:29:10.830206] [DEBUG] [LOCAL ] TPH: Saving derivative data. [2025-09-26T22:29:10.848077] [DEBUG] [LOCAL ] TPH: Derivative data saved (1820 records). [2025-09-26T22:29:10.848246] [INFO ] [MAIN ] TPH: Successfully saved derivative data. [2025-09-26T22:29:10.851942] [INFO ] [MAIN ] Derivative Progress: 1836/2074 symbols completed. TPH took 1.3s. Estimated remaining: 1m 39s. Rate: 144.4 symbols/min [2025-09-26T22:29:10.860689] [INFO ] [MAIN ] TPYP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:10.875415] [DEBUG] [LOCAL ] TPVG: Loaded 27400 existing records from primary storage. [2025-09-26T22:29:10.888401] [INFO ] [MAIN ] TPVG: Loaded 27400 primary data records. [2025-09-26T22:29:10.926628] [DEBUG] [LOCAL ] TPYP: Loaded 8039 existing records from primary storage. [2025-09-26T22:29:10.952969] [INFO ] [MAIN ] TPYP: Loaded 8039 primary data records. [2025-09-26T22:29:11.113061] [DEBUG] [LOCAL ] TPR: Loaded 54252 existing records from primary storage. [2025-09-26T22:29:11.158733] [INFO ] [MAIN ] TPR: Loaded 54252 primary data records. [2025-09-26T22:29:11.960506] [DEBUG] [MAIN ] TPVG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:11.962187] [INFO ] [MAIN ] TPVG: Generated 1820 derivative records from 27400 primary records. [2025-09-26T22:29:11.963368] [DEBUG] [LOCAL ] TPVG: Saving derivative data. [2025-09-26T22:29:11.994587] [DEBUG] [MAIN ] TPYP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:11.995805] [INFO ] [MAIN ] TPYP: Generated 1820 derivative records from 8039 primary records. [2025-09-26T22:29:11.998149] [DEBUG] [LOCAL ] TPYP: Saving derivative data. [2025-09-26T22:29:11.998046] [DEBUG] [LOCAL ] TPVG: Derivative data saved (1820 records). [2025-09-26T22:29:11.999084] [INFO ] [MAIN ] TPVG: Successfully saved derivative data. [2025-09-26T22:29:12.001132] [INFO ] [MAIN ] Derivative Progress: 1837/2074 symbols completed. TPVG took 1.2s. Estimated remaining: 1m 39s. Rate: 144.3 symbols/min [2025-09-26T22:29:12.001746] [INFO ] [MAIN ] TPZ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:12.020931] [DEBUG] [LOCAL ] TPYP: Derivative data saved (1820 records). [2025-09-26T22:29:12.021074] [INFO ] [MAIN ] TPYP: Successfully saved derivative data. [2025-09-26T22:29:12.024249] [INFO ] [MAIN ] Derivative Progress: 1838/2074 symbols completed. TPYP took 1.2s. Estimated remaining: 1m 38s. Rate: 144.3 symbols/min [2025-09-26T22:29:12.024805] [INFO ] [MAIN ] TR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:12.044068] [DEBUG] [LOCAL ] TPZ: Loaded 5095 existing records from primary storage. [2025-09-26T22:29:12.041170] [DEBUG] [MAIN ] TPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:12.045037] [INFO ] [MAIN ] TPZ: Loaded 5095 primary data records. [2025-09-26T22:29:12.044969] [INFO ] [MAIN ] TPR: Generated 1820 derivative records from 54252 primary records. [2025-09-26T22:29:12.045152] [DEBUG] [LOCAL ] TPR: Saving derivative data. [2025-09-26T22:29:12.185515] [DEBUG] [LOCAL ] TR: Loaded 18494 existing records from primary storage. [2025-09-26T22:29:12.184617] [DEBUG] [LOCAL ] TPR: Derivative data saved (1820 records). [2025-09-26T22:29:12.190208] [INFO ] [MAIN ] TR: Loaded 18494 primary data records. [2025-09-26T22:29:12.190504] [INFO ] [MAIN ] TPR: Successfully saved derivative data. [2025-09-26T22:29:12.221993] [INFO ] [MAIN ] Derivative Progress: 1839/2074 symbols completed. TPR took 1.4s. Estimated remaining: 1m 38s. Rate: 144.4 symbols/min [2025-09-26T22:29:12.279482] [INFO ] [MAIN ] TRAK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:12.537706] [DEBUG] [LOCAL ] TRAK: Loaded 9383 existing records from primary storage. [2025-09-26T22:29:12.559332] [INFO ] [MAIN ] TRAK: Loaded 9383 primary data records. [2025-09-26T22:29:13.121997] [DEBUG] [MAIN ] TPZ: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:29:13.123780] [INFO ] [MAIN ] TPZ: Generated 1819 derivative records from 5095 primary records. [2025-09-26T22:29:13.124037] [DEBUG] [LOCAL ] TPZ: Saving derivative data. [2025-09-26T22:29:13.143384] [DEBUG] [LOCAL ] TPZ: Derivative data saved (1819 records). [2025-09-26T22:29:13.143792] [INFO ] [MAIN ] TPZ: Successfully saved derivative data. [2025-09-26T22:29:13.147025] [INFO ] [MAIN ] Derivative Progress: 1840/2074 symbols completed. TPZ took 1.1s. Estimated remaining: 1m 37s. Rate: 144.3 symbols/min [2025-09-26T22:29:13.149696] [INFO ] [MAIN ] TRC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:13.164155] [DEBUG] [MAIN ] TR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:13.165313] [INFO ] [MAIN ] TR: Generated 1820 derivative records from 18494 primary records. [2025-09-26T22:29:13.165788] [DEBUG] [LOCAL ] TR: Saving derivative data. [2025-09-26T22:29:13.191226] [DEBUG] [LOCAL ] TR: Derivative data saved (1820 records). [2025-09-26T22:29:13.191585] [INFO ] [MAIN ] TR: Successfully saved derivative data. [2025-09-26T22:29:13.212984] [INFO ] [MAIN ] Derivative Progress: 1841/2074 symbols completed. TR took 1.2s. Estimated remaining: 1m 37s. Rate: 144.4 symbols/min [2025-09-26T22:29:13.213704] [DEBUG] [LOCAL ] TRC: Loaded 16189 existing records from primary storage. [2025-09-26T22:29:13.214591] [DEBUG] [MAIN ] TRAK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:13.214690] [INFO ] [MAIN ] TREX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:13.215677] [INFO ] [MAIN ] TRAK: Generated 1820 derivative records from 9383 primary records. [2025-09-26T22:29:13.216237] [DEBUG] [LOCAL ] TRAK: Saving derivative data. [2025-09-26T22:29:13.215796] [INFO ] [MAIN ] TRC: Loaded 16189 primary data records. [2025-09-26T22:29:13.289749] [DEBUG] [LOCAL ] TRAK: Derivative data saved (1820 records). [2025-09-26T22:29:13.289896] [INFO ] [MAIN ] TRAK: Successfully saved derivative data. [2025-09-26T22:29:13.293323] [INFO ] [MAIN ] Derivative Progress: 1842/2074 symbols completed. TRAK took 1.0s. Estimated remaining: 1m 36s. Rate: 144.4 symbols/min [2025-09-26T22:29:13.303006] [INFO ] [MAIN ] TRGP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:13.581302] [DEBUG] [LOCAL ] TREX: Loaded 50733 existing records from primary storage. [2025-09-26T22:29:13.581745] [INFO ] [MAIN ] TREX: Loaded 50733 primary data records. [2025-09-26T22:29:13.770018] [DEBUG] [LOCAL ] TRGP: Loaded 51504 existing records from primary storage. [2025-09-26T22:29:13.779427] [INFO ] [MAIN ] TRGP: Loaded 51504 primary data records. [2025-09-26T22:29:14.104538] [DEBUG] [MAIN ] TRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:14.157378] [INFO ] [MAIN ] TRC: Generated 1820 derivative records from 16189 primary records. [2025-09-26T22:29:14.287639] [DEBUG] [LOCAL ] TRC: Saving derivative data. [2025-09-26T22:29:14.308309] [DEBUG] [LOCAL ] TRC: Derivative data saved (1820 records). [2025-09-26T22:29:14.308945] [INFO ] [MAIN ] TRC: Successfully saved derivative data. [2025-09-26T22:29:14.311618] [INFO ] [MAIN ] Derivative Progress: 1843/2074 symbols completed. TRC took 1.2s. Estimated remaining: 1m 36s. Rate: 144.3 symbols/min [2025-09-26T22:29:14.335516] [DEBUG] [MAIN ] TREX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:14.336547] [INFO ] [MAIN ] TREX: Generated 1820 derivative records from 50733 primary records. [2025-09-26T22:29:14.336859] [DEBUG] [LOCAL ] TREX: Saving derivative data. [2025-09-26T22:29:14.355597] [DEBUG] [LOCAL ] TREX: Derivative data saved (1820 records). [2025-09-26T22:29:14.355809] [INFO ] [MAIN ] TREX: Successfully saved derivative data. [2025-09-26T22:29:14.358684] [INFO ] [MAIN ] Derivative Progress: 1844/2074 symbols completed. TREX took 1.1s. Estimated remaining: 1m 36s. Rate: 144.4 symbols/min [2025-09-26T22:29:14.371599] [DEBUG] [MAIN ] TRGP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:14.372257] [INFO ] [MAIN ] TRGP: Generated 1820 derivative records from 51504 primary records. [2025-09-26T22:29:14.372320] [DEBUG] [LOCAL ] TRGP: Saving derivative data. [2025-09-26T22:29:14.388532] [DEBUG] [LOCAL ] TRGP: Derivative data saved (1820 records). [2025-09-26T22:29:14.388631] [INFO ] [MAIN ] TRGP: Successfully saved derivative data. [2025-09-26T22:29:14.391859] [INFO ] [MAIN ] Derivative Progress: 1845/2074 symbols completed. TRGP took 1.1s. Estimated remaining: 1m 35s. Rate: 144.4 symbols/min [2025-09-26T22:29:14.392927] [INFO ] [MAIN ] TRN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:14.392983] [INFO ] [MAIN ] TRNO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:14.392790] [INFO ] [MAIN ] TROX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:14.451100] [DEBUG] [LOCAL ] TRN: Loaded 37786 existing records from primary storage. [2025-09-26T22:29:14.461936] [INFO ] [MAIN ] TRN: Loaded 37786 primary data records. [2025-09-26T22:29:14.610921] [DEBUG] [LOCAL ] TRNO: Loaded 44598 existing records from primary storage. [2025-09-26T22:29:14.612624] [INFO ] [MAIN ] TRNO: Loaded 44598 primary data records. [2025-09-26T22:29:14.624196] [DEBUG] [LOCAL ] TROX: Loaded 52550 existing records from primary storage. [2025-09-26T22:29:14.634577] [INFO ] [MAIN ] TROX: Loaded 52550 primary data records. [2025-09-26T22:29:15.542162] [DEBUG] [MAIN ] TRN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:15.543933] [INFO ] [MAIN ] TRN: Generated 1820 derivative records from 37786 primary records. [2025-09-26T22:29:15.544553] [DEBUG] [LOCAL ] TRN: Saving derivative data. [2025-09-26T22:29:15.569418] [DEBUG] [MAIN ] TROX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:15.590366] [DEBUG] [MAIN ] TRNO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:15.591853] [INFO ] [MAIN ] TROX: Generated 1820 derivative records from 52550 primary records. [2025-09-26T22:29:15.590039] [DEBUG] [LOCAL ] TRN: Derivative data saved (1820 records). [2025-09-26T22:29:15.592160] [DEBUG] [LOCAL ] TROX: Saving derivative data. [2025-09-26T22:29:15.593055] [INFO ] [MAIN ] TRNO: Generated 1820 derivative records from 44598 primary records. [2025-09-26T22:29:15.594311] [INFO ] [MAIN ] TRN: Successfully saved derivative data. [2025-09-26T22:29:15.594376] [DEBUG] [LOCAL ] TRNO: Saving derivative data. [2025-09-26T22:29:15.596942] [INFO ] [MAIN ] Derivative Progress: 1846/2074 symbols completed. TRN took 1.2s. Estimated remaining: 1m 35s. Rate: 144.3 symbols/min [2025-09-26T22:29:15.597251] [INFO ] [MAIN ] TRP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:15.628674] [DEBUG] [LOCAL ] TROX: Derivative data saved (1820 records). [2025-09-26T22:29:15.629864] [INFO ] [MAIN ] TROX: Successfully saved derivative data. [2025-09-26T22:29:15.633185] [INFO ] [MAIN ] Derivative Progress: 1847/2074 symbols completed. TROX took 1.2s. Estimated remaining: 1m 34s. Rate: 144.4 symbols/min [2025-09-26T22:29:15.634060] [INFO ] [MAIN ] TRTX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:15.634883] [DEBUG] [LOCAL ] TRNO: Derivative data saved (1820 records). [2025-09-26T22:29:15.635236] [INFO ] [MAIN ] TRNO: Successfully saved derivative data. [2025-09-26T22:29:15.638409] [INFO ] [MAIN ] Derivative Progress: 1848/2074 symbols completed. TRNO took 1.2s. Estimated remaining: 1m 34s. Rate: 144.4 symbols/min [2025-09-26T22:29:15.638809] [INFO ] [MAIN ] TRU: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:15.741343] [DEBUG] [LOCAL ] TRP: Loaded 52891 existing records from primary storage. [2025-09-26T22:29:15.752978] [DEBUG] [LOCAL ] TRU: Loaded 51965 existing records from primary storage. [2025-09-26T22:29:15.753104] [INFO ] [MAIN ] TRP: Loaded 52891 primary data records. [2025-09-26T22:29:15.753174] [INFO ] [MAIN ] TRU: Loaded 51965 primary data records. [2025-09-26T22:29:15.825224] [DEBUG] [LOCAL ] TRTX: Loaded 38058 existing records from primary storage. [2025-09-26T22:29:15.899706] [INFO ] [MAIN ] TRTX: Loaded 38058 primary data records. [2025-09-26T22:29:16.793428] [DEBUG] [MAIN ] TRU: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:29:16.806547] [INFO ] [MAIN ] TRU: Generated 1819 derivative records from 51965 primary records. [2025-09-26T22:29:16.808904] [DEBUG] [LOCAL ] TRU: Saving derivative data. [2025-09-26T22:29:16.809823] [DEBUG] [MAIN ] TRP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:16.811845] [INFO ] [MAIN ] TRP: Generated 1820 derivative records from 52891 primary records. [2025-09-26T22:29:16.819287] [DEBUG] [LOCAL ] TRP: Saving derivative data. [2025-09-26T22:29:16.839897] [DEBUG] [MAIN ] TRTX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:16.840866] [INFO ] [MAIN ] TRTX: Generated 1820 derivative records from 38058 primary records. [2025-09-26T22:29:16.848432] [DEBUG] [LOCAL ] TRTX: Saving derivative data. [2025-09-26T22:29:16.849340] [DEBUG] [LOCAL ] TRU: Derivative data saved (1819 records). [2025-09-26T22:29:16.853720] [INFO ] [MAIN ] TRU: Successfully saved derivative data. [2025-09-26T22:29:16.869619] [INFO ] [MAIN ] Derivative Progress: 1849/2074 symbols completed. TRU took 1.2s. Estimated remaining: 1m 34s. Rate: 144.3 symbols/min [2025-09-26T22:29:16.873992] [DEBUG] [LOCAL ] TRP: Derivative data saved (1820 records). [2025-09-26T22:29:16.874865] [INFO ] [MAIN ] TS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:16.876067] [DEBUG] [LOCAL ] TRTX: Derivative data saved (1820 records). [2025-09-26T22:29:16.876249] [INFO ] [MAIN ] TRTX: Successfully saved derivative data. [2025-09-26T22:29:16.874107] [INFO ] [MAIN ] TRP: Successfully saved derivative data. [2025-09-26T22:29:16.879430] [INFO ] [MAIN ] Derivative Progress: 1850/2074 symbols completed. TRTX took 1.2s. Estimated remaining: 1m 33s. Rate: 144.4 symbols/min [2025-09-26T22:29:16.882927] [INFO ] [MAIN ] TSE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:16.883031] [INFO ] [MAIN ] Derivative Progress: 1851/2074 symbols completed. TRP took 1.3s. Estimated remaining: 1m 33s. Rate: 144.4 symbols/min [2025-09-26T22:29:16.883986] [INFO ] [MAIN ] TSI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:16.905834] [DEBUG] [LOCAL ] TSI: Loaded 8090 existing records from primary storage. [2025-09-26T22:29:16.905976] [INFO ] [MAIN ] TSI: Loaded 8090 primary data records. [2025-09-26T22:29:17.084940] [DEBUG] [LOCAL ] TSE: Loaded 29074 existing records from primary storage. [2025-09-26T22:29:17.143700] [INFO ] [MAIN ] TSE: Loaded 29074 primary data records. [2025-09-26T22:29:17.328301] [DEBUG] [LOCAL ] TS: Loaded 52425 existing records from primary storage. [2025-09-26T22:29:17.351230] [INFO ] [MAIN ] TS: Loaded 52425 primary data records. [2025-09-26T22:29:17.953928] [DEBUG] [MAIN ] TSI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:17.955355] [INFO ] [MAIN ] TSI: Generated 1820 derivative records from 8090 primary records. [2025-09-26T22:29:17.956814] [DEBUG] [LOCAL ] TSI: Saving derivative data. [2025-09-26T22:29:17.974598] [DEBUG] [LOCAL ] TSI: Derivative data saved (1820 records). [2025-09-26T22:29:17.975069] [INFO ] [MAIN ] TSI: Successfully saved derivative data. [2025-09-26T22:29:17.977856] [INFO ] [MAIN ] Derivative Progress: 1852/2074 symbols completed. TSI took 1.1s. Estimated remaining: 1m 32s. Rate: 144.3 symbols/min [2025-09-26T22:29:17.978466] [INFO ] [MAIN ] TSLX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:18.001824] [DEBUG] [MAIN ] TSE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:18.016509] [DEBUG] [MAIN ] TS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:18.016064] [INFO ] [MAIN ] TSE: Generated 1820 derivative records from 29074 primary records. [2025-09-26T22:29:18.017697] [DEBUG] [LOCAL ] TSE: Saving derivative data. [2025-09-26T22:29:18.017594] [INFO ] [MAIN ] TS: Generated 1820 derivative records from 52425 primary records. [2025-09-26T22:29:18.018738] [DEBUG] [LOCAL ] TS: Saving derivative data. [2025-09-26T22:29:18.057058] [DEBUG] [LOCAL ] TSE: Derivative data saved (1820 records). [2025-09-26T22:29:18.061075] [INFO ] [MAIN ] TSE: Successfully saved derivative data. [2025-09-26T22:29:18.065470] [INFO ] [MAIN ] Derivative Progress: 1853/2074 symbols completed. TSE took 1.2s. Estimated remaining: 1m 32s. Rate: 144.4 symbols/min [2025-09-26T22:29:18.066310] [DEBUG] [LOCAL ] TS: Derivative data saved (1820 records). [2025-09-26T22:29:18.066459] [INFO ] [MAIN ] TS: Successfully saved derivative data. [2025-09-26T22:29:18.069777] [INFO ] [MAIN ] Derivative Progress: 1854/2074 symbols completed. TS took 1.2s. Estimated remaining: 1m 31s. Rate: 144.5 symbols/min [2025-09-26T22:29:18.070721] [INFO ] [MAIN ] TSM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:18.070923] [INFO ] [MAIN ] TSN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:18.082809] [DEBUG] [LOCAL ] TSLX: Loaded 35752 existing records from primary storage. [2025-09-26T22:29:18.083127] [INFO ] [MAIN ] TSLX: Loaded 35752 primary data records. [2025-09-26T22:29:18.495952] [DEBUG] [LOCAL ] TSN: Loaded 53638 existing records from primary storage. [2025-09-26T22:29:18.497344] [INFO ] [MAIN ] TSN: Loaded 53638 primary data records. [2025-09-26T22:29:18.547583] [DEBUG] [LOCAL ] TSM: Loaded 54599 existing records from primary storage. [2025-09-26T22:29:18.565924] [INFO ] [MAIN ] TSM: Loaded 54599 primary data records. [2025-09-26T22:29:19.048175] [DEBUG] [MAIN ] TSLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:19.081419] [INFO ] [MAIN ] TSLX: Generated 1820 derivative records from 35752 primary records. [2025-09-26T22:29:19.231843] [DEBUG] [LOCAL ] TSLX: Saving derivative data. [2025-09-26T22:29:19.262506] [DEBUG] [LOCAL ] TSLX: Derivative data saved (1820 records). [2025-09-26T22:29:19.262673] [INFO ] [MAIN ] TSLX: Successfully saved derivative data. [2025-09-26T22:29:19.264770] [INFO ] [MAIN ] Derivative Progress: 1855/2074 symbols completed. TSLX took 1.3s. Estimated remaining: 1m 31s. Rate: 144.3 symbols/min [2025-09-26T22:29:19.266465] [INFO ] [MAIN ] TSQ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:19.285615] [DEBUG] [LOCAL ] TSQ: Loaded 12195 existing records from primary storage. [2025-09-26T22:29:19.288199] [INFO ] [MAIN ] TSQ: Loaded 12195 primary data records. [2025-09-26T22:29:19.410682] [DEBUG] [MAIN ] TSN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:19.427913] [INFO ] [MAIN ] TSN: Generated 1820 derivative records from 53638 primary records. [2025-09-26T22:29:19.438026] [DEBUG] [LOCAL ] TSN: Saving derivative data. [2025-09-26T22:29:19.438454] [DEBUG] [MAIN ] TSM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:19.450186] [INFO ] [MAIN ] TSM: Generated 1820 derivative records from 54599 primary records. [2025-09-26T22:29:19.481760] [DEBUG] [LOCAL ] TSM: Saving derivative data. [2025-09-26T22:29:19.673942] [DEBUG] [LOCAL ] TSM: Derivative data saved (1820 records). [2025-09-26T22:29:19.677163] [INFO ] [MAIN ] TSM: Successfully saved derivative data. [2025-09-26T22:29:19.682387] [INFO ] [MAIN ] Derivative Progress: 1856/2074 symbols completed. TSM took 1.6s. Estimated remaining: 1m 31s. Rate: 144.3 symbols/min [2025-09-26T22:29:19.684539] [DEBUG] [LOCAL ] TSN: Derivative data saved (1820 records). [2025-09-26T22:29:19.685724] [INFO ] [MAIN ] TSN: Successfully saved derivative data. [2025-09-26T22:29:19.688535] [INFO ] [MAIN ] Derivative Progress: 1857/2074 symbols completed. TSN took 1.6s. Estimated remaining: 1m 30s. Rate: 144.4 symbols/min [2025-09-26T22:29:19.685962] [INFO ] [MAIN ] TT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:19.689981] [INFO ] [MAIN ] TTC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:19.727807] [DEBUG] [MAIN ] TSQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:19.728710] [INFO ] [MAIN ] TSQ: Generated 1820 derivative records from 12195 primary records. [2025-09-26T22:29:19.728833] [DEBUG] [LOCAL ] TSQ: Saving derivative data. [2025-09-26T22:29:19.766057] [DEBUG] [LOCAL ] TSQ: Derivative data saved (1820 records). [2025-09-26T22:29:19.766302] [INFO ] [MAIN ] TSQ: Successfully saved derivative data. [2025-09-26T22:29:19.768570] [INFO ] [MAIN ] Derivative Progress: 1858/2074 symbols completed. TSQ took 0.5s. Estimated remaining: 1m 30s. Rate: 144.5 symbols/min [2025-09-26T22:29:19.782079] [DEBUG] [LOCAL ] TTC: Loaded 43005 existing records from primary storage. [2025-09-26T22:29:19.782753] [INFO ] [MAIN ] TTC: Loaded 43005 primary data records. [2025-09-26T22:29:19.903512] [DEBUG] [LOCAL ] TT: Loaded 48538 existing records from primary storage. [2025-09-26T22:29:19.909457] [INFO ] [MAIN ] TT: Loaded 48538 primary data records. [2025-09-26T22:29:20.452302] [DEBUG] [MAIN ] TTC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:20.453454] [INFO ] [MAIN ] TTC: Generated 1820 derivative records from 43005 primary records. [2025-09-26T22:29:20.453680] [DEBUG] [LOCAL ] TTC: Saving derivative data. [2025-09-26T22:29:20.472895] [DEBUG] [LOCAL ] TTC: Derivative data saved (1820 records). [2025-09-26T22:29:20.473043] [INFO ] [MAIN ] TTC: Successfully saved derivative data. [2025-09-26T22:29:20.475080] [INFO ] [MAIN ] Derivative Progress: 1859/2074 symbols completed. TTC took 0.8s. Estimated remaining: 1m 29s. Rate: 144.4 symbols/min [2025-09-26T22:29:20.490109] [DEBUG] [MAIN ] TT: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:29:20.490838] [INFO ] [MAIN ] TT: Generated 1819 derivative records from 48538 primary records. [2025-09-26T22:29:20.490903] [DEBUG] [LOCAL ] TT: Saving derivative data. [2025-09-26T22:29:20.507340] [DEBUG] [LOCAL ] TT: Derivative data saved (1819 records). [2025-09-26T22:29:20.507410] [INFO ] [MAIN ] TT: Successfully saved derivative data. [2025-09-26T22:29:20.509596] [INFO ] [MAIN ] Derivative Progress: 1860/2074 symbols completed. TT took 0.8s. Estimated remaining: 1m 29s. Rate: 144.5 symbols/min [2025-09-26T22:29:20.510342] [INFO ] [MAIN ] TTE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:20.510575] [INFO ] [MAIN ] TTI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:20.510688] [INFO ] [MAIN ] TU: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:20.588412] [DEBUG] [LOCAL ] TTI: Loaded 46112 existing records from primary storage. [2025-09-26T22:29:20.588743] [INFO ] [MAIN ] TTI: Loaded 46112 primary data records. [2025-09-26T22:29:20.739010] [DEBUG] [LOCAL ] TU: Loaded 50606 existing records from primary storage. [2025-09-26T22:29:20.729000] [DEBUG] [LOCAL ] TTE: Loaded 52395 existing records from primary storage. [2025-09-26T22:29:20.744067] [INFO ] [MAIN ] TU: Loaded 50606 primary data records. [2025-09-26T22:29:20.749546] [INFO ] [MAIN ] TTE: Loaded 52395 primary data records. [2025-09-26T22:29:21.665870] [DEBUG] [MAIN ] TTI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:21.666824] [INFO ] [MAIN ] TTI: Generated 1820 derivative records from 46112 primary records. [2025-09-26T22:29:21.667156] [DEBUG] [LOCAL ] TTI: Saving derivative data. [2025-09-26T22:29:21.685243] [DEBUG] [LOCAL ] TTI: Derivative data saved (1820 records). [2025-09-26T22:29:21.685411] [INFO ] [MAIN ] TTI: Successfully saved derivative data. [2025-09-26T22:29:21.687518] [INFO ] [MAIN ] Derivative Progress: 1861/2074 symbols completed. TTI took 1.2s. Estimated remaining: 1m 29s. Rate: 144.3 symbols/min [2025-09-26T22:29:21.688888] [INFO ] [MAIN ] TUYA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:21.720359] [DEBUG] [MAIN ] TU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:21.720066] [DEBUG] [MAIN ] TTE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:21.721981] [INFO ] [MAIN ] TTE: Generated 1820 derivative records from 52395 primary records. [2025-09-26T22:29:21.721268] [INFO ] [MAIN ] TU: Generated 1820 derivative records from 50606 primary records. [2025-09-26T22:29:21.722260] [DEBUG] [LOCAL ] TTE: Saving derivative data. [2025-09-26T22:29:21.722123] [DEBUG] [LOCAL ] TU: Saving derivative data. [2025-09-26T22:29:21.751620] [DEBUG] [LOCAL ] TTE: Derivative data saved (1820 records). [2025-09-26T22:29:21.752280] [INFO ] [MAIN ] TTE: Successfully saved derivative data. [2025-09-26T22:29:21.755500] [INFO ] [MAIN ] Derivative Progress: 1862/2074 symbols completed. TTE took 1.2s. Estimated remaining: 1m 28s. Rate: 144.4 symbols/min [2025-09-26T22:29:21.756592] [INFO ] [MAIN ] TV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:21.771116] [DEBUG] [LOCAL ] TU: Derivative data saved (1820 records). [2025-09-26T22:29:21.771226] [INFO ] [MAIN ] TU: Successfully saved derivative data. [2025-09-26T22:29:21.773501] [INFO ] [MAIN ] Derivative Progress: 1863/2074 symbols completed. TU took 1.3s. Estimated remaining: 1m 28s. Rate: 144.5 symbols/min [2025-09-26T22:29:21.773887] [INFO ] [MAIN ] TVC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:21.792723] [DEBUG] [LOCAL ] TVC: Loaded 3466 existing records from primary storage. [2025-09-26T22:29:21.794248] [INFO ] [MAIN ] TVC: Loaded 3466 primary data records. [2025-09-26T22:29:21.807317] [DEBUG] [LOCAL ] TUYA: Loaded 47185 existing records from primary storage. [2025-09-26T22:29:21.831482] [INFO ] [MAIN ] TUYA: Loaded 47185 primary data records. [2025-09-26T22:29:22.142886] [DEBUG] [LOCAL ] TV: Loaded 43514 existing records from primary storage. [2025-09-26T22:29:22.298518] [INFO ] [MAIN ] TV: Loaded 43514 primary data records. [2025-09-26T22:29:22.826172] [DEBUG] [MAIN ] TVC: Filtered 7001 bins outside market hours, 7797 incomplete bins [2025-09-26T22:29:22.827264] [INFO ] [MAIN ] TVC: Generated 1817 derivative records from 3466 primary records. [2025-09-26T22:29:22.827677] [DEBUG] [LOCAL ] TVC: Saving derivative data. [2025-09-26T22:29:22.858274] [DEBUG] [MAIN ] TUYA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:22.859759] [INFO ] [MAIN ] TUYA: Generated 1820 derivative records from 47185 primary records. [2025-09-26T22:29:22.860001] [DEBUG] [LOCAL ] TUYA: Saving derivative data. [2025-09-26T22:29:22.882224] [DEBUG] [LOCAL ] TUYA: Derivative data saved (1820 records). [2025-09-26T22:29:22.878735] [DEBUG] [LOCAL ] TVC: Derivative data saved (1817 records). [2025-09-26T22:29:22.882589] [INFO ] [MAIN ] TVC: Successfully saved derivative data. [2025-09-26T22:29:22.884625] [INFO ] [MAIN ] Derivative Progress: 1864/2074 symbols completed. TVC took 1.1s. Estimated remaining: 1m 27s. Rate: 144.3 symbols/min [2025-09-26T22:29:22.884731] [INFO ] [MAIN ] TUYA: Successfully saved derivative data. [2025-09-26T22:29:22.887669] [INFO ] [MAIN ] TVE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:22.895562] [INFO ] [MAIN ] Derivative Progress: 1865/2074 symbols completed. TUYA took 1.2s. Estimated remaining: 1m 27s. Rate: 144.4 symbols/min [2025-09-26T22:29:22.901782] [INFO ] [MAIN ] TWI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:22.901580] [DEBUG] [MAIN ] TV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:22.902944] [INFO ] [MAIN ] TV: Generated 1820 derivative records from 43514 primary records. [2025-09-26T22:29:22.903978] [DEBUG] [LOCAL ] TV: Saving derivative data. [2025-09-26T22:29:22.907851] [DEBUG] [LOCAL ] TVE: Loaded 2795 existing records from primary storage. [2025-09-26T22:29:22.908307] [INFO ] [MAIN ] TVE: Loaded 2795 primary data records. [2025-09-26T22:29:22.984965] [DEBUG] [LOCAL ] TV: Derivative data saved (1820 records). [2025-09-26T22:29:23.000028] [INFO ] [MAIN ] TV: Successfully saved derivative data. [2025-09-26T22:29:23.050909] [INFO ] [MAIN ] Derivative Progress: 1866/2074 symbols completed. TV took 1.3s. Estimated remaining: 1m 26s. Rate: 144.5 symbols/min [2025-09-26T22:29:23.062391] [INFO ] [MAIN ] TWLO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:23.282429] [DEBUG] [LOCAL ] TWI: Loaded 34981 existing records from primary storage. [2025-09-26T22:29:23.296555] [INFO ] [MAIN ] TWI: Loaded 34981 primary data records. [2025-09-26T22:29:23.652833] [DEBUG] [LOCAL ] TWLO: Loaded 53501 existing records from primary storage. [2025-09-26T22:29:23.653411] [INFO ] [MAIN ] TWLO: Loaded 53501 primary data records. [2025-09-26T22:29:23.722319] [DEBUG] [MAIN ] TVE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:23.737050] [INFO ] [MAIN ] TVE: Generated 1820 derivative records from 2795 primary records. [2025-09-26T22:29:23.751789] [DEBUG] [LOCAL ] TVE: Saving derivative data. [2025-09-26T22:29:23.831077] [DEBUG] [LOCAL ] TVE: Derivative data saved (1820 records). [2025-09-26T22:29:23.859024] [INFO ] [MAIN ] TVE: Successfully saved derivative data. [2025-09-26T22:29:23.862369] [INFO ] [MAIN ] Derivative Progress: 1867/2074 symbols completed. TVE took 1.0s. Estimated remaining: 1m 26s. Rate: 144.4 symbols/min [2025-09-26T22:29:23.881021] [INFO ] [MAIN ] TWN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:24.039221] [DEBUG] [LOCAL ] TWN: Loaded 3250 existing records from primary storage. [2025-09-26T22:29:24.040327] [INFO ] [MAIN ] TWN: Loaded 3250 primary data records. [2025-09-26T22:29:24.090051] [DEBUG] [MAIN ] TWI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:24.096536] [INFO ] [MAIN ] TWI: Generated 1820 derivative records from 34981 primary records. [2025-09-26T22:29:24.104927] [DEBUG] [LOCAL ] TWI: Saving derivative data. [2025-09-26T22:29:24.191160] [DEBUG] [LOCAL ] TWI: Derivative data saved (1820 records). [2025-09-26T22:29:24.218544] [INFO ] [MAIN ] TWI: Successfully saved derivative data. [2025-09-26T22:29:24.244827] [INFO ] [MAIN ] Derivative Progress: 1868/2074 symbols completed. TWI took 1.3s. Estimated remaining: 1m 26s. Rate: 144.4 symbols/min [2025-09-26T22:29:24.277679] [INFO ] [MAIN ] TWO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:24.420978] [DEBUG] [MAIN ] TWLO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:24.422001] [INFO ] [MAIN ] TWLO: Generated 1820 derivative records from 53501 primary records. [2025-09-26T22:29:24.422201] [DEBUG] [LOCAL ] TWLO: Saving derivative data. [2025-09-26T22:29:24.441809] [DEBUG] [LOCAL ] TWLO: Derivative data saved (1820 records). [2025-09-26T22:29:24.442269] [INFO ] [MAIN ] TWLO: Successfully saved derivative data. [2025-09-26T22:29:24.444610] [INFO ] [MAIN ] Derivative Progress: 1869/2074 symbols completed. TWLO took 1.4s. Estimated remaining: 1m 25s. Rate: 144.4 symbols/min [2025-09-26T22:29:24.445387] [INFO ] [MAIN ] TX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:24.476319] [DEBUG] [MAIN ] TWN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:24.477160] [INFO ] [MAIN ] TWN: Generated 1820 derivative records from 3250 primary records. [2025-09-26T22:29:24.477230] [DEBUG] [LOCAL ] TWN: Saving derivative data. [2025-09-26T22:29:24.510862] [DEBUG] [LOCAL ] TWN: Derivative data saved (1820 records). [2025-09-26T22:29:24.518112] [INFO ] [MAIN ] TWN: Successfully saved derivative data. [2025-09-26T22:29:24.521618] [INFO ] [MAIN ] Derivative Progress: 1870/2074 symbols completed. TWN took 0.6s. Estimated remaining: 1m 25s. Rate: 144.5 symbols/min [2025-09-26T22:29:24.523074] [DEBUG] [LOCAL ] TWO: Loaded 49002 existing records from primary storage. [2025-09-26T22:29:24.523513] [INFO ] [MAIN ] TWO: Loaded 49002 primary data records. [2025-09-26T22:29:24.523604] [INFO ] [MAIN ] TXNM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:24.524134] [DEBUG] [LOCAL ] TX: Loaded 23932 existing records from primary storage. [2025-09-26T22:29:24.537691] [INFO ] [MAIN ] TX: Loaded 23932 primary data records. [2025-09-26T22:29:25.258465] [DEBUG] [LOCAL ] TXNM: Loaded 44463 existing records from primary storage. [2025-09-26T22:29:25.258994] [INFO ] [MAIN ] TXNM: Loaded 44463 primary data records. [2025-09-26T22:29:25.608497] [DEBUG] [MAIN ] TWO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:25.609908] [INFO ] [MAIN ] TWO: Generated 1820 derivative records from 49002 primary records. [2025-09-26T22:29:25.610110] [DEBUG] [LOCAL ] TWO: Saving derivative data. [2025-09-26T22:29:25.628495] [DEBUG] [LOCAL ] TWO: Derivative data saved (1820 records). [2025-09-26T22:29:25.628783] [INFO ] [MAIN ] TWO: Successfully saved derivative data. [2025-09-26T22:29:25.631992] [INFO ] [MAIN ] Derivative Progress: 1871/2074 symbols completed. TWO took 1.4s. Estimated remaining: 1m 24s. Rate: 144.4 symbols/min [2025-09-26T22:29:25.632448] [INFO ] [MAIN ] TXO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:25.649572] [DEBUG] [MAIN ] TX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:25.650590] [INFO ] [MAIN ] TX: Generated 1820 derivative records from 23932 primary records. [2025-09-26T22:29:25.650831] [DEBUG] [LOCAL ] TX: Saving derivative data. [2025-09-26T22:29:25.683709] [DEBUG] [LOCAL ] TXO: Loaded 19060 existing records from primary storage. [2025-09-26T22:29:25.683323] [DEBUG] [LOCAL ] TX: Derivative data saved (1820 records). [2025-09-26T22:29:25.683847] [INFO ] [MAIN ] TXO: Loaded 19060 primary data records. [2025-09-26T22:29:25.689182] [INFO ] [MAIN ] TX: Successfully saved derivative data. [2025-09-26T22:29:25.704227] [INFO ] [MAIN ] Derivative Progress: 1872/2074 symbols completed. TX took 1.3s. Estimated remaining: 1m 24s. Rate: 144.4 symbols/min [2025-09-26T22:29:25.736187] [INFO ] [MAIN ] TXT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:25.786412] [DEBUG] [MAIN ] TXNM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:25.798435] [INFO ] [MAIN ] TXNM: Generated 1820 derivative records from 44463 primary records. [2025-09-26T22:29:25.805896] [DEBUG] [LOCAL ] TXNM: Saving derivative data. [2025-09-26T22:29:26.057095] [DEBUG] [LOCAL ] TXNM: Derivative data saved (1820 records). [2025-09-26T22:29:26.057251] [INFO ] [MAIN ] TXNM: Successfully saved derivative data. [2025-09-26T22:29:26.060540] [INFO ] [MAIN ] Derivative Progress: 1873/2074 symbols completed. TXNM took 1.5s. Estimated remaining: 1m 23s. Rate: 144.4 symbols/min [2025-09-26T22:29:26.118008] [DEBUG] [MAIN ] TXO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:26.119030] [INFO ] [MAIN ] TXO: Generated 1820 derivative records from 19060 primary records. [2025-09-26T22:29:26.120125] [DEBUG] [LOCAL ] TXT: Loaded 50470 existing records from primary storage. [2025-09-26T22:29:26.120240] [DEBUG] [LOCAL ] TXO: Saving derivative data. [2025-09-26T22:29:26.120354] [INFO ] [MAIN ] TXT: Loaded 50470 primary data records. [2025-09-26T22:29:26.257238] [DEBUG] [LOCAL ] TXO: Derivative data saved (1820 records). [2025-09-26T22:29:26.272790] [INFO ] [MAIN ] TXO: Successfully saved derivative data. [2025-09-26T22:29:26.293958] [INFO ] [MAIN ] Derivative Progress: 1874/2074 symbols completed. TXO took 0.7s. Estimated remaining: 1m 23s. Rate: 144.5 symbols/min [2025-09-26T22:29:26.474981] [DEBUG] [MAIN ] TXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:26.475964] [INFO ] [MAIN ] TXT: Generated 1820 derivative records from 50470 primary records. [2025-09-26T22:29:26.476035] [DEBUG] [LOCAL ] TXT: Saving derivative data. [2025-09-26T22:29:26.493503] [DEBUG] [LOCAL ] TXT: Derivative data saved (1820 records). [2025-09-26T22:29:26.493634] [INFO ] [MAIN ] TXT: Successfully saved derivative data. [2025-09-26T22:29:26.495940] [INFO ] [MAIN ] Derivative Progress: 1875/2074 symbols completed. TXT took 0.8s. Estimated remaining: 1m 23s. Rate: 144.5 symbols/min [2025-09-26T22:29:26.496547] [INFO ] [MAIN ] TYL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:26.497044] [INFO ] [MAIN ] TY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:26.496896] [INFO ] [MAIN ] TYG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:26.507894] [DEBUG] [LOCAL ] TY: Loaded 7756 existing records from primary storage. [2025-09-26T22:29:26.508075] [INFO ] [MAIN ] TY: Loaded 7756 primary data records. [2025-09-26T22:29:26.646998] [DEBUG] [LOCAL ] TYL: Loaded 22582 existing records from primary storage. [2025-09-26T22:29:26.648168] [INFO ] [MAIN ] TYL: Loaded 22582 primary data records. [2025-09-26T22:29:26.647873] [DEBUG] [LOCAL ] TYG: Loaded 14410 existing records from primary storage. [2025-09-26T22:29:26.690980] [INFO ] [MAIN ] TYG: Loaded 14410 primary data records. [2025-09-26T22:29:27.578101] [DEBUG] [MAIN ] TY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:27.579000] [INFO ] [MAIN ] TY: Generated 1820 derivative records from 7756 primary records. [2025-09-26T22:29:27.580771] [DEBUG] [LOCAL ] TY: Saving derivative data. [2025-09-26T22:29:27.601725] [DEBUG] [LOCAL ] TY: Derivative data saved (1820 records). [2025-09-26T22:29:27.609822] [INFO ] [MAIN ] TY: Successfully saved derivative data. [2025-09-26T22:29:27.617268] [INFO ] [MAIN ] Derivative Progress: 1876/2074 symbols completed. TY took 1.1s. Estimated remaining: 1m 22s. Rate: 144.4 symbols/min [2025-09-26T22:29:27.617926] [DEBUG] [MAIN ] TYL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:27.618812] [INFO ] [MAIN ] TYL: Generated 1820 derivative records from 22582 primary records. [2025-09-26T22:29:27.626890] [INFO ] [MAIN ] U: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:27.632354] [DEBUG] [MAIN ] TYG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:27.633439] [INFO ] [MAIN ] TYG: Generated 1820 derivative records from 14410 primary records. [2025-09-26T22:29:27.633724] [DEBUG] [LOCAL ] TYG: Saving derivative data. [2025-09-26T22:29:27.631854] [DEBUG] [LOCAL ] TYL: Saving derivative data. [2025-09-26T22:29:27.663469] [DEBUG] [LOCAL ] TYG: Derivative data saved (1820 records). [2025-09-26T22:29:27.664139] [INFO ] [MAIN ] TYG: Successfully saved derivative data. [2025-09-26T22:29:27.667335] [INFO ] [MAIN ] Derivative Progress: 1877/2074 symbols completed. TYG took 1.2s. Estimated remaining: 1m 22s. Rate: 144.5 symbols/min [2025-09-26T22:29:27.668197] [INFO ] [MAIN ] UA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:27.672472] [DEBUG] [LOCAL ] TYL: Derivative data saved (1820 records). [2025-09-26T22:29:27.672681] [INFO ] [MAIN ] TYL: Successfully saved derivative data. [2025-09-26T22:29:27.675101] [INFO ] [MAIN ] Derivative Progress: 1878/2074 symbols completed. TYL took 1.2s. Estimated remaining: 1m 21s. Rate: 144.5 symbols/min [2025-09-26T22:29:27.675562] [INFO ] [MAIN ] UAA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:27.721875] [DEBUG] [LOCAL ] U: Loaded 54579 existing records from primary storage. [2025-09-26T22:29:27.722153] [INFO ] [MAIN ] U: Loaded 54579 primary data records. [2025-09-26T22:29:27.928125] [DEBUG] [LOCAL ] UA: Loaded 51189 existing records from primary storage. [2025-09-26T22:29:27.974132] [INFO ] [MAIN ] UA: Loaded 51189 primary data records. [2025-09-26T22:29:28.132986] [DEBUG] [LOCAL ] UAA: Loaded 54287 existing records from primary storage. [2025-09-26T22:29:28.160809] [INFO ] [MAIN ] UAA: Loaded 54287 primary data records. [2025-09-26T22:29:28.765487] [DEBUG] [MAIN ] U: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:28.767064] [INFO ] [MAIN ] U: Generated 1820 derivative records from 54579 primary records. [2025-09-26T22:29:28.768627] [DEBUG] [LOCAL ] U: Saving derivative data. [2025-09-26T22:29:28.787524] [DEBUG] [LOCAL ] U: Derivative data saved (1820 records). [2025-09-26T22:29:28.787865] [INFO ] [MAIN ] U: Successfully saved derivative data. [2025-09-26T22:29:28.790950] [INFO ] [MAIN ] Derivative Progress: 1879/2074 symbols completed. U took 1.2s. Estimated remaining: 1m 21s. Rate: 144.4 symbols/min [2025-09-26T22:29:28.792274] [INFO ] [MAIN ] UAN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:28.820160] [DEBUG] [MAIN ] UA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:28.824865] [INFO ] [MAIN ] UA: Generated 1820 derivative records from 51189 primary records. [2025-09-26T22:29:28.823806] [DEBUG] [LOCAL ] UAN: Loaded 5507 existing records from primary storage. [2025-09-26T22:29:28.825301] [INFO ] [MAIN ] UAN: Loaded 5507 primary data records. [2025-09-26T22:29:28.825382] [DEBUG] [LOCAL ] UA: Saving derivative data. [2025-09-26T22:29:28.962951] [DEBUG] [LOCAL ] UA: Derivative data saved (1820 records). [2025-09-26T22:29:28.968415] [INFO ] [MAIN ] UA: Successfully saved derivative data. [2025-09-26T22:29:28.968840] [DEBUG] [MAIN ] UAA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:28.974912] [INFO ] [MAIN ] UAA: Generated 1820 derivative records from 54287 primary records. [2025-09-26T22:29:28.987454] [DEBUG] [LOCAL ] UAA: Saving derivative data. [2025-09-26T22:29:28.987370] [INFO ] [MAIN ] Derivative Progress: 1880/2074 symbols completed. UA took 1.3s. Estimated remaining: 1m 21s. Rate: 144.4 symbols/min [2025-09-26T22:29:29.056673] [INFO ] [MAIN ] UBER: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:29.201976] [DEBUG] [LOCAL ] UAA: Derivative data saved (1820 records). [2025-09-26T22:29:29.202632] [INFO ] [MAIN ] UAA: Successfully saved derivative data. [2025-09-26T22:29:29.205623] [INFO ] [MAIN ] Derivative Progress: 1881/2074 symbols completed. UAA took 1.5s. Estimated remaining: 1m 20s. Rate: 144.5 symbols/min [2025-09-26T22:29:29.206118] [INFO ] [MAIN ] UBS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:29.243017] [DEBUG] [MAIN ] UAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:29.246236] [INFO ] [MAIN ] UAN: Generated 1820 derivative records from 5507 primary records. [2025-09-26T22:29:29.246419] [DEBUG] [LOCAL ] UAN: Saving derivative data. [2025-09-26T22:29:29.263409] [DEBUG] [LOCAL ] UAN: Derivative data saved (1820 records). [2025-09-26T22:29:29.278187] [INFO ] [MAIN ] UAN: Successfully saved derivative data. [2025-09-26T22:29:29.294534] [DEBUG] [LOCAL ] UBER: Loaded 54586 existing records from primary storage. [2025-09-26T22:29:29.293102] [INFO ] [MAIN ] Derivative Progress: 1882/2074 symbols completed. UAN took 0.5s. Estimated remaining: 1m 20s. Rate: 144.5 symbols/min [2025-09-26T22:29:29.294784] [INFO ] [MAIN ] UBER: Loaded 54586 primary data records. [2025-09-26T22:29:29.295201] [INFO ] [MAIN ] UCB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:29.424553] [DEBUG] [LOCAL ] UBS: Loaded 53187 existing records from primary storage. [2025-09-26T22:29:29.430712] [INFO ] [MAIN ] UBS: Loaded 53187 primary data records. [2025-09-26T22:29:29.877825] [DEBUG] [LOCAL ] UCB: Loaded 38555 existing records from primary storage. [2025-09-26T22:29:29.911094] [INFO ] [MAIN ] UCB: Loaded 38555 primary data records. [2025-09-26T22:29:30.402627] [DEBUG] [MAIN ] UBER: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:30.404735] [INFO ] [MAIN ] UBER: Generated 1820 derivative records from 54586 primary records. [2025-09-26T22:29:30.408147] [DEBUG] [LOCAL ] UBER: Saving derivative data. [2025-09-26T22:29:30.442857] [DEBUG] [MAIN ] UBS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:30.442969] [DEBUG] [LOCAL ] UBER: Derivative data saved (1820 records). [2025-09-26T22:29:30.444373] [INFO ] [MAIN ] UBER: Successfully saved derivative data. [2025-09-26T22:29:30.444278] [INFO ] [MAIN ] UBS: Generated 1820 derivative records from 53187 primary records. [2025-09-26T22:29:30.444511] [DEBUG] [LOCAL ] UBS: Saving derivative data. [2025-09-26T22:29:30.447085] [INFO ] [MAIN ] Derivative Progress: 1883/2074 symbols completed. UBER took 1.4s. Estimated remaining: 1m 19s. Rate: 144.4 symbols/min [2025-09-26T22:29:30.461525] [INFO ] [MAIN ] UDR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:30.470939] [DEBUG] [LOCAL ] UBS: Derivative data saved (1820 records). [2025-09-26T22:29:30.471277] [INFO ] [MAIN ] UBS: Successfully saved derivative data. [2025-09-26T22:29:30.473689] [INFO ] [MAIN ] Derivative Progress: 1884/2074 symbols completed. UBS took 1.3s. Estimated remaining: 1m 19s. Rate: 144.5 symbols/min [2025-09-26T22:29:30.474140] [INFO ] [MAIN ] UE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:30.488458] [DEBUG] [MAIN ] UCB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:30.489503] [INFO ] [MAIN ] UCB: Generated 1820 derivative records from 38555 primary records. [2025-09-26T22:29:30.489788] [DEBUG] [LOCAL ] UCB: Saving derivative data. [2025-09-26T22:29:30.508443] [DEBUG] [LOCAL ] UCB: Derivative data saved (1820 records). [2025-09-26T22:29:30.508716] [INFO ] [MAIN ] UCB: Successfully saved derivative data. [2025-09-26T22:29:30.511559] [INFO ] [MAIN ] Derivative Progress: 1885/2074 symbols completed. UCB took 1.2s. Estimated remaining: 1m 18s. Rate: 144.5 symbols/min [2025-09-26T22:29:30.512157] [INFO ] [MAIN ] UFI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:30.545072] [DEBUG] [LOCAL ] UFI: Loaded 8229 existing records from primary storage. [2025-09-26T22:29:30.546126] [INFO ] [MAIN ] UFI: Loaded 8229 primary data records. [2025-09-26T22:29:30.618238] [DEBUG] [LOCAL ] UDR: Loaded 52555 existing records from primary storage. [2025-09-26T22:29:30.653848] [INFO ] [MAIN ] UDR: Loaded 52555 primary data records. [2025-09-26T22:29:30.705708] [DEBUG] [LOCAL ] UE: Loaded 43513 existing records from primary storage. [2025-09-26T22:29:30.767639] [INFO ] [MAIN ] UE: Loaded 43513 primary data records. [2025-09-26T22:29:31.670049] [DEBUG] [MAIN ] UFI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:31.671232] [INFO ] [MAIN ] UFI: Generated 1820 derivative records from 8229 primary records. [2025-09-26T22:29:31.671421] [DEBUG] [LOCAL ] UFI: Saving derivative data. [2025-09-26T22:29:31.711468] [DEBUG] [LOCAL ] UFI: Derivative data saved (1820 records). [2025-09-26T22:29:31.709853] [DEBUG] [MAIN ] UDR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:31.712619] [INFO ] [MAIN ] UDR: Generated 1820 derivative records from 52555 primary records. [2025-09-26T22:29:31.725078] [DEBUG] [LOCAL ] UDR: Saving derivative data. [2025-09-26T22:29:31.725149] [INFO ] [MAIN ] UFI: Successfully saved derivative data. [2025-09-26T22:29:31.728539] [INFO ] [MAIN ] Derivative Progress: 1886/2074 symbols completed. UFI took 1.2s. Estimated remaining: 1m 18s. Rate: 144.4 symbols/min [2025-09-26T22:29:31.729855] [INFO ] [MAIN ] UGI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:31.729678] [DEBUG] [MAIN ] UE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:31.738069] [INFO ] [MAIN ] UE: Generated 1820 derivative records from 43513 primary records. [2025-09-26T22:29:31.739345] [DEBUG] [LOCAL ] UE: Saving derivative data. [2025-09-26T22:29:31.760786] [DEBUG] [LOCAL ] UDR: Derivative data saved (1820 records). [2025-09-26T22:29:31.761215] [INFO ] [MAIN ] UDR: Successfully saved derivative data. [2025-09-26T22:29:31.763869] [INFO ] [MAIN ] Derivative Progress: 1887/2074 symbols completed. UDR took 1.3s. Estimated remaining: 1m 18s. Rate: 144.5 symbols/min [2025-09-26T22:29:31.765290] [INFO ] [MAIN ] UGP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:31.772481] [DEBUG] [LOCAL ] UE: Derivative data saved (1820 records). [2025-09-26T22:29:31.772803] [INFO ] [MAIN ] UE: Successfully saved derivative data. [2025-09-26T22:29:31.775621] [INFO ] [MAIN ] Derivative Progress: 1888/2074 symbols completed. UE took 1.3s. Estimated remaining: 1m 17s. Rate: 144.5 symbols/min [2025-09-26T22:29:31.825542] [DEBUG] [LOCAL ] UGI: Loaded 51290 existing records from primary storage. [2025-09-26T22:29:31.825769] [INFO ] [MAIN ] UGI: Loaded 51290 primary data records. [2025-09-26T22:29:31.958557] [DEBUG] [LOCAL ] UGP: Loaded 43319 existing records from primary storage. [2025-09-26T22:29:31.969024] [INFO ] [MAIN ] UGP: Loaded 43319 primary data records. [2025-09-26T22:29:32.523261] [DEBUG] [MAIN ] UGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:32.524140] [INFO ] [MAIN ] UGI: Generated 1820 derivative records from 51290 primary records. [2025-09-26T22:29:32.524348] [DEBUG] [LOCAL ] UGI: Saving derivative data. [2025-09-26T22:29:32.554770] [DEBUG] [MAIN ] UGP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:32.556599] [INFO ] [MAIN ] UGP: Generated 1820 derivative records from 43319 primary records. [2025-09-26T22:29:32.556719] [DEBUG] [LOCAL ] UGP: Saving derivative data. [2025-09-26T22:29:32.568362] [DEBUG] [LOCAL ] UGI: Derivative data saved (1820 records). [2025-09-26T22:29:32.573822] [INFO ] [MAIN ] UGI: Successfully saved derivative data. [2025-09-26T22:29:32.575369] [DEBUG] [LOCAL ] UGP: Derivative data saved (1820 records). [2025-09-26T22:29:32.577698] [INFO ] [MAIN ] Derivative Progress: 1889/2074 symbols completed. UGI took 0.8s. Estimated remaining: 1m 17s. Rate: 144.5 symbols/min [2025-09-26T22:29:32.577800] [INFO ] [MAIN ] UGP: Successfully saved derivative data. [2025-09-26T22:29:32.580740] [INFO ] [MAIN ] Derivative Progress: 1890/2074 symbols completed. UGP took 0.8s. Estimated remaining: 1m 16s. Rate: 144.5 symbols/min [2025-09-26T22:29:32.581333] [INFO ] [MAIN ] UHS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:32.581600] [INFO ] [MAIN ] UHAL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:32.581773] [INFO ] [MAIN ] UHT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:32.593993] [DEBUG] [LOCAL ] UHT: Loaded 10131 existing records from primary storage. [2025-09-26T22:29:32.594293] [INFO ] [MAIN ] UHT: Loaded 10131 primary data records. [2025-09-26T22:29:32.707862] [DEBUG] [LOCAL ] UHAL: Loaded 16817 existing records from primary storage. [2025-09-26T22:29:32.725747] [INFO ] [MAIN ] UHAL: Loaded 16817 primary data records. [2025-09-26T22:29:32.930993] [DEBUG] [LOCAL ] UHS: Loaded 41674 existing records from primary storage. [2025-09-26T22:29:32.944065] [INFO ] [MAIN ] UHS: Loaded 41674 primary data records. [2025-09-26T22:29:33.714488] [DEBUG] [MAIN ] UHT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:33.715711] [INFO ] [MAIN ] UHT: Generated 1820 derivative records from 10131 primary records. [2025-09-26T22:29:33.715983] [DEBUG] [LOCAL ] UHT: Saving derivative data. [2025-09-26T22:29:33.753217] [DEBUG] [MAIN ] UHAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:33.754237] [DEBUG] [LOCAL ] UHT: Derivative data saved (1820 records). [2025-09-26T22:29:33.755211] [INFO ] [MAIN ] UHAL: Generated 1820 derivative records from 16817 primary records. [2025-09-26T22:29:33.755594] [DEBUG] [LOCAL ] UHAL: Saving derivative data. [2025-09-26T22:29:33.755696] [INFO ] [MAIN ] UHT: Successfully saved derivative data. [2025-09-26T22:29:33.759117] [INFO ] [MAIN ] Derivative Progress: 1891/2074 symbols completed. UHT took 1.2s. Estimated remaining: 1m 16s. Rate: 144.4 symbols/min [2025-09-26T22:29:33.767668] [INFO ] [MAIN ] UI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:33.781692] [DEBUG] [LOCAL ] UHAL: Derivative data saved (1820 records). [2025-09-26T22:29:33.781900] [INFO ] [MAIN ] UHAL: Successfully saved derivative data. [2025-09-26T22:29:33.801217] [INFO ] [MAIN ] Derivative Progress: 1892/2074 symbols completed. UHAL took 1.2s. Estimated remaining: 1m 16s. Rate: 144.5 symbols/min [2025-09-26T22:29:33.801916] [DEBUG] [MAIN ] UHS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:33.802279] [INFO ] [MAIN ] UIS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:33.803211] [INFO ] [MAIN ] UHS: Generated 1820 derivative records from 41674 primary records. [2025-09-26T22:29:33.803729] [DEBUG] [LOCAL ] UHS: Saving derivative data. [2025-09-26T22:29:33.810615] [DEBUG] [LOCAL ] UI: Loaded 13008 existing records from primary storage. [2025-09-26T22:29:33.822728] [INFO ] [MAIN ] UI: Loaded 13008 primary data records. [2025-09-26T22:29:33.882880] [DEBUG] [LOCAL ] UHS: Derivative data saved (1820 records). [2025-09-26T22:29:33.907204] [INFO ] [MAIN ] UHS: Successfully saved derivative data. [2025-09-26T22:29:33.926754] [INFO ] [MAIN ] Derivative Progress: 1893/2074 symbols completed. UHS took 1.3s. Estimated remaining: 1m 15s. Rate: 144.5 symbols/min [2025-09-26T22:29:33.980999] [INFO ] [MAIN ] UL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:34.189325] [DEBUG] [LOCAL ] UIS: Loaded 37552 existing records from primary storage. [2025-09-26T22:29:34.203447] [INFO ] [MAIN ] UIS: Loaded 37552 primary data records. [2025-09-26T22:29:34.568969] [DEBUG] [LOCAL ] UL: Loaded 53843 existing records from primary storage. [2025-09-26T22:29:34.569473] [INFO ] [MAIN ] UL: Loaded 53843 primary data records. [2025-09-26T22:29:34.701687] [DEBUG] [MAIN ] UI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:34.714780] [INFO ] [MAIN ] UI: Generated 1820 derivative records from 13008 primary records. [2025-09-26T22:29:34.720313] [DEBUG] [LOCAL ] UI: Saving derivative data. [2025-09-26T22:29:34.936210] [DEBUG] [LOCAL ] UI: Derivative data saved (1820 records). [2025-09-26T22:29:34.937061] [INFO ] [MAIN ] UI: Successfully saved derivative data. [2025-09-26T22:29:34.939456] [INFO ] [MAIN ] Derivative Progress: 1894/2074 symbols completed. UI took 1.2s. Estimated remaining: 1m 15s. Rate: 144.4 symbols/min [2025-09-26T22:29:34.939891] [INFO ] [MAIN ] ULS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:34.954075] [DEBUG] [MAIN ] UIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:34.954970] [INFO ] [MAIN ] UIS: Generated 1820 derivative records from 37552 primary records. [2025-09-26T22:29:34.955205] [DEBUG] [LOCAL ] UIS: Saving derivative data. [2025-09-26T22:29:34.975455] [DEBUG] [LOCAL ] UIS: Derivative data saved (1820 records). [2025-09-26T22:29:34.975908] [INFO ] [MAIN ] UIS: Successfully saved derivative data. [2025-09-26T22:29:34.978590] [INFO ] [MAIN ] Derivative Progress: 1895/2074 symbols completed. UIS took 1.2s. Estimated remaining: 1m 14s. Rate: 144.5 symbols/min [2025-09-26T22:29:34.979803] [INFO ] [MAIN ] UMC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:34.996013] [DEBUG] [MAIN ] UL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:34.996809] [INFO ] [MAIN ] UL: Generated 1820 derivative records from 53843 primary records. [2025-09-26T22:29:34.996937] [DEBUG] [LOCAL ] UL: Saving derivative data. [2025-09-26T22:29:35.035465] [DEBUG] [LOCAL ] ULS: Loaded 39769 existing records from primary storage. [2025-09-26T22:29:35.036213] [INFO ] [MAIN ] ULS: Loaded 39769 primary data records. [2025-09-26T22:29:35.036412] [DEBUG] [LOCAL ] UL: Derivative data saved (1820 records). [2025-09-26T22:29:35.041732] [INFO ] [MAIN ] UL: Successfully saved derivative data. [2025-09-26T22:29:35.050439] [INFO ] [MAIN ] Derivative Progress: 1896/2074 symbols completed. UL took 1.1s. Estimated remaining: 1m 14s. Rate: 144.5 symbols/min [2025-09-26T22:29:35.076859] [INFO ] [MAIN ] UMH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:35.263022] [DEBUG] [LOCAL ] UMC: Loaded 53490 existing records from primary storage. [2025-09-26T22:29:35.368701] [INFO ] [MAIN ] UMC: Loaded 53490 primary data records. [2025-09-26T22:29:35.529891] [DEBUG] [LOCAL ] UMH: Loaded 34078 existing records from primary storage. [2025-09-26T22:29:35.557513] [INFO ] [MAIN ] UMH: Loaded 34078 primary data records. [2025-09-26T22:29:36.165057] [DEBUG] [MAIN ] ULS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:36.166247] [INFO ] [MAIN ] ULS: Generated 1820 derivative records from 39769 primary records. [2025-09-26T22:29:36.166700] [DEBUG] [LOCAL ] ULS: Saving derivative data. [2025-09-26T22:29:36.205727] [DEBUG] [LOCAL ] ULS: Derivative data saved (1820 records). [2025-09-26T22:29:36.205984] [INFO ] [MAIN ] ULS: Successfully saved derivative data. [2025-09-26T22:29:36.208155] [INFO ] [MAIN ] Derivative Progress: 1897/2074 symbols completed. ULS took 1.3s. Estimated remaining: 1m 14s. Rate: 144.4 symbols/min [2025-09-26T22:29:36.208502] [INFO ] [MAIN ] UNF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:36.205173] [DEBUG] [MAIN ] UMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:36.209627] [INFO ] [MAIN ] UMC: Generated 1820 derivative records from 53490 primary records. [2025-09-26T22:29:36.209775] [DEBUG] [LOCAL ] UMC: Saving derivative data. [2025-09-26T22:29:36.243595] [DEBUG] [MAIN ] UMH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:36.245191] [INFO ] [MAIN ] UMH: Generated 1820 derivative records from 34078 primary records. [2025-09-26T22:29:36.245332] [DEBUG] [LOCAL ] UMH: Saving derivative data. [2025-09-26T22:29:36.252295] [DEBUG] [LOCAL ] UMC: Derivative data saved (1820 records). [2025-09-26T22:29:36.260141] [DEBUG] [LOCAL ] UNF: Loaded 12048 existing records from primary storage. [2025-09-26T22:29:36.252588] [INFO ] [MAIN ] UMC: Successfully saved derivative data. [2025-09-26T22:29:36.266361] [INFO ] [MAIN ] Derivative Progress: 1898/2074 symbols completed. UMC took 1.3s. Estimated remaining: 1m 13s. Rate: 144.5 symbols/min [2025-09-26T22:29:36.261123] [INFO ] [MAIN ] UNF: Loaded 12048 primary data records. [2025-09-26T22:29:36.271844] [INFO ] [MAIN ] UNFI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:36.438164] [DEBUG] [LOCAL ] UMH: Derivative data saved (1820 records). [2025-09-26T22:29:36.462077] [INFO ] [MAIN ] UMH: Successfully saved derivative data. [2025-09-26T22:29:36.503404] [INFO ] [MAIN ] Derivative Progress: 1899/2074 symbols completed. UMH took 1.4s. Estimated remaining: 1m 13s. Rate: 144.5 symbols/min [2025-09-26T22:29:36.598355] [INFO ] [MAIN ] UNH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:36.616699] [DEBUG] [LOCAL ] UNFI: Loaded 42528 existing records from primary storage. [2025-09-26T22:29:36.617015] [INFO ] [MAIN ] UNFI: Loaded 42528 primary data records. [2025-09-26T22:29:36.985326] [DEBUG] [LOCAL ] UNH: Loaded 54574 existing records from primary storage. [2025-09-26T22:29:36.985685] [DEBUG] [MAIN ] UNF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:36.986581] [INFO ] [MAIN ] UNF: Generated 1820 derivative records from 12048 primary records. [2025-09-26T22:29:36.986917] [INFO ] [MAIN ] UNH: Loaded 54574 primary data records. [2025-09-26T22:29:36.986815] [DEBUG] [LOCAL ] UNF: Saving derivative data. [2025-09-26T22:29:37.150023] [DEBUG] [LOCAL ] UNF: Derivative data saved (1820 records). [2025-09-26T22:29:37.199722] [INFO ] [MAIN ] UNF: Successfully saved derivative data. [2025-09-26T22:29:37.208322] [INFO ] [MAIN ] Derivative Progress: 1900/2074 symbols completed. UNF took 1.0s. Estimated remaining: 1m 12s. Rate: 144.5 symbols/min [2025-09-26T22:29:37.208794] [INFO ] [MAIN ] UNM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:37.348301] [DEBUG] [MAIN ] UNFI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:37.349497] [INFO ] [MAIN ] UNFI: Generated 1820 derivative records from 42528 primary records. [2025-09-26T22:29:37.349632] [DEBUG] [LOCAL ] UNFI: Saving derivative data. [2025-09-26T22:29:37.371132] [DEBUG] [LOCAL ] UNFI: Derivative data saved (1820 records). [2025-09-26T22:29:37.371284] [INFO ] [MAIN ] UNFI: Successfully saved derivative data. [2025-09-26T22:29:37.373814] [INFO ] [MAIN ] Derivative Progress: 1901/2074 symbols completed. UNFI took 1.1s. Estimated remaining: 1m 12s. Rate: 144.5 symbols/min [2025-09-26T22:29:37.374202] [INFO ] [MAIN ] UNMA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:37.406043] [DEBUG] [MAIN ] UNH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:37.406238] [DEBUG] [LOCAL ] UNMA: Loaded 3627 existing records from primary storage. [2025-09-26T22:29:37.407120] [INFO ] [MAIN ] UNH: Generated 1820 derivative records from 54574 primary records. [2025-09-26T22:29:37.407201] [INFO ] [MAIN ] UNMA: Loaded 3627 primary data records. [2025-09-26T22:29:37.407316] [DEBUG] [LOCAL ] UNH: Saving derivative data. [2025-09-26T22:29:37.545959] [DEBUG] [LOCAL ] UNM: Loaded 49368 existing records from primary storage. [2025-09-26T22:29:37.550550] [INFO ] [MAIN ] UNM: Loaded 49368 primary data records. [2025-09-26T22:29:37.812461] [DEBUG] [LOCAL ] UNH: Derivative data saved (1820 records). [2025-09-26T22:29:37.845833] [INFO ] [MAIN ] UNH: Successfully saved derivative data. [2025-09-26T22:29:37.861103] [INFO ] [MAIN ] Derivative Progress: 1902/2074 symbols completed. UNH took 1.3s. Estimated remaining: 1m 11s. Rate: 144.5 symbols/min [2025-09-26T22:29:37.873911] [INFO ] [MAIN ] UNP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:38.166582] [DEBUG] [MAIN ] UNMA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:38.167465] [INFO ] [MAIN ] UNMA: Generated 1820 derivative records from 3627 primary records. [2025-09-26T22:29:38.167636] [DEBUG] [LOCAL ] UNMA: Saving derivative data. [2025-09-26T22:29:38.201620] [DEBUG] [LOCAL ] UNP: Loaded 54030 existing records from primary storage. [2025-09-26T22:29:38.203028] [INFO ] [MAIN ] UNP: Loaded 54030 primary data records. [2025-09-26T22:29:38.216412] [DEBUG] [LOCAL ] UNMA: Derivative data saved (1820 records). [2025-09-26T22:29:38.257611] [INFO ] [MAIN ] UNMA: Successfully saved derivative data. [2025-09-26T22:29:38.258080] [DEBUG] [MAIN ] UNM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:38.267434] [INFO ] [MAIN ] UNM: Generated 1820 derivative records from 49368 primary records. [2025-09-26T22:29:38.272706] [DEBUG] [LOCAL ] UNM: Saving derivative data. [2025-09-26T22:29:38.283221] [INFO ] [MAIN ] Derivative Progress: 1903/2074 symbols completed. UNMA took 0.9s. Estimated remaining: 1m 11s. Rate: 144.5 symbols/min [2025-09-26T22:29:38.555218] [DEBUG] [LOCAL ] UNM: Derivative data saved (1820 records). [2025-09-26T22:29:38.555635] [INFO ] [MAIN ] UNM: Successfully saved derivative data. [2025-09-26T22:29:38.558290] [INFO ] [MAIN ] Derivative Progress: 1904/2074 symbols completed. UNM took 1.3s. Estimated remaining: 1m 11s. Rate: 144.5 symbols/min [2025-09-26T22:29:38.582589] [DEBUG] [MAIN ] UNP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:38.583297] [INFO ] [MAIN ] UNP: Generated 1820 derivative records from 54030 primary records. [2025-09-26T22:29:38.583362] [DEBUG] [LOCAL ] UNP: Saving derivative data. [2025-09-26T22:29:38.600358] [DEBUG] [LOCAL ] UNP: Derivative data saved (1820 records). [2025-09-26T22:29:38.600438] [INFO ] [MAIN ] UNP: Successfully saved derivative data. [2025-09-26T22:29:38.602755] [INFO ] [MAIN ] Derivative Progress: 1905/2074 symbols completed. UNP took 0.7s. Estimated remaining: 1m 10s. Rate: 144.6 symbols/min [2025-09-26T22:29:38.603292] [INFO ] [MAIN ] UP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:38.604207] [INFO ] [MAIN ] UPS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:38.604320] [INFO ] [MAIN ] URI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:38.669571] [DEBUG] [LOCAL ] URI: Loaded 36669 existing records from primary storage. [2025-09-26T22:29:38.669885] [INFO ] [MAIN ] URI: Loaded 36669 primary data records. [2025-09-26T22:29:38.747305] [DEBUG] [LOCAL ] UP: Loaded 43857 existing records from primary storage. [2025-09-26T22:29:38.786474] [DEBUG] [LOCAL ] UPS: Loaded 54490 existing records from primary storage. [2025-09-26T22:29:38.809703] [INFO ] [MAIN ] UPS: Loaded 54490 primary data records. [2025-09-26T22:29:38.809826] [INFO ] [MAIN ] UP: Loaded 43857 primary data records. [2025-09-26T22:29:39.681957] [DEBUG] [MAIN ] URI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:39.683039] [INFO ] [MAIN ] URI: Generated 1820 derivative records from 36669 primary records. [2025-09-26T22:29:39.683260] [DEBUG] [LOCAL ] URI: Saving derivative data. [2025-09-26T22:29:39.718115] [DEBUG] [MAIN ] UP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:39.731921] [INFO ] [MAIN ] UP: Generated 1820 derivative records from 43857 primary records. [2025-09-26T22:29:39.732881] [DEBUG] [LOCAL ] UP: Saving derivative data. [2025-09-26T22:29:39.735082] [DEBUG] [MAIN ] UPS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:39.746152] [DEBUG] [LOCAL ] URI: Derivative data saved (1820 records). [2025-09-26T22:29:39.744340] [INFO ] [MAIN ] UPS: Generated 1820 derivative records from 54490 primary records. [2025-09-26T22:29:39.749251] [INFO ] [MAIN ] URI: Successfully saved derivative data. [2025-09-26T22:29:39.749175] [DEBUG] [LOCAL ] UPS: Saving derivative data. [2025-09-26T22:29:39.751454] [INFO ] [MAIN ] Derivative Progress: 1906/2074 symbols completed. URI took 1.1s. Estimated remaining: 1m 10s. Rate: 144.4 symbols/min [2025-09-26T22:29:39.754442] [INFO ] [MAIN ] USA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:39.772695] [DEBUG] [LOCAL ] UP: Derivative data saved (1820 records). [2025-09-26T22:29:39.773349] [INFO ] [MAIN ] UP: Successfully saved derivative data. [2025-09-26T22:29:39.775958] [INFO ] [MAIN ] Derivative Progress: 1907/2074 symbols completed. UP took 1.2s. Estimated remaining: 1m 9s. Rate: 144.5 symbols/min [2025-09-26T22:29:39.776852] [INFO ] [MAIN ] USAC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:39.779584] [DEBUG] [LOCAL ] UPS: Derivative data saved (1820 records). [2025-09-26T22:29:39.779738] [INFO ] [MAIN ] UPS: Successfully saved derivative data. [2025-09-26T22:29:39.783093] [INFO ] [MAIN ] Derivative Progress: 1908/2074 symbols completed. UPS took 1.2s. Estimated remaining: 1m 9s. Rate: 144.6 symbols/min [2025-09-26T22:29:39.783479] [INFO ] [MAIN ] USB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:39.816133] [DEBUG] [LOCAL ] USA: Loaded 36524 existing records from primary storage. [2025-09-26T22:29:39.816417] [INFO ] [MAIN ] USA: Loaded 36524 primary data records. [2025-09-26T22:29:39.886096] [DEBUG] [LOCAL ] USAC: Loaded 23060 existing records from primary storage. [2025-09-26T22:29:39.901799] [INFO ] [MAIN ] USAC: Loaded 23060 primary data records. [2025-09-26T22:29:40.208817] [DEBUG] [LOCAL ] USB: Loaded 54468 existing records from primary storage. [2025-09-26T22:29:40.357404] [INFO ] [MAIN ] USB: Loaded 54468 primary data records. [2025-09-26T22:29:40.937621] [DEBUG] [MAIN ] USA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:40.940279] [INFO ] [MAIN ] USA: Generated 1820 derivative records from 36524 primary records. [2025-09-26T22:29:40.940783] [DEBUG] [LOCAL ] USA: Saving derivative data. [2025-09-26T22:29:40.973603] [DEBUG] [MAIN ] USAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:40.975612] [INFO ] [MAIN ] USAC: Generated 1820 derivative records from 23060 primary records. [2025-09-26T22:29:40.976319] [DEBUG] [LOCAL ] USAC: Saving derivative data. [2025-09-26T22:29:40.991982] [DEBUG] [LOCAL ] USA: Derivative data saved (1820 records). [2025-09-26T22:29:40.992169] [INFO ] [MAIN ] USA: Successfully saved derivative data. [2025-09-26T22:29:40.994397] [INFO ] [MAIN ] Derivative Progress: 1909/2074 symbols completed. USA took 1.2s. Estimated remaining: 1m 9s. Rate: 144.4 symbols/min [2025-09-26T22:29:40.995372] [INFO ] [MAIN ] USFD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:41.010676] [DEBUG] [MAIN ] USB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:41.013214] [INFO ] [MAIN ] USB: Generated 1820 derivative records from 54468 primary records. [2025-09-26T22:29:41.013619] [DEBUG] [LOCAL ] USB: Saving derivative data. [2025-09-26T22:29:41.028844] [DEBUG] [LOCAL ] USAC: Derivative data saved (1820 records). [2025-09-26T22:29:41.030083] [INFO ] [MAIN ] USAC: Successfully saved derivative data. [2025-09-26T22:29:41.032863] [INFO ] [MAIN ] Derivative Progress: 1910/2074 symbols completed. USAC took 1.3s. Estimated remaining: 1m 8s. Rate: 144.5 symbols/min [2025-09-26T22:29:41.033698] [INFO ] [MAIN ] USNA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:41.040677] [DEBUG] [LOCAL ] USB: Derivative data saved (1820 records). [2025-09-26T22:29:41.040772] [INFO ] [MAIN ] USB: Successfully saved derivative data. [2025-09-26T22:29:41.044502] [INFO ] [MAIN ] Derivative Progress: 1911/2074 symbols completed. USB took 1.3s. Estimated remaining: 1m 8s. Rate: 144.6 symbols/min [2025-09-26T22:29:41.044979] [INFO ] [MAIN ] USPH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:41.067786] [DEBUG] [LOCAL ] USNA: Loaded 18368 existing records from primary storage. [2025-09-26T22:29:41.068063] [INFO ] [MAIN ] USNA: Loaded 18368 primary data records. [2025-09-26T22:29:41.154471] [DEBUG] [LOCAL ] USPH: Loaded 16827 existing records from primary storage. [2025-09-26T22:29:41.205058] [INFO ] [MAIN ] USPH: Loaded 16827 primary data records. [2025-09-26T22:29:41.306449] [DEBUG] [LOCAL ] USFD: Loaded 51959 existing records from primary storage. [2025-09-26T22:29:41.340824] [INFO ] [MAIN ] USFD: Loaded 51959 primary data records. [2025-09-26T22:29:42.177926] [DEBUG] [MAIN ] USNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:42.180243] [INFO ] [MAIN ] USNA: Generated 1820 derivative records from 18368 primary records. [2025-09-26T22:29:42.182319] [DEBUG] [LOCAL ] USNA: Saving derivative data. [2025-09-26T22:29:42.212088] [DEBUG] [MAIN ] USPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:42.213743] [INFO ] [MAIN ] USPH: Generated 1820 derivative records from 16827 primary records. [2025-09-26T22:29:42.214129] [DEBUG] [LOCAL ] USPH: Saving derivative data. [2025-09-26T22:29:42.232701] [DEBUG] [LOCAL ] USNA: Derivative data saved (1820 records). [2025-09-26T22:29:42.233535] [INFO ] [MAIN ] USNA: Successfully saved derivative data. [2025-09-26T22:29:42.236152] [INFO ] [MAIN ] Derivative Progress: 1912/2074 symbols completed. USNA took 1.2s. Estimated remaining: 1m 7s. Rate: 144.4 symbols/min [2025-09-26T22:29:42.250380] [INFO ] [MAIN ] UTF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:42.251508] [DEBUG] [MAIN ] USFD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:42.253800] [INFO ] [MAIN ] USFD: Generated 1820 derivative records from 51959 primary records. [2025-09-26T22:29:42.254306] [DEBUG] [LOCAL ] USFD: Saving derivative data. [2025-09-26T22:29:42.256030] [DEBUG] [LOCAL ] USPH: Derivative data saved (1820 records). [2025-09-26T22:29:42.256613] [INFO ] [MAIN ] USPH: Successfully saved derivative data. [2025-09-26T22:29:42.259355] [INFO ] [MAIN ] Derivative Progress: 1913/2074 symbols completed. USPH took 1.2s. Estimated remaining: 1m 7s. Rate: 144.5 symbols/min [2025-09-26T22:29:42.271127] [INFO ] [MAIN ] UTI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:42.276999] [DEBUG] [LOCAL ] USFD: Derivative data saved (1820 records). [2025-09-26T22:29:42.277093] [INFO ] [MAIN ] USFD: Successfully saved derivative data. [2025-09-26T22:29:42.280107] [INFO ] [MAIN ] Derivative Progress: 1914/2074 symbols completed. USFD took 1.3s. Estimated remaining: 1m 6s. Rate: 144.6 symbols/min [2025-09-26T22:29:42.280533] [INFO ] [MAIN ] UTL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:42.308096] [DEBUG] [LOCAL ] UTL: Loaded 11273 existing records from primary storage. [2025-09-26T22:29:42.318601] [INFO ] [MAIN ] UTL: Loaded 11273 primary data records. [2025-09-26T22:29:42.324702] [DEBUG] [LOCAL ] UTF: Loaded 29200 existing records from primary storage. [2025-09-26T22:29:42.342432] [INFO ] [MAIN ] UTF: Loaded 29200 primary data records. [2025-09-26T22:29:42.586550] [DEBUG] [LOCAL ] UTI: Loaded 41146 existing records from primary storage. [2025-09-26T22:29:42.598046] [INFO ] [MAIN ] UTI: Loaded 41146 primary data records. [2025-09-26T22:29:43.397682] [DEBUG] [MAIN ] UTL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:43.398946] [INFO ] [MAIN ] UTL: Generated 1820 derivative records from 11273 primary records. [2025-09-26T22:29:43.399275] [DEBUG] [LOCAL ] UTL: Saving derivative data. [2025-09-26T22:29:43.451568] [DEBUG] [MAIN ] UTF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:43.453985] [INFO ] [MAIN ] UTF: Generated 1820 derivative records from 29200 primary records. [2025-09-26T22:29:43.453196] [DEBUG] [LOCAL ] UTL: Derivative data saved (1820 records). [2025-09-26T22:29:43.454121] [DEBUG] [LOCAL ] UTF: Saving derivative data. [2025-09-26T22:29:43.454218] [INFO ] [MAIN ] UTL: Successfully saved derivative data. [2025-09-26T22:29:43.456364] [INFO ] [MAIN ] Derivative Progress: 1915/2074 symbols completed. UTL took 1.2s. Estimated remaining: 1m 6s. Rate: 144.5 symbols/min [2025-09-26T22:29:43.452390] [DEBUG] [MAIN ] UTI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:43.456797] [INFO ] [MAIN ] UTZ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:43.458183] [INFO ] [MAIN ] UTI: Generated 1820 derivative records from 41146 primary records. [2025-09-26T22:29:43.459225] [DEBUG] [LOCAL ] UTI: Saving derivative data. [2025-09-26T22:29:43.488686] [DEBUG] [LOCAL ] UTI: Derivative data saved (1820 records). [2025-09-26T22:29:43.489384] [INFO ] [MAIN ] UTI: Successfully saved derivative data. [2025-09-26T22:29:43.492316] [INFO ] [MAIN ] Derivative Progress: 1916/2074 symbols completed. UTI took 1.2s. Estimated remaining: 1m 6s. Rate: 144.5 symbols/min [2025-09-26T22:29:43.493420] [INFO ] [MAIN ] UVE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:43.497309] [DEBUG] [LOCAL ] UTF: Derivative data saved (1820 records). [2025-09-26T22:29:43.503005] [INFO ] [MAIN ] UTF: Successfully saved derivative data. [2025-09-26T22:29:43.505779] [INFO ] [MAIN ] Derivative Progress: 1917/2074 symbols completed. UTF took 1.3s. Estimated remaining: 1m 5s. Rate: 144.6 symbols/min [2025-09-26T22:29:43.506315] [INFO ] [MAIN ] UVV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:43.536498] [DEBUG] [LOCAL ] UVE: Loaded 22124 existing records from primary storage. [2025-09-26T22:29:43.536674] [INFO ] [MAIN ] UVE: Loaded 22124 primary data records. [2025-09-26T22:29:43.661250] [DEBUG] [LOCAL ] UVV: Loaded 22660 existing records from primary storage. [2025-09-26T22:29:43.674313] [INFO ] [MAIN ] UVV: Loaded 22660 primary data records. [2025-09-26T22:29:43.674180] [DEBUG] [LOCAL ] UTZ: Loaded 45341 existing records from primary storage. [2025-09-26T22:29:43.674478] [INFO ] [MAIN ] UTZ: Loaded 45341 primary data records. [2025-09-26T22:29:44.626479] [DEBUG] [MAIN ] UVE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:44.629476] [INFO ] [MAIN ] UVE: Generated 1820 derivative records from 22124 primary records. [2025-09-26T22:29:44.630007] [DEBUG] [LOCAL ] UVE: Saving derivative data. [2025-09-26T22:29:44.657344] [DEBUG] [LOCAL ] UVE: Derivative data saved (1820 records). [2025-09-26T22:29:44.657874] [INFO ] [MAIN ] UVE: Successfully saved derivative data. [2025-09-26T22:29:44.661209] [INFO ] [MAIN ] Derivative Progress: 1918/2074 symbols completed. UVE took 1.2s. Estimated remaining: 1m 5s. Rate: 144.5 symbols/min [2025-09-26T22:29:44.681311] [DEBUG] [MAIN ] UVV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:44.683793] [INFO ] [MAIN ] UVV: Generated 1820 derivative records from 22660 primary records. [2025-09-26T22:29:44.683925] [DEBUG] [LOCAL ] UVV: Saving derivative data. [2025-09-26T22:29:44.705340] [DEBUG] [MAIN ] UTZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:44.710554] [INFO ] [MAIN ] UTZ: Generated 1820 derivative records from 45341 primary records. [2025-09-26T22:29:44.713559] [DEBUG] [LOCAL ] UTZ: Saving derivative data. [2025-09-26T22:29:44.715396] [DEBUG] [LOCAL ] UVV: Derivative data saved (1820 records). [2025-09-26T22:29:44.715772] [INFO ] [MAIN ] UVV: Successfully saved derivative data. [2025-09-26T22:29:44.719777] [INFO ] [MAIN ] Derivative Progress: 1919/2074 symbols completed. UVV took 1.2s. Estimated remaining: 1m 4s. Rate: 144.5 symbols/min [2025-09-26T22:29:44.736164] [DEBUG] [LOCAL ] UTZ: Derivative data saved (1820 records). [2025-09-26T22:29:44.736243] [INFO ] [MAIN ] UTZ: Successfully saved derivative data. [2025-09-26T22:29:44.740561] [INFO ] [MAIN ] Derivative Progress: 1920/2074 symbols completed. UTZ took 1.3s. Estimated remaining: 1m 4s. Rate: 144.6 symbols/min [2025-09-26T22:29:44.741418] [INFO ] [MAIN ] UZD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:44.741292] [INFO ] [MAIN ] UZE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:44.742433] [INFO ] [MAIN ] UWMC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:44.755691] [DEBUG] [LOCAL ] UZD: Loaded 6455 existing records from primary storage. [2025-09-26T22:29:44.755946] [INFO ] [MAIN ] UZD: Loaded 6455 primary data records. [2025-09-26T22:29:44.794982] [DEBUG] [LOCAL ] UZE: Loaded 7528 existing records from primary storage. [2025-09-26T22:29:44.814810] [INFO ] [MAIN ] UZE: Loaded 7528 primary data records. [2025-09-26T22:29:45.457184] [DEBUG] [LOCAL ] UWMC: Loaded 53516 existing records from primary storage. [2025-09-26T22:29:45.458528] [INFO ] [MAIN ] UWMC: Loaded 53516 primary data records. [2025-09-26T22:29:45.816100] [DEBUG] [MAIN ] UZD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:45.828219] [INFO ] [MAIN ] UZD: Generated 1820 derivative records from 6455 primary records. [2025-09-26T22:29:45.834339] [DEBUG] [LOCAL ] UZD: Saving derivative data. [2025-09-26T22:29:45.833844] [DEBUG] [MAIN ] UZE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:45.836946] [INFO ] [MAIN ] UZE: Generated 1820 derivative records from 7528 primary records. [2025-09-26T22:29:45.837241] [DEBUG] [LOCAL ] UZE: Saving derivative data. [2025-09-26T22:29:45.875241] [DEBUG] [LOCAL ] UZE: Derivative data saved (1820 records). [2025-09-26T22:29:45.876106] [INFO ] [MAIN ] UZE: Successfully saved derivative data. [2025-09-26T22:29:45.879515] [INFO ] [MAIN ] Derivative Progress: 1921/2074 symbols completed. UZE took 1.1s. Estimated remaining: 1m 4s. Rate: 144.5 symbols/min [2025-09-26T22:29:45.893312] [INFO ] [MAIN ] UZF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:45.892405] [DEBUG] [LOCAL ] UZD: Derivative data saved (1820 records). [2025-09-26T22:29:45.893639] [DEBUG] [MAIN ] UWMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:45.895031] [INFO ] [MAIN ] UZD: Successfully saved derivative data. [2025-09-26T22:29:45.897969] [INFO ] [MAIN ] Derivative Progress: 1922/2074 symbols completed. UZD took 1.2s. Estimated remaining: 1m 3s. Rate: 144.5 symbols/min [2025-09-26T22:29:45.894947] [INFO ] [MAIN ] UWMC: Generated 1820 derivative records from 53516 primary records. [2025-09-26T22:29:45.899016] [DEBUG] [LOCAL ] UWMC: Saving derivative data. [2025-09-26T22:29:45.899263] [INFO ] [MAIN ] V: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:45.928452] [DEBUG] [LOCAL ] UZF: Loaded 6574 existing records from primary storage. [2025-09-26T22:29:45.928916] [INFO ] [MAIN ] UZF: Loaded 6574 primary data records. [2025-09-26T22:29:45.963484] [DEBUG] [LOCAL ] UWMC: Derivative data saved (1820 records). [2025-09-26T22:29:45.969979] [INFO ] [MAIN ] UWMC: Successfully saved derivative data. [2025-09-26T22:29:45.979385] [INFO ] [MAIN ] Derivative Progress: 1923/2074 symbols completed. UWMC took 1.2s. Estimated remaining: 1m 3s. Rate: 144.6 symbols/min [2025-09-26T22:29:46.000715] [INFO ] [MAIN ] VAC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:46.307744] [DEBUG] [LOCAL ] V: Loaded 54535 existing records from primary storage. [2025-09-26T22:29:46.308754] [INFO ] [MAIN ] V: Loaded 54535 primary data records. [2025-09-26T22:29:46.375953] [DEBUG] [LOCAL ] VAC: Loaded 35026 existing records from primary storage. [2025-09-26T22:29:46.400846] [INFO ] [MAIN ] VAC: Loaded 35026 primary data records. [2025-09-26T22:29:46.943711] [DEBUG] [MAIN ] UZF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:47.074844] [INFO ] [MAIN ] UZF: Generated 1820 derivative records from 6574 primary records. [2025-09-26T22:29:47.075518] [DEBUG] [LOCAL ] UZF: Saving derivative data. [2025-09-26T22:29:47.104049] [DEBUG] [LOCAL ] UZF: Derivative data saved (1820 records). [2025-09-26T22:29:47.104757] [INFO ] [MAIN ] UZF: Successfully saved derivative data. [2025-09-26T22:29:47.107508] [INFO ] [MAIN ] Derivative Progress: 1924/2074 symbols completed. UZF took 1.2s. Estimated remaining: 1m 2s. Rate: 144.5 symbols/min [2025-09-26T22:29:47.109505] [INFO ] [MAIN ] VAL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:47.137279] [DEBUG] [MAIN ] V: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:47.140004] [INFO ] [MAIN ] V: Generated 1820 derivative records from 54535 primary records. [2025-09-26T22:29:47.141615] [DEBUG] [LOCAL ] V: Saving derivative data. [2025-09-26T22:29:47.172192] [DEBUG] [MAIN ] VAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:47.174987] [INFO ] [MAIN ] VAC: Generated 1820 derivative records from 35026 primary records. [2025-09-26T22:29:47.176526] [DEBUG] [LOCAL ] VAC: Saving derivative data. [2025-09-26T22:29:47.187837] [DEBUG] [LOCAL ] V: Derivative data saved (1820 records). [2025-09-26T22:29:47.193236] [INFO ] [MAIN ] V: Successfully saved derivative data. [2025-09-26T22:29:47.196481] [INFO ] [MAIN ] Derivative Progress: 1925/2074 symbols completed. V took 1.3s. Estimated remaining: 1m 2s. Rate: 144.5 symbols/min [2025-09-26T22:29:47.196996] [INFO ] [MAIN ] VALE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:47.220554] [DEBUG] [LOCAL ] VAC: Derivative data saved (1820 records). [2025-09-26T22:29:47.220880] [INFO ] [MAIN ] VAC: Successfully saved derivative data. [2025-09-26T22:29:47.223830] [INFO ] [MAIN ] Derivative Progress: 1926/2074 symbols completed. VAC took 1.2s. Estimated remaining: 1m 1s. Rate: 144.6 symbols/min [2025-09-26T22:29:47.224335] [INFO ] [MAIN ] VATE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:47.244124] [DEBUG] [LOCAL ] VAL: Loaded 51142 existing records from primary storage. [2025-09-26T22:29:47.244481] [INFO ] [MAIN ] VAL: Loaded 51142 primary data records. [2025-09-26T22:29:47.281138] [DEBUG] [LOCAL ] VATE: Loaded 5658 existing records from primary storage. [2025-09-26T22:29:47.287009] [INFO ] [MAIN ] VATE: Loaded 5658 primary data records. [2025-09-26T22:29:47.922440] [DEBUG] [LOCAL ] VALE: Loaded 54474 existing records from primary storage. [2025-09-26T22:29:47.922945] [INFO ] [MAIN ] VALE: Loaded 54474 primary data records. [2025-09-26T22:29:48.291166] [DEBUG] [MAIN ] VAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:48.304430] [INFO ] [MAIN ] VAL: Generated 1820 derivative records from 51142 primary records. [2025-09-26T22:29:48.304764] [DEBUG] [LOCAL ] VAL: Saving derivative data. [2025-09-26T22:29:48.314971] [DEBUG] [MAIN ] VATE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:48.325778] [INFO ] [MAIN ] VATE: Generated 1820 derivative records from 5658 primary records. [2025-09-26T22:29:48.326067] [DEBUG] [LOCAL ] VATE: Saving derivative data. [2025-09-26T22:29:48.342816] [DEBUG] [LOCAL ] VAL: Derivative data saved (1820 records). [2025-09-26T22:29:48.342947] [INFO ] [MAIN ] VAL: Successfully saved derivative data. [2025-09-26T22:29:48.347192] [INFO ] [MAIN ] Derivative Progress: 1927/2074 symbols completed. VAL took 1.2s. Estimated remaining: 1m 1s. Rate: 144.5 symbols/min [2025-09-26T22:29:48.352128] [INFO ] [MAIN ] VBF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:48.364697] [DEBUG] [LOCAL ] VATE: Derivative data saved (1820 records). [2025-09-26T22:29:48.365003] [INFO ] [MAIN ] VATE: Successfully saved derivative data. [2025-09-26T22:29:48.382673] [DEBUG] [LOCAL ] VBF: Loaded 7206 existing records from primary storage. [2025-09-26T22:29:48.386941] [INFO ] [MAIN ] Derivative Progress: 1928/2074 symbols completed. VATE took 1.2s. Estimated remaining: 1m 1s. Rate: 144.5 symbols/min [2025-09-26T22:29:48.388018] [DEBUG] [MAIN ] VALE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:48.388127] [INFO ] [MAIN ] VCV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:48.387070] [INFO ] [MAIN ] VBF: Loaded 7206 primary data records. [2025-09-26T22:29:48.389464] [INFO ] [MAIN ] VALE: Generated 1820 derivative records from 54474 primary records. [2025-09-26T22:29:48.395005] [DEBUG] [LOCAL ] VALE: Saving derivative data. [2025-09-26T22:29:48.533331] [DEBUG] [LOCAL ] VCV: Loaded 13766 existing records from primary storage. [2025-09-26T22:29:48.555124] [INFO ] [MAIN ] VCV: Loaded 13766 primary data records. [2025-09-26T22:29:48.771219] [DEBUG] [LOCAL ] VALE: Derivative data saved (1820 records). [2025-09-26T22:29:48.888238] [INFO ] [MAIN ] VALE: Successfully saved derivative data. [2025-09-26T22:29:48.918826] [INFO ] [MAIN ] Derivative Progress: 1929/2074 symbols completed. VALE took 1.7s. Estimated remaining: 1m 0s. Rate: 144.5 symbols/min [2025-09-26T22:29:48.931026] [INFO ] [MAIN ] VEEV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:49.162066] [DEBUG] [MAIN ] VBF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:49.164774] [INFO ] [MAIN ] VBF: Generated 1820 derivative records from 7206 primary records. [2025-09-26T22:29:49.165164] [DEBUG] [LOCAL ] VBF: Saving derivative data. [2025-09-26T22:29:49.196785] [DEBUG] [LOCAL ] VBF: Derivative data saved (1820 records). [2025-09-26T22:29:49.201168] [INFO ] [MAIN ] VBF: Successfully saved derivative data. [2025-09-26T22:29:49.203919] [INFO ] [MAIN ] Derivative Progress: 1930/2074 symbols completed. VBF took 0.9s. Estimated remaining: 59.8s. Rate: 144.5 symbols/min [2025-09-26T22:29:49.204579] [INFO ] [MAIN ] VEL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:49.236031] [DEBUG] [MAIN ] VCV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:49.238936] [DEBUG] [LOCAL ] VEEV: Loaded 47821 existing records from primary storage. [2025-09-26T22:29:49.239233] [INFO ] [MAIN ] VEEV: Loaded 47821 primary data records. [2025-09-26T22:29:49.237591] [INFO ] [MAIN ] VCV: Generated 1820 derivative records from 13766 primary records. [2025-09-26T22:29:49.239446] [DEBUG] [LOCAL ] VCV: Saving derivative data. [2025-09-26T22:29:49.381581] [DEBUG] [LOCAL ] VEL: Loaded 13299 existing records from primary storage. [2025-09-26T22:29:49.388261] [INFO ] [MAIN ] VEL: Loaded 13299 primary data records. [2025-09-26T22:29:49.491692] [DEBUG] [LOCAL ] VCV: Derivative data saved (1820 records). [2025-09-26T22:29:49.534216] [INFO ] [MAIN ] VCV: Successfully saved derivative data. [2025-09-26T22:29:49.547215] [INFO ] [MAIN ] Derivative Progress: 1931/2074 symbols completed. VCV took 1.2s. Estimated remaining: 59.4s. Rate: 144.6 symbols/min [2025-09-26T22:29:49.605413] [INFO ] [MAIN ] VET: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:50.029891] [DEBUG] [MAIN ] VEEV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:50.032147] [INFO ] [MAIN ] VEEV: Generated 1820 derivative records from 47821 primary records. [2025-09-26T22:29:50.032469] [DEBUG] [LOCAL ] VEEV: Saving derivative data. [2025-09-26T22:29:50.031064] [DEBUG] [LOCAL ] VET: Loaded 44749 existing records from primary storage. [2025-09-26T22:29:50.033755] [INFO ] [MAIN ] VET: Loaded 44749 primary data records. [2025-09-26T22:29:50.181583] [DEBUG] [MAIN ] VEL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:50.198633] [INFO ] [MAIN ] VEL: Generated 1820 derivative records from 13299 primary records. [2025-09-26T22:29:50.199255] [DEBUG] [LOCAL ] VEL: Saving derivative data. [2025-09-26T22:29:50.245819] [DEBUG] [LOCAL ] VEEV: Derivative data saved (1820 records). [2025-09-26T22:29:50.271616] [INFO ] [MAIN ] VEEV: Successfully saved derivative data. [2025-09-26T22:29:50.387265] [INFO ] [MAIN ] Derivative Progress: 1932/2074 symbols completed. VEEV took 1.5s. Estimated remaining: 59.0s. Rate: 144.5 symbols/min [2025-09-26T22:29:50.399573] [INFO ] [MAIN ] VFC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:50.414886] [DEBUG] [LOCAL ] VEL: Derivative data saved (1820 records). [2025-09-26T22:29:50.415033] [INFO ] [MAIN ] VEL: Successfully saved derivative data. [2025-09-26T22:29:50.417877] [INFO ] [MAIN ] Derivative Progress: 1933/2074 symbols completed. VEL took 1.2s. Estimated remaining: 58.5s. Rate: 144.5 symbols/min [2025-09-26T22:29:50.443893] [DEBUG] [MAIN ] VET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:50.444764] [INFO ] [MAIN ] VET: Generated 1820 derivative records from 44749 primary records. [2025-09-26T22:29:50.444886] [DEBUG] [LOCAL ] VET: Saving derivative data. [2025-09-26T22:29:50.476109] [DEBUG] [LOCAL ] VET: Derivative data saved (1820 records). [2025-09-26T22:29:50.476220] [INFO ] [MAIN ] VET: Successfully saved derivative data. [2025-09-26T22:29:50.479761] [INFO ] [MAIN ] Derivative Progress: 1934/2074 symbols completed. VET took 0.9s. Estimated remaining: 58.1s. Rate: 144.6 symbols/min [2025-09-26T22:29:50.500547] [DEBUG] [LOCAL ] VFC: Loaded 54390 existing records from primary storage. [2025-09-26T22:29:50.500770] [INFO ] [MAIN ] VFC: Loaded 54390 primary data records. [2025-09-26T22:29:50.867325] [DEBUG] [MAIN ] VFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:50.868153] [INFO ] [MAIN ] VFC: Generated 1820 derivative records from 54390 primary records. [2025-09-26T22:29:50.868219] [DEBUG] [LOCAL ] VFC: Saving derivative data. [2025-09-26T22:29:50.884536] [DEBUG] [LOCAL ] VFC: Derivative data saved (1820 records). [2025-09-26T22:29:50.884598] [INFO ] [MAIN ] VFC: Successfully saved derivative data. [2025-09-26T22:29:50.886777] [INFO ] [MAIN ] Derivative Progress: 1935/2074 symbols completed. VFC took 0.5s. Estimated remaining: 57.7s. Rate: 144.6 symbols/min [2025-09-26T22:29:50.888074] [INFO ] [MAIN ] VHI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:50.887603] [INFO ] [MAIN ] VGI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:50.888220] [INFO ] [MAIN ] VGM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:50.895219] [DEBUG] [LOCAL ] VHI: Loaded 2905 existing records from primary storage. [2025-09-26T22:29:50.896996] [INFO ] [MAIN ] VHI: Loaded 2905 primary data records. [2025-09-26T22:29:50.970004] [DEBUG] [LOCAL ] VGI: Loaded 5237 existing records from primary storage. [2025-09-26T22:29:50.988524] [INFO ] [MAIN ] VGI: Loaded 5237 primary data records. [2025-09-26T22:29:51.107147] [DEBUG] [LOCAL ] VGM: Loaded 18384 existing records from primary storage. [2025-09-26T22:29:51.203537] [INFO ] [MAIN ] VGM: Loaded 18384 primary data records. [2025-09-26T22:29:51.929772] [DEBUG] [MAIN ] VHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:51.931840] [INFO ] [MAIN ] VHI: Generated 1820 derivative records from 2905 primary records. [2025-09-26T22:29:51.931944] [DEBUG] [LOCAL ] VHI: Saving derivative data. [2025-09-26T22:29:51.964546] [DEBUG] [MAIN ] VGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:51.965854] [INFO ] [MAIN ] VGI: Generated 1820 derivative records from 5237 primary records. [2025-09-26T22:29:51.966223] [DEBUG] [LOCAL ] VGI: Saving derivative data. [2025-09-26T22:29:51.984685] [DEBUG] [LOCAL ] VHI: Derivative data saved (1820 records). [2025-09-26T22:29:51.985152] [INFO ] [MAIN ] VHI: Successfully saved derivative data. [2025-09-26T22:29:51.988533] [INFO ] [MAIN ] Derivative Progress: 1936/2074 symbols completed. VHI took 1.1s. Estimated remaining: 57.3s. Rate: 144.5 symbols/min [2025-09-26T22:29:51.988917] [INFO ] [MAIN ] VICI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:52.005916] [DEBUG] [LOCAL ] VGI: Derivative data saved (1820 records). [2025-09-26T22:29:52.006828] [INFO ] [MAIN ] VGI: Successfully saved derivative data. [2025-09-26T22:29:52.006725] [DEBUG] [MAIN ] VGM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:52.009640] [INFO ] [MAIN ] Derivative Progress: 1937/2074 symbols completed. VGI took 1.1s. Estimated remaining: 56.9s. Rate: 144.6 symbols/min [2025-09-26T22:29:52.010572] [INFO ] [MAIN ] VGM: Generated 1820 derivative records from 18384 primary records. [2025-09-26T22:29:52.010820] [DEBUG] [LOCAL ] VGM: Saving derivative data. [2025-09-26T22:29:52.012135] [INFO ] [MAIN ] VIK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:52.034412] [DEBUG] [LOCAL ] VGM: Derivative data saved (1820 records). [2025-09-26T22:29:52.034743] [INFO ] [MAIN ] VGM: Successfully saved derivative data. [2025-09-26T22:29:52.037584] [INFO ] [MAIN ] Derivative Progress: 1938/2074 symbols completed. VGM took 1.1s. Estimated remaining: 56.4s. Rate: 144.6 symbols/min [2025-09-26T22:29:52.037978] [INFO ] [MAIN ] VIPS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:52.096856] [DEBUG] [LOCAL ] VICI: Loaded 54427 existing records from primary storage. [2025-09-26T22:29:52.097248] [INFO ] [MAIN ] VICI: Loaded 54427 primary data records. [2025-09-26T22:29:52.233926] [DEBUG] [LOCAL ] VIK: Loaded 53250 existing records from primary storage. [2025-09-26T22:29:52.247874] [INFO ] [MAIN ] VIK: Loaded 53250 primary data records. [2025-09-26T22:29:52.376110] [DEBUG] [LOCAL ] VIPS: Loaded 52093 existing records from primary storage. [2025-09-26T22:29:52.433468] [INFO ] [MAIN ] VIPS: Loaded 52093 primary data records. [2025-09-26T22:29:53.253205] [DEBUG] [MAIN ] VICI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:53.254910] [INFO ] [MAIN ] VICI: Generated 1820 derivative records from 54427 primary records. [2025-09-26T22:29:53.256008] [DEBUG] [LOCAL ] VICI: Saving derivative data. [2025-09-26T22:29:53.288254] [DEBUG] [MAIN ] VIK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:53.291877] [INFO ] [MAIN ] VIK: Generated 1820 derivative records from 53250 primary records. [2025-09-26T22:29:53.293291] [DEBUG] [LOCAL ] VIK: Saving derivative data. [2025-09-26T22:29:53.298152] [DEBUG] [LOCAL ] VICI: Derivative data saved (1820 records). [2025-09-26T22:29:53.311491] [INFO ] [MAIN ] VICI: Successfully saved derivative data. [2025-09-26T22:29:53.318613] [INFO ] [MAIN ] Derivative Progress: 1939/2074 symbols completed. VICI took 1.3s. Estimated remaining: 56.1s. Rate: 144.5 symbols/min [2025-09-26T22:29:53.320378] [INFO ] [MAIN ] VIRT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:53.340539] [DEBUG] [MAIN ] VIPS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:53.342560] [INFO ] [MAIN ] VIPS: Generated 1820 derivative records from 52093 primary records. [2025-09-26T22:29:53.342803] [DEBUG] [LOCAL ] VIPS: Saving derivative data. [2025-09-26T22:29:53.345923] [DEBUG] [LOCAL ] VIK: Derivative data saved (1820 records). [2025-09-26T22:29:53.353559] [INFO ] [MAIN ] VIK: Successfully saved derivative data. [2025-09-26T22:29:53.357822] [INFO ] [MAIN ] Derivative Progress: 1940/2074 symbols completed. VIK took 1.3s. Estimated remaining: 55.6s. Rate: 144.5 symbols/min [2025-09-26T22:29:53.363383] [INFO ] [MAIN ] VIST: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:53.386337] [DEBUG] [LOCAL ] VIPS: Derivative data saved (1820 records). [2025-09-26T22:29:53.386797] [INFO ] [MAIN ] VIPS: Successfully saved derivative data. [2025-09-26T22:29:53.393552] [INFO ] [MAIN ] Derivative Progress: 1941/2074 symbols completed. VIPS took 1.4s. Estimated remaining: 55.2s. Rate: 144.6 symbols/min [2025-09-26T22:29:53.393879] [INFO ] [MAIN ] VIV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:53.414984] [DEBUG] [LOCAL ] VIRT: Loaded 47448 existing records from primary storage. [2025-09-26T22:29:53.415194] [INFO ] [MAIN ] VIRT: Loaded 47448 primary data records. [2025-09-26T22:29:53.576324] [DEBUG] [LOCAL ] VIST: Loaded 46722 existing records from primary storage. [2025-09-26T22:29:53.617238] [INFO ] [MAIN ] VIST: Loaded 46722 primary data records. [2025-09-26T22:29:53.900088] [DEBUG] [LOCAL ] VIV: Loaded 45667 existing records from primary storage. [2025-09-26T22:29:53.911680] [INFO ] [MAIN ] VIV: Loaded 45667 primary data records. [2025-09-26T22:29:54.470549] [DEBUG] [MAIN ] VIRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:54.472368] [INFO ] [MAIN ] VIRT: Generated 1820 derivative records from 47448 primary records. [2025-09-26T22:29:54.472862] [DEBUG] [LOCAL ] VIRT: Saving derivative data. [2025-09-26T22:29:54.511932] [DEBUG] [LOCAL ] VIRT: Derivative data saved (1820 records). [2025-09-26T22:29:54.517852] [INFO ] [MAIN ] VIRT: Successfully saved derivative data. [2025-09-26T22:29:54.520848] [INFO ] [MAIN ] Derivative Progress: 1942/2074 symbols completed. VIRT took 1.2s. Estimated remaining: 54.8s. Rate: 144.5 symbols/min [2025-09-26T22:29:54.522043] [INFO ] [MAIN ] VKQ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:54.521259] [DEBUG] [MAIN ] VIST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:54.523626] [INFO ] [MAIN ] VIST: Generated 1820 derivative records from 46722 primary records. [2025-09-26T22:29:54.524757] [DEBUG] [LOCAL ] VIST: Saving derivative data. [2025-09-26T22:29:54.571521] [DEBUG] [MAIN ] VIV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:54.573794] [INFO ] [MAIN ] VIV: Generated 1820 derivative records from 45667 primary records. [2025-09-26T22:29:54.574520] [DEBUG] [LOCAL ] VIV: Saving derivative data. [2025-09-26T22:29:54.587271] [DEBUG] [LOCAL ] VKQ: Loaded 17552 existing records from primary storage. [2025-09-26T22:29:54.596971] [DEBUG] [LOCAL ] VIST: Derivative data saved (1820 records). [2025-09-26T22:29:54.601789] [INFO ] [MAIN ] VIST: Successfully saved derivative data. [2025-09-26T22:29:54.604278] [INFO ] [MAIN ] Derivative Progress: 1943/2074 symbols completed. VIST took 1.2s. Estimated remaining: 54.4s. Rate: 144.5 symbols/min [2025-09-26T22:29:54.605389] [INFO ] [MAIN ] VLN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:54.605229] [INFO ] [MAIN ] VKQ: Loaded 17552 primary data records. [2025-09-26T22:29:54.734388] [DEBUG] [LOCAL ] VIV: Derivative data saved (1820 records). [2025-09-26T22:29:54.755112] [INFO ] [MAIN ] VIV: Successfully saved derivative data. [2025-09-26T22:29:54.758086] [INFO ] [MAIN ] Derivative Progress: 1944/2074 symbols completed. VIV took 1.4s. Estimated remaining: 53.9s. Rate: 144.6 symbols/min [2025-09-26T22:29:54.764671] [INFO ] [MAIN ] VLO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:54.796491] [DEBUG] [LOCAL ] VLN: Loaded 29056 existing records from primary storage. [2025-09-26T22:29:54.819438] [INFO ] [MAIN ] VLN: Loaded 29056 primary data records. [2025-09-26T22:29:55.375584] [DEBUG] [LOCAL ] VLO: Loaded 53865 existing records from primary storage. [2025-09-26T22:29:55.376802] [INFO ] [MAIN ] VLO: Loaded 53865 primary data records. [2025-09-26T22:29:55.520869] [DEBUG] [MAIN ] VKQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:55.561864] [INFO ] [MAIN ] VKQ: Generated 1820 derivative records from 17552 primary records. [2025-09-26T22:29:55.562053] [DEBUG] [LOCAL ] VKQ: Saving derivative data. [2025-09-26T22:29:55.762955] [DEBUG] [MAIN ] VLN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:55.762586] [DEBUG] [LOCAL ] VKQ: Derivative data saved (1820 records). [2025-09-26T22:29:55.764713] [INFO ] [MAIN ] VLN: Generated 1820 derivative records from 29056 primary records. [2025-09-26T22:29:55.765240] [DEBUG] [LOCAL ] VLN: Saving derivative data. [2025-09-26T22:29:55.765594] [INFO ] [MAIN ] VKQ: Successfully saved derivative data. [2025-09-26T22:29:55.769956] [INFO ] [MAIN ] Derivative Progress: 1945/2074 symbols completed. VKQ took 1.2s. Estimated remaining: 53.6s. Rate: 144.5 symbols/min [2025-09-26T22:29:55.771892] [INFO ] [MAIN ] VLRS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:55.789056] [DEBUG] [LOCAL ] VLN: Derivative data saved (1820 records). [2025-09-26T22:29:55.789587] [INFO ] [MAIN ] VLN: Successfully saved derivative data. [2025-09-26T22:29:55.792333] [INFO ] [MAIN ] Derivative Progress: 1946/2074 symbols completed. VLN took 1.2s. Estimated remaining: 53.1s. Rate: 144.5 symbols/min [2025-09-26T22:29:55.793461] [INFO ] [MAIN ] VLT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:55.802601] [DEBUG] [LOCAL ] VLT: Loaded 4615 existing records from primary storage. [2025-09-26T22:29:55.802733] [INFO ] [MAIN ] VLT: Loaded 4615 primary data records. [2025-09-26T22:29:56.039071] [DEBUG] [LOCAL ] VLRS: Loaded 41188 existing records from primary storage. [2025-09-26T22:29:56.048198] [INFO ] [MAIN ] VLRS: Loaded 41188 primary data records. [2025-09-26T22:29:56.047883] [DEBUG] [MAIN ] VLO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:56.158755] [INFO ] [MAIN ] VLO: Generated 1820 derivative records from 53865 primary records. [2025-09-26T22:29:56.196829] [DEBUG] [LOCAL ] VLO: Saving derivative data. [2025-09-26T22:29:56.320398] [DEBUG] [LOCAL ] VLO: Derivative data saved (1820 records). [2025-09-26T22:29:56.325754] [INFO ] [MAIN ] VLO: Successfully saved derivative data. [2025-09-26T22:29:56.340512] [INFO ] [MAIN ] Derivative Progress: 1947/2074 symbols completed. VLO took 1.6s. Estimated remaining: 52.7s. Rate: 144.5 symbols/min [2025-09-26T22:29:56.376497] [INFO ] [MAIN ] VLTO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:56.555008] [DEBUG] [MAIN ] VLT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:56.555869] [INFO ] [MAIN ] VLT: Generated 1820 derivative records from 4615 primary records. [2025-09-26T22:29:56.556055] [DEBUG] [LOCAL ] VLT: Saving derivative data. [2025-09-26T22:29:56.572904] [DEBUG] [LOCAL ] VLT: Derivative data saved (1820 records). [2025-09-26T22:29:56.573296] [INFO ] [MAIN ] VLT: Successfully saved derivative data. [2025-09-26T22:29:56.575531] [INFO ] [MAIN ] Derivative Progress: 1948/2074 symbols completed. VLT took 0.8s. Estimated remaining: 52.3s. Rate: 144.6 symbols/min [2025-09-26T22:29:56.602802] [DEBUG] [MAIN ] VLRS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:56.603508] [INFO ] [MAIN ] VLRS: Generated 1820 derivative records from 41188 primary records. [2025-09-26T22:29:56.603573] [DEBUG] [LOCAL ] VLRS: Saving derivative data. [2025-09-26T22:29:56.619942] [DEBUG] [LOCAL ] VLRS: Derivative data saved (1820 records). [2025-09-26T22:29:56.620093] [INFO ] [MAIN ] VLRS: Successfully saved derivative data. [2025-09-26T22:29:56.635029] [INFO ] [MAIN ] Derivative Progress: 1949/2074 symbols completed. VLRS took 0.9s. Estimated remaining: 51.9s. Rate: 144.6 symbols/min [2025-09-26T22:29:56.638047] [DEBUG] [LOCAL ] VLTO: Loaded 46710 existing records from primary storage. [2025-09-26T22:29:56.638224] [INFO ] [MAIN ] VLTO: Loaded 46710 primary data records. [2025-09-26T22:29:56.973903] [DEBUG] [MAIN ] VLTO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:56.974620] [INFO ] [MAIN ] VLTO: Generated 1820 derivative records from 46710 primary records. [2025-09-26T22:29:56.974712] [DEBUG] [LOCAL ] VLTO: Saving derivative data. [2025-09-26T22:29:56.990968] [DEBUG] [LOCAL ] VLTO: Derivative data saved (1820 records). [2025-09-26T22:29:56.991050] [INFO ] [MAIN ] VLTO: Successfully saved derivative data. [2025-09-26T22:29:56.993199] [INFO ] [MAIN ] Derivative Progress: 1950/2074 symbols completed. VLTO took 0.6s. Estimated remaining: 51.4s. Rate: 144.6 symbols/min [2025-09-26T22:29:56.994293] [INFO ] [MAIN ] VMI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:56.994391] [INFO ] [MAIN ] VMC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:56.994904] [INFO ] [MAIN ] VMO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:57.017785] [DEBUG] [LOCAL ] VMI: Loaded 15711 existing records from primary storage. [2025-09-26T22:29:57.018062] [INFO ] [MAIN ] VMI: Loaded 15711 primary data records. [2025-09-26T22:29:57.105626] [DEBUG] [LOCAL ] VMO: Loaded 21297 existing records from primary storage. [2025-09-26T22:29:57.140579] [INFO ] [MAIN ] VMO: Loaded 21297 primary data records. [2025-09-26T22:29:57.461827] [DEBUG] [LOCAL ] VMC: Loaded 44263 existing records from primary storage. [2025-09-26T22:29:57.551749] [INFO ] [MAIN ] VMC: Loaded 44263 primary data records. [2025-09-26T22:29:58.111687] [DEBUG] [MAIN ] VMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:58.113517] [INFO ] [MAIN ] VMI: Generated 1820 derivative records from 15711 primary records. [2025-09-26T22:29:58.113978] [DEBUG] [LOCAL ] VMI: Saving derivative data. [2025-09-26T22:29:58.133504] [DEBUG] [LOCAL ] VMI: Derivative data saved (1820 records). [2025-09-26T22:29:58.146188] [INFO ] [MAIN ] VMI: Successfully saved derivative data. [2025-09-26T22:29:58.148505] [INFO ] [MAIN ] Derivative Progress: 1951/2074 symbols completed. VMI took 1.2s. Estimated remaining: 51.1s. Rate: 144.5 symbols/min [2025-09-26T22:29:58.148814] [DEBUG] [MAIN ] VMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:58.149142] [INFO ] [MAIN ] VNCE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:58.150602] [INFO ] [MAIN ] VMO: Generated 1820 derivative records from 21297 primary records. [2025-09-26T22:29:58.150847] [DEBUG] [LOCAL ] VMO: Saving derivative data. [2025-09-26T22:29:58.171864] [DEBUG] [LOCAL ] VMO: Derivative data saved (1820 records). [2025-09-26T22:29:58.172107] [INFO ] [MAIN ] VMO: Successfully saved derivative data. [2025-09-26T22:29:58.174892] [INFO ] [MAIN ] Derivative Progress: 1952/2074 symbols completed. VMO took 1.2s. Estimated remaining: 50.6s. Rate: 144.6 symbols/min [2025-09-26T22:29:58.175174] [INFO ] [MAIN ] VNO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:58.192225] [DEBUG] [LOCAL ] VNCE: Loaded 7593 existing records from primary storage. [2025-09-26T22:29:58.192588] [DEBUG] [MAIN ] VMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:58.192953] [INFO ] [MAIN ] VNCE: Loaded 7593 primary data records. [2025-09-26T22:29:58.193950] [INFO ] [MAIN ] VMC: Generated 1820 derivative records from 44263 primary records. [2025-09-26T22:29:58.205950] [DEBUG] [LOCAL ] VMC: Saving derivative data. [2025-09-26T22:29:58.322728] [DEBUG] [LOCAL ] VMC: Derivative data saved (1820 records). [2025-09-26T22:29:58.323265] [INFO ] [MAIN ] VMC: Successfully saved derivative data. [2025-09-26T22:29:58.347005] [INFO ] [MAIN ] Derivative Progress: 1953/2074 symbols completed. VMC took 1.4s. Estimated remaining: 50.2s. Rate: 144.6 symbols/min [2025-09-26T22:29:58.374677] [INFO ] [MAIN ] VNT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:58.565561] [DEBUG] [LOCAL ] VNO: Loaded 49668 existing records from primary storage. [2025-09-26T22:29:58.566084] [INFO ] [MAIN ] VNO: Loaded 49668 primary data records. [2025-09-26T22:29:58.771876] [DEBUG] [LOCAL ] VNT: Loaded 44451 existing records from primary storage. [2025-09-26T22:29:58.800510] [INFO ] [MAIN ] VNT: Loaded 44451 primary data records. [2025-09-26T22:29:58.800438] [DEBUG] [MAIN ] VNCE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:58.927346] [INFO ] [MAIN ] VNCE: Generated 1820 derivative records from 7593 primary records. [2025-09-26T22:29:58.932889] [DEBUG] [LOCAL ] VNCE: Saving derivative data. [2025-09-26T22:29:59.030517] [DEBUG] [LOCAL ] VNCE: Derivative data saved (1820 records). [2025-09-26T22:29:59.057281] [INFO ] [MAIN ] VNCE: Successfully saved derivative data. [2025-09-26T22:29:59.071632] [INFO ] [MAIN ] Derivative Progress: 1954/2074 symbols completed. VNCE took 0.9s. Estimated remaining: 49.8s. Rate: 144.6 symbols/min [2025-09-26T22:29:59.083174] [INFO ] [MAIN ] VOC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:59.330342] [DEBUG] [LOCAL ] VOC: Loaded 9021 existing records from primary storage. [2025-09-26T22:29:59.330549] [INFO ] [MAIN ] VOC: Loaded 9021 primary data records. [2025-09-26T22:29:59.463967] [DEBUG] [MAIN ] VNO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:59.492371] [INFO ] [MAIN ] VNO: Generated 1820 derivative records from 49668 primary records. [2025-09-26T22:29:59.550707] [DEBUG] [LOCAL ] VNO: Saving derivative data. [2025-09-26T22:29:59.696883] [DEBUG] [LOCAL ] VNO: Derivative data saved (1820 records). [2025-09-26T22:29:59.698709] [INFO ] [MAIN ] VNO: Successfully saved derivative data. [2025-09-26T22:29:59.701537] [INFO ] [MAIN ] Derivative Progress: 1955/2074 symbols completed. VNO took 1.5s. Estimated remaining: 49.4s. Rate: 144.5 symbols/min [2025-09-26T22:29:59.702587] [INFO ] [MAIN ] VOYA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:59.731613] [DEBUG] [MAIN ] VNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:59.733062] [INFO ] [MAIN ] VNT: Generated 1820 derivative records from 44451 primary records. [2025-09-26T22:29:59.733399] [DEBUG] [LOCAL ] VNT: Saving derivative data. [2025-09-26T22:29:59.783767] [DEBUG] [MAIN ] VOC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:29:59.785584] [INFO ] [MAIN ] VOC: Generated 1820 derivative records from 9021 primary records. [2025-09-26T22:29:59.785728] [DEBUG] [LOCAL ] VOC: Saving derivative data. [2025-09-26T22:29:59.784529] [DEBUG] [LOCAL ] VNT: Derivative data saved (1820 records). [2025-09-26T22:29:59.786906] [INFO ] [MAIN ] VNT: Successfully saved derivative data. [2025-09-26T22:29:59.789579] [INFO ] [MAIN ] Derivative Progress: 1956/2074 symbols completed. VNT took 1.4s. Estimated remaining: 49.0s. Rate: 144.6 symbols/min [2025-09-26T22:29:59.798427] [INFO ] [MAIN ] VPG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:59.809085] [DEBUG] [LOCAL ] VOC: Derivative data saved (1820 records). [2025-09-26T22:29:59.821753] [INFO ] [MAIN ] VOC: Successfully saved derivative data. [2025-09-26T22:29:59.824845] [INFO ] [MAIN ] Derivative Progress: 1957/2074 symbols completed. VOC took 0.8s. Estimated remaining: 48.5s. Rate: 144.6 symbols/min [2025-09-26T22:29:59.825912] [DEBUG] [LOCAL ] VOYA: Loaded 43377 existing records from primary storage. [2025-09-26T22:29:59.826328] [INFO ] [MAIN ] VPV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:29:59.826477] [INFO ] [MAIN ] VOYA: Loaded 43377 primary data records. [2025-09-26T22:29:59.927876] [DEBUG] [LOCAL ] VPV: Loaded 5429 existing records from primary storage. [2025-09-26T22:29:59.933193] [DEBUG] [LOCAL ] VPG: Loaded 17373 existing records from primary storage. [2025-09-26T22:29:59.938736] [INFO ] [MAIN ] VPG: Loaded 17373 primary data records. [2025-09-26T22:29:59.946189] [INFO ] [MAIN ] VPV: Loaded 5429 primary data records. [2025-09-26T22:30:00.888152] [DEBUG] [MAIN ] VOYA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:00.889236] [INFO ] [MAIN ] VOYA: Generated 1820 derivative records from 43377 primary records. [2025-09-26T22:30:00.890506] [DEBUG] [LOCAL ] VOYA: Saving derivative data. [2025-09-26T22:30:00.923053] [DEBUG] [MAIN ] VPG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:00.937103] [INFO ] [MAIN ] VPG: Generated 1820 derivative records from 17373 primary records. [2025-09-26T22:30:00.937805] [DEBUG] [LOCAL ] VPG: Saving derivative data. [2025-09-26T22:30:00.940105] [DEBUG] [MAIN ] VPV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:00.949938] [INFO ] [MAIN ] VPV: Generated 1820 derivative records from 5429 primary records. [2025-09-26T22:30:00.952275] [DEBUG] [LOCAL ] VPV: Saving derivative data. [2025-09-26T22:30:00.960345] [DEBUG] [LOCAL ] VOYA: Derivative data saved (1820 records). [2025-09-26T22:30:00.970268] [DEBUG] [LOCAL ] VPG: Derivative data saved (1820 records). [2025-09-26T22:30:00.971613] [INFO ] [MAIN ] VOYA: Successfully saved derivative data. [2025-09-26T22:30:00.970474] [INFO ] [MAIN ] VPG: Successfully saved derivative data. [2025-09-26T22:30:00.974064] [INFO ] [MAIN ] Derivative Progress: 1958/2074 symbols completed. VOYA took 1.3s. Estimated remaining: 48.2s. Rate: 144.5 symbols/min [2025-09-26T22:30:00.977159] [INFO ] [MAIN ] VRE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:00.982475] [INFO ] [MAIN ] Derivative Progress: 1959/2074 symbols completed. VPG took 1.2s. Estimated remaining: 47.7s. Rate: 144.6 symbols/min [2025-09-26T22:30:00.984015] [DEBUG] [LOCAL ] VPV: Derivative data saved (1820 records). [2025-09-26T22:30:00.984824] [INFO ] [MAIN ] VRT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:00.984751] [INFO ] [MAIN ] VPV: Successfully saved derivative data. [2025-09-26T22:30:00.987853] [INFO ] [MAIN ] Derivative Progress: 1960/2074 symbols completed. VPV took 1.2s. Estimated remaining: 47.3s. Rate: 144.7 symbols/min [2025-09-26T22:30:00.988466] [INFO ] [MAIN ] VRTS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:01.000321] [DEBUG] [LOCAL ] VRTS: Loaded 9287 existing records from primary storage. [2025-09-26T22:30:01.000526] [INFO ] [MAIN ] VRTS: Loaded 9287 primary data records. [2025-09-26T22:30:01.364221] [DEBUG] [LOCAL ] VRE: Loaded 35345 existing records from primary storage. [2025-09-26T22:30:01.379021] [INFO ] [MAIN ] VRE: Loaded 35345 primary data records. [2025-09-26T22:30:01.413754] [DEBUG] [LOCAL ] VRT: Loaded 54533 existing records from primary storage. [2025-09-26T22:30:01.440591] [INFO ] [MAIN ] VRT: Loaded 54533 primary data records. [2025-09-26T22:30:02.219330] [DEBUG] [MAIN ] VRTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:02.220747] [INFO ] [MAIN ] VRTS: Generated 1820 derivative records from 9287 primary records. [2025-09-26T22:30:02.221437] [DEBUG] [LOCAL ] VRTS: Saving derivative data. [2025-09-26T22:30:02.242347] [DEBUG] [LOCAL ] VRTS: Derivative data saved (1820 records). [2025-09-26T22:30:02.243389] [INFO ] [MAIN ] VRTS: Successfully saved derivative data. [2025-09-26T22:30:02.247012] [INFO ] [MAIN ] Derivative Progress: 1961/2074 symbols completed. VRTS took 1.3s. Estimated remaining: 46.9s. Rate: 144.5 symbols/min [2025-09-26T22:30:02.247585] [INFO ] [MAIN ] VSCO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:02.275967] [DEBUG] [MAIN ] VRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:02.277209] [INFO ] [MAIN ] VRE: Generated 1820 derivative records from 35345 primary records. [2025-09-26T22:30:02.277951] [DEBUG] [LOCAL ] VRE: Saving derivative data. [2025-09-26T22:30:02.309327] [DEBUG] [LOCAL ] VRE: Derivative data saved (1820 records). [2025-09-26T22:30:02.311102] [INFO ] [MAIN ] VRE: Successfully saved derivative data. [2025-09-26T22:30:02.314040] [INFO ] [MAIN ] Derivative Progress: 1962/2074 symbols completed. VRE took 1.3s. Estimated remaining: 46.5s. Rate: 144.6 symbols/min [2025-09-26T22:30:02.314807] [INFO ] [MAIN ] VSH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:02.337254] [DEBUG] [MAIN ] VRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:02.338521] [INFO ] [MAIN ] VRT: Generated 1820 derivative records from 54533 primary records. [2025-09-26T22:30:02.338635] [DEBUG] [LOCAL ] VRT: Saving derivative data. [2025-09-26T22:30:02.390314] [DEBUG] [LOCAL ] VRT: Derivative data saved (1820 records). [2025-09-26T22:30:02.390795] [INFO ] [MAIN ] VRT: Successfully saved derivative data. [2025-09-26T22:30:02.394500] [INFO ] [MAIN ] Derivative Progress: 1963/2074 symbols completed. VRT took 1.4s. Estimated remaining: 46.0s. Rate: 144.6 symbols/min [2025-09-26T22:30:02.435012] [DEBUG] [LOCAL ] VSCO: Loaded 53556 existing records from primary storage. [2025-09-26T22:30:02.435333] [INFO ] [MAIN ] VSCO: Loaded 53556 primary data records. [2025-09-26T22:30:02.580751] [DEBUG] [LOCAL ] VSH: Loaded 49188 existing records from primary storage. [2025-09-26T22:30:02.615897] [INFO ] [MAIN ] VSH: Loaded 49188 primary data records. [2025-09-26T22:30:03.314220] [DEBUG] [MAIN ] VSCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:03.315517] [INFO ] [MAIN ] VSCO: Generated 1820 derivative records from 53556 primary records. [2025-09-26T22:30:03.315833] [DEBUG] [LOCAL ] VSCO: Saving derivative data. [2025-09-26T22:30:03.352855] [DEBUG] [MAIN ] VSH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:03.354796] [DEBUG] [LOCAL ] VSCO: Derivative data saved (1820 records). [2025-09-26T22:30:03.355846] [INFO ] [MAIN ] VSH: Generated 1820 derivative records from 49188 primary records. [2025-09-26T22:30:03.355938] [INFO ] [MAIN ] VSCO: Successfully saved derivative data. [2025-09-26T22:30:03.358173] [INFO ] [MAIN ] Derivative Progress: 1964/2074 symbols completed. VSCO took 1.1s. Estimated remaining: 45.7s. Rate: 144.5 symbols/min [2025-09-26T22:30:03.358325] [DEBUG] [LOCAL ] VSH: Saving derivative data. [2025-09-26T22:30:03.376144] [DEBUG] [LOCAL ] VSH: Derivative data saved (1820 records). [2025-09-26T22:30:03.376242] [INFO ] [MAIN ] VSH: Successfully saved derivative data. [2025-09-26T22:30:03.379021] [INFO ] [MAIN ] Derivative Progress: 1965/2074 symbols completed. VSH took 1.1s. Estimated remaining: 45.2s. Rate: 144.6 symbols/min [2025-09-26T22:30:03.379783] [INFO ] [MAIN ] VSTS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:03.380426] [INFO ] [MAIN ] VTEX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:03.380327] [INFO ] [MAIN ] VST: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:03.449153] [DEBUG] [LOCAL ] VTEX: Loaded 43948 existing records from primary storage. [2025-09-26T22:30:03.449451] [INFO ] [MAIN ] VTEX: Loaded 43948 primary data records. [2025-09-26T22:30:03.539557] [DEBUG] [LOCAL ] VSTS: Loaded 49773 existing records from primary storage. [2025-09-26T22:30:03.595730] [INFO ] [MAIN ] VSTS: Loaded 49773 primary data records. [2025-09-26T22:30:03.608772] [DEBUG] [LOCAL ] VST: Loaded 54498 existing records from primary storage. [2025-09-26T22:30:03.624381] [INFO ] [MAIN ] VST: Loaded 54498 primary data records. [2025-09-26T22:30:04.547602] [DEBUG] [MAIN ] VTEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:04.548622] [INFO ] [MAIN ] VTEX: Generated 1820 derivative records from 43948 primary records. [2025-09-26T22:30:04.549164] [DEBUG] [LOCAL ] VTEX: Saving derivative data. [2025-09-26T22:30:04.595132] [DEBUG] [MAIN ] VSTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:04.601116] [DEBUG] [LOCAL ] VTEX: Derivative data saved (1820 records). [2025-09-26T22:30:04.602133] [INFO ] [MAIN ] VSTS: Generated 1820 derivative records from 49773 primary records. [2025-09-26T22:30:04.602450] [DEBUG] [LOCAL ] VSTS: Saving derivative data. [2025-09-26T22:30:04.602524] [INFO ] [MAIN ] VTEX: Successfully saved derivative data. [2025-09-26T22:30:04.605586] [INFO ] [MAIN ] Derivative Progress: 1966/2074 symbols completed. VTEX took 1.2s. Estimated remaining: 44.9s. Rate: 144.5 symbols/min [2025-09-26T22:30:04.606716] [INFO ] [MAIN ] VTLE: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:04.605981] [DEBUG] [MAIN ] VST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:04.615885] [INFO ] [MAIN ] VST: Generated 1820 derivative records from 54498 primary records. [2025-09-26T22:30:04.624861] [DEBUG] [LOCAL ] VST: Saving derivative data. [2025-09-26T22:30:04.625157] [DEBUG] [LOCAL ] VSTS: Derivative data saved (1820 records). [2025-09-26T22:30:04.626746] [INFO ] [MAIN ] VSTS: Successfully saved derivative data. [2025-09-26T22:30:04.629971] [INFO ] [MAIN ] Derivative Progress: 1967/2074 symbols completed. VSTS took 1.3s. Estimated remaining: 44.4s. Rate: 144.5 symbols/min [2025-09-26T22:30:04.643571] [INFO ] [MAIN ] VTMX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:04.653814] [DEBUG] [LOCAL ] VST: Derivative data saved (1820 records). [2025-09-26T22:30:04.654149] [INFO ] [MAIN ] VST: Successfully saved derivative data. [2025-09-26T22:30:04.657343] [INFO ] [MAIN ] Derivative Progress: 1968/2074 symbols completed. VST took 1.3s. Estimated remaining: 44.0s. Rate: 144.6 symbols/min [2025-09-26T22:30:04.658110] [INFO ] [MAIN ] VTN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:04.676707] [DEBUG] [LOCAL ] VTN: Loaded 7293 existing records from primary storage. [2025-09-26T22:30:04.677265] [INFO ] [MAIN ] VTN: Loaded 7293 primary data records. [2025-09-26T22:30:04.760091] [DEBUG] [LOCAL ] VTMX: Loaded 17811 existing records from primary storage. [2025-09-26T22:30:04.798054] [INFO ] [MAIN ] VTMX: Loaded 17811 primary data records. [2025-09-26T22:30:04.995459] [DEBUG] [LOCAL ] VTLE: Loaded 49337 existing records from primary storage. [2025-09-26T22:30:05.078698] [INFO ] [MAIN ] VTLE: Loaded 49337 primary data records. [2025-09-26T22:30:05.795412] [DEBUG] [MAIN ] VTN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:05.797154] [INFO ] [MAIN ] VTN: Generated 1820 derivative records from 7293 primary records. [2025-09-26T22:30:05.797474] [DEBUG] [LOCAL ] VTN: Saving derivative data. [2025-09-26T22:30:05.819921] [DEBUG] [LOCAL ] VTN: Derivative data saved (1820 records). [2025-09-26T22:30:05.833175] [INFO ] [MAIN ] VTN: Successfully saved derivative data. [2025-09-26T22:30:05.836555] [INFO ] [MAIN ] Derivative Progress: 1969/2074 symbols completed. VTN took 1.2s. Estimated remaining: 43.6s. Rate: 144.5 symbols/min [2025-09-26T22:30:05.833855] [DEBUG] [MAIN ] VTMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:05.837331] [INFO ] [MAIN ] VTOL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:05.838488] [INFO ] [MAIN ] VTMX: Generated 1820 derivative records from 17811 primary records. [2025-09-26T22:30:05.839411] [DEBUG] [LOCAL ] VTMX: Saving derivative data. [2025-09-26T22:30:05.858526] [DEBUG] [LOCAL ] VTMX: Derivative data saved (1820 records). [2025-09-26T22:30:05.859008] [INFO ] [MAIN ] VTMX: Successfully saved derivative data. [2025-09-26T22:30:05.861693] [INFO ] [MAIN ] Derivative Progress: 1970/2074 symbols completed. VTMX took 1.2s. Estimated remaining: 43.2s. Rate: 144.5 symbols/min [2025-09-26T22:30:05.862532] [INFO ] [MAIN ] VTR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:05.880452] [DEBUG] [LOCAL ] VTOL: Loaded 19915 existing records from primary storage. [2025-09-26T22:30:05.880886] [INFO ] [MAIN ] VTOL: Loaded 19915 primary data records. [2025-09-26T22:30:05.954182] [DEBUG] [MAIN ] VTLE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:05.971112] [INFO ] [MAIN ] VTLE: Generated 1820 derivative records from 49337 primary records. [2025-09-26T22:30:05.990745] [DEBUG] [LOCAL ] VTLE: Saving derivative data. [2025-09-26T22:30:06.091057] [DEBUG] [LOCAL ] VTLE: Derivative data saved (1820 records). [2025-09-26T22:30:06.122750] [INFO ] [MAIN ] VTLE: Successfully saved derivative data. [2025-09-26T22:30:06.125981] [INFO ] [MAIN ] Derivative Progress: 1971/2074 symbols completed. VTLE took 1.5s. Estimated remaining: 42.8s. Rate: 144.6 symbols/min [2025-09-26T22:30:06.291678] [INFO ] [MAIN ] VTS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:06.309064] [DEBUG] [LOCAL ] VTR: Loaded 53620 existing records from primary storage. [2025-09-26T22:30:06.309267] [INFO ] [MAIN ] VTR: Loaded 53620 primary data records. [2025-09-26T22:30:06.664023] [DEBUG] [LOCAL ] VTS: Loaded 30992 existing records from primary storage. [2025-09-26T22:30:06.664204] [INFO ] [MAIN ] VTS: Loaded 30992 primary data records. [2025-09-26T22:30:06.886846] [DEBUG] [MAIN ] VTOL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:07.013309] [INFO ] [MAIN ] VTOL: Generated 1820 derivative records from 19915 primary records. [2025-09-26T22:30:07.014960] [DEBUG] [LOCAL ] VTOL: Saving derivative data. [2025-09-26T22:30:07.034393] [DEBUG] [LOCAL ] VTOL: Derivative data saved (1820 records). [2025-09-26T22:30:07.036667] [INFO ] [MAIN ] VTOL: Successfully saved derivative data. [2025-09-26T22:30:07.040552] [INFO ] [MAIN ] Derivative Progress: 1972/2074 symbols completed. VTOL took 1.2s. Estimated remaining: 42.4s. Rate: 144.5 symbols/min [2025-09-26T22:30:07.042017] [INFO ] [MAIN ] VVR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:07.063634] [DEBUG] [MAIN ] VTR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:07.064545] [INFO ] [MAIN ] VTR: Generated 1820 derivative records from 53620 primary records. [2025-09-26T22:30:07.064848] [DEBUG] [LOCAL ] VTR: Saving derivative data. [2025-09-26T22:30:07.096754] [DEBUG] [LOCAL ] VTR: Derivative data saved (1820 records). [2025-09-26T22:30:07.097095] [INFO ] [MAIN ] VTR: Successfully saved derivative data. [2025-09-26T22:30:07.113472] [INFO ] [MAIN ] Derivative Progress: 1973/2074 symbols completed. VTR took 1.3s. Estimated remaining: 41.9s. Rate: 144.5 symbols/min [2025-09-26T22:30:07.110912] [DEBUG] [MAIN ] VTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:07.114153] [INFO ] [MAIN ] VVV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:07.129617] [INFO ] [MAIN ] VTS: Generated 1820 derivative records from 30992 primary records. [2025-09-26T22:30:07.129949] [DEBUG] [LOCAL ] VTS: Saving derivative data. [2025-09-26T22:30:07.132229] [DEBUG] [LOCAL ] VVR: Loaded 31251 existing records from primary storage. [2025-09-26T22:30:07.132785] [INFO ] [MAIN ] VVR: Loaded 31251 primary data records. [2025-09-26T22:30:07.306999] [DEBUG] [LOCAL ] VTS: Derivative data saved (1820 records). [2025-09-26T22:30:07.312298] [INFO ] [MAIN ] VTS: Successfully saved derivative data. [2025-09-26T22:30:07.320361] [INFO ] [MAIN ] Derivative Progress: 1974/2074 symbols completed. VTS took 1.0s. Estimated remaining: 41.5s. Rate: 144.6 symbols/min [2025-09-26T22:30:07.359255] [INFO ] [MAIN ] VVX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:07.529089] [DEBUG] [LOCAL ] VVV: Loaded 50933 existing records from primary storage. [2025-09-26T22:30:07.529993] [INFO ] [MAIN ] VVV: Loaded 50933 primary data records. [2025-09-26T22:30:07.675315] [DEBUG] [LOCAL ] VVX: Loaded 23664 existing records from primary storage. [2025-09-26T22:30:07.687142] [INFO ] [MAIN ] VVX: Loaded 23664 primary data records. [2025-09-26T22:30:08.266995] [DEBUG] [MAIN ] VVR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:08.282287] [INFO ] [MAIN ] VVR: Generated 1820 derivative records from 31251 primary records. [2025-09-26T22:30:08.283182] [DEBUG] [LOCAL ] VVR: Saving derivative data. [2025-09-26T22:30:08.323312] [DEBUG] [MAIN ] VVV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:08.324178] [INFO ] [MAIN ] VVV: Generated 1820 derivative records from 50933 primary records. [2025-09-26T22:30:08.322997] [DEBUG] [LOCAL ] VVR: Derivative data saved (1820 records). [2025-09-26T22:30:08.324418] [DEBUG] [LOCAL ] VVV: Saving derivative data. [2025-09-26T22:30:08.325680] [INFO ] [MAIN ] VVR: Successfully saved derivative data. [2025-09-26T22:30:08.327983] [INFO ] [MAIN ] Derivative Progress: 1975/2074 symbols completed. VVR took 1.3s. Estimated remaining: 41.1s. Rate: 144.5 symbols/min [2025-09-26T22:30:08.341218] [INFO ] [MAIN ] VYX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:08.350151] [DEBUG] [LOCAL ] VVV: Derivative data saved (1820 records). [2025-09-26T22:30:08.350426] [INFO ] [MAIN ] VVV: Successfully saved derivative data. [2025-09-26T22:30:08.353090] [INFO ] [MAIN ] Derivative Progress: 1976/2074 symbols completed. VVV took 1.2s. Estimated remaining: 40.7s. Rate: 144.5 symbols/min [2025-09-26T22:30:08.353539] [INFO ] [MAIN ] VZ: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:08.367087] [DEBUG] [MAIN ] VVX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:08.367847] [INFO ] [MAIN ] VVX: Generated 1820 derivative records from 23664 primary records. [2025-09-26T22:30:08.367979] [DEBUG] [LOCAL ] VVX: Saving derivative data. [2025-09-26T22:30:08.385353] [DEBUG] [LOCAL ] VVX: Derivative data saved (1820 records). [2025-09-26T22:30:08.397108] [INFO ] [MAIN ] VVX: Successfully saved derivative data. [2025-09-26T22:30:08.400042] [INFO ] [MAIN ] Derivative Progress: 1977/2074 symbols completed. VVX took 1.0s. Estimated remaining: 40.3s. Rate: 144.6 symbols/min [2025-09-26T22:30:08.400708] [INFO ] [MAIN ] W: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:08.423274] [DEBUG] [LOCAL ] VYX: Loaded 49624 existing records from primary storage. [2025-09-26T22:30:08.423585] [INFO ] [MAIN ] VYX: Loaded 49624 primary data records. [2025-09-26T22:30:08.618060] [DEBUG] [LOCAL ] VZ: Loaded 54571 existing records from primary storage. [2025-09-26T22:30:08.638532] [INFO ] [MAIN ] VZ: Loaded 54571 primary data records. [2025-09-26T22:30:08.868019] [DEBUG] [LOCAL ] W: Loaded 54266 existing records from primary storage. [2025-09-26T22:30:08.913313] [INFO ] [MAIN ] W: Loaded 54266 primary data records. [2025-09-26T22:30:09.550378] [DEBUG] [MAIN ] VYX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:09.551599] [INFO ] [MAIN ] VYX: Generated 1820 derivative records from 49624 primary records. [2025-09-26T22:30:09.552282] [DEBUG] [LOCAL ] VYX: Saving derivative data. [2025-09-26T22:30:09.579150] [DEBUG] [LOCAL ] VYX: Derivative data saved (1820 records). [2025-09-26T22:30:09.579386] [INFO ] [MAIN ] VYX: Successfully saved derivative data. [2025-09-26T22:30:09.581679] [INFO ] [MAIN ] Derivative Progress: 1978/2074 symbols completed. VYX took 1.2s. Estimated remaining: 39.9s. Rate: 144.5 symbols/min [2025-09-26T22:30:09.595620] [DEBUG] [MAIN ] VZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:09.600209] [INFO ] [MAIN ] VZ: Generated 1820 derivative records from 54571 primary records. [2025-09-26T22:30:09.600798] [DEBUG] [LOCAL ] VZ: Saving derivative data. [2025-09-26T22:30:09.635035] [DEBUG] [MAIN ] W: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:09.636398] [INFO ] [MAIN ] W: Generated 1820 derivative records from 54266 primary records. [2025-09-26T22:30:09.636916] [DEBUG] [LOCAL ] W: Saving derivative data. [2025-09-26T22:30:09.636981] [DEBUG] [LOCAL ] VZ: Derivative data saved (1820 records). [2025-09-26T22:30:09.637814] [INFO ] [MAIN ] VZ: Successfully saved derivative data. [2025-09-26T22:30:09.640151] [INFO ] [MAIN ] Derivative Progress: 1979/2074 symbols completed. VZ took 1.3s. Estimated remaining: 39.4s. Rate: 144.5 symbols/min [2025-09-26T22:30:09.656531] [DEBUG] [LOCAL ] W: Derivative data saved (1820 records). [2025-09-26T22:30:09.656661] [INFO ] [MAIN ] W: Successfully saved derivative data. [2025-09-26T22:30:09.660908] [INFO ] [MAIN ] Derivative Progress: 1980/2074 symbols completed. W took 1.3s. Estimated remaining: 39.0s. Rate: 144.6 symbols/min [2025-09-26T22:30:09.661557] [INFO ] [MAIN ] WAB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:09.662303] [INFO ] [MAIN ] WAT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:09.661859] [INFO ] [MAIN ] WAL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:09.736060] [DEBUG] [LOCAL ] WAB: Loaded 44872 existing records from primary storage. [2025-09-26T22:30:09.747340] [INFO ] [MAIN ] WAB: Loaded 44872 primary data records. [2025-09-26T22:30:09.748108] [DEBUG] [LOCAL ] WAT: Loaded 35620 existing records from primary storage. [2025-09-26T22:30:09.753434] [INFO ] [MAIN ] WAT: Loaded 35620 primary data records. [2025-09-26T22:30:09.944054] [DEBUG] [LOCAL ] WAL: Loaded 46040 existing records from primary storage. [2025-09-26T22:30:10.000349] [INFO ] [MAIN ] WAL: Loaded 46040 primary data records. [2025-09-26T22:30:10.883065] [DEBUG] [MAIN ] WAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:10.884854] [INFO ] [MAIN ] WAT: Generated 1820 derivative records from 35620 primary records. [2025-09-26T22:30:10.885074] [DEBUG] [LOCAL ] WAT: Saving derivative data. [2025-09-26T22:30:10.883748] [DEBUG] [MAIN ] WAB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:10.889258] [INFO ] [MAIN ] WAB: Generated 1820 derivative records from 44872 primary records. [2025-09-26T22:30:10.897851] [DEBUG] [LOCAL ] WAB: Saving derivative data. [2025-09-26T22:30:10.917356] [DEBUG] [LOCAL ] WAT: Derivative data saved (1820 records). [2025-09-26T22:30:10.930496] [INFO ] [MAIN ] WAT: Successfully saved derivative data. [2025-09-26T22:30:10.936080] [DEBUG] [MAIN ] WAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:10.939857] [DEBUG] [LOCAL ] WAB: Derivative data saved (1820 records). [2025-09-26T22:30:10.943110] [INFO ] [MAIN ] WAL: Generated 1820 derivative records from 46040 primary records. [2025-09-26T22:30:10.943304] [DEBUG] [LOCAL ] WAL: Saving derivative data. [2025-09-26T22:30:10.942136] [INFO ] [MAIN ] Derivative Progress: 1981/2074 symbols completed. WAT took 1.3s. Estimated remaining: 38.6s. Rate: 144.4 symbols/min [2025-09-26T22:30:10.943391] [INFO ] [MAIN ] WAB: Successfully saved derivative data. [2025-09-26T22:30:10.947323] [INFO ] [MAIN ] Derivative Progress: 1982/2074 symbols completed. WAB took 1.3s. Estimated remaining: 38.2s. Rate: 144.5 symbols/min [2025-09-26T22:30:10.947973] [INFO ] [MAIN ] WBS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:10.960305] [INFO ] [MAIN ] WBX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:10.971181] [DEBUG] [LOCAL ] WAL: Derivative data saved (1820 records). [2025-09-26T22:30:10.971371] [INFO ] [MAIN ] WAL: Successfully saved derivative data. [2025-09-26T22:30:10.974400] [INFO ] [MAIN ] Derivative Progress: 1983/2074 symbols completed. WAL took 1.3s. Estimated remaining: 37.8s. Rate: 144.6 symbols/min [2025-09-26T22:30:10.975073] [INFO ] [MAIN ] WCC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:10.982912] [DEBUG] [LOCAL ] WBX: Loaded 12558 existing records from primary storage. [2025-09-26T22:30:10.983049] [INFO ] [MAIN ] WBX: Loaded 12558 primary data records. [2025-09-26T22:30:11.352918] [DEBUG] [LOCAL ] WBS: Loaded 49471 existing records from primary storage. [2025-09-26T22:30:11.363441] [INFO ] [MAIN ] WBS: Loaded 49471 primary data records. [2025-09-26T22:30:11.384422] [DEBUG] [LOCAL ] WCC: Loaded 40567 existing records from primary storage. [2025-09-26T22:30:11.390914] [INFO ] [MAIN ] WCC: Loaded 40567 primary data records. [2025-09-26T22:30:12.057006] [DEBUG] [MAIN ] WBX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:12.058972] [INFO ] [MAIN ] WBX: Generated 1820 derivative records from 12558 primary records. [2025-09-26T22:30:12.059083] [DEBUG] [LOCAL ] WBX: Saving derivative data. [2025-09-26T22:30:12.077897] [DEBUG] [LOCAL ] WBX: Derivative data saved (1820 records). [2025-09-26T22:30:12.078162] [INFO ] [MAIN ] WBX: Successfully saved derivative data. [2025-09-26T22:30:12.080637] [INFO ] [MAIN ] Derivative Progress: 1984/2074 symbols completed. WBX took 1.1s. Estimated remaining: 37.4s. Rate: 144.5 symbols/min [2025-09-26T22:30:12.081216] [INFO ] [MAIN ] WCN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:12.100957] [DEBUG] [MAIN ] WBS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:12.102080] [INFO ] [MAIN ] WBS: Generated 1820 derivative records from 49471 primary records. [2025-09-26T22:30:12.102319] [DEBUG] [LOCAL ] WBS: Saving derivative data. [2025-09-26T22:30:12.138246] [DEBUG] [MAIN ] WCC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:12.140303] [INFO ] [MAIN ] WCC: Generated 1820 derivative records from 40567 primary records. [2025-09-26T22:30:12.144908] [DEBUG] [LOCAL ] WCC: Saving derivative data. [2025-09-26T22:30:12.144805] [DEBUG] [LOCAL ] WBS: Derivative data saved (1820 records). [2025-09-26T22:30:12.146212] [INFO ] [MAIN ] WBS: Successfully saved derivative data. [2025-09-26T22:30:12.149258] [INFO ] [MAIN ] Derivative Progress: 1985/2074 symbols completed. WBS took 1.2s. Estimated remaining: 37.0s. Rate: 144.5 symbols/min [2025-09-26T22:30:12.166022] [INFO ] [MAIN ] WD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:12.171405] [DEBUG] [LOCAL ] WCC: Derivative data saved (1820 records). [2025-09-26T22:30:12.171784] [INFO ] [MAIN ] WCC: Successfully saved derivative data. [2025-09-26T22:30:12.175093] [INFO ] [MAIN ] Derivative Progress: 1986/2074 symbols completed. WCC took 1.2s. Estimated remaining: 36.5s. Rate: 144.6 symbols/min [2025-09-26T22:30:12.175792] [INFO ] [MAIN ] WDH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:12.215024] [DEBUG] [LOCAL ] WDH: Loaded 17597 existing records from primary storage. [2025-09-26T22:30:12.215197] [INFO ] [MAIN ] WDH: Loaded 17597 primary data records. [2025-09-26T22:30:12.255208] [DEBUG] [LOCAL ] WD: Loaded 23747 existing records from primary storage. [2025-09-26T22:30:12.282183] [INFO ] [MAIN ] WD: Loaded 23747 primary data records. [2025-09-26T22:30:12.342463] [DEBUG] [LOCAL ] WCN: Loaded 48708 existing records from primary storage. [2025-09-26T22:30:12.382883] [INFO ] [MAIN ] WCN: Loaded 48708 primary data records. [2025-09-26T22:30:13.381003] [DEBUG] [MAIN ] WD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:13.381796] [DEBUG] [MAIN ] WDH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:13.383078] [INFO ] [MAIN ] WD: Generated 1820 derivative records from 23747 primary records. [2025-09-26T22:30:13.383333] [DEBUG] [LOCAL ] WD: Saving derivative data. [2025-09-26T22:30:13.384979] [INFO ] [MAIN ] WDH: Generated 1820 derivative records from 17597 primary records. [2025-09-26T22:30:13.385103] [DEBUG] [LOCAL ] WDH: Saving derivative data. [2025-09-26T22:30:13.404200] [DEBUG] [LOCAL ] WD: Derivative data saved (1820 records). [2025-09-26T22:30:13.431166] [INFO ] [MAIN ] WD: Successfully saved derivative data. [2025-09-26T22:30:13.431620] [DEBUG] [MAIN ] WCN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:13.434926] [INFO ] [MAIN ] Derivative Progress: 1987/2074 symbols completed. WD took 1.3s. Estimated remaining: 36.1s. Rate: 144.4 symbols/min [2025-09-26T22:30:13.436136] [INFO ] [MAIN ] WCN: Generated 1820 derivative records from 48708 primary records. [2025-09-26T22:30:13.437236] [DEBUG] [LOCAL ] WCN: Saving derivative data. [2025-09-26T22:30:13.438600] [INFO ] [MAIN ] WDI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:13.439304] [DEBUG] [LOCAL ] WDH: Derivative data saved (1820 records). [2025-09-26T22:30:13.439614] [INFO ] [MAIN ] WDH: Successfully saved derivative data. [2025-09-26T22:30:13.453881] [INFO ] [MAIN ] Derivative Progress: 1988/2074 symbols completed. WDH took 1.3s. Estimated remaining: 35.7s. Rate: 144.5 symbols/min [2025-09-26T22:30:13.455893] [INFO ] [MAIN ] WDS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:13.459366] [DEBUG] [LOCAL ] WCN: Derivative data saved (1820 records). [2025-09-26T22:30:13.459919] [INFO ] [MAIN ] WCN: Successfully saved derivative data. [2025-09-26T22:30:13.463066] [INFO ] [MAIN ] Derivative Progress: 1989/2074 symbols completed. WCN took 1.4s. Estimated remaining: 35.3s. Rate: 144.6 symbols/min [2025-09-26T22:30:13.463545] [INFO ] [MAIN ] WEA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:13.480559] [DEBUG] [LOCAL ] WEA: Loaded 7379 existing records from primary storage. [2025-09-26T22:30:13.480778] [INFO ] [MAIN ] WEA: Loaded 7379 primary data records. [2025-09-26T22:30:13.608927] [DEBUG] [LOCAL ] WDI: Loaded 21314 existing records from primary storage. [2025-09-26T22:30:13.618953] [INFO ] [MAIN ] WDI: Loaded 21314 primary data records. [2025-09-26T22:30:13.984569] [DEBUG] [LOCAL ] WDS: Loaded 44259 existing records from primary storage. [2025-09-26T22:30:13.996497] [INFO ] [MAIN ] WDS: Loaded 44259 primary data records. [2025-09-26T22:30:14.574292] [DEBUG] [MAIN ] WEA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:14.576491] [INFO ] [MAIN ] WEA: Generated 1820 derivative records from 7379 primary records. [2025-09-26T22:30:14.577379] [DEBUG] [LOCAL ] WEA: Saving derivative data. [2025-09-26T22:30:14.597981] [DEBUG] [LOCAL ] WEA: Derivative data saved (1820 records). [2025-09-26T22:30:14.598560] [INFO ] [MAIN ] WEA: Successfully saved derivative data. [2025-09-26T22:30:14.600941] [INFO ] [MAIN ] Derivative Progress: 1990/2074 symbols completed. WEA took 1.1s. Estimated remaining: 34.9s. Rate: 144.5 symbols/min [2025-09-26T22:30:14.601627] [INFO ] [MAIN ] WEAV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:14.615939] [DEBUG] [MAIN ] WDI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:14.617442] [INFO ] [MAIN ] WDI: Generated 1820 derivative records from 21314 primary records. [2025-09-26T22:30:14.617588] [DEBUG] [LOCAL ] WDI: Saving derivative data. [2025-09-26T22:30:14.637859] [DEBUG] [LOCAL ] WDI: Derivative data saved (1820 records). [2025-09-26T22:30:14.639545] [INFO ] [MAIN ] WDI: Successfully saved derivative data. [2025-09-26T22:30:14.642422] [INFO ] [MAIN ] Derivative Progress: 1991/2074 symbols completed. WDI took 1.2s. Estimated remaining: 34.5s. Rate: 144.5 symbols/min [2025-09-26T22:30:14.643261] [INFO ] [MAIN ] WEC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:14.657903] [DEBUG] [MAIN ] WDS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:14.658637] [INFO ] [MAIN ] WDS: Generated 1820 derivative records from 44259 primary records. [2025-09-26T22:30:14.658743] [DEBUG] [LOCAL ] WDS: Saving derivative data. [2025-09-26T22:30:14.676110] [DEBUG] [LOCAL ] WDS: Derivative data saved (1820 records). [2025-09-26T22:30:14.676507] [INFO ] [MAIN ] WDS: Successfully saved derivative data. [2025-09-26T22:30:14.679574] [INFO ] [MAIN ] Derivative Progress: 1992/2074 symbols completed. WDS took 1.2s. Estimated remaining: 34.0s. Rate: 144.6 symbols/min [2025-09-26T22:30:14.689749] [INFO ] [MAIN ] WELL: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:14.708754] [DEBUG] [LOCAL ] WEAV: Loaded 42562 existing records from primary storage. [2025-09-26T22:30:14.708999] [INFO ] [MAIN ] WEAV: Loaded 42562 primary data records. [2025-09-26T22:30:14.961443] [DEBUG] [LOCAL ] WEC: Loaded 52958 existing records from primary storage. [2025-09-26T22:30:15.120733] [INFO ] [MAIN ] WEC: Loaded 52958 primary data records. [2025-09-26T22:30:15.201837] [DEBUG] [LOCAL ] WELL: Loaded 53132 existing records from primary storage. [2025-09-26T22:30:15.254099] [INFO ] [MAIN ] WELL: Loaded 53132 primary data records. [2025-09-26T22:30:15.828771] [DEBUG] [MAIN ] WEAV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:15.829693] [INFO ] [MAIN ] WEAV: Generated 1820 derivative records from 42562 primary records. [2025-09-26T22:30:15.830338] [DEBUG] [LOCAL ] WEAV: Saving derivative data. [2025-09-26T22:30:15.849758] [DEBUG] [LOCAL ] WEAV: Derivative data saved (1820 records). [2025-09-26T22:30:15.850047] [INFO ] [MAIN ] WEAV: Successfully saved derivative data. [2025-09-26T22:30:15.852590] [INFO ] [MAIN ] Derivative Progress: 1993/2074 symbols completed. WEAV took 1.3s. Estimated remaining: 33.6s. Rate: 144.5 symbols/min [2025-09-26T22:30:15.871468] [DEBUG] [MAIN ] WEC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:15.872448] [INFO ] [MAIN ] WEC: Generated 1820 derivative records from 52958 primary records. [2025-09-26T22:30:15.872829] [DEBUG] [LOCAL ] WEC: Saving derivative data. [2025-09-26T22:30:15.905075] [DEBUG] [MAIN ] WELL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:15.906333] [INFO ] [MAIN ] WELL: Generated 1820 derivative records from 53132 primary records. [2025-09-26T22:30:15.906682] [DEBUG] [LOCAL ] WELL: Saving derivative data. [2025-09-26T22:30:15.908181] [DEBUG] [LOCAL ] WEC: Derivative data saved (1820 records). [2025-09-26T22:30:15.908679] [INFO ] [MAIN ] WEC: Successfully saved derivative data. [2025-09-26T22:30:15.911073] [INFO ] [MAIN ] Derivative Progress: 1994/2074 symbols completed. WEC took 1.3s. Estimated remaining: 33.2s. Rate: 144.5 symbols/min [2025-09-26T22:30:15.927803] [DEBUG] [LOCAL ] WELL: Derivative data saved (1820 records). [2025-09-26T22:30:15.927879] [INFO ] [MAIN ] WELL: Successfully saved derivative data. [2025-09-26T22:30:15.930861] [INFO ] [MAIN ] Derivative Progress: 1995/2074 symbols completed. WELL took 1.2s. Estimated remaining: 32.8s. Rate: 144.6 symbols/min [2025-09-26T22:30:15.931346] [INFO ] [MAIN ] WES: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:15.931859] [INFO ] [MAIN ] WF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:15.931702] [INFO ] [MAIN ] WEX: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:15.945498] [DEBUG] [LOCAL ] WF: Loaded 10903 existing records from primary storage. [2025-09-26T22:30:15.945673] [INFO ] [MAIN ] WF: Loaded 10903 primary data records. [2025-09-26T22:30:16.195939] [DEBUG] [LOCAL ] WEX: Loaded 35697 existing records from primary storage. [2025-09-26T22:30:16.324490] [INFO ] [MAIN ] WEX: Loaded 35697 primary data records. [2025-09-26T22:30:16.323494] [DEBUG] [LOCAL ] WES: Loaded 48689 existing records from primary storage. [2025-09-26T22:30:16.325104] [INFO ] [MAIN ] WES: Loaded 48689 primary data records. [2025-09-26T22:30:17.106970] [DEBUG] [MAIN ] WF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:17.108173] [INFO ] [MAIN ] WF: Generated 1820 derivative records from 10903 primary records. [2025-09-26T22:30:17.109201] [DEBUG] [LOCAL ] WF: Saving derivative data. [2025-09-26T22:30:17.134343] [DEBUG] [LOCAL ] WF: Derivative data saved (1820 records). [2025-09-26T22:30:17.135076] [INFO ] [MAIN ] WF: Successfully saved derivative data. [2025-09-26T22:30:17.137626] [INFO ] [MAIN ] Derivative Progress: 1996/2074 symbols completed. WF took 1.2s. Estimated remaining: 32.4s. Rate: 144.4 symbols/min [2025-09-26T22:30:17.138255] [INFO ] [MAIN ] WFC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:17.152232] [DEBUG] [MAIN ] WEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:17.153251] [INFO ] [MAIN ] WEX: Generated 1820 derivative records from 35697 primary records. [2025-09-26T22:30:17.153767] [DEBUG] [LOCAL ] WEX: Saving derivative data. [2025-09-26T22:30:17.172749] [DEBUG] [LOCAL ] WEX: Derivative data saved (1820 records). [2025-09-26T22:30:17.174526] [INFO ] [MAIN ] WEX: Successfully saved derivative data. [2025-09-26T22:30:17.177230] [INFO ] [MAIN ] Derivative Progress: 1997/2074 symbols completed. WEX took 1.2s. Estimated remaining: 32.0s. Rate: 144.5 symbols/min [2025-09-26T22:30:17.177749] [INFO ] [MAIN ] WFG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:17.193390] [DEBUG] [MAIN ] WES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:17.194232] [INFO ] [MAIN ] WES: Generated 1820 derivative records from 48689 primary records. [2025-09-26T22:30:17.194370] [DEBUG] [LOCAL ] WES: Saving derivative data. [2025-09-26T22:30:17.232280] [DEBUG] [LOCAL ] WES: Derivative data saved (1820 records). [2025-09-26T22:30:17.232530] [INFO ] [MAIN ] WES: Successfully saved derivative data. [2025-09-26T22:30:17.235492] [INFO ] [MAIN ] Derivative Progress: 1998/2074 symbols completed. WES took 1.3s. Estimated remaining: 31.5s. Rate: 144.6 symbols/min [2025-09-26T22:30:17.236567] [INFO ] [MAIN ] WGO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:17.246073] [DEBUG] [LOCAL ] WFG: Loaded 25211 existing records from primary storage. [2025-09-26T22:30:17.246435] [INFO ] [MAIN ] WFG: Loaded 25211 primary data records. [2025-09-26T22:30:17.378712] [DEBUG] [LOCAL ] WFC: Loaded 54528 existing records from primary storage. [2025-09-26T22:30:17.395701] [INFO ] [MAIN ] WFC: Loaded 54528 primary data records. [2025-09-26T22:30:17.748010] [DEBUG] [LOCAL ] WGO: Loaded 39823 existing records from primary storage. [2025-09-26T22:30:17.778386] [INFO ] [MAIN ] WGO: Loaded 39823 primary data records. [2025-09-26T22:30:18.293719] [DEBUG] [MAIN ] WFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:18.295691] [INFO ] [MAIN ] WFG: Generated 1820 derivative records from 25211 primary records. [2025-09-26T22:30:18.296148] [DEBUG] [LOCAL ] WFG: Saving derivative data. [2025-09-26T22:30:18.323180] [DEBUG] [LOCAL ] WFG: Derivative data saved (1820 records). [2025-09-26T22:30:18.323763] [INFO ] [MAIN ] WFG: Successfully saved derivative data. [2025-09-26T22:30:18.335412] [INFO ] [MAIN ] Derivative Progress: 1999/2074 symbols completed. WFG took 1.2s. Estimated remaining: 31.2s. Rate: 144.5 symbols/min [2025-09-26T22:30:18.341276] [INFO ] [MAIN ] WH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:18.341698] [DEBUG] [MAIN ] WFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:18.343269] [INFO ] [MAIN ] WFC: Generated 1820 derivative records from 54528 primary records. [2025-09-26T22:30:18.343587] [DEBUG] [LOCAL ] WFC: Saving derivative data. [2025-09-26T22:30:18.366619] [DEBUG] [LOCAL ] WFC: Derivative data saved (1820 records). [2025-09-26T22:30:18.368544] [INFO ] [MAIN ] WFC: Successfully saved derivative data. [2025-09-26T22:30:18.371810] [INFO ] [MAIN ] Derivative Progress: 2000/2074 symbols completed. WFC took 1.2s. Estimated remaining: 30.7s. Rate: 144.5 symbols/min [2025-09-26T22:30:18.372410] [INFO ] [MAIN ] WHD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:18.388252] [DEBUG] [MAIN ] WGO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:18.389112] [INFO ] [MAIN ] WGO: Generated 1820 derivative records from 39823 primary records. [2025-09-26T22:30:18.389608] [DEBUG] [LOCAL ] WGO: Saving derivative data. [2025-09-26T22:30:18.417427] [DEBUG] [LOCAL ] WGO: Derivative data saved (1820 records). [2025-09-26T22:30:18.417583] [INFO ] [MAIN ] WGO: Successfully saved derivative data. [2025-09-26T22:30:18.420734] [INFO ] [MAIN ] Derivative Progress: 2001/2074 symbols completed. WGO took 1.2s. Estimated remaining: 30.3s. Rate: 144.6 symbols/min [2025-09-26T22:30:18.421349] [INFO ] [MAIN ] WHG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:18.437109] [DEBUG] [LOCAL ] WH: Loaded 46339 existing records from primary storage. [2025-09-26T22:30:18.438291] [INFO ] [MAIN ] WH: Loaded 46339 primary data records. [2025-09-26T22:30:18.473912] [DEBUG] [LOCAL ] WHG: Loaded 3416 existing records from primary storage. [2025-09-26T22:30:18.500442] [INFO ] [MAIN ] WHG: Loaded 3416 primary data records. [2025-09-26T22:30:18.709412] [DEBUG] [LOCAL ] WHD: Loaded 41130 existing records from primary storage. [2025-09-26T22:30:18.725604] [INFO ] [MAIN ] WHD: Loaded 41130 primary data records. [2025-09-26T22:30:19.557361] [DEBUG] [MAIN ] WHG: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:30:19.559126] [INFO ] [MAIN ] WHG: Generated 1819 derivative records from 3416 primary records. [2025-09-26T22:30:19.564462] [DEBUG] [LOCAL ] WHG: Saving derivative data. [2025-09-26T22:30:19.566964] [DEBUG] [MAIN ] WH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:19.577139] [INFO ] [MAIN ] WH: Generated 1820 derivative records from 46339 primary records. [2025-09-26T22:30:19.582582] [DEBUG] [LOCAL ] WH: Saving derivative data. [2025-09-26T22:30:19.606349] [DEBUG] [LOCAL ] WH: Derivative data saved (1820 records). [2025-09-26T22:30:19.607121] [INFO ] [MAIN ] WH: Successfully saved derivative data. [2025-09-26T22:30:19.610364] [INFO ] [MAIN ] Derivative Progress: 2002/2074 symbols completed. WH took 1.3s. Estimated remaining: 29.9s. Rate: 144.4 symbols/min [2025-09-26T22:30:19.611568] [DEBUG] [LOCAL ] WHG: Derivative data saved (1819 records). [2025-09-26T22:30:19.611892] [INFO ] [MAIN ] WHR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:19.611830] [INFO ] [MAIN ] WHG: Successfully saved derivative data. [2025-09-26T22:30:19.627504] [INFO ] [MAIN ] Derivative Progress: 2003/2074 symbols completed. WHG took 1.2s. Estimated remaining: 29.5s. Rate: 144.5 symbols/min [2025-09-26T22:30:19.628418] [DEBUG] [MAIN ] WHD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:19.628859] [INFO ] [MAIN ] WIA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:19.630039] [INFO ] [MAIN ] WHD: Generated 1820 derivative records from 41130 primary records. [2025-09-26T22:30:19.630226] [DEBUG] [LOCAL ] WHD: Saving derivative data. [2025-09-26T22:30:19.649544] [DEBUG] [LOCAL ] WIA: Loaded 4937 existing records from primary storage. [2025-09-26T22:30:19.650168] [INFO ] [MAIN ] WIA: Loaded 4937 primary data records. [2025-09-26T22:30:19.718298] [DEBUG] [LOCAL ] WHD: Derivative data saved (1820 records). [2025-09-26T22:30:19.748723] [INFO ] [MAIN ] WHD: Successfully saved derivative data. [2025-09-26T22:30:19.774336] [INFO ] [MAIN ] Derivative Progress: 2004/2074 symbols completed. WHD took 1.4s. Estimated remaining: 29.1s. Rate: 144.6 symbols/min [2025-09-26T22:30:19.788223] [INFO ] [MAIN ] WINN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:19.919500] [DEBUG] [LOCAL ] WHR: Loaded 48846 existing records from primary storage. [2025-09-26T22:30:20.047763] [DEBUG] [LOCAL ] WINN: Loaded 11944 existing records from primary storage. [2025-09-26T22:30:20.047938] [INFO ] [MAIN ] WHR: Loaded 48846 primary data records. [2025-09-26T22:30:20.065907] [INFO ] [MAIN ] WINN: Loaded 11944 primary data records. [2025-09-26T22:30:20.765172] [DEBUG] [MAIN ] WIA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:20.767173] [INFO ] [MAIN ] WIA: Generated 1820 derivative records from 4937 primary records. [2025-09-26T22:30:20.767401] [DEBUG] [LOCAL ] WIA: Saving derivative data. [2025-09-26T22:30:20.785752] [DEBUG] [LOCAL ] WIA: Derivative data saved (1820 records). [2025-09-26T22:30:20.786319] [INFO ] [MAIN ] WIA: Successfully saved derivative data. [2025-09-26T22:30:20.788543] [INFO ] [MAIN ] Derivative Progress: 2005/2074 symbols completed. WIA took 1.2s. Estimated remaining: 28.7s. Rate: 144.5 symbols/min [2025-09-26T22:30:20.789418] [INFO ] [MAIN ] WIT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:20.808843] [DEBUG] [MAIN ] WINN: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:30:20.811757] [INFO ] [MAIN ] WINN: Generated 1819 derivative records from 11944 primary records. [2025-09-26T22:30:20.812516] [DEBUG] [LOCAL ] WINN: Saving derivative data. [2025-09-26T22:30:20.839238] [DEBUG] [MAIN ] WHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:20.840756] [INFO ] [MAIN ] WHR: Generated 1820 derivative records from 48846 primary records. [2025-09-26T22:30:20.840921] [DEBUG] [LOCAL ] WHR: Saving derivative data. [2025-09-26T22:30:20.860048] [DEBUG] [LOCAL ] WINN: Derivative data saved (1819 records). [2025-09-26T22:30:20.860790] [INFO ] [MAIN ] WINN: Successfully saved derivative data. [2025-09-26T22:30:20.863593] [INFO ] [MAIN ] Derivative Progress: 2006/2074 symbols completed. WINN took 1.1s. Estimated remaining: 28.2s. Rate: 144.5 symbols/min [2025-09-26T22:30:20.864747] [INFO ] [MAIN ] WIW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:20.881033] [DEBUG] [LOCAL ] WHR: Derivative data saved (1820 records). [2025-09-26T22:30:20.881262] [INFO ] [MAIN ] WHR: Successfully saved derivative data. [2025-09-26T22:30:20.884431] [INFO ] [MAIN ] Derivative Progress: 2007/2074 symbols completed. WHR took 1.3s. Estimated remaining: 27.8s. Rate: 144.6 symbols/min [2025-09-26T22:30:20.884983] [INFO ] [MAIN ] WK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:20.911864] [DEBUG] [LOCAL ] WIT: Loaded 53070 existing records from primary storage. [2025-09-26T22:30:20.912049] [INFO ] [MAIN ] WIT: Loaded 53070 primary data records. [2025-09-26T22:30:20.956688] [DEBUG] [LOCAL ] WIW: Loaded 20756 existing records from primary storage. [2025-09-26T22:30:21.014464] [INFO ] [MAIN ] WIW: Loaded 20756 primary data records. [2025-09-26T22:30:21.246317] [DEBUG] [LOCAL ] WK: Loaded 37342 existing records from primary storage. [2025-09-26T22:30:21.281494] [INFO ] [MAIN ] WK: Loaded 37342 primary data records. [2025-09-26T22:30:22.075958] [DEBUG] [MAIN ] WIT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:22.079468] [INFO ] [MAIN ] WIT: Generated 1820 derivative records from 53070 primary records. [2025-09-26T22:30:22.079621] [DEBUG] [LOCAL ] WIT: Saving derivative data. [2025-09-26T22:30:22.114336] [DEBUG] [MAIN ] WIW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:22.113938] [DEBUG] [LOCAL ] WIT: Derivative data saved (1820 records). [2025-09-26T22:30:22.115142] [INFO ] [MAIN ] WIT: Successfully saved derivative data. [2025-09-26T22:30:22.118677] [INFO ] [MAIN ] Derivative Progress: 2008/2074 symbols completed. WIT took 1.3s. Estimated remaining: 27.4s. Rate: 144.4 symbols/min [2025-09-26T22:30:22.116072] [INFO ] [MAIN ] WIW: Generated 1820 derivative records from 20756 primary records. [2025-09-26T22:30:22.119131] [DEBUG] [LOCAL ] WIW: Saving derivative data. [2025-09-26T22:30:22.148177] [DEBUG] [MAIN ] WK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:22.149461] [INFO ] [MAIN ] WK: Generated 1820 derivative records from 37342 primary records. [2025-09-26T22:30:22.149830] [DEBUG] [LOCAL ] WK: Saving derivative data. [2025-09-26T22:30:22.167845] [DEBUG] [LOCAL ] WIW: Derivative data saved (1820 records). [2025-09-26T22:30:22.168432] [INFO ] [MAIN ] WIW: Successfully saved derivative data. [2025-09-26T22:30:22.168513] [DEBUG] [LOCAL ] WK: Derivative data saved (1820 records). [2025-09-26T22:30:22.171309] [INFO ] [MAIN ] Derivative Progress: 2009/2074 symbols completed. WIW took 1.3s. Estimated remaining: 27.0s. Rate: 144.5 symbols/min [2025-09-26T22:30:22.168598] [INFO ] [MAIN ] WK: Successfully saved derivative data. [2025-09-26T22:30:22.174697] [INFO ] [MAIN ] Derivative Progress: 2010/2074 symbols completed. WK took 1.3s. Estimated remaining: 26.6s. Rate: 144.6 symbols/min [2025-09-26T22:30:22.175319] [INFO ] [MAIN ] WKC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:22.175502] [INFO ] [MAIN ] WLKP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:22.176353] [INFO ] [MAIN ] WLK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:22.185796] [DEBUG] [LOCAL ] WLKP: Loaded 6800 existing records from primary storage. [2025-09-26T22:30:22.185966] [INFO ] [MAIN ] WLKP: Loaded 6800 primary data records. [2025-09-26T22:30:22.544213] [DEBUG] [LOCAL ] WKC: Loaded 35538 existing records from primary storage. [2025-09-26T22:30:22.557450] [INFO ] [MAIN ] WKC: Loaded 35538 primary data records. [2025-09-26T22:30:22.558260] [DEBUG] [LOCAL ] WLK: Loaded 46113 existing records from primary storage. [2025-09-26T22:30:22.564436] [INFO ] [MAIN ] WLK: Loaded 46113 primary data records. [2025-09-26T22:30:23.291396] [DEBUG] [MAIN ] WLKP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:23.293107] [INFO ] [MAIN ] WLKP: Generated 1820 derivative records from 6800 primary records. [2025-09-26T22:30:23.293273] [DEBUG] [LOCAL ] WLKP: Saving derivative data. [2025-09-26T22:30:23.317072] [DEBUG] [LOCAL ] WLKP: Derivative data saved (1820 records). [2025-09-26T22:30:23.317266] [INFO ] [MAIN ] WLKP: Successfully saved derivative data. [2025-09-26T22:30:23.320161] [INFO ] [MAIN ] Derivative Progress: 2011/2074 symbols completed. WLKP took 1.1s. Estimated remaining: 26.2s. Rate: 144.5 symbols/min [2025-09-26T22:30:23.323552] [INFO ] [MAIN ] WLY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:23.340931] [DEBUG] [MAIN ] WLK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:23.349941] [INFO ] [MAIN ] WLK: Generated 1820 derivative records from 46113 primary records. [2025-09-26T22:30:23.350104] [DEBUG] [LOCAL ] WLK: Saving derivative data. [2025-09-26T22:30:23.356376] [DEBUG] [MAIN ] WKC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:23.365195] [INFO ] [MAIN ] WKC: Generated 1820 derivative records from 35538 primary records. [2025-09-26T22:30:23.369435] [DEBUG] [LOCAL ] WKC: Saving derivative data. [2025-09-26T22:30:23.374914] [DEBUG] [LOCAL ] WLK: Derivative data saved (1820 records). [2025-09-26T22:30:23.375612] [INFO ] [MAIN ] WLK: Successfully saved derivative data. [2025-09-26T22:30:23.379088] [INFO ] [MAIN ] Derivative Progress: 2012/2074 symbols completed. WLK took 1.2s. Estimated remaining: 25.7s. Rate: 144.5 symbols/min [2025-09-26T22:30:23.379699] [INFO ] [MAIN ] WM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:23.415377] [DEBUG] [LOCAL ] WLY: Loaded 30414 existing records from primary storage. [2025-09-26T22:30:23.416603] [INFO ] [MAIN ] WLY: Loaded 30414 primary data records. [2025-09-26T22:30:23.417231] [DEBUG] [LOCAL ] WKC: Derivative data saved (1820 records). [2025-09-26T22:30:23.450528] [INFO ] [MAIN ] WKC: Successfully saved derivative data. [2025-09-26T22:30:23.479920] [INFO ] [MAIN ] Derivative Progress: 2013/2074 symbols completed. WKC took 1.3s. Estimated remaining: 25.3s. Rate: 144.6 symbols/min [2025-09-26T22:30:23.508361] [INFO ] [MAIN ] WMB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:23.820477] [DEBUG] [LOCAL ] WM: Loaded 51697 existing records from primary storage. [2025-09-26T22:30:23.820955] [INFO ] [MAIN ] WM: Loaded 51697 primary data records. [2025-09-26T22:30:24.075591] [DEBUG] [LOCAL ] WMB: Loaded 54451 existing records from primary storage. [2025-09-26T22:30:24.205276] [INFO ] [MAIN ] WMB: Loaded 54451 primary data records. [2025-09-26T22:30:24.341015] [DEBUG] [MAIN ] WLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:24.342171] [INFO ] [MAIN ] WLY: Generated 1820 derivative records from 30414 primary records. [2025-09-26T22:30:24.342274] [DEBUG] [LOCAL ] WLY: Saving derivative data. [2025-09-26T22:30:24.583665] [DEBUG] [LOCAL ] WLY: Derivative data saved (1820 records). [2025-09-26T22:30:24.584849] [INFO ] [MAIN ] WLY: Successfully saved derivative data. [2025-09-26T22:30:24.587718] [INFO ] [MAIN ] Derivative Progress: 2014/2074 symbols completed. WLY took 1.3s. Estimated remaining: 24.9s. Rate: 144.4 symbols/min [2025-09-26T22:30:24.589391] [INFO ] [MAIN ] WMK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:24.606908] [DEBUG] [MAIN ] WM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:24.607854] [INFO ] [MAIN ] WM: Generated 1820 derivative records from 51697 primary records. [2025-09-26T22:30:24.608043] [DEBUG] [LOCAL ] WM: Saving derivative data. [2025-09-26T22:30:24.635001] [DEBUG] [LOCAL ] WMK: Loaded 14753 existing records from primary storage. [2025-09-26T22:30:24.635759] [INFO ] [MAIN ] WMK: Loaded 14753 primary data records. [2025-09-26T22:30:24.660401] [DEBUG] [LOCAL ] WM: Derivative data saved (1820 records). [2025-09-26T22:30:24.660574] [INFO ] [MAIN ] WM: Successfully saved derivative data. [2025-09-26T22:30:24.693215] [INFO ] [MAIN ] Derivative Progress: 2015/2074 symbols completed. WM took 1.3s. Estimated remaining: 24.5s. Rate: 144.5 symbols/min [2025-09-26T22:30:24.729187] [INFO ] [MAIN ] WMS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:24.819284] [DEBUG] [MAIN ] WMB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:24.862378] [INFO ] [MAIN ] WMB: Generated 1820 derivative records from 54451 primary records. [2025-09-26T22:30:24.923797] [DEBUG] [LOCAL ] WMB: Saving derivative data. [2025-09-26T22:30:25.005771] [DEBUG] [LOCAL ] WMB: Derivative data saved (1820 records). [2025-09-26T22:30:25.007186] [INFO ] [MAIN ] WMB: Successfully saved derivative data. [2025-09-26T22:30:25.010511] [INFO ] [MAIN ] Derivative Progress: 2016/2074 symbols completed. WMB took 1.5s. Estimated remaining: 24.1s. Rate: 144.5 symbols/min [2025-09-26T22:30:25.020854] [INFO ] [MAIN ] WMT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:25.052341] [DEBUG] [LOCAL ] WMS: Loaded 40249 existing records from primary storage. [2025-09-26T22:30:25.057934] [INFO ] [MAIN ] WMS: Loaded 40249 primary data records. [2025-09-26T22:30:25.057855] [DEBUG] [MAIN ] WMK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:25.058863] [INFO ] [MAIN ] WMK: Generated 1820 derivative records from 14753 primary records. [2025-09-26T22:30:25.058998] [DEBUG] [LOCAL ] WMK: Saving derivative data. [2025-09-26T22:30:25.269413] [DEBUG] [LOCAL ] WMK: Derivative data saved (1820 records). [2025-09-26T22:30:25.308862] [INFO ] [MAIN ] WMK: Successfully saved derivative data. [2025-09-26T22:30:25.423906] [DEBUG] [LOCAL ] WMT: Loaded 54580 existing records from primary storage. [2025-09-26T22:30:25.426756] [INFO ] [MAIN ] Derivative Progress: 2017/2074 symbols completed. WMK took 0.8s. Estimated remaining: 23.7s. Rate: 144.5 symbols/min [2025-09-26T22:30:25.436474] [INFO ] [MAIN ] WMT: Loaded 54580 primary data records. [2025-09-26T22:30:25.443000] [INFO ] [MAIN ] WNC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:25.846999] [DEBUG] [LOCAL ] WNC: Loaded 40452 existing records from primary storage. [2025-09-26T22:30:25.847531] [INFO ] [MAIN ] WNC: Loaded 40452 primary data records. [2025-09-26T22:30:25.965013] [DEBUG] [MAIN ] WMS: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-26T22:30:25.988361] [INFO ] [MAIN ] WMS: Generated 1819 derivative records from 40249 primary records. [2025-09-26T22:30:25.999307] [DEBUG] [LOCAL ] WMS: Saving derivative data. [2025-09-26T22:30:26.248752] [DEBUG] [LOCAL ] WMS: Derivative data saved (1819 records). [2025-09-26T22:30:26.249343] [INFO ] [MAIN ] WMS: Successfully saved derivative data. [2025-09-26T22:30:26.249129] [DEBUG] [MAIN ] WMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:26.250294] [INFO ] [MAIN ] WMT: Generated 1820 derivative records from 54580 primary records. [2025-09-26T22:30:26.253031] [INFO ] [MAIN ] Derivative Progress: 2018/2074 symbols completed. WMS took 1.5s. Estimated remaining: 23.3s. Rate: 144.4 symbols/min [2025-09-26T22:30:26.254634] [INFO ] [MAIN ] WNS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:26.253600] [DEBUG] [LOCAL ] WMT: Saving derivative data. [2025-09-26T22:30:26.273455] [DEBUG] [LOCAL ] WMT: Derivative data saved (1820 records). [2025-09-26T22:30:26.273668] [INFO ] [MAIN ] WMT: Successfully saved derivative data. [2025-09-26T22:30:26.276323] [INFO ] [MAIN ] Derivative Progress: 2019/2074 symbols completed. WMT took 1.3s. Estimated remaining: 22.8s. Rate: 144.5 symbols/min [2025-09-26T22:30:26.277419] [INFO ] [MAIN ] WOLF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:26.299311] [DEBUG] [MAIN ] WNC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:26.300556] [INFO ] [MAIN ] WNC: Generated 1820 derivative records from 40452 primary records. [2025-09-26T22:30:26.300705] [DEBUG] [LOCAL ] WNC: Saving derivative data. [2025-09-26T22:30:26.329665] [DEBUG] [LOCAL ] WNC: Derivative data saved (1820 records). [2025-09-26T22:30:26.341775] [INFO ] [MAIN ] WNC: Successfully saved derivative data. [2025-09-26T22:30:26.346427] [INFO ] [MAIN ] Derivative Progress: 2020/2074 symbols completed. WNC took 0.9s. Estimated remaining: 22.4s. Rate: 144.6 symbols/min [2025-09-26T22:30:26.347038] [INFO ] [MAIN ] WOR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:26.348248] [DEBUG] [LOCAL ] WNS: Loaded 40539 existing records from primary storage. [2025-09-26T22:30:26.363905] [INFO ] [MAIN ] WNS: Loaded 40539 primary data records. [2025-09-26T22:30:26.534494] [DEBUG] [LOCAL ] WOLF: Loaded 54312 existing records from primary storage. [2025-09-26T22:30:26.579088] [INFO ] [MAIN ] WOLF: Loaded 54312 primary data records. [2025-09-26T22:30:26.578980] [DEBUG] [LOCAL ] WOR: Loaded 25288 existing records from primary storage. [2025-09-26T22:30:26.608085] [INFO ] [MAIN ] WOR: Loaded 25288 primary data records. [2025-09-26T22:30:27.414476] [DEBUG] [MAIN ] WNS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:27.415474] [INFO ] [MAIN ] WNS: Generated 1820 derivative records from 40539 primary records. [2025-09-26T22:30:27.415786] [DEBUG] [LOCAL ] WNS: Saving derivative data. [2025-09-26T22:30:27.443425] [DEBUG] [LOCAL ] WNS: Derivative data saved (1820 records). [2025-09-26T22:30:27.443598] [INFO ] [MAIN ] WNS: Successfully saved derivative data. [2025-09-26T22:30:27.446225] [INFO ] [MAIN ] Derivative Progress: 2021/2074 symbols completed. WNS took 1.2s. Estimated remaining: 22.0s. Rate: 144.5 symbols/min [2025-09-26T22:30:27.446797] [INFO ] [MAIN ] WOW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:27.462428] [DEBUG] [MAIN ] WOLF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:27.463531] [INFO ] [MAIN ] WOLF: Generated 1820 derivative records from 54312 primary records. [2025-09-26T22:30:27.463952] [DEBUG] [LOCAL ] WOLF: Saving derivative data. [2025-09-26T22:30:27.484413] [DEBUG] [LOCAL ] WOLF: Derivative data saved (1820 records). [2025-09-26T22:30:27.485708] [INFO ] [MAIN ] WOLF: Successfully saved derivative data. [2025-09-26T22:30:27.488617] [INFO ] [MAIN ] Derivative Progress: 2022/2074 symbols completed. WOLF took 1.2s. Estimated remaining: 21.6s. Rate: 144.5 symbols/min [2025-09-26T22:30:27.489567] [INFO ] [MAIN ] WPC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:27.503948] [DEBUG] [MAIN ] WOR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:27.505096] [INFO ] [MAIN ] WOR: Generated 1820 derivative records from 25288 primary records. [2025-09-26T22:30:27.505349] [DEBUG] [LOCAL ] WOR: Saving derivative data. [2025-09-26T22:30:27.543454] [DEBUG] [LOCAL ] WOW: Loaded 30769 existing records from primary storage. [2025-09-26T22:30:27.544369] [INFO ] [MAIN ] WOW: Loaded 30769 primary data records. [2025-09-26T22:30:27.609775] [DEBUG] [LOCAL ] WOR: Derivative data saved (1820 records). [2025-09-26T22:30:27.628482] [INFO ] [MAIN ] WOR: Successfully saved derivative data. [2025-09-26T22:30:27.636964] [INFO ] [MAIN ] Derivative Progress: 2023/2074 symbols completed. WOR took 1.3s. Estimated remaining: 21.2s. Rate: 144.6 symbols/min [2025-09-26T22:30:27.793717] [DEBUG] [LOCAL ] WPC: Loaded 49217 existing records from primary storage. [2025-09-26T22:30:27.919079] [INFO ] [MAIN ] WPC: Loaded 49217 primary data records. [2025-09-26T22:30:28.318247] [DEBUG] [MAIN ] WOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:28.319705] [INFO ] [MAIN ] WOW: Generated 1820 derivative records from 30769 primary records. [2025-09-26T22:30:28.320098] [DEBUG] [LOCAL ] WOW: Saving derivative data. [2025-09-26T22:30:28.340514] [DEBUG] [LOCAL ] WOW: Derivative data saved (1820 records). [2025-09-26T22:30:28.340805] [INFO ] [MAIN ] WOW: Successfully saved derivative data. [2025-09-26T22:30:28.343312] [INFO ] [MAIN ] Derivative Progress: 2024/2074 symbols completed. WOW took 0.9s. Estimated remaining: 20.8s. Rate: 144.5 symbols/min [2025-09-26T22:30:28.360954] [DEBUG] [MAIN ] WPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:28.361608] [INFO ] [MAIN ] WPC: Generated 1820 derivative records from 49217 primary records. [2025-09-26T22:30:28.361693] [DEBUG] [LOCAL ] WPC: Saving derivative data. [2025-09-26T22:30:28.377446] [DEBUG] [LOCAL ] WPC: Derivative data saved (1820 records). [2025-09-26T22:30:28.377571] [INFO ] [MAIN ] WPC: Successfully saved derivative data. [2025-09-26T22:30:28.380393] [INFO ] [MAIN ] Derivative Progress: 2025/2074 symbols completed. WPC took 0.9s. Estimated remaining: 20.3s. Rate: 144.6 symbols/min [2025-09-26T22:30:28.381424] [INFO ] [MAIN ] WPM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:28.381549] [INFO ] [MAIN ] WRB: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:28.381259] [INFO ] [MAIN ] WPP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:28.433101] [DEBUG] [LOCAL ] WPP: Loaded 34282 existing records from primary storage. [2025-09-26T22:30:28.433558] [INFO ] [MAIN ] WPP: Loaded 34282 primary data records. [2025-09-26T22:30:28.606051] [DEBUG] [LOCAL ] WRB: Loaded 51313 existing records from primary storage. [2025-09-26T22:30:28.613687] [DEBUG] [LOCAL ] WPM: Loaded 53504 existing records from primary storage. [2025-09-26T22:30:28.619088] [INFO ] [MAIN ] WPM: Loaded 53504 primary data records. [2025-09-26T22:30:28.619474] [INFO ] [MAIN ] WRB: Loaded 51313 primary data records. [2025-09-26T22:30:29.577905] [DEBUG] [MAIN ] WPP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:29.579423] [INFO ] [MAIN ] WPP: Generated 1820 derivative records from 34282 primary records. [2025-09-26T22:30:29.579866] [DEBUG] [LOCAL ] WPP: Saving derivative data. [2025-09-26T22:30:29.601866] [DEBUG] [LOCAL ] WPP: Derivative data saved (1820 records). [2025-09-26T22:30:29.605239] [INFO ] [MAIN ] WPP: Successfully saved derivative data. [2025-09-26T22:30:29.610895] [INFO ] [MAIN ] Derivative Progress: 2026/2074 symbols completed. WPP took 1.2s. Estimated remaining: 19.9s. Rate: 144.4 symbols/min [2025-09-26T22:30:29.626015] [DEBUG] [MAIN ] WPM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:29.626213] [INFO ] [MAIN ] WRBY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:29.640687] [INFO ] [MAIN ] WPM: Generated 1820 derivative records from 53504 primary records. [2025-09-26T22:30:29.641542] [DEBUG] [LOCAL ] WPM: Saving derivative data. [2025-09-26T22:30:29.641818] [DEBUG] [MAIN ] WRB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:29.643515] [INFO ] [MAIN ] WRB: Generated 1820 derivative records from 51313 primary records. [2025-09-26T22:30:29.644154] [DEBUG] [LOCAL ] WRB: Saving derivative data. [2025-09-26T22:30:29.675149] [DEBUG] [LOCAL ] WRB: Derivative data saved (1820 records). [2025-09-26T22:30:29.675670] [INFO ] [MAIN ] WRB: Successfully saved derivative data. [2025-09-26T22:30:29.679050] [INFO ] [MAIN ] Derivative Progress: 2027/2074 symbols completed. WRB took 1.3s. Estimated remaining: 19.5s. Rate: 144.5 symbols/min [2025-09-26T22:30:29.679472] [INFO ] [MAIN ] WS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:29.683142] [DEBUG] [LOCAL ] WPM: Derivative data saved (1820 records). [2025-09-26T22:30:29.683361] [INFO ] [MAIN ] WPM: Successfully saved derivative data. [2025-09-26T22:30:29.686072] [INFO ] [MAIN ] Derivative Progress: 2028/2074 symbols completed. WPM took 1.3s. Estimated remaining: 19.1s. Rate: 144.6 symbols/min [2025-09-26T22:30:29.686513] [INFO ] [MAIN ] WSM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:29.709284] [DEBUG] [LOCAL ] WS: Loaded 24434 existing records from primary storage. [2025-09-26T22:30:29.727513] [INFO ] [MAIN ] WS: Loaded 24434 primary data records. [2025-09-26T22:30:29.888164] [DEBUG] [LOCAL ] WRBY: Loaded 51609 existing records from primary storage. [2025-09-26T22:30:29.912278] [INFO ] [MAIN ] WRBY: Loaded 51609 primary data records. [2025-09-26T22:30:30.196352] [DEBUG] [LOCAL ] WSM: Loaded 50533 existing records from primary storage. [2025-09-26T22:30:30.215909] [INFO ] [MAIN ] WSM: Loaded 50533 primary data records. [2025-09-26T22:30:30.886147] [DEBUG] [MAIN ] WS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:30.887955] [INFO ] [MAIN ] WS: Generated 1820 derivative records from 24434 primary records. [2025-09-26T22:30:30.888331] [DEBUG] [LOCAL ] WS: Saving derivative data. [2025-09-26T22:30:30.924204] [DEBUG] [MAIN ] WRBY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:30.926209] [INFO ] [MAIN ] WRBY: Generated 1820 derivative records from 51609 primary records. [2025-09-26T22:30:30.927154] [DEBUG] [LOCAL ] WS: Derivative data saved (1820 records). [2025-09-26T22:30:30.926731] [DEBUG] [LOCAL ] WRBY: Saving derivative data. [2025-09-26T22:30:30.927475] [INFO ] [MAIN ] WS: Successfully saved derivative data. [2025-09-26T22:30:30.930237] [INFO ] [MAIN ] Derivative Progress: 2029/2074 symbols completed. WS took 1.3s. Estimated remaining: 18.7s. Rate: 144.4 symbols/min [2025-09-26T22:30:30.931070] [INFO ] [MAIN ] WSO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:30.951142] [DEBUG] [LOCAL ] WRBY: Derivative data saved (1820 records). [2025-09-26T22:30:30.951447] [INFO ] [MAIN ] WRBY: Successfully saved derivative data. [2025-09-26T22:30:30.954021] [INFO ] [MAIN ] Derivative Progress: 2030/2074 symbols completed. WRBY took 1.3s. Estimated remaining: 18.3s. Rate: 144.5 symbols/min [2025-09-26T22:30:30.967110] [INFO ] [MAIN ] WSR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:30.967754] [DEBUG] [MAIN ] WSM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:30.968724] [INFO ] [MAIN ] WSM: Generated 1820 derivative records from 50533 primary records. [2025-09-26T22:30:30.969015] [DEBUG] [LOCAL ] WSM: Saving derivative data. [2025-09-26T22:30:31.002159] [DEBUG] [LOCAL ] WSM: Derivative data saved (1820 records). [2025-09-26T22:30:31.002985] [DEBUG] [LOCAL ] WSO: Loaded 25059 existing records from primary storage. [2025-09-26T22:30:31.003104] [INFO ] [MAIN ] WSO: Loaded 25059 primary data records. [2025-09-26T22:30:31.003177] [INFO ] [MAIN ] WSM: Successfully saved derivative data. [2025-09-26T22:30:31.006246] [INFO ] [MAIN ] Derivative Progress: 2031/2074 symbols completed. WSM took 1.3s. Estimated remaining: 17.8s. Rate: 144.6 symbols/min [2025-09-26T22:30:31.090462] [INFO ] [MAIN ] WST: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:31.122490] [DEBUG] [LOCAL ] WSR: Loaded 23550 existing records from primary storage. [2025-09-26T22:30:31.142447] [INFO ] [MAIN ] WSR: Loaded 23550 primary data records. [2025-09-26T22:30:31.700150] [DEBUG] [LOCAL ] WST: Loaded 38092 existing records from primary storage. [2025-09-26T22:30:31.700846] [INFO ] [MAIN ] WST: Loaded 38092 primary data records. [2025-09-26T22:30:32.061806] [DEBUG] [MAIN ] WSO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:32.063427] [INFO ] [MAIN ] WSO: Generated 1820 derivative records from 25059 primary records. [2025-09-26T22:30:32.064665] [DEBUG] [LOCAL ] WSO: Saving derivative data. [2025-09-26T22:30:32.107287] [DEBUG] [MAIN ] WSR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:32.111509] [INFO ] [MAIN ] WSR: Generated 1820 derivative records from 23550 primary records. [2025-09-26T22:30:32.112129] [DEBUG] [LOCAL ] WSR: Saving derivative data. [2025-09-26T22:30:32.131868] [DEBUG] [LOCAL ] WSO: Derivative data saved (1820 records). [2025-09-26T22:30:32.132901] [INFO ] [MAIN ] WSO: Successfully saved derivative data. [2025-09-26T22:30:32.137624] [INFO ] [MAIN ] Derivative Progress: 2032/2074 symbols completed. WSO took 1.2s. Estimated remaining: 17.4s. Rate: 144.4 symbols/min [2025-09-26T22:30:32.139137] [DEBUG] [LOCAL ] WSR: Derivative data saved (1820 records). [2025-09-26T22:30:32.139058] [INFO ] [MAIN ] WT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:32.139448] [INFO ] [MAIN ] WSR: Successfully saved derivative data. [2025-09-26T22:30:32.142963] [INFO ] [MAIN ] Derivative Progress: 2033/2074 symbols completed. WSR took 1.2s. Estimated remaining: 17.0s. Rate: 144.5 symbols/min [2025-09-26T22:30:32.143390] [INFO ] [MAIN ] WTI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:32.161503] [DEBUG] [MAIN ] WST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:32.162374] [INFO ] [MAIN ] WST: Generated 1820 derivative records from 38092 primary records. [2025-09-26T22:30:32.162537] [DEBUG] [LOCAL ] WST: Saving derivative data. [2025-09-26T22:30:32.180512] [DEBUG] [LOCAL ] WST: Derivative data saved (1820 records). [2025-09-26T22:30:32.180821] [INFO ] [MAIN ] WST: Successfully saved derivative data. [2025-09-26T22:30:32.184048] [INFO ] [MAIN ] Derivative Progress: 2034/2074 symbols completed. WST took 1.1s. Estimated remaining: 16.6s. Rate: 144.6 symbols/min [2025-09-26T22:30:32.184486] [INFO ] [MAIN ] WTRG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:32.232578] [DEBUG] [LOCAL ] WTI: Loaded 44472 existing records from primary storage. [2025-09-26T22:30:32.233423] [INFO ] [MAIN ] WTI: Loaded 44472 primary data records. [2025-09-26T22:30:32.335788] [DEBUG] [LOCAL ] WT: Loaded 48354 existing records from primary storage. [2025-09-26T22:30:32.342409] [INFO ] [MAIN ] WT: Loaded 48354 primary data records. [2025-09-26T22:30:32.472109] [DEBUG] [LOCAL ] WTRG: Loaded 51656 existing records from primary storage. [2025-09-26T22:30:32.508731] [INFO ] [MAIN ] WTRG: Loaded 51656 primary data records. [2025-09-26T22:30:33.403693] [DEBUG] [MAIN ] WTI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:33.419371] [INFO ] [MAIN ] WTI: Generated 1820 derivative records from 44472 primary records. [2025-09-26T22:30:33.420074] [DEBUG] [LOCAL ] WTI: Saving derivative data. [2025-09-26T22:30:33.420006] [DEBUG] [MAIN ] WT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:33.421575] [INFO ] [MAIN ] WT: Generated 1820 derivative records from 48354 primary records. [2025-09-26T22:30:33.422057] [DEBUG] [LOCAL ] WT: Saving derivative data. [2025-09-26T22:30:33.451670] [DEBUG] [LOCAL ] WTI: Derivative data saved (1820 records). [2025-09-26T22:30:33.452634] [INFO ] [MAIN ] WTI: Successfully saved derivative data. [2025-09-26T22:30:33.455847] [INFO ] [MAIN ] Derivative Progress: 2035/2074 symbols completed. WTI took 1.3s. Estimated remaining: 16.2s. Rate: 144.4 symbols/min [2025-09-26T22:30:33.461041] [INFO ] [MAIN ] WTTR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:33.476987] [DEBUG] [LOCAL ] WT: Derivative data saved (1820 records). [2025-09-26T22:30:33.477919] [INFO ] [MAIN ] WT: Successfully saved derivative data. [2025-09-26T22:30:33.477866] [DEBUG] [MAIN ] WTRG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:33.478718] [INFO ] [MAIN ] WTRG: Generated 1820 derivative records from 51656 primary records. [2025-09-26T22:30:33.482116] [DEBUG] [LOCAL ] WTRG: Saving derivative data. [2025-09-26T22:30:33.481856] [INFO ] [MAIN ] Derivative Progress: 2036/2074 symbols completed. WT took 1.3s. Estimated remaining: 15.8s. Rate: 144.5 symbols/min [2025-09-26T22:30:33.482692] [INFO ] [MAIN ] WU: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:33.501206] [DEBUG] [LOCAL ] WTRG: Derivative data saved (1820 records). [2025-09-26T22:30:33.501441] [INFO ] [MAIN ] WTRG: Successfully saved derivative data. [2025-09-26T22:30:33.506132] [INFO ] [MAIN ] Derivative Progress: 2037/2074 symbols completed. WTRG took 1.3s. Estimated remaining: 15.4s. Rate: 144.6 symbols/min [2025-09-26T22:30:33.506543] [INFO ] [MAIN ] WWW: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:33.558403] [DEBUG] [LOCAL ] WTTR: Loaded 45735 existing records from primary storage. [2025-09-26T22:30:33.558810] [INFO ] [MAIN ] WTTR: Loaded 45735 primary data records. [2025-09-26T22:30:33.704595] [DEBUG] [LOCAL ] WU: Loaded 54232 existing records from primary storage. [2025-09-26T22:30:33.710521] [INFO ] [MAIN ] WU: Loaded 54232 primary data records. [2025-09-26T22:30:33.985605] [DEBUG] [LOCAL ] WWW: Loaded 49906 existing records from primary storage. [2025-09-26T22:30:34.039569] [INFO ] [MAIN ] WWW: Loaded 49906 primary data records. [2025-09-26T22:30:34.746249] [DEBUG] [MAIN ] WTTR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:34.747943] [INFO ] [MAIN ] WTTR: Generated 1820 derivative records from 45735 primary records. [2025-09-26T22:30:34.748223] [DEBUG] [LOCAL ] WTTR: Saving derivative data. [2025-09-26T22:30:34.775492] [DEBUG] [LOCAL ] WTTR: Derivative data saved (1820 records). [2025-09-26T22:30:34.775965] [INFO ] [MAIN ] WTTR: Successfully saved derivative data. [2025-09-26T22:30:34.778313] [INFO ] [MAIN ] Derivative Progress: 2038/2074 symbols completed. WTTR took 1.3s. Estimated remaining: 15.0s. Rate: 144.4 symbols/min [2025-09-26T22:30:34.795426] [DEBUG] [MAIN ] WU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:34.796769] [INFO ] [MAIN ] WU: Generated 1820 derivative records from 54232 primary records. [2025-09-26T22:30:34.796987] [DEBUG] [LOCAL ] WU: Saving derivative data. [2025-09-26T22:30:34.811031] [DEBUG] [MAIN ] WWW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:34.812333] [INFO ] [MAIN ] WWW: Generated 1820 derivative records from 49906 primary records. [2025-09-26T22:30:34.812694] [DEBUG] [LOCAL ] WWW: Saving derivative data. [2025-09-26T22:30:34.838721] [DEBUG] [LOCAL ] WU: Derivative data saved (1820 records). [2025-09-26T22:30:34.841543] [INFO ] [MAIN ] WU: Successfully saved derivative data. [2025-09-26T22:30:34.844063] [INFO ] [MAIN ] Derivative Progress: 2039/2074 symbols completed. WU took 1.4s. Estimated remaining: 14.5s. Rate: 144.5 symbols/min [2025-09-26T22:30:34.850860] [DEBUG] [LOCAL ] WWW: Derivative data saved (1820 records). [2025-09-26T22:30:34.851020] [INFO ] [MAIN ] WWW: Successfully saved derivative data. [2025-09-26T22:30:34.855384] [INFO ] [MAIN ] Derivative Progress: 2040/2074 symbols completed. WWW took 1.3s. Estimated remaining: 14.1s. Rate: 144.5 symbols/min [2025-09-26T22:30:34.856745] [INFO ] [MAIN ] XFLT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:34.856929] [INFO ] [MAIN ] XHR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:34.856672] [INFO ] [MAIN ] WY: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:34.903580] [DEBUG] [LOCAL ] XFLT: Loaded 30306 existing records from primary storage. [2025-09-26T22:30:34.903938] [INFO ] [MAIN ] XFLT: Loaded 30306 primary data records. [2025-09-26T22:30:35.050039] [DEBUG] [LOCAL ] XHR: Loaded 44680 existing records from primary storage. [2025-09-26T22:30:35.088688] [INFO ] [MAIN ] XHR: Loaded 44680 primary data records. [2025-09-26T22:30:35.131166] [DEBUG] [LOCAL ] WY: Loaded 53899 existing records from primary storage. [2025-09-26T22:30:35.189427] [INFO ] [MAIN ] WY: Loaded 53899 primary data records. [2025-09-26T22:30:35.983945] [DEBUG] [MAIN ] XFLT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:35.985297] [INFO ] [MAIN ] XFLT: Generated 1820 derivative records from 30306 primary records. [2025-09-26T22:30:35.985619] [DEBUG] [LOCAL ] XFLT: Saving derivative data. [2025-09-26T22:30:36.009039] [DEBUG] [LOCAL ] XFLT: Derivative data saved (1820 records). [2025-09-26T22:30:36.017621] [INFO ] [MAIN ] XFLT: Successfully saved derivative data. [2025-09-26T22:30:36.026890] [INFO ] [MAIN ] Derivative Progress: 2041/2074 symbols completed. XFLT took 1.2s. Estimated remaining: 13.7s. Rate: 144.4 symbols/min [2025-09-26T22:30:36.028512] [DEBUG] [MAIN ] XHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:36.030444] [INFO ] [MAIN ] XHR: Generated 1820 derivative records from 44680 primary records. [2025-09-26T22:30:36.031632] [DEBUG] [LOCAL ] XHR: Saving derivative data. [2025-09-26T22:30:36.031360] [INFO ] [MAIN ] XPER: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:36.061156] [DEBUG] [MAIN ] WY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:36.062976] [INFO ] [MAIN ] WY: Generated 1820 derivative records from 53899 primary records. [2025-09-26T22:30:36.064096] [DEBUG] [LOCAL ] WY: Saving derivative data. [2025-09-26T22:30:36.074585] [DEBUG] [LOCAL ] XHR: Derivative data saved (1820 records). [2025-09-26T22:30:36.081177] [INFO ] [MAIN ] XHR: Successfully saved derivative data. [2025-09-26T22:30:36.089722] [DEBUG] [LOCAL ] WY: Derivative data saved (1820 records). [2025-09-26T22:30:36.089575] [INFO ] [MAIN ] Derivative Progress: 2042/2074 symbols completed. XHR took 1.2s. Estimated remaining: 13.3s. Rate: 144.5 symbols/min [2025-09-26T22:30:36.090137] [INFO ] [MAIN ] XPEV: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:36.090440] [INFO ] [MAIN ] WY: Successfully saved derivative data. [2025-09-26T22:30:36.102105] [INFO ] [MAIN ] Derivative Progress: 2043/2074 symbols completed. WY took 1.2s. Estimated remaining: 12.9s. Rate: 144.5 symbols/min [2025-09-26T22:30:36.102703] [INFO ] [MAIN ] XPO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:36.119144] [DEBUG] [LOCAL ] XPER: Loaded 30181 existing records from primary storage. [2025-09-26T22:30:36.119579] [INFO ] [MAIN ] XPER: Loaded 30181 primary data records. [2025-09-26T22:30:36.502931] [DEBUG] [LOCAL ] XPEV: Loaded 54419 existing records from primary storage. [2025-09-26T22:30:36.503272] [INFO ] [MAIN ] XPEV: Loaded 54419 primary data records. [2025-09-26T22:30:36.540244] [DEBUG] [LOCAL ] XPO: Loaded 48656 existing records from primary storage. [2025-09-26T22:30:36.558433] [INFO ] [MAIN ] XPO: Loaded 48656 primary data records. [2025-09-26T22:30:37.270398] [DEBUG] [MAIN ] XPER: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:37.271600] [INFO ] [MAIN ] XPER: Generated 1820 derivative records from 30181 primary records. [2025-09-26T22:30:37.272348] [DEBUG] [LOCAL ] XPER: Saving derivative data. [2025-09-26T22:30:37.290048] [DEBUG] [LOCAL ] XPER: Derivative data saved (1820 records). [2025-09-26T22:30:37.290607] [INFO ] [MAIN ] XPER: Successfully saved derivative data. [2025-09-26T22:30:37.293572] [INFO ] [MAIN ] Derivative Progress: 2044/2074 symbols completed. XPER took 1.3s. Estimated remaining: 12.5s. Rate: 144.4 symbols/min [2025-09-26T22:30:37.294038] [INFO ] [MAIN ] XPOF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:37.320821] [DEBUG] [MAIN ] XPO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:37.334504] [DEBUG] [MAIN ] XPEV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:37.334221] [INFO ] [MAIN ] XPO: Generated 1820 derivative records from 48656 primary records. [2025-09-26T22:30:37.335484] [DEBUG] [LOCAL ] XPO: Saving derivative data. [2025-09-26T22:30:37.335215] [INFO ] [MAIN ] XPEV: Generated 1820 derivative records from 54419 primary records. [2025-09-26T22:30:37.345356] [DEBUG] [LOCAL ] XPEV: Saving derivative data. [2025-09-26T22:30:37.373876] [DEBUG] [LOCAL ] XPO: Derivative data saved (1820 records). [2025-09-26T22:30:37.377810] [INFO ] [MAIN ] XPO: Successfully saved derivative data. [2025-09-26T22:30:37.380085] [INFO ] [MAIN ] Derivative Progress: 2045/2074 symbols completed. XPO took 1.3s. Estimated remaining: 12.0s. Rate: 144.5 symbols/min [2025-09-26T22:30:37.380852] [INFO ] [MAIN ] XPRO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:37.380520] [DEBUG] [LOCAL ] XPEV: Derivative data saved (1820 records). [2025-09-26T22:30:37.381061] [INFO ] [MAIN ] XPEV: Successfully saved derivative data. [2025-09-26T22:30:37.395104] [INFO ] [MAIN ] Derivative Progress: 2046/2074 symbols completed. XPEV took 1.3s. Estimated remaining: 11.6s. Rate: 144.5 symbols/min [2025-09-26T22:30:37.395519] [INFO ] [MAIN ] XYF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:37.397209] [DEBUG] [LOCAL ] XPOF: Loaded 39243 existing records from primary storage. [2025-09-26T22:30:37.397480] [INFO ] [MAIN ] XPOF: Loaded 39243 primary data records. [2025-09-26T22:30:37.753895] [DEBUG] [LOCAL ] XYF: Loaded 28464 existing records from primary storage. [2025-09-26T22:30:37.754182] [INFO ] [MAIN ] XYF: Loaded 28464 primary data records. [2025-09-26T22:30:37.887563] [DEBUG] [LOCAL ] XPRO: Loaded 46617 existing records from primary storage. [2025-09-26T22:30:37.908888] [INFO ] [MAIN ] XPRO: Loaded 46617 primary data records. [2025-09-26T22:30:38.441868] [DEBUG] [MAIN ] XPOF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:38.443270] [INFO ] [MAIN ] XPOF: Generated 1820 derivative records from 39243 primary records. [2025-09-26T22:30:38.443585] [DEBUG] [LOCAL ] XPOF: Saving derivative data. [2025-09-26T22:30:38.480221] [DEBUG] [MAIN ] XYF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:38.481162] [DEBUG] [LOCAL ] XPOF: Derivative data saved (1820 records). [2025-09-26T22:30:38.482145] [INFO ] [MAIN ] XYF: Generated 1820 derivative records from 28464 primary records. [2025-09-26T22:30:38.482318] [DEBUG] [LOCAL ] XYF: Saving derivative data. [2025-09-26T22:30:38.482395] [INFO ] [MAIN ] XPOF: Successfully saved derivative data. [2025-09-26T22:30:38.486488] [INFO ] [MAIN ] Derivative Progress: 2047/2074 symbols completed. XPOF took 1.2s. Estimated remaining: 11.2s. Rate: 144.4 symbols/min [2025-09-26T22:30:38.498746] [INFO ] [MAIN ] YALA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:38.522205] [DEBUG] [MAIN ] XPRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:38.521984] [DEBUG] [LOCAL ] XYF: Derivative data saved (1820 records). [2025-09-26T22:30:38.522346] [INFO ] [MAIN ] XYF: Successfully saved derivative data. [2025-09-26T22:30:38.524851] [INFO ] [MAIN ] Derivative Progress: 2048/2074 symbols completed. XYF took 1.1s. Estimated remaining: 10.8s. Rate: 144.5 symbols/min [2025-09-26T22:30:38.525831] [INFO ] [MAIN ] XPRO: Generated 1820 derivative records from 46617 primary records. [2025-09-26T22:30:38.526368] [DEBUG] [LOCAL ] XPRO: Saving derivative data. [2025-09-26T22:30:38.526475] [INFO ] [MAIN ] YELP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:38.554915] [DEBUG] [LOCAL ] XPRO: Derivative data saved (1820 records). [2025-09-26T22:30:38.555057] [INFO ] [MAIN ] XPRO: Successfully saved derivative data. [2025-09-26T22:30:38.558159] [INFO ] [MAIN ] Derivative Progress: 2049/2074 symbols completed. XPRO took 1.2s. Estimated remaining: 10.4s. Rate: 144.5 symbols/min [2025-09-26T22:30:38.558677] [INFO ] [MAIN ] YETI: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:38.587859] [DEBUG] [LOCAL ] YALA: Loaded 37892 existing records from primary storage. [2025-09-26T22:30:38.588217] [INFO ] [MAIN ] YALA: Loaded 37892 primary data records. [2025-09-26T22:30:38.736132] [DEBUG] [LOCAL ] YELP: Loaded 45909 existing records from primary storage. [2025-09-26T22:30:38.742566] [INFO ] [MAIN ] YELP: Loaded 45909 primary data records. [2025-09-26T22:30:39.053573] [DEBUG] [LOCAL ] YETI: Loaded 53216 existing records from primary storage. [2025-09-26T22:30:39.067825] [INFO ] [MAIN ] YETI: Loaded 53216 primary data records. [2025-09-26T22:30:39.702265] [DEBUG] [MAIN ] YALA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:39.704104] [INFO ] [MAIN ] YALA: Generated 1820 derivative records from 37892 primary records. [2025-09-26T22:30:39.704488] [DEBUG] [LOCAL ] YALA: Saving derivative data. [2025-09-26T22:30:39.726633] [DEBUG] [LOCAL ] YALA: Derivative data saved (1820 records). [2025-09-26T22:30:39.727681] [INFO ] [MAIN ] YALA: Successfully saved derivative data. [2025-09-26T22:30:39.730301] [INFO ] [MAIN ] Derivative Progress: 2050/2074 symbols completed. YALA took 1.2s. Estimated remaining: 10.0s. Rate: 144.4 symbols/min [2025-09-26T22:30:39.731222] [INFO ] [MAIN ] YEXT: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:39.748298] [DEBUG] [MAIN ] YELP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:39.757267] [INFO ] [MAIN ] YELP: Generated 1820 derivative records from 45909 primary records. [2025-09-26T22:30:39.762594] [DEBUG] [LOCAL ] YELP: Saving derivative data. [2025-09-26T22:30:39.762515] [DEBUG] [MAIN ] YETI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:39.764733] [INFO ] [MAIN ] YETI: Generated 1820 derivative records from 53216 primary records. [2025-09-26T22:30:39.772016] [DEBUG] [LOCAL ] YETI: Saving derivative data. [2025-09-26T22:30:39.807574] [DEBUG] [LOCAL ] YELP: Derivative data saved (1820 records). [2025-09-26T22:30:39.808220] [INFO ] [MAIN ] YELP: Successfully saved derivative data. [2025-09-26T22:30:39.811235] [DEBUG] [LOCAL ] YETI: Derivative data saved (1820 records). [2025-09-26T22:30:39.811135] [INFO ] [MAIN ] Derivative Progress: 2051/2074 symbols completed. YELP took 1.3s. Estimated remaining: 9.6s. Rate: 144.5 symbols/min [2025-09-26T22:30:39.811768] [INFO ] [MAIN ] YETI: Successfully saved derivative data. [2025-09-26T22:30:39.815899] [INFO ] [MAIN ] YMM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:39.815722] [INFO ] [MAIN ] Derivative Progress: 2052/2074 symbols completed. YETI took 1.3s. Estimated remaining: 9.1s. Rate: 144.5 symbols/min [2025-09-26T22:30:39.816376] [INFO ] [MAIN ] YOU: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:39.832917] [DEBUG] [LOCAL ] YEXT: Loaded 43863 existing records from primary storage. [2025-09-26T22:30:39.833147] [INFO ] [MAIN ] YEXT: Loaded 43863 primary data records. [2025-09-26T22:30:40.208053] [DEBUG] [LOCAL ] YOU: Loaded 50504 existing records from primary storage. [2025-09-26T22:30:40.210048] [DEBUG] [LOCAL ] YMM: Loaded 53425 existing records from primary storage. [2025-09-26T22:30:40.208812] [INFO ] [MAIN ] YOU: Loaded 50504 primary data records. [2025-09-26T22:30:40.210401] [INFO ] [MAIN ] YMM: Loaded 53425 primary data records. [2025-09-26T22:30:40.907980] [DEBUG] [MAIN ] YEXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:40.909632] [INFO ] [MAIN ] YEXT: Generated 1820 derivative records from 43863 primary records. [2025-09-26T22:30:40.909854] [DEBUG] [LOCAL ] YEXT: Saving derivative data. [2025-09-26T22:30:40.933310] [DEBUG] [LOCAL ] YEXT: Derivative data saved (1820 records). [2025-09-26T22:30:40.934018] [INFO ] [MAIN ] YEXT: Successfully saved derivative data. [2025-09-26T22:30:40.937058] [INFO ] [MAIN ] Derivative Progress: 2053/2074 symbols completed. YEXT took 1.2s. Estimated remaining: 8.7s. Rate: 144.4 symbols/min [2025-09-26T22:30:40.956305] [DEBUG] [MAIN ] YOU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:40.972300] [INFO ] [MAIN ] YOU: Generated 1820 derivative records from 50504 primary records. [2025-09-26T22:30:40.972429] [DEBUG] [LOCAL ] YOU: Saving derivative data. [2025-09-26T22:30:40.971314] [DEBUG] [MAIN ] YMM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:40.973856] [INFO ] [MAIN ] YMM: Generated 1820 derivative records from 53425 primary records. [2025-09-26T22:30:40.974233] [DEBUG] [LOCAL ] YMM: Saving derivative data. [2025-09-26T22:30:41.006530] [DEBUG] [LOCAL ] YOU: Derivative data saved (1820 records). [2025-09-26T22:30:41.007956] [DEBUG] [LOCAL ] YMM: Derivative data saved (1820 records). [2025-09-26T22:30:41.008188] [INFO ] [MAIN ] YOU: Successfully saved derivative data. [2025-09-26T22:30:41.008304] [INFO ] [MAIN ] YMM: Successfully saved derivative data. [2025-09-26T22:30:41.010739] [INFO ] [MAIN ] Derivative Progress: 2054/2074 symbols completed. YOU took 1.2s. Estimated remaining: 8.3s. Rate: 144.5 symbols/min [2025-09-26T22:30:41.014007] [INFO ] [MAIN ] Derivative Progress: 2055/2074 symbols completed. YMM took 1.2s. Estimated remaining: 7.9s. Rate: 144.6 symbols/min [2025-09-26T22:30:41.014743] [INFO ] [MAIN ] YRD: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:41.014875] [INFO ] [MAIN ] YSG: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:41.014608] [INFO ] [MAIN ] YPF: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:41.030029] [DEBUG] [LOCAL ] YRD: Loaded 12726 existing records from primary storage. [2025-09-26T22:30:41.030252] [INFO ] [MAIN ] YRD: Loaded 12726 primary data records. [2025-09-26T22:30:41.159105] [DEBUG] [LOCAL ] YSG: Loaded 25485 existing records from primary storage. [2025-09-26T22:30:41.159489] [INFO ] [MAIN ] YSG: Loaded 25485 primary data records. [2025-09-26T22:30:41.555708] [DEBUG] [LOCAL ] YPF: Loaded 51252 existing records from primary storage. [2025-09-26T22:30:41.557451] [INFO ] [MAIN ] YPF: Loaded 51252 primary data records. [2025-09-26T22:30:42.139369] [DEBUG] [MAIN ] YRD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:42.141582] [INFO ] [MAIN ] YRD: Generated 1820 derivative records from 12726 primary records. [2025-09-26T22:30:42.142035] [DEBUG] [LOCAL ] YRD: Saving derivative data. [2025-09-26T22:30:42.162316] [DEBUG] [LOCAL ] YRD: Derivative data saved (1820 records). [2025-09-26T22:30:42.162788] [INFO ] [MAIN ] YRD: Successfully saved derivative data. [2025-09-26T22:30:42.178276] [INFO ] [MAIN ] Derivative Progress: 2056/2074 symbols completed. YRD took 1.2s. Estimated remaining: 7.5s. Rate: 144.4 symbols/min [2025-09-26T22:30:42.179132] [DEBUG] [MAIN ] YSG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:42.180082] [INFO ] [MAIN ] YSG: Generated 1820 derivative records from 25485 primary records. [2025-09-26T22:30:42.180584] [INFO ] [MAIN ] YUM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:42.180521] [DEBUG] [LOCAL ] YSG: Saving derivative data. [2025-09-26T22:30:42.201246] [DEBUG] [LOCAL ] YSG: Derivative data saved (1820 records). [2025-09-26T22:30:42.214550] [INFO ] [MAIN ] YSG: Successfully saved derivative data. [2025-09-26T22:30:42.217117] [INFO ] [MAIN ] Derivative Progress: 2057/2074 symbols completed. YSG took 1.2s. Estimated remaining: 7.1s. Rate: 144.5 symbols/min [2025-09-26T22:30:42.214821] [DEBUG] [MAIN ] YPF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:42.218349] [INFO ] [MAIN ] YPF: Generated 1820 derivative records from 51252 primary records. [2025-09-26T22:30:42.218556] [INFO ] [MAIN ] YUMC: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:42.218748] [DEBUG] [LOCAL ] YPF: Saving derivative data. [2025-09-26T22:30:42.236619] [DEBUG] [LOCAL ] YPF: Derivative data saved (1820 records). [2025-09-26T22:30:42.236827] [INFO ] [MAIN ] YPF: Successfully saved derivative data. [2025-09-26T22:30:42.239668] [INFO ] [MAIN ] Derivative Progress: 2058/2074 symbols completed. YPF took 1.2s. Estimated remaining: 6.6s. Rate: 144.6 symbols/min [2025-09-26T22:30:42.240031] [INFO ] [MAIN ] ZBH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:42.300051] [DEBUG] [LOCAL ] YUM: Loaded 51931 existing records from primary storage. [2025-09-26T22:30:42.313263] [INFO ] [MAIN ] YUM: Loaded 51931 primary data records. [2025-09-26T22:30:42.404148] [DEBUG] [LOCAL ] YUMC: Loaded 53455 existing records from primary storage. [2025-09-26T22:30:42.418115] [INFO ] [MAIN ] YUMC: Loaded 53455 primary data records. [2025-09-26T22:30:42.523686] [DEBUG] [LOCAL ] ZBH: Loaded 51948 existing records from primary storage. [2025-09-26T22:30:42.548711] [INFO ] [MAIN ] ZBH: Loaded 51948 primary data records. [2025-09-26T22:30:43.462954] [DEBUG] [MAIN ] YUM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:43.464492] [INFO ] [MAIN ] YUM: Generated 1820 derivative records from 51931 primary records. [2025-09-26T22:30:43.466318] [DEBUG] [LOCAL ] YUM: Saving derivative data. [2025-09-26T22:30:43.493490] [DEBUG] [MAIN ] YUMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:43.497519] [INFO ] [MAIN ] YUMC: Generated 1820 derivative records from 53455 primary records. [2025-09-26T22:30:43.498728] [DEBUG] [LOCAL ] YUMC: Saving derivative data. [2025-09-26T22:30:43.500191] [DEBUG] [LOCAL ] YUM: Derivative data saved (1820 records). [2025-09-26T22:30:43.502154] [INFO ] [MAIN ] YUM: Successfully saved derivative data. [2025-09-26T22:30:43.517403] [INFO ] [MAIN ] Derivative Progress: 2059/2074 symbols completed. YUM took 1.3s. Estimated remaining: 6.2s. Rate: 144.4 symbols/min [2025-09-26T22:30:43.521273] [INFO ] [MAIN ] ZEPP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:43.528672] [DEBUG] [LOCAL ] YUMC: Derivative data saved (1820 records). [2025-09-26T22:30:43.538283] [INFO ] [MAIN ] YUMC: Successfully saved derivative data. [2025-09-26T22:30:43.541368] [INFO ] [MAIN ] Derivative Progress: 2060/2074 symbols completed. YUMC took 1.3s. Estimated remaining: 5.8s. Rate: 144.5 symbols/min [2025-09-26T22:30:43.541899] [INFO ] [MAIN ] ZETA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:43.542746] [DEBUG] [MAIN ] ZBH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:43.543919] [INFO ] [MAIN ] ZBH: Generated 1820 derivative records from 51948 primary records. [2025-09-26T22:30:43.544093] [DEBUG] [LOCAL ] ZBH: Saving derivative data. [2025-09-26T22:30:43.562117] [DEBUG] [LOCAL ] ZBH: Derivative data saved (1820 records). [2025-09-26T22:30:43.566478] [INFO ] [MAIN ] ZBH: Successfully saved derivative data. [2025-09-26T22:30:43.569402] [INFO ] [MAIN ] Derivative Progress: 2061/2074 symbols completed. ZBH took 1.3s. Estimated remaining: 5.4s. Rate: 144.5 symbols/min [2025-09-26T22:30:43.569982] [INFO ] [MAIN ] ZGN: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:43.580227] [DEBUG] [LOCAL ] ZEPP: Loaded 17335 existing records from primary storage. [2025-09-26T22:30:43.580552] [INFO ] [MAIN ] ZEPP: Loaded 17335 primary data records. [2025-09-26T22:30:43.965708] [DEBUG] [LOCAL ] ZGN: Loaded 41333 existing records from primary storage. [2025-09-26T22:30:43.967267] [DEBUG] [LOCAL ] ZETA: Loaded 54375 existing records from primary storage. [2025-09-26T22:30:43.967544] [INFO ] [MAIN ] ZGN: Loaded 41333 primary data records. [2025-09-26T22:30:43.967596] [INFO ] [MAIN ] ZETA: Loaded 54375 primary data records. [2025-09-26T22:30:44.666788] [DEBUG] [MAIN ] ZEPP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:44.669606] [INFO ] [MAIN ] ZEPP: Generated 1820 derivative records from 17335 primary records. [2025-09-26T22:30:44.670445] [DEBUG] [LOCAL ] ZEPP: Saving derivative data. [2025-09-26T22:30:44.689988] [DEBUG] [LOCAL ] ZEPP: Derivative data saved (1820 records). [2025-09-26T22:30:44.691612] [INFO ] [MAIN ] ZEPP: Successfully saved derivative data. [2025-09-26T22:30:44.694237] [INFO ] [MAIN ] Derivative Progress: 2062/2074 symbols completed. ZEPP took 1.2s. Estimated remaining: 5.0s. Rate: 144.4 symbols/min [2025-09-26T22:30:44.695305] [INFO ] [MAIN ] ZH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:44.716212] [DEBUG] [MAIN ] ZGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:44.720619] [INFO ] [MAIN ] ZGN: Generated 1820 derivative records from 41333 primary records. [2025-09-26T22:30:44.720937] [DEBUG] [LOCAL ] ZGN: Saving derivative data. [2025-09-26T22:30:44.750995] [DEBUG] [MAIN ] ZETA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:44.757700] [INFO ] [MAIN ] ZETA: Generated 1820 derivative records from 54375 primary records. [2025-09-26T22:30:44.760299] [DEBUG] [LOCAL ] ZETA: Saving derivative data. [2025-09-26T22:30:44.762372] [DEBUG] [LOCAL ] ZGN: Derivative data saved (1820 records). [2025-09-26T22:30:44.763387] [INFO ] [MAIN ] ZGN: Successfully saved derivative data. [2025-09-26T22:30:44.766300] [INFO ] [MAIN ] Derivative Progress: 2063/2074 symbols completed. ZGN took 1.2s. Estimated remaining: 4.6s. Rate: 144.5 symbols/min [2025-09-26T22:30:44.785750] [INFO ] [MAIN ] ZIM: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:44.791557] [DEBUG] [LOCAL ] ZETA: Derivative data saved (1820 records). [2025-09-26T22:30:44.791891] [INFO ] [MAIN ] ZETA: Successfully saved derivative data. [2025-09-26T22:30:44.795058] [INFO ] [MAIN ] Derivative Progress: 2064/2074 symbols completed. ZETA took 1.3s. Estimated remaining: 4.2s. Rate: 144.5 symbols/min [2025-09-26T22:30:44.795306] [DEBUG] [LOCAL ] ZH: Loaded 27298 existing records from primary storage. [2025-09-26T22:30:44.795460] [INFO ] [MAIN ] ZH: Loaded 27298 primary data records. [2025-09-26T22:30:44.801310] [INFO ] [MAIN ] ZIP: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:45.167520] [DEBUG] [LOCAL ] ZIP: Loaded 44952 existing records from primary storage. [2025-09-26T22:30:45.168607] [INFO ] [MAIN ] ZIP: Loaded 44952 primary data records. [2025-09-26T22:30:45.234165] [DEBUG] [LOCAL ] ZIM: Loaded 54298 existing records from primary storage. [2025-09-26T22:30:45.258180] [INFO ] [MAIN ] ZIM: Loaded 54298 primary data records. [2025-09-26T22:30:45.935833] [DEBUG] [MAIN ] ZH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:45.937312] [INFO ] [MAIN ] ZH: Generated 1820 derivative records from 27298 primary records. [2025-09-26T22:30:45.937612] [DEBUG] [LOCAL ] ZH: Saving derivative data. [2025-09-26T22:30:45.959397] [DEBUG] [LOCAL ] ZH: Derivative data saved (1820 records). [2025-09-26T22:30:45.962584] [INFO ] [MAIN ] ZH: Successfully saved derivative data. [2025-09-26T22:30:45.965834] [INFO ] [MAIN ] Derivative Progress: 2065/2074 symbols completed. ZH took 1.3s. Estimated remaining: 3.7s. Rate: 144.4 symbols/min [2025-09-26T22:30:45.980519] [INFO ] [MAIN ] ZK: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:45.982125] [DEBUG] [MAIN ] ZIP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:45.983868] [INFO ] [MAIN ] ZIP: Generated 1820 derivative records from 44952 primary records. [2025-09-26T22:30:45.984915] [DEBUG] [LOCAL ] ZIP: Saving derivative data. [2025-09-26T22:30:46.015254] [DEBUG] [MAIN ] ZIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:46.018837] [DEBUG] [LOCAL ] ZIP: Derivative data saved (1820 records). [2025-09-26T22:30:46.020301] [INFO ] [MAIN ] ZIM: Generated 1820 derivative records from 54298 primary records. [2025-09-26T22:30:46.020408] [INFO ] [MAIN ] ZIP: Successfully saved derivative data. [2025-09-26T22:30:46.020572] [DEBUG] [LOCAL ] ZIM: Saving derivative data. [2025-09-26T22:30:46.023598] [INFO ] [MAIN ] Derivative Progress: 2066/2074 symbols completed. ZIP took 1.2s. Estimated remaining: 3.3s. Rate: 144.5 symbols/min [2025-09-26T22:30:46.025283] [INFO ] [MAIN ] ZKH: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:46.042617] [DEBUG] [LOCAL ] ZIM: Derivative data saved (1820 records). [2025-09-26T22:30:46.042936] [INFO ] [MAIN ] ZIM: Successfully saved derivative data. [2025-09-26T22:30:46.045852] [INFO ] [MAIN ] Derivative Progress: 2067/2074 symbols completed. ZIM took 1.3s. Estimated remaining: 2.9s. Rate: 144.5 symbols/min [2025-09-26T22:30:46.046308] [INFO ] [MAIN ] ZTO: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:46.056017] [DEBUG] [LOCAL ] ZKH: Loaded 8119 existing records from primary storage. [2025-09-26T22:30:46.056173] [INFO ] [MAIN ] ZKH: Loaded 8119 primary data records. [2025-09-26T22:30:46.249856] [DEBUG] [LOCAL ] ZK: Loaded 40504 existing records from primary storage. [2025-09-26T22:30:46.280877] [INFO ] [MAIN ] ZK: Loaded 40504 primary data records. [2025-09-26T22:30:46.608595] [DEBUG] [LOCAL ] ZTO: Loaded 50751 existing records from primary storage. [2025-09-26T22:30:46.669980] [INFO ] [MAIN ] ZTO: Loaded 50751 primary data records. [2025-09-26T22:30:47.160995] [DEBUG] [MAIN ] ZKH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:47.162871] [INFO ] [MAIN ] ZKH: Generated 1820 derivative records from 8119 primary records. [2025-09-26T22:30:47.163409] [DEBUG] [LOCAL ] ZKH: Saving derivative data. [2025-09-26T22:30:47.180538] [DEBUG] [LOCAL ] ZKH: Derivative data saved (1820 records). [2025-09-26T22:30:47.182045] [INFO ] [MAIN ] ZKH: Successfully saved derivative data. [2025-09-26T22:30:47.185151] [INFO ] [MAIN ] Derivative Progress: 2068/2074 symbols completed. ZKH took 1.2s. Estimated remaining: 2.5s. Rate: 144.4 symbols/min [2025-09-26T22:30:47.200768] [DEBUG] [MAIN ] ZK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:47.201666] [INFO ] [MAIN ] ZK: Generated 1820 derivative records from 40504 primary records. [2025-09-26T22:30:47.201831] [DEBUG] [LOCAL ] ZK: Saving derivative data. [2025-09-26T22:30:47.218865] [DEBUG] [LOCAL ] ZK: Derivative data saved (1820 records). [2025-09-26T22:30:47.219069] [INFO ] [MAIN ] ZK: Successfully saved derivative data. [2025-09-26T22:30:47.221970] [INFO ] [MAIN ] Derivative Progress: 2069/2074 symbols completed. ZK took 1.3s. Estimated remaining: 2.1s. Rate: 144.5 symbols/min [2025-09-26T22:30:47.237032] [DEBUG] [MAIN ] ZTO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:47.237681] [INFO ] [MAIN ] ZTO: Generated 1820 derivative records from 50751 primary records. [2025-09-26T22:30:47.237746] [DEBUG] [LOCAL ] ZTO: Saving derivative data. [2025-09-26T22:30:47.253620] [DEBUG] [LOCAL ] ZTO: Derivative data saved (1820 records). [2025-09-26T22:30:47.253746] [INFO ] [MAIN ] ZTO: Successfully saved derivative data. [2025-09-26T22:30:47.256563] [INFO ] [MAIN ] Derivative Progress: 2070/2074 symbols completed. ZTO took 1.2s. Estimated remaining: 1.7s. Rate: 144.5 symbols/min [2025-09-26T22:30:47.257172] [INFO ] [MAIN ] ZTR: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:47.257227] [INFO ] [MAIN ] ZTS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:47.257393] [INFO ] [MAIN ] ZVIA: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:47.276382] [DEBUG] [LOCAL ] ZTR: Loaded 16911 existing records from primary storage. [2025-09-26T22:30:47.276557] [INFO ] [MAIN ] ZTR: Loaded 16911 primary data records. [2025-09-26T22:30:47.499750] [DEBUG] [LOCAL ] ZVIA: Loaded 35966 existing records from primary storage. [2025-09-26T22:30:47.645983] [INFO ] [MAIN ] ZVIA: Loaded 35966 primary data records. [2025-09-26T22:30:47.734277] [DEBUG] [LOCAL ] ZTS: Loaded 53775 existing records from primary storage. [2025-09-26T22:30:47.758867] [INFO ] [MAIN ] ZTS: Loaded 53775 primary data records. [2025-09-26T22:30:48.366239] [DEBUG] [MAIN ] ZTR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:48.367245] [INFO ] [MAIN ] ZTR: Generated 1820 derivative records from 16911 primary records. [2025-09-26T22:30:48.367682] [DEBUG] [LOCAL ] ZTR: Saving derivative data. [2025-09-26T22:30:48.385580] [DEBUG] [LOCAL ] ZTR: Derivative data saved (1820 records). [2025-09-26T22:30:48.386119] [INFO ] [MAIN ] ZTR: Successfully saved derivative data. [2025-09-26T22:30:48.388518] [INFO ] [MAIN ] Derivative Progress: 2071/2074 symbols completed. ZTR took 1.1s. Estimated remaining: 1.2s. Rate: 144.4 symbols/min [2025-09-26T22:30:48.389093] [INFO ] [MAIN ] ZWS: Starting derivative data generation with 30-minute intervals. [2025-09-26T22:30:48.410223] [DEBUG] [MAIN ] ZVIA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:48.413031] [INFO ] [MAIN ] ZVIA: Generated 1820 derivative records from 35966 primary records. [2025-09-26T22:30:48.413353] [DEBUG] [LOCAL ] ZVIA: Saving derivative data. [2025-09-26T22:30:48.437479] [DEBUG] [MAIN ] ZTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:48.442583] [INFO ] [MAIN ] ZTS: Generated 1820 derivative records from 53775 primary records. [2025-09-26T22:30:48.447407] [DEBUG] [LOCAL ] ZVIA: Derivative data saved (1820 records). [2025-09-26T22:30:48.447554] [DEBUG] [LOCAL ] ZTS: Saving derivative data. [2025-09-26T22:30:48.447751] [INFO ] [MAIN ] ZVIA: Successfully saved derivative data. [2025-09-26T22:30:48.450101] [INFO ] [MAIN ] Derivative Progress: 2072/2074 symbols completed. ZVIA took 1.2s. Estimated remaining: 0.8s. Rate: 144.5 symbols/min [2025-09-26T22:30:48.489141] [DEBUG] [LOCAL ] ZTS: Derivative data saved (1820 records). [2025-09-26T22:30:48.490310] [INFO ] [MAIN ] ZTS: Successfully saved derivative data. [2025-09-26T22:30:48.494402] [DEBUG] [LOCAL ] ZWS: Loaded 43134 existing records from primary storage. [2025-09-26T22:30:48.493336] [INFO ] [MAIN ] Derivative Progress: 2073/2074 symbols completed. ZTS took 1.2s. Estimated remaining: 0.4s. Rate: 144.5 symbols/min [2025-09-26T22:30:48.494720] [INFO ] [MAIN ] ZWS: Loaded 43134 primary data records. [2025-09-26T22:30:48.818763] [DEBUG] [MAIN ] ZWS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-26T22:30:48.819475] [INFO ] [MAIN ] ZWS: Generated 1820 derivative records from 43134 primary records. [2025-09-26T22:30:48.819542] [DEBUG] [LOCAL ] ZWS: Saving derivative data. [2025-09-26T22:30:48.835230] [DEBUG] [LOCAL ] ZWS: Derivative data saved (1820 records). [2025-09-26T22:30:48.835306] [INFO ] [MAIN ] ZWS: Successfully saved derivative data. [2025-09-26T22:30:48.837427] [INFO ] [MAIN ] Derivative Progress: 2074/2074 symbols completed. ZWS took 0.4s. Estimated remaining: 0.0s. Rate: 144.6 symbols/min [2025-09-26T22:30:48.839596] [INFO ] [MAIN ] Parallel derivative generation completed in 14m 21s [2025-09-26T22:30:48.839749] [INFO ] [MAIN ] Derivative generation success rate: 100.0% (2074/2074 symbols) [2025-09-26T22:30:49.436465] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Derivative Generation Completed (2074/2074 @ 100.00%)' [2025-09-26T22:30:49.437403] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-09-26T22:30:49.437610] [INFO ] [STATE ] Last completion updated: 2025-09-26T22:30:49.437494